2023-10-03T09:56:16.347 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T09:56:16.347 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567 --name dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi --owner scheduled_dparmar@teuthology --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} --verbose -- /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/orig.config.yaml 2023-10-03T09:56:16.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T09:56:16.485 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567 branch: fix-nfs-apply-err-reporting description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} email: null first_in_suite: false job_id: '7409567' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: fix-nfs-apply-err-reporting ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.dir_split install: ceph: flavor: default sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62953 sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 owner: scheduled_dparmar@teuthology priority: 55 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 seed: 6051 sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-62953 suite_path: /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa suite_relpath: qa suite_repo: https://github.com/dparmar18/ceph suite_sha1: a6297898cc696a7db13e71aaa0b24c78a4c800c5 targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJugLw4EpRV4k3fbFBvUpsZ4LKn1cu6pEnLFOGZ9MVVpKxi0uJPHk8SFSRxDeOw8MAoVN4SmqsVMRyF1ZTmrxZI= smithi027.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvhCvZSoprhj9eQROITp419ViYyTHx4x2KJZ8CTKjfOptIDZgXnGHCXXcbxuUnDp0KLHXs9T201lg3xKSVYc0= tasks: - install: branch: pacific exclude_packages: - cephadm - ceph-mgr-cephadm - ceph-immutable-object-cache - python3-rados - python3-rgw - python3-rbd - python3-cephfs - ceph-volume extra_packages: - python-rados - python-rgw - python-rbd - python-cephfs extra_system_packages: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - print: '**** done installing pacific' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client pacific - print: '**** done ceph' - ceph-fuse: null - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: reef - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph osd dump -f json-pretty - ceph versions - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph osd require-osd-release reef - ceph.healthy: null - print: '**** done ceph.restart' - ceph-fuse: client.0: mounted: false - print: '**** done unmount client.0' - install.upgrade: client.0: null - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: null - print: '**** done remount client.0' - workunit: clients: all: - suites/blogbench.sh teuthology: branch: pacific fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end - if not is_fuse() then reject() end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-03_09:48:43 tube: smithi user: dparmar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-03T09:56:16.486 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa; will attempt to use it 2023-10-03T09:56:16.486 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks 2023-10-03T09:56:16.486 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-03T09:56:16.488 INFO:teuthology.task.internal:Checking packages... 2023-10-03T09:56:16.508 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d6eb91756d99e822eeed7c6b783104a6ad86054' 2023-10-03T09:56:16.508 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T09:56:16.508 INFO:teuthology.packaging:ref: None 2023-10-03T09:56:16.508 INFO:teuthology.packaging:tag: None 2023-10-03T09:56:16.508 INFO:teuthology.packaging:branch: fix-nfs-apply-err-reporting 2023-10-03T09:56:16.508 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T09:56:16.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=fix-nfs-apply-err-reporting 2023-10-03T09:56:16.648 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5795.g3d6eb917 2023-10-03T09:56:16.648 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-03T09:56:16.655 INFO:teuthology.task.internal:no buildpackages task found 2023-10-03T09:56:16.655 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-03T09:56:16.684 INFO:teuthology.task.internal:Saving configuration 2023-10-03T09:56:16.700 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-03T09:56:16.705 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T09:56:16.731 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:45.951916', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJugLw4EpRV4k3fbFBvUpsZ4LKn1cu6pEnLFOGZ9MVVpKxi0uJPHk8SFSRxDeOw8MAoVN4SmqsVMRyF1ZTmrxZI='} 2023-10-03T09:56:16.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:45.953588', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvhCvZSoprhj9eQROITp419ViYyTHx4x2KJZ8CTKjfOptIDZgXnGHCXXcbxuUnDp0KLHXs9T201lg3xKSVYc0='} 2023-10-03T09:56:16.752 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-03T09:56:16.757 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-10-03T09:56:16.758 INFO:teuthology.task.internal:roles: ubuntu@smithi027.front.sepia.ceph.com - ['client.0'] 2023-10-03T09:56:16.758 INFO:teuthology.run_tasks:Running task console_log... 2023-10-03T09:56:16.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f23fd7f7f70>, signals=[15]) 2023-10-03T09:56:16.824 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-03T09:56:16.830 INFO:teuthology.task.internal:Opening connections... 2023-10-03T09:56:16.830 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T09:56:16.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:56:16.900 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi027.front.sepia.ceph.com 2023-10-03T09:56:16.901 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:56:16.971 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-03T09:56:16.977 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-10-03T09:56:16.999 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-10-03T09:56:16.999 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="8" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="8" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-10-03T09:56:17.061 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:56:17.062 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:56:17.062 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:56:17.062 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:56:17.062 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:56:17.062 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-10-03T09:56:17.084 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-10-03T09:56:17.106 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-10-03T09:56:17.106 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-10-03T09:56:17.168 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-03T09:56:17.169 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-10-03T09:56:17.169 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T09:56:17.169 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-03T09:56:17.169 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T09:56:17.169 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-10-03T09:56:17.192 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-03T09:56:17.201 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-03T09:56:17.205 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-03T09:56:17.205 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:56:17.208 DEBUG:teuthology.orchestra.run.smithi027:> test '!' -e /home/ubuntu/cephtest 2023-10-03T09:56:17.228 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-03T09:56:17.233 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-03T09:56:17.233 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:56:17.269 DEBUG:teuthology.orchestra.run.smithi027:> test -z $(ls -A /var/lib/ceph) 2023-10-03T09:56:17.305 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-03T09:56:17.356 INFO:teuthology.run_tasks:Running task kernel... 2023-10-03T09:56:17.428 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-03T09:56:17.428 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-03T09:56:17.429 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:56:17.429 DEBUG:teuthology.orchestra.run.smithi027:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-03T09:56:17.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:56:17.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T09:56:17.451 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-03T09:56:17.451 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-10-03T09:56:17.512 INFO:teuthology.orchestra.run.smithi027.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:17.512 INFO:teuthology.task.kernel:Running kernel on smithi027: 4.18.0-489.el8.x86_64 2023-10-03T09:56:17.512 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum install -y kernel 2023-10-03T09:56:17.513 INFO:teuthology.orchestra.run.smithi019.stdout:4.18.0-489.el8.x86_64 2023-10-03T09:56:17.514 INFO:teuthology.task.kernel:Running kernel on smithi019: 4.18.0-489.el8.x86_64 2023-10-03T09:56:17.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2023-10-03T09:56:22.425 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T09:56:22.462 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - AppStream 13 MB/s | 33 MB 00:02 2023-10-03T09:56:31.087 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T09:56:31.142 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - BaseOS 22 MB/s | 48 MB 00:02 2023-10-03T09:56:38.579 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras 86 kB/s | 18 kB 00:00 2023-10-03T09:56:38.992 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-10-03T09:56:39.146 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2023-10-03T09:56:39.368 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - Extras common packages 39 kB/s | 6.9 kB 00:00 2023-10-03T09:56:39.673 INFO:teuthology.orchestra.run.smithi019.stdout:Copr repo for python3-asyncssh owned by ceph 9.5 kB/s | 3.5 kB 00:00 2023-10-03T09:56:39.828 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-10-03T09:56:41.846 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 16 MB 00:01 2023-10-03T09:56:45.870 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 498 kB/s | 24 kB 00:00 2023-10-03T09:56:49.653 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:49.653 INFO:teuthology.orchestra.run.smithi027.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:49.918 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-10-03T09:56:49.919 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout:================================================================================ 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout:Install 3 Packages 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:56:49.920 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 88 M 2023-10-03T09:56:49.921 INFO:teuthology.orchestra.run.smithi027.stdout:Installed size: 96 M 2023-10-03T09:56:49.921 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-10-03T09:56:51.063 INFO:teuthology.orchestra.run.smithi027.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 9.1 MB/s | 10 MB 00:01 2023-10-03T09:56:51.958 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 16 MB 00:12 2023-10-03T09:56:52.289 INFO:teuthology.orchestra.run.smithi027.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 15 MB/s | 35 MB 00:02 2023-10-03T09:56:52.856 INFO:teuthology.orchestra.run.smithi027.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 15 MB/s | 43 MB 00:02 2023-10-03T09:56:52.856 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:56:52.856 INFO:teuthology.orchestra.run.smithi027.stdout:Total 30 MB/s | 88 MB 00:02 2023-10-03T09:56:53.553 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-10-03T09:56:53.983 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-10-03T09:56:53.983 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-10-03T09:56:55.268 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-10-03T09:56:55.293 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-10-03T09:56:55.997 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 556 kB/s | 24 kB 00:00 2023-10-03T09:56:58.221 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-10-03T09:56:58.788 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:56:59.613 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-03T09:56:59.613 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-03T09:56:59.887 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-10-03T09:56:59.888 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout:Install 3 Packages 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:56:59.889 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 88 M 2023-10-03T09:56:59.890 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 96 M 2023-10-03T09:56:59.890 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-10-03T09:57:01.190 INFO:teuthology.orchestra.run.smithi019.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 9.0 MB/s | 10 MB 00:01 2023-10-03T09:57:02.190 INFO:teuthology.orchestra.run.smithi019.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 17 MB/s | 35 MB 00:02 2023-10-03T09:57:02.565 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:02.757 INFO:teuthology.orchestra.run.smithi019.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 16 MB/s | 43 MB 00:02 2023-10-03T09:57:02.757 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-10-03T09:57:02.758 INFO:teuthology.orchestra.run.smithi019.stdout:Total 31 MB/s | 88 MB 00:02 2023-10-03T09:57:02.921 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:03.459 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-10-03T09:57:03.912 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-10-03T09:57:03.913 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-10-03T09:57:05.195 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-10-03T09:57:05.213 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-10-03T09:57:06.542 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:06.846 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:08.129 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-10-03T09:57:08.687 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:12.423 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:12.820 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:16.445 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:16.753 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:29.800 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:29.825 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:30.181 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:30.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:30.181 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:31.194 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:57:31.194 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-10-03T09:57:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:31.195 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:57:31.195 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-10-03T09:57:31.337 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:31.560 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:31.561 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:31.562 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:31.562 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:31.562 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:31.562 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-03T09:57:31.562 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi027.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:31.562 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:31.780 INFO:teuthology.orchestra.run.smithi027.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:31.780 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:31.780 DEBUG:teuthology.orchestra.run.smithi027:> sudo rpm -qi grub2-tools 2023-10-03T09:57:31.814 INFO:teuthology.orchestra.run.smithi027.stdout:Name : grub2-tools 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Epoch : 1 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Version : 2.02 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Release : 129.el8 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Architecture: x86_64 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Group : System Environment/Base 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Size : 9265586 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:License : GPLv3+ 2023-10-03T09:57:31.815 INFO:teuthology.orchestra.run.smithi027.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Relocations : (not relocatable) 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Vendor : CentOS 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:Description : 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:31.816 INFO:teuthology.orchestra.run.smithi027.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:31.817 INFO:teuthology.orchestra.run.smithi027.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:31.817 INFO:teuthology.orchestra.run.smithi027.stdout:hardware devices. 2023-10-03T09:57:31.817 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T09:57:31.817 INFO:teuthology.orchestra.run.smithi027.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:31.818 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:31.818 INFO:teuthology.task.kernel:Updating grub on smithi027 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:31.818 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:33.142 INFO:teuthology.orchestra.run.smithi027.stderr:Generating grub configuration file ... 2023-10-03T09:57:35.133 INFO:teuthology.orchestra.run.smithi027.stderr:done 2023-10-03T09:57:35.136 DEBUG:teuthology.orchestra.run.smithi027:> mktemp 2023-10-03T09:57:35.157 INFO:teuthology.orchestra.run.smithi027.stdout:/tmp/tmp.GbIIeyp55k 2023-10-03T09:57:35.157 DEBUG:teuthology.orchestra.run.smithi027:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.GbIIeyp55k 2023-10-03T09:57:35.229 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0666 /tmp/tmp.GbIIeyp55k 2023-10-03T09:57:35.365 DEBUG:teuthology.orchestra.remote:smithi027:/tmp/tmp.GbIIeyp55k is 6KB 2023-10-03T09:57:35.412 DEBUG:teuthology.orchestra.run.smithi027:> rm -fr /tmp/tmp.GbIIeyp55k 2023-10-03T09:57:35.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:35.496 INFO:teuthology.orchestra.run.smithi027.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:35.496 INFO:teuthology.orchestra.run.smithi027.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:35.496 INFO:teuthology.orchestra.run.smithi027.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:35.496 INFO:teuthology.orchestra.run.smithi027.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:35.497 DEBUG:teuthology.orchestra.run.smithi027:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:35.652 DEBUG:teuthology.orchestra.run.smithi027:> sudo shutdown -r now 2023-10-03T09:57:39.815 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:39.839 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:40.203 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:40.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-03T09:57:40.203 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:57:40.931 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-10-03T09:57:41.078 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:41.307 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:41.307 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:41.307 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-03T09:57:41.307 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-03T09:57:41.307 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-03T09:57:41.307 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-03T09:57:41.308 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2023-10-03T09:57:41.308 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2023-10-03T09:57:41.525 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-03T09:57:41.526 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-03T09:57:41.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2023-10-03T09:57:41.560 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2023-10-03T09:57:41.560 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2023-10-03T09:57:41.560 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.02 2023-10-03T09:57:41.560 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 129.el8 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Group : System Environment/Base 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 9265586 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-03T09:57:41.561 INFO:teuthology.orchestra.run.smithi019.stdout:Relocations : (not relocatable) 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : CentOS BuildSystem 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2023-10-03T09:57:41.562 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T09:57:41.563 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2023-10-03T09:57:41.563 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-03T09:57:41.564 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 4.18.0-514.el8.x86_64 2023-10-03T09:57:41.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-03T09:57:43.263 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2023-10-03T09:57:45.639 INFO:teuthology.orchestra.run.smithi019.stderr:done 2023-10-03T09:57:45.641 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-10-03T09:57:45.667 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.hpmlszq2fG 2023-10-03T09:57:45.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hpmlszq2fG 2023-10-03T09:57:45.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.hpmlszq2fG 2023-10-03T09:57:45.906 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.hpmlszq2fG is 6KB 2023-10-03T09:57:45.954 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.hpmlszq2fG 2023-10-03T09:57:45.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2023-10-03T09:57:46.040 INFO:teuthology.orchestra.run.smithi019.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-03T09:57:46.040 INFO:teuthology.orchestra.run.smithi019.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-03T09:57:46.040 INFO:teuthology.orchestra.run.smithi019.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-03T09:57:46.041 INFO:teuthology.orchestra.run.smithi019.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-03T09:57:46.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-03T09:57:46.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2023-10-03T09:58:05.655 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-03T09:58:05.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T09:58:05.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:16.217 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-03T09:58:16.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T09:58:16.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:24.122 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-03T09:58:33.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T09:58:33.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:34.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-10-03T09:58:36.186 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-03T09:58:43.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T09:58:43.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:48.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T09:58:48.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:58:51.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-03T09:59:06.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T09:59:06.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:09.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-03T09:59:27.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T09:59:27.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:43.647 DEBUG:teuthology.orchestra.remote:timed out 2023-10-03T09:59:45.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.27 2023-10-03T09:59:55.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T09:59:55.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T09:59:55.909 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-10-03T09:59:56.247 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T09:59:56.247 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-03T09:59:56.247 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2023-10-03T09:59:56.269 INFO:teuthology.orchestra.run.smithi019.stdout:4.18.0-514.el8.x86_64 2023-10-03T09:59:56.269 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T09:59:56.270 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T09:59:56.270 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T09:59:57.271 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-03T09:59:57.271 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T09:59:57.358 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2023-10-03T09:59:57.378 DEBUG:teuthology.parallel:result is None 2023-10-03T10:00:06.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T10:00:06.792 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:00:07.076 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-03T10:00:07.348 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T10:00:07.348 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-514.el8.x86_64"... 2023-10-03T10:00:07.348 DEBUG:teuthology.orchestra.run.smithi027:> uname -r 2023-10-03T10:00:07.368 INFO:teuthology.orchestra.run.smithi027.stdout:4.18.0-514.el8.x86_64 2023-10-03T10:00:07.368 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-03T10:00:07.368 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-03T10:00:07.368 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-03T10:00:08.370 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-10-03T10:00:08.370 DEBUG:teuthology.orchestra.run.smithi027:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-03T10:00:08.455 INFO:teuthology.orchestra.run.smithi027.stdout:ttyS1 2023-10-03T10:00:08.471 DEBUG:teuthology.parallel:result is None 2023-10-03T10:00:08.471 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-03T10:00:08.481 INFO:teuthology.task.internal:Creating test directory... 2023-10-03T10:00:08.481 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T10:00:08.484 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-03T10:00:08.506 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-03T10:00:08.512 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-03T10:00:08.633 INFO:teuthology.task.internal:Creating archive directory... 2023-10-03T10:00:08.634 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T10:00:08.637 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-03T10:00:08.678 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-03T10:00:08.684 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-03T10:00:08.684 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T10:00:08.710 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-03T10:00:08.754 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T10:00:08.767 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T10:00:08.856 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T10:00:08.869 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-03T10:00:08.871 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-03T10:00:08.878 INFO:teuthology.task.internal:Configuring sudo... 2023-10-03T10:00:08.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T10:00:08.881 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-03T10:00:08.915 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-03T10:00:08.924 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-03T10:00:08.924 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:00:08.959 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:00:08.980 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T10:00:09.072 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T10:00:09.125 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T10:00:09.217 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T10:00:09.266 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:00:09.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T10:00:09.341 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T10:00:09.392 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-03T10:00:09.448 DEBUG:teuthology.orchestra.run.smithi027:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T10:00:09.536 DEBUG:teuthology.orchestra.run.smithi027:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-03T10:00:09.583 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:00:09.583 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-03T10:00:09.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2023-10-03T10:00:09.658 DEBUG:teuthology.orchestra.run.smithi027:> sudo service rsyslog restart 2023-10-03T10:00:09.743 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:00:09.752 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:00:10.225 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-03T10:00:10.233 INFO:teuthology.task.internal:Starting timer... 2023-10-03T10:00:10.233 INFO:teuthology.run_tasks:Running task pcp... 2023-10-03T10:00:10.283 INFO:teuthology.run_tasks:Running task selinux... 2023-10-03T10:00:10.291 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-03T10:00:10.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2023-10-03T10:00:10.374 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2023-10-03T10:00:10.376 DEBUG:teuthology.orchestra.run.smithi027:> sudo service auditd rotate 2023-10-03T10:00:10.473 INFO:teuthology.orchestra.run.smithi027.stdout:Rotating logs: 2023-10-03T10:00:10.474 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-03T10:00:10.475 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2023-10-03T10:00:10.500 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2023-10-03T10:00:10.500 DEBUG:teuthology.orchestra.run.smithi027:> /usr/sbin/getenforce 2023-10-03T10:00:10.526 INFO:teuthology.orchestra.run.smithi027.stdout:Permissive 2023-10-03T10:00:10.527 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi027.front.sepia.ceph.com': 'permissive'} 2023-10-03T10:00:10.527 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:00:10.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:00:10.576 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:00:10.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:00:10.607 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-03T10:00:10.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2023-10-03T10:00:10.651 DEBUG:teuthology.orchestra.run.smithi027:> sudo /usr/sbin/setenforce permissive 2023-10-03T10:00:10.680 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-03T10:00:10.689 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-03T10:00:10.689 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-03T10:00:10.707 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-03T10:00:10.708 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi027.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-03T10:08:16.391 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi027.front.sepia.ceph.com')] 2023-10-03T10:08:16.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T10:08:16.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:08:16.465 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-10-03T10:08:16.499 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-10-03T10:08:16.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T10:08:16.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T10:08:16.570 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-10-03T10:08:16.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-10-03T10:08:16.641 INFO:teuthology.run_tasks:Running task clock... 2023-10-03T10:08:16.651 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-03T10:08:16.651 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:08:16.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:08:16.654 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-03T10:08:16.655 DEBUG:teuthology.orchestra.run.smithi027:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:08:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:08:16.710 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:08:16.715 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-03T10:08:16.730 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-03T10:08:16.784 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2023-10-03T10:08:16.798 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2023-10-03T10:08:16.810 INFO:teuthology.orchestra.run.smithi027.stderr:sudo: ntpd: command not found 2023-10-03T10:08:16.815 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:08:16.821 INFO:teuthology.orchestra.run.smithi027.stdout:506 Cannot talk to daemon 2023-10-03T10:08:16.831 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:08:16.836 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-03T10:08:16.850 INFO:teuthology.orchestra.run.smithi027.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-03T10:08:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:bash: ntpq: command not found 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.904 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.933 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.937 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:08:16.938 INFO:teuthology.run_tasks:Running task install... 2023-10-03T10:08:16.946 DEBUG:teuthology.task.install:project ceph 2023-10-03T10:08:16.946 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}} 2023-10-03T10:08:16.946 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:08:16.946 INFO:teuthology.task.install:Using flavor: default 2023-10-03T10:08:16.951 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:08:16.951 INFO:teuthology.task.install:extra packages: ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'] 2023-10-03T10:08:16.952 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:08:16.952 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:16.952 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:16.952 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:16.952 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:16.952 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:16.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:08:16.954 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'tag': None, 'wait_for_package': False} 2023-10-03T10:08:16.954 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:16.954 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:16.954 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:16.954 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:16.954 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:16.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:08:17.203 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:08:17.203 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:08:17.270 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/ 2023-10-03T10:08:17.271 INFO:teuthology.task.install.rpm:Package version is 16.2.14-44.geeb13ac9 2023-10-03T10:08:17.310 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:08:17.311 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:08:17.311 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:08:17.347 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:08:17.347 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:17.347 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:17.347 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:17.347 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:17.347 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:17.348 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:08:17.374 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/eeb13ac974775bd0cce96a2c687e8bcc2faca43d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:08:17.375 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:08:17.375 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:08:17.405 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, rbd-fuse, rbd-mirror, rbd-nbd, python-rados, python-rgw, python-rbd, python-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux on remote rpm x86_64 2023-10-03T10:08:17.406 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:08:17.406 INFO:teuthology.packaging:ref: None 2023-10-03T10:08:17.406 INFO:teuthology.packaging:tag: None 2023-10-03T10:08:17.406 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:08:17.406 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:08:17.406 DEBUG:teuthology.orchestra.run.smithi027:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:08:17.423 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:08:17.476 DEBUG:teuthology.orchestra.run.smithi027:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:08:17.511 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:08:17.543 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2023-10-03T10:08:17.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2023-10-03T10:08:17.555 DEBUG:teuthology.orchestra.run.smithi027:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:08:17.624 INFO:teuthology.orchestra.run.smithi027.stdout:check_obsoletes = 1 2023-10-03T10:08:17.625 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum clean all 2023-10-03T10:08:17.882 INFO:teuthology.orchestra.run.smithi019.stdout:76 files removed 2023-10-03T10:08:17.900 INFO:teuthology.orchestra.run.smithi027.stdout:76 files removed 2023-10-03T10:08:17.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:08:17.928 DEBUG:teuthology.orchestra.run.smithi027:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 rbd-fuse rbd-mirror rbd-nbd python-rados python-rgw python-rbd python-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux 2023-10-03T10:08:18.677 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 262 kB/s | 76 kB 00:00 2023-10-03T10:08:18.706 INFO:teuthology.orchestra.run.smithi027.stdout:ceph packages for x86_64 220 kB/s | 76 kB 00:00 2023-10-03T10:08:19.003 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 54 kB/s | 15 kB 00:00 2023-10-03T10:08:19.040 INFO:teuthology.orchestra.run.smithi027.stdout:ceph noarch packages 52 kB/s | 15 kB 00:00 2023-10-03T10:08:19.295 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2023-10-03T10:08:19.366 INFO:teuthology.orchestra.run.smithi027.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-03T10:08:21.724 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T10:08:21.770 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - AppStream 14 MB/s | 33 MB 00:02 2023-10-03T10:08:30.342 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - BaseOS 23 MB/s | 48 MB 00:02 2023-10-03T10:08:30.888 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - BaseOS 20 MB/s | 48 MB 00:02 2023-10-03T10:08:37.959 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - Extras 104 kB/s | 18 kB 00:00 2023-10-03T10:08:38.301 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - Extras common packages 44 kB/s | 6.9 kB 00:00 2023-10-03T10:08:38.919 INFO:teuthology.orchestra.run.smithi027.stdout:CentOS Stream 8 - PowerTools 14 MB/s | 6.5 MB 00:00 2023-10-03T10:08:38.963 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras 53 kB/s | 18 kB 00:00 2023-10-03T10:08:39.305 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras common packages 49 kB/s | 6.9 kB 00:00 2023-10-03T10:08:40.073 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - PowerTools 11 MB/s | 6.5 MB 00:00 2023-10-03T10:08:40.429 INFO:teuthology.orchestra.run.smithi027.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-10-03T10:08:41.658 INFO:teuthology.orchestra.run.smithi019.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-10-03T10:08:41.930 INFO:teuthology.orchestra.run.smithi027.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-10-03T10:08:45.553 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 4.3 MB/s | 16 MB 00:03 2023-10-03T10:08:46.022 INFO:teuthology.orchestra.run.smithi027.stdout:lab-extras 429 kB/s | 24 kB 00:00 2023-10-03T10:08:49.817 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 339 kB/s | 24 kB 00:00 2023-10-03T10:08:50.506 INFO:teuthology.orchestra.run.smithi027.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:08:50.507 INFO:teuthology.orchestra.run.smithi027.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:08:50.533 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:08:50.533 INFO:teuthology.orchestra.run.smithi027.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:08:50.534 INFO:teuthology.orchestra.run.smithi027.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:08:50.536 INFO:teuthology.orchestra.run.smithi027.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:08:50.758 INFO:teuthology.orchestra.run.smithi027.stdout:Dependencies resolved. 2023-10-03T10:08:50.770 INFO:teuthology.orchestra.run.smithi027.stdout:==================================================================================================== 2023-10-03T10:08:50.770 INFO:teuthology.orchestra.run.smithi027.stdout: Package Arch Version Repository Size 2023-10-03T10:08:50.770 INFO:teuthology.orchestra.run.smithi027.stdout:==================================================================================================== 2023-10-03T10:08:50.770 INFO:teuthology.orchestra.run.smithi027.stdout:Installing: 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:08:50.771 INFO:teuthology.orchestra.run.smithi027.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrading: 2023-10-03T10:08:50.772 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:08:50.773 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout:Installing dependencies: 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:08:50.774 INFO:teuthology.orchestra.run.smithi027.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:08:50.775 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:08:50.776 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:08:50.777 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:08:50.778 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:08:50.779 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction Summary 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout:==================================================================================================== 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout:Install 108 Packages 2023-10-03T10:08:50.780 INFO:teuthology.orchestra.run.smithi027.stdout:Upgrade 14 Packages 2023-10-03T10:08:50.781 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:08:50.781 INFO:teuthology.orchestra.run.smithi027.stdout:Total download size: 200 M 2023-10-03T10:08:50.781 INFO:teuthology.orchestra.run.smithi027.stdout:Downloading Packages: 2023-10-03T10:08:51.098 INFO:teuthology.orchestra.run.smithi027.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 34 kB/s | 6.4 kB 00:00 2023-10-03T10:08:51.449 INFO:teuthology.orchestra.run.smithi027.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 2.5 MB/s | 910 kB 00:00 2023-10-03T10:08:51.632 INFO:teuthology.orchestra.run.smithi027.stdout:(3/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 8.4 MB/s | 6.1 MB 00:00 2023-10-03T10:08:51.782 INFO:teuthology.orchestra.run.smithi027.stdout:(4/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 11 MB/s | 1.6 MB 00:00 2023-10-03T10:08:51.907 INFO:teuthology.orchestra.run.smithi027.stdout:(5/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 5.3 MB/s | 2.4 MB 00:00 2023-10-03T10:08:52.224 INFO:teuthology.orchestra.run.smithi027.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 11 MB/s | 5.0 MB 00:00 2023-10-03T10:08:53.159 INFO:teuthology.orchestra.run.smithi027.stdout:(7/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 12 MB/s | 12 MB 00:00 2023-10-03T10:08:53.225 INFO:teuthology.orchestra.run.smithi027.stdout:(8/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 386 kB/s | 26 kB 00:00 2023-10-03T10:08:54.425 INFO:teuthology.orchestra.run.smithi027.stdout:(9/122): ceph-common-16.2.14-44.geeb13ac9.el8.x 6.9 MB/s | 24 MB 00:03 2023-10-03T10:08:54.492 INFO:teuthology.orchestra.run.smithi027.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 384 kB/s | 25 kB 00:00 2023-10-03T10:08:54.493 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:08:54.493 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-03T10:08:54.521 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-03T10:08:54.521 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-03T10:08:54.522 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-03T10:08:54.523 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-03T10:08:54.757 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-10-03T10:08:54.768 INFO:teuthology.orchestra.run.smithi027.stdout:(11/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86 6.4 MB/s | 18 MB 00:02 2023-10-03T10:08:54.770 INFO:teuthology.orchestra.run.smithi019.stdout:==================================================================================================== 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout:==================================================================================================== 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.4 k 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 6.1 M 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 910 k 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 1.6 M 2023-10-03T10:08:54.771 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 3.1 M 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 8.6 M 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 27 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 12 M 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 52 M 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 25 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 824 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 131 k 2023-10-03T10:08:54.772 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 215 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 390 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 369 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 114 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 88 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 173 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-03T10:08:54.773 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.7 M 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 4.2 M 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-03T10:08:54.774 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 24 M 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 24 k 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 2.4 M 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 244 k 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 5.0 M 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 18 M 2023-10-03T10:08:54.775 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:16.2.14-44.geeb13ac9.el8 ceph-noarch 15 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 26 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 174 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-03T10:08:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 493 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 3.8 M 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-03T10:08:54.777 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-03T10:08:54.778 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 45 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:16.2.14-44.geeb13ac9.el8 ceph 99 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-03T10:08:54.779 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-03T10:08:54.780 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-03T10:08:54.781 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-03T10:08:54.782 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout:==================================================================================================== 2023-10-03T10:08:54.783 INFO:teuthology.orchestra.run.smithi019.stdout:Install 108 Packages 2023-10-03T10:08:54.784 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 14 Packages 2023-10-03T10:08:54.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:08:54.784 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 200 M 2023-10-03T10:08:54.784 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-10-03T10:08:54.809 INFO:teuthology.orchestra.run.smithi027.stdout:(12/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 2.5 MB/s | 824 kB 00:00 2023-10-03T10:08:54.835 INFO:teuthology.orchestra.run.smithi027.stdout:(13/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.5 MB/s | 174 kB 00:00 2023-10-03T10:08:54.876 INFO:teuthology.orchestra.run.smithi027.stdout:(14/122): librados-devel-16.2.14-44.geeb13ac9.e 1.9 MB/s | 131 kB 00:00 2023-10-03T10:08:54.910 INFO:teuthology.orchestra.run.smithi027.stdout:(15/122): libradosstriper1-16.2.14-44.geeb13ac9 6.4 MB/s | 493 kB 00:00 2023-10-03T10:08:55.002 INFO:teuthology.orchestra.run.smithi027.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 491 kB/s | 45 kB 00:00 2023-10-03T10:08:55.094 INFO:teuthology.orchestra.run.smithi027.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.1 MB/s | 99 kB 00:00 2023-10-03T10:08:55.203 INFO:teuthology.orchestra.run.smithi027.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 1.9 MB/s | 215 kB 00:00 2023-10-03T10:08:55.268 INFO:teuthology.orchestra.run.smithi019.stdout:(1/122): ceph-16.2.14-44.geeb13ac9.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2023-10-03T10:08:55.320 INFO:teuthology.orchestra.run.smithi027.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 3.3 MB/s | 390 kB 00:00 2023-10-03T10:08:55.387 INFO:teuthology.orchestra.run.smithi027.stdout:(20/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 7.4 MB/s | 3.8 MB 00:00 2023-10-03T10:08:55.412 INFO:teuthology.orchestra.run.smithi027.stdout:(21/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 3.9 MB/s | 369 kB 00:00 2023-10-03T10:08:55.471 INFO:teuthology.orchestra.run.smithi027.stdout:(22/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.3 MB/s | 114 kB 00:00 2023-10-03T10:08:55.505 INFO:teuthology.orchestra.run.smithi027.stdout:(23/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 958 kB/s | 88 kB 00:00 2023-10-03T10:08:55.785 INFO:teuthology.orchestra.run.smithi019.stdout:(2/122): ceph-fuse-16.2.14-44.geeb13ac9.el8.x86 1.7 MB/s | 910 kB 00:00 2023-10-03T10:08:55.788 INFO:teuthology.orchestra.run.smithi027.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 612 kB/s | 173 kB 00:00 2023-10-03T10:08:55.888 INFO:teuthology.orchestra.run.smithi027.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 243 kB/s | 24 kB 00:00 2023-10-03T10:08:55.972 INFO:teuthology.orchestra.run.smithi027.stdout:(26/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 7.3 MB/s | 3.7 MB 00:00 2023-10-03T10:08:56.686 INFO:teuthology.orchestra.run.smithi019.stdout:(3/122): ceph-mds-16.2.14-44.geeb13ac9.el8.x86_ 2.7 MB/s | 2.4 MB 00:00 2023-10-03T10:08:56.921 INFO:teuthology.orchestra.run.smithi019.stdout:(4/122): ceph-base-16.2.14-44.geeb13ac9.el8.x86 3.2 MB/s | 6.1 MB 00:01 2023-10-03T10:08:56.978 INFO:teuthology.orchestra.run.smithi019.stdout:(5/122): ceph-mgr-16.2.14-44.geeb13ac9.el8.x86_ 5.5 MB/s | 1.6 MB 00:00 2023-10-03T10:08:57.106 INFO:teuthology.orchestra.run.smithi027.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 13 MB/s | 52 MB 00:03 2023-10-03T10:08:57.248 INFO:teuthology.orchestra.run.smithi027.stdout:(28/122): ceph-mgr-diskprediction-local-16.2.14 6.7 MB/s | 8.6 MB 00:01 2023-10-03T10:08:57.273 INFO:teuthology.orchestra.run.smithi027.stdout:(29/122): ceph-mgr-modules-core-16.2.14-44.geeb 1.4 MB/s | 244 kB 00:00 2023-10-03T10:08:57.323 INFO:teuthology.orchestra.run.smithi027.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 365 kB/s | 27 kB 00:00 2023-10-03T10:08:57.341 INFO:teuthology.orchestra.run.smithi027.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 222 kB/s | 15 kB 00:00 2023-10-03T10:08:57.470 INFO:teuthology.orchestra.run.smithi019.stdout:(6/122): ceph-mon-16.2.14-44.geeb13ac9.el8.x86_ 9.1 MB/s | 5.0 MB 00:00 2023-10-03T10:08:57.516 INFO:teuthology.orchestra.run.smithi027.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-10-03T10:08:57.541 INFO:teuthology.orchestra.run.smithi027.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 3.1 MB/s | 688 kB 00:00 2023-10-03T10:08:57.566 INFO:teuthology.orchestra.run.smithi027.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-10-03T10:08:57.608 INFO:teuthology.orchestra.run.smithi027.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-10-03T10:08:57.642 INFO:teuthology.orchestra.run.smithi027.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.4 MB/s | 259 kB 00:00 2023-10-03T10:08:57.667 INFO:teuthology.orchestra.run.smithi027.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-10-03T10:08:57.792 INFO:teuthology.orchestra.run.smithi027.stdout:(38/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 1.6 MB/s | 3.1 MB 00:01 2023-10-03T10:08:57.926 INFO:teuthology.orchestra.run.smithi027.stdout:(39/122): openblas-0.3.15-4.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-10-03T10:08:58.018 INFO:teuthology.orchestra.run.smithi027.stdout:(40/122): python3-jsonpatch-1.21-2.el8.noarch.r 118 kB/s | 27 kB 00:00 2023-10-03T10:08:58.168 INFO:teuthology.orchestra.run.smithi027.stdout:(41/122): python3-jsonpointer-1.10-11.el8.noarc 82 kB/s | 20 kB 00:00 2023-10-03T10:08:58.194 INFO:teuthology.orchestra.run.smithi027.stdout:(42/122): python3-mako-1.0.6-14.el8.noarch.rpm 894 kB/s | 157 kB 00:00 2023-10-03T10:08:58.227 INFO:teuthology.orchestra.run.smithi027.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 660 kB/s | 39 kB 00:00 2023-10-03T10:08:58.294 INFO:teuthology.orchestra.run.smithi027.stdout:(44/122): openblas-threads-0.3.15-4.el8.x86_64. 7.7 MB/s | 4.9 MB 00:00 2023-10-03T10:08:58.320 INFO:teuthology.orchestra.run.smithi027.stdout:(45/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-10-03T10:08:58.353 INFO:teuthology.orchestra.run.smithi027.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 751 kB/s | 44 kB 00:00 2023-10-03T10:08:58.379 INFO:teuthology.orchestra.run.smithi027.stdout:(47/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-10-03T10:08:58.412 INFO:teuthology.orchestra.run.smithi027.stdout:(48/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-10-03T10:08:58.438 INFO:teuthology.orchestra.run.smithi027.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-03T10:08:58.486 INFO:teuthology.orchestra.run.smithi027.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 771 kB/s | 57 kB 00:00 2023-10-03T10:08:58.553 INFO:teuthology.orchestra.run.smithi019.stdout:(7/122): ceph-osd-16.2.14-44.geeb13ac9.el8.x86_ 12 MB/s | 18 MB 00:01 2023-10-03T10:08:58.571 INFO:teuthology.orchestra.run.smithi027.stdout:(51/122): python3-numpy-1.14.3-10.el8.x86_64.rp 9.9 MB/s | 3.7 MB 00:00 2023-10-03T10:08:58.605 INFO:teuthology.orchestra.run.smithi027.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-10-03T10:08:58.639 INFO:teuthology.orchestra.run.smithi027.stdout:(53/122): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-10-03T10:08:58.664 INFO:teuthology.orchestra.run.smithi027.stdout:(54/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2023-10-03T10:08:58.687 INFO:teuthology.orchestra.run.smithi019.stdout:(8/122): ceph-radosgw-16.2.14-44.geeb13ac9.el8. 9.5 MB/s | 12 MB 00:01 2023-10-03T10:08:58.712 INFO:teuthology.orchestra.run.smithi019.stdout:(9/122): ceph-selinux-16.2.14-44.geeb13ac9.el8. 162 kB/s | 26 kB 00:00 2023-10-03T10:08:58.770 INFO:teuthology.orchestra.run.smithi019.stdout:(10/122): libcephfs-devel-16.2.14-44.geeb13ac9. 439 kB/s | 25 kB 00:00 2023-10-03T10:08:58.898 INFO:teuthology.orchestra.run.smithi027.stdout:(55/122): python3-scipy-1.0.0-21.module_el8.5.0 30 MB/s | 14 MB 00:00 2023-10-03T10:08:58.904 INFO:teuthology.orchestra.run.smithi019.stdout:(11/122): libcephfs2-16.2.14-44.geeb13ac9.el8.x 6.0 MB/s | 824 kB 00:00 2023-10-03T10:08:58.988 INFO:teuthology.orchestra.run.smithi019.stdout:(12/122): libcephsqlite-16.2.14-44.geeb13ac9.el 2.0 MB/s | 174 kB 00:00 2023-10-03T10:08:59.023 INFO:teuthology.orchestra.run.smithi027.stdout:(56/122): elfutils-libelf-devel-0.189-3.el8.x86 161 kB/s | 62 kB 00:00 2023-10-03T10:08:59.063 INFO:teuthology.orchestra.run.smithi019.stdout:(13/122): librados-devel-16.2.14-44.geeb13ac9.e 1.7 MB/s | 131 kB 00:00 2023-10-03T10:08:59.065 INFO:teuthology.orchestra.run.smithi027.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 207 kB/s | 83 kB 00:00 2023-10-03T10:08:59.164 INFO:teuthology.orchestra.run.smithi019.stdout:(14/122): libradosstriper1-16.2.14-44.geeb13ac9 4.8 MB/s | 493 kB 00:00 2023-10-03T10:08:59.199 INFO:teuthology.orchestra.run.smithi027.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 291 kB/s | 39 kB 00:00 2023-10-03T10:08:59.240 INFO:teuthology.orchestra.run.smithi027.stdout:(59/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 141 kB/s | 48 kB 00:00 2023-10-03T10:08:59.407 INFO:teuthology.orchestra.run.smithi027.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.4 MB/s | 561 kB 00:00 2023-10-03T10:08:59.499 INFO:teuthology.orchestra.run.smithi027.stdout:(61/122): libquadmath-8.5.0-20.el8.x86_64.rpm 667 kB/s | 172 kB 00:00 2023-10-03T10:08:59.516 INFO:teuthology.orchestra.run.smithi027.stdout:(62/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 432 kB/s | 47 kB 00:00 2023-10-03T10:08:59.566 INFO:teuthology.orchestra.run.smithi027.stdout:(63/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2023-10-03T10:08:59.614 INFO:teuthology.orchestra.run.smithi019.stdout:(15/122): librgw2-16.2.14-44.geeb13ac9.el8.x86_ 8.4 MB/s | 3.8 MB 00:00 2023-10-03T10:08:59.625 INFO:teuthology.orchestra.run.smithi027.stdout:(64/122): libsepol-devel-2.9-3.el8.x86_64.rpm 803 kB/s | 87 kB 00:00 2023-10-03T10:08:59.658 INFO:teuthology.orchestra.run.smithi027.stdout:(65/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-10-03T10:08:59.672 INFO:teuthology.orchestra.run.smithi019.stdout:(16/122): python3-ceph-argparse-16.2.14-44.geeb 776 kB/s | 45 kB 00:00 2023-10-03T10:08:59.675 INFO:teuthology.orchestra.run.smithi027.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 166 kB/s | 18 kB 00:00 2023-10-03T10:08:59.717 INFO:teuthology.orchestra.run.smithi027.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 475 kB/s | 44 kB 00:00 2023-10-03T10:08:59.731 INFO:teuthology.orchestra.run.smithi019.stdout:(17/122): python3-ceph-common-16.2.14-44.geeb13 1.7 MB/s | 99 kB 00:00 2023-10-03T10:08:59.823 INFO:teuthology.orchestra.run.smithi019.stdout:(18/122): python3-cephfs-16.2.14-44.geeb13ac9.e 2.3 MB/s | 215 kB 00:00 2023-10-03T10:08:59.834 INFO:teuthology.orchestra.run.smithi027.stdout:(68/122): pcre2-devel-10.32-3.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-10-03T10:08:59.859 INFO:teuthology.orchestra.run.smithi027.stdout:(69/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-10-03T10:08:59.907 INFO:teuthology.orchestra.run.smithi019.stdout:(19/122): python3-rados-16.2.14-44.geeb13ac9.el 4.6 MB/s | 390 kB 00:00 2023-10-03T10:08:59.951 INFO:teuthology.orchestra.run.smithi027.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-10-03T10:08:59.982 INFO:teuthology.orchestra.run.smithi019.stdout:(20/122): python3-rbd-16.2.14-44.geeb13ac9.el8. 4.8 MB/s | 369 kB 00:00 2023-10-03T10:08:59.994 INFO:teuthology.orchestra.run.smithi027.stdout:(71/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.8 MB/s | 249 kB 00:00 2023-10-03T10:09:00.049 INFO:teuthology.orchestra.run.smithi019.stdout:(21/122): python3-rgw-16.2.14-44.geeb13ac9.el8. 1.7 MB/s | 114 kB 00:00 2023-10-03T10:09:00.116 INFO:teuthology.orchestra.run.smithi019.stdout:(22/122): rbd-fuse-16.2.14-44.geeb13ac9.el8.x86 1.3 MB/s | 88 kB 00:00 2023-10-03T10:09:00.127 INFO:teuthology.orchestra.run.smithi027.stdout:(72/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 6.8 MB/s | 3.2 MB 00:00 2023-10-03T10:09:00.152 INFO:teuthology.orchestra.run.smithi027.stdout:(73/122): python3-jwt-1.6.1-2.el8.noarch.rpm 269 kB/s | 43 kB 00:00 2023-10-03T10:09:00.178 INFO:teuthology.orchestra.run.smithi027.stdout:(74/122): python3-cryptography-3.2.1-6.el8.x86_ 2.8 MB/s | 641 kB 00:00 2023-10-03T10:09:00.228 INFO:teuthology.orchestra.run.smithi027.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2023-10-03T10:09:00.262 INFO:teuthology.orchestra.run.smithi027.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:09:00.287 INFO:teuthology.orchestra.run.smithi027.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 391 kB/s | 43 kB 00:00 2023-10-03T10:09:00.329 INFO:teuthology.orchestra.run.smithi027.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 577 kB/s | 58 kB 00:00 2023-10-03T10:09:00.546 INFO:teuthology.orchestra.run.smithi027.stdout:(79/122): leveldb-1.22-1.el8.x86_64.rpm 700 kB/s | 181 kB 00:00 2023-10-03T10:09:00.566 INFO:teuthology.orchestra.run.smithi019.stdout:(23/122): rbd-mirror-16.2.14-44.geeb13ac9.el8.x 8.2 MB/s | 3.7 MB 00:00 2023-10-03T10:09:00.571 INFO:teuthology.orchestra.run.smithi027.stdout:(80/122): liboath-2.6.2-3.el8.x86_64.rpm 243 kB/s | 59 kB 00:00 2023-10-03T10:09:00.596 INFO:teuthology.orchestra.run.smithi027.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 916 kB/s | 306 kB 00:00 2023-10-03T10:09:00.621 INFO:teuthology.orchestra.run.smithi027.stdout:(82/122): libunwind-1.3.1-3.el8.x86_64.rpm 995 kB/s | 75 kB 00:00 2023-10-03T10:09:00.642 INFO:teuthology.orchestra.run.smithi019.stdout:(24/122): rbd-nbd-16.2.14-44.geeb13ac9.el8.x86_ 2.3 MB/s | 173 kB 00:00 2023-10-03T10:09:00.647 INFO:teuthology.orchestra.run.smithi027.stdout:(83/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 578 kB/s | 44 kB 00:00 2023-10-03T10:09:00.672 INFO:teuthology.orchestra.run.smithi027.stdout:(84/122): python3-cachetools-3.1.1-4.el8.noarch 661 kB/s | 33 kB 00:00 2023-10-03T10:09:00.697 INFO:teuthology.orchestra.run.smithi027.stdout:(85/122): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-10-03T10:09:00.709 INFO:teuthology.orchestra.run.smithi019.stdout:(25/122): ceph-grafana-dashboards-16.2.14-44.ge 366 kB/s | 24 kB 00:00 2023-10-03T10:09:00.722 INFO:teuthology.orchestra.run.smithi027.stdout:(86/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2023-10-03T10:09:00.748 INFO:teuthology.orchestra.run.smithi027.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-03T10:09:00.773 INFO:teuthology.orchestra.run.smithi027.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-10-03T10:09:00.790 INFO:teuthology.orchestra.run.smithi027.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2023-10-03T10:09:00.824 INFO:teuthology.orchestra.run.smithi027.stdout:(90/122): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2023-10-03T10:09:00.849 INFO:teuthology.orchestra.run.smithi027.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-10-03T10:09:00.874 INFO:teuthology.orchestra.run.smithi027.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 971 kB/s | 49 kB 00:00 2023-10-03T10:09:00.899 INFO:teuthology.orchestra.run.smithi027.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-03T10:09:00.925 INFO:teuthology.orchestra.run.smithi027.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-10-03T10:09:00.950 INFO:teuthology.orchestra.run.smithi027.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-10-03T10:09:00.975 INFO:teuthology.orchestra.run.smithi027.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 673 kB/s | 34 kB 00:00 2023-10-03T10:09:01.001 INFO:teuthology.orchestra.run.smithi027.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-10-03T10:09:01.051 INFO:teuthology.orchestra.run.smithi027.stdout:(98/122): python3-rsa-4.9-2.el8.noarch.rpm 856 kB/s | 64 kB 00:00 2023-10-03T10:09:01.076 INFO:teuthology.orchestra.run.smithi027.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 249 kB/s | 19 kB 00:00 2023-10-03T10:09:01.092 INFO:teuthology.orchestra.run.smithi019.stdout:(26/122): ceph-mgr-dashboard-16.2.14-44.geeb13a 8.2 MB/s | 3.1 MB 00:00 2023-10-03T10:09:01.101 INFO:teuthology.orchestra.run.smithi027.stdout:(100/122): python3-singledispatch-3.4.0.3-18.el 476 kB/s | 24 kB 00:00 2023-10-03T10:09:01.127 INFO:teuthology.orchestra.run.smithi027.stdout:(101/122): python3-tempora-1.14.1-5.el8.noarch. 583 kB/s | 29 kB 00:00 2023-10-03T10:09:01.152 INFO:teuthology.orchestra.run.smithi027.stdout:(102/122): python3-trustme-0.6.0-4.el8.noarch.r 547 kB/s | 27 kB 00:00 2023-10-03T10:09:01.177 INFO:teuthology.orchestra.run.smithi027.stdout:(103/122): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2023-10-03T10:09:01.211 INFO:teuthology.orchestra.run.smithi027.stdout:(104/122): python3-kubernetes-11.0.0-6.el8.noar 2.8 MB/s | 1.2 MB 00:00 2023-10-03T10:09:01.236 INFO:teuthology.orchestra.run.smithi027.stdout:(105/122): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2023-10-03T10:09:01.261 INFO:teuthology.orchestra.run.smithi027.stdout:(106/122): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2023-10-03T10:09:01.287 INFO:teuthology.orchestra.run.smithi027.stdout:(107/122): python3-zc-lockfile-2.0-2.el8.noarch 457 kB/s | 23 kB 00:00 2023-10-03T10:09:01.312 INFO:teuthology.orchestra.run.smithi027.stdout:(108/122): python3-webob-1.8.5-1.el8.1.noarch.r 1.5 MB/s | 251 kB 00:00 2023-10-03T10:09:01.429 INFO:teuthology.orchestra.run.smithi027.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-10-03T10:09:01.538 INFO:teuthology.orchestra.run.smithi027.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 703 kB/s | 76 kB 00:00 2023-10-03T10:09:01.683 INFO:teuthology.orchestra.run.smithi027.stdout:(111/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-10-03T10:09:01.755 INFO:teuthology.orchestra.run.smithi027.stdout:(112/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 8.9 MB/s | 4.2 MB 00:00 2023-10-03T10:09:01.814 INFO:teuthology.orchestra.run.smithi027.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.3 MB/s | 303 kB 00:00 2023-10-03T10:09:01.930 INFO:teuthology.orchestra.run.smithi027.stdout:(114/122): iproute-6.2.0-5.el8.x86_64.rpm 4.8 MB/s | 854 kB 00:00 2023-10-03T10:09:01.956 INFO:teuthology.orchestra.run.smithi027.stdout:(115/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-03T10:09:02.043 INFO:teuthology.orchestra.run.smithi019.stdout:(27/122): ceph-test-16.2.14-44.geeb13ac9.el8.x8 15 MB/s | 52 MB 00:03 2023-10-03T10:09:02.073 INFO:teuthology.orchestra.run.smithi027.stdout:(116/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2023-10-03T10:09:02.098 INFO:teuthology.orchestra.run.smithi027.stdout:(117/122): libmount-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 236 kB 00:00 2023-10-03T10:09:02.143 INFO:teuthology.orchestra.run.smithi019.stdout:(28/122): ceph-mgr-modules-core-16.2.14-44.geeb 2.4 MB/s | 244 kB 00:00 2023-10-03T10:09:02.215 INFO:teuthology.orchestra.run.smithi027.stdout:(118/122): libsmartcols-2.32.1-43.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-10-03T10:09:02.240 INFO:teuthology.orchestra.run.smithi027.stdout:(119/122): libuuid-2.32.1-43.el8.x86_64.rpm 697 kB/s | 99 kB 00:00 2023-10-03T10:09:02.301 INFO:teuthology.orchestra.run.smithi019.stdout:(29/122): ceph-mgr-diskprediction-local-16.2.14 7.1 MB/s | 8.6 MB 00:01 2023-10-03T10:09:02.327 INFO:teuthology.orchestra.run.smithi019.stdout:(30/122): ceph-mgr-rook-16.2.14-44.geeb13ac9.el 149 kB/s | 27 kB 00:00 2023-10-03T10:09:02.352 INFO:teuthology.orchestra.run.smithi019.stdout:(31/122): ceph-prometheus-alerts-16.2.14-44.gee 296 kB/s | 15 kB 00:00 2023-10-03T10:09:02.357 INFO:teuthology.orchestra.run.smithi027.stdout:(120/122): librados2-16.2.14-44.geeb13ac9.el8.x 3.4 MB/s | 3.7 MB 00:01 2023-10-03T10:09:02.374 INFO:teuthology.orchestra.run.smithi027.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 769 kB/s | 103 kB 00:00 2023-10-03T10:09:02.508 INFO:teuthology.orchestra.run.smithi027.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 8.5 MB/s | 2.5 MB 00:00 2023-10-03T10:09:02.510 INFO:teuthology.orchestra.run.smithi027.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:09:02.511 INFO:teuthology.orchestra.run.smithi027.stdout:Total 17 MB/s | 200 MB 00:11 2023-10-03T10:09:02.534 INFO:teuthology.orchestra.run.smithi019.stdout:(32/122): flex-2.6.1-9.el8.x86_64.rpm 1.7 MB/s | 320 kB 00:00 2023-10-03T10:09:02.586 INFO:teuthology.orchestra.run.smithi019.stdout:(33/122): bison-3.0.4-10.el8.x86_64.rpm 2.6 MB/s | 688 kB 00:00 2023-10-03T10:09:02.611 INFO:teuthology.orchestra.run.smithi019.stdout:(34/122): jq-1.6-7.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-10-03T10:09:02.653 INFO:teuthology.orchestra.run.smithi019.stdout:(35/122): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-10-03T10:09:02.679 INFO:teuthology.orchestra.run.smithi019.stdout:(36/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2023-10-03T10:09:02.729 INFO:teuthology.orchestra.run.smithi019.stdout:(37/122): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-10-03T10:09:02.900 INFO:teuthology.orchestra.run.smithi019.stdout:(38/122): openblas-0.3.15-4.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-10-03T10:09:02.955 INFO:teuthology.orchestra.run.smithi019.stdout:(39/122): python3-jsonpatch-1.21-2.el8.noarch.r 495 kB/s | 27 kB 00:00 2023-10-03T10:09:02.996 INFO:teuthology.orchestra.run.smithi019.stdout:(40/122): python3-jsonpointer-1.10-11.el8.noarc 482 kB/s | 20 kB 00:00 2023-10-03T10:09:03.038 INFO:teuthology.orchestra.run.smithi019.stdout:(41/122): python3-mako-1.0.6-14.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-10-03T10:09:03.106 INFO:teuthology.orchestra.run.smithi019.stdout:(42/122): openblas-threads-0.3.15-4.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-10-03T10:09:03.131 INFO:teuthology.orchestra.run.smithi019.stdout:(43/122): python3-markupsafe-0.23-19.el8.x86_64 421 kB/s | 39 kB 00:00 2023-10-03T10:09:03.173 INFO:teuthology.orchestra.run.smithi019.stdout:(44/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-10-03T10:09:03.265 INFO:teuthology.orchestra.run.smithi019.stdout:(45/122): python3-numpy-1.14.3-10.el8.x86_64.rp 24 MB/s | 3.7 MB 00:00 2023-10-03T10:09:03.269 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction check 2023-10-03T10:09:03.290 INFO:teuthology.orchestra.run.smithi019.stdout:(46/122): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2023-10-03T10:09:03.324 INFO:teuthology.orchestra.run.smithi019.stdout:(47/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2023-10-03T10:09:03.349 INFO:teuthology.orchestra.run.smithi019.stdout:(48/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-10-03T10:09:03.383 INFO:teuthology.orchestra.run.smithi019.stdout:(49/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-10-03T10:09:03.400 INFO:teuthology.orchestra.run.smithi019.stdout:(50/122): python3-pytz-2017.2-11.el8.noarch.rpm 1.1 MB/s | 57 kB 00:00 2023-10-03T10:09:03.510 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction check succeeded. 2023-10-03T10:09:03.510 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction test 2023-10-03T10:09:03.659 INFO:teuthology.orchestra.run.smithi019.stdout:(51/122): ceph-common-16.2.14-44.geeb13ac9.el8. 2.8 MB/s | 24 MB 00:08 2023-10-03T10:09:03.692 INFO:teuthology.orchestra.run.smithi019.stdout:(52/122): python3-werkzeug-0.12.2-4.el8.noarch. 1.5 MB/s | 457 kB 00:00 2023-10-03T10:09:03.734 INFO:teuthology.orchestra.run.smithi019.stdout:(53/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2023-10-03T10:09:03.826 INFO:teuthology.orchestra.run.smithi019.stdout:(54/122): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2023-10-03T10:09:04.160 INFO:teuthology.orchestra.run.smithi019.stdout:(55/122): python3-scipy-1.0.0-21.module_el8.5.0 18 MB/s | 14 MB 00:00 2023-10-03T10:09:04.186 INFO:teuthology.orchestra.run.smithi019.stdout:(56/122): elfutils-libelf-devel-0.189-3.el8.x86 137 kB/s | 62 kB 00:00 2023-10-03T10:09:04.227 INFO:teuthology.orchestra.run.smithi019.stdout:(57/122): fuse-2.9.7-17.el8.x86_64.rpm 207 kB/s | 83 kB 00:00 2023-10-03T10:09:04.360 INFO:teuthology.orchestra.run.smithi019.stdout:(58/122): libcom_err-devel-1.45.6-5.el8.x86_64. 291 kB/s | 39 kB 00:00 2023-10-03T10:09:04.502 INFO:teuthology.orchestra.run.smithi019.stdout:(59/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 140 kB/s | 48 kB 00:00 2023-10-03T10:09:04.561 INFO:teuthology.orchestra.run.smithi019.stdout:(60/122): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.5 MB/s | 561 kB 00:00 2023-10-03T10:09:04.669 INFO:teuthology.orchestra.run.smithi019.stdout:(61/122): librabbitmq-0.9.0-4.el8.x86_64.rpm 433 kB/s | 47 kB 00:00 2023-10-03T10:09:04.728 INFO:teuthology.orchestra.run.smithi019.stdout:(62/122): libgfortran-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 645 kB 00:00 2023-10-03T10:09:04.762 INFO:teuthology.orchestra.run.smithi019.stdout:(63/122): libquadmath-8.5.0-20.el8.x86_64.rpm 666 kB/s | 172 kB 00:00 2023-10-03T10:09:04.787 INFO:teuthology.orchestra.run.smithi019.stdout:(64/122): libselinux-devel-2.9-8.el8.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2023-10-03T10:09:04.837 INFO:teuthology.orchestra.run.smithi019.stdout:(65/122): libsepol-devel-2.9-3.el8.x86_64.rpm 799 kB/s | 87 kB 00:00 2023-10-03T10:09:04.862 INFO:teuthology.orchestra.run.smithi019.stdout:(66/122): libverto-devel-0.3.2-2.el8.x86_64.rpm 180 kB/s | 18 kB 00:00 2023-10-03T10:09:04.888 INFO:teuthology.orchestra.run.smithi019.stdout:(67/122): libzstd-devel-1.4.4-1.el8.x86_64.rpm 436 kB/s | 44 kB 00:00 2023-10-03T10:09:04.898 INFO:teuthology.orchestra.run.smithi027.stdout:Transaction test succeeded. 2023-10-03T10:09:04.902 INFO:teuthology.orchestra.run.smithi027.stdout:Running transaction 2023-10-03T10:09:05.021 INFO:teuthology.orchestra.run.smithi019.stdout:(68/122): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-10-03T10:09:05.138 INFO:teuthology.orchestra.run.smithi019.stdout:(69/122): pcre2-devel-10.32-3.el8.x86_64.rpm 2.1 MB/s | 605 kB 00:00 2023-10-03T10:09:05.163 INFO:teuthology.orchestra.run.smithi019.stdout:(70/122): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-10-03T10:09:05.230 INFO:teuthology.orchestra.run.smithi019.stdout:(71/122): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.1 MB/s | 3.2 MB 00:00 2023-10-03T10:09:05.264 INFO:teuthology.orchestra.run.smithi019.stdout:(72/122): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 249 kB 00:00 2023-10-03T10:09:05.348 INFO:teuthology.orchestra.run.smithi019.stdout:(73/122): python3-cryptography-3.2.1-6.el8.x86_ 3.4 MB/s | 641 kB 00:00 2023-10-03T10:09:05.373 INFO:teuthology.orchestra.run.smithi019.stdout:(74/122): python3-jwt-1.6.1-2.el8.noarch.rpm 299 kB/s | 43 kB 00:00 2023-10-03T10:09:05.398 INFO:teuthology.orchestra.run.smithi019.stdout:(75/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-10-03T10:09:05.457 INFO:teuthology.orchestra.run.smithi019.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2023-10-03T10:09:05.482 INFO:teuthology.orchestra.run.smithi019.stdout:(77/122): python3-requests-oauthlib-1.0.0-1.el8 392 kB/s | 43 kB 00:00 2023-10-03T10:09:05.508 INFO:teuthology.orchestra.run.smithi019.stdout:(78/122): zlib-devel-1.2.11-21.el8.x86_64.rpm 531 kB/s | 58 kB 00:00 2023-10-03T10:09:05.725 INFO:teuthology.orchestra.run.smithi019.stdout:(79/122): liboath-2.6.2-3.el8.x86_64.rpm 271 kB/s | 59 kB 00:00 2023-10-03T10:09:05.750 INFO:teuthology.orchestra.run.smithi019.stdout:(80/122): leveldb-1.22-1.el8.x86_64.rpm 677 kB/s | 181 kB 00:00 2023-10-03T10:09:05.800 INFO:teuthology.orchestra.run.smithi019.stdout:(81/122): gperftools-libs-2.7-9.el8.x86_64.rpm 893 kB/s | 306 kB 00:00 2023-10-03T10:09:05.825 INFO:teuthology.orchestra.run.smithi019.stdout:(82/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 579 kB/s | 44 kB 00:00 2023-10-03T10:09:05.842 INFO:teuthology.orchestra.run.smithi019.stdout:(83/122): libunwind-1.3.1-3.el8.x86_64.rpm 640 kB/s | 75 kB 00:00 2023-10-03T10:09:05.876 INFO:teuthology.orchestra.run.smithi019.stdout:(84/122): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2023-10-03T10:09:05.893 INFO:teuthology.orchestra.run.smithi019.stdout:(85/122): python3-cachetools-3.1.1-4.el8.noarch 491 kB/s | 33 kB 00:00 2023-10-03T10:09:05.918 INFO:teuthology.orchestra.run.smithi019.stdout:(86/122): python3-certifi-2018.10.15-7.el8.noar 215 kB/s | 16 kB 00:00 2023-10-03T10:09:05.952 INFO:teuthology.orchestra.run.smithi019.stdout:(87/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-10-03T10:09:06.010 INFO:teuthology.orchestra.run.smithi019.stdout:(88/122): python3-google-auth-1.1.1-10.el8.noar 885 kB/s | 81 kB 00:00 2023-10-03T10:09:06.027 INFO:teuthology.orchestra.run.smithi019.stdout:(89/122): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-10-03T10:09:06.052 INFO:teuthology.orchestra.run.smithi019.stdout:(90/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-10-03T10:09:06.070 INFO:teuthology.orchestra.run.smithi019.stdout:(91/122): python3-jaraco-functools-2.0-4.el8.no 299 kB/s | 18 kB 00:00 2023-10-03T10:09:06.111 INFO:teuthology.orchestra.run.smithi019.stdout:(92/122): python3-logutils-0.3.5-11.el8.noarch. 831 kB/s | 49 kB 00:00 2023-10-03T10:09:06.136 INFO:teuthology.orchestra.run.smithi019.stdout:(93/122): python3-more-itertools-7.2.0-3.el8.no 879 kB/s | 59 kB 00:00 2023-10-03T10:09:06.187 INFO:teuthology.orchestra.run.smithi019.stdout:(94/122): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-10-03T10:09:06.212 INFO:teuthology.orchestra.run.smithi019.stdout:(95/122): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-10-03T10:09:06.254 INFO:teuthology.orchestra.run.smithi019.stdout:(96/122): python3-repoze-lru-0.7-6.el8.noarch.r 505 kB/s | 34 kB 00:00 2023-10-03T10:09:06.279 INFO:teuthology.orchestra.run.smithi019.stdout:(97/122): python3-routes-2.4.1-12.el8.noarch.rp 2.9 MB/s | 196 kB 00:00 2023-10-03T10:09:06.339 INFO:teuthology.orchestra.run.smithi019.stdout:(98/122): python3-kubernetes-11.0.0-6.el8.noarc 3.7 MB/s | 1.2 MB 00:00 2023-10-03T10:09:06.363 INFO:teuthology.orchestra.run.smithi019.stdout:(99/122): python3-simplegeneric-0.8.1-17.el8.no 224 kB/s | 19 kB 00:00 2023-10-03T10:09:06.388 INFO:teuthology.orchestra.run.smithi019.stdout:(100/122): python3-rsa-4.9-2.el8.noarch.rpm 479 kB/s | 64 kB 00:00 2023-10-03T10:09:06.405 INFO:teuthology.orchestra.run.smithi019.stdout:(101/122): python3-singledispatch-3.4.0.3-18.el 364 kB/s | 24 kB 00:00 2023-10-03T10:09:06.422 INFO:teuthology.orchestra.run.smithi019.stdout:(102/122): python3-tempora-1.14.1-5.el8.noarch. 496 kB/s | 29 kB 00:00 2023-10-03T10:09:06.448 INFO:teuthology.orchestra.run.smithi019.stdout:(103/122): python3-trustme-0.6.0-4.el8.noarch.r 468 kB/s | 27 kB 00:00 2023-10-03T10:09:06.482 INFO:teuthology.orchestra.run.smithi019.stdout:(104/122): python3-waitress-1.4.3-1.el8.noarch. 3.3 MB/s | 255 kB 00:00 2023-10-03T10:09:06.506 INFO:teuthology.orchestra.run.smithi019.stdout:(105/122): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-10-03T10:09:06.532 INFO:teuthology.orchestra.run.smithi019.stdout:(106/122): python3-websocket-client-0.56.0-5.el 731 kB/s | 61 kB 00:00 2023-10-03T10:09:06.549 INFO:teuthology.orchestra.run.smithi019.stdout:(107/122): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2023-10-03T10:09:06.574 INFO:teuthology.orchestra.run.smithi019.stdout:(108/122): python3-zc-lockfile-2.0-2.el8.noarch 339 kB/s | 23 kB 00:00 2023-10-03T10:09:06.691 INFO:teuthology.orchestra.run.smithi019.stdout:(109/122): NetworkManager-initscripts-updown-1. 1.2 MB/s | 143 kB 00:00 2023-10-03T10:09:06.800 INFO:teuthology.orchestra.run.smithi019.stdout:(110/122): elfutils-debuginfod-client-0.189-3.e 704 kB/s | 76 kB 00:00 2023-10-03T10:09:06.884 INFO:teuthology.orchestra.run.smithi019.stdout:(111/122): librados2-16.2.14-44.geeb13ac9.el8.x 11 MB/s | 3.7 MB 00:00 2023-10-03T10:09:06.917 INFO:teuthology.orchestra.run.smithi019.stdout:(112/122): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2023-10-03T10:09:07.026 INFO:teuthology.orchestra.run.smithi019.stdout:(113/122): elfutils-libs-0.189-3.el8.x86_64.rpm 2.1 MB/s | 303 kB 00:00 2023-10-03T10:09:07.084 INFO:teuthology.orchestra.run.smithi019.stdout:(114/122): librbd1-16.2.14-44.geeb13ac9.el8.x86 7.8 MB/s | 4.2 MB 00:00 2023-10-03T10:09:07.118 INFO:teuthology.orchestra.run.smithi019.stdout:(115/122): iproute-6.2.0-5.el8.x86_64.rpm 4.2 MB/s | 854 kB 00:00 2023-10-03T10:09:07.152 INFO:teuthology.orchestra.run.smithi019.stdout:(116/122): libblkid-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-10-03T10:09:07.227 INFO:teuthology.orchestra.run.smithi019.stdout:(117/122): libfdisk-2.32.1-43.el8.x86_64.rpm 1.7 MB/s | 254 kB 00:00 2023-10-03T10:09:07.327 INFO:teuthology.orchestra.run.smithi019.stdout:(118/122): libmount-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 236 kB 00:00 2023-10-03T10:09:07.378 INFO:teuthology.orchestra.run.smithi019.stdout:(119/122): libsmartcols-2.32.1-43.el8.x86_64.rp 795 kB/s | 179 kB 00:00 2023-10-03T10:09:07.403 INFO:teuthology.orchestra.run.smithi019.stdout:(120/122): libuuid-2.32.1-43.el8.x86_64.rpm 564 kB/s | 99 kB 00:00 2023-10-03T10:09:07.511 INFO:teuthology.orchestra.run.smithi019.stdout:(121/122): util-linux-user-2.32.1-43.el8.x86_64 769 kB/s | 103 kB 00:00 2023-10-03T10:09:07.709 INFO:teuthology.orchestra.run.smithi019.stdout:(122/122): util-linux-2.32.1-43.el8.x86_64.rpm 6.5 MB/s | 2.5 MB 00:00 2023-10-03T10:09:07.712 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:09:07.712 INFO:teuthology.orchestra.run.smithi019.stdout:Total 15 MB/s | 200 MB 00:12 2023-10-03T10:09:08.498 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-10-03T10:09:08.753 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-10-03T10:09:08.753 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-10-03T10:09:09.618 INFO:teuthology.orchestra.run.smithi027.stdout: Preparing : 1/1 2023-10-03T10:09:09.652 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:09:09.816 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:09:10.035 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:09:10.164 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:09:10.237 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-10-03T10:09:10.241 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-10-03T10:09:10.244 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:09:10.381 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:09:10.479 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:09:10.687 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:09:10.882 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:09:11.047 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:09:11.436 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:09:11.606 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:12.042 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:12.222 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:12.356 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:12.506 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:12.630 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:12.964 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:13.105 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:09:13.499 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:09:13.647 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:13.720 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:14.082 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:09:14.380 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:09:14.539 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:09:14.630 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:09:14.772 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:09:14.908 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:09:15.095 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:09:15.290 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:09:15.405 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:09:15.436 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-10-03T10:09:15.480 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: liboath-2.6.2-3.el8.x86_64 1/1 2023-10-03T10:09:15.524 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:09:15.656 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/136 2023-10-03T10:09:15.664 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:09:15.897 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : leveldb-1.22-1.el8.x86_64 2/136 2023-10-03T10:09:16.040 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:09:16.125 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/136 2023-10-03T10:09:16.291 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:09:16.301 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:09:16.394 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/136 2023-10-03T10:09:16.530 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:09:16.630 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 5/136 2023-10-03T10:09:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/136 2023-10-03T10:09:17.040 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:09:17.183 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:09:17.338 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:09:17.443 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/136 2023-10-03T10:09:17.649 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:18.083 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:09:18.085 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:09:18.307 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:18.429 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:09:18.438 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:09:18.632 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:18.645 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:09:18.735 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:09:18.836 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:09:18.985 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:09:19.140 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:09:19.213 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:09:19.434 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:09:19.580 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/136 2023-10-03T10:09:19.638 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:09:19.723 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:19.801 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:09:20.039 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/136 2023-10-03T10:09:20.274 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/136 2023-10-03T10:09:20.398 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:09:20.511 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 16/136 2023-10-03T10:09:20.673 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:09:20.791 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 17/136 2023-10-03T10:09:21.023 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 18/136 2023-10-03T10:09:21.188 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 19/136 2023-10-03T10:09:21.332 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:09:21.466 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 20/136 2023-10-03T10:09:21.551 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:09:21.640 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:09:21.861 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:09:22.024 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:09:22.267 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:09:22.299 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 21/136 2023-10-03T10:09:22.482 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:09:22.488 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:09:22.652 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:09:22.908 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:09:23.087 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:09:23.154 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 22/136 2023-10-03T10:09:23.264 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:09:23.398 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:09:23.504 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:09:23.584 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:09:23.771 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:09:23.848 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:09:24.004 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:09:24.182 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 23/136 2023-10-03T10:09:24.548 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 24/136 2023-10-03T10:09:24.569 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:09:24.828 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/136 2023-10-03T10:09:24.838 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:09:24.854 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:09:25.025 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:09:25.055 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 26/136 2023-10-03T10:09:25.215 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 27/136 2023-10-03T10:09:25.277 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:09:25.482 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 28/136 2023-10-03T10:09:25.544 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:09:25.689 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:09:25.709 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:09:25.857 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:09:26.081 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:09:26.291 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:09:26.449 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:09:26.669 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:09:26.830 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:09:27.014 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:09:27.225 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:09:27.490 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:09:27.693 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:09:27.694 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/136 2023-10-03T10:09:27.898 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:09:27.994 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 30/136 2023-10-03T10:09:28.100 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:09:28.173 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 31/136 2023-10-03T10:09:28.323 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:09:28.539 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:09:28.795 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/136 2023-10-03T10:09:28.925 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:09:29.046 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 33/136 2023-10-03T10:09:29.227 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:09:29.237 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 34/136 2023-10-03T10:09:29.432 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:09:29.509 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 35/136 2023-10-03T10:09:29.681 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:09:29.698 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 36/136 2023-10-03T10:09:29.908 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 37/136 2023-10-03T10:09:29.952 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:09:30.122 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:09:30.190 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 38/136 2023-10-03T10:09:30.422 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:09:30.494 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 39/136 2023-10-03T10:09:30.672 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:09:31.057 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:09:31.313 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 40/136 2023-10-03T10:09:31.321 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:09:31.548 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:09:31.598 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:09:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 41/136 2023-10-03T10:09:31.805 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:09:31.839 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 42/136 2023-10-03T10:09:32.040 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:09:32.096 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 43/136 2023-10-03T10:09:32.216 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:32.364 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 44/136 2023-10-03T10:09:32.527 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:32.569 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 45/136 2023-10-03T10:09:32.700 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:09:32.718 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 46/136 2023-10-03T10:09:32.830 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:09:32.953 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 47/136 2023-10-03T10:09:32.985 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:09:33.220 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 48/136 2023-10-03T10:09:33.292 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:09:33.384 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 49/136 2023-10-03T10:09:33.516 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:09:33.604 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 50/136 2023-10-03T10:09:33.657 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:09:33.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 51/136 2023-10-03T10:09:33.872 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:09:33.957 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 52/136 2023-10-03T10:09:34.063 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:09:34.169 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 53/136 2023-10-03T10:09:34.238 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:09:34.393 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 54/136 2023-10-03T10:09:34.539 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:09:34.636 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 55/136 2023-10-03T10:09:34.727 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:09:34.882 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:09:34.889 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 56/136 2023-10-03T10:09:35.092 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:09:35.099 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/136 2023-10-03T10:09:35.367 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/136 2023-10-03T10:09:35.389 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:09:35.583 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/136 2023-10-03T10:09:35.679 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:09:35.837 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:09:35.985 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/136 2023-10-03T10:09:36.277 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 61/136 2023-10-03T10:09:36.488 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/136 2023-10-03T10:09:36.750 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 63/136 2023-10-03T10:09:37.007 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 64/136 2023-10-03T10:09:38.187 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 65/136 2023-10-03T10:09:38.448 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 66/136 2023-10-03T10:09:38.451 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:38.661 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:38.692 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 67/136 2023-10-03T10:09:38.875 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 68/136 2023-10-03T10:09:39.176 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/136 2023-10-03T10:09:39.402 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:39.402 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 70/136 2023-10-03T10:09:39.715 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 71/136 2023-10-03T10:09:39.911 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 72/136 2023-10-03T10:09:40.090 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 73/136 2023-10-03T10:09:40.112 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:09:40.220 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:09:40.240 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 74/136 2023-10-03T10:09:40.344 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:09:40.554 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 75/136 2023-10-03T10:09:40.776 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 76/136 2023-10-03T10:09:40.920 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 77/136 2023-10-03T10:09:41.155 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 78/136 2023-10-03T10:09:41.375 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 79/136 2023-10-03T10:09:41.566 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.7-17.el8.x86_64 80/136 2023-10-03T10:09:41.847 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 81/136 2023-10-03T10:09:42.072 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 82/136 2023-10-03T10:09:42.251 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 83/136 2023-10-03T10:09:42.477 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/136 2023-10-03T10:09:42.760 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/136 2023-10-03T10:09:43.006 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/136 2023-10-03T10:09:43.163 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 87/136 2023-10-03T10:09:45.905 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:46.146 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:46.924 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 88/136 2023-10-03T10:09:47.255 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:09:47.380 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 89/136 2023-10-03T10:09:47.545 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /sys 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /proc 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /run 2023-10-03T10:09:59.548 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /mnt 2023-10-03T10:09:59.549 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /var/tmp 2023-10-03T10:09:59.549 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /home 2023-10-03T10:09:59.549 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /tmp 2023-10-03T10:09:59.549 INFO:teuthology.orchestra.run.smithi027.stdout:skipping the directory /dev 2023-10-03T10:09:59.549 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:09:59.982 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:10:00.448 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:10:00.600 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:10:02.180 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:10:02.408 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:10:02.444 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:10:02.664 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:10:03.012 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:10:03.290 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:10:03.499 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:10:03.762 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:10:03.924 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:10:04.004 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:10:04.178 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:10:04.324 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:10:05.449 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:10:05.742 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:10:06.852 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:10:07.032 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:10:07.129 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:10:07.517 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:10:07.709 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:10:07.736 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:10:07.890 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:10:07.902 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 90/136 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /dev 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /run 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2023-10-03T10:10:08.580 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2023-10-03T10:10:08.581 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2023-10-03T10:10:08.581 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2023-10-03T10:10:08.581 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /dev 2023-10-03T10:10:08.581 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:09.011 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:10:09.517 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 91/136 2023-10-03T10:10:09.693 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:10:11.332 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 92/136 2023-10-03T10:10:11.567 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:10:11.609 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 93/136 2023-10-03T10:10:11.831 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 94/136 2023-10-03T10:10:12.208 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 95/136 2023-10-03T10:10:12.483 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 96/136 2023-10-03T10:10:12.717 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 97/136 2023-10-03T10:10:12.831 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:10:12.972 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 98/136 2023-10-03T10:10:13.116 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:10:13.201 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 99/136 2023-10-03T10:10:13.404 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jq-1.6-7.el8.x86_64 100/136 2023-10-03T10:10:13.524 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 101/136 2023-10-03T10:10:14.104 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:10:14.325 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:10:14.729 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 102/136 2023-10-03T10:10:14.730 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:10:14.907 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:15.005 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:15.009 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:10:15.927 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:10:16.165 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 103/136 2023-10-03T10:10:16.177 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:10:16.341 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:10:16.374 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:10:16.444 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 104/136 2023-10-03T10:10:16.568 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:10:16.731 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:10:16.865 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 105/136 2023-10-03T10:10:16.923 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:10:17.084 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:10:17.116 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 106/136 2023-10-03T10:10:17.245 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:10:17.288 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:10:17.302 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 107/136 2023-10-03T10:10:17.483 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:10:17.639 INFO:teuthology.orchestra.run.smithi027.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:10:17.733 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:10:17.939 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:10:18.033 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:10:18.222 INFO:teuthology.orchestra.run.smithi027.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:10:18.236 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:10:18.424 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:10:18.584 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:10:18.585 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:10:18.816 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:10:18.822 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:10:18.951 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:10:18.951 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:10:19.205 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:10:19.391 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:10:19.547 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:10:19.799 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:10:19.799 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:10:20.033 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:10:20.033 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:20.233 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:20.234 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:10:20.467 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:10:20.467 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:20.667 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:20.667 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:10:20.858 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:10:21.066 INFO:teuthology.orchestra.run.smithi027.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:10:21.678 INFO:teuthology.orchestra.run.smithi027.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:10:21.679 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:10:21.680 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:10:21.681 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:10:21.681 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:10:21.681 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:10:21.681 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:10:21.690 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:10:21.691 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:10:21.692 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:10:21.693 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:10:21.694 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:10:21.695 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:10:21.696 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:10:21.697 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:10:21.698 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:21.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:10:21.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:21.699 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:10:22.429 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 108/136 2023-10-03T10:10:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:10:23.652 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:23.652 INFO:teuthology.orchestra.run.smithi027.stdout:Upgraded: 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.653 INFO:teuthology.orchestra.run.smithi027.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout:Installed: 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.654 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.655 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:10:23.656 INFO:teuthology.orchestra.run.smithi027.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:10:23.657 INFO:teuthology.orchestra.run.smithi027.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:10:23.658 INFO:teuthology.orchestra.run.smithi027.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:10:23.659 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:10:23.660 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:10:23.661 INFO:teuthology.orchestra.run.smithi027.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.662 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:10:23.663 INFO:teuthology.orchestra.run.smithi027.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:10:23.664 INFO:teuthology.orchestra.run.smithi027.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:10:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:10:23.665 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:23.665 INFO:teuthology.orchestra.run.smithi027.stdout:Complete! 2023-10-03T10:10:23.732 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:10:23.837 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:23.967 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:10:24.427 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 110/136 2023-10-03T10:10:24.599 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:24.702 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:25.665 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 112/136 2023-10-03T10:10:25.938 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 113/136 2023-10-03T10:10:26.184 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 114/136 2023-10-03T10:10:26.353 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 115/136 2023-10-03T10:10:26.557 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 116/136 2023-10-03T10:10:26.774 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 117/136 2023-10-03T10:10:27.061 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 118/136 2023-10-03T10:10:27.317 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 119/136 2023-10-03T10:10:27.506 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:10:27.574 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 120/136 2023-10-03T10:10:27.798 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:10:27.899 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/136 2023-10-03T10:10:28.131 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:10:28.146 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/136 2023-10-03T10:10:28.308 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 123/136 2023-10-03T10:10:28.485 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 124/136 2023-10-03T10:10:28.485 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:10:28.725 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 125/136 2023-10-03T10:10:28.731 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:10:28.885 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 126/136 2023-10-03T10:10:28.885 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:10:29.147 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 127/136 2023-10-03T10:10:29.334 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 128/136 2023-10-03T10:10:29.536 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 129/136 2023-10-03T10:10:29.833 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:10:29.833 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:10:30.026 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 131/136 2023-10-03T10:10:30.026 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:30.251 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:30.251 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:10:30.492 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 133/136 2023-10-03T10:10:30.493 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:30.684 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:30.684 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:10:30.942 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 135/136 2023-10-03T10:10:31.116 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:10:31.785 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 136/136 2023-10-03T10:10:31.785 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 1/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 3/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 4/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 5/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 6/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 7/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 8/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 9/136 2023-10-03T10:10:31.786 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 10/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 11/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_6 12/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 13/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 14/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 15/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_ 16/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 17/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8 18/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x 19/136 2023-10-03T10:10:31.787 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 20/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 21/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 22/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 23/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 24/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 25/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 26/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.e 27/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.no 28/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb1 29/136 2023-10-03T10:10:31.788 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8 30/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 31/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el 32/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.0.4-10.el8.x86_64 33/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.1-9.el8.x86_64 34/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jq-1.6-7.el8.x86_64 35/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 36/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 37/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 38/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 39/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 40/136 2023-10-03T10:10:31.789 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 41/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 42/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 43/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 44/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 45/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 46/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 47/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 48/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 49/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 50/136 2023-10-03T10:10:31.790 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 51/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 52/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 53/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 54/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 55/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 56/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 57/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 58/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 59/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 60/136 2023-10-03T10:10:31.791 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 61/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 62/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 63/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 64/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 65/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 66/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 67/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 68/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 69/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 70/136 2023-10-03T10:10:31.792 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 71/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 72/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 73/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 78/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 79/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : leveldb-1.22-1.el8.x86_64 80/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 81/136 2023-10-03T10:10:31.793 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 82/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 85/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 86/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 87/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 88/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 89/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 90/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 91/136 2023-10-03T10:10:31.794 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 92/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 93/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 94/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 95/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-2.6-1.el8.noarch 96/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 97/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 98/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 99/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 100/136 2023-10-03T10:10:31.795 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 101/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 102/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 103/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 104/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 105/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 106/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 107/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 108/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 109/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 110/136 2023-10-03T10:10:31.796 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 111/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 112/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 113/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 114/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 115/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 116/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 117/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 118/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 119/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 120/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 121/136 2023-10-03T10:10:31.797 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 122/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 123/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 124/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 125/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 126/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 127/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 128/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 129/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 130/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 131/136 2023-10-03T10:10:31.798 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 132/136 2023-10-03T10:10:31.799 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 133/136 2023-10-03T10:10:31.799 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 134/136 2023-10-03T10:10:31.799 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 135/136 2023-10-03T10:10:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 136/136 2023-10-03T10:10:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:33.831 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2023-10-03T10:10:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-03T10:10:33.831 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.832 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.0.4-10.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.833 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8.noarch 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.1-9.el8.x86_64 2023-10-03T10:10:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: jq-1.6-7.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: leveldb-1.22-1.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-03T10:10:33.835 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-03T10:10:33.836 INFO:teuthology.orchestra.run.smithi019.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.837 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-03T10:10:33.838 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-2.6-1.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-03T10:10:33.839 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-03T10:10:33.840 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.841 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:33.842 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-10-03T10:10:34.082 DEBUG:teuthology.parallel:result is None 2023-10-03T10:10:34.082 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:10:34.082 INFO:teuthology.packaging:ref: None 2023-10-03T10:10:34.082 INFO:teuthology.packaging:tag: None 2023-10-03T10:10:34.082 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:10:34.082 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:10:34.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:10:34.320 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:10:34.349 INFO:teuthology.orchestra.run.smithi019.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:34.350 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:34.350 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:10:34.350 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-03T10:10:34.350 INFO:teuthology.packaging:ref: None 2023-10-03T10:10:34.350 INFO:teuthology.packaging:tag: None 2023-10-03T10:10:34.350 INFO:teuthology.packaging:branch: pacific 2023-10-03T10:10:34.350 INFO:teuthology.packaging:sha1: 3d6eb91756d99e822eeed7c6b783104a6ad86054 2023-10-03T10:10:34.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2023-10-03T10:10:34.667 DEBUG:teuthology.orchestra.run.smithi027:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:10:34.696 INFO:teuthology.orchestra.run.smithi027.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:34.697 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:10:34.697 INFO:teuthology.task.install:The correct ceph version 16.2.14-44.geeb13ac9 is installed. 2023-10-03T10:10:34.697 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-03T10:10:34.697 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:34.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:10:34.737 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:34.737 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-03T10:10:34.773 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-03T10:10:34.773 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:34.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:10:34.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:10:34.886 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:34.886 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/daemon-helper 2023-10-03T10:10:34.918 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-03T10:10:34.988 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-03T10:10:34.988 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:34.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:10:35.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:10:35.097 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:35.097 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-03T10:10:35.126 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-03T10:10:35.196 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-03T10:10:35.196 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:35.196 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:10:35.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:10:35.305 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:35.305 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/usr/bin/stdin-killer 2023-10-03T10:10:35.334 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-03T10:10:35.403 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:10:35.412 INFO:teuthology.task.print:**** done installing pacific 2023-10-03T10:10:35.412 INFO:teuthology.run_tasks:Running task ceph... 2023-10-03T10:10:35.546 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-03T10:10:35.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2023-10-03T10:10:35.548 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 777 /var/log/ceph 2023-10-03T10:10:35.581 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-03T10:10:35.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:10:35.623 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-03T10:10:35.654 INFO:tasks.ceph:Creating extra log directories... 2023-10-03T10:10:35.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:10:35.698 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-03T10:10:35.738 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-03T10:10:35.738 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-03T10:10:35.738 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567', 'branch': 'fix-nfs-apply-err-reporting', 'description': 'fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}}', 'email': None, 'first_in_suite': False, 'job_id': '7409567', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'fix-nfs-apply-err-reporting'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.dir_split']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62953', 'sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5'}}, 'owner': 'scheduled_dparmar@teuthology', 'priority': 55, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0']], 'seed': 6051, 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'sleep_before_teardown': 0, 'suite': 'fs:upgrade', 'suite_branch': 'wip-62953', 'suite_path': '/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/dparmar18/ceph', 'suite_sha1': 'a6297898cc696a7db13e71aaa0b24c78a4c800c5', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJugLw4EpRV4k3fbFBvUpsZ4LKn1cu6pEnLFOGZ9MVVpKxi0uJPHk8SFSRxDeOw8MAoVN4SmqsVMRyF1ZTmrxZI=', 'smithi027.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvhCvZSoprhj9eQROITp419ViYyTHx4x2KJZ8CTKjfOptIDZgXnGHCXXcbxuUnDp0KLHXs9T201lg3xKSVYc0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'pacific', 'exclude_packages': ['cephadm', 'ceph-mgr-cephadm', 'ceph-immutable-object-cache', 'python3-rados', 'python3-rgw', 'python3-rbd', 'python3-cephfs', 'ceph-volume'], 'extra_packages': ['python-rados', 'python-rgw', 'python-rbd', 'python-cephfs'], 'extra_system_packages': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux'], 'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'}}, {'print': '**** done installing pacific'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request'], 'flavor': 'default', 'fs': 'xfs', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client pacific']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'reef'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph osd dump -f json-pretty', 'ceph versions', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done', 'ceph osd require-osd-release reef']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'ceph-fuse': {'client.0': {'mounted': False}}}, {'print': '**** done unmount client.0'}, {'install.upgrade': {'client.0': None}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': None}}, {'print': '**** done remount client.0'}, {'workunit': {'clients': {'all': ['suites/blogbench.sh']}}}], 'teuthology': {'branch': 'pacific', 'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end", 'if not is_fuse() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-03_09:48:43', 'tube': 'smithi', 'user': 'dparmar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-03T10:10:35.739 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:10:35.772 DEBUG:teuthology.orchestra.run.smithi027:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-03T10:10:35.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:10:35.835 DEBUG:teuthology.orchestra.run.smithi027:> sudo install -d -m0777 -- /var/run/ceph 2023-10-03T10:10:35.868 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:35.868 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2023-10-03T10:10:35.929 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-03T10:10:35.930 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 386045 Links: 1 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-10-03 10:10:31.385411377 +0000 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-10-03 10:07:36.815807795 +0000 2023-10-03T10:10:35.991 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-10-03 10:07:36.815807795 +0000 2023-10-03T10:10:35.992 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-10-03T10:10:35.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-03T10:10:36.064 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-10-03T10:10:36.064 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-10-03T10:10:36.064 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000244367 s, 2.1 MB/s 2023-10-03T10:10:36.065 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-03T10:10:36.131 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2023-10-03T10:10:36.194 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 394340 Links: 1 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-10-03 10:10:31.386411368 +0000 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-10-03 10:07:37.382802719 +0000 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-10-03 10:07:37.382802719 +0000 2023-10-03T10:10:36.195 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-10-03T10:10:36.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-03T10:10:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-10-03T10:10:36.267 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-10-03T10:10:36.268 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000251512 s, 2.0 MB/s 2023-10-03T10:10:36.269 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-03T10:10:36.333 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2023-10-03T10:10:36.396 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-03T10:10:36.396 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 396354 Links: 1 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-10-03 10:10:31.386411368 +0000 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-10-03 10:07:37.941797715 +0000 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-10-03 10:07:37.941797715 +0000 2023-10-03T10:10:36.397 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-10-03T10:10:36.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-03T10:10:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-10-03T10:10:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-10-03T10:10:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000241517 s, 2.1 MB/s 2023-10-03T10:10:36.471 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-03T10:10:36.535 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 6h/6d Inode: 395451 Links: 1 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2023-10-03 10:10:31.386411368 +0000 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2023-10-03 10:07:38.499792719 +0000 2023-10-03T10:10:36.598 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2023-10-03 10:07:38.499792719 +0000 2023-10-03T10:10:36.599 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: - 2023-10-03T10:10:36.599 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-03T10:10:36.671 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2023-10-03T10:10:36.671 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2023-10-03T10:10:36.671 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000249046 s, 2.1 MB/s 2023-10-03T10:10:36.672 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-03T10:10:36.737 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:10:36.737 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:10:36.737 INFO:tasks.ceph:Generating config... 2023-10-03T10:10:36.738 INFO:tasks.ceph:[global] mon warn on pool no app = False 2023-10-03T10:10:36.738 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-03T10:10:36.738 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2023-10-03T10:10:36.739 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2023-10-03T10:10:36.739 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-10-03T10:10:36.739 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-03T10:10:36.739 INFO:tasks.ceph:[client] debug client = 20 2023-10-03T10:10:36.739 INFO:tasks.ceph:[client] debug ms = 1 2023-10-03T10:10:36.739 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-03T10:10:36.739 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-03T10:10:36.739 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-03T10:10:36.740 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2023-10-03T10:10:36.740 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-03T10:10:36.740 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-03T10:10:36.740 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-03T10:10:36.741 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-03T10:10:36.742 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-03T10:10:36.742 INFO:tasks.ceph:Setting up mon.a... 2023-10-03T10:10:36.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-03T10:10:37.095 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2023-10-03T10:10:37.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-03T10:10:37.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:10:37.182 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.b', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.c', '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]')] 2023-10-03T10:10:37.183 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-03T10:10:37.183 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:37.183 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:10:37.246 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv b '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --addv c '[v2:172.21.15.19:3302,v1:172.21.15.19:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:37.341 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:37.341 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid 7e072252-f281-43a7-ab05-1896c0d28d72 2023-10-03T10:10:37.341 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:fsid 7e072252-f281-43a7-ab05-1896c0d28d72 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2023-10-03T10:10:37.342201+0000 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:created 2023-10-03T10:10:37.342201+0000 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 0 (unknown) 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2023-10-03T10:10:37.342 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2023-10-03T10:10:37.343 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.b 2023-10-03T10:10:37.343 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] mon.c 2023-10-03T10:10:37.343 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-03T10:10:37.345 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-03T10:10:37.368 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7e072252-f281-43a7-ab05-1896c0d28d72... 2023-10-03T10:10:37.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:10:37.412 DEBUG:teuthology.orchestra.run.smithi027:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.467 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2023-10-03T10:10:37.468 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2023-10-03T10:10:37.469 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2023-10-03T10:10:37.470 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.471 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on pool no app = False 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: ms bind msgr2 = False 2023-10-03T10:10:37.472 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn min per osd = 0 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = 7e072252-f281-43a7-ab05-1896c0d28d72 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.473 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2023-10-03T10:10:37.474 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.475 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2023-10-03T10:10:37.476 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2023-10-03T10:10:37.477 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2023-10-03T10:10:37.478 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:10:37.479 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2023-10-03T10:10:37.480 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:10:37.481 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:10:37.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: mon op complaint time = 120 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2023-10-03T10:10:37.483 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: client mount timeout = 600 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: debug client = 20 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2023-10-03T10:10:37.484 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout:[mds] 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds = 20 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout: debug mds balancer = 20 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2023-10-03T10:10:37.485 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug frag = True 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: mds debug scatterstat = True 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: mds op complaint time = 180 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: mds verify scatter = True 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: osd op complaint time = 180 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: rados mon op timeout = 900 2023-10-03T10:10:37.486 INFO:teuthology.orchestra.run.smithi019.stdout: rados osd op timeout = 900 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout:[global] 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: chdir = "" 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: auth supported = cephx 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: filestore xattr use omap = true 2023-10-03T10:10:37.488 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: mon clock drift allowed = 1.000 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: osd crush chooseleaf type = 0 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: auth debug = true 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on old message = true 2023-10-03T10:10:37.489 INFO:teuthology.orchestra.run.smithi027.stdout: ms die on bug = true 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn max object skew = 0 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: # disable pg_autoscaler by default for new pools 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.490 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default size = 2 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow primary affinity = true 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd allow pg remap = true 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on legacy crush tunables = false 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on crush straw calc version zero = false 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on no sortbitwise = false 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = false 2023-10-03T10:10:37.491 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on too few osds = false 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: mon_allow_pool_size_one = true 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: osd default data pool replay window = 5 2023-10-03T10:10:37.492 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon allow pool delete = true 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon cluster log file level = debug 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: debug asserts on shutdown = true 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon health detail to clog = false 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],[v2:172.21.15.19:3302,v1:172.21.15.19:6791]" 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on pool no app = False 2023-10-03T10:10:37.493 INFO:teuthology.orchestra.run.smithi027.stdout: ms bind msgr2 = False 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore warn on legacy statfs = False 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore warn on no per pool omap = False 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: mon pg warn min per osd = 0 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: fsid = 7e072252-f281-43a7-ab05-1896c0d28d72 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout:[osd] 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: osd journal size = 100 2023-10-03T10:10:37.494 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub load threshold = 5.0 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd scrub max interval = 600 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd mclock profile = high_recovery_ops 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd recover clone overlap = true 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd recovery max chunk = 1048576 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.495 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug shutdown = true 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug op order = true 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug verify stray on activate = true 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: osd open classes on start = true 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug pg log writeout = true 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: osd deep scrub update digest min age = 30 2023-10-03T10:10:37.496 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: osd map max advance = 10 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: journal zero on create = true 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: filestore ondisk finisher threads = 3 2023-10-03T10:10:37.497 INFO:teuthology.orchestra.run.smithi027.stdout: filestore apply finisher threads = 3 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bdev debug aio = true 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: osd debug misdirected ops = true 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bdev async discard = True 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bdev enable discard = True 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore allocator = bitmap 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore block size = 96636764160 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: bluestore fsck on mount = True 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluefs = 1/20 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug bluestore = 1/20 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug osd = 20 2023-10-03T10:10:37.498 INFO:teuthology.orchestra.run.smithi027.stdout: debug rocksdb = 4/10 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd backfillfull_ratio = 0.85 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd full ratio = 0.9 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd nearfull ratio = 0.8 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: osd failsafe full ratio = 0.95 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: osd objectstore = bluestore 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout:[mgr] 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mgr = 20 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:10:37.499 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mgr/telemetry/nag = false 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout:[mon] 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: debug mon = 20 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: debug paxos = 20 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: debug auth = 20 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon data avail warn = 5 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon mgr mkfs grace = 240 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min pgs per osd = 4 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd reporter subtree level = osd 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon osd prime pg temp = true 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: mon reweight min bytes per osd = 10 2023-10-03T10:10:37.500 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: auth mon ticket ttl = 660 # 11m 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: auth service ticket ttl = 240 # 4m 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: # don't complain about insecure global_id in the test suite 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: # 1m isn't quite enough 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon_down_mkfs_grace = 2m 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon_warn_on_filestore_osds = false 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon op complaint time = 120 2023-10-03T10:10:37.501 INFO:teuthology.orchestra.run.smithi027.stdout: mon warn on osd down out interval zero = False 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout:[client] 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: rgw cache enabled = true 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable ops log = true 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: rgw enable usage log = true 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: client mount timeout = 600 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: debug client = 20 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-03T10:10:37.502 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.a] 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.b] 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout:[mon.c] 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout:[mds.a] 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout:[mds] 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds = 20 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: debug mds balancer = 20 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: debug ms = 1 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug frag = True 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: mds debug scatterstat = True 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: mds op complaint time = 180 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: mds verify scatter = True 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: osd op complaint time = 180 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: rados mon op timeout = 900 2023-10-03T10:10:37.503 INFO:teuthology.orchestra.run.smithi027.stdout: rados osd op timeout = 900 2023-10-03T10:10:37.504 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-03T10:10:37.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-03T10:10:37.591 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-03T10:10:37.592 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:37.592 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-03T10:10:37.612 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:37.612 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-03T10:10:37.676 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:10:37.676 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:37.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:10:37.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:10:37.762 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:37.763 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:37.826 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi027.front.sepia.ceph.com 2023-10-03T10:10:37.826 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:37.826 DEBUG:teuthology.orchestra.run.smithi027:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-03T10:10:37.826 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-03T10:10:37.871 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:37.871 DEBUG:teuthology.orchestra.run.smithi027:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:37.932 INFO:tasks.ceph:Setting up mon nodes... 2023-10-03T10:10:37.932 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-03T10:10:37.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:10:37.994 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-03T10:10:37.997 INFO:tasks.ceph:Setting up mds nodes... 2023-10-03T10:10:37.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:10:38.055 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-03T10:10:38.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-03T10:10:38.089 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-03T10:10:38.089 DEBUG:teuthology.orchestra.run.smithi027:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-03T10:10:38.214 INFO:teuthology.orchestra.run.smithi027.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-03T10:10:38.227 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-03T10:10:38.228 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2023-10-03T10:10:38.228 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-03T10:10:38.262 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:10:38.263 INFO:tasks.ceph:role: osd.0 2023-10-03T10:10:38.263 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:10:38.263 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-03T10:10:38.345 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:10:38.346 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:10:38.777 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-10-03T10:10:38.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-10-03T10:10:38.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-03T10:10:38.947 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-03T10:10:38.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-03T10:10:39.065 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:10:39.065 INFO:tasks.ceph:role: osd.1 2023-10-03T10:10:39.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:10:39.065 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-03T10:10:39.147 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:10:39.148 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:10:39.574 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-10-03T10:10:39.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-10-03T10:10:39.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-03T10:10:39.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-03T10:10:39.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-03T10:10:39.812 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:10:39.812 INFO:tasks.ceph:role: osd.2 2023-10-03T10:10:39.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:10:39.812 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-03T10:10:39.895 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:10:39.895 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:10:39.895 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:10:39.895 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:10:39.895 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:10:39.896 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:10:39.896 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:10:39.896 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:10:39.896 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:10:39.896 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:10:40.351 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-10-03T10:10:40.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-10-03T10:10:40.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-03T10:10:40.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-03T10:10:40.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-03T10:10:40.637 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-03T10:10:40.637 INFO:tasks.ceph:role: osd.3 2023-10-03T10:10:40.637 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:10:40.637 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-03T10:10:40.720 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-03T10:10:40.721 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-03T10:10:40.721 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-03T10:10:41.159 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2023-10-03T10:10:41.161 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2023-10-03T10:10:41.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-03T10:10:41.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-03T10:10:41.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-03T10:10:41.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:41.476+0000 7f1bd9c47200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-03T10:10:44.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-03T10:10:44.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.456+0000 7f83e2dd9200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-03T10:10:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.457+0000 7f83e2dd9200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-03T10:10:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.457+0000 7f83e2dd9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:10:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.457+0000 7f83e2dd9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:10:44.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.457+0000 7f83e2dd9200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-03T10:10:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:44.457+0000 7f83e2dd9200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-03T10:10:47.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-03T10:10:47.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.435+0000 7fa45a188200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-03T10:10:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.435+0000 7fa45a188200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-03T10:10:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.435+0000 7fa45a188200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:10:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.435+0000 7fa45a188200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:10:47.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.435+0000 7fa45a188200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-03T10:10:47.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:47.436+0000 7fa45a188200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-03T10:10:50.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-03T10:10:50.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.733+0000 7f3452c0c200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-03T10:10:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.734+0000 7f3452c0c200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-03T10:10:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.734+0000 7f3452c0c200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:10:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.734+0000 7f3452c0c200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:10:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.734+0000 7f3452c0c200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-03T10:10:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:50.734+0000 7f3452c0c200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-03T10:10:53.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-03T10:10:54.117 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-03T10:10:54.117 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-03T10:10:54.192 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-03T10:10:54.319 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-03T10:10:54.394 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-03T10:10:54.470 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-03T10:10:54.544 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:54.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-03T10:10:54.620 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:10:54.620 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-03T10:10:54.643 INFO:tasks.ceph:Adding keys to all mons... 2023-10-03T10:10:54.643 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-03T10:10:54.693 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2023-10-03T10:10:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCd6BtlQFBUOxAAqi13MSKjXlASlf7UL9lJ5g== 2023-10-03T10:10:54.693 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a] 2023-10-03T10:10:54.693 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCe6BtlUC1gAxAAyC7+FSW6Y5447cnzsINLcw== 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCh6BtlZXZqHBAAZfUtbfZdnSd6q8hGqX2KVw== 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCk6Btl3dRHGxAAZ8955OGsBCRHznfXzMjsjA== 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCn6Btloaj6GRAAMjr1bfXRCQDiSTQhjnj9Rg== 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCq6BtlPIPKKxAAFQXLFbDZ2NABQvfgS9yhbA== 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2023-10-03T10:10:54.694 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCe6BtlkWrRDBAARAAX5x2OZTWSQNbdhDQ8KQ== 2023-10-03T10:10:54.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-03T10:10:54.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-03T10:10:54.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:10:54.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:10:55.056 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:10:55.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-03T10:10:55.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-03T10:10:55.561 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-03T10:10:55.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-03T10:10:55.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:10:55.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-03T10:10:55.736 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-03T10:10:55.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:10:55.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-03T10:10:55.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-03T10:10:56.023 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-03T10:10:56.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-03T10:10:56.164 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-03T10:10:56.227 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-03T10:10:56.227 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:10:56.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:10:56.269 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:10:56.269 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:10:56.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:10:56.271 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:10:56.271 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:10:56.272 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:10:56.274 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:10:56.274 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-03T10:10:56.274 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:10:56.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:10:56.277 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:10:56.277 INFO:tasks.ceph:Setting crush tunables to default 2023-10-03T10:10:56.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2023-10-03T10:10:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.449+0000 7f3bf79f0700 1 Processor -- start 2023-10-03T10:10:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.449+0000 7f3bf79f0700 1 -- start start 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf79f0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf79f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bf01328e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf79f0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0096370 con 0x7f3bf0097df0 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf79f0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00981d0 con 0x7f3bf0098e20 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf79f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0099ed0 con 0x7f3bf01304f0 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf5f8d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bf01328e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47476/0 (socket says 172.21.15.19:47476) 2023-10-03T10:10:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 learned_addr learned my addr 172.21.15.19:0/1221576592 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 msgr2=0x7f3bf0099200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 msgr2=0x7f3bf0099200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 msgr2=0x7f3bf01328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 msgr2=0x7f3bf01328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bf01328e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bf01328e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:10:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.450+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:10:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.647+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847543928 0 0) 0x7f3bf0096370 con 0x7f3bf0097df0 2023-10-03T10:10:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.647+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc0033f0 con 0x7f3bf0097df0 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1546198370 0 0) 0x7f3bdc0033f0 con 0x7f3bf0097df0 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 msgr2=0x7f3bf01328e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bf01328e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 msgr2=0x7f3bf0099200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 --2- 172.21.15.19:0/1221576592 >> v2:172.21.15.19:3300/0 conn(0x7f3bf0098e20 0x7f3bf0099200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0094e30 con 0x7f3bf0097df0 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4067856125 0 0) 0x7f3bec001470 con 0x7f3bf0097df0 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 >> v1:172.21.15.19:6789/0 conn(0x7f3bf0097df0 legacy=0x7f3bf0098710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bdc003910 0x7f3bdc003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bdc004690 0x7f3bdc004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bdc005040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00981d0 con 0x7f3bdc004690 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc00b990 con 0x7f3bf01304f0 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc00bb50 con 0x7f3bdc003910 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bdc004690 0x7f3bdc004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bdc005040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf578c700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bdc003910 0x7f3bdc003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bdc003910 msgr2=0x7f3bdc003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bdc003910 0x7f3bdc003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 msgr2=0x7f3bdc005040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bdc005040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 -- 172.21.15.19:0/1221576592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0033f0 con 0x7f3bdc004690 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bf01304f0 0x7f3bdc005040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.648+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bdc004690 0x7f3bdc004b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3be0006e70 tx=0x7f3be0008040).ready entity=mon.0 client_cookie=5ff90a19ae29a28f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000b420 con 0x7f3bdc004690 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be000d5d0 con 0x7f3bdc004690 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3be7fff700 1 -- 172.21.15.19:0/1221576592 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be000d950 con 0x7f3bdc004690 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3bf79f0700 1 -- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bdc004690 msgr2=0x7f3bdc004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3bf79f0700 1 --2- 172.21.15.19:0/1221576592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bdc004690 0x7f3bdc004b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3be0006e70 tx=0x7f3be0008040).stop 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.649+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/1221576592 reap_dead start 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.650+0000 7f3bf79f0700 1 -- 172.21.15.19:0/1221576592 shutdown_connections 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.650+0000 7f3bf79f0700 1 -- 172.21.15.19:0/1221576592 >> 172.21.15.19:0/1221576592 conn(0x7f3bf009dcf0 msgr2=0x7f3bf009e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.650+0000 7f3bf79f0700 1 -- 172.21.15.19:0/1221576592 shutdown_connections 2023-10-03T10:10:56.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.650+0000 7f3bf79f0700 1 -- 172.21.15.19:0/1221576592 wait complete. 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.651+0000 7f3bf79f0700 1 Processor -- start 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.651+0000 7f3bf79f0700 1 -- start start 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 0x7f3bf011abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf011d5f0 con 0x7f3bf013e990 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf011bf40 con 0x7f3bdc004690 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.652+0000 7f3bf79f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00945a0 con 0x7f3bf011a810 2023-10-03T10:10:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf578c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf4f8b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 0x7f3bf011abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf578c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51176/0 (socket says 172.21.15.19:51176) 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47496/0 (socket says 172.21.15.19:47496) 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf578c700 1 -- 172.21.15.19:0/4036281854 learned_addr learned my addr 172.21.15.19:0/4036281854 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 msgr2=0x7f3bf011abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 0x7f3bf011abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 msgr2=0x7f3bf011a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 -- 172.21.15.19:0/4036281854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0099cc0 con 0x7f3bf013e990 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf4f8b700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 0x7f3bf011abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf578c700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf5f8d700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3bf0097af0 tx=0x7f3be8009740).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8011440 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80115a0 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf011b0e0 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.653+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8011920 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.654+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf011e530 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.654+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f3be8003040 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.654+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f3be8015900 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.655+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf005a260 con 0x7f3bf013e990 2023-10-03T10:10:56.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.657+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f3be8011d10 con 0x7f3bf013e990 2023-10-03T10:10:56.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.734+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3bf0065f50 con 0x7f3bf013e990 2023-10-03T10:10:56.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.739+0000 7f3be57fa700 1 -- 172.21.15.19:0/4036281854 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3be8015b90 con 0x7f3bf013e990 2023-10-03T10:10:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 msgr2=0x7f3bf0140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f3bf0097af0 tx=0x7f3be8009740).stop 2023-10-03T10:10:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 shutdown_connections 2023-10-03T10:10:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3bf013e990 0x7f3bf0140d80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3bdc004690 0x7f3bf011a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 --2- 172.21.15.19:0/4036281854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3bf011a810 0x7f3bf011abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:56.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 >> 172.21.15.19:0/4036281854 conn(0x7f3bf009dcf0 msgr2=0x7f3bf009bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:56.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 shutdown_connections 2023-10-03T10:10:56.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:56.740+0000 7f3bf79f0700 1 -- 172.21.15.19:0/4036281854 wait complete. 2023-10-03T10:10:56.742 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2023-10-03T10:10:56.753 INFO:tasks.ceph:check_enable_crimson: False 2023-10-03T10:10:56.753 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-03T10:10:56.753 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:56.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-03T10:10:56.783 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:56.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-03T10:10:56.856 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:56.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-03T10:10:56.929 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:10:56.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-03T10:10:57.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 254f1f35-d197-4b51-8a96-760da60c16a8 0 2023-10-03T10:10:57.144 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:57.144+0000 7fec1f359680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:10:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.177+0000 7fb16db65700 1 Processor -- start 2023-10-03T10:10:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.177+0000 7fb16db65700 1 -- start start 2023-10-03T10:10:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.177+0000 7fb16db65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.177+0000 7fb16db65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb16db65700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb168093f70 con 0x7fb1680973e0 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb16db65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb168092110 con 0x7fb168096b10 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb16db65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1680927f0 con 0x7fb168091d30 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb166ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb166ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51206/0 (socket says 172.21.15.19:51206) 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43076/0 (socket says 172.21.15.19:43076) 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb166ffd700 1 -- 172.21.15.19:0/3873859236 learned_addr learned my addr 172.21.15.19:0/3873859236 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb167fff700 1 --1- 172.21.15.19:0/3873859236 >> v1:172.21.15.19:6789/0 conn(0x7fb1680973e0 0x7fb16812f460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39022/0 (socket says 172.21.15.19:39022) 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 -- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 msgr2=0x7fb168096ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1667fc700 1 -- 172.21.15.19:0/3873859236 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215300266 0 0) 0x7fb168093f70 con 0x7fb1680973e0 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 -- 172.21.15.19:0/3873859236 >> v1:172.21.15.19:6789/0 conn(0x7fb1680973e0 legacy=0x7fb16812f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 -- 172.21.15.19:0/3873859236 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb168095c40 con 0x7fb168091d30 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb166ffd700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1677fe700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb158009ec0 tx=0x7fb158009780).ready entity=mon.2 client_cookie=6223b770a53344ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.178+0000 7fb1667fc700 1 -- 172.21.15.19:0/3873859236 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15800e070 con 0x7fb168091d30 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb1667fc700 1 -- 172.21.15.19:0/3873859236 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15800bbf0 con 0x7fb168091d30 2023-10-03T10:10:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb1667fc700 1 -- 172.21.15.19:0/3873859236 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158012410 con 0x7fb168091d30 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 -- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 msgr2=0x7fb168096620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb158009ec0 tx=0x7fb158009780).stop 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 -- 172.21.15.19:0/3873859236 shutdown_connections 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb168096620 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 --2- 172.21.15.19:0/3873859236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168096ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 -- 172.21.15.19:0/3873859236 >> 172.21.15.19:0/3873859236 conn(0x7fb168098720 msgr2=0x7fb168098b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 -- 172.21.15.19:0/3873859236 shutdown_connections 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.179+0000 7fb16db65700 1 -- 172.21.15.19:0/3873859236 wait complete. 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.180+0000 7fb16db65700 1 Processor -- start 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.180+0000 7fb16db65700 1 -- start start 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168118e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 0x7fb168119380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1681187b0 con 0x7fb1680973e0 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806a4a0 con 0x7fb168096b10 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb16db65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb16806a710 con 0x7fb168091d30 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43088/0 (socket says 172.21.15.19:43088) 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 -- 172.21.15.19:0/2289862045 learned_addr learned my addr 172.21.15.19:0/2289862045 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb166ffd700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168118e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb167fff700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 0x7fb168119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 -- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 msgr2=0x7fb168118e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168118e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 -- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 msgr2=0x7fb168119380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 0x7fb168119380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb1677fe700 1 -- 172.21.15.19:0/2289862045 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009370 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.181+0000 7fb167fff700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 0x7fb168119380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb1677fe700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb1580097c0 tx=0x7fb1680939e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15801d420 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15801d580 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15801d900 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb158009a20 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16811c4e0 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb158003040 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.182+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb158027c10 con 0x7fb168091d30 2023-10-03T10:10:57.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.183+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16811bd80 con 0x7fb168091d30 2023-10-03T10:10:57.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.185+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb16811bd80 con 0x7fb168091d30 2023-10-03T10:10:57.226 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:57.226+0000 7fec1f359680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:10:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.271+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd new", "uuid": "254f1f35-d197-4b51-8a96-760da60c16a8", "id": 0} v 0) v1 -- 0x7fb16811baa0 con 0x7fb168091d30 2023-10-03T10:10:57.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.277+0000 7fb15f7fe700 1 -- 172.21.15.19:0/2289862045 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "254f1f35-d197-4b51-8a96-760da60c16a8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb158017070 con 0x7fb168091d30 2023-10-03T10:10:57.726 INFO:teuthology.orchestra.run.smithi019.stdout:0 2023-10-03T10:10:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 msgr2=0x7fb1681189a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fb1580097c0 tx=0x7fb1680939e0).stop 2023-10-03T10:10:57.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 shutdown_connections 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1680973e0 0x7fb168119380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb168091d30 0x7fb1681189a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 --2- 172.21.15.19:0/2289862045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb168096b10 0x7fb168118e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 >> 172.21.15.19:0/2289862045 conn(0x7fb168098720 msgr2=0x7fb168099ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 shutdown_connections 2023-10-03T10:10:57.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.279+0000 7fb16db65700 1 -- 172.21.15.19:0/2289862045 wait complete. 2023-10-03T10:10:57.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 916c386e-c460-4114-9dbe-21434a2f252d 1 2023-10-03T10:10:57.729 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:57.321+0000 7fec1f359680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.858+0000 7f83aff59700 1 Processor -- start 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 -- start start 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 0x7f83a812fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a8096de0 con 0x7f83a8059070 2023-10-03T10:10:57.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a8092a50 con 0x7f83a8130240 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83aff59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a8091ba0 con 0x7f83a8127fa0 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83ae4f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.859+0000 7f83ad4f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 0x7f83a812fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ae4f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47534/0 (socket says 172.21.15.19:47534) 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ae4f6700 1 -- 172.21.15.19:0/3635495350 learned_addr learned my addr 172.21.15.19:0/3635495350 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ad4f4700 1 -- 172.21.15.19:0/3635495350 >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 msgr2=0x7f83a8132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ad4f4700 1 --2- 172.21.15.19:0/3635495350 >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ad4f4700 1 -- 172.21.15.19:0/3635495350 >> v1:172.21.15.19:6789/0 conn(0x7f83a8059070 legacy=0x7f83a8127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ad4f4700 1 -- 172.21.15.19:0/3635495350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8091e60 con 0x7f83a8127fa0 2023-10-03T10:10:57.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83accf3700 1 -- 172.21.15.19:0/3635495350 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291474810 0 0) 0x7f83a8096de0 con 0x7f83a8059070 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ae4f6700 1 --2- 172.21.15.19:0/3635495350 >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83ad4f4700 1 --2- 172.21.15.19:0/3635495350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 0x7f83a812fd50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8398009790 tx=0x7f8398009060).ready entity=mon.1 client_cookie=f1235d754d0fedf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83accf3700 1 -- 172.21.15.19:0/3635495350 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800f510 con 0x7f83a8127fa0 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83accf3700 1 -- 172.21.15.19:0/3635495350 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800f670 con 0x7f83a8127fa0 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.860+0000 7f83accf3700 1 -- 172.21.15.19:0/3635495350 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800f9f0 con 0x7f83a8127fa0 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 -- 172.21.15.19:0/3635495350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 msgr2=0x7f83a812fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 --2- 172.21.15.19:0/3635495350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 0x7f83a812fd50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8398009790 tx=0x7f8398009060).stop 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 -- 172.21.15.19:0/3635495350 shutdown_connections 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 --2- 172.21.15.19:0/3635495350 >> v2:172.21.15.19:3300/0 conn(0x7f83a8130240 0x7f83a8132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 --2- 172.21.15.19:0/3635495350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8127fa0 0x7f83a812fd50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 -- 172.21.15.19:0/3635495350 >> 172.21.15.19:0/3635495350 conn(0x7f83a80974f0 msgr2=0x7f83a8097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:57.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 -- 172.21.15.19:0/3635495350 shutdown_connections 2023-10-03T10:10:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.861+0000 7f83aff59700 1 -- 172.21.15.19:0/3635495350 wait complete. 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.862+0000 7f83aff59700 1 Processor -- start 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.862+0000 7f83aff59700 1 -- start start 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 0x7f83a812e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a812ecf0 con 0x7f83a8130240 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a812f290 con 0x7f83a8059070 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83aff59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83a812ff90 con 0x7f83a8127fa0 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83ad4f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83adcf5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83ad4f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43092/0 (socket says 172.21.15.19:43092) 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83adcf5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51240/0 (socket says 172.21.15.19:51240) 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83ad4f4700 1 -- 172.21.15.19:0/2390618065 learned_addr learned my addr 172.21.15.19:0/2390618065 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.863+0000 7f83ae4f6700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 0x7f83a812e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 -- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 msgr2=0x7f83a812de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 -- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 msgr2=0x7f83a812e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 0x7f83a812e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 -- 172.21.15.19:0/2390618065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a0009ae0 con 0x7f83a8127fa0 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83adcf5700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ae4f6700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 0x7f83a812e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:57.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83ad4f4700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8398011000 tx=0x7f8398017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839800f7e0 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839800f940 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980092a0 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839801b660 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a81115d0 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f839801bc70 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.864+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f8398024a90 con 0x7f83a8127fa0 2023-10-03T10:10:57.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.866+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a81125f0 con 0x7f83a8127fa0 2023-10-03T10:10:57.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.868+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f8398043e50 con 0x7f83a8127fa0 2023-10-03T10:10:57.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.953+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd new", "uuid": "916c386e-c460-4114-9dbe-21434a2f252d", "id": 1} v 0) v1 -- 0x7f83a805a260 con 0x7f83a8127fa0 2023-10-03T10:10:57.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.961+0000 7f839dffb700 1 -- 172.21.15.19:0/2390618065 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "916c386e-c460-4114-9dbe-21434a2f252d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8398032030 con 0x7f83a8127fa0 2023-10-03T10:10:57.962 INFO:teuthology.orchestra.run.smithi019.stdout:1 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 msgr2=0x7f83a812e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f8398011000 tx=0x7f8398017000).stop 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 shutdown_connections 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a8130240 0x7f83a812e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83a8059070 0x7f83a812de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 --2- 172.21.15.19:0/2390618065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83a8127fa0 0x7f83a812e310 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 >> 172.21.15.19:0/2390618065 conn(0x7f83a80974f0 msgr2=0x7f83a8125450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 shutdown_connections 2023-10-03T10:10:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:57.963+0000 7f83aff59700 1 -- 172.21.15.19:0/2390618065 wait complete. 2023-10-03T10:10:57.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 567f9cb5-3aaa-4022-97b8-d11809d82b46 2 2023-10-03T10:10:58.125 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:58.125+0000 7fec1f359680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:10:58.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 Processor -- start 2023-10-03T10:10:58.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 -- start start 2023-10-03T10:10:58.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc065e50 con 0x7ff4cc12f690 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc095830 con 0x7ff4cc098c80 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.144+0000 7ff4d45b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc095ba0 con 0x7ff4cc0651e0 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d234e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d234e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43094/0 (socket says 172.21.15.19:43094) 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51248/0 (socket says 172.21.15.19:51248) 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d234e700 1 -- 172.21.15.19:0/2812241735 learned_addr learned my addr 172.21.15.19:0/2812241735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d2b4f700 1 --1- 172.21.15.19:0/2812241735 >> v1:172.21.15.19:6789/0 conn(0x7ff4cc12f690 0x7ff4cc131a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39052/0 (socket says 172.21.15.19:39052) 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 msgr2=0x7ff4cc098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2812241735 >> v1:172.21.15.19:6789/0 conn(0x7ff4cc12f690 legacy=0x7ff4cc131a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2812241735 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc095500 con 0x7ff4cc098c80 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d134c700 1 -- 172.21.15.19:0/2812241735 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221959335 0 0) 0x7ff4cc065e50 con 0x7ff4cc12f690 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d234e700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d1b4d700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4c0009790 tx=0x7ff4c0009060).ready entity=mon.1 client_cookie=d49412adb85fdad7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d134c700 1 -- 172.21.15.19:0/2812241735 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c00090d0 con 0x7ff4cc098c80 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d134c700 1 -- 172.21.15.19:0/2812241735 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000f510 con 0x7ff4cc098c80 2023-10-03T10:10:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.145+0000 7ff4d134c700 1 -- 172.21.15.19:0/2812241735 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000f890 con 0x7ff4cc098c80 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 msgr2=0x7ff4cc0990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff4c0009790 tx=0x7ff4c0009060).stop 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2812241735 shutdown_connections 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc0651e0 0x7ff4cc098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2812241735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc0990a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2812241735 >> 172.21.15.19:0/2812241735 conn(0x7ff4cc09a960 msgr2=0x7ff4cc09ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2812241735 shutdown_connections 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.146+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2812241735 wait complete. 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.147+0000 7ff4d45b2700 1 Processor -- start 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 -- start start 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc0651e0 0x7ff4cc11a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 0x7ff4cc11aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc11b4e0 con 0x7ff4cc0651e0 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc11eb00 con 0x7ff4cc098c80 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d45b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc094ae0 con 0x7ff4cc12f690 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d1b4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d2b4f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 0x7ff4cc11aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d1b4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51258/0 (socket says 172.21.15.19:51258) 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2143571557 learned_addr learned my addr 172.21.15.19:0/2143571557 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.148+0000 7ff4d234e700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc0651e0 0x7ff4cc11a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 msgr2=0x7ff4cc11aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 0x7ff4cc11aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc0651e0 msgr2=0x7ff4cc11a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc0651e0 0x7ff4cc11a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 -- 172.21.15.19:0/2143571557 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4009370 con 0x7ff4cc098c80 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d2b4f700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 0x7ff4cc11aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d1b4d700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4c0009e30 tx=0x7ff4c0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c000f890 con 0x7ff4cc098c80 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c000fc50 con 0x7ff4cc098c80 2023-10-03T10:10:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c00092a0 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c001b410 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc11c050 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7ff4c001b9e0 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.149+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff4c001bc90 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.150+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc09e890 con 0x7ff4cc098c80 2023-10-03T10:10:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.153+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7ff4c0043e50 con 0x7ff4cc098c80 2023-10-03T10:10:58.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.238+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd new", "uuid": "567f9cb5-3aaa-4022-97b8-d11809d82b46", "id": 2} v 0) v1 -- 0x7ff4cc05a260 con 0x7ff4cc098c80 2023-10-03T10:10:58.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.242+0000 7ff4ca7fc700 1 -- 172.21.15.19:0/2143571557 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "567f9cb5-3aaa-4022-97b8-d11809d82b46", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff4c0032030 con 0x7ff4cc098c80 2023-10-03T10:10:58.242 INFO:teuthology.orchestra.run.smithi019.stdout:2 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 msgr2=0x7ff4cc11ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff4c0009e30 tx=0x7ff4c0017000).stop 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 shutdown_connections 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4cc12f690 0x7ff4cc11aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4cc0651e0 0x7ff4cc11a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 --2- 172.21.15.19:0/2143571557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4cc098c80 0x7ff4cc11ab00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 >> 172.21.15.19:0/2143571557 conn(0x7ff4cc09a960 msgr2=0x7ff4cc09bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 shutdown_connections 2023-10-03T10:10:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.243+0000 7ff4d45b2700 1 -- 172.21.15.19:0/2143571557 wait complete. 2023-10-03T10:10:58.251 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:58.251+0000 7fec1f359680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:10:58.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd new 8991320d-e996-46ae-a954-e1235c1a6bd8 3 2023-10-03T10:10:58.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 Processor -- start 2023-10-03T10:10:58.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 -- start start 2023-10-03T10:10:58.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 0x7f2b001288b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 0x7f2b00094300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b00096210 con 0x7f2b00128ed0 2023-10-03T10:10:58.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000964b0 con 0x7f2b001292f0 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b06b7f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00095790 con 0x7f2b00096c20 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b0491b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 0x7f2b001288b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2afffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b00128ed0 0x7f2b00093bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39058/0 (socket says 172.21.15.19:39058) 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2afffff700 1 -- 172.21.15.19:0/4231373294 learned_addr learned my addr 172.21.15.19:0/4231373294 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.384+0000 7f2b0511c700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 0x7f2b00094300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0491b700 1 -- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 msgr2=0x7f2b00094300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2aff7fe700 1 -- 172.21.15.19:0/4231373294 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030649223 0 0) 0x7f2b00096210 con 0x7f2b00128ed0 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0491b700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 0x7f2b00094300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0491b700 1 -- 172.21.15.19:0/4231373294 >> v1:172.21.15.19:6789/0 conn(0x7f2b00128ed0 legacy=0x7f2b00093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0491b700 1 -- 172.21.15.19:0/4231373294 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b00097000 con 0x7f2b00096c20 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0511c700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 0x7f2b00094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2b0491b700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 0x7f2b001288b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2af4009790 tx=0x7f2af4009060).ready entity=mon.2 client_cookie=5908c5f0b9d4ec97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2aff7fe700 1 -- 172.21.15.19:0/4231373294 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40090d0 con 0x7f2b00096c20 2023-10-03T10:10:58.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2aff7fe700 1 -- 172.21.15.19:0/4231373294 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af400f510 con 0x7f2b00096c20 2023-10-03T10:10:58.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.385+0000 7f2aff7fe700 1 -- 172.21.15.19:0/4231373294 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400f890 con 0x7f2b00096c20 2023-10-03T10:10:58.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 -- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 msgr2=0x7f2b001288b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 0x7f2b001288b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f2af4009790 tx=0x7f2af4009060).stop 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 -- 172.21.15.19:0/4231373294 shutdown_connections 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b001292f0 0x7f2b00094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/4231373294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00096c20 0x7f2b001288b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 -- 172.21.15.19:0/4231373294 >> 172.21.15.19:0/4231373294 conn(0x7f2b000974f0 msgr2=0x7f2b00097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 -- 172.21.15.19:0/4231373294 shutdown_connections 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.386+0000 7f2b06b7f700 1 -- 172.21.15.19:0/4231373294 wait complete. 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.387+0000 7f2b06b7f700 1 Processor -- start 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.387+0000 7f2b06b7f700 1 -- start start 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 0x7f2b001249a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 0x7f2b00111da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000959c0 con 0x7f2b00128ed0 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00115350 con 0x7f2b00096c20 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b06b7f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00127c50 con 0x7f2b001292f0 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2afffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 0x7f2b001249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0511c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 0x7f2b00111da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2afffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47560/0 (socket says 172.21.15.19:47560) 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2afffff700 1 -- 172.21.15.19:0/156906304 learned_addr learned my addr 172.21.15.19:0/156906304 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 -- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 msgr2=0x7f2b00111da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 0x7f2b00111da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 -- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 msgr2=0x7f2b001118b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 -- 172.21.15.19:0/156906304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af800de30 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2afffff700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0511c700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 0x7f2b00111da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2b0491b700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 0x7f2b001249a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2af4014000 tx=0x7f2af4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.388+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400f890 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4000d10 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af40092a0 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af400fea0 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b00124e90 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f2af401b880 con 0x7f2b00096c20 2023-10-03T10:10:58.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.389+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f2af40238a0 con 0x7f2b00096c20 2023-10-03T10:10:58.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.390+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0005a260 con 0x7f2b00096c20 2023-10-03T10:10:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.392+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2af4043e50 con 0x7f2b00096c20 2023-10-03T10:10:58.406 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:58.406+0000 7fec1f359680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:10:58.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.478+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8991320d-e996-46ae-a954-e1235c1a6bd8", "id": 3} v 0) v1 -- 0x7f2b00059230 con 0x7f2b00096c20 2023-10-03T10:10:58.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.481+0000 7f2afcff9700 1 -- 172.21.15.19:0/156906304 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8991320d-e996-46ae-a954-e1235c1a6bd8", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2af4032030 con 0x7f2b00096c20 2023-10-03T10:10:58.481 INFO:teuthology.orchestra.run.smithi019.stdout:3 2023-10-03T10:10:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 msgr2=0x7f2b001249a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 0x7f2b001249a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f2af4014000 tx=0x7f2af4017000).stop 2023-10-03T10:10:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 shutdown_connections 2023-10-03T10:10:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b001292f0 0x7f2b00111da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00096c20 0x7f2b001249a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 --2- 172.21.15.19:0/156906304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b00128ed0 0x7f2b001118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 >> 172.21.15.19:0/156906304 conn(0x7f2b000974f0 msgr2=0x7f2b00093c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 shutdown_connections 2023-10-03T10:10:58.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.482+0000 7f2b06b7f700 1 -- 172.21.15.19:0/156906304 wait complete. 2023-10-03T10:10:58.495 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:10:58.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:10:58.497 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:10:58.497 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:10:58.497 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:10:58.499 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:10:58.499 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:10:58.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:10:58.501 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:10:58.501 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:10:58.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:10:58.503 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:10:58.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:58.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.694+0000 7fdad91e1700 1 Processor -- start 2023-10-03T10:10:58.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.694+0000 7fdad91e1700 1 -- start start 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad91e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 0x7fdad4067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad91e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad91e1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4068880 con 0x7fdad4123a90 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad91e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4124250 con 0x7fdad4092340 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad91e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4068c90 con 0x7fdad4123e70 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 0x7fdad4067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad2d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdad4123a90 0x7fdad4126f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39088/0 (socket says 172.21.15.19:39088) 2023-10-03T10:10:58.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad2d9d700 1 -- 172.21.15.19:0/2679204065 learned_addr learned my addr 172.21.15.19:0/2679204065 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:10:58.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51332/0 (socket says 172.21.15.19:51332) 2023-10-03T10:10:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 -- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 msgr2=0x7fdad4127680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad1d9b700 1 -- 172.21.15.19:0/2679204065 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712492197 0 0) 0x7fdad4068880 con 0x7fdad4123a90 2023-10-03T10:10:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 -- 172.21.15.19:0/2679204065 >> v1:172.21.15.19:6789/0 conn(0x7fdad4123a90 legacy=0x7fdad4126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 -- 172.21.15.19:0/2679204065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4124430 con 0x7fdad4123e70 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad359e700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.695+0000 7fdad259c700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 0x7fdad4067ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdac80097c0 tx=0x7fdac8009060).ready entity=mon.2 client_cookie=8eb9da4cdc70df34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad1d9b700 1 -- 172.21.15.19:0/2679204065 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800f510 con 0x7fdad4123e70 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad1d9b700 1 -- 172.21.15.19:0/2679204065 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800f670 con 0x7fdad4123e70 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad1d9b700 1 -- 172.21.15.19:0/2679204065 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800f9f0 con 0x7fdad4123e70 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 -- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 msgr2=0x7fdad4067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 0x7fdad4067ce0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fdac80097c0 tx=0x7fdac8009060).stop 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 -- 172.21.15.19:0/2679204065 shutdown_connections 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 --2- 172.21.15.19:0/2679204065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123e70 0x7fdad4067ce0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.696+0000 7fdad91e1700 1 -- 172.21.15.19:0/2679204065 >> 172.21.15.19:0/2679204065 conn(0x7fdad409a220 msgr2=0x7fdad409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.697+0000 7fdad91e1700 1 -- 172.21.15.19:0/2679204065 shutdown_connections 2023-10-03T10:10:58.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.697+0000 7fdad91e1700 1 -- 172.21.15.19:0/2679204065 wait complete. 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 Processor -- start 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 -- start start 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 0x7fdad41144d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4115870 con 0x7fdad4123e70 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad41149c0 con 0x7fdad4092340 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad91e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdad4115680 con 0x7fdad4123a90 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43176/0 (socket says 172.21.15.19:43176) 2023-10-03T10:10:58.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad259c700 1 -- 172.21.15.19:0/628239689 learned_addr learned my addr 172.21.15.19:0/628239689 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.698+0000 7fdad359e700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 0x7fdad41144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad2d9d700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 -- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 msgr2=0x7fdad4113fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 -- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 msgr2=0x7fdad4113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 -- 172.21.15.19:0/628239689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc009a20 con 0x7fdad4123e70 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad259c700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad359e700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 0x7fdad41144d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdacc009e70 tx=0x7fdacc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00ca40 con 0x7fdad4123e70 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00f040 con 0x7fdad4123e70 2023-10-03T10:10:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00cdb0 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac80092a0 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad4099520 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fdacc013870 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.699+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fdacc013b20 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.701+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40697c0 con 0x7fdad4123e70 2023-10-03T10:10:58.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.703+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fdacc013df0 con 0x7fdad4123e70 2023-10-03T10:10:58.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.774+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad405a260 con 0x7fdad4123e70 2023-10-03T10:10:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.775+0000 7fdabaffd700 1 -- 172.21.15.19:0/628239689 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7fdacc01c610 con 0x7fdad4123e70 2023-10-03T10:10:58.775 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:10:58.775 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:10:58.479662+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 msgr2=0x7fdad41144d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 0x7fdad41144d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fdacc009e70 tx=0x7fdacc00b040).stop 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 shutdown_connections 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdad4123e70 0x7fdad41144d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdad4092340 0x7fdad4113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 --2- 172.21.15.19:0/628239689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdad4123a90 0x7fdad4113fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 >> 172.21.15.19:0/628239689 conn(0x7fdad409a220 msgr2=0x7fdad4094a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 shutdown_connections 2023-10-03T10:10:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:10:58.776+0000 7fdad91e1700 1 -- 172.21.15.19:0/628239689 wait complete. 2023-10-03T10:10:58.789 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-03T10:10:58.789 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-03T10:10:58.871 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:10:58.871+0000 7fc7bb737200 -1 Falling back to public interface 2023-10-03T10:10:58.945 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:58.945+0000 7fec1f359680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:10:59.119 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:10:59.119+0000 7f6e15f77200 -1 Falling back to public interface 2023-10-03T10:10:59.135 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:10:59.135+0000 7f2006aec200 -1 Falling back to public interface 2023-10-03T10:10:59.141 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.142+0000 7fec1f359680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:10:59.143 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:10:59.143+0000 7f51a11bc200 -1 Falling back to public interface 2023-10-03T10:10:59.192 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:10:59.219 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.219+0000 7fec1f359680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:10:59.307 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.308+0000 7fec1f359680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:10:59.314 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 Processor -- start 2023-10-03T10:10:59.314 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 -- start start 2023-10-03T10:10:59.314 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 0x7f34c8130200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 0x7f34c8132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c8094ee0 con 0x7f34c80957d0 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8096b50 con 0x7f34c80962c0 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.314+0000 7f34cd168700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8092f30 con 0x7f34c81306f0 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f34c80957d0 0x7f34c8095bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39098/0 (socket says 172.21.15.19:39098) 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 0x7f34c8130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 0x7f34c8132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:59.315 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c6d9d700 1 -- 172.21.15.19:0/566675930 learned_addr learned my addr 172.21.15.19:0/566675930 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:10:59.316 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c5d9b700 1 -- 172.21.15.19:0/566675930 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736931143 0 0) 0x7f34c8094ee0 con 0x7f34c80957d0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 -- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 msgr2=0x7f34c8132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 0x7f34c8132ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 -- 172.21.15.19:0/566675930 >> v1:172.21.15.19:6789/0 conn(0x7f34c80957d0 legacy=0x7f34c8095bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 -- 172.21.15.19:0/566675930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c80966a0 con 0x7f34c80962c0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c759e700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 0x7f34c8132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c659c700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 0x7f34c8130200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f34bc0097c0 tx=0x7f34bc009060).ready entity=mon.1 client_cookie=f38220f9fa81422e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c5d9b700 1 -- 172.21.15.19:0/566675930 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00f510 con 0x7f34c80962c0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c5d9b700 1 -- 172.21.15.19:0/566675930 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc00f670 con 0x7f34c80962c0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.315+0000 7f34c5d9b700 1 -- 172.21.15.19:0/566675930 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc00f9f0 con 0x7f34c80962c0 2023-10-03T10:10:59.317 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 -- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 msgr2=0x7f34c8130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 0x7f34c8130200 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f34bc0097c0 tx=0x7f34bc009060).stop 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 -- 172.21.15.19:0/566675930 shutdown_connections 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c81306f0 0x7f34c8132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 --2- 172.21.15.19:0/566675930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c80962c0 0x7f34c8130200 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 -- 172.21.15.19:0/566675930 >> 172.21.15.19:0/566675930 conn(0x7f34c809ab90 msgr2=0x7f34c809afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 -- 172.21.15.19:0/566675930 shutdown_connections 2023-10-03T10:10:59.318 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.316+0000 7f34cd168700 1 -- 172.21.15.19:0/566675930 wait complete. 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.318+0000 7f34cd168700 1 Processor -- start 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.318+0000 7f34cd168700 1 -- start start 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 0x7f34c8117fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:10:59.320 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c81189c0 con 0x7f34c80957d0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8118fc0 con 0x7f34c81306f0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34cd168700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34c8096df0 con 0x7f34c80962c0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 0x7f34c8117fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47586/0 (socket says 172.21.15.19:47586) 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51358/0 (socket says 172.21.15.19:51358) 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 0x7f34c8117fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43208/0 (socket says 172.21.15.19:43208) 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c759e700 1 -- 172.21.15.19:0/3583156598 learned_addr learned my addr 172.21.15.19:0/3583156598 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 -- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 msgr2=0x7f34c8117fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 0x7f34c8117fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 -- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 msgr2=0x7f34c81184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:59.321 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c6d9d700 1 -- 172.21.15.19:0/3583156598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c0009a20 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.319+0000 7f34c759e700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34c6d9d700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f34b8000c00 tx=0x7f34b8007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b80070d0 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8007250 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8007610 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc0092a0 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c8099e60 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f34b8005c10 con 0x7f34c80957d0 2023-10-03T10:10:59.322 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.320+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f34b8013c80 con 0x7f34c80957d0 2023-10-03T10:10:59.323 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.321+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c811ad20 con 0x7f34c80957d0 2023-10-03T10:10:59.323 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.323+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f34b8013770 con 0x7f34c80957d0 2023-10-03T10:10:59.388 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.389+0000 7fec1f359680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:10:59.394 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.394+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34c805a260 con 0x7f34c80957d0 2023-10-03T10:10:59.394 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.395+0000 7f34aeffd700 1 -- 172.21.15.19:0/3583156598 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4109 (secure 0 0 0) 0x7f34b8013910 con 0x7f34c80957d0 2023-10-03T10:10:59.395 INFO:teuthology.misc.health.smithi019.stdout: 2023-10-03T10:10:59.395 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":6,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:10:58.479662+0000","last_up_change":"0.000000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 msgr2=0x7f34c8117af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f34b8000c00 tx=0x7f34b8007b90).stop 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 shutdown_connections 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34c81306f0 0x7f34c81184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34c80957d0 0x7f34c8117af0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 --2- 172.21.15.19:0/3583156598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34c80962c0 0x7f34c8117fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 >> 172.21.15.19:0/3583156598 conn(0x7f34c809ab90 msgr2=0x7f34c8111a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:10:59.396 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 shutdown_connections 2023-10-03T10:10:59.397 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:10:59.396+0000 7f34cd168700 1 -- 172.21.15.19:0/3583156598 wait complete. 2023-10-03T10:10:59.408 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-10-03T10:10:59.787 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.787+0000 7fec1f359680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:10:59.883 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:10:59.883+0000 7fec1f359680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:11:00.606 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:00.606+0000 7fec1f359680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:11:00.684 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:00.684+0000 7fec1f359680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:11:00.772 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:00.773+0000 7fec1f359680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:11:01.103 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.103+0000 7fec1f359680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:11:01.183 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.183+0000 7fec1f359680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:11:01.317 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.317+0000 7fec1f359680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:11:01.439 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.439+0000 7fec1f359680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:11:01.611 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.611+0000 7fec1f359680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:11:01.699 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:01.698+0000 7fec1f359680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:11:02.368 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:11:02.368+0000 7fc7bb737200 -1 osd.2 0 log_to_monitors {default=true} 2023-10-03T10:11:02.633 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:11:02.633+0000 7f51a11bc200 -1 osd.3 0 log_to_monitors {default=true} 2023-10-03T10:11:02.639 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:11:02.639+0000 7f6e15f77200 -1 osd.1 0 log_to_monitors {default=true} 2023-10-03T10:11:02.644 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:11:02.644+0000 7f2006aec200 -1 osd.0 0 log_to_monitors {default=true} 2023-10-03T10:11:02.722 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:02.722+0000 7febd5d96700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:11:02.722 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:11:02.723+0000 7febd5d96700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:11:03.778 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:11:03.778+0000 7f1ffd48d700 -1 osd.0 0 waiting for initial osdmap 2023-10-03T10:11:03.779 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:11:03.778+0000 7f5197b5d700 -1 osd.3 0 waiting for initial osdmap 2023-10-03T10:11:03.779 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:11:03.779+0000 7fc7b20d8700 -1 osd.2 0 waiting for initial osdmap 2023-10-03T10:11:03.780 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:11:03.780+0000 7f6e0c918700 -1 osd.1 0 waiting for initial osdmap 2023-10-03T10:11:03.783 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:11:03.784+0000 7f51942d9700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:03.785 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:11:03.785+0000 7f1ff9c09700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:03.785 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:11:03.786+0000 7f6e09094700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:03.787 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:11:03.787+0000 7fc7ae854700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:11:05.812 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:05.939 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.939+0000 7f0a6aa47700 1 Processor -- start 2023-10-03T10:11:05.939 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.939+0000 7f0a6aa47700 1 -- start start 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a6aa47700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 0x7f0a64095bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a6aa47700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a64130910 0x7f0a64132d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a6aa47700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a64094ee0 con 0x7f0a640960a0 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a6aa47700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a64096b50 con 0x7f0a64130910 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a6aa47700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64092f30 con 0x7f0a640957d0 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 0x7f0a64095bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a68fe4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a64130910 0x7f0a64132d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:05.941 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a637fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0a640960a0 0x7f0a6412f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39148/0 (socket says 172.21.15.19:39148) 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a637fe700 1 -- 172.21.15.19:0/2477665331 learned_addr learned my addr 172.21.15.19:0/2477665331 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 0x7f0a64095bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43276/0 (socket says 172.21.15.19:43276) 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a62ffd700 1 -- 172.21.15.19:0/2477665331 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816458927 0 0) 0x7f0a64094ee0 con 0x7f0a640960a0 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.940+0000 7f0a62ffd700 1 -- 172.21.15.19:0/2477665331 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a4c0033f0 con 0x7f0a640960a0 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a68fe4700 1 -- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 msgr2=0x7f0a64095bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a68fe4700 1 --2- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 0x7f0a64095bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a68fe4700 1 -- 172.21.15.19:0/2477665331 >> v1:172.21.15.19:6789/0 conn(0x7f0a640960a0 legacy=0x7f0a6412f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a68fe4700 1 -- 172.21.15.19:0/2477665331 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640632f0 con 0x7f0a64130910 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a68fe4700 1 --2- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a64130910 0x7f0a64132d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0a5c009ec0 tx=0x7f0a5c009780).ready entity=mon.0 client_cookie=efe538cfa459eca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a62ffd700 1 -- 172.21.15.19:0/2477665331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00e070 con 0x7f0a64130910 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a62ffd700 1 -- 172.21.15.19:0/2477665331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c00bb00 con 0x7f0a64130910 2023-10-03T10:11:05.942 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a62ffd700 1 -- 172.21.15.19:0/2477665331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c00be80 con 0x7f0a64130910 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a64130910 msgr2=0x7f0a64132d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.941+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a64130910 0x7f0a64132d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f0a5c009ec0 tx=0x7f0a5c009780).stop 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2477665331 shutdown_connections 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a64130910 0x7f0a64132d00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2477665331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a640957d0 0x7f0a64095bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2477665331 >> 172.21.15.19:0/2477665331 conn(0x7f0a6409ab90 msgr2=0x7f0a6409afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2477665331 shutdown_connections 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2477665331 wait complete. 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.942+0000 7f0a6aa47700 1 Processor -- start 2023-10-03T10:11:05.945 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 -- start start 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 0x7f0a641176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a64130910 0x7f0a64117ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6412d780 con 0x7f0a640960a0 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64119c90 con 0x7f0a640957d0 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a6aa47700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64096df0 con 0x7f0a64130910 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a637fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 0x7f0a641176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a63fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51416/0 (socket says 172.21.15.19:51416) 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a63fff700 1 -- 172.21.15.19:0/2739159248 learned_addr learned my addr 172.21.15.19:0/2739159248 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.943+0000 7f0a68fe4700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a64130910 0x7f0a64117ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 -- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a64130910 msgr2=0x7f0a64117ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:05.946 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a64130910 0x7f0a64117ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 -- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 msgr2=0x7f0a6411b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 -- 172.21.15.19:0/2739159248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c009a20 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a63fff700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a637fe700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 0x7f0a641176b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0a6409a930 tx=0x7f0a58007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580070d0 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a58007250 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6411b100 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58007610 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.944+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641193b0 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.945+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0a580059b0 con 0x7f0a640960a0 2023-10-03T10:11:05.947 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.945+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7f0a5803a0f0 con 0x7f0a640960a0 2023-10-03T10:11:05.948 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.945+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6405a260 con 0x7f0a640960a0 2023-10-03T10:11:05.950 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:05.950+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0a58018030 con 0x7f0a640960a0 2023-10-03T10:11:06.129 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.129+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a64092bd0 con 0x7f0a640960a0 2023-10-03T10:11:06.130 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.130+0000 7f0a4bfff700 1 -- 172.21.15.19:0/2739159248 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6597 (secure 0 0 0) 0x7f0a58013970 con 0x7f0a640960a0 2023-10-03T10:11:06.130 INFO:teuthology.misc.health.smithi019.stdout: 2023-10-03T10:11:06.130 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:05.778766+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 >> v1:172.21.15.19:6816/118286 conn(0x7f0a5002bb90 legacy=0x7f0a5002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 msgr2=0x7f0a641176b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 0x7f0a641176b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f0a6409a930 tx=0x7f0a58007bd0).stop 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 shutdown_connections 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a64130910 0x7f0a64117ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a640957d0 0x7f0a6411b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.132 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 --2- 172.21.15.19:0/2739159248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a640960a0 0x7f0a641176b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.133 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 >> 172.21.15.19:0/2739159248 conn(0x7f0a6409ab90 msgr2=0x7f0a64111990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:06.133 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 shutdown_connections 2023-10-03T10:11:06.133 INFO:teuthology.misc.health.smithi019.stderr:2023-10-03T10:11:06.132+0000 7f0a6aa47700 1 -- 172.21.15.19:0/2739159248 wait complete. 2023-10-03T10:11:06.144 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-10-03T10:11:06.144 INFO:tasks.ceph:Creating RBD pool 2023-10-03T10:11:06.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-03T10:11:06.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.273+0000 7f3017ad8700 1 Processor -- start 2023-10-03T10:11:06.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 -- start start 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010096d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3010095e60 con 0x7f301012d230 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3010068d40 con 0x7f30100694d0 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3017ad8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3010068fb0 con 0x7f3010096900 2023-10-03T10:11:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3015874700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3015073700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010096d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3016075700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3015874700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51430/0 (socket says 172.21.15.19:51430) 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3016075700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47658/0 (socket says 172.21.15.19:47658) 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3015073700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010096d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:43290/0 (socket says 172.21.15.19:43290) 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.274+0000 7f3015874700 1 -- 172.21.15.19:0/1019778041 learned_addr learned my addr 172.21.15.19:0/1019778041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 -- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 msgr2=0x7f3010096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 --2- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010096d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 -- 172.21.15.19:0/1019778041 >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 msgr2=0x7f301012f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 --2- 172.21.15.19:0/1019778041 >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 -- 172.21.15.19:0/1019778041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010068a10 con 0x7f30100694d0 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3016075700 1 --2- 172.21.15.19:0/1019778041 >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3015874700 1 --2- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f300c006fd0 tx=0x7f300c0090f0).ready entity=mon.1 client_cookie=736d019ca5574b61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3014872700 1 -- 172.21.15.19:0/1019778041 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00f510 con 0x7f30100694d0 2023-10-03T10:11:06.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3014872700 1 -- 172.21.15.19:0/1019778041 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c00f670 con 0x7f30100694d0 2023-10-03T10:11:06.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.275+0000 7f3014872700 1 -- 172.21.15.19:0/1019778041 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c00f9f0 con 0x7f30100694d0 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 -- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 msgr2=0x7f3010096410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 --2- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f300c006fd0 tx=0x7f300c0090f0).stop 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 -- 172.21.15.19:0/1019778041 shutdown_connections 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 --2- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30100694d0 0x7f3010096410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 --2- 172.21.15.19:0/1019778041 >> v2:172.21.15.19:3300/0 conn(0x7f301012d230 0x7f301012f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 --2- 172.21.15.19:0/1019778041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010096d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 -- 172.21.15.19:0/1019778041 >> 172.21.15.19:0/1019778041 conn(0x7f301009ba60 msgr2=0x7f301009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 -- 172.21.15.19:0/1019778041 shutdown_connections 2023-10-03T10:11:06.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.276+0000 7f3017ad8700 1 -- 172.21.15.19:0/1019778041 wait complete. 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.277+0000 7f3017ad8700 1 Processor -- start 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.277+0000 7f3017ad8700 1 -- start start 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010117cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 0x7f30101181e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010067d80 con 0x7f30100694d0 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301012cdf0 con 0x7f301012d230 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3017ad8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f301011b780 con 0x7f3010096900 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3015874700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 0x7f30101181e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3015874700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47670/0 (socket says 172.21.15.19:47670) 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3015874700 1 -- 172.21.15.19:0/3706587197 learned_addr learned my addr 172.21.15.19:0/3706587197 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:06.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3015073700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010117cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 -- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 msgr2=0x7f3010117cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010117cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 -- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 msgr2=0x7f301011bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 -- 172.21.15.19:0/3706587197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008009a20 con 0x7f301012d230 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3015874700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.278+0000 7f3016075700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 0x7f30101181e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3008009f10 tx=0x7f300800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.279+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800cb70 con 0x7f301012d230 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.279+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300800f040 con 0x7f301012d230 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.279+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c009370 con 0x7f301012d230 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.279+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3008013400 con 0x7f301012d230 2023-10-03T10:11:06.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.279+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3010119870 con 0x7f301012d230 2023-10-03T10:11:06.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.280+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301011b3a0 con 0x7f301012d230 2023-10-03T10:11:06.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.281+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f30080137f0 con 0x7f301012d230 2023-10-03T10:11:06.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.281+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2461+0+0 (secure 0 0 0) 0x7f300803bdf0 con 0x7f301012d230 2023-10-03T10:11:06.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.285+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f3008013aa0 con 0x7f301012d230 2023-10-03T10:11:06.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.463+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f301005a260 con 0x7f301012d230 2023-10-03T10:11:06.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.798+0000 7f3001ffb700 1 -- 172.21.15.19:0/3706587197 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v11) v1 ==== 109+0+0 (secure 0 0 0) 0x7f300802a0a0 con 0x7f301012d230 2023-10-03T10:11:06.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 >> v1:172.21.15.19:6816/118286 conn(0x7f2ff402bb60 legacy=0x7f2ff402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 msgr2=0x7f30101181e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 0x7f30101181e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f3008009f10 tx=0x7f300800b040).stop 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 shutdown_connections 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f301012d230 0x7f30101181e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30100694d0 0x7f301011bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 --2- 172.21.15.19:0/3706587197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3010096900 0x7f3010117cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 >> 172.21.15.19:0/3706587197 conn(0x7f301009ba60 msgr2=0x7f301009a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 shutdown_connections 2023-10-03T10:11:06.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.802+0000 7f3017ad8700 1 -- 172.21.15.19:0/3706587197 wait complete. 2023-10-03T10:11:06.807 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2023-10-03T10:11:06.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-03T10:11:06.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.953+0000 7f639d84c700 1 Processor -- start 2023-10-03T10:11:06.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.953+0000 7f639d84c700 1 -- start start 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f639d84c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6398059070 0x7f63981287a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f639d84c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f639d84c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6398129670 con 0x7f6398128dc0 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f639d84c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6398059450 con 0x7f6398059070 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f639d84c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f639806a7e0 con 0x7f63981291e0 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f63977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f6396ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6398059070 0x7f63981287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f63977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45342/0 (socket says 172.21.15.19:45342) 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f6396ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6398059070 0x7f63981287a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42030/0 (socket says 172.21.15.19:42030) 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f63977fe700 1 -- 172.21.15.19:0/2692544094 learned_addr learned my addr 172.21.15.19:0/2692544094 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.954+0000 7f63967fc700 1 --1- 172.21.15.19:0/2692544094 >> v1:172.21.15.19:6789/0 conn(0x7f6398128dc0 0x7f6398093bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49726/0 (socket says 172.21.15.19:49726) 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6396ffd700 1 -- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 msgr2=0x7f6398094300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6396ffd700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6396ffd700 1 -- 172.21.15.19:0/2692544094 >> v1:172.21.15.19:6789/0 conn(0x7f6398128dc0 legacy=0x7f6398093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6396ffd700 1 -- 172.21.15.19:0/2692544094 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980956b0 con 0x7f6398059070 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f63977fe700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6396ffd700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f63981287a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6388009760 tx=0x7f6388009060).ready entity=mon.0 client_cookie=cebef1a078da5e74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6395ffb700 1 -- 172.21.15.19:0/2692544094 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800f510 con 0x7f6398059070 2023-10-03T10:11:06.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6395ffb700 1 -- 172.21.15.19:0/2692544094 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638800f670 con 0x7f6398059070 2023-10-03T10:11:06.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.955+0000 7f6395ffb700 1 -- 172.21.15.19:0/2692544094 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800f9f0 con 0x7f6398059070 2023-10-03T10:11:06.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 -- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 msgr2=0x7f63981287a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f63981287a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f6388009760 tx=0x7f6388009060).stop 2023-10-03T10:11:06.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 -- 172.21.15.19:0/2692544094 shutdown_connections 2023-10-03T10:11:06.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398094300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 --2- 172.21.15.19:0/2692544094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f63981287a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 -- 172.21.15.19:0/2692544094 >> 172.21.15.19:0/2692544094 conn(0x7f6398097560 msgr2=0x7f6398097970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 -- 172.21.15.19:0/2692544094 shutdown_connections 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.956+0000 7f639d84c700 1 -- 172.21.15.19:0/2692544094 wait complete. 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 Processor -- start 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 -- start start 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 0x7f6398111c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398112110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6398115120 con 0x7f6398059070 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6398115cf0 con 0x7f6398128dc0 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f639d84c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6398123b20 con 0x7f63981291e0 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f6396ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f63967fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 0x7f6398111c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f63977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398112110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f6396ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42038/0 (socket says 172.21.15.19:42038) 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.957+0000 7f6396ffd700 1 -- 172.21.15.19:0/247284066 learned_addr learned my addr 172.21.15.19:0/247284066 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 -- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 msgr2=0x7f6398111c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 0x7f6398111c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 -- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 msgr2=0x7f6398122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 -- 172.21.15.19:0/247284066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009ae0 con 0x7f63981291e0 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f6396ffd700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63967fc700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 0x7f6398111c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f63977fe700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398112110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6390009f10 tx=0x7f639000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:06.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900092e0 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639000f040 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63880092a0 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639000cb70 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.958+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6398113020 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.959+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6390014460 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.959+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2827+0+0 (secure 0 0 0) 0x7f639003abc0 con 0x7f63981291e0 2023-10-03T10:11:06.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.959+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6398115620 con 0x7f63981291e0 2023-10-03T10:11:06.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:06.964+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f639001cd30 con 0x7f63981291e0 2023-10-03T10:11:07.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.142+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f639805a260 con 0x7f63981291e0 2023-10-03T10:11:07.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.806+0000 7f637effd700 1 -- 172.21.15.19:0/247284066 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v12) v1 ==== 173+0+0 (secure 0 0 0) 0x7f639001cb50 con 0x7f63981291e0 2023-10-03T10:11:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 >> v1:172.21.15.19:6816/118286 conn(0x7f638402bb90 legacy=0x7f638402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 msgr2=0x7f6398112110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398112110 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f6390009f10 tx=0x7f639000b040).stop 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 shutdown_connections 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63981291e0 0x7f6398112110 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6398059070 0x7f6398122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 --2- 172.21.15.19:0/247284066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6398128dc0 0x7f6398111c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 >> 172.21.15.19:0/247284066 conn(0x7f6398097560 msgr2=0x7f6398126ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 shutdown_connections 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.809+0000 7f639d84c700 1 -- 172.21.15.19:0/247284066 wait complete. 2023-10-03T10:11:07.810 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-03T10:11:07.826 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-03T10:11:07.826 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:11:07.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:11:07.829 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:11:07.829 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-03T10:11:07.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:07.915 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-10-03T10:11:07.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 Processor -- start 2023-10-03T10:11:07.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 -- start start 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 0x7fd4400986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440132480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd440096160 con 0x7fd440097c30 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4400654d0 con 0x7fd4400650f0 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd445b12700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd440065dd0 con 0x7fd4400992a0 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd43f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 0x7fd4400986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd43effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd440097c30 0x7fd440098b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49760/0 (socket says 172.21.15.19:49760) 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd43ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440132480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.965+0000 7fd43effd700 1 -- 172.21.15.19:0/159468908 learned_addr learned my addr 172.21.15.19:0/159468908 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:07.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43ffff700 1 -- 172.21.15.19:0/159468908 >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 msgr2=0x7fd4400986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43ffff700 1 --2- 172.21.15.19:0/159468908 >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 0x7fd4400986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43ffff700 1 -- 172.21.15.19:0/159468908 >> v1:172.21.15.19:6789/0 conn(0x7fd440097c30 legacy=0x7fd440098b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43ffff700 1 -- 172.21.15.19:0/159468908 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440099790 con 0x7fd4400992a0 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43f7fe700 1 --2- 172.21.15.19:0/159468908 >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 0x7fd4400986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43e7fc700 1 -- 172.21.15.19:0/159468908 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343089097 0 0) 0x7fd440096160 con 0x7fd440097c30 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43ffff700 1 --2- 172.21.15.19:0/159468908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440132480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd438009e60 tx=0x7fd438009780).ready entity=mon.1 client_cookie=172bc0d9965564ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43e7fc700 1 -- 172.21.15.19:0/159468908 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800e070 con 0x7fd4400992a0 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43e7fc700 1 -- 172.21.15.19:0/159468908 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43800bb60 con 0x7fd4400992a0 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.966+0000 7fd43e7fc700 1 -- 172.21.15.19:0/159468908 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438012410 con 0x7fd4400992a0 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 -- 172.21.15.19:0/159468908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 msgr2=0x7fd440132480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 --2- 172.21.15.19:0/159468908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440132480 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fd438009e60 tx=0x7fd438009780).stop 2023-10-03T10:11:07.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 -- 172.21.15.19:0/159468908 shutdown_connections 2023-10-03T10:11:07.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 --2- 172.21.15.19:0/159468908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440132480 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 --2- 172.21.15.19:0/159468908 >> v2:172.21.15.19:3300/0 conn(0x7fd4400650f0 0x7fd4400986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 -- 172.21.15.19:0/159468908 >> 172.21.15.19:0/159468908 conn(0x7fd44009dc70 msgr2=0x7fd44009e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:07.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 -- 172.21.15.19:0/159468908 shutdown_connections 2023-10-03T10:11:07.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.967+0000 7fd445b12700 1 -- 172.21.15.19:0/159468908 wait complete. 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 Processor -- start 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 -- start start 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440066e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 0x7fd440067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44006a9e0 con 0x7fd4400672f0 2023-10-03T10:11:07.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44006a280 con 0x7fd4400992a0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd445b12700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd440099a80 con 0x7fd4400650f0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.968+0000 7fd43f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440066e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45378/0 (socket says 172.21.15.19:45378) 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43f7fe700 1 -- 172.21.15.19:0/2213960297 learned_addr learned my addr 172.21.15.19:0/2213960297 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43ffff700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 0x7fd440067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 -- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 msgr2=0x7fd440066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 -- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 msgr2=0x7fd440067750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 0x7fd440067750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 -- 172.21.15.19:0/2213960297 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4300092a0 con 0x7fd4400992a0 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43ffff700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 0x7fd440067750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:07.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43f7fe700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd43effd700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440066e00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd434000c00 tx=0x7fd434007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4340070d0 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434007250 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434007610 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd438009a20 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.969+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd440069ca0 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.970+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd4340059b0 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.970+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fd43403a200 con 0x7fd4400992a0 2023-10-03T10:11:07.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.970+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44005a260 con 0x7fd4400992a0 2023-10-03T10:11:07.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:07.975+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd434013970 con 0x7fd4400992a0 2023-10-03T10:11:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.151+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4400973a0 con 0x7fd4400992a0 2023-10-03T10:11:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.151+0000 7fd4277fe700 1 -- 172.21.15.19:0/2213960297 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+8137 (secure 0 0 0) 0x7fd434010300 con 0x7fd4400992a0 2023-10-03T10:11:08.151 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:08.152 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":12,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:07.794264+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:08.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 >> v1:172.21.15.19:6816/118286 conn(0x7fd42c02bb90 legacy=0x7fd42c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 msgr2=0x7fd440066e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440066e00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd434000c00 tx=0x7fd434007b90).stop 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 shutdown_connections 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4400672f0 0x7fd440067750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd4400650f0 0x7fd440066910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 --2- 172.21.15.19:0/2213960297 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd4400992a0 0x7fd440066e00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 >> 172.21.15.19:0/2213960297 conn(0x7fd44009dc70 msgr2=0x7fd44009a810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 shutdown_connections 2023-10-03T10:11:08.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.153+0000 7fd445b12700 1 -- 172.21.15.19:0/2213960297 wait complete. 2023-10-03T10:11:08.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:11:08.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:11:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.299+0000 7f30396a5700 1 Processor -- start 2023-10-03T10:11:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.299+0000 7f30396a5700 1 -- start start 2023-10-03T10:11:08.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 0x7f3034127980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340664f0 con 0x7f303412add0 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3034065d80 con 0x7f3034066110 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30396a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3034065c20 con 0x7f30341274d0 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f3032ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30327fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 0x7f3034127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f3032ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59908/0 (socket says 172.21.15.19:59908) 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30327fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42070/0 (socket says 172.21.15.19:42070) 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f3032ffd700 1 -- 172.21.15.19:0/4057307449 learned_addr learned my addr 172.21.15.19:0/4057307449 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:08.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 -- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 msgr2=0x7f3034097420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 -- 172.21.15.19:0/4057307449 >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 msgr2=0x7f303412b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 --2- 172.21.15.19:0/4057307449 >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 -- 172.21.15.19:0/4057307449 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3034064e80 con 0x7f30341274d0 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30327fc700 1 --2- 172.21.15.19:0/4057307449 >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f3032ffd700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.300+0000 7f30337fe700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 0x7f3034127980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f302c009e60 tx=0x7f302c009780).ready entity=mon.2 client_cookie=25adc43a4fa510b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f3031ffb700 1 -- 172.21.15.19:0/4057307449 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00e070 con 0x7f30341274d0 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f3031ffb700 1 -- 172.21.15.19:0/4057307449 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c00bab0 con 0x7f30341274d0 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f3031ffb700 1 -- 172.21.15.19:0/4057307449 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00be30 con 0x7f30341274d0 2023-10-03T10:11:08.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 -- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 msgr2=0x7f3034127980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 0x7f3034127980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f302c009e60 tx=0x7f302c009780).stop 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 -- 172.21.15.19:0/4057307449 shutdown_connections 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3034066110 0x7f3034097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 --2- 172.21.15.19:0/4057307449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30341274d0 0x7f3034127980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 --2- 172.21.15.19:0/4057307449 >> v2:172.21.15.19:3300/0 conn(0x7f303412add0 0x7f303412b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 -- 172.21.15.19:0/4057307449 >> 172.21.15.19:0/4057307449 conn(0x7f303409ba60 msgr2=0x7f303409be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 -- 172.21.15.19:0/4057307449 shutdown_connections 2023-10-03T10:11:08.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.301+0000 7f30396a5700 1 -- 172.21.15.19:0/4057307449 wait complete. 2023-10-03T10:11:08.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.302+0000 7f30396a5700 1 Processor -- start 2023-10-03T10:11:08.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.302+0000 7f30396a5700 1 -- start start 2023-10-03T10:11:08.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3034066110 0x7f3034116e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 0x7f3034114320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3034125320 con 0x7f30341274d0 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30341173c0 con 0x7f303412add0 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30396a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3034117f90 con 0x7f3034066110 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42082/0 (socket says 172.21.15.19:42082) 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 -- 172.21.15.19:0/4250165155 learned_addr learned my addr 172.21.15.19:0/4250165155 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30337fe700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 0x7f3034114320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f3032ffd700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3034066110 0x7f3034116e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 -- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3034066110 msgr2=0x7f3034116e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3034066110 0x7f3034116e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 -- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 msgr2=0x7f3034114320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 0x7f3034114320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30327fc700 1 -- 172.21.15.19:0/4250165155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009370 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.303+0000 7f30337fe700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 0x7f3034114320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f30327fc700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f301c00e960 tx=0x7f301c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c009580 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c012600 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c012980 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301c0092a0 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.304+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c009a20 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.305+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f301c012d30 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.305+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f301c03b020 con 0x7f30341274d0 2023-10-03T10:11:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.305+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30341178a0 con 0x7f30341274d0 2023-10-03T10:11:08.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.310+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f301c016030 con 0x7f30341274d0 2023-10-03T10:11:08.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.484+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f303405a260 con 0x7f30341274d0 2023-10-03T10:11:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.485+0000 7f302affd700 1 -- 172.21.15.19:0/4250165155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v12) v1 ==== 110+0+10 (secure 0 0 0) 0x7f301c016020 con 0x7f30341274d0 2023-10-03T10:11:08.485 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 >> v1:172.21.15.19:6816/118286 conn(0x7f301402bb60 legacy=0x7f301402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 msgr2=0x7f3034113e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f301c00e960 tx=0x7f301c009060).stop 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 shutdown_connections 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f303412add0 0x7f3034114320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3034066110 0x7f3034116e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 --2- 172.21.15.19:0/4250165155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30341274d0 0x7f3034113e30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 >> 172.21.15.19:0/4250165155 conn(0x7f303409ba60 msgr2=0x7f30341292d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 shutdown_connections 2023-10-03T10:11:08.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.487+0000 7f30396a5700 1 -- 172.21.15.19:0/4250165155 wait complete. 2023-10-03T10:11:08.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:08.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 Processor -- start 2023-10-03T10:11:08.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 -- start start 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bf412f430 0x7f1bf4131820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf4065e80 con 0x7f1bf412f430 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf40663b0 con 0x7f1bf40653a0 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf998a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf4065780 con 0x7f1bf4098b30 2023-10-03T10:11:08.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bf412f430 0x7f1bf4131820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59918/0 (socket says 172.21.15.19:59918) 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45404/0 (socket says 172.21.15.19:45404) 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf2ffd700 1 -- 172.21.15.19:0/1687626272 learned_addr learned my addr 172.21.15.19:0/1687626272 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.633+0000 7f1bf37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1bf412f430 0x7f1bf4131820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42086/0 (socket says 172.21.15.19:42086) 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 -- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 msgr2=0x7f1bf4098f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 -- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 msgr2=0x7f1bf4098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 -- 172.21.15.19:0/1687626272 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4096180 con 0x7f1bf412f430 2023-10-03T10:11:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf2ffd700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf27fc700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf37fe700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf412f430 0x7f1bf4131820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1bec009e90 tx=0x7f1bec009780).ready entity=mon.0 client_cookie=8faf4cd53cff937f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf1ffb700 1 -- 172.21.15.19:0/1687626272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00e070 con 0x7f1bf412f430 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf1ffb700 1 -- 172.21.15.19:0/1687626272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec00ba70 con 0x7f1bf412f430 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.634+0000 7f1bf1ffb700 1 -- 172.21.15.19:0/1687626272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec00bdf0 con 0x7f1bf412f430 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 -- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf412f430 msgr2=0x7f1bf4131820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf412f430 0x7f1bf4131820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f1bec009e90 tx=0x7f1bec009780).stop 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 -- 172.21.15.19:0/1687626272 shutdown_connections 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf40653a0 0x7f1bf4098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf412f430 0x7f1bf4131820 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 --2- 172.21.15.19:0/1687626272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf4098f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 -- 172.21.15.19:0/1687626272 >> 172.21.15.19:0/1687626272 conn(0x7f1bf409dc20 msgr2=0x7f1bf409e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 -- 172.21.15.19:0/1687626272 shutdown_connections 2023-10-03T10:11:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.635+0000 7f1bf998a700 1 -- 172.21.15.19:0/1687626272 wait complete. 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.636+0000 7f1bf998a700 1 Processor -- start 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.636+0000 7f1bf998a700 1 -- start start 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf411a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf412f430 0x7f1bf411acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf411c9d0 con 0x7f1bf40653a0 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf411b760 con 0x7f1bf412f430 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf998a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf411ea80 con 0x7f1bf4098b30 2023-10-03T10:11:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42092/0 (socket says 172.21.15.19:42092) 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf411a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf2ffd700 1 -- 172.21.15.19:0/3099483684 learned_addr learned my addr 172.21.15.19:0/3099483684 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf37fe700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf412f430 0x7f1bf411acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf2ffd700 1 -- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 msgr2=0x7f1bf411a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.637+0000 7f1bf2ffd700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf411a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf2ffd700 1 -- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf412f430 msgr2=0x7f1bf411acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf2ffd700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf412f430 0x7f1bf411acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf2ffd700 1 -- 172.21.15.19:0/3099483684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be4009370 con 0x7f1bf40653a0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf27fc700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf411a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf2ffd700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1be400ea50 tx=0x7f1be40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400ee90 con 0x7f1bf40653a0 2023-10-03T10:11:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be400c850 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be80092a0 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be400cbd0 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.638+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bec009a20 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.639+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f1be401b400 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.639+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f1be403b1c0 con 0x7f1bf40653a0 2023-10-03T10:11:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.639+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf405a260 con 0x7f1bf40653a0 2023-10-03T10:11:08.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.644+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1be4016020 con 0x7f1bf40653a0 2023-10-03T10:11:08.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.819+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1bf4091ee0 con 0x7f1bf40653a0 2023-10-03T10:11:08.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.819+0000 7f1bdaffd700 1 -- 172.21.15.19:0/3099483684 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1be401be60 con 0x7f1bf40653a0 2023-10-03T10:11:08.820 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:11:08.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 >> v1:172.21.15.19:6816/118286 conn(0x7f1be002bb60 legacy=0x7f1be002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 msgr2=0x7f1bf411a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1be400ea50 tx=0x7f1be40090f0).stop 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 shutdown_connections 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1bf412f430 0x7f1bf411acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bf40653a0 0x7f1bf411a2d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 --2- 172.21.15.19:0/3099483684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1bf4098b30 0x7f1bf411a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 >> 172.21.15.19:0/3099483684 conn(0x7f1bf409dc20 msgr2=0x7f1bf409bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 shutdown_connections 2023-10-03T10:11:08.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.821+0000 7f1bf998a700 1 -- 172.21.15.19:0/3099483684 wait complete. 2023-10-03T10:11:08.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.965+0000 7f7f5a8a4700 1 Processor -- start 2023-10-03T10:11:08.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.965+0000 7f7f5a8a4700 1 -- start start 2023-10-03T10:11:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f5a8a4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 0x7f7f5412fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f5a8a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 0x7f7f54132150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f5a8a4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f54091b60 con 0x7f7f54059070 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f5a8a4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f54059450 con 0x7f7f54127390 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f5a8a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f540968c0 con 0x7f7f54127fa0 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f537fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 0x7f7f5412fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 0x7f7f54132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f53fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7f54059070 0x7f7f54127890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49766/0 (socket says 172.21.15.19:49766) 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f53fff700 1 -- 172.21.15.19:0/3596742985 learned_addr learned my addr 172.21.15.19:0/3596742985 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f52ffd700 1 -- 172.21.15.19:0/3596742985 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623203132 0 0) 0x7f7f54091b60 con 0x7f7f54059070 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f52ffd700 1 -- 172.21.15.19:0/3596742985 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f400033f0 con 0x7f7f54059070 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 -- 172.21.15.19:0/3596742985 >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 msgr2=0x7f7f5412fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 --2- 172.21.15.19:0/3596742985 >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 0x7f7f5412fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 -- 172.21.15.19:0/3596742985 >> v1:172.21.15.19:6789/0 conn(0x7f7f54059070 legacy=0x7f7f54127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 -- 172.21.15.19:0/3596742985 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54092a10 con 0x7f7f54127fa0 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f537fe700 1 --2- 172.21.15.19:0/3596742985 >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 0x7f7f5412fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f58e41700 1 --2- 172.21.15.19:0/3596742985 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 0x7f7f54132150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7f4c009e60 tx=0x7f7f4c009780).ready entity=mon.2 client_cookie=de85d8a75091cba9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.966+0000 7f7f52ffd700 1 -- 172.21.15.19:0/3596742985 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00e070 con 0x7f7f54127fa0 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f52ffd700 1 -- 172.21.15.19:0/3596742985 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c00bab0 con 0x7f7f54127fa0 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f52ffd700 1 -- 172.21.15.19:0/3596742985 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00be30 con 0x7f7f54127fa0 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/3596742985 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 msgr2=0x7f7f54132150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/3596742985 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 0x7f7f54132150 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f7f4c009e60 tx=0x7f7f4c009780).stop 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/3596742985 shutdown_connections 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/3596742985 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54127fa0 0x7f7f54132150 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/3596742985 >> v2:172.21.15.19:3300/0 conn(0x7f7f54127390 0x7f7f5412fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/3596742985 >> 172.21.15.19:0/3596742985 conn(0x7f7f54097470 msgr2=0x7f7f54097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/3596742985 shutdown_connections 2023-10-03T10:11:08.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.967+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/3596742985 wait complete. 2023-10-03T10:11:08.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.968+0000 7f7f5a8a4700 1 Processor -- start 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.968+0000 7f7f5a8a4700 1 -- start start 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54059070 0x7f7f54126e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54130b60 con 0x7f7f54127fa0 2023-10-03T10:11:08.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54131310 con 0x7f7f54127390 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f5a8a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54111fa0 con 0x7f7f54059070 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59938/0 (socket says 172.21.15.19:59938) 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42102/0 (socket says 172.21.15.19:42102) 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f537fe700 1 -- 172.21.15.19:0/1598615408 learned_addr learned my addr 172.21.15.19:0/1598615408 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:08.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f53fff700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54059070 0x7f7f54126e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 -- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54059070 msgr2=0x7f7f54126e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54059070 0x7f7f54126e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 -- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 msgr2=0x7f7f5412f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 -- 172.21.15.19:0/1598615408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0092a0 con 0x7f7f54127fa0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f537fe700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.969+0000 7f7f58e41700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7f4c014000 tx=0x7f7f54092520).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c007080 con 0x7f7f54127fa0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f4c013e40 con 0x7f7f54127fa0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f4c009a20 con 0x7f7f54127fa0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c01d860 con 0x7f7f54127fa0 2023-10-03T10:11:08.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f54096ea0 con 0x7f7f54127fa0 2023-10-03T10:11:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.970+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7f4c003040 con 0x7f7f54127fa0 2023-10-03T10:11:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.971+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f7f4c03c8f0 con 0x7f7f54127fa0 2023-10-03T10:11:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.971+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f54091d80 con 0x7f7f54127fa0 2023-10-03T10:11:08.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:08.975+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7f4c027460 con 0x7f7f54127fa0 2023-10-03T10:11:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.193+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f54112450 con 0x7f7f54127fa0 2023-10-03T10:11:09.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.193+0000 7f7f4bfff700 1 -- 172.21.15.19:0/1598615408 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1194 (secure 0 0 0) 0x7f7f4c025360 con 0x7f7f54127fa0 2023-10-03T10:11:09.194 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:09.194 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4189,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-03T10:11:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 >> v1:172.21.15.19:6816/118286 conn(0x7f7f3402bb60 legacy=0x7f7f3402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 msgr2=0x7f7f5412fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f7f4c014000 tx=0x7f7f54092520).stop 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 shutdown_connections 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f54127fa0 0x7f7f5412fbe0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f54059070 0x7f7f54126e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 --2- 172.21.15.19:0/1598615408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f54127390 0x7f7f5412f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 >> 172.21.15.19:0/1598615408 conn(0x7f7f54097470 msgr2=0x7f7f54099f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.195+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 shutdown_connections 2023-10-03T10:11:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.196+0000 7f7f5a8a4700 1 -- 172.21.15.19:0/1598615408 wait complete. 2023-10-03T10:11:09.197 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 2 2023-10-03T10:11:09.209 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.338+0000 7f956a3db700 1 Processor -- start 2023-10-03T10:11:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.338+0000 7f956a3db700 1 -- start start 2023-10-03T10:11:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 0x7f956412aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 0x7f956412b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9564066590 con 0x7f9564127570 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95640656f0 con 0x7f95640661b0 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f956a3db700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95640649f0 con 0x7f9564064570 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9568978700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f95637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 0x7f956412b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 0x7f956412aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9568978700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42104/0 (socket says 172.21.15.19:42104) 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9568978700 1 -- 172.21.15.19:0/1246753866 learned_addr learned my addr 172.21.15.19:0/1246753866 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 -- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 msgr2=0x7f956412b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 0x7f956412b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 -- 172.21.15.19:0/1246753866 >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 msgr2=0x7f95641279f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 --2- 172.21.15.19:0/1246753866 >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 -- 172.21.15.19:0/1246753866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956412af80 con 0x7f95640661b0 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f95637fe700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 0x7f956412b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9568978700 1 --2- 172.21.15.19:0/1246753866 >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9563fff700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 0x7f956412aa90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9554009760 tx=0x7f9554009060).ready entity=mon.1 client_cookie=12dd3b1a2931b884 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.339+0000 7f9562ffd700 1 -- 172.21.15.19:0/1246753866 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400d4a0 con 0x7f95640661b0 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f9562ffd700 1 -- 172.21.15.19:0/1246753866 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400d600 con 0x7f95640661b0 2023-10-03T10:11:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f9562ffd700 1 -- 172.21.15.19:0/1246753866 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400d980 con 0x7f95640661b0 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 -- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 msgr2=0x7f956412aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 0x7f956412aa90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9554009760 tx=0x7f9554009060).stop 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 -- 172.21.15.19:0/1246753866 shutdown_connections 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95640661b0 0x7f956412aa90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 --2- 172.21.15.19:0/1246753866 >> v2:172.21.15.19:3300/0 conn(0x7f9564127570 0x7f95641279f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 --2- 172.21.15.19:0/1246753866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564064570 0x7f956412b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 -- 172.21.15.19:0/1246753866 >> 172.21.15.19:0/1246753866 conn(0x7f956409ba50 msgr2=0x7f956409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 -- 172.21.15.19:0/1246753866 shutdown_connections 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.340+0000 7f956a3db700 1 -- 172.21.15.19:0/1246753866 wait complete. 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.341+0000 7f956a3db700 1 Processor -- start 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.341+0000 7f956a3db700 1 -- start start 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95640661b0 0x7f9564113930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 0x7f9564113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95640650b0 con 0x7f95640661b0 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9564114da0 con 0x7f9564064570 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f956a3db700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9564117460 con 0x7f9564127570 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9568978700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 0x7f9564113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59944/0 (socket says 172.21.15.19:59944) 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 -- 172.21.15.19:0/2229858483 learned_addr learned my addr 172.21.15.19:0/2229858483 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f95637fe700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95640661b0 0x7f9564113930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 -- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 msgr2=0x7f9564113e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 0x7f9564113e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 -- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95640661b0 msgr2=0x7f9564113930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95640661b0 0x7f9564113930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 -- 172.21.15.19:0/2229858483 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580092a0 con 0x7f9564064570 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9568978700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 0x7f9564113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f9563fff700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9554011fb0 tx=0x7f9554016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:09.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.342+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400dd30 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955400de90 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955400d980 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f955c009ae0 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540092a0 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f955401d640 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.343+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f955403c220 con 0x7f9564064570 2023-10-03T10:11:09.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.344+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9564117080 con 0x7f9564064570 2023-10-03T10:11:09.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.348+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f955401d8f0 con 0x7f9564064570 2023-10-03T10:11:09.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.525+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956405a260 con 0x7f9564064570 2023-10-03T10:11:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.526+0000 7f954bfff700 1 -- 172.21.15.19:0/2229858483 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+8124 (secure 0 0 0) 0x7f9554010360 con 0x7f9564064570 2023-10-03T10:11:09.526 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:09.526 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:08.801650+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":11,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 >> v1:172.21.15.19:6816/118286 conn(0x7f955002bb60 legacy=0x7f955002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 msgr2=0x7f9564124a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f9554011fb0 tx=0x7f9554016000).stop 2023-10-03T10:11:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 shutdown_connections 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9564127570 0x7f9564113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9564064570 0x7f9564124a90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 --2- 172.21.15.19:0/2229858483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95640661b0 0x7f9564113930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 >> 172.21.15.19:0/2229858483 conn(0x7f956409ba50 msgr2=0x7f9564129760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 shutdown_connections 2023-10-03T10:11:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.528+0000 7f956a3db700 1 -- 172.21.15.19:0/2229858483 wait complete. 2023-10-03T10:11:09.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-03T10:11:09.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.674+0000 7f5e45f6f700 1 Processor -- start 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.674+0000 7f5e45f6f700 1 -- start start 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e45f6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e45f6f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e4012d160 0x7f5e4012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e45f6f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40092d80 con 0x7f5e40098c80 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e45f6f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e40093c20 con 0x7f5e4012d160 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e45f6f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40092b90 con 0x7f5e40093840 2023-10-03T10:11:09.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e3ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e4012d160 0x7f5e4012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e3effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5e40098c80 0x7f5e40099060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49772/0 (socket says 172.21.15.19:49772) 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.675+0000 7f5e3effd700 1 -- 172.21.15.19:0/2688791774 learned_addr learned my addr 172.21.15.19:0/2688791774 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3ffff700 1 -- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 msgr2=0x7f5e40098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3ffff700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3ffff700 1 -- 172.21.15.19:0/2688791774 >> v1:172.21.15.19:6789/0 conn(0x7f5e40098c80 legacy=0x7f5e40099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3ffff700 1 -- 172.21.15.19:0/2688791774 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40099b70 con 0x7f5e4012d160 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3e7fc700 1 -- 172.21.15.19:0/2688791774 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457564138 0 0) 0x7f5e40092d80 con 0x7f5e40098c80 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3f7fe700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3ffff700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e4012d160 0x7f5e4012f550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e38009e90 tx=0x7f5e38009780).ready entity=mon.0 client_cookie=8bf02c51da1d20ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3e7fc700 1 -- 172.21.15.19:0/2688791774 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800e070 con 0x7f5e4012d160 2023-10-03T10:11:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3e7fc700 1 -- 172.21.15.19:0/2688791774 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800bb20 con 0x7f5e4012d160 2023-10-03T10:11:09.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e3e7fc700 1 -- 172.21.15.19:0/2688791774 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800bea0 con 0x7f5e4012d160 2023-10-03T10:11:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 -- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e4012d160 msgr2=0x7f5e4012f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e4012d160 0x7f5e4012f550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f5e38009e90 tx=0x7f5e38009780).stop 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 -- 172.21.15.19:0/2688791774 shutdown_connections 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e4012d160 0x7f5e4012f550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/2688791774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.676+0000 7f5e45f6f700 1 -- 172.21.15.19:0/2688791774 >> 172.21.15.19:0/2688791774 conn(0x7f5e40097480 msgr2=0x7f5e40097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.677+0000 7f5e45f6f700 1 -- 172.21.15.19:0/2688791774 shutdown_connections 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.677+0000 7f5e45f6f700 1 -- 172.21.15.19:0/2688791774 wait complete. 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 Processor -- start 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 -- start start 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e40098c80 0x7f5e40066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 0x7f5e40066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400673e0 con 0x7f5e40098c80 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4011d600 con 0x7f5e4012d160 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e45f6f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40064d30 con 0x7f5e40093840 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 0x7f5e40066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45474/0 (socket says 172.21.15.19:45474) 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e3f7fe700 1 -- 172.21.15.19:0/948777606 learned_addr learned my addr 172.21.15.19:0/948777606 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.678+0000 7f5e3effd700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e40098c80 0x7f5e40066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 -- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 msgr2=0x7f5e40066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 0x7f5e40066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 -- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e40098c80 msgr2=0x7f5e40066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e40098c80 0x7f5e40066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 -- 172.21.15.19:0/948777606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300092a0 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3ffff700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 0x7f5e40066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e3f7fe700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5e3000ea20 tx=0x7f5e30009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000ee60 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000c850 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e38009a20 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000cbd0 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.679+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40068000 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.680+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5e3001b400 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.680+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7f5e3003b210 con 0x7f5e40093840 2023-10-03T10:11:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.680+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4011c400 con 0x7f5e40093840 2023-10-03T10:11:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.685+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5e30019900 con 0x7f5e40093840 2023-10-03T10:11:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.860+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5e4005a260 con 0x7f5e40093840 2023-10-03T10:11:09.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.860+0000 7f5e277fe700 1 -- 172.21.15.19:0/948777606 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5e30019310 con 0x7f5e40093840 2023-10-03T10:11:09.860 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.862+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 >> v1:172.21.15.19:6816/118286 conn(0x7f5e2c02bb90 legacy=0x7f5e2c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 msgr2=0x7f5e40066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5e3000ea20 tx=0x7f5e30009060).stop 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 shutdown_connections 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e4012d160 0x7f5e40066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e40093840 0x7f5e40066510 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 --2- 172.21.15.19:0/948777606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e40098c80 0x7f5e40066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:09.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 >> 172.21.15.19:0/948777606 conn(0x7f5e40097480 msgr2=0x7f5e40068920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 shutdown_connections 2023-10-03T10:11:09.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:09.863+0000 7f5e45f6f700 1 -- 172.21.15.19:0/948777606 wait complete. 2023-10-03T10:11:09.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 Processor -- start 2023-10-03T10:11:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 -- start start 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff860098ea0 0x7ff8600992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860092d80 con 0x7ff860093840 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860093c20 con 0x7ff860098ea0 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff866424700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff860092b90 con 0x7ff86012d160 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff85f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff860098ea0 0x7ff8600992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff8649c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff85ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff860093840 0x7ff860098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49776/0 (socket says 172.21.15.19:49776) 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff85f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff860098ea0 0x7ff8600992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42150/0 (socket says 172.21.15.19:42150) 2023-10-03T10:11:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff8649c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45486/0 (socket says 172.21.15.19:45486) 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.009+0000 7ff85ffff700 1 -- 172.21.15.19:0/2987165571 learned_addr learned my addr 172.21.15.19:0/2987165571 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85f7fe700 1 -- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 msgr2=0x7ff86012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85f7fe700 1 -- 172.21.15.19:0/2987165571 >> v1:172.21.15.19:6789/0 conn(0x7ff860093840 legacy=0x7ff860098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85f7fe700 1 -- 172.21.15.19:0/2987165571 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860099b70 con 0x7ff860098ea0 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85effd700 1 -- 172.21.15.19:0/2987165571 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345174401 0 0) 0x7ff860092d80 con 0x7ff860093840 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff8649c1700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff8600992b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff854009760 tx=0x7ff854009060).ready entity=mon.0 client_cookie=6b9c18c67bce7381 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85effd700 1 -- 172.21.15.19:0/2987165571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400f510 con 0x7ff860098ea0 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85effd700 1 -- 172.21.15.19:0/2987165571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85400f670 con 0x7ff860098ea0 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff85effd700 1 -- 172.21.15.19:0/2987165571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400f9f0 con 0x7ff860098ea0 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff866424700 1 -- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 msgr2=0x7ff8600992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.010+0000 7ff866424700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff8600992b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7ff854009760 tx=0x7ff854009060).stop 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 -- 172.21.15.19:0/2987165571 shutdown_connections 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 --2- 172.21.15.19:0/2987165571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff8600992b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 -- 172.21.15.19:0/2987165571 >> 172.21.15.19:0/2987165571 conn(0x7ff860097480 msgr2=0x7ff860097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 -- 172.21.15.19:0/2987165571 shutdown_connections 2023-10-03T10:11:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 -- 172.21.15.19:0/2987165571 wait complete. 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.011+0000 7ff866424700 1 Processor -- start 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 -- start start 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff860116380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff860116870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860116d60 con 0x7ff860098ea0 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86006a520 con 0x7ff860093840 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff866424700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff860119610 con 0x7ff86012d160 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff860116380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59964/0 (socket says 172.21.15.19:59964) 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.012+0000 7ff85ffff700 1 -- 172.21.15.19:0/888428717 learned_addr learned my addr 172.21.15.19:0/888428717 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff8649c1700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff860116870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 -- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 msgr2=0x7ff860116870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff860116870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 -- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 msgr2=0x7ff860115e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 -- 172.21.15.19:0/888428717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009a20 con 0x7ff860098ea0 2023-10-03T10:11:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85ffff700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff860116380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff860065790 tx=0x7ff854017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400f7e0 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85400f980 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8540092a0 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85401b660 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.013+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff860119350 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.014+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff85401b9d0 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.014+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7ff85403c550 con 0x7ff860098ea0 2023-10-03T10:11:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.014+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86005a260 con 0x7ff860098ea0 2023-10-03T10:11:10.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.019+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff854029080 con 0x7ff860098ea0 2023-10-03T10:11:10.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.195+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8600699a0 con 0x7ff860098ea0 2023-10-03T10:11:10.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.195+0000 7ff847fff700 1 -- 172.21.15.19:0/888428717 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff85401f020 con 0x7ff860098ea0 2023-10-03T10:11:10.195 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 >> v1:172.21.15.19:6816/118286 conn(0x7ff84c02bb60 legacy=0x7ff84c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 msgr2=0x7ff860116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff860116380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7ff860065790 tx=0x7ff854017000).stop 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 shutdown_connections 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff86012d160 0x7ff860116870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860093840 0x7ff860115e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 --2- 172.21.15.19:0/888428717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff860098ea0 0x7ff860116380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 >> 172.21.15.19:0/888428717 conn(0x7ff860097480 msgr2=0x7ff860068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:10.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 shutdown_connections 2023-10-03T10:11:10.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.197+0000 7ff866424700 1 -- 172.21.15.19:0/888428717 wait complete. 2023-10-03T10:11:10.211 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-03T10:11:10.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.340+0000 7fe4fb799700 1 Processor -- start 2023-10-03T10:11:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 -- start start 2023-10-03T10:11:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 0x7fe4f4130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f4132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f4065ed0 con 0x7fe4f40654a0 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4095880 con 0x7fe4f4099190 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4fb799700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4096120 con 0x7fe4f4098d50 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4f9d36700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f4132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4f9535700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe4f40654a0 0x7fe4f4098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49782/0 (socket says 172.21.15.19:49782) 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4f9535700 1 -- 172.21.15.19:0/1489059440 learned_addr learned my addr 172.21.15.19:0/1489059440 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.341+0000 7fe4f8d34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 0x7fe4f4130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f9d36700 1 -- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 msgr2=0x7fe4f4130480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f9d36700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 0x7fe4f4130480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4ebfff700 1 -- 172.21.15.19:0/1489059440 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621751072 0 0) 0x7fe4f4065ed0 con 0x7fe4f40654a0 2023-10-03T10:11:10.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f9d36700 1 -- 172.21.15.19:0/1489059440 >> v1:172.21.15.19:6789/0 conn(0x7fe4f40654a0 legacy=0x7fe4f4098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f9d36700 1 -- 172.21.15.19:0/1489059440 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f4066280 con 0x7fe4f4099190 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f8d34700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 0x7fe4f4130480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4f9d36700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f4132980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4ec009ec0 tx=0x7fe4ec009780).ready entity=mon.1 client_cookie=78eb6c066c5651a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4ebfff700 1 -- 172.21.15.19:0/1489059440 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00e070 con 0x7fe4f4099190 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4ebfff700 1 -- 172.21.15.19:0/1489059440 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00bbf0 con 0x7fe4f4099190 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4ebfff700 1 -- 172.21.15.19:0/1489059440 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec012410 con 0x7fe4f4099190 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 -- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 msgr2=0x7fe4f4132980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f4132980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4ec009ec0 tx=0x7fe4ec009780).stop 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 -- 172.21.15.19:0/1489059440 shutdown_connections 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f4132980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 --2- 172.21.15.19:0/1489059440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f4098d50 0x7fe4f4130480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.342+0000 7fe4fb799700 1 -- 172.21.15.19:0/1489059440 >> 172.21.15.19:0/1489059440 conn(0x7fe4f409a740 msgr2=0x7fe4f409ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:10.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.343+0000 7fe4fb799700 1 -- 172.21.15.19:0/1489059440 shutdown_connections 2023-10-03T10:11:10.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.343+0000 7fe4fb799700 1 -- 172.21.15.19:0/1489059440 wait complete. 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.343+0000 7fe4fb799700 1 Processor -- start 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 -- start start 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f40654a0 0x7fe4f413a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f413ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f411df00 con 0x7fe4f4098d50 2023-10-03T10:11:10.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4099b00 con 0x7fe4f4099190 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4fb799700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f409c870 con 0x7fe4f40654a0 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4f8d34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4f9535700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f40654a0 0x7fe4f413a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4f9d36700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f413ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4f8d34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42170/0 (socket says 172.21.15.19:42170) 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.344+0000 7fe4f8d34700 1 -- 172.21.15.19:0/3472689808 learned_addr learned my addr 172.21.15.19:0/3472689808 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 -- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f40654a0 msgr2=0x7fe4f413a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f40654a0 0x7fe4f413a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 -- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 msgr2=0x7fe4f413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f413ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 -- 172.21.15.19:0/3472689808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e40092a0 con 0x7fe4f4098d50 2023-10-03T10:11:10.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f9d36700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4f8d34700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe4e400ea00 tx=0x7fe4e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400c6a0 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400c800 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec009a20 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400cb80 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.345+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f411e710 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.346+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe4e401b400 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.346+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fe4e403aff0 con 0x7fe4f4098d50 2023-10-03T10:11:10.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.346+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f411e710 con 0x7fe4f4098d50 2023-10-03T10:11:10.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.351+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe4f411e710 con 0x7fe4f4098d50 2023-10-03T10:11:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.527+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe4f411e710 con 0x7fe4f4098d50 2023-10-03T10:11:10.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.527+0000 7fe4e97fa700 1 -- 172.21.15.19:0/3472689808 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v13) v1 ==== 84+0+143 (secure 0 0 0) 0x7fe4f411e710 con 0x7fe4f4098d50 2023-10-03T10:11:10.527 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:10.527 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": "device_health_metrics" 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 2, 2023-10-03T10:11:10.528 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": "rbd" 2023-10-03T10:11:10.529 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:11:10.529 INFO:teuthology.orchestra.run.smithi019.stdout:] 2023-10-03T10:11:10.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 >> v1:172.21.15.19:6816/118286 conn(0x7fe4d802bb60 legacy=0x7fe4d802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 msgr2=0x7fe4f413a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe4e400ea00 tx=0x7fe4e4009060).stop 2023-10-03T10:11:10.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 shutdown_connections 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4f4099190 0x7fe4f413ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4f40654a0 0x7fe4f413a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 --2- 172.21.15.19:0/3472689808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f4098d50 0x7fe4f413a680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 >> 172.21.15.19:0/3472689808 conn(0x7fe4f409a740 msgr2=0x7fe4f409dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 shutdown_connections 2023-10-03T10:11:10.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.529+0000 7fe4fb799700 1 -- 172.21.15.19:0/3472689808 wait complete. 2023-10-03T10:11:10.542 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-03T10:11:10.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-03T10:11:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.677+0000 7fb291698700 1 Processor -- start 2023-10-03T10:11:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.677+0000 7fb291698700 1 -- start start 2023-10-03T10:11:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb291698700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 0x7fb28c098710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb291698700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 0x7fb28c132500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb291698700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28c065fe0 con 0x7fb28c097ef0 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb291698700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c0657d0 con 0x7fb28c0653f0 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb291698700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c095b50 con 0x7fb28c099310 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 0x7fb28c132500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28a7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb28c097ef0 0x7fb28c098c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49788/0 (socket says 172.21.15.19:49788) 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28a7fc700 1 -- 172.21.15.19:0/943760525 learned_addr learned my addr 172.21.15.19:0/943760525 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28affd700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 0x7fb28c098710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 -- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 msgr2=0x7fb28c098710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 0x7fb28c098710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb289ffb700 1 -- 172.21.15.19:0/943760525 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274699043 0 0) 0x7fb28c065fe0 con 0x7fb28c097ef0 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 -- 172.21.15.19:0/943760525 >> v1:172.21.15.19:6789/0 conn(0x7fb28c097ef0 legacy=0x7fb28c098c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 -- 172.21.15.19:0/943760525 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28c0663b0 con 0x7fb28c099310 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28affd700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 0x7fb28c098710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb28b7fe700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 0x7fb28c132500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb284009e90 tx=0x7fb284009780).ready entity=mon.2 client_cookie=ea1eead97f20f1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.678+0000 7fb289ffb700 1 -- 172.21.15.19:0/943760525 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28400e070 con 0x7fb28c099310 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb289ffb700 1 -- 172.21.15.19:0/943760525 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28400bb60 con 0x7fb28c099310 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb289ffb700 1 -- 172.21.15.19:0/943760525 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb284012410 con 0x7fb28c099310 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 -- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 msgr2=0x7fb28c132500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 0x7fb28c132500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fb284009e90 tx=0x7fb284009780).stop 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 -- 172.21.15.19:0/943760525 shutdown_connections 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c099310 0x7fb28c132500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 --2- 172.21.15.19:0/943760525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c0653f0 0x7fb28c098710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 -- 172.21.15.19:0/943760525 >> 172.21.15.19:0/943760525 conn(0x7fb28c09dcf0 msgr2=0x7fb28c09e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 -- 172.21.15.19:0/943760525 shutdown_connections 2023-10-03T10:11:10.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.679+0000 7fb291698700 1 -- 172.21.15.19:0/943760525 wait complete. 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.680+0000 7fb291698700 1 Processor -- start 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.680+0000 7fb291698700 1 -- start start 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c099310 0x7fb28c1321a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 0x7fb28c11a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c099da0 con 0x7fb28c0653f0 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c11db00 con 0x7fb28c099310 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb291698700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb28c094770 con 0x7fb28c11a140 2023-10-03T10:11:10.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 0x7fb28c11a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42186/0 (socket says 172.21.15.19:42186) 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 -- 172.21.15.19:0/2220383812 learned_addr learned my addr 172.21.15.19:0/2220383812 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28a7fc700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c099310 0x7fb28c1321a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 -- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 msgr2=0x7fb28c11a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 0x7fb28c11a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 -- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c099310 msgr2=0x7fb28c1321a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c099310 0x7fb28c1321a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 -- 172.21.15.19:0/2220383812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0092a0 con 0x7fb28c0653f0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28b7fe700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 0x7fb28c11a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb28affd700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb27c00ea20 tx=0x7fb27c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00ee60 con 0x7fb28c0653f0 2023-10-03T10:11:10.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.681+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c00c850 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.682+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb284009a20 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.682+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00cbd0 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.682+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28c132850 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.683+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb28c11d920 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.683+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb27c01b400 con 0x7fb28c0653f0 2023-10-03T10:11:10.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.683+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2838+0+0 (secure 0 0 0) 0x7fb27c03b5e0 con 0x7fb28c0653f0 2023-10-03T10:11:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.687+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb27c023b00 con 0x7fb28c0653f0 2023-10-03T10:11:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:10.864+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb28c05a260 con 0x7fb28c0653f0 2023-10-03T10:11:11.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.824+0000 7fb282ffd700 1 -- 172.21.15.19:0/2220383812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v14) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb27c029070 con 0x7fb28c0653f0 2023-10-03T10:11:11.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 >> v1:172.21.15.19:6816/118286 conn(0x7fb26c02bb60 legacy=0x7fb26c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 msgr2=0x7fb28c11e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb27c00ea20 tx=0x7fb27c009060).stop 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 shutdown_connections 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb28c11a140 0x7fb28c11a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb28c0653f0 0x7fb28c11e000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 --2- 172.21.15.19:0/2220383812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb28c099310 0x7fb28c1321a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.829+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 >> 172.21.15.19:0/2220383812 conn(0x7fb28c09dcf0 msgr2=0x7fb28c096880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.831+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 shutdown_connections 2023-10-03T10:11:11.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.831+0000 7fb291698700 1 -- 172.21.15.19:0/2220383812 wait complete. 2023-10-03T10:11:11.837 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2023-10-03T10:11:11.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-03T10:11:11.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 Processor -- start 2023-10-03T10:11:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 -- start start 2023-10-03T10:11:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 0x7f8734127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 0x7f87340953f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:11.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8734092a50 con 0x7f87340958e0 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8734091ba0 con 0x7f8734059070 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.993+0000 7f873b51c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8734091e60 con 0x7f8734127d80 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 0x7f87340953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f87392b8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 0x7f8734127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8739ab9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f87340958e0 0x7f8734131d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49804/0 (socket says 172.21.15.19:49804) 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8739ab9700 1 -- 172.21.15.19:0/212188359 learned_addr learned my addr 172.21.15.19:0/212188359 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 -- 172.21.15.19:0/212188359 >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 msgr2=0x7f8734127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 --2- 172.21.15.19:0/212188359 >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 0x7f8734127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 -- 172.21.15.19:0/212188359 >> v1:172.21.15.19:6789/0 conn(0x7f87340958e0 legacy=0x7f8734131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f872bfff700 1 -- 172.21.15.19:0/212188359 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768721145 0 0) 0x7f8734092a50 con 0x7f87340958e0 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 -- 172.21.15.19:0/212188359 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734097220 con 0x7f8734127d80 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f87392b8700 1 --2- 172.21.15.19:0/212188359 >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 0x7f8734127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:11.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f8738ab7700 1 --2- 172.21.15.19:0/212188359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 0x7f87340953f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8730009760 tx=0x7f8730009060).ready entity=mon.2 client_cookie=753e0c472439a207 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:11.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f872bfff700 1 -- 172.21.15.19:0/212188359 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000f510 con 0x7f8734127d80 2023-10-03T10:11:11.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f872bfff700 1 -- 172.21.15.19:0/212188359 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000f670 con 0x7f8734127d80 2023-10-03T10:11:11.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.994+0000 7f872bfff700 1 -- 172.21.15.19:0/212188359 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000f9f0 con 0x7f8734127d80 2023-10-03T10:11:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 -- 172.21.15.19:0/212188359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 msgr2=0x7f87340953f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:11.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 --2- 172.21.15.19:0/212188359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 0x7f87340953f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f8730009760 tx=0x7f8730009060).stop 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 -- 172.21.15.19:0/212188359 shutdown_connections 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 --2- 172.21.15.19:0/212188359 >> v2:172.21.15.19:3300/0 conn(0x7f8734059070 0x7f8734127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 --2- 172.21.15.19:0/212188359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734127d80 0x7f87340953f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 -- 172.21.15.19:0/212188359 >> 172.21.15.19:0/212188359 conn(0x7f87340974f0 msgr2=0x7f8734097900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 -- 172.21.15.19:0/212188359 shutdown_connections 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.995+0000 7f873b51c700 1 -- 172.21.15.19:0/212188359 wait complete. 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.996+0000 7f873b51c700 1 Processor -- start 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.996+0000 7f873b51c700 1 -- start start 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 0x7f87340664a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 0x7f8734066990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:11.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8734067940 con 0x7f8734127d80 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8734097010 con 0x7f87340958e0 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f873406a500 con 0x7f8734059070 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87392b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 0x7f8734066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87392b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45534/0 (socket says 172.21.15.19:45534) 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87392b8700 1 -- 172.21.15.19:0/73337752 learned_addr learned my addr 172.21.15.19:0/73337752 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8738ab7700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 0x7f87340664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 -- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 msgr2=0x7f87340693e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 -- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 msgr2=0x7f87340664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 0x7f87340664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:12.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 -- 172.21.15.19:0/73337752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87240092a0 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87392b8700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8738ab7700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 0x7f87340664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f8739ab9700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 0x7f8734066990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f872c002230 tx=0x7f872c007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c005d30 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c005e90 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87300092a0 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.997+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c007360 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.998+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8734068030 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.998+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f872c007710 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.999+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3208+0+0 (secure 0 0 0) 0x7f872c03ad40 con 0x7f8734127d80 2023-10-03T10:11:12.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:11.999+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734098a50 con 0x7f8734127d80 2023-10-03T10:11:12.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.004+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f872c01c3e0 con 0x7f8734127d80 2023-10-03T10:11:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.179+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8734069b60 con 0x7f8734127d80 2023-10-03T10:11:12.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.829+0000 7f87297fa700 1 -- 172.21.15.19:0/73337752 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v15) v1 ==== 170+0+0 (secure 0 0 0) 0x7f872c01a300 con 0x7f8734127d80 2023-10-03T10:11:12.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 >> v1:172.21.15.19:6816/118286 conn(0x7f871802bb60 legacy=0x7f871802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 msgr2=0x7f8734066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 0x7f8734066990 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f872c002230 tx=0x7f872c007eb0).stop 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 shutdown_connections 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8734127d80 0x7f8734066990 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8734059070 0x7f87340693e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 --2- 172.21.15.19:0/73337752 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f87340958e0 0x7f87340664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.841+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 >> 172.21.15.19:0/73337752 conn(0x7f87340974f0 msgr2=0x7f87340942e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.842+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 shutdown_connections 2023-10-03T10:11:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:12.843+0000 7f873b51c700 1 -- 172.21.15.19:0/73337752 wait complete. 2023-10-03T10:11:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2023-10-03T10:11:12.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-03T10:11:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.003+0000 7fb04b9cd700 1 Processor -- start 2023-10-03T10:11:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 -- start start 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 0x7fb0440992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 0x7fb04412f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb044092d80 con 0x7fb044093840 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb044093c20 con 0x7fb044098ea0 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb04b9cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb044092b90 con 0x7fb04412d160 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb049f6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 0x7fb04412f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb048f68700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 0x7fb0440992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb049769700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb044093840 0x7fb044098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49806/0 (socket says 172.21.15.19:49806) 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.004+0000 7fb049769700 1 -- 172.21.15.19:0/891348198 learned_addr learned my addr 172.21.15.19:0/891348198 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb049f6a700 1 -- 172.21.15.19:0/891348198 >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 msgr2=0x7fb0440992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb049f6a700 1 --2- 172.21.15.19:0/891348198 >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 0x7fb0440992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb049f6a700 1 -- 172.21.15.19:0/891348198 >> v1:172.21.15.19:6789/0 conn(0x7fb044093840 legacy=0x7fb044098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb049f6a700 1 -- 172.21.15.19:0/891348198 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb044099b70 con 0x7fb04412d160 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb048f68700 1 --2- 172.21.15.19:0/891348198 >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 0x7fb0440992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb049f6a700 1 --2- 172.21.15.19:0/891348198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 0x7fb04412f550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb03c009e60 tx=0x7fb03c009780).ready entity=mon.2 client_cookie=6e6310ac1a2c8f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb03bfff700 1 -- 172.21.15.19:0/891348198 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00e070 con 0x7fb04412d160 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb03bfff700 1 -- 172.21.15.19:0/891348198 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00bb60 con 0x7fb04412d160 2023-10-03T10:11:13.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb03bfff700 1 -- 172.21.15.19:0/891348198 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c012410 con 0x7fb04412d160 2023-10-03T10:11:13.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb04b9cd700 1 -- 172.21.15.19:0/891348198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 msgr2=0x7fb04412f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.005+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/891348198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 0x7fb04412f550 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fb03c009e60 tx=0x7fb03c009780).stop 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 -- 172.21.15.19:0/891348198 shutdown_connections 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/891348198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04412d160 0x7fb04412f550 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/891348198 >> v2:172.21.15.19:3300/0 conn(0x7fb044098ea0 0x7fb0440992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 -- 172.21.15.19:0/891348198 >> 172.21.15.19:0/891348198 conn(0x7fb044097480 msgr2=0x7fb044097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 -- 172.21.15.19:0/891348198 shutdown_connections 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.006+0000 7fb04b9cd700 1 -- 172.21.15.19:0/891348198 wait complete. 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 Processor -- start 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 -- start start 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 0x7fb044116c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 0x7fb044117180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044096d80 con 0x7fb04412d160 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04406a4f0 con 0x7fb044093840 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb04b9cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb044118c00 con 0x7fb044098ea0 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb049f6a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb049769700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 0x7fb044116c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb048f68700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 0x7fb044117180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb049f6a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42220/0 (socket says 172.21.15.19:42220) 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.007+0000 7fb049f6a700 1 -- 172.21.15.19:0/152334556 learned_addr learned my addr 172.21.15.19:0/152334556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 -- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 msgr2=0x7fb044116c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 0x7fb044116c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 -- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 msgr2=0x7fb044117670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 -- 172.21.15.19:0/152334556 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0340092a0 con 0x7fb044098ea0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb049769700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 0x7fb044116c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb049f6a700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb048f68700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 0x7fb044117180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb03400e980 tx=0x7fb034009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034012600 con 0x7fb044098ea0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb034012760 con 0x7fb044098ea0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c009a20 con 0x7fb044098ea0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb034012ae0 con 0x7fb044098ea0 2023-10-03T10:11:13.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.008+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04411e300 con 0x7fb044098ea0 2023-10-03T10:11:13.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.009+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb03401b400 con 0x7fb044098ea0 2023-10-03T10:11:13.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.009+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04405a260 con 0x7fb044098ea0 2023-10-03T10:11:13.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.010+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3590+0+0 (secure 0 0 0) 0x7fb03403b3e0 con 0x7fb044098ea0 2023-10-03T10:11:13.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.014+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb034019900 con 0x7fb044098ea0 2023-10-03T10:11:13.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.230+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb044046c20 con 0x7fb044098ea0 2023-10-03T10:11:13.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.241+0000 7fb0397fa700 1 -- 172.21.15.19:0/152334556 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v3) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb034019310 con 0x7fb044098ea0 2023-10-03T10:11:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.265+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 >> v1:172.21.15.19:6816/118286 conn(0x7fb02802bb60 legacy=0x7fb02802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.265+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 msgr2=0x7fb044117180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.265+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 0x7fb044117180 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fb03400e980 tx=0x7fb034009060).stop 2023-10-03T10:11:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.266+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 shutdown_connections 2023-10-03T10:11:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.266+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04412d160 0x7fb044117670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.266+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb044093840 0x7fb044116c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.266+0000 7fb04b9cd700 1 --2- 172.21.15.19:0/152334556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb044098ea0 0x7fb044117180 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.266+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 >> 172.21.15.19:0/152334556 conn(0x7fb044097480 msgr2=0x7fb044110fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.269+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 shutdown_connections 2023-10-03T10:11:13.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.269+0000 7fb04b9cd700 1 -- 172.21.15.19:0/152334556 wait complete. 2023-10-03T10:11:13.274 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 3 and data pool 4 2023-10-03T10:11:13.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:13.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 Processor -- start 2023-10-03T10:11:13.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 -- start start 2023-10-03T10:11:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5610095f00 con 0x7f5610093bf0 2023-10-03T10:11:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5610059450 con 0x7f56101251c0 2023-10-03T10:11:13.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f5615baf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5610096190 con 0x7f5610059070 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60026/0 (socket says 172.21.15.19:60026) 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5610093bf0 0x7f5610094050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49818/0 (socket says 172.21.15.19:49818) 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45562/0 (socket says 172.21.15.19:45562) 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.423+0000 7f560effd700 1 -- 172.21.15.19:0/1036582735 learned_addr learned my addr 172.21.15.19:0/1036582735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560f7fe700 1 -- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 msgr2=0x7f5610125bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560f7fe700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560f7fe700 1 -- 172.21.15.19:0/1036582735 >> v1:172.21.15.19:6789/0 conn(0x7f5610093bf0 legacy=0x7f5610094050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560f7fe700 1 -- 172.21.15.19:0/1036582735 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56101260a0 con 0x7f5610059070 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560e7fc700 1 -- 172.21.15.19:0/1036582735 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801815146 0 0) 0x7f5610095f00 con 0x7f5610093bf0 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560effd700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560f7fe700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f56000097c0 tx=0x7f5600009060).ready entity=mon.2 client_cookie=684241658a9f8b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560e7fc700 1 -- 172.21.15.19:0/1036582735 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000f510 con 0x7f5610059070 2023-10-03T10:11:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560e7fc700 1 -- 172.21.15.19:0/1036582735 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560000f670 con 0x7f5610059070 2023-10-03T10:11:13.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.424+0000 7f560e7fc700 1 -- 172.21.15.19:0/1036582735 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000f9f0 con 0x7f5610059070 2023-10-03T10:11:13.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 -- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 msgr2=0x7f56101256c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f56000097c0 tx=0x7f5600009060).stop 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 -- 172.21.15.19:0/1036582735 shutdown_connections 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610059070 0x7f56101256c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 --2- 172.21.15.19:0/1036582735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f5610125bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 -- 172.21.15.19:0/1036582735 >> 172.21.15.19:0/1036582735 conn(0x7f5610097470 msgr2=0x7f5610097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 -- 172.21.15.19:0/1036582735 shutdown_connections 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.425+0000 7f5615baf700 1 -- 172.21.15.19:0/1036582735 wait complete. 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 Processor -- start 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 -- start start 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 0x7f5610138570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f56100678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56100958d0 con 0x7f5610059070 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5610112060 con 0x7f56101251c0 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f5615baf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5610068d30 con 0x7f5610093bf0 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f560f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f560f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42236/0 (socket says 172.21.15.19:42236) 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f560ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f56100678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f560f7fe700 1 -- 172.21.15.19:0/1992546610 learned_addr learned my addr 172.21.15.19:0/1992546610 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.426+0000 7f560effd700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 0x7f5610138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 -- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 msgr2=0x7f5610138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 0x7f5610138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 -- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 msgr2=0x7f56100678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f56100678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 -- 172.21.15.19:0/1992546610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009370 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560ffff700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f56100678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560effd700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 0x7f5610138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f560f7fe700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5600009e60 tx=0x7f5600017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000f7e0 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560000f940 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56000092a0 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560001b660 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.427+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56101124e0 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.428+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f560001b9d0 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.428+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f560003c880 con 0x7f5610059070 2023-10-03T10:11:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.428+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5610111a10 con 0x7f5610059070 2023-10-03T10:11:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.433+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5610111a10 con 0x7f5610059070 2023-10-03T10:11:13.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.610+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f561005a260 con 0x7f5610059070 2023-10-03T10:11:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.611+0000 7f55f77fe700 1 -- 172.21.15.19:0/1992546610 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7f560001f080 con 0x7f5610059070 2023-10-03T10:11:13.611 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:13.611 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:13.231910+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 >> v1:172.21.15.19:6816/118286 conn(0x7f55fc02bb60 legacy=0x7f55fc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 msgr2=0x7f5610138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f5600009e60 tx=0x7f5600017000).stop 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 shutdown_connections 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56101251c0 0x7f56100678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5610059070 0x7f5610138080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 --2- 172.21.15.19:0/1992546610 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5610093bf0 0x7f5610138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 >> 172.21.15.19:0/1992546610 conn(0x7f5610097470 msgr2=0x7f56101287a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 shutdown_connections 2023-10-03T10:11:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.613+0000 7f5615baf700 1 -- 172.21.15.19:0/1992546610 wait complete. 2023-10-03T10:11:13.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:13.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.756+0000 7fca2ef7e700 1 Processor -- start 2023-10-03T10:11:13.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 -- start start 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 0x7fca2812c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 0x7fca2812f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca28096760 con 0x7fca28096380 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca28091ff0 con 0x7fca2812ce60 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2ef7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca28092c80 con 0x7fca28091b00 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2d51b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 0x7fca2812f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2cd1a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca28096380 0x7fca28094730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49822/0 (socket says 172.21.15.19:49822) 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca27fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 0x7fca2812c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.757+0000 7fca2cd1a700 1 -- 172.21.15.19:0/1840246072 learned_addr learned my addr 172.21.15.19:0/1840246072 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca277fe700 1 -- 172.21.15.19:0/1840246072 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809502612 0 0) 0x7fca28096760 con 0x7fca28096380 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca27fff700 1 -- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 msgr2=0x7fca2812f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca27fff700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 0x7fca2812f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca27fff700 1 -- 172.21.15.19:0/1840246072 >> v1:172.21.15.19:6789/0 conn(0x7fca28096380 legacy=0x7fca28094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca27fff700 1 -- 172.21.15.19:0/1840246072 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28094e40 con 0x7fca28091b00 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2d51b700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 0x7fca2812f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca27fff700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 0x7fca2812c970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fca10009790 tx=0x7fca10009060).ready entity=mon.2 client_cookie=ddd05ee3becd8dec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca277fe700 1 -- 172.21.15.19:0/1840246072 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000f510 con 0x7fca28091b00 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca277fe700 1 -- 172.21.15.19:0/1840246072 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000f670 con 0x7fca28091b00 2023-10-03T10:11:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca277fe700 1 -- 172.21.15.19:0/1840246072 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000f9f0 con 0x7fca28091b00 2023-10-03T10:11:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 msgr2=0x7fca2812c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 0x7fca2812c970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fca10009790 tx=0x7fca10009060).stop 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1840246072 shutdown_connections 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2812ce60 0x7fca2812f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1840246072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28091b00 0x7fca2812c970 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.758+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1840246072 >> 172.21.15.19:0/1840246072 conn(0x7fca28097470 msgr2=0x7fca28097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.759+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1840246072 shutdown_connections 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.759+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1840246072 wait complete. 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.759+0000 7fca2ef7e700 1 Processor -- start 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 -- start start 2023-10-03T10:11:13.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28096380 0x7fca28128740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 0x7fca28128c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca28129b40 con 0x7fca2812ce60 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2812c5b0 con 0x7fca28091b00 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2ef7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca28111210 con 0x7fca28096380 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2cd1a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2d51b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 0x7fca28128c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2cd1a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60060/0 (socket says 172.21.15.19:60060) 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca2cd1a700 1 -- 172.21.15.19:0/1375449685 learned_addr learned my addr 172.21.15.19:0/1375449685 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.760+0000 7fca27fff700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28096380 0x7fca28128740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 -- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28096380 msgr2=0x7fca28128740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28096380 0x7fca28128740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 -- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 msgr2=0x7fca28128c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 0x7fca28128c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 -- 172.21.15.19:0/1375449685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009a20 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2d51b700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 0x7fca28128c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2cd1a700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fca1800c4c0 tx=0x7fca18007c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180072e0 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca18007460 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca100092a0 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180059f0 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.761+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca2812c120 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.762+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fca18013450 con 0x7fca28091b00 2023-10-03T10:11:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.762+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fca1803a760 con 0x7fca28091b00 2023-10-03T10:11:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.762+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2805a260 con 0x7fca28091b00 2023-10-03T10:11:13.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.767+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fca1801c350 con 0x7fca28091b00 2023-10-03T10:11:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.941+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca28129540 con 0x7fca28091b00 2023-10-03T10:11:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.942+0000 7fca24ff9700 1 -- 172.21.15.19:0/1375449685 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11354 (secure 0 0 0) 0x7fca18011350 con 0x7fca28091b00 2023-10-03T10:11:13.942 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:13.942 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":16,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:13.231910+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 >> v1:172.21.15.19:6816/118286 conn(0x7fca0802bb90 legacy=0x7fca0802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 msgr2=0x7fca28124e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fca1800c4c0 tx=0x7fca18007c10).stop 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 shutdown_connections 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2812ce60 0x7fca28128c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca28091b00 0x7fca28124e60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 --2- 172.21.15.19:0/1375449685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca28096380 0x7fca28128740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:13.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 >> 172.21.15.19:0/1375449685 conn(0x7fca28097470 msgr2=0x7fca28098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:13.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 shutdown_connections 2023-10-03T10:11:13.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:13.944+0000 7fca2ef7e700 1 -- 172.21.15.19:0/1375449685 wait complete. 2023-10-03T10:11:13.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-03T10:11:14.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 Processor -- start 2023-10-03T10:11:14.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 -- start start 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 0x7fef98130c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef98095270 con 0x7fef98099010 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef98094d20 con 0x7fef98069430 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9e2df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98096520 con 0x7fef98098740 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef97fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef97fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60076/0 (socket says 172.21.15.19:60076) 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef9c87c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 0x7fef98130c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:14.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef977fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef98099010 0x7fef98068d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49836/0 (socket says 172.21.15.19:49836) 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.090+0000 7fef97fff700 1 -- 172.21.15.19:0/3890613643 learned_addr learned my addr 172.21.15.19:0/3890613643 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef97fff700 1 -- 172.21.15.19:0/3890613643 >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 msgr2=0x7fef98130c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef97fff700 1 --2- 172.21.15.19:0/3890613643 >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 0x7fef98130c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef97fff700 1 -- 172.21.15.19:0/3890613643 >> v1:172.21.15.19:6789/0 conn(0x7fef98099010 legacy=0x7fef98068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef97fff700 1 -- 172.21.15.19:0/3890613643 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98094870 con 0x7fef98098740 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef96ffd700 1 -- 172.21.15.19:0/3890613643 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453171662 0 0) 0x7fef98095270 con 0x7fef98099010 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef9c87c700 1 --2- 172.21.15.19:0/3890613643 >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 0x7fef98130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef97fff700 1 --2- 172.21.15.19:0/3890613643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fef88006fd0 tx=0x7fef880090f0).ready entity=mon.1 client_cookie=3d943389a337465b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef96ffd700 1 -- 172.21.15.19:0/3890613643 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800b580 con 0x7fef98098740 2023-10-03T10:11:14.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef96ffd700 1 -- 172.21.15.19:0/3890613643 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b6e0 con 0x7fef98098740 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.091+0000 7fef96ffd700 1 -- 172.21.15.19:0/3890613643 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800ba80 con 0x7fef98098740 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 -- 172.21.15.19:0/3890613643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 msgr2=0x7fef98098b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 --2- 172.21.15.19:0/3890613643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fef88006fd0 tx=0x7fef880090f0).stop 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 -- 172.21.15.19:0/3890613643 shutdown_connections 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 --2- 172.21.15.19:0/3890613643 >> v2:172.21.15.19:3300/0 conn(0x7fef98069430 0x7fef98130c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 --2- 172.21.15.19:0/3890613643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef98098b20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 -- 172.21.15.19:0/3890613643 >> 172.21.15.19:0/3890613643 conn(0x7fef9809a1c0 msgr2=0x7fef9809a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 -- 172.21.15.19:0/3890613643 shutdown_connections 2023-10-03T10:11:14.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.092+0000 7fef9e2df700 1 -- 172.21.15.19:0/3890613643 wait complete. 2023-10-03T10:11:14.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 Processor -- start 2023-10-03T10:11:14.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 -- start start 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef981387a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef98099010 0x7fef98116f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9812d070 con 0x7fef98069430 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef98094f70 con 0x7fef98098740 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef9e2df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9811a970 con 0x7fef98099010 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.093+0000 7fef97fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42272/0 (socket says 172.21.15.19:42272) 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 -- 172.21.15.19:0/2647816613 learned_addr learned my addr 172.21.15.19:0/2647816613 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef9c87c700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef98099010 0x7fef98116f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef977fe700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef981387a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 -- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef98099010 msgr2=0x7fef98116f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef98099010 0x7fef98116f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 -- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 msgr2=0x7fef981387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef981387a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 -- 172.21.15.19:0/2647816613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90009a20 con 0x7fef98069430 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef977fe700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef981387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef97fff700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef98096660 tx=0x7fef88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800be40 con 0x7fef98069430 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8800b850 con 0x7fef98069430 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef88009370 con 0x7fef98069430 2023-10-03T10:11:14.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8801c420 con 0x7fef98069430 2023-10-03T10:11:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.094+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9811b050 con 0x7fef98069430 2023-10-03T10:11:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.095+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fef8801c790 con 0x7fef98069430 2023-10-03T10:11:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.095+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fef8803ccd0 con 0x7fef98069430 2023-10-03T10:11:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.095+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9811a5f0 con 0x7fef98069430 2023-10-03T10:11:14.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.100+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fef9811a5f0 con 0x7fef98069430 2023-10-03T10:11:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:14.320+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fef9811a5f0 con 0x7fef98069430 2023-10-03T10:11:15.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.245+0000 7fef7ffff700 1 -- 172.21.15.19:0/2647816613 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fef9811a5f0 con 0x7fef98069430 2023-10-03T10:11:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 >> v1:172.21.15.19:6816/118286 conn(0x7fef8402bb60 legacy=0x7fef8402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 msgr2=0x7fef981382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef98096660 tx=0x7fef88017000).stop 2023-10-03T10:11:15.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 shutdown_connections 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef98099010 0x7fef98116f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef98069430 0x7fef981382b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 --2- 172.21.15.19:0/2647816613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef98098740 0x7fef981387a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 >> 172.21.15.19:0/2647816613 conn(0x7fef9809a1c0 msgr2=0x7fef98065d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 shutdown_connections 2023-10-03T10:11:15.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.248+0000 7fef9e2df700 1 -- 172.21.15.19:0/2647816613 wait complete. 2023-10-03T10:11:15.263 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-03T10:11:15.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:11:15.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.402+0000 7f868fed7700 1 Processor -- start 2023-10-03T10:11:15.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.402+0000 7f868fed7700 1 -- start start 2023-10-03T10:11:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868fed7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f868812c3c0 0x7f868812bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868fed7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 0x7f868812ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868fed7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868809a050 con 0x7f868812f320 2023-10-03T10:11:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868fed7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868806a750 con 0x7f868812c3c0 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868fed7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868812c1a0 con 0x7f86880925d0 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868d472700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 0x7f868812ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f868812c3c0 0x7f868812bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868e474700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f868812f320 0x7f8688136130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49852/0 (socket says 172.21.15.19:49852) 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868e474700 1 -- 172.21.15.19:0/2285260150 learned_addr learned my addr 172.21.15.19:0/2285260150 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 -- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 msgr2=0x7f868812ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 0x7f868812ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 -- 172.21.15.19:0/2285260150 >> v1:172.21.15.19:6789/0 conn(0x7f868812f320 legacy=0x7f8688136130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868cc71700 1 -- 172.21.15.19:0/2285260150 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617201212 0 0) 0x7f868809a050 con 0x7f868812f320 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 -- 172.21.15.19:0/2285260150 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8688091ed0 con 0x7f868812c3c0 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868d472700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 0x7f868812ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868dc73700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868812c3c0 0x7f868812bb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8684009760 tx=0x7f8684009060).ready entity=mon.0 client_cookie=c66ccc8b08219d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868cc71700 1 -- 172.21.15.19:0/2285260150 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400f510 con 0x7f868812c3c0 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868cc71700 1 -- 172.21.15.19:0/2285260150 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400f670 con 0x7f868812c3c0 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.403+0000 7f868cc71700 1 -- 172.21.15.19:0/2285260150 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400f9f0 con 0x7f868812c3c0 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 -- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868812c3c0 msgr2=0x7f868812bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868812c3c0 0x7f868812bb80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8684009760 tx=0x7f8684009060).stop 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 -- 172.21.15.19:0/2285260150 shutdown_connections 2023-10-03T10:11:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f868812c3c0 0x7f868812bb80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 --2- 172.21.15.19:0/2285260150 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86880925d0 0x7f868812ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 -- 172.21.15.19:0/2285260150 >> 172.21.15.19:0/2285260150 conn(0x7f8688097480 msgr2=0x7f8688097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 -- 172.21.15.19:0/2285260150 shutdown_connections 2023-10-03T10:11:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.404+0000 7f868fed7700 1 -- 172.21.15.19:0/2285260150 wait complete. 2023-10-03T10:11:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.405+0000 7f868fed7700 1 Processor -- start 2023-10-03T10:11:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.405+0000 7f868fed7700 1 -- start start 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 0x7f868811a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 0x7f868811a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868809a280 con 0x7f86880925d0 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868811da40 con 0x7f868812f320 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f868812eed0 con 0x7f868812c3c0 2023-10-03T10:11:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42284/0 (socket says 172.21.15.19:42284) 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 -- 172.21.15.19:0/824991798 learned_addr learned my addr 172.21.15.19:0/824991798 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868e474700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 0x7f868811a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868d472700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 0x7f868811a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 -- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 msgr2=0x7f868811a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 0x7f868811a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 -- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 msgr2=0x7f868811a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 0x7f868811a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 -- 172.21.15.19:0/824991798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86780092a0 con 0x7f86880925d0 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868e474700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 0x7f868811a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868d472700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 0x7f868811a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868dc73700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8684009e00 tx=0x7f8684017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868400f7e0 con 0x7f86880925d0 2023-10-03T10:11:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868400f940 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.406+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840092a0 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.407+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868401b660 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.407+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868811e2e0 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.407+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f868401ba50 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.408+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f868403c6c0 con 0x7f86880925d0 2023-10-03T10:11:15.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.408+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868811e2e0 con 0x7f86880925d0 2023-10-03T10:11:15.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.412+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f868811e2e0 con 0x7f86880925d0 2023-10-03T10:11:15.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:15.631+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f868805a2d0 con 0x7f86880925d0 2023-10-03T10:11:16.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.250+0000 7f867dffb700 1 -- 172.21.15.19:0/824991798 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f868805a2d0 con 0x7f86880925d0 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.252+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 >> v1:172.21.15.19:6816/118286 conn(0x7f866c02bb60 legacy=0x7f866c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.252+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 msgr2=0x7f868812b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.252+0000 7f868fed7700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f8684009e00 tx=0x7f8684017000).stop 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 shutdown_connections 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f868812f320 0x7f868811a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86880925d0 0x7f868812b070 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 --2- 172.21.15.19:0/824991798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f868812c3c0 0x7f868811a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 >> 172.21.15.19:0/824991798 conn(0x7f8688097480 msgr2=0x7f8688094560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:16.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 shutdown_connections 2023-10-03T10:11:16.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.253+0000 7f868fed7700 1 -- 172.21.15.19:0/824991798 wait complete. 2023-10-03T10:11:16.267 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-03T10:11:16.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 Processor -- start 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 -- start start 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 0x7fe91c127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 0x7fe91c0957f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe91c096940 con 0x7fe91c095370 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c059c00 con 0x7fe91c059070 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe92307b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c091b60 con 0x7fe91c127390 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe920e17700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 0x7fe91c127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe921618700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 0x7fe91c0957f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54192/0 (socket says 172.21.15.19:54192) 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.401+0000 7fe91bfff700 1 -- 172.21.15.19:0/3655445062 learned_addr learned my addr 172.21.15.19:0/3655445062 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 -- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 msgr2=0x7fe91c127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 0x7fe91c127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 -- 172.21.15.19:0/3655445062 >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 msgr2=0x7fe91c0957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3655445062 >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 0x7fe91c0957f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 -- 172.21.15.19:0/3655445062 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c0929d0 con 0x7fe91c127390 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe920e17700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 0x7fe91c127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe921618700 1 --2- 172.21.15.19:0/3655445062 >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 0x7fe91c0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe904009830 tx=0x7fe9040090f0).ready entity=mon.2 client_cookie=958ca53b33379aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91b7fe700 1 -- 172.21.15.19:0/3655445062 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400f510 con 0x7fe91c127390 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91b7fe700 1 -- 172.21.15.19:0/3655445062 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90400f670 con 0x7fe91c127390 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.402+0000 7fe91b7fe700 1 -- 172.21.15.19:0/3655445062 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400fa10 con 0x7fe91c127390 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 -- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 msgr2=0x7fe91c127d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fe904009830 tx=0x7fe9040090f0).stop 2023-10-03T10:11:16.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 -- 172.21.15.19:0/3655445062 shutdown_connections 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c059070 0x7fe91c127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 --2- 172.21.15.19:0/3655445062 >> v2:172.21.15.19:3300/0 conn(0x7fe91c095370 0x7fe91c0957f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 --2- 172.21.15.19:0/3655445062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c127390 0x7fe91c127d80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 -- 172.21.15.19:0/3655445062 >> 172.21.15.19:0/3655445062 conn(0x7fe91c097470 msgr2=0x7fe91c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 -- 172.21.15.19:0/3655445062 shutdown_connections 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.403+0000 7fe92307b700 1 -- 172.21.15.19:0/3655445062 wait complete. 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 Processor -- start 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 -- start start 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 0x7fe91c113d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 0x7fe91c114760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c116c80 con 0x7fe91c127390 2023-10-03T10:11:16.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c113b50 con 0x7fe91c095370 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe92307b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c096f20 con 0x7fe91c059070 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.404+0000 7fe921618700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 0x7fe91c114760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41982/0 (socket says 172.21.15.19:41982) 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 -- 172.21.15.19:0/3279410831 learned_addr learned my addr 172.21.15.19:0/3279410831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe920e17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 0x7fe91c113d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 -- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 msgr2=0x7fe91c113d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 0x7fe91c113d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 -- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 msgr2=0x7fe91c114760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 0x7fe91c114760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 -- 172.21.15.19:0/3279410831 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0092a0 con 0x7fe91c095370 2023-10-03T10:11:16.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe920e17700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 0x7fe91c113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe921618700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 0x7fe91c114760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe91bfff700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe904011000 tx=0x7fe904015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904006910 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904000bc0 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe914009a20 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904024470 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.405+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe904009370 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.406+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe904021070 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.406+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe90403c8b0 con 0x7fe91c095370 2023-10-03T10:11:16.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.406+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c05a260 con 0x7fe91c095370 2023-10-03T10:11:16.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.411+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe904029030 con 0x7fe91c095370 2023-10-03T10:11:16.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.625+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91c046c20 con 0x7fe91c095370 2023-10-03T10:11:16.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.626+0000 7fe918ff9700 1 -- 172.21.15.19:0/3279410831 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fe904029020 con 0x7fe91c095370 2023-10-03T10:11:16.626 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:16.626 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:16.244692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.627+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 >> v1:172.21.15.19:6816/118286 conn(0x7fe8fc02bb60 legacy=0x7fe8fc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.627+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 msgr2=0x7fe91c114270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.627+0000 7fe92307b700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fe904011000 tx=0x7fe904015000).stop 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 shutdown_connections 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe91c127390 0x7fe91c114760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe91c059070 0x7fe91c113d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 --2- 172.21.15.19:0/3279410831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe91c095370 0x7fe91c114270 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 >> 172.21.15.19:0/3279410831 conn(0x7fe91c097470 msgr2=0x7fe91c094380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:16.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 shutdown_connections 2023-10-03T10:11:16.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.628+0000 7fe92307b700 1 -- 172.21.15.19:0/3279410831 wait complete. 2023-10-03T10:11:16.629 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-10-03T10:11:16.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:16.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.770+0000 7ff11b083700 1 Processor -- start 2023-10-03T10:11:16.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.770+0000 7ff11b083700 1 -- start start 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.770+0000 7ff11b083700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff11b083700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1140970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff11b083700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff114068df0 con 0x7ff1140975e0 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff11b083700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11406a4c0 con 0x7ff114067940 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff11b083700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff114098260 con 0x7ff114096820 2023-10-03T10:11:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff118e1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1140970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff118e1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54208/0 (socket says 172.21.15.19:54208) 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff119620700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff1140975e0 0x7ff11412f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47556/0 (socket says 172.21.15.19:47556) 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff118e1f700 1 -- 172.21.15.19:0/708366910 learned_addr learned my addr 172.21.15.19:0/708366910 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 -- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 msgr2=0x7ff114096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 -- 172.21.15.19:0/708366910 >> v1:172.21.15.19:6789/0 conn(0x7ff1140975e0 legacy=0x7ff11412f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 -- 172.21.15.19:0/708366910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114095e60 con 0x7ff114067940 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff1137fe700 1 -- 172.21.15.19:0/708366910 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174904199 0 0) 0x7ff114068df0 con 0x7ff1140975e0 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff118e1f700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff113fff700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1140970f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff108009790 tx=0x7ff108009060).ready entity=mon.1 client_cookie=e67dc1027a21d0c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff1137fe700 1 -- 172.21.15.19:0/708366910 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800f510 con 0x7ff114067940 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff1137fe700 1 -- 172.21.15.19:0/708366910 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800f670 con 0x7ff114067940 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.771+0000 7ff1137fe700 1 -- 172.21.15.19:0/708366910 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800f9f0 con 0x7ff114067940 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 -- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 msgr2=0x7ff1140970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1140970f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff108009790 tx=0x7ff108009060).stop 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 -- 172.21.15.19:0/708366910 shutdown_connections 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 --2- 172.21.15.19:0/708366910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1140970f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 -- 172.21.15.19:0/708366910 >> 172.21.15.19:0/708366910 conn(0x7ff11409ba50 msgr2=0x7ff11409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 -- 172.21.15.19:0/708366910 shutdown_connections 2023-10-03T10:11:16.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.772+0000 7ff11b083700 1 -- 172.21.15.19:0/708366910 wait complete. 2023-10-03T10:11:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.773+0000 7ff11b083700 1 Processor -- start 2023-10-03T10:11:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 -- start start 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 0x7ff114138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff114139070 con 0x7ff1140975e0 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11411bf10 con 0x7ff114067940 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff11b083700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff114067e30 con 0x7ff114096820 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff118e1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff118e1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42004/0 (socket says 172.21.15.19:42004) 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff118e1f700 1 -- 172.21.15.19:0/3617169047 learned_addr learned my addr 172.21.15.19:0/3617169047 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff119620700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 0x7ff114138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.774+0000 7ff113fff700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 -- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 msgr2=0x7ff114138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 -- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 msgr2=0x7ff114138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 0x7ff114138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 -- 172.21.15.19:0/3617169047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009370 con 0x7ff114067940 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff113fff700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff119620700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 0x7ff114138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff118e1f700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff10400ea50 tx=0x7ff1040090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104009650 con 0x7ff114067940 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10400ee90 con 0x7ff114067940 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1080092a0 con 0x7ff114067940 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10400ca60 con 0x7ff114067940 2023-10-03T10:11:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.775+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11411c560 con 0x7ff114067940 2023-10-03T10:11:16.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.776+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff10401b400 con 0x7ff114067940 2023-10-03T10:11:16.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.776+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff10403b410 con 0x7ff114067940 2023-10-03T10:11:16.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.776+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11405a260 con 0x7ff114067940 2023-10-03T10:11:16.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.781+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff104016020 con 0x7ff114067940 2023-10-03T10:11:16.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.955+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff114069870 con 0x7ff114067940 2023-10-03T10:11:16.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.955+0000 7ff110ff9700 1 -- 172.21.15.19:0/3617169047 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7ff104019310 con 0x7ff114067940 2023-10-03T10:11:16.956 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:16.956 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.957+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 >> v1:172.21.15.19:6816/118286 conn(0x7ff10002bb60 legacy=0x7ff10002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.957+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 msgr2=0x7ff1141381a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.957+0000 7ff11b083700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7ff10400ea50 tx=0x7ff1040090f0).stop 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 shutdown_connections 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff1140975e0 0x7ff114138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff114067940 0x7ff1141381a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 --2- 172.21.15.19:0/3617169047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff114096820 0x7ff114138690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:16.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 >> 172.21.15.19:0/3617169047 conn(0x7ff11409ba50 msgr2=0x7ff1140998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:16.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 shutdown_connections 2023-10-03T10:11:16.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:16.958+0000 7ff11b083700 1 -- 172.21.15.19:0/3617169047 wait complete. 2023-10-03T10:11:16.971 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-03T10:11:16.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.100+0000 7f6e8eb7c700 1 Processor -- start 2023-10-03T10:11:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.100+0000 7f6e8eb7c700 1 -- start start 2023-10-03T10:11:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8eb7c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e88096be0 0x7f6e881251c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8eb7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88125770 0x7f6e88125b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8eb7c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e88095ea0 con 0x7f6e88093bf0 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8eb7c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e880956a0 con 0x7f6e88096be0 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8eb7c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88096fc0 con 0x7f6e88125770 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8c918700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e88096be0 0x7f6e881251c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8d119700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6e88093bf0 0x7f6e880940a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47564/0 (socket says 172.21.15.19:47564) 2023-10-03T10:11:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8d119700 1 -- 172.21.15.19:0/4100195522 learned_addr learned my addr 172.21.15.19:0/4100195522 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e87fff700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88125770 0x7f6e88125b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8c918700 1 -- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88125770 msgr2=0x7f6e88125b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8c918700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88125770 0x7f6e88125b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8c918700 1 -- 172.21.15.19:0/4100195522 >> v1:172.21.15.19:6789/0 conn(0x7f6e88093bf0 legacy=0x7f6e880940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e877fe700 1 -- 172.21.15.19:0/4100195522 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230642740 0 0) 0x7f6e88095ea0 con 0x7f6e88093bf0 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.101+0000 7f6e8c918700 1 -- 172.21.15.19:0/4100195522 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88096120 con 0x7f6e88096be0 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8c918700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e881251c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e78009760 tx=0x7f6e78009060).ready entity=mon.0 client_cookie=4d3b33181e4362c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e877fe700 1 -- 172.21.15.19:0/4100195522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800f510 con 0x7f6e88096be0 2023-10-03T10:11:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e877fe700 1 -- 172.21.15.19:0/4100195522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800f670 con 0x7f6e88096be0 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e877fe700 1 -- 172.21.15.19:0/4100195522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800f9f0 con 0x7f6e88096be0 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 msgr2=0x7f6e881251c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e881251c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6e78009760 tx=0x7f6e78009060).stop 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/4100195522 shutdown_connections 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e881251c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/4100195522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88125770 0x7f6e88125b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/4100195522 >> 172.21.15.19:0/4100195522 conn(0x7f6e88097470 msgr2=0x7f6e88097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/4100195522 shutdown_connections 2023-10-03T10:11:17.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.102+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/4100195522 wait complete. 2023-10-03T10:11:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.104+0000 7f6e8eb7c700 1 Processor -- start 2023-10-03T10:11:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.104+0000 7f6e8eb7c700 1 -- start start 2023-10-03T10:11:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e88138420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e88125770 0x7f6e88067820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88069e50 con 0x7f6e88096be0 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880958d0 con 0x7f6e88125770 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88111550 con 0x7f6e88093bf0 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e87fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e88138420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54236/0 (socket says 172.21.15.19:54236) 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 -- 172.21.15.19:0/802637682 learned_addr learned my addr 172.21.15.19:0/802637682 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:17.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8d119700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e88125770 0x7f6e88067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 -- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e88125770 msgr2=0x7f6e88067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e88125770 0x7f6e88067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 -- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 msgr2=0x7f6e88138420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e88138420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 -- 172.21.15.19:0/802637682 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780092a0 con 0x7f6e88093bf0 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e87fff700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e88138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8c918700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e78009e00 tx=0x7f6e78017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800f7e0 con 0x7f6e88093bf0 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800f940 con 0x7f6e88093bf0 2023-10-03T10:11:17.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e881238c0 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801b660 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.105+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88111ad0 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.106+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6e7801ba50 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.106+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6e7803c980 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.107+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8805a260 con 0x7f6e88093bf0 2023-10-03T10:11:17.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.112+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6e78028030 con 0x7f6e88093bf0 2023-10-03T10:11:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.280+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e88046c20 con 0x7f6e6802bb60 2023-10-03T10:11:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.288+0000 7f6e84ff9700 1 -- 172.21.15.19:0/802637682 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244307 (unknown 2965378022 0 962904250) 0x7f6e88046c20 con 0x7f6e6802bb60 2023-10-03T10:11:17.292 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:17.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.290+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 >> v1:172.21.15.19:6816/118286 conn(0x7f6e6802bb60 legacy=0x7f6e6802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 msgr2=0x7f6e88137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f6e78009e00 tx=0x7f6e78017000).stop 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 shutdown_connections 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e88125770 0x7f6e88067820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e88093bf0 0x7f6e88137f30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 --2- 172.21.15.19:0/802637682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e88096be0 0x7f6e88138420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 >> 172.21.15.19:0/802637682 conn(0x7f6e88097470 msgr2=0x7f6e88128510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 shutdown_connections 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.291+0000 7f6e8eb7c700 1 -- 172.21.15.19:0/802637682 wait complete. 2023-10-03T10:11:17.295 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:17.305 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:11:15.722687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298500,"statfs":{"total":386547056640,"available":385329664000,"internally_reserved":0,"allocated":487424,"data_stored":131721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.819392+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:07.819392+0000","last_peered":"2023-10-03T10:11:07.819392+0000","last_clean":"2023-10-03T10:11:07.819392+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:07.819392+0000","last_undegraded":"2023-10-03T10:11:07.819392+0000","last_fullsized":"2023-10-03T10:11:07.819392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.813141+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:07.813141+0000","last_peered":"2023-10-03T10:11:07.813141+0000","last_clean":"2023-10-03T10:11:07.813141+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:07.813141+0000","last_undegraded":"2023-10-03T10:11:07.813141+0000","last_fullsized":"2023-10-03T10:11:07.813141+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.818773+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:07.818773+0000","last_peered":"2023-10-03T10:11:07.818773+0000","last_clean":"2023-10-03T10:11:07.818773+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:07.818773+0000","last_undegraded":"2023-10-03T10:11:07.818773+0000","last_fullsized":"2023-10-03T10:11:07.818773+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.824773+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:07.824773+0000","last_peered":"2023-10-03T10:11:07.824773+0000","last_clean":"2023-10-03T10:11:07.824773+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:07.824773+0000","last_undegraded":"2023-10-03T10:11:07.824773+0000","last_fullsized":"2023-10-03T10:11:07.824773+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:08.449217+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:08.449217+0000","last_peered":"2023-10-03T10:11:08.449217+0000","last_clean":"2023-10-03T10:11:08.449217+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:08.449217+0000","last_undegraded":"2023-10-03T10:11:08.449217+0000","last_fullsized":"2023-10-03T10:11:08.449217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:08.449233+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:08.449233+0000","last_peered":"2023-10-03T10:11:08.449233+0000","last_clean":"2023-10-03T10:11:08.449233+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:08.449233+0000","last_undegraded":"2023-10-03T10:11:08.449233+0000","last_fullsized":"2023-10-03T10:11:08.449233+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:17.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 Processor -- start 2023-10-03T10:11:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 -- start start 2023-10-03T10:11:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 0x7f877c1250f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 0x7f877c125a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c096190 con 0x7f877c093bf0 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c059450 con 0x7f877c059070 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f878117a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c095f20 con 0x7f877c1256a0 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f877a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 0x7f877c125a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f877ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 0x7f877c1250f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f877b59e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f877c093bf0 0x7f877c094080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47578/0 (socket says 172.21.15.19:47578) 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.476+0000 7f877b59e700 1 -- 172.21.15.19:0/2838747696 learned_addr learned my addr 172.21.15.19:0/2838747696 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f8779d9b700 1 -- 172.21.15.19:0/2838747696 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634590698 0 0) 0x7f877c096190 con 0x7f877c093bf0 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877a59c700 1 -- 172.21.15.19:0/2838747696 >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 msgr2=0x7f877c1250f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:17.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877a59c700 1 --2- 172.21.15.19:0/2838747696 >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 0x7f877c1250f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877a59c700 1 -- 172.21.15.19:0/2838747696 >> v1:172.21.15.19:6789/0 conn(0x7f877c093bf0 legacy=0x7f877c094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877a59c700 1 -- 172.21.15.19:0/2838747696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c059b90 con 0x7f877c1256a0 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877ad9d700 1 --2- 172.21.15.19:0/2838747696 >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 0x7f877c1250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f877a59c700 1 --2- 172.21.15.19:0/2838747696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 0x7f877c125a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f876c009760 tx=0x7f876c009060).ready entity=mon.1 client_cookie=750f049585b19408 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f8779d9b700 1 -- 172.21.15.19:0/2838747696 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00f510 con 0x7f877c1256a0 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f8779d9b700 1 -- 172.21.15.19:0/2838747696 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876c00f670 con 0x7f877c1256a0 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.477+0000 7f8779d9b700 1 -- 172.21.15.19:0/2838747696 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c00f9f0 con 0x7f877c1256a0 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 -- 172.21.15.19:0/2838747696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 msgr2=0x7f877c125a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 --2- 172.21.15.19:0/2838747696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 0x7f877c125a80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f876c009760 tx=0x7f876c009060).stop 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 -- 172.21.15.19:0/2838747696 shutdown_connections 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 --2- 172.21.15.19:0/2838747696 >> v2:172.21.15.19:3300/0 conn(0x7f877c059070 0x7f877c1250f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 --2- 172.21.15.19:0/2838747696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c1256a0 0x7f877c125a80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 -- 172.21.15.19:0/2838747696 >> 172.21.15.19:0/2838747696 conn(0x7f877c097470 msgr2=0x7f877c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 -- 172.21.15.19:0/2838747696 shutdown_connections 2023-10-03T10:11:17.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.478+0000 7f878117a700 1 -- 172.21.15.19:0/2838747696 wait complete. 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 Processor -- start 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 -- start start 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877c059070 0x7f877c117cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 0x7f877c113d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c1151c0 con 0x7f877c1256a0 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0958d0 con 0x7f877c093bf0 2023-10-03T10:11:17.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f878117a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f877c117220 con 0x7f877c059070 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f877b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f877ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877c059070 0x7f877c117cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.479+0000 7f877b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44204/0 (socket says 172.21.15.19:44204) 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 -- 172.21.15.19:0/1379856820 learned_addr learned my addr 172.21.15.19:0/1379856820 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877a59c700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 0x7f877c113d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 -- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877c059070 msgr2=0x7f877c117cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877c059070 0x7f877c117cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 -- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 msgr2=0x7f877c113d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 0x7f877c113d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 -- 172.21.15.19:0/1379856820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87700092a0 con 0x7f877c1256a0 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877a59c700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 0x7f877c113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:17.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f877b59e700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f877400c7e0 tx=0x7f8774007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774005d30 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774005e90 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774007360 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c0092a0 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.480+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c116e50 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.481+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8774007710 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.481+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f877403ae80 con 0x7f877c1256a0 2023-10-03T10:11:17.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.482+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c099ad0 con 0x7f877c1256a0 2023-10-03T10:11:17.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.486+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f877401a300 con 0x7f877c1256a0 2023-10-03T10:11:17.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.657+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f877c117720 con 0x7f876802bb60 2023-10-03T10:11:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.663+0000 7f8762ffd700 1 -- 172.21.15.19:0/1379856820 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244307 (unknown 2965378022 0 962904250) 0x7f8770009810 con 0x7f876802bb60 2023-10-03T10:11:17.668 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 >> v1:172.21.15.19:6816/118286 conn(0x7f876802bb60 legacy=0x7f876802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 msgr2=0x7f877c114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f877400c7e0 tx=0x7f8774007f90).stop 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 shutdown_connections 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877c1256a0 0x7f877c114210 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877c059070 0x7f877c117cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 --2- 172.21.15.19:0/1379856820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877c093bf0 0x7f877c113d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 >> 172.21.15.19:0/1379856820 conn(0x7f877c097470 msgr2=0x7f877c0990c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 shutdown_connections 2023-10-03T10:11:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.667+0000 7f878117a700 1 -- 172.21.15.19:0/1379856820 wait complete. 2023-10-03T10:11:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:17.681 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-03T10:11:15.722687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1188860,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298500,"statfs":{"total":386547056640,"available":385329664000,"internally_reserved":0,"allocated":487424,"data_stored":131721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.819392+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:07.819392+0000","last_peered":"2023-10-03T10:11:07.819392+0000","last_clean":"2023-10-03T10:11:07.819392+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:07.819392+0000","last_undegraded":"2023-10-03T10:11:07.819392+0000","last_fullsized":"2023-10-03T10:11:07.819392+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.813141+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:07.813141+0000","last_peered":"2023-10-03T10:11:07.813141+0000","last_clean":"2023-10-03T10:11:07.813141+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:07.813141+0000","last_undegraded":"2023-10-03T10:11:07.813141+0000","last_fullsized":"2023-10-03T10:11:07.813141+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.818773+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:07.818773+0000","last_peered":"2023-10-03T10:11:07.818773+0000","last_clean":"2023-10-03T10:11:07.818773+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:07.818773+0000","last_undegraded":"2023-10-03T10:11:07.818773+0000","last_fullsized":"2023-10-03T10:11:07.818773+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:07.824773+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:07.824773+0000","last_peered":"2023-10-03T10:11:07.824773+0000","last_clean":"2023-10-03T10:11:07.824773+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:07.824773+0000","last_undegraded":"2023-10-03T10:11:07.824773+0000","last_fullsized":"2023-10-03T10:11:07.824773+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:08.449217+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:08.449217+0000","last_peered":"2023-10-03T10:11:08.449217+0000","last_clean":"2023-10-03T10:11:08.449217+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:08.449217+0000","last_undegraded":"2023-10-03T10:11:08.449217+0000","last_fullsized":"2023-10-03T10:11:08.449217+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":12,"state":"active+clean","last_fresh":"2023-10-03T10:11:08.449233+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:08.449233+0000","last_peered":"2023-10-03T10:11:08.449233+0000","last_clean":"2023-10-03T10:11:08.449233+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:08.449233+0000","last_undegraded":"2023-10-03T10:11:08.449233+0000","last_fullsized":"2023-10-03T10:11:08.449233+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:11.818519+0000","last_change":"2023-10-03T10:11:11.818519+0000","last_active":"2023-10-03T10:11:11.818519+0000","last_peered":"2023-10-03T10:11:11.818519+0000","last_clean":"2023-10-03T10:11:11.818519+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:11.818519+0000","last_undegraded":"2023-10-03T10:11:11.818519+0000","last_fullsized":"2023-10-03T10:11:11.818519+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-03T10:11:12.822737+0000","last_change":"2023-10-03T10:11:12.822737+0000","last_active":"2023-10-03T10:11:12.822737+0000","last_peered":"2023-10-03T10:11:12.822737+0000","last_clean":"2023-10-03T10:11:12.822737+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-03T10:11:12.822737+0000","last_undegraded":"2023-10-03T10:11:12.822737+0000","last_fullsized":"2023-10-03T10:11:12.822737+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":34,"acting":34,"num_store_stats":1},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297208,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074632,"statfs":{"total":96636764160,"available":96332423168,"internally_reserved":0,"allocated":114688,"data_stored":30204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":26836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:17.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:17.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 Processor -- start 2023-10-03T10:11:17.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 -- start start 2023-10-03T10:11:17.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 0x7f854c132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c065ed0 con 0x7f854c0654a0 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c095880 con 0x7f854c099190 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.853+0000 7f8552c66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c096120 con 0x7f854c098d50 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54248/0 (socket says 172.21.15.19:54248) 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 -- 172.21.15.19:0/1824135288 learned_addr learned my addr 172.21.15.19:0/1824135288 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f8551203700 1 --2- 172.21.15.19:0/1824135288 >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 0x7f854c132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 -- 172.21.15.19:0/1824135288 >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 msgr2=0x7f854c132980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 --2- 172.21.15.19:0/1824135288 >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 0x7f854c132980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 -- 172.21.15.19:0/1824135288 >> v1:172.21.15.19:6789/0 conn(0x7f854c0654a0 legacy=0x7f854c098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 -- 172.21.15.19:0/1824135288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c066280 con 0x7f854c098d50 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f8551203700 1 --2- 172.21.15.19:0/1824135288 >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 0x7f854c132980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:17.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854bfff700 1 --2- 172.21.15.19:0/1824135288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8538006fd0 tx=0x7f85380090f0).ready entity=mon.2 client_cookie=20351ffefebb1f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854b7fe700 1 -- 172.21.15.19:0/1824135288 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800b600 con 0x7f854c098d50 2023-10-03T10:11:17.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854b7fe700 1 -- 172.21.15.19:0/1824135288 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853800b760 con 0x7f854c098d50 2023-10-03T10:11:17.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.854+0000 7f854b7fe700 1 -- 172.21.15.19:0/1824135288 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800bae0 con 0x7f854c098d50 2023-10-03T10:11:17.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 -- 172.21.15.19:0/1824135288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 msgr2=0x7f854c130480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 --2- 172.21.15.19:0/1824135288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f8538006fd0 tx=0x7f85380090f0).stop 2023-10-03T10:11:17.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 -- 172.21.15.19:0/1824135288 shutdown_connections 2023-10-03T10:11:17.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 --2- 172.21.15.19:0/1824135288 >> v2:172.21.15.19:3300/0 conn(0x7f854c099190 0x7f854c132980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 --2- 172.21.15.19:0/1824135288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c098d50 0x7f854c130480 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 -- 172.21.15.19:0/1824135288 >> 172.21.15.19:0/1824135288 conn(0x7f854c09a740 msgr2=0x7f854c09ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 -- 172.21.15.19:0/1824135288 shutdown_connections 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.855+0000 7f8552c66700 1 -- 172.21.15.19:0/1824135288 wait complete. 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.856+0000 7f8552c66700 1 Processor -- start 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.856+0000 7f8552c66700 1 -- start start 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 0x7f854c13a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c11da50 con 0x7f854c098d50 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c11c0e0 con 0x7f854c099190 2023-10-03T10:11:17.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8552c66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f854c09d030 con 0x7f854c0654a0 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8550a02700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 0x7f854c13a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f854bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42030/0 (socket says 172.21.15.19:42030) 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f854bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44224/0 (socket says 172.21.15.19:44224) 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8550a02700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 0x7f854c13a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54250/0 (socket says 172.21.15.19:54250) 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 -- 172.21.15.19:0/3184584679 learned_addr learned my addr 172.21.15.19:0/3184584679 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 -- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 msgr2=0x7f854c13a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 0x7f854c13a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 -- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 msgr2=0x7f854c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f8551203700 1 -- 172.21.15.19:0/3184584679 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538009370 con 0x7f854c099190 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.857+0000 7f854bfff700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8551203700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f854400a380 tx=0x7f8544007900).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544016470 con 0x7f854c099190 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85440165d0 con 0x7f854c099190 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8544016950 con 0x7f854c099190 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c099b00 con 0x7f854c099190 2023-10-03T10:11:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.858+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c11e6d0 con 0x7f854c099190 2023-10-03T10:11:17.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.859+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c11dc70 con 0x7f854c099190 2023-10-03T10:11:17.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.859+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8544013070 con 0x7f854c099190 2023-10-03T10:11:17.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.859+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f854403bc30 con 0x7f854c099190 2023-10-03T10:11:17.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:17.864+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f854400d440 con 0x7f854c099190 2023-10-03T10:11:17.936 INFO:tasks.ceph.mds.a.smithi019.stderr:2023-10-03T10:11:17.934+0000 7f97f989a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-03T10:11:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.034+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f854c05a2d0 con 0x7f853002bb60 2023-10-03T10:11:18.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.041+0000 7f8548ff9700 1 -- 172.21.15.19:0/3184584679 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250003 (unknown 2965378022 0 1781328318) 0x7f854c05a2d0 con 0x7f853002bb60 2023-10-03T10:11:18.044 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 >> v1:172.21.15.19:6816/118286 conn(0x7f853002bb60 legacy=0x7f853002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 msgr2=0x7f854c13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f854400a380 tx=0x7f8544007900).stop 2023-10-03T10:11:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 shutdown_connections 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f854c099190 0x7f854c13b210 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f854c0654a0 0x7f854c13a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 --2- 172.21.15.19:0/3184584679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f854c098d50 0x7f854c13ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 >> 172.21.15.19:0/3184584679 conn(0x7f854c09a740 msgr2=0x7f854c1142e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 shutdown_connections 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.044+0000 7f8552c66700 1 -- 172.21.15.19:0/3184584679 wait complete. 2023-10-03T10:11:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:18.058 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-03T10:11:17.723176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000488"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268370+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:11:13.268370+0000","last_peered":"2023-10-03T10:11:13.268370+0000","last_clean":"2023-10-03T10:11:13.268370+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:11:13.268370+0000","last_undegraded":"2023-10-03T10:11:13.268370+0000","last_fullsized":"2023-10-03T10:11:13.268370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268760+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:11:13.268760+0000","last_peered":"2023-10-03T10:11:13.268760+0000","last_clean":"2023-10-03T10:11:13.268760+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:11:13.268760+0000","last_undegraded":"2023-10-03T10:11:13.268760+0000","last_fullsized":"2023-10-03T10:11:13.268760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276725+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:11:13.276725+0000","last_peered":"2023-10-03T10:11:13.276725+0000","last_clean":"2023-10-03T10:11:13.276725+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:11:13.276725+0000","last_undegraded":"2023-10-03T10:11:13.276725+0000","last_fullsized":"2023-10-03T10:11:13.276725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.277146+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:11:13.277146+0000","last_peered":"2023-10-03T10:11:13.277146+0000","last_clean":"2023-10-03T10:11:13.277146+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:11:13.277146+0000","last_undegraded":"2023-10-03T10:11:13.277146+0000","last_fullsized":"2023-10-03T10:11:13.277146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285549+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:11:13.285549+0000","last_peered":"2023-10-03T10:11:13.285549+0000","last_clean":"2023-10-03T10:11:13.285549+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:11:13.285549+0000","last_undegraded":"2023-10-03T10:11:13.285549+0000","last_fullsized":"2023-10-03T10:11:13.285549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276317+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:11:13.276317+0000","last_peered":"2023-10-03T10:11:13.276317+0000","last_clean":"2023-10-03T10:11:13.276317+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:11:13.276317+0000","last_undegraded":"2023-10-03T10:11:13.276317+0000","last_fullsized":"2023-10-03T10:11:13.276317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276451+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:11:13.276451+0000","last_peered":"2023-10-03T10:11:13.276451+0000","last_clean":"2023-10-03T10:11:13.276451+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:11:13.276451+0000","last_undegraded":"2023-10-03T10:11:13.276451+0000","last_fullsized":"2023-10-03T10:11:13.276451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285473+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:11:13.285473+0000","last_peered":"2023-10-03T10:11:13.285473+0000","last_clean":"2023-10-03T10:11:13.285473+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:11:13.285473+0000","last_undegraded":"2023-10-03T10:11:13.285473+0000","last_fullsized":"2023-10-03T10:11:13.285473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278826+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:11:13.278826+0000","last_peered":"2023-10-03T10:11:13.278826+0000","last_clean":"2023-10-03T10:11:13.278826+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:11:13.278826+0000","last_undegraded":"2023-10-03T10:11:13.278826+0000","last_fullsized":"2023-10-03T10:11:13.278826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285649+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:11:13.285649+0000","last_peered":"2023-10-03T10:11:13.285649+0000","last_clean":"2023-10-03T10:11:13.285649+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:11:13.285649+0000","last_undegraded":"2023-10-03T10:11:13.285649+0000","last_fullsized":"2023-10-03T10:11:13.285649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281847+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:11:13.281847+0000","last_peered":"2023-10-03T10:11:13.281847+0000","last_clean":"2023-10-03T10:11:13.281847+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:11:13.281847+0000","last_undegraded":"2023-10-03T10:11:13.281847+0000","last_fullsized":"2023-10-03T10:11:13.281847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276513+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:11:13.276513+0000","last_peered":"2023-10-03T10:11:13.276513+0000","last_clean":"2023-10-03T10:11:13.276513+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:11:13.276513+0000","last_undegraded":"2023-10-03T10:11:13.276513+0000","last_fullsized":"2023-10-03T10:11:13.276513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285497+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:11:13.285497+0000","last_peered":"2023-10-03T10:11:13.285497+0000","last_clean":"2023-10-03T10:11:13.285497+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:11:13.285497+0000","last_undegraded":"2023-10-03T10:11:13.285497+0000","last_fullsized":"2023-10-03T10:11:13.285497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276394+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:11:13.276394+0000","last_peered":"2023-10-03T10:11:13.276394+0000","last_clean":"2023-10-03T10:11:13.276394+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:11:13.276394+0000","last_undegraded":"2023-10-03T10:11:13.276394+0000","last_fullsized":"2023-10-03T10:11:13.276394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285853+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:11:13.285853+0000","last_peered":"2023-10-03T10:11:13.285853+0000","last_clean":"2023-10-03T10:11:13.285853+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:11:13.285853+0000","last_undegraded":"2023-10-03T10:11:13.285853+0000","last_fullsized":"2023-10-03T10:11:13.285853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276604+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:11:13.276604+0000","last_peered":"2023-10-03T10:11:13.276604+0000","last_clean":"2023-10-03T10:11:13.276604+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:11:13.276604+0000","last_undegraded":"2023-10-03T10:11:13.276604+0000","last_fullsized":"2023-10-03T10:11:13.276604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278163+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:11:13.278163+0000","last_peered":"2023-10-03T10:11:13.278163+0000","last_clean":"2023-10-03T10:11:13.278163+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:11:13.278163+0000","last_undegraded":"2023-10-03T10:11:13.278163+0000","last_fullsized":"2023-10-03T10:11:13.278163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286916+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:11:13.286916+0000","last_peered":"2023-10-03T10:11:13.286916+0000","last_clean":"2023-10-03T10:11:13.286916+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:11:13.286916+0000","last_undegraded":"2023-10-03T10:11:13.286916+0000","last_fullsized":"2023-10-03T10:11:13.286916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280713+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:11:13.280713+0000","last_peered":"2023-10-03T10:11:13.280713+0000","last_clean":"2023-10-03T10:11:13.280713+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:11:13.280713+0000","last_undegraded":"2023-10-03T10:11:13.280713+0000","last_fullsized":"2023-10-03T10:11:13.280713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276415+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:11:13.276415+0000","last_peered":"2023-10-03T10:11:13.276415+0000","last_clean":"2023-10-03T10:11:13.276415+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:11:13.276415+0000","last_undegraded":"2023-10-03T10:11:13.276415+0000","last_fullsized":"2023-10-03T10:11:13.276415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240250+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:11:13.240250+0000","last_peered":"2023-10-03T10:11:13.240250+0000","last_clean":"2023-10-03T10:11:13.240250+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:11:13.240250+0000","last_undegraded":"2023-10-03T10:11:13.240250+0000","last_fullsized":"2023-10-03T10:11:13.240250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287203+0000","last_change":"2023-10-03T10:11:13.283237+0000","last_active":"2023-10-03T10:11:13.287203+0000","last_peered":"2023-10-03T10:11:13.287203+0000","last_clean":"2023-10-03T10:11:13.287203+0000","last_became_active":"2023-10-03T10:11:13.282919+0000","last_became_peered":"2023-10-03T10:11:13.282919+0000","last_unstale":"2023-10-03T10:11:13.287203+0000","last_undegraded":"2023-10-03T10:11:13.287203+0000","last_fullsized":"2023-10-03T10:11:13.287203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252142+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:11:13.252142+0000","last_peered":"2023-10-03T10:11:13.252142+0000","last_clean":"2023-10-03T10:11:13.252142+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:11:13.252142+0000","last_undegraded":"2023-10-03T10:11:13.252142+0000","last_fullsized":"2023-10-03T10:11:13.252142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276531+0000","last_change":"2023-10-03T10:11:13.264719+0000","last_active":"2023-10-03T10:11:13.276531+0000","last_peered":"2023-10-03T10:11:13.276531+0000","last_clean":"2023-10-03T10:11:13.276531+0000","last_became_active":"2023-10-03T10:11:13.255651+0000","last_became_peered":"2023-10-03T10:11:13.255651+0000","last_unstale":"2023-10-03T10:11:13.276531+0000","last_undegraded":"2023-10-03T10:11:13.276531+0000","last_fullsized":"2023-10-03T10:11:13.276531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253054+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:11:13.253054+0000","last_peered":"2023-10-03T10:11:13.253054+0000","last_clean":"2023-10-03T10:11:13.253054+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:11:13.253054+0000","last_undegraded":"2023-10-03T10:11:13.253054+0000","last_fullsized":"2023-10-03T10:11:13.253054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276430+0000","last_change":"2023-10-03T10:11:13.268456+0000","last_active":"2023-10-03T10:11:13.276430+0000","last_peered":"2023-10-03T10:11:13.276430+0000","last_clean":"2023-10-03T10:11:13.276430+0000","last_became_active":"2023-10-03T10:11:13.267206+0000","last_became_peered":"2023-10-03T10:11:13.267206+0000","last_unstale":"2023-10-03T10:11:13.276430+0000","last_undegraded":"2023-10-03T10:11:13.276430+0000","last_fullsized":"2023-10-03T10:11:13.276430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.284853+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:11:13.284853+0000","last_peered":"2023-10-03T10:11:13.284853+0000","last_clean":"2023-10-03T10:11:13.284853+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:11:13.284853+0000","last_undegraded":"2023-10-03T10:11:13.284853+0000","last_fullsized":"2023-10-03T10:11:13.284853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287590+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:11:13.287590+0000","last_peered":"2023-10-03T10:11:13.287590+0000","last_clean":"2023-10-03T10:11:13.287590+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:11:13.287590+0000","last_undegraded":"2023-10-03T10:11:13.287590+0000","last_fullsized":"2023-10-03T10:11:13.287590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285616+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:11:13.285616+0000","last_peered":"2023-10-03T10:11:13.285616+0000","last_clean":"2023-10-03T10:11:13.285616+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:11:13.285616+0000","last_undegraded":"2023-10-03T10:11:13.285616+0000","last_fullsized":"2023-10-03T10:11:13.285616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280900+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:11:13.280900+0000","last_peered":"2023-10-03T10:11:13.280900+0000","last_clean":"2023-10-03T10:11:13.280900+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:11:13.280900+0000","last_undegraded":"2023-10-03T10:11:13.280900+0000","last_fullsized":"2023-10-03T10:11:13.280900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280337+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:11:13.280337+0000","last_peered":"2023-10-03T10:11:13.280337+0000","last_clean":"2023-10-03T10:11:13.280337+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:11:13.280337+0000","last_undegraded":"2023-10-03T10:11:13.280337+0000","last_fullsized":"2023-10-03T10:11:13.280337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.246336+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:11:13.246336+0000","last_peered":"2023-10-03T10:11:13.246336+0000","last_clean":"2023-10-03T10:11:13.246336+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:11:13.246336+0000","last_undegraded":"2023-10-03T10:11:13.246336+0000","last_fullsized":"2023-10-03T10:11:13.246336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286895+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:11:13.286895+0000","last_peered":"2023-10-03T10:11:13.286895+0000","last_clean":"2023-10-03T10:11:13.286895+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:11:13.286895+0000","last_undegraded":"2023-10-03T10:11:13.286895+0000","last_fullsized":"2023-10-03T10:11:13.286895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240734+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:11:13.240734+0000","last_peered":"2023-10-03T10:11:13.240734+0000","last_clean":"2023-10-03T10:11:13.240734+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:11:13.240734+0000","last_undegraded":"2023-10-03T10:11:13.240734+0000","last_fullsized":"2023-10-03T10:11:13.240734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285224+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:11:13.285224+0000","last_peered":"2023-10-03T10:11:13.285224+0000","last_clean":"2023-10-03T10:11:13.285224+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:11:13.285224+0000","last_undegraded":"2023-10-03T10:11:13.285224+0000","last_fullsized":"2023-10-03T10:11:13.285224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287484+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:11:13.287484+0000","last_peered":"2023-10-03T10:11:13.287484+0000","last_clean":"2023-10-03T10:11:13.287484+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:11:13.287484+0000","last_undegraded":"2023-10-03T10:11:13.287484+0000","last_fullsized":"2023-10-03T10:11:13.287484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273737+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:11:13.273737+0000","last_peered":"2023-10-03T10:11:13.273737+0000","last_clean":"2023-10-03T10:11:13.273737+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:11:13.273737+0000","last_undegraded":"2023-10-03T10:11:13.273737+0000","last_fullsized":"2023-10-03T10:11:13.273737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276494+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:11:13.276494+0000","last_peered":"2023-10-03T10:11:13.276494+0000","last_clean":"2023-10-03T10:11:13.276494+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:11:13.276494+0000","last_undegraded":"2023-10-03T10:11:13.276494+0000","last_fullsized":"2023-10-03T10:11:13.276494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281554+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:11:13.281554+0000","last_peered":"2023-10-03T10:11:13.281554+0000","last_clean":"2023-10-03T10:11:13.281554+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:11:13.281554+0000","last_undegraded":"2023-10-03T10:11:13.281554+0000","last_fullsized":"2023-10-03T10:11:13.281554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283286+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:11:13.283286+0000","last_peered":"2023-10-03T10:11:13.283286+0000","last_clean":"2023-10-03T10:11:13.283286+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:11:13.283286+0000","last_undegraded":"2023-10-03T10:11:13.283286+0000","last_fullsized":"2023-10-03T10:11:13.283286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286761+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:11:13.286761+0000","last_peered":"2023-10-03T10:11:13.286761+0000","last_clean":"2023-10-03T10:11:13.286761+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:11:13.286761+0000","last_undegraded":"2023-10-03T10:11:13.286761+0000","last_fullsized":"2023-10-03T10:11:13.286761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.249192+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:11:13.249192+0000","last_peered":"2023-10-03T10:11:13.249192+0000","last_clean":"2023-10-03T10:11:13.249192+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:11:13.249192+0000","last_undegraded":"2023-10-03T10:11:13.249192+0000","last_fullsized":"2023-10-03T10:11:13.249192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281374+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:11:13.281374+0000","last_peered":"2023-10-03T10:11:13.281374+0000","last_clean":"2023-10-03T10:11:13.281374+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:11:13.281374+0000","last_undegraded":"2023-10-03T10:11:13.281374+0000","last_fullsized":"2023-10-03T10:11:13.281374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280752+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:11:13.280752+0000","last_peered":"2023-10-03T10:11:13.280752+0000","last_clean":"2023-10-03T10:11:13.280752+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:11:13.280752+0000","last_undegraded":"2023-10-03T10:11:13.280752+0000","last_fullsized":"2023-10-03T10:11:13.280752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285393+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:11:13.285393+0000","last_peered":"2023-10-03T10:11:13.285393+0000","last_clean":"2023-10-03T10:11:13.285393+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:11:13.285393+0000","last_undegraded":"2023-10-03T10:11:13.285393+0000","last_fullsized":"2023-10-03T10:11:13.285393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.241008+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:11:13.241008+0000","last_peered":"2023-10-03T10:11:13.241008+0000","last_clean":"2023-10-03T10:11:13.241008+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:11:13.241008+0000","last_undegraded":"2023-10-03T10:11:13.241008+0000","last_fullsized":"2023-10-03T10:11:13.241008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280692+0000","last_change":"2023-10-03T10:11:13.271873+0000","last_active":"2023-10-03T10:11:13.280692+0000","last_peered":"2023-10-03T10:11:13.280692+0000","last_clean":"2023-10-03T10:11:13.280692+0000","last_became_active":"2023-10-03T10:11:13.270857+0000","last_became_peered":"2023-10-03T10:11:13.270857+0000","last_unstale":"2023-10-03T10:11:13.280692+0000","last_undegraded":"2023-10-03T10:11:13.280692+0000","last_fullsized":"2023-10-03T10:11:13.280692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240604+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:11:13.240604+0000","last_peered":"2023-10-03T10:11:13.240604+0000","last_clean":"2023-10-03T10:11:13.240604+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:11:13.240604+0000","last_undegraded":"2023-10-03T10:11:13.240604+0000","last_fullsized":"2023-10-03T10:11:13.240604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285970+0000","last_change":"2023-10-03T10:11:13.281452+0000","last_active":"2023-10-03T10:11:13.285970+0000","last_peered":"2023-10-03T10:11:13.285970+0000","last_clean":"2023-10-03T10:11:13.285970+0000","last_became_active":"2023-10-03T10:11:13.279215+0000","last_became_peered":"2023-10-03T10:11:13.279215+0000","last_unstale":"2023-10-03T10:11:13.285970+0000","last_undegraded":"2023-10-03T10:11:13.285970+0000","last_fullsized":"2023-10-03T10:11:13.285970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.239668+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:11:13.239668+0000","last_peered":"2023-10-03T10:11:13.239668+0000","last_clean":"2023-10-03T10:11:13.239668+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:11:13.239668+0000","last_undegraded":"2023-10-03T10:11:13.239668+0000","last_fullsized":"2023-10-03T10:11:13.239668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252481+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:11:13.252481+0000","last_peered":"2023-10-03T10:11:13.252481+0000","last_clean":"2023-10-03T10:11:13.252481+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:11:13.252481+0000","last_undegraded":"2023-10-03T10:11:13.252481+0000","last_fullsized":"2023-10-03T10:11:13.252481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240906+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:13.240906+0000","last_peered":"2023-10-03T10:11:13.240906+0000","last_clean":"2023-10-03T10:11:13.240906+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:13.240906+0000","last_undegraded":"2023-10-03T10:11:13.240906+0000","last_fullsized":"2023-10-03T10:11:13.240906+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.250948+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:11:13.250948+0000","last_peered":"2023-10-03T10:11:13.250948+0000","last_clean":"2023-10-03T10:11:13.250948+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:11:13.250948+0000","last_undegraded":"2023-10-03T10:11:13.250948+0000","last_fullsized":"2023-10-03T10:11:13.250948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253245+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:13.253245+0000","last_peered":"2023-10-03T10:11:13.253245+0000","last_clean":"2023-10-03T10:11:13.253245+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:13.253245+0000","last_undegraded":"2023-10-03T10:11:13.253245+0000","last_fullsized":"2023-10-03T10:11:13.253245+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240708+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:13.240708+0000","last_peered":"2023-10-03T10:11:13.240708+0000","last_clean":"2023-10-03T10:11:13.240708+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:13.240708+0000","last_undegraded":"2023-10-03T10:11:13.240708+0000","last_fullsized":"2023-10-03T10:11:13.240708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240818+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:11:13.240818+0000","last_peered":"2023-10-03T10:11:13.240818+0000","last_clean":"2023-10-03T10:11:13.240818+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:11:13.240818+0000","last_undegraded":"2023-10-03T10:11:13.240818+0000","last_fullsized":"2023-10-03T10:11:13.240818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280736+0000","last_change":"2023-10-03T10:11:13.272220+0000","last_active":"2023-10-03T10:11:13.280736+0000","last_peered":"2023-10-03T10:11:13.280736+0000","last_clean":"2023-10-03T10:11:13.280736+0000","last_became_active":"2023-10-03T10:11:13.271605+0000","last_became_peered":"2023-10-03T10:11:13.271605+0000","last_unstale":"2023-10-03T10:11:13.280736+0000","last_undegraded":"2023-10-03T10:11:13.280736+0000","last_fullsized":"2023-10-03T10:11:13.280736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240139+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:13.240139+0000","last_peered":"2023-10-03T10:11:13.240139+0000","last_clean":"2023-10-03T10:11:13.240139+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:13.240139+0000","last_undegraded":"2023-10-03T10:11:13.240139+0000","last_fullsized":"2023-10-03T10:11:13.240139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.248096+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:11:13.248096+0000","last_peered":"2023-10-03T10:11:13.248096+0000","last_clean":"2023-10-03T10:11:13.248096+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:11:13.248096+0000","last_undegraded":"2023-10-03T10:11:13.248096+0000","last_fullsized":"2023-10-03T10:11:13.248096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276315+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:11:13.276315+0000","last_peered":"2023-10-03T10:11:13.276315+0000","last_clean":"2023-10-03T10:11:13.276315+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:11:13.276315+0000","last_undegraded":"2023-10-03T10:11:13.276315+0000","last_fullsized":"2023-10-03T10:11:13.276315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.243333+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:13.243333+0000","last_peered":"2023-10-03T10:11:13.243333+0000","last_clean":"2023-10-03T10:11:13.243333+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:13.243333+0000","last_undegraded":"2023-10-03T10:11:13.243333+0000","last_fullsized":"2023-10-03T10:11:13.243333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276101+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:11:13.276101+0000","last_peered":"2023-10-03T10:11:13.276101+0000","last_clean":"2023-10-03T10:11:13.276101+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:11:13.276101+0000","last_undegraded":"2023-10-03T10:11:13.276101+0000","last_fullsized":"2023-10-03T10:11:13.276101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283517+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:11:13.283517+0000","last_peered":"2023-10-03T10:11:13.283517+0000","last_clean":"2023-10-03T10:11:13.283517+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:11:13.283517+0000","last_undegraded":"2023-10-03T10:11:13.283517+0000","last_fullsized":"2023-10-03T10:11:13.283517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276475+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:11:13.276475+0000","last_peered":"2023-10-03T10:11:13.276475+0000","last_clean":"2023-10-03T10:11:13.276475+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:11:13.276475+0000","last_undegraded":"2023-10-03T10:11:13.276475+0000","last_fullsized":"2023-10-03T10:11:13.276475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251108+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:13.251108+0000","last_peered":"2023-10-03T10:11:13.251108+0000","last_clean":"2023-10-03T10:11:13.251108+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:13.251108+0000","last_undegraded":"2023-10-03T10:11:13.251108+0000","last_fullsized":"2023-10-03T10:11:13.251108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251664+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:11:13.251664+0000","last_peered":"2023-10-03T10:11:13.251664+0000","last_clean":"2023-10-03T10:11:13.251664+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:11:13.251664+0000","last_undegraded":"2023-10-03T10:11:13.251664+0000","last_fullsized":"2023-10-03T10:11:13.251664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285553+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:11:13.285553+0000","last_peered":"2023-10-03T10:11:13.285553+0000","last_clean":"2023-10-03T10:11:13.285553+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:11:13.285553+0000","last_undegraded":"2023-10-03T10:11:13.285553+0000","last_fullsized":"2023-10-03T10:11:13.285553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278547+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:11:13.278547+0000","last_peered":"2023-10-03T10:11:13.278547+0000","last_clean":"2023-10-03T10:11:13.278547+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:11:13.278547+0000","last_undegraded":"2023-10-03T10:11:13.278547+0000","last_fullsized":"2023-10-03T10:11:13.278547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.271145+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:11:13.271145+0000","last_peered":"2023-10-03T10:11:13.271145+0000","last_clean":"2023-10-03T10:11:13.271145+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:11:13.271145+0000","last_undegraded":"2023-10-03T10:11:13.271145+0000","last_fullsized":"2023-10-03T10:11:13.271145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285634+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:11:13.285634+0000","last_peered":"2023-10-03T10:11:13.285634+0000","last_clean":"2023-10-03T10:11:13.285634+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:11:13.285634+0000","last_undegraded":"2023-10-03T10:11:13.285634+0000","last_fullsized":"2023-10-03T10:11:13.285634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281776+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:11:13.281776+0000","last_peered":"2023-10-03T10:11:13.281776+0000","last_clean":"2023-10-03T10:11:13.281776+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:11:13.281776+0000","last_undegraded":"2023-10-03T10:11:13.281776+0000","last_fullsized":"2023-10-03T10:11:13.281776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286788+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:11:13.286788+0000","last_peered":"2023-10-03T10:11:13.286788+0000","last_clean":"2023-10-03T10:11:13.286788+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:11:13.286788+0000","last_undegraded":"2023-10-03T10:11:13.286788+0000","last_fullsized":"2023-10-03T10:11:13.286788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276099+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:11:13.276099+0000","last_peered":"2023-10-03T10:11:13.276099+0000","last_clean":"2023-10-03T10:11:13.276099+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:11:13.276099+0000","last_undegraded":"2023-10-03T10:11:13.276099+0000","last_fullsized":"2023-10-03T10:11:13.276099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276468+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:11:13.276468+0000","last_peered":"2023-10-03T10:11:13.276468+0000","last_clean":"2023-10-03T10:11:13.276468+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:11:13.276468+0000","last_undegraded":"2023-10-03T10:11:13.276468+0000","last_fullsized":"2023-10-03T10:11:13.276468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273955+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:11:13.273955+0000","last_peered":"2023-10-03T10:11:13.273955+0000","last_clean":"2023-10-03T10:11:13.273955+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:11:13.273955+0000","last_undegraded":"2023-10-03T10:11:13.273955+0000","last_fullsized":"2023-10-03T10:11:13.273955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.261244+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:11:13.261244+0000","last_peered":"2023-10-03T10:11:13.261244+0000","last_clean":"2023-10-03T10:11:13.261244+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:11:13.261244+0000","last_undegraded":"2023-10-03T10:11:13.261244+0000","last_fullsized":"2023-10-03T10:11:13.261244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270710+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:11:13.270710+0000","last_peered":"2023-10-03T10:11:13.270710+0000","last_clean":"2023-10-03T10:11:13.270710+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:11:13.270710+0000","last_undegraded":"2023-10-03T10:11:13.270710+0000","last_fullsized":"2023-10-03T10:11:13.270710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285520+0000","last_change":"2023-10-03T10:11:13.278425+0000","last_active":"2023-10-03T10:11:13.285520+0000","last_peered":"2023-10-03T10:11:13.285520+0000","last_clean":"2023-10-03T10:11:13.285520+0000","last_became_active":"2023-10-03T10:11:13.278120+0000","last_became_peered":"2023-10-03T10:11:13.278120+0000","last_unstale":"2023-10-03T10:11:13.285520+0000","last_undegraded":"2023-10-03T10:11:13.285520+0000","last_fullsized":"2023-10-03T10:11:13.285520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276989+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:11:13.276989+0000","last_peered":"2023-10-03T10:11:13.276989+0000","last_clean":"2023-10-03T10:11:13.276989+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:11:13.276989+0000","last_undegraded":"2023-10-03T10:11:13.276989+0000","last_fullsized":"2023-10-03T10:11:13.276989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:18.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-03T10:11:18.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 Processor -- start 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 -- start start 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7220094c20 0x7f7220127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7220096760 con 0x7f7220094c20 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7220091ff0 con 0x7f7220091b00 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.229+0000 7f7225b97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7220092c80 con 0x7f7220096380 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7220094c20 0x7f7220127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7220094c20 0x7f7220127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44226/0 (socket says 172.21.15.19:44226) 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54260/0 (socket says 172.21.15.19:54260) 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42042/0 (socket says 172.21.15.19:42042) 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 -- 172.21.15.19:0/3703795501 learned_addr learned my addr 172.21.15.19:0/3703795501 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 -- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 msgr2=0x7f7220094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 -- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 msgr2=0x7f7220127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 -- 172.21.15.19:0/3703795501 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220093900 con 0x7f7220094c20 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721f7fe700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:18.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721ffff700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220094c20 0x7f7220127af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7218009f20 tx=0x7f7218009840).ready entity=mon.0 client_cookie=57bd0143144906f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:18.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721e7fc700 1 -- 172.21.15.19:0/3703795501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800e070 con 0x7f7220094c20 2023-10-03T10:11:18.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721e7fc700 1 -- 172.21.15.19:0/3703795501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721800b970 con 0x7f7220094c20 2023-10-03T10:11:18.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.230+0000 7f721e7fc700 1 -- 172.21.15.19:0/3703795501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800bcf0 con 0x7f7220094c20 2023-10-03T10:11:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 -- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220094c20 msgr2=0x7f7220127af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220094c20 0x7f7220127af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f7218009f20 tx=0x7f7218009840).stop 2023-10-03T10:11:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 -- 172.21.15.19:0/3703795501 shutdown_connections 2023-10-03T10:11:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220094c20 0x7f7220127af0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220096380 0x7f7220094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 --2- 172.21.15.19:0/3703795501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 -- 172.21.15.19:0/3703795501 >> 172.21.15.19:0/3703795501 conn(0x7f7220097470 msgr2=0x7f7220097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 -- 172.21.15.19:0/3703795501 shutdown_connections 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.231+0000 7f7225b97700 1 -- 172.21.15.19:0/3703795501 wait complete. 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.232+0000 7f7225b97700 1 Processor -- start 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.232+0000 7f7225b97700 1 -- start start 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220069ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 0x7f722012c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 0x7f722012c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7220127d70 con 0x7f7220096380 2023-10-03T10:11:18.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72200694c0 con 0x7f7220091b00 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7220066b40 con 0x7f7220094c20 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 0x7f722012c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 0x7f722012c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220069ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 0x7f722012c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44240/0 (socket says 172.21.15.19:44240) 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721ffff700 1 -- 172.21.15.19:0/3459174274 learned_addr learned my addr 172.21.15.19:0/3459174274 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 -- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 msgr2=0x7f7220069ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220069ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 -- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 msgr2=0x7f722012c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 0x7f722012c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 -- 172.21.15.19:0/3459174274 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72100092a0 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721f7fe700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f721effd700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 0x7f722012c500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f720800e900 tx=0x7f7208009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208009450 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7208012600 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208012980 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.233+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7218009ae0 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.234+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7220068fc0 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.234+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7208012d30 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.234+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f720803b2e0 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.235+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f722005a260 con 0x7f7220094c20 2023-10-03T10:11:18.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.239+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7208011b00 con 0x7f7220094c20 2023-10-03T10:11:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.481+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f722012d300 con 0x7f7220094c20 2023-10-03T10:11:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.482+0000 7f72177fe700 1 -- 172.21.15.19:0/3459174274 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7f7208011b00 con 0x7f7220094c20 2023-10-03T10:11:18.483 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:18.483 INFO:teuthology.orchestra.run.smithi019.stdout:{"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":17,"num_osds":4,"num_up_osds":4,"osd_up_since":1696327864,"num_in_osds":4,"osd_in_since":1696327858,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":1217560576,"bytes_avail":385329496064,"bytes_total":386547056640,"write_bytes_sec":6654,"read_op_per_sec":0,"write_op_per_sec":14},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4189}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-03T10:10:56.622120+0000","services":{}},"progress_events":{}} 2023-10-03T10:11:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 >> v1:172.21.15.19:6816/118286 conn(0x7f720002bb60 legacy=0x7f720002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 msgr2=0x7f722012c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 0x7f722012c500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f720800e900 tx=0x7f7208009060).stop 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 shutdown_connections 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220096380 0x7f722012c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7220091b00 0x7f7220069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 --2- 172.21.15.19:0/3459174274 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7220094c20 0x7f722012c500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.483+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 >> 172.21.15.19:0/3459174274 conn(0x7f7220097470 msgr2=0x7f7220098e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.484+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 shutdown_connections 2023-10-03T10:11:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.484+0000 7f7225b97700 1 -- 172.21.15.19:0/3459174274 wait complete. 2023-10-03T10:11:18.498 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-03T10:11:18.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:18.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.627+0000 7f4763e64700 1 Processor -- start 2023-10-03T10:11:18.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.627+0000 7f4763e64700 1 -- start start 2023-10-03T10:11:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.627+0000 7f4763e64700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f475c096380 0x7f475c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4763e64700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c094c20 0x7f475c127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4763e64700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c096760 con 0x7f475c091b00 2023-10-03T10:11:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4763e64700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c091ff0 con 0x7f475c096380 2023-10-03T10:11:18.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4763e64700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475c092c80 con 0x7f475c094c20 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f475c096380 0x7f475c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f47613ff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f475c091b00 0x7f475c127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47594/0 (socket says 172.21.15.19:47594) 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f47613ff700 1 -- 172.21.15.19:0/2549708856 learned_addr learned my addr 172.21.15.19:0/2549708856 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4762401700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c094c20 0x7f475c127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 -- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c094c20 msgr2=0x7f475c127d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c094c20 0x7f475c127d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 -- 172.21.15.19:0/2549708856 >> v1:172.21.15.19:6789/0 conn(0x7f475c091b00 legacy=0x7f475c127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 -- 172.21.15.19:0/2549708856 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c093900 con 0x7f475c096380 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4760bfe700 1 -- 172.21.15.19:0/2549708856 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172395620 0 0) 0x7f475c096760 con 0x7f475c091b00 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4761c00700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c096380 0x7f475c094730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4758009760 tx=0x7f4758009060).ready entity=mon.0 client_cookie=814772cdee68a80d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4760bfe700 1 -- 172.21.15.19:0/2549708856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800f510 con 0x7f475c096380 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4760bfe700 1 -- 172.21.15.19:0/2549708856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475800f670 con 0x7f475c096380 2023-10-03T10:11:18.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.628+0000 7f4760bfe700 1 -- 172.21.15.19:0/2549708856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475800f9f0 con 0x7f475c096380 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 -- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c096380 msgr2=0x7f475c094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c096380 0x7f475c094730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4758009760 tx=0x7f4758009060).stop 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 -- 172.21.15.19:0/2549708856 shutdown_connections 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c094c20 0x7f475c127d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 --2- 172.21.15.19:0/2549708856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c096380 0x7f475c094730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 -- 172.21.15.19:0/2549708856 >> 172.21.15.19:0/2549708856 conn(0x7f475c097470 msgr2=0x7f475c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 -- 172.21.15.19:0/2549708856 shutdown_connections 2023-10-03T10:11:18.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.629+0000 7f4763e64700 1 -- 172.21.15.19:0/2549708856 wait complete. 2023-10-03T10:11:18.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.630+0000 7f4763e64700 1 Processor -- start 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.630+0000 7f4763e64700 1 -- start start 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475c091b00 0x7f475c112b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 0x7f475c113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c115cd0 con 0x7f475c094c20 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c124ad0 con 0x7f475c091b00 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4763e64700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475c115ef0 con 0x7f475c096380 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f47613ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 0x7f475c113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f47613ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44264/0 (socket says 172.21.15.19:44264) 2023-10-03T10:11:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f47613ff700 1 -- 172.21.15.19:0/2378934389 learned_addr learned my addr 172.21.15.19:0/2378934389 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4761c00700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475c091b00 0x7f475c112b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 -- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475c091b00 msgr2=0x7f475c112b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475c091b00 0x7f475c112b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 -- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 msgr2=0x7f475c113040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 -- 172.21.15.19:0/2378934389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47580092a0 con 0x7f475c096380 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f47613ff700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.631+0000 7f4762401700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 0x7f475c113530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4754009e80 tx=0x7f475400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4754009bb0 con 0x7f475c096380 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400f040 con 0x7f475c096380 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400ccb0 con 0x7f475c096380 2023-10-03T10:11:18.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c06a4e0 con 0x7f475c096380 2023-10-03T10:11:18.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c116b70 con 0x7f475c096380 2023-10-03T10:11:18.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.632+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f475401d460 con 0x7f475c096380 2023-10-03T10:11:18.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.633+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f475403b6e0 con 0x7f475c096380 2023-10-03T10:11:18.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.633+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0991b0 con 0x7f475c096380 2023-10-03T10:11:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.638+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4754007700 con 0x7f475c096380 2023-10-03T10:11:18.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.809+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f475c05a260 con 0x7f474002bb60 2023-10-03T10:11:18.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.816+0000 7f4751ffb700 1 -- 172.21.15.19:0/2378934389 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+250003 (unknown 2965378022 0 1781328318) 0x7f475c05a260 con 0x7f474002bb60 2023-10-03T10:11:18.819 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.818+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 >> v1:172.21.15.19:6816/118286 conn(0x7f474002bb60 legacy=0x7f474002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.818+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 msgr2=0x7f475c113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:18.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.818+0000 7f4763e64700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 0x7f475c113530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f4754009e80 tx=0x7f475400b040).stop 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 shutdown_connections 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475c096380 0x7f475c113530 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475c091b00 0x7f475c112b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 --2- 172.21.15.19:0/2378934389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f475c094c20 0x7f475c113040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 >> 172.21.15.19:0/2378934389 conn(0x7f475c097470 msgr2=0x7f475c126f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 shutdown_connections 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:18.819+0000 7f4763e64700 1 -- 172.21.15.19:0/2378934389 wait complete. 2023-10-03T10:11:18.822 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:18.833 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-03T10:11:17.723176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":146,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000488"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268370+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:11:13.268370+0000","last_peered":"2023-10-03T10:11:13.268370+0000","last_clean":"2023-10-03T10:11:13.268370+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:11:13.268370+0000","last_undegraded":"2023-10-03T10:11:13.268370+0000","last_fullsized":"2023-10-03T10:11:13.268370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268760+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:11:13.268760+0000","last_peered":"2023-10-03T10:11:13.268760+0000","last_clean":"2023-10-03T10:11:13.268760+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:11:13.268760+0000","last_undegraded":"2023-10-03T10:11:13.268760+0000","last_fullsized":"2023-10-03T10:11:13.268760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276725+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:11:13.276725+0000","last_peered":"2023-10-03T10:11:13.276725+0000","last_clean":"2023-10-03T10:11:13.276725+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:11:13.276725+0000","last_undegraded":"2023-10-03T10:11:13.276725+0000","last_fullsized":"2023-10-03T10:11:13.276725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.277146+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:11:13.277146+0000","last_peered":"2023-10-03T10:11:13.277146+0000","last_clean":"2023-10-03T10:11:13.277146+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:11:13.277146+0000","last_undegraded":"2023-10-03T10:11:13.277146+0000","last_fullsized":"2023-10-03T10:11:13.277146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285549+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:11:13.285549+0000","last_peered":"2023-10-03T10:11:13.285549+0000","last_clean":"2023-10-03T10:11:13.285549+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:11:13.285549+0000","last_undegraded":"2023-10-03T10:11:13.285549+0000","last_fullsized":"2023-10-03T10:11:13.285549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276317+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:11:13.276317+0000","last_peered":"2023-10-03T10:11:13.276317+0000","last_clean":"2023-10-03T10:11:13.276317+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:11:13.276317+0000","last_undegraded":"2023-10-03T10:11:13.276317+0000","last_fullsized":"2023-10-03T10:11:13.276317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276451+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:11:13.276451+0000","last_peered":"2023-10-03T10:11:13.276451+0000","last_clean":"2023-10-03T10:11:13.276451+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:11:13.276451+0000","last_undegraded":"2023-10-03T10:11:13.276451+0000","last_fullsized":"2023-10-03T10:11:13.276451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285473+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:11:13.285473+0000","last_peered":"2023-10-03T10:11:13.285473+0000","last_clean":"2023-10-03T10:11:13.285473+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:11:13.285473+0000","last_undegraded":"2023-10-03T10:11:13.285473+0000","last_fullsized":"2023-10-03T10:11:13.285473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278826+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:11:13.278826+0000","last_peered":"2023-10-03T10:11:13.278826+0000","last_clean":"2023-10-03T10:11:13.278826+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:11:13.278826+0000","last_undegraded":"2023-10-03T10:11:13.278826+0000","last_fullsized":"2023-10-03T10:11:13.278826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285649+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:11:13.285649+0000","last_peered":"2023-10-03T10:11:13.285649+0000","last_clean":"2023-10-03T10:11:13.285649+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:11:13.285649+0000","last_undegraded":"2023-10-03T10:11:13.285649+0000","last_fullsized":"2023-10-03T10:11:13.285649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281847+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:11:13.281847+0000","last_peered":"2023-10-03T10:11:13.281847+0000","last_clean":"2023-10-03T10:11:13.281847+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:11:13.281847+0000","last_undegraded":"2023-10-03T10:11:13.281847+0000","last_fullsized":"2023-10-03T10:11:13.281847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276513+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:11:13.276513+0000","last_peered":"2023-10-03T10:11:13.276513+0000","last_clean":"2023-10-03T10:11:13.276513+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:11:13.276513+0000","last_undegraded":"2023-10-03T10:11:13.276513+0000","last_fullsized":"2023-10-03T10:11:13.276513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285497+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:11:13.285497+0000","last_peered":"2023-10-03T10:11:13.285497+0000","last_clean":"2023-10-03T10:11:13.285497+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:11:13.285497+0000","last_undegraded":"2023-10-03T10:11:13.285497+0000","last_fullsized":"2023-10-03T10:11:13.285497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276394+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:11:13.276394+0000","last_peered":"2023-10-03T10:11:13.276394+0000","last_clean":"2023-10-03T10:11:13.276394+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:11:13.276394+0000","last_undegraded":"2023-10-03T10:11:13.276394+0000","last_fullsized":"2023-10-03T10:11:13.276394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285853+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:11:13.285853+0000","last_peered":"2023-10-03T10:11:13.285853+0000","last_clean":"2023-10-03T10:11:13.285853+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:11:13.285853+0000","last_undegraded":"2023-10-03T10:11:13.285853+0000","last_fullsized":"2023-10-03T10:11:13.285853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276604+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:11:13.276604+0000","last_peered":"2023-10-03T10:11:13.276604+0000","last_clean":"2023-10-03T10:11:13.276604+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:11:13.276604+0000","last_undegraded":"2023-10-03T10:11:13.276604+0000","last_fullsized":"2023-10-03T10:11:13.276604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278163+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:11:13.278163+0000","last_peered":"2023-10-03T10:11:13.278163+0000","last_clean":"2023-10-03T10:11:13.278163+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:11:13.278163+0000","last_undegraded":"2023-10-03T10:11:13.278163+0000","last_fullsized":"2023-10-03T10:11:13.278163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286916+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:11:13.286916+0000","last_peered":"2023-10-03T10:11:13.286916+0000","last_clean":"2023-10-03T10:11:13.286916+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:11:13.286916+0000","last_undegraded":"2023-10-03T10:11:13.286916+0000","last_fullsized":"2023-10-03T10:11:13.286916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280713+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:11:13.280713+0000","last_peered":"2023-10-03T10:11:13.280713+0000","last_clean":"2023-10-03T10:11:13.280713+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:11:13.280713+0000","last_undegraded":"2023-10-03T10:11:13.280713+0000","last_fullsized":"2023-10-03T10:11:13.280713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276415+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:11:13.276415+0000","last_peered":"2023-10-03T10:11:13.276415+0000","last_clean":"2023-10-03T10:11:13.276415+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:11:13.276415+0000","last_undegraded":"2023-10-03T10:11:13.276415+0000","last_fullsized":"2023-10-03T10:11:13.276415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240250+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:11:13.240250+0000","last_peered":"2023-10-03T10:11:13.240250+0000","last_clean":"2023-10-03T10:11:13.240250+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:11:13.240250+0000","last_undegraded":"2023-10-03T10:11:13.240250+0000","last_fullsized":"2023-10-03T10:11:13.240250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287203+0000","last_change":"2023-10-03T10:11:13.283237+0000","last_active":"2023-10-03T10:11:13.287203+0000","last_peered":"2023-10-03T10:11:13.287203+0000","last_clean":"2023-10-03T10:11:13.287203+0000","last_became_active":"2023-10-03T10:11:13.282919+0000","last_became_peered":"2023-10-03T10:11:13.282919+0000","last_unstale":"2023-10-03T10:11:13.287203+0000","last_undegraded":"2023-10-03T10:11:13.287203+0000","last_fullsized":"2023-10-03T10:11:13.287203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252142+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:11:13.252142+0000","last_peered":"2023-10-03T10:11:13.252142+0000","last_clean":"2023-10-03T10:11:13.252142+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:11:13.252142+0000","last_undegraded":"2023-10-03T10:11:13.252142+0000","last_fullsized":"2023-10-03T10:11:13.252142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276531+0000","last_change":"2023-10-03T10:11:13.264719+0000","last_active":"2023-10-03T10:11:13.276531+0000","last_peered":"2023-10-03T10:11:13.276531+0000","last_clean":"2023-10-03T10:11:13.276531+0000","last_became_active":"2023-10-03T10:11:13.255651+0000","last_became_peered":"2023-10-03T10:11:13.255651+0000","last_unstale":"2023-10-03T10:11:13.276531+0000","last_undegraded":"2023-10-03T10:11:13.276531+0000","last_fullsized":"2023-10-03T10:11:13.276531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253054+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:11:13.253054+0000","last_peered":"2023-10-03T10:11:13.253054+0000","last_clean":"2023-10-03T10:11:13.253054+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:11:13.253054+0000","last_undegraded":"2023-10-03T10:11:13.253054+0000","last_fullsized":"2023-10-03T10:11:13.253054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276430+0000","last_change":"2023-10-03T10:11:13.268456+0000","last_active":"2023-10-03T10:11:13.276430+0000","last_peered":"2023-10-03T10:11:13.276430+0000","last_clean":"2023-10-03T10:11:13.276430+0000","last_became_active":"2023-10-03T10:11:13.267206+0000","last_became_peered":"2023-10-03T10:11:13.267206+0000","last_unstale":"2023-10-03T10:11:13.276430+0000","last_undegraded":"2023-10-03T10:11:13.276430+0000","last_fullsized":"2023-10-03T10:11:13.276430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.284853+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:11:13.284853+0000","last_peered":"2023-10-03T10:11:13.284853+0000","last_clean":"2023-10-03T10:11:13.284853+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:11:13.284853+0000","last_undegraded":"2023-10-03T10:11:13.284853+0000","last_fullsized":"2023-10-03T10:11:13.284853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287590+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:11:13.287590+0000","last_peered":"2023-10-03T10:11:13.287590+0000","last_clean":"2023-10-03T10:11:13.287590+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:11:13.287590+0000","last_undegraded":"2023-10-03T10:11:13.287590+0000","last_fullsized":"2023-10-03T10:11:13.287590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285616+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:11:13.285616+0000","last_peered":"2023-10-03T10:11:13.285616+0000","last_clean":"2023-10-03T10:11:13.285616+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:11:13.285616+0000","last_undegraded":"2023-10-03T10:11:13.285616+0000","last_fullsized":"2023-10-03T10:11:13.285616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280900+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:11:13.280900+0000","last_peered":"2023-10-03T10:11:13.280900+0000","last_clean":"2023-10-03T10:11:13.280900+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:11:13.280900+0000","last_undegraded":"2023-10-03T10:11:13.280900+0000","last_fullsized":"2023-10-03T10:11:13.280900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280337+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:11:13.280337+0000","last_peered":"2023-10-03T10:11:13.280337+0000","last_clean":"2023-10-03T10:11:13.280337+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:11:13.280337+0000","last_undegraded":"2023-10-03T10:11:13.280337+0000","last_fullsized":"2023-10-03T10:11:13.280337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.246336+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:11:13.246336+0000","last_peered":"2023-10-03T10:11:13.246336+0000","last_clean":"2023-10-03T10:11:13.246336+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:11:13.246336+0000","last_undegraded":"2023-10-03T10:11:13.246336+0000","last_fullsized":"2023-10-03T10:11:13.246336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286895+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:11:13.286895+0000","last_peered":"2023-10-03T10:11:13.286895+0000","last_clean":"2023-10-03T10:11:13.286895+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:11:13.286895+0000","last_undegraded":"2023-10-03T10:11:13.286895+0000","last_fullsized":"2023-10-03T10:11:13.286895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240734+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:11:13.240734+0000","last_peered":"2023-10-03T10:11:13.240734+0000","last_clean":"2023-10-03T10:11:13.240734+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:11:13.240734+0000","last_undegraded":"2023-10-03T10:11:13.240734+0000","last_fullsized":"2023-10-03T10:11:13.240734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285224+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:11:13.285224+0000","last_peered":"2023-10-03T10:11:13.285224+0000","last_clean":"2023-10-03T10:11:13.285224+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:11:13.285224+0000","last_undegraded":"2023-10-03T10:11:13.285224+0000","last_fullsized":"2023-10-03T10:11:13.285224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287484+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:11:13.287484+0000","last_peered":"2023-10-03T10:11:13.287484+0000","last_clean":"2023-10-03T10:11:13.287484+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:11:13.287484+0000","last_undegraded":"2023-10-03T10:11:13.287484+0000","last_fullsized":"2023-10-03T10:11:13.287484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273737+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:11:13.273737+0000","last_peered":"2023-10-03T10:11:13.273737+0000","last_clean":"2023-10-03T10:11:13.273737+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:11:13.273737+0000","last_undegraded":"2023-10-03T10:11:13.273737+0000","last_fullsized":"2023-10-03T10:11:13.273737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276494+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:11:13.276494+0000","last_peered":"2023-10-03T10:11:13.276494+0000","last_clean":"2023-10-03T10:11:13.276494+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:11:13.276494+0000","last_undegraded":"2023-10-03T10:11:13.276494+0000","last_fullsized":"2023-10-03T10:11:13.276494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281554+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:11:13.281554+0000","last_peered":"2023-10-03T10:11:13.281554+0000","last_clean":"2023-10-03T10:11:13.281554+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:11:13.281554+0000","last_undegraded":"2023-10-03T10:11:13.281554+0000","last_fullsized":"2023-10-03T10:11:13.281554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283286+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:11:13.283286+0000","last_peered":"2023-10-03T10:11:13.283286+0000","last_clean":"2023-10-03T10:11:13.283286+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:11:13.283286+0000","last_undegraded":"2023-10-03T10:11:13.283286+0000","last_fullsized":"2023-10-03T10:11:13.283286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286761+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:11:13.286761+0000","last_peered":"2023-10-03T10:11:13.286761+0000","last_clean":"2023-10-03T10:11:13.286761+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:11:13.286761+0000","last_undegraded":"2023-10-03T10:11:13.286761+0000","last_fullsized":"2023-10-03T10:11:13.286761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.249192+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:11:13.249192+0000","last_peered":"2023-10-03T10:11:13.249192+0000","last_clean":"2023-10-03T10:11:13.249192+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:11:13.249192+0000","last_undegraded":"2023-10-03T10:11:13.249192+0000","last_fullsized":"2023-10-03T10:11:13.249192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281374+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:11:13.281374+0000","last_peered":"2023-10-03T10:11:13.281374+0000","last_clean":"2023-10-03T10:11:13.281374+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:11:13.281374+0000","last_undegraded":"2023-10-03T10:11:13.281374+0000","last_fullsized":"2023-10-03T10:11:13.281374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280752+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:11:13.280752+0000","last_peered":"2023-10-03T10:11:13.280752+0000","last_clean":"2023-10-03T10:11:13.280752+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:11:13.280752+0000","last_undegraded":"2023-10-03T10:11:13.280752+0000","last_fullsized":"2023-10-03T10:11:13.280752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285393+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:11:13.285393+0000","last_peered":"2023-10-03T10:11:13.285393+0000","last_clean":"2023-10-03T10:11:13.285393+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:11:13.285393+0000","last_undegraded":"2023-10-03T10:11:13.285393+0000","last_fullsized":"2023-10-03T10:11:13.285393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.241008+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:11:13.241008+0000","last_peered":"2023-10-03T10:11:13.241008+0000","last_clean":"2023-10-03T10:11:13.241008+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:11:13.241008+0000","last_undegraded":"2023-10-03T10:11:13.241008+0000","last_fullsized":"2023-10-03T10:11:13.241008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280692+0000","last_change":"2023-10-03T10:11:13.271873+0000","last_active":"2023-10-03T10:11:13.280692+0000","last_peered":"2023-10-03T10:11:13.280692+0000","last_clean":"2023-10-03T10:11:13.280692+0000","last_became_active":"2023-10-03T10:11:13.270857+0000","last_became_peered":"2023-10-03T10:11:13.270857+0000","last_unstale":"2023-10-03T10:11:13.280692+0000","last_undegraded":"2023-10-03T10:11:13.280692+0000","last_fullsized":"2023-10-03T10:11:13.280692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240604+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:11:13.240604+0000","last_peered":"2023-10-03T10:11:13.240604+0000","last_clean":"2023-10-03T10:11:13.240604+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:11:13.240604+0000","last_undegraded":"2023-10-03T10:11:13.240604+0000","last_fullsized":"2023-10-03T10:11:13.240604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285970+0000","last_change":"2023-10-03T10:11:13.281452+0000","last_active":"2023-10-03T10:11:13.285970+0000","last_peered":"2023-10-03T10:11:13.285970+0000","last_clean":"2023-10-03T10:11:13.285970+0000","last_became_active":"2023-10-03T10:11:13.279215+0000","last_became_peered":"2023-10-03T10:11:13.279215+0000","last_unstale":"2023-10-03T10:11:13.285970+0000","last_undegraded":"2023-10-03T10:11:13.285970+0000","last_fullsized":"2023-10-03T10:11:13.285970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.239668+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:11:13.239668+0000","last_peered":"2023-10-03T10:11:13.239668+0000","last_clean":"2023-10-03T10:11:13.239668+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:11:13.239668+0000","last_undegraded":"2023-10-03T10:11:13.239668+0000","last_fullsized":"2023-10-03T10:11:13.239668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252481+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:11:13.252481+0000","last_peered":"2023-10-03T10:11:13.252481+0000","last_clean":"2023-10-03T10:11:13.252481+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:11:13.252481+0000","last_undegraded":"2023-10-03T10:11:13.252481+0000","last_fullsized":"2023-10-03T10:11:13.252481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240906+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:13.240906+0000","last_peered":"2023-10-03T10:11:13.240906+0000","last_clean":"2023-10-03T10:11:13.240906+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:13.240906+0000","last_undegraded":"2023-10-03T10:11:13.240906+0000","last_fullsized":"2023-10-03T10:11:13.240906+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.250948+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:11:13.250948+0000","last_peered":"2023-10-03T10:11:13.250948+0000","last_clean":"2023-10-03T10:11:13.250948+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:11:13.250948+0000","last_undegraded":"2023-10-03T10:11:13.250948+0000","last_fullsized":"2023-10-03T10:11:13.250948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253245+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:13.253245+0000","last_peered":"2023-10-03T10:11:13.253245+0000","last_clean":"2023-10-03T10:11:13.253245+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:13.253245+0000","last_undegraded":"2023-10-03T10:11:13.253245+0000","last_fullsized":"2023-10-03T10:11:13.253245+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240708+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:13.240708+0000","last_peered":"2023-10-03T10:11:13.240708+0000","last_clean":"2023-10-03T10:11:13.240708+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:13.240708+0000","last_undegraded":"2023-10-03T10:11:13.240708+0000","last_fullsized":"2023-10-03T10:11:13.240708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240818+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:11:13.240818+0000","last_peered":"2023-10-03T10:11:13.240818+0000","last_clean":"2023-10-03T10:11:13.240818+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:11:13.240818+0000","last_undegraded":"2023-10-03T10:11:13.240818+0000","last_fullsized":"2023-10-03T10:11:13.240818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280736+0000","last_change":"2023-10-03T10:11:13.272220+0000","last_active":"2023-10-03T10:11:13.280736+0000","last_peered":"2023-10-03T10:11:13.280736+0000","last_clean":"2023-10-03T10:11:13.280736+0000","last_became_active":"2023-10-03T10:11:13.271605+0000","last_became_peered":"2023-10-03T10:11:13.271605+0000","last_unstale":"2023-10-03T10:11:13.280736+0000","last_undegraded":"2023-10-03T10:11:13.280736+0000","last_fullsized":"2023-10-03T10:11:13.280736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240139+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:13.240139+0000","last_peered":"2023-10-03T10:11:13.240139+0000","last_clean":"2023-10-03T10:11:13.240139+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:13.240139+0000","last_undegraded":"2023-10-03T10:11:13.240139+0000","last_fullsized":"2023-10-03T10:11:13.240139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.248096+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:11:13.248096+0000","last_peered":"2023-10-03T10:11:13.248096+0000","last_clean":"2023-10-03T10:11:13.248096+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:11:13.248096+0000","last_undegraded":"2023-10-03T10:11:13.248096+0000","last_fullsized":"2023-10-03T10:11:13.248096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276315+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:11:13.276315+0000","last_peered":"2023-10-03T10:11:13.276315+0000","last_clean":"2023-10-03T10:11:13.276315+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:11:13.276315+0000","last_undegraded":"2023-10-03T10:11:13.276315+0000","last_fullsized":"2023-10-03T10:11:13.276315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.243333+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:13.243333+0000","last_peered":"2023-10-03T10:11:13.243333+0000","last_clean":"2023-10-03T10:11:13.243333+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:13.243333+0000","last_undegraded":"2023-10-03T10:11:13.243333+0000","last_fullsized":"2023-10-03T10:11:13.243333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276101+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:11:13.276101+0000","last_peered":"2023-10-03T10:11:13.276101+0000","last_clean":"2023-10-03T10:11:13.276101+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:11:13.276101+0000","last_undegraded":"2023-10-03T10:11:13.276101+0000","last_fullsized":"2023-10-03T10:11:13.276101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283517+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:11:13.283517+0000","last_peered":"2023-10-03T10:11:13.283517+0000","last_clean":"2023-10-03T10:11:13.283517+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:11:13.283517+0000","last_undegraded":"2023-10-03T10:11:13.283517+0000","last_fullsized":"2023-10-03T10:11:13.283517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276475+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:11:13.276475+0000","last_peered":"2023-10-03T10:11:13.276475+0000","last_clean":"2023-10-03T10:11:13.276475+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:11:13.276475+0000","last_undegraded":"2023-10-03T10:11:13.276475+0000","last_fullsized":"2023-10-03T10:11:13.276475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251108+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:13.251108+0000","last_peered":"2023-10-03T10:11:13.251108+0000","last_clean":"2023-10-03T10:11:13.251108+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:13.251108+0000","last_undegraded":"2023-10-03T10:11:13.251108+0000","last_fullsized":"2023-10-03T10:11:13.251108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251664+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:11:13.251664+0000","last_peered":"2023-10-03T10:11:13.251664+0000","last_clean":"2023-10-03T10:11:13.251664+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:11:13.251664+0000","last_undegraded":"2023-10-03T10:11:13.251664+0000","last_fullsized":"2023-10-03T10:11:13.251664+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285553+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:11:13.285553+0000","last_peered":"2023-10-03T10:11:13.285553+0000","last_clean":"2023-10-03T10:11:13.285553+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:11:13.285553+0000","last_undegraded":"2023-10-03T10:11:13.285553+0000","last_fullsized":"2023-10-03T10:11:13.285553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278547+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:11:13.278547+0000","last_peered":"2023-10-03T10:11:13.278547+0000","last_clean":"2023-10-03T10:11:13.278547+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:11:13.278547+0000","last_undegraded":"2023-10-03T10:11:13.278547+0000","last_fullsized":"2023-10-03T10:11:13.278547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.271145+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:11:13.271145+0000","last_peered":"2023-10-03T10:11:13.271145+0000","last_clean":"2023-10-03T10:11:13.271145+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:11:13.271145+0000","last_undegraded":"2023-10-03T10:11:13.271145+0000","last_fullsized":"2023-10-03T10:11:13.271145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285634+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:11:13.285634+0000","last_peered":"2023-10-03T10:11:13.285634+0000","last_clean":"2023-10-03T10:11:13.285634+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:11:13.285634+0000","last_undegraded":"2023-10-03T10:11:13.285634+0000","last_fullsized":"2023-10-03T10:11:13.285634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281776+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:11:13.281776+0000","last_peered":"2023-10-03T10:11:13.281776+0000","last_clean":"2023-10-03T10:11:13.281776+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:11:13.281776+0000","last_undegraded":"2023-10-03T10:11:13.281776+0000","last_fullsized":"2023-10-03T10:11:13.281776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286788+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:11:13.286788+0000","last_peered":"2023-10-03T10:11:13.286788+0000","last_clean":"2023-10-03T10:11:13.286788+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:11:13.286788+0000","last_undegraded":"2023-10-03T10:11:13.286788+0000","last_fullsized":"2023-10-03T10:11:13.286788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276099+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:11:13.276099+0000","last_peered":"2023-10-03T10:11:13.276099+0000","last_clean":"2023-10-03T10:11:13.276099+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:11:13.276099+0000","last_undegraded":"2023-10-03T10:11:13.276099+0000","last_fullsized":"2023-10-03T10:11:13.276099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276468+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:11:13.276468+0000","last_peered":"2023-10-03T10:11:13.276468+0000","last_clean":"2023-10-03T10:11:13.276468+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:11:13.276468+0000","last_undegraded":"2023-10-03T10:11:13.276468+0000","last_fullsized":"2023-10-03T10:11:13.276468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273955+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:11:13.273955+0000","last_peered":"2023-10-03T10:11:13.273955+0000","last_clean":"2023-10-03T10:11:13.273955+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:11:13.273955+0000","last_undegraded":"2023-10-03T10:11:13.273955+0000","last_fullsized":"2023-10-03T10:11:13.273955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.261244+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:11:13.261244+0000","last_peered":"2023-10-03T10:11:13.261244+0000","last_clean":"2023-10-03T10:11:13.261244+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:11:13.261244+0000","last_undegraded":"2023-10-03T10:11:13.261244+0000","last_fullsized":"2023-10-03T10:11:13.261244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270710+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:11:13.270710+0000","last_peered":"2023-10-03T10:11:13.270710+0000","last_clean":"2023-10-03T10:11:13.270710+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:11:13.270710+0000","last_undegraded":"2023-10-03T10:11:13.270710+0000","last_fullsized":"2023-10-03T10:11:13.270710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285520+0000","last_change":"2023-10-03T10:11:13.278425+0000","last_active":"2023-10-03T10:11:13.285520+0000","last_peered":"2023-10-03T10:11:13.285520+0000","last_clean":"2023-10-03T10:11:13.285520+0000","last_became_active":"2023-10-03T10:11:13.278120+0000","last_became_peered":"2023-10-03T10:11:13.278120+0000","last_unstale":"2023-10-03T10:11:13.285520+0000","last_undegraded":"2023-10-03T10:11:13.285520+0000","last_fullsized":"2023-10-03T10:11:13.285520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276989+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:11:13.276989+0000","last_peered":"2023-10-03T10:11:13.276989+0000","last_clean":"2023-10-03T10:11:13.276989+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:11:13.276989+0000","last_undegraded":"2023-10-03T10:11:13.276989+0000","last_fullsized":"2023-10-03T10:11:13.276989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705667,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]}]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:21.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 Processor -- start 2023-10-03T10:11:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 -- start start 2023-10-03T10:11:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 0x7f669c094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c096760 con 0x7f669c091b00 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c091ff0 con 0x7f669c096380 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.979+0000 7f66a2386700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669c092c80 con 0x7f669c094c20 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 0x7f669c094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54312/0 (socket says 172.21.15.19:54312) 2023-10-03T10:11:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f669c091b00 0x7f669c127600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47598/0 (socket says 172.21.15.19:47598) 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 -- 172.21.15.19:0/1902954214 learned_addr learned my addr 172.21.15.19:0/1902954214 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 -- 172.21.15.19:0/1902954214 >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 msgr2=0x7f669c094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 --2- 172.21.15.19:0/1902954214 >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 0x7f669c094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 -- 172.21.15.19:0/1902954214 >> v1:172.21.15.19:6789/0 conn(0x7f669c091b00 legacy=0x7f669c127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669affd700 1 -- 172.21.15.19:0/1902954214 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448206291 0 0) 0x7f669c096760 con 0x7f669c091b00 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 -- 172.21.15.19:0/1902954214 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c093900 con 0x7f669c094c20 2023-10-03T10:11:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669bfff700 1 --2- 172.21.15.19:0/1902954214 >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 0x7f669c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f66a0923700 1 --2- 172.21.15.19:0/1902954214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6694009f20 tx=0x7f6694009840).ready entity=mon.2 client_cookie=7c2ac9a4c98f804e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669affd700 1 -- 172.21.15.19:0/1902954214 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400e070 con 0x7f669c094c20 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669affd700 1 -- 172.21.15.19:0/1902954214 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669400b9d0 con 0x7f669c094c20 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.980+0000 7f669affd700 1 -- 172.21.15.19:0/1902954214 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669400bd50 con 0x7f669c094c20 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 -- 172.21.15.19:0/1902954214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 msgr2=0x7f669c127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 --2- 172.21.15.19:0/1902954214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f6694009f20 tx=0x7f6694009840).stop 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 -- 172.21.15.19:0/1902954214 shutdown_connections 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 --2- 172.21.15.19:0/1902954214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c094c20 0x7f669c127d10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 --2- 172.21.15.19:0/1902954214 >> v2:172.21.15.19:3300/0 conn(0x7f669c096380 0x7f669c094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 -- 172.21.15.19:0/1902954214 >> 172.21.15.19:0/1902954214 conn(0x7f669c097470 msgr2=0x7f669c097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 -- 172.21.15.19:0/1902954214 shutdown_connections 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.981+0000 7f66a2386700 1 -- 172.21.15.19:0/1902954214 wait complete. 2023-10-03T10:11:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 Processor -- start 2023-10-03T10:11:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 -- start start 2023-10-03T10:11:21.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 0x7f669c069850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669c096380 0x7f669c13a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c112c90 con 0x7f669c094c20 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c099fb0 con 0x7f669c096380 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.982+0000 7f66a2386700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f669c1126f0 con 0x7f669c091b00 2023-10-03T10:11:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 0x7f669c069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44282/0 (socket says 172.21.15.19:44282) 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 0x7f669c069850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54318/0 (socket says 172.21.15.19:54318) 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 -- 172.21.15.19:0/3131534268 learned_addr learned my addr 172.21.15.19:0/3131534268 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f66a0923700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669c096380 0x7f669c13a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 -- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 msgr2=0x7f669c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 0x7f669c069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 -- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669c096380 msgr2=0x7f669c13a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669c096380 0x7f669c13a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 -- 172.21.15.19:0/3131534268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668c0092a0 con 0x7f669c094c20 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f669b7fe700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f669000c4c0 tx=0x7f6690007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000ce30 con 0x7f669c094c20 2023-10-03T10:11:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66900072e0 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900056e0 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6694009ae0 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.983+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c139eb0 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.984+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6690005a90 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.984+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f669003a6d0 con 0x7f669c094c20 2023-10-03T10:11:21.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.985+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c05a260 con 0x7f669c094c20 2023-10-03T10:11:21.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:21.989+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6690010af0 con 0x7f669c094c20 2023-10-03T10:11:22.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.159+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f669c0942e0 con 0x7f668802bb60 2023-10-03T10:11:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.166+0000 7f6683fff700 1 -- 172.21.15.19:0/3131534268 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249899 (unknown 2965378022 0 1500631381) 0x7f669c0942e0 con 0x7f668802bb60 2023-10-03T10:11:22.172 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:22.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 >> v1:172.21.15.19:6816/118286 conn(0x7f668802bb60 legacy=0x7f668802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 msgr2=0x7f669c13a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f669000c4c0 tx=0x7f6690007c10).stop 2023-10-03T10:11:22.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 shutdown_connections 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669c096380 0x7f669c13a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669c091b00 0x7f669c069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 --2- 172.21.15.19:0/3131534268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f669c094c20 0x7f669c13a1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 >> 172.21.15.19:0/3131534268 conn(0x7f669c097470 msgr2=0x7f669c12a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 shutdown_connections 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.169+0000 7f66a2386700 1 -- 172.21.15.19:0/3131534268 wait complete. 2023-10-03T10:11:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:22.183 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-03T10:11:21.724244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001556"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268370+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:11:13.268370+0000","last_peered":"2023-10-03T10:11:13.268370+0000","last_clean":"2023-10-03T10:11:13.268370+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:11:13.268370+0000","last_undegraded":"2023-10-03T10:11:13.268370+0000","last_fullsized":"2023-10-03T10:11:13.268370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268760+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:11:13.268760+0000","last_peered":"2023-10-03T10:11:13.268760+0000","last_clean":"2023-10-03T10:11:13.268760+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:11:13.268760+0000","last_undegraded":"2023-10-03T10:11:13.268760+0000","last_fullsized":"2023-10-03T10:11:13.268760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276725+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:11:13.276725+0000","last_peered":"2023-10-03T10:11:13.276725+0000","last_clean":"2023-10-03T10:11:13.276725+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:11:13.276725+0000","last_undegraded":"2023-10-03T10:11:13.276725+0000","last_fullsized":"2023-10-03T10:11:13.276725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.277146+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:11:13.277146+0000","last_peered":"2023-10-03T10:11:13.277146+0000","last_clean":"2023-10-03T10:11:13.277146+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:11:13.277146+0000","last_undegraded":"2023-10-03T10:11:13.277146+0000","last_fullsized":"2023-10-03T10:11:13.277146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285549+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:11:13.285549+0000","last_peered":"2023-10-03T10:11:13.285549+0000","last_clean":"2023-10-03T10:11:13.285549+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:11:13.285549+0000","last_undegraded":"2023-10-03T10:11:13.285549+0000","last_fullsized":"2023-10-03T10:11:13.285549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276317+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:11:13.276317+0000","last_peered":"2023-10-03T10:11:13.276317+0000","last_clean":"2023-10-03T10:11:13.276317+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:11:13.276317+0000","last_undegraded":"2023-10-03T10:11:13.276317+0000","last_fullsized":"2023-10-03T10:11:13.276317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276451+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:11:13.276451+0000","last_peered":"2023-10-03T10:11:13.276451+0000","last_clean":"2023-10-03T10:11:13.276451+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:11:13.276451+0000","last_undegraded":"2023-10-03T10:11:13.276451+0000","last_fullsized":"2023-10-03T10:11:13.276451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285473+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:11:13.285473+0000","last_peered":"2023-10-03T10:11:13.285473+0000","last_clean":"2023-10-03T10:11:13.285473+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:11:13.285473+0000","last_undegraded":"2023-10-03T10:11:13.285473+0000","last_fullsized":"2023-10-03T10:11:13.285473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278826+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:11:13.278826+0000","last_peered":"2023-10-03T10:11:13.278826+0000","last_clean":"2023-10-03T10:11:13.278826+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:11:13.278826+0000","last_undegraded":"2023-10-03T10:11:13.278826+0000","last_fullsized":"2023-10-03T10:11:13.278826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285649+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:11:13.285649+0000","last_peered":"2023-10-03T10:11:13.285649+0000","last_clean":"2023-10-03T10:11:13.285649+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:11:13.285649+0000","last_undegraded":"2023-10-03T10:11:13.285649+0000","last_fullsized":"2023-10-03T10:11:13.285649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281847+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:11:13.281847+0000","last_peered":"2023-10-03T10:11:13.281847+0000","last_clean":"2023-10-03T10:11:13.281847+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:11:13.281847+0000","last_undegraded":"2023-10-03T10:11:13.281847+0000","last_fullsized":"2023-10-03T10:11:13.281847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276513+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:11:13.276513+0000","last_peered":"2023-10-03T10:11:13.276513+0000","last_clean":"2023-10-03T10:11:13.276513+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:11:13.276513+0000","last_undegraded":"2023-10-03T10:11:13.276513+0000","last_fullsized":"2023-10-03T10:11:13.276513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285497+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:11:13.285497+0000","last_peered":"2023-10-03T10:11:13.285497+0000","last_clean":"2023-10-03T10:11:13.285497+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:11:13.285497+0000","last_undegraded":"2023-10-03T10:11:13.285497+0000","last_fullsized":"2023-10-03T10:11:13.285497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276394+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:11:13.276394+0000","last_peered":"2023-10-03T10:11:13.276394+0000","last_clean":"2023-10-03T10:11:13.276394+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:11:13.276394+0000","last_undegraded":"2023-10-03T10:11:13.276394+0000","last_fullsized":"2023-10-03T10:11:13.276394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285853+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:11:13.285853+0000","last_peered":"2023-10-03T10:11:13.285853+0000","last_clean":"2023-10-03T10:11:13.285853+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:11:13.285853+0000","last_undegraded":"2023-10-03T10:11:13.285853+0000","last_fullsized":"2023-10-03T10:11:13.285853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276604+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:11:13.276604+0000","last_peered":"2023-10-03T10:11:13.276604+0000","last_clean":"2023-10-03T10:11:13.276604+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:11:13.276604+0000","last_undegraded":"2023-10-03T10:11:13.276604+0000","last_fullsized":"2023-10-03T10:11:13.276604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278163+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:11:13.278163+0000","last_peered":"2023-10-03T10:11:13.278163+0000","last_clean":"2023-10-03T10:11:13.278163+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:11:13.278163+0000","last_undegraded":"2023-10-03T10:11:13.278163+0000","last_fullsized":"2023-10-03T10:11:13.278163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286916+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:11:13.286916+0000","last_peered":"2023-10-03T10:11:13.286916+0000","last_clean":"2023-10-03T10:11:13.286916+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:11:13.286916+0000","last_undegraded":"2023-10-03T10:11:13.286916+0000","last_fullsized":"2023-10-03T10:11:13.286916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280713+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:11:13.280713+0000","last_peered":"2023-10-03T10:11:13.280713+0000","last_clean":"2023-10-03T10:11:13.280713+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:11:13.280713+0000","last_undegraded":"2023-10-03T10:11:13.280713+0000","last_fullsized":"2023-10-03T10:11:13.280713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276415+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:11:13.276415+0000","last_peered":"2023-10-03T10:11:13.276415+0000","last_clean":"2023-10-03T10:11:13.276415+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:11:13.276415+0000","last_undegraded":"2023-10-03T10:11:13.276415+0000","last_fullsized":"2023-10-03T10:11:13.276415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240250+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:11:13.240250+0000","last_peered":"2023-10-03T10:11:13.240250+0000","last_clean":"2023-10-03T10:11:13.240250+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:11:13.240250+0000","last_undegraded":"2023-10-03T10:11:13.240250+0000","last_fullsized":"2023-10-03T10:11:13.240250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287203+0000","last_change":"2023-10-03T10:11:13.283237+0000","last_active":"2023-10-03T10:11:13.287203+0000","last_peered":"2023-10-03T10:11:13.287203+0000","last_clean":"2023-10-03T10:11:13.287203+0000","last_became_active":"2023-10-03T10:11:13.282919+0000","last_became_peered":"2023-10-03T10:11:13.282919+0000","last_unstale":"2023-10-03T10:11:13.287203+0000","last_undegraded":"2023-10-03T10:11:13.287203+0000","last_fullsized":"2023-10-03T10:11:13.287203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252142+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:11:13.252142+0000","last_peered":"2023-10-03T10:11:13.252142+0000","last_clean":"2023-10-03T10:11:13.252142+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:11:13.252142+0000","last_undegraded":"2023-10-03T10:11:13.252142+0000","last_fullsized":"2023-10-03T10:11:13.252142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276531+0000","last_change":"2023-10-03T10:11:13.264719+0000","last_active":"2023-10-03T10:11:13.276531+0000","last_peered":"2023-10-03T10:11:13.276531+0000","last_clean":"2023-10-03T10:11:13.276531+0000","last_became_active":"2023-10-03T10:11:13.255651+0000","last_became_peered":"2023-10-03T10:11:13.255651+0000","last_unstale":"2023-10-03T10:11:13.276531+0000","last_undegraded":"2023-10-03T10:11:13.276531+0000","last_fullsized":"2023-10-03T10:11:13.276531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253054+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:11:13.253054+0000","last_peered":"2023-10-03T10:11:13.253054+0000","last_clean":"2023-10-03T10:11:13.253054+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:11:13.253054+0000","last_undegraded":"2023-10-03T10:11:13.253054+0000","last_fullsized":"2023-10-03T10:11:13.253054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276430+0000","last_change":"2023-10-03T10:11:13.268456+0000","last_active":"2023-10-03T10:11:13.276430+0000","last_peered":"2023-10-03T10:11:13.276430+0000","last_clean":"2023-10-03T10:11:13.276430+0000","last_became_active":"2023-10-03T10:11:13.267206+0000","last_became_peered":"2023-10-03T10:11:13.267206+0000","last_unstale":"2023-10-03T10:11:13.276430+0000","last_undegraded":"2023-10-03T10:11:13.276430+0000","last_fullsized":"2023-10-03T10:11:13.276430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.284853+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:11:13.284853+0000","last_peered":"2023-10-03T10:11:13.284853+0000","last_clean":"2023-10-03T10:11:13.284853+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:11:13.284853+0000","last_undegraded":"2023-10-03T10:11:13.284853+0000","last_fullsized":"2023-10-03T10:11:13.284853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287590+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:11:13.287590+0000","last_peered":"2023-10-03T10:11:13.287590+0000","last_clean":"2023-10-03T10:11:13.287590+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:11:13.287590+0000","last_undegraded":"2023-10-03T10:11:13.287590+0000","last_fullsized":"2023-10-03T10:11:13.287590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285616+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:11:13.285616+0000","last_peered":"2023-10-03T10:11:13.285616+0000","last_clean":"2023-10-03T10:11:13.285616+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:11:13.285616+0000","last_undegraded":"2023-10-03T10:11:13.285616+0000","last_fullsized":"2023-10-03T10:11:13.285616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280900+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:11:13.280900+0000","last_peered":"2023-10-03T10:11:13.280900+0000","last_clean":"2023-10-03T10:11:13.280900+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:11:13.280900+0000","last_undegraded":"2023-10-03T10:11:13.280900+0000","last_fullsized":"2023-10-03T10:11:13.280900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280337+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:11:13.280337+0000","last_peered":"2023-10-03T10:11:13.280337+0000","last_clean":"2023-10-03T10:11:13.280337+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:11:13.280337+0000","last_undegraded":"2023-10-03T10:11:13.280337+0000","last_fullsized":"2023-10-03T10:11:13.280337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.246336+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:11:13.246336+0000","last_peered":"2023-10-03T10:11:13.246336+0000","last_clean":"2023-10-03T10:11:13.246336+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:11:13.246336+0000","last_undegraded":"2023-10-03T10:11:13.246336+0000","last_fullsized":"2023-10-03T10:11:13.246336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286895+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:11:13.286895+0000","last_peered":"2023-10-03T10:11:13.286895+0000","last_clean":"2023-10-03T10:11:13.286895+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:11:13.286895+0000","last_undegraded":"2023-10-03T10:11:13.286895+0000","last_fullsized":"2023-10-03T10:11:13.286895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240734+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:11:13.240734+0000","last_peered":"2023-10-03T10:11:13.240734+0000","last_clean":"2023-10-03T10:11:13.240734+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:11:13.240734+0000","last_undegraded":"2023-10-03T10:11:13.240734+0000","last_fullsized":"2023-10-03T10:11:13.240734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285224+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:11:13.285224+0000","last_peered":"2023-10-03T10:11:13.285224+0000","last_clean":"2023-10-03T10:11:13.285224+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:11:13.285224+0000","last_undegraded":"2023-10-03T10:11:13.285224+0000","last_fullsized":"2023-10-03T10:11:13.285224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287484+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:11:13.287484+0000","last_peered":"2023-10-03T10:11:13.287484+0000","last_clean":"2023-10-03T10:11:13.287484+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:11:13.287484+0000","last_undegraded":"2023-10-03T10:11:13.287484+0000","last_fullsized":"2023-10-03T10:11:13.287484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273737+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:11:13.273737+0000","last_peered":"2023-10-03T10:11:13.273737+0000","last_clean":"2023-10-03T10:11:13.273737+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:11:13.273737+0000","last_undegraded":"2023-10-03T10:11:13.273737+0000","last_fullsized":"2023-10-03T10:11:13.273737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276494+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:11:13.276494+0000","last_peered":"2023-10-03T10:11:13.276494+0000","last_clean":"2023-10-03T10:11:13.276494+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:11:13.276494+0000","last_undegraded":"2023-10-03T10:11:13.276494+0000","last_fullsized":"2023-10-03T10:11:13.276494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281554+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:11:13.281554+0000","last_peered":"2023-10-03T10:11:13.281554+0000","last_clean":"2023-10-03T10:11:13.281554+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:11:13.281554+0000","last_undegraded":"2023-10-03T10:11:13.281554+0000","last_fullsized":"2023-10-03T10:11:13.281554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283286+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:11:13.283286+0000","last_peered":"2023-10-03T10:11:13.283286+0000","last_clean":"2023-10-03T10:11:13.283286+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:11:13.283286+0000","last_undegraded":"2023-10-03T10:11:13.283286+0000","last_fullsized":"2023-10-03T10:11:13.283286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286761+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:11:13.286761+0000","last_peered":"2023-10-03T10:11:13.286761+0000","last_clean":"2023-10-03T10:11:13.286761+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:11:13.286761+0000","last_undegraded":"2023-10-03T10:11:13.286761+0000","last_fullsized":"2023-10-03T10:11:13.286761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.249192+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:11:13.249192+0000","last_peered":"2023-10-03T10:11:13.249192+0000","last_clean":"2023-10-03T10:11:13.249192+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:11:13.249192+0000","last_undegraded":"2023-10-03T10:11:13.249192+0000","last_fullsized":"2023-10-03T10:11:13.249192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281374+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:11:13.281374+0000","last_peered":"2023-10-03T10:11:13.281374+0000","last_clean":"2023-10-03T10:11:13.281374+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:11:13.281374+0000","last_undegraded":"2023-10-03T10:11:13.281374+0000","last_fullsized":"2023-10-03T10:11:13.281374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280752+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:11:13.280752+0000","last_peered":"2023-10-03T10:11:13.280752+0000","last_clean":"2023-10-03T10:11:13.280752+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:11:13.280752+0000","last_undegraded":"2023-10-03T10:11:13.280752+0000","last_fullsized":"2023-10-03T10:11:13.280752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285393+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:11:13.285393+0000","last_peered":"2023-10-03T10:11:13.285393+0000","last_clean":"2023-10-03T10:11:13.285393+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:11:13.285393+0000","last_undegraded":"2023-10-03T10:11:13.285393+0000","last_fullsized":"2023-10-03T10:11:13.285393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.241008+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:11:13.241008+0000","last_peered":"2023-10-03T10:11:13.241008+0000","last_clean":"2023-10-03T10:11:13.241008+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:11:13.241008+0000","last_undegraded":"2023-10-03T10:11:13.241008+0000","last_fullsized":"2023-10-03T10:11:13.241008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280692+0000","last_change":"2023-10-03T10:11:13.271873+0000","last_active":"2023-10-03T10:11:13.280692+0000","last_peered":"2023-10-03T10:11:13.280692+0000","last_clean":"2023-10-03T10:11:13.280692+0000","last_became_active":"2023-10-03T10:11:13.270857+0000","last_became_peered":"2023-10-03T10:11:13.270857+0000","last_unstale":"2023-10-03T10:11:13.280692+0000","last_undegraded":"2023-10-03T10:11:13.280692+0000","last_fullsized":"2023-10-03T10:11:13.280692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240604+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:11:13.240604+0000","last_peered":"2023-10-03T10:11:13.240604+0000","last_clean":"2023-10-03T10:11:13.240604+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:11:13.240604+0000","last_undegraded":"2023-10-03T10:11:13.240604+0000","last_fullsized":"2023-10-03T10:11:13.240604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285970+0000","last_change":"2023-10-03T10:11:13.281452+0000","last_active":"2023-10-03T10:11:13.285970+0000","last_peered":"2023-10-03T10:11:13.285970+0000","last_clean":"2023-10-03T10:11:13.285970+0000","last_became_active":"2023-10-03T10:11:13.279215+0000","last_became_peered":"2023-10-03T10:11:13.279215+0000","last_unstale":"2023-10-03T10:11:13.285970+0000","last_undegraded":"2023-10-03T10:11:13.285970+0000","last_fullsized":"2023-10-03T10:11:13.285970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.239668+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:11:13.239668+0000","last_peered":"2023-10-03T10:11:13.239668+0000","last_clean":"2023-10-03T10:11:13.239668+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:11:13.239668+0000","last_undegraded":"2023-10-03T10:11:13.239668+0000","last_fullsized":"2023-10-03T10:11:13.239668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252481+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:11:13.252481+0000","last_peered":"2023-10-03T10:11:13.252481+0000","last_clean":"2023-10-03T10:11:13.252481+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:11:13.252481+0000","last_undegraded":"2023-10-03T10:11:13.252481+0000","last_fullsized":"2023-10-03T10:11:13.252481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240906+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:13.240906+0000","last_peered":"2023-10-03T10:11:13.240906+0000","last_clean":"2023-10-03T10:11:13.240906+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:13.240906+0000","last_undegraded":"2023-10-03T10:11:13.240906+0000","last_fullsized":"2023-10-03T10:11:13.240906+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.250948+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:11:13.250948+0000","last_peered":"2023-10-03T10:11:13.250948+0000","last_clean":"2023-10-03T10:11:13.250948+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:11:13.250948+0000","last_undegraded":"2023-10-03T10:11:13.250948+0000","last_fullsized":"2023-10-03T10:11:13.250948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253245+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:13.253245+0000","last_peered":"2023-10-03T10:11:13.253245+0000","last_clean":"2023-10-03T10:11:13.253245+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:13.253245+0000","last_undegraded":"2023-10-03T10:11:13.253245+0000","last_fullsized":"2023-10-03T10:11:13.253245+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240708+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:13.240708+0000","last_peered":"2023-10-03T10:11:13.240708+0000","last_clean":"2023-10-03T10:11:13.240708+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:13.240708+0000","last_undegraded":"2023-10-03T10:11:13.240708+0000","last_fullsized":"2023-10-03T10:11:13.240708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240818+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:11:13.240818+0000","last_peered":"2023-10-03T10:11:13.240818+0000","last_clean":"2023-10-03T10:11:13.240818+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:11:13.240818+0000","last_undegraded":"2023-10-03T10:11:13.240818+0000","last_fullsized":"2023-10-03T10:11:13.240818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280736+0000","last_change":"2023-10-03T10:11:13.272220+0000","last_active":"2023-10-03T10:11:13.280736+0000","last_peered":"2023-10-03T10:11:13.280736+0000","last_clean":"2023-10-03T10:11:13.280736+0000","last_became_active":"2023-10-03T10:11:13.271605+0000","last_became_peered":"2023-10-03T10:11:13.271605+0000","last_unstale":"2023-10-03T10:11:13.280736+0000","last_undegraded":"2023-10-03T10:11:13.280736+0000","last_fullsized":"2023-10-03T10:11:13.280736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240139+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:13.240139+0000","last_peered":"2023-10-03T10:11:13.240139+0000","last_clean":"2023-10-03T10:11:13.240139+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:13.240139+0000","last_undegraded":"2023-10-03T10:11:13.240139+0000","last_fullsized":"2023-10-03T10:11:13.240139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.248096+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:11:13.248096+0000","last_peered":"2023-10-03T10:11:13.248096+0000","last_clean":"2023-10-03T10:11:13.248096+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:11:13.248096+0000","last_undegraded":"2023-10-03T10:11:13.248096+0000","last_fullsized":"2023-10-03T10:11:13.248096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276315+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:11:13.276315+0000","last_peered":"2023-10-03T10:11:13.276315+0000","last_clean":"2023-10-03T10:11:13.276315+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:11:13.276315+0000","last_undegraded":"2023-10-03T10:11:13.276315+0000","last_fullsized":"2023-10-03T10:11:13.276315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.243333+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:13.243333+0000","last_peered":"2023-10-03T10:11:13.243333+0000","last_clean":"2023-10-03T10:11:13.243333+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:13.243333+0000","last_undegraded":"2023-10-03T10:11:13.243333+0000","last_fullsized":"2023-10-03T10:11:13.243333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276101+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:11:13.276101+0000","last_peered":"2023-10-03T10:11:13.276101+0000","last_clean":"2023-10-03T10:11:13.276101+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:11:13.276101+0000","last_undegraded":"2023-10-03T10:11:13.276101+0000","last_fullsized":"2023-10-03T10:11:13.276101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283517+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:11:13.283517+0000","last_peered":"2023-10-03T10:11:13.283517+0000","last_clean":"2023-10-03T10:11:13.283517+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:11:13.283517+0000","last_undegraded":"2023-10-03T10:11:13.283517+0000","last_fullsized":"2023-10-03T10:11:13.283517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276475+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:11:13.276475+0000","last_peered":"2023-10-03T10:11:13.276475+0000","last_clean":"2023-10-03T10:11:13.276475+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:11:13.276475+0000","last_undegraded":"2023-10-03T10:11:13.276475+0000","last_fullsized":"2023-10-03T10:11:13.276475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251108+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:13.251108+0000","last_peered":"2023-10-03T10:11:13.251108+0000","last_clean":"2023-10-03T10:11:13.251108+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:13.251108+0000","last_undegraded":"2023-10-03T10:11:13.251108+0000","last_fullsized":"2023-10-03T10:11:13.251108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:11:15.346855+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:11:15.346855+0000","last_peered":"2023-10-03T10:11:15.346855+0000","last_clean":"2023-10-03T10:11:15.346855+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:11:15.346855+0000","last_undegraded":"2023-10-03T10:11:15.346855+0000","last_fullsized":"2023-10-03T10:11:15.346855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285553+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:11:13.285553+0000","last_peered":"2023-10-03T10:11:13.285553+0000","last_clean":"2023-10-03T10:11:13.285553+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:11:13.285553+0000","last_undegraded":"2023-10-03T10:11:13.285553+0000","last_fullsized":"2023-10-03T10:11:13.285553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278547+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:11:13.278547+0000","last_peered":"2023-10-03T10:11:13.278547+0000","last_clean":"2023-10-03T10:11:13.278547+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:11:13.278547+0000","last_undegraded":"2023-10-03T10:11:13.278547+0000","last_fullsized":"2023-10-03T10:11:13.278547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.271145+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:11:13.271145+0000","last_peered":"2023-10-03T10:11:13.271145+0000","last_clean":"2023-10-03T10:11:13.271145+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:11:13.271145+0000","last_undegraded":"2023-10-03T10:11:13.271145+0000","last_fullsized":"2023-10-03T10:11:13.271145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285634+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:11:13.285634+0000","last_peered":"2023-10-03T10:11:13.285634+0000","last_clean":"2023-10-03T10:11:13.285634+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:11:13.285634+0000","last_undegraded":"2023-10-03T10:11:13.285634+0000","last_fullsized":"2023-10-03T10:11:13.285634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281776+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:11:13.281776+0000","last_peered":"2023-10-03T10:11:13.281776+0000","last_clean":"2023-10-03T10:11:13.281776+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:11:13.281776+0000","last_undegraded":"2023-10-03T10:11:13.281776+0000","last_fullsized":"2023-10-03T10:11:13.281776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286788+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:11:13.286788+0000","last_peered":"2023-10-03T10:11:13.286788+0000","last_clean":"2023-10-03T10:11:13.286788+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:11:13.286788+0000","last_undegraded":"2023-10-03T10:11:13.286788+0000","last_fullsized":"2023-10-03T10:11:13.286788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276099+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:11:13.276099+0000","last_peered":"2023-10-03T10:11:13.276099+0000","last_clean":"2023-10-03T10:11:13.276099+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:11:13.276099+0000","last_undegraded":"2023-10-03T10:11:13.276099+0000","last_fullsized":"2023-10-03T10:11:13.276099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276468+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:11:13.276468+0000","last_peered":"2023-10-03T10:11:13.276468+0000","last_clean":"2023-10-03T10:11:13.276468+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:11:13.276468+0000","last_undegraded":"2023-10-03T10:11:13.276468+0000","last_fullsized":"2023-10-03T10:11:13.276468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273955+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:11:13.273955+0000","last_peered":"2023-10-03T10:11:13.273955+0000","last_clean":"2023-10-03T10:11:13.273955+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:11:13.273955+0000","last_undegraded":"2023-10-03T10:11:13.273955+0000","last_fullsized":"2023-10-03T10:11:13.273955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.261244+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:11:13.261244+0000","last_peered":"2023-10-03T10:11:13.261244+0000","last_clean":"2023-10-03T10:11:13.261244+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:11:13.261244+0000","last_undegraded":"2023-10-03T10:11:13.261244+0000","last_fullsized":"2023-10-03T10:11:13.261244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270710+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:11:13.270710+0000","last_peered":"2023-10-03T10:11:13.270710+0000","last_clean":"2023-10-03T10:11:13.270710+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:11:13.270710+0000","last_undegraded":"2023-10-03T10:11:13.270710+0000","last_fullsized":"2023-10-03T10:11:13.270710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285520+0000","last_change":"2023-10-03T10:11:13.278425+0000","last_active":"2023-10-03T10:11:13.285520+0000","last_peered":"2023-10-03T10:11:13.285520+0000","last_clean":"2023-10-03T10:11:13.285520+0000","last_became_active":"2023-10-03T10:11:13.278120+0000","last_became_peered":"2023-10-03T10:11:13.278120+0000","last_unstale":"2023-10-03T10:11:13.285520+0000","last_undegraded":"2023-10-03T10:11:13.285520+0000","last_fullsized":"2023-10-03T10:11:13.285520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276989+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:11:13.276989+0000","last_peered":"2023-10-03T10:11:13.276989+0000","last_clean":"2023-10-03T10:11:13.276989+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:11:13.276989+0000","last_undegraded":"2023-10-03T10:11:13.276989+0000","last_fullsized":"2023-10-03T10:11:13.276989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]}]},{"osd":1,"up_from":9,"seq":38654705668,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:22.189 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-03T10:11:22.189 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:11:22.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:11:22.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:11:22.190 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.354+0000 7f2e2e670700 1 Processor -- start 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 -- start start 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e28059070 0x7f2e28127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 0x7f2e28095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e28091b60 con 0x7f2e28127390 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e28096940 con 0x7f2e28059070 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2e670700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28059c00 con 0x7f2e28127d80 2023-10-03T10:11:22.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e2cc0d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 0x7f2e28095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e27fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e28059070 0x7f2e28127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e277fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2e28127390 0x7f2e28095370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47612/0 (socket says 172.21.15.19:47612) 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.355+0000 7f2e277fe700 1 -- 172.21.15.19:0/3734552046 learned_addr learned my addr 172.21.15.19:0/3734552046 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e27fff700 1 -- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 msgr2=0x7f2e28095a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e27fff700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 0x7f2e28095a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e27fff700 1 -- 172.21.15.19:0/3734552046 >> v1:172.21.15.19:6789/0 conn(0x7f2e28127390 legacy=0x7f2e28095370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e26ffd700 1 -- 172.21.15.19:0/3734552046 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331513037 0 0) 0x7f2e28091b60 con 0x7f2e28127390 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e27fff700 1 -- 172.21.15.19:0/3734552046 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280929d0 con 0x7f2e28059070 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e2cc0d700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 0x7f2e28095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e27fff700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28059070 0x7f2e28127890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2e18009760 tx=0x7f2e18009060).ready entity=mon.0 client_cookie=e9dece961e223b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e26ffd700 1 -- 172.21.15.19:0/3734552046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180090d0 con 0x7f2e28059070 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e26ffd700 1 -- 172.21.15.19:0/3734552046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800f510 con 0x7f2e28059070 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.356+0000 7f2e26ffd700 1 -- 172.21.15.19:0/3734552046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800f890 con 0x7f2e28059070 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 -- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28059070 msgr2=0x7f2e28127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28059070 0x7f2e28127890 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f2e18009760 tx=0x7f2e18009060).stop 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 -- 172.21.15.19:0/3734552046 shutdown_connections 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28127d80 0x7f2e28095a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 --2- 172.21.15.19:0/3734552046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28059070 0x7f2e28127890 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 -- 172.21.15.19:0/3734552046 >> 172.21.15.19:0/3734552046 conn(0x7f2e28097470 msgr2=0x7f2e28097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 -- 172.21.15.19:0/3734552046 shutdown_connections 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.357+0000 7f2e2e670700 1 -- 172.21.15.19:0/3734552046 wait complete. 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 Processor -- start 2023-10-03T10:11:22.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 -- start start 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 0x7f2e28115380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28127d80 0x7f2e28115870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28116d80 con 0x7f2e28127d80 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28126a30 con 0x7f2e28059070 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e2e670700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e28096f20 con 0x7f2e28127390 2023-10-03T10:11:22.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e27fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42094/0 (socket says 172.21.15.19:42094) 2023-10-03T10:11:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 0x7f2e28115380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.358+0000 7f2e27fff700 1 -- 172.21.15.19:0/693166675 learned_addr learned my addr 172.21.15.19:0/693166675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e2cc0d700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28127d80 0x7f2e28115870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 -- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 msgr2=0x7f2e28115380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 0x7f2e28115380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 -- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28127d80 msgr2=0x7f2e28115870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28127d80 0x7f2e28115870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 -- 172.21.15.19:0/693166675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009a20 con 0x7f2e28059070 2023-10-03T10:11:22.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e277fe700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 0x7f2e28115380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:22.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e27fff700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2e18009e00 tx=0x7f2e18017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:22.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800f890 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18006930 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e180092a0 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800fea0 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.359+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e28114c60 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.360+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f2e1801b620 con 0x7f2e28059070 2023-10-03T10:11:22.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.360+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f2e1803cca0 con 0x7f2e28059070 2023-10-03T10:11:22.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.360+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2805a260 con 0x7f2e28059070 2023-10-03T10:11:22.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.365+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2e1801f020 con 0x7f2e28059070 2023-10-03T10:11:22.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.585+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2e28046c20 con 0x7f2e28059070 2023-10-03T10:11:22.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.586+0000 7f2e0ffff700 1 -- 172.21.15.19:0/693166675 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+64130 (secure 0 0 0) 0x7f2e18029070 con 0x7f2e28059070 2023-10-03T10:11:22.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:22.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 >> v1:172.21.15.19:6816/118286 conn(0x7f2e1402bb60 legacy=0x7f2e1402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 msgr2=0x7f2e28114e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2e18009e00 tx=0x7f2e18017000).stop 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 shutdown_connections 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e28127d80 0x7f2e28115870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e28059070 0x7f2e28114e90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 --2- 172.21.15.19:0/693166675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e28127390 0x7f2e28115380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 >> 172.21.15.19:0/693166675 conn(0x7f2e28097470 msgr2=0x7f2e280943d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.588+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 shutdown_connections 2023-10-03T10:11:22.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.589+0000 7f2e2e670700 1 -- 172.21.15.19:0/693166675 wait complete. 2023-10-03T10:11:22.602 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6816","nonce":118286}]},"active_addr":"172.21.15.19:6816/118286","active_change":"2023-10-03T10:11:01.713045+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2933255455}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2596252035}]}]} 2023-10-03T10:11:22.604 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:11:22.604 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:11:22.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.734+0000 7fdd7bc7d700 1 Processor -- start 2023-10-03T10:11:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.734+0000 7fdd7bc7d700 1 -- start start 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.734+0000 7fdd7bc7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 0x7fdd74096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.734+0000 7fdd7bc7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 0x7fdd740970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd7bc7d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd74068df0 con 0x7fdd740975e0 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd7bc7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7406a4c0 con 0x7fdd74067940 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd7bc7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74098260 con 0x7fdd74096820 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 0x7fdd740970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd7a21a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdd740975e0 0x7fdd7412f270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47626/0 (socket says 172.21.15.19:47626) 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd7a21a700 1 -- 172.21.15.19:0/4044120653 learned_addr learned my addr 172.21.15.19:0/4044120653 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79a19700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 0x7fdd74096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 -- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 msgr2=0x7fdd74096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 0x7fdd74096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd78a17700 1 -- 172.21.15.19:0/4044120653 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546243382 0 0) 0x7fdd74068df0 con 0x7fdd740975e0 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 -- 172.21.15.19:0/4044120653 >> v1:172.21.15.19:6789/0 conn(0x7fdd740975e0 legacy=0x7fdd7412f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 -- 172.21.15.19:0/4044120653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74095e60 con 0x7fdd74067940 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79a19700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 0x7fdd74096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd79218700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 0x7fdd740970f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdd64009790 tx=0x7fdd64009060).ready entity=mon.1 client_cookie=fc42fe77339a13e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd78a17700 1 -- 172.21.15.19:0/4044120653 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400f510 con 0x7fdd74067940 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd78a17700 1 -- 172.21.15.19:0/4044120653 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6400f670 con 0x7fdd74067940 2023-10-03T10:11:22.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.735+0000 7fdd78a17700 1 -- 172.21.15.19:0/4044120653 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400f9f0 con 0x7fdd74067940 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 msgr2=0x7fdd740970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 0x7fdd740970f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fdd64009790 tx=0x7fdd64009060).stop 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4044120653 shutdown_connections 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74096820 0x7fdd74096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4044120653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd74067940 0x7fdd740970f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4044120653 >> 172.21.15.19:0/4044120653 conn(0x7fdd7409ba50 msgr2=0x7fdd7409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4044120653 shutdown_connections 2023-10-03T10:11:22.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.736+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4044120653 wait complete. 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.737+0000 7fdd7bc7d700 1 Processor -- start 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.737+0000 7fdd7bc7d700 1 -- start start 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.737+0000 7fdd7bc7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 0x7fdd741381a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.737+0000 7fdd7bc7d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7bc7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 0x7fdd74138b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:22.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7bc7d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74139070 con 0x7fdd74096820 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7bc7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7411bf10 con 0x7fdd740975e0 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7bc7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74067e30 con 0x7fdd74067940 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79a19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 0x7fdd741381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7a21a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 0x7fdd74138b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79a19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 0x7fdd741381a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54340/0 (socket says 172.21.15.19:54340) 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79a19700 1 -- 172.21.15.19:0/4258958037 learned_addr learned my addr 172.21.15.19:0/4258958037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44300/0 (socket says 172.21.15.19:44300) 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 -- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 msgr2=0x7fdd741381a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 0x7fdd741381a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 -- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 msgr2=0x7fdd74138b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 0x7fdd74138b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 -- 172.21.15.19:0/4258958037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700092a0 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7a21a700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 0x7fdd74138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd79218700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdd64014000 tx=0x7fdd64017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400f7e0 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6400f940 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd640092a0 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.738+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6401b640 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.739+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7411c560 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.739+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdd6401ba30 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.739+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdd6403c7a0 con 0x7fdd74096820 2023-10-03T10:11:22.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.740+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd74091b70 con 0x7fdd74096820 2023-10-03T10:11:22.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.744+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdd64029080 con 0x7fdd74096820 2023-10-03T10:11:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.920+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd7405a260 con 0x7fdd74096820 2023-10-03T10:11:22.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.921+0000 7fdd69ffb700 1 -- 172.21.15.19:0/4258958037 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fdd6401f020 con 0x7fdd74096820 2023-10-03T10:11:22.922 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:22.922 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 >> v1:172.21.15.19:6816/118286 conn(0x7fdd5802bb60 legacy=0x7fdd5802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 msgr2=0x7fdd74138690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdd64014000 tx=0x7fdd64017000).stop 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 shutdown_connections 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd740975e0 0x7fdd74138b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd74067940 0x7fdd741381a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 --2- 172.21.15.19:0/4258958037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd74096820 0x7fdd74138690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.922+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 >> 172.21.15.19:0/4258958037 conn(0x7fdd7409ba50 msgr2=0x7fdd740998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.923+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 shutdown_connections 2023-10-03T10:11:22.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:22.923+0000 7fdd7bc7d700 1 -- 172.21.15.19:0/4258958037 wait complete. 2023-10-03T10:11:22.937 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:11:22.937 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:23.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 Processor -- start 2023-10-03T10:11:23.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 -- start start 2023-10-03T10:11:23.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 0x7f232c0969c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c0933b0 con 0x7f232c0682d0 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c092190 con 0x7f232c0965e0 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2332a23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c069a20 con 0x7f232c096eb0 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f232b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f232b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42124/0 (socket says 172.21.15.19:42124) 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f232bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 0x7f232c0969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f232b7fe700 1 -- 172.21.15.19:0/1364503711 learned_addr learned my addr 172.21.15.19:0/1364503711 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.067+0000 7f2330fc0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f232c0682d0 0x7f232c12ec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47634/0 (socket says 172.21.15.19:47634) 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232b7fe700 1 -- 172.21.15.19:0/1364503711 >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 msgr2=0x7f232c0969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232b7fe700 1 --2- 172.21.15.19:0/1364503711 >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 0x7f232c0969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232b7fe700 1 -- 172.21.15.19:0/1364503711 >> v1:172.21.15.19:6789/0 conn(0x7f232c0682d0 legacy=0x7f232c12ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232b7fe700 1 -- 172.21.15.19:0/1364503711 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c069ca0 con 0x7f232c096eb0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232affd700 1 -- 172.21.15.19:0/1364503711 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840111890 0 0) 0x7f232c0933b0 con 0x7f232c0682d0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232bfff700 1 --2- 172.21.15.19:0/1364503711 >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 0x7f232c0969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232b7fe700 1 --2- 172.21.15.19:0/1364503711 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2320006fd0 tx=0x7f23200090f0).ready entity=mon.1 client_cookie=b9f00dce9677751b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232affd700 1 -- 172.21.15.19:0/1364503711 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000b580 con 0x7f232c096eb0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232affd700 1 -- 172.21.15.19:0/1364503711 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232000b6e0 con 0x7f232c096eb0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.068+0000 7f232affd700 1 -- 172.21.15.19:0/1364503711 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000ba60 con 0x7f232c096eb0 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 -- 172.21.15.19:0/1364503711 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 msgr2=0x7f232c067de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 --2- 172.21.15.19:0/1364503711 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f2320006fd0 tx=0x7f23200090f0).stop 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 -- 172.21.15.19:0/1364503711 shutdown_connections 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 --2- 172.21.15.19:0/1364503711 >> v2:172.21.15.19:3300/0 conn(0x7f232c0965e0 0x7f232c0969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 --2- 172.21.15.19:0/1364503711 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c096eb0 0x7f232c067de0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 -- 172.21.15.19:0/1364503711 >> 172.21.15.19:0/1364503711 conn(0x7f232c09a220 msgr2=0x7f232c09a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 -- 172.21.15.19:0/1364503711 shutdown_connections 2023-10-03T10:11:23.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 -- 172.21.15.19:0/1364503711 wait complete. 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.069+0000 7f2332a23700 1 Processor -- start 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 -- start start 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 0x7f232c13a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f232c096eb0 0x7f232c119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c131410 con 0x7f232c096eb0 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c11c560 con 0x7f232c0965e0 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2332a23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0666d0 con 0x7f232c0682d0 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f232b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f232bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 0x7f232c13a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f232b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42128/0 (socket says 172.21.15.19:42128) 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f232b7fe700 1 -- 172.21.15.19:0/1353817253 learned_addr learned my addr 172.21.15.19:0/1353817253 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.070+0000 7f2330fc0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f232c096eb0 0x7f232c119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 -- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 msgr2=0x7f232c13a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 0x7f232c13a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 -- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f232c096eb0 msgr2=0x7f232c119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f232c096eb0 0x7f232c119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 -- 172.21.15.19:0/1353817253 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0092a0 con 0x7f232c0965e0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232bfff700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 0x7f232c13a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f232b7fe700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f232c069b60 tx=0x7f2320017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320000bc0 con 0x7f232c0965e0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232000b850 con 0x7f232c0965e0 2023-10-03T10:11:23.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2320009370 con 0x7f232c0965e0 2023-10-03T10:11:23.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320000d20 con 0x7f232c0965e0 2023-10-03T10:11:23.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.071+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c11d430 con 0x7f232c0965e0 2023-10-03T10:11:23.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.072+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f232001d890 con 0x7f232c0965e0 2023-10-03T10:11:23.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.072+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f232003d0d0 con 0x7f232c0965e0 2023-10-03T10:11:23.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.072+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c05a260 con 0x7f232c0965e0 2023-10-03T10:11:23.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.077+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f232000b9c0 con 0x7f232c0965e0 2023-10-03T10:11:23.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.250+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f232c069210 con 0x7f232c0965e0 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.251+0000 7f2313fff700 1 -- 172.21.15.19:0/1353817253 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f23200103a0 con 0x7f232c0965e0 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:23.252 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 >> v1:172.21.15.19:6816/118286 conn(0x7f231802bb60 legacy=0x7f231802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 msgr2=0x7f232c13ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f232c069b60 tx=0x7f2320017000).stop 2023-10-03T10:11:23.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 shutdown_connections 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f232c096eb0 0x7f232c119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f232c0682d0 0x7f232c13a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 --2- 172.21.15.19:0/1353817253 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f232c0965e0 0x7f232c13ab20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 >> 172.21.15.19:0/1353817253 conn(0x7f232c09a220 msgr2=0x7f232c099000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 shutdown_connections 2023-10-03T10:11:23.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.253+0000 7f2332a23700 1 -- 172.21.15.19:0/1353817253 wait complete. 2023-10-03T10:11:23.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:11:23.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:11:23.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:11:23.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:11:23.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.408+0000 7fba2d059700 1 Processor -- start 2023-10-03T10:11:23.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.408+0000 7fba2d059700 1 -- start start 2023-10-03T10:11:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2d059700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba28096380 0x7fba28094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2d059700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2d059700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba28096760 con 0x7fba28094c20 2023-10-03T10:11:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2d059700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba28091ff0 con 0x7fba28096380 2023-10-03T10:11:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2d059700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba28092c80 con 0x7fba28091b00 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba26d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fba28096380 0x7fba28094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2759e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba28094c20 0x7fba28127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47646/0 (socket says 172.21.15.19:47646) 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2759e700 1 -- 172.21.15.19:0/1508178728 learned_addr learned my addr 172.21.15.19:0/1508178728 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba2659c700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7f63d5d52700 1 Processor -- start 2023-10-03T10:11:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 -- start start 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.409+0000 7fba25d9b700 1 -- 172.21.15.19:0/1508178728 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510768999 0 0) 0x7fba28096760 con 0x7fba28094c20 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba25d9b700 1 -- 172.21.15.19:0/1508178728 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba100033f0 con 0x7fba28094c20 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba26d9d700 1 -- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 msgr2=0x7fba28127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba26d9d700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba26d9d700 1 -- 172.21.15.19:0/1508178728 >> v1:172.21.15.19:6789/0 conn(0x7fba28094c20 legacy=0x7fba28127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba26d9d700 1 -- 172.21.15.19:0/1508178728 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28093900 con 0x7fba28096380 2023-10-03T10:11:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba26d9d700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28096380 0x7fba28094730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fba18009790 tx=0x7fba18009060).ready entity=mon.0 client_cookie=56153e69411565e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d0090040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d00960b0 con 0x7f63d0090530 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0096520 con 0x7f63d0067ba0 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63d5d52700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0068ef0 con 0x7f63d0068470 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba25d9b700 1 -- 172.21.15.19:0/1508178728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800d4a0 con 0x7fba28096380 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba25d9b700 1 -- 172.21.15.19:0/1508178728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800d600 con 0x7fba28096380 2023-10-03T10:11:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7fba25d9b700 1 -- 172.21.15.19:0/1508178728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800d980 con 0x7fba28096380 2023-10-03T10:11:23.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63cf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63cf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42150/0 (socket says 172.21.15.19:42150) 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63cf7fe700 1 -- 172.21.15.19:0/2369509453 learned_addr learned my addr 172.21.15.19:0/2369509453 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.410+0000 7f63cffff700 1 --1- 172.21.15.19:0/2369509453 >> v1:172.21.15.19:6789/0 conn(0x7f63d0090530 0x7f63d0130070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47648/0 (socket says 172.21.15.19:47648) 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63cf7fe700 1 -- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 msgr2=0x7f63d0090040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63cf7fe700 1 --2- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d0090040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63cf7fe700 1 -- 172.21.15.19:0/2369509453 >> v1:172.21.15.19:6789/0 conn(0x7f63d0090530 legacy=0x7f63d0130070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63cf7fe700 1 -- 172.21.15.19:0/2369509453 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d006a960 con 0x7f63d0067ba0 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63cf7fe700 1 --2- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f63c4009840 tx=0x7f63c4009060).ready entity=mon.1 client_cookie=752b9463ab89d157 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63ce7fc700 1 -- 172.21.15.19:0/2369509453 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005880 con 0x7f63d0067ba0 2023-10-03T10:11:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 -- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28096380 msgr2=0x7fba28094730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28096380 0x7fba28094730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fba18009790 tx=0x7fba18009060).stop 2023-10-03T10:11:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63ce7fc700 1 -- 172.21.15.19:0/2369509453 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c40059e0 con 0x7f63d0067ba0 2023-10-03T10:11:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7f63ce7fc700 1 -- 172.21.15.19:0/2369509453 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005d60 con 0x7f63d0067ba0 2023-10-03T10:11:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 -- 172.21.15.19:0/1508178728 shutdown_connections 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28096380 0x7fba28094730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 --2- 172.21.15.19:0/1508178728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 -- 172.21.15.19:0/1508178728 >> 172.21.15.19:0/1508178728 conn(0x7fba28097470 msgr2=0x7fba28097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 -- 172.21.15.19:0/1508178728 shutdown_connections 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.411+0000 7fba2d059700 1 -- 172.21.15.19:0/1508178728 wait complete. 2023-10-03T10:11:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 -- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 msgr2=0x7f63d0067f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 --2- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f63c4009840 tx=0x7f63c4009060).stop 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 -- 172.21.15.19:0/2369509453 shutdown_connections 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 --2- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0067ba0 0x7f63d0067f80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 --2- 172.21.15.19:0/2369509453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d0090040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.412+0000 7f63d5d52700 1 -- 172.21.15.19:0/2369509453 >> 172.21.15.19:0/2369509453 conn(0x7f63d009a750 msgr2=0x7f63d00967d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f8634781700 1 Processor -- start 2023-10-03T10:11:23.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f63d5d52700 1 -- 172.21.15.19:0/2369509453 shutdown_connections 2023-10-03T10:11:23.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 Processor -- start 2023-10-03T10:11:23.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f8634781700 1 -- start start 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 -- start start 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28124ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28094c20 0x7fba28112b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 0x7fba28113050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28114d20 con 0x7fba28094c20 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2806a5e0 con 0x7fba28091b00 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2d059700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba280990c0 con 0x7fba28096380 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 0x7fba28113050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba26d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28124ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 0x7fba28113050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54378/0 (socket says 172.21.15.19:54378) 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7fba2759e700 1 -- 172.21.15.19:0/305119117 learned_addr learned my addr 172.21.15.19:0/305119117 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba26d9d700 1 -- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 msgr2=0x7fba28113050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba26d9d700 1 --2- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 0x7fba28113050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba26d9d700 1 -- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28094c20 msgr2=0x7fba28112b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba26d9d700 1 --2- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba28094c20 0x7fba28112b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba26d9d700 1 -- 172.21.15.19:0/305119117 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180092a0 con 0x7fba28091b00 2023-10-03T10:11:23.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7fba2759e700 1 --2- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba28096380 0x7fba28113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8634781700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8634781700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c132980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8634781700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c065ed0 con 0x7f862c0654a0 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8634781700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c095880 con 0x7f862c099190 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8634781700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f862c096120 con 0x7f862c098d50 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54392/0 (socket says 172.21.15.19:54392) 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 -- 172.21.15.19:0/3764345413 learned_addr learned my addr 172.21.15.19:0/3764345413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8632d1e700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c132980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 -- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 msgr2=0x7f862c132980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c132980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f8631d1c700 1 -- 172.21.15.19:0/3764345413 >> v1:172.21.15.19:6789/0 conn(0x7f862c0654a0 legacy=0x7f862c098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f8631d1c700 1 -- 172.21.15.19:0/3764345413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c066280 con 0x7f862c098d50 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f63d5d52700 1 -- 172.21.15.19:0/2369509453 wait complete. 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 Processor -- start 2023-10-03T10:11:23.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 -- start start 2023-10-03T10:11:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7fba26d9d700 1 --2- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28124ba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fba18009760 tx=0x7fba18016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f8631d1c700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f861c009830 tx=0x7f861c0090f0).ready entity=mon.2 client_cookie=f6fb9987244e8726 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f863151b700 1 -- 172.21.15.19:0/3764345413 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00b600 con 0x7f862c098d50 2023-10-03T10:11:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f863151b700 1 -- 172.21.15.19:0/3764345413 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00b760 con 0x7f862c098d50 2023-10-03T10:11:23.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f863151b700 1 -- 172.21.15.19:0/3764345413 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00bae0 con 0x7f862c098d50 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18000c90 con 0x7fba28091b00 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1800d770 con 0x7fba28091b00 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1801d430 con 0x7fba28091b00 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63d0067ba0 0x7f63d013a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d013aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0090530 0x7f63d013afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00900e0 con 0x7f63d0067ba0 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d0096270 con 0x7f63d0090530 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63d5d52700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63d008f5b0 con 0x7f63d0068470 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f63ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d013aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d013aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54414/0 (socket says 172.21.15.19:54414) 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 -- 172.21.15.19:0/2361732579 learned_addr learned my addr 172.21.15.19:0/2361732579 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63cf7fe700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63d0067ba0 0x7f63d013a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 -- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0090530 msgr2=0x7f63d013afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63d0090530 0x7f63d013afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 -- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63d0067ba0 msgr2=0x7f63d013a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63d0067ba0 0x7f63d013a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 -- 172.21.15.19:0/2361732579 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4009300 con 0x7f63d0068470 2023-10-03T10:11:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63ceffd700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d013aab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f63c000b560 tx=0x7f63c00090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f63cf7fe700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63d0067ba0 0x7f63d013a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f753ec98700 1 Processor -- start 2023-10-03T10:11:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.413+0000 7f753ec98700 1 -- start start 2023-10-03T10:11:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba28116060 con 0x7fba28091b00 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f753ec98700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538123a90 0x7f7538123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f753ec98700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f753ec98700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7538068880 con 0x7f7538126f70 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f753ec98700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75380680c0 con 0x7f7538067ce0 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f753ec98700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7538068c90 con 0x7f7538123a90 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f7537fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f7537fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42184/0 (socket says 172.21.15.19:42184) 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.414+0000 7f7537fff700 1 -- 172.21.15.19:0/2821299528 learned_addr learned my addr 172.21.15.19:0/2821299528 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f7537fff700 1 -- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538123a90 msgr2=0x7f7538123e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f7537fff700 1 --2- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538123a90 0x7f7538123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f7537fff700 1 -- 172.21.15.19:0/2821299528 >> v1:172.21.15.19:6789/0 conn(0x7f7538126f70 legacy=0x7f75381273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f7537fff700 1 -- 172.21.15.19:0/2821299528 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538124430 con 0x7f7538067ce0 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f7537fff700 1 --2- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7524009830 tx=0x7f75240090f0).ready entity=mon.1 client_cookie=c81d2d8946bfa25b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f75377fe700 1 -- 172.21.15.19:0/2821299528 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400b600 con 0x7f7538067ce0 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba28116cb0 con 0x7fba28091b00 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f75377fe700 1 -- 172.21.15.19:0/2821299528 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400b760 con 0x7f7538067ce0 2023-10-03T10:11:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.415+0000 7f75377fe700 1 -- 172.21.15.19:0/2821299528 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400bae0 con 0x7f7538067ce0 2023-10-03T10:11:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f8634781700 1 -- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 msgr2=0x7f862c130480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.416+0000 7f8634781700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f861c009830 tx=0x7f861c0090f0).stop 2023-10-03T10:11:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fba1801c390 con 0x7fba28091b00 2023-10-03T10:11:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 -- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 msgr2=0x7f7538092340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 --2- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f7524009830 tx=0x7f75240090f0).stop 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba28098890 con 0x7fba28091b00 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00023f0 con 0x7f63d0068470 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0002550 con 0x7f63d0068470 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0002910 con 0x7f63d0068470 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f8634781700 1 -- 172.21.15.19:0/3764345413 shutdown_connections 2023-10-03T10:11:23.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f8634781700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c132980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f8634781700 1 --2- 172.21.15.19:0/3764345413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c130480 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f8634781700 1 -- 172.21.15.19:0/3764345413 >> 172.21.15.19:0/3764345413 conn(0x7f862c09a740 msgr2=0x7f862c09ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d0062b80 con 0x7f63d0068470 2023-10-03T10:11:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d008fe30 con 0x7f63d0068470 2023-10-03T10:11:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 -- 172.21.15.19:0/2821299528 shutdown_connections 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 --2- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538123a90 0x7f7538123e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 --2- 172.21.15.19:0/2821299528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538067ce0 0x7f7538092340 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7f753ec98700 1 -- 172.21.15.19:0/2821299528 >> 172.21.15.19:0/2821299528 conn(0x7f753809a220 msgr2=0x7f753809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f753ec98700 1 -- 172.21.15.19:0/2821299528 shutdown_connections 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7f753ec98700 1 -- 172.21.15.19:0/2821299528 wait complete. 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.417+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fba1803b960 con 0x7fba28091b00 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 --> v1:172.21.15.19:6812/118856 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba14038490 con 0x7fba140347a0 2023-10-03T10:11:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.418+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba18024900 con 0x7fba28091b00 2023-10-03T10:11:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f8634781700 1 -- 172.21.15.19:0/3764345413 shutdown_connections 2023-10-03T10:11:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f8634781700 1 -- 172.21.15.19:0/3764345413 wait complete. 2023-10-03T10:11:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f63d005a260 con 0x7f63d0068470 2023-10-03T10:11:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f63c0012410 con 0x7f63d0068470 2023-10-03T10:11:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f753ec98700 1 Processor -- start 2023-10-03T10:11:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== osd.3 v1:172.21.15.19:6812/118856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fba14038490 con 0x7fba140347a0 2023-10-03T10:11:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f63c003afc0 con 0x7f63d0068470 2023-10-03T10:11:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.419+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 --> v1:172.21.15.19:6800/118826 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63bc038630 con 0x7f63bc034940 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 Processor -- start 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 -- start start 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862c0654a0 0x7f862c1193a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c119890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c119d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c11a270 con 0x7f862c0654a0 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c11ce40 con 0x7f862c099190 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f8634781700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f862c11da20 con 0x7f862c098d50 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c119890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c119890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54440/0 (socket says 172.21.15.19:54440) 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 -- 172.21.15.19:0/2859593255 learned_addr learned my addr 172.21.15.19:0/2859593255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f863251d700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862c0654a0 0x7f862c1193a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8632d1e700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c119d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 -- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 msgr2=0x7f862c119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c119d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 -- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862c0654a0 msgr2=0x7f862c1193a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f862c0654a0 0x7f862c1193a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 -- 172.21.15.19:0/2859593255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009370 con 0x7f862c098d50 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8632d1e700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f862c099190 0x7f862c119d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f8631d1c700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c119890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f861c009f80 tx=0x7f861c017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00b8d0 con 0x7f862c098d50 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c00ba30 con 0x7f862c098d50 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c099b00 con 0x7f862c098d50 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c01a430 con 0x7f862c098d50 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 -- start start 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538067ce0 0x7f7538111910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 0x7f7538111e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538126f70 0x7f75381122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7538113f90 con 0x7f7538123a90 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7538099d30 con 0x7f7538126f70 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.420+0000 7f753ec98700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75380697c0 con 0x7f7538067ce0 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 0x7f7538111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 0x7f7538111e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44368/0 (socket says 172.21.15.19:44368) 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 -- 172.21.15.19:0/3428069395 learned_addr learned my addr 172.21.15.19:0/3428069395 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f753ca34700 1 --2- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538067ce0 0x7f7538111910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 -- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538067ce0 msgr2=0x7f7538111910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 --2- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7538067ce0 0x7f7538111910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 -- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538126f70 msgr2=0x7f75381122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 --2- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7538126f70 0x7f75381122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.421+0000 7f7537fff700 1 -- 172.21.15.19:0/3428069395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7524009370 con 0x7f7538123a90 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f7537fff700 1 --2- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 0x7f7538111e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7524009130 tx=0x7f7524017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c11afb0 con 0x7f862c098d50 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752400b8d0 con 0x7f7538123a90 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752400ba30 con 0x7f7538123a90 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752401c650 con 0x7f7538123a90 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7538116080 con 0x7f7538123a90 2023-10-03T10:11:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7538115ca0 con 0x7f7538123a90 2023-10-03T10:11:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.423+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f862c05a260 con 0x7f862c098d50 2023-10-03T10:11:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.423+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f753805a260 con 0x7f7538123a90 2023-10-03T10:11:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.423+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f861c021020 con 0x7f862c098d50 2023-10-03T10:11:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f861c045400 con 0x7f862c098d50 2023-10-03T10:11:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f752401ca80 con 0x7f7538123a90 2023-10-03T10:11:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 --> v1:172.21.15.19:6804/118825 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f86100384e0 con 0x7f86100347f0 2023-10-03T10:11:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f861c0456c0 con 0x7f862c098d50 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f752405f0b0 con 0x7f7538123a90 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 --> v1:172.21.15.19:6808/118843 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f751c038630 con 0x7f751c034940 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.424+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f752405f3e0 con 0x7f7538123a90 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.422+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c003f4f0 con 0x7f63d0068470 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.425+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== osd.2 v1:172.21.15.19:6800/118826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f63bc038630 con 0x7f63bc034940 2023-10-03T10:11:23.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.425+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== osd.1 v1:172.21.15.19:6804/118825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f86100384e0 con 0x7f86100347f0 2023-10-03T10:11:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.426+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== osd.0 v1:172.21.15.19:6808/118843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f751c038630 con 0x7f751c034940 2023-10-03T10:11:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.437+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 --> v1:172.21.15.19:6812/118856 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba28116cb0 con 0x7fba140347a0 2023-10-03T10:11:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.437+0000 7fba0effd700 1 -- 172.21.15.19:0/305119117 <== osd.3 v1:172.21.15.19:6812/118856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fba28116cb0 con 0x7fba140347a0 2023-10-03T10:11:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.437+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 >> v1:172.21.15.19:6812/118856 conn(0x7fba140347a0 legacy=0x7fba14036c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 >> v1:172.21.15.19:6816/118286 conn(0x7fba1402bb90 legacy=0x7fba1402e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 msgr2=0x7fba28124ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 --2- 172.21.15.19:0/305119117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba28091b00 0x7fba28124ba0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fba18009760 tx=0x7fba18016000).stop 2023-10-03T10:11:23.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2759e700 1 -- 172.21.15.19:0/305119117 reap_dead start 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 shutdown_connections 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 >> 172.21.15.19:0/305119117 conn(0x7fba28097470 msgr2=0x7fba28059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 shutdown_connections 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.438+0000 7fba2d059700 1 -- 172.21.15.19:0/305119117 wait complete. 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 --> v1:172.21.15.19:6800/118826 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f63d008f210 con 0x7f63bc034940 2023-10-03T10:11:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63b77fe700 1 -- 172.21.15.19:0/2361732579 <== osd.2 v1:172.21.15.19:6800/118826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2972949718) 0x7f63d008f210 con 0x7f63bc034940 2023-10-03T10:11:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 >> v1:172.21.15.19:6800/118826 conn(0x7f63bc034940 legacy=0x7f63bc036dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 >> v1:172.21.15.19:6816/118286 conn(0x7f63bc02bbb0 legacy=0x7f63bc02e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 msgr2=0x7f63d013aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63d5d52700 1 --2- 172.21.15.19:0/2361732579 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63d0068470 0x7f63d013aab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f63c000b560 tx=0x7f63c00090f0).stop 2023-10-03T10:11:23.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.441+0000 7f63cffff700 1 -- 172.21.15.19:0/2361732579 reap_dead start 2023-10-03T10:11:23.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.442+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 shutdown_connections 2023-10-03T10:11:23.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.442+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 >> 172.21.15.19:0/2361732579 conn(0x7f63d009a750 msgr2=0x7f63d0093790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.442+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 shutdown_connections 2023-10-03T10:11:23.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.442+0000 7f63d5d52700 1 -- 172.21.15.19:0/2361732579 wait complete. 2023-10-03T10:11:23.453 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:23.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.452+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 --> v1:172.21.15.19:6808/118843 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7538115ca0 con 0x7f751c034940 2023-10-03T10:11:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f7534ff9700 1 -- 172.21.15.19:0/3428069395 <== osd.0 v1:172.21.15.19:6808/118843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f7538115ca0 con 0x7f751c034940 2023-10-03T10:11:23.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 >> v1:172.21.15.19:6808/118843 conn(0x7f751c034940 legacy=0x7f751c036dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 >> v1:172.21.15.19:6816/118286 conn(0x7f751c02bbb0 legacy=0x7f751c02e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 msgr2=0x7f7538111e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f753ec98700 1 --2- 172.21.15.19:0/3428069395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7538123a90 0x7f7538111e00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f7524009130 tx=0x7f7524017000).stop 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.453+0000 7f753d235700 1 -- 172.21.15.19:0/3428069395 reap_dead start 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.454+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 shutdown_connections 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.454+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 >> 172.21.15.19:0/3428069395 conn(0x7f753809a220 msgr2=0x7f7538066b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.454+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 shutdown_connections 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.454+0000 7f753ec98700 1 -- 172.21.15.19:0/3428069395 wait complete. 2023-10-03T10:11:23.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.455+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 --> v1:172.21.15.19:6804/118825 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f862c097400 con 0x7f86100347f0 2023-10-03T10:11:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.456+0000 7f86227fc700 1 -- 172.21.15.19:0/2859593255 <== osd.1 v1:172.21.15.19:6804/118825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f862c097400 con 0x7f86100347f0 2023-10-03T10:11:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.456+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 >> v1:172.21.15.19:6804/118825 conn(0x7f86100347f0 legacy=0x7f8610036c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.456+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 >> v1:172.21.15.19:6816/118286 conn(0x7f861002bb60 legacy=0x7f861002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.456+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 msgr2=0x7f862c119890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.456+0000 7f8634781700 1 --2- 172.21.15.19:0/2859593255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f862c098d50 0x7f862c119890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f861c009f80 tx=0x7f861c017000).stop 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.457+0000 7f8632d1e700 1 -- 172.21.15.19:0/2859593255 reap_dead start 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.457+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 shutdown_connections 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.457+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 >> 172.21.15.19:0/2859593255 conn(0x7f862c09a740 msgr2=0x7f862c12e690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.457+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 shutdown_connections 2023-10-03T10:11:23.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.457+0000 7f8634781700 1 -- 172.21.15.19:0/2859593255 wait complete. 2023-10-03T10:11:23.460 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-10-03T10:11:23.460 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:23.471 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:23.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:23.474 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:23.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.597+0000 7fb82f320700 1 Processor -- start 2023-10-03T10:11:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.597+0000 7fb82f320700 1 -- start start 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb8280613a0 0x7fb82812ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 0x7fb82812b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828095df0 0x7fb828096270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb828061780 con 0x7fb8280613a0 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82812abd0 con 0x7fb828095df0 2023-10-03T10:11:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82f320700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb828067530 con 0x7fb82812b2f0 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82d0bc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb8280613a0 0x7fb82812ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82d0bc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb8280613a0 0x7fb82812ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44390/0 (socket says 172.21.15.19:44390) 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82d0bc700 1 -- 172.21.15.19:0/3135938466 learned_addr learned my addr 172.21.15.19:0/3135938466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82c8bb700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 0x7fb82812b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.598+0000 7fb82d8bd700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828095df0 0x7fb828096270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 -- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 msgr2=0x7fb82812b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 0x7fb82812b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 -- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828095df0 msgr2=0x7fb828096270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828095df0 0x7fb828096270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 -- 172.21.15.19:0/3135938466 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280683c0 con 0x7fb8280613a0 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82c8bb700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 0x7fb82812b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8280613a0 0x7fb82812ae00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb824006fd0 tx=0x7fb8240090f0).ready entity=mon.0 client_cookie=efd597eea080be96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb81ffff700 1 -- 172.21.15.19:0/3135938466 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400f510 con 0x7fb8280613a0 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb81ffff700 1 -- 172.21.15.19:0/3135938466 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400f670 con 0x7fb8280613a0 2023-10-03T10:11:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.599+0000 7fb81ffff700 1 -- 172.21.15.19:0/3135938466 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400f9f0 con 0x7fb8280613a0 2023-10-03T10:11:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 -- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8280613a0 msgr2=0x7fb82812ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8280613a0 0x7fb82812ae00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fb824006fd0 tx=0x7fb8240090f0).stop 2023-10-03T10:11:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 -- 172.21.15.19:0/3135938466 shutdown_connections 2023-10-03T10:11:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828095df0 0x7fb828096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8280613a0 0x7fb82812ae00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 --2- 172.21.15.19:0/3135938466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812b2f0 0x7fb82812b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 -- 172.21.15.19:0/3135938466 >> 172.21.15.19:0/3135938466 conn(0x7fb82809a220 msgr2=0x7fb82809a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 -- 172.21.15.19:0/3135938466 shutdown_connections 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.600+0000 7fb82f320700 1 -- 172.21.15.19:0/3135938466 wait complete. 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.601+0000 7fb82f320700 1 Processor -- start 2023-10-03T10:11:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.601+0000 7fb82f320700 1 -- start start 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb828095df0 0x7fb828094e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 0x7fb828136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828067130 con 0x7fb82812b2f0 2023-10-03T10:11:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb828129470 con 0x7fb8280613a0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82f320700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb828112490 con 0x7fb828095df0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42246/0 (socket says 172.21.15.19:42246) 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 -- 172.21.15.19:0/4071721559 learned_addr learned my addr 172.21.15.19:0/4071721559 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d8bd700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 0x7fb828136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82c8bb700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb828095df0 0x7fb828094e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 -- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb828095df0 msgr2=0x7fb828094e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb828095df0 0x7fb828094e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 -- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 msgr2=0x7fb828136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 0x7fb828136060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 -- 172.21.15.19:0/4071721559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8180092a0 con 0x7fb8280613a0 2023-10-03T10:11:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d8bd700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 0x7fb828136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.602+0000 7fb82d0bc700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb824009df0 tx=0x7fb824017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.603+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82400f7e0 con 0x7fb8280613a0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.603+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82400f940 con 0x7fb8280613a0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.603+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82401c630 con 0x7fb8280613a0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.603+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb824009370 con 0x7fb8280613a0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.603+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb828113110 con 0x7fb8280613a0 2023-10-03T10:11:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.604+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb82401c9e0 con 0x7fb8280613a0 2023-10-03T10:11:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.604+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb82403cc40 con 0x7fb8280613a0 2023-10-03T10:11:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.604+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb828128f40 con 0x7fb8280613a0 2023-10-03T10:11:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.611+0000 7facf99dd700 1 Processor -- start 2023-10-03T10:11:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.611+0000 7facf99dd700 1 -- start start 2023-10-03T10:11:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7facf4059070 0x7facf4127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4127390 0x7facf4127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4095370 0x7facf4095820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf4059450 con 0x7facf4059070 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40968c0 con 0x7facf4127390 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf99dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf4094f30 con 0x7facf4095370 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7facf4059070 0x7facf4127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7facf4059070 0x7facf4127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44414/0 (socket says 172.21.15.19:44414) 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 -- 172.21.15.19:0/3974930605 learned_addr learned my addr 172.21.15.19:0/3974930605 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 -- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4095370 msgr2=0x7facf4095820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4095370 0x7facf4095820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 -- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4127390 msgr2=0x7facf4127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4127390 0x7facf4127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.612+0000 7facf2ffd700 1 -- 172.21.15.19:0/3974930605 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4091b60 con 0x7facf4059070 2023-10-03T10:11:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.613+0000 7facf2ffd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4059070 0x7facf4127890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7face4009830 tx=0x7face40090f0).ready entity=mon.0 client_cookie=947a6e1591bb368f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.613+0000 7facf1ffb700 1 -- 172.21.15.19:0/3974930605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400b600 con 0x7facf4059070 2023-10-03T10:11:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.613+0000 7facf1ffb700 1 -- 172.21.15.19:0/3974930605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400b760 con 0x7facf4059070 2023-10-03T10:11:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.613+0000 7facf1ffb700 1 -- 172.21.15.19:0/3974930605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400bb00 con 0x7facf4059070 2023-10-03T10:11:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.613+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb82402d350 con 0x7fb8280613a0 2023-10-03T10:11:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 -- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4059070 msgr2=0x7facf4127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4059070 0x7facf4127890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7face4009830 tx=0x7face40090f0).stop 2023-10-03T10:11:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 -- 172.21.15.19:0/3974930605 shutdown_connections 2023-10-03T10:11:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4095370 0x7facf4095820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4059070 0x7facf4127890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 --2- 172.21.15.19:0/3974930605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4127390 0x7facf4127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 -- 172.21.15.19:0/3974930605 >> 172.21.15.19:0/3974930605 conn(0x7facf4097470 msgr2=0x7facf4097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 -- 172.21.15.19:0/3974930605 shutdown_connections 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.614+0000 7facf99dd700 1 -- 172.21.15.19:0/3974930605 wait complete. 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.615+0000 7facf99dd700 1 Processor -- start 2023-10-03T10:11:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.615+0000 7facf99dd700 1 -- start start 2023-10-03T10:11:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 0x7facf4117a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 0x7facf4113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4115f10 con 0x7facf4095370 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf4124b80 con 0x7facf4059070 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf99dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facf4096ea0 con 0x7facf4127390 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 0x7facf4113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44428/0 (socket says 172.21.15.19:44428) 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 0x7facf4113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54464/0 (socket says 172.21.15.19:54464) 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 0x7facf4117a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 -- 172.21.15.19:0/964393636 learned_addr learned my addr 172.21.15.19:0/964393636 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 -- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 msgr2=0x7facf4113fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 0x7facf4113fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 -- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 msgr2=0x7facf4117a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 0x7facf4117a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf27fc700 1 -- 172.21.15.19:0/964393636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4009370 con 0x7facf4095370 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.616+0000 7facf2ffd700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 0x7facf4117a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.617+0000 7facf27fc700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7face800b540 tx=0x7face80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.617+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8002320 con 0x7facf4095370 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.617+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face80024a0 con 0x7facf4095370 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.617+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf4129190 con 0x7facf4095370 2023-10-03T10:11:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.617+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf4115640 con 0x7facf4095370 2023-10-03T10:11:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.618+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8002860 con 0x7facf4095370 2023-10-03T10:11:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.618+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7face8002bd0 con 0x7facf4095370 2023-10-03T10:11:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.618+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7face803aef0 con 0x7facf4095370 2023-10-03T10:11:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.619+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4114f60 con 0x7facf4095370 2023-10-03T10:11:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.624+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7face801b3e0 con 0x7facf4095370 2023-10-03T10:11:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.668+0000 7f7995409700 1 Processor -- start 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.668+0000 7f7995409700 1 -- start start 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f7995409700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f799012f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f7995409700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f799012ecd0 0x7f799012f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f7995409700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7990059ba0 con 0x7f7990095370 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f7995409700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900969b0 con 0x7f799012ecd0 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f7995409700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7990092320 con 0x7f7990059070 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f799012ecd0 0x7f799012f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f799012ecd0 0x7f799012f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44442/0 (socket says 172.21.15.19:44442) 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798e7fc700 1 -- 172.21.15.19:0/3454198975 learned_addr learned my addr 172.21.15.19:0/3454198975 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798effd700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f799012f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798e7fc700 1 -- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 msgr2=0x7f799012f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.669+0000 7f798e7fc700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f799012f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798e7fc700 1 -- 172.21.15.19:0/3454198975 >> v1:172.21.15.19:6789/0 conn(0x7f7990095370 legacy=0x7f7990095800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798e7fc700 1 -- 172.21.15.19:0/3454198975 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990091c10 con 0x7f799012ecd0 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798dffb700 1 -- 172.21.15.19:0/3454198975 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928872085 0 0) 0x7f7990059ba0 con 0x7f7990095370 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798effd700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f799012f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798e7fc700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f799012ecd0 0x7f799012f650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7984009830 tx=0x7f79840090f0).ready entity=mon.0 client_cookie=ed95b4ddc8d7665d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798dffb700 1 -- 172.21.15.19:0/3454198975 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400b600 con 0x7f799012ecd0 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798dffb700 1 -- 172.21.15.19:0/3454198975 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798400b760 con 0x7f799012ecd0 2023-10-03T10:11:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.670+0000 7f798dffb700 1 -- 172.21.15.19:0/3454198975 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400bb00 con 0x7f799012ecd0 2023-10-03T10:11:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 -- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f799012ecd0 msgr2=0x7f799012f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f799012ecd0 0x7f799012f650 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f7984009830 tx=0x7f79840090f0).stop 2023-10-03T10:11:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 -- 172.21.15.19:0/3454198975 shutdown_connections 2023-10-03T10:11:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f799012f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 --2- 172.21.15.19:0/3454198975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f799012ecd0 0x7f799012f650 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 -- 172.21.15.19:0/3454198975 >> 172.21.15.19:0/3454198975 conn(0x7f7990097470 msgr2=0x7f7990097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 -- 172.21.15.19:0/3454198975 shutdown_connections 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.671+0000 7f7995409700 1 -- 172.21.15.19:0/3454198975 wait complete. 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.672+0000 7f0a56cc1700 1 Processor -- start 2023-10-03T10:11:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 -- start start 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f7995409700 1 Processor -- start 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f7995409700 1 -- start start 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a50097310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a50097800 0x7f0a50130280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a50068df0 con 0x7f0a50096820 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a5006a4c0 con 0x7f0a50097800 2023-10-03T10:11:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.673+0000 7f0a56cc1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50098260 con 0x7f0a50067940 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f7990137520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f799012fd60 0x7f79901301c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7990069c10 con 0x7f7990095370 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7990132370 con 0x7f7990059070 2023-10-03T10:11:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f7995409700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7990131dd0 con 0x7f799012fd60 2023-10-03T10:11:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a54a5d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0a50096820 0x7f0a50096c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47692/0 (socket says 172.21.15.19:47692) 2023-10-03T10:11:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a54a5d700 1 -- 172.21.15.19:0/546004886 learned_addr learned my addr 172.21.15.19:0/546004886 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f7990137520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44462/0 (socket says 172.21.15.19:44462) 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f7990137520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42314/0 (socket says 172.21.15.19:42314) 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 -- 172.21.15.19:0/207336739 learned_addr learned my addr 172.21.15.19:0/207336739 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798f7fe700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f799012fd60 0x7f79901301c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 -- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f799012fd60 msgr2=0x7f79901301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f799012fd60 0x7f79901301c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 -- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 msgr2=0x7f7990137520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f7990137520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f798e7fc700 1 -- 172.21.15.19:0/207336739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984009370 con 0x7f7990095370 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/546004886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a50097310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a5525e700 1 --2- 172.21.15.19:0/546004886 >> v2:172.21.15.19:3300/0 conn(0x7f0a50097800 0x7f0a50130280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a4ffff700 1 -- 172.21.15.19:0/546004886 >> v2:172.21.15.19:3300/0 conn(0x7f0a50097800 msgr2=0x7f0a50130280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/546004886 >> v2:172.21.15.19:3300/0 conn(0x7f0a50097800 0x7f0a50130280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a4ffff700 1 -- 172.21.15.19:0/546004886 >> v1:172.21.15.19:6789/0 conn(0x7f0a50096820 legacy=0x7f0a50096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.674+0000 7f0a4ffff700 1 -- 172.21.15.19:0/546004886 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50097c70 con 0x7f0a50067940 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/546004886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a50097310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0a48009e60 tx=0x7f0a48009780).ready entity=mon.1 client_cookie=d50d089ac12f38d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f798e7fc700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f79900925d0 tx=0x7f7984017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/546004886 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800e070 con 0x7f0a50067940 2023-10-03T10:11:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/546004886 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4800bbf0 con 0x7f0a50067940 2023-10-03T10:11:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/546004886 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48012410 con 0x7f0a50067940 2023-10-03T10:11:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400bec0 con 0x7f7990095370 2023-10-03T10:11:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79840069b0 con 0x7f7990095370 2023-10-03T10:11:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7990132090 con 0x7f7990095370 2023-10-03T10:11:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798400bb00 con 0x7f7990095370 2023-10-03T10:11:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.675+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79900691c0 con 0x7f7990095370 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 -- 172.21.15.19:0/546004886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 msgr2=0x7f0a50097310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/546004886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a50097310 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0a48009e60 tx=0x7f0a48009780).stop 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 -- 172.21.15.19:0/546004886 shutdown_connections 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/546004886 >> v2:172.21.15.19:3300/0 conn(0x7f0a50097800 0x7f0a50130280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/546004886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a50097310 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 -- 172.21.15.19:0/546004886 >> 172.21.15.19:0/546004886 conn(0x7f0a5009ba50 msgr2=0x7f0a5009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 -- 172.21.15.19:0/546004886 shutdown_connections 2023-10-03T10:11:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f0a56cc1700 1 -- 172.21.15.19:0/546004886 wait complete. 2023-10-03T10:11:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7984021070 con 0x7f7990095370 2023-10-03T10:11:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.676+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f798403cc50 con 0x7f7990095370 2023-10-03T10:11:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.677+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79900958b0 con 0x7f7990095370 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.677+0000 7f0a56cc1700 1 Processor -- start 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.678+0000 7f0a56cc1700 1 -- start start 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.678+0000 7f0a56cc1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a5011a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.678+0000 7f0a56cc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a56cc1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a50097800 0x7f0a5011ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a56cc1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5011d6f0 con 0x7f0a50096820 2023-10-03T10:11:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a56cc1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5011b350 con 0x7f0a50067940 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a56cc1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5011c8c0 con 0x7f0a50097800 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44474/0 (socket says 172.21.15.19:44474) 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 -- 172.21.15.19:0/585104371 learned_addr learned my addr 172.21.15.19:0/585104371 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a5525e700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a50097800 0x7f0a5011ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 -- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a50097800 msgr2=0x7f0a5011ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a50097800 0x7f0a5011ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 -- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 msgr2=0x7f0a5011a480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a5011a480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 -- 172.21.15.19:0/585104371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009a20 con 0x7f0a50096820 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.679+0000 7f0a4ffff700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0a500983a0 tx=0x7f0a50068130).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801d420 con 0x7f0a50096820 2023-10-03T10:11:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7984024680 con 0x7f7990095370 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4801d580 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5011d4c0 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5011e5b0 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.682+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4801d900 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.685+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f0a48003040 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.685+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a30005120 con 0x7f0a50096820 2023-10-03T10:11:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.685+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f0a4803cce0 con 0x7f0a50096820 2023-10-03T10:11:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.695+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f0a48026830 con 0x7f0a50096820 2023-10-03T10:11:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.807+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb828112690 con 0x7fb8280613a0 2023-10-03T10:11:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.808+0000 7fb81d7fa700 1 -- 172.21.15.19:0/4071721559 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb824024ba0 con 0x7fb8280613a0 2023-10-03T10:11:23.809 INFO:teuthology.orchestra.run.smithi019.stdout:38654705668 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 >> v1:172.21.15.19:6816/118286 conn(0x7fb80c02bb60 legacy=0x7fb80c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 msgr2=0x7fb828094930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb824009df0 tx=0x7fb824017000).stop 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 shutdown_connections 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812b2f0 0x7fb828136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8280613a0 0x7fb828094930 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 --2- 172.21.15.19:0/4071721559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb828095df0 0x7fb828094e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 >> 172.21.15.19:0/4071721559 conn(0x7fb82809a220 msgr2=0x7fb828127e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 shutdown_connections 2023-10-03T10:11:23.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.811+0000 7fb82f320700 1 -- 172.21.15.19:0/4071721559 wait complete. 2023-10-03T10:11:23.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.818+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7facf405a260 con 0x7facf4095370 2023-10-03T10:11:23.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.818+0000 7facdaffd700 1 -- 172.21.15.19:0/964393636 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7face8019300 con 0x7facf4095370 2023-10-03T10:11:23.819 INFO:teuthology.orchestra.run.smithi019.stdout:38654705670 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.820+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 >> v1:172.21.15.19:6816/118286 conn(0x7face002bbb0 legacy=0x7face002e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 msgr2=0x7facf4113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7face800b540 tx=0x7face80090f0).stop 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 shutdown_connections 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facf4127390 0x7facf4113fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facf4059070 0x7facf4117a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 --2- 172.21.15.19:0/964393636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facf4095370 0x7facf4113ab0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 >> 172.21.15.19:0/964393636 conn(0x7facf4097470 msgr2=0x7facf412afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 shutdown_connections 2023-10-03T10:11:23.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.821+0000 7facf99dd700 1 -- 172.21.15.19:0/964393636 wait complete. 2023-10-03T10:11:23.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2023-10-03T10:11:23.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2023-10-03T10:11:23.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.898+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0a300057f0 con 0x7f0a50096820 2023-10-03T10:11:23.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.899+0000 7f0a4cff9700 1 -- 172.21.15.19:0/585104371 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a48011e40 con 0x7f0a50096820 2023-10-03T10:11:23.900 INFO:teuthology.orchestra.run.smithi019.stdout:38654705668 2023-10-03T10:11:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.901+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f799012f8b0 con 0x7f7990095370 2023-10-03T10:11:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.901+0000 7f7976ffd700 1 -- 172.21.15.19:0/207336739 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7984032030 con 0x7f7990095370 2023-10-03T10:11:23.902 INFO:teuthology.orchestra.run.smithi019.stdout:38654705668 2023-10-03T10:11:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.901+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 >> v1:172.21.15.19:6816/118286 conn(0x7f0a3c02bbe0 legacy=0x7f0a3c02e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.901+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 msgr2=0x7f0a5011a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.901+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0a500983a0 tx=0x7f0a50068130).stop 2023-10-03T10:11:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 shutdown_connections 2023-10-03T10:11:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a50097800 0x7f0a5011ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50067940 0x7f0a5011a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 --2- 172.21.15.19:0/585104371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50096820 0x7f0a5011a970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 >> 172.21.15.19:0/585104371 conn(0x7f0a5009ba50 msgr2=0x7f0a50099950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 shutdown_connections 2023-10-03T10:11:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.902+0000 7f0a56cc1700 1 -- 172.21.15.19:0/585104371 wait complete. 2023-10-03T10:11:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.904+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 >> v1:172.21.15.19:6816/118286 conn(0x7f797c02bb90 legacy=0x7f797c02e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.904+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 msgr2=0x7f7990137a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.904+0000 7f7995409700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f79900925d0 tx=0x7f7984017000).stop 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 shutdown_connections 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f799012fd60 0x7f79901301c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7990059070 0x7f7990137520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 --2- 172.21.15.19:0/207336739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7990095370 0x7f7990137a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 >> 172.21.15.19:0/207336739 conn(0x7f7990097470 msgr2=0x7f799011e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 shutdown_connections 2023-10-03T10:11:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:23.907+0000 7f7995409700 1 -- 172.21.15.19:0/207336739 wait complete. 2023-10-03T10:11:23.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.1 2023-10-03T10:11:23.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2023-10-03T10:11:24.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:11:24.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:11:24.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:11:24.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:11:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.976+0000 7fe5297c7700 1 Processor -- start 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.976+0000 7fe5297c7700 1 -- start start 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5297c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5297c7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 0x7fe524127680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5297c7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe524068880 con 0x7fe524067ce0 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5297c7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5240680c0 con 0x7fe524092340 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5297c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe524068c90 con 0x7fe524123a90 2023-10-03T10:11:24.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54494/0 (socket says 172.21.15.19:54494) 2023-10-03T10:11:24.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 -- 172.21.15.19:0/2050252673 learned_addr learned my addr 172.21.15.19:0/2050252673 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:24.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe5237fe700 1 --2- 172.21.15.19:0/2050252673 >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 0x7fe524127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 -- 172.21.15.19:0/2050252673 >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 msgr2=0x7fe524127680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 --2- 172.21.15.19:0/2050252673 >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 0x7fe524127680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 -- 172.21.15.19:0/2050252673 >> v1:172.21.15.19:6789/0 conn(0x7fe524067ce0 legacy=0x7fe524126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.977+0000 7fe522ffd700 1 -- 172.21.15.19:0/2050252673 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe524124430 con 0x7fe524123a90 2023-10-03T10:11:24.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.978+0000 7fe5237fe700 1 --2- 172.21.15.19:0/2050252673 >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 0x7fe524127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.978+0000 7fe522ffd700 1 --2- 172.21.15.19:0/2050252673 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe51400baf0 tx=0x7fe51400b370).ready entity=mon.2 client_cookie=2cc5287054aff33e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.978+0000 7fe521ffb700 1 -- 172.21.15.19:0/2050252673 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400dc00 con 0x7fe524123a90 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.978+0000 7fe521ffb700 1 -- 172.21.15.19:0/2050252673 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51400dd60 con 0x7fe524123a90 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.978+0000 7fe521ffb700 1 -- 172.21.15.19:0/2050252673 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe514015600 con 0x7fe524123a90 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 -- 172.21.15.19:0/2050252673 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 msgr2=0x7fe524123e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 --2- 172.21.15.19:0/2050252673 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe51400baf0 tx=0x7fe51400b370).stop 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 -- 172.21.15.19:0/2050252673 shutdown_connections 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 --2- 172.21.15.19:0/2050252673 >> v2:172.21.15.19:3300/0 conn(0x7fe524092340 0x7fe524127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 --2- 172.21.15.19:0/2050252673 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524123a90 0x7fe524123e70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 -- 172.21.15.19:0/2050252673 >> 172.21.15.19:0/2050252673 conn(0x7fe52409a220 msgr2=0x7fe52409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 -- 172.21.15.19:0/2050252673 shutdown_connections 2023-10-03T10:11:24.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.979+0000 7fe5297c7700 1 -- 172.21.15.19:0/2050252673 wait complete. 2023-10-03T10:11:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.980+0000 7f6c885b1700 1 Processor -- start 2023-10-03T10:11:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.980+0000 7f6c885b1700 1 -- start start 2023-10-03T10:11:24.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7fe5297c7700 1 Processor -- start 2023-10-03T10:11:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c885b1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c885b1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c80097b20 0x7f6c8013afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c885b1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c80099650 con 0x7f6c80093a70 2023-10-03T10:11:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c885b1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c80093e50 con 0x7f6c80097b20 2023-10-03T10:11:24.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c885b1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80082d80 con 0x7f6c80097700 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54506/0 (socket says 172.21.15.19:54506) 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 -- 172.21.15.19:0/2051476940 learned_addr learned my addr 172.21.15.19:0/2051476940 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 -- 172.21.15.19:0/2051476940 >> v2:172.21.15.19:3300/0 conn(0x7f6c80097b20 msgr2=0x7f6c8013afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 --2- 172.21.15.19:0/2051476940 >> v2:172.21.15.19:3300/0 conn(0x7f6c80097b20 0x7f6c8013afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 -- 172.21.15.19:0/2051476940 >> v1:172.21.15.19:6789/0 conn(0x7f6c80093a70 legacy=0x7f6c80097f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7f6c85b4c700 1 -- 172.21.15.19:0/2051476940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c80093290 con 0x7f6c80097700 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7fe5297c7700 1 -- start start 2023-10-03T10:11:24.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.981+0000 7fe5297c7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe5297c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524092340 0x7fe524111d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe5297c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe524123a90 0x7fe524112210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe5297c7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe524112700 con 0x7fe524123a90 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe5297c7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe524114d30 con 0x7fe524067ce0 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe5297c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe524113540 con 0x7fe524092340 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7f6c85b4c700 1 --2- 172.21.15.19:0/2051476940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6c70006fd0 tx=0x7f6c700090f0).ready entity=mon.2 client_cookie=21b2b501b048bccc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42322/0 (socket says 172.21.15.19:42322) 2023-10-03T10:11:24.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 -- 172.21.15.19:0/492446500 learned_addr learned my addr 172.21.15.19:0/492446500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:24.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7f6c8534b700 1 -- 172.21.15.19:0/2051476940 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000b600 con 0x7f6c80097700 2023-10-03T10:11:24.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7f6c8534b700 1 -- 172.21.15.19:0/2051476940 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7000b760 con 0x7f6c80097700 2023-10-03T10:11:24.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7f6c8534b700 1 -- 172.21.15.19:0/2051476940 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000bae0 con 0x7f6c80097700 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 -- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524092340 msgr2=0x7fe524111d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524092340 0x7fe524111d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 -- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe524123a90 msgr2=0x7fe524112210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe524123a90 0x7fe524112210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 -- 172.21.15.19:0/492446500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe51400b6a0 con 0x7fe524067ce0 2023-10-03T10:11:24.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.982+0000 7fe522ffd700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe514006d40 tx=0x7fe51401a000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 -- 172.21.15.19:0/2051476940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 msgr2=0x7f6c8013e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 --2- 172.21.15.19:0/2051476940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6c70006fd0 tx=0x7f6c700090f0).stop 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51401e710 con 0x7fe524067ce0 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51401e870 con 0x7fe524067ce0 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51401ebf0 con 0x7fe524067ce0 2023-10-03T10:11:24.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 -- 172.21.15.19:0/2051476940 shutdown_connections 2023-10-03T10:11:24.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 --2- 172.21.15.19:0/2051476940 >> v2:172.21.15.19:3300/0 conn(0x7f6c80097b20 0x7f6c8013afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:24.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 --2- 172.21.15.19:0/2051476940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097700 0x7f6c8013e0e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:24.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 -- 172.21.15.19:0/2051476940 >> 172.21.15.19:0/2051476940 conn(0x7f6c800998d0 msgr2=0x7f6c80099ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:24.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5241278a0 con 0x7fe524067ce0 2023-10-03T10:11:24.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 -- 172.21.15.19:0/2051476940 shutdown_connections 2023-10-03T10:11:24.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe524114980 con 0x7fe524067ce0 2023-10-03T10:11:24.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.983+0000 7f6c885b1700 1 -- 172.21.15.19:0/2051476940 wait complete. 2023-10-03T10:11:24.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.984+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe51401c040 con 0x7fe524067ce0 2023-10-03T10:11:24.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.984+0000 7f6c885b1700 1 Processor -- start 2023-10-03T10:11:24.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.984+0000 7f6c885b1700 1 -- start start 2023-10-03T10:11:24.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe51403dea0 con 0x7fe524067ce0 2023-10-03T10:11:24.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52405a260 con 0x7fe524067ce0 2023-10-03T10:11:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097700 0x7f6c800772d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097b20 0x7f6c800777c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8007b730 con 0x7f6c80093a70 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8007a7c0 con 0x7f6c80097700 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c885b1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8007b390 con 0x7f6c80097b20 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c8634d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c8634d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44526/0 (socket says 172.21.15.19:44526) 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.985+0000 7f6c8634d700 1 -- 172.21.15.19:0/1435222651 learned_addr learned my addr 172.21.15.19:0/1435222651 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c86b4e700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097b20 0x7f6c800777c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 -- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097b20 msgr2=0x7f6c800777c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097b20 0x7f6c800777c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 -- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097700 msgr2=0x7f6c800772d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097700 0x7f6c800772d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 -- 172.21.15.19:0/1435222651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70009370 con 0x7f6c80093a70 2023-10-03T10:11:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.986+0000 7f6c8634d700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c7c00b490 tx=0x7f6c7c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.987+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0090d0 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.987+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c012410 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.987+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c0127d0 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.987+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c800658c0 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.987+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80078e50 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.988+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8007aae0 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.989+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6c7c012b80 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.989+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6c7c03b130 con 0x7f6c80093a70 2023-10-03T10:11:24.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.993+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe514023070 con 0x7fe524067ce0 2023-10-03T10:11:24.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:24.994+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6c7c019300 con 0x7f6c80093a70 2023-10-03T10:11:25.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 Processor -- start 2023-10-03T10:11:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 -- start start 2023-10-03T10:11:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bbc096390 0x7f5bbc12da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc12def0 0x7f5bbc1302e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc068840 con 0x7f5bbc097330 2023-10-03T10:11:25.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc068a70 con 0x7f5bbc096390 2023-10-03T10:11:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.060+0000 7f5bbb59e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc067e50 con 0x7f5bbc12def0 2023-10-03T10:11:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bbc096390 0x7f5bbc12da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bbad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc12def0 0x7f5bbc1302e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bbc096390 0x7f5bbc12da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44538/0 (socket says 172.21.15.19:44538) 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 -- 172.21.15.19:0/3203230883 learned_addr learned my addr 172.21.15.19:0/3203230883 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 -- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc12def0 msgr2=0x7f5bbc1302e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 --2- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc12def0 0x7f5bbc1302e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 -- 172.21.15.19:0/3203230883 >> v1:172.21.15.19:6789/0 conn(0x7f5bbc097330 legacy=0x7f5bbc095c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 -- 172.21.15.19:0/3203230883 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc068290 con 0x7f5bbc096390 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb9d9b700 1 --2- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc12da00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5bb0006fd0 tx=0x7f5bb00090f0).ready entity=mon.0 client_cookie=eac2d7501083f011 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb959a700 1 -- 172.21.15.19:0/3203230883 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000b520 con 0x7f5bbc096390 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb959a700 1 -- 172.21.15.19:0/3203230883 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000b680 con 0x7f5bbc096390 2023-10-03T10:11:25.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.061+0000 7f5bb959a700 1 -- 172.21.15.19:0/3203230883 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000ba20 con 0x7f5bbc096390 2023-10-03T10:11:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 -- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 msgr2=0x7f5bbc12da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc12da00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f5bb0006fd0 tx=0x7f5bb00090f0).stop 2023-10-03T10:11:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 -- 172.21.15.19:0/3203230883 shutdown_connections 2023-10-03T10:11:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc12def0 0x7f5bbc1302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/3203230883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc12da00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 -- 172.21.15.19:0/3203230883 >> 172.21.15.19:0/3203230883 conn(0x7f5bbc09a900 msgr2=0x7f5bbc096a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 -- 172.21.15.19:0/3203230883 shutdown_connections 2023-10-03T10:11:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.062+0000 7f5bbb59e700 1 -- 172.21.15.19:0/3203230883 wait complete. 2023-10-03T10:11:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.063+0000 7f5bbb59e700 1 Processor -- start 2023-10-03T10:11:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.063+0000 7f5bbb59e700 1 -- start start 2023-10-03T10:11:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc097330 0x7f5bbc120890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc12def0 0x7f5bbc120d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc122460 con 0x7f5bbc096390 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc122650 con 0x7f5bbc097330 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbb59e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0991a0 con 0x7f5bbc12def0 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bba59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bba59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44552/0 (socket says 172.21.15.19:44552) 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bba59c700 1 -- 172.21.15.19:0/2989027730 learned_addr learned my addr 172.21.15.19:0/2989027730 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bbad9d700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc12def0 0x7f5bbc120d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bb9d9b700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc097330 0x7f5bbc120890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.064+0000 7f5bba59c700 1 -- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc12def0 msgr2=0x7f5bbc120d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5bba59c700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc12def0 0x7f5bbc120d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5bba59c700 1 -- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc097330 msgr2=0x7f5bbc120890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5bba59c700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc097330 0x7f5bbc120890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5bba59c700 1 -- 172.21.15.19:0/2989027730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb0009370 con 0x7f5bbc096390 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5bba59c700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5bac00c440 tx=0x7f5bac007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac012400 con 0x7f5bbc096390 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac0125a0 con 0x7f5bbc096390 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.065+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac012960 con 0x7f5bbc096390 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.066+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc1243d0 con 0x7f5bbc096390 2023-10-03T10:11:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.066+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc125d30 con 0x7f5bbc096390 2023-10-03T10:11:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.067+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5bac012d10 con 0x7f5bbc096390 2023-10-03T10:11:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.067+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5bac03a400 con 0x7f5bbc096390 2023-10-03T10:11:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.067+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc129500 con 0x7f5bbc096390 2023-10-03T10:11:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.076+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5bac01b3b0 con 0x7f5bbc096390 2023-10-03T10:11:25.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.101+0000 7f6e9b027700 1 Processor -- start 2023-10-03T10:11:25.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.101+0000 7f6e9b027700 1 -- start start 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.101+0000 7f6e9b027700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e940613a0 0x7f6e9412ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e9b027700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b6d0 0x7f6e94096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e9b027700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9412abd0 con 0x7f6e9412b2f0 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e9b027700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e94061780 con 0x7f6e940613a0 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e9b027700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94067530 con 0x7f6e9412b6d0 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e940613a0 0x7f6e9412ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e940613a0 0x7f6e9412ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44566/0 (socket says 172.21.15.19:44566) 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 -- 172.21.15.19:0/621792773 learned_addr learned my addr 172.21.15.19:0/621792773 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e995c4700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b6d0 0x7f6e94096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 -- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b6d0 msgr2=0x7f6e94096500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b6d0 0x7f6e94096500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 -- 172.21.15.19:0/621792773 >> v1:172.21.15.19:6789/0 conn(0x7f6e9412b2f0 legacy=0x7f6e94095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 -- 172.21.15.19:0/621792773 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940683c0 con 0x7f6e940613a0 2023-10-03T10:11:25.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.102+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e940613a0 0x7f6e9412ae00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e880090f0).ready entity=mon.0 client_cookie=e815bc3c359edd8a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e937fe700 1 -- 172.21.15.19:0/621792773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800b580 con 0x7f6e940613a0 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e937fe700 1 -- 172.21.15.19:0/621792773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800b6e0 con 0x7f6e940613a0 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e937fe700 1 -- 172.21.15.19:0/621792773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800ba60 con 0x7f6e940613a0 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 -- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e940613a0 msgr2=0x7f6e9412ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e940613a0 0x7f6e9412ae00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e880090f0).stop 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 -- 172.21.15.19:0/621792773 shutdown_connections 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b6d0 0x7f6e94096500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 --2- 172.21.15.19:0/621792773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e940613a0 0x7f6e9412ae00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 -- 172.21.15.19:0/621792773 >> 172.21.15.19:0/621792773 conn(0x7f6e9409a220 msgr2=0x7f6e9409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 -- 172.21.15.19:0/621792773 shutdown_connections 2023-10-03T10:11:25.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.103+0000 7f6e9b027700 1 -- 172.21.15.19:0/621792773 wait complete. 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 Processor -- start 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 -- start start 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 0x7f6e94117320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 0x7f6e94117d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9411ae80 con 0x7f6e9412b6d0 2023-10-03T10:11:25.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.105+0000 7f6e9b027700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94067130 con 0x7f6e9412b2f0 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e9b027700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94129900 con 0x7f6e940613a0 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e93fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42366/0 (socket says 172.21.15.19:42366) 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e93fff700 1 -- 172.21.15.19:0/2201503462 learned_addr learned my addr 172.21.15.19:0/2201503462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 0x7f6e94117320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e995c4700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 0x7f6e94117d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 -- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 msgr2=0x7f6e94117810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 -- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 msgr2=0x7f6e94117d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 0x7f6e94117d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 -- 172.21.15.19:0/2201503462 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009370 con 0x7f6e940613a0 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e995c4700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 0x7f6e94117d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e93fff700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.106+0000 7f6e98dc3700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 0x7f6e94117320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e88017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.107+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88000bc0 con 0x7f6e940613a0 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.107+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800b850 con 0x7f6e940613a0 2023-10-03T10:11:25.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.107+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9411a8d0 con 0x7f6e940613a0 2023-10-03T10:11:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.107+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88000d20 con 0x7f6e940613a0 2023-10-03T10:11:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.107+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9411b6b0 con 0x7f6e940613a0 2023-10-03T10:11:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.108+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6e8801bac0 con 0x7f6e940613a0 2023-10-03T10:11:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.108+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6e8803caa0 con 0x7f6e940613a0 2023-10-03T10:11:25.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.108+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9411b6b0 con 0x7f6e940613a0 2023-10-03T10:11:25.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.113+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6e9411b6b0 con 0x7f6e940613a0 2023-10-03T10:11:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.176+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe524046c20 con 0x7fe524067ce0 2023-10-03T10:11:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.176+0000 7fe50affd700 1 -- 172.21.15.19:0/492446500 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe514023030 con 0x7fe524067ce0 2023-10-03T10:11:25.177 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 >> v1:172.21.15.19:6816/118286 conn(0x7fe51002bb60 legacy=0x7fe51002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 msgr2=0x7fe524111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe514006d40 tx=0x7fe51401a000).stop 2023-10-03T10:11:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 shutdown_connections 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe524123a90 0x7fe524112210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe524067ce0 0x7fe524111830 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 --2- 172.21.15.19:0/492446500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe524092340 0x7fe524111d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 >> 172.21.15.19:0/492446500 conn(0x7fe52409a220 msgr2=0x7fe524066b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 shutdown_connections 2023-10-03T10:11:25.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.178+0000 7fe5297c7700 1 -- 172.21.15.19:0/492446500 wait complete. 2023-10-03T10:11:25.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2023-10-03T10:11:25.193 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:25.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.204+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6c8007aca0 con 0x7f6c80093a70 2023-10-03T10:11:25.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.204+0000 7f6c767fc700 1 -- 172.21.15.19:0/1435222651 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c8007aca0 con 0x7f6c80093a70 2023-10-03T10:11:25.205 INFO:teuthology.orchestra.run.smithi019.stdout:38654705671 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 >> v1:172.21.15.19:6816/118286 conn(0x7f6c6402bb60 legacy=0x7f6c6402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 msgr2=0x7f6c80143260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f6c7c00b490 tx=0x7f6c7c009060).stop 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 shutdown_connections 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097b20 0x7f6c800777c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80093a70 0x7f6c80143260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 --2- 172.21.15.19:0/1435222651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097700 0x7f6c800772d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 >> 172.21.15.19:0/1435222651 conn(0x7f6c800998d0 msgr2=0x7f6c80095940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 shutdown_connections 2023-10-03T10:11:25.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.207+0000 7f6c885b1700 1 -- 172.21.15.19:0/1435222651 wait complete. 2023-10-03T10:11:25.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2023-10-03T10:11:25.221 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.274+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bbc098530 con 0x7f5bbc096390 2023-10-03T10:11:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.274+0000 7f5baa7fc700 1 -- 172.21.15.19:0/2989027730 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bac018260 con 0x7f5bbc096390 2023-10-03T10:11:25.275 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 >> v1:172.21.15.19:6816/118286 conn(0x7f5b9c02bb30 legacy=0x7f5b9c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 msgr2=0x7f5bbc125840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f5bac00c440 tx=0x7f5bac007de0).stop 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 shutdown_connections 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc12def0 0x7f5bbc120d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc096390 0x7f5bbc125840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 --2- 172.21.15.19:0/2989027730 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc097330 0x7f5bbc120890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.276+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 >> 172.21.15.19:0/2989027730 conn(0x7f5bbc09a900 msgr2=0x7f5bbc066a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.277+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 shutdown_connections 2023-10-03T10:11:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.277+0000 7f5bbb59e700 1 -- 172.21.15.19:0/2989027730 wait complete. 2023-10-03T10:11:25.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.1 2023-10-03T10:11:25.291 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:25.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.294+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e9411b6b0 con 0x7f6e940613a0 2023-10-03T10:11:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.294+0000 7f6e90ff9700 1 -- 172.21.15.19:0/2201503462 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e9411b6b0 con 0x7f6e940613a0 2023-10-03T10:11:25.295 INFO:teuthology.orchestra.run.smithi019.stdout:38654705669 2023-10-03T10:11:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 >> v1:172.21.15.19:6816/118286 conn(0x7f6e7802bb60 legacy=0x7f6e7802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 msgr2=0x7f6e94117320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 0x7f6e94117320 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6e88006fd0 tx=0x7f6e88017000).stop 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 shutdown_connections 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e9412b6d0 0x7f6e94117d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e940613a0 0x7f6e94117320 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 --2- 172.21.15.19:0/2201503462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e9412b2f0 0x7f6e94117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 >> 172.21.15.19:0/2201503462 conn(0x7f6e9409a220 msgr2=0x7f6e94098b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 shutdown_connections 2023-10-03T10:11:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.296+0000 7f6e9b027700 1 -- 172.21.15.19:0/2201503462 wait complete. 2023-10-03T10:11:25.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2023-10-03T10:11:25.310 DEBUG:teuthology.parallel:result is None 2023-10-03T10:11:25.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:11:25.311 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:25.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.483+0000 7f5d3fe59700 1 Processor -- start 2023-10-03T10:11:25.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.483+0000 7f5d3fe59700 1 -- start start 2023-10-03T10:11:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d38095880 con 0x7f5d380654a0 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38065ed0 con 0x7f5d3812f470 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3fe59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38096120 con 0x7f5d38098b30 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3d3f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3dbf5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3e3f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3d3f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54572/0 (socket says 172.21.15.19:54572) 2023-10-03T10:11:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3dbf5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44590/0 (socket says 172.21.15.19:44590) 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3e3f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42376/0 (socket says 172.21.15.19:42376) 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.484+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/2475567820 learned_addr learned my addr 172.21.15.19:0/2475567820 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 msgr2=0x7f5d38131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/2475567820 >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 msgr2=0x7f5d38098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/2475567820 >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/2475567820 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38099460 con 0x7f5d38098b30 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3dbf5700 1 --2- 172.21.15.19:0/2475567820 >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3e3f6700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5d28006fd0 tx=0x7f5d280090f0).ready entity=mon.2 client_cookie=b7327c9b4a5e608e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3cbf3700 1 -- 172.21.15.19:0/2475567820 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f510 con 0x7f5d38098b30 2023-10-03T10:11:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3cbf3700 1 -- 172.21.15.19:0/2475567820 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800f670 con 0x7f5d38098b30 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3cbf3700 1 -- 172.21.15.19:0/2475567820 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f9f0 con 0x7f5d38098b30 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.485+0000 7f5d3fe59700 1 -- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 msgr2=0x7f5d38098f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5d28006fd0 tx=0x7f5d280090f0).stop 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 -- 172.21.15.19:0/2475567820 shutdown_connections 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d38131860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/2475567820 >> v2:172.21.15.19:3300/0 conn(0x7f5d380654a0 0x7f5d38098640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/2475567820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d38098b30 0x7f5d38098f70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 -- 172.21.15.19:0/2475567820 >> 172.21.15.19:0/2475567820 conn(0x7f5d3809a740 msgr2=0x7f5d3809ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 -- 172.21.15.19:0/2475567820 shutdown_connections 2023-10-03T10:11:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.486+0000 7f5d3fe59700 1 -- 172.21.15.19:0/2475567820 wait complete. 2023-10-03T10:11:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 Processor -- start 2023-10-03T10:11:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 -- start start 2023-10-03T10:11:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 0x7f5d3811a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d3811ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3811b8e0 con 0x7f5d38098b30 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3811b2d0 con 0x7f5d3812f470 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3fe59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3811d990 con 0x7f5d380654a0 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3d3f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3d3f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44598/0 (socket says 172.21.15.19:44598) 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/3776340417 learned_addr learned my addr 172.21.15.19:0/3776340417 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3dbf5700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 0x7f5d3811a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.487+0000 7f5d3e3f6700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d3811ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 msgr2=0x7f5d3811a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 0x7f5d3811a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 msgr2=0x7f5d3811ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d3811ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 -- 172.21.15.19:0/3776340417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340092a0 con 0x7f5d38098b30 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3dbf5700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 0x7f5d3811a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3e3f6700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d3811ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3d3f4700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5d28011000 tx=0x7f5d28017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800f7e0 con 0x7f5d38098b30 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2800f940 con 0x7f5d38098b30 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2801c670 con 0x7f5d38098b30 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30009a20 con 0x7f5d38098b30 2023-10-03T10:11:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.488+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d28009370 con 0x7f5d38098b30 2023-10-03T10:11:25.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.489+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f5d2801ca20 con 0x7f5d38098b30 2023-10-03T10:11:25.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.489+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f5d2803cc60 con 0x7f5d38098b30 2023-10-03T10:11:25.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.489+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38099b00 con 0x7f5d38098b30 2023-10-03T10:11:25.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.494+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f5d28020030 con 0x7f5d38098b30 2023-10-03T10:11:25.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.664+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d3811de90 con 0x7f5d1c02bb60 2023-10-03T10:11:25.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.671+0000 7f5d2dffb700 1 -- 172.21.15.19:0/3776340417 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249983 (unknown 2965378022 0 3402501951) 0x7f5d34009cb0 con 0x7f5d1c02bb60 2023-10-03T10:11:25.675 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 >> v1:172.21.15.19:6816/118286 conn(0x7f5d1c02bb60 legacy=0x7f5d1c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 msgr2=0x7f5d3811a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f5d28011000 tx=0x7f5d28017000).stop 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 shutdown_connections 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d3812f470 0x7f5d3811ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d380654a0 0x7f5d3811a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 --2- 172.21.15.19:0/3776340417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d38098b30 0x7f5d3811a8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 >> 172.21.15.19:0/3776340417 conn(0x7f5d3809a740 msgr2=0x7f5d3809bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 shutdown_connections 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.674+0000 7f5d3fe59700 1 -- 172.21.15.19:0/3776340417 wait complete. 2023-10-03T10:11:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:25.688 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-03T10:11:23.724914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002227"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268370+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:11:13.268370+0000","last_peered":"2023-10-03T10:11:13.268370+0000","last_clean":"2023-10-03T10:11:13.268370+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:11:13.268370+0000","last_undegraded":"2023-10-03T10:11:13.268370+0000","last_fullsized":"2023-10-03T10:11:13.268370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268760+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:11:13.268760+0000","last_peered":"2023-10-03T10:11:13.268760+0000","last_clean":"2023-10-03T10:11:13.268760+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:11:13.268760+0000","last_undegraded":"2023-10-03T10:11:13.268760+0000","last_fullsized":"2023-10-03T10:11:13.268760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276725+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:11:13.276725+0000","last_peered":"2023-10-03T10:11:13.276725+0000","last_clean":"2023-10-03T10:11:13.276725+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:11:13.276725+0000","last_undegraded":"2023-10-03T10:11:13.276725+0000","last_fullsized":"2023-10-03T10:11:13.276725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.277146+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:11:13.277146+0000","last_peered":"2023-10-03T10:11:13.277146+0000","last_clean":"2023-10-03T10:11:13.277146+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:11:13.277146+0000","last_undegraded":"2023-10-03T10:11:13.277146+0000","last_fullsized":"2023-10-03T10:11:13.277146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285549+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:11:13.285549+0000","last_peered":"2023-10-03T10:11:13.285549+0000","last_clean":"2023-10-03T10:11:13.285549+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:11:13.285549+0000","last_undegraded":"2023-10-03T10:11:13.285549+0000","last_fullsized":"2023-10-03T10:11:13.285549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276317+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:11:13.276317+0000","last_peered":"2023-10-03T10:11:13.276317+0000","last_clean":"2023-10-03T10:11:13.276317+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:11:13.276317+0000","last_undegraded":"2023-10-03T10:11:13.276317+0000","last_fullsized":"2023-10-03T10:11:13.276317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276451+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:11:13.276451+0000","last_peered":"2023-10-03T10:11:13.276451+0000","last_clean":"2023-10-03T10:11:13.276451+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:11:13.276451+0000","last_undegraded":"2023-10-03T10:11:13.276451+0000","last_fullsized":"2023-10-03T10:11:13.276451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285473+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:11:13.285473+0000","last_peered":"2023-10-03T10:11:13.285473+0000","last_clean":"2023-10-03T10:11:13.285473+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:11:13.285473+0000","last_undegraded":"2023-10-03T10:11:13.285473+0000","last_fullsized":"2023-10-03T10:11:13.285473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278826+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:11:13.278826+0000","last_peered":"2023-10-03T10:11:13.278826+0000","last_clean":"2023-10-03T10:11:13.278826+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:11:13.278826+0000","last_undegraded":"2023-10-03T10:11:13.278826+0000","last_fullsized":"2023-10-03T10:11:13.278826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285649+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:11:13.285649+0000","last_peered":"2023-10-03T10:11:13.285649+0000","last_clean":"2023-10-03T10:11:13.285649+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:11:13.285649+0000","last_undegraded":"2023-10-03T10:11:13.285649+0000","last_fullsized":"2023-10-03T10:11:13.285649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281847+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:11:13.281847+0000","last_peered":"2023-10-03T10:11:13.281847+0000","last_clean":"2023-10-03T10:11:13.281847+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:11:13.281847+0000","last_undegraded":"2023-10-03T10:11:13.281847+0000","last_fullsized":"2023-10-03T10:11:13.281847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276513+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:11:13.276513+0000","last_peered":"2023-10-03T10:11:13.276513+0000","last_clean":"2023-10-03T10:11:13.276513+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:11:13.276513+0000","last_undegraded":"2023-10-03T10:11:13.276513+0000","last_fullsized":"2023-10-03T10:11:13.276513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285497+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:11:13.285497+0000","last_peered":"2023-10-03T10:11:13.285497+0000","last_clean":"2023-10-03T10:11:13.285497+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:11:13.285497+0000","last_undegraded":"2023-10-03T10:11:13.285497+0000","last_fullsized":"2023-10-03T10:11:13.285497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276394+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:11:13.276394+0000","last_peered":"2023-10-03T10:11:13.276394+0000","last_clean":"2023-10-03T10:11:13.276394+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:11:13.276394+0000","last_undegraded":"2023-10-03T10:11:13.276394+0000","last_fullsized":"2023-10-03T10:11:13.276394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285853+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:11:13.285853+0000","last_peered":"2023-10-03T10:11:13.285853+0000","last_clean":"2023-10-03T10:11:13.285853+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:11:13.285853+0000","last_undegraded":"2023-10-03T10:11:13.285853+0000","last_fullsized":"2023-10-03T10:11:13.285853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276604+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:11:13.276604+0000","last_peered":"2023-10-03T10:11:13.276604+0000","last_clean":"2023-10-03T10:11:13.276604+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:11:13.276604+0000","last_undegraded":"2023-10-03T10:11:13.276604+0000","last_fullsized":"2023-10-03T10:11:13.276604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278163+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:11:13.278163+0000","last_peered":"2023-10-03T10:11:13.278163+0000","last_clean":"2023-10-03T10:11:13.278163+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:11:13.278163+0000","last_undegraded":"2023-10-03T10:11:13.278163+0000","last_fullsized":"2023-10-03T10:11:13.278163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286916+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:11:13.286916+0000","last_peered":"2023-10-03T10:11:13.286916+0000","last_clean":"2023-10-03T10:11:13.286916+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:11:13.286916+0000","last_undegraded":"2023-10-03T10:11:13.286916+0000","last_fullsized":"2023-10-03T10:11:13.286916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280713+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:11:13.280713+0000","last_peered":"2023-10-03T10:11:13.280713+0000","last_clean":"2023-10-03T10:11:13.280713+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:11:13.280713+0000","last_undegraded":"2023-10-03T10:11:13.280713+0000","last_fullsized":"2023-10-03T10:11:13.280713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276415+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:11:13.276415+0000","last_peered":"2023-10-03T10:11:13.276415+0000","last_clean":"2023-10-03T10:11:13.276415+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:11:13.276415+0000","last_undegraded":"2023-10-03T10:11:13.276415+0000","last_fullsized":"2023-10-03T10:11:13.276415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240250+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:11:13.240250+0000","last_peered":"2023-10-03T10:11:13.240250+0000","last_clean":"2023-10-03T10:11:13.240250+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:11:13.240250+0000","last_undegraded":"2023-10-03T10:11:13.240250+0000","last_fullsized":"2023-10-03T10:11:13.240250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287203+0000","last_change":"2023-10-03T10:11:13.283237+0000","last_active":"2023-10-03T10:11:13.287203+0000","last_peered":"2023-10-03T10:11:13.287203+0000","last_clean":"2023-10-03T10:11:13.287203+0000","last_became_active":"2023-10-03T10:11:13.282919+0000","last_became_peered":"2023-10-03T10:11:13.282919+0000","last_unstale":"2023-10-03T10:11:13.287203+0000","last_undegraded":"2023-10-03T10:11:13.287203+0000","last_fullsized":"2023-10-03T10:11:13.287203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252142+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:11:13.252142+0000","last_peered":"2023-10-03T10:11:13.252142+0000","last_clean":"2023-10-03T10:11:13.252142+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:11:13.252142+0000","last_undegraded":"2023-10-03T10:11:13.252142+0000","last_fullsized":"2023-10-03T10:11:13.252142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276531+0000","last_change":"2023-10-03T10:11:13.264719+0000","last_active":"2023-10-03T10:11:13.276531+0000","last_peered":"2023-10-03T10:11:13.276531+0000","last_clean":"2023-10-03T10:11:13.276531+0000","last_became_active":"2023-10-03T10:11:13.255651+0000","last_became_peered":"2023-10-03T10:11:13.255651+0000","last_unstale":"2023-10-03T10:11:13.276531+0000","last_undegraded":"2023-10-03T10:11:13.276531+0000","last_fullsized":"2023-10-03T10:11:13.276531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253054+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:11:13.253054+0000","last_peered":"2023-10-03T10:11:13.253054+0000","last_clean":"2023-10-03T10:11:13.253054+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:11:13.253054+0000","last_undegraded":"2023-10-03T10:11:13.253054+0000","last_fullsized":"2023-10-03T10:11:13.253054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276430+0000","last_change":"2023-10-03T10:11:13.268456+0000","last_active":"2023-10-03T10:11:13.276430+0000","last_peered":"2023-10-03T10:11:13.276430+0000","last_clean":"2023-10-03T10:11:13.276430+0000","last_became_active":"2023-10-03T10:11:13.267206+0000","last_became_peered":"2023-10-03T10:11:13.267206+0000","last_unstale":"2023-10-03T10:11:13.276430+0000","last_undegraded":"2023-10-03T10:11:13.276430+0000","last_fullsized":"2023-10-03T10:11:13.276430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.284853+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:11:13.284853+0000","last_peered":"2023-10-03T10:11:13.284853+0000","last_clean":"2023-10-03T10:11:13.284853+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:11:13.284853+0000","last_undegraded":"2023-10-03T10:11:13.284853+0000","last_fullsized":"2023-10-03T10:11:13.284853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287590+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:11:13.287590+0000","last_peered":"2023-10-03T10:11:13.287590+0000","last_clean":"2023-10-03T10:11:13.287590+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:11:13.287590+0000","last_undegraded":"2023-10-03T10:11:13.287590+0000","last_fullsized":"2023-10-03T10:11:13.287590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285616+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:11:13.285616+0000","last_peered":"2023-10-03T10:11:13.285616+0000","last_clean":"2023-10-03T10:11:13.285616+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:11:13.285616+0000","last_undegraded":"2023-10-03T10:11:13.285616+0000","last_fullsized":"2023-10-03T10:11:13.285616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280900+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:11:13.280900+0000","last_peered":"2023-10-03T10:11:13.280900+0000","last_clean":"2023-10-03T10:11:13.280900+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:11:13.280900+0000","last_undegraded":"2023-10-03T10:11:13.280900+0000","last_fullsized":"2023-10-03T10:11:13.280900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280337+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:11:13.280337+0000","last_peered":"2023-10-03T10:11:13.280337+0000","last_clean":"2023-10-03T10:11:13.280337+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:11:13.280337+0000","last_undegraded":"2023-10-03T10:11:13.280337+0000","last_fullsized":"2023-10-03T10:11:13.280337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.246336+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:11:13.246336+0000","last_peered":"2023-10-03T10:11:13.246336+0000","last_clean":"2023-10-03T10:11:13.246336+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:11:13.246336+0000","last_undegraded":"2023-10-03T10:11:13.246336+0000","last_fullsized":"2023-10-03T10:11:13.246336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286895+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:11:13.286895+0000","last_peered":"2023-10-03T10:11:13.286895+0000","last_clean":"2023-10-03T10:11:13.286895+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:11:13.286895+0000","last_undegraded":"2023-10-03T10:11:13.286895+0000","last_fullsized":"2023-10-03T10:11:13.286895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240734+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:11:13.240734+0000","last_peered":"2023-10-03T10:11:13.240734+0000","last_clean":"2023-10-03T10:11:13.240734+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:11:13.240734+0000","last_undegraded":"2023-10-03T10:11:13.240734+0000","last_fullsized":"2023-10-03T10:11:13.240734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285224+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:11:13.285224+0000","last_peered":"2023-10-03T10:11:13.285224+0000","last_clean":"2023-10-03T10:11:13.285224+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:11:13.285224+0000","last_undegraded":"2023-10-03T10:11:13.285224+0000","last_fullsized":"2023-10-03T10:11:13.285224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287484+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:11:13.287484+0000","last_peered":"2023-10-03T10:11:13.287484+0000","last_clean":"2023-10-03T10:11:13.287484+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:11:13.287484+0000","last_undegraded":"2023-10-03T10:11:13.287484+0000","last_fullsized":"2023-10-03T10:11:13.287484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273737+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:11:13.273737+0000","last_peered":"2023-10-03T10:11:13.273737+0000","last_clean":"2023-10-03T10:11:13.273737+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:11:13.273737+0000","last_undegraded":"2023-10-03T10:11:13.273737+0000","last_fullsized":"2023-10-03T10:11:13.273737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276494+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:11:13.276494+0000","last_peered":"2023-10-03T10:11:13.276494+0000","last_clean":"2023-10-03T10:11:13.276494+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:11:13.276494+0000","last_undegraded":"2023-10-03T10:11:13.276494+0000","last_fullsized":"2023-10-03T10:11:13.276494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281554+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:11:13.281554+0000","last_peered":"2023-10-03T10:11:13.281554+0000","last_clean":"2023-10-03T10:11:13.281554+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:11:13.281554+0000","last_undegraded":"2023-10-03T10:11:13.281554+0000","last_fullsized":"2023-10-03T10:11:13.281554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283286+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:11:13.283286+0000","last_peered":"2023-10-03T10:11:13.283286+0000","last_clean":"2023-10-03T10:11:13.283286+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:11:13.283286+0000","last_undegraded":"2023-10-03T10:11:13.283286+0000","last_fullsized":"2023-10-03T10:11:13.283286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286761+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:11:13.286761+0000","last_peered":"2023-10-03T10:11:13.286761+0000","last_clean":"2023-10-03T10:11:13.286761+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:11:13.286761+0000","last_undegraded":"2023-10-03T10:11:13.286761+0000","last_fullsized":"2023-10-03T10:11:13.286761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.249192+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:11:13.249192+0000","last_peered":"2023-10-03T10:11:13.249192+0000","last_clean":"2023-10-03T10:11:13.249192+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:11:13.249192+0000","last_undegraded":"2023-10-03T10:11:13.249192+0000","last_fullsized":"2023-10-03T10:11:13.249192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281374+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:11:13.281374+0000","last_peered":"2023-10-03T10:11:13.281374+0000","last_clean":"2023-10-03T10:11:13.281374+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:11:13.281374+0000","last_undegraded":"2023-10-03T10:11:13.281374+0000","last_fullsized":"2023-10-03T10:11:13.281374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280752+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:11:13.280752+0000","last_peered":"2023-10-03T10:11:13.280752+0000","last_clean":"2023-10-03T10:11:13.280752+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:11:13.280752+0000","last_undegraded":"2023-10-03T10:11:13.280752+0000","last_fullsized":"2023-10-03T10:11:13.280752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285393+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:11:13.285393+0000","last_peered":"2023-10-03T10:11:13.285393+0000","last_clean":"2023-10-03T10:11:13.285393+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:11:13.285393+0000","last_undegraded":"2023-10-03T10:11:13.285393+0000","last_fullsized":"2023-10-03T10:11:13.285393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.241008+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:11:13.241008+0000","last_peered":"2023-10-03T10:11:13.241008+0000","last_clean":"2023-10-03T10:11:13.241008+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:11:13.241008+0000","last_undegraded":"2023-10-03T10:11:13.241008+0000","last_fullsized":"2023-10-03T10:11:13.241008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280692+0000","last_change":"2023-10-03T10:11:13.271873+0000","last_active":"2023-10-03T10:11:13.280692+0000","last_peered":"2023-10-03T10:11:13.280692+0000","last_clean":"2023-10-03T10:11:13.280692+0000","last_became_active":"2023-10-03T10:11:13.270857+0000","last_became_peered":"2023-10-03T10:11:13.270857+0000","last_unstale":"2023-10-03T10:11:13.280692+0000","last_undegraded":"2023-10-03T10:11:13.280692+0000","last_fullsized":"2023-10-03T10:11:13.280692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240604+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:11:13.240604+0000","last_peered":"2023-10-03T10:11:13.240604+0000","last_clean":"2023-10-03T10:11:13.240604+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:11:13.240604+0000","last_undegraded":"2023-10-03T10:11:13.240604+0000","last_fullsized":"2023-10-03T10:11:13.240604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285970+0000","last_change":"2023-10-03T10:11:13.281452+0000","last_active":"2023-10-03T10:11:13.285970+0000","last_peered":"2023-10-03T10:11:13.285970+0000","last_clean":"2023-10-03T10:11:13.285970+0000","last_became_active":"2023-10-03T10:11:13.279215+0000","last_became_peered":"2023-10-03T10:11:13.279215+0000","last_unstale":"2023-10-03T10:11:13.285970+0000","last_undegraded":"2023-10-03T10:11:13.285970+0000","last_fullsized":"2023-10-03T10:11:13.285970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.239668+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:11:13.239668+0000","last_peered":"2023-10-03T10:11:13.239668+0000","last_clean":"2023-10-03T10:11:13.239668+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:11:13.239668+0000","last_undegraded":"2023-10-03T10:11:13.239668+0000","last_fullsized":"2023-10-03T10:11:13.239668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252481+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:11:13.252481+0000","last_peered":"2023-10-03T10:11:13.252481+0000","last_clean":"2023-10-03T10:11:13.252481+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:11:13.252481+0000","last_undegraded":"2023-10-03T10:11:13.252481+0000","last_fullsized":"2023-10-03T10:11:13.252481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240906+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:13.240906+0000","last_peered":"2023-10-03T10:11:13.240906+0000","last_clean":"2023-10-03T10:11:13.240906+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:13.240906+0000","last_undegraded":"2023-10-03T10:11:13.240906+0000","last_fullsized":"2023-10-03T10:11:13.240906+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.250948+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:11:13.250948+0000","last_peered":"2023-10-03T10:11:13.250948+0000","last_clean":"2023-10-03T10:11:13.250948+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:11:13.250948+0000","last_undegraded":"2023-10-03T10:11:13.250948+0000","last_fullsized":"2023-10-03T10:11:13.250948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253245+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:13.253245+0000","last_peered":"2023-10-03T10:11:13.253245+0000","last_clean":"2023-10-03T10:11:13.253245+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:13.253245+0000","last_undegraded":"2023-10-03T10:11:13.253245+0000","last_fullsized":"2023-10-03T10:11:13.253245+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240708+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:13.240708+0000","last_peered":"2023-10-03T10:11:13.240708+0000","last_clean":"2023-10-03T10:11:13.240708+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:13.240708+0000","last_undegraded":"2023-10-03T10:11:13.240708+0000","last_fullsized":"2023-10-03T10:11:13.240708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240818+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:11:13.240818+0000","last_peered":"2023-10-03T10:11:13.240818+0000","last_clean":"2023-10-03T10:11:13.240818+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:11:13.240818+0000","last_undegraded":"2023-10-03T10:11:13.240818+0000","last_fullsized":"2023-10-03T10:11:13.240818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280736+0000","last_change":"2023-10-03T10:11:13.272220+0000","last_active":"2023-10-03T10:11:13.280736+0000","last_peered":"2023-10-03T10:11:13.280736+0000","last_clean":"2023-10-03T10:11:13.280736+0000","last_became_active":"2023-10-03T10:11:13.271605+0000","last_became_peered":"2023-10-03T10:11:13.271605+0000","last_unstale":"2023-10-03T10:11:13.280736+0000","last_undegraded":"2023-10-03T10:11:13.280736+0000","last_fullsized":"2023-10-03T10:11:13.280736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240139+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:13.240139+0000","last_peered":"2023-10-03T10:11:13.240139+0000","last_clean":"2023-10-03T10:11:13.240139+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:13.240139+0000","last_undegraded":"2023-10-03T10:11:13.240139+0000","last_fullsized":"2023-10-03T10:11:13.240139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.248096+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:11:13.248096+0000","last_peered":"2023-10-03T10:11:13.248096+0000","last_clean":"2023-10-03T10:11:13.248096+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:11:13.248096+0000","last_undegraded":"2023-10-03T10:11:13.248096+0000","last_fullsized":"2023-10-03T10:11:13.248096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276315+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:11:13.276315+0000","last_peered":"2023-10-03T10:11:13.276315+0000","last_clean":"2023-10-03T10:11:13.276315+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:11:13.276315+0000","last_undegraded":"2023-10-03T10:11:13.276315+0000","last_fullsized":"2023-10-03T10:11:13.276315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.243333+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:13.243333+0000","last_peered":"2023-10-03T10:11:13.243333+0000","last_clean":"2023-10-03T10:11:13.243333+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:13.243333+0000","last_undegraded":"2023-10-03T10:11:13.243333+0000","last_fullsized":"2023-10-03T10:11:13.243333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276101+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:11:13.276101+0000","last_peered":"2023-10-03T10:11:13.276101+0000","last_clean":"2023-10-03T10:11:13.276101+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:11:13.276101+0000","last_undegraded":"2023-10-03T10:11:13.276101+0000","last_fullsized":"2023-10-03T10:11:13.276101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283517+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:11:13.283517+0000","last_peered":"2023-10-03T10:11:13.283517+0000","last_clean":"2023-10-03T10:11:13.283517+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:11:13.283517+0000","last_undegraded":"2023-10-03T10:11:13.283517+0000","last_fullsized":"2023-10-03T10:11:13.283517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276475+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:11:13.276475+0000","last_peered":"2023-10-03T10:11:13.276475+0000","last_clean":"2023-10-03T10:11:13.276475+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:11:13.276475+0000","last_undegraded":"2023-10-03T10:11:13.276475+0000","last_fullsized":"2023-10-03T10:11:13.276475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251108+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:13.251108+0000","last_peered":"2023-10-03T10:11:13.251108+0000","last_clean":"2023-10-03T10:11:13.251108+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:13.251108+0000","last_undegraded":"2023-10-03T10:11:13.251108+0000","last_fullsized":"2023-10-03T10:11:13.251108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:11:15.346855+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:11:15.346855+0000","last_peered":"2023-10-03T10:11:15.346855+0000","last_clean":"2023-10-03T10:11:15.346855+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:11:15.346855+0000","last_undegraded":"2023-10-03T10:11:15.346855+0000","last_fullsized":"2023-10-03T10:11:15.346855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285553+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:11:13.285553+0000","last_peered":"2023-10-03T10:11:13.285553+0000","last_clean":"2023-10-03T10:11:13.285553+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:11:13.285553+0000","last_undegraded":"2023-10-03T10:11:13.285553+0000","last_fullsized":"2023-10-03T10:11:13.285553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278547+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:11:13.278547+0000","last_peered":"2023-10-03T10:11:13.278547+0000","last_clean":"2023-10-03T10:11:13.278547+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:11:13.278547+0000","last_undegraded":"2023-10-03T10:11:13.278547+0000","last_fullsized":"2023-10-03T10:11:13.278547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.271145+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:11:13.271145+0000","last_peered":"2023-10-03T10:11:13.271145+0000","last_clean":"2023-10-03T10:11:13.271145+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:11:13.271145+0000","last_undegraded":"2023-10-03T10:11:13.271145+0000","last_fullsized":"2023-10-03T10:11:13.271145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285634+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:11:13.285634+0000","last_peered":"2023-10-03T10:11:13.285634+0000","last_clean":"2023-10-03T10:11:13.285634+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:11:13.285634+0000","last_undegraded":"2023-10-03T10:11:13.285634+0000","last_fullsized":"2023-10-03T10:11:13.285634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281776+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:11:13.281776+0000","last_peered":"2023-10-03T10:11:13.281776+0000","last_clean":"2023-10-03T10:11:13.281776+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:11:13.281776+0000","last_undegraded":"2023-10-03T10:11:13.281776+0000","last_fullsized":"2023-10-03T10:11:13.281776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286788+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:11:13.286788+0000","last_peered":"2023-10-03T10:11:13.286788+0000","last_clean":"2023-10-03T10:11:13.286788+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:11:13.286788+0000","last_undegraded":"2023-10-03T10:11:13.286788+0000","last_fullsized":"2023-10-03T10:11:13.286788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276099+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:11:13.276099+0000","last_peered":"2023-10-03T10:11:13.276099+0000","last_clean":"2023-10-03T10:11:13.276099+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:11:13.276099+0000","last_undegraded":"2023-10-03T10:11:13.276099+0000","last_fullsized":"2023-10-03T10:11:13.276099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276468+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:11:13.276468+0000","last_peered":"2023-10-03T10:11:13.276468+0000","last_clean":"2023-10-03T10:11:13.276468+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:11:13.276468+0000","last_undegraded":"2023-10-03T10:11:13.276468+0000","last_fullsized":"2023-10-03T10:11:13.276468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273955+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:11:13.273955+0000","last_peered":"2023-10-03T10:11:13.273955+0000","last_clean":"2023-10-03T10:11:13.273955+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:11:13.273955+0000","last_undegraded":"2023-10-03T10:11:13.273955+0000","last_fullsized":"2023-10-03T10:11:13.273955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.261244+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:11:13.261244+0000","last_peered":"2023-10-03T10:11:13.261244+0000","last_clean":"2023-10-03T10:11:13.261244+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:11:13.261244+0000","last_undegraded":"2023-10-03T10:11:13.261244+0000","last_fullsized":"2023-10-03T10:11:13.261244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270710+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:11:13.270710+0000","last_peered":"2023-10-03T10:11:13.270710+0000","last_clean":"2023-10-03T10:11:13.270710+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:11:13.270710+0000","last_undegraded":"2023-10-03T10:11:13.270710+0000","last_fullsized":"2023-10-03T10:11:13.270710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285520+0000","last_change":"2023-10-03T10:11:13.278425+0000","last_active":"2023-10-03T10:11:13.285520+0000","last_peered":"2023-10-03T10:11:13.285520+0000","last_clean":"2023-10-03T10:11:13.285520+0000","last_became_active":"2023-10-03T10:11:13.278120+0000","last_became_peered":"2023-10-03T10:11:13.278120+0000","last_unstale":"2023-10-03T10:11:13.285520+0000","last_undegraded":"2023-10-03T10:11:13.285520+0000","last_fullsized":"2023-10-03T10:11:13.285520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276989+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:11:13.276989+0000","last_peered":"2023-10-03T10:11:13.276989+0000","last_clean":"2023-10-03T10:11:13.276989+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:11:13.276989+0000","last_undegraded":"2023-10-03T10:11:13.276989+0000","last_fullsized":"2023-10-03T10:11:13.276989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:25.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:11:25.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.861+0000 7fc32cfc9700 1 Processor -- start 2023-10-03T10:11:25.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.862+0000 7fc32cfc9700 1 -- start start 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32cfc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 0x7fc328125710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32cfc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 0x7fc328130b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32cfc9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc328059e10 con 0x7fc328125c00 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32cfc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc328059450 con 0x7fc328059070 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32cfc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280961a0 con 0x7fc328094300 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 0x7fc328125710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 0x7fc328130b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc325d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc328125c00 0x7fc328093bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47742/0 (socket says 172.21.15.19:47742) 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc325d9b700 1 -- 172.21.15.19:0/1612024617 learned_addr learned my addr 172.21.15.19:0/1612024617 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32559a700 1 -- 172.21.15.19:0/1612024617 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278618784 0 0) 0x7fc328059e10 con 0x7fc328125c00 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 -- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 msgr2=0x7fc328125710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 0x7fc328125710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 -- 172.21.15.19:0/1612024617 >> v1:172.21.15.19:6789/0 conn(0x7fc328125c00 legacy=0x7fc328093bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 -- 172.21.15.19:0/1612024617 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc328097010 con 0x7fc328094300 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32659c700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 0x7fc328125710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc326d9d700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 0x7fc328130b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc320009ec0 tx=0x7fc320009780).ready entity=mon.2 client_cookie=455b02b19eb0e98c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32559a700 1 -- 172.21.15.19:0/1612024617 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000e070 con 0x7fc328094300 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32559a700 1 -- 172.21.15.19:0/1612024617 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000bbf0 con 0x7fc328094300 2023-10-03T10:11:25.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.863+0000 7fc32559a700 1 -- 172.21.15.19:0/1612024617 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc320012410 con 0x7fc328094300 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 -- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 msgr2=0x7fc328130b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 0x7fc328130b80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc320009ec0 tx=0x7fc320009780).stop 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 -- 172.21.15.19:0/1612024617 shutdown_connections 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328094300 0x7fc328130b80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/1612024617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328059070 0x7fc328125710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 -- 172.21.15.19:0/1612024617 >> 172.21.15.19:0/1612024617 conn(0x7fc32809a8e0 msgr2=0x7fc32809acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 -- 172.21.15.19:0/1612024617 shutdown_connections 2023-10-03T10:11:25.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.864+0000 7fc32cfc9700 1 -- 172.21.15.19:0/1612024617 wait complete. 2023-10-03T10:11:25.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.865+0000 7fc32cfc9700 1 Processor -- start 2023-10-03T10:11:25.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 -- start start 2023-10-03T10:11:25.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 0x7fc3280923c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280928b0 con 0x7fc328125c00 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3280934b0 con 0x7fc328094300 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32cfc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32806a690 con 0x7fc328059070 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc325d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54602/0 (socket says 172.21.15.19:54602) 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc325d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42394/0 (socket says 172.21.15.19:42394) 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc32659c700 1 -- 172.21.15.19:0/3968107558 learned_addr learned my addr 172.21.15.19:0/3968107558 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:25.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.866+0000 7fc326d9d700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 0x7fc3280923c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 -- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 msgr2=0x7fc328091ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 -- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 msgr2=0x7fc3280923c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 0x7fc3280923c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 -- 172.21.15.19:0/3968107558 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180092a0 con 0x7fc328059070 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc326d9d700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 0x7fc3280923c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc325d9b700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32659c700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc31800ea50 tx=0x7fc318009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800ee90 con 0x7fc328059070 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800c850 con 0x7fc328059070 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc320009a20 con 0x7fc328059070 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800cbd0 con 0x7fc328059070 2023-10-03T10:11:25.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.867+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc328117200 con 0x7fc328059070 2023-10-03T10:11:25.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.868+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fc31801b400 con 0x7fc328059070 2023-10-03T10:11:25.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.868+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fc31803b4e0 con 0x7fc328059070 2023-10-03T10:11:25.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.868+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc328064cf0 con 0x7fc328059070 2023-10-03T10:11:25.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:25.873+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fc31801be60 con 0x7fc328059070 2023-10-03T10:11:26.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.046+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 --> v1:172.21.15.19:6816/118286 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3281176e0 con 0x7fc30802bb60 2023-10-03T10:11:26.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.053+0000 7fc3167fc700 1 -- 172.21.15.19:0/3968107558 <== mgr.4105 v1:172.21.15.19:6816/118286 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249970 (unknown 2965378022 0 1767949054) 0x7fc3281176e0 con 0x7fc30802bb60 2023-10-03T10:11:26.057 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:26.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 >> v1:172.21.15.19:6816/118286 conn(0x7fc30802bb60 legacy=0x7fc30802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 msgr2=0x7fc3280919e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc31800ea50 tx=0x7fc318009060).stop 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 shutdown_connections 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc328125c00 0x7fc3280923c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc328059070 0x7fc3280919e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 --2- 172.21.15.19:0/3968107558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc328094300 0x7fc328091ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 >> 172.21.15.19:0/3968107558 conn(0x7fc32809a8e0 msgr2=0x7fc328128fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 shutdown_connections 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.056+0000 7fc32cfc9700 1 -- 172.21.15.19:0/3968107558 wait complete. 2023-10-03T10:11:26.059 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:11:26.070 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-03T10:11:25.725611+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189024,"kb_used_data":640,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298336,"statfs":{"total":386547056640,"available":385329496064,"internally_reserved":0,"allocated":655360,"data_stored":193408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002923"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268370+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:11:13.268370+0000","last_peered":"2023-10-03T10:11:13.268370+0000","last_clean":"2023-10-03T10:11:13.268370+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:11:13.268370+0000","last_undegraded":"2023-10-03T10:11:13.268370+0000","last_fullsized":"2023-10-03T10:11:13.268370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268760+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:11:13.268760+0000","last_peered":"2023-10-03T10:11:13.268760+0000","last_clean":"2023-10-03T10:11:13.268760+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:11:13.268760+0000","last_undegraded":"2023-10-03T10:11:13.268760+0000","last_fullsized":"2023-10-03T10:11:13.268760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276725+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:11:13.276725+0000","last_peered":"2023-10-03T10:11:13.276725+0000","last_clean":"2023-10-03T10:11:13.276725+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:11:13.276725+0000","last_undegraded":"2023-10-03T10:11:13.276725+0000","last_fullsized":"2023-10-03T10:11:13.276725+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.277146+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:11:13.277146+0000","last_peered":"2023-10-03T10:11:13.277146+0000","last_clean":"2023-10-03T10:11:13.277146+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:11:13.277146+0000","last_undegraded":"2023-10-03T10:11:13.277146+0000","last_fullsized":"2023-10-03T10:11:13.277146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285549+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:11:13.285549+0000","last_peered":"2023-10-03T10:11:13.285549+0000","last_clean":"2023-10-03T10:11:13.285549+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:11:13.285549+0000","last_undegraded":"2023-10-03T10:11:13.285549+0000","last_fullsized":"2023-10-03T10:11:13.285549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276317+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:11:13.276317+0000","last_peered":"2023-10-03T10:11:13.276317+0000","last_clean":"2023-10-03T10:11:13.276317+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:11:13.276317+0000","last_undegraded":"2023-10-03T10:11:13.276317+0000","last_fullsized":"2023-10-03T10:11:13.276317+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276451+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:11:13.276451+0000","last_peered":"2023-10-03T10:11:13.276451+0000","last_clean":"2023-10-03T10:11:13.276451+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:11:13.276451+0000","last_undegraded":"2023-10-03T10:11:13.276451+0000","last_fullsized":"2023-10-03T10:11:13.276451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280108+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:11:13.280108+0000","last_peered":"2023-10-03T10:11:13.280108+0000","last_clean":"2023-10-03T10:11:13.280108+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:11:13.280108+0000","last_undegraded":"2023-10-03T10:11:13.280108+0000","last_fullsized":"2023-10-03T10:11:13.280108+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285473+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:11:13.285473+0000","last_peered":"2023-10-03T10:11:13.285473+0000","last_clean":"2023-10-03T10:11:13.285473+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:11:13.285473+0000","last_undegraded":"2023-10-03T10:11:13.285473+0000","last_fullsized":"2023-10-03T10:11:13.285473+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285639+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:11:13.285639+0000","last_peered":"2023-10-03T10:11:13.285639+0000","last_clean":"2023-10-03T10:11:13.285639+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:11:13.285639+0000","last_undegraded":"2023-10-03T10:11:13.285639+0000","last_fullsized":"2023-10-03T10:11:13.285639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280358+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:11:13.280358+0000","last_peered":"2023-10-03T10:11:13.280358+0000","last_clean":"2023-10-03T10:11:13.280358+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:11:13.280358+0000","last_undegraded":"2023-10-03T10:11:13.280358+0000","last_fullsized":"2023-10-03T10:11:13.280358+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278826+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:11:13.278826+0000","last_peered":"2023-10-03T10:11:13.278826+0000","last_clean":"2023-10-03T10:11:13.278826+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:11:13.278826+0000","last_undegraded":"2023-10-03T10:11:13.278826+0000","last_fullsized":"2023-10-03T10:11:13.278826+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285649+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:11:13.285649+0000","last_peered":"2023-10-03T10:11:13.285649+0000","last_clean":"2023-10-03T10:11:13.285649+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:11:13.285649+0000","last_undegraded":"2023-10-03T10:11:13.285649+0000","last_fullsized":"2023-10-03T10:11:13.285649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268595+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:11:13.268595+0000","last_peered":"2023-10-03T10:11:13.268595+0000","last_clean":"2023-10-03T10:11:13.268595+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:11:13.268595+0000","last_undegraded":"2023-10-03T10:11:13.268595+0000","last_fullsized":"2023-10-03T10:11:13.268595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281847+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:11:13.281847+0000","last_peered":"2023-10-03T10:11:13.281847+0000","last_clean":"2023-10-03T10:11:13.281847+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:11:13.281847+0000","last_undegraded":"2023-10-03T10:11:13.281847+0000","last_fullsized":"2023-10-03T10:11:13.281847+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276513+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:11:13.276513+0000","last_peered":"2023-10-03T10:11:13.276513+0000","last_clean":"2023-10-03T10:11:13.276513+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:11:13.276513+0000","last_undegraded":"2023-10-03T10:11:13.276513+0000","last_fullsized":"2023-10-03T10:11:13.276513+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285497+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:11:13.285497+0000","last_peered":"2023-10-03T10:11:13.285497+0000","last_clean":"2023-10-03T10:11:13.285497+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:11:13.285497+0000","last_undegraded":"2023-10-03T10:11:13.285497+0000","last_fullsized":"2023-10-03T10:11:13.285497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276394+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:11:13.276394+0000","last_peered":"2023-10-03T10:11:13.276394+0000","last_clean":"2023-10-03T10:11:13.276394+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:11:13.276394+0000","last_undegraded":"2023-10-03T10:11:13.276394+0000","last_fullsized":"2023-10-03T10:11:13.276394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285853+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:11:13.285853+0000","last_peered":"2023-10-03T10:11:13.285853+0000","last_clean":"2023-10-03T10:11:13.285853+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:11:13.285853+0000","last_undegraded":"2023-10-03T10:11:13.285853+0000","last_fullsized":"2023-10-03T10:11:13.285853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286185+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:11:13.286185+0000","last_peered":"2023-10-03T10:11:13.286185+0000","last_clean":"2023-10-03T10:11:13.286185+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:11:13.286185+0000","last_undegraded":"2023-10-03T10:11:13.286185+0000","last_fullsized":"2023-10-03T10:11:13.286185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276699+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:11:13.276699+0000","last_peered":"2023-10-03T10:11:13.276699+0000","last_clean":"2023-10-03T10:11:13.276699+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:11:13.276699+0000","last_undegraded":"2023-10-03T10:11:13.276699+0000","last_fullsized":"2023-10-03T10:11:13.276699+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276604+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:11:13.276604+0000","last_peered":"2023-10-03T10:11:13.276604+0000","last_clean":"2023-10-03T10:11:13.276604+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:11:13.276604+0000","last_undegraded":"2023-10-03T10:11:13.276604+0000","last_fullsized":"2023-10-03T10:11:13.276604+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278163+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:11:13.278163+0000","last_peered":"2023-10-03T10:11:13.278163+0000","last_clean":"2023-10-03T10:11:13.278163+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:11:13.278163+0000","last_undegraded":"2023-10-03T10:11:13.278163+0000","last_fullsized":"2023-10-03T10:11:13.278163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280089+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:11:13.280089+0000","last_peered":"2023-10-03T10:11:13.280089+0000","last_clean":"2023-10-03T10:11:13.280089+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:11:13.280089+0000","last_undegraded":"2023-10-03T10:11:13.280089+0000","last_fullsized":"2023-10-03T10:11:13.280089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268892+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:11:13.268892+0000","last_peered":"2023-10-03T10:11:13.268892+0000","last_clean":"2023-10-03T10:11:13.268892+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:11:13.268892+0000","last_undegraded":"2023-10-03T10:11:13.268892+0000","last_fullsized":"2023-10-03T10:11:13.268892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276977+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:11:13.276977+0000","last_peered":"2023-10-03T10:11:13.276977+0000","last_clean":"2023-10-03T10:11:13.276977+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:11:13.276977+0000","last_undegraded":"2023-10-03T10:11:13.276977+0000","last_fullsized":"2023-10-03T10:11:13.276977+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286916+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:11:13.286916+0000","last_peered":"2023-10-03T10:11:13.286916+0000","last_clean":"2023-10-03T10:11:13.286916+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:11:13.286916+0000","last_undegraded":"2023-10-03T10:11:13.286916+0000","last_fullsized":"2023-10-03T10:11:13.286916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268513+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:11:13.268513+0000","last_peered":"2023-10-03T10:11:13.268513+0000","last_clean":"2023-10-03T10:11:13.268513+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:11:13.268513+0000","last_undegraded":"2023-10-03T10:11:13.268513+0000","last_fullsized":"2023-10-03T10:11:13.268513+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280713+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:11:13.280713+0000","last_peered":"2023-10-03T10:11:13.280713+0000","last_clean":"2023-10-03T10:11:13.280713+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:11:13.280713+0000","last_undegraded":"2023-10-03T10:11:13.280713+0000","last_fullsized":"2023-10-03T10:11:13.280713+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.255463+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:11:13.255463+0000","last_peered":"2023-10-03T10:11:13.255463+0000","last_clean":"2023-10-03T10:11:13.255463+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:11:13.255463+0000","last_undegraded":"2023-10-03T10:11:13.255463+0000","last_fullsized":"2023-10-03T10:11:13.255463+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276415+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:11:13.276415+0000","last_peered":"2023-10-03T10:11:13.276415+0000","last_clean":"2023-10-03T10:11:13.276415+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:11:13.276415+0000","last_undegraded":"2023-10-03T10:11:13.276415+0000","last_fullsized":"2023-10-03T10:11:13.276415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240250+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:11:13.240250+0000","last_peered":"2023-10-03T10:11:13.240250+0000","last_clean":"2023-10-03T10:11:13.240250+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:11:13.240250+0000","last_undegraded":"2023-10-03T10:11:13.240250+0000","last_fullsized":"2023-10-03T10:11:13.240250+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287203+0000","last_change":"2023-10-03T10:11:13.283237+0000","last_active":"2023-10-03T10:11:13.287203+0000","last_peered":"2023-10-03T10:11:13.287203+0000","last_clean":"2023-10-03T10:11:13.287203+0000","last_became_active":"2023-10-03T10:11:13.282919+0000","last_became_peered":"2023-10-03T10:11:13.282919+0000","last_unstale":"2023-10-03T10:11:13.287203+0000","last_undegraded":"2023-10-03T10:11:13.287203+0000","last_fullsized":"2023-10-03T10:11:13.287203+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252142+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:11:13.252142+0000","last_peered":"2023-10-03T10:11:13.252142+0000","last_clean":"2023-10-03T10:11:13.252142+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:11:13.252142+0000","last_undegraded":"2023-10-03T10:11:13.252142+0000","last_fullsized":"2023-10-03T10:11:13.252142+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276531+0000","last_change":"2023-10-03T10:11:13.264719+0000","last_active":"2023-10-03T10:11:13.276531+0000","last_peered":"2023-10-03T10:11:13.276531+0000","last_clean":"2023-10-03T10:11:13.276531+0000","last_became_active":"2023-10-03T10:11:13.255651+0000","last_became_peered":"2023-10-03T10:11:13.255651+0000","last_unstale":"2023-10-03T10:11:13.276531+0000","last_undegraded":"2023-10-03T10:11:13.276531+0000","last_fullsized":"2023-10-03T10:11:13.276531+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253054+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:11:13.253054+0000","last_peered":"2023-10-03T10:11:13.253054+0000","last_clean":"2023-10-03T10:11:13.253054+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:11:13.253054+0000","last_undegraded":"2023-10-03T10:11:13.253054+0000","last_fullsized":"2023-10-03T10:11:13.253054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276430+0000","last_change":"2023-10-03T10:11:13.268456+0000","last_active":"2023-10-03T10:11:13.276430+0000","last_peered":"2023-10-03T10:11:13.276430+0000","last_clean":"2023-10-03T10:11:13.276430+0000","last_became_active":"2023-10-03T10:11:13.267206+0000","last_became_peered":"2023-10-03T10:11:13.267206+0000","last_unstale":"2023-10-03T10:11:13.276430+0000","last_undegraded":"2023-10-03T10:11:13.276430+0000","last_fullsized":"2023-10-03T10:11:13.276430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.284853+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:11:13.284853+0000","last_peered":"2023-10-03T10:11:13.284853+0000","last_clean":"2023-10-03T10:11:13.284853+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:11:13.284853+0000","last_undegraded":"2023-10-03T10:11:13.284853+0000","last_fullsized":"2023-10-03T10:11:13.284853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276886+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:11:13.276886+0000","last_peered":"2023-10-03T10:11:13.276886+0000","last_clean":"2023-10-03T10:11:13.276886+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:11:13.276886+0000","last_undegraded":"2023-10-03T10:11:13.276886+0000","last_fullsized":"2023-10-03T10:11:13.276886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"16'6","reported_seq":16,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287590+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:11:13.287590+0000","last_peered":"2023-10-03T10:11:13.287590+0000","last_clean":"2023-10-03T10:11:13.287590+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:11:13.287590+0000","last_undegraded":"2023-10-03T10:11:13.287590+0000","last_fullsized":"2023-10-03T10:11:13.287590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285616+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:11:13.285616+0000","last_peered":"2023-10-03T10:11:13.285616+0000","last_clean":"2023-10-03T10:11:13.285616+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:11:13.285616+0000","last_undegraded":"2023-10-03T10:11:13.285616+0000","last_fullsized":"2023-10-03T10:11:13.285616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280900+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:11:13.280900+0000","last_peered":"2023-10-03T10:11:13.280900+0000","last_clean":"2023-10-03T10:11:13.280900+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:11:13.280900+0000","last_undegraded":"2023-10-03T10:11:13.280900+0000","last_fullsized":"2023-10-03T10:11:13.280900+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280337+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:11:13.280337+0000","last_peered":"2023-10-03T10:11:13.280337+0000","last_clean":"2023-10-03T10:11:13.280337+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:11:13.280337+0000","last_undegraded":"2023-10-03T10:11:13.280337+0000","last_fullsized":"2023-10-03T10:11:13.280337+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.246336+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:11:13.246336+0000","last_peered":"2023-10-03T10:11:13.246336+0000","last_clean":"2023-10-03T10:11:13.246336+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:11:13.246336+0000","last_undegraded":"2023-10-03T10:11:13.246336+0000","last_fullsized":"2023-10-03T10:11:13.246336+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286895+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:11:13.286895+0000","last_peered":"2023-10-03T10:11:13.286895+0000","last_clean":"2023-10-03T10:11:13.286895+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:11:13.286895+0000","last_undegraded":"2023-10-03T10:11:13.286895+0000","last_fullsized":"2023-10-03T10:11:13.286895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240734+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:11:13.240734+0000","last_peered":"2023-10-03T10:11:13.240734+0000","last_clean":"2023-10-03T10:11:13.240734+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:11:13.240734+0000","last_undegraded":"2023-10-03T10:11:13.240734+0000","last_fullsized":"2023-10-03T10:11:13.240734+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285224+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:11:13.285224+0000","last_peered":"2023-10-03T10:11:13.285224+0000","last_clean":"2023-10-03T10:11:13.285224+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:11:13.285224+0000","last_undegraded":"2023-10-03T10:11:13.285224+0000","last_fullsized":"2023-10-03T10:11:13.285224+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":18,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281371+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:11:13.281371+0000","last_peered":"2023-10-03T10:11:13.281371+0000","last_clean":"2023-10-03T10:11:13.281371+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:11:13.281371+0000","last_undegraded":"2023-10-03T10:11:13.281371+0000","last_fullsized":"2023-10-03T10:11:13.281371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.287484+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:11:13.287484+0000","last_peered":"2023-10-03T10:11:13.287484+0000","last_clean":"2023-10-03T10:11:13.287484+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:11:13.287484+0000","last_undegraded":"2023-10-03T10:11:13.287484+0000","last_fullsized":"2023-10-03T10:11:13.287484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273737+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:11:13.273737+0000","last_peered":"2023-10-03T10:11:13.273737+0000","last_clean":"2023-10-03T10:11:13.273737+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:11:13.273737+0000","last_undegraded":"2023-10-03T10:11:13.273737+0000","last_fullsized":"2023-10-03T10:11:13.273737+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276494+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:11:13.276494+0000","last_peered":"2023-10-03T10:11:13.276494+0000","last_clean":"2023-10-03T10:11:13.276494+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:11:13.276494+0000","last_undegraded":"2023-10-03T10:11:13.276494+0000","last_fullsized":"2023-10-03T10:11:13.276494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281554+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:11:13.281554+0000","last_peered":"2023-10-03T10:11:13.281554+0000","last_clean":"2023-10-03T10:11:13.281554+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:11:13.281554+0000","last_undegraded":"2023-10-03T10:11:13.281554+0000","last_fullsized":"2023-10-03T10:11:13.281554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268451+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:11:13.268451+0000","last_peered":"2023-10-03T10:11:13.268451+0000","last_clean":"2023-10-03T10:11:13.268451+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:11:13.268451+0000","last_undegraded":"2023-10-03T10:11:13.268451+0000","last_fullsized":"2023-10-03T10:11:13.268451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283286+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:11:13.283286+0000","last_peered":"2023-10-03T10:11:13.283286+0000","last_clean":"2023-10-03T10:11:13.283286+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:11:13.283286+0000","last_undegraded":"2023-10-03T10:11:13.283286+0000","last_fullsized":"2023-10-03T10:11:13.283286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286761+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:11:13.286761+0000","last_peered":"2023-10-03T10:11:13.286761+0000","last_clean":"2023-10-03T10:11:13.286761+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:11:13.286761+0000","last_undegraded":"2023-10-03T10:11:13.286761+0000","last_fullsized":"2023-10-03T10:11:13.286761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.249192+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:11:13.249192+0000","last_peered":"2023-10-03T10:11:13.249192+0000","last_clean":"2023-10-03T10:11:13.249192+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:11:13.249192+0000","last_undegraded":"2023-10-03T10:11:13.249192+0000","last_fullsized":"2023-10-03T10:11:13.249192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281374+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:11:13.281374+0000","last_peered":"2023-10-03T10:11:13.281374+0000","last_clean":"2023-10-03T10:11:13.281374+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:11:13.281374+0000","last_undegraded":"2023-10-03T10:11:13.281374+0000","last_fullsized":"2023-10-03T10:11:13.281374+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280752+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:11:13.280752+0000","last_peered":"2023-10-03T10:11:13.280752+0000","last_clean":"2023-10-03T10:11:13.280752+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:11:13.280752+0000","last_undegraded":"2023-10-03T10:11:13.280752+0000","last_fullsized":"2023-10-03T10:11:13.280752+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285393+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:11:13.285393+0000","last_peered":"2023-10-03T10:11:13.285393+0000","last_clean":"2023-10-03T10:11:13.285393+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:11:13.285393+0000","last_undegraded":"2023-10-03T10:11:13.285393+0000","last_fullsized":"2023-10-03T10:11:13.285393+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.241008+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:11:13.241008+0000","last_peered":"2023-10-03T10:11:13.241008+0000","last_clean":"2023-10-03T10:11:13.241008+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:11:13.241008+0000","last_undegraded":"2023-10-03T10:11:13.241008+0000","last_fullsized":"2023-10-03T10:11:13.241008+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280692+0000","last_change":"2023-10-03T10:11:13.271873+0000","last_active":"2023-10-03T10:11:13.280692+0000","last_peered":"2023-10-03T10:11:13.280692+0000","last_clean":"2023-10-03T10:11:13.280692+0000","last_became_active":"2023-10-03T10:11:13.270857+0000","last_became_peered":"2023-10-03T10:11:13.270857+0000","last_unstale":"2023-10-03T10:11:13.280692+0000","last_undegraded":"2023-10-03T10:11:13.280692+0000","last_fullsized":"2023-10-03T10:11:13.280692+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240604+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:11:13.240604+0000","last_peered":"2023-10-03T10:11:13.240604+0000","last_clean":"2023-10-03T10:11:13.240604+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:11:13.240604+0000","last_undegraded":"2023-10-03T10:11:13.240604+0000","last_fullsized":"2023-10-03T10:11:13.240604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285970+0000","last_change":"2023-10-03T10:11:13.281452+0000","last_active":"2023-10-03T10:11:13.285970+0000","last_peered":"2023-10-03T10:11:13.285970+0000","last_clean":"2023-10-03T10:11:13.285970+0000","last_became_active":"2023-10-03T10:11:13.279215+0000","last_became_peered":"2023-10-03T10:11:13.279215+0000","last_unstale":"2023-10-03T10:11:13.285970+0000","last_undegraded":"2023-10-03T10:11:13.285970+0000","last_fullsized":"2023-10-03T10:11:13.285970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.239668+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:11:13.239668+0000","last_peered":"2023-10-03T10:11:13.239668+0000","last_clean":"2023-10-03T10:11:13.239668+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:11:13.239668+0000","last_undegraded":"2023-10-03T10:11:13.239668+0000","last_fullsized":"2023-10-03T10:11:13.239668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.268914+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:11:13.268914+0000","last_peered":"2023-10-03T10:11:13.268914+0000","last_clean":"2023-10-03T10:11:13.268914+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:11:13.268914+0000","last_undegraded":"2023-10-03T10:11:13.268914+0000","last_fullsized":"2023-10-03T10:11:13.268914+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258554+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:11:13.258554+0000","last_peered":"2023-10-03T10:11:13.258554+0000","last_clean":"2023-10-03T10:11:13.258554+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:11:13.258554+0000","last_undegraded":"2023-10-03T10:11:13.258554+0000","last_fullsized":"2023-10-03T10:11:13.258554+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252481+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:11:13.252481+0000","last_peered":"2023-10-03T10:11:13.252481+0000","last_clean":"2023-10-03T10:11:13.252481+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:11:13.252481+0000","last_undegraded":"2023-10-03T10:11:13.252481+0000","last_fullsized":"2023-10-03T10:11:13.252481+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286145+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:11:13.286145+0000","last_peered":"2023-10-03T10:11:13.286145+0000","last_clean":"2023-10-03T10:11:13.286145+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:11:13.286145+0000","last_undegraded":"2023-10-03T10:11:13.286145+0000","last_fullsized":"2023-10-03T10:11:13.286145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240906+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:11:13.240906+0000","last_peered":"2023-10-03T10:11:13.240906+0000","last_clean":"2023-10-03T10:11:13.240906+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:11:13.240906+0000","last_undegraded":"2023-10-03T10:11:13.240906+0000","last_fullsized":"2023-10-03T10:11:13.240906+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.250948+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:11:13.250948+0000","last_peered":"2023-10-03T10:11:13.250948+0000","last_clean":"2023-10-03T10:11:13.250948+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:11:13.250948+0000","last_undegraded":"2023-10-03T10:11:13.250948+0000","last_fullsized":"2023-10-03T10:11:13.250948+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272528+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:11:13.272528+0000","last_peered":"2023-10-03T10:11:13.272528+0000","last_clean":"2023-10-03T10:11:13.272528+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:11:13.272528+0000","last_undegraded":"2023-10-03T10:11:13.272528+0000","last_fullsized":"2023-10-03T10:11:13.272528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253245+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:11:13.253245+0000","last_peered":"2023-10-03T10:11:13.253245+0000","last_clean":"2023-10-03T10:11:13.253245+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:11:13.253245+0000","last_undegraded":"2023-10-03T10:11:13.253245+0000","last_fullsized":"2023-10-03T10:11:13.253245+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.253057+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:11:13.253057+0000","last_peered":"2023-10-03T10:11:13.253057+0000","last_clean":"2023-10-03T10:11:13.253057+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:11:13.253057+0000","last_undegraded":"2023-10-03T10:11:13.253057+0000","last_fullsized":"2023-10-03T10:11:13.253057+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276910+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:11:13.276910+0000","last_peered":"2023-10-03T10:11:13.276910+0000","last_clean":"2023-10-03T10:11:13.276910+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:11:13.276910+0000","last_undegraded":"2023-10-03T10:11:13.276910+0000","last_fullsized":"2023-10-03T10:11:13.276910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240708+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:11:13.240708+0000","last_peered":"2023-10-03T10:11:13.240708+0000","last_clean":"2023-10-03T10:11:13.240708+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:11:13.240708+0000","last_undegraded":"2023-10-03T10:11:13.240708+0000","last_fullsized":"2023-10-03T10:11:13.240708+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.252954+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:11:13.252954+0000","last_peered":"2023-10-03T10:11:13.252954+0000","last_clean":"2023-10-03T10:11:13.252954+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:11:13.252954+0000","last_undegraded":"2023-10-03T10:11:13.252954+0000","last_fullsized":"2023-10-03T10:11:13.252954+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240818+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:11:13.240818+0000","last_peered":"2023-10-03T10:11:13.240818+0000","last_clean":"2023-10-03T10:11:13.240818+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:11:13.240818+0000","last_undegraded":"2023-10-03T10:11:13.240818+0000","last_fullsized":"2023-10-03T10:11:13.240818+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.280736+0000","last_change":"2023-10-03T10:11:13.272220+0000","last_active":"2023-10-03T10:11:13.280736+0000","last_peered":"2023-10-03T10:11:13.280736+0000","last_clean":"2023-10-03T10:11:13.280736+0000","last_became_active":"2023-10-03T10:11:13.271605+0000","last_became_peered":"2023-10-03T10:11:13.271605+0000","last_unstale":"2023-10-03T10:11:13.280736+0000","last_undegraded":"2023-10-03T10:11:13.280736+0000","last_fullsized":"2023-10-03T10:11:13.280736+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.240139+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:11:13.240139+0000","last_peered":"2023-10-03T10:11:13.240139+0000","last_clean":"2023-10-03T10:11:13.240139+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:11:13.240139+0000","last_undegraded":"2023-10-03T10:11:13.240139+0000","last_fullsized":"2023-10-03T10:11:13.240139+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.248096+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:11:13.248096+0000","last_peered":"2023-10-03T10:11:13.248096+0000","last_clean":"2023-10-03T10:11:13.248096+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:11:13.248096+0000","last_undegraded":"2023-10-03T10:11:13.248096+0000","last_fullsized":"2023-10-03T10:11:13.248096+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276315+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:11:13.276315+0000","last_peered":"2023-10-03T10:11:13.276315+0000","last_clean":"2023-10-03T10:11:13.276315+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:11:13.276315+0000","last_undegraded":"2023-10-03T10:11:13.276315+0000","last_fullsized":"2023-10-03T10:11:13.276315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.243333+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:11:13.243333+0000","last_peered":"2023-10-03T10:11:13.243333+0000","last_clean":"2023-10-03T10:11:13.243333+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:11:13.243333+0000","last_undegraded":"2023-10-03T10:11:13.243333+0000","last_fullsized":"2023-10-03T10:11:13.243333+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.258326+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:11:13.258326+0000","last_peered":"2023-10-03T10:11:13.258326+0000","last_clean":"2023-10-03T10:11:13.258326+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:11:13.258326+0000","last_undegraded":"2023-10-03T10:11:13.258326+0000","last_fullsized":"2023-10-03T10:11:13.258326+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276101+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:11:13.276101+0000","last_peered":"2023-10-03T10:11:13.276101+0000","last_clean":"2023-10-03T10:11:13.276101+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:11:13.276101+0000","last_undegraded":"2023-10-03T10:11:13.276101+0000","last_fullsized":"2023-10-03T10:11:13.276101+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.283517+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:11:13.283517+0000","last_peered":"2023-10-03T10:11:13.283517+0000","last_clean":"2023-10-03T10:11:13.283517+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:11:13.283517+0000","last_undegraded":"2023-10-03T10:11:13.283517+0000","last_fullsized":"2023-10-03T10:11:13.283517+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.266765+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:11:13.266765+0000","last_peered":"2023-10-03T10:11:13.266765+0000","last_clean":"2023-10-03T10:11:13.266765+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:11:13.266765+0000","last_undegraded":"2023-10-03T10:11:13.266765+0000","last_fullsized":"2023-10-03T10:11:13.266765+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276475+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:11:13.276475+0000","last_peered":"2023-10-03T10:11:13.276475+0000","last_clean":"2023-10-03T10:11:13.276475+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:11:13.276475+0000","last_undegraded":"2023-10-03T10:11:13.276475+0000","last_fullsized":"2023-10-03T10:11:13.276475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.251108+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:11:13.251108+0000","last_peered":"2023-10-03T10:11:13.251108+0000","last_clean":"2023-10-03T10:11:13.251108+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:11:13.251108+0000","last_undegraded":"2023-10-03T10:11:13.251108+0000","last_fullsized":"2023-10-03T10:11:13.251108+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-03T10:11:15.346855+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:11:15.346855+0000","last_peered":"2023-10-03T10:11:15.346855+0000","last_clean":"2023-10-03T10:11:15.346855+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:11:15.346855+0000","last_undegraded":"2023-10-03T10:11:15.346855+0000","last_fullsized":"2023-10-03T10:11:15.346855+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285553+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:11:13.285553+0000","last_peered":"2023-10-03T10:11:13.285553+0000","last_clean":"2023-10-03T10:11:13.285553+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:11:13.285553+0000","last_undegraded":"2023-10-03T10:11:13.285553+0000","last_fullsized":"2023-10-03T10:11:13.285553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.278547+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:11:13.278547+0000","last_peered":"2023-10-03T10:11:13.278547+0000","last_clean":"2023-10-03T10:11:13.278547+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:11:13.278547+0000","last_undegraded":"2023-10-03T10:11:13.278547+0000","last_fullsized":"2023-10-03T10:11:13.278547+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.271145+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:11:13.271145+0000","last_peered":"2023-10-03T10:11:13.271145+0000","last_clean":"2023-10-03T10:11:13.271145+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:11:13.271145+0000","last_undegraded":"2023-10-03T10:11:13.271145+0000","last_fullsized":"2023-10-03T10:11:13.271145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.279766+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:11:13.279766+0000","last_peered":"2023-10-03T10:11:13.279766+0000","last_clean":"2023-10-03T10:11:13.279766+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:11:13.279766+0000","last_undegraded":"2023-10-03T10:11:13.279766+0000","last_fullsized":"2023-10-03T10:11:13.279766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285634+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:11:13.285634+0000","last_peered":"2023-10-03T10:11:13.285634+0000","last_clean":"2023-10-03T10:11:13.285634+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:11:13.285634+0000","last_undegraded":"2023-10-03T10:11:13.285634+0000","last_fullsized":"2023-10-03T10:11:13.285634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":12,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.281776+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:11:13.281776+0000","last_peered":"2023-10-03T10:11:13.281776+0000","last_clean":"2023-10-03T10:11:13.281776+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:11:13.281776+0000","last_undegraded":"2023-10-03T10:11:13.281776+0000","last_fullsized":"2023-10-03T10:11:13.281776+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.286788+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:11:13.286788+0000","last_peered":"2023-10-03T10:11:13.286788+0000","last_clean":"2023-10-03T10:11:13.286788+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:11:13.286788+0000","last_undegraded":"2023-10-03T10:11:13.286788+0000","last_fullsized":"2023-10-03T10:11:13.286788+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":11,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276099+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:11:13.276099+0000","last_peered":"2023-10-03T10:11:13.276099+0000","last_clean":"2023-10-03T10:11:13.276099+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:11:13.276099+0000","last_undegraded":"2023-10-03T10:11:13.276099+0000","last_fullsized":"2023-10-03T10:11:13.276099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276468+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:11:13.276468+0000","last_peered":"2023-10-03T10:11:13.276468+0000","last_clean":"2023-10-03T10:11:13.276468+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:11:13.276468+0000","last_undegraded":"2023-10-03T10:11:13.276468+0000","last_fullsized":"2023-10-03T10:11:13.276468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":14,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.273955+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:11:13.273955+0000","last_peered":"2023-10-03T10:11:13.273955+0000","last_clean":"2023-10-03T10:11:13.273955+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:11:13.273955+0000","last_undegraded":"2023-10-03T10:11:13.273955+0000","last_fullsized":"2023-10-03T10:11:13.273955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.261244+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:11:13.261244+0000","last_peered":"2023-10-03T10:11:13.261244+0000","last_clean":"2023-10-03T10:11:13.261244+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:11:13.261244+0000","last_undegraded":"2023-10-03T10:11:13.261244+0000","last_fullsized":"2023-10-03T10:11:13.261244+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270642+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:11:13.270642+0000","last_peered":"2023-10-03T10:11:13.270642+0000","last_clean":"2023-10-03T10:11:13.270642+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:11:13.270642+0000","last_undegraded":"2023-10-03T10:11:13.270642+0000","last_fullsized":"2023-10-03T10:11:13.270642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.270710+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:11:13.270710+0000","last_peered":"2023-10-03T10:11:13.270710+0000","last_clean":"2023-10-03T10:11:13.270710+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:11:13.270710+0000","last_undegraded":"2023-10-03T10:11:13.270710+0000","last_fullsized":"2023-10-03T10:11:13.270710+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.285520+0000","last_change":"2023-10-03T10:11:13.278425+0000","last_active":"2023-10-03T10:11:13.285520+0000","last_peered":"2023-10-03T10:11:13.285520+0000","last_clean":"2023-10-03T10:11:13.285520+0000","last_became_active":"2023-10-03T10:11:13.278120+0000","last_became_peered":"2023-10-03T10:11:13.278120+0000","last_unstale":"2023-10-03T10:11:13.285520+0000","last_undegraded":"2023-10-03T10:11:13.285520+0000","last_fullsized":"2023-10-03T10:11:13.285520+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.276989+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:11:13.276989+0000","last_peered":"2023-10-03T10:11:13.276989+0000","last_clean":"2023-10-03T10:11:13.276989+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:11:13.276989+0000","last_undegraded":"2023-10-03T10:11:13.276989+0000","last_fullsized":"2023-10-03T10:11:13.276989+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-03T10:11:13.272506+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:11:13.272506+0000","last_peered":"2023-10-03T10:11:13.272506+0000","last_clean":"2023-10-03T10:11:13.272506+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:11:13.272506+0000","last_undegraded":"2023-10-03T10:11:13.272506+0000","last_fullsized":"2023-10-03T10:11:13.272506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297264,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074576,"statfs":{"total":96636764160,"available":96332365824,"internally_reserved":0,"allocated":172032,"data_stored":48929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":48735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297256,"kb_used_data":160,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074584,"statfs":{"total":96636764160,"available":96332374016,"internally_reserved":0,"allocated":163840,"data_stored":47899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297252,"kb_used_data":156,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074588,"statfs":{"total":96636764160,"available":96332378112,"internally_reserved":0,"allocated":159744,"data_stored":47845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:11:26.075 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:11:26.075 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:11:26.075 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:11:26.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:11:26.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.240+0000 7f55e1da4700 1 Processor -- start 2023-10-03T10:11:26.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 -- start start 2023-10-03T10:11:26.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 0x7f55dc125160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55dc125780 0x7f55dc125b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc096120 con 0x7f55dc125780 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc0956a0 con 0x7f55dc096bc0 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55e1da4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc126050 con 0x7f55dc093bf0 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55daffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55dc125780 0x7f55dc125b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55db7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 0x7f55dc125160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55daffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f55dc125780 0x7f55dc125b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44626/0 (socket says 172.21.15.19:44626) 2023-10-03T10:11:26.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54610/0 (socket says 172.21.15.19:54610) 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.241+0000 7f55daffd700 1 -- 172.21.15.19:0/780698749 learned_addr learned my addr 172.21.15.19:0/780698749 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 -- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 msgr2=0x7f55dc094080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 -- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 msgr2=0x7f55dc125160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 0x7f55dc125160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 -- 172.21.15.19:0/780698749 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc096fa0 con 0x7f55dc125780 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55db7fe700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 0x7f55dc125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55dbfff700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55daffd700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc125780 0x7f55dc125b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f55d0006fd0 tx=0x7f55d00090f0).ready entity=mon.0 client_cookie=94174746b83652f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55da7fc700 1 -- 172.21.15.19:0/780698749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d000f510 con 0x7f55dc125780 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55da7fc700 1 -- 172.21.15.19:0/780698749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d000f670 con 0x7f55dc125780 2023-10-03T10:11:26.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.242+0000 7f55da7fc700 1 -- 172.21.15.19:0/780698749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d000f9f0 con 0x7f55dc125780 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 -- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc125780 msgr2=0x7f55dc125b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc125780 0x7f55dc125b60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f55d0006fd0 tx=0x7f55d00090f0).stop 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 -- 172.21.15.19:0/780698749 shutdown_connections 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc096bc0 0x7f55dc125160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc094080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 --2- 172.21.15.19:0/780698749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc125780 0x7f55dc125b60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 -- 172.21.15.19:0/780698749 >> 172.21.15.19:0/780698749 conn(0x7f55dc097470 msgr2=0x7f55dc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 -- 172.21.15.19:0/780698749 shutdown_connections 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.243+0000 7f55e1da4700 1 -- 172.21.15.19:0/780698749 wait complete. 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 Processor -- start 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 -- start start 2023-10-03T10:11:26.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc096bc0 0x7f55dc1385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 0x7f55dc110fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc1146e0 con 0x7f55dc096bc0 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc12ce20 con 0x7f55dc125780 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.244+0000 7f55e1da4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc1137e0 con 0x7f55dc093bf0 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55daffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc096bc0 0x7f55dc1385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:54620/0 (socket says 172.21.15.19:54620) 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 -- 172.21.15.19:0/3441198433 learned_addr learned my addr 172.21.15.19:0/3441198433 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55dbfff700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 0x7f55dc110fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 -- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 msgr2=0x7f55dc110fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 0x7f55dc110fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 -- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc096bc0 msgr2=0x7f55dc1385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc096bc0 0x7f55dc1385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 -- 172.21.15.19:0/3441198433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009a20 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55dbfff700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 0x7f55dc110fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55db7fe700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f55cc00ea20 tx=0x7f55cc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00c850 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc00c9b0 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc0092a0 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc00cd30 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.245+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d0009370 con 0x7f55dc093bf0 2023-10-03T10:11:26.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.246+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f55cc012600 con 0x7f55dc093bf0 2023-10-03T10:11:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.246+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f55cc03b5b0 con 0x7f55dc093bf0 2023-10-03T10:11:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.246+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc09a3c0 con 0x7f55dc093bf0 2023-10-03T10:11:26.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.251+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f55cc01b400 con 0x7f55dc093bf0 2023-10-03T10:11:26.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.469+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55dc05a260 con 0x7f55dc093bf0 2023-10-03T10:11:26.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.469+0000 7f55c37fe700 1 -- 172.21.15.19:0/3441198433 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f55cc023350 con 0x7f55dc093bf0 2023-10-03T10:11:26.470 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:26.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 >> v1:172.21.15.19:6816/118286 conn(0x7f55c802bb60 legacy=0x7f55c802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 msgr2=0x7f55dc1380d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f55cc00ea20 tx=0x7f55cc009060).stop 2023-10-03T10:11:26.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 shutdown_connections 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f55dc125780 0x7f55dc110fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f55dc093bf0 0x7f55dc1380d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 --2- 172.21.15.19:0/3441198433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55dc096bc0 0x7f55dc1385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 >> 172.21.15.19:0/3441198433 conn(0x7f55dc097470 msgr2=0x7f55dc12bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 shutdown_connections 2023-10-03T10:11:26.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.471+0000 7f55e1da4700 1 -- 172.21.15.19:0/3441198433 wait complete. 2023-10-03T10:11:26.485 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:11:26.485 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:11:26.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:26.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.614+0000 7f45c4cfe700 1 Processor -- start 2023-10-03T10:11:26.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.614+0000 7f45c4cfe700 1 -- start start 2023-10-03T10:11:26.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45c4cfe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45c0123e70 0x7f45c0067ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45c4cfe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45c4cfe700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45c0068880 con 0x7f45c0123a90 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45c4cfe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45c0124250 con 0x7f45c0123e70 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45c4cfe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0068c90 con 0x7f45c0092340 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45bdd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45c0123e70 0x7f45c0067ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45be59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f45c0123a90 0x7f45c0126f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59666/0 (socket says 172.21.15.19:59666) 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46470/0 (socket says 172.21.15.19:46470) 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.615+0000 7f45be59c700 1 -- 172.21.15.19:0/1628045232 learned_addr learned my addr 172.21.15.19:0/1628045232 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:26.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bdd9b700 1 -- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 msgr2=0x7f45c0127680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bdd9b700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bdd9b700 1 -- 172.21.15.19:0/1628045232 >> v1:172.21.15.19:6789/0 conn(0x7f45c0123a90 legacy=0x7f45c0126f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bdd9b700 1 -- 172.21.15.19:0/1628045232 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c0124430 con 0x7f45c0123e70 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bd59a700 1 -- 172.21.15.19:0/1628045232 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233546164 0 0) 0x7f45c0068880 con 0x7f45c0123a90 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bed9d700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bdd9b700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123e70 0x7f45c0067ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f45b4009760 tx=0x7f45b4009060).ready entity=mon.0 client_cookie=1286e540624e9acd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bd59a700 1 -- 172.21.15.19:0/1628045232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400f510 con 0x7f45c0123e70 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bd59a700 1 -- 172.21.15.19:0/1628045232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400f670 con 0x7f45c0123e70 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45bd59a700 1 -- 172.21.15.19:0/1628045232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400f9f0 con 0x7f45c0123e70 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45c4cfe700 1 -- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123e70 msgr2=0x7f45c0067ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123e70 0x7f45c0067ce0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f45b4009760 tx=0x7f45b4009060).stop 2023-10-03T10:11:26.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.616+0000 7f45c4cfe700 1 -- 172.21.15.19:0/1628045232 shutdown_connections 2023-10-03T10:11:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0092340 0x7f45c0127680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/1628045232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123e70 0x7f45c0067ce0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 -- 172.21.15.19:0/1628045232 >> 172.21.15.19:0/1628045232 conn(0x7f45c009a220 msgr2=0x7f45c009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 -- 172.21.15.19:0/1628045232 shutdown_connections 2023-10-03T10:11:26.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 -- 172.21.15.19:0/1628045232 wait complete. 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 Processor -- start 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.617+0000 7f45c4cfe700 1 -- start start 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45c0092340 0x7f45c0115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 0x7f45c0116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c0117130 con 0x7f45c0123a90 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45c011a390 con 0x7f45c0123e70 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45c4cfe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45c01182a0 con 0x7f45c0092340 2023-10-03T10:11:26.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bdd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 0x7f45c0116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46476/0 (socket says 172.21.15.19:46476) 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 -- 172.21.15.19:0/3306729008 learned_addr learned my addr 172.21.15.19:0/3306729008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bdd9b700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 0x7f45c0116160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35638/0 (socket says 172.21.15.19:35638) 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45be59c700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45c0092340 0x7f45c0115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 -- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45c0092340 msgr2=0x7f45c0115c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45c0092340 0x7f45c0115c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 -- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 msgr2=0x7f45c0116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 0x7f45c0116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.618+0000 7f45bed9d700 1 -- 172.21.15.19:0/3306729008 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b8009a20 con 0x7f45c0123e70 2023-10-03T10:11:26.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45bed9d700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f45b8009f20 tx=0x7f45b800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b800cb70 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b800f040 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b40092a0 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b8013400 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.619+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c0119170 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.620+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f45b80137f0 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.620+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f45b803b890 con 0x7f45c0123e70 2023-10-03T10:11:26.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.620+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c005a260 con 0x7f45c0123e70 2023-10-03T10:11:26.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.625+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f45b8013aa0 con 0x7f45c0123e70 2023-10-03T10:11:26.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.803+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45c0046c20 con 0x7f45c0123e70 2023-10-03T10:11:26.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.804+0000 7f45ae7fc700 1 -- 172.21.15.19:0/3306729008 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f45b802c090 con 0x7f45c0123e70 2023-10-03T10:11:26.805 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:26.805 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 >> v1:172.21.15.19:6816/118286 conn(0x7f45a002bb60 legacy=0x7f45a002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 msgr2=0x7f45c0116650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f45b8009f20 tx=0x7f45b800b040).stop 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 shutdown_connections 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45c0123e70 0x7f45c0116650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45c0092340 0x7f45c0115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 --2- 172.21.15.19:0/3306729008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c0123a90 0x7f45c0116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 >> 172.21.15.19:0/3306729008 conn(0x7f45c009a220 msgr2=0x7f45c0065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 shutdown_connections 2023-10-03T10:11:26.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.806+0000 7f45c4cfe700 1 -- 172.21.15.19:0/3306729008 wait complete. 2023-10-03T10:11:26.820 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:11:26.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:11:26.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 Processor -- start 2023-10-03T10:11:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 -- start start 2023-10-03T10:11:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 0x7fb2b0125250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b012ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b0098790 con 0x7fb2b0059070 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0059450 con 0x7fb2b0125f00 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.953+0000 7fb2b4bc2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0059da0 con 0x7fb2b012db40 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ae59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2b0059070 0x7fb2b01257f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59674/0 (socket says 172.21.15.19:59674) 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2aed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b012ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ae59c700 1 -- 172.21.15.19:0/1689921146 learned_addr learned my addr 172.21.15.19:0/1689921146 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:26.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 0x7fb2b0125250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ad59a700 1 -- 172.21.15.19:0/1689921146 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509401247 0 0) 0x7fb2b0098790 con 0x7fb2b0059070 2023-10-03T10:11:26.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ad59a700 1 -- 172.21.15.19:0/1689921146 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2980033f0 con 0x7fb2b0059070 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 -- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 msgr2=0x7fb2b012ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b012ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 -- 172.21.15.19:0/1689921146 >> v1:172.21.15.19:6789/0 conn(0x7fb2b0059070 legacy=0x7fb2b01257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 -- 172.21.15.19:0/1689921146 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b00996f0 con 0x7fb2b0125f00 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2aed9d700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b012ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2add9b700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 0x7fb2b0125250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb2a4009790 tx=0x7fb2a4009060).ready entity=mon.1 client_cookie=62ec3663f81e929f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ad59a700 1 -- 172.21.15.19:0/1689921146 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a40090d0 con 0x7fb2b0125f00 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ad59a700 1 -- 172.21.15.19:0/1689921146 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400f510 con 0x7fb2b0125f00 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.954+0000 7fb2ad59a700 1 -- 172.21.15.19:0/1689921146 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400f890 con 0x7fb2b0125f00 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 msgr2=0x7fb2b0125250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 0x7fb2b0125250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb2a4009790 tx=0x7fb2a4009060).stop 2023-10-03T10:11:26.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/1689921146 shutdown_connections 2023-10-03T10:11:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b012ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/1689921146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0125f00 0x7fb2b0125250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/1689921146 >> 172.21.15.19:0/1689921146 conn(0x7fb2b0097480 msgr2=0x7fb2b0097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/1689921146 shutdown_connections 2023-10-03T10:11:26.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.955+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/1689921146 wait complete. 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 Processor -- start 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 -- start start 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b00664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0067f00 con 0x7fb2b0125f00 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b006a310 con 0x7fb2b0059070 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.956+0000 7fb2b4bc2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b0064e50 con 0x7fb2b012db40 2023-10-03T10:11:26.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2ae59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2aed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b00664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35640/0 (socket says 172.21.15.19:35640) 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 -- 172.21.15.19:0/2581755654 learned_addr learned my addr 172.21.15.19:0/2581755654 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2ae59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46500/0 (socket says 172.21.15.19:46500) 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 -- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 msgr2=0x7fb2b00664e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b00664e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 -- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 msgr2=0x7fb2b01224a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 -- 172.21.15.19:0/2581755654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a8009a20 con 0x7fb2b0125f00 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2ae59c700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2add9b700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb2b0098920 tx=0x7fb2a4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:26.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4006910 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a4011960 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40092a0 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4011d20 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.957+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b0069870 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.958+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fb2a401b620 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.958+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fb2a403c640 con 0x7fb2b0125f00 2023-10-03T10:11:26.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.958+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b0128450 con 0x7fb2b0125f00 2023-10-03T10:11:26.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:26.963+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fb2a402b940 con 0x7fb2b0125f00 2023-10-03T10:11:27.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.137+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2b005a260 con 0x7fb2b0125f00 2023-10-03T10:11:27.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.137+0000 7fb29e7fc700 1 -- 172.21.15.19:0/2581755654 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2a402b350 con 0x7fb2b0125f00 2023-10-03T10:11:27.138 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 >> v1:172.21.15.19:6816/118286 conn(0x7fb29002bb60 legacy=0x7fb29002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 msgr2=0x7fb2b0122990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fb2b0098920 tx=0x7fb2a4017000).stop 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 shutdown_connections 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2b012db40 0x7fb2b00664e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2b0059070 0x7fb2b01224a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 --2- 172.21.15.19:0/2581755654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2b0125f00 0x7fb2b0122990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 >> 172.21.15.19:0/2581755654 conn(0x7fb2b0097480 msgr2=0x7fb2b01249a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 shutdown_connections 2023-10-03T10:11:27.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.139+0000 7fb2b4bc2700 1 -- 172.21.15.19:0/2581755654 wait complete. 2023-10-03T10:11:27.153 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:27.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.284+0000 7ff8668c0700 1 Processor -- start 2023-10-03T10:11:27.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.284+0000 7ff8668c0700 1 -- start start 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff8668c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff8668c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff8668c0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860092d80 con 0x7ff860093840 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff8668c0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860093c20 con 0x7ff86012d160 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff8668c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff860092b90 con 0x7ff860098ea0 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff85f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff864e5d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff85ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff860093840 0x7ff860098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59690/0 (socket says 172.21.15.19:59690) 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff85ffff700 1 -- 172.21.15.19:0/3315202269 learned_addr learned my addr 172.21.15.19:0/3315202269 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.285+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/3315202269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46502/0 (socket says 172.21.15.19:46502) 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85f7fe700 1 -- 172.21.15.19:0/3315202269 >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 msgr2=0x7ff86012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/3315202269 >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85f7fe700 1 -- 172.21.15.19:0/3315202269 >> v1:172.21.15.19:6789/0 conn(0x7ff860093840 legacy=0x7ff860098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85effd700 1 -- 172.21.15.19:0/3315202269 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313499150 0 0) 0x7ff860092d80 con 0x7ff860093840 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85f7fe700 1 -- 172.21.15.19:0/3315202269 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860099b70 con 0x7ff860098ea0 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff864e5d700 1 --2- 172.21.15.19:0/3315202269 >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/3315202269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff854009760 tx=0x7ff854009060).ready entity=mon.1 client_cookie=812009633812af9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85effd700 1 -- 172.21.15.19:0/3315202269 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400f510 con 0x7ff860098ea0 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85effd700 1 -- 172.21.15.19:0/3315202269 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85400f670 con 0x7ff860098ea0 2023-10-03T10:11:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff85effd700 1 -- 172.21.15.19:0/3315202269 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400f9f0 con 0x7ff860098ea0 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff8668c0700 1 -- 172.21.15.19:0/3315202269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 msgr2=0x7ff860099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.286+0000 7ff8668c0700 1 --2- 172.21.15.19:0/3315202269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff854009760 tx=0x7ff854009060).stop 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 -- 172.21.15.19:0/3315202269 shutdown_connections 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 --2- 172.21.15.19:0/3315202269 >> v2:172.21.15.19:3300/0 conn(0x7ff86012d160 0x7ff86012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 --2- 172.21.15.19:0/3315202269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff860099280 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 -- 172.21.15.19:0/3315202269 >> 172.21.15.19:0/3315202269 conn(0x7ff860097480 msgr2=0x7ff860097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 -- 172.21.15.19:0/3315202269 shutdown_connections 2023-10-03T10:11:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 -- 172.21.15.19:0/3315202269 wait complete. 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.287+0000 7ff8668c0700 1 Processor -- start 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 -- start start 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 0x7ff8601193d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff8601198c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86011a2a0 con 0x7ff86012d160 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86011af60 con 0x7ff860098ea0 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff8668c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff86011c8d0 con 0x7ff860093840 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff864e5d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 0x7ff8601193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff864e5d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35654/0 (socket says 172.21.15.19:35654) 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff85ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 0x7ff8601193d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57440/0 (socket says 172.21.15.19:57440) 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff864e5d700 1 -- 172.21.15.19:0/2738837042 learned_addr learned my addr 172.21.15.19:0/2738837042 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:27.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.288+0000 7ff85f7fe700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff8601198c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 -- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 msgr2=0x7ff8601193d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 0x7ff8601193d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 -- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 msgr2=0x7ff8601198c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff8601198c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 -- 172.21.15.19:0/2738837042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858009a20 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff864e5d700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff85800ef90 tx=0x7ff85800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85800cbd0 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85800f040 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8540092a0 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858013400 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.289+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86006a520 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.290+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff858013830 con 0x7ff86012d160 2023-10-03T10:11:27.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.290+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff85803b8e0 con 0x7ff86012d160 2023-10-03T10:11:27.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.290+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86005a260 con 0x7ff86012d160 2023-10-03T10:11:27.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.295+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff858007bc0 con 0x7ff86012d160 2023-10-03T10:11:27.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.470+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff860046c20 con 0x7ff86012d160 2023-10-03T10:11:27.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.470+0000 7ff847fff700 1 -- 172.21.15.19:0/2738837042 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff85802c0a0 con 0x7ff86012d160 2023-10-03T10:11:27.471 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 >> v1:172.21.15.19:6816/118286 conn(0x7ff84c02bb30 legacy=0x7ff84c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 msgr2=0x7ff860119db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7ff85800ef90 tx=0x7ff85800b040).stop 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 shutdown_connections 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff86012d160 0x7ff860119db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff860093840 0x7ff8601193d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 --2- 172.21.15.19:0/2738837042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff860098ea0 0x7ff8601198c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 >> 172.21.15.19:0/2738837042 conn(0x7ff860097480 msgr2=0x7ff860068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 shutdown_connections 2023-10-03T10:11:27.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.472+0000 7ff8668c0700 1 -- 172.21.15.19:0/2738837042 wait complete. 2023-10-03T10:11:27.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:27.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.619+0000 7f7ace12f700 1 Processor -- start 2023-10-03T10:11:27.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.619+0000 7f7ace12f700 1 -- start start 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ace12f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 0x7f7ac80992b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ace12f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 0x7f7ac812f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ace12f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac8092d80 con 0x7f7ac8093840 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ace12f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8093c20 con 0x7f7ac8098ea0 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ace12f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8092b90 con 0x7f7ac812d160 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ac77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7ac8093840 0x7f7ac8098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59696/0 (socket says 172.21.15.19:59696) 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ac77fe700 1 -- 172.21.15.19:0/2854362143 learned_addr learned my addr 172.21.15.19:0/2854362143 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:27.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2854362143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 0x7f7ac812f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ac6ffd700 1 --2- 172.21.15.19:0/2854362143 >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 0x7f7ac80992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.620+0000 7f7ac67fc700 1 -- 172.21.15.19:0/2854362143 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604669798 0 0) 0x7f7ac8092d80 con 0x7f7ac8093840 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac67fc700 1 -- 172.21.15.19:0/2854362143 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab40033f0 con 0x7f7ac8093840 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2854362143 >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 msgr2=0x7f7ac80992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2854362143 >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 0x7f7ac80992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2854362143 >> v1:172.21.15.19:6789/0 conn(0x7f7ac8093840 legacy=0x7f7ac8098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2854362143 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8099b70 con 0x7f7ac812d160 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac6ffd700 1 --2- 172.21.15.19:0/2854362143 >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 0x7f7ac80992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2854362143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 0x7f7ac812f550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7ac0009e60 tx=0x7f7ac0009780).ready entity=mon.2 client_cookie=8be14cd4b9734e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac67fc700 1 -- 172.21.15.19:0/2854362143 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000e070 con 0x7f7ac812d160 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac67fc700 1 -- 172.21.15.19:0/2854362143 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000bab0 con 0x7f7ac812d160 2023-10-03T10:11:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ac67fc700 1 -- 172.21.15.19:0/2854362143 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000be30 con 0x7f7ac812d160 2023-10-03T10:11:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ace12f700 1 -- 172.21.15.19:0/2854362143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 msgr2=0x7f7ac812f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2854362143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 0x7f7ac812f550 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7ac0009e60 tx=0x7f7ac0009780).stop 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.621+0000 7f7ace12f700 1 -- 172.21.15.19:0/2854362143 shutdown_connections 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.622+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2854362143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac812d160 0x7f7ac812f550 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.622+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2854362143 >> v2:172.21.15.19:3300/0 conn(0x7f7ac8098ea0 0x7f7ac80992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.622+0000 7f7ace12f700 1 -- 172.21.15.19:0/2854362143 >> 172.21.15.19:0/2854362143 conn(0x7f7ac8097480 msgr2=0x7f7ac8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.622+0000 7f7ace12f700 1 -- 172.21.15.19:0/2854362143 shutdown_connections 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.622+0000 7f7ace12f700 1 -- 172.21.15.19:0/2854362143 wait complete. 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 Processor -- start 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 -- start start 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 0x7f7ac8119e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac811d360 con 0x7f7ac812d160 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac811cfc0 con 0x7f7ac8093840 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ace12f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8095f90 con 0x7f7ac8098ea0 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35668/0 (socket says 172.21.15.19:35668) 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2982297897 learned_addr learned my addr 172.21.15.19:0/2982297897 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46528/0 (socket says 172.21.15.19:46528) 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.623+0000 7f7ac6ffd700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 0x7f7ac8119e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 msgr2=0x7f7ac8119e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 0x7f7ac8119e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 msgr2=0x7f7ac811de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 -- 172.21.15.19:0/2982297897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80092a0 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac77fe700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac6ffd700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 0x7f7ac8119e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ac7fff700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f7ac8093740 tx=0x7f7ac0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac001d630 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac001d790 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac0009a20 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac001db50 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.624+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac811b9f0 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.625+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f7ac0003040 con 0x7f7ac812d160 2023-10-03T10:11:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.625+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f7ac003cd10 con 0x7f7ac812d160 2023-10-03T10:11:27.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.625+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac805a260 con 0x7f7ac812d160 2023-10-03T10:11:27.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.630+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f7ac0024310 con 0x7f7ac812d160 2023-10-03T10:11:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.803+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ac8046c20 con 0x7f7ac812d160 2023-10-03T10:11:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.804+0000 7f7abf7fe700 1 -- 172.21.15.19:0/2982297897 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ac001bb00 con 0x7f7ac812d160 2023-10-03T10:11:27.805 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:11:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 >> v1:172.21.15.19:6816/118286 conn(0x7f7aa802bb60 legacy=0x7f7aa802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 msgr2=0x7f7ac811a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f7ac8093740 tx=0x7f7ac0009780).stop 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 shutdown_connections 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac812d160 0x7f7ac811a350 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac8093840 0x7f7ac811de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 --2- 172.21.15.19:0/2982297897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac8098ea0 0x7f7ac8119e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 >> 172.21.15.19:0/2982297897 conn(0x7f7ac8097480 msgr2=0x7f7ac8099280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 shutdown_connections 2023-10-03T10:11:27.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.806+0000 7f7ace12f700 1 -- 172.21.15.19:0/2982297897 wait complete. 2023-10-03T10:11:27.820 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:27.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.951+0000 7ff5d659d700 1 Processor -- start 2023-10-03T10:11:27.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.951+0000 7ff5d659d700 1 -- start start 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d659d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d0099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d659d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 0x7ff5d012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d659d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d0092d80 con 0x7ff5d0093840 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d659d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d0093c20 con 0x7ff5d012d160 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d659d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0092b90 con 0x7ff5d0098ea0 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5d4b3a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 0x7ff5d012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d0099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5d0093840 0x7ff5d0098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59706/0 (socket says 172.21.15.19:59706) 2023-10-03T10:11:27.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cffff700 1 -- 172.21.15.19:0/626847788 learned_addr learned my addr 172.21.15.19:0/626847788 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5ceffd700 1 -- 172.21.15.19:0/626847788 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369552524 0 0) 0x7ff5d0092d80 con 0x7ff5d0093840 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/626847788 >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 msgr2=0x7ff5d012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cf7fe700 1 --2- 172.21.15.19:0/626847788 >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 0x7ff5d012f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.952+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/626847788 >> v1:172.21.15.19:6789/0 conn(0x7ff5d0093840 legacy=0x7ff5d0098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/626847788 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0099b70 con 0x7ff5d0098ea0 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d4b3a700 1 --2- 172.21.15.19:0/626847788 >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 0x7ff5d012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5cf7fe700 1 --2- 172.21.15.19:0/626847788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d0099280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff5c4009760 tx=0x7ff5c4009060).ready entity=mon.1 client_cookie=1f368d1e6ffbc7fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5ceffd700 1 -- 172.21.15.19:0/626847788 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400f510 con 0x7ff5d0098ea0 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5ceffd700 1 -- 172.21.15.19:0/626847788 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c400f670 con 0x7ff5d0098ea0 2023-10-03T10:11:27.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5ceffd700 1 -- 172.21.15.19:0/626847788 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c400f9f0 con 0x7ff5d0098ea0 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 -- 172.21.15.19:0/626847788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 msgr2=0x7ff5d0099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 --2- 172.21.15.19:0/626847788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d0099280 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff5c4009760 tx=0x7ff5c4009060).stop 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 -- 172.21.15.19:0/626847788 shutdown_connections 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 --2- 172.21.15.19:0/626847788 >> v2:172.21.15.19:3300/0 conn(0x7ff5d012d160 0x7ff5d012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 --2- 172.21.15.19:0/626847788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d0099280 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.953+0000 7ff5d659d700 1 -- 172.21.15.19:0/626847788 >> 172.21.15.19:0/626847788 conn(0x7ff5d0097480 msgr2=0x7ff5d0097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.954+0000 7ff5d659d700 1 -- 172.21.15.19:0/626847788 shutdown_connections 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.954+0000 7ff5d659d700 1 -- 172.21.15.19:0/626847788 wait complete. 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.954+0000 7ff5d659d700 1 Processor -- start 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 -- start start 2023-10-03T10:11:27.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d012d160 0x7ff5d013ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d012d5e0 con 0x7ff5d0093840 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d011c890 con 0x7ff5d0098ea0 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d659d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d006a520 con 0x7ff5d012d160 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5cf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5cf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46546/0 (socket says 172.21.15.19:46546) 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35688/0 (socket says 172.21.15.19:35688) 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5d4b3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d012d160 0x7ff5d013ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.955+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3285105870 learned_addr learned my addr 172.21.15.19:0/3285105870 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 -- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d012d160 msgr2=0x7ff5d013ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d012d160 0x7ff5d013ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 -- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 msgr2=0x7ff5d013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 -- 172.21.15.19:0/3285105870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8009a20 con 0x7ff5d0093840 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cf7fe700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff5c0000c00 tx=0x7ff5c0007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000ce20 con 0x7ff5d0093840 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c00072e0 con 0x7ff5d0093840 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c40092a0 con 0x7ff5d0093840 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00057a0 con 0x7ff5d0093840 2023-10-03T10:11:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.956+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d00680a0 con 0x7ff5d0093840 2023-10-03T10:11:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.957+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d005a260 con 0x7ff5d0093840 2023-10-03T10:11:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.957+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff5c0005b90 con 0x7ff5d0093840 2023-10-03T10:11:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.958+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff5c003acf0 con 0x7ff5d0093840 2023-10-03T10:11:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:27.962+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff5c0005e40 con 0x7ff5d0093840 2023-10-03T10:11:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.135+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5d0069ab0 con 0x7ff5d0093840 2023-10-03T10:11:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.136+0000 7ff5b7fff700 1 -- 172.21.15.19:0/3285105870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5c0011350 con 0x7ff5d0093840 2023-10-03T10:11:28.137 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:11:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 >> v1:172.21.15.19:6816/118286 conn(0x7ff5bc02bb30 legacy=0x7ff5bc02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 msgr2=0x7ff5d011e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff5c0000c00 tx=0x7ff5c0007b90).stop 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 shutdown_connections 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d012d160 0x7ff5d013ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0093840 0x7ff5d011e200 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 --2- 172.21.15.19:0/3285105870 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d0098ea0 0x7ff5d013a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 >> 172.21.15.19:0/3285105870 conn(0x7ff5d0097480 msgr2=0x7ff5d0068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.137+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 shutdown_connections 2023-10-03T10:11:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.138+0000 7ff5d659d700 1 -- 172.21.15.19:0/3285105870 wait complete. 2023-10-03T10:11:28.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 Processor -- start 2023-10-03T10:11:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 -- start start 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 0x7fa7bc132ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc065ed0 con 0x7fa7bc098b30 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc095880 con 0x7fa7bc098f70 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7c2746700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc096120 con 0x7fa7bc0654a0 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.280+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7c0ce3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 0x7fa7bc132ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57470/0 (socket says 172.21.15.19:57470) 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 -- 172.21.15.19:0/3995296116 learned_addr learned my addr 172.21.15.19:0/3995296116 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bb7fe700 1 --1- 172.21.15.19:0/3995296116 >> v1:172.21.15.19:6789/0 conn(0x7fa7bc098b30 0x7fa7bc12f470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59722/0 (socket says 172.21.15.19:59722) 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 -- 172.21.15.19:0/3995296116 >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 msgr2=0x7fa7bc132ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 --2- 172.21.15.19:0/3995296116 >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 0x7fa7bc132ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 -- 172.21.15.19:0/3995296116 >> v1:172.21.15.19:6789/0 conn(0x7fa7bc098b30 legacy=0x7fa7bc12f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 -- 172.21.15.19:0/3995296116 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc066280 con 0x7fa7bc0654a0 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7baffd700 1 -- 172.21.15.19:0/3995296116 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356894869 0 0) 0x7fa7bc065ed0 con 0x7fa7bc098b30 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7c0ce3700 1 --2- 172.21.15.19:0/3995296116 >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 0x7fa7bc132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7bbfff700 1 --2- 172.21.15.19:0/3995296116 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7ac006fd0 tx=0x7fa7ac0090f0).ready entity=mon.2 client_cookie=66e0dd18ce25245a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7baffd700 1 -- 172.21.15.19:0/3995296116 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00b580 con 0x7fa7bc0654a0 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7baffd700 1 -- 172.21.15.19:0/3995296116 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00b6e0 con 0x7fa7bc0654a0 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.281+0000 7fa7baffd700 1 -- 172.21.15.19:0/3995296116 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac00ba60 con 0x7fa7bc0654a0 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 -- 172.21.15.19:0/3995296116 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 msgr2=0x7fa7bc098640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 --2- 172.21.15.19:0/3995296116 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa7ac006fd0 tx=0x7fa7ac0090f0).stop 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 -- 172.21.15.19:0/3995296116 shutdown_connections 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 --2- 172.21.15.19:0/3995296116 >> v2:172.21.15.19:3300/0 conn(0x7fa7bc098f70 0x7fa7bc132ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 --2- 172.21.15.19:0/3995296116 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc0654a0 0x7fa7bc098640 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 -- 172.21.15.19:0/3995296116 >> 172.21.15.19:0/3995296116 conn(0x7fa7bc09a740 msgr2=0x7fa7bc09ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 -- 172.21.15.19:0/3995296116 shutdown_connections 2023-10-03T10:11:28.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.282+0000 7fa7c2746700 1 -- 172.21.15.19:0/3995296116 wait complete. 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 Processor -- start 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 -- start start 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7bc0654a0 0x7fa7bc11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 0x7fa7bc11a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 0x7fa7bc11a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc11eb50 con 0x7fa7bc098f70 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc11ca60 con 0x7fa7bc0654a0 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.283+0000 7fa7c2746700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc099b00 con 0x7fa7bc098b30 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 0x7fa7bc11a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 0x7fa7bc11a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7bb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 0x7fa7bc11a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57478/0 (socket says 172.21.15.19:57478) 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7bb7fe700 1 -- 172.21.15.19:0/942083102 learned_addr learned my addr 172.21.15.19:0/942083102 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7bbfff700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7bc0654a0 0x7fa7bc11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 -- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 msgr2=0x7fa7bc11a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 0x7fa7bc11a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 -- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7bc0654a0 msgr2=0x7fa7bc11e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7bc0654a0 0x7fa7bc11e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 -- 172.21.15.19:0/942083102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4009a20 con 0x7fa7bc098f70 2023-10-03T10:11:28.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c0ce3700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 0x7fa7bc11a920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa7b4009f10 tx=0x7fa7b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400cb70 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400f040 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ac009370 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4013400 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.284+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc11bfc0 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.285+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fa7b40137f0 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.285+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fa7b403b7f0 con 0x7fa7bc098f70 2023-10-03T10:11:28.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.285+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc05a260 con 0x7fa7bc098f70 2023-10-03T10:11:28.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.290+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fa7b401bbd0 con 0x7fa7bc098f70 2023-10-03T10:11:28.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.509+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7bc11b230 con 0x7fa7bc098f70 2023-10-03T10:11:28.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.509+0000 7fa7a3fff700 1 -- 172.21.15.19:0/942083102 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fa7b401b7e0 con 0x7fa7bc098f70 2023-10-03T10:11:28.510 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:28.511 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:16.244692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:28.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 >> v1:172.21.15.19:6816/118286 conn(0x7fa7a802bb90 legacy=0x7fa7a802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 msgr2=0x7fa7bc11a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 0x7fa7bc11a920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa7b4009f10 tx=0x7fa7b400b040).stop 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 shutdown_connections 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7bc098f70 0x7fa7bc11a920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7bc0654a0 0x7fa7bc11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 --2- 172.21.15.19:0/942083102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7bc098b30 0x7fa7bc11a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 >> 172.21.15.19:0/942083102 conn(0x7fa7bc09a740 msgr2=0x7fa7bc09bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 shutdown_connections 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.511+0000 7fa7c2746700 1 -- 172.21.15.19:0/942083102 wait complete. 2023-10-03T10:11:28.513 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-10-03T10:11:28.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:28.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.654+0000 7f69248f9700 1 Processor -- start 2023-10-03T10:11:28.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 -- start start 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6920094c20 0x7f6920127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6920096760 con 0x7f6920094c20 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6920091ff0 con 0x7f6920091b00 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f69248f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6920092c80 con 0x7f6920096380 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f691e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f691ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6920094c20 0x7f6920127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.655+0000 7f691dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6920094c20 0x7f6920127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35720/0 (socket says 172.21.15.19:35720) 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 -- 172.21.15.19:0/936723450 learned_addr learned my addr 172.21.15.19:0/936723450 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57486/0 (socket says 172.21.15.19:57486) 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46564/0 (socket says 172.21.15.19:46564) 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 -- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 msgr2=0x7f6920094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 -- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 msgr2=0x7f6920127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 -- 172.21.15.19:0/936723450 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920093900 con 0x7f6920094c20 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691dd9b700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691e59c700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691ed9d700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920094c20 0x7f6920127af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6918009f20 tx=0x7f6918009840).ready entity=mon.0 client_cookie=bbd68e2a96c7e74c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691d59a700 1 -- 172.21.15.19:0/936723450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800e070 con 0x7f6920094c20 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691d59a700 1 -- 172.21.15.19:0/936723450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691800b970 con 0x7f6920094c20 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.656+0000 7f691d59a700 1 -- 172.21.15.19:0/936723450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800bcf0 con 0x7f6920094c20 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 -- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920094c20 msgr2=0x7f6920127af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920094c20 0x7f6920127af0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f6918009f20 tx=0x7f6918009840).stop 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 -- 172.21.15.19:0/936723450 shutdown_connections 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920094c20 0x7f6920127af0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920096380 0x7f6920094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 --2- 172.21.15.19:0/936723450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920091b00 0x7f6920127600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 -- 172.21.15.19:0/936723450 >> 172.21.15.19:0/936723450 conn(0x7f6920097470 msgr2=0x7f6920097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 -- 172.21.15.19:0/936723450 shutdown_connections 2023-10-03T10:11:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.657+0000 7f69248f9700 1 -- 172.21.15.19:0/936723450 wait complete. 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 Processor -- start 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 -- start start 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 0x7f69201174f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 0x7f69201179e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920117ed0 con 0x7f6920091b00 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692011a590 con 0x7f6920096380 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.658+0000 7f69248f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6920118c20 con 0x7f6920094c20 2023-10-03T10:11:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35724/0 (socket says 172.21.15.19:35724) 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 -- 172.21.15.19:0/3626756031 learned_addr learned my addr 172.21.15.19:0/3626756031 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691ed9d700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 0x7f69201179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691dd9b700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 0x7f69201174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 -- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 msgr2=0x7f69201174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 0x7f69201174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 -- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 msgr2=0x7f69201179e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 0x7f69201179e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 -- 172.21.15.19:0/3626756031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69140092a0 con 0x7f6920091b00 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691ed9d700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 0x7f69201179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691dd9b700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 0x7f69201174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f691e59c700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f691000ede0 tx=0x7f691000b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000dac0 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000dc20 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691000b540 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910010440 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.659+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6918009ae0 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.660+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f69100107f0 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.660+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f691003b920 con 0x7f6920091b00 2023-10-03T10:11:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.660+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692006a580 con 0x7f6920091b00 2023-10-03T10:11:28.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.665+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f69100176f0 con 0x7f6920091b00 2023-10-03T10:11:28.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.841+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f692005a260 con 0x7f6920091b00 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.842+0000 7f690e7fc700 1 -- 172.21.15.19:0/3626756031 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7f6910028090 con 0x7f6920091b00 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:28.843 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:28.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 >> v1:172.21.15.19:6816/118286 conn(0x7f690002bb60 legacy=0x7f690002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 msgr2=0x7f6920117000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f691000ede0 tx=0x7f691000b300).stop 2023-10-03T10:11:28.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 shutdown_connections 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6920096380 0x7f69201179e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6920091b00 0x7f6920117000 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 --2- 172.21.15.19:0/3626756031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6920094c20 0x7f69201174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 >> 172.21.15.19:0/3626756031 conn(0x7f6920097470 msgr2=0x7f6920127110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 shutdown_connections 2023-10-03T10:11:28.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.844+0000 7f69248f9700 1 -- 172.21.15.19:0/3626756031 wait complete. 2023-10-03T10:11:28.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:11:28.859 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:11:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.990+0000 7fd8af0ed700 1 Processor -- start 2023-10-03T10:11:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 -- start start 2023-10-03T10:11:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 0x7fd8a8127980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80664f0 con 0x7fd8a8066110 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8065d80 con 0x7fd8a812add0 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.991+0000 7fd8af0ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8065c20 con 0x7fd8a81274d0 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8ace89700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8ad68a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 0x7fd8a8127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46594/0 (socket says 172.21.15.19:46594) 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8ace89700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35726/0 (socket says 172.21.15.19:35726) 2023-10-03T10:11:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 -- 172.21.15.19:0/310128220 learned_addr learned my addr 172.21.15.19:0/310128220 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 -- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 msgr2=0x7fd8a8127980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 0x7fd8a8127980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 -- 172.21.15.19:0/310128220 >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 msgr2=0x7fd8a8097420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 --2- 172.21.15.19:0/310128220 >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 -- 172.21.15.19:0/310128220 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a8064e80 con 0x7fd8a812add0 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8ad68a700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 0x7fd8a8127980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8ace89700 1 --2- 172.21.15.19:0/310128220 >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a7fff700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd890006fd0 tx=0x7fd8900090f0).ready entity=mon.1 client_cookie=bfd6e0b3691ba05b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a77fe700 1 -- 172.21.15.19:0/310128220 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000f510 con 0x7fd8a812add0 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a77fe700 1 -- 172.21.15.19:0/310128220 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89000f670 con 0x7fd8a812add0 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.992+0000 7fd8a77fe700 1 -- 172.21.15.19:0/310128220 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89000fa10 con 0x7fd8a812add0 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 -- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 msgr2=0x7fd8a812b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fd890006fd0 tx=0x7fd8900090f0).stop 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 -- 172.21.15.19:0/310128220 shutdown_connections 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a81274d0 0x7fd8a8127980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/310128220 >> v2:172.21.15.19:3300/0 conn(0x7fd8a8066110 0x7fd8a8097420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/310128220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a812add0 0x7fd8a812b2a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 -- 172.21.15.19:0/310128220 >> 172.21.15.19:0/310128220 conn(0x7fd8a809ba60 msgr2=0x7fd8a809be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 -- 172.21.15.19:0/310128220 shutdown_connections 2023-10-03T10:11:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.993+0000 7fd8af0ed700 1 -- 172.21.15.19:0/310128220 wait complete. 2023-10-03T10:11:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.994+0000 7fd8af0ed700 1 Processor -- start 2023-10-03T10:11:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.994+0000 7fd8af0ed700 1 -- start start 2023-10-03T10:11:28.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a81274d0 0x7fd8a8113e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 0x7fd8a8114330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81173d0 con 0x7fd8a8066110 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a809b3d0 con 0x7fd8a81274d0 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8065030 con 0x7fd8a812add0 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35742/0 (socket says 172.21.15.19:35742) 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 -- 172.21.15.19:0/1706013084 learned_addr learned my addr 172.21.15.19:0/1706013084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ad68a700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 0x7fd8a8114330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8a7fff700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a81274d0 0x7fd8a8113e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:28.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 -- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 msgr2=0x7fd8a8114330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 0x7fd8a8114330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 -- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a81274d0 msgr2=0x7fd8a8113e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a81274d0 0x7fd8a8113e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 -- 172.21.15.19:0/1706013084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980092a0 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ad68a700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 0x7fd8a8114330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8ace89700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd89800ea20 tx=0x7fd898009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800c850 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800c9b0 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a0009a20 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800cd30 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.995+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd890009370 con 0x7fd8a8066110 2023-10-03T10:11:29.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.996+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd898012600 con 0x7fd8a8066110 2023-10-03T10:11:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.996+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd89803b5b0 con 0x7fd8a8066110 2023-10-03T10:11:29.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:28.997+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a81257d0 con 0x7fd8a8066110 2023-10-03T10:11:29.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.001+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd89801b400 con 0x7fd8a8066110 2023-10-03T10:11:29.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.174+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd8a805a260 con 0x7fd8a8066110 2023-10-03T10:11:29.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.175+0000 7fd8a4ff9700 1 -- 172.21.15.19:0/1706013084 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd898023350 con 0x7fd8a8066110 2023-10-03T10:11:29.176 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 >> v1:172.21.15.19:6816/118286 conn(0x7fd88802bb90 legacy=0x7fd88802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 msgr2=0x7fd8a8117e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fd89800ea20 tx=0x7fd898009060).stop 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 shutdown_connections 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8a812add0 0x7fd8a8114330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8a8066110 0x7fd8a8117e70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 --2- 172.21.15.19:0/1706013084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8a81274d0 0x7fd8a8113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 >> 172.21.15.19:0/1706013084 conn(0x7fd8a809ba60 msgr2=0x7fd8a8098510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 shutdown_connections 2023-10-03T10:11:29.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.177+0000 7fd8af0ed700 1 -- 172.21.15.19:0/1706013084 wait complete. 2023-10-03T10:11:29.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.325+0000 7f4645a20700 1 Processor -- start 2023-10-03T10:11:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 -- start start 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 0x7f4640132830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46400663b0 con 0x7f46400653a0 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4640065e80 con 0x7f4640130440 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f4645a20700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4640065780 con 0x7f4640098d50 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f463e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f463f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 0x7f4640132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f463e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46610/0 (socket says 172.21.15.19:46610) 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f463e7fc700 1 -- 172.21.15.19:0/1075020788 learned_addr learned my addr 172.21.15.19:0/1075020788 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.326+0000 7f463effd700 1 --1- 172.21.15.19:0/1075020788 >> v1:172.21.15.19:6789/0 conn(0x7f46400653a0 0x7f4640098640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59738/0 (socket says 172.21.15.19:59738) 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463e7fc700 1 -- 172.21.15.19:0/1075020788 >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 msgr2=0x7f4640132830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463e7fc700 1 --2- 172.21.15.19:0/1075020788 >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 0x7f4640132830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463e7fc700 1 -- 172.21.15.19:0/1075020788 >> v1:172.21.15.19:6789/0 conn(0x7f46400653a0 legacy=0x7f4640098640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463e7fc700 1 -- 172.21.15.19:0/1075020788 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640096180 con 0x7f4640098d50 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463dffb700 1 -- 172.21.15.19:0/1075020788 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115545202 0 0) 0x7f46400663b0 con 0x7f46400653a0 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463f7fe700 1 --2- 172.21.15.19:0/1075020788 >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 0x7f4640132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463e7fc700 1 --2- 172.21.15.19:0/1075020788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f46340090f0).ready entity=mon.1 client_cookie=6520bc77fbe992aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463dffb700 1 -- 172.21.15.19:0/1075020788 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400b580 con 0x7f4640098d50 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463dffb700 1 -- 172.21.15.19:0/1075020788 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463400b6e0 con 0x7f4640098d50 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f463dffb700 1 -- 172.21.15.19:0/1075020788 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463400ba60 con 0x7f4640098d50 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f4645a20700 1 -- 172.21.15.19:0/1075020788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 msgr2=0x7f4640099130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.327+0000 7f4645a20700 1 --2- 172.21.15.19:0/1075020788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4634006fd0 tx=0x7f46340090f0).stop 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 -- 172.21.15.19:0/1075020788 shutdown_connections 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 --2- 172.21.15.19:0/1075020788 >> v2:172.21.15.19:3300/0 conn(0x7f4640130440 0x7f4640132830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 --2- 172.21.15.19:0/1075020788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640098d50 0x7f4640099130 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 -- 172.21.15.19:0/1075020788 >> 172.21.15.19:0/1075020788 conn(0x7f464009dc20 msgr2=0x7f464009e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 -- 172.21.15.19:0/1075020788 shutdown_connections 2023-10-03T10:11:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.328+0000 7f4645a20700 1 -- 172.21.15.19:0/1075020788 wait complete. 2023-10-03T10:11:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 Processor -- start 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 -- start start 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4640098d50 0x7f464013ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 0x7f464013b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464011c050 con 0x7f46400653a0 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4640094770 con 0x7f4640130440 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f4645a20700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4640099a90 con 0x7f4640098d50 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f463effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f463effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35764/0 (socket says 172.21.15.19:35764) 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f463effd700 1 -- 172.21.15.19:0/2849808061 learned_addr learned my addr 172.21.15.19:0/2849808061 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.329+0000 7f463e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4640098d50 0x7f464013ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463f7fe700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 0x7f464013b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 -- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4640098d50 msgr2=0x7f464013ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4640098d50 0x7f464013ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 -- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 msgr2=0x7f464013b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 0x7f464013b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 -- 172.21.15.19:0/2849808061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4638009a20 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463f7fe700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 0x7f464013b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f463effd700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f463000c4c0 tx=0x7f4630007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46300072e0 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4630007440 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4630015bb0 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4634009370 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.330+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464011d6a0 con 0x7f46400653a0 2023-10-03T10:11:29.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.331+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f463001e410 con 0x7f46400653a0 2023-10-03T10:11:29.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.331+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4630042c80 con 0x7f46400653a0 2023-10-03T10:11:29.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.332+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464005a260 con 0x7f46400653a0 2023-10-03T10:11:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.336+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4630007d50 con 0x7f46400653a0 2023-10-03T10:11:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.509+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4640097400 con 0x7f46400653a0 2023-10-03T10:11:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.509+0000 7f4626ffd700 1 -- 172.21.15.19:0/2849808061 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f463001c320 con 0x7f46400653a0 2023-10-03T10:11:29.510 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 >> v1:172.21.15.19:6816/118286 conn(0x7f462c02bb30 legacy=0x7f462c02dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 msgr2=0x7f464013a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f463000c4c0 tx=0x7f4630007c10).stop 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 shutdown_connections 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4640130440 0x7f464013b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46400653a0 0x7f464013a9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 --2- 172.21.15.19:0/2849808061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4640098d50 0x7f464013ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 >> 172.21.15.19:0/2849808061 conn(0x7f464009dc20 msgr2=0x7f464009bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 shutdown_connections 2023-10-03T10:11:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.511+0000 7f4645a20700 1 -- 172.21.15.19:0/2849808061 wait complete. 2023-10-03T10:11:29.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:29.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 Processor -- start 2023-10-03T10:11:29.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 -- start start 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 0x7f83dc12f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83dc092d80 con 0x7f83dc093840 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83dc093c20 con 0x7f83dc12d160 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e2306700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc092b90 con 0x7f83dc098ea0 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e08a3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 0x7f83dc12f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e08a3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 0x7f83dc12f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35778/0 (socket says 172.21.15.19:35778) 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57518/0 (socket says 172.21.15.19:57518) 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83e08a3700 1 -- 172.21.15.19:0/3317492152 learned_addr learned my addr 172.21.15.19:0/3317492152 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:29.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.657+0000 7f83dbfff700 1 --1- 172.21.15.19:0/3317492152 >> v1:172.21.15.19:6789/0 conn(0x7f83dc093840 0x7f83dc098790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59754/0 (socket says 172.21.15.19:59754) 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83db7fe700 1 -- 172.21.15.19:0/3317492152 >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 msgr2=0x7f83dc12f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83db7fe700 1 --2- 172.21.15.19:0/3317492152 >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 0x7f83dc12f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83db7fe700 1 -- 172.21.15.19:0/3317492152 >> v1:172.21.15.19:6789/0 conn(0x7f83dc093840 legacy=0x7f83dc098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83db7fe700 1 -- 172.21.15.19:0/3317492152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc099b70 con 0x7f83dc098ea0 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83db7fe700 1 --2- 172.21.15.19:0/3317492152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f83c4009760 tx=0x7f83c4009060).ready entity=mon.2 client_cookie=e817bf7cbdddcfb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83daffd700 1 -- 172.21.15.19:0/3317492152 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400f510 con 0x7f83dc098ea0 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83daffd700 1 -- 172.21.15.19:0/3317492152 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400f670 con 0x7f83dc098ea0 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.658+0000 7f83daffd700 1 -- 172.21.15.19:0/3317492152 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400f9f0 con 0x7f83dc098ea0 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 -- 172.21.15.19:0/3317492152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 msgr2=0x7f83dc099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 --2- 172.21.15.19:0/3317492152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f83c4009760 tx=0x7f83c4009060).stop 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 -- 172.21.15.19:0/3317492152 shutdown_connections 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 --2- 172.21.15.19:0/3317492152 >> v2:172.21.15.19:3300/0 conn(0x7f83dc12d160 0x7f83dc12f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 --2- 172.21.15.19:0/3317492152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc099280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 -- 172.21.15.19:0/3317492152 >> 172.21.15.19:0/3317492152 conn(0x7f83dc097480 msgr2=0x7f83dc097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 -- 172.21.15.19:0/3317492152 shutdown_connections 2023-10-03T10:11:29.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.659+0000 7f83e2306700 1 -- 172.21.15.19:0/3317492152 wait complete. 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 Processor -- start 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 -- start start 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc13ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 0x7f83dc13b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc12cd70 con 0x7f83dc093840 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc13b550 con 0x7f83dc12d160 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83e2306700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc064fc0 con 0x7f83dc098ea0 2023-10-03T10:11:29.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc13ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83dbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35786/0 (socket says 172.21.15.19:35786) 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.660+0000 7f83dbfff700 1 -- 172.21.15.19:0/696193330 learned_addr learned my addr 172.21.15.19:0/696193330 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83e08a3700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 0x7f83dc13b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 -- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 msgr2=0x7f83dc13b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 0x7f83dc13b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 -- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 msgr2=0x7f83dc13a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 -- 172.21.15.19:0/696193330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c40092a0 con 0x7f83dc098ea0 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83dbfff700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83e08a3700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 0x7f83dc13b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83db7fe700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc13ab70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f83c4014000 tx=0x7f83c4017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c400f7e0 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c400f960 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c401b660 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83dc11d9f0 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.661+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83dc11e810 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.662+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f83c401b9d0 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.662+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f83c403c730 con 0x7f83dc098ea0 2023-10-03T10:11:29.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.663+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83dc11e810 con 0x7f83dc098ea0 2023-10-03T10:11:29.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.667+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f83dc11e810 con 0x7f83dc098ea0 2023-10-03T10:11:29.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.840+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83dc11e810 con 0x7f83dc098ea0 2023-10-03T10:11:29.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.840+0000 7f83d3fff700 1 -- 172.21.15.19:0/696193330 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v17) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83dc11e810 con 0x7f83dc098ea0 2023-10-03T10:11:29.842 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 >> v1:172.21.15.19:6816/118286 conn(0x7f83bc02bb60 legacy=0x7f83bc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 msgr2=0x7f83dc13ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc13ab70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f83c4014000 tx=0x7f83c4017000).stop 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 shutdown_connections 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f83dc12d160 0x7f83dc13b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83dc093840 0x7f83dc13a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 --2- 172.21.15.19:0/696193330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f83dc098ea0 0x7f83dc13ab70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.842+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 >> 172.21.15.19:0/696193330 conn(0x7f83dc097480 msgr2=0x7f83dc068aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.843+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 shutdown_connections 2023-10-03T10:11:29.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.843+0000 7f83e2306700 1 -- 172.21.15.19:0/696193330 wait complete. 2023-10-03T10:11:29.857 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:29.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 Processor -- start 2023-10-03T10:11:29.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 -- start start 2023-10-03T10:11:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a60096410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 0x7f4a60130630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a60095e60 con 0x7f4a60096900 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60068d40 con 0x7f4a600694d0 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.988+0000 7f4a672b5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60068fb0 con 0x7f4a6012e240 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 0x7f4a60130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a64850700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4a60096900 0x7f4a60096d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59758/0 (socket says 172.21.15.19:59758) 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a64850700 1 -- 172.21.15.19:0/1451512114 learned_addr learned my addr 172.21.15.19:0/1451512114 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65051700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a60096410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a57fff700 1 -- 172.21.15.19:0/1451512114 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3905646501 0 0) 0x7f4a60095e60 con 0x7f4a60096900 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 -- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 msgr2=0x7f4a60096410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a60096410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 -- 172.21.15.19:0/1451512114 >> v1:172.21.15.19:6789/0 conn(0x7f4a60096900 legacy=0x7f4a60096d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 -- 172.21.15.19:0/1451512114 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60068a10 con 0x7f4a6012e240 2023-10-03T10:11:29.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65051700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a60096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:29.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a65852700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 0x7f4a60130630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a58009e90 tx=0x7f4a58009780).ready entity=mon.2 client_cookie=5d483efeef2018fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a57fff700 1 -- 172.21.15.19:0/1451512114 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800e070 con 0x7f4a6012e240 2023-10-03T10:11:29.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a57fff700 1 -- 172.21.15.19:0/1451512114 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5800bb60 con 0x7f4a6012e240 2023-10-03T10:11:29.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.989+0000 7f4a57fff700 1 -- 172.21.15.19:0/1451512114 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58012410 con 0x7f4a6012e240 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 -- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 msgr2=0x7f4a60130630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 0x7f4a60130630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f4a58009e90 tx=0x7f4a58009780).stop 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 -- 172.21.15.19:0/1451512114 shutdown_connections 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a6012e240 0x7f4a60130630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 --2- 172.21.15.19:0/1451512114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a60096410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 -- 172.21.15.19:0/1451512114 >> 172.21.15.19:0/1451512114 conn(0x7f4a6009ba60 msgr2=0x7f4a6009be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:29.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 -- 172.21.15.19:0/1451512114 shutdown_connections 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.990+0000 7f4a672b5700 1 -- 172.21.15.19:0/1451512114 wait complete. 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.991+0000 7f4a672b5700 1 Processor -- start 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.991+0000 7f4a672b5700 1 -- start start 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a6012dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a60096900 0x7f4a60064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 0x7f4a60064a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60067d80 con 0x7f4a6012e240 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a6011d220 con 0x7f4a600694d0 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60091b80 con 0x7f4a60096900 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65051700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a6012dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 0x7f4a60064a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65051700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a6012dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46640/0 (socket says 172.21.15.19:46640) 2023-10-03T10:11:29.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65051700 1 -- 172.21.15.19:0/2175208905 learned_addr learned my addr 172.21.15.19:0/2175208905 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a64850700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a60096900 0x7f4a60064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 -- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a60096900 msgr2=0x7f4a60064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a60096900 0x7f4a60064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 -- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 msgr2=0x7f4a6012dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a6012dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 -- 172.21.15.19:0/2175208905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c0092a0 con 0x7f4a6012e240 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a65852700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 0x7f4a60064a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a58014000 tx=0x7f4a600983f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5801d630 con 0x7f4a6012e240 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a5801d790 con 0x7f4a6012e240 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a58009a20 con 0x7f4a6012e240 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5801db50 con 0x7f4a6012e240 2023-10-03T10:11:29.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.992+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6011de60 con 0x7f4a6012e240 2023-10-03T10:11:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.993+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f4a58027460 con 0x7f4a6012e240 2023-10-03T10:11:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.993+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f4a5803d070 con 0x7f4a6012e240 2023-10-03T10:11:29.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.994+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a6005a260 con 0x7f4a6012e240 2023-10-03T10:11:29.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:29.998+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f4a5801b900 con 0x7f4a6012e240 2023-10-03T10:11:30.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.172+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4a60065340 con 0x7f4a6012e240 2023-10-03T10:11:30.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.172+0000 7f4a557fa700 1 -- 172.21.15.19:0/2175208905 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v17) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4a580263c0 con 0x7f4a6012e240 2023-10-03T10:11:30.173 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:11:30.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.174+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 >> v1:172.21.15.19:6816/118286 conn(0x7f4a4402bb60 legacy=0x7f4a4402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.174+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 msgr2=0x7f4a60064a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.174+0000 7f4a672b5700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 0x7f4a60064a30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a58014000 tx=0x7f4a600983f0).stop 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 shutdown_connections 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6012e240 0x7f4a60064a30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4a600694d0 0x7f4a6012dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 --2- 172.21.15.19:0/2175208905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4a60096900 0x7f4a60064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 >> 172.21.15.19:0/2175208905 conn(0x7f4a6009ba60 msgr2=0x7f4a60094c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 shutdown_connections 2023-10-03T10:11:30.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.175+0000 7f4a672b5700 1 -- 172.21.15.19:0/2175208905 wait complete. 2023-10-03T10:11:30.188 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:30.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 Processor -- start 2023-10-03T10:11:30.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 -- start start 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 0x7fdf38094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 0x7fdf38127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38096760 con 0x7fdf38094c20 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf38091ff0 con 0x7fdf38096380 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3ee26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38092c80 con 0x7fdf38091b00 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 0x7fdf38127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3cbc2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 0x7fdf38094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3d3c3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdf38094c20 0x7fdf38127af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59760/0 (socket says 172.21.15.19:59760) 2023-10-03T10:11:30.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.318+0000 7fdf3d3c3700 1 -- 172.21.15.19:0/2063119445 learned_addr learned my addr 172.21.15.19:0/2063119445 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf377fe700 1 -- 172.21.15.19:0/2063119445 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298625366 0 0) 0x7fdf38096760 con 0x7fdf38094c20 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf37fff700 1 -- 172.21.15.19:0/2063119445 >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 msgr2=0x7fdf38094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf37fff700 1 --2- 172.21.15.19:0/2063119445 >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 0x7fdf38094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf37fff700 1 -- 172.21.15.19:0/2063119445 >> v1:172.21.15.19:6789/0 conn(0x7fdf38094c20 legacy=0x7fdf38127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf37fff700 1 -- 172.21.15.19:0/2063119445 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38093900 con 0x7fdf38091b00 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf3cbc2700 1 --2- 172.21.15.19:0/2063119445 >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 0x7fdf38094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf37fff700 1 --2- 172.21.15.19:0/2063119445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 0x7fdf38127600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf20009790 tx=0x7fdf20009060).ready entity=mon.1 client_cookie=735465980663e47b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf377fe700 1 -- 172.21.15.19:0/2063119445 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000f510 con 0x7fdf38091b00 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf377fe700 1 -- 172.21.15.19:0/2063119445 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000f670 con 0x7fdf38091b00 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.319+0000 7fdf377fe700 1 -- 172.21.15.19:0/2063119445 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000f9f0 con 0x7fdf38091b00 2023-10-03T10:11:30.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 -- 172.21.15.19:0/2063119445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 msgr2=0x7fdf38127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/2063119445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 0x7fdf38127600 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdf20009790 tx=0x7fdf20009060).stop 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 -- 172.21.15.19:0/2063119445 shutdown_connections 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/2063119445 >> v2:172.21.15.19:3300/0 conn(0x7fdf38096380 0x7fdf38094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/2063119445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38091b00 0x7fdf38127600 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 -- 172.21.15.19:0/2063119445 >> 172.21.15.19:0/2063119445 conn(0x7fdf38097470 msgr2=0x7fdf38097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 -- 172.21.15.19:0/2063119445 shutdown_connections 2023-10-03T10:11:30.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.320+0000 7fdf3ee26700 1 -- 172.21.15.19:0/2063119445 wait complete. 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 Processor -- start 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 -- start start 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf38091b00 0x7fdf38124be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38096380 0x7fdf38112ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3806a520 con 0x7fdf38096380 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf381165a0 con 0x7fdf38094c20 2023-10-03T10:11:30.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3ee26700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38098ff0 con 0x7fdf38091b00 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46670/0 (socket says 172.21.15.19:46670) 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf37fff700 1 -- 172.21.15.19:0/3552806811 learned_addr learned my addr 172.21.15.19:0/3552806811 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3d3c3700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38096380 0x7fdf38112ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.321+0000 7fdf3cbc2700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf38091b00 0x7fdf38124be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 -- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf38091b00 msgr2=0x7fdf38124be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf38091b00 0x7fdf38124be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 -- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38096380 msgr2=0x7fdf38112ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38096380 0x7fdf38112ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 -- 172.21.15.19:0/3552806811 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280092a0 con 0x7fdf38094c20 2023-10-03T10:11:30.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf37fff700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf38092dc0 tx=0x7fdf20017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2000f7e0 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2000f960 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf200092a0 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2001b690 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.322+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381250d0 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.323+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdf2001ba80 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.323+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdf2003c530 con 0x7fdf38094c20 2023-10-03T10:11:30.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.323+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf381161c0 con 0x7fdf38094c20 2023-10-03T10:11:30.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.328+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdf20006b30 con 0x7fdf38094c20 2023-10-03T10:11:30.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.547+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf3805a260 con 0x7fdf38094c20 2023-10-03T10:11:30.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.547+0000 7fdf34ff9700 1 -- 172.21.15.19:0/3552806811 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fdf200253c0 con 0x7fdf38094c20 2023-10-03T10:11:30.548 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:30.548 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:16.244692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 >> v1:172.21.15.19:6816/118286 conn(0x7fdf1802bb60 legacy=0x7fdf1802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 msgr2=0x7fdf38112b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fdf38092dc0 tx=0x7fdf20017000).stop 2023-10-03T10:11:30.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 shutdown_connections 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf38096380 0x7fdf38112ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf38091b00 0x7fdf38124be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 --2- 172.21.15.19:0/3552806811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf38094c20 0x7fdf38112b00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 >> 172.21.15.19:0/3552806811 conn(0x7fdf38097470 msgr2=0x7fdf38126ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 shutdown_connections 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.549+0000 7fdf3ee26700 1 -- 172.21.15.19:0/3552806811 wait complete. 2023-10-03T10:11:30.551 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-10-03T10:11:30.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.692+0000 7fdfb9bfa700 1 Processor -- start 2023-10-03T10:11:30.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.692+0000 7fdfb9bfa700 1 -- start start 2023-10-03T10:11:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb9bfa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb9bfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb9bfa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb412abd0 con 0x7fdfb412b2f0 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb9bfa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb4061780 con 0x7fdfb40613a0 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb9bfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4067530 con 0x7fdfb412b6d0 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdfb412b2f0 0x7fdfb4095df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59768/0 (socket says 172.21.15.19:59768) 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46676/0 (socket says 172.21.15.19:46676) 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35816/0 (socket says 172.21.15.19:35816) 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb2ffd700 1 -- 172.21.15.19:0/424602914 learned_addr learned my addr 172.21.15.19:0/424602914 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 -- 172.21.15.19:0/424602914 >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 msgr2=0x7fdfb412ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 --2- 172.21.15.19:0/424602914 >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 -- 172.21.15.19:0/424602914 >> v1:172.21.15.19:6789/0 conn(0x7fdfb412b2f0 legacy=0x7fdfb4095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 -- 172.21.15.19:0/424602914 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb40683c0 con 0x7fdfb412b6d0 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb37fe700 1 --2- 172.21.15.19:0/424602914 >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.693+0000 7fdfb3fff700 1 --2- 172.21.15.19:0/424602914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdfac009e90 tx=0x7fdfac009780).ready entity=mon.1 client_cookie=94d44a86278280f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb27fc700 1 -- 172.21.15.19:0/424602914 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00e070 con 0x7fdfb412b6d0 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb27fc700 1 -- 172.21.15.19:0/424602914 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac00bb20 con 0x7fdfb412b6d0 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb27fc700 1 -- 172.21.15.19:0/424602914 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00bea0 con 0x7fdfb412b6d0 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/424602914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 msgr2=0x7fdfb4096500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/424602914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fdfac009e90 tx=0x7fdfac009780).stop 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/424602914 shutdown_connections 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/424602914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb412b6d0 0x7fdfb4096500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/424602914 >> v2:172.21.15.19:3300/0 conn(0x7fdfb40613a0 0x7fdfb412ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/424602914 >> 172.21.15.19:0/424602914 conn(0x7fdfb409a220 msgr2=0x7fdfb409a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/424602914 shutdown_connections 2023-10-03T10:11:30.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.694+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/424602914 wait complete. 2023-10-03T10:11:30.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.695+0000 7fdfb9bfa700 1 Processor -- start 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.695+0000 7fdfb9bfa700 1 -- start start 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb40613a0 0x7fdfb4119110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb412b2f0 0x7fdfb41159a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4129b20 con 0x7fdfb412b6d0 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4067130 con 0x7fdfb40613a0 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb9bfa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4118670 con 0x7fdfb412b2f0 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb412b2f0 0x7fdfb41159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35822/0 (socket says 172.21.15.19:35822) 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 -- 172.21.15.19:0/127658189 learned_addr learned my addr 172.21.15.19:0/127658189 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb40613a0 0x7fdfb4119110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 -- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb412b2f0 msgr2=0x7fdfb41159a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb412b2f0 0x7fdfb41159a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 -- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb40613a0 msgr2=0x7fdfb4119110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb40613a0 0x7fdfb4119110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 -- 172.21.15.19:0/127658189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa80092a0 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.696+0000 7fdfb3fff700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdfb4067670 tx=0x7fdfb4097460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac01d630 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac01d790 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfac009a20 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac01db50 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb4115600 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.697+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fdfac003040 con 0x7fdfb412b6d0 2023-10-03T10:11:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.698+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fdfac03cd90 con 0x7fdfb412b6d0 2023-10-03T10:11:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.698+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb4067730 con 0x7fdfb412b6d0 2023-10-03T10:11:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.702+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fdfac01b310 con 0x7fdfb412b6d0 2023-10-03T10:11:30.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.881+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfb4069430 con 0x7fdfb412b6d0 2023-10-03T10:11:30.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.881+0000 7fdf9b7fe700 1 -- 172.21.15.19:0/127658189 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+11341 (secure 0 0 0) 0x7fdfac025b10 con 0x7fdfb412b6d0 2023-10-03T10:11:30.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:30.883 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:14.236548+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 >> v1:172.21.15.19:6816/118286 conn(0x7fdfa002bb90 legacy=0x7fdfa002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 msgr2=0x7fdfb4115e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fdfb4067670 tx=0x7fdfb4097460).stop 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 shutdown_connections 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb412b6d0 0x7fdfb4115e90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb40613a0 0x7fdfb4119110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 --2- 172.21.15.19:0/127658189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb412b2f0 0x7fdfb41159a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 >> 172.21.15.19:0/127658189 conn(0x7fdfb409a220 msgr2=0x7fdfb412e040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 shutdown_connections 2023-10-03T10:11:30.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:30.883+0000 7fdfb9bfa700 1 -- 172.21.15.19:0/127658189 wait complete. 2023-10-03T10:11:30.898 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:31.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.026+0000 7ff43b9a7700 1 Processor -- start 2023-10-03T10:11:31.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.026+0000 7ff43b9a7700 1 -- start start 2023-10-03T10:11:31.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff434059c00 con 0x7ff434059070 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff434096900 con 0x7ff434095370 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff43b9a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff434091b60 con 0x7ff434127390 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439743700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff438f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439f44700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439743700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35836/0 (socket says 172.21.15.19:35836) 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff438f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57576/0 (socket says 172.21.15.19:57576) 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439f44700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46706/0 (socket says 172.21.15.19:46706) 2023-10-03T10:11:31.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439743700 1 -- 172.21.15.19:0/2739892254 learned_addr learned my addr 172.21.15.19:0/2739892254 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439f44700 1 -- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 msgr2=0x7ff434127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.027+0000 7ff439f44700 1 --2- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff439f44700 1 -- 172.21.15.19:0/2739892254 >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 msgr2=0x7ff434127890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff439f44700 1 --2- 172.21.15.19:0/2739892254 >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff439f44700 1 -- 172.21.15.19:0/2739892254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434092a10 con 0x7ff434095370 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff439743700 1 --2- 172.21.15.19:0/2739892254 >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff439f44700 1 --2- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff42c009e60 tx=0x7ff42c009780).ready entity=mon.1 client_cookie=73cb42127b924fde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff427fff700 1 -- 172.21.15.19:0/2739892254 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00e070 con 0x7ff434095370 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff427fff700 1 -- 172.21.15.19:0/2739892254 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00bab0 con 0x7ff434095370 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff427fff700 1 -- 172.21.15.19:0/2739892254 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00be30 con 0x7ff434095370 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 -- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 msgr2=0x7ff434095820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7ff42c009e60 tx=0x7ff42c009780).stop 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 -- 172.21.15.19:0/2739892254 shutdown_connections 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434095820 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/2739892254 >> v2:172.21.15.19:3300/0 conn(0x7ff434059070 0x7ff434127890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/2739892254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.028+0000 7ff43b9a7700 1 -- 172.21.15.19:0/2739892254 >> 172.21.15.19:0/2739892254 conn(0x7ff434097470 msgr2=0x7ff434097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.029+0000 7ff43b9a7700 1 -- 172.21.15.19:0/2739892254 shutdown_connections 2023-10-03T10:11:31.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.029+0000 7ff43b9a7700 1 -- 172.21.15.19:0/2739892254 wait complete. 2023-10-03T10:11:31.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.029+0000 7ff43b9a7700 1 Processor -- start 2023-10-03T10:11:31.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 -- start start 2023-10-03T10:11:31.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434117510 con 0x7ff434059070 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff434099ea0 con 0x7ff434095370 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff43b9a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff434096f00 con 0x7ff434127390 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff439743700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff439f44700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff438f42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff439f44700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57582/0 (socket says 172.21.15.19:57582) 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff438f42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46722/0 (socket says 172.21.15.19:46722) 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff439743700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35844/0 (socket says 172.21.15.19:35844) 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.030+0000 7ff439f44700 1 -- 172.21.15.19:0/207296288 learned_addr learned my addr 172.21.15.19:0/207296288 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 -- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 msgr2=0x7ff434114c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 -- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 msgr2=0x7ff434114730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 -- 172.21.15.19:0/207296288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009370 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff438f42700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439743700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff439f44700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff4340971f0 tx=0x7ff42c009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c007000 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c013e60 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42c009a20 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c01d860 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.031+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff434114350 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.032+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7ff42c003040 con 0x7ff434127390 2023-10-03T10:11:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.032+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7ff42c03ccf0 con 0x7ff434127390 2023-10-03T10:11:31.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.032+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43405a260 con 0x7ff434127390 2023-10-03T10:11:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.037+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7ff42c01b310 con 0x7ff434127390 2023-10-03T10:11:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.255+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff434117730 con 0x7ff434127390 2023-10-03T10:11:31.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.255+0000 7ff4257fa700 1 -- 172.21.15.19:0/207296288 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2154 (secure 0 0 0) 0x7ff42c026bb0 con 0x7ff434127390 2023-10-03T10:11:31.256 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:31.257 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:16.244692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:31.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 >> v1:172.21.15.19:6816/118286 conn(0x7ff41802bb90 legacy=0x7ff41802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 msgr2=0x7ff434115110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7ff4340971f0 tx=0x7ff42c009780).stop 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 shutdown_connections 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff434127390 0x7ff434115110 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff434059070 0x7ff434114730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 --2- 172.21.15.19:0/207296288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff434095370 0x7ff434114c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 >> 172.21.15.19:0/207296288 conn(0x7ff434097470 msgr2=0x7ff434098780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 shutdown_connections 2023-10-03T10:11:31.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.257+0000 7ff43b9a7700 1 -- 172.21.15.19:0/207296288 wait complete. 2023-10-03T10:11:31.260 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-10-03T10:11:31.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:11:13.232209+0000', 'modified': '2023-10-03T10:11:16.244692+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6817/497268310', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.19:6817', 'nonce': 497268310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:11:31.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:11:31.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:11:31.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.510+0000 7fe0eb3e6700 1 Processor -- start 2023-10-03T10:11:31.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.510+0000 7fe0eb3e6700 1 -- start start 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0e406a220 0x7fe0e4096750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 0x7fe0e4097060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e406a600 con 0x7fe0e406a220 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4064630 con 0x7fe0e4097550 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0eb3e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4065d20 con 0x7fe0e4096c40 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e9983700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e9182700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0e406a220 0x7fe0e4096750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 0x7fe0e4097060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e9182700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0e406a220 0x7fe0e4096750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35846/0 (socket says 172.21.15.19:35846) 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e9182700 1 -- 172.21.15.19:0/330320739 learned_addr learned my addr 172.21.15.19:0/330320739 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.511+0000 7fe0e9983700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46724/0 (socket says 172.21.15.19:46724) 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 -- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 msgr2=0x7fe0e4097060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 0x7fe0e4097060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 -- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 msgr2=0x7fe0e4135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 -- 172.21.15.19:0/330320739 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4098260 con 0x7fe0e406a220 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9983700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e8981700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 0x7fe0e4097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0e9182700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e406a220 0x7fe0e4096750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe0e0009830 tx=0x7fe0e00090f0).ready entity=mon.0 client_cookie=906b67bbb5234e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0d7fff700 1 -- 172.21.15.19:0/330320739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000f510 con 0x7fe0e406a220 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0d7fff700 1 -- 172.21.15.19:0/330320739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e000f670 con 0x7fe0e406a220 2023-10-03T10:11:31.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0d7fff700 1 -- 172.21.15.19:0/330320739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000fa10 con 0x7fe0e406a220 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e406a220 msgr2=0x7fe0e4096750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e406a220 0x7fe0e4096750 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe0e0009830 tx=0x7fe0e00090f0).stop 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/330320739 shutdown_connections 2023-10-03T10:11:31.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4097550 0x7fe0e4135a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e406a220 0x7fe0e4096750 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/330320739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e4096c40 0x7fe0e4097060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.512+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/330320739 >> 172.21.15.19:0/330320739 conn(0x7fe0e409ba50 msgr2=0x7fe0e409be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.513+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/330320739 shutdown_connections 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.513+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/330320739 wait complete. 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.513+0000 7fe0eb3e6700 1 Processor -- start 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 -- start start 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 0x7fe0e413ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e4097550 0x7fe0e413f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4122530 con 0x7fe0e4097550 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4064d60 con 0x7fe0e4096c40 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0eb3e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e4099990 con 0x7fe0e406a220 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 0x7fe0e413ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57608/0 (socket says 172.21.15.19:57608) 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0e9182700 1 -- 172.21.15.19:0/1398016371 learned_addr learned my addr 172.21.15.19:0/1398016371 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.514+0000 7fe0e9983700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e4097550 0x7fe0e413f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 -- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 msgr2=0x7fe0e413e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 -- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e4097550 msgr2=0x7fe0e413f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e4097550 0x7fe0e413f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 -- 172.21.15.19:0/1398016371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80092a0 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e9182700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0e8981700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 0x7fe0e413ecb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe0d800e980 tx=0x7fe0d8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0d57fa700 1 -- 172.21.15.19:0/1398016371 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800ee70 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0d57fa700 1 -- 172.21.15.19:0/1398016371 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d800c7f0 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc009a20 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0d57fa700 1 -- 172.21.15.19:0/1398016371 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800cb90 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.515+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e0009370 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.516+0000 7fe0d57fa700 1 -- 172.21.15.19:0/1398016371 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe0d801b400 con 0x7fe0e4096c40 2023-10-03T10:11:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.516+0000 7fe0d57fa700 1 -- 172.21.15.19:0/1398016371 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe0d803b470 con 0x7fe0e4096c40 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.519+0000 7fe0fcd99b80 1 Processor -- start 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.519+0000 7fe0fcd99b80 1 -- start start 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd154f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15519a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd14ef610 con 0x55fcd154f5b0 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcd1465db0 con 0x55fcd1525170 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fcd147b030 con 0x55fcd1525a40 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46736/0 (socket says 172.21.15.19:46736) 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd154f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 -- 172.21.15.19:0/2131955156 learned_addr learned my addr 172.21.15.19:0/2131955156 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9983700 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 -- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 msgr2=0x55fcd154f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd154f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 -- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 msgr2=0x55fcd15519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 -- 172.21.15.19:0/2131955156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcd1316710 con 0x55fcd1525170 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9983700 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0e9182700 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe0e0006e60 tx=0x7fe0e0015000).ready entity=mon.1 client_cookie=ca8fc2e59e4d271b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.520+0000 7fe0ce7fc700 1 -- 172.21.15.19:0/2131955156 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0022070 con 0x55fcd1525170 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0ce7fc700 1 -- 172.21.15.19:0/2131955156 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0000d10 con 0x55fcd1525170 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0ce7fc700 1 -- 172.21.15.19:0/2131955156 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000f9f0 con 0x55fcd1525170 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 msgr2=0x55fcd1525550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe0e0006e60 tx=0x7fe0e0015000).stop 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/2131955156 shutdown_connections 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd1525550 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/2131955156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd154f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/2131955156 >> 172.21.15.19:0/2131955156 conn(0x55fcd1393940 msgr2=0x55fcd1545cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/2131955156 shutdown_connections 2023-10-03T10:11:31.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.521+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/2131955156 wait complete. 2023-10-03T10:11:31.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 -- start start 2023-10-03T10:11:31.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 Processor -- start 2023-10-03T10:11:31.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd1555060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd154f5b0 0x55fcd154a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd147b170 con 0x55fcd1525170 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcd147b3f0 con 0x55fcd154f5b0 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.522+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fcd1446920 con 0x55fcd1525a40 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0fcd99b80 10 client.0 ll_register_callbacks cb 0x55fcd141bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35876/0 (socket says 172.21.15.19:35876) 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 -- 172.21.15.19:0/570167801 learned_addr learned my addr 172.21.15.19:0/570167801 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e8981700 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd1555060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9983700 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd154f5b0 0x55fcd154a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 -- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 msgr2=0x55fcd1555060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd1555060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 -- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd154f5b0 msgr2=0x55fcd154a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd154f5b0 0x55fcd154a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 -- 172.21.15.19:0/570167801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e4098260 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0e9182700 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fe0e00092c0 tx=0x7fe0e0022000).ready entity=mon.0 client_cookie=7b37691978ce3481 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e002d070 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe0e0011e00 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.523+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fcd151df20 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0e0027830 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 10 client.4602 fetch_fsmap learned FSMap version 6 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fcd144db00 con 0x55fcd1525170 2023-10-03T10:11:31.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fcd151df20 con 0x55fcd1525170 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fe0e0009860 con 0x55fcd1525170 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 10 client.4602 fetch_fsmap finished waiting for FSMap version 6 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 10 client.4602 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 20 client.4602 populate_metadata read hostname 'smithi019' 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 4 client.4602 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fcd14f3250 con 0x55fcd154b310 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.524+0000 7fe0c37fe700 10 client.4602 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0c37fe700 1 -- 172.21.15.19:0/570167801 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55fcd14f3250 con 0x55fcd154b310 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0c37fe700 10 client.4602 handle_command_reply: tid=0 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 client.4602 shutdown 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 msgr2=0x55fcd1554b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fe0e00092c0 tx=0x7fe0e0022000).stop 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 shutdown_connections 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd154f5b0 0x55fcd154a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd1525170 0x55fcd1554b70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/570167801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd1555060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0c37fe700 0 client.4602 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 >> 172.21.15.19:0/570167801 conn(0x55fcd1393940 msgr2=0x55fcd1545c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 shutdown_connections 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.525+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/570167801 wait complete. 2023-10-03T10:11:31.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.526+0000 7fe0fcd99b80 20 client.4602 trim_cache size 0 max 16384 2023-10-03T10:11:31.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 Processor -- start 2023-10-03T10:11:31.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 -- start start 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525a40 0x55fcd1564f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd1528f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd1546830 con 0x55fcd154f5b0 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcd154eea0 con 0x55fcd1525a40 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fcd154df00 con 0x55fcd1525170 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525a40 0x55fcd1564f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0e9983700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd1528f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0e9182700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57626/0 (socket says 172.21.15.19:57626) 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.543+0000 7fe0e9182700 1 -- 172.21.15.19:0/1531204434 learned_addr learned my addr 172.21.15.19:0/1531204434 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 -- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525a40 msgr2=0x55fcd1564f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525a40 0x55fcd1564f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 -- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 msgr2=0x55fcd1528f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd1528f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 -- 172.21.15.19:0/1531204434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fcd1473f70 con 0x55fcd1525170 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9983700 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd1528f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0e9182700 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe0e003e050 tx=0x7fe0e002d000).ready entity=mon.2 client_cookie=f55dfb2084b006b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0ceffd700 1 -- 172.21.15.19:0/1531204434 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0040070 con 0x55fcd1525170 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0ceffd700 1 -- 172.21.15.19:0/1531204434 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0009860 con 0x55fcd1525170 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0ceffd700 1 -- 172.21.15.19:0/1531204434 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0022070 con 0x55fcd1525170 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 msgr2=0x55fcd1526840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe0e003e050 tx=0x7fe0e002d000).stop 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/1531204434 shutdown_connections 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd1528f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525170 0x55fcd1526840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.544+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/1531204434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525a40 0x55fcd1564f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.545+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/1531204434 >> 172.21.15.19:0/1531204434 conn(0x55fcd1393940 msgr2=0x55fcd1524980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.545+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/1531204434 shutdown_connections 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.545+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/1531204434 wait complete. 2023-10-03T10:11:31.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.545+0000 7fe0fcd99b80 1 -- start start 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.545+0000 7fe0fcd99b80 1 Processor -- start 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd15a9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fcd15554c0 con 0x55fcd154f5b0 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fcd158d020 con 0x55fcd1525170 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55fcd1525550 con 0x55fcd1525a40 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0fcd99b80 10 client.0 ll_register_callbacks cb 0x55fcd141bce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57636/0 (socket says 172.21.15.19:57636) 2023-10-03T10:11:31.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e9983700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 -- 172.21.15.19:0/3772490694 learned_addr learned my addr 172.21.15.19:0/3772490694 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e9182700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd15a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 -- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 msgr2=0x55fcd15a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd15a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 -- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 msgr2=0x55fcd15a9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15a9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 -- 172.21.15.19:0/3772490694 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0dc011660 con 0x55fcd1525a40 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e9182700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd15a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e9983700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0e8981700 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe0d801a040 tx=0x7fe0d8037040).ready entity=mon.2 client_cookie=e8b77a9fa8ccd173 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.546+0000 7fe0c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.19:3302/0 2023-10-03T10:11:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d802c070 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mon.2 v2:172.21.15.19:3302/0 2 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe0d8011350 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0e0000d10 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0d8011e80 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 10 client.4475 fetch_fsmap learned FSMap version 6 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55fcd144db00 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mon.2 v2:172.21.15.19:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d8035020 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mon.2 v2:172.21.15.19:3302/0 5 ==== fsmap(e 6) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fe0d8023350 con 0x55fcd1525a40 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 10 client.4475 fetch_fsmap finished waiting for FSMap version 6 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 10 client.4475 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 20 client.4475 populate_metadata read hostname 'smithi019' 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 4 client.4475 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-03T10:11:31.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fcd12e3ef0 con 0x55fcd158a860 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.547+0000 7fe0c37fe700 10 client.4475 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0c37fe700 1 -- 172.21.15.19:0/3772490694 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 3039367672) 0x55fcd12e3ef0 con 0x55fcd158a860 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0c37fe700 10 client.4475 handle_command_reply: tid=0 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 client.4475 shutdown 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 msgr2=0x55fcd15a9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fe0d801a040 tx=0x7fe0d8037040).stop 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 shutdown_connections 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fcd154f5b0 0x55fcd15a9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0c37fe700 0 client.4475 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55fcd1525170 0x55fcd15a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 --2- 172.21.15.19:0/3772490694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55fcd1525a40 0x55fcd15a9730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 >> 172.21.15.19:0/3772490694 conn(0x55fcd1393940 msgr2=0x55fcd1528f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 shutdown_connections 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 1 -- 172.21.15.19:0/3772490694 wait complete. 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.548+0000 7fe0fcd99b80 20 client.4475 trim_cache size 0 max 16384 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "7e072252-f281-43a7-ab05-1896c0d28d72", 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4189, 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-10-03T10:11:31.556 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 18.312775992999999, 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 6, 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 17, 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 17, 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 23.632900957 2023-10-03T10:11:31.557 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 >> v1:172.21.15.19:6816/118286 conn(0x7fe0c802bb60 legacy=0x7fe0c802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 msgr2=0x7fe0e413ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 0x7fe0e413ecb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fe0d800e980 tx=0x7fe0d8009060).stop 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 shutdown_connections 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0e4097550 0x7fe0e413f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0e406a220 0x7fe0e413e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 --2- 172.21.15.19:0/1398016371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0e4096c40 0x7fe0e413ecb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 >> 172.21.15.19:0/1398016371 conn(0x7fe0e409ba50 msgr2=0x7fe0e4068900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 shutdown_connections 2023-10-03T10:11:31.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.549+0000 7fe0eb3e6700 1 -- 172.21.15.19:0/1398016371 wait complete. 2023-10-03T10:11:31.563 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:11:31.572 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:11:31.572 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:11:31.572 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client pacific' 2023-10-03T10:11:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.700+0000 7f64133cb700 1 Processor -- start 2023-10-03T10:11:31.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.700+0000 7f64133cb700 1 -- start start 2023-10-03T10:11:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f64133cb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f64133cb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 0x7f640c096510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f64133cb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c0672b0 con 0x7f640c12b2c0 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f64133cb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c059450 con 0x7f640c12b6e0 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f64133cb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c12bb70 con 0x7f640c059070 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411968700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 0x7f640c096510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46782/0 (socket says 172.21.15.19:46782) 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 -- 172.21.15.19:0/2775321335 learned_addr learned my addr 172.21.15.19:0/2775321335 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6410966700 1 --1- 172.21.15.19:0/2775321335 >> v1:172.21.15.19:6789/0 conn(0x7f640c12b2c0 0x7f640c095e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59784/0 (socket says 172.21.15.19:59784) 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 -- 172.21.15.19:0/2775321335 >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 msgr2=0x7f640c096510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 --2- 172.21.15.19:0/2775321335 >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 0x7f640c096510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 -- 172.21.15.19:0/2775321335 >> v1:172.21.15.19:6789/0 conn(0x7f640c12b2c0 legacy=0x7f640c095e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411167700 1 -- 172.21.15.19:0/2775321335 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c067530 con 0x7f640c059070 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f63fffff700 1 -- 172.21.15.19:0/2775321335 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951229056 0 0) 0x7f640c0672b0 con 0x7f640c12b2c0 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.701+0000 7f6411968700 1 --2- 172.21.15.19:0/2775321335 >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 0x7f640c096510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f6411167700 1 --2- 172.21.15.19:0/2775321335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6400006fd0 tx=0x7f64000090f0).ready entity=mon.1 client_cookie=79b18b4187968a81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f63fffff700 1 -- 172.21.15.19:0/2775321335 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640000b580 con 0x7f640c059070 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f63fffff700 1 -- 172.21.15.19:0/2775321335 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640000b6e0 con 0x7f640c059070 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f63fffff700 1 -- 172.21.15.19:0/2775321335 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640000ba60 con 0x7f640c059070 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 -- 172.21.15.19:0/2775321335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 msgr2=0x7f640c12add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 --2- 172.21.15.19:0/2775321335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f6400006fd0 tx=0x7f64000090f0).stop 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 -- 172.21.15.19:0/2775321335 shutdown_connections 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 --2- 172.21.15.19:0/2775321335 >> v2:172.21.15.19:3300/0 conn(0x7f640c12b6e0 0x7f640c096510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 --2- 172.21.15.19:0/2775321335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c059070 0x7f640c12add0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.702+0000 7f64133cb700 1 -- 172.21.15.19:0/2775321335 >> 172.21.15.19:0/2775321335 conn(0x7f640c09a2a0 msgr2=0x7f640c09a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.703+0000 7f64133cb700 1 -- 172.21.15.19:0/2775321335 shutdown_connections 2023-10-03T10:11:31.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.703+0000 7f64133cb700 1 -- 172.21.15.19:0/2775321335 wait complete. 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.703+0000 7f64133cb700 1 Processor -- start 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.703+0000 7f64133cb700 1 -- start start 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f640c059070 0x7f640c13a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 0x7f640c115bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1170b0 con 0x7f640c12b2c0 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c12f450 con 0x7f640c12b6e0 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f64133cb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f640c118200 con 0x7f640c059070 2023-10-03T10:11:31.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6410966700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411968700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 0x7f640c115bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6410966700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35922/0 (socket says 172.21.15.19:35922) 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6410966700 1 -- 172.21.15.19:0/4185338763 learned_addr learned my addr 172.21.15.19:0/4185338763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411167700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f640c059070 0x7f640c13a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411968700 1 -- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f640c059070 msgr2=0x7f640c13a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411968700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f640c059070 0x7f640c13a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411968700 1 -- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 msgr2=0x7f640c13ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.704+0000 7f6411968700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f6411968700 1 -- 172.21.15.19:0/4185338763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6404009a20 con 0x7f640c12b6e0 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f6410966700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f6411968700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 0x7f640c115bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6404009f10 tx=0x7f640400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:31.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6404009c70 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640400f040 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640400cd80 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400009370 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.705+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c119d50 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.706+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6404013610 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.706+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f640403b7f0 con 0x7f640c12b6e0 2023-10-03T10:11:31.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.706+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640c098920 con 0x7f640c12b6e0 2023-10-03T10:11:31.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.711+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f640401c410 con 0x7f640c12b6e0 2023-10-03T10:11:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:31.897+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "pacific"} v 0) v1 -- 0x7f640c05ff50 con 0x7f640c12b6e0 2023-10-03T10:11:32.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.438+0000 7f63fd7fa700 1 -- 172.21.15.19:0/4185338763 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "pacific"}]=0 set require_min_compat_client to pacific v18) v1 ==== 143+0+0 (secure 0 0 0) 0x7f640401a690 con 0x7f640c12b6e0 2023-10-03T10:11:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.440+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 >> v1:172.21.15.19:6816/118286 conn(0x7f63f002bb60 legacy=0x7f63f002e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.440+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 msgr2=0x7f640c115bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 0x7f640c115bd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f6404009f10 tx=0x7f640400b040).stop 2023-10-03T10:11:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 shutdown_connections 2023-10-03T10:11:32.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f640c12b6e0 0x7f640c115bd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f640c059070 0x7f640c13a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 --2- 172.21.15.19:0/4185338763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f640c12b2c0 0x7f640c13ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 >> 172.21.15.19:0/4185338763 conn(0x7f640c09a2a0 msgr2=0x7f640c12e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 shutdown_connections 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.441+0000 7f64133cb700 1 -- 172.21.15.19:0/4185338763 wait complete. 2023-10-03T10:11:32.443 INFO:teuthology.orchestra.run.smithi019.stderr:set require_min_compat_client to pacific 2023-10-03T10:11:32.457 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:11:32.465 INFO:teuthology.task.print:**** done ceph 2023-10-03T10:11:32.465 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-03T10:11:32.491 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-03T10:11:32.491 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-10-03T10:11:32.491 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-03T10:11:32.491 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-03T10:11:32.491 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:32.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:32.492 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-03T10:11:32.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:32.516 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-10-03T10:11:32.593 INFO:teuthology.orchestra.run.smithi027.stderr:Cannot find device "ceph-brx" 2023-10-03T10:11:32.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:11:32.594 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-03T10:11:32.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-03T10:11:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 Processor -- start 2023-10-03T10:11:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 -- start start 2023-10-03T10:11:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 0x7f09f012c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f0096760 con 0x7f09f0096380 2023-10-03T10:11:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f0091ff0 con 0x7f09f0091b00 2023-10-03T10:11:32.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09f5fb7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0092c80 con 0x7f09f012ce60 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.733+0000 7f09effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09eeffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 0x7f09f012c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57644/0 (socket says 172.21.15.19:57644) 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 -- 172.21.15.19:0/3562620210 learned_addr learned my addr 172.21.15.19:0/3562620210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09ef7fe700 1 --1- 172.21.15.19:0/3562620210 >> v1:172.21.15.19:6789/0 conn(0x7f09f0096380 0x7f09f0094730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59796/0 (socket says 172.21.15.19:59796) 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 -- 172.21.15.19:0/3562620210 >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 msgr2=0x7f09f012c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 --2- 172.21.15.19:0/3562620210 >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 0x7f09f012c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 -- 172.21.15.19:0/3562620210 >> v1:172.21.15.19:6789/0 conn(0x7f09f0096380 legacy=0x7f09f0094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 -- 172.21.15.19:0/3562620210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0094e40 con 0x7f09f012ce60 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09eeffd700 1 --2- 172.21.15.19:0/3562620210 >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 0x7f09f012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09effff700 1 --2- 172.21.15.19:0/3562620210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f09e8009f20 tx=0x7f09e8009840).ready entity=mon.2 client_cookie=6060e715f24477d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09ee7fc700 1 -- 172.21.15.19:0/3562620210 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800e070 con 0x7f09f012ce60 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09ee7fc700 1 -- 172.21.15.19:0/3562620210 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e800b9d0 con 0x7f09f012ce60 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.734+0000 7f09ee7fc700 1 -- 172.21.15.19:0/3562620210 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e800bd50 con 0x7f09f012ce60 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 -- 172.21.15.19:0/3562620210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 msgr2=0x7f09f012f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/3562620210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f09e8009f20 tx=0x7f09e8009840).stop 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 -- 172.21.15.19:0/3562620210 shutdown_connections 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/3562620210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012f250 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/3562620210 >> v2:172.21.15.19:3300/0 conn(0x7f09f0091b00 0x7f09f012c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 -- 172.21.15.19:0/3562620210 >> 172.21.15.19:0/3562620210 conn(0x7f09f0097470 msgr2=0x7f09f0097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 -- 172.21.15.19:0/3562620210 shutdown_connections 2023-10-03T10:11:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.735+0000 7f09f5fb7700 1 -- 172.21.15.19:0/3562620210 wait complete. 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 Processor -- start 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 -- start start 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 0x7f09f01298c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 0x7f09f0129db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f012a790 con 0x7f09f0096380 2023-10-03T10:11:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0098cc0 con 0x7f09f0091b00 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.736+0000 7f09f5fb7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0111c20 con 0x7f09f012ce60 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09ef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 0x7f09f01298c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09ef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 0x7f09f01298c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:46800/0 (socket says 172.21.15.19:46800) 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09ef7fe700 1 -- 172.21.15.19:0/1076085811 learned_addr learned my addr 172.21.15.19:0/1076085811 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09eeffd700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 0x7f09f0129db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 -- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 msgr2=0x7f09f01298c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 0x7f09f01298c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 -- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 msgr2=0x7f09f0129db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 0x7f09f0129db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 -- 172.21.15.19:0/1076085811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e40092a0 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09eeffd700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 0x7f09f0129db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09effff700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012a2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f09e8013000 tx=0x7f09e8009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8009550 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80092e0 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e8009ae0 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8007860 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.737+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f012b6b0 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.738+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f09e8003040 con 0x7f09f012ce60 2023-10-03T10:11:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.738+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f09e803caf0 con 0x7f09f012ce60 2023-10-03T10:11:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.739+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0098850 con 0x7f09f012ce60 2023-10-03T10:11:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.743+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f09e8024070 con 0x7f09f012ce60 2023-10-03T10:11:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.967+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f09f005a260 con 0x7f09f012ce60 2023-10-03T10:11:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.967+0000 7f09d77fe700 1 -- 172.21.15.19:0/1076085811 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f09e8024030 con 0x7f09f012ce60 2023-10-03T10:11:32.969 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.969+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 >> v1:172.21.15.19:6816/118286 conn(0x7f09dc02bb60 legacy=0x7f09dc02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.969+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 msgr2=0x7f09f012a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.969+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012a2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f09e8013000 tx=0x7f09e8009840).stop 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 shutdown_connections 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09f012ce60 0x7f09f012a2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09f0091b00 0x7f09f01298c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 --2- 172.21.15.19:0/1076085811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09f0096380 0x7f09f0129db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 >> 172.21.15.19:0/1076085811 conn(0x7f09f0097470 msgr2=0x7f09f0059070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 shutdown_connections 2023-10-03T10:11:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:32.970+0000 7f09f5fb7700 1 -- 172.21.15.19:0/1076085811 wait complete. 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi027.front.sepia.ceph.com 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-03T10:11:32.984 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:11:32.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:32.985 DEBUG:teuthology.orchestra.run.smithi027:> ip addr 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout: inet 127.0.0.1/8 scope host lo 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 ::1/128 scope host 2023-10-03T10:11:33.008 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c8 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f0 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether 0c:c4:7a:6b:fe:c9 brd ff:ff:ff:ff:ff:ff 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp7s0f1 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5a brd ff:ff:ff:ff:ff:ff 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f0 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: inet 172.21.15.27/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft 42498sec preferred_lft 42498sec 2023-10-03T10:11:33.009 INFO:teuthology.orchestra.run.smithi027.stdout: inet6 fe80::ae1f:6bff:fef8:395a/64 scope link 2023-10-03T10:11:33.010 INFO:teuthology.orchestra.run.smithi027.stdout: valid_lft forever preferred_lft forever 2023-10-03T10:11:33.010 INFO:teuthology.orchestra.run.smithi027.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-03T10:11:33.010 INFO:teuthology.orchestra.run.smithi027.stdout: link/ether ac:1f:6b:f8:39:5b brd ff:ff:ff:ff:ff:ff 2023-10-03T10:11:33.010 INFO:teuthology.orchestra.run.smithi027.stdout: altname enp1s0f1 2023-10-03T10:11:33.010 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-03T10:11:33.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.010 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-03T10:11:33.010 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-03T10:11:33.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add name ceph-brx type bridge 2023-10-03T10:11:33.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr flush dev ceph-brx 2023-10-03T10:11:33.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set ceph-brx up 2023-10-03T10:11:33.011 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-03T10:11:33.011 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-03T10:11:33.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.179 DEBUG:teuthology.orchestra.run.smithi027:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-03T10:11:33.214 INFO:teuthology.orchestra.run.smithi027.stdout:1 2023-10-03T10:11:33.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.215 DEBUG:teuthology.orchestra.run.smithi027:> route 2023-10-03T10:11:33.287 INFO:teuthology.orchestra.run.smithi027.stdout:Kernel IP routing table 2023-10-03T10:11:33.287 INFO:teuthology.orchestra.run.smithi027.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-03T10:11:33.288 INFO:teuthology.orchestra.run.smithi027.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-03T10:11:33.288 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-03T10:11:33.288 INFO:teuthology.orchestra.run.smithi027.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-03T10:11:33.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.288 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-03T10:11:33.288 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-03T10:11:33.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-03T10:11:33.288 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-03T10:11:33.289 DEBUG:teuthology.orchestra.run.smithi027:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-03T10:11:33.289 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-03T10:11:33.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.586 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-03T10:11:33.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.604 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list-id 2023-10-03T10:11:33.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.663 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-03T10:11:33.663 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-03T10:11:33.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:11:33.663 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-03T10:11:33.663 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-03T10:11:33.759 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-03T10:11:33.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-03T10:11:33.760 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-03T10:11:33.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:33.963 DEBUG:teuthology.orchestra.run.smithi027:> (cd / && exec bash -c ' 2023-10-03T10:11:33.963 DEBUG:teuthology.orchestra.run.smithi027:> set -e 2023-10-03T10:11:33.963 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set brx.0 up 2023-10-03T10:11:33.963 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link set dev brx.0 master ceph-brx 2023-10-03T10:11:33.963 DEBUG:teuthology.orchestra.run.smithi027:> ') 2023-10-03T10:11:34.062 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-03T10:11:34.062 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:11:34.062 DEBUG:teuthology.orchestra.run.smithi027:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:34.080 INFO:teuthology.orchestra.run.smithi027.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-03T10:11:34.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-03T10:11:34.081 DEBUG:teuthology.orchestra.run.smithi027:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:34.138 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-03T10:11:34.207 DEBUG:teuthology.orchestra.run.smithi027:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/sys 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/proc 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/dev 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/security 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/shm 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/pts 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/run 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup 2023-10-03T10:11:34.265 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/pstore 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/bpf 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/devices 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/memory 2023-10-03T10:11:34.266 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/pids 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/tracing 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/config 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/ 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/selinux 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/mqueue 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/debug 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/hugepages 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/fuse/connections 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:11:34.267 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/1000 2023-10-03T10:11:34.268 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/ceph 2023-10-03T10:11:34.268 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns 2023-10-03T10:11:34.268 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:11:34.268 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:11:34.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:34.269 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-03T10:11:34.326 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-03T10:11:34.326 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-03T10:11:34.368 DEBUG:teuthology.orchestra.run.smithi027:> sudo modprobe fuse 2023-10-03T10:11:34.396 DEBUG:teuthology.orchestra.run.smithi027:> cat /proc/self/mounts | awk '{print $2}' 2023-10-03T10:11:34.455 INFO:teuthology.orchestra.run.smithi027.stdout:/sys 2023-10-03T10:11:34.455 INFO:teuthology.orchestra.run.smithi027.stdout:/proc 2023-10-03T10:11:34.455 INFO:teuthology.orchestra.run.smithi027.stdout:/dev 2023-10-03T10:11:34.455 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/security 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/shm 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/pts 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/run 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/systemd 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/pstore 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/bpf 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/freezer 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/devices 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/blkio 2023-10-03T10:11:34.456 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/rdma 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/perf_event 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/hugetlb 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/memory 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/pids 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/cgroup/cpuset 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/tracing 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/config 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/ 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/selinux 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/mqueue 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/kernel/debug 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/proc/sys/fs/binfmt_misc 2023-10-03T10:11:34.457 INFO:teuthology.orchestra.run.smithi027.stdout:/dev/hugepages 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/sys/fs/fuse/connections 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/nfs/rpc_pipefs 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/run/user/1000 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/var/lib/ceph 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run.smithi027.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:11:34.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:34.458 DEBUG:teuthology.orchestra.run.smithi027:> ls /sys/fs/fuse/connections 2023-10-03T10:11:34.462 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:2023-10-03T10:11:34.462+0000 7f62c78303c0 -1 init, newargv = 0x559635def090 newargc=15 2023-10-03T10:11:34.463 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[112336]: starting ceph client 2023-10-03T10:11:34.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[112336]: starting fuse 2023-10-03T10:11:34.481 INFO:teuthology.orchestra.run.smithi027.stdout:46 2023-10-03T10:11:34.482 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> sudo stdin-killer -- python3 -c ' 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> import glob 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> import re 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> import os 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> import subprocess 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> def _find_admin_socket(client_name): 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-03T10:11:34.482 DEBUG:teuthology.orchestra.run.smithi027:> files = glob.glob(asok_path) 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> # Given a non-glob path, it better be there 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> if "*" not in asok_path: 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> assert(len(files) == 1) 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> return files[0] 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> for f in files: 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> contents = proc_f.read() 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> if mountpoint in contents: 2023-10-03T10:11:34.483 DEBUG:teuthology.orchestra.run.smithi027:> return f 2023-10-03T10:11:34.484 DEBUG:teuthology.orchestra.run.smithi027:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-03T10:11:34.484 DEBUG:teuthology.orchestra.run.smithi027:> 2023-10-03T10:11:34.484 DEBUG:teuthology.orchestra.run.smithi027:> print(_find_admin_socket("client.0")) 2023-10-03T10:11:34.485 DEBUG:teuthology.orchestra.run.smithi027:> ' 2023-10-03T10:11:34.607 INFO:teuthology.orchestra.run.smithi027.stdout:/var/run/ceph/ceph-client.0.112336.asok 2023-10-03T10:11:34.610 INFO:teuthology.orchestra.run.smithi027.stderr:2023-10-03T10:11:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-03T10:11:34.617 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112336.asok 2023-10-03T10:11:34.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:34.617 DEBUG:teuthology.orchestra.run.smithi027:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112336.asok status 2023-10-03T10:11:34.772 INFO:teuthology.orchestra.run.smithi027.stdout:{ 2023-10-03T10:11:34.772 INFO:teuthology.orchestra.run.smithi027.stdout: "metadata": { 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_sha1": "eeb13ac974775bd0cce96a2c687e8bcc2faca43d", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "ceph_version": "ceph version 16.2.14-44-geeb13ac9 (eeb13ac974775bd0cce96a2c687e8bcc2faca43d) pacific (stable)", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "entity_id": "0", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "hostname": "smithi027", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "pid": "112336", 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "root": "/" 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_count": 0, 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "dentry_pinned_count": 0, 2023-10-03T10:11:34.773 INFO:teuthology.orchestra.run.smithi027.stdout: "id": 4490, 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "inst": { 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "name": { 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "client", 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "num": 4490 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1850122934 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: } 2023-10-03T10:11:34.774 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": { 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "type": "v1", 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "addr": "172.21.15.27:0", 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "nonce": 1850122934 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: }, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "inst_str": "client.4490 172.21.15.27:0/1850122934", 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "addr_str": "172.21.15.27:0/1850122934", 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "inode_count": 1, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "mds_epoch": 6, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch": 18, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "osd_epoch_barrier": 0, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "blocklisted": false, 2023-10-03T10:11:34.775 INFO:teuthology.orchestra.run.smithi027.stdout: "fs_name": "cephfs" 2023-10-03T10:11:34.776 INFO:teuthology.orchestra.run.smithi027.stdout:} 2023-10-03T10:11:34.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:34.783 DEBUG:teuthology.orchestra.run.smithi027:> stat --file-system '--printf=%T 2023-10-03T10:11:34.783 DEBUG:teuthology.orchestra.run.smithi027:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:34.801 INFO:teuthology.orchestra.run.smithi027.stdout:fuseblk 2023-10-03T10:11:34.802 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:34.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:11:34.802 DEBUG:teuthology.orchestra.run.smithi027:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-03T10:11:34.869 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2023-10-03T10:11:34.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 Processor -- start 2023-10-03T10:11:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 -- start start 2023-10-03T10:11:35.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 0x7f397012ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 0x7f3970096500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397012abd0 con 0x7f397012b2f0 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970061780 con 0x7f397012b6d0 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.017+0000 7f3977c8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3970067530 con 0x7f39700613a0 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975227700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f397012b2f0 0x7f3970095df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59810/0 (socket says 172.21.15.19:59810) 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3976229700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 0x7f3970096500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975227700 1 -- 172.21.15.19:0/1779508275 learned_addr learned my addr 172.21.15.19:0/1779508275 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 0x7f397012ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3974a26700 1 -- 172.21.15.19:0/1779508275 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845545549 0 0) 0x7f397012abd0 con 0x7f397012b2f0 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 -- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 msgr2=0x7f3970096500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 0x7f3970096500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 -- 172.21.15.19:0/1779508275 >> v1:172.21.15.19:6789/0 conn(0x7f397012b2f0 legacy=0x7f3970095df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 -- 172.21.15.19:0/1779508275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700683c0 con 0x7f39700613a0 2023-10-03T10:11:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3976229700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 0x7f3970096500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3975a28700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 0x7f397012ae00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f396c0097c0 tx=0x7f396c009060).ready entity=mon.2 client_cookie=1565cd99c7a3941e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3974a26700 1 -- 172.21.15.19:0/1779508275 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00f510 con 0x7f39700613a0 2023-10-03T10:11:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3974a26700 1 -- 172.21.15.19:0/1779508275 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c00f670 con 0x7f39700613a0 2023-10-03T10:11:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.018+0000 7f3974a26700 1 -- 172.21.15.19:0/1779508275 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c00f9f0 con 0x7f39700613a0 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 -- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 msgr2=0x7f397012ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 0x7f397012ae00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f396c0097c0 tx=0x7f396c009060).stop 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 -- 172.21.15.19:0/1779508275 shutdown_connections 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b6d0 0x7f3970096500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 --2- 172.21.15.19:0/1779508275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39700613a0 0x7f397012ae00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 -- 172.21.15.19:0/1779508275 >> 172.21.15.19:0/1779508275 conn(0x7f397009a220 msgr2=0x7f397009a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 -- 172.21.15.19:0/1779508275 shutdown_connections 2023-10-03T10:11:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.019+0000 7f3977c8c700 1 -- 172.21.15.19:0/1779508275 wait complete. 2023-10-03T10:11:35.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 Processor -- start 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 -- start start 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 0x7f397011b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 0x7f39701171c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f397012b6d0 0x7f39701176b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970128320 con 0x7f39700613a0 2023-10-03T10:11:35.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970098ce0 con 0x7f397012b2f0 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3977c8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3970067130 con 0x7f397012b6d0 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.020+0000 7f3975a28700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 0x7f397011b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 0x7f39701171c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975a28700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 0x7f397011b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35946/0 (socket says 172.21.15.19:35946) 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975a28700 1 -- 172.21.15.19:0/409880628 learned_addr learned my addr 172.21.15.19:0/409880628 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:35.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3976229700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f397012b6d0 0x7f39701176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 -- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f397012b6d0 msgr2=0x7f39701176b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f397012b6d0 0x7f39701176b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 -- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 msgr2=0x7f397011b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 0x7f397011b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 -- 172.21.15.19:0/409880628 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009a20 con 0x7f397012b2f0 2023-10-03T10:11:35.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3975227700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 0x7f39701171c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3960000c00 tx=0x7f3960007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000ce20 con 0x7f397012b2f0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600072e0 con 0x7f397012b2f0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396c0092a0 con 0x7f397012b2f0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39600057a0 con 0x7f397012b2f0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.021+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970118fa0 con 0x7f397012b2f0 2023-10-03T10:11:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.022+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f3960005bd0 con 0x7f397012b2f0 2023-10-03T10:11:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.022+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f396003a660 con 0x7f397012b2f0 2023-10-03T10:11:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.023+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3970067730 con 0x7f397012b2f0 2023-10-03T10:11:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.027+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f396001d3f0 con 0x7f397012b2f0 2023-10-03T10:11:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.202+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f397005a260 con 0x7f397012b2f0 2023-10-03T10:11:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.203+0000 7f3965ffb700 1 -- 172.21.15.19:0/409880628 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f396001c350 con 0x7f397012b2f0 2023-10-03T10:11:35.204 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:35.204 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:32.425294+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 >> v1:172.21.15.19:6816/118286 conn(0x7f395402bb60 legacy=0x7f395402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 msgr2=0x7f39701171c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 0x7f39701171c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f3960000c00 tx=0x7f3960007b90).stop 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 shutdown_connections 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f397012b6d0 0x7f39701176b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39700613a0 0x7f397011b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 --2- 172.21.15.19:0/409880628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f397012b2f0 0x7f39701171c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 >> 172.21.15.19:0/409880628 conn(0x7f397009a220 msgr2=0x7f39701293c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 shutdown_connections 2023-10-03T10:11:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.205+0000 7f3977c8c700 1 -- 172.21.15.19:0/409880628 wait complete. 2023-10-03T10:11:35.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-03T10:11:35.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.351+0000 7f8323df0700 1 Processor -- start 2023-10-03T10:11:35.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.351+0000 7f8323df0700 1 -- start start 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8323df0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 0x7f831c098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8323df0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c12f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8323df0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c092d80 con 0x7f831c098c80 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8323df0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c093c20 con 0x7f831c093840 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8323df0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c092b90 con 0x7f831c12d160 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832238d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c12f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8321b8c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 0x7f831c098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832138b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f831c098c80 0x7f831c099090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59816/0 (socket says 172.21.15.19:59816) 2023-10-03T10:11:35.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832138b700 1 -- 172.21.15.19:0/2415823052 learned_addr learned my addr 172.21.15.19:0/2415823052 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832238d700 1 -- 172.21.15.19:0/2415823052 >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 msgr2=0x7f831c098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832238d700 1 --2- 172.21.15.19:0/2415823052 >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 0x7f831c098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f832238d700 1 -- 172.21.15.19:0/2415823052 >> v1:172.21.15.19:6789/0 conn(0x7f831c098c80 legacy=0x7f831c099090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.352+0000 7f8320b8a700 1 -- 172.21.15.19:0/2415823052 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 300415292 0 0) 0x7f831c092d80 con 0x7f831c098c80 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f832238d700 1 -- 172.21.15.19:0/2415823052 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c099b70 con 0x7f831c12d160 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8321b8c700 1 --2- 172.21.15.19:0/2415823052 >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 0x7f831c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f832238d700 1 --2- 172.21.15.19:0/2415823052 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c12f550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8314009e60 tx=0x7f8314009780).ready entity=mon.2 client_cookie=b28c0ec4480d96a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8320b8a700 1 -- 172.21.15.19:0/2415823052 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400e070 con 0x7f831c12d160 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8320b8a700 1 -- 172.21.15.19:0/2415823052 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831400bb60 con 0x7f831c12d160 2023-10-03T10:11:35.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8320b8a700 1 -- 172.21.15.19:0/2415823052 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314012410 con 0x7f831c12d160 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 -- 172.21.15.19:0/2415823052 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 msgr2=0x7f831c12f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 --2- 172.21.15.19:0/2415823052 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c12f550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f8314009e60 tx=0x7f8314009780).stop 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 -- 172.21.15.19:0/2415823052 shutdown_connections 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 --2- 172.21.15.19:0/2415823052 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c12f550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 --2- 172.21.15.19:0/2415823052 >> v2:172.21.15.19:3300/0 conn(0x7f831c093840 0x7f831c098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.353+0000 7f8323df0700 1 -- 172.21.15.19:0/2415823052 >> 172.21.15.19:0/2415823052 conn(0x7f831c097480 msgr2=0x7f831c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.354+0000 7f8323df0700 1 -- 172.21.15.19:0/2415823052 shutdown_connections 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.354+0000 7f8323df0700 1 -- 172.21.15.19:0/2415823052 wait complete. 2023-10-03T10:11:35.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.354+0000 7f8323df0700 1 Processor -- start 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 -- start start 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f831c098c80 0x7f831c066a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0673e0 con 0x7f831c093840 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0680a0 con 0x7f831c098c80 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8323df0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f831c068290 con 0x7f831c12d160 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35964/0 (socket says 172.21.15.19:35964) 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 -- 172.21.15.19:0/35638124 learned_addr learned my addr 172.21.15.19:0/35638124 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f832238d700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f832138b700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f831c098c80 0x7f831c066a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 -- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 msgr2=0x7f831c066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 -- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f831c098c80 msgr2=0x7f831c066a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f831c098c80 0x7f831c066a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f8321b8c700 1 -- 172.21.15.19:0/35638124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100092a0 con 0x7f831c093840 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.355+0000 7f832238d700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f8321b8c700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f831000ea50 tx=0x7f8310009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000ee90 con 0x7f831c093840 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310009600 con 0x7f831c093840 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314009a20 con 0x7f831c093840 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000ca60 con 0x7f831c093840 2023-10-03T10:11:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.356+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c06a520 con 0x7f831c093840 2023-10-03T10:11:35.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.357+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f831001b400 con 0x7f831c093840 2023-10-03T10:11:35.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.357+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f831003b410 con 0x7f831c093840 2023-10-03T10:11:35.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.357+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c05a260 con 0x7f831c093840 2023-10-03T10:11:35.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.362+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8310016070 con 0x7f831c093840 2023-10-03T10:11:35.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.535+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f831c11d400 con 0x7f831c093840 2023-10-03T10:11:35.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.535+0000 7f830dffb700 1 -- 172.21.15.19:0/35638124 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8310016020 con 0x7f831c093840 2023-10-03T10:11:35.536 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:11:35.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 >> v1:172.21.15.19:6816/118286 conn(0x7f830002bb90 legacy=0x7f830002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 msgr2=0x7f831c066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f831000ea50 tx=0x7f8310009060).stop 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 shutdown_connections 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f831c12d160 0x7f831c066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f831c093840 0x7f831c066510 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 --2- 172.21.15.19:0/35638124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f831c098c80 0x7f831c066a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 >> 172.21.15.19:0/35638124 conn(0x7f831c097480 msgr2=0x7f831c068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 shutdown_connections 2023-10-03T10:11:35.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.537+0000 7f8323df0700 1 -- 172.21.15.19:0/35638124 wait complete. 2023-10-03T10:11:35.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:11:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.683+0000 7f20aefac700 1 Processor -- start 2023-10-03T10:11:35.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.683+0000 7f20aefac700 1 -- start start 2023-10-03T10:11:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 0x7f20a8099060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a812c150 0x7f20a812e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a8093c20 con 0x7f20a812c150 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8092b90 con 0x7f20a8098c80 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20aefac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8092d80 con 0x7f20a8093840 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20acd48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20a812c150 0x7f20a812e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20a7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 0x7f20a8099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20acd48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57702/0 (socket says 172.21.15.19:57702) 2023-10-03T10:11:35.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20acd48700 1 -- 172.21.15.19:0/1873249791 learned_addr learned my addr 172.21.15.19:0/1873249791 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 -- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 msgr2=0x7f20a8098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 -- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 msgr2=0x7f20a8099060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 0x7f20a8099060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 -- 172.21.15.19:0/1873249791 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a8099b70 con 0x7f20a812c150 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20acd48700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20a7fff700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 0x7f20a8099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.684+0000 7f20ad549700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a812c150 0x7f20a812e540 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f20a0009e60 tx=0x7f20a0009780).ready entity=mon.0 client_cookie=254a268b3928eeba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20a77fe700 1 -- 172.21.15.19:0/1873249791 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000e070 con 0x7f20a812c150 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20a77fe700 1 -- 172.21.15.19:0/1873249791 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000bab0 con 0x7f20a812c150 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20a77fe700 1 -- 172.21.15.19:0/1873249791 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000be30 con 0x7f20a812c150 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 -- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a812c150 msgr2=0x7f20a812e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a812c150 0x7f20a812e540 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f20a0009e60 tx=0x7f20a0009780).stop 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 -- 172.21.15.19:0/1873249791 shutdown_connections 2023-10-03T10:11:35.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a812c150 0x7f20a812e540 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a8093840 0x7f20a8098790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 --2- 172.21.15.19:0/1873249791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8098c80 0x7f20a8099060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 -- 172.21.15.19:0/1873249791 >> 172.21.15.19:0/1873249791 conn(0x7f20a8097480 msgr2=0x7f20a8097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 -- 172.21.15.19:0/1873249791 shutdown_connections 2023-10-03T10:11:35.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.685+0000 7f20aefac700 1 -- 172.21.15.19:0/1873249791 wait complete. 2023-10-03T10:11:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.686+0000 7f20aefac700 1 Processor -- start 2023-10-03T10:11:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.686+0000 7f20aefac700 1 -- start start 2023-10-03T10:11:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8093840 0x7f20a81190a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a812c150 0x7f20a81158c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a806a520 con 0x7f20a8098c80 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8064c40 con 0x7f20a8093840 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20aefac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8119780 con 0x7f20a812c150 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20ad549700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a812c150 0x7f20a81158c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35972/0 (socket says 172.21.15.19:35972) 2023-10-03T10:11:35.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20acd48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8093840 0x7f20a81190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 -- 172.21.15.19:0/868920671 learned_addr learned my addr 172.21.15.19:0/868920671 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 -- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a812c150 msgr2=0x7f20a81158c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a812c150 0x7f20a81158c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 -- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8093840 msgr2=0x7f20a81190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8093840 0x7f20a81190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 -- 172.21.15.19:0/868920671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2098009370 con 0x7f20a8098c80 2023-10-03T10:11:35.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.687+0000 7f20a7fff700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f209000ede0 tx=0x7f209000b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209000db20 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209000dc80 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f209000b540 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090010440 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a0009a20 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.688+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f20900107f0 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.689+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f209003b830 con 0x7f20a8098c80 2023-10-03T10:11:35.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.689+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a805a260 con 0x7f20a8098c80 2023-10-03T10:11:35.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.693+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f2090019400 con 0x7f20a8098c80 2023-10-03T10:11:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.869+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f20a81161d0 con 0x7f20a8098c80 2023-10-03T10:11:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.869+0000 7f20a4ff9700 1 -- 172.21.15.19:0/868920671 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2090017310 con 0x7f20a8098c80 2023-10-03T10:11:35.871 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 >> v1:172.21.15.19:6816/118286 conn(0x7f208802bb90 legacy=0x7f208802e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 msgr2=0x7f20a81153d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f209000ede0 tx=0x7f209000b300).stop 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 shutdown_connections 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20a812c150 0x7f20a81158c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20a8093840 0x7f20a81190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 --2- 172.21.15.19:0/868920671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20a8098c80 0x7f20a81153d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:35.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 >> 172.21.15.19:0/868920671 conn(0x7f20a8097480 msgr2=0x7f20a81295f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:35.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 shutdown_connections 2023-10-03T10:11:35.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:35.872+0000 7f20aefac700 1 -- 172.21.15.19:0/868920671 wait complete. 2023-10-03T10:11:35.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:11:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 Processor -- start 2023-10-03T10:11:36.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 -- start start 2023-10-03T10:11:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f826c12c3c0 0x7f826c12bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 0x7f826c137140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826c09a050 con 0x7f826c0925d0 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826c06a750 con 0x7f826c12c3c0 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.018+0000 7f8273c18700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f826c12c1a0 con 0x7f826c12f540 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f826c12c3c0 0x7f826c12bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82721b5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 0x7f826c137140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82711b3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f826c0925d0 0x7f826c12ee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59826/0 (socket says 172.21.15.19:59826) 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82711b3700 1 -- 172.21.15.19:0/6661580 learned_addr learned my addr 172.21.15.19:0/6661580 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 -- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 msgr2=0x7f826c137140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 0x7f826c137140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 -- 172.21.15.19:0/6661580 >> v1:172.21.15.19:6789/0 conn(0x7f826c0925d0 legacy=0x7f826c12ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82709b2700 1 -- 172.21.15.19:0/6661580 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052792981 0 0) 0x7f826c09a050 con 0x7f826c0925d0 2023-10-03T10:11:36.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 -- 172.21.15.19:0/6661580 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c091ed0 con 0x7f826c12c3c0 2023-10-03T10:11:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82721b5700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 0x7f826c137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82719b4700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12c3c0 0x7f826c12bb80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8260009760 tx=0x7f8260009060).ready entity=mon.0 client_cookie=8f8e03b82af699fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82709b2700 1 -- 172.21.15.19:0/6661580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000f510 con 0x7f826c12c3c0 2023-10-03T10:11:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82709b2700 1 -- 172.21.15.19:0/6661580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826000f670 con 0x7f826c12c3c0 2023-10-03T10:11:36.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.019+0000 7f82709b2700 1 -- 172.21.15.19:0/6661580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000f9f0 con 0x7f826c12c3c0 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 -- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12c3c0 msgr2=0x7f826c12bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12c3c0 0x7f826c12bb80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8260009760 tx=0x7f8260009060).stop 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 -- 172.21.15.19:0/6661580 shutdown_connections 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12f540 0x7f826c137140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 --2- 172.21.15.19:0/6661580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12c3c0 0x7f826c12bb80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 -- 172.21.15.19:0/6661580 >> 172.21.15.19:0/6661580 conn(0x7f826c097480 msgr2=0x7f826c097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 -- 172.21.15.19:0/6661580 shutdown_connections 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.020+0000 7f8273c18700 1 -- 172.21.15.19:0/6661580 wait complete. 2023-10-03T10:11:36.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 Processor -- start 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 -- start start 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f826c0925d0 0x7f826c068530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12c3c0 0x7f826c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f826c12f100 con 0x7f826c12f540 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f826c09a280 con 0x7f826c0925d0 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.021+0000 7f8273c18700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f826c11a5b0 con 0x7f826c12c3c0 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82719b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f826c0925d0 0x7f826c068530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35994/0 (socket says 172.21.15.19:35994) 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 -- 172.21.15.19:0/1029415187 learned_addr learned my addr 172.21.15.19:0/1029415187 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:36.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82711b3700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12c3c0 0x7f826c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 -- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12c3c0 msgr2=0x7f826c068a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12c3c0 0x7f826c068a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 -- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f826c0925d0 msgr2=0x7f826c068530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f826c0925d0 0x7f826c068530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 -- 172.21.15.19:0/1029415187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8264009a20 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f82721b5700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8264009fc0 tx=0x7f826400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826400cbd0 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826400f040 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82600092a0 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.022+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8264013400 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.023+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826c11af70 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.023+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f82640137b0 con 0x7f826c12f540 2023-10-03T10:11:36.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.023+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f826403b830 con 0x7f826c12f540 2023-10-03T10:11:36.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.024+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826c064cb0 con 0x7f826c12f540 2023-10-03T10:11:36.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.028+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8264007da0 con 0x7f826c12f540 2023-10-03T10:11:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.200+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f826c05a260 con 0x7f826c12f540 2023-10-03T10:11:36.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.200+0000 7f825dffb700 1 -- 172.21.15.19:0/1029415187 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8264007340 con 0x7f826c12f540 2023-10-03T10:11:36.201 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:11:36.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 >> v1:172.21.15.19:6816/118286 conn(0x7f825002bb90 legacy=0x7f825002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 msgr2=0x7f826c068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8264009fc0 tx=0x7f826400b040).stop 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 shutdown_connections 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f826c12f540 0x7f826c068f10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f826c0925d0 0x7f826c068530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 --2- 172.21.15.19:0/1029415187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f826c12c3c0 0x7f826c068a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 >> 172.21.15.19:0/1029415187 conn(0x7f826c097480 msgr2=0x7f826c132190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 shutdown_connections 2023-10-03T10:11:36.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.202+0000 7f8273c18700 1 -- 172.21.15.19:0/1029415187 wait complete. 2023-10-03T10:11:36.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:11:36.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 Processor -- start 2023-10-03T10:11:36.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 -- start start 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c1012f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c10092d80 con 0x7f8c10093840 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10093c20 con 0x7f8c1012d160 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.348+0000 7f8c18517700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c10092b90 con 0x7f8c10098ea0 2023-10-03T10:11:36.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56894/0 (socket says 172.21.15.19:56894) 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c16ab4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c1012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 -- 172.21.15.19:0/3193588736 learned_addr learned my addr 172.21.15.19:0/3193588736 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 -- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 msgr2=0x7f8c1012f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c1012f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 -- 172.21.15.19:0/3193588736 >> v1:172.21.15.19:6789/0 conn(0x7f8c10093840 legacy=0x7f8c10098790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 -- 172.21.15.19:0/3193588736 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10099b70 con 0x7f8c10098ea0 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c152b1700 1 -- 172.21.15.19:0/3193588736 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152133187 0 0) 0x7f8c10092d80 con 0x7f8c10093840 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c16ab4700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c1012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c15ab2700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8c00009830 tx=0x7f8c000090f0).ready entity=mon.2 client_cookie=4987583f0349113b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c152b1700 1 -- 172.21.15.19:0/3193588736 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000b580 con 0x7f8c10098ea0 2023-10-03T10:11:36.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c152b1700 1 -- 172.21.15.19:0/3193588736 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0000b6e0 con 0x7f8c10098ea0 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.349+0000 7f8c152b1700 1 -- 172.21.15.19:0/3193588736 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0000ba60 con 0x7f8c10098ea0 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 -- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 msgr2=0x7f8c10099280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8c00009830 tx=0x7f8c000090f0).stop 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 -- 172.21.15.19:0/3193588736 shutdown_connections 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c1012f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 --2- 172.21.15.19:0/3193588736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10098ea0 0x7f8c10099280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 -- 172.21.15.19:0/3193588736 >> 172.21.15.19:0/3193588736 conn(0x7f8c10097480 msgr2=0x7f8c10097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 -- 172.21.15.19:0/3193588736 shutdown_connections 2023-10-03T10:11:36.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.350+0000 7f8c18517700 1 -- 172.21.15.19:0/3193588736 wait complete. 2023-10-03T10:11:36.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.351+0000 7f8c18517700 1 Processor -- start 2023-10-03T10:11:36.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.351+0000 7f8c18517700 1 -- start start 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.351+0000 7f8c18517700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 0x7f8c10138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.351+0000 7f8c18517700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 0x7f8c10138c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1011bcc0 con 0x7f8c10098ea0 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1012d540 con 0x7f8c1012d160 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1006a520 con 0x7f8c10093840 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c162b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 0x7f8c10138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c15ab2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 0x7f8c10138c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c15ab2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 0x7f8c10138c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35314/0 (socket says 172.21.15.19:35314) 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c162b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 0x7f8c10138780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56898/0 (socket says 172.21.15.19:56898) 2023-10-03T10:11:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c15ab2700 1 -- 172.21.15.19:0/2674120515 learned_addr learned my addr 172.21.15.19:0/2674120515 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53076/0 (socket says 172.21.15.19:53076) 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 -- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 msgr2=0x7f8c10138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 0x7f8c10138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 -- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 msgr2=0x7f8c10138c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 0x7f8c10138c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 -- 172.21.15.19:0/2674120515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08009a20 con 0x7f8c1012d160 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c16ab4700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8c08009ed0 tx=0x7f8c0800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800cb70 con 0x7f8c1012d160 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c0800f040 con 0x7f8c1012d160 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c00009370 con 0x7f8c1012d160 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08013400 con 0x7f8c1012d160 2023-10-03T10:11:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.352+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c10119e30 con 0x7f8c1012d160 2023-10-03T10:11:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.353+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1011b940 con 0x7f8c1012d160 2023-10-03T10:11:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.354+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f8c080137b0 con 0x7f8c1012d160 2023-10-03T10:11:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.354+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f8c0803c140 con 0x7f8c1012d160 2023-10-03T10:11:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.358+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f8c08007340 con 0x7f8c1012d160 2023-10-03T10:11:36.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.534+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c1011b940 con 0x7f8c1012d160 2023-10-03T10:11:36.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.534+0000 7f8c067fc700 1 -- 172.21.15.19:0/2674120515 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c1011b940 con 0x7f8c1012d160 2023-10-03T10:11:36.535 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:11:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 >> v1:172.21.15.19:6816/118286 conn(0x7f8bf402bb30 legacy=0x7f8bf402dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 msgr2=0x7f8c10118220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8c08009ed0 tx=0x7f8c0800b040).stop 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 shutdown_connections 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c1012d160 0x7f8c10118220 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c10093840 0x7f8c10138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 --2- 172.21.15.19:0/2674120515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c10098ea0 0x7f8c10138c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 >> 172.21.15.19:0/2674120515 conn(0x7f8c10097480 msgr2=0x7f8c10068b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 shutdown_connections 2023-10-03T10:11:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.536+0000 7f8c18517700 1 -- 172.21.15.19:0/2674120515 wait complete. 2023-10-03T10:11:36.550 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:36.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.680+0000 7f6ec3158700 1 Processor -- start 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.680+0000 7f6ec3158700 1 -- start start 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec3158700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec3158700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec3158700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc096760 con 0x7f6ebc091b00 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec3158700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc091ff0 con 0x7f6ebc096380 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec3158700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc092c80 con 0x7f6ebc094c20 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec0ef4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53092/0 (socket says 172.21.15.19:53092) 2023-10-03T10:11:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec0ef4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35326/0 (socket says 172.21.15.19:35326) 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 -- 172.21.15.19:0/1053364157 learned_addr learned my addr 172.21.15.19:0/1053364157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ebb7fe700 1 -- 172.21.15.19:0/1053364157 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813874951 0 0) 0x7f6ebc096760 con 0x7f6ebc091b00 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 -- 172.21.15.19:0/1053364157 >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 msgr2=0x7f6ebc094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 --2- 172.21.15.19:0/1053364157 >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 -- 172.21.15.19:0/1053364157 >> v1:172.21.15.19:6789/0 conn(0x7f6ebc091b00 legacy=0x7f6ebc127600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 -- 172.21.15.19:0/1053364157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc093900 con 0x7f6ebc094c20 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec0ef4700 1 --2- 172.21.15.19:0/1053364157 >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.681+0000 7f6ec16f5700 1 --2- 172.21.15.19:0/1053364157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6eb4009f20 tx=0x7f6eb4009840).ready entity=mon.1 client_cookie=2700804d87cd6a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ebb7fe700 1 -- 172.21.15.19:0/1053364157 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400e070 con 0x7f6ebc094c20 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ebb7fe700 1 -- 172.21.15.19:0/1053364157 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb400b9d0 con 0x7f6ebc094c20 2023-10-03T10:11:36.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ebb7fe700 1 -- 172.21.15.19:0/1053364157 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400bd50 con 0x7f6ebc094c20 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 -- 172.21.15.19:0/1053364157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 msgr2=0x7f6ebc127d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 --2- 172.21.15.19:0/1053364157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f6eb4009f20 tx=0x7f6eb4009840).stop 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 -- 172.21.15.19:0/1053364157 shutdown_connections 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 --2- 172.21.15.19:0/1053364157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc127d10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 --2- 172.21.15.19:0/1053364157 >> v2:172.21.15.19:3300/0 conn(0x7f6ebc096380 0x7f6ebc094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 -- 172.21.15.19:0/1053364157 >> 172.21.15.19:0/1053364157 conn(0x7f6ebc097470 msgr2=0x7f6ebc097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 -- 172.21.15.19:0/1053364157 shutdown_connections 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.682+0000 7f6ec3158700 1 -- 172.21.15.19:0/1053364157 wait complete. 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.683+0000 7f6ec3158700 1 Processor -- start 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.683+0000 7f6ec3158700 1 -- start start 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ebc091b00 0x7f6ebc12e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 0x7f6ebc12eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc112700 con 0x7f6ebc096380 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc098b10 con 0x7f6ebc094c20 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec3158700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc124c70 con 0x7f6ebc091b00 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec16f5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 0x7f6ebc12eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53104/0 (socket says 172.21.15.19:53104) 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 -- 172.21.15.19:0/3709722003 learned_addr learned my addr 172.21.15.19:0/3709722003 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec0ef4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ebc091b00 0x7f6ebc12e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 -- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ebc091b00 msgr2=0x7f6ebc12e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ebc091b00 0x7f6ebc12e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 -- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 msgr2=0x7f6ebc12eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 0x7f6ebc12eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ebbfff700 1 -- 172.21.15.19:0/3709722003 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eac0092a0 con 0x7f6ebc094c20 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.684+0000 7f6ec16f5700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 0x7f6ebc12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6ebbfff700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6ea4007fd0 tx=0x7f6ea4007c20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400ce10 con 0x7f6ebc094c20 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea400f470 con 0x7f6ebc094c20 2023-10-03T10:11:36.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb4009ae0 con 0x7f6ebc094c20 2023-10-03T10:11:36.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400f830 con 0x7f6ebc094c20 2023-10-03T10:11:36.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc111170 con 0x7f6ebc094c20 2023-10-03T10:11:36.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.685+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f6ea400fba0 con 0x7f6ebc094c20 2023-10-03T10:11:36.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.686+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f6ea403a4a0 con 0x7f6ebc094c20 2023-10-03T10:11:36.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.686+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc05a260 con 0x7f6ebc094c20 2023-10-03T10:11:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.691+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f6ea4012400 con 0x7f6ebc094c20 2023-10-03T10:11:36.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.909+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ebc094320 con 0x7f6ebc094c20 2023-10-03T10:11:36.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.909+0000 7f6eb8ff9700 1 -- 172.21.15.19:0/3709722003 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2154 (secure 0 0 0) 0x7f6ea4010300 con 0x7f6ebc094c20 2023-10-03T10:11:36.910 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:36.910 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:16.244692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 >> v1:172.21.15.19:6816/118286 conn(0x7f6e9c02bb60 legacy=0x7f6e9c02e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 msgr2=0x7f6ebc12e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6ea4007fd0 tx=0x7f6ea4007c20).stop 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 shutdown_connections 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ebc096380 0x7f6ebc12eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ebc091b00 0x7f6ebc12e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 --2- 172.21.15.19:0/3709722003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ebc094c20 0x7f6ebc12e9f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.911+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 >> 172.21.15.19:0/3709722003 conn(0x7f6ebc097470 msgr2=0x7f6ebc127640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.912+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 shutdown_connections 2023-10-03T10:11:36.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:36.912+0000 7f6ec3158700 1 -- 172.21.15.19:0/3709722003 wait complete. 2023-10-03T10:11:36.914 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2023-10-03T10:11:36.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:11:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.054+0000 7f378b5c0700 1 Processor -- start 2023-10-03T10:11:37.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.054+0000 7f378b5c0700 1 -- start start 2023-10-03T10:11:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378b5c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378b5c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378b5c0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3784091b60 con 0x7f3784095370 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378b5c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784096940 con 0x7f3784059070 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378b5c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3784059c00 con 0x7f3784127390 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3788b5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3789b5d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3784095370 0x7f37840957f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39966/0 (socket says 172.21.15.19:39966) 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3789b5d700 1 -- 172.21.15.19:0/3781866676 learned_addr learned my addr 172.21.15.19:0/3781866676 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3788b5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56912/0 (socket says 172.21.15.19:56912) 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53116/0 (socket says 172.21.15.19:53116) 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3777fff700 1 -- 172.21.15.19:0/3781866676 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870918219 0 0) 0x7f3784091b60 con 0x7f3784095370 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3777fff700 1 -- 172.21.15.19:0/3781866676 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37700033f0 con 0x7f3784095370 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 -- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 msgr2=0x7f3784127d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 -- 172.21.15.19:0/3781866676 >> v1:172.21.15.19:6789/0 conn(0x7f3784095370 legacy=0x7f37840957f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 -- 172.21.15.19:0/3781866676 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37840929d0 con 0x7f3784059070 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f3788b5b700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.055+0000 7f378935c700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f37780097c0 tx=0x7f3778009060).ready entity=mon.1 client_cookie=aca63a52f7e896a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f3777fff700 1 -- 172.21.15.19:0/3781866676 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780090d0 con 0x7f3784059070 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f3777fff700 1 -- 172.21.15.19:0/3781866676 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377800d4a0 con 0x7f3784059070 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f3777fff700 1 -- 172.21.15.19:0/3781866676 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377800d820 con 0x7f3784059070 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 -- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 msgr2=0x7f3784127890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f37780097c0 tx=0x7f3778009060).stop 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 -- 172.21.15.19:0/3781866676 shutdown_connections 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784127890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 --2- 172.21.15.19:0/3781866676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784127d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 -- 172.21.15.19:0/3781866676 >> 172.21.15.19:0/3781866676 conn(0x7f3784097470 msgr2=0x7f3784097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 -- 172.21.15.19:0/3781866676 shutdown_connections 2023-10-03T10:11:37.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.056+0000 7f378b5c0700 1 -- 172.21.15.19:0/3781866676 wait complete. 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.057+0000 7f378b5c0700 1 Processor -- start 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.057+0000 7f378b5c0700 1 -- start start 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784117880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 0x7f3784113850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37841249b0 con 0x7f3784095370 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3784125430 con 0x7f3784059070 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378b5c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3784096f20 con 0x7f3784127390 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3788b5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 0x7f3784113850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3788b5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 0x7f3784113850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35348/0 (socket says 172.21.15.19:35348) 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56928/0 (socket says 172.21.15.19:56928) 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3788b5b700 1 -- 172.21.15.19:0/2470412508 learned_addr learned my addr 172.21.15.19:0/2470412508 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f378935c700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784117880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 -- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 msgr2=0x7f3784117880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784117880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 -- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 msgr2=0x7f3784113850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 0x7f3784113850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.058+0000 7f3789b5d700 1 -- 172.21.15.19:0/2470412508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800092a0 con 0x7f3784127390 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f3789b5d700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f377c00c790 tx=0x7f377c007f10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c005d30 con 0x7f3784127390 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c005e90 con 0x7f3784127390 2023-10-03T10:11:37.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37780092a0 con 0x7f3784127390 2023-10-03T10:11:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c0072e0 con 0x7f3784127390 2023-10-03T10:11:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.059+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3784115470 con 0x7f3784127390 2023-10-03T10:11:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.060+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3784099c90 con 0x7f3784127390 2023-10-03T10:11:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.060+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f377c0076d0 con 0x7f3784127390 2023-10-03T10:11:37.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.061+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f377c03ad70 con 0x7f3784127390 2023-10-03T10:11:37.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.065+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f377c007980 con 0x7f3784127390 2023-10-03T10:11:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.238+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f378405a260 con 0x7f3784127390 2023-10-03T10:11:37.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.239+0000 7f37757fa700 1 -- 172.21.15.19:0/2470412508 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+11340 (secure 0 0 0) 0x7f377c011b40 con 0x7f3784127390 2023-10-03T10:11:37.240 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:37.240 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":18,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:11:32.425294+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:11:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 >> v1:172.21.15.19:6816/118286 conn(0x7f376802bb60 legacy=0x7f376802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 msgr2=0x7f3784113d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f377c00c790 tx=0x7f377c007f10).stop 2023-10-03T10:11:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 shutdown_connections 2023-10-03T10:11:37.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3784127390 0x7f3784113d40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3784059070 0x7f3784117880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 --2- 172.21.15.19:0/2470412508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3784095370 0x7f3784113850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 >> 172.21.15.19:0/2470412508 conn(0x7f3784097470 msgr2=0x7f3784094240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 shutdown_connections 2023-10-03T10:11:37.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.241+0000 7f378b5c0700 1 -- 172.21.15.19:0/2470412508 wait complete. 2023-10-03T10:11:37.255 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-03T10:11:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.388+0000 7f156c99b700 1 Processor -- start 2023-10-03T10:11:37.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.388+0000 7f156c99b700 1 -- start start 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156c99b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156c99b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1568127be0 0x7f1568128000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156c99b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1568091c80 con 0x7f156812a9a0 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156c99b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1568099dd0 con 0x7f1568127be0 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156c99b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15680999d0 con 0x7f15680926d0 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53140/0 (socket says 172.21.15.19:53140) 2023-10-03T10:11:37.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f1565d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1568127be0 0x7f1568128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f156659c700 1 -- 172.21.15.19:0/2559754014 learned_addr learned my addr 172.21.15.19:0/2559754014 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.389+0000 7f1566d9d700 1 --1- 172.21.15.19:0/2559754014 >> v1:172.21.15.19:6789/0 conn(0x7f156812a9a0 0x7f156812ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39982/0 (socket says 172.21.15.19:39982) 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f1565d9b700 1 -- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 msgr2=0x7f15681275c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f1565d9b700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f1565d9b700 1 -- 172.21.15.19:0/2559754014 >> v1:172.21.15.19:6789/0 conn(0x7f156812a9a0 legacy=0x7f156812ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f1565d9b700 1 -- 172.21.15.19:0/2559754014 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156809a280 con 0x7f1568127be0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f156559a700 1 -- 172.21.15.19:0/2559754014 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503211044 0 0) 0x7f1568091c80 con 0x7f156812a9a0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f156659c700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f1565d9b700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1568127be0 0x7f1568128000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f155c009760 tx=0x7f155c009060).ready entity=mon.0 client_cookie=5d59cd9b702d67cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f156559a700 1 -- 172.21.15.19:0/2559754014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00f510 con 0x7f1568127be0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f156559a700 1 -- 172.21.15.19:0/2559754014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c00f670 con 0x7f1568127be0 2023-10-03T10:11:37.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.390+0000 7f156559a700 1 -- 172.21.15.19:0/2559754014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c00f9f0 con 0x7f1568127be0 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 -- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1568127be0 msgr2=0x7f1568128000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1568127be0 0x7f1568128000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f155c009760 tx=0x7f155c009060).stop 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 -- 172.21.15.19:0/2559754014 shutdown_connections 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15680926d0 0x7f15681275c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 --2- 172.21.15.19:0/2559754014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1568127be0 0x7f1568128000 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 -- 172.21.15.19:0/2559754014 >> 172.21.15.19:0/2559754014 conn(0x7f1568097480 msgr2=0x7f1568097890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 -- 172.21.15.19:0/2559754014 shutdown_connections 2023-10-03T10:11:37.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.391+0000 7f156c99b700 1 -- 172.21.15.19:0/2559754014 wait complete. 2023-10-03T10:11:37.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 Processor -- start 2023-10-03T10:11:37.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 -- start start 2023-10-03T10:11:37.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1568127be0 0x7f1568113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f156812a9a0 0x7f1568113f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1568124b00 con 0x7f15680926d0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156809a4b0 con 0x7f1568127be0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156c99b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15681174d0 con 0x7f156812a9a0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35358/0 (socket says 172.21.15.19:35358) 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f156659c700 1 -- 172.21.15.19:0/3052080500 learned_addr learned my addr 172.21.15.19:0/3052080500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f1565d9b700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1568127be0 0x7f1568113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.392+0000 7f1566d9d700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f156812a9a0 0x7f1568113f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:37.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 -- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f156812a9a0 msgr2=0x7f1568113f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f156812a9a0 0x7f1568113f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 -- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1568127be0 msgr2=0x7f1568113a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1568127be0 0x7f1568113a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 -- 172.21.15.19:0/3052080500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009370 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156659c700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f155800ea20 tx=0x7f15580090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800ee60 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155800c850 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c0092a0 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155800cbd0 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.393+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15681155c0 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.394+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7f155801b400 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.394+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7f155803b520 con 0x7f15680926d0 2023-10-03T10:11:37.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.394+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156805a260 con 0x7f15680926d0 2023-10-03T10:11:37.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.399+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7f1558016070 con 0x7f15680926d0 2023-10-03T10:11:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:37.617+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1568046c20 con 0x7f15680926d0 2023-10-03T10:11:38.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.450+0000 7f15567fc700 1 -- 172.21.15.19:0/3052080500 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1558016020 con 0x7f15680926d0 2023-10-03T10:11:38.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 >> v1:172.21.15.19:6816/118286 conn(0x7f154802bb60 legacy=0x7f154802e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 msgr2=0x7f15681179d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f155800ea20 tx=0x7f15580090f0).stop 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 shutdown_connections 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f156812a9a0 0x7f1568113f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15680926d0 0x7f15681179d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 --2- 172.21.15.19:0/3052080500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1568127be0 0x7f1568113a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 >> 172.21.15.19:0/3052080500 conn(0x7f1568097480 msgr2=0x7f1568095d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 shutdown_connections 2023-10-03T10:11:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.453+0000 7f156c99b700 1 -- 172.21.15.19:0/3052080500 wait complete. 2023-10-03T10:11:38.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2023-10-03T10:11:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.605+0000 7fe8cd737700 1 Processor -- start 2023-10-03T10:11:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.605+0000 7fe8cd737700 1 -- start start 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8cd737700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8cd737700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8cd737700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c8067620 con 0x7fe8c8097610 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8cd737700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c806a4e0 con 0x7fe8c8096470 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8cd737700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80690d0 con 0x7fe8c8096d40 2023-10-03T10:11:38.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56954/0 (socket says 172.21.15.19:56954) 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53156/0 (socket says 172.21.15.19:53156) 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8c8097610 0x7fe8c812f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39988/0 (socket says 172.21.15.19:39988) 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c67fc700 1 -- 172.21.15.19:0/722626901 learned_addr learned my addr 172.21.15.19:0/722626901 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 -- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 msgr2=0x7fe8c8097120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 -- 172.21.15.19:0/722626901 >> v1:172.21.15.19:6789/0 conn(0x7fe8c8097610 legacy=0x7fe8c812f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 -- 172.21.15.19:0/722626901 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8095e60 con 0x7fe8c8096470 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c67fc700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.606+0000 7fe8c6ffd700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe8b8009790 tx=0x7fe8b8009060).ready entity=mon.1 client_cookie=47a8681fe3f7c95a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8c5ffb700 1 -- 172.21.15.19:0/722626901 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80090d0 con 0x7fe8c8096470 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8c5ffb700 1 -- 172.21.15.19:0/722626901 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b800d4a0 con 0x7fe8c8096470 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8c5ffb700 1 -- 172.21.15.19:0/722626901 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800d820 con 0x7fe8c8096470 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 -- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 msgr2=0x7fe8c8096850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fe8b8009790 tx=0x7fe8b8009060).stop 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 -- 172.21.15.19:0/722626901 shutdown_connections 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8096850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 --2- 172.21.15.19:0/722626901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8097120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 -- 172.21.15.19:0/722626901 >> 172.21.15.19:0/722626901 conn(0x7fe8c809ba50 msgr2=0x7fe8c809be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 -- 172.21.15.19:0/722626901 shutdown_connections 2023-10-03T10:11:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.607+0000 7fe8cd737700 1 -- 172.21.15.19:0/722626901 wait complete. 2023-10-03T10:11:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.608+0000 7fe8cd737700 1 Processor -- start 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.608+0000 7fe8cd737700 1 -- start start 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8138160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8138650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 0x7fe8c8138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c811bed0 con 0x7fe8c8097610 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8067d30 con 0x7fe8c8096470 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8cd737700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8091e30 con 0x7fe8c8096d40 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8138160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8138160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53158/0 (socket says 172.21.15.19:53158) 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c6ffd700 1 -- 172.21.15.19:0/1135769057 learned_addr learned my addr 172.21.15.19:0/1135769057 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c77fe700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 0x7fe8c8138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 -- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 msgr2=0x7fe8c8138160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8138160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 -- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 msgr2=0x7fe8c8138b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 0x7fe8c8138b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 -- 172.21.15.19:0/1135769057 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009370 con 0x7fe8c8096d40 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c77fe700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 0x7fe8c8138b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.609+0000 7fe8c67fc700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8138650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe8bc00ea30 tx=0x7fe8bc0090f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00ee70 con 0x7fe8c8096d40 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc00c850 con 0x7fe8c8096d40 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b80092a0 con 0x7fe8c8096d40 2023-10-03T10:11:38.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00cbd0 con 0x7fe8c8096d40 2023-10-03T10:11:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c811c6e0 con 0x7fe8c8096d40 2023-10-03T10:11:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.610+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe8bc01b400 con 0x7fe8c8096d40 2023-10-03T10:11:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.611+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe8bc03b360 con 0x7fe8c8096d40 2023-10-03T10:11:38.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.611+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c811c6e0 con 0x7fe8c8096d40 2023-10-03T10:11:38.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.616+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fe8c811c6e0 con 0x7fe8c8096d40 2023-10-03T10:11:38.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:38.835+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe8c811c6e0 con 0x7fe8c8096d40 2023-10-03T10:11:39.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.452+0000 7fe8aeffd700 1 -- 172.21.15.19:0/1135769057 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe8c811c6e0 con 0x7fe8c8096d40 2023-10-03T10:11:39.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.455+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 >> v1:172.21.15.19:6816/118286 conn(0x7fe8b402bb60 legacy=0x7fe8b402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.455+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 msgr2=0x7fe8c8138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.455+0000 7fe8cd737700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8138650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe8bc00ea30 tx=0x7fe8bc0090f0).stop 2023-10-03T10:11:39.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 shutdown_connections 2023-10-03T10:11:39.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c8097610 0x7fe8c8138b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c8096470 0x7fe8c8138160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 --2- 172.21.15.19:0/1135769057 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c8096d40 0x7fe8c8138650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 >> 172.21.15.19:0/1135769057 conn(0x7fe8c809ba50 msgr2=0x7fe8c809a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 shutdown_connections 2023-10-03T10:11:39.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.456+0000 7fe8cd737700 1 -- 172.21.15.19:0/1135769057 wait complete. 2023-10-03T10:11:39.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:11:39.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.604+0000 7fd204da7700 1 Processor -- start 2023-10-03T10:11:39.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.604+0000 7fd204da7700 1 -- start start 2023-10-03T10:11:39.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd200067940 0x7fd2000970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd20012f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd200068df0 con 0x7fd200067940 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20006a4c0 con 0x7fd200096820 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd204da7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd200098260 con 0x7fd2000975e0 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd200067940 0x7fd2000970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fe59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd20012f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fe59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53166/0 (socket says 172.21.15.19:53166) 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd200067940 0x7fd2000970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35368/0 (socket says 172.21.15.19:35368) 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fe59c700 1 -- 172.21.15.19:0/1084963764 learned_addr learned my addr 172.21.15.19:0/1084963764 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 -- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 msgr2=0x7fd20012f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd20012f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 -- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 msgr2=0x7fd200096c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fdd9b700 1 -- 172.21.15.19:0/1084963764 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd200095e60 con 0x7fd200067940 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.605+0000 7fd1fe59c700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd1fdd9b700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd2000970f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd1e8009760 tx=0x7fd1e8009060).ready entity=mon.0 client_cookie=6116eca9cbbcd154 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd1fd59a700 1 -- 172.21.15.19:0/1084963764 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800d4a0 con 0x7fd200067940 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd1fd59a700 1 -- 172.21.15.19:0/1084963764 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800d600 con 0x7fd200067940 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd1fd59a700 1 -- 172.21.15.19:0/1084963764 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800d980 con 0x7fd200067940 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 -- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 msgr2=0x7fd2000970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd2000970f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fd1e8009760 tx=0x7fd1e8009060).stop 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 -- 172.21.15.19:0/1084963764 shutdown_connections 2023-10-03T10:11:39.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd200096c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd20012f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 --2- 172.21.15.19:0/1084963764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd2000970f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 -- 172.21.15.19:0/1084963764 >> 172.21.15.19:0/1084963764 conn(0x7fd20009ba50 msgr2=0x7fd20009be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 -- 172.21.15.19:0/1084963764 shutdown_connections 2023-10-03T10:11:39.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.606+0000 7fd204da7700 1 -- 172.21.15.19:0/1084963764 wait complete. 2023-10-03T10:11:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.607+0000 7fd204da7700 1 Processor -- start 2023-10-03T10:11:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.607+0000 7fd204da7700 1 -- start start 2023-10-03T10:11:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd20013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd200064540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20011dff0 con 0x7fd200067940 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd200091de0 con 0x7fd200096820 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd204da7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd200067e30 con 0x7fd2000975e0 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fdd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd20013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fdd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53174/0 (socket says 172.21.15.19:53174) 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd200064540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fdd9b700 1 -- 172.21.15.19:0/2052877008 learned_addr learned my addr 172.21.15.19:0/2052877008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 -- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 msgr2=0x7fd200064540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd200064540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 -- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 msgr2=0x7fd20013acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 -- 172.21.15.19:0/2052877008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0009370 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fdd9b700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.608+0000 7fd1fe59c700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd20013a800 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd1f000ea00 tx=0x7fd1f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000c6a0 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f000c800 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e80092a0 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f000cb80 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20011e660 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.609+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fd1f001b400 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.610+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fd1f003b510 con 0x7fd200067940 2023-10-03T10:11:39.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.610+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20009b530 con 0x7fd200067940 2023-10-03T10:11:39.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.614+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+156992 (secure 0 0 0) 0x7fd1f0019900 con 0x7fd200067940 2023-10-03T10:11:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.833+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd20011de10 con 0x7fd200067940 2023-10-03T10:11:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.834+0000 7fd1f67fc700 1 -- 172.21.15.19:0/2052877008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2154 (secure 0 0 0) 0x7fd1f002a090 con 0x7fd200067940 2023-10-03T10:11:39.838 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:11:39.838 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:39.450921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-03T10:11:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 >> v1:172.21.15.19:6816/118286 conn(0x7fd1e002bb90 legacy=0x7fd1e002e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 msgr2=0x7fd20013a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd20013a800 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd1f000ea00 tx=0x7fd1f00090f0).stop 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 shutdown_connections 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2000975e0 0x7fd200064540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd200067940 0x7fd20013a800 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 --2- 172.21.15.19:0/2052877008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd200096820 0x7fd20013acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 >> 172.21.15.19:0/2052877008 conn(0x7fd20009ba50 msgr2=0x7fd2001120d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 shutdown_connections 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:39.836+0000 7fd204da7700 1 -- 172.21.15.19:0/2052877008 wait complete. 2023-10-03T10:11:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2023-10-03T10:11:39.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:11:13.232209+0000', 'modified': '2023-10-03T10:11:39.450921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6817/497268310', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.19:6817', 'nonce': 497268310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-03T10:11:39.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:11:39.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:11:40.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 Processor -- start 2023-10-03T10:11:40.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 -- start start 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408094730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe408091b00 0x7fe408127600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe408096760 con 0x7fe408091b00 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408091ff0 con 0x7fe408094c20 2023-10-03T10:11:40.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40efcb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe408092c80 con 0x7fe408096380 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe407fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe408091b00 0x7fe408127600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53188/0 (socket says 172.21.15.19:53188) 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe407fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe408091b00 0x7fe408127600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35396/0 (socket says 172.21.15.19:35396) 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408094730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.088+0000 7fe40d568700 1 -- 172.21.15.19:0/3749203225 learned_addr learned my addr 172.21.15.19:0/3749203225 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 -- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 msgr2=0x7fe408094730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408094730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 -- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 msgr2=0x7fe408127af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 -- 172.21.15.19:0/3749203225 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408093900 con 0x7fe408091b00 2023-10-03T10:11:40.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe40d568700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe407fff700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408127600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fe3fc009760 tx=0x7fe3fc009060).ready entity=mon.0 client_cookie=b4c59ca0e0487028 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe4077fe700 1 -- 172.21.15.19:0/3749203225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc00d4a0 con 0x7fe408091b00 2023-10-03T10:11:40.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe4077fe700 1 -- 172.21.15.19:0/3749203225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3fc00d600 con 0x7fe408091b00 2023-10-03T10:11:40.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.089+0000 7fe4077fe700 1 -- 172.21.15.19:0/3749203225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc00d980 con 0x7fe408091b00 2023-10-03T10:11:40.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 -- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 msgr2=0x7fe408127600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408127600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fe3fc009760 tx=0x7fe3fc009060).stop 2023-10-03T10:11:40.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 -- 172.21.15.19:0/3749203225 shutdown_connections 2023-10-03T10:11:40.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe408127af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408094730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 --2- 172.21.15.19:0/3749203225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408127600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 -- 172.21.15.19:0/3749203225 >> 172.21.15.19:0/3749203225 conn(0x7fe408097470 msgr2=0x7fe408097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 -- 172.21.15.19:0/3749203225 shutdown_connections 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.090+0000 7fe40efcb700 1 -- 172.21.15.19:0/3749203225 wait complete. 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.091+0000 7fe40efcb700 1 Processor -- start 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.091+0000 7fe40efcb700 1 -- start start 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe4081175f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408117ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe408119760 con 0x7fe408091b00 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408127cf0 con 0x7fe408094c20 2023-10-03T10:11:40.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe40806a520 con 0x7fe408096380 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35398/0 (socket says 172.21.15.19:35398) 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408117ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40cd67700 1 -- 172.21.15.19:0/573701815 learned_addr learned my addr 172.21.15.19:0/573701815 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe407fff700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe4081175f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 -- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 msgr2=0x7fe4081175f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe4081175f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 -- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 msgr2=0x7fe408117100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 -- 172.21.15.19:0/573701815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40000bcf0 con 0x7fe408096380 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40cd67700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40d568700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408117ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe40000e470 tx=0x7fe40000d040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe404ff9700 1 -- 172.21.15.19:0/573701815 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400010040 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe404ff9700 1 -- 172.21.15.19:0/573701815 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40000ee80 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0092a0 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe404ff9700 1 -- 172.21.15.19:0/573701815 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000b320 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.092+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe408118d20 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.093+0000 7fe404ff9700 1 -- 172.21.15.19:0/573701815 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 4) v1 ==== 31548+0+0 (secure 0 0 0) 0x7fe400009820 con 0x7fe408096380 2023-10-03T10:11:40.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.093+0000 7fe404ff9700 1 -- 172.21.15.19:0/573701815 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe40003b890 con 0x7fe408096380 2023-10-03T10:11:40.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.096+0000 7fe42097eb80 1 Processor -- start 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.096+0000 7fe42097eb80 1 -- start start 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 0x5640987420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x5640987449a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640986e2610 con 0x564098718a40 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x564098658db0 con 0x5640987425b0 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x56409866e030 con 0x564098718170 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe407fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 0x5640987420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57010/0 (socket says 172.21.15.19:57010) 2023-10-03T10:11:40.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 -- 172.21.15.19:0/852410231 learned_addr learned my addr 172.21.15.19:0/852410231 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40d568700 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x5640987449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 -- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 msgr2=0x5640987449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x5640987449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 -- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 msgr2=0x5640987420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 0x5640987420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 -- 172.21.15.19:0/852410231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564098509710 con 0x564098718170 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe407fff700 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 0x5640987420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.097+0000 7fe40cd67700 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe3f80138c0 tx=0x7fe3f8009060).ready entity=mon.2 client_cookie=c4a3ccbba9207ae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe3edffb700 1 -- 172.21.15.19:0/852410231 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8015700 con 0x564098718170 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe3edffb700 1 -- 172.21.15.19:0/852410231 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8015860 con 0x564098718170 2023-10-03T10:11:40.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe3edffb700 1 -- 172.21.15.19:0/852410231 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8015c20 con 0x564098718170 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 -- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 msgr2=0x564098718550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fe3f80138c0 tx=0x7fe3f8009060).stop 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 -- 172.21.15.19:0/852410231 shutdown_connections 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x5640987449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x564098718550 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 --2- 172.21.15.19:0/852410231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718a40 0x5640987420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 -- 172.21.15.19:0/852410231 >> 172.21.15.19:0/852410231 conn(0x564098586940 msgr2=0x564098738cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 -- 172.21.15.19:0/852410231 shutdown_connections 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.098+0000 7fe42097eb80 1 -- 172.21.15.19:0/852410231 wait complete. 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 -- start start 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 Processor -- start 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x56409873d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409866e170 con 0x564098718170 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x56409866e3f0 con 0x564098718a40 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.099+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x564098639920 con 0x5640987425b0 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe42097eb80 10 client.0 ll_register_callbacks cb 0x56409860ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57018/0 (socket says 172.21.15.19:57018) 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe40d568700 1 -- 172.21.15.19:0/4182998464 learned_addr learned my addr 172.21.15.19:0/4182998464 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe40cd67700 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x56409873d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 -- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 msgr2=0x56409873e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 -- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 msgr2=0x56409873d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x56409873d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 -- 172.21.15.19:0/4182998464 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f8013420 con 0x564098718a40 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe40d568700 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe407fff700 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873dda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe3fc013000 tx=0x7fe3fc016000).ready entity=mon.1 client_cookie=53515ad1b6ff12c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe3e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.19:3301/0 2023-10-03T10:11:40.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3fc023070 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mon.1 v2:172.21.15.19:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe3fc01e410 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564098710f20 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.100+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3fc00d980 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 10 client.4549 fetch_fsmap learned FSMap version 8 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564098640b00 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mon.1 v2:172.21.15.19:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564098710f20 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mon.1 v2:172.21.15.19:3301/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fe3fc018020 con 0x564098718a40 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 10 client.4549 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 10 client.4549 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 20 client.4549 populate_metadata read hostname 'smithi019' 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 4 client.4549 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640986e6250 con 0x5640987329d0 2023-10-03T10:11:40.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.101+0000 7fe3e6ffd700 10 client.4549 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/4182998464 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x5640986e6250 con 0x5640987329d0 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe3e6ffd700 10 client.4549 handle_command_reply: tid=0 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 client.4549 shutdown 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 msgr2=0x56409873dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873dda0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fe3fc013000 tx=0x7fe3fc016000).stop 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 shutdown_connections 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x5640987425b0 0x56409873e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x56409873d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 --2- 172.21.15.19:0/4182998464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873dda0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe3e6ffd700 0 client.4549 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 >> 172.21.15.19:0/4182998464 conn(0x564098586940 msgr2=0x564098738c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 shutdown_connections 2023-10-03T10:11:40.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 1 -- 172.21.15.19:0/4182998464 wait complete. 2023-10-03T10:11:40.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.102+0000 7fe42097eb80 20 client.4549 trim_cache size 0 max 16384 2023-10-03T10:11:40.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 Processor -- start 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 -- start start 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 0x56409871b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x564098740ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x564098715230 con 0x564098718170 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640987401c0 con 0x5640987425b0 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x56409873f4b0 con 0x564098718a40 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x564098740ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35428/0 (socket says 172.21.15.19:35428) 2023-10-03T10:11:40.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe40cd67700 1 -- 172.21.15.19:0/139125227 learned_addr learned my addr 172.21.15.19:0/139125227 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.120+0000 7fe407fff700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 0x56409871b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 -- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 msgr2=0x56409871b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 0x56409871b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 -- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 msgr2=0x564098740ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x564098740ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 -- 172.21.15.19:0/139125227 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564098666f70 con 0x564098718170 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40d568700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x564098740ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe407fff700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 0x56409871b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe40cd67700 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe3f8017000 tx=0x7fe3f801b000).ready entity=mon.0 client_cookie=7f48493dc861b0ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe3ee7fc700 1 -- 172.21.15.19:0/139125227 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f80159d0 con 0x564098718170 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe3ee7fc700 1 -- 172.21.15.19:0/139125227 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8027040 con 0x564098718170 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe3ee7fc700 1 -- 172.21.15.19:0/139125227 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f8015b30 con 0x564098718170 2023-10-03T10:11:40.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe42097eb80 1 -- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 msgr2=0x564098714610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.121+0000 7fe42097eb80 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe3f8017000 tx=0x7fe3f801b000).stop 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 -- 172.21.15.19:0/139125227 shutdown_connections 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x5640987425b0 0x564098740ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564098718170 0x564098714610 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 --2- 172.21.15.19:0/139125227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718a40 0x56409871b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 -- 172.21.15.19:0/139125227 >> 172.21.15.19:0/139125227 conn(0x564098586940 msgr2=0x56409873d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 -- 172.21.15.19:0/139125227 shutdown_connections 2023-10-03T10:11:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 -- 172.21.15.19:0/139125227 wait complete. 2023-10-03T10:11:40.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 -- start start 2023-10-03T10:11:40.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.122+0000 7fe42097eb80 1 Processor -- start 2023-10-03T10:11:40.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x56409874c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x564098734a90 con 0x5640987425b0 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x564098740850 con 0x564098718a40 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x56409874ac10 con 0x564098718170 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe42097eb80 10 client.0 ll_register_callbacks cb 0x56409860ece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x56409874c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe407fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40d568700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35444/0 (socket says 172.21.15.19:35444) 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40d568700 1 -- 172.21.15.19:0/3138722355 learned_addr learned my addr 172.21.15.19:0/3138722355 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 -- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 msgr2=0x56409873bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 -- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 msgr2=0x56409873c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:11:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40cd67700 1 -- 172.21.15.19:0/3138722355 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe408118d20 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe40d568700 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.123+0000 7fe407fff700 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe40cd67700 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x56409874c630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe3f80133f0 tx=0x7fe3f8021070).ready entity=mon.2 client_cookie=89ad57617fd47f73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.19:3302/0 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f801f430 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mon.2 v2:172.21.15.19:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3690+0+0 (secure 0 0 0) 0x7fe3f801f590 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3f8015860 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3f801f9a0 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 10 client.4562 fetch_fsmap learned FSMap version 8 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x564098509710 con 0x564098718170 2023-10-03T10:11:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mon.2 v2:172.21.15.19:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f8015860 con 0x564098718170 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mon.2 v2:172.21.15.19:3302/0 5 ==== fsmap(e 8) v1 ==== 1430+0+0 (secure 0 0 0) 0x7fe3f803c070 con 0x564098718170 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 10 client.4562 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 10 client.4562 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 20 client.4562 populate_metadata read hostname 'smithi019' 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 4 client.4562 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.124+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640984d6ef0 con 0x5640987a2f30 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe3e6ffd700 10 client.4562 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe3e6ffd700 1 -- 172.21.15.19:0/3138722355 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (unknown 0 0 445299027) 0x5640984d6ef0 con 0x5640987a2f30 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe3e6ffd700 10 client.4562 handle_command_reply: tid=0 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 client.4562 shutdown 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 msgr2=0x56409874c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x56409874c630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fe3f80133f0 tx=0x7fe3f8021070).stop 2023-10-03T10:11:40.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 shutdown_connections 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5640987425b0 0x56409873c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x564098718170 0x56409874c630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 --2- 172.21.15.19:0/3138722355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x564098718a40 0x56409873bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe3e6ffd700 0 client.4562 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 >> 172.21.15.19:0/3138722355 conn(0x564098586940 msgr2=0x564098714610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 shutdown_connections 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 1 -- 172.21.15.19:0/3138722355 wait complete. 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.125+0000 7fe42097eb80 20 client.4562 trim_cache size 0 max 16384 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-10-03T10:11:40.132 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "7e072252-f281-43a7-ab05-1896c0d28d72", 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4189, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 26.889948616000002, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 8, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 18, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 32.210073178999998 2023-10-03T10:11:40.133 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 >> v1:172.21.15.19:6816/118286 conn(0x7fe3f402bb60 legacy=0x7fe3f402e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 msgr2=0x7fe408117ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408117ae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fe40000e470 tx=0x7fe40000d040).stop 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 shutdown_connections 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe408096380 0x7fe408117ae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe408091b00 0x7fe408117100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 --2- 172.21.15.19:0/573701815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe408094c20 0x7fe4081175f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-10-03T10:11:40.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 >> 172.21.15.19:0/573701815 conn(0x7fe408097470 msgr2=0x7fe408126f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:11:40.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 shutdown_connections 2023-10-03T10:11:40.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:11:40.126+0000 7fe40efcb700 1 -- 172.21.15.19:0/573701815 wait complete. 2023-10-03T10:11:40.140 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:11:40.148 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2023-10-03T10:11:40.148 INFO:teuthology.run_tasks:Running task install.upgrade... 2023-10-03T10:11:40.297 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'reef'}} overrides {'flavor': 'default', 'sha1': '3d6eb91756d99e822eeed7c6b783104a6ad86054'} 2023-10-03T10:11:40.297 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2023-10-03T10:11:40.297 INFO:teuthology.task.install:remote ubuntu@smithi019.front.sepia.ceph.com config {'branch': 'reef', 'flavor': 'default'} 2023-10-03T10:11:40.297 INFO:teuthology.task.install:extra packages: [] 2023-10-03T10:11:40.302 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-03T10:11:40.303 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2023-10-03T10:11:40.303 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:11:40.332 INFO:teuthology.orchestra.run.smithi019.stdout:16.2.14-44.geeb13ac9.el8 2023-10-03T10:11:40.332 INFO:teuthology.packaging:The installed version of ceph-common is 16.2.14-44.geeb13ac9.el8 2023-10-03T10:11:40.332 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:11:40.560 INFO:teuthology.task.install:Ceph rpm upgrade from 16.2.14-44.geeb13ac9.el8 to 18.2.0-507.g7cd99ce4 2023-10-03T10:11:40.560 INFO:teuthology.task.install.rpm:Host smithi019 is: centos 8 x86_64 2023-10-03T10:11:40.560 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:11:40.879 INFO:teuthology.task.install.rpm:Repo base URL: https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/ 2023-10-03T10:11:40.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/yum.repos.d/ceph.repo 2023-10-03T10:11:41.241 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/reef/7cd99ce428fa36b28345615983ecfd3d24e90eba/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-03T10:11:41.241 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2023-10-03T10:11:41.242 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-03T10:11:41.277 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/reef/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-03T10:11:41.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-03T10:11:41.430 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-03T10:11:41.493 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2023-10-03T10:11:41.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2023-10-03T10:11:41.818 INFO:teuthology.orchestra.run.smithi019.stdout:71 files removed 2023-10-03T10:11:41.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2023-10-03T10:11:42.951 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 129 kB/s | 80 kB 00:00 2023-10-03T10:11:43.318 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-10-03T10:11:43.677 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-10-03T10:11:44.694 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - AppStream 34 MB/s | 33 MB 00:00 2023-10-03T10:11:53.762 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - BaseOS 21 MB/s | 48 MB 00:02 2023-10-03T10:12:01.572 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras 98 kB/s | 18 kB 00:00 2023-10-03T10:12:01.930 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - Extras common packages 44 kB/s | 6.9 kB 00:00 2023-10-03T10:12:04.033 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 8 - PowerTools 3.4 MB/s | 6.5 MB 00:01 2023-10-03T10:12:05.576 INFO:teuthology.orchestra.run.smithi019.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-03T10:12:07.669 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 16 MB 00:01 2023-10-03T10:12:11.925 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 405 kB/s | 24 kB 00:00 2023-10-03T10:12:16.608 INFO:teuthology.orchestra.run.smithi019.stderr:Package cephadm available, but not installed. 2023-10-03T10:12:16.609 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: cephadm 2023-10-03T10:12:16.609 INFO:teuthology.orchestra.run.smithi019.stderr:Package ceph-immutable-object-cache available, but not installed. 2023-10-03T10:12:16.609 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-immutable-object-cache 2023-10-03T10:12:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:Package ceph-mgr-cephadm available, but not installed. 2023-10-03T10:12:16.624 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-cephadm 2023-10-03T10:12:16.628 INFO:teuthology.orchestra.run.smithi019.stderr:Package ceph-volume available, but not installed. 2023-10-03T10:12:16.629 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-volume 2023-10-03T10:12:16.941 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.4 k 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 5.4 M 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 22 M 2023-10-03T10:12:16.948 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 847 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 23 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 2.3 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 1.5 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 1.7 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 7.4 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 241 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 47 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 4.6 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 18 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:18.2.0-507.g7cd99ce4.el8 ceph-noarch 15 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 13 M 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 24 k 2023-10-03T10:12:16.949 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 47 M 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 30 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 769 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 137 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 139 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.7 M 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 474 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.6 M 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 6.5 M 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 45 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 123 k 2023-10-03T10:12:16.950 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 190 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 370 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 364 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 107 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 94 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 3.4 M 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:18.2.0-507.g7cd99ce4.el8 ceph 179 k 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout:Install 1 Package 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 34 Packages 2023-10-03T10:12:16.951 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:12:16.952 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 145 M 2023-10-03T10:12:16.952 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2023-10-03T10:12:17.385 INFO:teuthology.orchestra.run.smithi019.stdout:(1/35): ceph-18.2.0-507.g7cd99ce4.el8.x86_64.rp 52 kB/s | 6.4 kB 00:00 2023-10-03T10:12:17.810 INFO:teuthology.orchestra.run.smithi019.stdout:(2/35): thrift-0.13.0-2.el8.x86_64.rpm 3.2 MB/s | 1.7 MB 00:00 2023-10-03T10:12:18.177 INFO:teuthology.orchestra.run.smithi019.stdout:(3/35): ceph-base-18.2.0-507.g7cd99ce4.el8.x86_ 5.9 MB/s | 5.4 MB 00:00 2023-10-03T10:12:18.519 INFO:teuthology.orchestra.run.smithi019.stdout:(4/35): ceph-mds-18.2.0-507.g7cd99ce4.el8.x86_6 6.7 MB/s | 2.3 MB 00:00 2023-10-03T10:12:18.561 INFO:teuthology.orchestra.run.smithi019.stdout:(5/35): ceph-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.1 MB/s | 847 kB 00:00 2023-10-03T10:12:18.953 INFO:teuthology.orchestra.run.smithi019.stdout:(6/35): ceph-common-18.2.0-507.g7cd99ce4.el8.x8 14 MB/s | 22 MB 00:01 2023-10-03T10:12:18.995 INFO:teuthology.orchestra.run.smithi019.stdout:(7/35): ceph-mgr-18.2.0-507.g7cd99ce4.el8.x86_6 3.3 MB/s | 1.5 MB 00:00 2023-10-03T10:12:20.154 INFO:teuthology.orchestra.run.smithi019.stdout:(8/35): ceph-osd-18.2.0-507.g7cd99ce4.el8.x86_6 15 MB/s | 18 MB 00:01 2023-10-03T10:12:20.229 INFO:teuthology.orchestra.run.smithi019.stdout:(9/35): ceph-selinux-18.2.0-507.g7cd99ce4.el8.x 329 kB/s | 24 kB 00:00 2023-10-03T10:12:20.413 INFO:teuthology.orchestra.run.smithi019.stdout:(10/35): ceph-radosgw-18.2.0-507.g7cd99ce4.el8. 9.2 MB/s | 13 MB 00:01 2023-10-03T10:12:20.471 INFO:teuthology.orchestra.run.smithi019.stdout:(11/35): ceph-mon-18.2.0-507.g7cd99ce4.el8.x86_ 2.4 MB/s | 4.6 MB 00:01 2023-10-03T10:12:20.529 INFO:teuthology.orchestra.run.smithi019.stdout:(12/35): libcephfs-devel-18.2.0-507.g7cd99ce4.e 264 kB/s | 30 kB 00:00 2023-10-03T10:12:20.589 INFO:teuthology.orchestra.run.smithi019.stdout:(13/35): libcephsqlite-18.2.0-507.g7cd99ce4.el8 2.3 MB/s | 137 kB 00:00 2023-10-03T10:12:20.680 INFO:teuthology.orchestra.run.smithi019.stdout:(14/35): librados-devel-18.2.0-507.g7cd99ce4.el 1.5 MB/s | 139 kB 00:00 2023-10-03T10:12:20.714 INFO:teuthology.orchestra.run.smithi019.stdout:(15/35): libcephfs2-18.2.0-507.g7cd99ce4.el8.x8 3.1 MB/s | 769 kB 00:00 2023-10-03T10:12:20.973 INFO:teuthology.orchestra.run.smithi019.stdout:(16/35): libradosstriper1-18.2.0-507.g7cd99ce4. 1.8 MB/s | 474 kB 00:00 2023-10-03T10:12:21.140 INFO:teuthology.orchestra.run.smithi019.stdout:(17/35): librados2-18.2.0-507.g7cd99ce4.el8.x86 8.0 MB/s | 3.7 MB 00:00 2023-10-03T10:12:21.923 INFO:teuthology.orchestra.run.smithi019.stdout:(18/35): librgw2-18.2.0-507.g7cd99ce4.el8.x86_6 8.3 MB/s | 6.5 MB 00:00 2023-10-03T10:12:22.024 INFO:teuthology.orchestra.run.smithi019.stdout:(19/35): python3-ceph-argparse-18.2.0-507.g7cd9 447 kB/s | 45 kB 00:00 2023-10-03T10:12:22.124 INFO:teuthology.orchestra.run.smithi019.stdout:(20/35): python3-ceph-common-18.2.0-507.g7cd99c 1.2 MB/s | 123 kB 00:00 2023-10-03T10:12:22.232 INFO:teuthology.orchestra.run.smithi019.stdout:(21/35): python3-cephfs-18.2.0-507.g7cd99ce4.el 1.7 MB/s | 190 kB 00:00 2023-10-03T10:12:22.333 INFO:teuthology.orchestra.run.smithi019.stdout:(22/35): python3-rados-18.2.0-507.g7cd99ce4.el8 3.6 MB/s | 370 kB 00:00 2023-10-03T10:12:22.433 INFO:teuthology.orchestra.run.smithi019.stdout:(23/35): python3-rbd-18.2.0-507.g7cd99ce4.el8.x 3.6 MB/s | 364 kB 00:00 2023-10-03T10:12:22.492 INFO:teuthology.orchestra.run.smithi019.stdout:(24/35): librbd1-18.2.0-507.g7cd99ce4.el8.x86_6 2.3 MB/s | 3.6 MB 00:01 2023-10-03T10:12:22.559 INFO:teuthology.orchestra.run.smithi019.stdout:(25/35): python3-rgw-18.2.0-507.g7cd99ce4.el8.x 851 kB/s | 107 kB 00:00 2023-10-03T10:12:22.584 INFO:teuthology.orchestra.run.smithi019.stdout:(26/35): rbd-fuse-18.2.0-507.g7cd99ce4.el8.x86_ 1.0 MB/s | 94 kB 00:00 2023-10-03T10:12:23.068 INFO:teuthology.orchestra.run.smithi019.stdout:(27/35): ceph-test-18.2.0-507.g7cd99ce4.el8.x86 16 MB/s | 47 MB 00:02 2023-10-03T10:12:23.093 INFO:teuthology.orchestra.run.smithi019.stdout:(28/35): rbd-nbd-18.2.0-507.g7cd99ce4.el8.x86_6 353 kB/s | 179 kB 00:00 2023-10-03T10:12:23.118 INFO:teuthology.orchestra.run.smithi019.stdout:(29/35): ceph-grafana-dashboards-18.2.0-507.g7c 464 kB/s | 23 kB 00:00 2023-10-03T10:12:23.194 INFO:teuthology.orchestra.run.smithi019.stdout:(30/35): rbd-mirror-18.2.0-507.g7cd99ce4.el8.x8 5.4 MB/s | 3.4 MB 00:00 2023-10-03T10:12:23.269 INFO:teuthology.orchestra.run.smithi019.stdout:(31/35): ceph-mgr-modules-core-18.2.0-507.g7cd9 3.2 MB/s | 241 kB 00:00 2023-10-03T10:12:23.411 INFO:teuthology.orchestra.run.smithi019.stdout:(32/35): ceph-mgr-rook-18.2.0-507.g7cd99ce4.el8 335 kB/s | 47 kB 00:00 2023-10-03T10:12:23.578 INFO:teuthology.orchestra.run.smithi019.stdout:(33/35): ceph-mgr-diskprediction-local-18.2.0-5 16 MB/s | 7.4 MB 00:00 2023-10-03T10:12:23.603 INFO:teuthology.orchestra.run.smithi019.stdout:(34/35): ceph-prometheus-alerts-18.2.0-507.g7cd 76 kB/s | 15 kB 00:00 2023-10-03T10:12:23.645 INFO:teuthology.orchestra.run.smithi019.stdout:(35/35): ceph-mgr-dashboard-18.2.0-507.g7cd99ce 3.1 MB/s | 1.7 MB 00:00 2023-10-03T10:12:23.649 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2023-10-03T10:12:23.649 INFO:teuthology.orchestra.run.smithi019.stdout:Total 22 MB/s | 145 MB 00:06 2023-10-03T10:12:23.650 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2023-10-03T10:12:23.729 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2023-10-03T10:12:23.729 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2023-10-03T10:12:24.458 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2023-10-03T10:12:24.461 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2023-10-03T10:12:26.944 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2023-10-03T10:12:27.146 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-10-03T10:12:27.838 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:12:28.091 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:12:28.515 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:12:28.723 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:12:28.866 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 3/69 2023-10-03T10:12:29.032 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:12:29.879 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:12:30.090 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:12:30.194 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 5/69 2023-10-03T10:12:30.429 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:12:30.632 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:12:30.745 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 7/69 2023-10-03T10:12:30.907 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:12:31.007 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:12:31.204 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 9/69 2023-10-03T10:12:31.456 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:12:31.695 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 11/69 2023-10-03T10:12:31.898 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:12:32.109 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 13/69 2023-10-03T10:12:32.229 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 14/69 2023-10-03T10:12:32.446 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 15/69 2023-10-03T10:12:32.784 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 16/69 2023-10-03T10:12:35.335 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:12:35.574 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:12:36.292 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 17/69 2023-10-03T10:12:36.574 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:12:36.641 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:12:36.848 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:12:57.185 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 19/69 2023-10-03T10:12:57.421 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:12:58.725 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 20/69 2023-10-03T10:12:59.003 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:12:59.111 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 21/69 2023-10-03T10:12:59.542 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 22/69 2023-10-03T10:12:59.788 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:12:59.818 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 23/69 2023-10-03T10:13:00.011 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:13:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 24/69 2023-10-03T10:13:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:13:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 25/69 2023-10-03T10:13:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:13:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:13:03.529 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:13:03.542 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 27/69 2023-10-03T10:13:05.120 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:13:05.562 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:13:06.012 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 29/69 2023-10-03T10:13:06.292 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:13:11.798 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:13:12.115 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 31/69 2023-10-03T10:13:12.445 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:13:12.637 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 33/69 2023-10-03T10:13:12.935 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:13:13.186 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 35/69 2023-10-03T10:13:13.297 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 36/69 2023-10-03T10:13:13.552 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:13:13.562 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:13:13.563 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:13:13.854 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 38/69 2023-10-03T10:13:14.011 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:13:14.011 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:13:14.187 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 40/69 2023-10-03T10:13:14.194 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:13:14.195 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:13:14.442 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 41/69 2023-10-03T10:13:14.620 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 42/69 2023-10-03T10:13:14.819 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 43/69 2023-10-03T10:13:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:13:14.827 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:13:15.003 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 44/69 2023-10-03T10:13:15.194 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:13:15.194 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:13:15.428 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 46/69 2023-10-03T10:13:15.569 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:13:15.577 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:13:15.578 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:13:16.057 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 48/69 2023-10-03T10:13:16.057 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:13:16.288 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 49/69 2023-10-03T10:13:16.295 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:13:16.296 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:13:16.495 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 50/69 2023-10-03T10:13:16.502 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:13:16.503 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:13:16.669 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:13:16.669 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:13:16.820 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 52/69 2023-10-03T10:13:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:13:16.854 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:13:17.174 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:13:17.175 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:13:17.403 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 54/69 2023-10-03T10:13:17.403 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:13:17.645 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:13:17.844 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 56/69 2023-10-03T10:13:18.019 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:13:18.019 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:13:18.269 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 58/69 2023-10-03T10:13:18.493 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 59/69 2023-10-03T10:13:18.494 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:13:18.719 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 60/69 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 61/69 2023-10-03T10:13:18.919 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:13:19.187 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 62/69 2023-10-03T10:13:19.318 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 63/69 2023-10-03T10:13:19.437 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 64/69 2023-10-03T10:13:19.618 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 65/69 2023-10-03T10:13:19.751 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 66/69 2023-10-03T10:13:19.879 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 67/69 2023-10-03T10:13:19.879 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:13:20.028 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 68/69 2023-10-03T10:13:20.028 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:13:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 69/69 2023-10-03T10:13:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 1/69 2023-10-03T10:13:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2/69 2023-10-03T10:13:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:16.2.14-44.geeb13ac9.el8.x86_64 3/69 2023-10-03T10:13:20.859 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 4/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:16.2.14-44.geeb13ac9.el8.x86_64 5/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 6/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:16.2.14-44.geeb13ac9.el8.x86_64 7/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 8/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 9/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 10/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:16.2.14-44.geeb13ac9.el8.x86_64 11/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 12/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:16.2.14-44.geeb13ac9.el8.x86_64 13/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 14/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:16.2.14-44.geeb13ac9.el8.x86_64 15/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 16/69 2023-10-03T10:13:20.860 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:16.2.14-44.geeb13ac9.el8.x86_64 17/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 18/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:16.2.14-44.geeb13ac9.el8.x86_64 19/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 20/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:16.2.14-44.geeb13ac9.el8.x86_64 21/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 22/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:16.2.14-44.geeb13ac9.el8.x86_64 23/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 24/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 25/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 26/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:16.2.14-44.geeb13ac9.el8.x86_64 27/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 28/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:16.2.14-44.geeb13ac9.el8.x86_64 29/69 2023-10-03T10:13:20.861 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 30/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:16.2.14-44.geeb13ac9.el8.x86_64 31/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 32/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.14-44.geeb13ac9.el8.x86_64 33/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 34/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:16.2.14-44.geeb13ac9.el8.x86_64 35/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 36/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.14-44.geeb13ac9.el8.x86_64 37/69 2023-10-03T10:13:20.865 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 38/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:16.2.14-44.geeb13ac9.el8.x86_64 39/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x 40/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:16.2.14-44.geeb13ac9.el8.x 41/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86 42/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:16.2.14-44.geeb13ac9.el8.x86 43/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 44/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:16.2.14-44.geeb13ac9.el8.x86_64 45/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 46/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:16.2.14-44.geeb13ac9.el8.x86_64 47/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 48/69 2023-10-03T10:13:20.866 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:16.2.14-44.geeb13ac9.el8.x86_64 49/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 50/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:16.2.14-44.geeb13ac9.el8.x86_64 51/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 52/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:16.2.14-44.geeb13ac9.el8.x86_64 53/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 54/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:16.2.14-44.geeb13ac9.el8.x86_64 55/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 56/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:16.2.14-44.geeb13ac9.el8.x86_64 57/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8 58/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-44.geeb13ac9.el8 59/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noar 60/69 2023-10-03T10:13:20.867 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-44.geeb13ac9.el8.noar 61/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99c 62/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-44.geeb13a 63/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.n 64/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-44.geeb13ac9.el8.n 65/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 66/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:16.2.14-44.geeb13ac9.el8.noarch 67/69 2023-10-03T10:13:20.868 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8. 68/69 2023-10-03T10:13:22.749 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-44.geeb13ac9.el8. 69/69 2023-10-03T10:13:22.749 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.750 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:18.2.0-507.g7cd99ce4.el8.noarch 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.751 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:18.2.0-507.g7cd99ce4.el8.x86_64 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2023-10-03T10:13:22.752 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-03T10:13:22.753 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:22.753 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2023-10-03T10:13:22.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef 2023-10-03T10:13:23.177 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-03T10:13:23.207 INFO:teuthology.orchestra.run.smithi019.stdout:18.2.0-507.g7cd99ce4.el8 2023-10-03T10:13:23.207 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-507.g7cd99ce4.el8 2023-10-03T10:13:23.207 INFO:teuthology.task.install:The correct ceph version 18.2.0-507.g7cd99ce4 is installed. 2023-10-03T10:13:23.207 INFO:teuthology.run_tasks:Running task print... 2023-10-03T10:13:23.217 INFO:teuthology.task.print:**** done install.upgrade the host 2023-10-03T10:13:23.217 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:13:23.230 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:13:23.231 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:23.261 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:13:23.261 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-03T10:13:23.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-03T10:13:23.303 INFO:tasks.ceph.mon.a:Started 2023-10-03T10:13:23.303 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:13:23.304 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:23.317 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:13:23.317 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-03T10:13:23.317 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-03T10:13:23.359 INFO:tasks.ceph.mon.b:Started 2023-10-03T10:13:23.359 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:13:23.359 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:23.375 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:13:23.375 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-03T10:13:23.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-03T10:13:23.418 INFO:tasks.ceph.mon.c:Started 2023-10-03T10:13:23.418 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:13:23.418 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:23.446 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:13:23.446 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-03T10:13:23.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-03T10:13:23.489 INFO:tasks.ceph.mgr.x:Started 2023-10-03T10:13:23.489 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:13:23.498 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:13:23.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:13:23.499 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:13:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.639+0000 7f1afea28700 1 Processor -- start 2023-10-03T10:13:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 -- start start 2023-10-03T10:13:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af809b120 con 0x7f1af809d6f0 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af806b460 con 0x7f1af809e1d0 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afea28700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af809a7e0 con 0x7f1af8139170 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37380/0 (socket says 172.21.15.19:37380) 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41210/0 (socket says 172.21.15.19:41210) 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 -- 172.21.15.19:0/654035306 learned_addr learned my addr 172.21.15.19:0/654035306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1af809d6f0 0x7f1af809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54400/0 (socket says 172.21.15.19:54400) 2023-10-03T10:13:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 msgr2=0x7f1af813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 msgr2=0x7f1af813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 -- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 msgr2=0x7f1af8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 -- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 msgr2=0x7f1af8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 --2- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1af77fe700 1 --2- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:13:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.640+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-03T10:13:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.715+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530973923 0 0) 0x7f1af809b120 con 0x7f1af809d6f0 2023-10-03T10:13:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.715+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae00035b0 con 0x7f1af809d6f0 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2736060568 0 0) 0x7f1ae00035b0 con 0x7f1af809d6f0 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 msgr2=0x7f1af813b550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1af813b550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 msgr2=0x7f1af8138c30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 --2- 172.21.15.19:0/654035306 >> v2:172.21.15.19:3300/0 conn(0x7f1af809e1d0 0x7f1af8138c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af809a500 con 0x7f1af809d6f0 2023-10-03T10:13:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f1ae8001670 con 0x7f1af809d6f0 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 >> v1:172.21.15.19:6789/0 conn(0x7f1af809d6f0 legacy=0x7f1af809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1ae0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1ae0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ae0004d90 0x7f1ae0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af806b460 con 0x7f1ae0004d90 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af809a7e0 con 0x7f1ae0003a00 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae000baf0 con 0x7f1af8139170 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af7fff700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1ae0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1af77fe700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1ae0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.720+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ae0004d90 0x7f1ae0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 msgr2=0x7f1ae0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af8139170 0x7f1ae0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ae0004d90 msgr2=0x7f1ae0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ae0004d90 0x7f1ae0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 -- 172.21.15.19:0/654035306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00035b0 con 0x7f1ae0003a00 2023-10-03T10:13:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.721+0000 7f1af7fff700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1ae0003e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c1c0 tx=0x7f1ae0005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7aaff2e28027e310 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8007b50 con 0x7f1ae0003a00 2023-10-03T10:13:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae800cd20 con 0x7f1ae0003a00 2023-10-03T10:13:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1af6ffd700 1 -- 172.21.15.19:0/654035306 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8005ae0 con 0x7f1ae0003a00 2023-10-03T10:13:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1afea28700 1 -- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 msgr2=0x7f1ae0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1afea28700 1 --2- 172.21.15.19:0/654035306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1ae0003e10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c1c0 tx=0x7f1ae0005880 comp rx=0 tx=0).stop 2023-10-03T10:13:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1afcfc5700 1 -- 172.21.15.19:0/654035306 reap_dead start 2023-10-03T10:13:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1afea28700 1 -- 172.21.15.19:0/654035306 shutdown_connections 2023-10-03T10:13:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.724+0000 7f1afea28700 1 -- 172.21.15.19:0/654035306 >> 172.21.15.19:0/654035306 conn(0x7f1af8066f50 msgr2=0x7f1af809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.725+0000 7f1afea28700 1 -- 172.21.15.19:0/654035306 shutdown_connections 2023-10-03T10:13:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.725+0000 7f1afea28700 1 -- 172.21.15.19:0/654035306 wait complete. 2023-10-03T10:13:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 Processor -- start 2023-10-03T10:13:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 -- start start 2023-10-03T10:13:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af811ed40 0x7f1af811f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8121e60 con 0x7f1af8133100 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af811f690 con 0x7f1ae0003a00 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.726+0000 7f1afea28700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1af8122040 con 0x7f1af811ed40 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37410/0 (socket says 172.21.15.19:37410) 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33634/0 (socket says 172.21.15.19:33634) 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 -- 172.21.15.19:0/1156597413 learned_addr learned my addr 172.21.15.19:0/1156597413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af77fe700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af811ed40 0x7f1af811f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 -- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af811ed40 msgr2=0x7f1af811f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af811ed40 0x7f1af811f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 -- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 msgr2=0x7f1af811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 -- 172.21.15.19:0/1156597413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af809c710 con 0x7f1af8133100 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af7fff700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afcfc5700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1af00045e0 tx=0x7f1af00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0007bb0 con 0x7f1af8133100 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0007d10 con 0x7f1af8133100 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af8121a90 con 0x7f1af8133100 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.727+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0014650 con 0x7f1af8133100 2023-10-03T10:13:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.728+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af8122ab0 con 0x7f1af8133100 2023-10-03T10:13:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.728+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f1af00147b0 con 0x7f1af8133100 2023-10-03T10:13:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.729+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f1af003bb90 con 0x7f1af8133100 2023-10-03T10:13:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.729+0000 7f1af7fff700 1 -- 172.21.15.19:0/1156597413 >> v1:172.21.15.19:6816/118286 conn(0x7f1ae402c1b0 legacy=0x7f1ae402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.729+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af8074ea0 con 0x7f1af8133100 2023-10-03T10:13:23.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.733+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f1af0014a60 con 0x7f1af8133100 2023-10-03T10:13:23.914 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:23.913+0000 7fc8dcd70240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-03T10:13:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.930+0000 7f1af7fff700 1 -- 172.21.15.19:0/1156597413 >> v1:172.21.15.19:6816/118286 conn(0x7f1ae402c1b0 legacy=0x7f1ae402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.964+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1af809f420 con 0x7f1af8133100 2023-10-03T10:13:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.966+0000 7f1af4ff9700 1 -- 172.21.15.19:0/1156597413 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+64282 (secure 0 0 0) 0x7f1af002c090 con 0x7f1af8133100 2023-10-03T10:13:23.967 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 >> v1:172.21.15.19:6816/118286 conn(0x7f1ae402c1b0 legacy=0x7f1ae402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 msgr2=0x7f1af8133550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1af00045e0 tx=0x7f1af00048f0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 shutdown_connections 2023-10-03T10:13:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1af8133100 0x7f1af8133550 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ae0003a00 0x7f1af811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 --2- 172.21.15.19:0/1156597413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1af811ed40 0x7f1af811f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 >> 172.21.15.19:0/1156597413 conn(0x7f1af8066f50 msgr2=0x7f1af809b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 shutdown_connections 2023-10-03T10:13:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:23.968+0000 7f1afea28700 1 -- 172.21.15.19:0/1156597413 wait complete. 2023-10-03T10:13:23.988 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6816","nonce":118286}]},"active_addr":"172.21.15.19:6816/118286","active_change":"2023-10-03T10:11:01.713045+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2933255455}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2596252035}]}]} 2023-10-03T10:13:23.990 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:13:23.990 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:13:23.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:24.106 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:24.106+0000 7fc8dcd70240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-03T10:13:24.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.165+0000 7fe2436f7700 1 Processor -- start 2023-10-03T10:13:24.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.165+0000 7fe2436f7700 1 -- start start 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe2436f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe2436f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 0x7fe23c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe2436f7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c09d2f0 con 0x7fe23c09d6f0 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe2436f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c09b0f0 con 0x7fe23c139170 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe2436f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c09a810 con 0x7fe23c09e1d0 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe240c92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe241c94700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 0x7fe23c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe241493700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe23c09d6f0 0x7fe23c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54432/0 (socket says 172.21.15.19:54432) 2023-10-03T10:13:24.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe240c92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33672/0 (socket says 172.21.15.19:33672) 2023-10-03T10:13:24.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe241493700 1 -- 172.21.15.19:0/3761255689 learned_addr learned my addr 172.21.15.19:0/3761255689 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe240c92700 1 -- 172.21.15.19:0/3761255689 >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 msgr2=0x7fe23c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe240c92700 1 --2- 172.21.15.19:0/3761255689 >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 0x7fe23c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.166+0000 7fe240c92700 1 -- 172.21.15.19:0/3761255689 >> v1:172.21.15.19:6789/0 conn(0x7fe23c09d6f0 legacy=0x7fe23c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe240c92700 1 -- 172.21.15.19:0/3761255689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c09a470 con 0x7fe23c09e1d0 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe241c94700 1 --2- 172.21.15.19:0/3761255689 >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 0x7fe23c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe240c92700 1 --2- 172.21.15.19:0/3761255689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009840 tx=0x7fe22c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11690bd9c9981b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe233fff700 1 -- 172.21.15.19:0/3761255689 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c011830 con 0x7fe23c09e1d0 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe233fff700 1 -- 172.21.15.19:0/3761255689 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c011990 con 0x7fe23c09e1d0 2023-10-03T10:13:24.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.167+0000 7fe233fff700 1 -- 172.21.15.19:0/3761255689 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c011d20 con 0x7fe23c09e1d0 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 -- 172.21.15.19:0/3761255689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 msgr2=0x7fe23c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 --2- 172.21.15.19:0/3761255689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009840 tx=0x7fe22c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 -- 172.21.15.19:0/3761255689 shutdown_connections 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 --2- 172.21.15.19:0/3761255689 >> v2:172.21.15.19:3300/0 conn(0x7fe23c139170 0x7fe23c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 --2- 172.21.15.19:0/3761255689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c09e1d0 0x7fe23c138c30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 -- 172.21.15.19:0/3761255689 >> 172.21.15.19:0/3761255689 conn(0x7fe23c066f50 msgr2=0x7fe23c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 -- 172.21.15.19:0/3761255689 shutdown_connections 2023-10-03T10:13:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.168+0000 7fe2436f7700 1 -- 172.21.15.19:0/3761255689 wait complete. 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 Processor -- start 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 -- start start 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23c09d6f0 0x7fe23c1c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c139170 0x7fe23c11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c134670 con 0x7fe23c09e1d0 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0a3180 con 0x7fe23c139170 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe2436f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c121c40 con 0x7fe23c09d6f0 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe240c92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe240c92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37436/0 (socket says 172.21.15.19:37436) 2023-10-03T10:13:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe240c92700 1 -- 172.21.15.19:0/881900373 learned_addr learned my addr 172.21.15.19:0/881900373 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe241493700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23c09d6f0 0x7fe23c1c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.169+0000 7fe241c94700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c139170 0x7fe23c11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 -- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23c09d6f0 msgr2=0x7fe23c1c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23c09d6f0 0x7fe23c1c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 -- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c139170 msgr2=0x7fe23c11e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c139170 0x7fe23c11e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 -- 172.21.15.19:0/881900373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe234009a70 con 0x7fe23c09e1d0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe240c92700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009fd0 tx=0x7fe22c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0045d0 con 0x7fe23c09e1d0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c01f070 con 0x7fe23c09e1d0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c0038e0 con 0x7fe23c09e1d0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c0094a0 con 0x7fe23c09e1d0 2023-10-03T10:13:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.170+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c1c9080 con 0x7fe23c09e1d0 2023-10-03T10:13:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.172+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c074ea0 con 0x7fe23c09e1d0 2023-10-03T10:13:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.172+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fe22c003a40 con 0x7fe23c09e1d0 2023-10-03T10:13:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.172+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fe22c021070 con 0x7fe23c09e1d0 2023-10-03T10:13:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.172+0000 7fe241493700 1 -- 172.21.15.19:0/881900373 >> v1:172.21.15.19:6816/118286 conn(0x7fe22002c1b0 legacy=0x7fe22002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.176+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fe22c01a430 con 0x7fe23c09e1d0 2023-10-03T10:13:24.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.358+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe23c06c360 con 0x7fe23c09e1d0 2023-10-03T10:13:24.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.359+0000 7fe231ffb700 1 -- 172.21.15.19:0/881900373 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12688 (secure 0 0 0) 0x7fe22c02b020 con 0x7fe23c09e1d0 2023-10-03T10:13:24.360 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:24.361 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:12:03.396746+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 >> v1:172.21.15.19:6816/118286 conn(0x7fe22002c1b0 legacy=0x7fe22002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 msgr2=0x7fe23c1c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009fd0 tx=0x7fe22c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 shutdown_connections 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23c139170 0x7fe23c11e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23c09d6f0 0x7fe23c1c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 --2- 172.21.15.19:0/881900373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23c09e1d0 0x7fe23c1c8b40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 >> 172.21.15.19:0/881900373 conn(0x7fe23c066f50 msgr2=0x7fe23c136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 shutdown_connections 2023-10-03T10:13:24.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.362+0000 7fe2436f7700 1 -- 172.21.15.19:0/881900373 wait complete. 2023-10-03T10:13:24.377 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:13:24.377 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:24.393 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:24.393+0000 7fc8dcd70240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-03T10:13:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.522+0000 7f6e3e7fb700 1 Processor -- start 2023-10-03T10:13:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 -- start start 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e3806a770 0x7f6e3806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e38131b40 0x7f6e38131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3809ece0 con 0x7f6e38131b40 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3809e760 con 0x7f6e3806b080 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3e7fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3809e040 con 0x7f6e3806a770 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3cd98700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e38131b40 0x7f6e38131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33702/0 (socket says 172.21.15.19:33702) 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e377fe700 1 -- 172.21.15.19:0/2443609430 learned_addr learned my addr 172.21.15.19:0/2443609430 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e3cd98700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e38131b40 0x7f6e38131fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37450/0 (socket says 172.21.15.19:37450) 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.523+0000 7f6e37fff700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e3806a770 0x7f6e3806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 -- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e3806a770 msgr2=0x7f6e3806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e3806a770 0x7f6e3806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 -- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 msgr2=0x7f6e38131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 -- 172.21.15.19:0/2443609430 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3809f630 con 0x7f6e38131b40 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e377fe700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e3cd98700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38131b40 0x7f6e38131fe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000f370 tx=0x7f6e3000f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730bf2c5deb13d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e36ffd700 1 -- 172.21.15.19:0/2443609430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e30012070 con 0x7f6e38131b40 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e36ffd700 1 -- 172.21.15.19:0/2443609430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3000fe70 con 0x7f6e38131b40 2023-10-03T10:13:24.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.524+0000 7f6e36ffd700 1 -- 172.21.15.19:0/2443609430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000d2f0 con 0x7f6e38131b40 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38131b40 msgr2=0x7f6e38131fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38131b40 0x7f6e38131fe0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000f370 tx=0x7f6e3000f680 comp rx=0 tx=0).stop 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/2443609430 shutdown_connections 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38131b40 0x7f6e38131fe0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e3806a770 0x7f6e3806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/2443609430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e38131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/2443609430 >> 172.21.15.19:0/2443609430 conn(0x7f6e38066f50 msgr2=0x7f6e3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/2443609430 shutdown_connections 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.525+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/2443609430 wait complete. 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.526+0000 7f6e3e7fb700 1 Processor -- start 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.526+0000 7f6e3e7fb700 1 -- start start 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e3811c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 0x7f6e3811c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3811f6f0 con 0x7f6e3806a770 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3811f940 con 0x7f6e3806b080 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3e7fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3811e830 con 0x7f6e38131b40 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e3811c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37458/0 (socket says 172.21.15.19:37458) 2023-10-03T10:13:24.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 -- 172.21.15.19:0/298118151 learned_addr learned my addr 172.21.15.19:0/298118151 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3cd98700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 0x7f6e3811c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 -- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 msgr2=0x7f6e3811c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 0x7f6e3811c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 -- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 msgr2=0x7f6e3811c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e3811c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 -- 172.21.15.19:0/298118151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e2c009550 con 0x7f6e3806a770 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e377fe700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e3811c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e3cd98700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 0x7f6e3811c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e37fff700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9b0 tx=0x7f6e2800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.527+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28009710 con 0x7f6e3806a770 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.528+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800ee50 con 0x7f6e3806a770 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.528+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3000f050 con 0x7f6e3806a770 2023-10-03T10:13:24.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.528+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800ca50 con 0x7f6e3806a770 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.528+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3811dad0 con 0x7f6e3806a770 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.528+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f6e2800cbb0 con 0x7f6e3806a770 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.529+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f6e2803b900 con 0x7f6e3806a770 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.529+0000 7f6e377fe700 1 -- 172.21.15.19:0/298118151 >> v1:172.21.15.19:6816/118286 conn(0x7f6e2402c1b0 legacy=0x7f6e2402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:24.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.529+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e38074ea0 con 0x7f6e3806a770 2023-10-03T10:13:24.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.533+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f6e28021080 con 0x7f6e3806a770 2023-10-03T10:13:24.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.715+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e3811f530 con 0x7f6e3806a770 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.716+0000 7f6e34ff9700 1 -- 172.21.15.19:0/298118151 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+12688 (secure 0 0 0) 0x7f6e3811f530 con 0x7f6e3806a770 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:24.717 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":20,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:12:03.396746+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 >> v1:172.21.15.19:6816/118286 conn(0x7f6e2402c1b0 legacy=0x7f6e2402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 msgr2=0x7f6e3811bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800e9b0 tx=0x7f6e2800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 shutdown_connections 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e38131b40 0x7f6e3811c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e3806a770 0x7f6e3811bea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 --2- 172.21.15.19:0/298118151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e3806b080 0x7f6e3811c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 >> 172.21.15.19:0/298118151 conn(0x7f6e38066f50 msgr2=0x7f6e38130de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 shutdown_connections 2023-10-03T10:13:24.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.718+0000 7f6e3e7fb700 1 -- 172.21.15.19:0/298118151 wait complete. 2023-10-03T10:13:24.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:13:24.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:13:24.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:13:24.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:13:24.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.923+0000 7f78f1f65700 1 Processor -- start 2023-10-03T10:13:24.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.923+0000 7f78f1f65700 1 -- start start 2023-10-03T10:13:24.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78ec09d9f0 0x7f78ec06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec06acb0 0x7f78ec06b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78ec06b630 con 0x7f78ec09d9f0 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec09e130 con 0x7f78ec1316c0 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78f1f65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1312b0 con 0x7f78ec06acb0 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78ec09d9f0 0x7f78ec06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78ec09d9f0 0x7f78ec06a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37462/0 (socket says 172.21.15.19:37462) 2023-10-03T10:13:24.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 -- 172.21.15.19:0/3593992538 learned_addr learned my addr 172.21.15.19:0/3593992538 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eb7fe700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78ebfff700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec06acb0 0x7f78ec06b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 -- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec06acb0 msgr2=0x7f78ec06b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec06acb0 0x7f78ec06b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 -- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 msgr2=0x7f78ec131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.924+0000 7f78eaffd700 1 -- 172.21.15.19:0/3593992538 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ec09f6e0 con 0x7f78ec09d9f0 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.925+0000 7f78eaffd700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec09d9f0 0x7f78ec06a770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098f0 tx=0x7f78dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80249bedc69debe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.926+0000 7f78ea7fc700 1 -- 172.21.15.19:0/3593992538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00b8a0 con 0x7f78ec09d9f0 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.926+0000 7f78ea7fc700 1 -- 172.21.15.19:0/3593992538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc00ba00 con 0x7f78ec09d9f0 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.926+0000 7f78ea7fc700 1 -- 172.21.15.19:0/3593992538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc00bd90 con 0x7f78ec09d9f0 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 -- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec09d9f0 msgr2=0x7f78ec06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec09d9f0 0x7f78ec06a770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0098f0 tx=0x7f78dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 -- 172.21.15.19:0/3593992538 shutdown_connections 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec06acb0 0x7f78ec06b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 --2- 172.21.15.19:0/3593992538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec09d9f0 0x7f78ec06a770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 -- 172.21.15.19:0/3593992538 >> 172.21.15.19:0/3593992538 conn(0x7f78ec066f50 msgr2=0x7f78ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 -- 172.21.15.19:0/3593992538 shutdown_connections 2023-10-03T10:13:24.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.927+0000 7f78f1f65700 1 -- 172.21.15.19:0/3593992538 wait complete. 2023-10-03T10:13:24.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.929+0000 7f78f1f65700 1 Processor -- start 2023-10-03T10:13:24.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.929+0000 7f78f1f65700 1 -- start start 2023-10-03T10:13:24.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 0x7f78ec132300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec09d9f0 0x7f78ec132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec132d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec134190 con 0x7f78ec06acb0 2023-10-03T10:13:24.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec1348e0 con 0x7f78ec1316c0 2023-10-03T10:13:24.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78f1f65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78ec133580 con 0x7f78ec09d9f0 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 0x7f78ec132300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 0x7f78ec132300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37478/0 (socket says 172.21.15.19:37478) 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 -- 172.21.15.19:0/1980554821 learned_addr learned my addr 172.21.15.19:0/1980554821 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78ebfff700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec132d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eaffd700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec09d9f0 0x7f78ec132840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 -- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec09d9f0 msgr2=0x7f78ec132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec09d9f0 0x7f78ec132840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 -- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 msgr2=0x7f78ec132d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f78ec1316c0 0x7f78ec132d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eb7fe700 1 -- 172.21.15.19:0/1980554821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78dc009550 con 0x7f78ec06acb0 2023-10-03T10:13:24.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.930+0000 7f78eaffd700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f78ec09d9f0 0x7f78ec132840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78eb7fe700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 0x7f78ec132300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78d400e810 tx=0x7f78d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4013610 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d4013770 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78ec0723f0 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d4013b20 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.931+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78ec071a20 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.932+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f78d4013c80 con 0x7f78ec06acb0 2023-10-03T10:13:24.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.932+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f78d403b500 con 0x7f78ec06acb0 2023-10-03T10:13:24.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.932+0000 7f78eaffd700 1 -- 172.21.15.19:0/1980554821 >> v1:172.21.15.19:6816/118286 conn(0x7f78cc02c200 legacy=0x7f78cc02e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:24.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.933+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 --> v1:172.21.15.19:6800/118826 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f78ec09b6f0 con 0x7f78ec061190 2023-10-03T10:13:24.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.934+0000 7ff3d108d700 1 Processor -- start 2023-10-03T10:13:24.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== osd.2 v1:172.21.15.19:6800/118826 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7f78ec09b6f0 con 0x7f78ec061190 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.934+0000 7ff3d108d700 1 -- start start 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3cc0a0a30 0x7ff3cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc133fa0 0x7ff3cc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc09edd0 con 0x7ff3cc0a0a30 2023-10-03T10:13:24.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc09e1f0 con 0x7ff3cc133fa0 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3d108d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc09dc50 con 0x7ff3cc0a1340 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3ca59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3ca59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41324/0 (socket says 172.21.15.19:41324) 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3ca59c700 1 -- 172.21.15.19:0/410134306 learned_addr learned my addr 172.21.15.19:0/410134306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3cb59e700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc133fa0 0x7ff3cc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.935+0000 7ff3cad9d700 1 --2- 172.21.15.19:0/410134306 >> v2:172.21.15.19:3300/0 conn(0x7ff3cc0a0a30 0x7ff3cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 -- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc133fa0 msgr2=0x7ff3cc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc133fa0 0x7ff3cc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 -- 172.21.15.19:0/410134306 >> v2:172.21.15.19:3300/0 conn(0x7ff3cc0a0a30 msgr2=0x7ff3cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 --2- 172.21.15.19:0/410134306 >> v2:172.21.15.19:3300/0 conn(0x7ff3cc0a0a30 0x7ff3cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 -- 172.21.15.19:0/410134306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0a1fe0 con 0x7ff3cc0a1340 2023-10-03T10:13:24.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3ca59c700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009920 tx=0x7ff3c0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501cc3ffe09e00c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3c9d9b700 1 -- 172.21.15.19:0/410134306 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0033640 con 0x7ff3cc0a1340 2023-10-03T10:13:24.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3c9d9b700 1 -- 172.21.15.19:0/410134306 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c00337a0 con 0x7ff3cc0a1340 2023-10-03T10:13:24.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.936+0000 7ff3c9d9b700 1 -- 172.21.15.19:0/410134306 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c0033b30 con 0x7ff3cc0a1340 2023-10-03T10:13:24.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 -- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 msgr2=0x7ff3cc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009920 tx=0x7ff3c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 -- 172.21.15.19:0/410134306 shutdown_connections 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc133fa0 0x7ff3cc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 --2- 172.21.15.19:0/410134306 >> v2:172.21.15.19:3300/0 conn(0x7ff3cc0a0a30 0x7ff3cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 --2- 172.21.15.19:0/410134306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a1340 0x7ff3cc133a60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 -- 172.21.15.19:0/410134306 >> 172.21.15.19:0/410134306 conn(0x7ff3cc0a6550 msgr2=0x7ff3cc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 -- 172.21.15.19:0/410134306 shutdown_connections 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.937+0000 7ff3d108d700 1 -- 172.21.15.19:0/410134306 wait complete. 2023-10-03T10:13:24.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 Processor -- start 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 -- start start 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a0a30 0x7ff3cc087de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc0a1340 0x7ff3cc088320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 0x7ff3cc1bb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc087a10 con 0x7ff3cc133fa0 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0a0220 con 0x7ff3cc0a1340 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.939+0000 7ff3d108d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0a35c0 con 0x7ff3cc0a0a30 2023-10-03T10:13:24.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 0x7ff3cc1bb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 0x7ff3cc1bb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37488/0 (socket says 172.21.15.19:37488) 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 -- 172.21.15.19:0/3495928259 learned_addr learned my addr 172.21.15.19:0/3495928259 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 -- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a0a30 msgr2=0x7ff3cc087de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 --2- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3cc0a0a30 0x7ff3cc087de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 -- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc0a1340 msgr2=0x7ff3cc088320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 --2- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3cc0a1340 0x7ff3cc088320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.940+0000 7ff3cb59e700 1 -- 172.21.15.19:0/3495928259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c0009550 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3cb59e700 1 --2- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 0x7ff3cc1bb810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400efc0 tx=0x7ff3c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400cd40 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c400f040 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc06e790 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40146c0 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.941+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc06f200 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.942+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3cc06cf30 con 0x7ff3cc133fa0 2023-10-03T10:13:24.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.942+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff3c4014820 con 0x7ff3cc133fa0 2023-10-03T10:13:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.943+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7ff3c40133e0 con 0x7ff3cc133fa0 2023-10-03T10:13:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.943+0000 7ff3cad9d700 1 -- 172.21.15.19:0/3495928259 >> v1:172.21.15.19:6816/118286 conn(0x7ff3b802c1b0 legacy=0x7ff3b802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.943+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 --> v1:172.21.15.19:6804/118825 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3b8038d90 con 0x7ff3b8035090 2023-10-03T10:13:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.943+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3c400cea0 con 0x7ff3cc133fa0 2023-10-03T10:13:24.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.945+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== osd.1 v1:172.21.15.19:6804/118825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7ff3b8038d90 con 0x7ff3b8035090 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.955+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 --> v1:172.21.15.19:6800/118826 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78ec09c850 con 0x7f78ec061190 2023-10-03T10:13:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.955+0000 7f78e3fff700 1 -- 172.21.15.19:0/1980554821 <== osd.2 v1:172.21.15.19:6800/118826 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2434951863) 0x7f78e4003a20 con 0x7f78ec061190 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 >> v1:172.21.15.19:6800/118826 conn(0x7f78ec061190 legacy=0x7f78ec061560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 >> v1:172.21.15.19:6816/118286 conn(0x7f78cc02c200 legacy=0x7f78cc02e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 msgr2=0x7f78ec132300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 --2- 172.21.15.19:0/1980554821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78ec06acb0 0x7f78ec132300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78d400e810 tx=0x7f78d400eb20 comp rx=0 tx=0).stop 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78ebfff700 1 -- 172.21.15.19:0/1980554821 reap_dead start 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 shutdown_connections 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.956+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 >> 172.21.15.19:0/1980554821 conn(0x7f78ec066f50 msgr2=0x7f78ec130100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.957+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 shutdown_connections 2023-10-03T10:13:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.957+0000 7f78f1f65700 1 -- 172.21.15.19:0/1980554821 wait complete. 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.962+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 --> v1:172.21.15.19:6804/118825 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3cc0a1d40 con 0x7ff3b8035090 2023-10-03T10:13:24.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3b37fe700 1 -- 172.21.15.19:0/3495928259 <== osd.1 v1:172.21.15.19:6804/118825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7ff3c0006c80 con 0x7ff3b8035090 2023-10-03T10:13:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 >> v1:172.21.15.19:6804/118825 conn(0x7ff3b8035090 legacy=0x7ff3b8037520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 >> v1:172.21.15.19:6816/118286 conn(0x7ff3b802c1b0 legacy=0x7ff3b802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 msgr2=0x7ff3cc1bb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 --2- 172.21.15.19:0/3495928259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3cc133fa0 0x7ff3cc1bb810 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400efc0 tx=0x7ff3c400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3cb59e700 1 -- 172.21.15.19:0/3495928259 reap_dead start 2023-10-03T10:13:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 shutdown_connections 2023-10-03T10:13:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 >> 172.21.15.19:0/3495928259 conn(0x7ff3cc0a6550 msgr2=0x7ff3cc0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.963+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 shutdown_connections 2023-10-03T10:13:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.964+0000 7ff3d108d700 1 -- 172.21.15.19:0/3495928259 wait complete. 2023-10-03T10:13:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:38654705696 2023-10-03T10:13:24.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:24.986 INFO:teuthology.orchestra.run.smithi019.stdout:38654705694 2023-10-03T10:13:24.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.991+0000 7fde6f0a9700 1 Processor -- start 2023-10-03T10:13:24.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.991+0000 7fde6f0a9700 1 -- start start 2023-10-03T10:13:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde68131810 0x7fde68131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68099a40 0x7fde68099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde68138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:24.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde681313c0 con 0x7fde68131810 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6806e8c0 con 0x7fde68099a40 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6f0a9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde68071d20 con 0x7fde6809a3b0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.992+0000 7fde6ce45700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde68131810 0x7fde68131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde68131810 0x7fde68131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37496/0 (socket says 172.21.15.19:37496) 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 -- 172.21.15.19:0/2493022121 learned_addr learned my addr 172.21.15.19:0/2493022121 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6d646700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde68138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde67fff700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68099a40 0x7fde68099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 -- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 msgr2=0x7fde68138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde68138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 -- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68099a40 msgr2=0x7fde68099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68099a40 0x7fde68099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 -- 172.21.15.19:0/2493022121 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680721a0 con 0x7fde68131810 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde6ce45700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68131810 0x7fde68131be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0098f0 tx=0x7fde5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e05deefaf3315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde677fe700 1 -- 172.21.15.19:0/2493022121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011830 con 0x7fde68131810 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde677fe700 1 -- 172.21.15.19:0/2493022121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c011990 con 0x7fde68131810 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fde677fe700 1 -- 172.21.15.19:0/2493022121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011d00 con 0x7fde68131810 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 -- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68131810 msgr2=0x7fde68131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68131810 0x7fde68131be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0098f0 tx=0x7fde5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 -- 172.21.15.19:0/2493022121 shutdown_connections 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde68138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:24.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68131810 0x7fde68131be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 --2- 172.21.15.19:0/2493022121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68099a40 0x7fde68099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fde6f0a9700 1 -- 172.21.15.19:0/2493022121 >> 172.21.15.19:0/2493022121 conn(0x7fde680a2aa0 msgr2=0x7fde680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fde6f0a9700 1 -- 172.21.15.19:0/2493022121 shutdown_connections 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fde6f0a9700 1 -- 172.21.15.19:0/2493022121 wait complete. 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.996+0000 7fde6f0a9700 1 Processor -- start 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.996+0000 7fde6f0a9700 1 -- start start 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fbe21dbd700 1 Processor -- start 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.993+0000 7fbe21dbd700 1 -- start start 2023-10-03T10:13:25.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe21dbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c130200 0x7fbe1c06f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe21dbd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c130a20 0x7fbe1c09e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe21dbd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe1c06fc00 con 0x7fbe1c1305d0 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe21dbd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe1c12fdd0 con 0x7fbe1c130a20 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe21dbd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c066680 con 0x7fbe1c130200 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe1bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c130a20 0x7fbe1c09e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe1bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe1c130a20 0x7fbe1c09e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37506/0 (socket says 172.21.15.19:37506) 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe1bfff700 1 -- 172.21.15.19:0/2347764499 learned_addr learned my addr 172.21.15.19:0/2347764499 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe1affd700 1 --1- 172.21.15.19:0/2347764499 >> v1:172.21.15.19:6789/0 conn(0x7fbe1c1305d0 0x7fbe1c09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54434/0 (socket says 172.21.15.19:54434) 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.994+0000 7fbe1b7fe700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c130200 0x7fbe1c06f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1bfff700 1 -- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c130200 msgr2=0x7fbe1c06f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1bfff700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c130200 0x7fbe1c06f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1bfff700 1 -- 172.21.15.19:0/2347764499 >> v1:172.21.15.19:6789/0 conn(0x7fbe1c1305d0 legacy=0x7fbe1c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1bfff700 1 -- 172.21.15.19:0/2347764499 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c06fee0 con 0x7fbe1c130a20 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1bfff700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130a20 0x7fbe1c09e560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009920 tx=0x7fbe0c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc98963058f9ae49 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1a7fc700 1 -- 172.21.15.19:0/2347764499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c011830 con 0x7fbe1c130a20 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1a7fc700 1 -- 172.21.15.19:0/2347764499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c011990 con 0x7fbe1c130a20 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.995+0000 7fbe1a7fc700 1 -- 172.21.15.19:0/2347764499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c011d20 con 0x7fbe1c130a20 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.996+0000 7fbe21dbd700 1 -- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130a20 msgr2=0x7fbe1c09e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.996+0000 7fbe21dbd700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130a20 0x7fbe1c09e560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009920 tx=0x7fbe0c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fbe21dbd700 1 -- 172.21.15.19:0/2347764499 shutdown_connections 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fbe21dbd700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130a20 0x7fbe1c09e560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fbe21dbd700 1 --2- 172.21.15.19:0/2347764499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c130200 0x7fbe1c06f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fbe21dbd700 1 -- 172.21.15.19:0/2347764499 >> 172.21.15.19:0/2347764499 conn(0x7fbe1c0a27f0 msgr2=0x7fbe1c0a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 0x7fde6811a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde6811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6ce45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 0x7fde6811a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6ce45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 0x7fde6811a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37518/0 (socket says 172.21.15.19:37518) 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68131810 0x7fde6811b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6811e090 con 0x7fde68099a40 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6811e8a0 con 0x7fde68131810 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6f0a9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde6806eb00 con 0x7fde6809a3b0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.997+0000 7fde6ce45700 1 -- 172.21.15.19:0/3004491988 learned_addr learned my addr 172.21.15.19:0/3004491988 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde67fff700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde6811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6d646700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68131810 0x7fde6811b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 -- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 msgr2=0x7fde6811ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde6809a3b0 0x7fde6811ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 -- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68131810 msgr2=0x7fde6811b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde68131810 0x7fde6811b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 -- 172.21.15.19:0/3004491988 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c009550 con 0x7fde68099a40 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.998+0000 7fde6ce45700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 0x7fde6811a950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c00 tx=0x7fde5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c004450 con 0x7fde68099a40 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c0045d0 con 0x7fde68099a40 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6811e2e0 con 0x7fde68099a40 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fbe21dbd700 1 -- 172.21.15.19:0/2347764499 shutdown_connections 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fbe21dbd700 1 -- 172.21.15.19:0/2347764499 wait complete. 2023-10-03T10:13:25.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0038e0 con 0x7fde68099a40 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:24.999+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6812dbb0 con 0x7fde68099a40 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.000+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde68066680 con 0x7fde68099a40 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.000+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fde5c003a40 con 0x7fde68099a40 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.001+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fde5c021030 con 0x7fde68099a40 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.001+0000 7fde67fff700 1 -- 172.21.15.19:0/3004491988 >> v1:172.21.15.19:6816/118286 conn(0x7fde4c02c1b0 legacy=0x7fde4c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.001+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 --> v1:172.21.15.19:6808/118843 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde4c038e10 con 0x7fde4c035110 2023-10-03T10:13:25.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.001+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde5c03d440 con 0x7fde68099a40 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.002+0000 7fbe21dbd700 1 Processor -- start 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 -- start start 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 0x7fbe1c11a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c1305d0 0x7fbe1c11aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe1c130a20 0x7fbe1c11b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c11c1c0 con 0x7fbe1c130200 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c11d410 con 0x7fbe1c130a20 2023-10-03T10:13:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe21dbd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1c11ddf0 con 0x7fbe1c1305d0 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe1b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 0x7fbe1c11a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe1b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 0x7fbe1c11a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37530/0 (socket says 172.21.15.19:37530) 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.003+0000 7fbe1b7fe700 1 -- 172.21.15.19:0/367915141 learned_addr learned my addr 172.21.15.19:0/367915141 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1affd700 1 --2- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c1305d0 0x7fbe1c11aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1b7fe700 1 -- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c1305d0 msgr2=0x7fbe1c11aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1b7fe700 1 --2- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe1c1305d0 0x7fbe1c11aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1b7fe700 1 -- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe1c130a20 msgr2=0x7fbe1c11b030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1b7fe700 1 --2- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe1c130a20 0x7fbe1c11b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.004+0000 7fbe1b7fe700 1 -- 172.21.15.19:0/367915141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c009550 con 0x7fbe1c130200 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.005+0000 7fbe1b7fe700 1 --2- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 0x7fbe1c11a5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe140116c0 tx=0x7fbe140119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14009b90 con 0x7fbe1c130200 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14009cf0 con 0x7fbe1c130200 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1400f250 con 0x7fbe1c130200 2023-10-03T10:13:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1c11d860 con 0x7fbe1c130200 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1c11ca50 con 0x7fbe1c130200 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.006+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== osd.0 v1:172.21.15.19:6808/118843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fde4c038e10 con 0x7fde4c035110 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.007+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbe1c099a40 con 0x7fbe1c130200 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.007+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fbe1401a020 con 0x7fbe1c130200 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.007+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fbe140453a0 con 0x7fbe1c130200 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.008+0000 7fbe1affd700 1 -- 172.21.15.19:0/367915141 >> v1:172.21.15.19:6816/118286 conn(0x7fbe0802c230 legacy=0x7fbe0802e6e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.008+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 --> v1:172.21.15.19:6812/118856 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbe08038f10 con 0x7fbe08035210 2023-10-03T10:13:25.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.008+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe140455e0 con 0x7fbe1c130200 2023-10-03T10:13:25.010 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:25.007+0000 7fc8dcd70240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-03T10:13:25.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.010+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== osd.3 v1:172.21.15.19:6812/118856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (unknown 0 0 1859947542) 0x7fbe08038f10 con 0x7fbe08035210 2023-10-03T10:13:25.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.026+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 --> v1:172.21.15.19:6808/118843 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde6809a800 con 0x7fde4c035110 2023-10-03T10:13:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.026+0000 7fde657fa700 1 -- 172.21.15.19:0/3004491988 <== osd.0 v1:172.21.15.19:6808/118843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7fde6000f040 con 0x7fde4c035110 2023-10-03T10:13:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.027+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 >> v1:172.21.15.19:6808/118843 conn(0x7fde4c035110 legacy=0x7fde4c0375a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.027+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 >> v1:172.21.15.19:6816/118286 conn(0x7fde4c02c1b0 legacy=0x7fde4c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.027+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 msgr2=0x7fde6811a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.027+0000 7fde6f0a9700 1 --2- 172.21.15.19:0/3004491988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde68099a40 0x7fde6811a950 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fde5c000c00 tx=0x7fde5c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.027+0000 7fde6d646700 1 -- 172.21.15.19:0/3004491988 reap_dead start 2023-10-03T10:13:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.028+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 shutdown_connections 2023-10-03T10:13:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.028+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 >> 172.21.15.19:0/3004491988 conn(0x7fde680a2aa0 msgr2=0x7fde6812f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.032+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 shutdown_connections 2023-10-03T10:13:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.032+0000 7fde6f0a9700 1 -- 172.21.15.19:0/3004491988 wait complete. 2023-10-03T10:13:25.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.041+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 --> v1:172.21.15.19:6812/118856 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbe1c04f2a0 con 0x7fbe08035210 2023-10-03T10:13:25.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.042+0000 7fbe03fff700 1 -- 172.21.15.19:0/367915141 <== osd.3 v1:172.21.15.19:6812/118856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1880693312) 0x7fbe1c04f2a0 con 0x7fbe08035210 2023-10-03T10:13:25.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.045+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 >> v1:172.21.15.19:6812/118856 conn(0x7fbe08035210 legacy=0x7fbe080376a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 >> v1:172.21.15.19:6816/118286 conn(0x7fbe0802c230 legacy=0x7fbe0802e6e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 msgr2=0x7fbe1c11a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 --2- 172.21.15.19:0/367915141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe1c130200 0x7fbe1c11a5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbe140116c0 tx=0x7fbe140119d0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe1bfff700 1 -- 172.21.15.19:0/367915141 reap_dead start 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 shutdown_connections 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 >> 172.21.15.19:0/367915141 conn(0x7fbe1c0a27f0 msgr2=0x7fbe1c09e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 shutdown_connections 2023-10-03T10:13:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.046+0000 7fbe21dbd700 1 -- 172.21.15.19:0/367915141 wait complete. 2023-10-03T10:13:25.051 INFO:teuthology.orchestra.run.smithi019.stdout:38654705694 2023-10-03T10:13:25.052 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:25.068 INFO:teuthology.orchestra.run.smithi019.stdout:38654705694 2023-10-03T10:13:25.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:25.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.153+0000 7f9aa0738700 1 Processor -- start 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.153+0000 7f9aa0738700 1 -- start start 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9aa0738700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a9809f410 0x7f9a98136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9aa0738700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9aa0738700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a98070940 con 0x7f9a9809e930 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9aa0738700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9806fd60 con 0x7f9a9809f410 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9aa0738700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806fa80 con 0x7f9a98136fe0 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41378/0 (socket says 172.21.15.19:41378) 2023-10-03T10:13:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/2387120205 learned_addr learned my addr 172.21.15.19:0/2387120205 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/2387120205 >> v2:172.21.15.19:3300/0 conn(0x7f9a9809f410 msgr2=0x7f9a98136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 --2- 172.21.15.19:0/2387120205 >> v2:172.21.15.19:3300/0 conn(0x7f9a9809f410 0x7f9a98136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/2387120205 >> v1:172.21.15.19:6789/0 conn(0x7f9a9809e930 legacy=0x7f9a9809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.154+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/2387120205 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9809fb60 con 0x7f9a98136fe0 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.155+0000 7f9a9ecd5700 1 --2- 172.21.15.19:0/2387120205 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009e50 tx=0x7f9a9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ba288c828fc8ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.155+0000 7f9a9d4d2700 1 -- 172.21.15.19:0/2387120205 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9000e070 con 0x7f9a98136fe0 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.155+0000 7f9a9d4d2700 1 -- 172.21.15.19:0/2387120205 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a90003a20 con 0x7f9a98136fe0 2023-10-03T10:13:25.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.155+0000 7f9a9d4d2700 1 -- 172.21.15.19:0/2387120205 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90003dd0 con 0x7f9a98136fe0 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 -- 172.21.15.19:0/2387120205 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 msgr2=0x7f9a981393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 --2- 172.21.15.19:0/2387120205 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009e50 tx=0x7f9a9000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 -- 172.21.15.19:0/2387120205 shutdown_connections 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 --2- 172.21.15.19:0/2387120205 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a981393c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 --2- 172.21.15.19:0/2387120205 >> v2:172.21.15.19:3300/0 conn(0x7f9a9809f410 0x7f9a98136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 -- 172.21.15.19:0/2387120205 >> 172.21.15.19:0/2387120205 conn(0x7f9a980a4210 msgr2=0x7f9a980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 -- 172.21.15.19:0/2387120205 shutdown_connections 2023-10-03T10:13:25.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.156+0000 7f9aa0738700 1 -- 172.21.15.19:0/2387120205 wait complete. 2023-10-03T10:13:25.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.158+0000 7f9aa0738700 1 Processor -- start 2023-10-03T10:13:25.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.158+0000 7f9aa0738700 1 -- start start 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.158+0000 7f9aa0738700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9809e930 0x7f9a9811b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9aa0738700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9809f410 0x7f9a9811ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9aa0738700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9aa0738700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98071d20 con 0x7f9a9809e930 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9aa0738700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9806d810 con 0x7f9a9809f410 2023-10-03T10:13:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9aa0738700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9811e790 con 0x7f9a98136fe0 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41380/0 (socket says 172.21.15.19:41380) 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/656357386 learned_addr learned my addr 172.21.15.19:0/656357386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9e4d4700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9809e930 0x7f9a9811b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9809f410 msgr2=0x7f9a9811ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9809f410 0x7f9a9811ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9809e930 msgr2=0x7f9a9811b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9809e930 0x7f9a9811b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.159+0000 7f9a9ecd5700 1 -- 172.21.15.19:0/656357386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a90009b30 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9a9ecd5700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000b730 tx=0x7f9a90004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90004440 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a900045a0 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9811ed20 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90004910 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.160+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9811f790 con 0x7f9a98136fe0 2023-10-03T10:13:25.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.161+0000 7f853d6b0700 1 Processor -- start 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.161+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a800052e0 con 0x7f9a98136fe0 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f9a9001e430 con 0x7f9a98136fe0 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f9a9003d410 con 0x7f9a98136fe0 2023-10-03T10:13:25.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.161+0000 7f853d6b0700 1 -- start start 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f853d6b0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f853d6b0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f853812f8b0 0x7f853812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f853d6b0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853812cd90 con 0x7f8538130260 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f853d6b0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853812d330 con 0x7f853812f8b0 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.162+0000 7f853d6b0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85381306e0 con 0x7f853812cf60 2023-10-03T10:13:25.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f9a9e4d4700 1 -- 172.21.15.19:0/656357386 >> v1:172.21.15.19:6816/118286 conn(0x7f9a7c02c1b0 legacy=0x7f9a7c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41384/0 (socket says 172.21.15.19:41384) 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 -- 172.21.15.19:0/2442334646 learned_addr learned my addr 172.21.15.19:0/2442334646 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 -- 172.21.15.19:0/2442334646 >> v2:172.21.15.19:3300/0 conn(0x7f853812f8b0 msgr2=0x7f853812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 --2- 172.21.15.19:0/2442334646 >> v2:172.21.15.19:3300/0 conn(0x7f853812f8b0 0x7f853812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 -- 172.21.15.19:0/2442334646 >> v1:172.21.15.19:6789/0 conn(0x7f8538130260 legacy=0x7f8538136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 -- 172.21.15.19:0/2442334646 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8538071780 con 0x7f853812cf60 2023-10-03T10:13:25.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.163+0000 7f8536ffd700 1 --2- 172.21.15.19:0/2442334646 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85280098f0 tx=0x7f8528009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30aaa596e410d7de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.165 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:25.164+0000 7fc8dcd70240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-03T10:13:25.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.170+0000 7f8535ffb700 1 -- 172.21.15.19:0/2442334646 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8528004230 con 0x7f853812cf60 2023-10-03T10:13:25.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.170+0000 7f8535ffb700 1 -- 172.21.15.19:0/2442334646 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8528004390 con 0x7f853812cf60 2023-10-03T10:13:25.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.170+0000 7f8535ffb700 1 -- 172.21.15.19:0/2442334646 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800c770 con 0x7f853812cf60 2023-10-03T10:13:25.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.170+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f9a90026d80 con 0x7f9a98136fe0 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 -- 172.21.15.19:0/2442334646 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 msgr2=0x7f853806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 --2- 172.21.15.19:0/2442334646 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f85280098f0 tx=0x7f8528009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 -- 172.21.15.19:0/2442334646 shutdown_connections 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 --2- 172.21.15.19:0/2442334646 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812cf60 0x7f853806f5d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 --2- 172.21.15.19:0/2442334646 >> v2:172.21.15.19:3300/0 conn(0x7f853812f8b0 0x7f853812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 -- 172.21.15.19:0/2442334646 >> 172.21.15.19:0/2442334646 conn(0x7f85380a2aa0 msgr2=0x7f85380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 -- 172.21.15.19:0/2442334646 shutdown_connections 2023-10-03T10:13:25.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.171+0000 7f853d6b0700 1 -- 172.21.15.19:0/2442334646 wait complete. 2023-10-03T10:13:25.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.173+0000 7f853d6b0700 1 Processor -- start 2023-10-03T10:13:25.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.173+0000 7f853d6b0700 1 -- start start 2023-10-03T10:13:25.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 0x7f85381c4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f85367fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f85367fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41388/0 (socket says 172.21.15.19:41388) 2023-10-03T10:13:25.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f8536ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 0x7f85381c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f8536ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 0x7f85381c4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33778/0 (socket says 172.21.15.19:33778) 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8538130260 0x7f85381c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853809cf70 con 0x7f8538130260 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8538129890 con 0x7f853812cf60 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f853d6b0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f853809da90 con 0x7f853812f8b0 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.174+0000 7f85367fc700 1 -- 172.21.15.19:0/979419213 learned_addr learned my addr 172.21.15.19:0/979419213 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85377fe700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8538130260 0x7f85381c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 -- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 msgr2=0x7f85381c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 0x7f85381c4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 -- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8538130260 msgr2=0x7f85381c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8538130260 0x7f85381c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 -- 172.21.15.19:0/979419213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528009550 con 0x7f853812f8b0 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.175+0000 7f85367fc700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f852c00b500 tx=0x7f852c00b8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.176+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011830 con 0x7f853812f8b0 2023-10-03T10:13:25.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.176+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852c0119b0 con 0x7f853812f8b0 2023-10-03T10:13:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.176+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852c011d60 con 0x7f853812f8b0 2023-10-03T10:13:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.176+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853809e6b0 con 0x7f853812f8b0 2023-10-03T10:13:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.176+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853812f630 con 0x7f853812f8b0 2023-10-03T10:13:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.177+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8538074ea0 con 0x7f853812f8b0 2023-10-03T10:13:25.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.178+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f852c01a400 con 0x7f853812f8b0 2023-10-03T10:13:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.178+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f852c03b910 con 0x7f853812f8b0 2023-10-03T10:13:25.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.178+0000 7f8536ffd700 1 -- 172.21.15.19:0/979419213 >> v1:172.21.15.19:6816/118286 conn(0x7f852402c1b0 legacy=0x7f852402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.186+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f852c00f8d0 con 0x7f853812f8b0 2023-10-03T10:13:25.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 Processor -- start 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 -- start start 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 0x7f343c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 0x7f343c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c12cd90 con 0x7f343c12f8b0 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c12d330 con 0x7f343c130430 2023-10-03T10:13:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.272+0000 7f3442398700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f343c071780 con 0x7f343c12cf60 2023-10-03T10:13:25.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f343b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f343c12f8b0 0x7f343c12fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54458/0 (socket says 172.21.15.19:54458) 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f343b7fe700 1 -- 172.21.15.19:0/2957667035 learned_addr learned my addr 172.21.15.19:0/2957667035 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 0x7f343c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f343bfff700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 0x7f343c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f343affd700 1 -- 172.21.15.19:0/2957667035 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2404234846 0 0) 0x7f343c12cd90 con 0x7f343c12f8b0 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 -- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 msgr2=0x7f343c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 0x7f343c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 -- 172.21.15.19:0/2957667035 >> v1:172.21.15.19:6789/0 conn(0x7f343c12f8b0 legacy=0x7f343c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 -- 172.21.15.19:0/2957667035 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c071a40 con 0x7f343c130430 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f343bfff700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 0x7f343c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.273+0000 7f3440935700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 0x7f343c137c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f343400adc0 tx=0x7f343400c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8770dcf9e7de679 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.274+0000 7f343affd700 1 -- 172.21.15.19:0/2957667035 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400f070 con 0x7f343c130430 2023-10-03T10:13:25.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.274+0000 7f343affd700 1 -- 172.21.15.19:0/2957667035 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343400ae50 con 0x7f343c130430 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.274+0000 7f343affd700 1 -- 172.21.15.19:0/2957667035 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343400ce10 con 0x7f343c130430 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.274+0000 7f3442398700 1 -- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 msgr2=0x7f343c137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.274+0000 7f3442398700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 0x7f343c137c30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f343400adc0 tx=0x7f343400c330 comp rx=0 tx=0).stop 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 -- 172.21.15.19:0/2957667035 shutdown_connections 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c130430 0x7f343c137c30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 --2- 172.21.15.19:0/2957667035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12cf60 0x7f343c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 -- 172.21.15.19:0/2957667035 >> 172.21.15.19:0/2957667035 conn(0x7f343c0a2aa0 msgr2=0x7f343c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 -- 172.21.15.19:0/2957667035 shutdown_connections 2023-10-03T10:13:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.275+0000 7f3442398700 1 -- 172.21.15.19:0/2957667035 wait complete. 2023-10-03T10:13:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 Processor -- start 2023-10-03T10:13:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 -- start start 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 0x7f343c1d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 0x7f343c1d5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f343c130430 0x7f343c1d5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1c95f0 con 0x7f343c130430 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1b83f0 con 0x7f343c12cf60 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.276+0000 7f3442398700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f343c1b8660 con 0x7f343c12f8b0 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 0x7f343c1d5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 0x7f343c1d5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41406/0 (socket says 172.21.15.19:41406) 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343b7fe700 1 -- 172.21.15.19:0/2772235318 learned_addr learned my addr 172.21.15.19:0/2772235318 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f3440935700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f343c130430 0x7f343c1d5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 0x7f343c1d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 -- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 msgr2=0x7f343c1d5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 0x7f343c1d5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 -- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f343c130430 msgr2=0x7f343c1d5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f343c130430 0x7f343c1d5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.277+0000 7f343bfff700 1 -- 172.21.15.19:0/2772235318 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343400aa70 con 0x7f343c12cf60 2023-10-03T10:13:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.278+0000 7f343bfff700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 0x7f343c1d4ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c7f0 tx=0x7f342c00cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.282+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c011800 con 0x7f343c12cf60 2023-10-03T10:13:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.282+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c011960 con 0x7f343c12cf60 2023-10-03T10:13:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.282+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c011cd0 con 0x7f343c12cf60 2023-10-03T10:13:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.282+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c12d9d0 con 0x7f343c12cf60 2023-10-03T10:13:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.282+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c1b5900 con 0x7f343c12cf60 2023-10-03T10:13:25.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.283+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c074ea0 con 0x7f343c12cf60 2023-10-03T10:13:25.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.284+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f342c022350 con 0x7f343c12cf60 2023-10-03T10:13:25.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.285+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f342c03b7b0 con 0x7f343c12cf60 2023-10-03T10:13:25.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.285+0000 7f343b7fe700 1 -- 172.21.15.19:0/2772235318 >> v1:172.21.15.19:6816/118286 conn(0x7f342802c1b0 legacy=0x7f342802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.291+0000 7f734f6e5700 1 Processor -- start 2023-10-03T10:13:25.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 -- start start 2023-10-03T10:13:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 0x7f73481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734809b120 con 0x7f734809e410 2023-10-03T10:13:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734806b460 con 0x7f734809e000 2023-10-03T10:13:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734f6e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734809a7e0 con 0x7f734809d6f0 2023-10-03T10:13:25.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.292+0000 7f734d481700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33800/0 (socket says 172.21.15.19:33800) 2023-10-03T10:13:25.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 -- 172.21.15.19:0/1323246564 learned_addr learned my addr 172.21.15.19:0/1323246564 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f342c00e2f0 con 0x7f343c12cf60 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734cc80700 1 --2- 172.21.15.19:0/1323246564 >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 0x7f73481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 -- 172.21.15.19:0/1323246564 >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 msgr2=0x7f73481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 --2- 172.21.15.19:0/1323246564 >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 0x7f73481339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 -- 172.21.15.19:0/1323246564 >> v1:172.21.15.19:6789/0 conn(0x7f734809e410 legacy=0x7f7348133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 -- 172.21.15.19:0/1323246564 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734809a500 con 0x7f734809d6f0 2023-10-03T10:13:25.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734cc80700 1 --2- 172.21.15.19:0/1323246564 >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 0x7f73481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.293+0000 7f734d481700 1 --2- 172.21.15.19:0/1323246564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7344009920 tx=0x7f7344009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c10853a90f61faf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.294+0000 7f733ffff700 1 -- 172.21.15.19:0/1323246564 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734400ba20 con 0x7f734809d6f0 2023-10-03T10:13:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.294+0000 7f733ffff700 1 -- 172.21.15.19:0/1323246564 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734400bb80 con 0x7f734809d6f0 2023-10-03T10:13:25.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.294+0000 7f733ffff700 1 -- 172.21.15.19:0/1323246564 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344009e70 con 0x7f734809d6f0 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.295+0000 7f734f6e5700 1 -- 172.21.15.19:0/1323246564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 msgr2=0x7f734809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.295+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1323246564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7344009920 tx=0x7f7344009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 -- 172.21.15.19:0/1323246564 shutdown_connections 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1323246564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809d6f0 0x7f734809dac0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1323246564 >> v2:172.21.15.19:3300/0 conn(0x7f734809e000 0x7f73481339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 -- 172.21.15.19:0/1323246564 >> 172.21.15.19:0/1323246564 conn(0x7f7348066f50 msgr2=0x7f734809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 -- 172.21.15.19:0/1323246564 shutdown_connections 2023-10-03T10:13:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.296+0000 7f734f6e5700 1 -- 172.21.15.19:0/1323246564 wait complete. 2023-10-03T10:13:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.297+0000 7f734f6e5700 1 Processor -- start 2023-10-03T10:13:25.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.297+0000 7f734f6e5700 1 -- start start 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f734809e000 0x7f73481c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809e410 0x7f73481c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73481aaa20 con 0x7f734809e000 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73480a30c0 con 0x7f734809e410 2023-10-03T10:13:25.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.298+0000 7f734f6e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f734809c710 con 0x7f734809d6f0 2023-10-03T10:13:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41408/0 (socket says 172.21.15.19:41408) 2023-10-03T10:13:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 -- 172.21.15.19:0/1720260520 learned_addr learned my addr 172.21.15.19:0/1720260520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734dc82700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809e410 0x7f73481c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734cc80700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f734809e000 0x7f73481c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 -- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809e410 msgr2=0x7f73481c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809e410 0x7f73481c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 -- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f734809e000 msgr2=0x7f73481c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f734809e000 0x7f73481c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 -- 172.21.15.19:0/1720260520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009550 con 0x7f734809d6f0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.299+0000 7f734d481700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f7344004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.300+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344004510 con 0x7f734809d6f0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.300+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73481a9c00 con 0x7f734809d6f0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.300+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73440036a0 con 0x7f734809d6f0 2023-10-03T10:13:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.300+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7344003a50 con 0x7f734809d6f0 2023-10-03T10:13:25.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.300+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73481ac1d0 con 0x7f734809d6f0 2023-10-03T10:13:25.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.301+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7348074ea0 con 0x7f734809d6f0 2023-10-03T10:13:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.303+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f7344003bb0 con 0x7f734809d6f0 2023-10-03T10:13:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.303+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f7344021030 con 0x7f734809d6f0 2023-10-03T10:13:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.303+0000 7f734cc80700 1 -- 172.21.15.19:0/1720260520 >> v1:172.21.15.19:6816/118286 conn(0x7f732c02c1e0 legacy=0x7f732c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.311+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f734401a430 con 0x7f734809d6f0 2023-10-03T10:13:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.364+0000 7f9a9e4d4700 1 -- 172.21.15.19:0/656357386 >> v1:172.21.15.19:6816/118286 conn(0x7f9a7c02c1b0 legacy=0x7f9a7c02e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.379+0000 7f8536ffd700 1 -- 172.21.15.19:0/979419213 >> v1:172.21.15.19:6816/118286 conn(0x7f852402c1b0 legacy=0x7f852402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.471+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a80005590 con 0x7f9a98136fe0 2023-10-03T10:13:25.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.471+0000 7f9a8affd700 1 -- 172.21.15.19:0/656357386 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a90017070 con 0x7f9a98136fe0 2023-10-03T10:13:25.473 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:25.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 >> v1:172.21.15.19:6816/118286 conn(0x7f9a7c02c1b0 legacy=0x7f9a7c02e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 msgr2=0x7f9a9811bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000b730 tx=0x7f9a90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 shutdown_connections 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98136fe0 0x7f9a9811bf60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9809e930 0x7f9a9811b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.473+0000 7f9aa0738700 1 --2- 172.21.15.19:0/656357386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9809f410 0x7f9a9811ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.474+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 >> 172.21.15.19:0/656357386 conn(0x7f9a980a4210 msgr2=0x7f9a980a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.477+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 shutdown_connections 2023-10-03T10:13:25.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.477+0000 7f9aa0738700 1 -- 172.21.15.19:0/656357386 wait complete. 2023-10-03T10:13:25.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.481+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f343c067cb0 con 0x7f343c12cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.483+0000 7f3438ff9700 1 -- 172.21.15.19:0/2772235318 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f342c019ed0 con 0x7f343c12cf60 2023-10-03T10:13:25.483 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.484+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 >> v1:172.21.15.19:6816/118286 conn(0x7f342802c1b0 legacy=0x7f342802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 msgr2=0x7f343c1d4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 0x7f343c1d4ee0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f342c00c7f0 tx=0x7f342c00cb00 comp rx=0 tx=0).stop 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 shutdown_connections 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f343c130430 0x7f343c1d5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f343c12cf60 0x7f343c1d4ee0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 --2- 172.21.15.19:0/2772235318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f343c12f8b0 0x7f343c1d5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 >> 172.21.15.19:0/2772235318 conn(0x7f343c0a2aa0 msgr2=0x7f343c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 shutdown_connections 2023-10-03T10:13:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.485+0000 7f3442398700 1 -- 172.21.15.19:0/2772235318 wait complete. 2023-10-03T10:13:25.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:13:25.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2023-10-03T10:13:25.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.504+0000 7f734cc80700 1 -- 172.21.15.19:0/1720260520 >> v1:172.21.15.19:6816/118286 conn(0x7f732c02c1e0 legacy=0x7f732c02e690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:25.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.536+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f85380713a0 con 0x7f853812f8b0 2023-10-03T10:13:25.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.536+0000 7f851f7fe700 1 -- 172.21.15.19:0/979419213 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f852c015020 con 0x7f853812f8b0 2023-10-03T10:13:25.538 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 >> v1:172.21.15.19:6816/118286 conn(0x7f852402c1b0 legacy=0x7f852402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 msgr2=0x7f85381c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f852c00b500 tx=0x7f852c00b8c0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 shutdown_connections 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8538130260 0x7f85381c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f853812cf60 0x7f85381c4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 --2- 172.21.15.19:0/979419213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f853812f8b0 0x7f85381c4570 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.538+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 >> 172.21.15.19:0/979419213 conn(0x7f85380a2aa0 msgr2=0x7f853806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.539+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 shutdown_connections 2023-10-03T10:13:25.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.539+0000 7f853d6b0700 1 -- 172.21.15.19:0/979419213 wait complete. 2023-10-03T10:13:25.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2023-10-03T10:13:25.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.602+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f734806c360 con 0x7f734809d6f0 2023-10-03T10:13:25.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.603+0000 7f733dffb700 1 -- 172.21.15.19:0/1720260520 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f734402b020 con 0x7f734809d6f0 2023-10-03T10:13:25.604 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 >> v1:172.21.15.19:6816/118286 conn(0x7f732c02c1e0 legacy=0x7f732c02e690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 msgr2=0x7f73481c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7344000c00 tx=0x7f7344004750 comp rx=0 tx=0).stop 2023-10-03T10:13:25.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 shutdown_connections 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f734809e410 0x7f73481c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f734809d6f0 0x7f73481c8720 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 --2- 172.21.15.19:0/1720260520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f734809e000 0x7f73481c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 >> 172.21.15.19:0/1720260520 conn(0x7f7348066f50 msgr2=0x7f73480708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 shutdown_connections 2023-10-03T10:13:25.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:25.605+0000 7f734f6e5700 1 -- 172.21.15.19:0/1720260520 wait complete. 2023-10-03T10:13:25.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-03T10:13:25.626 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:25.625+0000 7fc8dcd70240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-03T10:13:25.789 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:25.788+0000 7fc8dcd70240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-03T10:13:25.872 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:25.871+0000 7fc8dcd70240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-03T10:13:26.024 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.023+0000 7fc8dcd70240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-03T10:13:26.103 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.102+0000 7fc8dcd70240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-03T10:13:26.286 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.285+0000 7fc8dcd70240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-03T10:13:26.375 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.374+0000 7fc8dcd70240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-03T10:13:26.463 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.462+0000 7fc8dcd70240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-03T10:13:26.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:26.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:26.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:26.565 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.565+0000 7fc8dcd70240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-03T10:13:26.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.642+0000 7f45c4049700 1 Processor -- start 2023-10-03T10:13:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.642+0000 7f45c4049700 1 -- start start 2023-10-03T10:13:26.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c4049700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45bc09e1d0 0x7f45bc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c4049700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c4049700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc09b120 con 0x7f45bc09d6f0 2023-10-03T10:13:26.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c4049700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc06b460 con 0x7f45bc09e1d0 2023-10-03T10:13:26.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c4049700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc09a7e0 con 0x7f45bc139170 2023-10-03T10:13:26.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c15e4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45bc09e1d0 0x7f45bc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c15e4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45bc09e1d0 0x7f45bc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48556/0 (socket says 172.21.15.19:48556) 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.643+0000 7f45c15e4700 1 -- 172.21.15.19:0/1165777957 learned_addr learned my addr 172.21.15.19:0/1165777957 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c0de3700 1 -- 172.21.15.19:0/1165777957 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170747176 0 0) 0x7f45bc09b120 con 0x7f45bc09d6f0 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c0de3700 1 -- 172.21.15.19:0/1165777957 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45a80035b0 con 0x7f45bc09d6f0 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c15e4700 1 -- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 msgr2=0x7f45bc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c15e4700 1 --2- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c15e4700 1 -- 172.21.15.19:0/1165777957 >> v1:172.21.15.19:6789/0 conn(0x7f45bc09d6f0 legacy=0x7f45bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c15e4700 1 -- 172.21.15.19:0/1165777957 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc09a500 con 0x7f45bc09e1d0 2023-10-03T10:13:26.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c15e4700 1 --2- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc138c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009920 tx=0x7f45ac009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd837a12af7c2424 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c0de3700 1 -- 172.21.15.19:0/1165777957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011830 con 0x7f45bc09e1d0 2023-10-03T10:13:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c0de3700 1 -- 172.21.15.19:0/1165777957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac011990 con 0x7f45bc09e1d0 2023-10-03T10:13:26.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.644+0000 7f45c0de3700 1 -- 172.21.15.19:0/1165777957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac011d20 con 0x7f45bc09e1d0 2023-10-03T10:13:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 -- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 msgr2=0x7f45bc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 --2- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc138c30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009920 tx=0x7f45ac009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:26.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 -- 172.21.15.19:0/1165777957 shutdown_connections 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 --2- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 --2- 172.21.15.19:0/1165777957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc138c30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 -- 172.21.15.19:0/1165777957 >> 172.21.15.19:0/1165777957 conn(0x7f45bc066f50 msgr2=0x7f45bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 -- 172.21.15.19:0/1165777957 shutdown_connections 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.645+0000 7f45c4049700 1 -- 172.21.15.19:0/1165777957 wait complete. 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.646+0000 7f45c4049700 1 Processor -- start 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 -- start start 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45bc09d6f0 0x7f45bc11e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc11ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc09c710 con 0x7f45bc09e1d0 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc1203b0 con 0x7f45bc139170 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c4049700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc0a2fb0 con 0x7f45bc09d6f0 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c25e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c25e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58294/0 (socket says 172.21.15.19:58294) 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.647+0000 7f45c25e6700 1 -- 172.21.15.19:0/2113088281 learned_addr learned my addr 172.21.15.19:0/2113088281 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c15e4700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc11ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 -- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45bc09d6f0 msgr2=0x7f45bc11e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45bc09d6f0 0x7f45bc11e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 -- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 msgr2=0x7f45bc11ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc11ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 -- 172.21.15.19:0/2113088281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ac009550 con 0x7f45bc139170 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.648+0000 7f45c25e6700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45b400ba10 tx=0x7f45b400bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.649+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400c930 con 0x7f45bc139170 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.649+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400cad0 con 0x7f45bc139170 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.649+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400ce80 con 0x7f45bc139170 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.649+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc121d20 con 0x7f45bc139170 2023-10-03T10:13:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.649+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc1227c0 con 0x7f45bc139170 2023-10-03T10:13:26.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.650+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f45b4014440 con 0x7f45bc139170 2023-10-03T10:13:26.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.650+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc122350 con 0x7f45bc139170 2023-10-03T10:13:26.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.650+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f45b4006e40 con 0x7f45bc139170 2023-10-03T10:13:26.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.650+0000 7f45c1de5700 1 -- 172.21.15.19:0/2113088281 >> v1:172.21.15.19:6816/118286 conn(0x7f45a002c1b0 legacy=0x7f45a002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.656+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f45b40133a0 con 0x7f45bc139170 2023-10-03T10:13:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.715+0000 7fac9d7dc700 1 Processor -- start 2023-10-03T10:13:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.715+0000 7fac9d7dc700 1 -- start start 2023-10-03T10:13:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac9d7dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac9d7dc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac9809a580 0x7fac98139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac9d7dc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac981313c0 con 0x7fac98099a40 2023-10-03T10:13:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac9d7dc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9809b580 con 0x7fac9809a580 2023-10-03T10:13:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac9d7dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac9806e8c0 con 0x7fac98131810 2023-10-03T10:13:26.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac9809a580 0x7fac98139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac9809a580 0x7fac98139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48572/0 (socket says 172.21.15.19:48572) 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.716+0000 7fac977fe700 1 -- 172.21.15.19:0/3469228189 learned_addr learned my addr 172.21.15.19:0/3469228189 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac95ffb700 1 -- 172.21.15.19:0/3469228189 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353133408 0 0) 0x7fac981313c0 con 0x7fac98099a40 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac95ffb700 1 -- 172.21.15.19:0/3469228189 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac800035b0 con 0x7fac98099a40 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac977fe700 1 -- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 msgr2=0x7fac98131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac977fe700 1 --2- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac977fe700 1 -- 172.21.15.19:0/3469228189 >> v1:172.21.15.19:6789/0 conn(0x7fac98099a40 legacy=0x7fac98099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac977fe700 1 -- 172.21.15.19:0/3469228189 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98071d20 con 0x7fac9809a580 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.717+0000 7fac977fe700 1 --2- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac9809a580 0x7fac98139660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac90009e50 tx=0x7fac9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a5963eabc114f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.718+0000 7fac95ffb700 1 -- 172.21.15.19:0/3469228189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9000e070 con 0x7fac9809a580 2023-10-03T10:13:26.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.718+0000 7fac95ffb700 1 -- 172.21.15.19:0/3469228189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90003a20 con 0x7fac9809a580 2023-10-03T10:13:26.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.718+0000 7fac95ffb700 1 -- 172.21.15.19:0/3469228189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90003d90 con 0x7fac9809a580 2023-10-03T10:13:26.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 -- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac9809a580 msgr2=0x7fac98139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac9809a580 0x7fac98139660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fac90009e50 tx=0x7fac9000b330 comp rx=0 tx=0).stop 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 -- 172.21.15.19:0/3469228189 shutdown_connections 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac9809a580 0x7fac98139660 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/3469228189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 -- 172.21.15.19:0/3469228189 >> 172.21.15.19:0/3469228189 conn(0x7fac980a2aa0 msgr2=0x7fac980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 -- 172.21.15.19:0/3469228189 shutdown_connections 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.719+0000 7fac9d7dc700 1 -- 172.21.15.19:0/3469228189 wait complete. 2023-10-03T10:13:26.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.720+0000 7f1974112700 1 Processor -- start 2023-10-03T10:13:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7fac9d7dc700 1 Processor -- start 2023-10-03T10:13:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.720+0000 7f1974112700 1 -- start start 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1974112700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f196c06c0e0 0x7f196c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1974112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1974112700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c134980 con 0x7f196c137f20 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1974112700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c06c4b0 con 0x7f196c06c0e0 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1974112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0a09c0 con 0x7f196c134ec0 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f19716ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f19716ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58300/0 (socket says 172.21.15.19:58300) 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f19716ad700 1 -- 172.21.15.19:0/4171964843 learned_addr learned my addr 172.21.15.19:0/4171964843 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1971eae700 1 --2- 172.21.15.19:0/4171964843 >> v2:172.21.15.19:3300/0 conn(0x7f196c06c0e0 0x7f196c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1971eae700 1 -- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 msgr2=0x7f196c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1971eae700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.721+0000 7f1971eae700 1 -- 172.21.15.19:0/4171964843 >> v1:172.21.15.19:6789/0 conn(0x7f196c137f20 legacy=0x7f196c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7f1971eae700 1 -- 172.21.15.19:0/4171964843 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0a0600 con 0x7f196c06c0e0 2023-10-03T10:13:26.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7f19716ad700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 -- start start 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac98099a40 0x7fac98119560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98119fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9811cdf0 con 0x7fac98099a40 2023-10-03T10:13:26.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.722+0000 7fac9d7dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9811d040 con 0x7fac9809a580 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac9d7dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac9811bf30 con 0x7fac98131810 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58304/0 (socket says 172.21.15.19:58304) 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 -- 172.21.15.19:0/918589302 learned_addr learned my addr 172.21.15.19:0/918589302 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac977fe700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98119fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac96ffd700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac98099a40 0x7fac98119560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 -- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 msgr2=0x7fac98119fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98119fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 -- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac98099a40 msgr2=0x7fac98119560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac98099a40 0x7fac98119560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 -- 172.21.15.19:0/918589302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90009b30 con 0x7fac9809a580 2023-10-03T10:13:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7fac967fc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c550 tx=0x7fac8c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.723+0000 7f1971eae700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c06c0e0 0x7f196c09ac90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1968009840 tx=0x7f1968009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8c63463762353a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7f1970eac700 1 -- 172.21.15.19:0/4171964843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968011830 con 0x7f196c06c0e0 2023-10-03T10:13:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0054e0 con 0x7fac9809a580 2023-10-03T10:13:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7f1970eac700 1 -- 172.21.15.19:0/4171964843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1968011990 con 0x7f196c06c0e0 2023-10-03T10:13:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7f1970eac700 1 -- 172.21.15.19:0/4171964843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1968011d20 con 0x7f196c06c0e0 2023-10-03T10:13:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c003680 con 0x7fac9809a580 2023-10-03T10:13:26.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.724+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c003a30 con 0x7fac9809a580 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 -- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c06c0e0 msgr2=0x7f196c09ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c06c0e0 0x7f196c09ac90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1968009840 tx=0x7f1968009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 -- 172.21.15.19:0/4171964843 shutdown_connections 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c06c0e0 0x7f196c09ac90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 --2- 172.21.15.19:0/4171964843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c134ec0 0x7f196c1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 -- 172.21.15.19:0/4171964843 >> 172.21.15.19:0/4171964843 conn(0x7f196c0a4210 msgr2=0x7f196c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 -- 172.21.15.19:0/4171964843 shutdown_connections 2023-10-03T10:13:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac980a19f0 con 0x7fac9809a580 2023-10-03T10:13:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7f1974112700 1 -- 172.21.15.19:0/4171964843 wait complete. 2023-10-03T10:13:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.725+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9811b1d0 con 0x7fac9809a580 2023-10-03T10:13:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.726+0000 7f1974112700 1 Processor -- start 2023-10-03T10:13:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.726+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fac8c003b90 con 0x7fac9809a580 2023-10-03T10:13:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.726+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fac8c03ad80 con 0x7fac9809a580 2023-10-03T10:13:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9811c450 con 0x7fac9809a580 2023-10-03T10:13:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7fac96ffd700 1 -- 172.21.15.19:0/918589302 >> v1:172.21.15.19:6816/118286 conn(0x7fac8402c200 legacy=0x7fac8402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.726+0000 7f1974112700 1 -- start start 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c06c0e0 0x7f196c11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f196c137f20 0x7f196c11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0a3c30 con 0x7f196c134ec0 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c11bdd0 con 0x7f196c06c0e0 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f1974112700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f196c11c2e0 con 0x7f196c137f20 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f19716ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f19716ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48592/0 (socket says 172.21.15.19:48592) 2023-10-03T10:13:26.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.727+0000 7f19716ad700 1 -- 172.21.15.19:0/2345329088 learned_addr learned my addr 172.21.15.19:0/2345329088 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f1971eae700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c06c0e0 0x7f196c11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 -- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f196c137f20 msgr2=0x7f196c11b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f196c137f20 0x7f196c11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 -- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c06c0e0 msgr2=0x7f196c11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c06c0e0 0x7f196c11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 -- 172.21.15.19:0/2345329088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c009550 con 0x7f196c134ec0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19716ad700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f195c00ebe0 tx=0x7f195c009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00c8b0 con 0x7f196c134ec0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195c00ca10 con 0x7f196c134ec0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195c00cd80 con 0x7f196c134ec0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19680094a0 con 0x7f196c134ec0 2023-10-03T10:13:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.728+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c11cb30 con 0x7f196c134ec0 2023-10-03T10:13:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.729+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c074ea0 con 0x7f196c134ec0 2023-10-03T10:13:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.730+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f195c013470 con 0x7f196c134ec0 2023-10-03T10:13:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.730+0000 7f1971eae700 1 -- 172.21.15.19:0/2345329088 >> v1:172.21.15.19:6816/118286 conn(0x7f195002c1b0 legacy=0x7f195002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.731+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f195c025e30 con 0x7f196c134ec0 2023-10-03T10:13:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.734+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f195c011760 con 0x7f196c134ec0 2023-10-03T10:13:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.735+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fac8c003e40 con 0x7fac9809a580 2023-10-03T10:13:26.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.779+0000 7faad7551700 1 Processor -- start 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.779+0000 7faad7551700 1 -- start start 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad7551700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad7551700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 0x7faad013f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad7551700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad0070ee0 con 0x7faad006e570 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad7551700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad0071980 con 0x7faad006f050 2023-10-03T10:13:26.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad7551700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad0071480 con 0x7faad009eca0 2023-10-03T10:13:26.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50966/0 (socket says 172.21.15.19:50966) 2023-10-03T10:13:26.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 -- 172.21.15.19:0/1506251837 learned_addr learned my addr 172.21.15.19:0/1506251837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad5aee700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 0x7faad013f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 -- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 msgr2=0x7faad013f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 0x7faad013f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.780+0000 7faad4aec700 1 -- 172.21.15.19:0/1506251837 >> v1:172.21.15.19:6789/0 conn(0x7faad006e570 legacy=0x7faad006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faad4aec700 1 -- 172.21.15.19:0/1506251837 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad0071b90 con 0x7faad009eca0 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faad5aee700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 0x7faad013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faad4aec700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faac0009920 tx=0x7faac0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c252fc2ea31585c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faac7fff700 1 -- 172.21.15.19:0/1506251837 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000ba60 con 0x7faad009eca0 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faac7fff700 1 -- 172.21.15.19:0/1506251837 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000bbc0 con 0x7faad009eca0 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.781+0000 7faac7fff700 1 -- 172.21.15.19:0/1506251837 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0009e70 con 0x7faad009eca0 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 -- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 msgr2=0x7faad013cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faac0009920 tx=0x7faac0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 -- 172.21.15.19:0/1506251837 shutdown_connections 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad006f050 0x7faad013f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 --2- 172.21.15.19:0/1506251837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad009eca0 0x7faad013cea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 -- 172.21.15.19:0/1506251837 >> 172.21.15.19:0/1506251837 conn(0x7faad00a2aa0 msgr2=0x7faad00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 -- 172.21.15.19:0/1506251837 shutdown_connections 2023-10-03T10:13:26.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.782+0000 7faad7551700 1 -- 172.21.15.19:0/1506251837 wait complete. 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.783+0000 7faad7551700 1 Processor -- start 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.783+0000 7faad7551700 1 -- start start 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad006f050 0x7faad013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad0138400 0x7faad013d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad013ecd0 con 0x7faad006e570 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad012cf50 con 0x7faad0138400 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad7551700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faad013e8b0 con 0x7faad006f050 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad52ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad52ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48602/0 (socket says 172.21.15.19:48602) 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad52ed700 1 -- 172.21.15.19:0/2826355536 learned_addr learned my addr 172.21.15.19:0/2826355536 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad4aec700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad006f050 0x7faad013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad5aee700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad0138400 0x7faad013d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.784+0000 7faad52ed700 1 -- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad006f050 msgr2=0x7faad013d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad52ed700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad006f050 0x7faad013d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad52ed700 1 -- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad0138400 msgr2=0x7faad013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad52ed700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad0138400 0x7faad013d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad52ed700 1 -- 172.21.15.19:0/2826355536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009550 con 0x7faad006e570 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad52ed700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c4e0 tx=0x7faacc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0052d0 con 0x7faad006e570 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc005430 con 0x7faad006e570 2023-10-03T10:13:26.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0038c0 con 0x7faad006e570 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad0070610 con 0x7faad006e570 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.785+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad012d930 con 0x7faad006e570 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.786+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7faacc003a20 con 0x7faad006e570 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.787+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7faacc03acd0 con 0x7faad006e570 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.787+0000 7faad4aec700 1 -- 172.21.15.19:0/2826355536 >> v1:172.21.15.19:6816/118286 conn(0x7faab402c1b0 legacy=0x7faab402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.787+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad0074ea0 con 0x7faad006e570 2023-10-03T10:13:26.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.795+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7faacc017070 con 0x7faad006e570 2023-10-03T10:13:26.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.851+0000 7f45c1de5700 1 -- 172.21.15.19:0/2113088281 >> v1:172.21.15.19:6816/118286 conn(0x7f45a002c1b0 legacy=0x7f45a002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.857+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f45bc09f420 con 0x7f45bc139170 2023-10-03T10:13:26.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.858+0000 7f45b27fc700 1 -- 172.21.15.19:0/2113088281 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45b4019070 con 0x7f45bc139170 2023-10-03T10:13:26.859 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 >> v1:172.21.15.19:6816/118286 conn(0x7f45a002c1b0 legacy=0x7f45a002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 msgr2=0x7f45bc11f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f45b400ba10 tx=0x7f45b400bd20 comp rx=0 tx=0).stop 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 shutdown_connections 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45bc139170 0x7f45bc11f220 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45bc09d6f0 0x7f45bc11e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 --2- 172.21.15.19:0/2113088281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45bc09e1d0 0x7f45bc11ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 >> 172.21.15.19:0/2113088281 conn(0x7f45bc066f50 msgr2=0x7f45bc138190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 shutdown_connections 2023-10-03T10:13:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.860+0000 7f45c4049700 1 -- 172.21.15.19:0/2113088281 wait complete. 2023-10-03T10:13:26.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:13:26.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.928+0000 7fac96ffd700 1 -- 172.21.15.19:0/918589302 >> v1:172.21.15.19:6816/118286 conn(0x7fac8402c200 legacy=0x7fac8402e6b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.931+0000 7f1971eae700 1 -- 172.21.15.19:0/2345329088 >> v1:172.21.15.19:6816/118286 conn(0x7f195002c1b0 legacy=0x7f195002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:26.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.941+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fac9811cc30 con 0x7fac9809a580 2023-10-03T10:13:26.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.942+0000 7fac7f7fe700 1 -- 172.21.15.19:0/918589302 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fac8c017020 con 0x7fac9809a580 2023-10-03T10:13:26.943 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 >> v1:172.21.15.19:6816/118286 conn(0x7fac8402c200 legacy=0x7fac8402e6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 msgr2=0x7fac98119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00c550 tx=0x7fac8c00c860 comp rx=0 tx=0).stop 2023-10-03T10:13:26.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 shutdown_connections 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac98131810 0x7fac98119fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac98099a40 0x7fac98119560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 --2- 172.21.15.19:0/918589302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac9809a580 0x7fac98119aa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 >> 172.21.15.19:0/918589302 conn(0x7fac980a2aa0 msgr2=0x7fac9812e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 shutdown_connections 2023-10-03T10:13:26.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.944+0000 7fac9d7dc700 1 -- 172.21.15.19:0/918589302 wait complete. 2023-10-03T10:13:26.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2023-10-03T10:13:26.982 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:26.981+0000 7fc8dcd70240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-03T10:13:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.985+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faad012d430 con 0x7faad006e570 2023-10-03T10:13:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.985+0000 7faac5ffb700 1 -- 172.21.15.19:0/2826355536 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faacc017020 con 0x7faad006e570 2023-10-03T10:13:26.986 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 >> v1:172.21.15.19:6816/118286 conn(0x7faab402c1b0 legacy=0x7faab402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 msgr2=0x7faad013cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c4e0 tx=0x7faacc00c8a0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 shutdown_connections 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faad0138400 0x7faad013d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faad006e570 0x7faad013cb20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 --2- 172.21.15.19:0/2826355536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faad006f050 0x7faad013d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 >> 172.21.15.19:0/2826355536 conn(0x7faad00a2aa0 msgr2=0x7faad009cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.987+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 shutdown_connections 2023-10-03T10:13:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.988+0000 7faad7551700 1 -- 172.21.15.19:0/2826355536 wait complete. 2023-10-03T10:13:26.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.993+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f196c06b250 con 0x7f196c134ec0 2023-10-03T10:13:26.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.993+0000 7f19627fc700 1 -- 172.21.15.19:0/2345329088 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f195c02a090 con 0x7f196c134ec0 2023-10-03T10:13:26.994 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.995+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 >> v1:172.21.15.19:6816/118286 conn(0x7f195002c1b0 legacy=0x7f195002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.995+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 msgr2=0x7f196c11abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.995+0000 7f1974112700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f195c00ebe0 tx=0x7f195c009e70 comp rx=0 tx=0).stop 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 shutdown_connections 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f196c137f20 0x7f196c11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f196c06c0e0 0x7f196c11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 --2- 172.21.15.19:0/2345329088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f196c134ec0 0x7f196c11abc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 >> 172.21.15.19:0/2345329088 conn(0x7f196c0a4210 msgr2=0x7f196c0a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 shutdown_connections 2023-10-03T10:13:26.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:26.996+0000 7f1974112700 1 -- 172.21.15.19:0/2345329088 wait complete. 2023-10-03T10:13:27.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-03T10:13:27.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2023-10-03T10:13:27.079 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:27.078+0000 7fc8dcd70240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-03T10:13:27.254 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:27.253+0000 7fc8dcd70240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-03T10:13:27.335 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:27.335+0000 7fc8dcd70240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-03T10:13:27.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:27.965 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:28.004 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:28.012 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.021+0000 7ff83b629700 1 Processor -- start 2023-10-03T10:13:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.021+0000 7ff83b629700 1 -- start start 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff83b629700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83412cf60 0x7ff83406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff83b629700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff83b629700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83412cd90 con 0x7ff83412f8b0 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff83b629700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83412d330 con 0x7ff834130430 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff83b629700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff834071780 con 0x7ff83412cf60 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff839bc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff839bc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58340/0 (socket says 172.21.15.19:58340) 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.022+0000 7ff839bc6700 1 -- 172.21.15.19:0/936203373 learned_addr learned my addr 172.21.15.19:0/936203373 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff8393c5700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83412cf60 0x7ff83406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff839bc6700 1 -- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83412cf60 msgr2=0x7ff83406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff839bc6700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83412cf60 0x7ff83406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff839bc6700 1 -- 172.21.15.19:0/936203373 >> v1:172.21.15.19:6789/0 conn(0x7ff83412f8b0 legacy=0x7ff83412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff839bc6700 1 -- 172.21.15.19:0/936203373 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834071a40 con 0x7ff834130430 2023-10-03T10:13:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff839bc6700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009e80 tx=0x7ff82c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf4841ae84bc706 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.023+0000 7ff82bfff700 1 -- 172.21.15.19:0/936203373 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00e070 con 0x7ff834130430 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.024+0000 7ff82bfff700 1 -- 172.21.15.19:0/936203373 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00b9c0 con 0x7ff834130430 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.024+0000 7ff82bfff700 1 -- 172.21.15.19:0/936203373 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00bd70 con 0x7ff834130430 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 -- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 msgr2=0x7ff834137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009e80 tx=0x7ff82c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 -- 172.21.15.19:0/936203373 shutdown_connections 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff834130430 0x7ff834137c30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 --2- 172.21.15.19:0/936203373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83412cf60 0x7ff83406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 -- 172.21.15.19:0/936203373 >> 172.21.15.19:0/936203373 conn(0x7ff8340a2aa0 msgr2=0x7ff8340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 -- 172.21.15.19:0/936203373 shutdown_connections 2023-10-03T10:13:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.025+0000 7ff83b629700 1 -- 172.21.15.19:0/936203373 wait complete. 2023-10-03T10:13:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 Processor -- start 2023-10-03T10:13:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 -- start start 2023-10-03T10:13:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83412cf60 0x7ff8341309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83412f8b0 0x7ff834130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83412f490 con 0x7ff83412cf60 2023-10-03T10:13:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834133240 con 0x7ff83412f8b0 2023-10-03T10:13:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.027+0000 7ff83b629700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff834132c90 con 0x7ff834130430 2023-10-03T10:13:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51002/0 (socket says 172.21.15.19:51002) 2023-10-03T10:13:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 -- 172.21.15.19:0/2483344461 learned_addr learned my addr 172.21.15.19:0/2483344461 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff838bc4700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83412f8b0 0x7ff834130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 -- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83412f8b0 msgr2=0x7ff834130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83412f8b0 0x7ff834130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 -- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83412cf60 msgr2=0x7ff8341309e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83412cf60 0x7ff8341309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 -- 172.21.15.19:0/2483344461 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009b30 con 0x7ff834130430 2023-10-03T10:13:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.028+0000 7ff839bc6700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff83412d470 tx=0x7ff82c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.029+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004450 con 0x7ff834130430 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.029+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c0045b0 con 0x7ff834130430 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.029+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c004960 con 0x7ff834130430 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.029+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff834131bc0 con 0x7ff834130430 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.029+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834131e00 con 0x7ff834130430 2023-10-03T10:13:28.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.030+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff834133080 con 0x7ff834130430 2023-10-03T10:13:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.031+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7ff82c025460 con 0x7ff834130430 2023-10-03T10:13:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.031+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7ff82c03d840 con 0x7ff834130430 2023-10-03T10:13:28.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.032+0000 7ff8393c5700 1 -- 172.21.15.19:0/2483344461 >> v1:172.21.15.19:6816/118286 conn(0x7ff81802c1b0 legacy=0x7ff81802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.036+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7ff82c01b7b0 con 0x7ff834130430 2023-10-03T10:13:28.095 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:28.094+0000 7fc8dcd70240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-03T10:13:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.131+0000 7efe4bc2b700 1 Processor -- start 2023-10-03T10:13:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.131+0000 7efe4bc2b700 1 -- start start 2023-10-03T10:13:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe4bc2b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe4409ac90 0x7efe4413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe4bc2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4413f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe4bc2b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe44134980 con 0x7efe4406c0e0 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe4bc2b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4406c4b0 con 0x7efe4409ac90 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe4bc2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4409b0e0 con 0x7efe4413d240 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe499c7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efe4406c0e0 0x7efe44134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38076/0 (socket says 172.21.15.19:38076) 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.132+0000 7efe499c7700 1 -- 172.21.15.19:0/1503290296 learned_addr learned my addr 172.21.15.19:0/1503290296 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 --2- 172.21.15.19:0/1503290296 >> v2:172.21.15.19:3300/0 conn(0x7efe4409ac90 0x7efe4413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe4a1c8700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 -- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 msgr2=0x7efe4413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 -- 172.21.15.19:0/1503290296 >> v1:172.21.15.19:6789/0 conn(0x7efe4406c0e0 legacy=0x7efe44134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 -- 172.21.15.19:0/1503290296 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe440a0600 con 0x7efe4409ac90 2023-10-03T10:13:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe491c6700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4409ac90 0x7efe4413cd00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe34009840 tx=0x7efe34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaef11003f0a597 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.133+0000 7efe489c5700 1 -- 172.21.15.19:0/1503290296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34011830 con 0x7efe4409ac90 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe489c5700 1 -- 172.21.15.19:0/1503290296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34011990 con 0x7efe4409ac90 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe489c5700 1 -- 172.21.15.19:0/1503290296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34011d20 con 0x7efe4409ac90 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4409ac90 msgr2=0x7efe4413cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4409ac90 0x7efe4413cd00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efe34009840 tx=0x7efe34009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1503290296 shutdown_connections 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1503290296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4409ac90 0x7efe4413cd00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.134+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1503290296 >> 172.21.15.19:0/1503290296 conn(0x7efe440a4210 msgr2=0x7efe440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.135+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1503290296 shutdown_connections 2023-10-03T10:13:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.135+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1503290296 wait complete. 2023-10-03T10:13:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 Processor -- start 2023-10-03T10:13:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 -- start start 2023-10-03T10:13:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe4409ac90 0x7efe4409be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4409c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4411af50 con 0x7efe4406c0e0 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4411b180 con 0x7efe4413d240 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.136+0000 7efe4bc2b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe440a03f0 con 0x7efe4409ac90 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48624/0 (socket says 172.21.15.19:48624) 2023-10-03T10:13:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 -- 172.21.15.19:0/1468278089 learned_addr learned my addr 172.21.15.19:0/1468278089 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 -- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe4409ac90 msgr2=0x7efe4409be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe4409ac90 0x7efe4409be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 -- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 msgr2=0x7efe4409c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4409c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 -- 172.21.15.19:0/1468278089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340094a0 con 0x7efe4406c0e0 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.137+0000 7efe499c7700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c480 tx=0x7efe4000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.138+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40005d70 con 0x7efe4406c0e0 2023-10-03T10:13:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.138+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe400070d0 con 0x7efe4406c0e0 2023-10-03T10:13:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.138+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40007440 con 0x7efe4406c0e0 2023-10-03T10:13:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.138+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4409da20 con 0x7efe4406c0e0 2023-10-03T10:13:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.138+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4413cc30 con 0x7efe4406c0e0 2023-10-03T10:13:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.139+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe44074ea0 con 0x7efe4406c0e0 2023-10-03T10:13:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.139+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7efe400075a0 con 0x7efe4406c0e0 2023-10-03T10:13:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.140+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7efe4003acb0 con 0x7efe4406c0e0 2023-10-03T10:13:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.144+0000 7efe491c6700 1 -- 172.21.15.19:0/1468278089 >> v1:172.21.15.19:6816/118286 conn(0x7efe2802c1b0 legacy=0x7efe2802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.144+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7efe40019b40 con 0x7efe4406c0e0 2023-10-03T10:13:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.163+0000 7f0a01d1b700 1 Processor -- start 2023-10-03T10:13:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.163+0000 7f0a01d1b700 1 -- start start 2023-10-03T10:13:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f0a01d1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f0a01d1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f0a01d1b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09fc070ee0 con 0x7f09fc134610 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f0a01d1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc071480 con 0x7f09fc09eca0 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f0a01d1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc06f3c0 con 0x7f09fc06e570 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58382/0 (socket says 172.21.15.19:58382) 2023-10-03T10:13:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 -- 172.21.15.19:0/3005468627 learned_addr learned my addr 172.21.15.19:0/3005468627 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 -- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 msgr2=0x7f09fc06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 --2- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 -- 172.21.15.19:0/3005468627 >> v1:172.21.15.19:6789/0 conn(0x7f09fc134610 legacy=0x7f09fc134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.164+0000 7f09faffd700 1 -- 172.21.15.19:0/3005468627 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc071b90 con 0x7f09fc09eca0 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.165+0000 7f09faffd700 1 --2- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009920 tx=0x7f09f0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3211db1a9c489bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.165+0000 7f09fa7fc700 1 -- 172.21.15.19:0/3005468627 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f000ba60 con 0x7f09fc09eca0 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.165+0000 7f09fa7fc700 1 -- 172.21.15.19:0/3005468627 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f000bbc0 con 0x7f09fc09eca0 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.165+0000 7f09fa7fc700 1 -- 172.21.15.19:0/3005468627 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0009e70 con 0x7f09fc09eca0 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 msgr2=0x7f09fc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009920 tx=0x7f09f0009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3005468627 shutdown_connections 2023-10-03T10:13:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3005468627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc09eca0 0x7f09fc06ee80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3005468627 >> 172.21.15.19:0/3005468627 conn(0x7f09fc0a2aa0 msgr2=0x7f09fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3005468627 shutdown_connections 2023-10-03T10:13:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.166+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3005468627 wait complete. 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.167+0000 7f0a01d1b700 1 Processor -- start 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.167+0000 7f0a01d1b700 1 -- start start 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09fc134610 0x7f09fc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 0x7f09fc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc11c660 con 0x7f09fc134610 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc070610 con 0x7f09fc11c1b0 2023-10-03T10:13:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f0a01d1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc0a1ec0 con 0x7f09fc06e570 2023-10-03T10:13:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f09fb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f09fb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51034/0 (socket says 172.21.15.19:51034) 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f09fb7fe700 1 -- 172.21.15.19:0/3705561690 learned_addr learned my addr 172.21.15.19:0/3705561690 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f09fbfff700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 0x7f09fc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.168+0000 7f09faffd700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09fc134610 0x7f09fc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 -- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 msgr2=0x7f09fc118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 -- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09fc134610 msgr2=0x7f09fc119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09fc134610 0x7f09fc119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 -- 172.21.15.19:0/3705561690 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0009550 con 0x7f09fc11c1b0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09fbfff700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 0x7f09fc119750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09f400cb90 tx=0x7f09f400cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4003c00 con 0x7f09fc11c1b0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f4003d60 con 0x7f09fc11c1b0 2023-10-03T10:13:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.169+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400aa80 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.170+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc11b710 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.170+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc1d1a50 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.171+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09fc074ea0 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.171+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f09f400abe0 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.171+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f09f403b760 con 0x7f09fc11c1b0 2023-10-03T10:13:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.171+0000 7f09fb7fe700 1 -- 172.21.15.19:0/3705561690 >> v1:172.21.15.19:6816/118286 conn(0x7f09e802c1b0 legacy=0x7f09e802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.176+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f09f40198f0 con 0x7f09fc11c1b0 2023-10-03T10:13:28.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.233+0000 7ff8393c5700 1 -- 172.21.15.19:0/2483344461 >> v1:172.21.15.19:6816/118286 conn(0x7ff81802c1b0 legacy=0x7ff81802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.241+0000 7fef34625700 1 Processor -- start 2023-10-03T10:13:28.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.242+0000 7fef34625700 1 -- start start 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef2c09d6f0 0x7fef2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c06b460 con 0x7fef2c09d6f0 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c09b120 con 0x7fef2c09e000 2023-10-03T10:13:28.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef34625700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c09a7e0 con 0x7fef2c09e410 2023-10-03T10:13:28.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58396/0 (socket says 172.21.15.19:58396) 2023-10-03T10:13:28.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 -- 172.21.15.19:0/1483848236 learned_addr learned my addr 172.21.15.19:0/1483848236 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef32bc2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 -- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 msgr2=0x7fef2c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 -- 172.21.15.19:0/1483848236 >> v2:172.21.15.19:3300/0 conn(0x7fef2c09d6f0 msgr2=0x7fef2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 --2- 172.21.15.19:0/1483848236 >> v2:172.21.15.19:3300/0 conn(0x7fef2c09d6f0 0x7fef2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef31bc0700 1 -- 172.21.15.19:0/1483848236 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c09a500 con 0x7fef2c09e000 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.243+0000 7fef32bc2700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.244+0000 7fef31bc0700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009920 tx=0x7fef1c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=193b5968a9ec446 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.244+0000 7fef313bf700 1 -- 172.21.15.19:0/1483848236 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00ba20 con 0x7fef2c09e000 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.244+0000 7fef313bf700 1 -- 172.21.15.19:0/1483848236 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00bb80 con 0x7fef2c09e000 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.244+0000 7fef313bf700 1 -- 172.21.15.19:0/1483848236 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c009e70 con 0x7fef2c09e000 2023-10-03T10:13:28.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 -- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 msgr2=0x7fef2c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009920 tx=0x7fef1c009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 -- 172.21.15.19:0/1483848236 shutdown_connections 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 --2- 172.21.15.19:0/1483848236 >> v2:172.21.15.19:3300/0 conn(0x7fef2c09d6f0 0x7fef2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 --2- 172.21.15.19:0/1483848236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09e000 0x7fef2c1339f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 -- 172.21.15.19:0/1483848236 >> 172.21.15.19:0/1483848236 conn(0x7fef2c066f50 msgr2=0x7fef2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 -- 172.21.15.19:0/1483848236 shutdown_connections 2023-10-03T10:13:28.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.245+0000 7fef34625700 1 -- 172.21.15.19:0/1483848236 wait complete. 2023-10-03T10:13:28.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.247+0000 7fef34625700 1 Processor -- start 2023-10-03T10:13:28.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.247+0000 7fef34625700 1 -- start start 2023-10-03T10:13:28.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 0x7fef2c1a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef31bc0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef31bc0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48650/0 (socket says 172.21.15.19:48650) 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c1a6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef31bc0700 1 -- 172.21.15.19:0/3545203033 learned_addr learned my addr 172.21.15.19:0/3545203033 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1a9630 con 0x7fef2c09e000 2023-10-03T10:13:28.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1a7b10 con 0x7fef2c09d6f0 2023-10-03T10:13:28.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c0a2040 con 0x7fef2c09e410 2023-10-03T10:13:28.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef32bc2700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c1a6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.248+0000 7fef323c1700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 0x7fef2c1a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 -- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 msgr2=0x7fef2c1a6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c1a6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 -- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 msgr2=0x7fef2c1a5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 0x7fef2c1a5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009550 con 0x7fef2c09e000 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef323c1700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 0x7fef2c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef31bc0700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009c70 tx=0x7fef1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c004510 con 0x7fef2c09e000 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c0036a0 con 0x7fef2c09e000 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c003a50 con 0x7fef2c09e000 2023-10-03T10:13:28.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.249+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c09c710 con 0x7fef2c09e000 2023-10-03T10:13:28.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.250+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c1a9910 con 0x7fef2c09e000 2023-10-03T10:13:28.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.251+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7fef1c021070 con 0x7fef2c09e000 2023-10-03T10:13:28.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.251+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7fef1c03cc90 con 0x7fef2c09e000 2023-10-03T10:13:28.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.251+0000 7fef323c1700 1 -- 172.21.15.19:0/3545203033 >> v1:172.21.15.19:6816/118286 conn(0x7fef1002c1b0 legacy=0x7fef1002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.251+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c074ea0 con 0x7fef2c09e000 2023-10-03T10:13:28.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.260+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fef1c015080 con 0x7fef2c09e000 2023-10-03T10:13:28.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.277+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff834074ea0 con 0x7ff834130430 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.278+0000 7ff829ffb700 1 -- 172.21.15.19:0/2483344461 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff82c02e3a0 con 0x7ff834130430 2023-10-03T10:13:28.279 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.280+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 >> v1:172.21.15.19:6816/118286 conn(0x7ff81802c1b0 legacy=0x7ff81802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:28.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.280+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 msgr2=0x7ff834131460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.280+0000 7ff83b629700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff83412d470 tx=0x7ff82c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.281+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 shutdown_connections 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.281+0000 7ff83b629700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff834130430 0x7ff834131460 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.281+0000 7ff83b629700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83412cf60 0x7ff8341309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.281+0000 7ff83b629700 1 --2- 172.21.15.19:0/2483344461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83412f8b0 0x7ff834130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.281+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 >> 172.21.15.19:0/2483344461 conn(0x7ff8340a2aa0 msgr2=0x7ff83406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.283+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 shutdown_connections 2023-10-03T10:13:28.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.287+0000 7ff83b629700 1 -- 172.21.15.19:0/2483344461 wait complete. 2023-10-03T10:13:28.294 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:28.294+0000 7fc8dcd70240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-03T10:13:28.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:13:28.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.345+0000 7efe491c6700 1 -- 172.21.15.19:0/1468278089 >> v1:172.21.15.19:6816/118286 conn(0x7efe2802c1b0 legacy=0x7efe2802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.373+0000 7f09fb7fe700 1 -- 172.21.15.19:0/3705561690 >> v1:172.21.15.19:6816/118286 conn(0x7f09e802c1b0 legacy=0x7f09e802e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.375+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efe4411b3a0 con 0x7efe4406c0e0 2023-10-03T10:13:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.376+0000 7efe3a7fc700 1 -- 172.21.15.19:0/1468278089 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe40017070 con 0x7efe4406c0e0 2023-10-03T10:13:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 >> v1:172.21.15.19:6816/118286 conn(0x7efe2802c1b0 legacy=0x7efe2802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 msgr2=0x7efe4409b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c480 tx=0x7efe4000c840 comp rx=0 tx=0).stop 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 shutdown_connections 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe4413d240 0x7efe4409c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe4406c0e0 0x7efe4409b920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 --2- 172.21.15.19:0/1468278089 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe4409ac90 0x7efe4409be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 >> 172.21.15.19:0/1468278089 conn(0x7efe440a4210 msgr2=0x7efe4406c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 shutdown_connections 2023-10-03T10:13:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.378+0000 7efe4bc2b700 1 -- 172.21.15.19:0/1468278089 wait complete. 2023-10-03T10:13:28.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2023-10-03T10:13:28.429 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:28.429+0000 7fc8dcd70240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:13:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.435+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f09fc071100 con 0x7f09fc11c1b0 2023-10-03T10:13:28.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.436+0000 7f09e3fff700 1 -- 172.21.15.19:0/3705561690 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09f4019300 con 0x7f09fc11c1b0 2023-10-03T10:13:28.437 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.437+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 >> v1:172.21.15.19:6816/118286 conn(0x7f09e802c1b0 legacy=0x7f09e802e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 msgr2=0x7f09fc119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 0x7f09fc119750 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f09f400cb90 tx=0x7f09f400cea0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 shutdown_connections 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f09fc11c1b0 0x7f09fc119750 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f09fc06e570 0x7f09fc118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 --2- 172.21.15.19:0/3705561690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f09fc134610 0x7f09fc119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 >> 172.21.15.19:0/3705561690 conn(0x7f09fc0a2aa0 msgr2=0x7f09fc136d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 shutdown_connections 2023-10-03T10:13:28.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.438+0000 7f0a01d1b700 1 -- 172.21.15.19:0/3705561690 wait complete. 2023-10-03T10:13:28.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.452+0000 7fef323c1700 1 -- 172.21.15.19:0/3545203033 >> v1:172.21.15.19:6816/118286 conn(0x7fef1002c1b0 legacy=0x7fef1002e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:28.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-03T10:13:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.515+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef2c1a9770 con 0x7fef2c09e000 2023-10-03T10:13:28.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.515+0000 7fef22ffd700 1 -- 172.21.15.19:0/3545203033 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef2c1a9770 con 0x7fef2c09e000 2023-10-03T10:13:28.516 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 >> v1:172.21.15.19:6816/118286 conn(0x7fef1002c1b0 legacy=0x7fef1002e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 msgr2=0x7fef2c1a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009c70 tx=0x7fef1c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 shutdown_connections 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef2c09e410 0x7fef2c1a6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef2c09d6f0 0x7fef2c1a5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 --2- 172.21.15.19:0/3545203033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef2c09e000 0x7fef2c1a6330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 >> 172.21.15.19:0/3545203033 conn(0x7fef2c066f50 msgr2=0x7fef2c1bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 shutdown_connections 2023-10-03T10:13:28.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:28.518+0000 7fef34625700 1 -- 172.21.15.19:0/3545203033 wait complete. 2023-10-03T10:13:28.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2023-10-03T10:13:29.072 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.071+0000 7fc8dcd70240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-03T10:13:29.206 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.205+0000 7fc8dcd70240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-03T10:13:29.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:29.384 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.383+0000 7fc8dcd70240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-03T10:13:29.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.446+0000 7f927d582700 1 Processor -- start 2023-10-03T10:13:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.446+0000 7f927d582700 1 -- start start 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f927d582700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f927809d6f0 0x7f927809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f927d582700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 0x7f9278130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f927d582700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927809f130 con 0x7f927809e410 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f927d582700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927809f520 con 0x7f927809d6f0 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f927d582700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927809e930 con 0x7f927809e000 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f9276ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f927809d6f0 0x7f927809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f92777fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f927809e410 0x7f9278130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38084/0 (socket says 172.21.15.19:38084) 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f92777fe700 1 -- 172.21.15.19:0/1979135670 learned_addr learned my addr 172.21.15.19:0/1979135670 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f92767fc700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 0x7f9278130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f9276ffd700 1 -- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 msgr2=0x7f9278130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f9276ffd700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 0x7f9278130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f9276ffd700 1 -- 172.21.15.19:0/1979135670 >> v1:172.21.15.19:6789/0 conn(0x7f927809e410 legacy=0x7f9278130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f9276ffd700 1 -- 172.21.15.19:0/1979135670 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927809b2d0 con 0x7f927809d6f0 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.447+0000 7f92767fc700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 0x7f9278130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.448+0000 7f9276ffd700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809d6f0 0x7f927809dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9268009840 tx=0x7f9268009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea292c08c178fde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.448+0000 7f9275ffb700 1 -- 172.21.15.19:0/1979135670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011830 con 0x7f927809d6f0 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.448+0000 7f9275ffb700 1 -- 172.21.15.19:0/1979135670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9268011990 con 0x7f927809d6f0 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.448+0000 7f9275ffb700 1 -- 172.21.15.19:0/1979135670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268011d20 con 0x7f927809d6f0 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 -- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809d6f0 msgr2=0x7f927809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809d6f0 0x7f927809dac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9268009840 tx=0x7f9268009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 -- 172.21.15.19:0/1979135670 shutdown_connections 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809d6f0 0x7f927809dac0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 --2- 172.21.15.19:0/1979135670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e000 0x7f9278130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 -- 172.21.15.19:0/1979135670 >> 172.21.15.19:0/1979135670 conn(0x7f9278066f50 msgr2=0x7f927809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 -- 172.21.15.19:0/1979135670 shutdown_connections 2023-10-03T10:13:29.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.449+0000 7f927d582700 1 -- 172.21.15.19:0/1979135670 wait complete. 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 Processor -- start 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 -- start start 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f927809d6f0 0x7f9278139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e410 0x7f927813a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92781370c0 con 0x7f927809e000 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9278138280 con 0x7f927809e410 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.450+0000 7f927d582700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f927809c700 con 0x7f927809d6f0 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48670/0 (socket says 172.21.15.19:48670) 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 -- 172.21.15.19:0/663133721 learned_addr learned my addr 172.21.15.19:0/663133721 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f9276ffd700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f927809d6f0 0x7f9278139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92777fe700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e410 0x7f927813a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 -- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f927809d6f0 msgr2=0x7f9278139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f927809d6f0 0x7f9278139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 -- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e410 msgr2=0x7f927813a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e410 0x7f927813a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 -- 172.21.15.19:0/663133721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0094a0 con 0x7f927809e000 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f92767fc700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f926c00ebe0 tx=0x7f926c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00c850 con 0x7f927809e000 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c00c9b0 con 0x7f927809e000 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92680094a0 con 0x7f927809e000 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.451+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00cd40 con 0x7f927809e000 2023-10-03T10:13:29.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.452+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9278137920 con 0x7f927809e000 2023-10-03T10:13:29.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.453+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) v1 ==== 31713+0+0 (secure 0 0 0) 0x7f926c013470 con 0x7f927809e000 2023-10-03T10:13:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.453+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3893+0+0 (secure 0 0 0) 0x7f926c03bc70 con 0x7f927809e000 2023-10-03T10:13:29.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.453+0000 7f9276ffd700 1 -- 172.21.15.19:0/663133721 >> v1:172.21.15.19:6816/118286 conn(0x7f926402c1b0 legacy=0x7f926402e660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/118286 2023-10-03T10:13:29.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.453+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9278138990 con 0x7f927809e000 2023-10-03T10:13:29.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.458+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f926c017020 con 0x7f927809e000 2023-10-03T10:13:29.517 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.516+0000 7fc8dcd70240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-03T10:13:29.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:29.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.535+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f926c013aa0 con 0x7f927809e000 2023-10-03T10:13:29.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.535+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 >> v1:172.21.15.19:6816/118286 conn(0x7f926402c1b0 legacy=0x7f926402e660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:29.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.568+0000 7fb71eff7700 1 Processor -- start 2023-10-03T10:13:29.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.568+0000 7fb71eff7700 1 -- start start 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71eff7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb71806f5d0 0x7fb71812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71eff7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb718138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71eff7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71806fa40 con 0x7fb71812cf60 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71eff7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71812cd90 con 0x7fb71806f5d0 2023-10-03T10:13:29.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71eff7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb718071780 con 0x7fb718135c20 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71cd93700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb71812cf60 0x7fb71812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38098/0 (socket says 172.21.15.19:38098) 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71cd93700 1 -- 172.21.15.19:0/4122851003 learned_addr learned my addr 172.21.15.19:0/4122851003 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb71d594700 1 --2- 172.21.15.19:0/4122851003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb718138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.569+0000 7fb717fff700 1 --2- 172.21.15.19:0/4122851003 >> v2:172.21.15.19:3300/0 conn(0x7fb71806f5d0 0x7fb71812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb71d594700 1 -- 172.21.15.19:0/4122851003 >> v2:172.21.15.19:3300/0 conn(0x7fb71806f5d0 msgr2=0x7fb71812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb71d594700 1 --2- 172.21.15.19:0/4122851003 >> v2:172.21.15.19:3300/0 conn(0x7fb71806f5d0 0x7fb71812ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb71d594700 1 -- 172.21.15.19:0/4122851003 >> v1:172.21.15.19:6789/0 conn(0x7fb71812cf60 legacy=0x7fb71812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb71d594700 1 -- 172.21.15.19:0/4122851003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb718071a40 con 0x7fb718135c20 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb7177fe700 1 -- 172.21.15.19:0/4122851003 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499268272 0 0) 0x7fb71806fa40 con 0x7fb71812cf60 2023-10-03T10:13:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb71d594700 1 --2- 172.21.15.19:0/4122851003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb718138000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb71000aea0 tx=0x7fb71000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a136d824aa77da9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb7177fe700 1 -- 172.21.15.19:0/4122851003 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000cbc0 con 0x7fb718135c20 2023-10-03T10:13:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb7177fe700 1 -- 172.21.15.19:0/4122851003 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71000f070 con 0x7fb718135c20 2023-10-03T10:13:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.570+0000 7fb7177fe700 1 -- 172.21.15.19:0/4122851003 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71000a2e0 con 0x7fb718135c20 2023-10-03T10:13:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 -- 172.21.15.19:0/4122851003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 msgr2=0x7fb718138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 --2- 172.21.15.19:0/4122851003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb718138000 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb71000aea0 tx=0x7fb71000c330 comp rx=0 tx=0).stop 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 -- 172.21.15.19:0/4122851003 shutdown_connections 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 --2- 172.21.15.19:0/4122851003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb718138000 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 --2- 172.21.15.19:0/4122851003 >> v2:172.21.15.19:3300/0 conn(0x7fb71806f5d0 0x7fb71812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.571+0000 7fb71eff7700 1 -- 172.21.15.19:0/4122851003 >> 172.21.15.19:0/4122851003 conn(0x7fb7180a2aa0 msgr2=0x7fb7180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.572+0000 7fb71eff7700 1 -- 172.21.15.19:0/4122851003 shutdown_connections 2023-10-03T10:13:29.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.573+0000 7fb71eff7700 1 -- 172.21.15.19:0/4122851003 wait complete. 2023-10-03T10:13:29.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.574+0000 7fb71eff7700 1 Processor -- start 2023-10-03T10:13:29.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.574+0000 7fb71eff7700 1 -- start start 2023-10-03T10:13:29.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb71812cf60 0x7fb71809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb71809a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809b280 con 0x7fb71812cf60 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809af60 con 0x7fb71806f5d0 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.575+0000 7fb71eff7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71809c380 con 0x7fb718135c20 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58454/0 (socket says 172.21.15.19:58454) 2023-10-03T10:13:29.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 -- 172.21.15.19:0/942935007 learned_addr learned my addr 172.21.15.19:0/942935007 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 -- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 msgr2=0x7fb71809a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb71809a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 -- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb71812cf60 msgr2=0x7fb71809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb71812cf60 0x7fb71809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.576+0000 7fb71cd93700 1 -- 172.21.15.19:0/942935007 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71000ab80 con 0x7fb71806f5d0 2023-10-03T10:13:29.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.577+0000 7fb71cd93700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c550 tx=0x7fb70c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.577+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c004c80 con 0x7fb71806f5d0 2023-10-03T10:13:29.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.577+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c004e00 con 0x7fb71806f5d0 2023-10-03T10:13:29.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.577+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c007310 con 0x7fb71806f5d0 2023-10-03T10:13:29.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.577+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180a1380 con 0x7fb71806f5d0 2023-10-03T10:13:29.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.579+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71809ba00 con 0x7fb71806f5d0 2023-10-03T10:13:29.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.580+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7fb70c007470 con 0x7fb71806f5d0 2023-10-03T10:13:29.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.580+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb718074ea0 con 0x7fb71806f5d0 2023-10-03T10:13:29.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.581+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7fb70c040cb0 con 0x7fb71806f5d0 2023-10-03T10:13:29.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.588+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7fb70c044060 con 0x7fb71806f5d0 2023-10-03T10:13:29.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.616+0000 7f65bc331700 1 Processor -- start 2023-10-03T10:13:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.616+0000 7f65bc331700 1 -- start start 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65bc331700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b409e1d0 0x7f65b4135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65bc331700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b4135e50 0x7f65b4138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65bc331700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b409f130 con 0x7f65b409d6f0 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65bc331700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b409f520 con 0x7f65b4135e50 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65bc331700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b409e930 con 0x7f65b409e1d0 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65ba0cd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f65b409d6f0 0x7f65b409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38114/0 (socket says 172.21.15.19:38114) 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65ba0cd700 1 -- 172.21.15.19:0/727868864 learned_addr learned my addr 172.21.15.19:0/727868864 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65ba8ce700 1 --2- 172.21.15.19:0/727868864 >> v2:172.21.15.19:3300/0 conn(0x7f65b4135e50 0x7f65b4138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.617+0000 7f65b98cc700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b409e1d0 0x7f65b4135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65197132 0 0) 0x7f65b409f130 con 0x7f65b409d6f0 2023-10-03T10:13:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65a40057c0 con 0x7f65b409d6f0 2023-10-03T10:13:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1074136690 0 0) 0x7f65a40057c0 con 0x7f65b409d6f0 2023-10-03T10:13:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b409e1d0 msgr2=0x7f65b4135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b409e1d0 0x7f65b4135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 >> v2:172.21.15.19:3300/0 conn(0x7f65b4135e50 msgr2=0x7f65b4138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 --2- 172.21.15.19:0/727868864 >> v2:172.21.15.19:3300/0 conn(0x7f65b4135e50 0x7f65b4138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b409b2d0 con 0x7f65b409d6f0 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f65a80019f0 con 0x7f65b409d6f0 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 >> v1:172.21.15.19:6789/0 conn(0x7f65b409d6f0 legacy=0x7f65b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65a4005c10 0x7f65a4006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65a40065a0 0x7f65a4006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40071a0 0x7f65a400dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b409e930 con 0x7f65a40071a0 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a400e160 con 0x7f65a40065a0 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.618+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65a400e2a0 con 0x7f65a4005c10 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba8ce700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40071a0 0x7f65a400dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65a4005c10 0x7f65a4006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65b98cc700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65a40065a0 0x7f65a4006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 -- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65a40065a0 msgr2=0x7f65a4006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65a40065a0 0x7f65a4006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 -- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40071a0 msgr2=0x7f65a400dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65a40071a0 0x7f65a400dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.619+0000 7f65ba0cd700 1 -- 172.21.15.19:0/727868864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b409b2d0 con 0x7f65a4005c10 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.620+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65a4005c10 0x7f65a4006020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f65a800a8c0 tx=0x7f65a4007a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfe1954f069ffb8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.620+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800a310 con 0x7f65a4005c10 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.620+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8012600 con 0x7f65a4005c10 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.620+0000 7f65b90cb700 1 -- 172.21.15.19:0/727868864 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80129b0 con 0x7f65a4005c10 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.622+0000 7f65bc331700 1 -- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65a4005c10 msgr2=0x7f65a4006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.622+0000 7f65bc331700 1 --2- 172.21.15.19:0/727868864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65a4005c10 0x7f65a4006020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f65a800a8c0 tx=0x7f65a4007a90 comp rx=0 tx=0).stop 2023-10-03T10:13:29.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.622+0000 7f65ba8ce700 1 -- 172.21.15.19:0/727868864 reap_dead start 2023-10-03T10:13:29.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.623+0000 7f65bc331700 1 -- 172.21.15.19:0/727868864 shutdown_connections 2023-10-03T10:13:29.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.623+0000 7f65bc331700 1 -- 172.21.15.19:0/727868864 >> 172.21.15.19:0/727868864 conn(0x7f65b4066f50 msgr2=0x7f65b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.624+0000 7f65bc331700 1 -- 172.21.15.19:0/727868864 shutdown_connections 2023-10-03T10:13:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.624+0000 7f65bc331700 1 -- 172.21.15.19:0/727868864 wait complete. 2023-10-03T10:13:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.626+0000 7f65bc331700 1 Processor -- start 2023-10-03T10:13:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.626+0000 7f65bc331700 1 -- start start 2023-10-03T10:13:29.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41c4bd0 0x7f65b4119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b4119c60 0x7f65b411a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b411cb30 con 0x7f65b4119c60 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41baf30 con 0x7f65b41c42c0 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65bc331700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b411b970 con 0x7f65b41c4bd0 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65ba0cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65ba0cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58480/0 (socket says 172.21.15.19:58480) 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.627+0000 7f65ba0cd700 1 -- 172.21.15.19:0/1450804810 learned_addr learned my addr 172.21.15.19:0/1450804810 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 -- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41c4bd0 msgr2=0x7f65b4119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41c4bd0 0x7f65b4119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 -- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b4119c60 msgr2=0x7f65b411a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b4119c60 0x7f65b411a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 -- 172.21.15.19:0/1450804810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40a3b20 con 0x7f65b41c42c0 2023-10-03T10:13:29.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65ba0cd700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000f80 tx=0x7f65a8001cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.628+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80019b0 con 0x7f65b41c42c0 2023-10-03T10:13:29.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.629+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a8027470 con 0x7f65b41c42c0 2023-10-03T10:13:29.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.629+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a80277e0 con 0x7f65b41c42c0 2023-10-03T10:13:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.629+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b409c700 con 0x7f65b41c42c0 2023-10-03T10:13:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.629+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b411d860 con 0x7f65b41c42c0 2023-10-03T10:13:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.630+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f65a8024070 con 0x7f65b41c42c0 2023-10-03T10:13:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.630+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f65a8041970 con 0x7f65b41c42c0 2023-10-03T10:13:29.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.631+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b411cca0 con 0x7f65b41c42c0 2023-10-03T10:13:29.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.637+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f65a802c070 con 0x7f65b41c42c0 2023-10-03T10:13:29.659 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.658+0000 7fc857bc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.659 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.658+0000 7fc857bc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.659 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.658+0000 7fc857bc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.659 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.658+0000 7fc857bc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.659 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.658+0000 7fc857bc1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.661 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.660+0000 7fc85a3c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.661 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.660+0000 7fc85a3c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.661 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.660+0000 7fc85a3c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.661 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.660+0000 7fc85a3c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.661 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:29.660+0000 7fc85a3c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-03T10:13:29.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.705+0000 7f752c181700 1 Processor -- start 2023-10-03T10:13:29.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 -- start start 2023-10-03T10:13:29.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 0x7f7524133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f752409e390 0x7f752409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7524070c80 con 0x7f75241338c0 2023-10-03T10:13:29.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752409ed20 con 0x7f75241341d0 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752c181700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f752406f720 con 0x7f752409e390 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752971c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f7529f1d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 0x7f7524133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752971c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58546/0 (socket says 172.21.15.19:58546) 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f7529f1d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 0x7f7524133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48822/0 (socket says 172.21.15.19:48822) 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752971c700 1 -- 172.21.15.19:0/2886362842 learned_addr learned my addr 172.21.15.19:0/2886362842 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:29.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.706+0000 7f752a71e700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f752409e390 0x7f752409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 -- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f752409e390 msgr2=0x7f752409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f752409e390 0x7f752409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 -- 172.21.15.19:0/2886362842 >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 msgr2=0x7f7524133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 --2- 172.21.15.19:0/2886362842 >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 0x7f7524133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 -- 172.21.15.19:0/2886362842 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752406fce0 con 0x7f75241341d0 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f752971c700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7514009920 tx=0x7f7514009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb61d1ef18b98b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f7528f1b700 1 -- 172.21.15.19:0/2886362842 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011830 con 0x7f75241341d0 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f7528f1b700 1 -- 172.21.15.19:0/2886362842 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7514011990 con 0x7f75241341d0 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.707+0000 7f7528f1b700 1 -- 172.21.15.19:0/2886362842 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7514011d20 con 0x7f75241341d0 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 -- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 msgr2=0x7f752409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7514009920 tx=0x7f7514009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 -- 172.21.15.19:0/2886362842 shutdown_connections 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f752409e390 0x7f752409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 --2- 172.21.15.19:0/2886362842 >> v2:172.21.15.19:3300/0 conn(0x7f75241338c0 0x7f7524133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 --2- 172.21.15.19:0/2886362842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241341d0 0x7f752409de50 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.708+0000 7f752c181700 1 -- 172.21.15.19:0/2886362842 >> 172.21.15.19:0/2886362842 conn(0x7f75240a2aa0 msgr2=0x7f75240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.709+0000 7f752c181700 1 -- 172.21.15.19:0/2886362842 shutdown_connections 2023-10-03T10:13:29.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.709+0000 7f752c181700 1 -- 172.21.15.19:0/2886362842 wait complete. 2023-10-03T10:13:29.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.710+0000 7f752c181700 1 Processor -- start 2023-10-03T10:13:29.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.710+0000 7f752c181700 1 -- start start 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 0x7f752411e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 0x7f752411eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7524130d10 con 0x7f752409e390 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752406f960 con 0x7f75241338c0 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752c181700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75241213a0 con 0x7f75241341d0 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51190/0 (socket says 172.21.15.19:51190) 2023-10-03T10:13:29.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 -- 172.21.15.19:0/3532886695 learned_addr learned my addr 172.21.15.19:0/3532886695 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752971c700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 0x7f752411eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f7529f1d700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 0x7f752411e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 -- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 msgr2=0x7f752411eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 0x7f752411eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 -- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 msgr2=0x7f752411e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 0x7f752411e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752a71e700 1 -- 172.21.15.19:0/3532886695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7514009550 con 0x7f75241341d0 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f7529f1d700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 0x7f752411e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.711+0000 7f752971c700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 0x7f752411eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f752a71e700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f751c00efc0 tx=0x7f751c00c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c00cb80 con 0x7f75241341d0 2023-10-03T10:13:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c00f040 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7524121c20 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c014480 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.712+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7524122c20 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.713+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 6) v1 ==== 35253+0+0 (secure 0 0 0) 0x7f751c0145e0 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.713+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4026+0+0 (secure 0 0 0) 0x7f751c03fd40 con 0x7f75241341d0 2023-10-03T10:13:29.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.713+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7524074ea0 con 0x7f75241341d0 2023-10-03T10:13:29.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.718+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+155592 (secure 0 0 0) 0x7f751c018020 con 0x7f75241341d0 2023-10-03T10:13:29.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.798+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9278074ea0 con 0x7f927809e000 2023-10-03T10:13:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.798+0000 7f925f7fe700 1 -- 172.21.15.19:0/663133721 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f926c00cea0 con 0x7f927809e000 2023-10-03T10:13:29.799 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:29.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 msgr2=0x7f927813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f926c00ebe0 tx=0x7f926c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 shutdown_connections 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f927809e410 0x7f927813a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f927809d6f0 0x7f9278139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.800+0000 7f927d582700 1 --2- 172.21.15.19:0/663133721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f927809e000 0x7f927813a0f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.801+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 >> 172.21.15.19:0/663133721 conn(0x7f9278066f50 msgr2=0x7f92780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.801+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 shutdown_connections 2023-10-03T10:13:29.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.801+0000 7f927d582700 1 -- 172.21.15.19:0/663133721 wait complete. 2023-10-03T10:13:29.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:13:29.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.840+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65b4074ea0 con 0x7f65b41c42c0 2023-10-03T10:13:29.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.841+0000 7f65b2ffd700 1 -- 172.21.15.19:0/1450804810 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65a8036090 con 0x7f65b41c42c0 2023-10-03T10:13:29.842 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 msgr2=0x7f65b41c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000f80 tx=0x7f65a8001cb0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 shutdown_connections 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b4119c60 0x7f65b411a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41c42c0 0x7f65b41c4690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 --2- 172.21.15.19:0/1450804810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41c4bd0 0x7f65b4119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 >> 172.21.15.19:0/1450804810 conn(0x7f65b4066f50 msgr2=0x7f65b4132810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 shutdown_connections 2023-10-03T10:13:29.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.843+0000 7f65bc331700 1 -- 172.21.15.19:0/1450804810 wait complete. 2023-10-03T10:13:29.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-03T10:13:29.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.867+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb7180713a0 con 0x7fb71806f5d0 2023-10-03T10:13:29.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.868+0000 7fb7157fa700 1 -- 172.21.15.19:0/942935007 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb70c0123b0 con 0x7fb71806f5d0 2023-10-03T10:13:29.869 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 msgr2=0x7fb718099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00c550 tx=0x7fb70c00c910 comp rx=0 tx=0).stop 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 shutdown_connections 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb718135c20 0x7fb71809a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71806f5d0 0x7fb718099d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 --2- 172.21.15.19:0/942935007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb71812cf60 0x7fb71809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 >> 172.21.15.19:0/942935007 conn(0x7fb7180a2aa0 msgr2=0x7fb71806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 shutdown_connections 2023-10-03T10:13:29.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.870+0000 7fb71eff7700 1 -- 172.21.15.19:0/942935007 wait complete. 2023-10-03T10:13:29.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2023-10-03T10:13:29.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.903+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f752406b9e0 con 0x7f75241341d0 2023-10-03T10:13:29.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.903+0000 7f751a7fc700 1 -- 172.21.15.19:0/3532886695 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f751c01a680 con 0x7f75241341d0 2023-10-03T10:13:29.904 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.905+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 msgr2=0x7f752411f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f751c00efc0 tx=0x7f751c00c0c0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 shutdown_connections 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75241341d0 0x7f752411f3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f752409e390 0x7f752411e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 --2- 172.21.15.19:0/3532886695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75241338c0 0x7f752411eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 >> 172.21.15.19:0/3532886695 conn(0x7f75240a2aa0 msgr2=0x7f752409f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 shutdown_connections 2023-10-03T10:13:29.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:29.906+0000 7f752c181700 1 -- 172.21.15.19:0/3532886695 wait complete. 2023-10-03T10:13:29.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2023-10-03T10:13:30.543 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:30.542+0000 7fc89e18b700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-03T10:13:30.544 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:30.542+0000 7fc89e18b700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-03T10:13:30.544 INFO:tasks.ceph.mgr.x.smithi019.stderr:2023-10-03T10:13:30.543+0000 7fc89e18b700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-10-03T10:13:30.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:30.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:30.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:30.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:30.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.980+0000 7f3d537e9700 1 Processor -- start 2023-10-03T10:13:30.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.980+0000 7f3d537e9700 1 -- start start 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c09de50 0x7f3d4c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d4c09e760 0x7f3d4c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4c06fef0 con 0x7f3d4c09e760 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c06ef30 con 0x7f3d4c09de50 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d537e9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c1334b0 con 0x7f3d4c1338a0 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51192/0 (socket says 172.21.15.19:51192) 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 -- 172.21.15.19:0/1563047988 learned_addr learned my addr 172.21.15.19:0/1563047988 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d50d84700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c09de50 0x7f3d4c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 -- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c09de50 msgr2=0x7f3d4c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c09de50 0x7f3d4c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 -- 172.21.15.19:0/1563047988 >> v2:172.21.15.19:3300/0 conn(0x7f3d4c09e760 msgr2=0x7f3d4c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:30.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 --2- 172.21.15.19:0/1563047988 >> v2:172.21.15.19:3300/0 conn(0x7f3d4c09e760 0x7f3d4c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.981+0000 7f3d51585700 1 -- 172.21.15.19:0/1563047988 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4c06fc30 con 0x7f3d4c1338a0 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.982+0000 7f3d51585700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009920 tx=0x7f3d48009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa06fc08b8ffef8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.982+0000 7f3d43fff700 1 -- 172.21.15.19:0/1563047988 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011830 con 0x7f3d4c1338a0 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.982+0000 7f3d43fff700 1 -- 172.21.15.19:0/1563047988 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48011990 con 0x7f3d4c1338a0 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.982+0000 7f3d43fff700 1 -- 172.21.15.19:0/1563047988 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48011d20 con 0x7f3d4c1338a0 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 -- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 msgr2=0x7f3d4c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009920 tx=0x7f3d48009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 -- 172.21.15.19:0/1563047988 shutdown_connections 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 --2- 172.21.15.19:0/1563047988 >> v2:172.21.15.19:3300/0 conn(0x7f3d4c09e760 0x7f3d4c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c1338a0 0x7f3d4c133c70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 --2- 172.21.15.19:0/1563047988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c09de50 0x7f3d4c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 -- 172.21.15.19:0/1563047988 >> 172.21.15.19:0/1563047988 conn(0x7f3d4c0a2aa0 msgr2=0x7f3d4c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 -- 172.21.15.19:0/1563047988 shutdown_connections 2023-10-03T10:13:30.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.983+0000 7f3d537e9700 1 -- 172.21.15.19:0/1563047988 wait complete. 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.984+0000 7f3d537e9700 1 Processor -- start 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.984+0000 7f3d537e9700 1 -- start start 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 0x7f3d4c11f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 0x7f3d4c11f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c12f720 con 0x7f3d4c09e760 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c121d20 con 0x7f3d4c1338a0 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d537e9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4c11ffd0 con 0x7f3d4c09de50 2023-10-03T10:13:30.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d51585700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d51585700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51194/0 (socket says 172.21.15.19:51194) 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d51585700 1 -- 172.21.15.19:0/2769826939 learned_addr learned my addr 172.21.15.19:0/2769826939 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d51d86700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 0x7f3d4c11f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.985+0000 7f3d50d84700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 0x7f3d4c11f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 -- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 msgr2=0x7f3d4c11f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 0x7f3d4c11f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 -- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 msgr2=0x7f3d4c11f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 0x7f3d4c11f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 -- 172.21.15.19:0/2769826939 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d48009550 con 0x7f3d4c09de50 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51d86700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 0x7f3d4c11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d50d84700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 0x7f3d4c11f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d51585700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000c00 tx=0x7f3d48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d480036a0 con 0x7f3d4c09de50 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d48003800 con 0x7f3d4c09de50 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4c122640 con 0x7f3d4c09de50 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48003bb0 con 0x7f3d4c09de50 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.986+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4c06f640 con 0x7f3d4c09de50 2023-10-03T10:13:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.988+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f3d48003d10 con 0x7f3d4c09de50 2023-10-03T10:13:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.988+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4c074ea0 con 0x7f3d4c09de50 2023-10-03T10:13:30.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.988+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f3d48040880 con 0x7f3d4c09de50 2023-10-03T10:13:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:30.993+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d4802b360 con 0x7f3d4c09de50 2023-10-03T10:13:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.033+0000 7f62f6b3e700 1 Processor -- start 2023-10-03T10:13:31.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.033+0000 7f62f6b3e700 1 -- start start 2023-10-03T10:13:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f6b3e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f012f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f6b3e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62f012c2f0 0x7f62f012fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f6b3e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f009a510 con 0x7f62f012cff0 2023-10-03T10:13:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f6b3e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f012c7d0 con 0x7f62f012c2f0 2023-10-03T10:13:31.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f6b3e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f009c190 con 0x7f62f012cc20 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62effff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62f012c2f0 0x7f62f012fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f50db700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f62f012cff0 0x7f62f0136cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38122/0 (socket says 172.21.15.19:38122) 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.034+0000 7f62f50db700 1 -- 172.21.15.19:0/52917931 learned_addr learned my addr 172.21.15.19:0/52917931 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62f48da700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62effff700 1 -- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 msgr2=0x7f62f012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62effff700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f012f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62effff700 1 -- 172.21.15.19:0/52917931 >> v1:172.21.15.19:6789/0 conn(0x7f62f012cff0 legacy=0x7f62f0136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62effff700 1 -- 172.21.15.19:0/52917931 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f009b540 con 0x7f62f012c2f0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62ef7fe700 1 -- 172.21.15.19:0/52917931 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304797648 0 0) 0x7f62f009a510 con 0x7f62f012cff0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62effff700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012c2f0 0x7f62f012fe70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00bae0 tx=0x7f62dc00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ce46fca3f77c73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62ef7fe700 1 -- 172.21.15.19:0/52917931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00dd30 con 0x7f62f012c2f0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62ef7fe700 1 -- 172.21.15.19:0/52917931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00de90 con 0x7f62f012c2f0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.035+0000 7f62ef7fe700 1 -- 172.21.15.19:0/52917931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc010690 con 0x7f62f012c2f0 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 -- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012c2f0 msgr2=0x7f62f012fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012c2f0 0x7f62f012fe70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62dc00bae0 tx=0x7f62dc00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 -- 172.21.15.19:0/52917931 shutdown_connections 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f012f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/52917931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012c2f0 0x7f62f012fe70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 -- 172.21.15.19:0/52917931 >> 172.21.15.19:0/52917931 conn(0x7f62f009f470 msgr2=0x7f62f00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 -- 172.21.15.19:0/52917931 shutdown_connections 2023-10-03T10:13:31.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.036+0000 7f62f6b3e700 1 -- 172.21.15.19:0/52917931 wait complete. 2023-10-03T10:13:31.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.037+0000 7f62f6b3e700 1 Processor -- start 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 -- start start 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 0x7f62f0128290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f01287d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 0x7f62f0128d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f006ff40 con 0x7f62f012cff0 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f006ecb0 con 0x7f62f012c2f0 2023-10-03T10:13:31.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.038+0000 7f62f6b3e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62f012b480 con 0x7f62f012cc20 2023-10-03T10:13:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f01287d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f50db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 0x7f62f0128d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f01287d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51218/0 (socket says 172.21.15.19:51218) 2023-10-03T10:13:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62effff700 1 -- 172.21.15.19:0/1079543560 learned_addr learned my addr 172.21.15.19:0/1079543560 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 0x7f62f0128290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 -- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 msgr2=0x7f62f01287d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f01287d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 -- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 msgr2=0x7f62f0128d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 0x7f62f0128d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 -- 172.21.15.19:0/1079543560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc00b740 con 0x7f62f012c2f0 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f50db700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 0x7f62f0128d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.039+0000 7f62f48da700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 0x7f62f0128290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009ea0 tx=0x7f62e400eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.040+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e400c070 con 0x7f62f012c2f0 2023-10-03T10:13:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.040+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f0129f10 con 0x7f62f012c2f0 2023-10-03T10:13:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.040+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e4013ac0 con 0x7f62f012c2f0 2023-10-03T10:13:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.040+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4013e50 con 0x7f62f012c2f0 2023-10-03T10:13:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.040+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f006f9e0 con 0x7f62f012c2f0 2023-10-03T10:13:31.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.041+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f006eed0 con 0x7f62f012c2f0 2023-10-03T10:13:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.041+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f62e401b3f0 con 0x7f62f012c2f0 2023-10-03T10:13:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.042+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f62e4043010 con 0x7f62f012c2f0 2023-10-03T10:13:31.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.051+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62e400f040 con 0x7f62f012c2f0 2023-10-03T10:13:31.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 Processor -- start 2023-10-03T10:13:31.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 -- start start 2023-10-03T10:13:31.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed812f8b0 0x7f1ed812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed812cd90 con 0x7f1ed8130260 2023-10-03T10:13:31.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed812d330 con 0x7f1ed812f8b0 2023-10-03T10:13:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.081+0000 7f1edf64f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed81306e0 con 0x7f1ed812cf60 2023-10-03T10:13:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed812f8b0 0x7f1ed812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed812f8b0 0x7f1ed812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48856/0 (socket says 172.21.15.19:48856) 2023-10-03T10:13:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 -- 172.21.15.19:0/2044281613 learned_addr learned my addr 172.21.15.19:0/2044281613 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:31.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edd3eb700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 -- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 msgr2=0x7f1ed806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 -- 172.21.15.19:0/2044281613 >> v1:172.21.15.19:6789/0 conn(0x7f1ed8130260 legacy=0x7f1ed8136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 -- 172.21.15.19:0/2044281613 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed8071780 con 0x7f1ed812f8b0 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1edcbea700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed812f8b0 0x7f1ed812fd20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800bb90 tx=0x7f1ec800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f4d7c92d33386b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.082+0000 7f1ecffff700 1 -- 172.21.15.19:0/2044281613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec800dc20 con 0x7f1ed812f8b0 2023-10-03T10:13:31.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1ecffff700 1 -- 172.21.15.19:0/2044281613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec800dd80 con 0x7f1ed812f8b0 2023-10-03T10:13:31.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1ecffff700 1 -- 172.21.15.19:0/2044281613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8017620 con 0x7f1ed812f8b0 2023-10-03T10:13:31.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 -- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed812f8b0 msgr2=0x7f1ed812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed812f8b0 0x7f1ed812fd20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1ec800bb90 tx=0x7f1ec800bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 -- 172.21.15.19:0/2044281613 shutdown_connections 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 --2- 172.21.15.19:0/2044281613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed812f8b0 0x7f1ed812fd20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.083+0000 7f1edf64f700 1 -- 172.21.15.19:0/2044281613 >> 172.21.15.19:0/2044281613 conn(0x7f1ed80a2aa0 msgr2=0x7f1ed80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.084+0000 7f1edf64f700 1 -- 172.21.15.19:0/2044281613 shutdown_connections 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.084+0000 7f1edf64f700 1 -- 172.21.15.19:0/2044281613 wait complete. 2023-10-03T10:13:31.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.085+0000 7f1edf64f700 1 Processor -- start 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.085+0000 7f1edf64f700 1 -- start start 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed81c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed812f8b0 0x7f1ed81c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed809d240 con 0x7f1ed8130260 2023-10-03T10:13:31.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed812a010 con 0x7f1ed812cf60 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edf64f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed809cda0 con 0x7f1ed812f8b0 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48864/0 (socket says 172.21.15.19:48864) 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1edcbea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed812f8b0 0x7f1ed81c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 -- 172.21.15.19:0/579332496 learned_addr learned my addr 172.21.15.19:0/579332496 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:31.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 -- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed812f8b0 msgr2=0x7f1ed81c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed812f8b0 0x7f1ed81c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 -- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 msgr2=0x7f1ed81c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed81c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.086+0000 7f1eddbec700 1 -- 172.21.15.19:0/579332496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec800b7f0 con 0x7f1ed8130260 2023-10-03T10:13:31.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1eddbec700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000cc80 tx=0x7f1ed000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed0003c00 con 0x7f1ed8130260 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed0003d60 con 0x7f1ed8130260 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed809eb30 con 0x7f1ed8130260 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed000aaf0 con 0x7f1ed8130260 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.087+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed809d410 con 0x7f1ed8130260 2023-10-03T10:13:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.088+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f1ed000ac50 con 0x7f1ed8130260 2023-10-03T10:13:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.088+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8074ea0 con 0x7f1ed8130260 2023-10-03T10:13:31.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.088+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f1ed003f700 con 0x7f1ed8130260 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.091+0000 7f74c4199700 1 Processor -- start 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.091+0000 7f74c4199700 1 -- start start 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c4199700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c4199700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74bc131fd0 0x7f74bc06e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c4199700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc09b420 con 0x7f74bc09ed20 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c4199700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74bc1314a0 con 0x7f74bc131fd0 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c4199700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc099ce0 con 0x7f74bc1316c0 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c2736700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f74bc09ed20 0x7f74bc06e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38128/0 (socket says 172.21.15.19:38128) 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.092+0000 7f74c2736700 1 -- 172.21.15.19:0/305673548 learned_addr learned my addr 172.21.15.19:0/305673548 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1f35700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 --2- 172.21.15.19:0/305673548 >> v2:172.21.15.19:3300/0 conn(0x7f74bc131fd0 0x7f74bc06e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 -- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 msgr2=0x7f74bc131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 -- 172.21.15.19:0/305673548 >> v1:172.21.15.19:6789/0 conn(0x7f74bc09ed20 legacy=0x7f74bc06e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 -- 172.21.15.19:0/305673548 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc09a510 con 0x7f74bc131fd0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1f35700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.093+0000 7f74c1734700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc06e490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009840 tx=0x7f74ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f931364c372a903 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.095+0000 7f74c0f33700 1 -- 172.21.15.19:0/305673548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74bc131fd0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.095+0000 7f74c0f33700 1 -- 172.21.15.19:0/305673548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74bc131fd0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.095+0000 7f74c0f33700 1 -- 172.21.15.19:0/305673548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d20 con 0x7f74bc131fd0 2023-10-03T10:13:31.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.095+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ed00196c0 con 0x7f1ed8130260 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 -- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 msgr2=0x7f74bc06e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc06e490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009840 tx=0x7f74ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 -- 172.21.15.19:0/305673548 shutdown_connections 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 --2- 172.21.15.19:0/305673548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc06e490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 -- 172.21.15.19:0/305673548 >> 172.21.15.19:0/305673548 conn(0x7f74bc0a2aa0 msgr2=0x7f74bc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 -- 172.21.15.19:0/305673548 shutdown_connections 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.096+0000 7f74c4199700 1 -- 172.21.15.19:0/305673548 wait complete. 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.097+0000 7f74c4199700 1 Processor -- start 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.097+0000 7f74c4199700 1 -- start start 2023-10-03T10:13:31.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 0x7f74bc06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc0700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc070ab0 con 0x7f74bc131fd0 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc130690 con 0x7f74bc1316c0 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c4199700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc099f20 con 0x7f74bc09ed20 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1734700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1734700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58624/0 (socket says 172.21.15.19:58624) 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1734700 1 -- 172.21.15.19:0/2029398568 learned_addr learned my addr 172.21.15.19:0/2029398568 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1f35700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 0x7f74bc06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1f35700 1 -- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 msgr2=0x7f74bc06fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.098+0000 7f74c1f35700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c1f35700 1 -- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 msgr2=0x7f74bc0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c1f35700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc0700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c1f35700 1 -- 172.21.15.19:0/2029398568 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094a0 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c1734700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c1f35700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 0x7f74bc06f650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9b0 tx=0x7f74b800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800c850 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b800c9b0 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac0094a0 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b800cd60 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.099+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc1204b0 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.100+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 7) v1 ==== 35345+0+0 (secure 0 0 0) 0x7f74b8013470 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.100+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 4009+0+0 (secure 0 0 0) 0x7f74b803f8d0 con 0x7f74bc09ed20 2023-10-03T10:13:31.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.102+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc06f090 con 0x7f74bc09ed20 2023-10-03T10:13:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.107+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74b8021020 con 0x7f74bc09ed20 2023-10-03T10:13:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.237+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d4c06b9e0 con 0x7f3d4c09de50 2023-10-03T10:13:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.238+0000 7f3d41ffb700 1 -- 172.21.15.19:0/2769826939 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d48028020 con 0x7f3d4c09de50 2023-10-03T10:13:31.240 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 >> v1:172.21.15.19:6816/126819 conn(0x7f3d3002f240 legacy=0x7f3d300316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 msgr2=0x7f3d4c11eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000c00 tx=0x7f3d48004750 comp rx=0 tx=0).stop 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 shutdown_connections 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d4c1338a0 0x7f3d4c11f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d4c09de50 0x7f3d4c11eb70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 --2- 172.21.15.19:0/2769826939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d4c09e760 0x7f3d4c11f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 >> 172.21.15.19:0/2769826939 conn(0x7f3d4c0a2aa0 msgr2=0x7f3d4c09ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 shutdown_connections 2023-10-03T10:13:31.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.240+0000 7f3d537e9700 1 -- 172.21.15.19:0/2769826939 wait complete. 2023-10-03T10:13:31.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.1 2023-10-03T10:13:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.318+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f74bc074ea0 con 0x7f74bc09ed20 2023-10-03T10:13:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.318+0000 7f74b27fc700 1 -- 172.21.15.19:0/2029398568 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74b802a090 con 0x7f74bc09ed20 2023-10-03T10:13:31.319 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.320+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 >> v1:172.21.15.19:6816/126819 conn(0x7f74a002f240 legacy=0x7f74a00316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 msgr2=0x7f74bc06f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 0x7f74bc06f650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f74b800e9b0 tx=0x7f74b800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 shutdown_connections 2023-10-03T10:13:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74bc131fd0 0x7f74bc0700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74bc09ed20 0x7f74bc06f650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 --2- 172.21.15.19:0/2029398568 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74bc1316c0 0x7f74bc06fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 >> 172.21.15.19:0/2029398568 conn(0x7f74bc0a2aa0 msgr2=0x7f74bc0a1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 shutdown_connections 2023-10-03T10:13:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.321+0000 7f74c4199700 1 -- 172.21.15.19:0/2029398568 wait complete. 2023-10-03T10:13:31.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.331+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f62f0130330 con 0x7f62f012c2f0 2023-10-03T10:13:31.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.331+0000 7f62ed7fa700 1 -- 172.21.15.19:0/1079543560 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f62e4018a90 con 0x7f62f012c2f0 2023-10-03T10:13:31.335 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:31.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705695 for osd.2 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 >> v1:172.21.15.19:6816/126819 conn(0x7f62d402f240 legacy=0x7f62d40316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 msgr2=0x7f62f0128290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 0x7f62f0128290 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f62e4009ea0 tx=0x7f62e400eac0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 shutdown_connections 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62f012cff0 0x7f62f0128d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62f012c2f0 0x7f62f0128290 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 --2- 172.21.15.19:0/1079543560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62f012cc20 0x7f62f01287d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 >> 172.21.15.19:0/1079543560 conn(0x7f62f009f470 msgr2=0x7f62f00a02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 shutdown_connections 2023-10-03T10:13:31.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.334+0000 7f62f6b3e700 1 -- 172.21.15.19:0/1079543560 wait complete. 2023-10-03T10:13:31.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.3 2023-10-03T10:13:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.355+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ed80713a0 con 0x7f1ed8130260 2023-10-03T10:13:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.356+0000 7f1ecdffb700 1 -- 172.21.15.19:0/579332496 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ed0011380 con 0x7f1ed8130260 2023-10-03T10:13:31.363 INFO:teuthology.orchestra.run.smithi019.stdout:38654705693 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 >> v1:172.21.15.19:6816/126819 conn(0x7f1ebc02f240 legacy=0x7f1ebc0316f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 msgr2=0x7f1ed81c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ed000cc80 tx=0x7f1ed000cf90 comp rx=0 tx=0).stop 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 shutdown_connections 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed8130260 0x7f1ed81c4a40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed812cf60 0x7f1ed81c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 --2- 172.21.15.19:0/579332496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed812f8b0 0x7f1ed81c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 >> 172.21.15.19:0/579332496 conn(0x7f1ed80a2aa0 msgr2=0x7f1ed806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 shutdown_connections 2023-10-03T10:13:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:31.358+0000 7f1edf64f700 1 -- 172.21.15.19:0/579332496 wait complete. 2023-10-03T10:13:31.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705693 for osd.0 2023-10-03T10:13:32.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:13:32.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:13:32.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:13:32.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:13:32.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.409+0000 7fa8c4c5e700 1 Processor -- start 2023-10-03T10:13:32.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.409+0000 7fa8c4c5e700 1 -- start start 2023-10-03T10:13:32.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.410+0000 7fa8c4c5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.410+0000 7fa8c4c5e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa8c009e000 0x7fa8c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8c4c5e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c009f130 con 0x7fa8c009e410 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8c4c5e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c009f520 con 0x7fa8c009e000 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8c4c5e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c009e930 con 0x7fa8c009d6f0 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58658/0 (socket says 172.21.15.19:58658) 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 -- 172.21.15.19:0/4235615520 learned_addr learned my addr 172.21.15.19:0/4235615520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8bdd9b700 1 --2- 172.21.15.19:0/4235615520 >> v2:172.21.15.19:3300/0 conn(0x7fa8c009e000 0x7fa8c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 -- 172.21.15.19:0/4235615520 >> v2:172.21.15.19:3300/0 conn(0x7fa8c009e000 msgr2=0x7fa8c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8bd59a700 1 -- 172.21.15.19:0/4235615520 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127503559 0 0) 0x7fa8c009f130 con 0x7fa8c009e410 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 --2- 172.21.15.19:0/4235615520 >> v2:172.21.15.19:3300/0 conn(0x7fa8c009e000 0x7fa8c0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 -- 172.21.15.19:0/4235615520 >> v1:172.21.15.19:6789/0 conn(0x7fa8c009e410 legacy=0x7fa8c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.411+0000 7fa8be59c700 1 -- 172.21.15.19:0/4235615520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c009b2d0 con 0x7fa8c009d6f0 2023-10-03T10:13:32.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.412+0000 7fa8be59c700 1 --2- 172.21.15.19:0/4235615520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000bb90 tx=0x7fa8b000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15436c49a5e74135 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.412+0000 7fa8bd59a700 1 -- 172.21.15.19:0/4235615520 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000db30 con 0x7fa8c009d6f0 2023-10-03T10:13:32.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.412+0000 7fa8bd59a700 1 -- 172.21.15.19:0/4235615520 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b000dc90 con 0x7fa8c009d6f0 2023-10-03T10:13:32.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.412+0000 7fa8bd59a700 1 -- 172.21.15.19:0/4235615520 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0010470 con 0x7fa8c009d6f0 2023-10-03T10:13:32.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.413+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/4235615520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 msgr2=0x7fa8c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.413+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/4235615520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000bb90 tx=0x7fa8b000bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.415+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/4235615520 shutdown_connections 2023-10-03T10:13:32.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.415+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/4235615520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009d6f0 0x7fa8c009dac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.415+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/4235615520 >> v2:172.21.15.19:3300/0 conn(0x7fa8c009e000 0x7fa8c0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.415+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/4235615520 >> 172.21.15.19:0/4235615520 conn(0x7fa8c0066f50 msgr2=0x7fa8c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.416+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/4235615520 shutdown_connections 2023-10-03T10:13:32.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.416+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/4235615520 wait complete. 2023-10-03T10:13:32.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.417+0000 7fa8c4c5e700 1 Processor -- start 2023-10-03T10:13:32.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 -- start start 2023-10-03T10:13:32.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 0x7fa8c01bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009e000 0x7fa8c01bff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c009c700 con 0x7fa8c009e410 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c01bf400 con 0x7fa8c009e000 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.418+0000 7fa8c4c5e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c01c11c0 con 0x7fa8c009d6f0 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 0x7fa8c01bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48926/0 (socket says 172.21.15.19:48926) 2023-10-03T10:13:32.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 -- 172.21.15.19:0/2875480675 learned_addr learned my addr 172.21.15.19:0/2875480675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8be59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 0x7fa8c01bfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51294/0 (socket says 172.21.15.19:51294) 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bdd9b700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009e000 0x7fa8c01bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 -- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 msgr2=0x7fa8c01bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 0x7fa8c01bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 -- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009e000 msgr2=0x7fa8c01bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009e000 0x7fa8c01bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.419+0000 7fa8bed9d700 1 -- 172.21.15.19:0/2875480675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b000b7f0 con 0x7fa8c009e410 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8bed9d700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c7c0 tx=0x7fa8b800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8003e30 con 0x7fa8c009e410 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b8005070 con 0x7fa8c009e410 2023-10-03T10:13:32.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c01be8a0 con 0x7fa8c009e410 2023-10-03T10:13:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8005420 con 0x7fa8c009e410 2023-10-03T10:13:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.420+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c01c09e0 con 0x7fa8c009e410 2023-10-03T10:13:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.421+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fa8b8005580 con 0x7fa8c009e410 2023-10-03T10:13:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.421+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fa8b803f720 con 0x7fa8c009e410 2023-10-03T10:13:32.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.422+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c0074ea0 con 0x7fa8c009e410 2023-10-03T10:13:32.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.432+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa8b8010710 con 0x7fa8c009e410 2023-10-03T10:13:32.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.507+0000 7f8092cfa700 1 Processor -- start 2023-10-03T10:13:32.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.507+0000 7f8092cfa700 1 -- start start 2023-10-03T10:13:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8092cfa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8092cfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c099a40 0x7f808c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8092cfa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c1313c0 con 0x7f808c09a3b0 2023-10-03T10:13:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8092cfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c09b580 con 0x7f808c099a40 2023-10-03T10:13:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8092cfa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f808c06e8c0 con 0x7f808c131810 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51298/0 (socket says 172.21.15.19:51298) 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 -- 172.21.15.19:0/564025361 learned_addr learned my addr 172.21.15.19:0/564025361 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8091297700 1 --1- 172.21.15.19:0/564025361 >> v1:172.21.15.19:6789/0 conn(0x7f808c09a3b0 0x7f808c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38144/0 (socket says 172.21.15.19:38144) 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 -- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c099a40 msgr2=0x7f808c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 --2- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c099a40 0x7f808c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 -- 172.21.15.19:0/564025361 >> v1:172.21.15.19:6789/0 conn(0x7f808c09a3b0 legacy=0x7f808c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.508+0000 7f8090a96700 1 -- 172.21.15.19:0/564025361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c09a820 con 0x7f808c131810 2023-10-03T10:13:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.509+0000 7f8090a96700 1 --2- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8080009920 tx=0x7f8080009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943300046fc2b25c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.509+0000 7f808b7fe700 1 -- 172.21.15.19:0/564025361 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808000ba60 con 0x7f808c131810 2023-10-03T10:13:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.509+0000 7f808b7fe700 1 -- 172.21.15.19:0/564025361 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808000bbc0 con 0x7f808c131810 2023-10-03T10:13:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.509+0000 7f808b7fe700 1 -- 172.21.15.19:0/564025361 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080009e70 con 0x7f808c131810 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 -- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 msgr2=0x7f808c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 --2- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8080009920 tx=0x7f8080009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 -- 172.21.15.19:0/564025361 shutdown_connections 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 --2- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c131810 0x7f808c131be0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 --2- 172.21.15.19:0/564025361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c099a40 0x7f808c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 -- 172.21.15.19:0/564025361 >> 172.21.15.19:0/564025361 conn(0x7f808c0a2aa0 msgr2=0x7f808c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 -- 172.21.15.19:0/564025361 shutdown_connections 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.510+0000 7f8092cfa700 1 -- 172.21.15.19:0/564025361 wait complete. 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.511+0000 7f8092cfa700 1 Processor -- start 2023-10-03T10:13:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.511+0000 7f8092cfa700 1 -- start start 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c09a3b0 0x7f808c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c131810 0x7f808c070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c12e9f0 con 0x7f808c131810 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c130bc0 con 0x7f808c09a3b0 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8092cfa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f808c071330 con 0x7f808c099a40 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51310/0 (socket says 172.21.15.19:51310) 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 -- 172.21.15.19:0/243447947 learned_addr learned my addr 172.21.15.19:0/243447947 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f808bfff700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c09a3b0 0x7f808c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8091297700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c131810 0x7f808c070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 -- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c09a3b0 msgr2=0x7f808c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c09a3b0 0x7f808c06fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 -- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c131810 msgr2=0x7f808c070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c131810 0x7f808c070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.512+0000 7f8090a96700 1 -- 172.21.15.19:0/243447947 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8080009550 con 0x7f808c099a40 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f8090a96700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8080009130 tx=0x7f8080004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080004590 con 0x7f808c099a40 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80800036a0 con 0x7f808c099a40 2023-10-03T10:13:32.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c120fb0 con 0x7f808c099a40 2023-10-03T10:13:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8080003a30 con 0x7f808c099a40 2023-10-03T10:13:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.513+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c121ce0 con 0x7f808c099a40 2023-10-03T10:13:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.514+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f8080003b90 con 0x7f808c099a40 2023-10-03T10:13:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.514+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f80800412f0 con 0x7f808c099a40 2023-10-03T10:13:32.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.514+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c074ea0 con 0x7f808c099a40 2023-10-03T10:13:32.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.520+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8080015080 con 0x7f808c099a40 2023-10-03T10:13:32.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.554+0000 7f9010a72700 1 Processor -- start 2023-10-03T10:13:32.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.554+0000 7f9010a72700 1 -- start start 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9010a72700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9010a72700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9010a72700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c09e130 con 0x7f900c09d9f0 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9010a72700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1312b0 con 0x7f900c1316c0 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9010a72700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f900c09f6e0 con 0x7f900c06ae80 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f900a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9009d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f900c09d9f0 0x7f900c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38148/0 (socket says 172.21.15.19:38148) 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f900ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51314/0 (socket says 172.21.15.19:51314) 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f900a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58688/0 (socket says 172.21.15.19:58688) 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.555+0000 7f9009d9b700 1 -- 172.21.15.19:0/1845353929 learned_addr learned my addr 172.21.15.19:0/1845353929 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900ad9d700 1 -- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 msgr2=0x7f900c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900ad9d700 1 --2- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900ad9d700 1 -- 172.21.15.19:0/1845353929 >> v1:172.21.15.19:6789/0 conn(0x7f900c09d9f0 legacy=0x7f900c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900ad9d700 1 -- 172.21.15.19:0/1845353929 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c09e760 con 0x7f900c06ae80 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900ad9d700 1 --2- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9004009dc0 tx=0x7f900400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a41b654d74c4a66d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900959a700 1 -- 172.21.15.19:0/1845353929 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900400e070 con 0x7f900c06ae80 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900959a700 1 -- 172.21.15.19:0/1845353929 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900400bb20 con 0x7f900c06ae80 2023-10-03T10:13:32.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.556+0000 7f900959a700 1 -- 172.21.15.19:0/1845353929 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9004012430 con 0x7f900c06ae80 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 -- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 msgr2=0x7f900c139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 --2- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9004009dc0 tx=0x7f900400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 -- 172.21.15.19:0/1845353929 shutdown_connections 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 --2- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c139550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 --2- 172.21.15.19:0/1845353929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.557+0000 7f9010a72700 1 -- 172.21.15.19:0/1845353929 >> 172.21.15.19:0/1845353929 conn(0x7f900c066f50 msgr2=0x7f900c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.558+0000 7f9010a72700 1 -- 172.21.15.19:0/1845353929 shutdown_connections 2023-10-03T10:13:32.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.558+0000 7f9010a72700 1 -- 172.21.15.19:0/1845353929 wait complete. 2023-10-03T10:13:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.559+0000 7f9010a72700 1 Processor -- start 2023-10-03T10:13:32.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.559+0000 7f9010a72700 1 -- start start 2023-10-03T10:13:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c11ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c0702e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c119720 con 0x7f900c09d9f0 2023-10-03T10:13:32.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c11a0a0 con 0x7f900c1316c0 2023-10-03T10:13:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9010a72700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f900c12b660 con 0x7f900c06ae80 2023-10-03T10:13:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9009d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48946/0 (socket says 172.21.15.19:48946) 2023-10-03T10:13:32.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.560+0000 7f9009d9b700 1 -- 172.21.15.19:0/3381652872 learned_addr learned my addr 172.21.15.19:0/3381652872 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 -- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 msgr2=0x7f900c11ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c11ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 -- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 msgr2=0x7f900c0702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c0702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 -- 172.21.15.19:0/3381652872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004009a70 con 0x7f900c09d9f0 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f9009d9b700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f900000c4a0 tx=0x7f900000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000005d70 con 0x7f900c09d9f0 2023-10-03T10:13:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90000070d0 con 0x7f900c09d9f0 2023-10-03T10:13:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.561+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9000007440 con 0x7f900c09d9f0 2023-10-03T10:13:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.562+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c071f70 con 0x7f900c09d9f0 2023-10-03T10:13:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.563+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c070a00 con 0x7f900c09d9f0 2023-10-03T10:13:32.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.564+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f90000075a0 con 0x7f900c09d9f0 2023-10-03T10:13:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.564+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f900c09eaa0 con 0x7f900c09d9f0 2023-10-03T10:13:32.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.564+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f90000421c0 con 0x7f900c09d9f0 2023-10-03T10:13:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.568+0000 7f9ac5989700 1 Processor -- start 2023-10-03T10:13:32.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.568+0000 7f9ac5989700 1 -- start start 2023-10-03T10:13:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.568+0000 7f9ac5989700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9ac5989700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ac013d1f0 0x7f9ac013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9ac5989700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac009a810 con 0x7f9ac006a770 2023-10-03T10:13:32.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9ac5989700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac006ab40 con 0x7f9ac013d1f0 2023-10-03T10:13:32.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9ac5989700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac009ebc0 con 0x7f9ac009de00 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9abf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ac013d1f0 0x7f9ac013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9abf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9ac013d1f0 0x7f9ac013f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48950/0 (socket says 172.21.15.19:48950) 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9abf7fe700 1 -- 172.21.15.19:0/915124110 learned_addr learned my addr 172.21.15.19:0/915124110 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9abeffd700 1 --1- 172.21.15.19:0/915124110 >> v1:172.21.15.19:6789/0 conn(0x7f9ac006a770 0x7f9ac009d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38152/0 (socket says 172.21.15.19:38152) 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.569+0000 7f9abe7fc700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f9abf7fe700 1 -- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 msgr2=0x7f9ac009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f9abf7fe700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f9abf7fe700 1 -- 172.21.15.19:0/915124110 >> v1:172.21.15.19:6789/0 conn(0x7f9ac006a770 legacy=0x7f9ac009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f9abf7fe700 1 -- 172.21.15.19:0/915124110 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac009e920 con 0x7f9ac013d1f0 2023-10-03T10:13:32.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9000017030 con 0x7f900c09d9f0 2023-10-03T10:13:32.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.570+0000 7f9abf7fe700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac013d1f0 0x7f9ac013f5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009e50 tx=0x7f9ab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e55b49fc04a11f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.571+0000 7f9abdffb700 1 -- 172.21.15.19:0/915124110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800e070 con 0x7f9ac013d1f0 2023-10-03T10:13:32.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.571+0000 7f9abdffb700 1 -- 172.21.15.19:0/915124110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800b9c0 con 0x7f9ac013d1f0 2023-10-03T10:13:32.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.571+0000 7f9abdffb700 1 -- 172.21.15.19:0/915124110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800bd70 con 0x7f9ac013d1f0 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 -- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac013d1f0 msgr2=0x7f9ac013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac013d1f0 0x7f9ac013f5d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009e50 tx=0x7f9ab800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 -- 172.21.15.19:0/915124110 shutdown_connections 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac013d1f0 0x7f9ac013f5d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 --2- 172.21.15.19:0/915124110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 -- 172.21.15.19:0/915124110 >> 172.21.15.19:0/915124110 conn(0x7f9ac0066f50 msgr2=0x7f9ac009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 -- 172.21.15.19:0/915124110 shutdown_connections 2023-10-03T10:13:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.575+0000 7f9ac5989700 1 -- 172.21.15.19:0/915124110 wait complete. 2023-10-03T10:13:32.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.576+0000 7f9ac5989700 1 Processor -- start 2023-10-03T10:13:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 -- start start 2023-10-03T10:13:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac013b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 0x7f9ac013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac011ea10 con 0x7f9ac006a770 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac011f090 con 0x7f9ac013d1f0 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9ac5989700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac009f1a0 con 0x7f9ac009de00 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.577+0000 7f9abeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48960/0 (socket says 172.21.15.19:48960) 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 -- 172.21.15.19:0/56011548 learned_addr learned my addr 172.21.15.19:0/56011548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abe7fc700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac013b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abf7fe700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 0x7f9ac013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 -- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 msgr2=0x7f9ac013b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac013b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 -- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 msgr2=0x7f9ac013bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 0x7f9ac013bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 -- 172.21.15.19:0/56011548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8009b30 con 0x7f9ac006a770 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abf7fe700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 0x7f9ac013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9abeffd700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c520 tx=0x7f9ab000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0005cb0 con 0x7f9ac006a770 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0005e10 con 0x7f9ac006a770 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.578+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab00072d0 con 0x7f9ac006a770 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.579+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac011e360 con 0x7f9ac006a770 2023-10-03T10:13:32.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.579+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac011f740 con 0x7f9ac006a770 2023-10-03T10:13:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.580+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f9ab0007430 con 0x7f9ac006a770 2023-10-03T10:13:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.580+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9ab00421c0 con 0x7f9ac006a770 2023-10-03T10:13:32.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.580+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac0074ea0 con 0x7f9ac006a770 2023-10-03T10:13:32.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.585+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ab0017030 con 0x7f9ac006a770 2023-10-03T10:13:32.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.691+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa8c006c360 con 0x7fa8c009e410 2023-10-03T10:13:32.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.692+0000 7fa8aeffd700 1 -- 172.21.15.19:0/2875480675 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa8b801a360 con 0x7fa8c009e410 2023-10-03T10:13:32.693 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 >> v1:172.21.15.19:6816/126819 conn(0x7fa8a002f480 legacy=0x7fa8a0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 msgr2=0x7fa8c01c04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800c7c0 tx=0x7fa8b800cad0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 shutdown_connections 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8c009e410 0x7fa8c01c04a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa8c009d6f0 0x7fa8c01bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 --2- 172.21.15.19:0/2875480675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa8c009e000 0x7fa8c01bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.694+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 >> 172.21.15.19:0/2875480675 conn(0x7fa8c0066f50 msgr2=0x7fa8c0070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.695+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 shutdown_connections 2023-10-03T10:13:32.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.695+0000 7fa8c4c5e700 1 -- 172.21.15.19:0/2875480675 wait complete. 2023-10-03T10:13:32.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.1 2023-10-03T10:13:32.710 DEBUG:teuthology.parallel:result is None 2023-10-03T10:13:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.738+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f808c121140 con 0x7f808c099a40 2023-10-03T10:13:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.738+0000 7f80897fa700 1 -- 172.21.15.19:0/243447947 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f808c121140 con 0x7f808c099a40 2023-10-03T10:13:32.739 INFO:teuthology.orchestra.run.smithi019.stdout:38654705697 2023-10-03T10:13:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 >> v1:172.21.15.19:6816/126819 conn(0x7f807002f480 legacy=0x7f8070031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 msgr2=0x7f808c06f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8080009130 tx=0x7f8080004750 comp rx=0 tx=0).stop 2023-10-03T10:13:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 shutdown_connections 2023-10-03T10:13:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f808c131810 0x7f808c070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f808c099a40 0x7f808c06f610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 --2- 172.21.15.19:0/243447947 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f808c09a3b0 0x7f808c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 >> 172.21.15.19:0/243447947 conn(0x7f808c0a2aa0 msgr2=0x7f808c1b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 shutdown_connections 2023-10-03T10:13:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.741+0000 7f8092cfa700 1 -- 172.21.15.19:0/243447947 wait complete. 2023-10-03T10:13:32.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705696 got 38654705697 for osd.2 2023-10-03T10:13:32.755 DEBUG:teuthology.parallel:result is None 2023-10-03T10:13:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.784+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f900c09e130 con 0x7f900c09d9f0 2023-10-03T10:13:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.784+0000 7f8ffaffd700 1 -- 172.21.15.19:0/3381652872 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f900c09e130 con 0x7f900c09d9f0 2023-10-03T10:13:32.785 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 >> v1:172.21.15.19:6816/126819 conn(0x7f8fec02f480 legacy=0x7f8fec031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 msgr2=0x7f900c12b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f900000c4a0 tx=0x7f900000c860 comp rx=0 tx=0).stop 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 shutdown_connections 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f900c1316c0 0x7f900c0702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f900c06ae80 0x7f900c11ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 --2- 172.21.15.19:0/3381652872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f900c09d9f0 0x7f900c12b120 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 >> 172.21.15.19:0/3381652872 conn(0x7f900c066f50 msgr2=0x7f900c1301b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 shutdown_connections 2023-10-03T10:13:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.787+0000 7f9010a72700 1 -- 172.21.15.19:0/3381652872 wait complete. 2023-10-03T10:13:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.795+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9ac009a3d0 con 0x7f9ac006a770 2023-10-03T10:13:32.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.796+0000 7f9aa7fff700 1 -- 172.21.15.19:0/56011548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9ab0017030 con 0x7f9ac006a770 2023-10-03T10:13:32.797 INFO:teuthology.orchestra.run.smithi019.stdout:38654705695 2023-10-03T10:13:32.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 >> v1:172.21.15.19:6816/126819 conn(0x7f9aac02f480 legacy=0x7f9aac031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 msgr2=0x7f9ac0071950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c520 tx=0x7f9ab000c8e0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 shutdown_connections 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9ac013d1f0 0x7f9ac013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9ac006a770 0x7f9ac0071950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 --2- 172.21.15.19:0/56011548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9ac009de00 0x7f9ac013b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 >> 172.21.15.19:0/56011548 conn(0x7f9ac0066f50 msgr2=0x7f9ac009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 shutdown_connections 2023-10-03T10:13:32.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.798+0000 7f9ac5989700 1 -- 172.21.15.19:0/56011548 wait complete. 2023-10-03T10:13:32.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.3 2023-10-03T10:13:32.802 DEBUG:teuthology.parallel:result is None 2023-10-03T10:13:32.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705694 got 38654705695 for osd.0 2023-10-03T10:13:32.813 DEBUG:teuthology.parallel:result is None 2023-10-03T10:13:32.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:13:32.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:13:32.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.992+0000 7f96a0eea700 1 Processor -- start 2023-10-03T10:13:32.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.992+0000 7f96a0eea700 1 -- start start 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f96a0eea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f96a0eea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f969c09f240 0x7f969c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f96a0eea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c070940 con 0x7f969c09f650 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f96a0eea700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c06fd60 con 0x7f969c09f240 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f96a0eea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c06fa80 con 0x7f969c09e930 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f969a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f969c09f240 0x7f969c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f969a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58702/0 (socket says 172.21.15.19:58702) 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f969a59c700 1 -- 172.21.15.19:0/3183505119 learned_addr learned my addr 172.21.15.19:0/3183505119 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 -- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 msgr2=0x7f969c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 -- 172.21.15.19:0/3183505119 >> v1:172.21.15.19:6789/0 conn(0x7f969c09f650 legacy=0x7f969c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 -- 172.21.15.19:0/3183505119 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c09fb60 con 0x7f969c09f240 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f969959a700 1 -- 172.21.15.19:0/3183505119 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267068532 0 0) 0x7f969c070940 con 0x7f969c09f650 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f969a59c700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.993+0000 7f9699d9b700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1317f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f968c009840 tx=0x7f968c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f05a17af9435216 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f969959a700 1 -- 172.21.15.19:0/3183505119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c011830 con 0x7f969c09f240 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f969959a700 1 -- 172.21.15.19:0/3183505119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c011990 con 0x7f969c09f240 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f969959a700 1 -- 172.21.15.19:0/3183505119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c011d20 con 0x7f969c09f240 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 -- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 msgr2=0x7f969c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1317f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f968c009840 tx=0x7f968c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 -- 172.21.15.19:0/3183505119 shutdown_connections 2023-10-03T10:13:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09e930 0x7f969c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 --2- 172.21.15.19:0/3183505119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1317f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 -- 172.21.15.19:0/3183505119 >> 172.21.15.19:0/3183505119 conn(0x7f969c0a4210 msgr2=0x7f969c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 -- 172.21.15.19:0/3183505119 shutdown_connections 2023-10-03T10:13:32.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.994+0000 7f96a0eea700 1 -- 172.21.15.19:0/3183505119 wait complete. 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.995+0000 7f96a0eea700 1 Processor -- start 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.995+0000 7f96a0eea700 1 -- start start 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 0x7f969c1a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1a5f20 con 0x7f969c09f240 2023-10-03T10:13:33.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1a6be0 con 0x7f969c09f650 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f96a0eea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f969c0a32f0 con 0x7f969c09e930 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f969a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 0x7f969c1a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f969ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48986/0 (socket says 172.21.15.19:48986) 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f969ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58708/0 (socket says 172.21.15.19:58708) 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f969a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 0x7f969c1a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51352/0 (socket says 172.21.15.19:51352) 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 -- 172.21.15.19:0/449804745 learned_addr learned my addr 172.21.15.19:0/449804745 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 -- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 msgr2=0x7f969c1a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 0x7f969c1a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 -- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 msgr2=0x7f969c1a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f9699d9b700 1 -- 172.21.15.19:0/449804745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009550 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.996+0000 7f969ad9d700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f9699d9b700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f968c009fd0 tx=0x7f968c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0036a0 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c01f070 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0094a0 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c003a60 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.997+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c0a0190 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.998+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f968c003bc0 con 0x7f969c09f240 2023-10-03T10:13:33.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.998+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f968c021070 con 0x7f969c09f240 2023-10-03T10:13:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:32.998+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c1a71d0 con 0x7f969c09f240 2023-10-03T10:13:33.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.003+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f969c1a71d0 con 0x7f969c09f240 2023-10-03T10:13:33.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.202+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 --> v1:172.21.15.19:6816/126819 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f969c1a73b0 con 0x7f967c02f480 2023-10-03T10:13:33.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.211+0000 7f9692ffd700 1 -- 172.21.15.19:0/449804745 <== mgr.14104 v1:172.21.15.19:6816/126819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270610 (unknown 2965378022 0 4152899852) 0x7f9684009860 con 0x7f967c02f480 2023-10-03T10:13:33.215 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 >> v1:172.21.15.19:6816/126819 conn(0x7f967c02f480 legacy=0x7f967c031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 msgr2=0x7f969c1a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f968c009fd0 tx=0x7f968c004750 comp rx=0 tx=0).stop 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 shutdown_connections 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f969c09f650 0x7f969c1a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f969c09e930 0x7f969c1a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 --2- 172.21.15.19:0/449804745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f969c09f240 0x7f969c1a4230 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 >> 172.21.15.19:0/449804745 conn(0x7f969c0a4210 msgr2=0x7f969c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 shutdown_connections 2023-10-03T10:13:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.214+0000 7f96a0eea700 1 -- 172.21.15.19:0/449804745 wait complete. 2023-10-03T10:13:33.218 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:13:33.229 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2023-10-03T10:13:31.552474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":262506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.006564"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406460+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:12:03.406460+0000","last_peered":"2023-10-03T10:12:03.406460+0000","last_clean":"2023-10-03T10:12:03.406460+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:12:03.406460+0000","last_undegraded":"2023-10-03T10:12:03.406460+0000","last_fullsized":"2023-10-03T10:12:03.406460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408512+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:12:03.408512+0000","last_peered":"2023-10-03T10:12:03.408512+0000","last_clean":"2023-10-03T10:12:03.408512+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:12:03.408512+0000","last_undegraded":"2023-10-03T10:12:03.408512+0000","last_fullsized":"2023-10-03T10:12:03.408512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406060+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:12:03.406060+0000","last_peered":"2023-10-03T10:12:03.406060+0000","last_clean":"2023-10-03T10:12:03.406060+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:12:03.406060+0000","last_undegraded":"2023-10-03T10:12:03.406060+0000","last_fullsized":"2023-10-03T10:12:03.406060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406323+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:12:03.406323+0000","last_peered":"2023-10-03T10:12:03.406323+0000","last_clean":"2023-10-03T10:12:03.406323+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:12:03.406323+0000","last_undegraded":"2023-10-03T10:12:03.406323+0000","last_fullsized":"2023-10-03T10:12:03.406323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405970+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:12:03.405970+0000","last_peered":"2023-10-03T10:12:03.405970+0000","last_clean":"2023-10-03T10:12:03.405970+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:12:03.405970+0000","last_undegraded":"2023-10-03T10:12:03.405970+0000","last_fullsized":"2023-10-03T10:12:03.405970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403716+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:12:03.403716+0000","last_peered":"2023-10-03T10:12:03.403716+0000","last_clean":"2023-10-03T10:12:03.403716+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:12:03.403716+0000","last_undegraded":"2023-10-03T10:12:03.403716+0000","last_fullsized":"2023-10-03T10:12:03.403716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401171+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:12:03.401171+0000","last_peered":"2023-10-03T10:12:03.401171+0000","last_clean":"2023-10-03T10:12:03.401171+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:12:03.401171+0000","last_undegraded":"2023-10-03T10:12:03.401171+0000","last_fullsized":"2023-10-03T10:12:03.401171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696417+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:12:03.696417+0000","last_peered":"2023-10-03T10:12:03.696417+0000","last_clean":"2023-10-03T10:12:03.696417+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:12:03.696417+0000","last_undegraded":"2023-10-03T10:12:03.696417+0000","last_fullsized":"2023-10-03T10:12:03.696417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407397+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:12:03.407397+0000","last_peered":"2023-10-03T10:12:03.407397+0000","last_clean":"2023-10-03T10:12:03.407397+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:12:03.407397+0000","last_undegraded":"2023-10-03T10:12:03.407397+0000","last_fullsized":"2023-10-03T10:12:03.407397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697475+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:12:03.697475+0000","last_peered":"2023-10-03T10:12:03.697475+0000","last_clean":"2023-10-03T10:12:03.697475+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:12:03.697475+0000","last_undegraded":"2023-10-03T10:12:03.697475+0000","last_fullsized":"2023-10-03T10:12:03.697475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697316+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:12:03.697316+0000","last_peered":"2023-10-03T10:12:03.697316+0000","last_clean":"2023-10-03T10:12:03.697316+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:12:03.697316+0000","last_undegraded":"2023-10-03T10:12:03.697316+0000","last_fullsized":"2023-10-03T10:12:03.697316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405002+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:12:03.405002+0000","last_peered":"2023-10-03T10:12:03.405002+0000","last_clean":"2023-10-03T10:12:03.405002+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:12:03.405002+0000","last_undegraded":"2023-10-03T10:12:03.405002+0000","last_fullsized":"2023-10-03T10:12:03.405002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403626+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:12:03.403626+0000","last_peered":"2023-10-03T10:12:03.403626+0000","last_clean":"2023-10-03T10:12:03.403626+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:12:03.403626+0000","last_undegraded":"2023-10-03T10:12:03.403626+0000","last_fullsized":"2023-10-03T10:12:03.403626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697367+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:12:03.697367+0000","last_peered":"2023-10-03T10:12:03.697367+0000","last_clean":"2023-10-03T10:12:03.697367+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:12:03.697367+0000","last_undegraded":"2023-10-03T10:12:03.697367+0000","last_fullsized":"2023-10-03T10:12:03.697367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407523+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:12:03.407523+0000","last_peered":"2023-10-03T10:12:03.407523+0000","last_clean":"2023-10-03T10:12:03.407523+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:12:03.407523+0000","last_undegraded":"2023-10-03T10:12:03.407523+0000","last_fullsized":"2023-10-03T10:12:03.407523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.400921+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:12:03.400921+0000","last_peered":"2023-10-03T10:12:03.400921+0000","last_clean":"2023-10-03T10:12:03.400921+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:12:03.400921+0000","last_undegraded":"2023-10-03T10:12:03.400921+0000","last_fullsized":"2023-10-03T10:12:03.400921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407383+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:12:03.407383+0000","last_peered":"2023-10-03T10:12:03.407383+0000","last_clean":"2023-10-03T10:12:03.407383+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:12:03.407383+0000","last_undegraded":"2023-10-03T10:12:03.407383+0000","last_fullsized":"2023-10-03T10:12:03.407383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406821+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:12:03.406821+0000","last_peered":"2023-10-03T10:12:03.406821+0000","last_clean":"2023-10-03T10:12:03.406821+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:12:03.406821+0000","last_undegraded":"2023-10-03T10:12:03.406821+0000","last_fullsized":"2023-10-03T10:12:03.406821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406612+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:12:03.406612+0000","last_peered":"2023-10-03T10:12:03.406612+0000","last_clean":"2023-10-03T10:12:03.406612+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:12:03.406612+0000","last_undegraded":"2023-10-03T10:12:03.406612+0000","last_fullsized":"2023-10-03T10:12:03.406612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697611+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:12:03.697611+0000","last_peered":"2023-10-03T10:12:03.697611+0000","last_clean":"2023-10-03T10:12:03.697611+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:12:03.697611+0000","last_undegraded":"2023-10-03T10:12:03.697611+0000","last_fullsized":"2023-10-03T10:12:03.697611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696940+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:12:03.696940+0000","last_peered":"2023-10-03T10:12:03.696940+0000","last_clean":"2023-10-03T10:12:03.696940+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:12:03.696940+0000","last_undegraded":"2023-10-03T10:12:03.696940+0000","last_fullsized":"2023-10-03T10:12:03.696940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406598+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:12:03.406598+0000","last_peered":"2023-10-03T10:12:03.406598+0000","last_clean":"2023-10-03T10:12:03.406598+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:12:03.406598+0000","last_undegraded":"2023-10-03T10:12:03.406598+0000","last_fullsized":"2023-10-03T10:12:03.406598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401086+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:12:03.401086+0000","last_peered":"2023-10-03T10:12:03.401086+0000","last_clean":"2023-10-03T10:12:03.401086+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:12:03.401086+0000","last_undegraded":"2023-10-03T10:12:03.401086+0000","last_fullsized":"2023-10-03T10:12:03.401086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696691+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:12:03.696691+0000","last_peered":"2023-10-03T10:12:03.696691+0000","last_clean":"2023-10-03T10:12:03.696691+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:12:03.696691+0000","last_undegraded":"2023-10-03T10:12:03.696691+0000","last_fullsized":"2023-10-03T10:12:03.696691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697937+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:12:03.697937+0000","last_peered":"2023-10-03T10:12:03.697937+0000","last_clean":"2023-10-03T10:12:03.697937+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:12:03.697937+0000","last_undegraded":"2023-10-03T10:12:03.697937+0000","last_fullsized":"2023-10-03T10:12:03.697937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697366+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:12:03.697366+0000","last_peered":"2023-10-03T10:12:03.697366+0000","last_clean":"2023-10-03T10:12:03.697366+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:12:03.697366+0000","last_undegraded":"2023-10-03T10:12:03.697366+0000","last_fullsized":"2023-10-03T10:12:03.697366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402014+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:12:03.402014+0000","last_peered":"2023-10-03T10:12:03.402014+0000","last_clean":"2023-10-03T10:12:03.402014+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:12:03.402014+0000","last_undegraded":"2023-10-03T10:12:03.402014+0000","last_fullsized":"2023-10-03T10:12:03.402014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697143+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:12:03.697143+0000","last_peered":"2023-10-03T10:12:03.697143+0000","last_clean":"2023-10-03T10:12:03.697143+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:12:03.697143+0000","last_undegraded":"2023-10-03T10:12:03.697143+0000","last_fullsized":"2023-10-03T10:12:03.697143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402144+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:12:03.402144+0000","last_peered":"2023-10-03T10:12:03.402144+0000","last_clean":"2023-10-03T10:12:03.402144+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:12:03.402144+0000","last_undegraded":"2023-10-03T10:12:03.402144+0000","last_fullsized":"2023-10-03T10:12:03.402144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696576+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:12:03.696576+0000","last_peered":"2023-10-03T10:12:03.696576+0000","last_clean":"2023-10-03T10:12:03.696576+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:12:03.696576+0000","last_undegraded":"2023-10-03T10:12:03.696576+0000","last_fullsized":"2023-10-03T10:12:03.696576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407011+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:12:03.407011+0000","last_peered":"2023-10-03T10:12:03.407011+0000","last_clean":"2023-10-03T10:12:03.407011+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:12:03.407011+0000","last_undegraded":"2023-10-03T10:12:03.407011+0000","last_fullsized":"2023-10-03T10:12:03.407011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401419+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:12:03.401419+0000","last_peered":"2023-10-03T10:12:03.401419+0000","last_clean":"2023-10-03T10:12:03.401419+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:12:03.401419+0000","last_undegraded":"2023-10-03T10:12:03.401419+0000","last_fullsized":"2023-10-03T10:12:03.401419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703422+0000","last_change":"2023-10-03T10:12:03.698855+0000","last_active":"2023-10-03T10:12:03.703422+0000","last_peered":"2023-10-03T10:12:03.703422+0000","last_clean":"2023-10-03T10:12:03.703422+0000","last_became_active":"2023-10-03T10:12:03.698418+0000","last_became_peered":"2023-10-03T10:12:03.698418+0000","last_unstale":"2023-10-03T10:12:03.703422+0000","last_undegraded":"2023-10-03T10:12:03.703422+0000","last_fullsized":"2023-10-03T10:12:03.703422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407225+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:12:03.407225+0000","last_peered":"2023-10-03T10:12:03.407225+0000","last_clean":"2023-10-03T10:12:03.407225+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:12:03.407225+0000","last_undegraded":"2023-10-03T10:12:03.407225+0000","last_fullsized":"2023-10-03T10:12:03.407225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.409549+0000","last_change":"2023-10-03T10:12:03.407641+0000","last_active":"2023-10-03T10:12:03.409549+0000","last_peered":"2023-10-03T10:12:03.409549+0000","last_clean":"2023-10-03T10:12:03.409549+0000","last_became_active":"2023-10-03T10:12:03.407268+0000","last_became_peered":"2023-10-03T10:12:03.407268+0000","last_unstale":"2023-10-03T10:12:03.409549+0000","last_undegraded":"2023-10-03T10:12:03.409549+0000","last_fullsized":"2023-10-03T10:12:03.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408397+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:12:03.408397+0000","last_peered":"2023-10-03T10:12:03.408397+0000","last_clean":"2023-10-03T10:12:03.408397+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:12:03.408397+0000","last_undegraded":"2023-10-03T10:12:03.408397+0000","last_fullsized":"2023-10-03T10:12:03.408397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.410620+0000","last_change":"2023-10-03T10:12:03.409321+0000","last_active":"2023-10-03T10:12:03.410620+0000","last_peered":"2023-10-03T10:12:03.410620+0000","last_clean":"2023-10-03T10:12:03.410620+0000","last_became_active":"2023-10-03T10:12:03.408975+0000","last_became_peered":"2023-10-03T10:12:03.408975+0000","last_unstale":"2023-10-03T10:12:03.410620+0000","last_undegraded":"2023-10-03T10:12:03.410620+0000","last_fullsized":"2023-10-03T10:12:03.410620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405973+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:12:03.405973+0000","last_peered":"2023-10-03T10:12:03.405973+0000","last_clean":"2023-10-03T10:12:03.405973+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:12:03.405973+0000","last_undegraded":"2023-10-03T10:12:03.405973+0000","last_fullsized":"2023-10-03T10:12:03.405973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697291+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:12:03.697291+0000","last_peered":"2023-10-03T10:12:03.697291+0000","last_clean":"2023-10-03T10:12:03.697291+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:12:03.697291+0000","last_undegraded":"2023-10-03T10:12:03.697291+0000","last_fullsized":"2023-10-03T10:12:03.697291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:13:29.674848+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:13:29.674848+0000","last_peered":"2023-10-03T10:13:29.674848+0000","last_clean":"2023-10-03T10:13:29.674848+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:13:29.674848+0000","last_undegraded":"2023-10-03T10:13:29.674848+0000","last_fullsized":"2023-10-03T10:13:29.674848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405286+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:12:03.405286+0000","last_peered":"2023-10-03T10:12:03.405286+0000","last_clean":"2023-10-03T10:12:03.405286+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:12:03.405286+0000","last_undegraded":"2023-10-03T10:12:03.405286+0000","last_fullsized":"2023-10-03T10:12:03.405286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402540+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:12:03.402540+0000","last_peered":"2023-10-03T10:12:03.402540+0000","last_clean":"2023-10-03T10:12:03.402540+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:12:03.402540+0000","last_undegraded":"2023-10-03T10:12:03.402540+0000","last_fullsized":"2023-10-03T10:12:03.402540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402416+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:12:03.402416+0000","last_peered":"2023-10-03T10:12:03.402416+0000","last_clean":"2023-10-03T10:12:03.402416+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:12:03.402416+0000","last_undegraded":"2023-10-03T10:12:03.402416+0000","last_fullsized":"2023-10-03T10:12:03.402416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406703+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:12:03.406703+0000","last_peered":"2023-10-03T10:12:03.406703+0000","last_clean":"2023-10-03T10:12:03.406703+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:12:03.406703+0000","last_undegraded":"2023-10-03T10:12:03.406703+0000","last_fullsized":"2023-10-03T10:12:03.406703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402952+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:12:03.402952+0000","last_peered":"2023-10-03T10:12:03.402952+0000","last_clean":"2023-10-03T10:12:03.402952+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:12:03.402952+0000","last_undegraded":"2023-10-03T10:12:03.402952+0000","last_fullsized":"2023-10-03T10:12:03.402952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401271+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:12:03.401271+0000","last_peered":"2023-10-03T10:12:03.401271+0000","last_clean":"2023-10-03T10:12:03.401271+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:12:03.401271+0000","last_undegraded":"2023-10-03T10:12:03.401271+0000","last_fullsized":"2023-10-03T10:12:03.401271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407164+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:12:03.407164+0000","last_peered":"2023-10-03T10:12:03.407164+0000","last_clean":"2023-10-03T10:12:03.407164+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:12:03.407164+0000","last_undegraded":"2023-10-03T10:12:03.407164+0000","last_fullsized":"2023-10-03T10:12:03.407164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697666+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:12:03.697666+0000","last_peered":"2023-10-03T10:12:03.697666+0000","last_clean":"2023-10-03T10:12:03.697666+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:12:03.697666+0000","last_undegraded":"2023-10-03T10:12:03.697666+0000","last_fullsized":"2023-10-03T10:12:03.697666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402516+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:12:03.402516+0000","last_peered":"2023-10-03T10:12:03.402516+0000","last_clean":"2023-10-03T10:12:03.402516+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:12:03.402516+0000","last_undegraded":"2023-10-03T10:12:03.402516+0000","last_fullsized":"2023-10-03T10:12:03.402516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407061+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:12:03.407061+0000","last_peered":"2023-10-03T10:12:03.407061+0000","last_clean":"2023-10-03T10:12:03.407061+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:12:03.407061+0000","last_undegraded":"2023-10-03T10:12:03.407061+0000","last_fullsized":"2023-10-03T10:12:03.407061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402098+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:12:03.402098+0000","last_peered":"2023-10-03T10:12:03.402098+0000","last_clean":"2023-10-03T10:12:03.402098+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:12:03.402098+0000","last_undegraded":"2023-10-03T10:12:03.402098+0000","last_fullsized":"2023-10-03T10:12:03.402098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408439+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:12:03.408439+0000","last_peered":"2023-10-03T10:12:03.408439+0000","last_clean":"2023-10-03T10:12:03.408439+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:12:03.408439+0000","last_undegraded":"2023-10-03T10:12:03.408439+0000","last_fullsized":"2023-10-03T10:12:03.408439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696689+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:12:03.696689+0000","last_peered":"2023-10-03T10:12:03.696689+0000","last_clean":"2023-10-03T10:12:03.696689+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:12:03.696689+0000","last_undegraded":"2023-10-03T10:12:03.696689+0000","last_fullsized":"2023-10-03T10:12:03.696689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402609+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:12:03.402609+0000","last_peered":"2023-10-03T10:12:03.402609+0000","last_clean":"2023-10-03T10:12:03.402609+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:12:03.402609+0000","last_undegraded":"2023-10-03T10:12:03.402609+0000","last_fullsized":"2023-10-03T10:12:03.402609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403831+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:12:03.403831+0000","last_peered":"2023-10-03T10:12:03.403831+0000","last_clean":"2023-10-03T10:12:03.403831+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:12:03.403831+0000","last_undegraded":"2023-10-03T10:12:03.403831+0000","last_fullsized":"2023-10-03T10:12:03.403831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406567+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:12:03.406567+0000","last_peered":"2023-10-03T10:12:03.406567+0000","last_clean":"2023-10-03T10:12:03.406567+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:12:03.406567+0000","last_undegraded":"2023-10-03T10:12:03.406567+0000","last_fullsized":"2023-10-03T10:12:03.406567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406450+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:12:03.406450+0000","last_peered":"2023-10-03T10:12:03.406450+0000","last_clean":"2023-10-03T10:12:03.406450+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:12:03.406450+0000","last_undegraded":"2023-10-03T10:12:03.406450+0000","last_fullsized":"2023-10-03T10:12:03.406450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402212+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:12:03.402212+0000","last_peered":"2023-10-03T10:12:03.402212+0000","last_clean":"2023-10-03T10:12:03.402212+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:12:03.402212+0000","last_undegraded":"2023-10-03T10:12:03.402212+0000","last_fullsized":"2023-10-03T10:12:03.402212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406477+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:12:03.406477+0000","last_peered":"2023-10-03T10:12:03.406477+0000","last_clean":"2023-10-03T10:12:03.406477+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:12:03.406477+0000","last_undegraded":"2023-10-03T10:12:03.406477+0000","last_fullsized":"2023-10-03T10:12:03.406477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403616+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:12:03.403616+0000","last_peered":"2023-10-03T10:12:03.403616+0000","last_clean":"2023-10-03T10:12:03.403616+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:12:03.403616+0000","last_undegraded":"2023-10-03T10:12:03.403616+0000","last_fullsized":"2023-10-03T10:12:03.403616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703347+0000","last_change":"2023-10-03T10:12:03.699252+0000","last_active":"2023-10-03T10:12:03.703347+0000","last_peered":"2023-10-03T10:12:03.703347+0000","last_clean":"2023-10-03T10:12:03.703347+0000","last_became_active":"2023-10-03T10:12:03.698824+0000","last_became_peered":"2023-10-03T10:12:03.698824+0000","last_unstale":"2023-10-03T10:12:03.703347+0000","last_undegraded":"2023-10-03T10:12:03.703347+0000","last_fullsized":"2023-10-03T10:12:03.703347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401202+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:12:03.401202+0000","last_peered":"2023-10-03T10:12:03.401202+0000","last_clean":"2023-10-03T10:12:03.401202+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:12:03.401202+0000","last_undegraded":"2023-10-03T10:12:03.401202+0000","last_fullsized":"2023-10-03T10:12:03.401202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.413565+0000","last_change":"2023-10-03T10:12:03.410398+0000","last_active":"2023-10-03T10:12:03.413565+0000","last_peered":"2023-10-03T10:12:03.413565+0000","last_clean":"2023-10-03T10:12:03.413565+0000","last_became_active":"2023-10-03T10:12:03.410004+0000","last_became_peered":"2023-10-03T10:12:03.410004+0000","last_unstale":"2023-10-03T10:12:03.413565+0000","last_undegraded":"2023-10-03T10:12:03.413565+0000","last_fullsized":"2023-10-03T10:12:03.413565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401045+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:12:03.401045+0000","last_peered":"2023-10-03T10:12:03.401045+0000","last_clean":"2023-10-03T10:12:03.401045+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:12:03.401045+0000","last_undegraded":"2023-10-03T10:12:03.401045+0000","last_fullsized":"2023-10-03T10:12:03.401045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697835+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:12:03.697835+0000","last_peered":"2023-10-03T10:12:03.697835+0000","last_clean":"2023-10-03T10:12:03.697835+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:12:03.697835+0000","last_undegraded":"2023-10-03T10:12:03.697835+0000","last_fullsized":"2023-10-03T10:12:03.697835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697544+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:12:03.697544+0000","last_peered":"2023-10-03T10:12:03.697544+0000","last_clean":"2023-10-03T10:12:03.697544+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:12:03.697544+0000","last_undegraded":"2023-10-03T10:12:03.697544+0000","last_fullsized":"2023-10-03T10:12:03.697544+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406491+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:12:03.406491+0000","last_peered":"2023-10-03T10:12:03.406491+0000","last_clean":"2023-10-03T10:12:03.406491+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:12:03.406491+0000","last_undegraded":"2023-10-03T10:12:03.406491+0000","last_fullsized":"2023-10-03T10:12:03.406491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697256+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:12:03.697256+0000","last_peered":"2023-10-03T10:12:03.697256+0000","last_clean":"2023-10-03T10:12:03.697256+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:12:03.697256+0000","last_undegraded":"2023-10-03T10:12:03.697256+0000","last_fullsized":"2023-10-03T10:12:03.697256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403526+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:12:03.403526+0000","last_peered":"2023-10-03T10:12:03.403526+0000","last_clean":"2023-10-03T10:12:03.403526+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:12:03.403526+0000","last_undegraded":"2023-10-03T10:12:03.403526+0000","last_fullsized":"2023-10-03T10:12:03.403526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406083+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:12:03.406083+0000","last_peered":"2023-10-03T10:12:03.406083+0000","last_clean":"2023-10-03T10:12:03.406083+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:12:03.406083+0000","last_undegraded":"2023-10-03T10:12:03.406083+0000","last_fullsized":"2023-10-03T10:12:03.406083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697369+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:12:03.697369+0000","last_peered":"2023-10-03T10:12:03.697369+0000","last_clean":"2023-10-03T10:12:03.697369+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:12:03.697369+0000","last_undegraded":"2023-10-03T10:12:03.697369+0000","last_fullsized":"2023-10-03T10:12:03.697369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.404275+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:12:03.404275+0000","last_peered":"2023-10-03T10:12:03.404275+0000","last_clean":"2023-10-03T10:12:03.404275+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:12:03.404275+0000","last_undegraded":"2023-10-03T10:12:03.404275+0000","last_fullsized":"2023-10-03T10:12:03.404275+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697120+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:12:03.697120+0000","last_peered":"2023-10-03T10:12:03.697120+0000","last_clean":"2023-10-03T10:12:03.697120+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:12:03.697120+0000","last_undegraded":"2023-10-03T10:12:03.697120+0000","last_fullsized":"2023-10-03T10:12:03.697120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697951+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:12:03.697951+0000","last_peered":"2023-10-03T10:12:03.697951+0000","last_clean":"2023-10-03T10:12:03.697951+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:12:03.697951+0000","last_undegraded":"2023-10-03T10:12:03.697951+0000","last_fullsized":"2023-10-03T10:12:03.697951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402326+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:12:03.402326+0000","last_peered":"2023-10-03T10:12:03.402326+0000","last_clean":"2023-10-03T10:12:03.402326+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:12:03.402326+0000","last_undegraded":"2023-10-03T10:12:03.402326+0000","last_fullsized":"2023-10-03T10:12:03.402326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696796+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:12:03.696796+0000","last_peered":"2023-10-03T10:12:03.696796+0000","last_clean":"2023-10-03T10:12:03.696796+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:12:03.696796+0000","last_undegraded":"2023-10-03T10:12:03.696796+0000","last_fullsized":"2023-10-03T10:12:03.696796+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403366+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:12:03.403366+0000","last_peered":"2023-10-03T10:12:03.403366+0000","last_clean":"2023-10-03T10:12:03.403366+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:12:03.403366+0000","last_undegraded":"2023-10-03T10:12:03.403366+0000","last_fullsized":"2023-10-03T10:12:03.403366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703265+0000","last_change":"2023-10-03T10:12:03.698657+0000","last_active":"2023-10-03T10:12:03.703265+0000","last_peered":"2023-10-03T10:12:03.703265+0000","last_clean":"2023-10-03T10:12:03.703265+0000","last_became_active":"2023-10-03T10:12:03.698259+0000","last_became_peered":"2023-10-03T10:12:03.698259+0000","last_unstale":"2023-10-03T10:12:03.703265+0000","last_undegraded":"2023-10-03T10:12:03.703265+0000","last_fullsized":"2023-10-03T10:12:03.703265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401236+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:12:03.401236+0000","last_peered":"2023-10-03T10:12:03.401236+0000","last_clean":"2023-10-03T10:12:03.401236+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:12:03.401236+0000","last_undegraded":"2023-10-03T10:12:03.401236+0000","last_fullsized":"2023-10-03T10:12:03.401236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405667+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:12:03.405667+0000","last_peered":"2023-10-03T10:12:03.405667+0000","last_clean":"2023-10-03T10:12:03.405667+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:12:03.405667+0000","last_undegraded":"2023-10-03T10:12:03.405667+0000","last_fullsized":"2023-10-03T10:12:03.405667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407261+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:12:03.407261+0000","last_peered":"2023-10-03T10:12:03.407261+0000","last_clean":"2023-10-03T10:12:03.407261+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:12:03.407261+0000","last_undegraded":"2023-10-03T10:12:03.407261+0000","last_fullsized":"2023-10-03T10:12:03.407261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402739+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:12:03.402739+0000","last_peered":"2023-10-03T10:12:03.402739+0000","last_clean":"2023-10-03T10:12:03.402739+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:12:03.402739+0000","last_undegraded":"2023-10-03T10:12:03.402739+0000","last_fullsized":"2023-10-03T10:12:03.402739+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697125+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:12:03.697125+0000","last_peered":"2023-10-03T10:12:03.697125+0000","last_clean":"2023-10-03T10:12:03.697125+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:12:03.697125+0000","last_undegraded":"2023-10-03T10:12:03.697125+0000","last_fullsized":"2023-10-03T10:12:03.697125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406353+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:12:03.406353+0000","last_peered":"2023-10-03T10:12:03.406353+0000","last_clean":"2023-10-03T10:12:03.406353+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:12:03.406353+0000","last_undegraded":"2023-10-03T10:12:03.406353+0000","last_fullsized":"2023-10-03T10:12:03.406353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402394+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:12:03.402394+0000","last_peered":"2023-10-03T10:12:03.402394+0000","last_clean":"2023-10-03T10:12:03.402394+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:12:03.402394+0000","last_undegraded":"2023-10-03T10:12:03.402394+0000","last_fullsized":"2023-10-03T10:12:03.402394+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697355+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:12:03.697355+0000","last_peered":"2023-10-03T10:12:03.697355+0000","last_clean":"2023-10-03T10:12:03.697355+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:12:03.697355+0000","last_undegraded":"2023-10-03T10:12:03.697355+0000","last_fullsized":"2023-10-03T10:12:03.697355+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401147+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:12:03.401147+0000","last_peered":"2023-10-03T10:12:03.401147+0000","last_clean":"2023-10-03T10:12:03.401147+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:12:03.401147+0000","last_undegraded":"2023-10-03T10:12:03.401147+0000","last_fullsized":"2023-10-03T10:12:03.401147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402433+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:12:03.402433+0000","last_peered":"2023-10-03T10:12:03.402433+0000","last_clean":"2023-10-03T10:12:03.402433+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:12:03.402433+0000","last_undegraded":"2023-10-03T10:12:03.402433+0000","last_fullsized":"2023-10-03T10:12:03.402433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406916+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:12:03.406916+0000","last_peered":"2023-10-03T10:12:03.406916+0000","last_clean":"2023-10-03T10:12:03.406916+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:12:03.406916+0000","last_undegraded":"2023-10-03T10:12:03.406916+0000","last_fullsized":"2023-10-03T10:12:03.406916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.404496+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:12:03.404496+0000","last_peered":"2023-10-03T10:12:03.404496+0000","last_clean":"2023-10-03T10:12:03.404496+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:12:03.404496+0000","last_undegraded":"2023-10-03T10:12:03.404496+0000","last_fullsized":"2023-10-03T10:12:03.404496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407552+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:12:03.407552+0000","last_peered":"2023-10-03T10:12:03.407552+0000","last_clean":"2023-10-03T10:12:03.407552+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:12:03.407552+0000","last_undegraded":"2023-10-03T10:12:03.407552+0000","last_fullsized":"2023-10-03T10:12:03.407552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405100+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:12:03.405100+0000","last_peered":"2023-10-03T10:12:03.405100+0000","last_clean":"2023-10-03T10:12:03.405100+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:12:03.405100+0000","last_undegraded":"2023-10-03T10:12:03.405100+0000","last_fullsized":"2023-10-03T10:12:03.405100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697436+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:12:03.697436+0000","last_peered":"2023-10-03T10:12:03.697436+0000","last_clean":"2023-10-03T10:12:03.697436+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:12:03.697436+0000","last_undegraded":"2023-10-03T10:12:03.697436+0000","last_fullsized":"2023-10-03T10:12:03.697436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403740+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:12:03.403740+0000","last_peered":"2023-10-03T10:12:03.403740+0000","last_clean":"2023-10-03T10:12:03.403740+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:12:03.403740+0000","last_undegraded":"2023-10-03T10:12:03.403740+0000","last_fullsized":"2023-10-03T10:12:03.403740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402750+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:12:03.402750+0000","last_peered":"2023-10-03T10:12:03.402750+0000","last_clean":"2023-10-03T10:12:03.402750+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:12:03.402750+0000","last_undegraded":"2023-10-03T10:12:03.402750+0000","last_fullsized":"2023-10-03T10:12:03.402750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403952+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:12:03.403952+0000","last_peered":"2023-10-03T10:12:03.403952+0000","last_clean":"2023-10-03T10:12:03.403952+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:12:03.403952+0000","last_undegraded":"2023-10-03T10:12:03.403952+0000","last_fullsized":"2023-10-03T10:12:03.403952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401933+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:12:03.401933+0000","last_peered":"2023-10-03T10:12:03.401933+0000","last_clean":"2023-10-03T10:12:03.401933+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:12:03.401933+0000","last_undegraded":"2023-10-03T10:12:03.401933+0000","last_fullsized":"2023-10-03T10:12:03.401933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401367+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:12:03.401367+0000","last_peered":"2023-10-03T10:12:03.401367+0000","last_clean":"2023-10-03T10:12:03.401367+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:12:03.401367+0000","last_undegraded":"2023-10-03T10:12:03.401367+0000","last_fullsized":"2023-10-03T10:12:03.401367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407309+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:12:03.407309+0000","last_peered":"2023-10-03T10:12:03.407309+0000","last_clean":"2023-10-03T10:12:03.407309+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:12:03.407309+0000","last_undegraded":"2023-10-03T10:12:03.407309+0000","last_fullsized":"2023-10-03T10:12:03.407309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403886+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:12:03.403886+0000","last_peered":"2023-10-03T10:12:03.403886+0000","last_clean":"2023-10-03T10:12:03.403886+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:12:03.403886+0000","last_undegraded":"2023-10-03T10:12:03.403886+0000","last_fullsized":"2023-10-03T10:12:03.403886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697133+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:12:03.697133+0000","last_peered":"2023-10-03T10:12:03.697133+0000","last_clean":"2023-10-03T10:12:03.697133+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:12:03.697133+0000","last_undegraded":"2023-10-03T10:12:03.697133+0000","last_fullsized":"2023-10-03T10:12:03.697133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401477+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:12:03.401477+0000","last_peered":"2023-10-03T10:12:03.401477+0000","last_clean":"2023-10-03T10:12:03.401477+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:12:03.401477+0000","last_undegraded":"2023-10-03T10:12:03.401477+0000","last_fullsized":"2023-10-03T10:12:03.401477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.411148+0000","last_change":"2023-10-03T10:12:03.410468+0000","last_active":"2023-10-03T10:12:03.411148+0000","last_peered":"2023-10-03T10:12:03.411148+0000","last_clean":"2023-10-03T10:12:03.411148+0000","last_became_active":"2023-10-03T10:12:03.410097+0000","last_became_peered":"2023-10-03T10:12:03.410097+0000","last_unstale":"2023-10-03T10:12:03.411148+0000","last_undegraded":"2023-10-03T10:12:03.411148+0000","last_fullsized":"2023-10-03T10:12:03.411148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402528+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:12:03.402528+0000","last_peered":"2023-10-03T10:12:03.402528+0000","last_clean":"2023-10-03T10:12:03.402528+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:12:03.402528+0000","last_undegraded":"2023-10-03T10:12:03.402528+0000","last_fullsized":"2023-10-03T10:12:03.402528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697486+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:12:03.697486+0000","last_peered":"2023-10-03T10:12:03.697486+0000","last_clean":"2023-10-03T10:12:03.697486+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:12:03.697486+0000","last_undegraded":"2023-10-03T10:12:03.697486+0000","last_fullsized":"2023-10-03T10:12:03.697486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.39300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.45100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":5.0019999999999998}]},{"osd":1,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.501,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.37}]},{"osd":2,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.47799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.58699999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705697,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.45600000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.44}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.313,"15min":0.308},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.46500000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.374,"15min":0.374},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35999999999999999,"15min":0.36299999999999999},"min":{"1min":0.28899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51500000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.434}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.314,"15min":0.316},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25800000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.318}]},{"osd":2,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.503,"15min":0.503},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.35799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:13:33.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.405+0000 7f6d1298c700 1 Processor -- start 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 -- start start 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 0x7f6d0c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 0x7f6d0c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c06b990 con 0x7f6d0c134260 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0a0590 con 0x7f6d0c133420 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d1298c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c09fb80 con 0x7f6d0c133e30 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d0bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 0x7f6d0c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d10f29700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6d0c134260 0x7f6d0c1304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38170/0 (socket says 172.21.15.19:38170) 2023-10-03T10:13:33.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d10f29700 1 -- 172.21.15.19:0/2753677696 learned_addr learned my addr 172.21.15.19:0/2753677696 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.406+0000 7f6d0b7fe700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 0x7f6d0c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0b7fe700 1 -- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 msgr2=0x7f6d0c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0b7fe700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 0x7f6d0c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0affd700 1 -- 172.21.15.19:0/2753677696 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305973798 0 0) 0x7f6d0c06b990 con 0x7f6d0c134260 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0b7fe700 1 -- 172.21.15.19:0/2753677696 >> v1:172.21.15.19:6789/0 conn(0x7f6d0c134260 legacy=0x7f6d0c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0b7fe700 1 -- 172.21.15.19:0/2753677696 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c0a0030 con 0x7f6d0c133e30 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0bfff700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 0x7f6d0c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0b7fe700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 0x7f6d0c12ff90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009870 tx=0x7f6cfc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714fa0d100512be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0affd700 1 -- 172.21.15.19:0/2753677696 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc011830 con 0x7f6d0c133e30 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0affd700 1 -- 172.21.15.19:0/2753677696 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc011990 con 0x7f6d0c133e30 2023-10-03T10:13:33.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d0affd700 1 -- 172.21.15.19:0/2753677696 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc011d20 con 0x7f6d0c133e30 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d1298c700 1 -- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 msgr2=0x7f6d0c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.407+0000 7f6d1298c700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 0x7f6d0c12ff90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc009870 tx=0x7f6cfc009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 -- 172.21.15.19:0/2753677696 shutdown_connections 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c133420 0x7f6d0c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 --2- 172.21.15.19:0/2753677696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133e30 0x7f6d0c12ff90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 -- 172.21.15.19:0/2753677696 >> 172.21.15.19:0/2753677696 conn(0x7f6d0c0a4210 msgr2=0x7f6d0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 -- 172.21.15.19:0/2753677696 shutdown_connections 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 -- 172.21.15.19:0/2753677696 wait complete. 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.408+0000 7f6d1298c700 1 Processor -- start 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 -- start start 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 0x7f6d0c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c120ee0 con 0x7f6d0c133e30 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c131400 con 0x7f6d0c134260 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d1298c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c11fcc0 con 0x7f6d0c133420 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d10f29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d0b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d10f29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58726/0 (socket says 172.21.15.19:58726) 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d0b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49000/0 (socket says 172.21.15.19:49000) 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d10f29700 1 -- 172.21.15.19:0/801606101 learned_addr learned my addr 172.21.15.19:0/801606101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.409+0000 7f6d0bfff700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 0x7f6d0c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 -- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 msgr2=0x7f6d0c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 0x7f6d0c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 -- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 msgr2=0x7f6d0c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 -- 172.21.15.19:0/801606101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40094a0 con 0x7f6d0c134260 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d0bfff700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 0x7f6d0c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d0b7fe700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d10f29700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6d04002230 tx=0x7f6d0400cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400aac0 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0400ac40 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc0094a0 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040070d0 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.410+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c11ff80 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.411+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f6d04007250 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.411+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c120ab0 con 0x7f6d0c134260 2023-10-03T10:13:33.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.411+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f6d0403f500 con 0x7f6d0c134260 2023-10-03T10:13:33.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.417+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d04019860 con 0x7f6d0c134260 2023-10-03T10:13:33.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.616+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 --> v1:172.21.15.19:6816/126819 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6d0c06c350 con 0x7f6cec02f4b0 2023-10-03T10:13:33.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.623+0000 7f6d08ff9700 1 -- 172.21.15.19:0/801606101 <== mgr.14104 v1:172.21.15.19:6816/126819 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270610 (unknown 2965378022 0 3954067429) 0x7f6cf4009cc0 con 0x7f6cec02f4b0 2023-10-03T10:13:33.627 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 >> v1:172.21.15.19:6816/126819 conn(0x7f6cec02f4b0 legacy=0x7f6cec031960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 msgr2=0x7f6d0c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6d04002230 tx=0x7f6d0400cf50 comp rx=0 tx=0).stop 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 shutdown_connections 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d0c134260 0x7f6d0c09cf00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d0c133420 0x7f6d0c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 --2- 172.21.15.19:0/801606101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d0c133e30 0x7f6d0c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.626+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 >> 172.21.15.19:0/801606101 conn(0x7f6d0c0a4210 msgr2=0x7f6d0c130460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.627+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 shutdown_connections 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.627+0000 7f6d1298c700 1 -- 172.21.15.19:0/801606101 wait complete. 2023-10-03T10:13:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2023-10-03T10:13:33.641 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-03T10:13:33.552848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1189136,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":1188352,"kb_avail":376298224,"statfs":{"total":386547056640,"available":385329381376,"internally_reserved":0,"allocated":770048,"data_stored":262506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1216872448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.006938"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406460+0000","last_change":"2023-10-03T10:11:13.264945+0000","last_active":"2023-10-03T10:12:03.406460+0000","last_peered":"2023-10-03T10:12:03.406460+0000","last_clean":"2023-10-03T10:12:03.406460+0000","last_became_active":"2023-10-03T10:11:13.264647+0000","last_became_peered":"2023-10-03T10:11:13.264647+0000","last_unstale":"2023-10-03T10:12:03.406460+0000","last_undegraded":"2023-10-03T10:12:03.406460+0000","last_fullsized":"2023-10-03T10:12:03.406460+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408512+0000","last_change":"2023-10-03T10:11:13.260998+0000","last_active":"2023-10-03T10:12:03.408512+0000","last_peered":"2023-10-03T10:12:03.408512+0000","last_clean":"2023-10-03T10:12:03.408512+0000","last_became_active":"2023-10-03T10:11:13.260705+0000","last_became_peered":"2023-10-03T10:11:13.260705+0000","last_unstale":"2023-10-03T10:12:03.408512+0000","last_undegraded":"2023-10-03T10:12:03.408512+0000","last_fullsized":"2023-10-03T10:12:03.408512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406060+0000","last_change":"2023-10-03T10:11:13.269086+0000","last_active":"2023-10-03T10:12:03.406060+0000","last_peered":"2023-10-03T10:12:03.406060+0000","last_clean":"2023-10-03T10:12:03.406060+0000","last_became_active":"2023-10-03T10:11:13.268844+0000","last_became_peered":"2023-10-03T10:11:13.268844+0000","last_unstale":"2023-10-03T10:12:03.406060+0000","last_undegraded":"2023-10-03T10:12:03.406060+0000","last_fullsized":"2023-10-03T10:12:03.406060+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406323+0000","last_change":"2023-10-03T10:11:13.269890+0000","last_active":"2023-10-03T10:12:03.406323+0000","last_peered":"2023-10-03T10:12:03.406323+0000","last_clean":"2023-10-03T10:12:03.406323+0000","last_became_active":"2023-10-03T10:11:13.269595+0000","last_became_peered":"2023-10-03T10:11:13.269595+0000","last_unstale":"2023-10-03T10:12:03.406323+0000","last_undegraded":"2023-10-03T10:12:03.406323+0000","last_fullsized":"2023-10-03T10:12:03.406323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405970+0000","last_change":"2023-10-03T10:11:13.278953+0000","last_active":"2023-10-03T10:12:03.405970+0000","last_peered":"2023-10-03T10:12:03.405970+0000","last_clean":"2023-10-03T10:12:03.405970+0000","last_became_active":"2023-10-03T10:11:13.278704+0000","last_became_peered":"2023-10-03T10:11:13.278704+0000","last_unstale":"2023-10-03T10:12:03.405970+0000","last_undegraded":"2023-10-03T10:12:03.405970+0000","last_fullsized":"2023-10-03T10:12:03.405970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403716+0000","last_change":"2023-10-03T10:11:13.264676+0000","last_active":"2023-10-03T10:12:03.403716+0000","last_peered":"2023-10-03T10:12:03.403716+0000","last_clean":"2023-10-03T10:12:03.403716+0000","last_became_active":"2023-10-03T10:11:13.264376+0000","last_became_peered":"2023-10-03T10:11:13.264376+0000","last_unstale":"2023-10-03T10:12:03.403716+0000","last_undegraded":"2023-10-03T10:12:03.403716+0000","last_fullsized":"2023-10-03T10:12:03.403716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401171+0000","last_change":"2023-10-03T10:11:13.268632+0000","last_active":"2023-10-03T10:12:03.401171+0000","last_peered":"2023-10-03T10:12:03.401171+0000","last_clean":"2023-10-03T10:12:03.401171+0000","last_became_active":"2023-10-03T10:11:13.267590+0000","last_became_peered":"2023-10-03T10:11:13.267590+0000","last_unstale":"2023-10-03T10:12:03.401171+0000","last_undegraded":"2023-10-03T10:12:03.401171+0000","last_fullsized":"2023-10-03T10:12:03.401171+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696417+0000","last_change":"2023-10-03T10:11:13.275885+0000","last_active":"2023-10-03T10:12:03.696417+0000","last_peered":"2023-10-03T10:12:03.696417+0000","last_clean":"2023-10-03T10:12:03.696417+0000","last_became_active":"2023-10-03T10:11:13.275565+0000","last_became_peered":"2023-10-03T10:11:13.275565+0000","last_unstale":"2023-10-03T10:12:03.696417+0000","last_undegraded":"2023-10-03T10:12:03.696417+0000","last_fullsized":"2023-10-03T10:12:03.696417+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407397+0000","last_change":"2023-10-03T10:11:13.277278+0000","last_active":"2023-10-03T10:12:03.407397+0000","last_peered":"2023-10-03T10:12:03.407397+0000","last_clean":"2023-10-03T10:12:03.407397+0000","last_became_active":"2023-10-03T10:11:13.276643+0000","last_became_peered":"2023-10-03T10:11:13.276643+0000","last_unstale":"2023-10-03T10:12:03.407397+0000","last_undegraded":"2023-10-03T10:12:03.407397+0000","last_fullsized":"2023-10-03T10:12:03.407397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697475+0000","last_change":"2023-10-03T10:11:13.279852+0000","last_active":"2023-10-03T10:12:03.697475+0000","last_peered":"2023-10-03T10:12:03.697475+0000","last_clean":"2023-10-03T10:12:03.697475+0000","last_became_active":"2023-10-03T10:11:13.279553+0000","last_became_peered":"2023-10-03T10:11:13.279553+0000","last_unstale":"2023-10-03T10:12:03.697475+0000","last_undegraded":"2023-10-03T10:12:03.697475+0000","last_fullsized":"2023-10-03T10:12:03.697475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697316+0000","last_change":"2023-10-03T10:11:13.275992+0000","last_active":"2023-10-03T10:12:03.697316+0000","last_peered":"2023-10-03T10:12:03.697316+0000","last_clean":"2023-10-03T10:12:03.697316+0000","last_became_active":"2023-10-03T10:11:13.275719+0000","last_became_peered":"2023-10-03T10:11:13.275719+0000","last_unstale":"2023-10-03T10:12:03.697316+0000","last_undegraded":"2023-10-03T10:12:03.697316+0000","last_fullsized":"2023-10-03T10:12:03.697316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405002+0000","last_change":"2023-10-03T10:11:13.276856+0000","last_active":"2023-10-03T10:12:03.405002+0000","last_peered":"2023-10-03T10:12:03.405002+0000","last_clean":"2023-10-03T10:12:03.405002+0000","last_became_active":"2023-10-03T10:11:13.276568+0000","last_became_peered":"2023-10-03T10:11:13.276568+0000","last_unstale":"2023-10-03T10:12:03.405002+0000","last_undegraded":"2023-10-03T10:12:03.405002+0000","last_fullsized":"2023-10-03T10:12:03.405002+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403626+0000","last_change":"2023-10-03T10:11:13.280739+0000","last_active":"2023-10-03T10:12:03.403626+0000","last_peered":"2023-10-03T10:12:03.403626+0000","last_clean":"2023-10-03T10:12:03.403626+0000","last_became_active":"2023-10-03T10:11:13.280158+0000","last_became_peered":"2023-10-03T10:11:13.280158+0000","last_unstale":"2023-10-03T10:12:03.403626+0000","last_undegraded":"2023-10-03T10:12:03.403626+0000","last_fullsized":"2023-10-03T10:12:03.403626+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697367+0000","last_change":"2023-10-03T10:11:13.260048+0000","last_active":"2023-10-03T10:12:03.697367+0000","last_peered":"2023-10-03T10:12:03.697367+0000","last_clean":"2023-10-03T10:12:03.697367+0000","last_became_active":"2023-10-03T10:11:13.259779+0000","last_became_peered":"2023-10-03T10:11:13.259779+0000","last_unstale":"2023-10-03T10:12:03.697367+0000","last_undegraded":"2023-10-03T10:12:03.697367+0000","last_fullsized":"2023-10-03T10:12:03.697367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407523+0000","last_change":"2023-10-03T10:11:13.272632+0000","last_active":"2023-10-03T10:12:03.407523+0000","last_peered":"2023-10-03T10:12:03.407523+0000","last_clean":"2023-10-03T10:12:03.407523+0000","last_became_active":"2023-10-03T10:11:13.272351+0000","last_became_peered":"2023-10-03T10:11:13.272351+0000","last_unstale":"2023-10-03T10:12:03.407523+0000","last_undegraded":"2023-10-03T10:12:03.407523+0000","last_fullsized":"2023-10-03T10:12:03.407523+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.400921+0000","last_change":"2023-10-03T10:11:13.264063+0000","last_active":"2023-10-03T10:12:03.400921+0000","last_peered":"2023-10-03T10:12:03.400921+0000","last_clean":"2023-10-03T10:12:03.400921+0000","last_became_active":"2023-10-03T10:11:13.263776+0000","last_became_peered":"2023-10-03T10:11:13.263776+0000","last_unstale":"2023-10-03T10:12:03.400921+0000","last_undegraded":"2023-10-03T10:12:03.400921+0000","last_fullsized":"2023-10-03T10:12:03.400921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407383+0000","last_change":"2023-10-03T10:11:13.277470+0000","last_active":"2023-10-03T10:12:03.407383+0000","last_peered":"2023-10-03T10:12:03.407383+0000","last_clean":"2023-10-03T10:12:03.407383+0000","last_became_active":"2023-10-03T10:11:13.277006+0000","last_became_peered":"2023-10-03T10:11:13.277006+0000","last_unstale":"2023-10-03T10:12:03.407383+0000","last_undegraded":"2023-10-03T10:12:03.407383+0000","last_fullsized":"2023-10-03T10:12:03.407383+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406821+0000","last_change":"2023-10-03T10:11:13.261477+0000","last_active":"2023-10-03T10:12:03.406821+0000","last_peered":"2023-10-03T10:12:03.406821+0000","last_clean":"2023-10-03T10:12:03.406821+0000","last_became_active":"2023-10-03T10:11:13.261087+0000","last_became_peered":"2023-10-03T10:11:13.261087+0000","last_unstale":"2023-10-03T10:12:03.406821+0000","last_undegraded":"2023-10-03T10:12:03.406821+0000","last_fullsized":"2023-10-03T10:12:03.406821+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406612+0000","last_change":"2023-10-03T10:11:13.284228+0000","last_active":"2023-10-03T10:12:03.406612+0000","last_peered":"2023-10-03T10:12:03.406612+0000","last_clean":"2023-10-03T10:12:03.406612+0000","last_became_active":"2023-10-03T10:11:13.283937+0000","last_became_peered":"2023-10-03T10:11:13.283937+0000","last_unstale":"2023-10-03T10:12:03.406612+0000","last_undegraded":"2023-10-03T10:12:03.406612+0000","last_fullsized":"2023-10-03T10:12:03.406612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697611+0000","last_change":"2023-10-03T10:11:13.283850+0000","last_active":"2023-10-03T10:12:03.697611+0000","last_peered":"2023-10-03T10:12:03.697611+0000","last_clean":"2023-10-03T10:12:03.697611+0000","last_became_active":"2023-10-03T10:11:13.283626+0000","last_became_peered":"2023-10-03T10:11:13.283626+0000","last_unstale":"2023-10-03T10:12:03.697611+0000","last_undegraded":"2023-10-03T10:12:03.697611+0000","last_fullsized":"2023-10-03T10:12:03.697611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696940+0000","last_change":"2023-10-03T10:11:13.272934+0000","last_active":"2023-10-03T10:12:03.696940+0000","last_peered":"2023-10-03T10:12:03.696940+0000","last_clean":"2023-10-03T10:12:03.696940+0000","last_became_active":"2023-10-03T10:11:13.272648+0000","last_became_peered":"2023-10-03T10:11:13.272648+0000","last_unstale":"2023-10-03T10:12:03.696940+0000","last_undegraded":"2023-10-03T10:12:03.696940+0000","last_fullsized":"2023-10-03T10:12:03.696940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406598+0000","last_change":"2023-10-03T10:11:13.269908+0000","last_active":"2023-10-03T10:12:03.406598+0000","last_peered":"2023-10-03T10:12:03.406598+0000","last_clean":"2023-10-03T10:12:03.406598+0000","last_became_active":"2023-10-03T10:11:13.269603+0000","last_became_peered":"2023-10-03T10:11:13.269603+0000","last_unstale":"2023-10-03T10:12:03.406598+0000","last_undegraded":"2023-10-03T10:12:03.406598+0000","last_fullsized":"2023-10-03T10:12:03.406598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401086+0000","last_change":"2023-10-03T10:11:13.269665+0000","last_active":"2023-10-03T10:12:03.401086+0000","last_peered":"2023-10-03T10:12:03.401086+0000","last_clean":"2023-10-03T10:12:03.401086+0000","last_became_active":"2023-10-03T10:11:13.269304+0000","last_became_peered":"2023-10-03T10:11:13.269304+0000","last_unstale":"2023-10-03T10:12:03.401086+0000","last_undegraded":"2023-10-03T10:12:03.401086+0000","last_fullsized":"2023-10-03T10:12:03.401086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696691+0000","last_change":"2023-10-03T10:11:13.275298+0000","last_active":"2023-10-03T10:12:03.696691+0000","last_peered":"2023-10-03T10:12:03.696691+0000","last_clean":"2023-10-03T10:12:03.696691+0000","last_became_active":"2023-10-03T10:11:13.275018+0000","last_became_peered":"2023-10-03T10:11:13.275018+0000","last_unstale":"2023-10-03T10:12:03.696691+0000","last_undegraded":"2023-10-03T10:12:03.696691+0000","last_fullsized":"2023-10-03T10:12:03.696691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697937+0000","last_change":"2023-10-03T10:11:13.257777+0000","last_active":"2023-10-03T10:12:03.697937+0000","last_peered":"2023-10-03T10:12:03.697937+0000","last_clean":"2023-10-03T10:12:03.697937+0000","last_became_active":"2023-10-03T10:11:13.257489+0000","last_became_peered":"2023-10-03T10:11:13.257489+0000","last_unstale":"2023-10-03T10:12:03.697937+0000","last_undegraded":"2023-10-03T10:12:03.697937+0000","last_fullsized":"2023-10-03T10:12:03.697937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697366+0000","last_change":"2023-10-03T10:11:13.272523+0000","last_active":"2023-10-03T10:12:03.697366+0000","last_peered":"2023-10-03T10:12:03.697366+0000","last_clean":"2023-10-03T10:12:03.697366+0000","last_became_active":"2023-10-03T10:11:13.269289+0000","last_became_peered":"2023-10-03T10:11:13.269289+0000","last_unstale":"2023-10-03T10:12:03.697366+0000","last_undegraded":"2023-10-03T10:12:03.697366+0000","last_fullsized":"2023-10-03T10:12:03.697366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402014+0000","last_change":"2023-10-03T10:11:13.281478+0000","last_active":"2023-10-03T10:12:03.402014+0000","last_peered":"2023-10-03T10:12:03.402014+0000","last_clean":"2023-10-03T10:12:03.402014+0000","last_became_active":"2023-10-03T10:11:13.280963+0000","last_became_peered":"2023-10-03T10:11:13.280963+0000","last_unstale":"2023-10-03T10:12:03.402014+0000","last_undegraded":"2023-10-03T10:12:03.402014+0000","last_fullsized":"2023-10-03T10:12:03.402014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697143+0000","last_change":"2023-10-03T10:11:12.855141+0000","last_active":"2023-10-03T10:12:03.697143+0000","last_peered":"2023-10-03T10:12:03.697143+0000","last_clean":"2023-10-03T10:12:03.697143+0000","last_became_active":"2023-10-03T10:11:12.854847+0000","last_became_peered":"2023-10-03T10:11:12.854847+0000","last_unstale":"2023-10-03T10:12:03.697143+0000","last_undegraded":"2023-10-03T10:12:03.697143+0000","last_fullsized":"2023-10-03T10:12:03.697143+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402144+0000","last_change":"2023-10-03T10:11:13.272057+0000","last_active":"2023-10-03T10:12:03.402144+0000","last_peered":"2023-10-03T10:12:03.402144+0000","last_clean":"2023-10-03T10:12:03.402144+0000","last_became_active":"2023-10-03T10:11:13.271254+0000","last_became_peered":"2023-10-03T10:11:13.271254+0000","last_unstale":"2023-10-03T10:12:03.402144+0000","last_undegraded":"2023-10-03T10:12:03.402144+0000","last_fullsized":"2023-10-03T10:12:03.402144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696576+0000","last_change":"2023-10-03T10:11:12.859451+0000","last_active":"2023-10-03T10:12:03.696576+0000","last_peered":"2023-10-03T10:12:03.696576+0000","last_clean":"2023-10-03T10:12:03.696576+0000","last_became_active":"2023-10-03T10:11:12.859152+0000","last_became_peered":"2023-10-03T10:11:12.859152+0000","last_unstale":"2023-10-03T10:12:03.696576+0000","last_undegraded":"2023-10-03T10:12:03.696576+0000","last_fullsized":"2023-10-03T10:12:03.696576+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407011+0000","last_change":"2023-10-03T10:11:13.270115+0000","last_active":"2023-10-03T10:12:03.407011+0000","last_peered":"2023-10-03T10:12:03.407011+0000","last_clean":"2023-10-03T10:12:03.407011+0000","last_became_active":"2023-10-03T10:11:13.269743+0000","last_became_peered":"2023-10-03T10:11:13.269743+0000","last_unstale":"2023-10-03T10:12:03.407011+0000","last_undegraded":"2023-10-03T10:12:03.407011+0000","last_fullsized":"2023-10-03T10:12:03.407011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401419+0000","last_change":"2023-10-03T10:11:12.864544+0000","last_active":"2023-10-03T10:12:03.401419+0000","last_peered":"2023-10-03T10:12:03.401419+0000","last_clean":"2023-10-03T10:12:03.401419+0000","last_became_active":"2023-10-03T10:11:12.862274+0000","last_became_peered":"2023-10-03T10:11:12.862274+0000","last_unstale":"2023-10-03T10:12:03.401419+0000","last_undegraded":"2023-10-03T10:12:03.401419+0000","last_fullsized":"2023-10-03T10:12:03.401419+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703422+0000","last_change":"2023-10-03T10:12:03.698855+0000","last_active":"2023-10-03T10:12:03.703422+0000","last_peered":"2023-10-03T10:12:03.703422+0000","last_clean":"2023-10-03T10:12:03.703422+0000","last_became_active":"2023-10-03T10:12:03.698418+0000","last_became_peered":"2023-10-03T10:12:03.698418+0000","last_unstale":"2023-10-03T10:12:03.703422+0000","last_undegraded":"2023-10-03T10:12:03.703422+0000","last_fullsized":"2023-10-03T10:12:03.703422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407225+0000","last_change":"2023-10-03T10:11:12.862491+0000","last_active":"2023-10-03T10:12:03.407225+0000","last_peered":"2023-10-03T10:12:03.407225+0000","last_clean":"2023-10-03T10:12:03.407225+0000","last_became_active":"2023-10-03T10:11:12.862202+0000","last_became_peered":"2023-10-03T10:11:12.862202+0000","last_unstale":"2023-10-03T10:12:03.407225+0000","last_undegraded":"2023-10-03T10:12:03.407225+0000","last_fullsized":"2023-10-03T10:12:03.407225+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.409549+0000","last_change":"2023-10-03T10:12:03.407641+0000","last_active":"2023-10-03T10:12:03.409549+0000","last_peered":"2023-10-03T10:12:03.409549+0000","last_clean":"2023-10-03T10:12:03.409549+0000","last_became_active":"2023-10-03T10:12:03.407268+0000","last_became_peered":"2023-10-03T10:12:03.407268+0000","last_unstale":"2023-10-03T10:12:03.409549+0000","last_undegraded":"2023-10-03T10:12:03.409549+0000","last_fullsized":"2023-10-03T10:12:03.409549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408397+0000","last_change":"2023-10-03T10:11:12.861355+0000","last_active":"2023-10-03T10:12:03.408397+0000","last_peered":"2023-10-03T10:12:03.408397+0000","last_clean":"2023-10-03T10:12:03.408397+0000","last_became_active":"2023-10-03T10:11:12.860874+0000","last_became_peered":"2023-10-03T10:11:12.860874+0000","last_unstale":"2023-10-03T10:12:03.408397+0000","last_undegraded":"2023-10-03T10:12:03.408397+0000","last_fullsized":"2023-10-03T10:12:03.408397+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.410620+0000","last_change":"2023-10-03T10:12:03.409321+0000","last_active":"2023-10-03T10:12:03.410620+0000","last_peered":"2023-10-03T10:12:03.410620+0000","last_clean":"2023-10-03T10:12:03.410620+0000","last_became_active":"2023-10-03T10:12:03.408975+0000","last_became_peered":"2023-10-03T10:12:03.408975+0000","last_unstale":"2023-10-03T10:12:03.410620+0000","last_undegraded":"2023-10-03T10:12:03.410620+0000","last_fullsized":"2023-10-03T10:12:03.410620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"16'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405973+0000","last_change":"2023-10-03T10:11:12.860545+0000","last_active":"2023-10-03T10:12:03.405973+0000","last_peered":"2023-10-03T10:12:03.405973+0000","last_clean":"2023-10-03T10:12:03.405973+0000","last_became_active":"2023-10-03T10:11:12.860178+0000","last_became_peered":"2023-10-03T10:11:12.860178+0000","last_unstale":"2023-10-03T10:12:03.405973+0000","last_undegraded":"2023-10-03T10:12:03.405973+0000","last_fullsized":"2023-10-03T10:12:03.405973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697291+0000","last_change":"2023-10-03T10:11:13.273926+0000","last_active":"2023-10-03T10:12:03.697291+0000","last_peered":"2023-10-03T10:12:03.697291+0000","last_clean":"2023-10-03T10:12:03.697291+0000","last_became_active":"2023-10-03T10:11:13.272065+0000","last_became_peered":"2023-10-03T10:11:13.272065+0000","last_unstale":"2023-10-03T10:12:03.697291+0000","last_undegraded":"2023-10-03T10:12:03.697291+0000","last_fullsized":"2023-10-03T10:12:03.697291+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"21'12","reported_seq":26,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-03T10:13:29.674848+0000","last_change":"2023-10-03T10:11:12.864627+0000","last_active":"2023-10-03T10:13:29.674848+0000","last_peered":"2023-10-03T10:13:29.674848+0000","last_clean":"2023-10-03T10:13:29.674848+0000","last_became_active":"2023-10-03T10:11:12.862403+0000","last_became_peered":"2023-10-03T10:11:12.862403+0000","last_unstale":"2023-10-03T10:13:29.674848+0000","last_undegraded":"2023-10-03T10:13:29.674848+0000","last_fullsized":"2023-10-03T10:13:29.674848+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3563,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405286+0000","last_change":"2023-10-03T10:11:13.280417+0000","last_active":"2023-10-03T10:12:03.405286+0000","last_peered":"2023-10-03T10:12:03.405286+0000","last_clean":"2023-10-03T10:12:03.405286+0000","last_became_active":"2023-10-03T10:11:13.279515+0000","last_became_peered":"2023-10-03T10:11:13.279515+0000","last_unstale":"2023-10-03T10:12:03.405286+0000","last_undegraded":"2023-10-03T10:12:03.405286+0000","last_fullsized":"2023-10-03T10:12:03.405286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402540+0000","last_change":"2023-10-03T10:11:12.860426+0000","last_active":"2023-10-03T10:12:03.402540+0000","last_peered":"2023-10-03T10:12:03.402540+0000","last_clean":"2023-10-03T10:12:03.402540+0000","last_became_active":"2023-10-03T10:11:12.859754+0000","last_became_peered":"2023-10-03T10:11:12.859754+0000","last_unstale":"2023-10-03T10:12:03.402540+0000","last_undegraded":"2023-10-03T10:12:03.402540+0000","last_fullsized":"2023-10-03T10:12:03.402540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402416+0000","last_change":"2023-10-03T10:11:13.273050+0000","last_active":"2023-10-03T10:12:03.402416+0000","last_peered":"2023-10-03T10:12:03.402416+0000","last_clean":"2023-10-03T10:12:03.402416+0000","last_became_active":"2023-10-03T10:11:13.272772+0000","last_became_peered":"2023-10-03T10:11:13.272772+0000","last_unstale":"2023-10-03T10:12:03.402416+0000","last_undegraded":"2023-10-03T10:12:03.402416+0000","last_fullsized":"2023-10-03T10:12:03.402416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406703+0000","last_change":"2023-10-03T10:11:12.861137+0000","last_active":"2023-10-03T10:12:03.406703+0000","last_peered":"2023-10-03T10:12:03.406703+0000","last_clean":"2023-10-03T10:12:03.406703+0000","last_became_active":"2023-10-03T10:11:12.860859+0000","last_became_peered":"2023-10-03T10:11:12.860859+0000","last_unstale":"2023-10-03T10:12:03.406703+0000","last_undegraded":"2023-10-03T10:12:03.406703+0000","last_fullsized":"2023-10-03T10:12:03.406703+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402952+0000","last_change":"2023-10-03T10:11:13.281261+0000","last_active":"2023-10-03T10:12:03.402952+0000","last_peered":"2023-10-03T10:12:03.402952+0000","last_clean":"2023-10-03T10:12:03.402952+0000","last_became_active":"2023-10-03T10:11:13.280430+0000","last_became_peered":"2023-10-03T10:11:13.280430+0000","last_unstale":"2023-10-03T10:12:03.402952+0000","last_undegraded":"2023-10-03T10:12:03.402952+0000","last_fullsized":"2023-10-03T10:12:03.402952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401271+0000","last_change":"2023-10-03T10:11:12.867571+0000","last_active":"2023-10-03T10:12:03.401271+0000","last_peered":"2023-10-03T10:12:03.401271+0000","last_clean":"2023-10-03T10:12:03.401271+0000","last_became_active":"2023-10-03T10:11:12.866917+0000","last_became_peered":"2023-10-03T10:11:12.866917+0000","last_unstale":"2023-10-03T10:12:03.401271+0000","last_undegraded":"2023-10-03T10:12:03.401271+0000","last_fullsized":"2023-10-03T10:12:03.401271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407164+0000","last_change":"2023-10-03T10:11:13.278273+0000","last_active":"2023-10-03T10:12:03.407164+0000","last_peered":"2023-10-03T10:12:03.407164+0000","last_clean":"2023-10-03T10:12:03.407164+0000","last_became_active":"2023-10-03T10:11:13.277584+0000","last_became_peered":"2023-10-03T10:11:13.277584+0000","last_unstale":"2023-10-03T10:12:03.407164+0000","last_undegraded":"2023-10-03T10:12:03.407164+0000","last_fullsized":"2023-10-03T10:12:03.407164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"16'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697666+0000","last_change":"2023-10-03T10:11:12.851616+0000","last_active":"2023-10-03T10:12:03.697666+0000","last_peered":"2023-10-03T10:12:03.697666+0000","last_clean":"2023-10-03T10:12:03.697666+0000","last_became_active":"2023-10-03T10:11:12.851290+0000","last_became_peered":"2023-10-03T10:11:12.851290+0000","last_unstale":"2023-10-03T10:12:03.697666+0000","last_undegraded":"2023-10-03T10:12:03.697666+0000","last_fullsized":"2023-10-03T10:12:03.697666+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402516+0000","last_change":"2023-10-03T10:11:13.284334+0000","last_active":"2023-10-03T10:12:03.402516+0000","last_peered":"2023-10-03T10:12:03.402516+0000","last_clean":"2023-10-03T10:12:03.402516+0000","last_became_active":"2023-10-03T10:11:13.282684+0000","last_became_peered":"2023-10-03T10:11:13.282684+0000","last_unstale":"2023-10-03T10:12:03.402516+0000","last_undegraded":"2023-10-03T10:12:03.402516+0000","last_fullsized":"2023-10-03T10:12:03.402516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407061+0000","last_change":"2023-10-03T10:11:12.855187+0000","last_active":"2023-10-03T10:12:03.407061+0000","last_peered":"2023-10-03T10:12:03.407061+0000","last_clean":"2023-10-03T10:12:03.407061+0000","last_became_active":"2023-10-03T10:11:12.854898+0000","last_became_peered":"2023-10-03T10:11:12.854898+0000","last_unstale":"2023-10-03T10:12:03.407061+0000","last_undegraded":"2023-10-03T10:12:03.407061+0000","last_fullsized":"2023-10-03T10:12:03.407061+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402098+0000","last_change":"2023-10-03T10:11:13.257223+0000","last_active":"2023-10-03T10:12:03.402098+0000","last_peered":"2023-10-03T10:12:03.402098+0000","last_clean":"2023-10-03T10:12:03.402098+0000","last_became_active":"2023-10-03T10:11:13.255822+0000","last_became_peered":"2023-10-03T10:11:13.255822+0000","last_unstale":"2023-10-03T10:12:03.402098+0000","last_undegraded":"2023-10-03T10:12:03.402098+0000","last_fullsized":"2023-10-03T10:12:03.402098+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.408439+0000","last_change":"2023-10-03T10:11:12.857774+0000","last_active":"2023-10-03T10:12:03.408439+0000","last_peered":"2023-10-03T10:12:03.408439+0000","last_clean":"2023-10-03T10:12:03.408439+0000","last_became_active":"2023-10-03T10:11:12.857374+0000","last_became_peered":"2023-10-03T10:11:12.857374+0000","last_unstale":"2023-10-03T10:12:03.408439+0000","last_undegraded":"2023-10-03T10:12:03.408439+0000","last_fullsized":"2023-10-03T10:12:03.408439+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696689+0000","last_change":"2023-10-03T10:11:13.257080+0000","last_active":"2023-10-03T10:12:03.696689+0000","last_peered":"2023-10-03T10:12:03.696689+0000","last_clean":"2023-10-03T10:12:03.696689+0000","last_became_active":"2023-10-03T10:11:13.256793+0000","last_became_peered":"2023-10-03T10:11:13.256793+0000","last_unstale":"2023-10-03T10:12:03.696689+0000","last_undegraded":"2023-10-03T10:12:03.696689+0000","last_fullsized":"2023-10-03T10:12:03.696689+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402609+0000","last_change":"2023-10-03T10:11:12.859263+0000","last_active":"2023-10-03T10:12:03.402609+0000","last_peered":"2023-10-03T10:12:03.402609+0000","last_clean":"2023-10-03T10:12:03.402609+0000","last_became_active":"2023-10-03T10:11:12.858969+0000","last_became_peered":"2023-10-03T10:11:12.858969+0000","last_unstale":"2023-10-03T10:12:03.402609+0000","last_undegraded":"2023-10-03T10:12:03.402609+0000","last_fullsized":"2023-10-03T10:12:03.402609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403831+0000","last_change":"2023-10-03T10:11:13.279921+0000","last_active":"2023-10-03T10:12:03.403831+0000","last_peered":"2023-10-03T10:12:03.403831+0000","last_clean":"2023-10-03T10:12:03.403831+0000","last_became_active":"2023-10-03T10:11:13.279257+0000","last_became_peered":"2023-10-03T10:11:13.279257+0000","last_unstale":"2023-10-03T10:12:03.403831+0000","last_undegraded":"2023-10-03T10:12:03.403831+0000","last_fullsized":"2023-10-03T10:12:03.403831+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406567+0000","last_change":"2023-10-03T10:11:12.860370+0000","last_active":"2023-10-03T10:12:03.406567+0000","last_peered":"2023-10-03T10:12:03.406567+0000","last_clean":"2023-10-03T10:12:03.406567+0000","last_became_active":"2023-10-03T10:11:12.860047+0000","last_became_peered":"2023-10-03T10:11:12.860047+0000","last_unstale":"2023-10-03T10:12:03.406567+0000","last_undegraded":"2023-10-03T10:12:03.406567+0000","last_fullsized":"2023-10-03T10:12:03.406567+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406450+0000","last_change":"2023-10-03T10:11:13.272124+0000","last_active":"2023-10-03T10:12:03.406450+0000","last_peered":"2023-10-03T10:12:03.406450+0000","last_clean":"2023-10-03T10:12:03.406450+0000","last_became_active":"2023-10-03T10:11:13.270207+0000","last_became_peered":"2023-10-03T10:11:13.270207+0000","last_unstale":"2023-10-03T10:12:03.406450+0000","last_undegraded":"2023-10-03T10:12:03.406450+0000","last_fullsized":"2023-10-03T10:12:03.406450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402212+0000","last_change":"2023-10-03T10:11:12.860600+0000","last_active":"2023-10-03T10:12:03.402212+0000","last_peered":"2023-10-03T10:12:03.402212+0000","last_clean":"2023-10-03T10:12:03.402212+0000","last_became_active":"2023-10-03T10:11:12.860134+0000","last_became_peered":"2023-10-03T10:11:12.860134+0000","last_unstale":"2023-10-03T10:12:03.402212+0000","last_undegraded":"2023-10-03T10:12:03.402212+0000","last_fullsized":"2023-10-03T10:12:03.402212+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406477+0000","last_change":"2023-10-03T10:11:13.277288+0000","last_active":"2023-10-03T10:12:03.406477+0000","last_peered":"2023-10-03T10:12:03.406477+0000","last_clean":"2023-10-03T10:12:03.406477+0000","last_became_active":"2023-10-03T10:11:13.276910+0000","last_became_peered":"2023-10-03T10:11:13.276910+0000","last_unstale":"2023-10-03T10:12:03.406477+0000","last_undegraded":"2023-10-03T10:12:03.406477+0000","last_fullsized":"2023-10-03T10:12:03.406477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403616+0000","last_change":"2023-10-03T10:11:12.857638+0000","last_active":"2023-10-03T10:12:03.403616+0000","last_peered":"2023-10-03T10:12:03.403616+0000","last_clean":"2023-10-03T10:12:03.403616+0000","last_became_active":"2023-10-03T10:11:12.857400+0000","last_became_peered":"2023-10-03T10:11:12.857400+0000","last_unstale":"2023-10-03T10:12:03.403616+0000","last_undegraded":"2023-10-03T10:12:03.403616+0000","last_fullsized":"2023-10-03T10:12:03.403616+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703347+0000","last_change":"2023-10-03T10:12:03.699252+0000","last_active":"2023-10-03T10:12:03.703347+0000","last_peered":"2023-10-03T10:12:03.703347+0000","last_clean":"2023-10-03T10:12:03.703347+0000","last_became_active":"2023-10-03T10:12:03.698824+0000","last_became_peered":"2023-10-03T10:12:03.698824+0000","last_unstale":"2023-10-03T10:12:03.703347+0000","last_undegraded":"2023-10-03T10:12:03.703347+0000","last_fullsized":"2023-10-03T10:12:03.703347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401202+0000","last_change":"2023-10-03T10:11:12.867320+0000","last_active":"2023-10-03T10:12:03.401202+0000","last_peered":"2023-10-03T10:12:03.401202+0000","last_clean":"2023-10-03T10:12:03.401202+0000","last_became_active":"2023-10-03T10:11:12.866858+0000","last_became_peered":"2023-10-03T10:11:12.866858+0000","last_unstale":"2023-10-03T10:12:03.401202+0000","last_undegraded":"2023-10-03T10:12:03.401202+0000","last_fullsized":"2023-10-03T10:12:03.401202+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.413565+0000","last_change":"2023-10-03T10:12:03.410398+0000","last_active":"2023-10-03T10:12:03.413565+0000","last_peered":"2023-10-03T10:12:03.413565+0000","last_clean":"2023-10-03T10:12:03.413565+0000","last_became_active":"2023-10-03T10:12:03.410004+0000","last_became_peered":"2023-10-03T10:12:03.410004+0000","last_unstale":"2023-10-03T10:12:03.413565+0000","last_undegraded":"2023-10-03T10:12:03.413565+0000","last_fullsized":"2023-10-03T10:12:03.413565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401045+0000","last_change":"2023-10-03T10:11:12.858496+0000","last_active":"2023-10-03T10:12:03.401045+0000","last_peered":"2023-10-03T10:12:03.401045+0000","last_clean":"2023-10-03T10:12:03.401045+0000","last_became_active":"2023-10-03T10:11:12.858237+0000","last_became_peered":"2023-10-03T10:11:12.858237+0000","last_unstale":"2023-10-03T10:12:03.401045+0000","last_undegraded":"2023-10-03T10:12:03.401045+0000","last_fullsized":"2023-10-03T10:12:03.401045+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697835+0000","last_change":"2023-10-03T10:11:13.257959+0000","last_active":"2023-10-03T10:12:03.697835+0000","last_peered":"2023-10-03T10:12:03.697835+0000","last_clean":"2023-10-03T10:12:03.697835+0000","last_became_active":"2023-10-03T10:11:13.257488+0000","last_became_peered":"2023-10-03T10:11:13.257488+0000","last_unstale":"2023-10-03T10:12:03.697835+0000","last_undegraded":"2023-10-03T10:12:03.697835+0000","last_fullsized":"2023-10-03T10:12:03.697835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697544+0000","last_change":"2023-10-03T10:11:08.445924+0000","last_active":"2023-10-03T10:12:03.697544+0000","last_peered":"2023-10-03T10:12:03.697544+0000","last_clean":"2023-10-03T10:12:03.697544+0000","last_became_active":"2023-10-03T10:11:08.445618+0000","last_became_peered":"2023-10-03T10:11:08.445618+0000","last_unstale":"2023-10-03T10:12:03.697544+0000","last_undegraded":"2023-10-03T10:12:03.697544+0000","last_fullsized":"2023-10-03T10:12:03.697544+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406491+0000","last_change":"2023-10-03T10:11:12.866144+0000","last_active":"2023-10-03T10:12:03.406491+0000","last_peered":"2023-10-03T10:12:03.406491+0000","last_clean":"2023-10-03T10:12:03.406491+0000","last_became_active":"2023-10-03T10:11:12.865873+0000","last_became_peered":"2023-10-03T10:11:12.865873+0000","last_unstale":"2023-10-03T10:12:03.406491+0000","last_undegraded":"2023-10-03T10:12:03.406491+0000","last_fullsized":"2023-10-03T10:12:03.406491+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697256+0000","last_change":"2023-10-03T10:11:13.283839+0000","last_active":"2023-10-03T10:12:03.697256+0000","last_peered":"2023-10-03T10:12:03.697256+0000","last_clean":"2023-10-03T10:12:03.697256+0000","last_became_active":"2023-10-03T10:11:13.283577+0000","last_became_peered":"2023-10-03T10:11:13.283577+0000","last_unstale":"2023-10-03T10:12:03.697256+0000","last_undegraded":"2023-10-03T10:12:03.697256+0000","last_fullsized":"2023-10-03T10:12:03.697256+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403526+0000","last_change":"2023-10-03T10:11:07.816706+0000","last_active":"2023-10-03T10:12:03.403526+0000","last_peered":"2023-10-03T10:12:03.403526+0000","last_clean":"2023-10-03T10:12:03.403526+0000","last_became_active":"2023-10-03T10:11:07.816336+0000","last_became_peered":"2023-10-03T10:11:07.816336+0000","last_unstale":"2023-10-03T10:12:03.403526+0000","last_undegraded":"2023-10-03T10:12:03.403526+0000","last_fullsized":"2023-10-03T10:12:03.403526+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406083+0000","last_change":"2023-10-03T10:11:12.857387+0000","last_active":"2023-10-03T10:12:03.406083+0000","last_peered":"2023-10-03T10:12:03.406083+0000","last_clean":"2023-10-03T10:12:03.406083+0000","last_became_active":"2023-10-03T10:11:12.857010+0000","last_became_peered":"2023-10-03T10:11:12.857010+0000","last_unstale":"2023-10-03T10:12:03.406083+0000","last_undegraded":"2023-10-03T10:12:03.406083+0000","last_fullsized":"2023-10-03T10:12:03.406083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697369+0000","last_change":"2023-10-03T10:11:13.262265+0000","last_active":"2023-10-03T10:12:03.697369+0000","last_peered":"2023-10-03T10:12:03.697369+0000","last_clean":"2023-10-03T10:12:03.697369+0000","last_became_active":"2023-10-03T10:11:13.261764+0000","last_became_peered":"2023-10-03T10:11:13.261764+0000","last_unstale":"2023-10-03T10:12:03.697369+0000","last_undegraded":"2023-10-03T10:12:03.697369+0000","last_fullsized":"2023-10-03T10:12:03.697369+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.404275+0000","last_change":"2023-10-03T10:11:07.813141+0000","last_active":"2023-10-03T10:12:03.404275+0000","last_peered":"2023-10-03T10:12:03.404275+0000","last_clean":"2023-10-03T10:12:03.404275+0000","last_became_active":"2023-10-03T10:11:07.812804+0000","last_became_peered":"2023-10-03T10:11:07.812804+0000","last_unstale":"2023-10-03T10:12:03.404275+0000","last_undegraded":"2023-10-03T10:12:03.404275+0000","last_fullsized":"2023-10-03T10:12:03.404275+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697120+0000","last_change":"2023-10-03T10:11:12.854289+0000","last_active":"2023-10-03T10:12:03.697120+0000","last_peered":"2023-10-03T10:12:03.697120+0000","last_clean":"2023-10-03T10:12:03.697120+0000","last_became_active":"2023-10-03T10:11:12.854008+0000","last_became_peered":"2023-10-03T10:11:12.854008+0000","last_unstale":"2023-10-03T10:12:03.697120+0000","last_undegraded":"2023-10-03T10:12:03.697120+0000","last_fullsized":"2023-10-03T10:12:03.697120+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697951+0000","last_change":"2023-10-03T10:11:13.273648+0000","last_active":"2023-10-03T10:12:03.697951+0000","last_peered":"2023-10-03T10:12:03.697951+0000","last_clean":"2023-10-03T10:12:03.697951+0000","last_became_active":"2023-10-03T10:11:13.273374+0000","last_became_peered":"2023-10-03T10:11:13.273374+0000","last_unstale":"2023-10-03T10:12:03.697951+0000","last_undegraded":"2023-10-03T10:12:03.697951+0000","last_fullsized":"2023-10-03T10:12:03.697951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402326+0000","last_change":"2023-10-03T10:11:07.813431+0000","last_active":"2023-10-03T10:12:03.402326+0000","last_peered":"2023-10-03T10:12:03.402326+0000","last_clean":"2023-10-03T10:12:03.402326+0000","last_became_active":"2023-10-03T10:11:07.813100+0000","last_became_peered":"2023-10-03T10:11:07.813100+0000","last_unstale":"2023-10-03T10:12:03.402326+0000","last_undegraded":"2023-10-03T10:12:03.402326+0000","last_fullsized":"2023-10-03T10:12:03.402326+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.696796+0000","last_change":"2023-10-03T10:11:06.814022+0000","last_active":"2023-10-03T10:12:03.696796+0000","last_peered":"2023-10-03T10:12:03.696796+0000","last_clean":"2023-10-03T10:12:03.696796+0000","last_became_active":"2023-10-03T10:11:06.813721+0000","last_became_peered":"2023-10-03T10:11:06.813721+0000","last_unstale":"2023-10-03T10:12:03.696796+0000","last_undegraded":"2023-10-03T10:12:03.696796+0000","last_fullsized":"2023-10-03T10:12:03.696796+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:05.778766+0000","last_clean_scrub_stamp":"2023-10-03T10:11:05.778766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403366+0000","last_change":"2023-10-03T10:11:12.861498+0000","last_active":"2023-10-03T10:12:03.403366+0000","last_peered":"2023-10-03T10:12:03.403366+0000","last_clean":"2023-10-03T10:12:03.403366+0000","last_became_active":"2023-10-03T10:11:12.861206+0000","last_became_peered":"2023-10-03T10:11:12.861206+0000","last_unstale":"2023-10-03T10:12:03.403366+0000","last_undegraded":"2023-10-03T10:12:03.403366+0000","last_fullsized":"2023-10-03T10:12:03.403366+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.703265+0000","last_change":"2023-10-03T10:12:03.698657+0000","last_active":"2023-10-03T10:12:03.703265+0000","last_peered":"2023-10-03T10:12:03.703265+0000","last_clean":"2023-10-03T10:12:03.703265+0000","last_became_active":"2023-10-03T10:12:03.698259+0000","last_became_peered":"2023-10-03T10:12:03.698259+0000","last_unstale":"2023-10-03T10:12:03.703265+0000","last_undegraded":"2023-10-03T10:12:03.703265+0000","last_fullsized":"2023-10-03T10:12:03.703265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401236+0000","last_change":"2023-10-03T10:11:07.819408+0000","last_active":"2023-10-03T10:12:03.401236+0000","last_peered":"2023-10-03T10:12:03.401236+0000","last_clean":"2023-10-03T10:12:03.401236+0000","last_became_active":"2023-10-03T10:11:07.819045+0000","last_became_peered":"2023-10-03T10:11:07.819045+0000","last_unstale":"2023-10-03T10:12:03.401236+0000","last_undegraded":"2023-10-03T10:12:03.401236+0000","last_fullsized":"2023-10-03T10:12:03.401236+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405667+0000","last_change":"2023-10-03T10:11:12.852326+0000","last_active":"2023-10-03T10:12:03.405667+0000","last_peered":"2023-10-03T10:12:03.405667+0000","last_clean":"2023-10-03T10:12:03.405667+0000","last_became_active":"2023-10-03T10:11:12.852000+0000","last_became_peered":"2023-10-03T10:11:12.852000+0000","last_unstale":"2023-10-03T10:12:03.405667+0000","last_undegraded":"2023-10-03T10:12:03.405667+0000","last_fullsized":"2023-10-03T10:12:03.405667+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407261+0000","last_change":"2023-10-03T10:11:13.257048+0000","last_active":"2023-10-03T10:12:03.407261+0000","last_peered":"2023-10-03T10:12:03.407261+0000","last_clean":"2023-10-03T10:12:03.407261+0000","last_became_active":"2023-10-03T10:11:13.256771+0000","last_became_peered":"2023-10-03T10:11:13.256771+0000","last_unstale":"2023-10-03T10:12:03.407261+0000","last_undegraded":"2023-10-03T10:12:03.407261+0000","last_fullsized":"2023-10-03T10:12:03.407261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402739+0000","last_change":"2023-10-03T10:11:08.445938+0000","last_active":"2023-10-03T10:12:03.402739+0000","last_peered":"2023-10-03T10:12:03.402739+0000","last_clean":"2023-10-03T10:12:03.402739+0000","last_became_active":"2023-10-03T10:11:08.445615+0000","last_became_peered":"2023-10-03T10:11:08.445615+0000","last_unstale":"2023-10-03T10:12:03.402739+0000","last_undegraded":"2023-10-03T10:12:03.402739+0000","last_fullsized":"2023-10-03T10:12:03.402739+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697125+0000","last_change":"2023-10-03T10:11:12.855174+0000","last_active":"2023-10-03T10:12:03.697125+0000","last_peered":"2023-10-03T10:12:03.697125+0000","last_clean":"2023-10-03T10:12:03.697125+0000","last_became_active":"2023-10-03T10:11:12.854872+0000","last_became_peered":"2023-10-03T10:11:12.854872+0000","last_unstale":"2023-10-03T10:12:03.697125+0000","last_undegraded":"2023-10-03T10:12:03.697125+0000","last_fullsized":"2023-10-03T10:12:03.697125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406353+0000","last_change":"2023-10-03T10:11:13.256967+0000","last_active":"2023-10-03T10:12:03.406353+0000","last_peered":"2023-10-03T10:12:03.406353+0000","last_clean":"2023-10-03T10:12:03.406353+0000","last_became_active":"2023-10-03T10:11:13.256648+0000","last_became_peered":"2023-10-03T10:11:13.256648+0000","last_unstale":"2023-10-03T10:12:03.406353+0000","last_undegraded":"2023-10-03T10:12:03.406353+0000","last_fullsized":"2023-10-03T10:12:03.406353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402394+0000","last_change":"2023-10-03T10:11:12.861904+0000","last_active":"2023-10-03T10:12:03.402394+0000","last_peered":"2023-10-03T10:12:03.402394+0000","last_clean":"2023-10-03T10:12:03.402394+0000","last_became_active":"2023-10-03T10:11:12.861591+0000","last_became_peered":"2023-10-03T10:11:12.861591+0000","last_unstale":"2023-10-03T10:12:03.402394+0000","last_undegraded":"2023-10-03T10:12:03.402394+0000","last_fullsized":"2023-10-03T10:12:03.402394+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697355+0000","last_change":"2023-10-03T10:11:08.445902+0000","last_active":"2023-10-03T10:12:03.697355+0000","last_peered":"2023-10-03T10:12:03.697355+0000","last_clean":"2023-10-03T10:12:03.697355+0000","last_became_active":"2023-10-03T10:11:08.445597+0000","last_became_peered":"2023-10-03T10:11:08.445597+0000","last_unstale":"2023-10-03T10:12:03.697355+0000","last_undegraded":"2023-10-03T10:12:03.697355+0000","last_fullsized":"2023-10-03T10:12:03.697355+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401147+0000","last_change":"2023-10-03T10:11:13.256092+0000","last_active":"2023-10-03T10:12:03.401147+0000","last_peered":"2023-10-03T10:12:03.401147+0000","last_clean":"2023-10-03T10:12:03.401147+0000","last_became_active":"2023-10-03T10:11:13.255483+0000","last_became_peered":"2023-10-03T10:11:13.255483+0000","last_unstale":"2023-10-03T10:12:03.401147+0000","last_undegraded":"2023-10-03T10:12:03.401147+0000","last_fullsized":"2023-10-03T10:12:03.401147+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402433+0000","last_change":"2023-10-03T10:11:08.446137+0000","last_active":"2023-10-03T10:12:03.402433+0000","last_peered":"2023-10-03T10:12:03.402433+0000","last_clean":"2023-10-03T10:12:03.402433+0000","last_became_active":"2023-10-03T10:11:08.445652+0000","last_became_peered":"2023-10-03T10:11:08.445652+0000","last_unstale":"2023-10-03T10:12:03.402433+0000","last_undegraded":"2023-10-03T10:12:03.402433+0000","last_fullsized":"2023-10-03T10:12:03.402433+0000","mapping_epoch":11,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":12,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:06.790529+0000","last_clean_scrub_stamp":"2023-10-03T10:11:06.790529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"17'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.406916+0000","last_change":"2023-10-03T10:11:12.853755+0000","last_active":"2023-10-03T10:12:03.406916+0000","last_peered":"2023-10-03T10:12:03.406916+0000","last_clean":"2023-10-03T10:12:03.406916+0000","last_became_active":"2023-10-03T10:11:12.853015+0000","last_became_peered":"2023-10-03T10:11:12.853015+0000","last_unstale":"2023-10-03T10:12:03.406916+0000","last_undegraded":"2023-10-03T10:12:03.406916+0000","last_fullsized":"2023-10-03T10:12:03.406916+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.404496+0000","last_change":"2023-10-03T10:11:13.279645+0000","last_active":"2023-10-03T10:12:03.404496+0000","last_peered":"2023-10-03T10:12:03.404496+0000","last_clean":"2023-10-03T10:12:03.404496+0000","last_became_active":"2023-10-03T10:11:13.279326+0000","last_became_peered":"2023-10-03T10:11:13.279326+0000","last_unstale":"2023-10-03T10:12:03.404496+0000","last_undegraded":"2023-10-03T10:12:03.404496+0000","last_fullsized":"2023-10-03T10:12:03.404496+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407552+0000","last_change":"2023-10-03T10:11:12.860316+0000","last_active":"2023-10-03T10:12:03.407552+0000","last_peered":"2023-10-03T10:12:03.407552+0000","last_clean":"2023-10-03T10:12:03.407552+0000","last_became_active":"2023-10-03T10:11:12.859989+0000","last_became_peered":"2023-10-03T10:11:12.859989+0000","last_unstale":"2023-10-03T10:12:03.407552+0000","last_undegraded":"2023-10-03T10:12:03.407552+0000","last_fullsized":"2023-10-03T10:12:03.407552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.405100+0000","last_change":"2023-10-03T10:11:13.270021+0000","last_active":"2023-10-03T10:12:03.405100+0000","last_peered":"2023-10-03T10:12:03.405100+0000","last_clean":"2023-10-03T10:12:03.405100+0000","last_became_active":"2023-10-03T10:11:13.269746+0000","last_became_peered":"2023-10-03T10:11:13.269746+0000","last_unstale":"2023-10-03T10:12:03.405100+0000","last_undegraded":"2023-10-03T10:12:03.405100+0000","last_fullsized":"2023-10-03T10:12:03.405100+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697436+0000","last_change":"2023-10-03T10:11:12.853915+0000","last_active":"2023-10-03T10:12:03.697436+0000","last_peered":"2023-10-03T10:12:03.697436+0000","last_clean":"2023-10-03T10:12:03.697436+0000","last_became_active":"2023-10-03T10:11:12.853482+0000","last_became_peered":"2023-10-03T10:11:12.853482+0000","last_unstale":"2023-10-03T10:12:03.697436+0000","last_undegraded":"2023-10-03T10:12:03.697436+0000","last_fullsized":"2023-10-03T10:12:03.697436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403740+0000","last_change":"2023-10-03T10:11:13.280593+0000","last_active":"2023-10-03T10:12:03.403740+0000","last_peered":"2023-10-03T10:12:03.403740+0000","last_clean":"2023-10-03T10:12:03.403740+0000","last_became_active":"2023-10-03T10:11:13.279831+0000","last_became_peered":"2023-10-03T10:11:13.279831+0000","last_unstale":"2023-10-03T10:12:03.403740+0000","last_undegraded":"2023-10-03T10:12:03.403740+0000","last_fullsized":"2023-10-03T10:12:03.403740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"16'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402750+0000","last_change":"2023-10-03T10:11:12.853476+0000","last_active":"2023-10-03T10:12:03.402750+0000","last_peered":"2023-10-03T10:12:03.402750+0000","last_clean":"2023-10-03T10:12:03.402750+0000","last_became_active":"2023-10-03T10:11:12.848124+0000","last_became_peered":"2023-10-03T10:11:12.848124+0000","last_unstale":"2023-10-03T10:12:03.402750+0000","last_undegraded":"2023-10-03T10:12:03.402750+0000","last_fullsized":"2023-10-03T10:12:03.402750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403952+0000","last_change":"2023-10-03T10:11:13.280115+0000","last_active":"2023-10-03T10:12:03.403952+0000","last_peered":"2023-10-03T10:12:03.403952+0000","last_clean":"2023-10-03T10:12:03.403952+0000","last_became_active":"2023-10-03T10:11:13.279636+0000","last_became_peered":"2023-10-03T10:11:13.279636+0000","last_unstale":"2023-10-03T10:12:03.403952+0000","last_undegraded":"2023-10-03T10:12:03.403952+0000","last_fullsized":"2023-10-03T10:12:03.403952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"16'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401933+0000","last_change":"2023-10-03T10:11:12.861245+0000","last_active":"2023-10-03T10:12:03.401933+0000","last_peered":"2023-10-03T10:12:03.401933+0000","last_clean":"2023-10-03T10:12:03.401933+0000","last_became_active":"2023-10-03T10:11:12.860967+0000","last_became_peered":"2023-10-03T10:11:12.860967+0000","last_unstale":"2023-10-03T10:12:03.401933+0000","last_undegraded":"2023-10-03T10:12:03.401933+0000","last_fullsized":"2023-10-03T10:12:03.401933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401367+0000","last_change":"2023-10-03T10:11:13.268881+0000","last_active":"2023-10-03T10:12:03.401367+0000","last_peered":"2023-10-03T10:12:03.401367+0000","last_clean":"2023-10-03T10:12:03.401367+0000","last_became_active":"2023-10-03T10:11:13.267973+0000","last_became_peered":"2023-10-03T10:11:13.267973+0000","last_unstale":"2023-10-03T10:12:03.401367+0000","last_undegraded":"2023-10-03T10:12:03.401367+0000","last_fullsized":"2023-10-03T10:12:03.401367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"16'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.407309+0000","last_change":"2023-10-03T10:11:12.853474+0000","last_active":"2023-10-03T10:12:03.407309+0000","last_peered":"2023-10-03T10:12:03.407309+0000","last_clean":"2023-10-03T10:12:03.407309+0000","last_became_active":"2023-10-03T10:11:12.853168+0000","last_became_peered":"2023-10-03T10:11:12.853168+0000","last_unstale":"2023-10-03T10:12:03.407309+0000","last_undegraded":"2023-10-03T10:12:03.407309+0000","last_fullsized":"2023-10-03T10:12:03.407309+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:11.818519+0000","last_clean_scrub_stamp":"2023-10-03T10:11:11.818519+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.403886+0000","last_change":"2023-10-03T10:11:13.260018+0000","last_active":"2023-10-03T10:12:03.403886+0000","last_peered":"2023-10-03T10:12:03.403886+0000","last_clean":"2023-10-03T10:12:03.403886+0000","last_became_active":"2023-10-03T10:11:13.259693+0000","last_became_peered":"2023-10-03T10:11:13.259693+0000","last_unstale":"2023-10-03T10:12:03.403886+0000","last_undegraded":"2023-10-03T10:12:03.403886+0000","last_fullsized":"2023-10-03T10:12:03.403886+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697133+0000","last_change":"2023-10-03T10:11:13.262645+0000","last_active":"2023-10-03T10:12:03.697133+0000","last_peered":"2023-10-03T10:12:03.697133+0000","last_clean":"2023-10-03T10:12:03.697133+0000","last_became_active":"2023-10-03T10:11:13.262248+0000","last_became_peered":"2023-10-03T10:11:13.262248+0000","last_unstale":"2023-10-03T10:12:03.697133+0000","last_undegraded":"2023-10-03T10:12:03.697133+0000","last_fullsized":"2023-10-03T10:12:03.697133+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.401477+0000","last_change":"2023-10-03T10:11:13.254993+0000","last_active":"2023-10-03T10:12:03.401477+0000","last_peered":"2023-10-03T10:12:03.401477+0000","last_clean":"2023-10-03T10:12:03.401477+0000","last_became_active":"2023-10-03T10:11:13.254715+0000","last_became_peered":"2023-10-03T10:11:13.254715+0000","last_unstale":"2023-10-03T10:12:03.401477+0000","last_undegraded":"2023-10-03T10:12:03.401477+0000","last_fullsized":"2023-10-03T10:12:03.401477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.411148+0000","last_change":"2023-10-03T10:12:03.410468+0000","last_active":"2023-10-03T10:12:03.411148+0000","last_peered":"2023-10-03T10:12:03.411148+0000","last_clean":"2023-10-03T10:12:03.411148+0000","last_became_active":"2023-10-03T10:12:03.410097+0000","last_became_peered":"2023-10-03T10:12:03.410097+0000","last_unstale":"2023-10-03T10:12:03.411148+0000","last_undegraded":"2023-10-03T10:12:03.411148+0000","last_fullsized":"2023-10-03T10:12:03.411148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.402528+0000","last_change":"2023-10-03T10:11:13.269437+0000","last_active":"2023-10-03T10:12:03.402528+0000","last_peered":"2023-10-03T10:12:03.402528+0000","last_clean":"2023-10-03T10:12:03.402528+0000","last_became_active":"2023-10-03T10:11:13.269187+0000","last_became_peered":"2023-10-03T10:11:13.269187+0000","last_unstale":"2023-10-03T10:12:03.402528+0000","last_undegraded":"2023-10-03T10:12:03.402528+0000","last_fullsized":"2023-10-03T10:12:03.402528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-03T10:12:03.697486+0000","last_change":"2023-10-03T10:11:13.262081+0000","last_active":"2023-10-03T10:12:03.697486+0000","last_peered":"2023-10-03T10:12:03.697486+0000","last_clean":"2023-10-03T10:12:03.697486+0000","last_became_active":"2023-10-03T10:11:13.261450+0000","last_became_peered":"2023-10-03T10:11:13.261450+0000","last_unstale":"2023-10-03T10:12:03.697486+0000","last_undegraded":"2023-10-03T10:12:03.697486+0000","last_fullsized":"2023-10-03T10:12:03.697486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-03T10:11:12.822737+0000","last_clean_scrub_stamp":"2023-10-03T10:11:12.822737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4333,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705695,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297292,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074548,"statfs":{"total":96636764160,"available":96332337152,"internally_reserved":0,"allocated":200704,"data_stored":67217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.34699999999999998,"15min":0.35499999999999998},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.39300000000000002,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.34599999999999997,"15min":0.34999999999999998},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.45100000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":5.0019999999999998}]},{"osd":1,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.36799999999999999},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.501,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.36899999999999999,"15min":0.374},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.37}]},{"osd":2,"last update":"Tue Oct 3 10:13:07 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.39000000000000001,"15min":0.39500000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.47799999999999998,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.44,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.58699999999999997}]}]},{"osd":2,"up_from":9,"seq":38654705697,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":67023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.35599999999999998,"15min":0.35999999999999999},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.57199999999999995,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.45600000000000002}]},{"osd":1,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.35699999999999998,"15min":0.36099999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Tue Oct 3 10:13:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.373,"15min":0.377},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.54200000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.379,"15min":0.38200000000000001},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.44}]}]},{"osd":0,"up_from":9,"seq":38654705695,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297284,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074556,"statfs":{"total":96636764160,"available":96332345344,"internally_reserved":0,"allocated":192512,"data_stored":64160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.313,"15min":0.308},"min":{"1min":0.26100000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.33900000000000002,"15min":0.34300000000000003},"min":{"1min":0.27300000000000002,"5min":0.245,"15min":0.245},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.41999999999999998}]},{"osd":2,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.46500000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"last":0.39900000000000002}]},{"osd":3,"last update":"Tue Oct 3 10:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.374,"15min":0.374},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35999999999999999,"15min":0.36299999999999999},"min":{"1min":0.28899999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51500000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.434}]}]},{"osd":1,"up_from":9,"seq":38654705695,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297280,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074560,"statfs":{"total":96636764160,"available":96332349440,"internally_reserved":0,"allocated":188416,"data_stored":64106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.314,"15min":0.316},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.25800000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.318}]},{"osd":2,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.371,"15min":0.375},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.45600000000000002,"5min":0.503,"15min":0.503},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36699999999999999,"15min":0.36799999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Tue Oct 3 10:13:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.28399999999999997,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.373,"15min":0.375},"min":{"1min":0.27800000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.35799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-03T10:13:33.646 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-03T10:13:33.646 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-03T10:13:33.646 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-03T10:13:33.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-03T10:13:33.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.816+0000 7fcd3862e700 1 Processor -- start 2023-10-03T10:13:33.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.816+0000 7fcd3862e700 1 -- start start 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 0x7fcd3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd3009e410 0x7fcd30130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3009f520 con 0x7fcd3009e410 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3009f130 con 0x7fcd3009e000 2023-10-03T10:13:33.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd3862e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3009e930 con 0x7fcd3009d6f0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd35bc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd363ca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 0x7fcd3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd36bcb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd3009e410 0x7fcd30130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd363ca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 0x7fcd3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51382/0 (socket says 172.21.15.19:51382) 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd35bc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58742/0 (socket says 172.21.15.19:58742) 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd363ca700 1 -- 172.21.15.19:0/575104083 learned_addr learned my addr 172.21.15.19:0/575104083 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd36bcb700 1 -- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 msgr2=0x7fcd3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.817+0000 7fcd36bcb700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 0x7fcd3009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd36bcb700 1 -- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 msgr2=0x7fcd30130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd36bcb700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd36bcb700 1 -- 172.21.15.19:0/575104083 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3009b2d0 con 0x7fcd3009e410 2023-10-03T10:13:33.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd35bc9700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd36bcb700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009e410 0x7fcd30130ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcf70e758bd7bb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd353c8700 1 -- 172.21.15.19:0/575104083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800e070 con 0x7fcd3009e410 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd353c8700 1 -- 172.21.15.19:0/575104083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2800bb20 con 0x7fcd3009e410 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd353c8700 1 -- 172.21.15.19:0/575104083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28012430 con 0x7fcd3009e410 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd3862e700 1 -- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009e410 msgr2=0x7fcd30130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.818+0000 7fcd3862e700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009e410 0x7fcd30130ba0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 -- 172.21.15.19:0/575104083 shutdown_connections 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009e410 0x7fcd30130ba0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009d6f0 0x7fcd3009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 --2- 172.21.15.19:0/575104083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd30130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 -- 172.21.15.19:0/575104083 >> 172.21.15.19:0/575104083 conn(0x7fcd30066f50 msgr2=0x7fcd3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 -- 172.21.15.19:0/575104083 shutdown_connections 2023-10-03T10:13:33.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.819+0000 7fcd3862e700 1 -- 172.21.15.19:0/575104083 wait complete. 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 Processor -- start 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 -- start start 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 0x7fcd301200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd301205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:33.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30122470 con 0x7fcd3009d6f0 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd301303c0 con 0x7fcd3009e000 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd3862e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3009c700 con 0x7fcd3009e410 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd36bcb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd363ca700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 0x7fcd301200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd36bcb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51388/0 (socket says 172.21.15.19:51388) 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd36bcb700 1 -- 172.21.15.19:0/1566511447 learned_addr learned my addr 172.21.15.19:0/1566511447 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.820+0000 7fcd35bc9700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd301205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 -- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 msgr2=0x7fcd30120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 -- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 msgr2=0x7fcd301205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd301205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 -- 172.21.15.19:0/1566511447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200094a0 con 0x7fcd3009d6f0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd36bcb700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd363ca700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 0x7fcd301200a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00e860 tx=0x7fcd2c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c013680 con 0x7fcd3009d6f0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0137e0 con 0x7fcd3009d6f0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd28009a70 con 0x7fcd3009d6f0 2023-10-03T10:13:33.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c013b70 con 0x7fcd3009d6f0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.821+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd30123580 con 0x7fcd3009d6f0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.822+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7fcd2c013cd0 con 0x7fcd3009d6f0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.822+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fcd2c03f930 con 0x7fcd3009d6f0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.822+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30074ea0 con 0x7fcd3009d6f0 2023-10-03T10:13:33.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:33.827+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd2c017080 con 0x7fcd3009d6f0 2023-10-03T10:13:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.075+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcd3006c360 con 0x7fcd3009d6f0 2023-10-03T10:13:34.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.075+0000 7fcd26ffd700 1 -- 172.21.15.19:0/1566511447 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcd2c021070 con 0x7fcd3009d6f0 2023-10-03T10:13:34.076 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:34.077 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-03T10:13:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.077+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 >> v1:172.21.15.19:6816/126819 conn(0x7fcd1402f480 legacy=0x7fcd14031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.077+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 msgr2=0x7fcd301200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.077+0000 7fcd3862e700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 0x7fcd301200a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00e860 tx=0x7fcd2c00eb70 comp rx=0 tx=0).stop 2023-10-03T10:13:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 shutdown_connections 2023-10-03T10:13:34.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3009e410 0x7fcd30120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3009d6f0 0x7fcd301200a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 --2- 172.21.15.19:0/1566511447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3009e000 0x7fcd301205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 >> 172.21.15.19:0/1566511447 conn(0x7fcd30066f50 msgr2=0x7fcd3006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 shutdown_connections 2023-10-03T10:13:34.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.078+0000 7fcd3862e700 1 -- 172.21.15.19:0/1566511447 wait complete. 2023-10-03T10:13:34.092 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-03T10:13:34.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:34.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 Processor -- start 2023-10-03T10:13:34.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 -- start start 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f0604130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.227+0000 7f060bf75700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060409f520 con 0x7f060409d6f0 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f060bf75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060409f130 con 0x7f060409e000 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f060bf75700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060409e930 con 0x7f060409e410 2023-10-03T10:13:34.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f060a512700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609d11700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f0604130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609d11700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49032/0 (socket says 172.21.15.19:49032) 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f060a512700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51390/0 (socket says 172.21.15.19:51390) 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609d11700 1 -- 172.21.15.19:0/1158844478 learned_addr learned my addr 172.21.15.19:0/1158844478 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 -- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 msgr2=0x7f0604130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 -- 172.21.15.19:0/1158844478 >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 msgr2=0x7f060409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 --2- 172.21.15.19:0/1158844478 >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 -- 172.21.15.19:0/1158844478 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060409b2d0 con 0x7f060409e000 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f060a512700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609d11700 1 --2- 172.21.15.19:0/1158844478 >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0609510700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f0604130660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f400bae0 tx=0x7f05f400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bfd4f81b6eaed21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0608d0f700 1 -- 172.21.15.19:0/1158844478 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400dc70 con 0x7f060409e000 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0608d0f700 1 -- 172.21.15.19:0/1158844478 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400ddd0 con 0x7f060409e000 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.228+0000 7f0608d0f700 1 -- 172.21.15.19:0/1158844478 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4010690 con 0x7f060409e000 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 -- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 msgr2=0x7f0604130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f0604130660 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f400bae0 tx=0x7f05f400bdf0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 -- 172.21.15.19:0/1158844478 shutdown_connections 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e410 0x7f0604130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 --2- 172.21.15.19:0/1158844478 >> v2:172.21.15.19:3300/0 conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 --2- 172.21.15.19:0/1158844478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f0604130660 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 -- 172.21.15.19:0/1158844478 >> 172.21.15.19:0/1158844478 conn(0x7f0604066f50 msgr2=0x7f060409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 -- 172.21.15.19:0/1158844478 shutdown_connections 2023-10-03T10:13:34.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.229+0000 7f060bf75700 1 -- 172.21.15.19:0/1158844478 wait complete. 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.230+0000 7f060bf75700 1 Processor -- start 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.230+0000 7f060bf75700 1 -- start start 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f060411e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f060411eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0604121b60 con 0x7f060409d6f0 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060409c770 con 0x7f060409e410 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060bf75700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06040a1ad0 con 0x7f060409e000 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060a512700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f060411eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49048/0 (socket says 172.21.15.19:49048) 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 -- 172.21.15.19:0/1277002417 learned_addr learned my addr 172.21.15.19:0/1277002417 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609510700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f060411e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 -- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 msgr2=0x7f060411e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f060411e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 -- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 msgr2=0x7f060411eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f060411eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 -- 172.21.15.19:0/1277002417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009550 con 0x7f060409d6f0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f060a512700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f060411eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f0609d11700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f060000ebb0 tx=0x7f060000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.231+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0600009e80 con 0x7f060409d6f0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.232+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600004030 con 0x7f060409d6f0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.232+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000043a0 con 0x7f060409d6f0 2023-10-03T10:13:34.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.232+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc009a70 con 0x7f060409d6f0 2023-10-03T10:13:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.232+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f400b740 con 0x7f060409d6f0 2023-10-03T10:13:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.232+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) v1 ==== 35553+0+0 (secure 0 0 0) 0x7f060000c7f0 con 0x7f060409d6f0 2023-10-03T10:13:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.233+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f060003fc80 con 0x7f060409d6f0 2023-10-03T10:13:34.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.233+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0604074ea0 con 0x7f060409d6f0 2023-10-03T10:13:34.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.238+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0600011d90 con 0x7f060409d6f0 2023-10-03T10:13:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.440+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f060406c360 con 0x7f060409d6f0 2023-10-03T10:13:34.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.441+0000 7f05fa7fc700 1 -- 172.21.15.19:0/1277002417 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7f0600011350 con 0x7f060409d6f0 2023-10-03T10:13:34.443 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:34.443 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:31.544969+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 >> v1:172.21.15.19:6816/126819 conn(0x7f05e802f480 legacy=0x7f05e8031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 msgr2=0x7f060411e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f060000ebb0 tx=0x7f060000eec0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 shutdown_connections 2023-10-03T10:13:34.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f060411eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f060411e040 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 --2- 172.21.15.19:0/1277002417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f060411e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 >> 172.21.15.19:0/1277002417 conn(0x7f0604066f50 msgr2=0x7f060406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 shutdown_connections 2023-10-03T10:13:34.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.444+0000 7f060bf75700 1 -- 172.21.15.19:0/1277002417 wait complete. 2023-10-03T10:13:34.460 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:13:34.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:13:34.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.599+0000 7fb7e604e700 1 Processor -- start 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.599+0000 7fb7e604e700 1 -- start start 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.599+0000 7fb7e604e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.599+0000 7fb7e604e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 0x7fb7e006ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7e604e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e012df80 con 0x7fb7e006b0a0 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7e604e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e009e640 con 0x7fb7e012e180 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7e604e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e009f7c0 con 0x7fb7e006a770 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 0x7fb7e006ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58758/0 (socket says 172.21.15.19:58758) 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7df7fe700 1 -- 172.21.15.19:0/2763381081 learned_addr learned my addr 172.21.15.19:0/2763381081 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 -- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 msgr2=0x7fb7e012e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7de7fc700 1 -- 172.21.15.19:0/2763381081 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303486367 0 0) 0x7fb7e012df80 con 0x7fb7e006b0a0 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 -- 172.21.15.19:0/2763381081 >> v1:172.21.15.19:6789/0 conn(0x7fb7e006b0a0 legacy=0x7fb7e0138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 -- 172.21.15.19:0/2763381081 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e009e900 con 0x7fb7e006a770 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7df7fe700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7deffd700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 0x7fb7e006ab60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b03d3fe049807d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7de7fc700 1 -- 172.21.15.19:0/2763381081 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011830 con 0x7fb7e006a770 2023-10-03T10:13:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7de7fc700 1 -- 172.21.15.19:0/2763381081 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0011990 con 0x7fb7e006a770 2023-10-03T10:13:34.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.600+0000 7fb7de7fc700 1 -- 172.21.15.19:0/2763381081 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011d20 con 0x7fb7e006a770 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 -- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 msgr2=0x7fb7e006ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 0x7fb7e006ab60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009870 tx=0x7fb7d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 -- 172.21.15.19:0/2763381081 shutdown_connections 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e012e180 0x7fb7e012e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 --2- 172.21.15.19:0/2763381081 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006a770 0x7fb7e006ab60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 -- 172.21.15.19:0/2763381081 >> 172.21.15.19:0/2763381081 conn(0x7fb7e0066d70 msgr2=0x7fb7e00a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 -- 172.21.15.19:0/2763381081 shutdown_connections 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.601+0000 7fb7e604e700 1 -- 172.21.15.19:0/2763381081 wait complete. 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.602+0000 7fb7e604e700 1 Processor -- start 2023-10-03T10:13:34.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.602+0000 7fb7e604e700 1 -- start start 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 0x7fb7e0072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 0x7fb7e009a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e006fd10 con 0x7fb7e012e180 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e012b8d0 con 0x7fb7e006a770 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7e604e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0070a50 con 0x7fb7e006b0a0 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 0x7fb7e0072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58772/0 (socket says 172.21.15.19:58772) 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 -- 172.21.15.19:0/3318836266 learned_addr learned my addr 172.21.15.19:0/3318836266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7dffff700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 0x7fb7e009a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 -- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 msgr2=0x7fb7e0072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 0x7fb7e0072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 -- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 msgr2=0x7fb7e009a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 0x7fb7e009a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7df7fe700 1 -- 172.21.15.19:0/3318836266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009550 con 0x7fb7e006a770 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7deffd700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 0x7fb7e0072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.603+0000 7fb7dffff700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 0x7fb7e009a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7df7fe700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400ec10 tx=0x7fb7d400ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400c850 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400c9b0 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400cd40 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d00094a0 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.604+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e009c340 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.605+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb7d4013470 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.605+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fb7d40400a0 con 0x7fb7e006a770 2023-10-03T10:13:34.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.605+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e00705e0 con 0x7fb7e006a770 2023-10-03T10:13:34.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.610+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7d400cea0 con 0x7fb7e006a770 2023-10-03T10:13:34.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.813+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7e004f2a0 con 0x7fb7e006a770 2023-10-03T10:13:34.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.814+0000 7fb7c7fff700 1 -- 172.21.15.19:0/3318836266 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7d4021030 con 0x7fb7e006a770 2023-10-03T10:13:34.815 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 >> v1:172.21.15.19:6816/126819 conn(0x7fb7cc02f510 legacy=0x7fb7cc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 msgr2=0x7fb7e0071b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400ec10 tx=0x7fb7d400ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 shutdown_connections 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7e012e180 0x7fb7e009a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7e006a770 0x7fb7e0071b40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 --2- 172.21.15.19:0/3318836266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7e006b0a0 0x7fb7e0072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 >> 172.21.15.19:0/3318836266 conn(0x7fb7e0066d70 msgr2=0x7fb7e012aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 shutdown_connections 2023-10-03T10:13:34.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.816+0000 7fb7e604e700 1 -- 172.21.15.19:0/3318836266 wait complete. 2023-10-03T10:13:34.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:13:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.968+0000 7f313aec9700 1 Processor -- start 2023-10-03T10:13:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.968+0000 7f313aec9700 1 -- start start 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f313aec9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 0x7f3134135a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f313aec9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f3134138340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f313aec9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313409b800 con 0x7f313409d7d0 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f313aec9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313409b620 con 0x7f313409e2b0 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f313aec9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313409f370 con 0x7f3134135f60 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f3138c65700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f313409d7d0 0x7f313409dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38192/0 (socket says 172.21.15.19:38192) 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f3138c65700 1 -- 172.21.15.19:0/1968951324 learned_addr learned my addr 172.21.15.19:0/1968951324 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f3133fff700 1 --2- 172.21.15.19:0/1968951324 >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 0x7f3134135a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.969+0000 7f3139466700 1 --2- 172.21.15.19:0/1968951324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f3134138340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3139466700 1 -- 172.21.15.19:0/1968951324 >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 msgr2=0x7f3134135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3139466700 1 --2- 172.21.15.19:0/1968951324 >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 0x7f3134135a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3139466700 1 -- 172.21.15.19:0/1968951324 >> v1:172.21.15.19:6789/0 conn(0x7f313409d7d0 legacy=0x7f313409dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3139466700 1 -- 172.21.15.19:0/1968951324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313409ef80 con 0x7f3134135f60 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3133fff700 1 --2- 172.21.15.19:0/1968951324 >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 0x7f3134135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f3139466700 1 --2- 172.21.15.19:0/1968951324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f3134138340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d90 tx=0x7f312c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78fea9bf4a7bd436 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f31337fe700 1 -- 172.21.15.19:0/1968951324 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00bd20 con 0x7f3134135f60 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f31337fe700 1 -- 172.21.15.19:0/1968951324 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c00be80 con 0x7f3134135f60 2023-10-03T10:13:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f31337fe700 1 -- 172.21.15.19:0/1968951324 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c0116a0 con 0x7f3134135f60 2023-10-03T10:13:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 -- 172.21.15.19:0/1968951324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 msgr2=0x7f3134138340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 --2- 172.21.15.19:0/1968951324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f3134138340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d90 tx=0x7f312c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 -- 172.21.15.19:0/1968951324 shutdown_connections 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 --2- 172.21.15.19:0/1968951324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f3134138340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 --2- 172.21.15.19:0/1968951324 >> v2:172.21.15.19:3300/0 conn(0x7f313409e2b0 0x7f3134135a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.970+0000 7f313aec9700 1 -- 172.21.15.19:0/1968951324 >> 172.21.15.19:0/1968951324 conn(0x7f3134066d70 msgr2=0x7f31340a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.971+0000 7f313aec9700 1 -- 172.21.15.19:0/1968951324 shutdown_connections 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.971+0000 7f313aec9700 1 -- 172.21.15.19:0/1968951324 wait complete. 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.971+0000 7f313aec9700 1 Processor -- start 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 -- start start 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 0x7f31341c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f313411e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134121c10 con 0x7f313409e2b0 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313409c720 con 0x7f313409d7d0 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f313aec9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31341bb040 con 0x7f3134135f60 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f3133fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f3138c65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 0x7f31341c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f3133fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49060/0 (socket says 172.21.15.19:49060) 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f3133fff700 1 -- 172.21.15.19:0/2626968282 learned_addr learned my addr 172.21.15.19:0/2626968282 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.972+0000 7f3139466700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f313411e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 -- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 msgr2=0x7f31341c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 0x7f31341c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 -- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 msgr2=0x7f31341c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 -- 172.21.15.19:0/2626968282 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0094a0 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3133fff700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3138c65700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 0x7f31341c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f3139466700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f313411e690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d90 tx=0x7f312c004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c004240 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c0043a0 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312c009a70 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c004750 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.973+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31341221b0 con 0x7f3134135f60 2023-10-03T10:13:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.974+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f312c011460 con 0x7f3134135f60 2023-10-03T10:13:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.974+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f312c045990 con 0x7f3134135f60 2023-10-03T10:13:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.974+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3134121d80 con 0x7f3134135f60 2023-10-03T10:13:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:34.979+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f312c00f340 con 0x7f3134135f60 2023-10-03T10:13:35.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.180+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f313404f2a0 con 0x7f3134135f60 2023-10-03T10:13:35.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.180+0000 7f31317fa700 1 -- 172.21.15.19:0/2626968282 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f312c008b80 con 0x7f3134135f60 2023-10-03T10:13:35.182 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 >> v1:172.21.15.19:6816/126819 conn(0x7f311402f510 legacy=0x7f31140319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 msgr2=0x7f313411e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f313411e690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f312c009d90 tx=0x7f312c004b40 comp rx=0 tx=0).stop 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 shutdown_connections 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135f60 0x7f313411e690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d7d0 0x7f31341c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 --2- 172.21.15.19:0/2626968282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f313409e2b0 0x7f31341c4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 >> 172.21.15.19:0/2626968282 conn(0x7f3134066d70 msgr2=0x7f31340a0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 shutdown_connections 2023-10-03T10:13:35.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.183+0000 7f313aec9700 1 -- 172.21.15.19:0/2626968282 wait complete. 2023-10-03T10:13:35.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:13:35.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.334+0000 7f1f968e7700 1 Processor -- start 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.334+0000 7f1f968e7700 1 -- start start 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.334+0000 7f1f968e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.334+0000 7f1f968e7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f968e7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9009b6f0 con 0x7f1f9012dc80 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f968e7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9012cf80 con 0x7f1f90130c20 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f968e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9012d170 con 0x7f1f9012d370 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f94e84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f94e84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49066/0 (socket says 172.21.15.19:49066) 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1f9012dc80 0x7f1f90130510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38198/0 (socket says 172.21.15.19:38198) 2023-10-03T10:13:35.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f94e84700 1 -- 172.21.15.19:0/1152626830 learned_addr learned my addr 172.21.15.19:0/1152626830 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58798/0 (socket says 172.21.15.19:58798) 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 -- 172.21.15.19:0/1152626830 >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 msgr2=0x7f1f901388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 --2- 172.21.15.19:0/1152626830 >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 -- 172.21.15.19:0/1152626830 >> v1:172.21.15.19:6789/0 conn(0x7f1f9012dc80 legacy=0x7f1f90130510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 -- 172.21.15.19:0/1152626830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9009c100 con 0x7f1f9012d370 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f94e84700 1 --2- 172.21.15.19:0/1152626830 >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8ffff700 1 --2- 172.21.15.19:0/1152626830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009840 tx=0x7f1f78009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128dda17739b65fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8effd700 1 -- 172.21.15.19:0/1152626830 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78011830 con 0x7f1f9012d370 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.335+0000 7f1f8effd700 1 -- 172.21.15.19:0/1152626830 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78011990 con 0x7f1f9012d370 2023-10-03T10:13:35.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f8effd700 1 -- 172.21.15.19:0/1152626830 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78011d20 con 0x7f1f9012d370 2023-10-03T10:13:35.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 -- 172.21.15.19:0/1152626830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 msgr2=0x7f1f9012d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1152626830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009840 tx=0x7f1f78009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 -- 172.21.15.19:0/1152626830 shutdown_connections 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1152626830 >> v2:172.21.15.19:3300/0 conn(0x7f1f90130c20 0x7f1f901388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1152626830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f9012d740 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 -- 172.21.15.19:0/1152626830 >> 172.21.15.19:0/1152626830 conn(0x7f1f900a2c10 msgr2=0x7f1f900a3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 -- 172.21.15.19:0/1152626830 shutdown_connections 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.336+0000 7f1f968e7700 1 -- 172.21.15.19:0/1152626830 wait complete. 2023-10-03T10:13:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.337+0000 7f1f968e7700 1 Processor -- start 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.337+0000 7f1f968e7700 1 -- start start 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f9012dc80 0x7f1f901c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 0x7f1f901c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9009b940 con 0x7f1f9012dc80 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9011dba0 con 0x7f1f9012d370 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f968e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9011cee0 con 0x7f1f90130c20 2023-10-03T10:13:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f8ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 0x7f1f901c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f8ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:58800/0 (socket says 172.21.15.19:58800) 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f8ffff700 1 -- 172.21.15.19:0/1592529096 learned_addr learned my addr 172.21.15.19:0/1592529096 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f8f7fe700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f9012dc80 0x7f1f901c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 -- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 msgr2=0x7f1f901c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 -- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f9012dc80 msgr2=0x7f1f901c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f9012dc80 0x7f1f901c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f94e84700 1 -- 172.21.15.19:0/1592529096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009b30 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.338+0000 7f1f8ffff700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f94e84700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 0x7f1f901c8780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009e50 tx=0x7f1f8800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88018070 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8800f040 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f780094a0 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88003c40 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.339+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f9009dbf0 con 0x7f1f90130c20 2023-10-03T10:13:35.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.340+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1f8800c880 con 0x7f1f90130c20 2023-10-03T10:13:35.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.340+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f1f8803fd10 con 0x7f1f90130c20 2023-10-03T10:13:35.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.340+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9004f2a0 con 0x7f1f90130c20 2023-10-03T10:13:35.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.345+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f88012340 con 0x7f1f90130c20 2023-10-03T10:13:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.547+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f90072d60 con 0x7f1f90130c20 2023-10-03T10:13:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.548+0000 7f1f8cff9700 1 -- 172.21.15.19:0/1592529096 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f8801cb70 con 0x7f1f90130c20 2023-10-03T10:13:35.549 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:13:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 >> v1:172.21.15.19:6816/126819 conn(0x7f1f7002f510 legacy=0x7f1f700319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 msgr2=0x7f1f901c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 0x7f1f901c8780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f88009e50 tx=0x7f1f8800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 shutdown_connections 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f90130c20 0x7f1f901c8780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f9012d370 0x7f1f901c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 --2- 172.21.15.19:0/1592529096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f9012dc80 0x7f1f901c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 >> 172.21.15.19:0/1592529096 conn(0x7f1f900a2c10 msgr2=0x7f1f900a06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 shutdown_connections 2023-10-03T10:13:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.550+0000 7f1f968e7700 1 -- 172.21.15.19:0/1592529096 wait complete. 2023-10-03T10:13:35.565 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:13:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.704+0000 7f67380ff700 1 Processor -- start 2023-10-03T10:13:35.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.704+0000 7f67380ff700 1 -- start start 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.704+0000 7f67380ff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673009dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.704+0000 7f67380ff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f67380ff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673009b800 con 0x7f673009e0e0 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f67380ff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673009b620 con 0x7f6730130e80 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f67380ff700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f673009f370 con 0x7f673009d7d0 2023-10-03T10:13:35.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f673669c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673009dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f673669c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49090/0 (socket says 172.21.15.19:49090) 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f673669c700 1 -- 172.21.15.19:0/1844223954 learned_addr learned my addr 172.21.15.19:0/1844223954 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f673569a700 1 --1- 172.21.15.19:0/1844223954 >> v1:172.21.15.19:6789/0 conn(0x7f673009e0e0 0x7f6730130770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38202/0 (socket says 172.21.15.19:38202) 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 -- 172.21.15.19:0/1844223954 >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 msgr2=0x7f6730138a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 --2- 172.21.15.19:0/1844223954 >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 -- 172.21.15.19:0/1844223954 >> v1:172.21.15.19:6789/0 conn(0x7f673009e0e0 legacy=0x7f6730130770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 -- 172.21.15.19:0/1844223954 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673009ef80 con 0x7f673009d7d0 2023-10-03T10:13:35.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f673669c700 1 --2- 172.21.15.19:0/1844223954 >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6735e9b700 1 --2- 172.21.15.19:0/1844223954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673009dba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6720009840 tx=0x7f6720009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6992dc8dab51ddf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6734e99700 1 -- 172.21.15.19:0/1844223954 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011830 con 0x7f673009d7d0 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6734e99700 1 -- 172.21.15.19:0/1844223954 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720011990 con 0x7f673009d7d0 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.705+0000 7f6734e99700 1 -- 172.21.15.19:0/1844223954 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720011d20 con 0x7f673009d7d0 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 -- 172.21.15.19:0/1844223954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 msgr2=0x7f673009dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 --2- 172.21.15.19:0/1844223954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673009dba0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6720009840 tx=0x7f6720009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 -- 172.21.15.19:0/1844223954 shutdown_connections 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 --2- 172.21.15.19:0/1844223954 >> v2:172.21.15.19:3300/0 conn(0x7f6730130e80 0x7f6730138a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 --2- 172.21.15.19:0/1844223954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673009dba0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 -- 172.21.15.19:0/1844223954 >> 172.21.15.19:0/1844223954 conn(0x7f6730066d70 msgr2=0x7f67300a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 -- 172.21.15.19:0/1844223954 shutdown_connections 2023-10-03T10:13:35.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.706+0000 7f67380ff700 1 -- 172.21.15.19:0/1844223954 wait complete. 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.707+0000 7f67380ff700 1 Processor -- start 2023-10-03T10:13:35.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.707+0000 7f67380ff700 1 -- start start 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673011e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 0x7f673011ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6730130e80 0x7f67301cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730121d70 con 0x7f673009e0e0 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6730122450 con 0x7f6730130e80 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f67380ff700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67301219b0 con 0x7f673009d7d0 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f6735e9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673011e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 0x7f673011ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f6735e9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673011e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51458/0 (socket says 172.21.15.19:51458) 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f6735e9b700 1 -- 172.21.15.19:0/823546305 learned_addr learned my addr 172.21.15.19:0/823546305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673669c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6730130e80 0x7f67301cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 -- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 msgr2=0x7f673011e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673011e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 -- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6730130e80 msgr2=0x7f67301cc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6730130e80 0x7f67301cc660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 -- 172.21.15.19:0/823546305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672800bd40 con 0x7f673009e0e0 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.708+0000 7f673569a700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 0x7f673011ec80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c480 tx=0x7f672c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c005cb0 con 0x7f673009e0e0 2023-10-03T10:13:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c005e10 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67200094a0 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0072d0 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6730120040 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.709+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f672c007430 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.710+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f672c03ede0 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.710+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673004f2a0 con 0x7f673009e0e0 2023-10-03T10:13:35.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.715+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f672c017070 con 0x7f673009e0e0 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.917+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67300008d0 con 0x7f673009e0e0 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.917+0000 7f67267fc700 1 -- 172.21.15.19:0/823546305 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f672c0076e0 con 0x7f673009e0e0 2023-10-03T10:13:35.918 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 >> v1:172.21.15.19:6816/126819 conn(0x7f671402f510 legacy=0x7f67140319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 msgr2=0x7f673011ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 0x7f673011ec80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f672c00c480 tx=0x7f672c00c790 comp rx=0 tx=0).stop 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 shutdown_connections 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6730130e80 0x7f67301cc660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673009d7d0 0x7f673011e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 --2- 172.21.15.19:0/823546305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673009e0e0 0x7f673011ec80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:35.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 >> 172.21.15.19:0/823546305 conn(0x7f6730066d70 msgr2=0x7f673006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 shutdown_connections 2023-10-03T10:13:35.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:35.920+0000 7f67380ff700 1 -- 172.21.15.19:0/823546305 wait complete. 2023-10-03T10:13:35.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:13:36.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 Processor -- start 2023-10-03T10:13:36.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 -- start start 2023-10-03T10:13:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 0x7f8bd8136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 0x7f8bd8139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd809ece0 con 0x7f8bd806a770 2023-10-03T10:13:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd806b640 con 0x7f8bd806b250 2023-10-03T10:13:36.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8be0452700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd809e760 con 0x7f8bd8136d80 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8bdd9ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 0x7f8bd8136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8bde1ee700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8bd806a770 0x7f8bd806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:38206/0 (socket says 172.21.15.19:38206) 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bde1ee700 1 -- 172.21.15.19:0/1976271127 learned_addr learned my addr 172.21.15.19:0/1976271127 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.070+0000 7f8bde9ef700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 0x7f8bd8139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 msgr2=0x7f8bd8139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd9ed700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 0x7f8bd8139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/1976271127 >> v1:172.21.15.19:6789/0 conn(0x7f8bd806a770 legacy=0x7f8bd806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd1ec700 1 -- 172.21.15.19:0/1976271127 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294282210 0 0) 0x7f8bd809ece0 con 0x7f8bd806a770 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/1976271127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd809e040 con 0x7f8bd806b250 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bde9ef700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 0x7f8bd8139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd9ed700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 0x7f8bd8136840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009870 tx=0x7f8bc8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c20fb158242c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd1ec700 1 -- 172.21.15.19:0/1976271127 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011830 con 0x7f8bd806b250 2023-10-03T10:13:36.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd1ec700 1 -- 172.21.15.19:0/1976271127 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8011990 con 0x7f8bd806b250 2023-10-03T10:13:36.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.071+0000 7f8bdd1ec700 1 -- 172.21.15.19:0/1976271127 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8011d20 con 0x7f8bd806b250 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 -- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 msgr2=0x7f8bd8136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 0x7f8bd8136840 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009870 tx=0x7f8bc8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 -- 172.21.15.19:0/1976271127 shutdown_connections 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd8136d80 0x7f8bd8139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 --2- 172.21.15.19:0/1976271127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806b250 0x7f8bd8136840 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 -- 172.21.15.19:0/1976271127 >> 172.21.15.19:0/1976271127 conn(0x7f8bd8066f50 msgr2=0x7f8bd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 -- 172.21.15.19:0/1976271127 shutdown_connections 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.072+0000 7f8be0452700 1 -- 172.21.15.19:0/1976271127 wait complete. 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 Processor -- start 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 -- start start 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 0x7f8bd81c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 0x7f8bd811c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8120200 con 0x7f8bd8136d80 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd811fd50 con 0x7f8bd806a770 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.073+0000 7f8be0452700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd81bbf70 con 0x7f8bd806b250 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bde9ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 0x7f8bd811c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bde9ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 0x7f8bd811c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49114/0 (socket says 172.21.15.19:49114) 2023-10-03T10:13:36.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:51472/0 (socket says 172.21.15.19:51472) 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bde1ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 0x7f8bd81c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/703293600 learned_addr learned my addr 172.21.15.19:0/703293600 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 msgr2=0x7f8bd81c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 0x7f8bd81c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 msgr2=0x7f8bd811c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 0x7f8bd811c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 -- 172.21.15.19:0/703293600 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd0009a70 con 0x7f8bd806b250 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bde1ee700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 0x7f8bd81c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bdd9ed700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009840 tx=0x7f8bc8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80045d0 con 0x7f8bd806b250 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc801f070 con 0x7f8bd806b250 2023-10-03T10:13:36.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc80094a0 con 0x7f8bd806b250 2023-10-03T10:13:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80038e0 con 0x7f8bd806b250 2023-10-03T10:13:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.074+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd806e8e0 con 0x7f8bd806b250 2023-10-03T10:13:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.075+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8bc8003a40 con 0x7f8bd806b250 2023-10-03T10:13:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.076+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f8bc8021070 con 0x7f8bd806b250 2023-10-03T10:13:36.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.076+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd811f980 con 0x7f8bd806b250 2023-10-03T10:13:36.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.080+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bc8015070 con 0x7f8bd806b250 2023-10-03T10:13:36.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.331+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bd809f6b0 con 0x7f8bd806b250 2023-10-03T10:13:36.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.331+0000 7f8bceffd700 1 -- 172.21.15.19:0/703293600 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2313 (secure 0 0 0) 0x7f8bc8003cf0 con 0x7f8bd806b250 2023-10-03T10:13:36.332 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:36.332 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:39.450921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.333+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 >> v1:172.21.15.19:6816/126819 conn(0x7f8bbc02f510 legacy=0x7f8bbc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.333+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 msgr2=0x7f8bd81c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.333+0000 7f8be0452700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8009840 tx=0x7f8bc8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 shutdown_connections 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd8136d80 0x7f8bd811c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd806a770 0x7f8bd81c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 --2- 172.21.15.19:0/703293600 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd806b250 0x7f8bd81c67c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 >> 172.21.15.19:0/703293600 conn(0x7f8bd8066f50 msgr2=0x7f8bd80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 shutdown_connections 2023-10-03T10:13:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.334+0000 7f8be0452700 1 -- 172.21.15.19:0/703293600 wait complete. 2023-10-03T10:13:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2023-10-03T10:13:36.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.484+0000 7fbef5f31700 1 Processor -- start 2023-10-03T10:13:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.484+0000 7fbef5f31700 1 -- start start 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbef5f31700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0131810 0x7fbef0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbef5f31700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbef0099a40 0x7fbef0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbef5f31700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef009a850 con 0x7fbef009a3b0 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbef5f31700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef009b580 con 0x7fbef0099a40 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbef5f31700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef01313c0 con 0x7fbef0131810 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeeffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbef0099a40 0x7fbef0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0131810 0x7fbef0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbef009a3b0 0x7fbef0138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49612/0 (socket says 172.21.15.19:49612) 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeffff700 1 -- 172.21.15.19:0/1269559319 learned_addr learned my addr 172.21.15.19:0/1269559319 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeeffd700 1 -- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0131810 msgr2=0x7fbef0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeeffd700 1 --2- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0131810 0x7fbef0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeeffd700 1 -- 172.21.15.19:0/1269559319 >> v1:172.21.15.19:6789/0 conn(0x7fbef009a3b0 legacy=0x7fbef0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeeeffd700 1 -- 172.21.15.19:0/1269559319 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef006e8c0 con 0x7fbef0099a40 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.485+0000 7fbeee7fc700 1 -- 172.21.15.19:0/1269559319 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058217030 0 0) 0x7fbef009a850 con 0x7fbef009a3b0 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbeeeffd700 1 --2- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef0099a40 0x7fbef0099e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009870 tx=0x7fbee4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8b5d5d3f0fe15f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbeee7fc700 1 -- 172.21.15.19:0/1269559319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4011830 con 0x7fbef0099a40 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbeee7fc700 1 -- 172.21.15.19:0/1269559319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4011990 con 0x7fbef0099a40 2023-10-03T10:13:36.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbeee7fc700 1 -- 172.21.15.19:0/1269559319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4011d20 con 0x7fbef0099a40 2023-10-03T10:13:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 -- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef0099a40 msgr2=0x7fbef0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef0099a40 0x7fbef0099e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbee4009870 tx=0x7fbee4009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 -- 172.21.15.19:0/1269559319 shutdown_connections 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0131810 0x7fbef0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1269559319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef0099a40 0x7fbef0099e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.486+0000 7fbef5f31700 1 -- 172.21.15.19:0/1269559319 >> 172.21.15.19:0/1269559319 conn(0x7fbef00a2aa0 msgr2=0x7fbef00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.487+0000 7fbef5f31700 1 -- 172.21.15.19:0/1269559319 shutdown_connections 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.487+0000 7fbef5f31700 1 -- 172.21.15.19:0/1269559319 wait complete. 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.487+0000 7fbef5f31700 1 Processor -- start 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 -- start start 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef009a3b0 0x7fbef006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbef0131810 0x7fbef0070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef0071190 con 0x7fbef009a3b0 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef011ec40 con 0x7fbef0099a40 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbef5f31700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbef011e160 con 0x7fbef0131810 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbeef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbeef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53282/0 (socket says 172.21.15.19:53282) 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbeef7fe700 1 -- 172.21.15.19:0/1551876369 learned_addr learned my addr 172.21.15.19:0/1551876369 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbeeffff700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbef0131810 0x7fbef0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.488+0000 7fbeeeffd700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef009a3b0 0x7fbef006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 -- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbef0131810 msgr2=0x7fbef0070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbef0131810 0x7fbef0070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 -- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef009a3b0 msgr2=0x7fbef006fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef009a3b0 0x7fbef006fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 -- 172.21.15.19:0/1551876369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40094a0 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbeef7fe700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e9e0 tx=0x7fbee000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee0009710 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee000ee80 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef011e970 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee000ca50 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.489+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef011ef00 con 0x7fbef0099a40 2023-10-03T10:13:36.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.490+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbee000cbb0 con 0x7fbef0099a40 2023-10-03T10:13:36.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.490+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fbee003ffe0 con 0x7fbef0099a40 2023-10-03T10:13:36.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.490+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef011f0f0 con 0x7fbef0099a40 2023-10-03T10:13:36.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.495+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbee0017070 con 0x7fbef0099a40 2023-10-03T10:13:36.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.700+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbef0071db0 con 0x7fbef0099a40 2023-10-03T10:13:36.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.701+0000 7fbed7fff700 1 -- 172.21.15.19:0/1551876369 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7fbee001b3b0 con 0x7fbef0099a40 2023-10-03T10:13:36.702 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:36.702 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:31.544969+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 >> v1:172.21.15.19:6816/126819 conn(0x7fbedc02f510 legacy=0x7fbedc0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 msgr2=0x7fbef006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbee000e9e0 tx=0x7fbee000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 shutdown_connections 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbef0131810 0x7fbef0070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbef0099a40 0x7fbef006f610 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 --2- 172.21.15.19:0/1551876369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbef009a3b0 0x7fbef006fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 >> 172.21.15.19:0/1551876369 conn(0x7fbef00a2aa0 msgr2=0x7fbef012e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 shutdown_connections 2023-10-03T10:13:36.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.703+0000 7fbef5f31700 1 -- 172.21.15.19:0/1551876369 wait complete. 2023-10-03T10:13:36.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:13:36.718 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:13:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 Processor -- start 2023-10-03T10:13:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 -- start start 2023-10-03T10:13:36.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4138b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41390a0 0x7f82c413b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82c41301c0 con 0x7f82c41303c0 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c409f620 con 0x7f82c41390a0 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.857+0000 7f82c9e05700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c409e1b0 con 0x7f82c4136780 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41390a0 0x7f82c413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82c41303c0 0x7f82c4130790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49622/0 (socket says 172.21.15.19:49622) 2023-10-03T10:13:36.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c37fe700 1 -- 172.21.15.19:0/3303591010 learned_addr learned my addr 172.21.15.19:0/3303591010 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c27fc700 1 -- 172.21.15.19:0/3303591010 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782383496 0 0) 0x7f82c41301c0 con 0x7f82c41303c0 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c27fc700 1 -- 172.21.15.19:0/3303591010 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82ac0035b0 con 0x7f82c41303c0 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 -- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41390a0 msgr2=0x7f82c413b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41390a0 0x7f82c413b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 -- 172.21.15.19:0/3303591010 >> v1:172.21.15.19:6789/0 conn(0x7f82c41303c0 legacy=0x7f82c4130790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 -- 172.21.15.19:0/3303591010 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82c40a3a60 con 0x7f82c4136780 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.858+0000 7f82c2ffd700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4138b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009870 tx=0x7f82b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd23334c2f85535 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c27fc700 1 -- 172.21.15.19:0/3303591010 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011830 con 0x7f82c4136780 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c27fc700 1 -- 172.21.15.19:0/3303591010 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b8011990 con 0x7f82c4136780 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c27fc700 1 -- 172.21.15.19:0/3303591010 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8011d20 con 0x7f82c4136780 2023-10-03T10:13:36.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 -- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 msgr2=0x7f82c4138b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4138b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009870 tx=0x7f82b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 -- 172.21.15.19:0/3303591010 shutdown_connections 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41390a0 0x7f82c413b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3303591010 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4138b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 -- 172.21.15.19:0/3303591010 >> 172.21.15.19:0/3303591010 conn(0x7f82c4066d70 msgr2=0x7f82c40a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 -- 172.21.15.19:0/3303591010 shutdown_connections 2023-10-03T10:13:36.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.859+0000 7f82c9e05700 1 -- 172.21.15.19:0/3303591010 wait complete. 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.861+0000 7f82c9e05700 1 Processor -- start 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.861+0000 7f82c9e05700 1 -- start start 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.861+0000 7f82c9e05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 0x7f82c4071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c9e05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c9e05700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c41390a0 0x7f82c41c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c9e05700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4133cc0 con 0x7f82c41390a0 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c9e05700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82c40701d0 con 0x7f82c41303c0 2023-10-03T10:13:36.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c9e05700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82c406af30 con 0x7f82c4136780 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 0x7f82c4071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4072000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35182/0 (socket says 172.21.15.19:35182) 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c2ffd700 1 -- 172.21.15.19:0/3597550520 learned_addr learned my addr 172.21.15.19:0/3597550520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c3fff700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c41390a0 0x7f82c41c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 -- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 msgr2=0x7f82c4072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4072000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 -- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c41390a0 msgr2=0x7f82c41c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c41390a0 0x7f82c41c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 -- 172.21.15.19:0/3597550520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80094a0 con 0x7f82c41303c0 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.862+0000 7f82c37fe700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 0x7f82c4071ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c490 tx=0x7f82b400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:36.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.863+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4005d70 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.863+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b40070d0 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.863+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4007440 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.863+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c4071800 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.863+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c4070f00 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.864+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f82b40075a0 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.864+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82c404f2a0 con 0x7f82c41303c0 2023-10-03T10:13:36.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.864+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f82b403ec20 con 0x7f82c41303c0 2023-10-03T10:13:36.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:36.869+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82b4018af0 con 0x7f82c41303c0 2023-10-03T10:13:37.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.071+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82c406c380 con 0x7f82c41303c0 2023-10-03T10:13:37.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.072+0000 7f82abfff700 1 -- 172.21.15.19:0/3597550520 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82b4010300 con 0x7f82c41303c0 2023-10-03T10:13:37.073 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 >> v1:172.21.15.19:6816/126819 conn(0x7f82b002f510 legacy=0x7f82b00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 msgr2=0x7f82c4071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 0x7f82c4071ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c490 tx=0x7f82b400c7a0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 shutdown_connections 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c41390a0 0x7f82c41c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82c41303c0 0x7f82c4071ac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 --2- 172.21.15.19:0/3597550520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82c4136780 0x7f82c4072000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 >> 172.21.15.19:0/3597550520 conn(0x7f82c4066d70 msgr2=0x7f82c4134560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 shutdown_connections 2023-10-03T10:13:37.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.074+0000 7f82c9e05700 1 -- 172.21.15.19:0/3597550520 wait complete. 2023-10-03T10:13:37.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:13:37.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.227+0000 7f95b5665700 1 Processor -- start 2023-10-03T10:13:37.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.227+0000 7f95b5665700 1 -- start start 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.227+0000 7f95b5665700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 0x7f95b00a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.227+0000 7f95b5665700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 0x7f95b00a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95b5665700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b00a1810 con 0x7f95b0133920 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95b5665700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b009ea10 con 0x7f95b009d5c0 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95b5665700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b009e210 con 0x7f95b00a09c0 2023-10-03T10:13:37.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 0x7f95b00a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95aeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 0x7f95b00a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95af7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f95b0133920 0x7f95b0133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49626/0 (socket says 172.21.15.19:49626) 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95af7fe700 1 -- 172.21.15.19:0/2594801425 learned_addr learned my addr 172.21.15.19:0/2594801425 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95adffb700 1 -- 172.21.15.19:0/2594801425 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769787278 0 0) 0x7f95b00a1810 con 0x7f95b0133920 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95adffb700 1 -- 172.21.15.19:0/2594801425 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f959c0035b0 con 0x7f95b0133920 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 msgr2=0x7f95b00a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 0x7f95b00a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2594801425 >> v1:172.21.15.19:6789/0 conn(0x7f95b0133920 legacy=0x7f95b0133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2594801425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00a26f0 con 0x7f95b009d5c0 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95aeffd700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 0x7f95b00a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95ae7fc700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 0x7f95b00a12d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9598009870 tx=0x7f9598009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85de0ba65227a4d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.228+0000 7f95adffb700 1 -- 172.21.15.19:0/2594801425 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011830 con 0x7f95b009d5c0 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95adffb700 1 -- 172.21.15.19:0/2594801425 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598011990 con 0x7f95b009d5c0 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95adffb700 1 -- 172.21.15.19:0/2594801425 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598011d20 con 0x7f95b009d5c0 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 -- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 msgr2=0x7f95b00a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 0x7f95b00a12d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9598009870 tx=0x7f9598009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 -- 172.21.15.19:0/2594801425 shutdown_connections 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b00a09c0 0x7f95b00a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 --2- 172.21.15.19:0/2594801425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b009d5c0 0x7f95b00a12d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 -- 172.21.15.19:0/2594801425 >> 172.21.15.19:0/2594801425 conn(0x7f95b00a2fe0 msgr2=0x7f95b00a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 -- 172.21.15.19:0/2594801425 shutdown_connections 2023-10-03T10:13:37.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.229+0000 7f95b5665700 1 -- 172.21.15.19:0/2594801425 wait complete. 2023-10-03T10:13:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.230+0000 7f95b5665700 1 Processor -- start 2023-10-03T10:13:37.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.230+0000 7f95b5665700 1 -- start start 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 0x7f95b011f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b0133920 0x7f95b01c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0121e90 con 0x7f95b0133920 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b011eec0 con 0x7f95b00a09c0 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95b5665700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0121200 con 0x7f95b009d5c0 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95aeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95ae7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 0x7f95b011f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95aeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35200/0 (socket says 172.21.15.19:35200) 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95aeffd700 1 -- 172.21.15.19:0/2701632585 learned_addr learned my addr 172.21.15.19:0/2701632585 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.231+0000 7f95af7fe700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b0133920 0x7f95b01c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 msgr2=0x7f95b011f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b0133920 msgr2=0x7f95b01c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b0133920 0x7f95b01c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 -- 172.21.15.19:0/2701632585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00094a0 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95aeffd700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95ae7fc700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 0x7f95b011f930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598004450 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959801e070 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95980094a0 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980038e0 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.232+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b0122bc0 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.233+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9598003a40 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.233+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b004f2a0 con 0x7f95b00a09c0 2023-10-03T10:13:37.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.233+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9598020070 con 0x7f95b00a09c0 2023-10-03T10:13:37.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.238+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9598003cf0 con 0x7f95b00a09c0 2023-10-03T10:13:37.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.451+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f95b0072980 con 0x7f95b00a09c0 2023-10-03T10:13:37.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.452+0000 7f95a77fe700 1 -- 172.21.15.19:0/2701632585 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f959802a070 con 0x7f95b00a09c0 2023-10-03T10:13:37.453 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:13:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 >> v1:172.21.15.19:6816/126819 conn(0x7f959002f510 legacy=0x7f95900319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 msgr2=0x7f95b011f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 0x7f95b011f930 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004750 comp rx=0 tx=0).stop 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 shutdown_connections 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95b0133920 0x7f95b01c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95b009d5c0 0x7f95b011f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 --2- 172.21.15.19:0/2701632585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95b00a09c0 0x7f95b011f930 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 >> 172.21.15.19:0/2701632585 conn(0x7f95b00a2fe0 msgr2=0x7f95b01bbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 shutdown_connections 2023-10-03T10:13:37.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.454+0000 7f95b5665700 1 -- 172.21.15.19:0/2701632585 wait complete. 2023-10-03T10:13:37.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:13:37.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.606+0000 7f7243311700 1 Processor -- start 2023-10-03T10:13:37.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 -- start start 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 0x7f723c138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723c09e1f0 con 0x7f723c133cc0 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c0a23b0 con 0x7f723c136c10 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f7243311700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f723c09df30 con 0x7f723c139530 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f72418ae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f72408ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 0x7f723c138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f72410ad700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f723c133cc0 0x7f723c134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49638/0 (socket says 172.21.15.19:49638) 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f72410ad700 1 -- 172.21.15.19:0/3311103945 learned_addr learned my addr 172.21.15.19:0/3311103945 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.607+0000 7f722ffff700 1 -- 172.21.15.19:0/3311103945 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2665703177 0 0) 0x7f723c09e1f0 con 0x7f723c133cc0 2023-10-03T10:13:37.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f722ffff700 1 -- 172.21.15.19:0/3311103945 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72280035b0 con 0x7f723c133cc0 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72408ac700 1 -- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 msgr2=0x7f723c13b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72408ac700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c13b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72408ac700 1 -- 172.21.15.19:0/3311103945 >> v1:172.21.15.19:6789/0 conn(0x7f723c133cc0 legacy=0x7f723c134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72408ac700 1 -- 172.21.15.19:0/3311103945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c09d960 con 0x7f723c136c10 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72418ae700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f72408ac700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 0x7f723c138ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7230009870 tx=0x7f7230009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0cf1dd9b839722 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f722ffff700 1 -- 172.21.15.19:0/3311103945 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230011830 con 0x7f723c136c10 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f722ffff700 1 -- 172.21.15.19:0/3311103945 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230011990 con 0x7f723c136c10 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.608+0000 7f722ffff700 1 -- 172.21.15.19:0/3311103945 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230011d20 con 0x7f723c136c10 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 -- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 msgr2=0x7f723c138ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 0x7f723c138ff0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7230009870 tx=0x7f7230009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 -- 172.21.15.19:0/3311103945 shutdown_connections 2023-10-03T10:13:37.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c13b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 --2- 172.21.15.19:0/3311103945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c136c10 0x7f723c138ff0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 -- 172.21.15.19:0/3311103945 >> 172.21.15.19:0/3311103945 conn(0x7f723c0a3050 msgr2=0x7f723c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 -- 172.21.15.19:0/3311103945 shutdown_connections 2023-10-03T10:13:37.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.609+0000 7f7243311700 1 -- 172.21.15.19:0/3311103945 wait complete. 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.610+0000 7f7243311700 1 Processor -- start 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.610+0000 7f7243311700 1 -- start start 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 0x7f723c11dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c11e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723c09ca70 con 0x7f723c136c10 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c120f30 con 0x7f723c133cc0 2023-10-03T10:13:37.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f7243311700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f723c1209f0 con 0x7f723c139530 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72408ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 0x7f723c11dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72418ae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c11e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53334/0 (socket says 172.21.15.19:53334) 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 -- 172.21.15.19:0/2791830101 learned_addr learned my addr 172.21.15.19:0/2791830101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 -- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 msgr2=0x7f723c11e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c11e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 -- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 msgr2=0x7f723c11dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 0x7f723c11dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 -- 172.21.15.19:0/2791830101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7234009a70 con 0x7f723c133cc0 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72408ac700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 0x7f723c11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.611+0000 7f72410ad700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f723800c730 tx=0x7f723800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.612+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238005d70 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.612+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380070d0 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.612+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7238007460 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.612+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72300094a0 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.612+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723c11fad0 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.613+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f72380075c0 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.613+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f723803f000 con 0x7f723c133cc0 2023-10-03T10:13:37.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.613+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723c121070 con 0x7f723c133cc0 2023-10-03T10:13:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.618+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f723c121070 con 0x7f723c133cc0 2023-10-03T10:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.820+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f723c121070 con 0x7f723c133cc0 2023-10-03T10:13:37.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.820+0000 7f722dffb700 1 -- 172.21.15.19:0/2791830101 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f723c121070 con 0x7f723c133cc0 2023-10-03T10:13:37.822 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:13:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 >> v1:172.21.15.19:6816/126819 conn(0x7f722002f510 legacy=0x7f72200319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 msgr2=0x7f723c11d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f723800c730 tx=0x7f723800ca40 comp rx=0 tx=0).stop 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 shutdown_connections 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723c139530 0x7f723c11e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f723c133cc0 0x7f723c11d6f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 --2- 172.21.15.19:0/2791830101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f723c136c10 0x7f723c11dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 >> 172.21.15.19:0/2791830101 conn(0x7f723c0a3050 msgr2=0x7f723c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 shutdown_connections 2023-10-03T10:13:37.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.822+0000 7f7243311700 1 -- 172.21.15.19:0/2791830101 wait complete. 2023-10-03T10:13:37.836 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:13:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.974+0000 7f58a8032700 1 Processor -- start 2023-10-03T10:13:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.974+0000 7f58a8032700 1 -- start start 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a8032700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 0x7f58a0138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a8032700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 0x7f58a013b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a8032700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a009e1f0 con 0x7f58a0133cc0 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a8032700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00a23b0 con 0x7f58a0136c10 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a8032700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a009df30 con 0x7f58a0139530 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a55cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 0x7f58a0138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a65cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 0x7f58a013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a5dce700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f58a0133cc0 0x7f58a0134090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49644/0 (socket says 172.21.15.19:49644) 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a5dce700 1 -- 172.21.15.19:0/3928328249 learned_addr learned my addr 172.21.15.19:0/3928328249 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a4dcc700 1 -- 172.21.15.19:0/3928328249 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587100184 0 0) 0x7f58a009e1f0 con 0x7f58a0133cc0 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a65cf700 1 -- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 msgr2=0x7f58a0138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a65cf700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 0x7f58a0138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a65cf700 1 -- 172.21.15.19:0/3928328249 >> v1:172.21.15.19:6789/0 conn(0x7f58a0133cc0 legacy=0x7f58a0134090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a65cf700 1 -- 172.21.15.19:0/3928328249 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a009d960 con 0x7f58a0139530 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.975+0000 7f58a55cd700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 0x7f58a0138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a65cf700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 0x7f58a013b910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5898009df0 tx=0x7f589800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd54a2e329d4a1b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a4dcc700 1 -- 172.21.15.19:0/3928328249 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800e070 con 0x7f58a0139530 2023-10-03T10:13:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a4dcc700 1 -- 172.21.15.19:0/3928328249 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589800bae0 con 0x7f58a0139530 2023-10-03T10:13:37.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a4dcc700 1 -- 172.21.15.19:0/3928328249 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589800be90 con 0x7f58a0139530 2023-10-03T10:13:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 -- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 msgr2=0x7f58a013b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 0x7f58a013b910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5898009df0 tx=0x7f589800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:37.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 -- 172.21.15.19:0/3928328249 shutdown_connections 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0139530 0x7f58a013b910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 --2- 172.21.15.19:0/3928328249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0136c10 0x7f58a0138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.976+0000 7f58a8032700 1 -- 172.21.15.19:0/3928328249 >> 172.21.15.19:0/3928328249 conn(0x7f58a00a3050 msgr2=0x7f58a00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.977+0000 7f58a8032700 1 -- 172.21.15.19:0/3928328249 shutdown_connections 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.977+0000 7f58a8032700 1 -- 172.21.15.19:0/3928328249 wait complete. 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.977+0000 7f58a8032700 1 Processor -- start 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 -- start start 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 0x7f58a009a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 0x7f58a009ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00a57b0 con 0x7f58a0136c10 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00a59b0 con 0x7f58a0139530 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a8032700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58a00a50b0 con 0x7f58a0133cc0 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a65cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 0x7f58a009a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a55cd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 0x7f58a009ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a65cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53364/0 (socket says 172.21.15.19:53364) 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a65cf700 1 -- 172.21.15.19:0/3784478380 learned_addr learned my addr 172.21.15.19:0/3784478380 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:37.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 -- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 msgr2=0x7f58a009b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 -- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 msgr2=0x7f58a009ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 0x7f58a009ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a5dce700 1 -- 172.21.15.19:0/3784478380 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58940094a0 con 0x7f58a0133cc0 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a55cd700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 0x7f58a009ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.978+0000 7f58a65cf700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58a5dce700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 0x7f58a009a920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c470 tx=0x7f589c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c004c80 con 0x7f58a0133cc0 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f589c004de0 con 0x7f58a0133cc0 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5898009a70 con 0x7f58a0133cc0 2023-10-03T10:13:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589c007310 con 0x7f58a0133cc0 2023-10-03T10:13:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.979+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a009ca70 con 0x7f58a0133cc0 2023-10-03T10:13:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.980+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a00a1cd0 con 0x7f58a0133cc0 2023-10-03T10:13:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.980+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f589c007470 con 0x7f58a0133cc0 2023-10-03T10:13:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.980+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f589c03fdb0 con 0x7f58a0133cc0 2023-10-03T10:13:37.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:37.985+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f589c007720 con 0x7f58a0133cc0 2023-10-03T10:13:38.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.188+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58a004f2a0 con 0x7f58a0133cc0 2023-10-03T10:13:38.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.189+0000 7f58927fc700 1 -- 172.21.15.19:0/3784478380 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f589c011360 con 0x7f58a0133cc0 2023-10-03T10:13:38.190 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:13:38.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 >> v1:172.21.15.19:6816/126819 conn(0x7f588402f510 legacy=0x7f58840319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 msgr2=0x7f58a009a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 0x7f58a009a920 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f589c00c470 tx=0x7f589c00c780 comp rx=0 tx=0).stop 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 shutdown_connections 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58a0139530 0x7f58a009b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58a0133cc0 0x7f58a009a920 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 --2- 172.21.15.19:0/3784478380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58a0136c10 0x7f58a009ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 >> 172.21.15.19:0/3784478380 conn(0x7f58a00a3050 msgr2=0x7f58a01349b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 shutdown_connections 2023-10-03T10:13:38.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.191+0000 7f58a8032700 1 -- 172.21.15.19:0/3784478380 wait complete. 2023-10-03T10:13:38.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:13:38.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.340+0000 7feb9ee4a700 1 Processor -- start 2023-10-03T10:13:38.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.340+0000 7feb9ee4a700 1 -- start start 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9ee4a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 0x7feb9806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9ee4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 0x7feb98139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9ee4a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9809ece0 con 0x7feb9806b080 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9ee4a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9809e760 con 0x7feb98131d10 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9d3e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 0x7feb98139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb97fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feb9806b080 0x7feb98131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49654/0 (socket says 172.21.15.19:49654) 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb9809e040 con 0x7feb9806a770 2023-10-03T10:13:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb97fff700 1 -- 172.21.15.19:0/2144960183 learned_addr learned my addr 172.21.15.19:0/2144960183 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 0x7feb9806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb977fe700 1 -- 172.21.15.19:0/2144960183 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184003711 0 0) 0x7feb9809ece0 con 0x7feb9806b080 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb977fe700 1 -- 172.21.15.19:0/2144960183 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb840035b0 con 0x7feb9806b080 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 msgr2=0x7feb98139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 0x7feb98139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2144960183 >> v1:172.21.15.19:6789/0 conn(0x7feb9806b080 legacy=0x7feb98131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2144960183 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9809f630 con 0x7feb9806a770 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.341+0000 7feb9d3e7700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 0x7feb98139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 0x7feb9806ab40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15a1fdf825c9a987 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb977fe700 1 -- 172.21.15.19:0/2144960183 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011830 con 0x7feb9806a770 2023-10-03T10:13:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb977fe700 1 -- 172.21.15.19:0/2144960183 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88011990 con 0x7feb9806a770 2023-10-03T10:13:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb977fe700 1 -- 172.21.15.19:0/2144960183 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011d20 con 0x7feb9806a770 2023-10-03T10:13:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 msgr2=0x7feb9806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.342+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 0x7feb9806ab40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb88009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 shutdown_connections 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb98131d10 0x7feb98139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2144960183 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb9806a770 0x7feb9806ab40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 >> 172.21.15.19:0/2144960183 conn(0x7feb98066f50 msgr2=0x7feb9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 shutdown_connections 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.343+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2144960183 wait complete. 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 Processor -- start 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 -- start start 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb9806b080 0x7feb98120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb98131d10 0x7feb98120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98130ea0 con 0x7feb9806b080 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98122050 con 0x7feb9806a770 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9ee4a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb98123920 con 0x7feb98131d10 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9cbe6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9cbe6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53396/0 (socket says 172.21.15.19:53396) 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2127032009 learned_addr learned my addr 172.21.15.19:0/2127032009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.344+0000 7feb9d3e7700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb98131d10 0x7feb98120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb97fff700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb9806b080 0x7feb98120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb98131d10 msgr2=0x7feb98120e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb98131d10 0x7feb98120e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb9806b080 msgr2=0x7feb98120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb9806b080 0x7feb98120930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 -- 172.21.15.19:0/2127032009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90009a70 con 0x7feb9806a770 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9cbe6700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb880090b0 tx=0x7feb88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88004450 con 0x7feb9806a770 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8801f070 con 0x7feb9806a770 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880038e0 con 0x7feb9806a770 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb880094a0 con 0x7feb9806a770 2023-10-03T10:13:38.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.345+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb98071e60 con 0x7feb9806a770 2023-10-03T10:13:38.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.346+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb98074ea0 con 0x7feb9806a770 2023-10-03T10:13:38.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.347+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7feb88003a40 con 0x7feb9806a770 2023-10-03T10:13:38.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.347+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7feb88021070 con 0x7feb9806a770 2023-10-03T10:13:38.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.351+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb88006bd0 con 0x7feb9806a770 2023-10-03T10:13:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.598+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb981246b0 con 0x7feb9806a770 2023-10-03T10:13:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.599+0000 7feb957fa700 1 -- 172.21.15.19:0/2127032009 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2313 (secure 0 0 0) 0x7feb88015020 con 0x7feb9806a770 2023-10-03T10:13:38.600 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:38.600 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:39.450921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:13:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 >> v1:172.21.15.19:6816/126819 conn(0x7feb7802f510 legacy=0x7feb780319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 msgr2=0x7feb981203f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feb880090b0 tx=0x7feb88004750 comp rx=0 tx=0).stop 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 shutdown_connections 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb98131d10 0x7feb98120e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb9806a770 0x7feb981203f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 --2- 172.21.15.19:0/2127032009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb9806b080 0x7feb98120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 >> 172.21.15.19:0/2127032009 conn(0x7feb98066f50 msgr2=0x7feb9806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 shutdown_connections 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.601+0000 7feb9ee4a700 1 -- 172.21.15.19:0/2127032009 wait complete. 2023-10-03T10:13:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2023-10-03T10:13:38.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:38.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.750+0000 7f676ce71700 1 Processor -- start 2023-10-03T10:13:38.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.750+0000 7f676ce71700 1 -- start start 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676ce71700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f676809d6f0 0x7f676809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676ce71700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809e440 0x7f6768134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676ce71700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676809b120 con 0x7f676809e000 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676ce71700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676806b460 con 0x7f676809d6f0 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676ce71700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676809a7e0 con 0x7f676809e440 2023-10-03T10:13:38.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f676809d6f0 0x7f676809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f6766d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809e440 0x7f6768134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f6765d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f676809e000 0x7f67681339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49664/0 (socket says 172.21.15.19:49664) 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f676809d6f0 0x7f676809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44786/0 (socket says 172.21.15.19:44786) 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f6765d9b700 1 -- 172.21.15.19:0/1284532850 learned_addr learned my addr 172.21.15.19:0/1284532850 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 -- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809e440 msgr2=0x7f6768134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 --2- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809e440 0x7f6768134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 -- 172.21.15.19:0/1284532850 >> v1:172.21.15.19:6789/0 conn(0x7f676809e000 legacy=0x7f67681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676559a700 1 -- 172.21.15.19:0/1284532850 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299950789 0 0) 0x7f676809b120 con 0x7f676809e000 2023-10-03T10:13:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.751+0000 7f676659c700 1 -- 172.21.15.19:0/1284532850 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676809a500 con 0x7f676809d6f0 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676659c700 1 --2- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809d6f0 0x7f676809dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6758009870 tx=0x7f6758009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec6434c59c30e9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676559a700 1 -- 172.21.15.19:0/1284532850 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011830 con 0x7f676809d6f0 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676559a700 1 -- 172.21.15.19:0/1284532850 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6758011990 con 0x7f676809d6f0 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676559a700 1 -- 172.21.15.19:0/1284532850 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758011d20 con 0x7f676809d6f0 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 -- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809d6f0 msgr2=0x7f676809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 --2- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809d6f0 0x7f676809dac0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6758009870 tx=0x7f6758009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 -- 172.21.15.19:0/1284532850 shutdown_connections 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 --2- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809e440 0x7f6768134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 --2- 172.21.15.19:0/1284532850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809d6f0 0x7f676809dac0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 -- 172.21.15.19:0/1284532850 >> 172.21.15.19:0/1284532850 conn(0x7f6768066f50 msgr2=0x7f676809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 -- 172.21.15.19:0/1284532850 shutdown_connections 2023-10-03T10:13:38.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.752+0000 7f676ce71700 1 -- 172.21.15.19:0/1284532850 wait complete. 2023-10-03T10:13:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.753+0000 7f676ce71700 1 Processor -- start 2023-10-03T10:13:38.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 -- start start 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 0x7f67681a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f676809e440 0x7f67681a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a6210 con 0x7f676809e000 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a7b80 con 0x7f676809d6f0 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676ce71700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a8200 con 0x7f676809e440 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 0x7f67681a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53412/0 (socket says 172.21.15.19:53412) 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676659c700 1 -- 172.21.15.19:0/893095028 learned_addr learned my addr 172.21.15.19:0/893095028 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6766d9d700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f676809e440 0x7f67681a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 -- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f676809e440 msgr2=0x7f67681a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f676809e440 0x7f67681a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 -- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 msgr2=0x7f67681a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f6765d9b700 1 -- 172.21.15.19:0/893095028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580094a0 con 0x7f676809e000 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.754+0000 7f676659c700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:38.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f6765d9b700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 0x7f67681a4bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f675000c470 tx=0x7f675000c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750004c80 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6750004de0 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67680a2e20 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6750007310 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.755+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681b90b0 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.756+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6750007470 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.756+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f675003f6c0 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.756+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6768074ea0 con 0x7f676809e000 2023-10-03T10:13:38.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.761+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6750007720 con 0x7f676809e000 2023-10-03T10:13:38.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.965+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67681a8910 con 0x7f676809e000 2023-10-03T10:13:38.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.966+0000 7f675effd700 1 -- 172.21.15.19:0/893095028 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+12864 (secure 0 0 0) 0x7f6750011360 con 0x7f676809e000 2023-10-03T10:13:38.968 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:38.968 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":23,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:31.544969+0000","last_up_change":"2023-10-03T10:11:04.773571+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 >> v1:172.21.15.19:6816/126819 conn(0x7f674802f510 legacy=0x7f67480319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 msgr2=0x7f67681a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 0x7f67681a4bd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f675000c470 tx=0x7f675000c780 comp rx=0 tx=0).stop 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 shutdown_connections 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f676809e440 0x7f67681a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f676809d6f0 0x7f67681a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 --2- 172.21.15.19:0/893095028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f676809e000 0x7f67681a4bd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:38.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 >> 172.21.15.19:0/893095028 conn(0x7f6768066f50 msgr2=0x7f67681bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:38.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 shutdown_connections 2023-10-03T10:13:38.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:38.969+0000 7f676ce71700 1 -- 172.21.15.19:0/893095028 wait complete. 2023-10-03T10:13:38.984 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-03T10:13:39.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.118+0000 7f26e5f50700 1 Processor -- start 2023-10-03T10:13:39.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.118+0000 7f26e5f50700 1 -- start start 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26e5f50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 0x7f26e0138c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26e5f50700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 0x7f26e013b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26e5f50700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e006bc00 con 0x7f26e0133a80 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26e5f50700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e006c570 con 0x7f26e0139140 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26e5f50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00a0040 con 0x7f26e0136820 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26df7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f26e0133a80 0x7f26e0133e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49672/0 (socket says 172.21.15.19:49672) 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26df7fe700 1 -- 172.21.15.19:0/3099161036 learned_addr learned my addr 172.21.15.19:0/3099161036 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26dffff700 1 --2- 172.21.15.19:0/3099161036 >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 0x7f26e013b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26deffd700 1 --2- 172.21.15.19:0/3099161036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 0x7f26e0138c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26deffd700 1 -- 172.21.15.19:0/3099161036 >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 msgr2=0x7f26e013b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26deffd700 1 --2- 172.21.15.19:0/3099161036 >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 0x7f26e013b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26deffd700 1 -- 172.21.15.19:0/3099161036 >> v1:172.21.15.19:6789/0 conn(0x7f26e0133a80 legacy=0x7f26e0133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26deffd700 1 -- 172.21.15.19:0/3099161036 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0133860 con 0x7f26e0136820 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26de7fc700 1 -- 172.21.15.19:0/3099161036 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475288831 0 0) 0x7f26e006bc00 con 0x7f26e0133a80 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.119+0000 7f26dffff700 1 --2- 172.21.15.19:0/3099161036 >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 0x7f26e013b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26deffd700 1 --2- 172.21.15.19:0/3099161036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 0x7f26e0138c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009840 tx=0x7f26c8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6618d950ba64b3bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26de7fc700 1 -- 172.21.15.19:0/3099161036 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011830 con 0x7f26e0136820 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26de7fc700 1 -- 172.21.15.19:0/3099161036 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8011990 con 0x7f26e0136820 2023-10-03T10:13:39.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26de7fc700 1 -- 172.21.15.19:0/3099161036 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8011d20 con 0x7f26e0136820 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 -- 172.21.15.19:0/3099161036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 msgr2=0x7f26e0138c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3099161036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 0x7f26e0138c00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009840 tx=0x7f26c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 -- 172.21.15.19:0/3099161036 shutdown_connections 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3099161036 >> v2:172.21.15.19:3300/0 conn(0x7f26e0139140 0x7f26e013b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3099161036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0136820 0x7f26e0138c00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 -- 172.21.15.19:0/3099161036 >> 172.21.15.19:0/3099161036 conn(0x7f26e00a4210 msgr2=0x7f26e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 -- 172.21.15.19:0/3099161036 shutdown_connections 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.120+0000 7f26e5f50700 1 -- 172.21.15.19:0/3099161036 wait complete. 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.121+0000 7f26e5f50700 1 Processor -- start 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 -- start start 2023-10-03T10:13:39.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 0x7f26e009b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 0x7f26e009beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e009dcd0 con 0x7f26e0139140 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01363d0 con 0x7f26e0133a80 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26e5f50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26e009deb0 con 0x7f26e0136820 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35276/0 (socket says 172.21.15.19:35276) 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26df7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 0x7f26e009b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26deffd700 1 -- 172.21.15.19:0/3880488220 learned_addr learned my addr 172.21.15.19:0/3880488220 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.122+0000 7f26dffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 0x7f26e009beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 -- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 msgr2=0x7f26e009b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 -- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 msgr2=0x7f26e009b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 0x7f26e009b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 -- 172.21.15.19:0/3880488220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d8009a70 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26deffd700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26df7fe700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 0x7f26e009b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26dffff700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 0x7f26e009beb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26d800efc0 tx=0x7f26d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800ca90 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d800f040 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c80094a0 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d800ce30 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.123+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e009ca70 con 0x7f26e0139140 2023-10-03T10:13:39.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.124+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f26d8014480 con 0x7f26e0139140 2023-10-03T10:13:39.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.124+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e009db30 con 0x7f26e0139140 2023-10-03T10:13:39.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.124+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f26d8040220 con 0x7f26e0139140 2023-10-03T10:13:39.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.129+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26e009db30 con 0x7f26e0139140 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.374+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26e009db30 con 0x7f26e0139140 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.374+0000 7f26d7fff700 1 -- 172.21.15.19:0/3880488220 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2313 (secure 0 0 0) 0x7f26e009db30 con 0x7f26e0139140 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:39.375 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-03T10:11:13.232209+0000","modified":"2023-10-03T10:11:39.450921+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4189},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4189":{"gid":4189,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.19:6817/497268310","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6817","nonce":497268310}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 >> v1:172.21.15.19:6816/126819 conn(0x7f26c002f510 legacy=0x7f26c00319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 msgr2=0x7f26e009beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 0x7f26e009beb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f26d800efc0 tx=0x7f26d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 shutdown_connections 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26e0139140 0x7f26e009beb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26e0133a80 0x7f26e009b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 --2- 172.21.15.19:0/3880488220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26e0136820 0x7f26e009b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 >> 172.21.15.19:0/3880488220 conn(0x7f26e00a4210 msgr2=0x7f26e00a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 shutdown_connections 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.377+0000 7f26e5f50700 1 -- 172.21.15.19:0/3880488220 wait complete. 2023-10-03T10:13:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2023-10-03T10:13:39.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-03T10:11:13.232209+0000', 'modified': '2023-10-03T10:11:39.450921+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4189}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4189': {'gid': 4189, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.19:6817/497268310', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.19:6817', 'nonce': 497268310}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-03T10:13:39.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-03T10:13:39.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-03T10:13:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.634+0000 7f5d78a6f700 1 Processor -- start 2023-10-03T10:13:39.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.634+0000 7f5d78a6f700 1 -- start start 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d78a6f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 0x7f5d741337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d78a6f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d74134260 0x7f5d741306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d78a6f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7406b990 con 0x7f5d74133e30 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d78a6f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d740a0590 con 0x7f5d74134260 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d78a6f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7409fb80 con 0x7f5d74133420 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 0x7f5d741337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d71d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5d74133e30 0x7f5d7412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49674/0 (socket says 172.21.15.19:49674) 2023-10-03T10:13:39.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d72d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d74134260 0x7f5d741306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.635+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2834820289 learned_addr learned my addr 172.21.15.19:0/2834820289 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7159a700 1 -- 172.21.15.19:0/2834820289 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559608807 0 0) 0x7f5d7406b990 con 0x7f5d74133e30 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7159a700 1 -- 172.21.15.19:0/2834820289 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d5c0035b0 con 0x7f5d74133e30 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d72d9d700 1 -- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 msgr2=0x7f5d741337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 0x7f5d741337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d72d9d700 1 -- 172.21.15.19:0/2834820289 >> v1:172.21.15.19:6789/0 conn(0x7f5d74133e30 legacy=0x7f5d7412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d72d9d700 1 -- 172.21.15.19:0/2834820289 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d740a0030 con 0x7f5d74134260 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 0x7f5d741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d741306a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009d90 tx=0x7f5d6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20a26e188d85bae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7159a700 1 -- 172.21.15.19:0/2834820289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00e070 con 0x7f5d74134260 2023-10-03T10:13:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7159a700 1 -- 172.21.15.19:0/2834820289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c00bb20 con 0x7f5d74134260 2023-10-03T10:13:39.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.636+0000 7f5d7159a700 1 -- 172.21.15.19:0/2834820289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c012430 con 0x7f5d74134260 2023-10-03T10:13:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 -- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 msgr2=0x7f5d741306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d741306a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c009d90 tx=0x7f5d6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 -- 172.21.15.19:0/2834820289 shutdown_connections 2023-10-03T10:13:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d741306a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/2834820289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133420 0x7f5d741337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 -- 172.21.15.19:0/2834820289 >> 172.21.15.19:0/2834820289 conn(0x7f5d740a4210 msgr2=0x7f5d740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 -- 172.21.15.19:0/2834820289 shutdown_connections 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.637+0000 7f5d78a6f700 1 -- 172.21.15.19:0/2834820289 wait complete. 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.638+0000 7f5d78a6f700 1 Processor -- start 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.638+0000 7f5d78a6f700 1 -- start start 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d7409cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d74131470 con 0x7f5d74134260 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d741204b0 con 0x7f5d74133e30 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d78a6f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7409e020 con 0x7f5d74133420 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d7409cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53456/0 (socket says 172.21.15.19:53456) 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35284/0 (socket says 172.21.15.19:35284) 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 -- 172.21.15.19:0/1219870015 learned_addr learned my addr 172.21.15.19:0/1219870015 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 -- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 msgr2=0x7f5d7409c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 -- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 msgr2=0x7f5d7409cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d7409cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 -- 172.21.15.19:0/1219870015 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640094a0 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d7259c700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d7409cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005910 tx=0x7f5d6800c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.639+0000 7f5d62ffd700 1 -- 172.21.15.19:0/1219870015 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68005d70 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.640+0000 7f5d62ffd700 1 -- 172.21.15.19:0/1219870015 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d680070d0 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.640+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c009a70 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.640+0000 7f5d62ffd700 1 -- 172.21.15.19:0/1219870015 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68007460 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.640+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7411fa70 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.640+0000 7f5d62ffd700 1 -- 172.21.15.19:0/1219870015 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5d680075c0 con 0x7f5d74133e30 2023-10-03T10:13:39.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.641+0000 7f5d62ffd700 1 -- 172.21.15.19:0/1219870015 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f5d6803efd0 con 0x7f5d74133e30 2023-10-03T10:13:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.643+0000 7f5d84c12b80 1 Processor -- start 2023-10-03T10:13:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 -- start start 2023-10-03T10:13:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 0x55b4ff9e1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff943c60 con 0x55b4ff9fd100 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff93ea10 con 0x55b4ff9e0c50 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff93c210 con 0x55b4ff9f78f0 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 0x55b4ff9e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44832/0 (socket says 172.21.15.19:44832) 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35292/0 (socket says 172.21.15.19:35292) 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.644+0000 7f5d71d9b700 1 -- 172.21.15.19:0/1098613471 learned_addr learned my addr 172.21.15.19:0/1098613471 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 -- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 msgr2=0x55b4ff9e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 0x55b4ff9e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 -- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 msgr2=0x55b4ff9e1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 -- 172.21.15.19:0/1098613471 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ff72b790 con 0x55b4ff9f78f0 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d7259c700 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 0x55b4ff9e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406e650 tx=0x7f5d6c010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a69ddc4ff1615739 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d53fff700 1 -- 172.21.15.19:0/1098613471 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c012680 con 0x55b4ff9f78f0 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d53fff700 1 -- 172.21.15.19:0/1098613471 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0127e0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.645+0000 7f5d53fff700 1 -- 172.21.15.19:0/1098613471 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c012b50 con 0x55b4ff9f78f0 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 msgr2=0x55b4ff9f7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5d7406e650 tx=0x7f5d6c010000 comp rx=0 tx=0).stop 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- 172.21.15.19:0/1098613471 shutdown_connections 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ff9f7d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9e0c50 0x55b4ff9e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/1098613471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9e1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- 172.21.15.19:0/1098613471 >> 172.21.15.19:0/1098613471 conn(0x55b4ff9e50f0 msgr2=0x55b4ff9e4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- 172.21.15.19:0/1098613471 shutdown_connections 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- 172.21.15.19:0/1098613471 wait complete. 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 -- start start 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.646+0000 7f5d84c12b80 1 Processor -- start 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ff9f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9fa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 0x55b4ff9fa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff937b00 con 0x55b4ff9e0c50 2023-10-03T10:13:39.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff8d3770 con 0x55b4ff9f78f0 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff8f66f0 con 0x55b4ff9fd100 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d84c12b80 10 client.0 _ll_register_callbacks cb 0x55b4ff73f5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 0x55b4ff9fa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9fa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 0x55b4ff9fa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35298/0 (socket says 172.21.15.19:35298) 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.647+0000 7f5d72d9d700 1 -- 172.21.15.19:0/2553630487 learned_addr learned my addr 172.21.15.19:0/2553630487 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ff9f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 msgr2=0x55b4ff9fa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 0x55b4ff9fa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 msgr2=0x55b4ff9f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ff9f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2553630487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7411fa70 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ff9f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9fa3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005f70 tx=0x7f5d68001150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=186ae96c445a5990 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.19:3301/0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68011360 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mon.1 v2:172.21.15.19:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f5d680339b0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4ff9d92b0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d68033bb0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 10 client.14362 fetch_fsmap learned FSMap version 8 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x7f5d740a0030 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mon.1 v2:172.21.15.19:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b4ff9d92b0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mon.1 v2:172.21.15.19:3301/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f5d68033d10 con 0x55b4ff9f78f0 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 10 client.14362 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 10 client.14362 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 20 client.14362 populate_metadata read hostname 'smithi019' 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 4 client.14362 mds_command: new command op to 4189 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.648+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b4ff9b5f40 con 0x55b4ffa1a140 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.649+0000 7f5d517fa700 10 client.14362 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.649+0000 7f5d517fa700 1 -- 172.21.15.19:0/2553630487 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (unknown 0 0 3608088055) 0x55b4ff9b5f40 con 0x55b4ffa1a140 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.649+0000 7f5d517fa700 10 client.14362 handle_command_reply: tid=0 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.649+0000 7f5d84c12b80 1 client.14362 shutdown 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 msgr2=0x55b4ff9fa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9fa3a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005f70 tx=0x7f5d68001150 comp rx=0 tx=0).stop 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 shutdown_connections 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9fd100 0x55b4ff9fa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ff9f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2553630487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9fa3a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d517fa700 0 client.14362 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 >> 172.21.15.19:0/2553630487 conn(0x55b4ff9e50f0 msgr2=0x55b4ff9e1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 shutdown_connections 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2553630487 wait complete. 2023-10-03T10:13:39.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.650+0000 7f5d84c12b80 20 client.14362 trim_cache size 0 max 16384 2023-10-03T10:13:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.668+0000 7f5d84c12b80 1 Processor -- start 2023-10-03T10:13:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.668+0000 7f5d84c12b80 1 -- start start 2023-10-03T10:13:39.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9f8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ffa01d60 con 0x55b4ff9fd100 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff72c390 con 0x55b4ff9f78f0 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b4ff9e1020 con 0x55b4ff9e0c50 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35312/0 (socket says 172.21.15.19:35312) 2023-10-03T10:13:39.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 -- 172.21.15.19:0/2975304168 learned_addr learned my addr 172.21.15.19:0/2975304168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 -- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 msgr2=0x55b4ff9f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 -- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 msgr2=0x55b4ff9f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9f8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 -- 172.21.15.19:0/2975304168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4ff8180a0 con 0x55b4ff9e0c50 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d72d9d700 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d640148f0 tx=0x7f5d64009210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0d07601a8e5a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d60ff9700 1 -- 172.21.15.19:0/2975304168 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6401b070 con 0x55b4ff9e0c50 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d60ff9700 1 -- 172.21.15.19:0/2975304168 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d640166b0 con 0x55b4ff9e0c50 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.669+0000 7f5d60ff9700 1 -- 172.21.15.19:0/2975304168 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64016840 con 0x55b4ff9e0c50 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 msgr2=0x55b4ff9e38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d640148f0 tx=0x7f5d64009210 comp rx=0 tx=0).stop 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2975304168 shutdown_connections 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9fd100 0x55b4ff9f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9e0c50 0x55b4ff9e38d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2975304168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9f78f0 0x55b4ff9f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2975304168 >> 172.21.15.19:0/2975304168 conn(0x55b4ff9e50f0 msgr2=0x55b4ff9fae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2975304168 shutdown_connections 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.670+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2975304168 wait complete. 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 -- start start 2023-10-03T10:13:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 Processor -- start 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ffa66130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9fd100 0x55b4ffa66670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4ffa0a4e0 con 0x55b4ff9e0c50 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b4ffa01600 con 0x55b4ff9fd100 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x55b4ffa49e90 con 0x55b4ff9f78f0 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d84c12b80 10 client.0 _ll_register_callbacks cb 0x7f5d68007870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-03T10:13:39.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ffa66130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d72d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9fd100 0x55b4ffa66670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d7259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44870/0 (socket says 172.21.15.19:44870) 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.671+0000 7f5d7259c700 1 -- 172.21.15.19:0/2546557000 learned_addr learned my addr 172.21.15.19:0/2546557000 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9fd100 msgr2=0x55b4ffa66670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9fd100 0x55b4ffa66670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 msgr2=0x55b4ffa0a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 -- 172.21.15.19:0/2546557000 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d740a0030 con 0x55b4ff9f78f0 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d7259c700 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d71d9b700 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ffa66130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800f420 tx=0x7f5d68007000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fce8d8c84258b0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d517fa700 10 client.0 ms_handle_connect on v2:172.21.15.19:3302/0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68032240 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mon.2 v2:172.21.15.19:3302/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f5d680323a0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d6c0127e0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d68032560 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d84c12b80 10 client.14363 fetch_fsmap learned FSMap version 8 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.672+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=3+}) v3 -- 0x55b4ff72b790 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mon.2 v2:172.21.15.19:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0127e0 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mon.2 v2:172.21.15.19:3302/0 5 ==== fsmap(e 8) v1 ==== 1436+0+0 (secure 0 0 0) 0x7f5d6804a070 con 0x55b4ff9f78f0 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 10 client.14363 fetch_fsmap finished waiting for FSMap version 8 2023-10-03T10:13:39.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 10 client.14363 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 20 client.14363 populate_metadata read hostname 'smithi019' 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 4 client.14363 mds_command: new command op to 4189 tid=0[{"prefix": "status"}] 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 --> v1:172.21.15.19:6817/497268310 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b4ff930ce0 con 0x55b4ffa66ca0 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d517fa700 10 client.14363 ms_handle_connect on v1:172.21.15.19:6817/497268310 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d517fa700 1 -- 172.21.15.19:0/2546557000 <== mds.0 v1:172.21.15.19:6817/497268310 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (unknown 0 0 3831562600) 0x55b4ff930ce0 con 0x55b4ffa66ca0 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d517fa700 10 client.14363 handle_command_reply: tid=0 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.673+0000 7f5d84c12b80 1 client.14363 shutdown 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 msgr2=0x55b4ffa66130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ffa66130 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800f420 tx=0x7f5d68007000 comp rx=0 tx=0).stop 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 shutdown_connections 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55b4ff9fd100 0x55b4ffa66670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b4ff9e0c50 0x55b4ffa0a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 --2- 172.21.15.19:0/2546557000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x55b4ff9f78f0 0x55b4ffa66130 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d517fa700 0 client.14363 ms_handle_reset on v1:172.21.15.19:6817/497268310 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 >> 172.21.15.19:0/2546557000 conn(0x55b4ff9e50f0 msgr2=0x55b4ff9f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 shutdown_connections 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 1 -- 172.21.15.19:0/2546557000 wait complete. 2023-10-03T10:13:39.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d84c12b80 20 client.14363 trim_cache size 0 max 16384 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "7e072252-f281-43a7-ab05-1896c0d28d72", 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 4189, 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 146.43856145699999, 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 8, 2023-10-03T10:13:39.683 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 23, 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 18, 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 151.75868405 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 >> v1:172.21.15.19:6816/126819 conn(0x7f5d5402f510 legacy=0x7f5d540319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 msgr2=0x7f5d7409c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.674+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005910 tx=0x7f5d6800c9e0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 shutdown_connections 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d74134260 0x7f5d7409cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d74133420 0x7f5d7409c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 --2- 172.21.15.19:0/1219870015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d74133e30 0x7f5d7409c9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 >> 172.21.15.19:0/1219870015 conn(0x7f5d740a4210 msgr2=0x7f5d74130350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 shutdown_connections 2023-10-03T10:13:39.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.675+0000 7f5d78a6f700 1 -- 172.21.15.19:0/1219870015 wait complete. 2023-10-03T10:13:39.689 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:13:39.699 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:13:39.699 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:39.727 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:13:39.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2023-10-03T10:13:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.908+0000 7f9a3af17700 1 Processor -- start 2023-10-03T10:13:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.908+0000 7f9a3af17700 1 -- start start 2023-10-03T10:13:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.908+0000 7f9a3af17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.908+0000 7f9a3af17700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 0x7f9a34139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.908+0000 7f9a3af17700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a34071a00 con 0x7f9a34131630 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a3af17700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34131430 con 0x7f9a34136f50 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a3af17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3409a510 con 0x7f9a34134630 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 0x7f9a34139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a38cb3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9a34131630 0x7f9a34131a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49690/0 (socket says 172.21.15.19:49690) 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a38cb3700 1 -- 172.21.15.19:0/1130389432 learned_addr learned my addr 172.21.15.19:0/1130389432 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a33fff700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 -- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 msgr2=0x7f9a34136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 -- 172.21.15.19:0/1130389432 >> v1:172.21.15.19:6789/0 conn(0x7f9a34131630 legacy=0x7f9a34131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a337fe700 1 -- 172.21.15.19:0/1130389432 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506648865 0 0) 0x7f9a34071a00 con 0x7f9a34131630 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 -- 172.21.15.19:0/1130389432 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a340721c0 con 0x7f9a34136f50 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a33fff700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a394b4700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 0x7f9a34139330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009dc0 tx=0x7f9a2c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1637b982f044bad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a337fe700 1 -- 172.21.15.19:0/1130389432 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00e070 con 0x7f9a34136f50 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a337fe700 1 -- 172.21.15.19:0/1130389432 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00bb20 con 0x7f9a34136f50 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.909+0000 7f9a337fe700 1 -- 172.21.15.19:0/1130389432 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c012430 con 0x7f9a34136f50 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 -- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 msgr2=0x7f9a34139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 0x7f9a34139330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009dc0 tx=0x7f9a2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:13:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 -- 172.21.15.19:0/1130389432 shutdown_connections 2023-10-03T10:13:39.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34136f50 0x7f9a34139330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 --2- 172.21.15.19:0/1130389432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 -- 172.21.15.19:0/1130389432 >> 172.21.15.19:0/1130389432 conn(0x7f9a340a2aa0 msgr2=0x7f9a340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:39.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 -- 172.21.15.19:0/1130389432 shutdown_connections 2023-10-03T10:13:39.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.910+0000 7f9a3af17700 1 -- 172.21.15.19:0/1130389432 wait complete. 2023-10-03T10:13:39.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.911+0000 7f9a3af17700 1 Processor -- start 2023-10-03T10:13:39.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.911+0000 7f9a3af17700 1 -- start start 2023-10-03T10:13:39.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 0x7f9a34118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 0x7f9a34119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3411c280 con 0x7f9a34136f50 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34099f20 con 0x7f9a34131630 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a3af17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3411a610 con 0x7f9a34134630 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a38cb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 0x7f9a34118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a394b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 0x7f9a34119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35338/0 (socket says 172.21.15.19:35338) 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a394b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 0x7f9a34119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44880/0 (socket says 172.21.15.19:44880) 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a38cb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 0x7f9a34118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53516/0 (socket says 172.21.15.19:53516) 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 -- 172.21.15.19:0/893712654 learned_addr learned my addr 172.21.15.19:0/893712654 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 -- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 msgr2=0x7f9a34118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 0x7f9a34118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 -- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 msgr2=0x7f9a34119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 0x7f9a34119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 -- 172.21.15.19:0/893712654 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c0094a0 con 0x7f9a34134630 2023-10-03T10:13:39.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a33fff700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00ebe0 tx=0x7f9a1c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.912+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00c850 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1c00c9b0 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c009a70 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1c00cd40 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3411ad60 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9a1c013470 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.913+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3411cd40 con 0x7f9a34134630 2023-10-03T10:13:39.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.914+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f9a1c03fc40 con 0x7f9a34134630 2023-10-03T10:13:39.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:39.919+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a1c013720 con 0x7f9a34134630 2023-10-03T10:13:40.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.136+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7f9a3411beb0 con 0x7f9a34134630 2023-10-03T10:13:40.137 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-10-03T10:13:40.137+0000 7efd42cf8700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2023-10-03T10:13:40.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.481+0000 7f9a317fa700 1 -- 172.21.15.19:0/893712654 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7f9a1c021070 con 0x7f9a34134630 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.485+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 >> v1:172.21.15.19:6816/126819 conn(0x7f9a1402f540 legacy=0x7f9a140319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.485+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 msgr2=0x7f9a34119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.485+0000 7f9a3af17700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00ebe0 tx=0x7f9a1c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.486+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 shutdown_connections 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.486+0000 7f9a3af17700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a34136f50 0x7f9a34119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.486+0000 7f9a3af17700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a34131630 0x7f9a34118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.486+0000 7f9a3af17700 1 --2- 172.21.15.19:0/893712654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a34134630 0x7f9a34119210 secure :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c00ebe0 tx=0x7f9a1c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.486+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 >> 172.21.15.19:0/893712654 conn(0x7f9a340a2aa0 msgr2=0x7f9a340a08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.487+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 shutdown_connections 2023-10-03T10:13:40.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.487+0000 7f9a3af17700 1 -- 172.21.15.19:0/893712654 wait complete. 2023-10-03T10:13:40.489 INFO:teuthology.orchestra.run.smithi019.stderr:marked down osd.0. 2023-10-03T10:13:40.505 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-03T10:13:40.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-03T10:13:40.507 INFO:tasks.ceph.osd.0:Started 2023-10-03T10:13:40.507 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:13:40.508 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:40.542 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:13:40.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2023-10-03T10:13:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.718+0000 7fef67e57700 1 Processor -- start 2023-10-03T10:13:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.718+0000 7fef67e57700 1 -- start start 2023-10-03T10:13:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef60133fa0 0x7fef60134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6009edd0 con 0x7fef60133fa0 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6009e1f0 con 0x7fef600a0a30 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef67e57700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6009dc50 con 0x7fef600a1340 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef65bf3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef653f2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef60133fa0 0x7fef60134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef65bf3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53528/0 (socket says 172.21.15.19:53528) 2023-10-03T10:13:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef60133fa0 0x7fef60134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44892/0 (socket says 172.21.15.19:44892) 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef653f2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35364/0 (socket says 172.21.15.19:35364) 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef65bf3700 1 -- 172.21.15.19:0/2428028367 learned_addr learned my addr 172.21.15.19:0/2428028367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 -- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 msgr2=0x7fef60133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 -- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 msgr2=0x7fef600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 -- 172.21.15.19:0/2428028367 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600a1fe0 con 0x7fef60133fa0 2023-10-03T10:13:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef653f2700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef65bf3700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.719+0000 7fef663f4700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef60133fa0 0x7fef60134410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef58009d90 tx=0x7fef5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aeffbd1b73bae66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef64bf1700 1 -- 172.21.15.19:0/2428028367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800e070 con 0x7fef60133fa0 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef64bf1700 1 -- 172.21.15.19:0/2428028367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800bb20 con 0x7fef60133fa0 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef64bf1700 1 -- 172.21.15.19:0/2428028367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef58012430 con 0x7fef60133fa0 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 -- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef60133fa0 msgr2=0x7fef60134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef60133fa0 0x7fef60134410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fef58009d90 tx=0x7fef5800b330 comp rx=0 tx=0).stop 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 -- 172.21.15.19:0/2428028367 shutdown_connections 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef600a0a30 0x7fef600a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef60133fa0 0x7fef60134410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 --2- 172.21.15.19:0/2428028367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a1340 0x7fef60133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 -- 172.21.15.19:0/2428028367 >> 172.21.15.19:0/2428028367 conn(0x7fef600a6550 msgr2=0x7fef600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 -- 172.21.15.19:0/2428028367 shutdown_connections 2023-10-03T10:13:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.720+0000 7fef67e57700 1 -- 172.21.15.19:0/2428028367 wait complete. 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.721+0000 7fef67e57700 1 Processor -- start 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.721+0000 7fef67e57700 1 -- start start 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef600a1340 0x7fef60120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef60133fa0 0x7fef60120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef60123480 con 0x7fef600a1340 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef601245b0 con 0x7fef60133fa0 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef67e57700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef60121dd0 con 0x7fef600a0a30 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35376/0 (socket says 172.21.15.19:35376) 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 -- 172.21.15.19:0/4224617609 learned_addr learned my addr 172.21.15.19:0/4224617609 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef663f4700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef60133fa0 0x7fef60120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef653f2700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef600a1340 0x7fef60120680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 -- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef60133fa0 msgr2=0x7fef60120bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef60133fa0 0x7fef60120bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 -- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef600a1340 msgr2=0x7fef60120680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef600a1340 0x7fef60120680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.722+0000 7fef65bf3700 1 -- 172.21.15.19:0/4224617609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef54009550 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef65bf3700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef5400ec10 tx=0x7fef5400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400c7f0 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5400c950 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5c0094a0 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5400cce0 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef58009a70 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.723+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fef54013470 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.724+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fef5403fe20 con 0x7fef600a0a30 2023-10-03T10:13:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.724+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef600a0220 con 0x7fef600a0a30 2023-10-03T10:13:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.729+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef54021020 con 0x7fef600a0a30 2023-10-03T10:13:40.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:40.942+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fef60074ea0 con 0x7fef600a0a30 2023-10-03T10:13:40.943 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-10-03T10:13:40.942+0000 7efd42cf8700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2023-10-03T10:13:41.117 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:13:41.116+0000 7f9756414680 -1 Falling back to public interface 2023-10-03T10:13:41.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.484+0000 7fef527fc700 1 -- 172.21.15.19:0/4224617609 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fef54013720 con 0x7fef600a0a30 2023-10-03T10:13:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 >> v1:172.21.15.19:6816/126819 conn(0x7fef4402f510 legacy=0x7fef440319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 msgr2=0x7fef60120140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fef5400ec10 tx=0x7fef5400ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 shutdown_connections 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef60133fa0 0x7fef60120bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef600a0a30 0x7fef60120140 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 --2- 172.21.15.19:0/4224617609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef600a1340 0x7fef60120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.488+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 >> 172.21.15.19:0/4224617609 conn(0x7fef600a6550 msgr2=0x7fef601bb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.489+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 shutdown_connections 2023-10-03T10:13:41.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.489+0000 7fef67e57700 1 -- 172.21.15.19:0/4224617609 wait complete. 2023-10-03T10:13:41.493 INFO:teuthology.orchestra.run.smithi019.stderr:marked down osd.1. 2023-10-03T10:13:41.510 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-03T10:13:41.510 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-03T10:13:41.512 INFO:tasks.ceph.osd.1:Started 2023-10-03T10:13:41.513 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:13:41.513 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:41.551 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:13:41.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2023-10-03T10:13:41.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.726+0000 7efe33ea7700 1 Processor -- start 2023-10-03T10:13:41.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 -- start start 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c09f130 con 0x7efe2c09e000 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c09f520 con 0x7efe2c09d6f0 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe33ea7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c09e930 con 0x7efe2c09e410 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe31c43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe32444700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe31c43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53546/0 (socket says 172.21.15.19:53546) 2023-10-03T10:13:41.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.727+0000 7efe31c43700 1 -- 172.21.15.19:0/2935665502 learned_addr learned my addr 172.21.15.19:0/2935665502 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe32444700 1 -- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 msgr2=0x7efe2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe32444700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe32444700 1 -- 172.21.15.19:0/2935665502 >> v1:172.21.15.19:6789/0 conn(0x7efe2c09e000 legacy=0x7efe2c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe30c41700 1 -- 172.21.15.19:0/2935665502 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149547986 0 0) 0x7efe2c09f130 con 0x7efe2c09e000 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe32444700 1 -- 172.21.15.19:0/2935665502 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c09b2d0 con 0x7efe2c09e410 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe31c43700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe32444700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c130d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe24009dc0 tx=0x7efe2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69499b2b99afd151 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe30c41700 1 -- 172.21.15.19:0/2935665502 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400e070 con 0x7efe2c09e410 2023-10-03T10:13:41.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe30c41700 1 -- 172.21.15.19:0/2935665502 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400bb20 con 0x7efe2c09e410 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.728+0000 7efe30c41700 1 -- 172.21.15.19:0/2935665502 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24012430 con 0x7efe2c09e410 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 -- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 msgr2=0x7efe2c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c130d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe24009dc0 tx=0x7efe2400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 -- 172.21.15.19:0/2935665502 shutdown_connections 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c130d70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2935665502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6f0 0x7efe2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 -- 172.21.15.19:0/2935665502 >> 172.21.15.19:0/2935665502 conn(0x7efe2c066f50 msgr2=0x7efe2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 -- 172.21.15.19:0/2935665502 shutdown_connections 2023-10-03T10:13:41.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.729+0000 7efe33ea7700 1 -- 172.21.15.19:0/2935665502 wait complete. 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 Processor -- start 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 -- start start 2023-10-03T10:13:41.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 0x7efe2c1201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 0x7efe2c1206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c122390 con 0x7efe2c09d6f0 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c09c700 con 0x7efe2c09e000 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe33ea7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0a1b80 con 0x7efe2c09e410 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe31c43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 0x7efe2c1201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe31442700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 0x7efe2c1206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe31c43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 0x7efe2c1201b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44918/0 (socket says 172.21.15.19:44918) 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.730+0000 7efe31c43700 1 -- 172.21.15.19:0/2638694755 learned_addr learned my addr 172.21.15.19:0/2638694755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe32444700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:41.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 -- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 msgr2=0x7efe2c120c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c120c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 -- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 msgr2=0x7efe2c1201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 0x7efe2c1201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 -- 172.21.15.19:0/2638694755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28009550 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe31442700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 0x7efe2c1206f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0a3e20 tx=0x7efe1c00c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0054e0 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00ce10 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24009a70 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0038c0 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.731+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c122560 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.732+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efe1c003a20 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.732+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4020+0+0 (secure 0 0 0) 0x7efe1c03eee0 con 0x7efe2c09e000 2023-10-03T10:13:41.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.732+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c123640 con 0x7efe2c09e000 2023-10-03T10:13:41.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.738+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe2c123640 con 0x7efe2c09e000 2023-10-03T10:13:41.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:41.953+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7efe2c123640 con 0x7efe2c09e000 2023-10-03T10:13:41.954 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-10-03T10:13:41.953+0000 7efd42cf8700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2023-10-03T10:13:42.116 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:13:42.115+0000 7f1eead36680 -1 Falling back to public interface 2023-10-03T10:13:42.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.491+0000 7efe227fc700 1 -- 172.21.15.19:0/2638694755 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7efe2c123640 con 0x7efe2c09e000 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 >> v1:172.21.15.19:6816/126819 conn(0x7efe1002f510 legacy=0x7efe100319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 msgr2=0x7efe2c1206f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 0x7efe2c1206f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0a3e20 tx=0x7efe1c00c710 comp rx=0 tx=0).stop 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 shutdown_connections 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c09e410 0x7efe2c120c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09d6f0 0x7efe2c1201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 --2- 172.21.15.19:0/2638694755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09e000 0x7efe2c1206f0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0a3e20 tx=0x7efe1c00c710 comp rx=0 tx=0).stop 2023-10-03T10:13:42.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.496+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 >> 172.21.15.19:0/2638694755 conn(0x7efe2c066f50 msgr2=0x7efe2c071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.497+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 shutdown_connections 2023-10-03T10:13:42.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.497+0000 7efe33ea7700 1 -- 172.21.15.19:0/2638694755 wait complete. 2023-10-03T10:13:42.499 INFO:teuthology.orchestra.run.smithi019.stderr:marked down osd.2. 2023-10-03T10:13:42.515 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-03T10:13:42.516 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-03T10:13:42.518 INFO:tasks.ceph.osd.2:Started 2023-10-03T10:13:42.518 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:13:42.518 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:42.557 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:13:42.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2023-10-03T10:13:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.734+0000 7fbfe8cf8700 1 Processor -- start 2023-10-03T10:13:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.734+0000 7fbfe8cf8700 1 -- start start 2023-10-03T10:13:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe8cf8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 0x7fbfe4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe8cf8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 0x7fbfe41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe8cf8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfe4070940 con 0x7fbfe409e930 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe8cf8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe406fd60 con 0x7fbfe4136fe0 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe8cf8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe406fa80 con 0x7fbfe409f410 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 0x7fbfe4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 0x7fbfe41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbfe409e930 0x7fbfe409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49736/0 (socket says 172.21.15.19:49736) 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe259c700 1 -- 172.21.15.19:0/841976970 learned_addr learned my addr 172.21.15.19:0/841976970 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe159a700 1 -- 172.21.15.19:0/841976970 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172376314 0 0) 0x7fbfe4070940 con 0x7fbfe409e930 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 msgr2=0x7fbfe41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 0x7fbfe41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/841976970 >> v1:172.21.15.19:6789/0 conn(0x7fbfe409e930 legacy=0x7fbfe409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/841976970 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe409fb60 con 0x7fbfe409f410 2023-10-03T10:13:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe2d9d700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 0x7fbfe41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe1d9b700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 0x7fbfe4136aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009870 tx=0x7fbfd8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ba546dfd10ce3d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe159a700 1 -- 172.21.15.19:0/841976970 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8011830 con 0x7fbfe409f410 2023-10-03T10:13:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe159a700 1 -- 172.21.15.19:0/841976970 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8011990 con 0x7fbfe409f410 2023-10-03T10:13:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.735+0000 7fbfe159a700 1 -- 172.21.15.19:0/841976970 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8011d20 con 0x7fbfe409f410 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 msgr2=0x7fbfe4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 0x7fbfe4136aa0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009870 tx=0x7fbfd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/841976970 shutdown_connections 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe4136fe0 0x7fbfe41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/841976970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe409f410 0x7fbfe4136aa0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/841976970 >> 172.21.15.19:0/841976970 conn(0x7fbfe40a4210 msgr2=0x7fbfe40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/841976970 shutdown_connections 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.736+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/841976970 wait complete. 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.737+0000 7fbfe8cf8700 1 Processor -- start 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.737+0000 7fbfe8cf8700 1 -- start start 2023-10-03T10:13:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe4136fe0 0x7fbfe406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4071d90 con 0x7fbfe409e930 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe406d640 con 0x7fbfe409f410 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe8cf8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbfe4134660 con 0x7fbfe4136fe0 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53594/0 (socket says 172.21.15.19:53594) 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44936/0 (socket says 172.21.15.19:44936) 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/828905683 learned_addr learned my addr 172.21.15.19:0/828905683 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe2d9d700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe4136fe0 0x7fbfe406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe4136fe0 msgr2=0x7fbfe406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe4136fe0 0x7fbfe406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 msgr2=0x7fbfe406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe1d9b700 1 -- 172.21.15.19:0/828905683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc009a70 con 0x7fbfe409f410 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.738+0000 7fbfe259c700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfe1d9b700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009840 tx=0x7fbfd8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8004510 con 0x7fbfe409f410 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd801f070 con 0x7fbfe409f410 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd80094a0 con 0x7fbfe409f410 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80038e0 con 0x7fbfe409f410 2023-10-03T10:13:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.739+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfe41341f0 con 0x7fbfe409f410 2023-10-03T10:13:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.740+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fbfd8003a40 con 0x7fbfe409f410 2023-10-03T10:13:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.740+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fbfd8021070 con 0x7fbfe409f410 2023-10-03T10:13:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.740+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfe4074ea0 con 0x7fbfe409f410 2023-10-03T10:13:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.745+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbfd803fe60 con 0x7fbfe409f410 2023-10-03T10:13:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:42.956+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7fbfe4122ae0 con 0x7fbfe409f410 2023-10-03T10:13:42.958 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-10-03T10:13:42.957+0000 7efd42cf8700 -1 mon.a@0(leader).osd e26 definitely_dead 0 2023-10-03T10:13:43.119 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:13:43.119+0000 7f2ada231680 -1 Falling back to public interface 2023-10-03T10:13:43.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.507+0000 7fbfd2ffd700 1 -- 172.21.15.19:0/828905683 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v27) v1 ==== 89+0+0 (secure 0 0 0) 0x7fbfd8015030 con 0x7fbfe409f410 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 >> v1:172.21.15.19:6816/126819 conn(0x7fbfc402f510 legacy=0x7fbfc40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 msgr2=0x7fbfe406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009840 tx=0x7fbfd8004750 comp rx=0 tx=0).stop 2023-10-03T10:13:43.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 shutdown_connections 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbfe4136fe0 0x7fbfe406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfe409e930 0x7fbfe406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 --2- 172.21.15.19:0/828905683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbfe409f410 0x7fbfe406bdf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 >> 172.21.15.19:0/828905683 conn(0x7fbfe40a4210 msgr2=0x7fbfe4134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 shutdown_connections 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.509+0000 7fbfe8cf8700 1 -- 172.21.15.19:0/828905683 wait complete. 2023-10-03T10:13:43.511 INFO:teuthology.orchestra.run.smithi019.stderr:marked down osd.3. 2023-10-03T10:13:43.525 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-03T10:13:43.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-03T10:13:43.527 INFO:tasks.ceph.osd.3:Started 2023-10-03T10:13:43.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:13:43.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:43.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.667+0000 7fe27b27c700 1 Processor -- start 2023-10-03T10:13:43.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.667+0000 7fe27b27c700 1 -- start start 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 0x7fe274137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 0x7fe27413a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27406bd70 con 0x7fe27409f0f0 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27406cc30 con 0x7fe27409e7e0 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe27b27c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe27406d870 con 0x7fe274137ff0 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279819700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 0x7fe27413a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe278817700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 0x7fe274137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53608/0 (socket says 172.21.15.19:53608) 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279819700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 0x7fe27413a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35424/0 (socket says 172.21.15.19:35424) 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 -- 172.21.15.19:0/1724260452 learned_addr learned my addr 172.21.15.19:0/1724260452 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 -- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 msgr2=0x7fe27413a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 --2- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 0x7fe27413a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 -- 172.21.15.19:0/1724260452 >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 msgr2=0x7fe274137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 --2- 172.21.15.19:0/1724260452 >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 0x7fe274137ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe279018700 1 -- 172.21.15.19:0/1724260452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27406bab0 con 0x7fe27409e7e0 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.668+0000 7fe278817700 1 --2- 172.21.15.19:0/1724260452 >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 0x7fe274137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe279018700 1 --2- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe2700098f0 tx=0x7fe270009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7af54ce391426aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe267fff700 1 -- 172.21.15.19:0/1724260452 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011830 con 0x7fe27409e7e0 2023-10-03T10:13:43.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe267fff700 1 -- 172.21.15.19:0/1724260452 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe270011990 con 0x7fe27409e7e0 2023-10-03T10:13:43.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe267fff700 1 -- 172.21.15.19:0/1724260452 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270011d20 con 0x7fe27409e7e0 2023-10-03T10:13:43.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 -- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 msgr2=0x7fe27409ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe2700098f0 tx=0x7fe270009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 -- 172.21.15.19:0/1724260452 shutdown_connections 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27409ebb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1724260452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe274137ff0 0x7fe27413a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1724260452 >> v2:172.21.15.19:3300/0 conn(0x7fe27409f0f0 0x7fe274137ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.669+0000 7fe27b27c700 1 -- 172.21.15.19:0/1724260452 >> 172.21.15.19:0/1724260452 conn(0x7fe2740a4300 msgr2=0x7fe2740a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.670+0000 7fe27b27c700 1 -- 172.21.15.19:0/1724260452 shutdown_connections 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.670+0000 7fe27b27c700 1 -- 172.21.15.19:0/1724260452 wait complete. 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.670+0000 7fe27b27c700 1 Processor -- start 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 -- start start 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe27409f0f0 0x7fe27411fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe274137ff0 0x7fe2741203e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2741216f0 con 0x7fe274137ff0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2740a3b60 con 0x7fe27409e7e0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe27b27c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe274122ee0 con 0x7fe27409f0f0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53614/0 (socket says 172.21.15.19:53614) 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 -- 172.21.15.19:0/1772877475 learned_addr learned my addr 172.21.15.19:0/1772877475 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279819700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe274137ff0 0x7fe2741203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe278817700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe27409f0f0 0x7fe27411fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 -- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe27409f0f0 msgr2=0x7fe27411fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe27409f0f0 0x7fe27411fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 -- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe274137ff0 msgr2=0x7fe2741203e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe274137ff0 0x7fe2741203e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.671+0000 7fe279018700 1 -- 172.21.15.19:0/1772877475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2680094a0 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe279018700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe270004450 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2700045b0 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270009550 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2700038e0 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.672+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe274134410 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.673+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe270021070 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.673+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fe2700411a0 con 0x7fe27409e7e0 2023-10-03T10:13:43.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.673+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe274123100 con 0x7fe27409e7e0 2023-10-03T10:13:43.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.678+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe274123100 con 0x7fe27409e7e0 2023-10-03T10:13:43.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.882+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe274123100 con 0x7fe27409e7e0 2023-10-03T10:13:43.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.883+0000 7fe265ffb700 1 -- 172.21.15.19:0/1772877475 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+11900 (secure 0 0 0) 0x7fe270029080 con 0x7fe27409e7e0 2023-10-03T10:13:43.884 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:43.885 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:43.488726+0000","last_up_change":"2023-10-03T10:13:43.488726+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":118843}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":118843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":118843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":118843}]},"public_addr":"172.21.15.19:6808/118843","cluster_addr":"172.21.15.19:6809/118843","heartbeat_back_addr":"172.21.15.19:6811/118843","heartbeat_front_addr":"172.21.15.19:6810/118843","state":["exists"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 >> v1:172.21.15.19:6816/126819 conn(0x7fe25802f510 legacy=0x7fe2580319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 msgr2=0x7fe27411f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe270000c00 tx=0x7fe270004750 comp rx=0 tx=0).stop 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 shutdown_connections 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe274137ff0 0x7fe2741203e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe27409e7e0 0x7fe27411f960 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 --2- 172.21.15.19:0/1772877475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe27409f0f0 0x7fe27411fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 >> 172.21.15.19:0/1772877475 conn(0x7fe2740a4300 msgr2=0x7fe2740a1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 shutdown_connections 2023-10-03T10:13:43.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:43.886+0000 7fe27b27c700 1 -- 172.21.15.19:0/1772877475 wait complete. 2023-10-03T10:13:44.131 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:13:44.132+0000 7f40de666680 -1 Falling back to public interface 2023-10-03T10:13:44.906 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:13:44.906+0000 7f9756414680 -1 osd.0 23 log_to_monitors true 2023-10-03T10:13:45.973 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:13:45.974+0000 7f1eead36680 -1 osd.1 23 log_to_monitors true 2023-10-03T10:13:46.456 INFO:tasks.ceph.osd.0.smithi019.stderr:2023-10-03T10:13:46.456+0000 7f974238f700 -1 osd.0 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:13:46.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:46.948 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:13:46.948+0000 7f2ada231680 -1 osd.2 25 log_to_monitors true 2023-10-03T10:13:47.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.075+0000 7f7c7feb2700 1 Processor -- start 2023-10-03T10:13:47.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.075+0000 7f7c7feb2700 1 -- start start 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7feb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 0x7f7c7809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7feb2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c7809e000 0x7f7c78130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7feb2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7809f130 con 0x7f7c7809e410 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7feb2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7809f520 con 0x7f7c7809e000 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7feb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7809e930 con 0x7f7c7809d6f0 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7d44d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c7809e000 0x7f7c78130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7d44d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c7809e000 0x7f7c78130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42492/0 (socket says 172.21.15.19:42492) 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7e44f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c7809e410 0x7f7c78130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49008/0 (socket says 172.21.15.19:49008) 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7d44d700 1 -- 172.21.15.19:0/2598123625 learned_addr learned my addr 172.21.15.19:0/2598123625 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.076+0000 7f7c7dc4e700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 0x7f7c7809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7cc4c700 1 -- 172.21.15.19:0/2598123625 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2658926115 0 0) 0x7f7c7809f130 con 0x7f7c7809e410 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7cc4c700 1 -- 172.21.15.19:0/2598123625 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c640035b0 con 0x7f7c7809e410 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7d44d700 1 -- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 msgr2=0x7f7c7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7d44d700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 0x7f7c7809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7d44d700 1 -- 172.21.15.19:0/2598123625 >> v1:172.21.15.19:6789/0 conn(0x7f7c7809e410 legacy=0x7f7c78130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7d44d700 1 -- 172.21.15.19:0/2598123625 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7809b2d0 con 0x7f7c7809e000 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7dc4e700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 0x7f7c7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7d44d700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c78130660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800bb90 tx=0x7f7c6800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a77892c31c07db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7cc4c700 1 -- 172.21.15.19:0/2598123625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800dd30 con 0x7f7c7809e000 2023-10-03T10:13:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7cc4c700 1 -- 172.21.15.19:0/2598123625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800de90 con 0x7f7c7809e000 2023-10-03T10:13:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.077+0000 7f7c7cc4c700 1 -- 172.21.15.19:0/2598123625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68010690 con 0x7f7c7809e000 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 -- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 msgr2=0x7f7c78130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c78130660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800bb90 tx=0x7f7c6800bea0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 -- 172.21.15.19:0/2598123625 shutdown_connections 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809d6f0 0x7f7c7809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/2598123625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c78130660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.078+0000 7f7c7feb2700 1 -- 172.21.15.19:0/2598123625 >> 172.21.15.19:0/2598123625 conn(0x7f7c78066f50 msgr2=0x7f7c7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.079+0000 7f7c7feb2700 1 -- 172.21.15.19:0/2598123625 shutdown_connections 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.079+0000 7f7c7feb2700 1 -- 172.21.15.19:0/2598123625 wait complete. 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.080+0000 7f7c7feb2700 1 Processor -- start 2023-10-03T10:13:47.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.080+0000 7f7c7feb2700 1 -- start start 2023-10-03T10:13:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c7811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 0x7f7c7811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78120240 con 0x7f7c7809e000 2023-10-03T10:13:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78121b00 con 0x7f7c7809d6f0 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7feb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78120ed0 con 0x7f7c7809e410 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7dc4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 0x7f7c7811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7dc4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48420/0 (socket says 172.21.15.19:48420) 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7dc4e700 1 -- 172.21.15.19:0/332929019 learned_addr learned my addr 172.21.15.19:0/332929019 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7d44d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c7811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 -- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 msgr2=0x7f7c7811dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 -- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 msgr2=0x7f7c7811e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c7811e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7e44f700 1 -- 172.21.15.19:0/332929019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740094a0 con 0x7f7c7809e410 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.081+0000 7f7c7dc4e700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c7e44f700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 0x7f7c7811ea60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cb10 tx=0x7f7c7000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000a9e0 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7000ab40 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6800b7f0 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70011560 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.082+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7809c700 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.083+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7c70017070 con 0x7f7c7809e410 2023-10-03T10:13:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.083+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c781214c0 con 0x7f7c7809e410 2023-10-03T10:13:47.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.083+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4020+0+0 (secure 0 0 0) 0x7f7c70043cb0 con 0x7f7c7809e410 2023-10-03T10:13:47.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.089+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c781214c0 con 0x7f7c7809e410 2023-10-03T10:13:47.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.364+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c781214c0 con 0x7f7c7809e410 2023-10-03T10:13:47.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.365+0000 7f7c6e7fc700 1 -- 172.21.15.19:0/332929019 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12688 (secure 0 0 0) 0x7f7c781214c0 con 0x7f7c7809e410 2023-10-03T10:13:47.365 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:47.365 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":29,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:46.507183+0000","last_up_change":"2023-10-03T10:13:46.507183+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.25,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"error_message":"pool 2 has some PGs where all OSDs are with primary_affinity 0 (at least pg 2.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 3 has some PGs where all OSDs are with primary_affinity 0 (at least pg 3.0), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 4 has some PGs where all OSDs are with primary_affinity 0 (at least pg 4.0), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":19,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":118825}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":118825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":118825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":118825}]},"public_addr":"172.21.15.19:6804/118825","cluster_addr":"172.21.15.19:6805/118825","heartbeat_back_addr":"172.21.15.19:6807/118825","heartbeat_front_addr":"172.21.15.19:6806/118825","state":["exists"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":118826}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":118826}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":118826}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":118826}]},"public_addr":"172.21.15.19:6800/118826","cluster_addr":"172.21.15.19:6801/118826","heartbeat_back_addr":"172.21.15.19:6803/118826","heartbeat_front_addr":"172.21.15.19:6802/118826","state":["exists"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":118856}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":118856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":118856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":118856}]},"public_addr":"172.21.15.19:6812/118856","cluster_addr":"172.21.15.19:6813/118856","heartbeat_back_addr":"172.21.15.19:6815/118856","heartbeat_front_addr":"172.21.15.19:6814/118856","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.367+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 >> v1:172.21.15.19:6816/126819 conn(0x7f7c5c02f4e0 legacy=0x7f7c5c031990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.367+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 msgr2=0x7f7c7811ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.367+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 0x7f7c7811ea60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cb10 tx=0x7f7c7000ce20 comp rx=0 tx=0).stop 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.367+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 shutdown_connections 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.367+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7809e410 0x7f7c7811ea60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.368+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7809d6f0 0x7f7c7811dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.368+0000 7f7c7feb2700 1 --2- 172.21.15.19:0/332929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7809e000 0x7f7c7811e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.368+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 >> 172.21.15.19:0/332929019 conn(0x7f7c78066f50 msgr2=0x7f7c78130a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.368+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 shutdown_connections 2023-10-03T10:13:47.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:47.368+0000 7f7c7feb2700 1 -- 172.21.15.19:0/332929019 wait complete. 2023-10-03T10:13:47.559 INFO:tasks.ceph.osd.1.smithi019.stderr:2023-10-03T10:13:47.559+0000 7f1ed6cb1700 -1 osd.1 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:13:47.974 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:13:47.975+0000 7f40de666680 -1 osd.3 26 log_to_monitors true 2023-10-03T10:13:48.477 INFO:tasks.ceph.osd.2.smithi019.stderr:2023-10-03T10:13:48.477+0000 7f2ac61ac700 -1 osd.2 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:13:49.553 INFO:tasks.ceph.osd.3.smithi019.stderr:2023-10-03T10:13:49.553+0000 7f40ca5e1700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-03T10:13:50.383 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.526+0000 7fc550f7d700 1 Processor -- start 2023-10-03T10:13:50.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.526+0000 7fc550f7d700 1 -- start start 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc550f7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc550f7d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 0x7fc54c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc550f7d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54c070940 con 0x7fc54c09e930 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc550f7d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54c06fd60 con 0x7fc54c136fe0 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc550f7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c06fa80 con 0x7fc54c09f410 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc54ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 0x7fc54c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53172/0 (socket says 172.21.15.19:53172) 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 -- 172.21.15.19:0/697253875 learned_addr learned my addr 172.21.15.19:0/697253875 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 -- 172.21.15.19:0/697253875 >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 msgr2=0x7fc54c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 --2- 172.21.15.19:0/697253875 >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 0x7fc54c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 -- 172.21.15.19:0/697253875 >> v1:172.21.15.19:6789/0 conn(0x7fc54c09e930 legacy=0x7fc54c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc549d9b700 1 -- 172.21.15.19:0/697253875 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c09fb60 con 0x7fc54c09f410 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc54959a700 1 -- 172.21.15.19:0/697253875 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567680777 0 0) 0x7fc54c070940 con 0x7fc54c09e930 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.527+0000 7fc54ad9d700 1 --2- 172.21.15.19:0/697253875 >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 0x7fc54c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.528+0000 7fc549d9b700 1 --2- 172.21.15.19:0/697253875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5340098f0 tx=0x7fc534009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdcd6d289c40aacc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.528+0000 7fc54959a700 1 -- 172.21.15.19:0/697253875 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534011830 con 0x7fc54c09f410 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.528+0000 7fc54959a700 1 -- 172.21.15.19:0/697253875 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc534011990 con 0x7fc54c09f410 2023-10-03T10:13:50.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.528+0000 7fc54959a700 1 -- 172.21.15.19:0/697253875 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc534011d20 con 0x7fc54c09f410 2023-10-03T10:13:50.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 -- 172.21.15.19:0/697253875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 msgr2=0x7fc54c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 --2- 172.21.15.19:0/697253875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5340098f0 tx=0x7fc534009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 -- 172.21.15.19:0/697253875 shutdown_connections 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 --2- 172.21.15.19:0/697253875 >> v2:172.21.15.19:3300/0 conn(0x7fc54c136fe0 0x7fc54c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 --2- 172.21.15.19:0/697253875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c09f410 0x7fc54c136aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 -- 172.21.15.19:0/697253875 >> 172.21.15.19:0/697253875 conn(0x7fc54c0a4210 msgr2=0x7fc54c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 -- 172.21.15.19:0/697253875 shutdown_connections 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.529+0000 7fc550f7d700 1 -- 172.21.15.19:0/697253875 wait complete. 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.530+0000 7fc550f7d700 1 Processor -- start 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.530+0000 7fc550f7d700 1 -- start start 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc54c09f410 0x7fc54c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 0x7fc54c1c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c121bb0 con 0x7fc54c09e930 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c122200 con 0x7fc54c09f410 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc550f7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c132260 con 0x7fc54c136fe0 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 0x7fc54c1c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42524/0 (socket says 172.21.15.19:42524) 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54a59c700 1 -- 172.21.15.19:0/1249563123 learned_addr learned my addr 172.21.15.19:0/1249563123 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc549d9b700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc54c09f410 0x7fc54c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 -- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc54c09f410 msgr2=0x7fc54c06c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc54c09f410 0x7fc54c06c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 -- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 msgr2=0x7fc54c06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 -- 172.21.15.19:0/1249563123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009a70 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54a59c700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc54ad9d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 0x7fc54c1c82f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc54400efc0 tx=0x7fc54400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.531+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400cc90 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.532+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400f040 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.532+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc534009550 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.532+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc544014480 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.532+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c06bd60 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.532+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc544014600 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.533+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c06d4c0 con 0x7fc54c136fe0 2023-10-03T10:13:50.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.533+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4020+0+0 (secure 0 0 0) 0x7fc544040490 con 0x7fc54c136fe0 2023-10-03T10:13:50.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.542+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc544018020 con 0x7fc54c136fe0 2023-10-03T10:13:50.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.772+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc54c071d20 con 0x7fc54c136fe0 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.773+0000 7fc542ffd700 1 -- 172.21.15.19:0/1249563123 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12902 (secure 0 0 0) 0x7fc544011680 con 0x7fc54c136fe0 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:50.773 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:50.569889+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":26,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 >> v1:172.21.15.19:6816/126819 conn(0x7fc52c02f510 legacy=0x7fc52c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 msgr2=0x7fc54c1c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 0x7fc54c1c82f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc54400efc0 tx=0x7fc54400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 shutdown_connections 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc54c136fe0 0x7fc54c1c82f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc54c09e930 0x7fc54c06c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 --2- 172.21.15.19:0/1249563123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc54c09f410 0x7fc54c06c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 >> 172.21.15.19:0/1249563123 conn(0x7fc54c0a4210 msgr2=0x7fc54c134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 shutdown_connections 2023-10-03T10:13:50.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:50.775+0000 7fc550f7d700 1 -- 172.21.15.19:0/1249563123 wait complete. 2023-10-03T10:13:50.789 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:13:50.789 INFO:teuthology.run_tasks:Running task ceph.stop... 2023-10-03T10:13:50.800 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:13:50.800 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:13:50.811 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:13:55.906 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2023-10-03T10:13:55.906 INFO:teuthology.run_tasks:Running task ceph.restart... 2023-10-03T10:13:55.919 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-03T10:13:55.919 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-03T10:13:55.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-03T10:13:55.922 INFO:tasks.ceph.mds.a:Started 2023-10-03T10:13:55.922 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:13:55.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:13:56.017 INFO:tasks.ceph.mds.a.smithi019.stdout:starting mds.a at 2023-10-03T10:13:56.033 INFO:tasks.ceph.mon.a.smithi019.stderr:2023-10-03T10:13:56.033+0000 7efd42cf8700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-03T10:13:56.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.075+0000 7fc9be2f1700 1 Processor -- start 2023-10-03T10:13:56.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 -- start start 2023-10-03T10:13:56.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9b809d630 0x7fc9b80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9b80a2a70 con 0x7fc9b8133930 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9b80a01d0 con 0x7fc9b809d630 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9be2f1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b809e2b0 con 0x7fc9b80a0a30 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9b7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9b77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9b809d630 0x7fc9b80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9bc88e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc9b8133930 0x7fc9b8133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49058/0 (socket says 172.21.15.19:49058) 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9b7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48456/0 (socket says 172.21.15.19:48456) 2023-10-03T10:13:56.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.076+0000 7fc9bc88e700 1 -- 172.21.15.19:0/2141228974 learned_addr learned my addr 172.21.15.19:0/2141228974 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b77fe700 1 -- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 msgr2=0x7fc9b80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b77fe700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b77fe700 1 -- 172.21.15.19:0/2141228974 >> v1:172.21.15.19:6789/0 conn(0x7fc9b8133930 legacy=0x7fc9b8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b77fe700 1 -- 172.21.15.19:0/2141228974 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b809dc50 con 0x7fc9b809d630 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b6ffd700 1 -- 172.21.15.19:0/2141228974 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698516972 0 0) 0x7fc9b80a2a70 con 0x7fc9b8133930 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b7fff700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b77fe700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b80a1340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27a39dba2f3d6ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b6ffd700 1 -- 172.21.15.19:0/2141228974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011830 con 0x7fc9b809d630 2023-10-03T10:13:56.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b6ffd700 1 -- 172.21.15.19:0/2141228974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac011990 con 0x7fc9b809d630 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9b6ffd700 1 -- 172.21.15.19:0/2141228974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac011d20 con 0x7fc9b809d630 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9be2f1700 1 -- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 msgr2=0x7fc9b80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b80a1340 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009840 tx=0x7fc9ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9be2f1700 1 -- 172.21.15.19:0/2141228974 shutdown_connections 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.077+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/2141228974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b80a1340 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.078+0000 7fc9be2f1700 1 -- 172.21.15.19:0/2141228974 >> 172.21.15.19:0/2141228974 conn(0x7fc9b80a3050 msgr2=0x7fc9b80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.078+0000 7fc9be2f1700 1 -- 172.21.15.19:0/2141228974 shutdown_connections 2023-10-03T10:13:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.078+0000 7fc9be2f1700 1 -- 172.21.15.19:0/2141228974 wait complete. 2023-10-03T10:13:56.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.078+0000 7fc9be2f1700 1 Processor -- start 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 -- start start 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 0x7fc9b806e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80712b0 con 0x7fc9b809d630 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8070590 con 0x7fc9b80a0a30 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9be2f1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b80a4350 con 0x7fc9b8133930 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9b77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9b77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48466/0 (socket says 172.21.15.19:48466) 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9b77fe700 1 -- 172.21.15.19:0/556152078 learned_addr learned my addr 172.21.15.19:0/556152078 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9bc88e700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 0x7fc9b806e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.079+0000 7fc9b7fff700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 -- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 msgr2=0x7fc9b806e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 -- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 msgr2=0x7fc9b806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b806dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 -- 172.21.15.19:0/556152078 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a80094a0 con 0x7fc9b8133930 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9b7fff700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9b77fe700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9bc88e700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 0x7fc9b806e540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000cbe0 tx=0x7fc9b000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000aa40 con 0x7fc9b8133930 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b000abc0 con 0x7fc9b8133930 2023-10-03T10:13:56.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ac0094a0 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00070d0 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.080+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b8070ff0 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.081+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc9b0007230 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.081+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9b80a5780 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.082+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc9b003f4f0 con 0x7fc9b8133930 2023-10-03T10:13:56.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.086+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc9b0019860 con 0x7fc9b8133930 2023-10-03T10:13:56.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.289+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9b80715f0 con 0x7fc9b8133930 2023-10-03T10:13:56.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.290+0000 7fc9b4ff9700 1 -- 172.21.15.19:0/556152078 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12966 (secure 0 0 0) 0x7fc9b0018020 con 0x7fc9b8133930 2023-10-03T10:13:56.290 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:56.290 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:13:56.033223+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"pacific","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":33,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6817/497268310":"2023-10-04T10:13:56.033183+0000","172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:13:56.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 >> v1:172.21.15.19:6816/126819 conn(0x7fc9a402f510 legacy=0x7fc9a40319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 msgr2=0x7fc9b806e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 0x7fc9b806e540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000cbe0 tx=0x7fc9b000cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 shutdown_connections 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9b8133930 0x7fc9b806e540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9b809d630 0x7fc9b806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 --2- 172.21.15.19:0/556152078 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc9b80a0a30 0x7fc9b806e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 >> 172.21.15.19:0/556152078 conn(0x7fc9b80a3050 msgr2=0x7fc9b81bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 shutdown_connections 2023-10-03T10:13:56.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.292+0000 7fc9be2f1700 1 -- 172.21.15.19:0/556152078 wait complete. 2023-10-03T10:13:56.306 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:13:56.306 INFO:teuthology.run_tasks:Running task exec... 2023-10-03T10:13:56.316 INFO:teuthology.task.exec:Executing custom commands... 2023-10-03T10:13:56.316 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:13:56.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2023-10-03T10:13:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.449+0000 7fd6bb5d7700 1 Processor -- start 2023-10-03T10:13:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.449+0000 7fd6bb5d7700 1 -- start start 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6bb5d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b409dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6bb5d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 0x7fd6b4133740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6bb5d7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b406b5a0 con 0x7fd6b4133c80 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6bb5d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409ab70 con 0x7fd6b409d950 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6bb5d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b409f3d0 con 0x7fd6b409e260 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b9373700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b409dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b9b74700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd6b4133c80 0x7fd6b413ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37200/0 (socket says 172.21.15.19:37200) 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b9b74700 1 -- 172.21.15.19:0/1385714352 learned_addr learned my addr 172.21.15.19:0/1385714352 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b8b72700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 0x7fd6b4133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b8b72700 1 -- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 msgr2=0x7fd6b409dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6a7fff700 1 -- 172.21.15.19:0/1385714352 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043419185 0 0) 0x7fd6b406b5a0 con 0x7fd6b4133c80 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b8b72700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b409dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.450+0000 7fd6b8b72700 1 -- 172.21.15.19:0/1385714352 >> v1:172.21.15.19:6789/0 conn(0x7fd6b4133c80 legacy=0x7fd6b413ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6b8b72700 1 -- 172.21.15.19:0/1385714352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b409a560 con 0x7fd6b409e260 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6b9373700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6b8b72700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 0x7fd6b4133740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009850 tx=0x7fd6a8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbf3a3d8a15a399 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6a7fff700 1 -- 172.21.15.19:0/1385714352 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8005e30 con 0x7fd6b409e260 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6a7fff700 1 -- 172.21.15.19:0/1385714352 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a8006030 con 0x7fd6b409e260 2023-10-03T10:13:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6a7fff700 1 -- 172.21.15.19:0/1385714352 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80063e0 con 0x7fd6b409e260 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 msgr2=0x7fd6b4133740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.451+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 0x7fd6b4133740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009850 tx=0x7fd6a8009b60 comp rx=0 tx=0).stop 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1385714352 shutdown_connections 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b409dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1385714352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b409e260 0x7fd6b4133740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1385714352 >> 172.21.15.19:0/1385714352 conn(0x7fd6b40a2f50 msgr2=0x7fd6b40a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1385714352 shutdown_connections 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.452+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1385714352 wait complete. 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 Processor -- start 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 -- start start 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6b409e260 0x7fd6b41c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 0x7fd6b41c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b40a1b90 con 0x7fd6b409e260 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4120260 con 0x7fd6b409d950 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6bb5d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41c5a70 con 0x7fd6b4133c80 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9373700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9373700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51822/0 (socket says 172.21.15.19:51822) 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9373700 1 -- 172.21.15.19:0/1315964650 learned_addr learned my addr 172.21.15.19:0/1315964650 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b8b72700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6b409e260 0x7fd6b41c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9b74700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 0x7fd6b41c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9373700 1 -- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 msgr2=0x7fd6b41c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.453+0000 7fd6b9373700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 0x7fd6b41c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6b9373700 1 -- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6b409e260 msgr2=0x7fd6b41c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6b9373700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6b409e260 0x7fd6b41c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6b9373700 1 -- 172.21.15.19:0/1315964650 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009430 con 0x7fd6b409d950 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6b9b74700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 0x7fd6b41c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6b9373700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ec10 tx=0x7fd6b000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0005a20 con 0x7fd6b409d950 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0005b80 con 0x7fd6b409d950 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a8009430 con 0x7fd6b409d950 2023-10-03T10:13:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b000c850 con 0x7fd6b409d950 2023-10-03T10:13:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.454+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b41209d0 con 0x7fd6b409d950 2023-10-03T10:13:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.455+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd6b000c9b0 con 0x7fd6b409d950 2023-10-03T10:13:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.455+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd6b003ff40 con 0x7fd6b409d950 2023-10-03T10:13:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.455+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b404f2a0 con 0x7fd6b409d950 2023-10-03T10:13:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.460+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd6b0022710 con 0x7fd6b409d950 2023-10-03T10:13:56.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.666+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd6b40727b0 con 0x7fd6b409d950 2023-10-03T10:13:56.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.667+0000 7fd6a5ffb700 1 -- 172.21.15.19:0/1315964650 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+24156 (secure 0 0 0) 0x7fd6b0023350 con 0x7fd6b409d950 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 35, 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "fsid": "7e072252-f281-43a7-ab05-1896c0d28d72", 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "created": "2023-10-03T10:10:56.621164+0000", 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "modified": "2023-10-03T10:13:56.033223+0000", 2023-10-03T10:13:56.674 INFO:teuthology.orchestra.run.smithi019.stdout: "last_up_change": "2023-10-03T10:13:50.569889+0000", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "last_in_change": "2023-10-03T10:10:58.479662+0000", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_num": 5799936, 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_set": [ 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "pglog_hardlimit", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "purged_snapdirs", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_deletes", 2023-10-03T10:13:56.675 INFO:teuthology.orchestra.run.smithi019.stdout: "sortbitwise" 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_version": 8, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "full_ratio": 0.94999998807907104, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "nearfull_ratio": 0.85000002384185791, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_snapshot": "", 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_max": 4, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd": 4, 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "require_min_compat_client": "pacific", 2023-10-03T10:13:56.676 INFO:teuthology.orchestra.run.smithi019.stdout: "min_compat_client": "luminous", 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "require_osd_release": "pacific", 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_crimson": false, 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "pools": [ 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 1, 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": ".mgr", 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2023-10-03T10:11:04.831433+0000", 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2023-10-03T10:13:56.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:13:56.678 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 1, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 1, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 1, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 1, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 1, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2023-10-03T10:13:56.679 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "23", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2023-10-03T10:13:56.680 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2023-10-03T10:13:56.681 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2023-10-03T10:13:56.682 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_max": 32, 2023-10-03T10:13:56.683 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 1 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": {}, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_devicehealth": {} 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 4, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 4, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 0.5, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2, 2023-10-03T10:13:56.684 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 2, 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "rbd", 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2023-10-03T10:11:06.511040+0000", 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2023-10-03T10:13:56.685 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:13:56.686 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 8, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 8, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 8, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 8, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 8, 2023-10-03T10:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "13", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:13:56.688 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2023-10-03T10:13:56.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2023-10-03T10:13:56.690 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:13:56.691 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "options": {}, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd": {} 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 2.5, 2023-10-03T10:13:56.692 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 2.5, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 2.5, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 2.5, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 3, 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_metadata", 2023-10-03T10:13:56.693 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2023-10-03T10:11:10.911282+0000", 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2023-10-03T10:13:56.694 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 32, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 32, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 32, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 32, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 32, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2023-10-03T10:13:56.695 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "16", 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2023-10-03T10:13:56.696 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:13:56.697 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:13:56.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_bias": 4, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 16, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_priority": 5 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.699 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "metadata": "cephfs" 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.6299999952316284, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.6299999952316284, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.6299999952316284, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.6299999952316284, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2023-10-03T10:13:56.700 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "pool": 4, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": "cephfs_data", 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "create_time": "2023-10-03T10:11:12.226977+0000", 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flags_names": "hashpspool", 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "type": 1, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "size": 2, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": 1, 2023-10-03T10:13:56.701 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_rule": 0, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_count": 0, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_target": 0, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_barrier": 0, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "object_hash": 2, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscale_mode": "off", 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": 64, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num": 64, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_placement_num_target": 64, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_target": 64, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_pending": 64, 2023-10-03T10:13:56.702 INFO:teuthology.orchestra.run.smithi019.stdout: "last_pg_merge_meta": { 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "source_pgid": "0.0", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "ready_epoch": 0, 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_started": 0, 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_epoch_clean": 0, 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "source_version": "0'0", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "target_version": "0'0" 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_change": "17", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend": "0", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_prenautilus": "0", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "last_force_op_resend_preluminous": "0", 2023-10-03T10:13:56.703 INFO:teuthology.orchestra.run.smithi019.stdout: "auid": 0, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_mode": "selfmanaged", 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_seq": 0, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "snap_epoch": 0, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_snaps": [], 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps": "[]", 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_bytes": 0, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "quota_max_objects": 0, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tiers": [], 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tier_of": -1, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "read_tier": -1, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "write_tier": -1, 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_mode": "none", 2023-10-03T10:13:56.704 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_bytes": 0, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "target_max_objects": 0, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_target_full_ratio_micro": 800000, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_flush_age": 0, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "cache_min_evict_age": 0, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profile": "", 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_params": { 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "none" 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_period": 0, 2023-10-03T10:13:56.705 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_count": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "use_gmt_hitset": true, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "min_read_recency_for_promote": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "min_write_recency_for_promote": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_grade_decay_rate": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "hit_set_search_last_n": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "grade_table": [], 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "stripe_width": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "expected_num_objects": 0, 2023-10-03T10:13:56.706 INFO:teuthology.orchestra.run.smithi019.stdout: "fast_read": false, 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "options": { 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num_min": 64, 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "target_size_ratio": 0.89999997615814209 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "application_metadata": { 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "cephfs": { 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: "data": "cephfs" 2023-10-03T10:13:56.707 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "read_balance": { 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "score_acting": 1.059999942779541, 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "score_stable": 1.059999942779541, 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "optimal_score": 1, 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_acting": 1.059999942779541, 2023-10-03T10:13:56.708 INFO:teuthology.orchestra.run.smithi019.stdout: "raw_score_stable": 1.059999942779541, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity_weighted": 1, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity": 1, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "average_primary_affinity_weighted": 1 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "osds": [ 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "254f1f35-d197-4b51-8a96-760da60c16a8", 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2023-10-03T10:13:56.709 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 9, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 23, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 29, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 24, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6804", 2023-10-03T10:13:56.710 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129535 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6805", 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129535 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6807", 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129535 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6806", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129535 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6804/129535", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6805/129535", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6807/129535", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6806/129535", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2023-10-03T10:13:56.713 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "916c386e-c460-4114-9dbe-21434a2f252d", 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 9, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 23, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 31, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2023-10-03T10:13:56.714 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 25, 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6800", 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129633 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.715 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6801", 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129633 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6803", 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129633 2023-10-03T10:13:56.716 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6802", 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129633 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6800/129633", 2023-10-03T10:13:56.717 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6801/129633", 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6803/129633", 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6802/129633", 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "567f9cb5-3aaa-4022-97b8-d11809d82b46", 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2023-10-03T10:13:56.718 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 9, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 25, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 31, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 26, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.719 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6808", 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129743 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6809", 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129743 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6811", 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129743 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.721 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6810", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 129743 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6808/129743", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6809/129743", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6811/129743", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6810/129743", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2023-10-03T10:13:56.722 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 3, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "uuid": "8991320d-e996-46ae-a954-e1235c1a6bd8", 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "up": 1, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "in": 1, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "weight": 1, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_affinity": 1, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_begin": 9, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "last_clean_end": 26, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "up_from": 33, 2023-10-03T10:13:56.723 INFO:teuthology.orchestra.run.smithi019.stdout: "up_thru": 33, 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "down_at": 27, 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "lost_at": 0, 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addrs": { 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6812", 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 130083 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addrs": { 2023-10-03T10:13:56.724 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6813", 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 130083 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addrs": { 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6815", 2023-10-03T10:13:56.725 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 130083 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addrs": { 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6814", 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 130083 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "public_addr": "172.21.15.19:6812/130083", 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_addr": "172.21.15.19:6813/130083", 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_back_addr": "172.21.15.19:6815/130083", 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "heartbeat_front_addr": "172.21.15.19:6814/130083", 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "state": [ 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "exists", 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "up" 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_xinfo": [ 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.727 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 0, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540138322906710015, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2023-10-03T10:11:03.629770+0000", 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 24 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 1, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2023-10-03T10:13:56.728 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540138322906710015, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2023-10-03T10:11:03.593513+0000", 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 25 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 2, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "0.000000", 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540138322906710015, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2023-10-03T10:13:56.729 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2023-10-03T10:11:03.383549+0000", 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 26 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": 3, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "down_stamp": "2023-10-03T10:13:43.488726+0000", 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_probability": 0, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "laggy_interval": 0, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "features": 4540138322906710015, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "old_weight": 0, 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "last_purged_snaps_scrub": "2023-10-03T10:11:03.603660+0000", 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: "dead_epoch": 0 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.730 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap": [], 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_items": [ 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.5", 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.731 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 2 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.d", 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 2 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.e", 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 0 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.10", 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.733 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 1, 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 2 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.11", 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 2 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.734 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.1f", 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 0 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "pgid": "4.22", 2023-10-03T10:13:56.735 INFO:teuthology.orchestra.run.smithi019.stdout: "mappings": [ 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: { 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "from": 3, 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "to": 2 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_upmap_primaries": [], 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_temp": [], 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "primary_temp": [], 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "blocklist": { 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "172.21.15.19:6817/497268310": "2023-10-04T10:13:56.033183+0000", 2023-10-03T10:13:56.736 INFO:teuthology.orchestra.run.smithi019.stdout: "172.21.15.19:0/2596252035": "2023-10-04T10:13:29.532347+0000", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "172.21.15.19:6816/118286": "2023-10-04T10:13:29.532347+0000", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "172.21.15.19:0/2933255455": "2023-10-04T10:13:29.532347+0000" 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "range_blocklist": {}, 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "erasure_code_profiles": { 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "default": { 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-failure-domain": "osd", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "k": "2", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "m": "1", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "plugin": "jerasure", 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: "technique": "reed_sol_van" 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "removed_snaps_queue": [], 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "new_removed_snaps": [], 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "new_purged_snaps": [], 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_node_flags": {}, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "device_class_flags": {}, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode": { 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_enabled": false, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_bucket_count": 0, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "degraded_stretch_mode": 0, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "recovering_stretch_mode": 0, 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: "stretch_mode_bucket": 0 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:56.738 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.669+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 >> v1:172.21.15.19:6816/126819 conn(0x7fd69802f510 legacy=0x7fd6980319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 msgr2=0x7fd6b41c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000ec10 tx=0x7fd6b000ef20 comp rx=0 tx=0).stop 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 shutdown_connections 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd6b4133c80 0x7fd6b41c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd6b409d950 0x7fd6b41c4ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 --2- 172.21.15.19:0/1315964650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6b409e260 0x7fd6b41c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 >> 172.21.15.19:0/1315964650 conn(0x7fd6b40a2f50 msgr2=0x7fd6b41baca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 shutdown_connections 2023-10-03T10:13:56.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.670+0000 7fd6bb5d7700 1 -- 172.21.15.19:0/1315964650 wait complete. 2023-10-03T10:13:56.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2023-10-03T10:13:56.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.876+0000 7f4eec54b700 1 Processor -- start 2023-10-03T10:13:56.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 -- start start 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee409a790 con 0x7f4ee4134410 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee409f640 con 0x7f4ee4133b00 2023-10-03T10:13:56.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eec54b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee409a4f0 con 0x7f4ee409de90 2023-10-03T10:13:56.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eea2e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eeaae8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4ee9ae6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eea2e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51834/0 (socket says 172.21.15.19:51834) 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4ee9ae6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57938/0 (socket says 172.21.15.19:57938) 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eeaae8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41740/0 (socket says 172.21.15.19:41740) 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.877+0000 7f4eea2e7700 1 -- 172.21.15.19:0/2755860466 learned_addr learned my addr 172.21.15.19:0/2755860466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 -- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 msgr2=0x7f4ee409e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 -- 172.21.15.19:0/2755860466 >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 msgr2=0x7f4ee409d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 --2- 172.21.15.19:0/2755860466 >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 -- 172.21.15.19:0/2755860466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee409eb20 con 0x7f4ee4133b00 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eeaae8700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4ee9ae6700 1 --2- 172.21.15.19:0/2755860466 >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4eea2e7700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098f0 tx=0x7f4ee0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0052536e38b5d2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4ee92e5700 1 -- 172.21.15.19:0/2755860466 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0011830 con 0x7f4ee4133b00 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4ee92e5700 1 -- 172.21.15.19:0/2755860466 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0011990 con 0x7f4ee4133b00 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.878+0000 7f4ee92e5700 1 -- 172.21.15.19:0/2755860466 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0011d20 con 0x7f4ee4133b00 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 -- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 msgr2=0x7f4ee4133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00098f0 tx=0x7f4ee0009c00 comp rx=0 tx=0).stop 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 -- 172.21.15.19:0/2755860466 shutdown_connections 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4133b00 0x7f4ee4133ed0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 --2- 172.21.15.19:0/2755860466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee409e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 --2- 172.21.15.19:0/2755860466 >> v2:172.21.15.19:3300/0 conn(0x7f4ee4134410 0x7f4ee409d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 -- 172.21.15.19:0/2755860466 >> 172.21.15.19:0/2755860466 conn(0x7f4ee40a2f50 msgr2=0x7f4ee40a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 -- 172.21.15.19:0/2755860466 shutdown_connections 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.879+0000 7f4eec54b700 1 -- 172.21.15.19:0/2755860466 wait complete. 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 Processor -- start 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 -- start start 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee411aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 0x7f4ee411b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee411c2e0 con 0x7f4ee4133b00 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee409cc60 con 0x7f4ee4134410 2023-10-03T10:13:56.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.880+0000 7f4eec54b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee411ca80 con 0x7f4ee409de90 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ee9ae6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 0x7f4ee411b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ee9ae6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57950/0 (socket says 172.21.15.19:57950) 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ee9ae6700 1 -- 172.21.15.19:0/1772261923 learned_addr learned my addr 172.21.15.19:0/1772261923 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eea2e7700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee411aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 -- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 msgr2=0x7f4ee411aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee411aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 -- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 msgr2=0x7f4ee411b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 -- 172.21.15.19:0/1772261923 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc009a70 con 0x7f4ee4134410 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ee9ae6700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eea2e7700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee411aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eeaae8700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 0x7f4ee411b920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00eed0 tx=0x7f4edc00b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc010040 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00ba80 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed8009430 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00be30 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.881+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee0009550 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.882+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4edc01d410 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.882+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4edc03fd90 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.882+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee404f2a0 con 0x7f4ee4134410 2023-10-03T10:13:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:56.887+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4edc007920 con 0x7f4ee4134410 2023-10-03T10:13:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.176+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ee40727b0 con 0x7f4ee4134410 2023-10-03T10:13:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.177+0000 7f4ed6ffd700 1 -- 172.21.15.19:0/1772261923 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+627 (secure 0 0 0) 0x7f4edc018030 con 0x7f4ee4134410 2023-10-03T10:13:57.177 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2023-10-03T10:13:57.178 INFO:teuthology.orchestra.run.smithi019.stdout: "mon": { 2023-10-03T10:13:57.178 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 3 2023-10-03T10:13:57.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:57.178 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr": { 2023-10-03T10:13:57.178 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: "osd": { 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 4 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": { 2023-10-03T10:13:57.179 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 1 2023-10-03T10:13:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2023-10-03T10:13:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: "overall": { 2023-10-03T10:13:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph version 18.2.0-507-g7cd99ce4 (7cd99ce428fa36b28345615983ecfd3d24e90eba) reef (stable)": 9 2023-10-03T10:13:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: } 2023-10-03T10:13:57.180 INFO:teuthology.orchestra.run.smithi019.stdout:} 2023-10-03T10:13:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 >> v1:172.21.15.19:6816/126819 conn(0x7f4ec802f510 legacy=0x7f4ec80319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 msgr2=0x7f4ee411b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 0x7f4ee411b920 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00eed0 tx=0x7f4edc00b390 comp rx=0 tx=0).stop 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 shutdown_connections 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ee4134410 0x7f4ee411b920 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ee409de90 0x7f4ee411aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 --2- 172.21.15.19:0/1772261923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ee4133b00 0x7f4ee411b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 >> 172.21.15.19:0/1772261923 conn(0x7f4ee40a2f50 msgr2=0x7f4ee4133140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 shutdown_connections 2023-10-03T10:13:57.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.179+0000 7f4eec54b700 1 -- 172.21.15.19:0/1772261923 wait complete. 2023-10-03T10:13:57.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2023-10-03T10:13:57.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.326+0000 7f3f469a4700 1 Processor -- start 2023-10-03T10:13:57.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 -- start start 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f4009dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 0x7f3f40130710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4009b9b0 con 0x7f3f40130c50 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4009b320 con 0x7f3f4009d950 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f469a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4009ed20 con 0x7f3f4009e260 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 0x7f3f40130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f44f41700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f40130c50 0x7f3f40137b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37210/0 (socket says 172.21.15.19:37210) 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f4009dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.327+0000 7f3f44f41700 1 -- 172.21.15.19:0/2185633977 learned_addr learned my addr 172.21.15.19:0/2185633977 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3effd700 1 -- 172.21.15.19:0/2185633977 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433128939 0 0) 0x7f3f4009b9b0 con 0x7f3f40130c50 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3f7fe700 1 -- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 msgr2=0x7f3f4009dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3f7fe700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f4009dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3f7fe700 1 -- 172.21.15.19:0/2185633977 >> v1:172.21.15.19:6789/0 conn(0x7f3f40130c50 legacy=0x7f3f40137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3f7fe700 1 -- 172.21.15.19:0/2185633977 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4009a350 con 0x7f3f4009e260 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3ffff700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f4009dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3f7fe700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 0x7f3f40130710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009850 tx=0x7f3f34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f6ce6d18f99f9a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3effd700 1 -- 172.21.15.19:0/2185633977 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34005e30 con 0x7f3f4009e260 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3effd700 1 -- 172.21.15.19:0/2185633977 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34006030 con 0x7f3f4009e260 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.328+0000 7f3f3effd700 1 -- 172.21.15.19:0/2185633977 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f340063e0 con 0x7f3f4009e260 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 -- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 msgr2=0x7f3f40130710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 0x7f3f40130710 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009850 tx=0x7f3f34009b60 comp rx=0 tx=0).stop 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 -- 172.21.15.19:0/2185633977 shutdown_connections 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f4009dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 --2- 172.21.15.19:0/2185633977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4009e260 0x7f3f40130710 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 -- 172.21.15.19:0/2185633977 >> 172.21.15.19:0/2185633977 conn(0x7f3f400a2f50 msgr2=0x7f3f400a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 -- 172.21.15.19:0/2185633977 shutdown_connections 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.329+0000 7f3f469a4700 1 -- 172.21.15.19:0/2185633977 wait complete. 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 Processor -- start 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 -- start start 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 0x7f3f401c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f40130c50 0x7f3f401c06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4009cb00 con 0x7f3f4009e260 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401201e0 con 0x7f3f4009d950 2023-10-03T10:13:57.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f469a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401c4b90 con 0x7f3f40130c50 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f3f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 0x7f3f401c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f3ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51882/0 (socket says 172.21.15.19:51882) 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f44f41700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f40130c50 0x7f3f401c06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.330+0000 7f3f3ffff700 1 -- 172.21.15.19:0/3420490983 learned_addr learned my addr 172.21.15.19:0/3420490983 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 -- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f40130c50 msgr2=0x7f3f401c06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f40130c50 0x7f3f401c06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 -- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 msgr2=0x7f3f401c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 0x7f3f401c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 -- 172.21.15.19:0/3420490983 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300094a0 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3f7fe700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 0x7f3f401c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3ffff700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000ebe0 tx=0x7f3f3000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000c850 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3000c9b0 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f34009430 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000cd40 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.331+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f40120780 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.332+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f3f30013470 con 0x7f3f4009d950 2023-10-03T10:13:57.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.332+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3f30040080 con 0x7f3f4009d950 2023-10-03T10:13:57.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.332+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40120350 con 0x7f3f4009d950 2023-10-03T10:13:57.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.337+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f30021020 con 0x7f3f4009d950 2023-10-03T10:13:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.536+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f3f4004f2a0 con 0x7f3f4009d950 2023-10-03T10:13:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.537+0000 7f3f3cff9700 1 -- 172.21.15.19:0/3420490983 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v35) v1 ==== 59+0+37 (secure 0 0 0) 0x7f3f30017070 con 0x7f3f4009d950 2023-10-03T10:13:57.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 >> v1:172.21.15.19:6816/126819 conn(0x7f3f2c02f510 legacy=0x7f3f2c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 msgr2=0x7f3f401c4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000ebe0 tx=0x7f3f3000eef0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 shutdown_connections 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f40130c50 0x7f3f401c06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4009d950 0x7f3f401c4110 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 --2- 172.21.15.19:0/3420490983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4009e260 0x7f3f401c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 >> 172.21.15.19:0/3420490983 conn(0x7f3f400a2f50 msgr2=0x7f3f4012fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 shutdown_connections 2023-10-03T10:13:57.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.539+0000 7f3f469a4700 1 -- 172.21.15.19:0/3420490983 wait complete. 2023-10-03T10:13:57.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.663+0000 7fa851cb6700 1 Processor -- start 2023-10-03T10:13:57.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.663+0000 7fa851cb6700 1 -- start start 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa851cb6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa851cb6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 0x7fa84c138a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa851cb6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84c09f500 con 0x7fa84c09e240 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa851cb6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c09ed90 con 0x7fa84c130f00 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa851cb6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c09a5a0 con 0x7fa84c09d930 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 0x7fa84c138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41776/0 (socket says 172.21.15.19:41776) 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84b7fe700 1 -- 172.21.15.19:0/213974016 learned_addr learned my addr 172.21.15.19:0/213974016 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 -- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 msgr2=0x7fa84c09dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:57.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84a7fc700 1 -- 172.21.15.19:0/213974016 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643042982 0 0) 0x7fa84c09f500 con 0x7fa84c09e240 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 -- 172.21.15.19:0/213974016 >> v1:172.21.15.19:6789/0 conn(0x7fa84c09e240 legacy=0x7fa84c1307f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 -- 172.21.15.19:0/213974016 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c09b570 con 0x7fa84c130f00 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84b7fe700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84bfff700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 0x7fa84c138a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa844009dc0 tx=0x7fa84400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9230ca5139a61b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.664+0000 7fa84a7fc700 1 -- 172.21.15.19:0/213974016 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400e070 con 0x7fa84c130f00 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa84a7fc700 1 -- 172.21.15.19:0/213974016 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400bb20 con 0x7fa84c130f00 2023-10-03T10:13:57.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa84a7fc700 1 -- 172.21.15.19:0/213974016 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844012430 con 0x7fa84c130f00 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 -- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 msgr2=0x7fa84c138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 0x7fa84c138a50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa844009dc0 tx=0x7fa84400b330 comp rx=0 tx=0).stop 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 -- 172.21.15.19:0/213974016 shutdown_connections 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c130f00 0x7fa84c138a50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 --2- 172.21.15.19:0/213974016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c09d930 0x7fa84c09dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 -- 172.21.15.19:0/213974016 >> 172.21.15.19:0/213974016 conn(0x7fa84c099c30 msgr2=0x7fa84c0a3030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 -- 172.21.15.19:0/213974016 shutdown_connections 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.665+0000 7fa851cb6700 1 -- 172.21.15.19:0/213974016 wait complete. 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.666+0000 7fa851cb6700 1 Processor -- start 2023-10-03T10:13:57.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.666+0000 7fa851cb6700 1 -- start start 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c09e240 0x7fa84c11e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c130f00 0x7fa84c11ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c1216f0 con 0x7fa84c09d930 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0a1fa0 con 0x7fa84c09e240 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa851cb6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c1218e0 con 0x7fa84c130f00 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c09e240 0x7fa84c11e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57974/0 (socket says 172.21.15.19:57974) 2023-10-03T10:13:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c130f00 0x7fa84c11ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 -- 172.21.15.19:0/73506722 learned_addr learned my addr 172.21.15.19:0/73506722 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 -- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c130f00 msgr2=0x7fa84c11ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c130f00 0x7fa84c11ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 -- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c09e240 msgr2=0x7fa84c11e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c09e240 0x7fa84c11e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 -- 172.21.15.19:0/73506722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c00b7f0 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.667+0000 7fa84b7fe700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa83c010fa0 tx=0x7fa83c00e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00eea0 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c011650 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa844009a70 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0119c0 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c121bf0 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.668+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa83c011b20 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.669+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa83c042710 con 0x7fa84c09d930 2023-10-03T10:13:57.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.669+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c121bf0 con 0x7fa84c09d930 2023-10-03T10:13:57.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.674+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa84c121bf0 con 0x7fa84c09d930 2023-10-03T10:13:57.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:57.877+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fa84c121bf0 con 0x7fa84c09d930 2023-10-03T10:13:58.054 INFO:tasks.ceph.mgr.x.smithi019.stderr:terminate called recursively 2023-10-03T10:13:58.055 INFO:tasks.ceph.mgr.x.smithi019.stderr:terminate called after throwing an instance of 'ceph::buffer::v15_2_0::end_of_buffer' 2023-10-03T10:13:58.055 INFO:tasks.ceph.mgr.x.smithi019.stderr: what(): End of buffer [buffer:2] 2023-10-03T10:13:58.055 INFO:tasks.ceph.mgr.x.smithi019.stderr:*** Caught signal (Aborted) ** 2023-10-03T10:13:58.055 INFO:tasks.ceph.mgr.x.smithi019.stderr: in thread 7fc8503b2700 thread_name:ms_dispatch 2023-10-03T10:13:58.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.318+0000 7fa84affd700 1 -- 172.21.15.19:0/73506722 >> v1:172.21.15.19:6816/126819 conn(0x7fa82c02f510 legacy=0x7fa82c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-10-03T10:13:58.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.318+0000 7fa84affd700 1 -- 172.21.15.19:0/73506722 >> v1:172.21.15.19:6816/126819 conn(0x7fa82c02f510 legacy=0x7fa82c0319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-10-03T10:13:58.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.318+0000 7fa84affd700 1 --1- 172.21.15.19:0/73506722 >> v1:172.21.15.19:6816/126819 conn(0x7fa82c02f510 0x7fa82c0319c0 :-1 s=OPENED pgs=56 cs=1 l=1).handle_message read tag failed 2023-10-03T10:13:58.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.318+0000 7fa84affd700 1 --1- 172.21.15.19:0/73506722 >> v1:172.21.15.19:6816/126819 conn(0x7fa82c02f510 0x7fa82c0319c0 :-1 s=OPENED pgs=56 cs=1 l=1).fault on lossy channel, failing 2023-10-03T10:13:58.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.318+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 >> v1:172.21.15.19:6816/126819 conn(0x7fa82c02f510 legacy=0x7fa82c0319c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-03T10:13:58.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.618+0000 7fa843fff700 1 -- 172.21.15.19:0/73506722 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v36) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa84c121bf0 con 0x7fa84c09d930 2023-10-03T10:13:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 msgr2=0x7fa84c11e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa83c010fa0 tx=0x7fa83c00e640 comp rx=0 tx=0).stop 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 shutdown_connections 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa84c130f00 0x7fa84c11ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa84c09d930 0x7fa84c11e3f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 --2- 172.21.15.19:0/73506722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa84c09e240 0x7fa84c11e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.621+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 >> 172.21.15.19:0/73506722 conn(0x7fa84c099c30 msgr2=0x7fa84c0a0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.623+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 shutdown_connections 2023-10-03T10:13:58.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.623+0000 7fa851cb6700 1 -- 172.21.15.19:0/73506722 wait complete. 2023-10-03T10:13:58.624 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 1 pg_autoscale_mode to off 2023-10-03T10:13:58.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.746+0000 7fd32bc78700 1 Processor -- start 2023-10-03T10:13:58.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.746+0000 7fd32bc78700 1 -- start start 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32bc78700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 0x7fd32413d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32bc78700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd32413d7e0 0x7fd32413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32bc78700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd324137bb0 con 0x7fd324138000 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32bc78700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32409f000 con 0x7fd32413d7e0 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32bc78700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd324138ae0 con 0x7fd32413aec0 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32a215700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd32413d7e0 0x7fd32413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd329a14700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd324138000 0x7fd3241383d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37240/0 (socket says 172.21.15.19:37240) 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd329a14700 1 -- 172.21.15.19:0/3453445935 learned_addr learned my addr 172.21.15.19:0/3453445935 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:13:58.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd329213700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 0x7fd32413d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32a215700 1 -- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 msgr2=0x7fd32413d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32a215700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 0x7fd32413d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32a215700 1 -- 172.21.15.19:0/3453445935 >> v1:172.21.15.19:6789/0 conn(0x7fd324138000 legacy=0x7fd3241383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd32a215700 1 -- 172.21.15.19:0/3453445935 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32409ae50 con 0x7fd32413d7e0 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd328a12700 1 -- 172.21.15.19:0/3453445935 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684158465 0 0) 0x7fd324137bb0 con 0x7fd324138000 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.747+0000 7fd329213700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 0x7fd32413d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32a215700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd32413fbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18080fa31257975 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd328a12700 1 -- 172.21.15.19:0/3453445935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011830 con 0x7fd32413d7e0 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd328a12700 1 -- 172.21.15.19:0/3453445935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c011990 con 0x7fd32413d7e0 2023-10-03T10:13:58.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd328a12700 1 -- 172.21.15.19:0/3453445935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c011d20 con 0x7fd32413d7e0 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 -- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 msgr2=0x7fd32413fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd32413fbc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009840 tx=0x7fd31c009b50 comp rx=0 tx=0).stop 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 -- 172.21.15.19:0/3453445935 shutdown_connections 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd32413fbc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 --2- 172.21.15.19:0/3453445935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd32413aec0 0x7fd32413d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.748+0000 7fd32bc78700 1 -- 172.21.15.19:0/3453445935 >> 172.21.15.19:0/3453445935 conn(0x7fd3240a29e0 msgr2=0x7fd3240a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:58.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.749+0000 7fd32bc78700 1 -- 172.21.15.19:0/3453445935 shutdown_connections 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.749+0000 7fd32bc78700 1 -- 172.21.15.19:0/3453445935 wait complete. 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.749+0000 7fd32bc78700 1 Processor -- start 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 -- start start 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd32413aec0 0x7fd3241cd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd3241cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324121700 con 0x7fd32413d7e0 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324121e80 con 0x7fd32413aec0 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32bc78700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd32413d2b0 con 0x7fd324138000 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41796/0 (socket says 172.21.15.19:41796) 2023-10-03T10:13:58.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 -- 172.21.15.19:0/1857940238 learned_addr learned my addr 172.21.15.19:0/1857940238 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329213700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd32413aec0 0x7fd3241cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd32a215700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd3241cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 -- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd32413aec0 msgr2=0x7fd3241cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd32413aec0 0x7fd3241cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 -- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 msgr2=0x7fd3241cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd3241cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.750+0000 7fd329a14700 1 -- 172.21.15.19:0/1857940238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3180094a0 con 0x7fd324138000 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd329a14700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cbe0 tx=0x7fd31400cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400aaa0 con 0x7fd324138000 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400ac00 con 0x7fd324138000 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140070d0 con 0x7fd324138000 2023-10-03T10:13:58.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0094a0 con 0x7fd324138000 2023-10-03T10:13:58.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.751+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32409a4c0 con 0x7fd324138000 2023-10-03T10:13:58.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.752+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd314007230 con 0x7fd324138000 2023-10-03T10:13:58.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.752+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd324067710 con 0x7fd324138000 2023-10-03T10:13:58.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.752+0000 7fd329213700 1 -- 172.21.15.19:0/1857940238 >> v1:172.21.15.19:6816/126819 conn(0x7fd31002f510 legacy=0x7fd3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:13:58.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.752+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd31403f5b0 con 0x7fd324138000 2023-10-03T10:13:58.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.757+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd314019860 con 0x7fd324138000 2023-10-03T10:13:58.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.953+0000 7fd329213700 1 -- 172.21.15.19:0/1857940238 >> v1:172.21.15.19:6816/126819 conn(0x7fd31002f510 legacy=0x7fd3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:13:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:58.960+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd32404f2a0 con 0x7fd324138000 2023-10-03T10:13:59.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.354+0000 7fd329213700 1 -- 172.21.15.19:0/1857940238 >> v1:172.21.15.19:6816/126819 conn(0x7fd31002f510 legacy=0x7fd3100319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:13:59.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.626+0000 7fd3227fc700 1 -- 172.21.15.19:0/1857940238 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v37) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd31401a310 con 0x7fd324138000 2023-10-03T10:13:59.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 >> v1:172.21.15.19:6816/126819 conn(0x7fd31002f510 legacy=0x7fd3100319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 msgr2=0x7fd3241ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd31400cbe0 tx=0x7fd31400cef0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 shutdown_connections 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd32413d7e0 0x7fd3241cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd324138000 0x7fd3241ccad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 --2- 172.21.15.19:0/1857940238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd32413aec0 0x7fd3241cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 >> 172.21.15.19:0/1857940238 conn(0x7fd3240a29e0 msgr2=0x7fd32409f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.629+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 shutdown_connections 2023-10-03T10:13:59.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.630+0000 7fd32bc78700 1 -- 172.21.15.19:0/1857940238 wait complete. 2023-10-03T10:13:59.631 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 2 pg_autoscale_mode to off 2023-10-03T10:13:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.753+0000 7f2920759700 1 Processor -- start 2023-10-03T10:13:59.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.753+0000 7f2920759700 1 -- start start 2023-10-03T10:13:59.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f2920759700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f2920759700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f2920759700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291809b120 con 0x7f29181306d0 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f2920759700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f291809b2d0 con 0x7f2918099c30 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f2920759700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f291809a5d0 con 0x7f291812fdc0 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291ecf6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41808/0 (socket says 172.21.15.19:41808) 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291ecf6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51928/0 (socket says 172.21.15.19:51928) 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 -- 172.21.15.19:0/1524328160 learned_addr learned my addr 172.21.15.19:0/1524328160 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291dcf4700 1 --1- 172.21.15.19:0/1524328160 >> v1:172.21.15.19:6789/0 conn(0x7f29181306d0 0x7f2918099520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37248/0 (socket says 172.21.15.19:37248) 2023-10-03T10:13:59.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291d4f3700 1 -- 172.21.15.19:0/1524328160 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52214552 0 0) 0x7f291809b120 con 0x7f29181306d0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 -- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 msgr2=0x7f291809a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 -- 172.21.15.19:0/1524328160 >> v1:172.21.15.19:6789/0 conn(0x7f29181306d0 legacy=0x7f2918099520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291e4f5700 1 -- 172.21.15.19:0/1524328160 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f291809c430 con 0x7f291812fdc0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.754+0000 7f291ecf6700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f291e4f5700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2914009920 tx=0x7f2914009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9f8a2129cd1b082 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f291d4f3700 1 -- 172.21.15.19:0/1524328160 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011830 con 0x7f291812fdc0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f291d4f3700 1 -- 172.21.15.19:0/1524328160 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2914011990 con 0x7f291812fdc0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f291d4f3700 1 -- 172.21.15.19:0/1524328160 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2914011d20 con 0x7f291812fdc0 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 -- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 msgr2=0x7f2918130190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2914009920 tx=0x7f2914009c30 comp rx=0 tx=0).stop 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 -- 172.21.15.19:0/1524328160 shutdown_connections 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2918099c30 0x7f291809a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 --2- 172.21.15.19:0/1524328160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f291812fdc0 0x7f2918130190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.755+0000 7f2920759700 1 -- 172.21.15.19:0/1524328160 >> 172.21.15.19:0/1524328160 conn(0x7f29180a2c80 msgr2=0x7f291809eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.756+0000 7f2920759700 1 -- 172.21.15.19:0/1524328160 shutdown_connections 2023-10-03T10:13:59.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.756+0000 7f2920759700 1 -- 172.21.15.19:0/1524328160 wait complete. 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 Processor -- start 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 -- start start 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 0x7f2918095940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 0x7f2918095e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2918071c70 con 0x7f291812fdc0 2023-10-03T10:13:59.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2918098d20 con 0x7f29181306d0 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f2920759700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2918097030 con 0x7f2918099c30 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f291e4f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f291ecf6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 0x7f2918095e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f291dcf4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 0x7f2918095940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f291e4f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41820/0 (socket says 172.21.15.19:41820) 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.757+0000 7f291e4f5700 1 -- 172.21.15.19:0/1909730696 learned_addr learned my addr 172.21.15.19:0/1909730696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 -- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 msgr2=0x7f2918093ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 -- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 msgr2=0x7f2918095940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 0x7f2918095940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 -- 172.21.15.19:0/1909730696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910009a70 con 0x7f29181306d0 2023-10-03T10:13:59.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291e4f5700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291dcf4700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 0x7f2918095940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f291ecf6700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 0x7f2918095e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f291000efc0 tx=0x7f291000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000ca90 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f291000f040 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000ce30 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914009550 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.758+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29180713a0 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.759+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2910014480 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.759+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f29100401f0 con 0x7f29181306d0 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.759+0000 7f291e4f5700 1 -- 172.21.15.19:0/1909730696 >> v1:172.21.15.19:6816/126819 conn(0x7f28fc02f540 legacy=0x7f28fc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:13:59.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.759+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291804f2a0 con 0x7f29181306d0 2023-10-03T10:13:59.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.764+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2910018070 con 0x7f29181306d0 2023-10-03T10:13:59.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.960+0000 7f291e4f5700 1 -- 172.21.15.19:0/1909730696 >> v1:172.21.15.19:6816/126819 conn(0x7f28fc02f540 legacy=0x7f28fc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:13:59.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:13:59.963+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f2918067390 con 0x7f29181306d0 2023-10-03T10:14:00.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.361+0000 7f291e4f5700 1 -- 172.21.15.19:0/1909730696 >> v1:172.21.15.19:6816/126819 conn(0x7f28fc02f540 legacy=0x7f28fc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.633+0000 7f290effd700 1 -- 172.21.15.19:0/1909730696 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v38) v1 ==== 164+0+0 (secure 0 0 0) 0x7f2910018070 con 0x7f29181306d0 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 >> v1:172.21.15.19:6816/126819 conn(0x7f28fc02f540 legacy=0x7f28fc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 msgr2=0x7f2918095e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 0x7f2918095e80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f291000efc0 tx=0x7f291000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 shutdown_connections 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29181306d0 0x7f2918095e80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2918099c30 0x7f2918093ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 --2- 172.21.15.19:0/1909730696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f291812fdc0 0x7f2918095940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 >> 172.21.15.19:0/1909730696 conn(0x7f29180a2c80 msgr2=0x7f29181290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 shutdown_connections 2023-10-03T10:14:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.636+0000 7f2920759700 1 -- 172.21.15.19:0/1909730696 wait complete. 2023-10-03T10:14:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 3 pg_autoscale_mode to off 2023-10-03T10:14:00.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 Processor -- start 2023-10-03T10:14:00.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 -- start start 2023-10-03T10:14:00.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 0x7f88f0136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 0x7f88f0139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f009abd0 con 0x7f88f009e9d0 2023-10-03T10:14:00.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f006fd90 con 0x7f88f0137140 2023-10-03T10:14:00.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.761+0000 7f88f7306700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0071e80 con 0x7f88f009f4b0 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f48a1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 0x7f88f0136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f50a2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f88f009e9d0 0x7f88f009eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37262/0 (socket says 172.21.15.19:37262) 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f50a2700 1 -- 172.21.15.19:0/2089670261 learned_addr learned my addr 172.21.15.19:0/2089670261 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 0x7f88f0139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 -- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 msgr2=0x7f88f0136c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 0x7f88f0136c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88e7fff700 1 -- 172.21.15.19:0/2089670261 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399229211 0 0) 0x7f88f009abd0 con 0x7f88f009e9d0 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 -- 172.21.15.19:0/2089670261 >> v1:172.21.15.19:6789/0 conn(0x7f88f009e9d0 legacy=0x7f88f009eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 -- 172.21.15.19:0/2089670261 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f00a0240 con 0x7f88f0137140 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f48a1700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 0x7f88f0136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88f58a3700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 0x7f88f0139520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009dc0 tx=0x7f88e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d555bf330ba3c90f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88e7fff700 1 -- 172.21.15.19:0/2089670261 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e800e070 con 0x7f88f0137140 2023-10-03T10:14:00.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88e7fff700 1 -- 172.21.15.19:0/2089670261 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e800bb20 con 0x7f88f0137140 2023-10-03T10:14:00.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.762+0000 7f88e7fff700 1 -- 172.21.15.19:0/2089670261 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8012430 con 0x7f88f0137140 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 -- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 msgr2=0x7f88f0139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 0x7f88f0139520 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009dc0 tx=0x7f88e800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 -- 172.21.15.19:0/2089670261 shutdown_connections 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f0137140 0x7f88f0139520 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 --2- 172.21.15.19:0/2089670261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009f4b0 0x7f88f0136c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 -- 172.21.15.19:0/2089670261 >> 172.21.15.19:0/2089670261 conn(0x7f88f00a43c0 msgr2=0x7f88f00a47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 -- 172.21.15.19:0/2089670261 shutdown_connections 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.763+0000 7f88f7306700 1 -- 172.21.15.19:0/2089670261 wait complete. 2023-10-03T10:14:00.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 Processor -- start 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 -- start start 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 0x7f88f011fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f009db80 con 0x7f88f0137140 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f0071450 con 0x7f88f009f4b0 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.764+0000 7f88f7306700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88f01225e0 con 0x7f88f009e9d0 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f50a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51952/0 (socket says 172.21.15.19:51952) 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 -- 172.21.15.19:0/2766454915 learned_addr learned my addr 172.21.15.19:0/2766454915 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:00.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f50a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41828/0 (socket says 172.21.15.19:41828) 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f58a3700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 0x7f88f011fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 -- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 msgr2=0x7f88f011f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 -- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 msgr2=0x7f88f011fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 0x7f88f011fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 -- 172.21.15.19:0/2766454915 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e00094a0 con 0x7f88f009f4b0 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f50a2700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f58a3700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 0x7f88f011fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f48a1700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88e000ebe0 tx=0x7f88e000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000c850 con 0x7f88f009f4b0 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e000c9b0 con 0x7f88f009f4b0 2023-10-03T10:14:00.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e000cd40 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.765+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e8009a70 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.766+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f01216f0 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.767+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f004f2a0 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.767+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f88e0013470 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.767+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f88e0040460 con 0x7f88f009f4b0 2023-10-03T10:14:00.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.767+0000 7f88f50a2700 1 -- 172.21.15.19:0/2766454915 >> v1:172.21.15.19:6816/126819 conn(0x7f88d402f510 legacy=0x7f88d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:00.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.772+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88e0013720 con 0x7f88f009f4b0 2023-10-03T10:14:00.806 INFO:tasks.ceph.mgr.x.smithi019.stderr:daemon-helper: command crashed with signal 6 2023-10-03T10:14:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.968+0000 7f88f50a2700 1 -- 172.21.15.19:0/2766454915 >> v1:172.21.15.19:6816/126819 conn(0x7f88d402f510 legacy=0x7f88d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:00.978+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f88f0122190 con 0x7f88f009f4b0 2023-10-03T10:14:01.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.369+0000 7f88f50a2700 1 -- 172.21.15.19:0/2766454915 >> v1:172.21.15.19:6816/126819 conn(0x7f88d402f510 legacy=0x7f88d40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:01.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.641+0000 7f88e5ffb700 1 -- 172.21.15.19:0/2766454915 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v39) v1 ==== 160+0+0 (secure 0 0 0) 0x7f88e0021070 con 0x7f88f009f4b0 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 >> v1:172.21.15.19:6816/126819 conn(0x7f88d402f510 legacy=0x7f88d40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 msgr2=0x7f88f011f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88e000ebe0 tx=0x7f88e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 shutdown_connections 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88f0137140 0x7f88f011fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88f009e9d0 0x7f88f011f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 --2- 172.21.15.19:0/2766454915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88f009f4b0 0x7f88f011f8c0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88e000ebe0 tx=0x7f88e000eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 >> 172.21.15.19:0/2766454915 conn(0x7f88f00a43c0 msgr2=0x7f88f00a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.645+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 shutdown_connections 2023-10-03T10:14:01.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.648+0000 7f88f7306700 1 -- 172.21.15.19:0/2766454915 wait complete. 2023-10-03T10:14:01.649 INFO:teuthology.orchestra.run.smithi019.stderr:set pool 4 pg_autoscale_mode to off 2023-10-03T10:14:01.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release reef' 2023-10-03T10:14:01.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 Processor -- start 2023-10-03T10:14:01.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 -- start start 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 0x7fcbdc09dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcbdc09e260 0x7fcbdc130780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 0x7fcbdc131140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc09f510 con 0x7fcbdc09e260 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc09bd00 con 0x7fcbdc130cc0 2023-10-03T10:14:01.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.803+0000 7fcbe2228700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc09a350 con 0x7fcbdc09d950 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcbdc09e260 0x7fcbdc130780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 0x7fcbdc131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 0x7fcbdc09dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcbdc09e260 0x7fcbdc130780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58016/0 (socket says 172.21.15.19:58016) 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 0x7fcbdc131140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51960/0 (socket says 172.21.15.19:51960) 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 -- 172.21.15.19:0/1933077146 learned_addr learned my addr 172.21.15.19:0/1933077146 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 -- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 msgr2=0x7fcbdc09dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 0x7fcbdc09dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 -- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 msgr2=0x7fcbdc131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 0x7fcbdc131140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 -- 172.21.15.19:0/1933077146 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc09ac70 con 0x7fcbdc09e260 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdb7fe700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 0x7fcbdc09dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbdaffd700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09e260 0x7fcbdc130780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fdbfac6c71c331 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbda7fc700 1 -- 172.21.15.19:0/1933077146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc005e30 con 0x7fcbdc09e260 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbda7fc700 1 -- 172.21.15.19:0/1933077146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc004030 con 0x7fcbdc09e260 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.804+0000 7fcbda7fc700 1 -- 172.21.15.19:0/1933077146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0043e0 con 0x7fcbdc09e260 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 -- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09e260 msgr2=0x7fcbdc130780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09e260 0x7fcbdc130780 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc009bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 -- 172.21.15.19:0/1933077146 shutdown_connections 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc130cc0 0x7fcbdc131140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc09d950 0x7fcbdc09dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 --2- 172.21.15.19:0/1933077146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09e260 0x7fcbdc130780 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 -- 172.21.15.19:0/1933077146 >> 172.21.15.19:0/1933077146 conn(0x7fcbdc0a2f50 msgr2=0x7fcbdc0a3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:01.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 -- 172.21.15.19:0/1933077146 shutdown_connections 2023-10-03T10:14:01.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.805+0000 7fcbe2228700 1 -- 172.21.15.19:0/1933077146 wait complete. 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.806+0000 7fcbe2228700 1 Processor -- start 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.806+0000 7fcbe2228700 1 -- start start 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc09e260 0x7fcbdc122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 0x7fcbdc122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc124060 con 0x7fcbdc09d950 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc1259d0 con 0x7fcbdc09e260 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbe2228700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc125f70 con 0x7fcbdc130cc0 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58026/0 (socket says 172.21.15.19:58026) 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 -- 172.21.15.19:0/2394840087 learned_addr learned my addr 172.21.15.19:0/2394840087 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdbfff700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 0x7fcbdc122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdaffd700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc09e260 0x7fcbdc122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 -- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 msgr2=0x7fcbdc122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 0x7fcbdc122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 -- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc09e260 msgr2=0x7fcbdc122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc09e260 0x7fcbdc122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 -- 172.21.15.19:0/2394840087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc400b6d0 con 0x7fcbdc09d950 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdbfff700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 0x7fcbdc122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.807+0000 7fcbdb7fe700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400ed40 tx=0x7fcbc400d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400dd90 con 0x7fcbdc09d950 2023-10-03T10:14:01.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc4005a20 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc009500 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4005d90 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc09cb00 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.808+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcbc4006030 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.809+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcbc4040210 con 0x7fcbdc09d950 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.809+0000 7fcbdaffd700 1 -- 172.21.15.19:0/2394840087 >> v1:172.21.15.19:6816/126819 conn(0x7fcbbc02f510 legacy=0x7fcbbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:01.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.809+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc04f2a0 con 0x7fcbdc09d950 2023-10-03T10:14:01.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:01.814+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbc401d070 con 0x7fcbdc09d950 2023-10-03T10:14:02.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.010+0000 7fcbdaffd700 1 -- 172.21.15.19:0/2394840087 >> v1:172.21.15.19:6816/126819 conn(0x7fcbbc02f510 legacy=0x7fcbbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.031+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd require-osd-release", "release": "reef"} v 0) v1 -- 0x7fcbdc0727b0 con 0x7fcbdc09d950 2023-10-03T10:14:02.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.411+0000 7fcbdaffd700 1 -- 172.21.15.19:0/2394840087 >> v1:172.21.15.19:6816/126819 conn(0x7fcbbc02f510 legacy=0x7fcbbc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.646+0000 7fcbd3fff700 1 -- 172.21.15.19:0/2394840087 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "reef"}]=0 v40) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcbc401f8f0 con 0x7fcbdc09d950 2023-10-03T10:14:02.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 >> v1:172.21.15.19:6816/126819 conn(0x7fcbbc02f510 legacy=0x7fcbbc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 msgr2=0x7fcbdc1224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400ed40 tx=0x7fcbc400d630 comp rx=0 tx=0).stop 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 shutdown_connections 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbdc130cc0 0x7fcbdc122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbdc09d950 0x7fcbdc1224e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 --2- 172.21.15.19:0/2394840087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbdc09e260 0x7fcbdc122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.650+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 >> 172.21.15.19:0/2394840087 conn(0x7fcbdc0a2f50 msgr2=0x7fcbdc0a0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.651+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 shutdown_connections 2023-10-03T10:14:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.651+0000 7fcbe2228700 1 -- 172.21.15.19:0/2394840087 wait complete. 2023-10-03T10:14:02.667 INFO:teuthology.run_tasks:Running task ceph.healthy... 2023-10-03T10:14:02.678 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-03T10:14:02.678 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-03T10:14:02.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-03T10:14:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.820+0000 7ff9e601d700 1 Processor -- start 2023-10-03T10:14:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.820+0000 7ff9e601d700 1 -- start start 2023-10-03T10:14:02.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.820+0000 7ff9e601d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e00a0a30 0x7ff9e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9e601d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9e601d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 0x7ff9e0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9e601d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e009edd0 con 0x7ff9e00a0a30 2023-10-03T10:14:02.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9e601d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e009e1f0 con 0x7ff9e0133fa0 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9e601d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e009dc50 con 0x7ff9e00a1340 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 0x7ff9e0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9e00a0a30 0x7ff9e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41866/0 (socket says 172.21.15.19:41866) 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9deffd700 1 -- 172.21.15.19:0/4228456037 learned_addr learned my addr 172.21.15.19:0/4228456037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 -- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 msgr2=0x7ff9e0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 -- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 msgr2=0x7ff9e0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 0x7ff9e0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 -- 172.21.15.19:0/4228456037 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00a1fe0 con 0x7ff9e00a0a30 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9dffff700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 0x7ff9e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9deffd700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00a0a30 0x7ff9e00a0e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009840 tx=0x7ff9d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff61f849f4637b7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9de7fc700 1 -- 172.21.15.19:0/4228456037 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0011830 con 0x7ff9e00a0a30 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.821+0000 7ff9de7fc700 1 -- 172.21.15.19:0/4228456037 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d0011990 con 0x7ff9e00a0a30 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9de7fc700 1 -- 172.21.15.19:0/4228456037 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0011d20 con 0x7ff9e00a0a30 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 -- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00a0a30 msgr2=0x7ff9e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00a0a30 0x7ff9e00a0e00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009840 tx=0x7ff9d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 -- 172.21.15.19:0/4228456037 shutdown_connections 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e0133fa0 0x7ff9e0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e00a0a30 0x7ff9e00a0e00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 --2- 172.21.15.19:0/4228456037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a1340 0x7ff9e0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 -- 172.21.15.19:0/4228456037 >> 172.21.15.19:0/4228456037 conn(0x7ff9e00a6550 msgr2=0x7ff9e00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 -- 172.21.15.19:0/4228456037 shutdown_connections 2023-10-03T10:14:02.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.822+0000 7ff9e601d700 1 -- 172.21.15.19:0/4228456037 wait complete. 2023-10-03T10:14:02.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.823+0000 7ff9e601d700 1 Processor -- start 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.823+0000 7ff9e601d700 1 -- start start 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 0x7ff9e0120940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01337a0 con 0x7ff9e0133fa0 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0123210 con 0x7ff9e00a1340 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9e601d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0123bf0 con 0x7ff9e00a0a30 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 0x7ff9e0120940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41882/0 (socket says 172.21.15.19:41882) 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9deffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 0x7ff9e0120940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51992/0 (socket says 172.21.15.19:51992) 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9dffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58032/0 (socket says 172.21.15.19:58032) 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 -- 172.21.15.19:0/2534193419 learned_addr learned my addr 172.21.15.19:0/2534193419 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 -- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 msgr2=0x7ff9e0120940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 0x7ff9e0120940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 -- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 msgr2=0x7ff9e0120e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 -- 172.21.15.19:0/2534193419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009550 con 0x7ff9e00a0a30 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9dffff700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.824+0000 7ff9df7fe700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009fd0 tx=0x7ff9d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0004450 con 0x7ff9e00a0a30 2023-10-03T10:14:02.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d001f070 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d8009a70 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d00038e0 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d00094a0 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.825+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff9d0003a40 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.826+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff9d0021070 con 0x7ff9e00a0a30 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.826+0000 7ff9deffd700 1 -- 172.21.15.19:0/2534193419 >> v1:172.21.15.19:6816/126819 conn(0x7ff9c002f510 legacy=0x7ff9c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.826+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e00a5360 con 0x7ff9e00a0a30 2023-10-03T10:14:02.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:02.830+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9d002b020 con 0x7ff9e00a0a30 2023-10-03T10:14:03.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.027+0000 7ff9deffd700 1 -- 172.21.15.19:0/2534193419 >> v1:172.21.15.19:6816/126819 conn(0x7ff9c002f510 legacy=0x7ff9c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:03.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.089+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff9e00a3410 con 0x7ff9e00a0a30 2023-10-03T10:14:03.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.091+0000 7ff9d7fff700 1 -- 172.21.15.19:0/2534193419 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v9) v1 ==== 74+0+70482 (secure 0 0 0) 0x7ff9d0015070 con 0x7ff9e00a0a30 2023-10-03T10:14:03.091 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 >> v1:172.21.15.19:6816/126819 conn(0x7ff9c002f510 legacy=0x7ff9c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 msgr2=0x7ff9e0120400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009fd0 tx=0x7ff9d0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 shutdown_connections 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e0133fa0 0x7ff9e0120e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9e00a0a30 0x7ff9e0120400 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 --2- 172.21.15.19:0/2534193419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9e00a1340 0x7ff9e0120940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 >> 172.21.15.19:0/2534193419 conn(0x7ff9e00a6550 msgr2=0x7ff9e01bafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 shutdown_connections 2023-10-03T10:14:03.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.093+0000 7ff9e601d700 1 -- 172.21.15.19:0/2534193419 wait complete. 2023-10-03T10:14:03.106 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"active_gid":14104,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6816","nonce":126819}]},"active_addr":"172.21.15.19:6816/126819","active_change":"2023-10-03T10:13:29.532628+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":21,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2293884931}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":487355738}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":873784498}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2790929541}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":2339933701}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3138365138}]}]} 2023-10-03T10:14:03.108 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-03T10:14:03.109 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-03T10:14:03.109 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:14:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.244+0000 7ff6d8d97700 1 Processor -- start 2023-10-03T10:14:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.244+0000 7ff6d8d97700 1 -- start start 2023-10-03T10:14:03.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d8d97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d8d97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6d409e000 0x7ff6d4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d8d97700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d409f130 con 0x7ff6d409e410 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d8d97700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d409f520 con 0x7ff6d409e000 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d8d97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d409e930 con 0x7ff6d409d6f0 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6d409e000 0x7ff6d4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d2d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6d409e410 0x7ff6d4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37264/0 (socket says 172.21.15.19:37264) 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d2d9d700 1 -- 172.21.15.19:0/835608290 learned_addr learned my addr 172.21.15.19:0/835608290 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d1d9b700 1 -- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 msgr2=0x7ff6d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d1d9b700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d1d9b700 1 -- 172.21.15.19:0/835608290 >> v1:172.21.15.19:6789/0 conn(0x7ff6d409e410 legacy=0x7ff6d4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d159a700 1 -- 172.21.15.19:0/835608290 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885492301 0 0) 0x7ff6d409f130 con 0x7ff6d409e410 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d1d9b700 1 -- 172.21.15.19:0/835608290 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d409b2d0 con 0x7ff6d409e000 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.245+0000 7ff6d259c700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d1d9b700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e000 0x7ff6d4130660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009840 tx=0x7ff6bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450eb623fd765fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d159a700 1 -- 172.21.15.19:0/835608290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc011830 con 0x7ff6d409e000 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d159a700 1 -- 172.21.15.19:0/835608290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc011990 con 0x7ff6d409e000 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d159a700 1 -- 172.21.15.19:0/835608290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc011d20 con 0x7ff6d409e000 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d8d97700 1 -- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e000 msgr2=0x7ff6d4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.246+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e000 0x7ff6d4130660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009840 tx=0x7ff6bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 -- 172.21.15.19:0/835608290 shutdown_connections 2023-10-03T10:14:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/835608290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e000 0x7ff6d4130660 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 -- 172.21.15.19:0/835608290 >> 172.21.15.19:0/835608290 conn(0x7ff6d4066f50 msgr2=0x7ff6d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 -- 172.21.15.19:0/835608290 shutdown_connections 2023-10-03T10:14:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.247+0000 7ff6d8d97700 1 -- 172.21.15.19:0/835608290 wait complete. 2023-10-03T10:14:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 Processor -- start 2023-10-03T10:14:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 -- start start 2023-10-03T10:14:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6d409e000 0x7ff6d4120500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 0x7ff6d4120a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4123ae0 con 0x7ff6d409e410 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d41235d0 con 0x7ff6d409e000 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d8d97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40a1b80 con 0x7ff6d409d6f0 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 0x7ff6d4120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.248+0000 7ff6d259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41892/0 (socket says 172.21.15.19:41892) 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 -- 172.21.15.19:0/1418754037 learned_addr learned my addr 172.21.15.19:0/1418754037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d1d9b700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6d409e000 0x7ff6d4120500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 -- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6d409e000 msgr2=0x7ff6d4120500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6d409e000 0x7ff6d4120500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 -- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 msgr2=0x7ff6d4120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 0x7ff6d4120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 -- 172.21.15.19:0/1418754037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40094a0 con 0x7ff6d409d6f0 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d2d9d700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 0x7ff6d4120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d259c700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400ebe0 tx=0x7ff6c400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400c850 con 0x7ff6d409d6f0 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c400c9b0 con 0x7ff6d409d6f0 2023-10-03T10:14:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc0094a0 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c400cd40 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.249+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d409c700 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.250+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff6c4013470 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.250+0000 7ff6d1d9b700 1 -- 172.21.15.19:0/1418754037 >> v1:172.21.15.19:6816/126819 conn(0x7ff6b402f510 legacy=0x7ff6b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.250+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff6c4040020 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.250+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4122eb0 con 0x7ff6d409d6f0 2023-10-03T10:14:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.255+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6c4021020 con 0x7ff6d409d6f0 2023-10-03T10:14:03.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.451+0000 7ff6d1d9b700 1 -- 172.21.15.19:0/1418754037 >> v1:172.21.15.19:6816/126819 conn(0x7ff6b402f510 legacy=0x7ff6b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:03.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.462+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d41303e0 con 0x7ff6d409d6f0 2023-10-03T10:14:03.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.463+0000 7ff6caffd700 1 -- 172.21.15.19:0/1418754037 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12963 (secure 0 0 0) 0x7ff6c4017070 con 0x7ff6d409d6f0 2023-10-03T10:14:03.463 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:14:03.463 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":40,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:14:02.643385+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":33,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6817/497268310":"2023-10-04T10:13:56.033183+0000","172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:14:03.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 >> v1:172.21.15.19:6816/126819 conn(0x7ff6b402f510 legacy=0x7ff6b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:03.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 msgr2=0x7ff6d411ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400ebe0 tx=0x7ff6c400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 shutdown_connections 2023-10-03T10:14:03.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6d409e410 0x7ff6d4120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6d409d6f0 0x7ff6d411ffc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 --2- 172.21.15.19:0/1418754037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6d409e000 0x7ff6d4120500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 >> 172.21.15.19:0/1418754037 conn(0x7ff6d4066f50 msgr2=0x7ff6d40710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 shutdown_connections 2023-10-03T10:14:03.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.466+0000 7ff6d8d97700 1 -- 172.21.15.19:0/1418754037 wait complete. 2023-10-03T10:14:03.480 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-03T10:14:03.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:14:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.616+0000 7fb768b49700 1 Processor -- start 2023-10-03T10:14:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.616+0000 7fb768b49700 1 -- start start 2023-10-03T10:14:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb768b49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb76409d6f0 0x7fb76409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb768b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 0x7fb764130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb768b49700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76409f130 con 0x7fb76409e410 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb768b49700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76409f520 con 0x7fb76409d6f0 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb768b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb76409e930 con 0x7fb76409e000 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb761d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 0x7fb764130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb76409d6f0 0x7fb76409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb762d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb76409e410 0x7fb764130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37272/0 (socket says 172.21.15.19:37272) 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb762d9d700 1 -- 172.21.15.19:0/4035977107 learned_addr learned my addr 172.21.15.19:0/4035977107 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 -- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 msgr2=0x7fb764130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 0x7fb764130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 -- 172.21.15.19:0/4035977107 >> v1:172.21.15.19:6789/0 conn(0x7fb76409e410 legacy=0x7fb764130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 -- 172.21.15.19:0/4035977107 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76409b2d0 con 0x7fb76409d6f0 2023-10-03T10:14:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb761d9b700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 0x7fb764130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.617+0000 7fb76259c700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb76409dac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb754009840 tx=0x7fb754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbcafe626903979 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb76159a700 1 -- 172.21.15.19:0/4035977107 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011830 con 0x7fb76409d6f0 2023-10-03T10:14:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb76159a700 1 -- 172.21.15.19:0/4035977107 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754011990 con 0x7fb76409d6f0 2023-10-03T10:14:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb76159a700 1 -- 172.21.15.19:0/4035977107 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754011d20 con 0x7fb76409d6f0 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 -- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 msgr2=0x7fb76409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb76409dac0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb754009840 tx=0x7fb754009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 -- 172.21.15.19:0/4035977107 shutdown_connections 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb76409dac0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 --2- 172.21.15.19:0/4035977107 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e000 0x7fb764130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 -- 172.21.15.19:0/4035977107 >> 172.21.15.19:0/4035977107 conn(0x7fb764066f50 msgr2=0x7fb76409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 -- 172.21.15.19:0/4035977107 shutdown_connections 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.618+0000 7fb768b49700 1 -- 172.21.15.19:0/4035977107 wait complete. 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.619+0000 7fb768b49700 1 Processor -- start 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.619+0000 7fb768b49700 1 -- start start 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb76409e000 0x7fb76413a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e410 0x7fb76413a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7641370c0 con 0x7fb76409d6f0 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764138280 con 0x7fb76409e000 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb768b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb76409c700 con 0x7fb76409e410 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58086/0 (socket says 172.21.15.19:58086) 2023-10-03T10:14:03.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 -- 172.21.15.19:0/2757566155 learned_addr learned my addr 172.21.15.19:0/2757566155 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb761d9b700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb76409e000 0x7fb76413a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb762d9d700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e410 0x7fb76413a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 -- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e410 msgr2=0x7fb76413a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e410 0x7fb76413a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 -- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb76409e000 msgr2=0x7fb76413a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb76409e000 0x7fb76413a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.620+0000 7fb76259c700 1 -- 172.21.15.19:0/2757566155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c0094a0 con 0x7fb76409d6f0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb76259c700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb754009fd0 tx=0x7fb754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540036a0 con 0x7fb76409d6f0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75401f070 con 0x7fb76409d6f0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540094a0 con 0x7fb76409d6f0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754003a60 con 0x7fb76409d6f0 2023-10-03T10:14:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.621+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb764137920 con 0x7fb76409d6f0 2023-10-03T10:14:03.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.622+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb754003bc0 con 0x7fb76409d6f0 2023-10-03T10:14:03.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.622+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb754021070 con 0x7fb76409d6f0 2023-10-03T10:14:03.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.622+0000 7fb761d9b700 1 -- 172.21.15.19:0/2757566155 >> v1:172.21.15.19:6816/126819 conn(0x7fb74402f510 legacy=0x7fb7440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:03.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.622+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb764138990 con 0x7fb76409d6f0 2023-10-03T10:14:03.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.627+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb75401a430 con 0x7fb76409d6f0 2023-10-03T10:14:03.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.823+0000 7fb761d9b700 1 -- 172.21.15.19:0/2757566155 >> v1:172.21.15.19:6816/126819 conn(0x7fb74402f510 legacy=0x7fb7440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.834+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb764074ea0 con 0x7fb76409d6f0 2023-10-03T10:14:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.835+0000 7fb75affd700 1 -- 172.21.15.19:0/2757566155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12963 (secure 0 0 0) 0x7fb7540372c0 con 0x7fb76409d6f0 2023-10-03T10:14:03.835 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:14:03.835 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":40,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:14:02.643385+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":33,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6817/497268310":"2023-10-04T10:13:56.033183+0000","172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:14:03.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 >> v1:172.21.15.19:6816/126819 conn(0x7fb74402f510 legacy=0x7fb7440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 msgr2=0x7fb764139bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb754009fd0 tx=0x7fb754004750 comp rx=0 tx=0).stop 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 shutdown_connections 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb76409e410 0x7fb76413a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb76409d6f0 0x7fb764139bb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 --2- 172.21.15.19:0/2757566155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb76409e000 0x7fb76413a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 >> 172.21.15.19:0/2757566155 conn(0x7fb764066f50 msgr2=0x7fb7640a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.837+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 shutdown_connections 2023-10-03T10:14:03.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:03.838+0000 7fb768b49700 1 -- 172.21.15.19:0/2757566155 wait complete. 2023-10-03T10:14:03.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-03T10:14:03.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-03T10:14:03.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-03T10:14:03.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-03T10:14:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.004+0000 7fc4c3155700 1 Processor -- start 2023-10-03T10:14:04.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.004+0000 7f44eec2a700 1 Processor -- start 2023-10-03T10:14:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.004+0000 7fc4c3155700 1 -- start start 2023-10-03T10:14:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.004+0000 7f44eec2a700 1 -- start start 2023-10-03T10:14:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c3155700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09e930 0x7fc4bc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c3155700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 0x7fc4bc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44eec2a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e809d630 0x7f44e80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44eec2a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44e8138d80 0x7f44e813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44eec2a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e80a2a70 con 0x7f44e80a0a30 2023-10-03T10:14:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44eec2a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e80a01d0 con 0x7f44e8138d80 2023-10-03T10:14:04.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44eec2a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e809e2b0 con 0x7f44e809d630 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c3155700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc070940 con 0x7fc4bc09f650 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c3155700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc06fd60 con 0x7fc4bc09f240 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c3155700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc06fa80 con 0x7fc4bc09e930 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c16f2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc4bc09f650 0x7fc4bc131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37298/0 (socket says 172.21.15.19:37298) 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4c16f2700 1 -- 172.21.15.19:0/2596699672 learned_addr learned my addr 172.21.15.19:0/2596699672 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7fc4bbfff700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 0x7fc4bc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44ec9c6700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f44e80a0a30 0x7f44e80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37286/0 (socket says 172.21.15.19:37286) 2023-10-03T10:14:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.005+0000 7f44ec9c6700 1 -- 172.21.15.19:0/424262132 learned_addr learned my addr 172.21.15.19:0/424262132 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bb7fe700 1 -- 172.21.15.19:0/2596699672 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399127030 0 0) 0x7fc4bc070940 con 0x7fc4bc09f650 2023-10-03T10:14:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bb7fe700 1 -- 172.21.15.19:0/2596699672 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ac0035b0 con 0x7fc4bc09f650 2023-10-03T10:14:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 --2- 172.21.15.19:0/424262132 >> v2:172.21.15.19:3300/0 conn(0x7f44e8138d80 0x7f44e813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bbfff700 1 -- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09e930 msgr2=0x7fc4bc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bbfff700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09e930 0x7fc4bc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bbfff700 1 -- 172.21.15.19:0/2596699672 >> v1:172.21.15.19:6789/0 conn(0x7fc4bc09f650 legacy=0x7fc4bc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bbfff700 1 -- 172.21.15.19:0/2596699672 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc09fb60 con 0x7fc4bc09f240 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bbfff700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 0x7fc4bc1317f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=324feade704a76b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44e77fe700 1 -- 172.21.15.19:0/424262132 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899397346 0 0) 0x7f44e80a2a70 con 0x7f44e80a0a30 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44e77fe700 1 -- 172.21.15.19:0/424262132 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d80035b0 con 0x7f44e80a0a30 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 -- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e809d630 msgr2=0x7f44e80a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 --2- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e809d630 0x7f44e80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 -- 172.21.15.19:0/424262132 >> v1:172.21.15.19:6789/0 conn(0x7f44e80a0a30 legacy=0x7f44e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 -- 172.21.15.19:0/424262132 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e809dc50 con 0x7f44e8138d80 2023-10-03T10:14:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bb7fe700 1 -- 172.21.15.19:0/2596699672 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011830 con 0x7fc4bc09f240 2023-10-03T10:14:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bb7fe700 1 -- 172.21.15.19:0/2596699672 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a8011990 con 0x7fc4bc09f240 2023-10-03T10:14:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7fc4bb7fe700 1 -- 172.21.15.19:0/2596699672 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8011d20 con 0x7fc4bc09f240 2023-10-03T10:14:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.006+0000 7f44ed1c7700 1 --2- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e8138d80 0x7f44e813b160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f94bcb4bdb1ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7f44e77fe700 1 -- 172.21.15.19:0/424262132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e000e070 con 0x7f44e8138d80 2023-10-03T10:14:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7f44e77fe700 1 -- 172.21.15.19:0/424262132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e000bb20 con 0x7f44e8138d80 2023-10-03T10:14:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7f44e77fe700 1 -- 172.21.15.19:0/424262132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0012430 con 0x7f44e8138d80 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 -- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 msgr2=0x7fc4bc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 0x7fc4bc1317f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009870 tx=0x7fc4a8009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 -- 172.21.15.19:0/2596699672 shutdown_connections 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09e930 0x7fc4bc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 --2- 172.21.15.19:0/2596699672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09f240 0x7fc4bc1317f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 -- 172.21.15.19:0/2596699672 >> 172.21.15.19:0/2596699672 conn(0x7fc4bc0a4210 msgr2=0x7fc4bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7fc4c3155700 1 -- 172.21.15.19:0/2596699672 shutdown_connections 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7f44eec2a700 1 -- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e8138d80 msgr2=0x7f44e813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.007+0000 7f44eec2a700 1 --2- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e8138d80 0x7f44e813b160 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009d90 tx=0x7f44e000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7fc4c3155700 1 -- 172.21.15.19:0/2596699672 wait complete. 2023-10-03T10:14:04.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 -- 172.21.15.19:0/424262132 shutdown_connections 2023-10-03T10:14:04.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 --2- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e8138d80 0x7f44e813b160 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 --2- 172.21.15.19:0/424262132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e809d630 0x7f44e80a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 -- 172.21.15.19:0/424262132 >> 172.21.15.19:0/424262132 conn(0x7f44e80a3050 msgr2=0x7f44e80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 -- 172.21.15.19:0/424262132 shutdown_connections 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.008+0000 7f44eec2a700 1 -- 172.21.15.19:0/424262132 wait complete. 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 Processor -- start 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 -- start start 2023-10-03T10:14:04.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7f44eec2a700 1 Processor -- start 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09e930 0x7fc4bc06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09f240 0x7fc4bc06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4bc09f650 0x7fc4bc06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1b7220 con 0x7fc4bc09f650 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1a93d0 con 0x7fc4bc09e930 2023-10-03T10:14:04.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7fc4c3155700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1a9730 con 0x7fc4bc09f240 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7f44eec2a700 1 -- start start 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.009+0000 7f44eec2a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 0x7f44e812de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44eec2a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e80a0a30 0x7f44e812e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44eec2a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44e8138d80 0x7f44e812e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44eec2a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e812f100 con 0x7f44e809d630 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44eec2a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80a4b20 con 0x7f44e8138d80 2023-10-03T10:14:04.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44eec2a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44e80a0410 con 0x7f44e80a0a30 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c16f2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4bc09f650 0x7fc4bc06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c16f2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4bc09f650 0x7fc4bc06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58100/0 (socket says 172.21.15.19:58100) 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c16f2700 1 -- 172.21.15.19:0/2133822559 learned_addr learned my addr 172.21.15.19:0/2133822559 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 --2- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09e930 0x7fc4bc06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 0x7f44e812de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 0x7f44e812de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58102/0 (socket says 172.21.15.19:58102) 2023-10-03T10:14:04.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 -- 172.21.15.19:0/358597786 learned_addr learned my addr 172.21.15.19:0/358597786 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 -- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09f240 msgr2=0x7fc4bc06bdc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 --2- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4bc09f240 0x7fc4bc06bdc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 -- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4bc09f650 msgr2=0x7fc4bc06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 --2- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4bc09f650 0x7fc4bc06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7fc4c0ef1700 1 -- 172.21.15.19:0/2133822559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80094a0 con 0x7fc4bc09e930 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ed1c7700 1 --2- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44e8138d80 0x7f44e812e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 -- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e80a0a30 msgr2=0x7f44e812e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 --2- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44e80a0a30 0x7f44e812e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 -- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44e8138d80 msgr2=0x7f44e812e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 --2- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44e8138d80 0x7f44e812e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.010+0000 7f44ec9c6700 1 -- 172.21.15.19:0/358597786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e0009a70 con 0x7f44e809d630 2023-10-03T10:14:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7fc4c0ef1700 1 --2- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09e930 0x7fc4bc06b880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b480 tx=0x7fc4b000b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7f44ec9c6700 1 --2- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 0x7f44e812de40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00c700 tx=0x7f44dc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bea0 con 0x7fc4bc09e930 2023-10-03T10:14:04.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0a0190 con 0x7fc4bc09e930 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc005d70 con 0x7f44e809d630 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc0070d0 con 0x7f44e809d630 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc007440 con 0x7f44e809d630 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e8071530 con 0x7f44e809d630 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc1a9150 con 0x7fc4bc09e930 2023-10-03T10:14:04.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.011+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b0009280 con 0x7fc4bc09e930 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.012+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0011a30 con 0x7fc4bc09e930 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.012+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc49c000fb0 con 0x7fc4bc09e930 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.012+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e8070890 con 0x7f44e809d630 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc4b0011b90 con 0x7fc4bc09e930 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc4b003fa20 con 0x7fc4bc09e930 2023-10-03T10:14:04.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7fc4bbfff700 1 -- 172.21.15.19:0/2133822559 >> v1:172.21.15.19:6816/126819 conn(0x7fc4a002f510 legacy=0x7fc4a00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f44dc0075a0 con 0x7f44e809d630 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44e7fff700 1 -- 172.21.15.19:0/358597786 >> v1:172.21.15.19:6816/126819 conn(0x7f44cc02f510 legacy=0x7f44cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f44dc042220 con 0x7f44e809d630 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f44e809e940 con 0x7f44e809d630 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 --> v1:172.21.15.19:6812/130083 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f44cc03c2e0 con 0x7f44cc0385e0 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44dc0012d0 con 0x7f44e809d630 2023-10-03T10:14:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 --> v1:172.21.15.19:6808/129743 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4a003c1e0 con 0x7fc4a00384e0 2023-10-03T10:14:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.013+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b000f2e0 con 0x7fc4bc09e930 2023-10-03T10:14:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.014+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== osd.3 v1:172.21.15.19:6812/130083 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f44cc03c2e0 con 0x7f44cc0385e0 2023-10-03T10:14:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.017+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== osd.2 v1:172.21.15.19:6808/129743 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7fc4a003c1e0 con 0x7fc4a00384e0 2023-10-03T10:14:04.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.048+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 --> v1:172.21.15.19:6808/129743 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc49c002d00 con 0x7fc4a00384e0 2023-10-03T10:14:04.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.048+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 --> v1:172.21.15.19:6812/130083 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f44e80a2020 con 0x7f44cc0385e0 2023-10-03T10:14:04.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.048+0000 7fc4b97fa700 1 -- 172.21.15.19:0/2133822559 <== osd.2 v1:172.21.15.19:6808/129743 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7fc49c002d00 con 0x7fc4a00384e0 2023-10-03T10:14:04.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.048+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 >> v1:172.21.15.19:6808/129743 conn(0x7fc4a00384e0 legacy=0x7fc4a003a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7f44e57fa700 1 -- 172.21.15.19:0/358597786 <== osd.3 v1:172.21.15.19:6812/130083 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3960515336) 0x7f44e0003a20 con 0x7f44cc0385e0 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 >> v1:172.21.15.19:6816/126819 conn(0x7fc4a002f510 legacy=0x7fc4a00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09e930 msgr2=0x7fc4bc06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 --2- 172.21.15.19:0/2133822559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4bc09e930 0x7fc4bc06b880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000b480 tx=0x7fc4b000b790 comp rx=0 tx=0).stop 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c16f2700 1 -- 172.21.15.19:0/2133822559 reap_dead start 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 shutdown_connections 2023-10-03T10:14:04.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 >> 172.21.15.19:0/2133822559 conn(0x7fc4bc0a4210 msgr2=0x7fc4bc1b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 >> v1:172.21.15.19:6812/130083 conn(0x7f44cc0385e0 legacy=0x7f44cc03aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 shutdown_connections 2023-10-03T10:14:04.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.049+0000 7fc4c3155700 1 -- 172.21.15.19:0/2133822559 wait complete. 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 >> v1:172.21.15.19:6816/126819 conn(0x7f44cc02f510 legacy=0x7f44cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 msgr2=0x7f44e812de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44eec2a700 1 --2- 172.21.15.19:0/358597786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44e809d630 0x7f44e812de40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f44dc00c700 tx=0x7f44dc00ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44ed1c7700 1 -- 172.21.15.19:0/358597786 reap_dead start 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 shutdown_connections 2023-10-03T10:14:04.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.050+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 >> 172.21.15.19:0/358597786 conn(0x7f44e80a3050 msgr2=0x7f44e8099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.053+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 shutdown_connections 2023-10-03T10:14:04.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.053+0000 7f44eec2a700 1 -- 172.21.15.19:0/358597786 wait complete. 2023-10-03T10:14:04.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.055+0000 7f975d944700 1 Processor -- start 2023-10-03T10:14:04.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.055+0000 7f975d944700 1 -- start start 2023-10-03T10:14:04.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.055+0000 7f975d944700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 0x7f975806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.055+0000 7f975d944700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f975812f8b0 0x7f975812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f975d944700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975812cd90 con 0x7f9758130260 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f975d944700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975812d330 con 0x7f975812f8b0 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f975d944700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97581306e0 con 0x7f975812cf60 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f9756ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 0x7f975806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f975812f8b0 0x7f975812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f9756ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 0x7f975806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52032/0 (socket says 172.21.15.19:52032) 2023-10-03T10:14:04.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f9756ffd700 1 -- 172.21.15.19:0/371456009 learned_addr learned my addr 172.21.15.19:0/371456009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 -- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 msgr2=0x7f975806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 --2- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 0x7f975806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 -- 172.21.15.19:0/371456009 >> v1:172.21.15.19:6789/0 conn(0x7f9758130260 legacy=0x7f9758136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 -- 172.21.15.19:0/371456009 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758071780 con 0x7f975812f8b0 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.056+0000 7f97567fc700 1 --2- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f975812f8b0 0x7f975812fd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f974c00a9e0 tx=0x7f974c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa2a968c1e0551 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.057+0000 7f9755ffb700 1 -- 172.21.15.19:0/371456009 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00cb70 con 0x7f975812f8b0 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.057+0000 7f9755ffb700 1 -- 172.21.15.19:0/371456009 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c00ccd0 con 0x7f975812f8b0 2023-10-03T10:14:04.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.057+0000 7f9755ffb700 1 -- 172.21.15.19:0/371456009 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c018620 con 0x7f975812f8b0 2023-10-03T10:14:04.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.057+0000 7f1b20611700 1 Processor -- start 2023-10-03T10:14:04.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.057+0000 7f1b20611700 1 -- start start 2023-10-03T10:14:04.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 -- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f975812f8b0 msgr2=0x7f975812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 --2- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f975812f8b0 0x7f975812fd20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f974c00a9e0 tx=0x7f974c00acf0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 -- 172.21.15.19:0/371456009 shutdown_connections 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 --2- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812cf60 0x7f975806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 --2- 172.21.15.19:0/371456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f975812f8b0 0x7f975812fd20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 -- 172.21.15.19:0/371456009 >> 172.21.15.19:0/371456009 conn(0x7f97580a2aa0 msgr2=0x7f97580a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b20611700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 0x7f1b181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b20611700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b18134260 0x7f1b181306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b20611700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1806b990 con 0x7f1b18133e30 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b20611700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b180a0590 con 0x7f1b18134260 2023-10-03T10:14:04.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b20611700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1809fb80 con 0x7f1b18133420 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b1e3ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 0x7f1b181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 -- 172.21.15.19:0/371456009 shutdown_connections 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b1e3ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 0x7f1b181337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41950/0 (socket says 172.21.15.19:41950) 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b1e3ad700 1 -- 172.21.15.19:0/522239864 learned_addr learned my addr 172.21.15.19:0/522239864 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f1b1ebae700 1 --2- 172.21.15.19:0/522239864 >> v2:172.21.15.19:3300/0 conn(0x7f1b18134260 0x7f1b181306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.058+0000 7f975d944700 1 -- 172.21.15.19:0/371456009 wait complete. 2023-10-03T10:14:04.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1d3ab700 1 -- 172.21.15.19:0/522239864 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981829872 0 0) 0x7f1b1806b990 con 0x7f1b18133e30 2023-10-03T10:14:04.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1d3ab700 1 -- 172.21.15.19:0/522239864 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b040035b0 con 0x7f1b18133e30 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1ebae700 1 -- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 msgr2=0x7f1b181337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1ebae700 1 --2- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 0x7f1b181337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1ebae700 1 -- 172.21.15.19:0/522239864 >> v1:172.21.15.19:6789/0 conn(0x7f1b18133e30 legacy=0x7f1b1812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1ebae700 1 -- 172.21.15.19:0/522239864 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180a0030 con 0x7f1b18134260 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1ebae700 1 --2- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b181306a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009d90 tx=0x7f1b1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43de14b8c2cdb30b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1d3ab700 1 -- 172.21.15.19:0/522239864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000e070 con 0x7f1b18134260 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1d3ab700 1 -- 172.21.15.19:0/522239864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1000bb20 con 0x7f1b18134260 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.059+0000 7f1b1d3ab700 1 -- 172.21.15.19:0/522239864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1000be90 con 0x7f1b18134260 2023-10-03T10:14:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f975d944700 1 Processor -- start 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 -- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 msgr2=0x7f1b181306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 --2- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b181306a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009d90 tx=0x7f1b1000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 -- 172.21.15.19:0/522239864 shutdown_connections 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 --2- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b181306a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 --2- 172.21.15.19:0/522239864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133420 0x7f1b181337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f1b20611700 1 -- 172.21.15.19:0/522239864 >> 172.21.15.19:0/522239864 conn(0x7f1b180a4210 msgr2=0x7f1b180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.060+0000 7f975d944700 1 -- start start 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f975812cf60 0x7f9758099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 0x7f975809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9758130260 0x7f975809a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975811fac0 con 0x7f9758130260 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9758129bd0 con 0x7f975812f8b0 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f975d944700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f975811fd20 con 0x7f975812cf60 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f97567fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 0x7f975809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f97577fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9758130260 0x7f975809a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f97567fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 0x7f975809a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52034/0 (socket says 172.21.15.19:52034) 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f97567fc700 1 -- 172.21.15.19:0/874900929 learned_addr learned my addr 172.21.15.19:0/874900929 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f9756ffd700 1 --2- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f975812cf60 0x7f9758099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.061+0000 7f1b20611700 1 -- 172.21.15.19:0/522239864 shutdown_connections 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 -- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f975812cf60 msgr2=0x7f9758099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 --2- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f975812cf60 0x7f9758099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 -- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9758130260 msgr2=0x7f975809a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 --2- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9758130260 0x7f975809a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 -- 172.21.15.19:0/874900929 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c00a640 con 0x7f975812f8b0 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f97567fc700 1 --2- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 0x7f975809a290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f974c00a1c0 tx=0x7f974c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f1b20611700 1 -- 172.21.15.19:0/522239864 wait complete. 2023-10-03T10:14:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c003ab0 con 0x7f975812f8b0 2023-10-03T10:14:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c003c10 con 0x7f975812f8b0 2023-10-03T10:14:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c021480 con 0x7f975812f8b0 2023-10-03T10:14:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975812f520 con 0x7f975812f8b0 2023-10-03T10:14:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.063+0000 7f1b20611700 1 Processor -- start 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.063+0000 7f1b20611700 1 -- start start 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b18133420 0x7f1b1809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133e30 0x7f1b1809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b1809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1811f080 con 0x7f1b18134260 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1811faf0 con 0x7f1b18133420 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b20611700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1811fd40 con 0x7f1b18133e30 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b1ebae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b1809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b1e3ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b18133420 0x7f1b1809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b1ebae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b1809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58142/0 (socket says 172.21.15.19:58142) 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b1ebae700 1 -- 172.21.15.19:0/2410197831 learned_addr learned my addr 172.21.15.19:0/2410197831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f1b1dbac700 1 --2- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133e30 0x7f1b1809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.062+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975811ffe0 con 0x7f975812f8b0 2023-10-03T10:14:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.063+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f974c018400 con 0x7f975812f8b0 2023-10-03T10:14:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f974c040ff0 con 0x7f975812f8b0 2023-10-03T10:14:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.064+0000 7f9756ffd700 1 -- 172.21.15.19:0/874900929 >> v1:172.21.15.19:6816/126819 conn(0x7f974402f510 legacy=0x7f97440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 -- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b18133420 msgr2=0x7f1b1809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 --2- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b18133420 0x7f1b1809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 -- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 msgr2=0x7f1b1809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 --2- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b18134260 0x7f1b1809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 -- 172.21.15.19:0/2410197831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b10009a70 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b1dbac700 1 --2- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133e30 0x7f1b1809c9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800c450 tx=0x7f1b0800c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080052d0 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1809d610 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1812d8f0 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b08005430 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.065+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b080038c0 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.066+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1b08003a20 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.066+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1b00000fb0 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.066+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1b0803efe0 con 0x7f1b18133e30 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.067+0000 7f1b1e3ad700 1 -- 172.21.15.19:0/2410197831 >> v1:172.21.15.19:6816/126819 conn(0x7f1afc02f510 legacy=0x7f1afc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.067+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 --> v1:172.21.15.19:6804/129535 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1afc03c260 con 0x7f1afc038560 2023-10-03T10:14:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.067+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 --> v1:172.21.15.19:6800/129633 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9758072220 con 0x7f9758061190 2023-10-03T10:14:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.067+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b08003cd0 con 0x7f1b18133e30 2023-10-03T10:14:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.068+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== osd.0 v1:172.21.15.19:6804/129535 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f1afc03c260 con 0x7f1afc038560 2023-10-03T10:14:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.068+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== osd.1 v1:172.21.15.19:6800/129633 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (unknown 0 0 75535769) 0x7f9750001dc0 con 0x7f9758061190 2023-10-03T10:14:04.073 INFO:teuthology.orchestra.run.smithi019.stdout:133143986180 2023-10-03T10:14:04.073 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:04.074 INFO:teuthology.orchestra.run.smithi019.stdout:141733920771 2023-10-03T10:14:04.075 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:04.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.084+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 --> v1:172.21.15.19:6804/129535 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1b00002d00 con 0x7f1afc038560 2023-10-03T10:14:04.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.085+0000 7f1b0effd700 1 -- 172.21.15.19:0/2410197831 <== osd.0 v1:172.21.15.19:6804/129535 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7f1b00002d00 con 0x7f1afc038560 2023-10-03T10:14:04.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.085+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 --> v1:172.21.15.19:6800/129633 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9758070ec0 con 0x7f9758061190 2023-10-03T10:14:04.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.085+0000 7f973ffff700 1 -- 172.21.15.19:0/874900929 <== osd.1 v1:172.21.15.19:6800/129633 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7f9750001f30 con 0x7f9758061190 2023-10-03T10:14:04.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.085+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 >> v1:172.21.15.19:6804/129535 conn(0x7f1afc038560 legacy=0x7f1afc03a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.085+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 >> v1:172.21.15.19:6800/129633 conn(0x7f9758061190 legacy=0x7f9758061560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 >> v1:172.21.15.19:6816/126819 conn(0x7f1afc02f510 legacy=0x7f1afc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133e30 msgr2=0x7f1b1809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f1b20611700 1 --2- 172.21.15.19:0/2410197831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b18133e30 0x7f1b1809c9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800c450 tx=0x7f1b0800c760 comp rx=0 tx=0).stop 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 >> v1:172.21.15.19:6816/126819 conn(0x7f974402f510 legacy=0x7f97440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 msgr2=0x7f975809a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 --2- 172.21.15.19:0/874900929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f975812f8b0 0x7f975809a290 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f974c00a1c0 tx=0x7f974c0047c0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f97577fe700 1 -- 172.21.15.19:0/874900929 reap_dead start 2023-10-03T10:14:04.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f1b1ebae700 1 -- 172.21.15.19:0/2410197831 reap_dead start 2023-10-03T10:14:04.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 shutdown_connections 2023-10-03T10:14:04.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 >> 172.21.15.19:0/874900929 conn(0x7f97580a2aa0 msgr2=0x7f975809e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 shutdown_connections 2023-10-03T10:14:04.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.086+0000 7f975d944700 1 -- 172.21.15.19:0/874900929 wait complete. 2023-10-03T10:14:04.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.087+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 shutdown_connections 2023-10-03T10:14:04.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.087+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 >> 172.21.15.19:0/2410197831 conn(0x7f1b180a4210 msgr2=0x7f1b180a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.087+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 shutdown_connections 2023-10-03T10:14:04.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.087+0000 7f1b20611700 1 -- 172.21.15.19:0/2410197831 wait complete. 2023-10-03T10:14:04.103 INFO:teuthology.orchestra.run.smithi019.stdout:133143986180 2023-10-03T10:14:04.103 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:04.105 INFO:teuthology.orchestra.run.smithi019.stdout:124554051588 2023-10-03T10:14:04.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.231+0000 7fa5e2d45700 1 Processor -- start 2023-10-03T10:14:04.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.231+0000 7fa5e2d45700 1 -- start start 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.232+0000 7fa5e2d45700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.232+0000 7fa5e2d45700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.232+0000 7fa5e2d45700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5dc09f130 con 0x7fa5dc09e000 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.232+0000 7fa5e2d45700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc09f520 con 0x7fa5dc09d6f0 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.232+0000 7fa5e2d45700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc09e930 con 0x7fa5dc09e410 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e0ae1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e0ae1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52052/0 (socket says 172.21.15.19:52052) 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41976/0 (socket says 172.21.15.19:41976) 2023-10-03T10:14:04.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e0ae1700 1 -- 172.21.15.19:0/2724552429 learned_addr learned my addr 172.21.15.19:0/2724552429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 -- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 msgr2=0x7fa5dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 -- 172.21.15.19:0/2724552429 >> v1:172.21.15.19:6789/0 conn(0x7fa5dc09e000 legacy=0x7fa5dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 -- 172.21.15.19:0/2724552429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc09b2d0 con 0x7fa5dc09e410 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e0ae1700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5e12e2700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400be60 tx=0x7fa5d40092f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611e265d005a59bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.233+0000 7fa5db7fe700 1 -- 172.21.15.19:0/2724552429 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4003a20 con 0x7fa5dc09e410 2023-10-03T10:14:04.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.234+0000 7fa5db7fe700 1 -- 172.21.15.19:0/2724552429 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4003b80 con 0x7fa5dc09e410 2023-10-03T10:14:04.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.234+0000 7fa5db7fe700 1 -- 172.21.15.19:0/2724552429 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d400c850 con 0x7fa5dc09e410 2023-10-03T10:14:04.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 -- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 msgr2=0x7fa5dc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400be60 tx=0x7fa5d40092f0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 -- 172.21.15.19:0/2724552429 shutdown_connections 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e410 0x7fa5dc130d70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/2724552429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09d6f0 0x7fa5dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 -- 172.21.15.19:0/2724552429 >> 172.21.15.19:0/2724552429 conn(0x7fa5dc066f50 msgr2=0x7fa5dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 -- 172.21.15.19:0/2724552429 shutdown_connections 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.235+0000 7fa5e2d45700 1 -- 172.21.15.19:0/2724552429 wait complete. 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.236+0000 7fa5e2d45700 1 Processor -- start 2023-10-03T10:14:04.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.236+0000 7fa5e2d45700 1 -- start start 2023-10-03T10:14:04.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 0x7fa5dc11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e000 0x7fa5dc11e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc1302d0 con 0x7fa5dc09d6f0 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc11f350 con 0x7fa5dc09e410 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e2d45700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5dc120d50 con 0x7fa5dc09e000 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e12e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e12e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52056/0 (socket says 172.21.15.19:52056) 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e12e2700 1 -- 172.21.15.19:0/1471003593 learned_addr learned my addr 172.21.15.19:0/1471003593 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5e0ae1700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 0x7fa5dc11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.237+0000 7fa5dbfff700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e000 0x7fa5dc11e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 -- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e000 msgr2=0x7fa5dc11e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e000 0x7fa5dc11e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 -- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 msgr2=0x7fa5dc11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 0x7fa5dc11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 -- 172.21.15.19:0/1471003593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d000d9f0 con 0x7fa5dc09e410 2023-10-03T10:14:04.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e0ae1700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 0x7fa5dc11def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e12e2700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400d010 tx=0x7fa5d4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4003a20 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4004230 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d400ba90 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d40045e0 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.238+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc1211a0 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.239+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa5d4004740 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.239+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa5d4041e60 con 0x7fa5dc09e410 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.239+0000 7fa5e0ae1700 1 -- 172.21.15.19:0/1471003593 >> v1:172.21.15.19:6816/126819 conn(0x7fa5c002f510 legacy=0x7fa5c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.239+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5dc0a1d00 con 0x7fa5dc09e410 2023-10-03T10:14:04.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.245+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5d4023020 con 0x7fa5dc09e410 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.245+0000 7fa06a310700 1 Processor -- start 2023-10-03T10:14:04.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.246+0000 7fa06a310700 1 -- start start 2023-10-03T10:14:04.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.246+0000 7fa06a310700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa06412cf60 0x7fa06406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.246+0000 7fa06a310700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa064130430 0x7fa064137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.246+0000 7fa06a310700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06412cd90 con 0x7fa06412f8b0 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa06a310700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06412d330 con 0x7fa064130430 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa06a310700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa064071780 con 0x7fa06412cf60 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa064130430 0x7fa064137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa063fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa06412cf60 0x7fa06406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa064130430 0x7fa064137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58156/0 (socket says 172.21.15.19:58156) 2023-10-03T10:14:04.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 -- 172.21.15.19:0/2382032930 learned_addr learned my addr 172.21.15.19:0/2382032930 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 -- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa06412cf60 msgr2=0x7fa06406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 --2- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa06412cf60 0x7fa06406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 -- 172.21.15.19:0/2382032930 >> v1:172.21.15.19:6789/0 conn(0x7fa06412f8b0 legacy=0x7fa06412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 -- 172.21.15.19:0/2382032930 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa064071a40 con 0x7fa064130430 2023-10-03T10:14:04.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.247+0000 7fa0688ad700 1 --2- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa064130430 0x7fa064137c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbf841deff83bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.248+0000 7fa0637fe700 1 -- 172.21.15.19:0/2382032930 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00e070 con 0x7fa064130430 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.248+0000 7fa0637fe700 1 -- 172.21.15.19:0/2382032930 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05c00b910 con 0x7fa064130430 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.248+0000 7fa0637fe700 1 -- 172.21.15.19:0/2382032930 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05c00bcc0 con 0x7fa064130430 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 -- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa064130430 msgr2=0x7fa064137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 --2- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa064130430 0x7fa064137c30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa05c009e50 tx=0x7fa05c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 -- 172.21.15.19:0/2382032930 shutdown_connections 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 --2- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa064130430 0x7fa064137c30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 --2- 172.21.15.19:0/2382032930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa06412cf60 0x7fa06406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 -- 172.21.15.19:0/2382032930 >> 172.21.15.19:0/2382032930 conn(0x7fa0640a2aa0 msgr2=0x7fa0640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 -- 172.21.15.19:0/2382032930 shutdown_connections 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.249+0000 7fa06a310700 1 -- 172.21.15.19:0/2382032930 wait complete. 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.250+0000 7fa06a310700 1 Processor -- start 2023-10-03T10:14:04.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.250+0000 7fa06a310700 1 -- start start 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 0x7fa064128dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa064130430 0x7fa064129850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa064132c10 con 0x7fa06412f8b0 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06409eab0 con 0x7fa064130430 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa06a310700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa064132f00 con 0x7fa06412cf60 2023-10-03T10:14:04.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa05bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58158/0 (socket says 172.21.15.19:58158) 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa05bfff700 1 -- 172.21.15.19:0/2138412269 learned_addr learned my addr 172.21.15.19:0/2138412269 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa063fff700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 0x7fa064128dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.251+0000 7fa0688ad700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa064130430 0x7fa064129850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 -- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa064130430 msgr2=0x7fa064129850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa064130430 0x7fa064129850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 -- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 msgr2=0x7fa064129310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 -- 172.21.15.19:0/2138412269 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c009b30 con 0x7fa06412cf60 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa05bfff700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa063fff700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 0x7fa064128dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e930 tx=0x7fa05400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054013680 con 0x7fa06412cf60 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0540137e0 con 0x7fa06412cf60 2023-10-03T10:14:04.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa054013b50 con 0x7fa06412cf60 2023-10-03T10:14:04.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa064129fa0 con 0x7fa06412cf60 2023-10-03T10:14:04.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.252+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06409df00 con 0x7fa06412cf60 2023-10-03T10:14:04.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.253+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0640705f0 con 0x7fa06412cf60 2023-10-03T10:14:04.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.254+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa054013cb0 con 0x7fa06412cf60 2023-10-03T10:14:04.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.255+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa0540404b0 con 0x7fa06412cf60 2023-10-03T10:14:04.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.255+0000 7fa05bfff700 1 -- 172.21.15.19:0/2138412269 >> v1:172.21.15.19:6816/126819 conn(0x7fa04402f510 legacy=0x7fa0440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.259+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa05401a360 con 0x7fa06412cf60 2023-10-03T10:14:04.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 Processor -- start 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 -- start start 2023-10-03T10:14:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f769809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f769813d1f0 0x7f769813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769809a810 con 0x7f769809dc30 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.303+0000 7f769f967700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769806ab40 con 0x7f769813d1f0 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769f967700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769809ebc0 con 0x7f769806a770 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769d703700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f769809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769cf02700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f769809dc30 0x7f769809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37322/0 (socket says 172.21.15.19:37322) 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769cf02700 1 -- 172.21.15.19:0/3273332323 learned_addr learned my addr 172.21.15.19:0/3273332323 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:04.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 --2- 172.21.15.19:0/3273332323 >> v2:172.21.15.19:3300/0 conn(0x7f769813d1f0 0x7f769813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 -- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 msgr2=0x7f769809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 --2- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f769809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f768ffff700 1 -- 172.21.15.19:0/3273332323 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614462243 0 0) 0x7f769809a810 con 0x7f769809dc30 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 -- 172.21.15.19:0/3273332323 >> v1:172.21.15.19:6789/0 conn(0x7f769809dc30 legacy=0x7f769809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 -- 172.21.15.19:0/3273332323 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769809e920 con 0x7f769813d1f0 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.304+0000 7f769df04700 1 --2- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813f5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7690009dc0 tx=0x7f769000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bb14964ba0773e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f768ffff700 1 -- 172.21.15.19:0/3273332323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000e070 con 0x7f769813d1f0 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f768ffff700 1 -- 172.21.15.19:0/3273332323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769000bae0 con 0x7f769813d1f0 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f768ffff700 1 -- 172.21.15.19:0/3273332323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769000be90 con 0x7f769813d1f0 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 -- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 msgr2=0x7f769813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 --2- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813f5d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7690009dc0 tx=0x7f769000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 -- 172.21.15.19:0/3273332323 shutdown_connections 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 --2- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813f5d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 --2- 172.21.15.19:0/3273332323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f769809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.305+0000 7f769f967700 1 -- 172.21.15.19:0/3273332323 >> 172.21.15.19:0/3273332323 conn(0x7f7698066f50 msgr2=0x7f769809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.306+0000 7f769f967700 1 -- 172.21.15.19:0/3273332323 shutdown_connections 2023-10-03T10:14:04.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.306+0000 7f769f967700 1 -- 172.21.15.19:0/3273332323 wait complete. 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 Processor -- start 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 -- start start 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f769809dc30 0x7f769813b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769813f6e0 con 0x7f769813d1f0 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76980722c0 con 0x7f769809dc30 2023-10-03T10:14:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769f967700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f769811ea10 con 0x7f769806a770 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769d703700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769df04700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769d703700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42010/0 (socket says 172.21.15.19:42010) 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769d703700 1 -- 172.21.15.19:0/554838216 learned_addr learned my addr 172.21.15.19:0/554838216 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.307+0000 7f769cf02700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f769809dc30 0x7f769813b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 -- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 msgr2=0x7f7698071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 -- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f769809dc30 msgr2=0x7f769813b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f769809dc30 0x7f769813b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 -- 172.21.15.19:0/554838216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009a70 con 0x7f769813d1f0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769d703700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f769df04700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813bb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7690016000 tx=0x7f7690004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690027480 con 0x7f769813d1f0 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690020070 con 0x7f769813d1f0 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.308+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690027840 con 0x7f769813d1f0 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.309+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f769811efb0 con 0x7f769813d1f0 2023-10-03T10:14:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.309+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769811e2f0 con 0x7f769813d1f0 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.310+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7698074ea0 con 0x7f769813d1f0 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.310+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f769001c400 con 0x7f769813d1f0 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.311+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7690022070 con 0x7f769813d1f0 2023-10-03T10:14:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.311+0000 7f769d703700 1 -- 172.21.15.19:0/554838216 >> v1:172.21.15.19:6816/126819 conn(0x7f767c02f510 legacy=0x7f767c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.315+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7690025740 con 0x7f769813d1f0 2023-10-03T10:14:04.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.321+0000 7f9a9e6bf700 1 Processor -- start 2023-10-03T10:14:04.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 -- start start 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9a9806f050 0x7f9a9813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a98070ee0 con 0x7f9a9806e570 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a98071980 con 0x7f9a9806f050 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.322+0000 7f9a9e6bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98071480 con 0x7f9a9809eca0 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42014/0 (socket says 172.21.15.19:42014) 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 -- 172.21.15.19:0/888806136 learned_addr learned my addr 172.21.15.19:0/888806136 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a9cc5c700 1 --2- 172.21.15.19:0/888806136 >> v2:172.21.15.19:3300/0 conn(0x7f9a9806f050 0x7f9a9813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 -- 172.21.15.19:0/888806136 >> v2:172.21.15.19:3300/0 conn(0x7f9a9806f050 msgr2=0x7f9a9813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 --2- 172.21.15.19:0/888806136 >> v2:172.21.15.19:3300/0 conn(0x7f9a9806f050 0x7f9a9813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 -- 172.21.15.19:0/888806136 >> v1:172.21.15.19:6789/0 conn(0x7f9a9806e570 legacy=0x7f9a9806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 -- 172.21.15.19:0/888806136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98071b90 con 0x7f9a9809eca0 2023-10-03T10:14:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a977fe700 1 --2- 172.21.15.19:0/888806136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0098f0 tx=0x7f9a8c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3178da2125d2cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.323+0000 7f9a96ffd700 1 -- 172.21.15.19:0/888806136 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00b8a0 con 0x7f9a9809eca0 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a96ffd700 1 -- 172.21.15.19:0/888806136 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c00ba00 con 0x7f9a9809eca0 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a96ffd700 1 -- 172.21.15.19:0/888806136 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00bd90 con 0x7f9a9809eca0 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/888806136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 msgr2=0x7f9a9813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/888806136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0098f0 tx=0x7f9a8c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/888806136 shutdown_connections 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/888806136 >> v2:172.21.15.19:3300/0 conn(0x7f9a9806f050 0x7f9a9813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/888806136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a9809eca0 0x7f9a9813cea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.324+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/888806136 >> 172.21.15.19:0/888806136 conn(0x7f9a980a2aa0 msgr2=0x7f9a980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.325+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/888806136 shutdown_connections 2023-10-03T10:14:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.325+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/888806136 wait complete. 2023-10-03T10:14:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.326+0000 7f9a9e6bf700 1 Processor -- start 2023-10-03T10:14:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.326+0000 7f9a9e6bf700 1 -- start start 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9806e570 0x7f9a981214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98121f60 0x7f9a98136e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98123ba0 con 0x7f9a9806f050 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a98122a90 con 0x7f9a9806e570 2023-10-03T10:14:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9e6bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9809a300 con 0x7f9a98121f60 2023-10-03T10:14:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a977fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a977fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58204/0 (socket says 172.21.15.19:58204) 2023-10-03T10:14:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a977fe700 1 -- 172.21.15.19:0/440554771 learned_addr learned my addr 172.21.15.19:0/440554771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a97fff700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9806e570 0x7f9a981214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.327+0000 7f9a9cc5c700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98121f60 0x7f9a98136e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 -- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98121f60 msgr2=0x7f9a98136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98121f60 0x7f9a98136e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 -- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9806e570 msgr2=0x7f9a981214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9806e570 0x7f9a981214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 -- 172.21.15.19:0/440554771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c009550 con 0x7f9a9806f050 2023-10-03T10:14:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a977fe700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009c40 tx=0x7f9a8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c004510 con 0x7f9a9806f050 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8c0036a0 con 0x7f9a9806f050 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a981234f0 con 0x7f9a9806f050 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a98124140 con 0x7f9a9806f050 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.328+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c003a50 con 0x7f9a9806f050 2023-10-03T10:14:04.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.330+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9a8c003bb0 con 0x7f9a9806f050 2023-10-03T10:14:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.330+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9a8c0410b0 con 0x7f9a9806f050 2023-10-03T10:14:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.330+0000 7f9a97fff700 1 -- 172.21.15.19:0/440554771 >> v1:172.21.15.19:6816/126819 conn(0x7f9a8402f560 legacy=0x7f9a84031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.330+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a780052e0 con 0x7f9a9806f050 2023-10-03T10:14:04.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.340+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a8c015080 con 0x7f9a9806f050 2023-10-03T10:14:04.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.440+0000 7fa5e0ae1700 1 -- 172.21.15.19:0/1471003593 >> v1:172.21.15.19:6816/126819 conn(0x7fa5c002f510 legacy=0x7fa5c00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.456+0000 7fa05bfff700 1 -- 172.21.15.19:0/2138412269 >> v1:172.21.15.19:6816/126819 conn(0x7fa04402f510 legacy=0x7fa0440319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.464+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5dc074ea0 con 0x7fa5dc09e410 2023-10-03T10:14:04.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.464+0000 7fa5d97fa700 1 -- 172.21.15.19:0/1471003593 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5d40123a0 con 0x7fa5dc09e410 2023-10-03T10:14:04.464 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 >> v1:172.21.15.19:6816/126819 conn(0x7fa5c002f510 legacy=0x7fa5c00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 msgr2=0x7fa5dc11e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400d010 tx=0x7fa5d4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 shutdown_connections 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5dc09e410 0x7fa5dc11e970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5dc09d6f0 0x7fa5dc11def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 --2- 172.21.15.19:0/1471003593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5dc09e000 0x7fa5dc11e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 >> 172.21.15.19:0/1471003593 conn(0x7fa5dc066f50 msgr2=0x7fa5dc070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 shutdown_connections 2023-10-03T10:14:04.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.467+0000 7fa5e2d45700 1 -- 172.21.15.19:0/1471003593 wait complete. 2023-10-03T10:14:04.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:04.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.500+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa064074ea0 con 0x7fa06412cf60 2023-10-03T10:14:04.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.501+0000 7fa0617fa700 1 -- 172.21.15.19:0/2138412269 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa054017070 con 0x7fa06412cf60 2023-10-03T10:14:04.501 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 >> v1:172.21.15.19:6816/126819 conn(0x7fa04402f510 legacy=0x7fa0440319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 msgr2=0x7fa064128dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 0x7fa064128dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa05400e930 tx=0x7fa05400ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 shutdown_connections 2023-10-03T10:14:04.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa064130430 0x7fa064129850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa06412cf60 0x7fa064128dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 --2- 172.21.15.19:0/2138412269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa06412f8b0 0x7fa064129310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 >> 172.21.15.19:0/2138412269 conn(0x7fa0640a2aa0 msgr2=0x7fa06406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 shutdown_connections 2023-10-03T10:14:04.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.504+0000 7fa06a310700 1 -- 172.21.15.19:0/2138412269 wait complete. 2023-10-03T10:14:04.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.512+0000 7f769d703700 1 -- 172.21.15.19:0/554838216 >> v1:172.21.15.19:6816/126819 conn(0x7f767c02f510 legacy=0x7f767c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:04.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.531+0000 7f9a97fff700 1 -- 172.21.15.19:0/440554771 >> v1:172.21.15.19:6816/126819 conn(0x7f9a8402f560 legacy=0x7f9a84031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:04.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.555+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f769809a3d0 con 0x7f769813d1f0 2023-10-03T10:14:04.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.556+0000 7f768dffb700 1 -- 172.21.15.19:0/554838216 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7690025380 con 0x7f769813d1f0 2023-10-03T10:14:04.555 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 >> v1:172.21.15.19:6816/126819 conn(0x7f767c02f510 legacy=0x7f767c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 msgr2=0x7f769813bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813bb60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7690016000 tx=0x7f7690004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 shutdown_connections 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f769813d1f0 0x7f769813bb60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f769806a770 0x7f7698071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 --2- 172.21.15.19:0/554838216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f769809dc30 0x7f769813b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 >> 172.21.15.19:0/554838216 conn(0x7f7698066f50 msgr2=0x7f769809b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 shutdown_connections 2023-10-03T10:14:04.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.558+0000 7f769f967700 1 -- 172.21.15.19:0/554838216 wait complete. 2023-10-03T10:14:04.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:04.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.578+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9a78005860 con 0x7f9a9806f050 2023-10-03T10:14:04.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.579+0000 7f9a94ff9700 1 -- 172.21.15.19:0/440554771 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a8c003e60 con 0x7f9a9806f050 2023-10-03T10:14:04.579 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:04.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 >> v1:172.21.15.19:6816/126819 conn(0x7f9a8402f560 legacy=0x7f9a84031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:04.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 msgr2=0x7f9a98121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:04.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009c40 tx=0x7f9a8c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:04.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 shutdown_connections 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9a98121f60 0x7f9a98136e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9a9806e570 0x7f9a981214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 --2- 172.21.15.19:0/440554771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9806f050 0x7f9a98121a20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 >> 172.21.15.19:0/440554771 conn(0x7f9a980a2aa0 msgr2=0x7f9a980a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 shutdown_connections 2023-10-03T10:14:04.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:04.581+0000 7f9a9e6bf700 1 -- 172.21.15.19:0/440554771 wait complete. 2023-10-03T10:14:04.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:05.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:05.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:05.572 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:05.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 Processor -- start 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 -- start start 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 0x7ff08806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812f8b0 0x7ff08812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08812cd90 con 0x7ff088130260 2023-10-03T10:14:05.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08812d330 con 0x7ff08812cf60 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.649+0000 7ff08e9d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0881306d0 con 0x7ff08812f8b0 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff08cf75700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff088130260 0x7ff088136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37346/0 (socket says 172.21.15.19:37346) 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff08cf75700 1 -- 172.21.15.19:0/2588921126 learned_addr learned my addr 172.21.15.19:0/2588921126 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff087fff700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 0x7ff08806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff086ffd700 1 -- 172.21.15.19:0/2588921126 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1199041674 0 0) 0x7ff08812cd90 con 0x7ff088130260 2023-10-03T10:14:05.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff086ffd700 1 -- 172.21.15.19:0/2588921126 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0700035b0 con 0x7ff088130260 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff087fff700 1 -- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812f8b0 msgr2=0x7ff08812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff087fff700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812f8b0 0x7ff08812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff087fff700 1 -- 172.21.15.19:0/2588921126 >> v1:172.21.15.19:6789/0 conn(0x7ff088130260 legacy=0x7ff088136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.650+0000 7ff087fff700 1 -- 172.21.15.19:0/2588921126 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff088071780 con 0x7ff08812cf60 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.651+0000 7ff087fff700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 0x7ff08806f5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff078009870 tx=0x7ff078009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85e958861dc27da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.651+0000 7ff086ffd700 1 -- 172.21.15.19:0/2588921126 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078011830 con 0x7ff08812cf60 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.651+0000 7ff086ffd700 1 -- 172.21.15.19:0/2588921126 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078011990 con 0x7ff08812cf60 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.651+0000 7ff086ffd700 1 -- 172.21.15.19:0/2588921126 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078011d20 con 0x7ff08812cf60 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 -- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 msgr2=0x7ff08806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 0x7ff08806f5d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff078009870 tx=0x7ff078009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 -- 172.21.15.19:0/2588921126 shutdown_connections 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812cf60 0x7ff08806f5d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/2588921126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812f8b0 0x7ff08812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.652+0000 7ff08e9d8700 1 -- 172.21.15.19:0/2588921126 >> 172.21.15.19:0/2588921126 conn(0x7ff0880a2aa0 msgr2=0x7ff0880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.653+0000 7ff08e9d8700 1 -- 172.21.15.19:0/2588921126 shutdown_connections 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.653+0000 7ff08e9d8700 1 -- 172.21.15.19:0/2588921126 wait complete. 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.654+0000 7ff08e9d8700 1 Processor -- start 2023-10-03T10:14:05.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.654+0000 7ff08e9d8700 1 -- start start 2023-10-03T10:14:05.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812cf60 0x7ff088129900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff088130260 0x7ff08809b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff088129fa0 con 0x7ff088130260 2023-10-03T10:14:05.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08809c440 con 0x7ff08812f8b0 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08e9d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff088131880 con 0x7ff08812cf60 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff0877fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff0877fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52098/0 (socket says 172.21.15.19:52098) 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff0877fe700 1 -- 172.21.15.19:0/32483451 learned_addr learned my addr 172.21.15.19:0/32483451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff08cf75700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff088130260 0x7ff08809b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.655+0000 7ff087fff700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812cf60 0x7ff088129900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 -- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812cf60 msgr2=0x7ff088129900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812cf60 0x7ff088129900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 -- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff088130260 msgr2=0x7ff08809b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff088130260 0x7ff08809b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 -- 172.21.15.19:0/32483451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780094a0 con 0x7ff08812f8b0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff0877fe700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b500 tx=0x7ff07c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c011830 con 0x7ff08812f8b0 2023-10-03T10:14:05.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.656+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c0119b0 con 0x7ff08812f8b0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.657+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08809db80 con 0x7ff08812f8b0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.657+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c011d60 con 0x7ff08812f8b0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.657+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08809d8a0 con 0x7ff08812f8b0 2023-10-03T10:14:05.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.658+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff07c01a400 con 0x7ff08812f8b0 2023-10-03T10:14:05.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.658+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff088074ea0 con 0x7ff08812f8b0 2023-10-03T10:14:05.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.658+0000 7ff087fff700 1 -- 172.21.15.19:0/32483451 >> v1:172.21.15.19:6816/126819 conn(0x7ff07402f540 legacy=0x7ff0740319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.658+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff07c03faa0 con 0x7ff08812f8b0 2023-10-03T10:14:05.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.667+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff07c00f6a0 con 0x7ff08812f8b0 2023-10-03T10:14:05.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 Processor -- start 2023-10-03T10:14:05.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 -- start start 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f760006e570 0x7f760006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f760009eca0 0x7f760006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7600070ee0 con 0x7f7600134610 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7600071480 con 0x7f760009eca0 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.683+0000 7f76057bd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f760006f3c0 con 0x7f760006e570 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f760009eca0 0x7f760006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f760009eca0 0x7f760006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58210/0 (socket says 172.21.15.19:58210) 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4145598763 learned_addr learned my addr 172.21.15.19:0/4145598763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75feffd700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f760006e570 0x7f760006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f760006e570 msgr2=0x7f760006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f760006e570 0x7f760006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4145598763 >> v1:172.21.15.19:6789/0 conn(0x7f7600134610 legacy=0x7f7600134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4145598763 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7600071b90 con 0x7f760009eca0 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.684+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760009eca0 0x7f760006ee80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098f0 tx=0x7f75f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93f7af36847e647 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f75fdffb700 1 -- 172.21.15.19:0/4145598763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400b8a0 con 0x7f760009eca0 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f75fdffb700 1 -- 172.21.15.19:0/4145598763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f400ba00 con 0x7f760009eca0 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f75fdffb700 1 -- 172.21.15.19:0/4145598763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400bd90 con 0x7f760009eca0 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 -- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760009eca0 msgr2=0x7f760006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760009eca0 0x7f760006ee80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f75f40098f0 tx=0x7f75f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 -- 172.21.15.19:0/4145598763 shutdown_connections 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f760006e570 0x7f760006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 --2- 172.21.15.19:0/4145598763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760009eca0 0x7f760006ee80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.685+0000 7f76057bd700 1 -- 172.21.15.19:0/4145598763 >> 172.21.15.19:0/4145598763 conn(0x7f76000a2aa0 msgr2=0x7f76000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.686+0000 7f76057bd700 1 -- 172.21.15.19:0/4145598763 shutdown_connections 2023-10-03T10:14:05.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.686+0000 7f76057bd700 1 -- 172.21.15.19:0/4145598763 wait complete. 2023-10-03T10:14:05.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.687+0000 7f76057bd700 1 Processor -- start 2023-10-03T10:14:05.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.687+0000 7f76057bd700 1 -- start start 2023-10-03T10:14:05.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 0x7f7600133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7600133650 0x7f7600133ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760013df20 con 0x7f760006e570 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760013cbf0 con 0x7f7600133650 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f76057bd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76001343c0 con 0x7f7600134610 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f75feffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f75feffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58212/0 (socket says 172.21.15.19:58212) 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f75feffd700 1 -- 172.21.15.19:0/4167583560 learned_addr learned my addr 172.21.15.19:0/4167583560 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.688+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 0x7f7600133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7600133650 msgr2=0x7f7600133ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7600133650 0x7f7600133ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 msgr2=0x7f76001403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 -- 172.21.15.19:0/4167583560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4009550 con 0x7f7600134610 2023-10-03T10:14:05.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75feffd700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75fe7fc700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 0x7f7600133110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75f4016000 tx=0x7f75f4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4004380 con 0x7f7600134610 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f401f070 con 0x7f7600134610 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760013fb20 con 0x7f7600134610 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f40036a0 con 0x7f7600134610 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.689+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7600070610 con 0x7f7600134610 2023-10-03T10:14:05.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.691+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760013dd50 con 0x7f7600134610 2023-10-03T10:14:05.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.691+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f75f4021030 con 0x7f7600134610 2023-10-03T10:14:05.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.691+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f75f40410c0 con 0x7f7600134610 2023-10-03T10:14:05.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.691+0000 7f75feffd700 1 -- 172.21.15.19:0/4167583560 >> v1:172.21.15.19:6816/126819 conn(0x7f75ec02f510 legacy=0x7f75ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.700+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75f4072750 con 0x7f7600134610 2023-10-03T10:14:05.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 Processor -- start 2023-10-03T10:14:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 -- start start 2023-10-03T10:14:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd33009d6f0 0x7fd33009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009e000 0x7fd330130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33009f130 con 0x7fd33009e410 2023-10-03T10:14:05.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33009f520 con 0x7fd33009d6f0 2023-10-03T10:14:05.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.739+0000 7fd335dba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33009e930 con 0x7fd33009e000 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd33009e410 0x7fd330130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37366/0 (socket says 172.21.15.19:37366) 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32ffff700 1 -- 172.21.15.19:0/1526646840 learned_addr learned my addr 172.21.15.19:0/1526646840 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32effd700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009e000 0x7fd330130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1526646840 >> v2:172.21.15.19:3300/0 conn(0x7fd33009d6f0 0x7fd33009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009e000 msgr2=0x7fd330130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009e000 0x7fd330130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1526646840 >> v1:172.21.15.19:6789/0 conn(0x7fd33009e410 legacy=0x7fd330130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1526646840 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33009b2d0 con 0x7fd33009d6f0 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32e7fc700 1 -- 172.21.15.19:0/1526646840 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848583053 0 0) 0x7fd33009f130 con 0x7fd33009e410 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.740+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009d6f0 0x7fd33009dac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd32000bae0 tx=0x7fd32000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bec070b3a0fb19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.741+0000 7fd32e7fc700 1 -- 172.21.15.19:0/1526646840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32000dc70 con 0x7fd33009d6f0 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.741+0000 7fd32e7fc700 1 -- 172.21.15.19:0/1526646840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32000ddd0 con 0x7fd33009d6f0 2023-10-03T10:14:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.741+0000 7fd32e7fc700 1 -- 172.21.15.19:0/1526646840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320010690 con 0x7fd33009d6f0 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 -- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009d6f0 msgr2=0x7fd33009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009d6f0 0x7fd33009dac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd32000bae0 tx=0x7fd32000bdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 -- 172.21.15.19:0/1526646840 shutdown_connections 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009d6f0 0x7fd33009dac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 --2- 172.21.15.19:0/1526646840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009e000 0x7fd330130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 -- 172.21.15.19:0/1526646840 >> 172.21.15.19:0/1526646840 conn(0x7fd330066f50 msgr2=0x7fd33009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 -- 172.21.15.19:0/1526646840 shutdown_connections 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.742+0000 7fd335dba700 1 -- 172.21.15.19:0/1526646840 wait complete. 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.743+0000 7fd335dba700 1 Processor -- start 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.743+0000 7fd335dba700 1 -- start start 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 0x7fd3301b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 0x7fd3301b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301b9750 con 0x7fd33009e410 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3301b8a90 con 0x7fd33009d6f0 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd335dba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3300a20b0 con 0x7fd33009e000 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42062/0 (socket says 172.21.15.19:42062) 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32effd700 1 -- 172.21.15.19:0/1799064810 learned_addr learned my addr 172.21.15.19:0/1799064810 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 0x7fd3301b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32ffff700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 0x7fd3301b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 msgr2=0x7fd3301b6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 msgr2=0x7fd3301b6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 0x7fd3301b6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32f7fe700 1 -- 172.21.15.19:0/1799064810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32000b740 con 0x7fd33009d6f0 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.744+0000 7fd32ffff700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 0x7fd3301b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd32effd700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd32f7fe700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 0x7fd3301b6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd320018000 tx=0x7fd320004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320003b70 con 0x7fd33009d6f0 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd320003cd0 con 0x7fd33009d6f0 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd320010690 con 0x7fd33009d6f0 2023-10-03T10:14:05.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3301b80a0 con 0x7fd33009d6f0 2023-10-03T10:14:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.745+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3301b91b0 con 0x7fd33009d6f0 2023-10-03T10:14:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.746+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd32002c430 con 0x7fd33009d6f0 2023-10-03T10:14:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.746+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd320041680 con 0x7fd33009d6f0 2023-10-03T10:14:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.746+0000 7fd32effd700 1 -- 172.21.15.19:0/1799064810 >> v1:172.21.15.19:6816/126819 conn(0x7fd31c02f510 legacy=0x7fd31c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.747+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3301ba330 con 0x7fd33009d6f0 2023-10-03T10:14:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.756+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd320003e40 con 0x7fd33009d6f0 2023-10-03T10:14:05.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.775+0000 7fc2d5648700 1 Processor -- start 2023-10-03T10:14:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.775+0000 7fc2d5648700 1 -- start start 2023-10-03T10:14:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2d5648700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2d5648700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2d013d1f0 0x7fc2d013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2d5648700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d009a810 con 0x7fc2d006a770 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2d5648700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d006ab40 con 0x7fc2d013d1f0 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2d5648700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d009ebc0 con 0x7fc2d009de00 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2ce7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2ce7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d009e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52134/0 (socket says 172.21.15.19:52134) 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2ce7fc700 1 -- 172.21.15.19:0/2156436935 learned_addr learned my addr 172.21.15.19:0/2156436935 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.776+0000 7fc2cf7fe700 1 --2- 172.21.15.19:0/2156436935 >> v2:172.21.15.19:3300/0 conn(0x7fc2d013d1f0 0x7fc2d013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cdffb700 1 -- 172.21.15.19:0/2156436935 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769987220 0 0) 0x7fc2d009a810 con 0x7fc2d006a770 2023-10-03T10:14:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cdffb700 1 -- 172.21.15.19:0/2156436935 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2b80035b0 con 0x7fc2d006a770 2023-10-03T10:14:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cf7fe700 1 -- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 msgr2=0x7fc2d009e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cf7fe700 1 --2- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d009e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cf7fe700 1 -- 172.21.15.19:0/2156436935 >> v1:172.21.15.19:6789/0 conn(0x7fc2d006a770 legacy=0x7fc2d009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cf7fe700 1 -- 172.21.15.19:0/2156436935 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d009e920 con 0x7fc2d013d1f0 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cf7fe700 1 --2- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013f5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009d90 tx=0x7fc2c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d382dbf61a65e08e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cdffb700 1 -- 172.21.15.19:0/2156436935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800e070 con 0x7fc2d013d1f0 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cdffb700 1 -- 172.21.15.19:0/2156436935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800bb20 con 0x7fc2d013d1f0 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.777+0000 7fc2cdffb700 1 -- 172.21.15.19:0/2156436935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8012430 con 0x7fc2d013d1f0 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.778+0000 7fc2d5648700 1 -- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 msgr2=0x7fc2d013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.778+0000 7fc2d5648700 1 --2- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013f5d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8009d90 tx=0x7fc2c800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.778+0000 7fc2d5648700 1 -- 172.21.15.19:0/2156436935 shutdown_connections 2023-10-03T10:14:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.778+0000 7fc2d5648700 1 --2- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013f5d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.778+0000 7fc2d5648700 1 --2- 172.21.15.19:0/2156436935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d009e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.779+0000 7fc2d5648700 1 -- 172.21.15.19:0/2156436935 >> 172.21.15.19:0/2156436935 conn(0x7fc2d0066f50 msgr2=0x7fc2d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.779+0000 7fc2d5648700 1 -- 172.21.15.19:0/2156436935 shutdown_connections 2023-10-03T10:14:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.779+0000 7fc2d5648700 1 -- 172.21.15.19:0/2156436935 wait complete. 2023-10-03T10:14:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.780+0000 7fc2d5648700 1 Processor -- start 2023-10-03T10:14:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.780+0000 7fc2d5648700 1 -- start start 2023-10-03T10:14:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00727c0 con 0x7fc2d013d1f0 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d013cd50 con 0x7fc2d009de00 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2d5648700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d011e140 con 0x7fc2d006a770 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42064/0 (socket says 172.21.15.19:42064) 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2ceffd700 1 -- 172.21.15.19:0/3714857003 learned_addr learned my addr 172.21.15.19:0/3714857003 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2cf7fe700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.781+0000 7fc2ce7fc700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 -- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 msgr2=0x7fc2d013b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d013b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 -- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 msgr2=0x7fc2d013b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 -- 172.21.15.19:0/3714857003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c8009a70 con 0x7fc2d006a770 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ce7fc700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2ceffd700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c520 tx=0x7fc2c000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00052d0 con 0x7fc2d006a770 2023-10-03T10:14:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0005430 con 0x7fc2d006a770 2023-10-03T10:14:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d011e930 con 0x7fc2d006a770 2023-10-03T10:14:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.782+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d011f640 con 0x7fc2d006a770 2023-10-03T10:14:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.783+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c00038c0 con 0x7fc2d006a770 2023-10-03T10:14:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.784+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc2c0003a20 con 0x7fc2d006a770 2023-10-03T10:14:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.784+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc2c003f0b0 con 0x7fc2d006a770 2023-10-03T10:14:05.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.784+0000 7fc2ce7fc700 1 -- 172.21.15.19:0/3714857003 >> v1:172.21.15.19:6816/126819 conn(0x7fc2bc02f510 legacy=0x7fc2bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.784+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b00052e0 con 0x7fc2d006a770 2023-10-03T10:14:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.794+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2c0017020 con 0x7fc2d006a770 2023-10-03T10:14:05.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.859+0000 7ff087fff700 1 -- 172.21.15.19:0/32483451 >> v1:172.21.15.19:6816/126819 conn(0x7ff07402f540 legacy=0x7ff0740319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.892+0000 7f75feffd700 1 -- 172.21.15.19:0/4167583560 >> v1:172.21.15.19:6816/126819 conn(0x7f75ec02f510 legacy=0x7f75ec0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.900+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0880713a0 con 0x7ff08812f8b0 2023-10-03T10:14:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.901+0000 7ff084ff9700 1 -- 172.21.15.19:0/32483451 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff07c00f2e0 con 0x7ff08812f8b0 2023-10-03T10:14:05.901 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 >> v1:172.21.15.19:6816/126819 conn(0x7ff07402f540 legacy=0x7ff0740319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:05.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 msgr2=0x7ff08809b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b500 tx=0x7ff07c00b810 comp rx=0 tx=0).stop 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 shutdown_connections 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff088130260 0x7ff08809b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff08812cf60 0x7ff088129900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 --2- 172.21.15.19:0/32483451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff08812f8b0 0x7ff08809b140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 >> 172.21.15.19:0/32483451 conn(0x7ff0880a2aa0 msgr2=0x7ff0880a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 shutdown_connections 2023-10-03T10:14:05.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.903+0000 7ff08e9d8700 1 -- 172.21.15.19:0/32483451 wait complete. 2023-10-03T10:14:05.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.914+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7600074ea0 con 0x7f7600134610 2023-10-03T10:14:05.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.914+0000 7f75e77fe700 1 -- 172.21.15.19:0/4167583560 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75f4015090 con 0x7f7600134610 2023-10-03T10:14:05.914 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 >> v1:172.21.15.19:6816/126819 conn(0x7f75ec02f510 legacy=0x7f75ec0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 msgr2=0x7f7600133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 0x7f7600133110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75f4016000 tx=0x7f75f4004750 comp rx=0 tx=0).stop 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 shutdown_connections 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7600133650 0x7f7600133ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f760006e570 0x7f76001403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 --2- 172.21.15.19:0/4167583560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7600134610 0x7f7600133110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 >> 172.21.15.19:0/4167583560 conn(0x7f76000a2aa0 msgr2=0x7f7600137fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 shutdown_connections 2023-10-03T10:14:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.917+0000 7f76057bd700 1 -- 172.21.15.19:0/4167583560 wait complete. 2023-10-03T10:14:05.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:05.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:05.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.947+0000 7fd32effd700 1 -- 172.21.15.19:0/1799064810 >> v1:172.21.15.19:6816/126819 conn(0x7fd31c02f510 legacy=0x7fd31c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.969+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd330074ea0 con 0x7fd33009d6f0 2023-10-03T10:14:05.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.969+0000 7fd317fff700 1 -- 172.21.15.19:0/1799064810 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd320021390 con 0x7fd33009d6f0 2023-10-03T10:14:05.969 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.971+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 >> v1:172.21.15.19:6816/126819 conn(0x7fd31c02f510 legacy=0x7fd31c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.971+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 msgr2=0x7fd3301b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.971+0000 7fd335dba700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 0x7fd3301b6300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd320018000 tx=0x7fd320004750 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 shutdown_connections 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd33009e410 0x7fd3301b6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd33009d6f0 0x7fd3301b6300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 --2- 172.21.15.19:0/1799064810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd33009e000 0x7fd3301b6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:05.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 >> 172.21.15.19:0/1799064810 conn(0x7fd330066f50 msgr2=0x7fd33012d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 shutdown_connections 2023-10-03T10:14:05.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.972+0000 7fd335dba700 1 -- 172.21.15.19:0/1799064810 wait complete. 2023-10-03T10:14:05.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:05.985+0000 7fc2ce7fc700 1 -- 172.21.15.19:0/3714857003 >> v1:172.21.15.19:6816/126819 conn(0x7fc2bc02f510 legacy=0x7fc2bc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:05.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.001+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc2b0005860 con 0x7fc2d006a770 2023-10-03T10:14:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.001+0000 7fc2b77fe700 1 -- 172.21.15.19:0/3714857003 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2c0019d00 con 0x7fc2d006a770 2023-10-03T10:14:06.002 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 >> v1:172.21.15.19:6816/126819 conn(0x7fc2bc02f510 legacy=0x7fc2bc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 msgr2=0x7fc2d0071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c520 tx=0x7fc2c000c830 comp rx=0 tx=0).stop 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 shutdown_connections 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2d013d1f0 0x7fc2d013b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2d006a770 0x7fc2d0071510 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 --2- 172.21.15.19:0/3714857003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2d009de00 0x7fc2d013b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:06.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 >> 172.21.15.19:0/3714857003 conn(0x7fc2d0066f50 msgr2=0x7fc2d009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 shutdown_connections 2023-10-03T10:14:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:06.004+0000 7fc2d5648700 1 -- 172.21.15.19:0/3714857003 wait complete. 2023-10-03T10:14:06.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:06.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:06.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:06.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:07.019 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:07.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.071+0000 7f851b33a700 1 Processor -- start 2023-10-03T10:14:07.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.072+0000 7f851b33a700 1 -- start start 2023-10-03T10:14:07.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.072+0000 7f851b33a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f851409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f851b33a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f85141339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f851b33a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851409b120 con 0x7f851409e410 2023-10-03T10:14:07.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f851b33a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851406b460 con 0x7f851409e000 2023-10-03T10:14:07.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f851b33a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851409a7e0 con 0x7f851409d6f0 2023-10-03T10:14:07.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f851409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85198d7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f851409e410 0x7f8514133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40708/0 (socket says 172.21.15.19:40708) 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85198d7700 1 -- 172.21.15.19:0/1574131348 learned_addr learned my addr 172.21.15.19:0/1574131348 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85188d5700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f85141339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f850bfff700 1 -- 172.21.15.19:0/1574131348 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284019290 0 0) 0x7f851409b120 con 0x7f851409e410 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 -- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 msgr2=0x7f85141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f85141339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 -- 172.21.15.19:0/1574131348 >> v1:172.21.15.19:6789/0 conn(0x7f851409e410 legacy=0x7f8514133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 -- 172.21.15.19:0/1574131348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851409a500 con 0x7f851409d6f0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.073+0000 7f85190d6700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f851409dac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85100098a0 tx=0x7f8510009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44dd5b4aadb4d045 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.074+0000 7f850bfff700 1 -- 172.21.15.19:0/1574131348 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510011830 con 0x7f851409d6f0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.074+0000 7f850bfff700 1 -- 172.21.15.19:0/1574131348 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8510011990 con 0x7f851409d6f0 2023-10-03T10:14:07.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.074+0000 7f850bfff700 1 -- 172.21.15.19:0/1574131348 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510011d20 con 0x7f851409d6f0 2023-10-03T10:14:07.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 -- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 msgr2=0x7f851409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f851409dac0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f85100098a0 tx=0x7f8510009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 -- 172.21.15.19:0/1574131348 shutdown_connections 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f851409dac0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 --2- 172.21.15.19:0/1574131348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f85141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 -- 172.21.15.19:0/1574131348 >> 172.21.15.19:0/1574131348 conn(0x7f8514066f50 msgr2=0x7f851409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 -- 172.21.15.19:0/1574131348 shutdown_connections 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.075+0000 7f851b33a700 1 -- 172.21.15.19:0/1574131348 wait complete. 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.076+0000 7f851b33a700 1 Processor -- start 2023-10-03T10:14:07.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.076+0000 7f851b33a700 1 -- start start 2023-10-03T10:14:07.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f8514122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f851409e410 0x7f8514122d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141258a0 con 0x7f851409e410 2023-10-03T10:14:07.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514124d30 con 0x7f851409e000 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f851b33a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f851409c710 con 0x7f851409d6f0 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f85190d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f85190d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34214/0 (socket says 172.21.15.19:34214) 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f85190d6700 1 -- 172.21.15.19:0/3494464108 learned_addr learned my addr 172.21.15.19:0/3494464108 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f85198d7700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f851409e410 0x7f8514122d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.077+0000 7f85188d5700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f8514122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 -- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 msgr2=0x7f8514122820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f8514122820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 -- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f851409e410 msgr2=0x7f8514122d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f851409e410 0x7f8514122d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 -- 172.21.15.19:0/3494464108 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100094a0 con 0x7f851409d6f0 2023-10-03T10:14:07.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f85190d6700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8510000c00 tx=0x7f8510004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510004550 con 0x7f851409d6f0 2023-10-03T10:14:07.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851001f070 con 0x7f851409d6f0 2023-10-03T10:14:07.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.078+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140a2b60 con 0x7f851409d6f0 2023-10-03T10:14:07.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.079+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85100038e0 con 0x7f851409d6f0 2023-10-03T10:14:07.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.079+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514125540 con 0x7f851409d6f0 2023-10-03T10:14:07.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.080+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851411f030 con 0x7f851409d6f0 2023-10-03T10:14:07.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.080+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8510003a40 con 0x7f851409d6f0 2023-10-03T10:14:07.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.081+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8510021070 con 0x7f851409d6f0 2023-10-03T10:14:07.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.081+0000 7f85188d5700 1 -- 172.21.15.19:0/3494464108 >> v1:172.21.15.19:6816/126819 conn(0x7f84f802f560 legacy=0x7f84f8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.085+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8510010380 con 0x7f851409d6f0 2023-10-03T10:14:07.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.114+0000 7fc63665f700 1 Processor -- start 2023-10-03T10:14:07.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.114+0000 7fc63665f700 1 -- start start 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc63665f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6300a0a30 0x7fc6300a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc63665f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6300a1340 0x7fc630133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc63665f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63009edd0 con 0x7fc630133fa0 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc63665f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63009e1f0 con 0x7fc6300a0a30 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc63665f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc63009dc50 con 0x7fc6300a1340 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc634bfc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc630133fa0 0x7fc63013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40712/0 (socket says 172.21.15.19:40712) 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc634bfc700 1 -- 172.21.15.19:0/128395277 learned_addr learned my addr 172.21.15.19:0/128395277 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:07.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62ffff700 1 --2- 172.21.15.19:0/128395277 >> v2:172.21.15.19:3300/0 conn(0x7fc6300a0a30 0x7fc6300a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62f7fe700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6300a1340 0x7fc630133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62effd700 1 -- 172.21.15.19:0/128395277 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864725878 0 0) 0x7fc63009edd0 con 0x7fc630133fa0 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62effd700 1 -- 172.21.15.19:0/128395277 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6180035b0 con 0x7fc630133fa0 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62ffff700 1 -- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6300a1340 msgr2=0x7fc630133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62ffff700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6300a1340 0x7fc630133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62ffff700 1 -- 172.21.15.19:0/128395277 >> v1:172.21.15.19:6789/0 conn(0x7fc630133fa0 legacy=0x7fc63013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.115+0000 7fc62ffff700 1 -- 172.21.15.19:0/128395277 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300a1fe0 con 0x7fc6300a0a30 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.116+0000 7fc62ffff700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a0a30 0x7fc6300a0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc620009840 tx=0x7fc620009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c52a1c738ada1f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.116+0000 7fc62effd700 1 -- 172.21.15.19:0/128395277 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011830 con 0x7fc6300a0a30 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.116+0000 7fc62effd700 1 -- 172.21.15.19:0/128395277 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620011990 con 0x7fc6300a0a30 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.116+0000 7fc62effd700 1 -- 172.21.15.19:0/128395277 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620011d00 con 0x7fc6300a0a30 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 -- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a0a30 msgr2=0x7fc6300a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a0a30 0x7fc6300a0e00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc620009840 tx=0x7fc620009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 -- 172.21.15.19:0/128395277 shutdown_connections 2023-10-03T10:14:07.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a0a30 0x7fc6300a0e00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 --2- 172.21.15.19:0/128395277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6300a1340 0x7fc630133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 -- 172.21.15.19:0/128395277 >> 172.21.15.19:0/128395277 conn(0x7fc6300a6550 msgr2=0x7fc6300a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 -- 172.21.15.19:0/128395277 shutdown_connections 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.117+0000 7fc63665f700 1 -- 172.21.15.19:0/128395277 wait complete. 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.118+0000 7fc63665f700 1 Processor -- start 2023-10-03T10:14:07.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.118+0000 7fc63665f700 1 -- start start 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 0x7fc63011e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 0x7fc63011ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630121230 con 0x7fc6300a1340 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300a0220 con 0x7fc6300a0a30 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc63665f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc63011f810 con 0x7fc630133fa0 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc62f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46630/0 (socket says 172.21.15.19:46630) 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc62f7fe700 1 -- 172.21.15.19:0/3202527323 learned_addr learned my addr 172.21.15.19:0/3202527323 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc634bfc700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 0x7fc63011ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.119+0000 7fc62ffff700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 0x7fc63011e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 -- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 msgr2=0x7fc63011ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 0x7fc63011ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 -- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 msgr2=0x7fc63011e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 -- 172.21.15.19:0/3202527323 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200094a0 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62f7fe700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc634bfc700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 0x7fc63011ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62ffff700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 0x7fc63011e3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc620016000 tx=0x7fc620004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620004590 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62001f070 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc630121e80 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200038c0 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.120+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630121ba0 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.121+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc620003a20 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.122+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6301207c0 con 0x7fc6300a0a30 2023-10-03T10:14:07.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.122+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc620021070 con 0x7fc6300a0a30 2023-10-03T10:14:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.122+0000 7fc62f7fe700 1 -- 172.21.15.19:0/3202527323 >> v1:172.21.15.19:6816/126819 conn(0x7fc61c02f510 legacy=0x7fc61c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.127+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc620015070 con 0x7fc6300a0a30 2023-10-03T10:14:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.153+0000 7f8e9c68d700 1 Processor -- start 2023-10-03T10:14:07.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.153+0000 7f8e9c68d700 1 -- start start 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9c68d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9c68d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e94135e50 0x7f8e94138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9c68d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9409f130 con 0x7f8e9409d6f0 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9c68d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9409f520 con 0x7f8e94135e50 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9c68d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9409e930 con 0x7f8e9409e1d0 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36730/0 (socket says 172.21.15.19:36730) 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 -- 172.21.15.19:0/1322398110 learned_addr learned my addr 172.21.15.19:0/1322398110 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:07.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e9ac2a700 1 --2- 172.21.15.19:0/1322398110 >> v2:172.21.15.19:3300/0 conn(0x7f8e94135e50 0x7f8e94138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 -- 172.21.15.19:0/1322398110 >> v2:172.21.15.19:3300/0 conn(0x7f8e94135e50 msgr2=0x7f8e94138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 --2- 172.21.15.19:0/1322398110 >> v2:172.21.15.19:3300/0 conn(0x7f8e94135e50 0x7f8e94138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 -- 172.21.15.19:0/1322398110 >> v1:172.21.15.19:6789/0 conn(0x7f8e9409d6f0 legacy=0x7f8e9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 -- 172.21.15.19:0/1322398110 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9409b2d0 con 0x7f8e9409e1d0 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.154+0000 7f8e99c28700 1 --2- 172.21.15.19:0/1322398110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009920 tx=0x7f8e84009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2abebddbf64b24bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.155+0000 7f8e99427700 1 -- 172.21.15.19:0/1322398110 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011830 con 0x7f8e9409e1d0 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.155+0000 7f8e99427700 1 -- 172.21.15.19:0/1322398110 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84011990 con 0x7f8e9409e1d0 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.155+0000 7f8e99427700 1 -- 172.21.15.19:0/1322398110 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84011d20 con 0x7f8e9409e1d0 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.155+0000 7f8e9c68d700 1 -- 172.21.15.19:0/1322398110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 msgr2=0x7f8e94135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.155+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/1322398110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009920 tx=0x7f8e84009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 -- 172.21.15.19:0/1322398110 shutdown_connections 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/1322398110 >> v2:172.21.15.19:3300/0 conn(0x7f8e94135e50 0x7f8e94138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/1322398110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e9409e1d0 0x7f8e94135910 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 -- 172.21.15.19:0/1322398110 >> 172.21.15.19:0/1322398110 conn(0x7f8e94066f50 msgr2=0x7f8e9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 -- 172.21.15.19:0/1322398110 shutdown_connections 2023-10-03T10:14:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.156+0000 7f8e9c68d700 1 -- 172.21.15.19:0/1322398110 wait complete. 2023-10-03T10:14:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.157+0000 7f8e9c68d700 1 Processor -- start 2023-10-03T10:14:07.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.157+0000 7f8e9c68d700 1 -- start start 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e9409e1d0 0x7f8e9411ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e94135e50 0x7f8e9411bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9411d220 con 0x7f8e9409e1d0 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941313f0 con 0x7f8e94135e50 2023-10-03T10:14:07.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9c68d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9406e960 con 0x7f8e9409d6f0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9a429700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9a429700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34246/0 (socket says 172.21.15.19:34246) 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9a429700 1 -- 172.21.15.19:0/903231136 learned_addr learned my addr 172.21.15.19:0/903231136 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e99c28700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e9409e1d0 0x7f8e9411ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.158+0000 7f8e9ac2a700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e94135e50 0x7f8e9411bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 -- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e94135e50 msgr2=0x7f8e9411bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e94135e50 0x7f8e9411bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 -- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e9409e1d0 msgr2=0x7f8e9411ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e9409e1d0 0x7f8e9411ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 -- 172.21.15.19:0/903231136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84009550 con 0x7f8e9409d6f0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9a429700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c4e0 tx=0x7f8e9000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900052d0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e90005430 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9411e7b0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900038c0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.159+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9411d8c0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.160+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e90003a20 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.160+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8e9003f020 con 0x7f8e9409d6f0 2023-10-03T10:14:07.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.160+0000 7f8e99c28700 1 -- 172.21.15.19:0/903231136 >> v1:172.21.15.19:6816/126819 conn(0x7f8e7802f510 legacy=0x7f8e780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.160+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e94074ea0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.165+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e90019910 con 0x7f8e9409d6f0 2023-10-03T10:14:07.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.242+0000 7f1df0562700 1 Processor -- start 2023-10-03T10:14:07.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.242+0000 7f1df0562700 1 -- start start 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1df0562700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809f410 0x7f1de8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1df0562700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1de8136fe0 0x7f1de81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1df0562700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de8070940 con 0x7f1de809e930 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1df0562700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de806fd60 con 0x7f1de8136fe0 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1df0562700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de806fa80 con 0x7f1de809f410 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1dedafd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809f410 0x7f1de8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1deeaff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1de8136fe0 0x7f1de81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1dee2fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1de809e930 0x7f1de809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40722/0 (socket says 172.21.15.19:40722) 2023-10-03T10:14:07.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.243+0000 7f1dee2fe700 1 -- 172.21.15.19:0/1964236329 learned_addr learned my addr 172.21.15.19:0/1964236329 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:07.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1deeaff700 1 -- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809f410 msgr2=0x7f1de8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1deeaff700 1 --2- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809f410 0x7f1de8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1deeaff700 1 -- 172.21.15.19:0/1964236329 >> v1:172.21.15.19:6789/0 conn(0x7f1de809e930 legacy=0x7f1de809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1deeaff700 1 -- 172.21.15.19:0/1964236329 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de809fb60 con 0x7f1de8136fe0 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1deeaff700 1 --2- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de8136fe0 0x7f1de81393c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009d90 tx=0x7f1de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e9d03a1d2caa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1ded2fc700 1 -- 172.21.15.19:0/1964236329 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de000e070 con 0x7f1de8136fe0 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1ded2fc700 1 -- 172.21.15.19:0/1964236329 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de000bb20 con 0x7f1de8136fe0 2023-10-03T10:14:07.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.244+0000 7f1ded2fc700 1 -- 172.21.15.19:0/1964236329 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0012430 con 0x7f1de8136fe0 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 -- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de8136fe0 msgr2=0x7f1de81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 --2- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de8136fe0 0x7f1de81393c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009d90 tx=0x7f1de000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 -- 172.21.15.19:0/1964236329 shutdown_connections 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 --2- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de8136fe0 0x7f1de81393c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 --2- 172.21.15.19:0/1964236329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809f410 0x7f1de8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 -- 172.21.15.19:0/1964236329 >> 172.21.15.19:0/1964236329 conn(0x7f1de80a4210 msgr2=0x7f1de80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 -- 172.21.15.19:0/1964236329 shutdown_connections 2023-10-03T10:14:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.245+0000 7f1df0562700 1 -- 172.21.15.19:0/1964236329 wait complete. 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.246+0000 7f1df0562700 1 Processor -- start 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.246+0000 7f1df0562700 1 -- start start 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 0x7f1de81c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1de8136fe0 0x7f1de806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8124000 con 0x7f1de809f410 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81bc0c0 con 0x7f1de8136fe0 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1df0562700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8134370 con 0x7f1de809e930 2023-10-03T10:14:07.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1dedafd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1dee2fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 0x7f1de81c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1dedafd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46682/0 (socket says 172.21.15.19:46682) 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1dedafd700 1 -- 172.21.15.19:0/1643922623 learned_addr learned my addr 172.21.15.19:0/1643922623 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1dee2fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 0x7f1de81c8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34270/0 (socket says 172.21.15.19:34270) 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.247+0000 7f1deeaff700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1de8136fe0 0x7f1de806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 -- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 msgr2=0x7f1de81c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 0x7f1de81c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 -- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1de8136fe0 msgr2=0x7f1de806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1de8136fe0 0x7f1de806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 -- 172.21.15.19:0/1643922623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009a70 con 0x7f1de809f410 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1dedafd700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800e9b0 tx=0x7f1dd800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:07.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8009710 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd800c7f0 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de81229a0 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd800cb60 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.248+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de806d4c0 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.249+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1dd800ccc0 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.249+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8074ea0 con 0x7f1de809f410 2023-10-03T10:14:07.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.249+0000 7f1dee2fe700 1 -- 172.21.15.19:0/1643922623 >> v1:172.21.15.19:6816/126819 conn(0x7f1dcc02f510 legacy=0x7f1dcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.249+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1dd803fcc0 con 0x7f1de809f410 2023-10-03T10:14:07.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.258+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1dd80232f0 con 0x7f1de809f410 2023-10-03T10:14:07.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.282+0000 7f85188d5700 1 -- 172.21.15.19:0/3494464108 >> v1:172.21.15.19:6816/126819 conn(0x7f84f802f560 legacy=0x7f84f8031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.323+0000 7fc62f7fe700 1 -- 172.21.15.19:0/3202527323 >> v1:172.21.15.19:6816/126819 conn(0x7fc61c02f510 legacy=0x7fc61c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.342+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6300a1d40 con 0x7fc6300a0a30 2023-10-03T10:14:07.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.342+0000 7fc62cff9700 1 -- 172.21.15.19:0/3202527323 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc620015070 con 0x7fc6300a0a30 2023-10-03T10:14:07.342 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 >> v1:172.21.15.19:6816/126819 conn(0x7fc61c02f510 legacy=0x7fc61c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 msgr2=0x7fc63011e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 0x7fc63011e3b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc620016000 tx=0x7fc620004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 shutdown_connections 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc630133fa0 0x7fc63011ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6300a0a30 0x7fc63011e3b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 --2- 172.21.15.19:0/3202527323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6300a1340 0x7fc63011e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 >> 172.21.15.19:0/3202527323 conn(0x7fc6300a6550 msgr2=0x7fc6300a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 shutdown_connections 2023-10-03T10:14:07.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.345+0000 7fc63665f700 1 -- 172.21.15.19:0/3202527323 wait complete. 2023-10-03T10:14:07.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:07.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.361+0000 7f8e99c28700 1 -- 172.21.15.19:0/903231136 >> v1:172.21.15.19:6816/126819 conn(0x7f8e7802f510 legacy=0x7f8e780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.362+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8514074ea0 con 0x7f851409d6f0 2023-10-03T10:14:07.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.363+0000 7f8509ffb700 1 -- 172.21.15.19:0/3494464108 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8510034020 con 0x7f851409d6f0 2023-10-03T10:14:07.363 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:07.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 >> v1:172.21.15.19:6816/126819 conn(0x7f84f802f560 legacy=0x7f84f8031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 msgr2=0x7f85141222e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8510000c00 tx=0x7f8510004750 comp rx=0 tx=0).stop 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 shutdown_connections 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f851409e410 0x7f8514122d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f851409d6f0 0x7f85141222e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 --2- 172.21.15.19:0/3494464108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f851409e000 0x7f8514122820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 >> 172.21.15.19:0/3494464108 conn(0x7f8514066f50 msgr2=0x7f8514133eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 shutdown_connections 2023-10-03T10:14:07.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.365+0000 7f851b33a700 1 -- 172.21.15.19:0/3494464108 wait complete. 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.375+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8e9411e940 con 0x7f8e9409d6f0 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.376+0000 7f8e8affd700 1 -- 172.21.15.19:0/903231136 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e900192c0 con 0x7f8e9409d6f0 2023-10-03T10:14:07.375 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 >> v1:172.21.15.19:6816/126819 conn(0x7f8e7802f510 legacy=0x7f8e780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 msgr2=0x7f8e9411b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000c4e0 tx=0x7f8e9000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 shutdown_connections 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e94135e50 0x7f8e9411bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e9409d6f0 0x7f8e9411b500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 --2- 172.21.15.19:0/903231136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e9409e1d0 0x7f8e9411ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 >> 172.21.15.19:0/903231136 conn(0x7f8e94066f50 msgr2=0x7f8e94134d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 shutdown_connections 2023-10-03T10:14:07.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.378+0000 7f8e9c68d700 1 -- 172.21.15.19:0/903231136 wait complete. 2023-10-03T10:14:07.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:07.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:07.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.450+0000 7f1dee2fe700 1 -- 172.21.15.19:0/1643922623 >> v1:172.21.15.19:6816/126819 conn(0x7f1dcc02f510 legacy=0x7f1dcc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:07.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.470+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1de8124140 con 0x7f1de809f410 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.470+0000 7f1ddeffd700 1 -- 172.21.15.19:0/1643922623 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1de8124140 con 0x7f1de809f410 2023-10-03T10:14:07.470 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:07.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 >> v1:172.21.15.19:6816/126819 conn(0x7f1dcc02f510 legacy=0x7f1dcc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 msgr2=0x7f1de81c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1dd800e9b0 tx=0x7f1dd800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 shutdown_connections 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1de8136fe0 0x7f1de806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1de809e930 0x7f1de81c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 --2- 172.21.15.19:0/1643922623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1de809f410 0x7f1de81c8a80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.472+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 >> 172.21.15.19:0/1643922623 conn(0x7f1de80a4210 msgr2=0x7f1de80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.473+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 shutdown_connections 2023-10-03T10:14:07.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:07.473+0000 7f1df0562700 1 -- 172.21.15.19:0/1643922623 wait complete. 2023-10-03T10:14:07.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:08.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:08.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:08.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:08.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.520+0000 7f48a4cd3700 1 Processor -- start 2023-10-03T10:14:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.520+0000 7f48a4cd3700 1 -- start start 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f48a4cd3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48a009f410 0x7f48a0136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f48a4cd3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a01393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f48a4cd3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a0070940 con 0x7f48a009e930 2023-10-03T10:14:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f48a4cd3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a006fd60 con 0x7f48a009f410 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f48a4cd3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a006fa80 con 0x7f48a0136fe0 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f489dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48a009f410 0x7f48a0136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f489e59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f48a009e930 0x7f48a009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40736/0 (socket says 172.21.15.19:40736) 2023-10-03T10:14:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.521+0000 7f489e59c700 1 -- 172.21.15.19:0/2228459534 learned_addr learned my addr 172.21.15.19:0/2228459534 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489ed9d700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a01393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489dd9b700 1 -- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 msgr2=0x7f48a01393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489dd9b700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a01393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489d59a700 1 -- 172.21.15.19:0/2228459534 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575016165 0 0) 0x7f48a0070940 con 0x7f48a009e930 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489dd9b700 1 -- 172.21.15.19:0/2228459534 >> v1:172.21.15.19:6789/0 conn(0x7f48a009e930 legacy=0x7f48a009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489dd9b700 1 -- 172.21.15.19:0/2228459534 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a009fb60 con 0x7f48a009f410 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489dd9b700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009f410 0x7f48a0136aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4894009840 tx=0x7f4894009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acd4894eb7cefde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489d59a700 1 -- 172.21.15.19:0/2228459534 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011830 con 0x7f48a009f410 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489d59a700 1 -- 172.21.15.19:0/2228459534 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894011990 con 0x7f48a009f410 2023-10-03T10:14:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.522+0000 7f489d59a700 1 -- 172.21.15.19:0/2228459534 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894011d20 con 0x7f48a009f410 2023-10-03T10:14:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.523+0000 7f48a4cd3700 1 -- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009f410 msgr2=0x7f48a0136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.523+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009f410 0x7f48a0136aa0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4894009840 tx=0x7f4894009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 -- 172.21.15.19:0/2228459534 shutdown_connections 2023-10-03T10:14:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a01393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/2228459534 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009f410 0x7f48a0136aa0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 -- 172.21.15.19:0/2228459534 >> 172.21.15.19:0/2228459534 conn(0x7f48a00a4210 msgr2=0x7f48a00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 -- 172.21.15.19:0/2228459534 shutdown_connections 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.524+0000 7f48a4cd3700 1 -- 172.21.15.19:0/2228459534 wait complete. 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.525+0000 7f48a4cd3700 1 Processor -- start 2023-10-03T10:14:08.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.525+0000 7f48a4cd3700 1 -- start start 2023-10-03T10:14:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a009f410 0x7f48a011ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a011f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a0120290 con 0x7f48a009e930 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a01208b0 con 0x7f48a0136fe0 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f48a4cd3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a0071d90 con 0x7f48a009f410 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f489e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f489e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46700/0 (socket says 172.21.15.19:46700) 2023-10-03T10:14:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.526+0000 7f489e59c700 1 -- 172.21.15.19:0/1975357771 learned_addr learned my addr 172.21.15.19:0/1975357771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:08.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489ed9d700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a011f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489dd9b700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a009f410 0x7f48a011ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 -- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a009f410 msgr2=0x7f48a011ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a009f410 0x7f48a011ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 -- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 msgr2=0x7f48a011f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a011f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 -- 172.21.15.19:0/1975357771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940094a0 con 0x7f48a009e930 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f489e59c700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f489000c550 tx=0x7f489000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890015d70 con 0x7f48a009e930 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890019070 con 0x7f48a009e930 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a00a3360 con 0x7f48a009e930 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890004ab0 con 0x7f48a009e930 2023-10-03T10:14:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.527+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a0121ec0 con 0x7f48a009e930 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.528+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4890004c10 con 0x7f48a009e930 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.529+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f489003f3d0 con 0x7f48a009e930 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.529+0000 7f489dd9b700 1 -- 172.21.15.19:0/1975357771 >> v1:172.21.15.19:6816/126819 conn(0x7f488002f510 legacy=0x7f48800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.529+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a0120ae0 con 0x7f48a009e930 2023-10-03T10:14:08.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.538+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f489001f7b0 con 0x7f48a009e930 2023-10-03T10:14:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.553+0000 7fa808758700 1 Processor -- start 2023-10-03T10:14:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.553+0000 7fa808758700 1 -- start start 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa808758700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 0x7fa800135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa808758700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 0x7fa800138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa808758700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80009f130 con 0x7fa80009d6f0 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa808758700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80009f520 con 0x7fa800135e50 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa808758700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80009e930 con 0x7fa80009e1d0 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa8064f4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa80009d6f0 0x7fa80009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40740/0 (socket says 172.21.15.19:40740) 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa8064f4700 1 -- 172.21.15.19:0/300313914 learned_addr learned my addr 172.21.15.19:0/300313914 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa805cf3700 1 --2- 172.21.15.19:0/300313914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 0x7fa800135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa806cf5700 1 --2- 172.21.15.19:0/300313914 >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 0x7fa800138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa8054f2700 1 -- 172.21.15.19:0/300313914 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078394788 0 0) 0x7fa80009f130 con 0x7fa80009d6f0 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.554+0000 7fa8054f2700 1 -- 172.21.15.19:0/300313914 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec0035b0 con 0x7fa80009d6f0 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa805cf3700 1 -- 172.21.15.19:0/300313914 >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 msgr2=0x7fa800138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa805cf3700 1 --2- 172.21.15.19:0/300313914 >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 0x7fa800138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa805cf3700 1 -- 172.21.15.19:0/300313914 >> v1:172.21.15.19:6789/0 conn(0x7fa80009d6f0 legacy=0x7fa80009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa805cf3700 1 -- 172.21.15.19:0/300313914 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80009b2d0 con 0x7fa80009e1d0 2023-10-03T10:14:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa806cf5700 1 --2- 172.21.15.19:0/300313914 >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 0x7fa800138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa805cf3700 1 --2- 172.21.15.19:0/300313914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 0x7fa800135910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30ad7a23d7a66fa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa8054f2700 1 -- 172.21.15.19:0/300313914 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0011830 con 0x7fa80009e1d0 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa8054f2700 1 -- 172.21.15.19:0/300313914 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f0011990 con 0x7fa80009e1d0 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.555+0000 7fa8054f2700 1 -- 172.21.15.19:0/300313914 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0011d20 con 0x7fa80009e1d0 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 -- 172.21.15.19:0/300313914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 msgr2=0x7fa800135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 --2- 172.21.15.19:0/300313914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 0x7fa800135910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 -- 172.21.15.19:0/300313914 shutdown_connections 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 --2- 172.21.15.19:0/300313914 >> v2:172.21.15.19:3300/0 conn(0x7fa800135e50 0x7fa800138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 --2- 172.21.15.19:0/300313914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa80009e1d0 0x7fa800135910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 -- 172.21.15.19:0/300313914 >> 172.21.15.19:0/300313914 conn(0x7fa800066f50 msgr2=0x7fa80009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 -- 172.21.15.19:0/300313914 shutdown_connections 2023-10-03T10:14:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.556+0000 7fa808758700 1 -- 172.21.15.19:0/300313914 wait complete. 2023-10-03T10:14:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.557+0000 7fa808758700 1 Processor -- start 2023-10-03T10:14:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.557+0000 7fa808758700 1 -- start start 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa80009d6f0 0x7fa8001194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 0x7fa800119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80011c760 con 0x7fa80009e1d0 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800130200 con 0x7fa800135e50 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa808758700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa80011b1b0 con 0x7fa80009d6f0 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46720/0 (socket says 172.21.15.19:46720) 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 -- 172.21.15.19:0/3420462802 learned_addr learned my addr 172.21.15.19:0/3420462802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa8064f4700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa80009d6f0 0x7fa8001194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa806cf5700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 0x7fa800119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 -- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa80009d6f0 msgr2=0x7fa8001194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa80009d6f0 0x7fa8001194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 -- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 msgr2=0x7fa800119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 0x7fa800119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 -- 172.21.15.19:0/3420462802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f800e980 con 0x7fa80009e1d0 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa806cf5700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 0x7fa800119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7f7e13371700 1 Processor -- start 2023-10-03T10:14:08.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.558+0000 7fa805cf3700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009840 tx=0x7fa7f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 -- start start 2023-10-03T10:14:08.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00036a0 con 0x7fa80009e1d0 2023-10-03T10:14:08.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f001f070 con 0x7fa80009e1d0 2023-10-03T10:14:08.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f0003a20 con 0x7fa80009e1d0 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09d6f0 0x7f7e0c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 0x7f7e0c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e0c09b120 con 0x7f7e0c09e000 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c06b460 con 0x7f7e0c09e410 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e13371700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c09a7e0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e1090c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7e0c09e000 0x7f7e0c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40744/0 (socket says 172.21.15.19:40744) 2023-10-03T10:14:08.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7f7e1090c700 1 -- 172.21.15.19:0/1081690051 learned_addr learned my addr 172.21.15.19:0/1081690051 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:08.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.559+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f00094a0 con 0x7fa80009e1d0 2023-10-03T10:14:08.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80011cfa0 con 0x7fa80009e1d0 2023-10-03T10:14:08.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1190e700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 0x7f7e0c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1110d700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09d6f0 0x7f7e0c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1190e700 1 -- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09d6f0 msgr2=0x7f7e0c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1190e700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09d6f0 0x7f7e0c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1190e700 1 -- 172.21.15.19:0/1081690051 >> v1:172.21.15.19:6789/0 conn(0x7f7e0c09e000 legacy=0x7f7e0c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7f7e1190e700 1 -- 172.21.15.19:0/1081690051 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c09a500 con 0x7f7e0c09e410 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7f7e1190e700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 0x7f7e0c134100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009dc0 tx=0x7f7e0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7335be944e10d2d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.560+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fa7f0003b80 con 0x7fa80009e1d0 2023-10-03T10:14:08.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fa7f0021070 con 0x7fa80009e1d0 2023-10-03T10:14:08.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7fa8064f4700 1 -- 172.21.15.19:0/3420462802 >> v1:172.21.15.19:6816/126819 conn(0x7fa7e402f510 legacy=0x7fa7e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800074ea0 con 0x7fa80009e1d0 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7f7e03fff700 1 -- 172.21.15.19:0/1081690051 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0400e070 con 0x7f7e0c09e410 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7f7e03fff700 1 -- 172.21.15.19:0/1081690051 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0400bb20 con 0x7f7e0c09e410 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.561+0000 7f7e03fff700 1 -- 172.21.15.19:0/1081690051 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04012430 con 0x7f7e0c09e410 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 -- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 msgr2=0x7f7e0c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 0x7f7e0c134100 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009dc0 tx=0x7f7e0400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 -- 172.21.15.19:0/1081690051 shutdown_connections 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e410 0x7f7e0c134100 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 --2- 172.21.15.19:0/1081690051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09d6f0 0x7f7e0c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 -- 172.21.15.19:0/1081690051 >> 172.21.15.19:0/1081690051 conn(0x7f7e0c066f50 msgr2=0x7f7e0c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 -- 172.21.15.19:0/1081690051 shutdown_connections 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.562+0000 7f7e13371700 1 -- 172.21.15.19:0/1081690051 wait complete. 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.563+0000 7f7e13371700 1 Processor -- start 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 -- start start 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 0x7f7e0c1225b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 0x7f7e0c122af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09e410 0x7f7e0c123030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c133570 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c1242d0 con 0x7f7e0c09e000 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e13371700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0c125b30 con 0x7f7e0c09e410 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e1090c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 0x7f7e0c122af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.564+0000 7f7e1110d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 0x7f7e0c1225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1090c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 0x7f7e0c122af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36800/0 (socket says 172.21.15.19:36800) 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1090c700 1 -- 172.21.15.19:0/1981144751 learned_addr learned my addr 172.21.15.19:0/1981144751 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1190e700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09e410 0x7f7e0c123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 -- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09e410 msgr2=0x7f7e0c123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09e410 0x7f7e0c123030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 -- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 msgr2=0x7f7e0c122af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 0x7f7e0c122af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 -- 172.21.15.19:0/1981144751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04009a70 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.565+0000 7f7e1110d700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 0x7f7e0c1225b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800e900 tx=0x7f7e0800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08013680 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e080137e0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e08013b50 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0c09c710 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7f002b020 con 0x7fa80009e1d0 2023-10-03T10:14:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.566+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0c126860 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.568+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0c074ea0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.568+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7e08013cb0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.568+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7e0803fcc0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.570+0000 7f7e1090c700 1 -- 172.21.15.19:0/1981144751 >> v1:172.21.15.19:6816/126819 conn(0x7f7df002f510 legacy=0x7f7df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.573+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e08046080 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.671+0000 7f169b18f700 1 Processor -- start 2023-10-03T10:14:08.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 -- start start 2023-10-03T10:14:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f169409e410 0x7f1694134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169409b120 con 0x7f169409e000 2023-10-03T10:14:08.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169406b460 con 0x7f169409e410 2023-10-03T10:14:08.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.672+0000 7f169b18f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169409a7e0 con 0x7f169409d6f0 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f1698f2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f1698f2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36802/0 (socket says 172.21.15.19:36802) 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f1698f2b700 1 -- 172.21.15.19:0/4035694316 learned_addr learned my addr 172.21.15.19:0/4035694316 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 --2- 172.21.15.19:0/4035694316 >> v2:172.21.15.19:3300/0 conn(0x7f169409e410 0x7f1694134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 -- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 msgr2=0x7f169409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 -- 172.21.15.19:0/4035694316 >> v1:172.21.15.19:6789/0 conn(0x7f169409e000 legacy=0x7f16941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 -- 172.21.15.19:0/4035694316 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169409a500 con 0x7f169409e410 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f1698f2b700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.673+0000 7f169972c700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e410 0x7f1694134100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f168c009d90 tx=0x7f168c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23361051d7fb1379 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.674+0000 7f16937fe700 1 -- 172.21.15.19:0/4035694316 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00e070 con 0x7f169409e410 2023-10-03T10:14:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.674+0000 7f16937fe700 1 -- 172.21.15.19:0/4035694316 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c00bb20 con 0x7f169409e410 2023-10-03T10:14:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.674+0000 7f16937fe700 1 -- 172.21.15.19:0/4035694316 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c012430 con 0x7f169409e410 2023-10-03T10:14:08.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.674+0000 7f169b18f700 1 -- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e410 msgr2=0x7f1694134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.674+0000 7f169b18f700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e410 0x7f1694134100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f168c009d90 tx=0x7f168c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 -- 172.21.15.19:0/4035694316 shutdown_connections 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e410 0x7f1694134100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 --2- 172.21.15.19:0/4035694316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409d6f0 0x7f169409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 -- 172.21.15.19:0/4035694316 >> 172.21.15.19:0/4035694316 conn(0x7f1694066f50 msgr2=0x7f169409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 -- 172.21.15.19:0/4035694316 shutdown_connections 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.675+0000 7f169b18f700 1 -- 172.21.15.19:0/4035694316 wait complete. 2023-10-03T10:14:08.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 Processor -- start 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 -- start start 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f169409d6f0 0x7f16941abb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e000 0x7f16941ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.676+0000 7f169b18f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16941ad6c0 con 0x7f169409e000 2023-10-03T10:14:08.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169b18f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169409c780 con 0x7f169409e410 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169b18f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16941adca0 con 0x7f169409d6f0 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f1693fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e000 0x7f16941ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36806/0 (socket says 172.21.15.19:36806) 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 -- 172.21.15.19:0/3327598619 learned_addr learned my addr 172.21.15.19:0/3327598619 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f1698f2b700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f169409d6f0 0x7f16941abb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 -- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f169409d6f0 msgr2=0x7f16941abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f169409d6f0 0x7f16941abb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 -- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e000 msgr2=0x7f16941ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e000 0x7f16941ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 -- 172.21.15.19:0/3327598619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1688009550 con 0x7f169409e410 2023-10-03T10:14:08.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.677+0000 7f169972c700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b680 tx=0x7f168c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.678+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c012430 con 0x7f169409e410 2023-10-03T10:14:08.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.678+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c020070 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.678+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c004280 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.678+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c009a70 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.678+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940a2f40 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.679+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f168c0043e0 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.679+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f168c022070 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.679+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16941baa40 con 0x7f169409e410 2023-10-03T10:14:08.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.679+0000 7f1698f2b700 1 -- 172.21.15.19:0/3327598619 >> v1:172.21.15.19:6816/126819 conn(0x7f167802f510 legacy=0x7f16780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.684+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f168c02c020 con 0x7f169409e410 2023-10-03T10:14:08.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.730+0000 7f489dd9b700 1 -- 172.21.15.19:0/1975357771 >> v1:172.21.15.19:6816/126819 conn(0x7f488002f510 legacy=0x7f48800319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.762+0000 7fa8064f4700 1 -- 172.21.15.19:0/3420462802 >> v1:172.21.15.19:6816/126819 conn(0x7fa7e402f510 legacy=0x7fa7e40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.771+0000 7f7e1090c700 1 -- 172.21.15.19:0/1981144751 >> v1:172.21.15.19:6816/126819 conn(0x7f7df002f510 legacy=0x7f7df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.788+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48a009a470 con 0x7f48a009e930 2023-10-03T10:14:08.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.789+0000 7f488effd700 1 -- 172.21.15.19:0/1975357771 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f489001e9a0 con 0x7f48a009e930 2023-10-03T10:14:08.788 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 >> v1:172.21.15.19:6816/126819 conn(0x7f488002f510 legacy=0x7f48800319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 msgr2=0x7f48a011e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f489000c550 tx=0x7f489000c860 comp rx=0 tx=0).stop 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 shutdown_connections 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a0136fe0 0x7f48a011f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a009e930 0x7f48a011e680 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 --2- 172.21.15.19:0/1975357771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a009f410 0x7f48a011ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 >> 172.21.15.19:0/1975357771 conn(0x7f48a00a4210 msgr2=0x7f48a0134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 shutdown_connections 2023-10-03T10:14:08.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.791+0000 7f48a4cd3700 1 -- 172.21.15.19:0/1975357771 wait complete. 2023-10-03T10:14:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.795+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e0c071fc0 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.795+0000 7f7e01ffb700 1 -- 172.21.15.19:0/1981144751 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e0801be10 con 0x7f7e0c09d6f0 2023-10-03T10:14:08.795 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.798+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 >> v1:172.21.15.19:6816/126819 conn(0x7f7df002f510 legacy=0x7f7df00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.798+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 msgr2=0x7f7e0c1225b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.798+0000 7f7e13371700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 0x7f7e0c1225b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800e900 tx=0x7f7e0800ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:08.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 shutdown_connections 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0c09e410 0x7f7e0c123030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0c09d6f0 0x7f7e0c1225b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 --2- 172.21.15.19:0/1981144751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0c09e000 0x7f7e0c122af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 >> 172.21.15.19:0/1981144751 conn(0x7f7e0c066f50 msgr2=0x7f7e0c070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 shutdown_connections 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.799+0000 7f7e13371700 1 -- 172.21.15.19:0/1981144751 wait complete. 2023-10-03T10:14:08.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.800+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa8000a20d0 con 0x7fa80009e1d0 2023-10-03T10:14:08.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.800+0000 7fa7f6ffd700 1 -- 172.21.15.19:0/3420462802 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7f0034070 con 0x7fa80009e1d0 2023-10-03T10:14:08.800 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:08.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 >> v1:172.21.15.19:6816/126819 conn(0x7fa7e402f510 legacy=0x7fa7e40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:08.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 msgr2=0x7fa8001199f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009840 tx=0x7fa7f0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 shutdown_connections 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa800135e50 0x7fa800119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa80009d6f0 0x7fa8001194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 --2- 172.21.15.19:0/3420462802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa80009e1d0 0x7fa8001199f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 >> 172.21.15.19:0/3420462802 conn(0x7fa800066f50 msgr2=0x7fa800130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 shutdown_connections 2023-10-03T10:14:08.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.804+0000 7fa808758700 1 -- 172.21.15.19:0/3420462802 wait complete. 2023-10-03T10:14:08.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:08.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:08.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:08.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.880+0000 7f1698f2b700 1 -- 172.21.15.19:0/3327598619 >> v1:172.21.15.19:6816/126819 conn(0x7f167802f510 legacy=0x7f16780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:08.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.894+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1694074ea0 con 0x7f169409e410 2023-10-03T10:14:08.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.894+0000 7f16917fa700 1 -- 172.21.15.19:0/3327598619 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f168c0263e0 con 0x7f169409e410 2023-10-03T10:14:08.894 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.896+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 >> v1:172.21.15.19:6816/126819 conn(0x7f167802f510 legacy=0x7f16780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.896+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 msgr2=0x7f16941ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.896+0000 7f169b18f700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b680 tx=0x7f168c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 shutdown_connections 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f169409e410 0x7f16941ac5c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f169409d6f0 0x7f16941abb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 --2- 172.21.15.19:0/3327598619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f169409e000 0x7f16941ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:08.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 >> 172.21.15.19:0/3327598619 conn(0x7f1694066f50 msgr2=0x7f16940a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 shutdown_connections 2023-10-03T10:14:08.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:08.897+0000 7f169b18f700 1 -- 172.21.15.19:0/3327598619 wait complete. 2023-10-03T10:14:08.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:09.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:09.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:09.824 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:09.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.962+0000 7fd174457700 1 Processor -- start 2023-10-03T10:14:09.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.962+0000 7fd174457700 1 -- start start 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd174457700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 0x7fd16c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd174457700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd16c139250 0x7fd16c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd174457700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd16c09edd0 con 0x7fd16c0a0a30 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd174457700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd16c0a18e0 con 0x7fd16c139250 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd174457700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c09e1f0 con 0x7fd16c0a1510 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1719f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 0x7fd16c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1721f3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd16c0a0a30 0x7fd16c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40764/0 (socket says 172.21.15.19:40764) 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1721f3700 1 -- 172.21.15.19:0/4018422377 learned_addr learned my addr 172.21.15.19:0/4018422377 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1729f4700 1 --2- 172.21.15.19:0/4018422377 >> v2:172.21.15.19:3300/0 conn(0x7fd16c139250 0x7fd16c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1719f2700 1 -- 172.21.15.19:0/4018422377 >> v2:172.21.15.19:3300/0 conn(0x7fd16c139250 msgr2=0x7fd16c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1719f2700 1 --2- 172.21.15.19:0/4018422377 >> v2:172.21.15.19:3300/0 conn(0x7fd16c139250 0x7fd16c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1719f2700 1 -- 172.21.15.19:0/4018422377 >> v1:172.21.15.19:6789/0 conn(0x7fd16c0a0a30 legacy=0x7fd16c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.963+0000 7fd1719f2700 1 -- 172.21.15.19:0/4018422377 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c09dc50 con 0x7fd16c0a1510 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd1719f2700 1 --2- 172.21.15.19:0/4018422377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 0x7fd16c138d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4c858b98753fcdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd1711f1700 1 -- 172.21.15.19:0/4018422377 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c011830 con 0x7fd16c0a1510 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd1711f1700 1 -- 172.21.15.19:0/4018422377 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c011990 con 0x7fd16c0a1510 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd1711f1700 1 -- 172.21.15.19:0/4018422377 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c011d20 con 0x7fd16c0a1510 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd174457700 1 -- 172.21.15.19:0/4018422377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 msgr2=0x7fd16c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.964+0000 7fd174457700 1 --2- 172.21.15.19:0/4018422377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 0x7fd16c138d10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009870 tx=0x7fd15c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 -- 172.21.15.19:0/4018422377 shutdown_connections 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 --2- 172.21.15.19:0/4018422377 >> v2:172.21.15.19:3300/0 conn(0x7fd16c139250 0x7fd16c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 --2- 172.21.15.19:0/4018422377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c0a1510 0x7fd16c138d10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 -- 172.21.15.19:0/4018422377 >> 172.21.15.19:0/4018422377 conn(0x7fd16c0a6550 msgr2=0x7fd16c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 -- 172.21.15.19:0/4018422377 shutdown_connections 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.965+0000 7fd174457700 1 -- 172.21.15.19:0/4018422377 wait complete. 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.966+0000 7fd174457700 1 Processor -- start 2023-10-03T10:14:09.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.966+0000 7fd174457700 1 -- start start 2023-10-03T10:14:09.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd16c0a0a30 0x7fd16c136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 0x7fd16c121880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c123610 con 0x7fd16c0a1510 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c1255c0 con 0x7fd16c139250 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd174457700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c138cf0 con 0x7fd16c0a0a30 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd1719f2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd1719f2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46780/0 (socket says 172.21.15.19:46780) 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd1719f2700 1 -- 172.21.15.19:0/1764270381 learned_addr learned my addr 172.21.15.19:0/1764270381 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd1729f4700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 0x7fd16c121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.967+0000 7fd1721f3700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd16c0a0a30 0x7fd16c136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:09.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 -- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd16c0a0a30 msgr2=0x7fd16c136690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd16c0a0a30 0x7fd16c136690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 -- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 msgr2=0x7fd16c121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 0x7fd16c121880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 -- 172.21.15.19:0/1764270381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c0094a0 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1729f4700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 0x7fd16c121880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd1719f2700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd15c000c00 tx=0x7fd15c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0036a0 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15c01f070 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c003a60 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c123a50 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.968+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c137110 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.969+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c074ea0 con 0x7fd16c0a1510 2023-10-03T10:14:09.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.970+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd15c003bc0 con 0x7fd16c0a1510 2023-10-03T10:14:09.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.970+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd15c021070 con 0x7fd16c0a1510 2023-10-03T10:14:09.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.970+0000 7fd1721f3700 1 -- 172.21.15.19:0/1764270381 >> v1:172.21.15.19:6816/126819 conn(0x7fd15002f510 legacy=0x7fd1500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:09.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:09.979+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd15c046060 con 0x7fd16c0a1510 2023-10-03T10:14:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.002+0000 7f8bda625700 1 Processor -- start 2023-10-03T10:14:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.002+0000 7f8bda625700 1 -- start start 2023-10-03T10:14:10.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bda625700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8bd409d630 0x7f8bd40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bda625700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 0x7f8bd413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bda625700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd40a2a70 con 0x7f8bd40a0a30 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bda625700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd40a01d0 con 0x7f8bd409d630 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bda625700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd409e2b0 con 0x7f8bd4138d80 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bd3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8bd40a0a30 0x7f8bd40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40772/0 (socket says 172.21.15.19:40772) 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bd3fff700 1 -- 172.21.15.19:0/1255789340 learned_addr learned my addr 172.21.15.19:0/1255789340 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/1255789340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 0x7f8bd413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.003+0000 7f8bd37fe700 1 --2- 172.21.15.19:0/1255789340 >> v2:172.21.15.19:3300/0 conn(0x7f8bd409d630 0x7f8bd40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd2ffd700 1 -- 172.21.15.19:0/1255789340 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25363790 0 0) 0x7f8bd40a2a70 con 0x7f8bd40a0a30 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd2ffd700 1 -- 172.21.15.19:0/1255789340 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bbc0035b0 con 0x7f8bd40a0a30 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/1255789340 >> v2:172.21.15.19:3300/0 conn(0x7f8bd409d630 msgr2=0x7f8bd40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/1255789340 >> v2:172.21.15.19:3300/0 conn(0x7f8bd409d630 0x7f8bd40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/1255789340 >> v1:172.21.15.19:6789/0 conn(0x7f8bd40a0a30 legacy=0x7f8bd40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/1255789340 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd409dc50 con 0x7f8bd4138d80 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/1255789340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 0x7f8bd413b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009d90 tx=0x7f8bcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdac1c6fe6515eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd2ffd700 1 -- 172.21.15.19:0/1255789340 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00e070 con 0x7f8bd4138d80 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd2ffd700 1 -- 172.21.15.19:0/1255789340 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc00bb20 con 0x7f8bd4138d80 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.004+0000 7f8bd2ffd700 1 -- 172.21.15.19:0/1255789340 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc00be90 con 0x7f8bd4138d80 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 -- 172.21.15.19:0/1255789340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 msgr2=0x7f8bd413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 --2- 172.21.15.19:0/1255789340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 0x7f8bd413b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc009d90 tx=0x7f8bcc00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 -- 172.21.15.19:0/1255789340 shutdown_connections 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 --2- 172.21.15.19:0/1255789340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd4138d80 0x7f8bd413b160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 --2- 172.21.15.19:0/1255789340 >> v2:172.21.15.19:3300/0 conn(0x7f8bd409d630 0x7f8bd40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 -- 172.21.15.19:0/1255789340 >> 172.21.15.19:0/1255789340 conn(0x7f8bd40a3050 msgr2=0x7f8bd40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 -- 172.21.15.19:0/1255789340 shutdown_connections 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.005+0000 7f8bda625700 1 -- 172.21.15.19:0/1255789340 wait complete. 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.006+0000 7f8bda625700 1 Processor -- start 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.006+0000 7f8bda625700 1 -- start start 2023-10-03T10:14:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 Processor -- start 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd409d630 0x7f8bd41204e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd40a0a30 0x7f8bd4120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd41220f0 con 0x7f8bd40a0a30 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4123340 con 0x7f8bd4138d80 2023-10-03T10:14:10.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bda625700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd4123d20 con 0x7f8bd409d630 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bd8bc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bd8bc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36826/0 (socket says 172.21.15.19:36826) 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/700415101 learned_addr learned my addr 172.21.15.19:0/700415101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 -- start start 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f324c06f050 0x7f324c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324c070ee0 con 0x7f324c06e570 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324c071980 con 0x7f324c06f050 2023-10-03T10:14:10.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.007+0000 7f3251f88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f324c071480 con 0x7f324c09eca0 2023-10-03T10:14:10.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd409d630 msgr2=0x7f8bd41204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd409d630 0x7f8bd41204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd40a0a30 msgr2=0x7f8bd4120a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd40a0a30 0x7f8bd4120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 -- 172.21.15.19:0/700415101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009a70 con 0x7f8bd4138d80 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd8bc2700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b370 tx=0x7f8bcc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc003e10 con 0x7f8bd4138d80 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc020070 con 0x7f8bd4138d80 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc0276c0 con 0x7f8bd4138d80 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd4123790 con 0x7f8bd4138d80 2023-10-03T10:14:10.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.008+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd40a0410 con 0x7f8bd4138d80 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.009+0000 7f324affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.009+0000 7f324affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34318/0 (socket says 172.21.15.19:34318) 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.009+0000 7f324affd700 1 -- 172.21.15.19:0/39688295 learned_addr learned my addr 172.21.15.19:0/39688295 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.009+0000 7f324bfff700 1 --2- 172.21.15.19:0/39688295 >> v2:172.21.15.19:3300/0 conn(0x7f324c06f050 0x7f324c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324affd700 1 -- 172.21.15.19:0/39688295 >> v2:172.21.15.19:3300/0 conn(0x7f324c06f050 msgr2=0x7f324c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324affd700 1 --2- 172.21.15.19:0/39688295 >> v2:172.21.15.19:3300/0 conn(0x7f324c06f050 0x7f324c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324affd700 1 -- 172.21.15.19:0/39688295 >> v1:172.21.15.19:6789/0 conn(0x7f324c06e570 legacy=0x7f324c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd40747f0 con 0x7f8bd4138d80 2023-10-03T10:14:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324affd700 1 -- 172.21.15.19:0/39688295 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c071b90 con 0x7f324c09eca0 2023-10-03T10:14:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324affd700 1 --2- 172.21.15.19:0/39688295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32400098f0 tx=0x7f3240009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a55da402b8522f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8bcc031430 con 0x7f8bd4138d80 2023-10-03T10:14:10.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324a7fc700 1 -- 172.21.15.19:0/39688295 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240004230 con 0x7f324c09eca0 2023-10-03T10:14:10.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324a7fc700 1 -- 172.21.15.19:0/39688295 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240004390 con 0x7f324c09eca0 2023-10-03T10:14:10.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f324a7fc700 1 -- 172.21.15.19:0/39688295 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32400036a0 con 0x7f324c09eca0 2023-10-03T10:14:10.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8bcc022070 con 0x7f8bd4138d80 2023-10-03T10:14:10.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.010+0000 7f8bd3fff700 1 -- 172.21.15.19:0/700415101 >> v1:172.21.15.19:6816/126819 conn(0x7f8bc002f540 legacy=0x7f8bc00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 -- 172.21.15.19:0/39688295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 msgr2=0x7f324c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 --2- 172.21.15.19:0/39688295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f32400098f0 tx=0x7f3240009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 -- 172.21.15.19:0/39688295 shutdown_connections 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 --2- 172.21.15.19:0/39688295 >> v2:172.21.15.19:3300/0 conn(0x7f324c06f050 0x7f324c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 --2- 172.21.15.19:0/39688295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c09eca0 0x7f324c13cea0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.011+0000 7f3251f88700 1 -- 172.21.15.19:0/39688295 >> 172.21.15.19:0/39688295 conn(0x7f324c0a2aa0 msgr2=0x7f324c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.012+0000 7f3251f88700 1 -- 172.21.15.19:0/39688295 shutdown_connections 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.012+0000 7f3251f88700 1 -- 172.21.15.19:0/39688295 wait complete. 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.013+0000 7f3251f88700 1 Processor -- start 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.013+0000 7f3251f88700 1 -- start start 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c06e570 0x7f324c13d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f324c06f050 0x7f324c13d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324c12c240 con 0x7f324c06f050 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324c13e4b0 con 0x7f324c13db60 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f3251f88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f324c12dc80 con 0x7f324c06e570 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f324bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f324bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36834/0 (socket says 172.21.15.19:36834) 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f324bfff700 1 -- 172.21.15.19:0/1773838435 learned_addr learned my addr 172.21.15.19:0/1773838435 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.014+0000 7f324b7fe700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c06e570 0x7f324c13d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 -- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c06e570 msgr2=0x7f324c13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c06e570 0x7f324c13d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 -- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f324c06f050 msgr2=0x7f324c13d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f324c06f050 0x7f324c13d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 -- 172.21.15.19:0/1773838435 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240009550 con 0x7f324c13db60 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.015+0000 7f324bfff700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f324400efc0 tx=0x7f324400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244009ea0 con 0x7f324c13db60 2023-10-03T10:14:10.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bcc012430 con 0x7f8bd4138d80 2023-10-03T10:14:10.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324400f040 con 0x7f324c13db60 2023-10-03T10:14:10.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3244014480 con 0x7f324c13db60 2023-10-03T10:14:10.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324c070610 con 0x7f324c13db60 2023-10-03T10:14:10.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.016+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f324c13ebe0 con 0x7f324c13db60 2023-10-03T10:14:10.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.017+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f32440145e0 con 0x7f324c13db60 2023-10-03T10:14:10.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.017+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f3244040670 con 0x7f324c13db60 2023-10-03T10:14:10.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.017+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324c074ea0 con 0x7f324c13db60 2023-10-03T10:14:10.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.017+0000 7f324b7fe700 1 -- 172.21.15.19:0/1773838435 >> v1:172.21.15.19:6816/126819 conn(0x7f323802f510 legacy=0x7f32380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.022+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3244018030 con 0x7f324c13db60 2023-10-03T10:14:10.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 Processor -- start 2023-10-03T10:14:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 -- start start 2023-10-03T10:14:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c64133a80 0x7f8c64133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c64130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6406c570 con 0x7f8c64133a80 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6406bc00 con 0x7f8c64130870 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.074+0000 7f8c6bf23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640a0040 con 0x7f8c6412ff20 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c694be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c64130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c6a4c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c694be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c64130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34330/0 (socket says 172.21.15.19:34330) 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c694be700 1 -- 172.21.15.19:0/3618754504 learned_addr learned my addr 172.21.15.19:0/3618754504 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:10.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c64133a80 0x7f8c64133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 -- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 msgr2=0x7f8c64130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c64130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 -- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 msgr2=0x7f8c6413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 -- 172.21.15.19:0/3618754504 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64133860 con 0x7f8c64133a80 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c6a4c0700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.075+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c64133e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009840 tx=0x7f8c60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad6dc7c14f189cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c68cbd700 1 -- 172.21.15.19:0/3618754504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011830 con 0x7f8c64133a80 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c68cbd700 1 -- 172.21.15.19:0/3618754504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60011990 con 0x7f8c64133a80 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c68cbd700 1 -- 172.21.15.19:0/3618754504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60011d20 con 0x7f8c64133a80 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 -- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 msgr2=0x7f8c64133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c64133e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009840 tx=0x7f8c60009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 -- 172.21.15.19:0/3618754504 shutdown_connections 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c64133e50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/3618754504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c64130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.076+0000 7f8c6bf23700 1 -- 172.21.15.19:0/3618754504 >> 172.21.15.19:0/3618754504 conn(0x7f8c640a4210 msgr2=0x7f8c640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.077+0000 7f8c6bf23700 1 -- 172.21.15.19:0/3618754504 shutdown_connections 2023-10-03T10:14:10.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.077+0000 7f8c6bf23700 1 -- 172.21.15.19:0/3618754504 wait complete. 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.078+0000 7f8c6bf23700 1 Processor -- start 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.078+0000 7f8c6bf23700 1 -- start start 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c6409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6406d280 con 0x7f8c64133a80 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6411fd80 con 0x7f8c64130870 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6bf23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6412da90 con 0x7f8c6412ff20 2023-10-03T10:14:10.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34338/0 (socket says 172.21.15.19:34338) 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 -- 172.21.15.19:0/1396745712 learned_addr learned my addr 172.21.15.19:0/1396745712 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c6a4c0700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c6409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c694be700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 -- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 msgr2=0x7f8c6409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 -- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 msgr2=0x7f8c6409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c6409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.079+0000 7f8c69cbf700 1 -- 172.21.15.19:0/1396745712 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009a70 con 0x7f8c6412ff20 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c694be700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c69cbf700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c600090b0 tx=0x7f8c60004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:10.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600044d0 con 0x7f8c6412ff20 2023-10-03T10:14:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6001f070 con 0x7f8c6412ff20 2023-10-03T10:14:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c600094a0 con 0x7f8c6412ff20 2023-10-03T10:14:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600038e0 con 0x7f8c6412ff20 2023-10-03T10:14:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.080+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6409dee0 con 0x7f8c6412ff20 2023-10-03T10:14:10.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.081+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c64074ea0 con 0x7f8c6412ff20 2023-10-03T10:14:10.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.081+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8c60003a40 con 0x7f8c6412ff20 2023-10-03T10:14:10.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.082+0000 7f8c694be700 1 -- 172.21.15.19:0/1396745712 >> v1:172.21.15.19:6816/126819 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.082+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8c60021070 con 0x7f8c6412ff20 2023-10-03T10:14:10.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.091+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c60046060 con 0x7f8c6412ff20 2023-10-03T10:14:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.171+0000 7fd1721f3700 1 -- 172.21.15.19:0/1764270381 >> v1:172.21.15.19:6816/126819 conn(0x7fd15002f510 legacy=0x7fd1500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.195+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd16c0a28e0 con 0x7fd16c0a1510 2023-10-03T10:14:10.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.195+0000 7fd162ffd700 1 -- 172.21.15.19:0/1764270381 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd15c046070 con 0x7fd16c0a1510 2023-10-03T10:14:10.195 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.197+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 >> v1:172.21.15.19:6816/126819 conn(0x7fd15002f510 legacy=0x7fd1500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.197+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 msgr2=0x7fd16c136bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.197+0000 7fd174457700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd15c000c00 tx=0x7fd15c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.197+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 shutdown_connections 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd16c139250 0x7fd16c121880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd16c0a0a30 0x7fd16c136690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 --2- 172.21.15.19:0/1764270381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd16c0a1510 0x7fd16c136bd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 >> 172.21.15.19:0/1764270381 conn(0x7fd16c0a6550 msgr2=0x7fd16c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 shutdown_connections 2023-10-03T10:14:10.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.198+0000 7fd174457700 1 -- 172.21.15.19:0/1764270381 wait complete. 2023-10-03T10:14:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.211+0000 7f8bd3fff700 1 -- 172.21.15.19:0/700415101 >> v1:172.21.15.19:6816/126819 conn(0x7f8bc002f540 legacy=0x7f8bc00319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:10.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.218+0000 7f324b7fe700 1 -- 172.21.15.19:0/1773838435 >> v1:172.21.15.19:6816/126819 conn(0x7f323802f510 legacy=0x7f32380319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.231+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8bd4072980 con 0x7f8bd4138d80 2023-10-03T10:14:10.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.231+0000 7f8bd0ff9700 1 -- 172.21.15.19:0/700415101 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bcc02c030 con 0x7f8bd4138d80 2023-10-03T10:14:10.231 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 >> v1:172.21.15.19:6816/126819 conn(0x7f8bc002f540 legacy=0x7f8bc00319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 msgr2=0x7f8bd4120f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc00b370 tx=0x7f8bcc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 shutdown_connections 2023-10-03T10:14:10.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bd4138d80 0x7f8bd4120f60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bd409d630 0x7f8bd41204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 --2- 172.21.15.19:0/700415101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bd40a0a30 0x7f8bd4120a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 >> 172.21.15.19:0/700415101 conn(0x7f8bd40a3050 msgr2=0x7f8bd409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 shutdown_connections 2023-10-03T10:14:10.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.234+0000 7f8bda625700 1 -- 172.21.15.19:0/700415101 wait complete. 2023-10-03T10:14:10.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.248+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f324c0a1f90 con 0x7f324c13db60 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.248+0000 7f3233fff700 1 -- 172.21.15.19:0/1773838435 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f324402a090 con 0x7f324c13db60 2023-10-03T10:14:10.248 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:10.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 >> v1:172.21.15.19:6816/126819 conn(0x7f323802f510 legacy=0x7f32380319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 msgr2=0x7f324c12adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f324400efc0 tx=0x7f324400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 shutdown_connections 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f324c13db60 0x7f324c12adf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f324c06e570 0x7f324c13d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 --2- 172.21.15.19:0/1773838435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f324c06f050 0x7f324c13d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 >> 172.21.15.19:0/1773838435 conn(0x7f324c0a2aa0 msgr2=0x7f324c09cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 shutdown_connections 2023-10-03T10:14:10.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.250+0000 7f3251f88700 1 -- 172.21.15.19:0/1773838435 wait complete. 2023-10-03T10:14:10.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:10.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.283+0000 7f8c694be700 1 -- 172.21.15.19:0/1396745712 >> v1:172.21.15.19:6816/126819 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:10.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.299+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8c6411ffa0 con 0x7f8c6412ff20 2023-10-03T10:14:10.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.299+0000 7f8c5a7fc700 1 -- 172.21.15.19:0/1396745712 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c60046020 con 0x7f8c6412ff20 2023-10-03T10:14:10.299 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:10.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 >> v1:172.21.15.19:6816/126819 conn(0x7f8c4802f510 legacy=0x7f8c480319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:10.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 msgr2=0x7f8c6409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c600090b0 tx=0x7f8c60004750 comp rx=0 tx=0).stop 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 shutdown_connections 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64133a80 0x7f8c6409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c6412ff20 0x7f8c6409c480 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 --2- 172.21.15.19:0/1396745712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c64130870 0x7f8c6409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 >> 172.21.15.19:0/1396745712 conn(0x7f8c640a4210 msgr2=0x7f8c6409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 shutdown_connections 2023-10-03T10:14:10.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:10.301+0000 7f8c6bf23700 1 -- 172.21.15.19:0/1396745712 wait complete. 2023-10-03T10:14:10.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:11.213 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:11.249 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:11.264 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:11.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:11.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.371+0000 7f909ce66700 1 Processor -- start 2023-10-03T10:14:11.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.371+0000 7f909ce66700 1 -- start start 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909ce66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909ce66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 0x7f9098134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909ce66700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909809b120 con 0x7f909809e000 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909ce66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909806b460 con 0x7f909809e410 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909ce66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f909809a7e0 con 0x7f909809d6f0 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34350/0 (socket says 172.21.15.19:34350) 2023-10-03T10:14:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f909659c700 1 -- 172.21.15.19:0/2422412305 learned_addr learned my addr 172.21.15.19:0/2422412305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.372+0000 7f9096d9d700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 0x7f9098134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f9096d9d700 1 -- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 msgr2=0x7f909809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f9096d9d700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f9096d9d700 1 -- 172.21.15.19:0/2422412305 >> v1:172.21.15.19:6789/0 conn(0x7f909809e000 legacy=0x7f90981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f9096d9d700 1 -- 172.21.15.19:0/2422412305 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909809a500 con 0x7f909809e410 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f909559a700 1 -- 172.21.15.19:0/2422412305 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264078656 0 0) 0x7f909809b120 con 0x7f909809e000 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f909659c700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f9096d9d700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 0x7f9098134100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9090009dc0 tx=0x7f909000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3133b467b0bd7c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f909559a700 1 -- 172.21.15.19:0/2422412305 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909000e070 con 0x7f909809e410 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f909559a700 1 -- 172.21.15.19:0/2422412305 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909000bb20 con 0x7f909809e410 2023-10-03T10:14:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.373+0000 7f909559a700 1 -- 172.21.15.19:0/2422412305 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090012430 con 0x7f909809e410 2023-10-03T10:14:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.374+0000 7f909ce66700 1 -- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 msgr2=0x7f9098134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.374+0000 7f909ce66700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 0x7f9098134100 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9090009dc0 tx=0x7f909000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 -- 172.21.15.19:0/2422412305 shutdown_connections 2023-10-03T10:14:11.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e410 0x7f9098134100 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 --2- 172.21.15.19:0/2422412305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809d6f0 0x7f909809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 -- 172.21.15.19:0/2422412305 >> 172.21.15.19:0/2422412305 conn(0x7f9098066f50 msgr2=0x7f909809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 -- 172.21.15.19:0/2422412305 shutdown_connections 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.375+0000 7f909ce66700 1 -- 172.21.15.19:0/2422412305 wait complete. 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.376+0000 7f909ce66700 1 Processor -- start 2023-10-03T10:14:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.376+0000 7f909ce66700 1 -- start start 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e000 0x7f9098122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 0x7f9098122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098125de0 con 0x7f909809d6f0 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098125840 con 0x7f909809e000 2023-10-03T10:14:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909ce66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9098123f70 con 0x7f909809e410 2023-10-03T10:14:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46816/0 (socket says 172.21.15.19:46816) 2023-10-03T10:14:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909659c700 1 -- 172.21.15.19:0/3312623675 learned_addr learned my addr 172.21.15.19:0/3312623675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f9095d9b700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e000 0x7f9098122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f9096d9d700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 0x7f9098122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.377+0000 7f909659c700 1 -- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 msgr2=0x7f9098122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909659c700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 0x7f9098122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909659c700 1 -- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e000 msgr2=0x7f9098122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909659c700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e000 0x7f9098122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909659c700 1 -- 172.21.15.19:0/3312623675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9088009550 con 0x7f909809d6f0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f9096d9d700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 0x7f9098122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909659c700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f908800ebe0 tx=0x7f908800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800c850 con 0x7f909809d6f0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908800c9b0 con 0x7f909809d6f0 2023-10-03T10:14:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908800cd20 con 0x7f909809d6f0 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090009a70 con 0x7f909809d6f0 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.378+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098124cd0 con 0x7f909809d6f0 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.379+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9088013470 con 0x7f909809d6f0 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.379+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909811f030 con 0x7f909809d6f0 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.380+0000 7f9095d9b700 1 -- 172.21.15.19:0/3312623675 >> v1:172.21.15.19:6816/126819 conn(0x7f907802f540 legacy=0x7f90780319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.380+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f908803fe60 con 0x7f909809d6f0 2023-10-03T10:14:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.385+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90880232f0 con 0x7f909809d6f0 2023-10-03T10:14:11.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.405+0000 7fc71d6f3700 1 Processor -- start 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.405+0000 7fc71d6f3700 1 -- start start 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc71d6f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc71d6f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 0x7fc718130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc71d6f3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71809f130 con 0x7fc71809e000 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc71d6f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71809f520 con 0x7fc71809e410 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc71d6f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc71809e930 con 0x7fc71809d6f0 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34370/0 (socket says 172.21.15.19:34370) 2023-10-03T10:14:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc716ffd700 1 -- 172.21.15.19:0/1370298497 learned_addr learned my addr 172.21.15.19:0/1370298497 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.406+0000 7fc7177fe700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 0x7fc718130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc7177fe700 1 -- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 msgr2=0x7fc71809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc7177fe700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc7177fe700 1 -- 172.21.15.19:0/1370298497 >> v1:172.21.15.19:6789/0 conn(0x7fc71809e000 legacy=0x7fc718130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc715ffb700 1 -- 172.21.15.19:0/1370298497 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382992540 0 0) 0x7fc71809f130 con 0x7fc71809e000 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc7177fe700 1 -- 172.21.15.19:0/1370298497 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71809b2d0 con 0x7fc71809e410 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc716ffd700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc7177fe700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 0x7fc718130d70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc710009dc0 tx=0x7fc71000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98392f2bc3ad8e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc715ffb700 1 -- 172.21.15.19:0/1370298497 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71000bd20 con 0x7fc71809e410 2023-10-03T10:14:11.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc715ffb700 1 -- 172.21.15.19:0/1370298497 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71000be80 con 0x7fc71809e410 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.407+0000 7fc715ffb700 1 -- 172.21.15.19:0/1370298497 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100116a0 con 0x7fc71809e410 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 -- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 msgr2=0x7fc718130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 0x7fc718130d70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc710009dc0 tx=0x7fc71000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 -- 172.21.15.19:0/1370298497 shutdown_connections 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809e410 0x7fc718130d70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/1370298497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809d6f0 0x7fc71809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 -- 172.21.15.19:0/1370298497 >> 172.21.15.19:0/1370298497 conn(0x7fc718066f50 msgr2=0x7fc71809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 -- 172.21.15.19:0/1370298497 shutdown_connections 2023-10-03T10:14:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.408+0000 7fc71d6f3700 1 -- 172.21.15.19:0/1370298497 wait complete. 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.409+0000 7fc71d6f3700 1 Processor -- start 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.409+0000 7fc71d6f3700 1 -- start start 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71809e000 0x7fc71811e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 0x7fc71811ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71809c700 con 0x7fc71809e000 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181202d0 con 0x7fc71809d6f0 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc71d6f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180a3ba0 con 0x7fc71809e410 2023-10-03T10:14:11.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc716ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36878/0 (socket says 172.21.15.19:36878) 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc716ffd700 1 -- 172.21.15.19:0/3759342488 learned_addr learned my addr 172.21.15.19:0/3759342488 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 0x7fc71811ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7167fc700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71809e000 0x7fc71811e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 -- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 msgr2=0x7fc71811e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 -- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71809e000 msgr2=0x7fc71811e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71809e000 0x7fc71811e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc7177fe700 1 -- 172.21.15.19:0/3759342488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708009550 con 0x7fc71809e410 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.410+0000 7fc716ffd700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc7177fe700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 0x7fc71811ec20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc710018000 tx=0x7fc710004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc710004880 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71001e070 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7100116a0 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc710009a70 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.411+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc718121950 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.412+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc71811ac20 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.412+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc710011800 con 0x7fc71809e410 2023-10-03T10:14:11.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.412+0000 7fc716ffd700 1 -- 172.21.15.19:0/3759342488 >> v1:172.21.15.19:6816/126819 conn(0x7fc70402f510 legacy=0x7fc7040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.412+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc710044310 con 0x7fc71809e410 2023-10-03T10:14:11.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.417+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc710011d40 con 0x7fc71809e410 2023-10-03T10:14:11.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.474+0000 7fd742588700 1 Processor -- start 2023-10-03T10:14:11.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.474+0000 7fd742588700 1 -- start start 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd73c09e000 0x7fd73c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c06b460 con 0x7fd73c09e000 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c09b120 con 0x7fd73c09d6f0 2023-10-03T10:14:11.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd742588700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c09a7e0 con 0x7fd73c09e410 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd73bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36888/0 (socket says 172.21.15.19:36888) 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd73bfff700 1 -- 172.21.15.19:0/1473578593 learned_addr learned my addr 172.21.15.19:0/1473578593 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.475+0000 7fd73b7fe700 1 --2- 172.21.15.19:0/1473578593 >> v2:172.21.15.19:3300/0 conn(0x7fd73c09e000 0x7fd73c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd740b25700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 -- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 msgr2=0x7fd73c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 -- 172.21.15.19:0/1473578593 >> v2:172.21.15.19:3300/0 conn(0x7fd73c09e000 msgr2=0x7fd73c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 --2- 172.21.15.19:0/1473578593 >> v2:172.21.15.19:3300/0 conn(0x7fd73c09e000 0x7fd73c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 -- 172.21.15.19:0/1473578593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c09a500 con 0x7fd73c09d6f0 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73bfff700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009920 tx=0x7fd72c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6d79d288fe47e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73affd700 1 -- 172.21.15.19:0/1473578593 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c011830 con 0x7fd73c09d6f0 2023-10-03T10:14:11.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73affd700 1 -- 172.21.15.19:0/1473578593 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c011990 con 0x7fd73c09d6f0 2023-10-03T10:14:11.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.476+0000 7fd73affd700 1 -- 172.21.15.19:0/1473578593 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c011d20 con 0x7fd73c09d6f0 2023-10-03T10:14:11.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 -- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 msgr2=0x7fd73c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009920 tx=0x7fd72c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 -- 172.21.15.19:0/1473578593 shutdown_connections 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09d6f0 0x7fd73c09dac0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 --2- 172.21.15.19:0/1473578593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 --2- 172.21.15.19:0/1473578593 >> v2:172.21.15.19:3300/0 conn(0x7fd73c09e000 0x7fd73c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 -- 172.21.15.19:0/1473578593 >> 172.21.15.19:0/1473578593 conn(0x7fd73c066f50 msgr2=0x7fd73c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 -- 172.21.15.19:0/1473578593 shutdown_connections 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.477+0000 7fd742588700 1 -- 172.21.15.19:0/1473578593 wait complete. 2023-10-03T10:14:11.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.479+0000 7fd742588700 1 Processor -- start 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.479+0000 7fd742588700 1 -- start start 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd73c09d6f0 0x7fd73c1a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c1a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1aa250 con 0x7fd73c09d6f0 2023-10-03T10:14:11.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1a7980 con 0x7fd73c09e000 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd742588700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1a8bd0 con 0x7fd73c09e410 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd73b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd73b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36890/0 (socket says 172.21.15.19:36890) 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd73b7fe700 1 -- 172.21.15.19:0/1595625098 learned_addr learned my addr 172.21.15.19:0/1595625098 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd740b25700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c1a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.480+0000 7fd73bfff700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd73c09d6f0 0x7fd73c1a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 -- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 msgr2=0x7fd73c1a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 -- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd73c09d6f0 msgr2=0x7fd73c1a5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd73c09d6f0 0x7fd73c1a5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 -- 172.21.15.19:0/1595625098 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009550 con 0x7fd73c09e410 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd73b7fe700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd740b25700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c1a6880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd734007df0 tx=0x7fd73400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd734018070 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd73400eb30 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400eec0 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c1a7f70 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.481+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c09c710 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.483+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd734014420 con 0x7fd73c09e410 2023-10-03T10:14:11.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.483+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c074ea0 con 0x7fd73c09e410 2023-10-03T10:14:11.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.483+0000 7fd73bfff700 1 -- 172.21.15.19:0/1595625098 >> v1:172.21.15.19:6816/126819 conn(0x7fd72802f510 legacy=0x7fd7280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.483+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd73403f9a0 con 0x7fd73c09e410 2023-10-03T10:14:11.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.492+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7340126a0 con 0x7fd73c09e410 2023-10-03T10:14:11.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.501+0000 7f14b64ba700 1 Processor -- start 2023-10-03T10:14:11.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.501+0000 7f14b64ba700 1 -- start start 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 0x7f14b0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 0x7f14b0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 0x7f14b0138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b009b580 con 0x7f14b009a3b0 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b01313c0 con 0x7f14b0131810 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b64ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14b006e8c0 con 0x7f14b0099a40 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14affff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 0x7f14b0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14affff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 0x7f14b0131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36894/0 (socket says 172.21.15.19:36894) 2023-10-03T10:14:11.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14affff700 1 -- 172.21.15.19:0/3855921289 learned_addr learned my addr 172.21.15.19:0/3855921289 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14af7fe700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 0x7f14b0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14b4a57700 1 --2- 172.21.15.19:0/3855921289 >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 0x7f14b0138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14af7fe700 1 -- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 msgr2=0x7f14b0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14af7fe700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 0x7f14b0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14af7fe700 1 -- 172.21.15.19:0/3855921289 >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 msgr2=0x7f14b0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.502+0000 7f14af7fe700 1 --2- 172.21.15.19:0/3855921289 >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 0x7f14b0138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14af7fe700 1 -- 172.21.15.19:0/3855921289 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b009a820 con 0x7f14b0099a40 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14b4a57700 1 --2- 172.21.15.19:0/3855921289 >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 0x7f14b0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:11.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14af7fe700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 0x7f14b0099e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009840 tx=0x7f14a4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeb8e6fa9fa7b452 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14aeffd700 1 -- 172.21.15.19:0/3855921289 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011830 con 0x7f14b0099a40 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14aeffd700 1 -- 172.21.15.19:0/3855921289 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4011990 con 0x7f14b0099a40 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.503+0000 7f14aeffd700 1 -- 172.21.15.19:0/3855921289 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4011d20 con 0x7f14b0099a40 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 -- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 msgr2=0x7f14b0099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 0x7f14b0099e70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009840 tx=0x7f14a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 -- 172.21.15.19:0/3855921289 shutdown_connections 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0131810 0x7f14b0131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 --2- 172.21.15.19:0/3855921289 >> v2:172.21.15.19:3300/0 conn(0x7f14b009a3b0 0x7f14b0138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 --2- 172.21.15.19:0/3855921289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b0099a40 0x7f14b0099e70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 -- 172.21.15.19:0/3855921289 >> 172.21.15.19:0/3855921289 conn(0x7f14b00a2aa0 msgr2=0x7f14b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 -- 172.21.15.19:0/3855921289 shutdown_connections 2023-10-03T10:14:11.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.504+0000 7f14b64ba700 1 -- 172.21.15.19:0/3855921289 wait complete. 2023-10-03T10:14:11.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.506+0000 7f14b64ba700 1 Processor -- start 2023-10-03T10:14:11.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.506+0000 7f14b64ba700 1 -- start start 2023-10-03T10:14:11.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b009a3b0 0x7f14b0119c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14b0131810 0x7f14b011a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b011b290 con 0x7f14b0131810 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b011c4e0 con 0x7f14b0099a40 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14b64ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14b011b870 con 0x7f14b009a3b0 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36902/0 (socket says 172.21.15.19:36902) 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 -- 172.21.15.19:0/858780648 learned_addr learned my addr 172.21.15.19:0/858780648 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14af7fe700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b009a3b0 0x7f14b0119c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 -- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b009a3b0 msgr2=0x7f14b0119c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b009a3b0 0x7f14b0119c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 -- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14b0131810 msgr2=0x7f14b011a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14b0131810 0x7f14b011a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 -- 172.21.15.19:0/858780648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009a70 con 0x7f14b0099a40 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.507+0000 7f14affff700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e940 tx=0x7f14a000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.508+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a00096a0 con 0x7f14b0099a40 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.508+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000ee90 con 0x7f14b0099a40 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.508+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000ca10 con 0x7f14b0099a40 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.508+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40094a0 con 0x7f14b0099a40 2023-10-03T10:14:11.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.508+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b0130970 con 0x7f14b0099a40 2023-10-03T10:14:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.509+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f14a000cb70 con 0x7f14b0099a40 2023-10-03T10:14:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.509+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b006eb60 con 0x7f14b0099a40 2023-10-03T10:14:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.509+0000 7f14af7fe700 1 -- 172.21.15.19:0/858780648 >> v1:172.21.15.19:6816/126819 conn(0x7f149c02f540 legacy=0x7f149c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.509+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f14a003fbc0 con 0x7f14b0099a40 2023-10-03T10:14:11.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.519+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f14a0013470 con 0x7f14b0099a40 2023-10-03T10:14:11.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.581+0000 7f9095d9b700 1 -- 172.21.15.19:0/3312623675 >> v1:172.21.15.19:6816/126819 conn(0x7f907802f540 legacy=0x7f90780319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.613+0000 7fc716ffd700 1 -- 172.21.15.19:0/3759342488 >> v1:172.21.15.19:6816/126819 conn(0x7fc70402f510 legacy=0x7fc7040319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.625+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9098074ea0 con 0x7f909809d6f0 2023-10-03T10:14:11.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.625+0000 7f9086ffd700 1 -- 172.21.15.19:0/3312623675 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9088021090 con 0x7f909809d6f0 2023-10-03T10:14:11.625 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 >> v1:172.21.15.19:6816/126819 conn(0x7f907802f540 legacy=0x7f90780319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 msgr2=0x7f90981222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f908800ebe0 tx=0x7f908800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 shutdown_connections 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909809e410 0x7f9098122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909809d6f0 0x7f90981222c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 --2- 172.21.15.19:0/3312623675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909809e000 0x7f9098122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 >> 172.21.15.19:0/3312623675 conn(0x7f9098066f50 msgr2=0x7f9098133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 shutdown_connections 2023-10-03T10:14:11.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.628+0000 7f909ce66700 1 -- 172.21.15.19:0/3312623675 wait complete. 2023-10-03T10:14:11.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.633+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc718120f70 con 0x7fc71809e410 2023-10-03T10:14:11.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.633+0000 7fc6ff7fe700 1 -- 172.21.15.19:0/3759342488 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc710010bd0 con 0x7fc71809e410 2023-10-03T10:14:11.633 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.637+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 >> v1:172.21.15.19:6816/126819 conn(0x7fc70402f510 legacy=0x7fc7040319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 msgr2=0x7fc71811ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 0x7fc71811ec20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc710018000 tx=0x7fc710004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 shutdown_connections 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc71809e410 0x7fc71811ec20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc71809d6f0 0x7fc71811e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 --2- 172.21.15.19:0/3759342488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc71809e000 0x7fc71811e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 >> 172.21.15.19:0/3759342488 conn(0x7fc718066f50 msgr2=0x7fc718130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 shutdown_connections 2023-10-03T10:14:11.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.638+0000 7fc71d6f3700 1 -- 172.21.15.19:0/3759342488 wait complete. 2023-10-03T10:14:11.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:11.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:11.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.684+0000 7fd73bfff700 1 -- 172.21.15.19:0/1595625098 >> v1:172.21.15.19:6816/126819 conn(0x7fd72802f510 legacy=0x7fd7280319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.709+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd73c06c360 con 0x7fd73c09e410 2023-10-03T10:14:11.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.709+0000 7fd738ff9700 1 -- 172.21.15.19:0/1595625098 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7340122e0 con 0x7fd73c09e410 2023-10-03T10:14:11.709 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:11.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.710+0000 7f14af7fe700 1 -- 172.21.15.19:0/858780648 >> v1:172.21.15.19:6816/126819 conn(0x7f149c02f540 legacy=0x7f149c0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 >> v1:172.21.15.19:6816/126819 conn(0x7fd72802f510 legacy=0x7fd7280319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 msgr2=0x7fd73c1a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c1a6880 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd734007df0 tx=0x7fd73400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 shutdown_connections 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd73c09e410 0x7fd73c1a6880 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd73c09d6f0 0x7fd73c1a5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 --2- 172.21.15.19:0/1595625098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd73c09e000 0x7fd73c1a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 >> 172.21.15.19:0/1595625098 conn(0x7fd73c066f50 msgr2=0x7fd73c1bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 shutdown_connections 2023-10-03T10:14:11.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.712+0000 7fd742588700 1 -- 172.21.15.19:0/1595625098 wait complete. 2023-10-03T10:14:11.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:11.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.731+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f14b0071d80 con 0x7f14b0099a40 2023-10-03T10:14:11.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.731+0000 7f14acff9700 1 -- 172.21.15.19:0/858780648 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f14a0017020 con 0x7f14b0099a40 2023-10-03T10:14:11.731 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 >> v1:172.21.15.19:6816/126819 conn(0x7f149c02f540 legacy=0x7f149c0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 msgr2=0x7f14b01196d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e940 tx=0x7f14a000ec50 comp rx=0 tx=0).stop 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 shutdown_connections 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14b0131810 0x7f14b011a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14b0099a40 0x7f14b01196d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 --2- 172.21.15.19:0/858780648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14b009a3b0 0x7f14b0119c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.733+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 >> 172.21.15.19:0/858780648 conn(0x7f14b00a2aa0 msgr2=0x7f14b012e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:11.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.734+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 shutdown_connections 2023-10-03T10:14:11.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:11.734+0000 7f14b64ba700 1 -- 172.21.15.19:0/858780648 wait complete. 2023-10-03T10:14:11.747 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:12.647 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:12.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:12.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:12.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:12.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 Processor -- start 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 -- start start 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98133540 0x7f5a98135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 0x7f5a98138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a980716a0 con 0x7f5a98130540 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98071290 con 0x7f5a98133540 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9eab0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98130340 con 0x7f5a98135e60 2023-10-03T10:14:12.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9c84c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5a98130540 0x7f5a98130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40802/0 (socket says 172.21.15.19:40802) 2023-10-03T10:14:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9c84c700 1 -- 172.21.15.19:0/3097415769 learned_addr learned my addr 172.21.15.19:0/3097415769 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:12.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.802+0000 7f5a9d04d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 0x7f5a98138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a977fe700 1 -- 172.21.15.19:0/3097415769 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859876616 0 0) 0x7f5a980716a0 con 0x7f5a98130540 2023-10-03T10:14:12.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a977fe700 1 -- 172.21.15.19:0/3097415769 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a880035b0 con 0x7f5a98130540 2023-10-03T10:14:12.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98133540 msgr2=0x7f5a98135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a9d04d700 1 --2- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98133540 0x7f5a98135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3097415769 >> v1:172.21.15.19:6789/0 conn(0x7f5a98130540 legacy=0x7f5a98130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3097415769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a98070b80 con 0x7f5a98135e60 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a9d04d700 1 --2- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 0x7f5a98138240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009dc0 tx=0x7f5a9000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2000811d8270383 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a977fe700 1 -- 172.21.15.19:0/3097415769 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9000e070 con 0x7f5a98135e60 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a977fe700 1 -- 172.21.15.19:0/3097415769 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9000bb20 con 0x7f5a98135e60 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.803+0000 7f5a977fe700 1 -- 172.21.15.19:0/3097415769 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012430 con 0x7f5a98135e60 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 msgr2=0x7f5a98138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 0x7f5a98138240 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5a90009dc0 tx=0x7f5a9000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3097415769 shutdown_connections 2023-10-03T10:14:12.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98135e60 0x7f5a98138240 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3097415769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98133540 0x7f5a98135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3097415769 >> 172.21.15.19:0/3097415769 conn(0x7f5a980a2aa0 msgr2=0x7f5a980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.804+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3097415769 shutdown_connections 2023-10-03T10:14:12.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.805+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3097415769 wait complete. 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 Processor -- start 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 -- start start 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 0x7f5a98118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a98133540 0x7f5a98119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9811a6e0 con 0x7f5a98133540 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a98132d80 con 0x7f5a98135e60 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.806+0000 7f5a9eab0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a980718e0 con 0x7f5a98130540 2023-10-03T10:14:12.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a97fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a98133540 0x7f5a98119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36922/0 (socket says 172.21.15.19:36922) 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3855942339 learned_addr learned my addr 172.21.15.19:0/3855942339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9c84c700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 0x7f5a98118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 msgr2=0x7f5a98118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 0x7f5a98118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a98133540 msgr2=0x7f5a98119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a98133540 0x7f5a98119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 -- 172.21.15.19:0/3855942339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a90009a70 con 0x7f5a98135e60 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9c84c700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 0x7f5a98118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.807+0000 7f5a9d04d700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a90014040 tx=0x7f5a90004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.808+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90012430 con 0x7f5a98135e60 2023-10-03T10:14:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.808+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a90020070 con 0x7f5a98135e60 2023-10-03T10:14:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.808+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9811c380 con 0x7f5a98135e60 2023-10-03T10:14:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.808+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a90004280 con 0x7f5a98135e60 2023-10-03T10:14:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.808+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9811bc40 con 0x7f5a98135e60 2023-10-03T10:14:12.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.809+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5a900043e0 con 0x7f5a98135e60 2023-10-03T10:14:12.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.809+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a780052e0 con 0x7f5a98135e60 2023-10-03T10:14:12.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.809+0000 7f5a9c84c700 1 -- 172.21.15.19:0/3855942339 >> v1:172.21.15.19:6816/126819 conn(0x7f5a7c02f510 legacy=0x7f5a7c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:12.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.809+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5a90022070 con 0x7f5a98135e60 2023-10-03T10:14:12.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.818+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a9001a970 con 0x7f5a98135e60 2023-10-03T10:14:12.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 Processor -- start 2023-10-03T10:14:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 -- start start 2023-10-03T10:14:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 0x7f768c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c09b120 con 0x7f768c09d6f0 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c06b460 con 0x7f768c139170 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f7691b66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f768c09a7e0 con 0x7f768c09e1d0 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.843+0000 7f768b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f768c09d6f0 0x7f768c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40804/0 (socket says 172.21.15.19:40804) 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768b7fe700 1 -- 172.21.15.19:0/1541969231 learned_addr learned my addr 172.21.15.19:0/1541969231 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768bfff700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 0x7f768c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 -- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 msgr2=0x7f768c13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 0x7f768c13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 -- 172.21.15.19:0/1541969231 >> v1:172.21.15.19:6789/0 conn(0x7f768c09d6f0 legacy=0x7f768c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 -- 172.21.15.19:0/1541969231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c09a500 con 0x7f768c09e1d0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768a7fc700 1 -- 172.21.15.19:0/1541969231 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866171185 0 0) 0x7f768c09b120 con 0x7f768c09d6f0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768bfff700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 0x7f768c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768affd700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c138c30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76800098a0 tx=0x7f7680009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c13347a99681ca29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768a7fc700 1 -- 172.21.15.19:0/1541969231 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011830 con 0x7f768c09e1d0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.844+0000 7f768a7fc700 1 -- 172.21.15.19:0/1541969231 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680011990 con 0x7f768c09e1d0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f768a7fc700 1 -- 172.21.15.19:0/1541969231 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011d20 con 0x7f768c09e1d0 2023-10-03T10:14:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 -- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 msgr2=0x7f768c138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c138c30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76800098a0 tx=0x7f7680009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 -- 172.21.15.19:0/1541969231 shutdown_connections 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c139170 0x7f768c13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 --2- 172.21.15.19:0/1541969231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c138c30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 -- 172.21.15.19:0/1541969231 >> 172.21.15.19:0/1541969231 conn(0x7f768c066f50 msgr2=0x7f768c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 -- 172.21.15.19:0/1541969231 shutdown_connections 2023-10-03T10:14:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.845+0000 7f7691b66700 1 -- 172.21.15.19:0/1541969231 wait complete. 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.846+0000 7f7691b66700 1 Processor -- start 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 -- start start 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c09d6f0 0x7f768c1c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f768c139170 0x7f768c1c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c072210 con 0x7f768c139170 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c120680 con 0x7f768c09d6f0 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f7691b66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f768c121d20 con 0x7f768c09e1d0 2023-10-03T10:14:12.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f768affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f768affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34456/0 (socket says 172.21.15.19:34456) 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f768affd700 1 -- 172.21.15.19:0/629049662 learned_addr learned my addr 172.21.15.19:0/629049662 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.847+0000 7f768bfff700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f768c139170 0x7f768c1c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768b7fe700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c09d6f0 0x7f768c1c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 -- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c09d6f0 msgr2=0x7f768c1c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c09d6f0 0x7f768c1c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 -- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f768c139170 msgr2=0x7f768c1c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f768c139170 0x7f768c1c8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 -- 172.21.15.19:0/629049662 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009a70 con 0x7f768c09e1d0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f768affd700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7680000c00 tx=0x7f7680004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680004550 con 0x7f768c09e1d0 2023-10-03T10:14:12.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680027070 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800094a0 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800038e0 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.848+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c1222b0 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.849+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c0a1dd0 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.850+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7680003a40 con 0x7f768c09e1d0 2023-10-03T10:14:12.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.850+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7680029070 con 0x7f768c09e1d0 2023-10-03T10:14:12.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.850+0000 7f768b7fe700 1 -- 172.21.15.19:0/629049662 >> v1:172.21.15.19:6816/126819 conn(0x7f767802f510 legacy=0x7f76780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:12.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.859+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76800193b0 con 0x7f768c09e1d0 2023-10-03T10:14:12.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.886+0000 7f4575058700 1 Processor -- start 2023-10-03T10:14:12.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.886+0000 7f4575058700 1 -- start start 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f4575058700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 0x7f457009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f4575058700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f457009e000 0x7f45701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f4575058700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457009b120 con 0x7f457009e410 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f4575058700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457006b460 con 0x7f457009e000 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f4575058700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f457009a7e0 con 0x7f457009d6f0 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 0x7f457009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456f59e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f457009e410 0x7f4570133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40806/0 (socket says 172.21.15.19:40806) 2023-10-03T10:14:12.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456f59e700 1 -- 172.21.15.19:0/4136853313 learned_addr learned my addr 172.21.15.19:0/4136853313 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456e59c700 1 --2- 172.21.15.19:0/4136853313 >> v2:172.21.15.19:3300/0 conn(0x7f457009e000 0x7f45701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456ed9d700 1 -- 172.21.15.19:0/4136853313 >> v2:172.21.15.19:3300/0 conn(0x7f457009e000 msgr2=0x7f45701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456ed9d700 1 --2- 172.21.15.19:0/4136853313 >> v2:172.21.15.19:3300/0 conn(0x7f457009e000 0x7f45701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456ed9d700 1 -- 172.21.15.19:0/4136853313 >> v1:172.21.15.19:6789/0 conn(0x7f457009e410 legacy=0x7f4570133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456dd9b700 1 -- 172.21.15.19:0/4136853313 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121308164 0 0) 0x7f457009b120 con 0x7f457009e410 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.887+0000 7f456ed9d700 1 -- 172.21.15.19:0/4136853313 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457009a500 con 0x7f457009d6f0 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f456ed9d700 1 --2- 172.21.15.19:0/4136853313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 0x7f457009dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4560009870 tx=0x7f4560009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca972e9fec92ba8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f456dd9b700 1 -- 172.21.15.19:0/4136853313 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560011830 con 0x7f457009d6f0 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f456dd9b700 1 -- 172.21.15.19:0/4136853313 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4560011990 con 0x7f457009d6f0 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f456dd9b700 1 -- 172.21.15.19:0/4136853313 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560011d20 con 0x7f457009d6f0 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f4575058700 1 -- 172.21.15.19:0/4136853313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 msgr2=0x7f457009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.888+0000 7f4575058700 1 --2- 172.21.15.19:0/4136853313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 0x7f457009dac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4560009870 tx=0x7f4560009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 -- 172.21.15.19:0/4136853313 shutdown_connections 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 --2- 172.21.15.19:0/4136853313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009d6f0 0x7f457009dac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 --2- 172.21.15.19:0/4136853313 >> v2:172.21.15.19:3300/0 conn(0x7f457009e000 0x7f45701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 -- 172.21.15.19:0/4136853313 >> 172.21.15.19:0/4136853313 conn(0x7f4570066f50 msgr2=0x7f457009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 -- 172.21.15.19:0/4136853313 shutdown_connections 2023-10-03T10:14:12.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.889+0000 7f4575058700 1 -- 172.21.15.19:0/4136853313 wait complete. 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.890+0000 7f4575058700 1 Processor -- start 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.890+0000 7f4575058700 1 -- start start 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.890+0000 7f4575058700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f457009d6f0 0x7f45701a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.890+0000 7f4575058700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f4575058700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 0x7f45701a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f4575058700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45701a4ab0 con 0x7f457009e410 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f4575058700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457009c710 con 0x7f457009d6f0 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f4575058700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45701a52e0 con 0x7f457009e000 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34468/0 (socket says 172.21.15.19:34468) 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 -- 172.21.15.19:0/3050574292 learned_addr learned my addr 172.21.15.19:0/3050574292 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456f59e700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 0x7f45701a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456ed9d700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f457009d6f0 0x7f45701a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 -- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f457009d6f0 msgr2=0x7f45701a35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f457009d6f0 0x7f45701a35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 -- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 msgr2=0x7f45701a4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 0x7f45701a4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 -- 172.21.15.19:0/3050574292 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600094a0 con 0x7f457009e000 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456f59e700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 0x7f45701a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.891+0000 7f456e59c700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f456400e980 tx=0x7f456400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.892+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564009710 con 0x7f457009e000 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.892+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4564024690 con 0x7f457009e000 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.892+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4564024a20 con 0x7f457009e000 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.892+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45700a2fa0 con 0x7f457009e000 2023-10-03T10:14:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.892+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45701b8000 con 0x7f457009e000 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.893+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4570074ea0 con 0x7f457009e000 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.894+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4564024b80 con 0x7f457009e000 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.894+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4564051420 con 0x7f457009e000 2023-10-03T10:14:12.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.894+0000 7f456ed9d700 1 -- 172.21.15.19:0/3050574292 >> v1:172.21.15.19:6816/126819 conn(0x7f455c02f510 legacy=0x7f455c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.898+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4564022360 con 0x7f457009e000 2023-10-03T10:14:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.975+0000 7f9cf346f700 1 Processor -- start 2023-10-03T10:14:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.976+0000 7f9cf346f700 1 -- start start 2023-10-03T10:14:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.976+0000 7f9cf346f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 0x7f9cec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.976+0000 7f9cf346f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cec09d630 0x7f9cec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.976+0000 7f9cf346f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cec0a2a70 con 0x7f9cec133930 2023-10-03T10:14:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.976+0000 7f9cf346f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0a01d0 con 0x7f9cec09d630 2023-10-03T10:14:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf346f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec09e2b0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf120b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 0x7f9cec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf120b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 0x7f9cec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34472/0 (socket says 172.21.15.19:34472) 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9cec09d630 0x7f9cec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf120b700 1 -- 172.21.15.19:0/1583520041 learned_addr learned my addr 172.21.15.19:0/1583520041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 msgr2=0x7f9cec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 0x7f9cec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/1583520041 >> v1:172.21.15.19:6789/0 conn(0x7f9cec133930 legacy=0x7f9cec133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/1583520041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec09dc50 con 0x7f9cec09d630 2023-10-03T10:14:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.977+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec09d630 0x7f9cec0a1340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009840 tx=0x7f9cdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581e01d4539da5e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.978+0000 7f9ce3fff700 1 -- 172.21.15.19:0/1583520041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011830 con 0x7f9cec09d630 2023-10-03T10:14:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.978+0000 7f9ce3fff700 1 -- 172.21.15.19:0/1583520041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc011990 con 0x7f9cec09d630 2023-10-03T10:14:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.978+0000 7f9ce3fff700 1 -- 172.21.15.19:0/1583520041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc011d00 con 0x7f9cec09d630 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.978+0000 7f9cf346f700 1 -- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec09d630 msgr2=0x7f9cec0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.978+0000 7f9cf346f700 1 --2- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec09d630 0x7f9cec0a1340 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc009840 tx=0x7f9cdc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 -- 172.21.15.19:0/1583520041 shutdown_connections 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 --2- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec0a0a30 0x7f9cec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 --2- 172.21.15.19:0/1583520041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec09d630 0x7f9cec0a1340 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 -- 172.21.15.19:0/1583520041 >> 172.21.15.19:0/1583520041 conn(0x7f9cec0a3050 msgr2=0x7f9cec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 -- 172.21.15.19:0/1583520041 shutdown_connections 2023-10-03T10:14:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.979+0000 7f9cf346f700 1 -- 172.21.15.19:0/1583520041 wait complete. 2023-10-03T10:14:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.980+0000 7f9cf346f700 1 Processor -- start 2023-10-03T10:14:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.980+0000 7f9cf346f700 1 -- start start 2023-10-03T10:14:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 0x7f9cec1c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 0x7f9cec1c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 0x7f9cec1c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0a4030 con 0x7f9cec0a0a30 2023-10-03T10:14:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec122350 con 0x7f9cec133930 2023-10-03T10:14:12.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf346f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec120cd0 con 0x7f9cec09d630 2023-10-03T10:14:12.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf1a0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 0x7f9cec1c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf120b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 0x7f9cec1c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf1a0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 0x7f9cec1c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36962/0 (socket says 172.21.15.19:36962) 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf120b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 0x7f9cec1c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34486/0 (socket says 172.21.15.19:34486) 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf1a0c700 1 -- 172.21.15.19:0/2516064034 learned_addr learned my addr 172.21.15.19:0/2516064034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.981+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 0x7f9cec1c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 msgr2=0x7f9cec1c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 0x7f9cec1c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 msgr2=0x7f9cec1c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 0x7f9cec1c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 -- 172.21.15.19:0/2516064034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0094a0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf0a0a700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 0x7f9cec1c86e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc016000 tx=0x7f9cdc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc004400 con 0x7f9cec0a0a30 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cdc01f070 con 0x7f9cec0a0a30 2023-10-03T10:14:12.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec120720 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.982+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cdc0038e0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.983+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec122dc0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.984+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9cdc021030 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.984+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec0747f0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.984+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9cdc0427f0 con 0x7f9cec0a0a30 2023-10-03T10:14:12.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.984+0000 7f9cf120b700 1 -- 172.21.15.19:0/2516064034 >> v1:172.21.15.19:6816/126819 conn(0x7f9cd002f510 legacy=0x7f9cd00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:12.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:12.989+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cdc015080 con 0x7f9cec0a0a30 2023-10-03T10:14:13.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.011+0000 7f5a9c84c700 1 -- 172.21.15.19:0/3855942339 >> v1:172.21.15.19:6816/126819 conn(0x7f5a7c02f510 legacy=0x7f5a7c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:13.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.051+0000 7f768b7fe700 1 -- 172.21.15.19:0/629049662 >> v1:172.21.15.19:6816/126819 conn(0x7f767802f510 legacy=0x7f76780319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.087+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5a78005860 con 0x7f5a98135e60 2023-10-03T10:14:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.087+0000 7f5a957fa700 1 -- 172.21.15.19:0/3855942339 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a9002c070 con 0x7f5a98135e60 2023-10-03T10:14:13.087 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 >> v1:172.21.15.19:6816/126819 conn(0x7f5a7c02f510 legacy=0x7f5a7c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 msgr2=0x7f5a98119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a90014040 tx=0x7f5a90004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 shutdown_connections 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a98135e60 0x7f5a98119750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a98130540 0x7f5a98118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 --2- 172.21.15.19:0/3855942339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a98133540 0x7f5a98119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 >> 172.21.15.19:0/3855942339 conn(0x7f5a980a2aa0 msgr2=0x7f5a9812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 shutdown_connections 2023-10-03T10:14:13.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.091+0000 7f5a9eab0700 1 -- 172.21.15.19:0/3855942339 wait complete. 2023-10-03T10:14:13.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.095+0000 7f456ed9d700 1 -- 172.21.15.19:0/3050574292 >> v1:172.21.15.19:6816/126819 conn(0x7f455c02f510 legacy=0x7f455c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:13.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.103+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f768c0a0720 con 0x7f768c09e1d0 2023-10-03T10:14:13.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.104+0000 7f7673fff700 1 -- 172.21.15.19:0/629049662 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f768003c090 con 0x7f768c09e1d0 2023-10-03T10:14:13.104 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.106+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 >> v1:172.21.15.19:6816/126819 conn(0x7f767802f510 legacy=0x7f76780319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.106+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 msgr2=0x7f768c1c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.106+0000 7f7691b66700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7680000c00 tx=0x7f7680004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 shutdown_connections 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f768c139170 0x7f768c1c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f768c09d6f0 0x7f768c1c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 --2- 172.21.15.19:0/629049662 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f768c09e1d0 0x7f768c1c89a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 >> 172.21.15.19:0/629049662 conn(0x7f768c066f50 msgr2=0x7f768c136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 shutdown_connections 2023-10-03T10:14:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.107+0000 7f7691b66700 1 -- 172.21.15.19:0/629049662 wait complete. 2023-10-03T10:14:13.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:13.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.115+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f457006c360 con 0x7f457009e000 2023-10-03T10:14:13.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.115+0000 7f45577fe700 1 -- 172.21.15.19:0/3050574292 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4564032020 con 0x7f457009e000 2023-10-03T10:14:13.115 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.118+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 >> v1:172.21.15.19:6816/126819 conn(0x7f455c02f510 legacy=0x7f455c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.118+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 msgr2=0x7f45701a3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.118+0000 7f4575058700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f456400e980 tx=0x7f456400ec90 comp rx=0 tx=0).stop 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 shutdown_connections 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f457009e410 0x7f45701a4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f457009d6f0 0x7f45701a35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 --2- 172.21.15.19:0/3050574292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f457009e000 0x7f45701a3b20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 >> 172.21.15.19:0/3050574292 conn(0x7f4570066f50 msgr2=0x7f45701bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 shutdown_connections 2023-10-03T10:14:13.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.119+0000 7f4575058700 1 -- 172.21.15.19:0/3050574292 wait complete. 2023-10-03T10:14:13.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:13.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:13.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.185+0000 7f9cf120b700 1 -- 172.21.15.19:0/2516064034 >> v1:172.21.15.19:6816/126819 conn(0x7f9cd002f510 legacy=0x7f9cd00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.228+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9cec072980 con 0x7f9cec0a0a30 2023-10-03T10:14:13.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.228+0000 7f9ce1ffb700 1 -- 172.21.15.19:0/2516064034 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cdc046060 con 0x7f9cec0a0a30 2023-10-03T10:14:13.228 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 >> v1:172.21.15.19:6816/126819 conn(0x7f9cd002f510 legacy=0x7f9cd00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 msgr2=0x7f9cec1c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 0x7f9cec1c86e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc016000 tx=0x7f9cdc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 shutdown_connections 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9cec133930 0x7f9cec1c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9cec09d630 0x7f9cec1c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 --2- 172.21.15.19:0/2516064034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9cec0a0a30 0x7f9cec1c86e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 >> 172.21.15.19:0/2516064034 conn(0x7f9cec0a3050 msgr2=0x7f9cec09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 shutdown_connections 2023-10-03T10:14:13.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:13.231+0000 7f9cf346f700 1 -- 172.21.15.19:0/2516064034 wait complete. 2023-10-03T10:14:13.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:14.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:14.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:14.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:14.245 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.274+0000 7f1a1c14a700 1 Processor -- start 2023-10-03T10:14:14.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.274+0000 7f1a1c14a700 1 -- start start 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a1c14a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a1c14a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 0x7f1a1409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a1c14a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1406ef30 con 0x7f1a1409e760 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a1c14a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a1406fef0 con 0x7f1a1409de50 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a1c14a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a141334b0 con 0x7f1a141338a0 2023-10-03T10:14:14.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a19ee6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a19ee6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34498/0 (socket says 172.21.15.19:34498) 2023-10-03T10:14:14.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.275+0000 7f1a19ee6700 1 -- 172.21.15.19:0/598229542 learned_addr learned my addr 172.21.15.19:0/598229542 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a19ee6700 1 -- 172.21.15.19:0/598229542 >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 msgr2=0x7f1a1409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a196e5700 1 --2- 172.21.15.19:0/598229542 >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 0x7f1a1409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a19ee6700 1 --2- 172.21.15.19:0/598229542 >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 0x7f1a1409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a19ee6700 1 -- 172.21.15.19:0/598229542 >> v1:172.21.15.19:6789/0 conn(0x7f1a1409e760 legacy=0x7f1a1413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a19ee6700 1 -- 172.21.15.19:0/598229542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1406fc30 con 0x7f1a141338a0 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a196e5700 1 --2- 172.21.15.19:0/598229542 >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 0x7f1a1409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a19ee6700 1 --2- 172.21.15.19:0/598229542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a100098f0 tx=0x7f1a10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fda2da0fa6c4e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a18ee4700 1 -- 172.21.15.19:0/598229542 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10004230 con 0x7f1a141338a0 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a18ee4700 1 -- 172.21.15.19:0/598229542 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10004390 con 0x7f1a141338a0 2023-10-03T10:14:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.276+0000 7f1a18ee4700 1 -- 172.21.15.19:0/598229542 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100036a0 con 0x7f1a141338a0 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.277+0000 7f1a1c14a700 1 -- 172.21.15.19:0/598229542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 msgr2=0x7f1a14133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.277+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/598229542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a100098f0 tx=0x7f1a10009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 -- 172.21.15.19:0/598229542 shutdown_connections 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/598229542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a141338a0 0x7f1a14133c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/598229542 >> v2:172.21.15.19:3300/0 conn(0x7f1a1409de50 0x7f1a1409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 -- 172.21.15.19:0/598229542 >> 172.21.15.19:0/598229542 conn(0x7f1a140a2aa0 msgr2=0x7f1a140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 -- 172.21.15.19:0/598229542 shutdown_connections 2023-10-03T10:14:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.278+0000 7f1a1c14a700 1 -- 172.21.15.19:0/598229542 wait complete. 2023-10-03T10:14:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.279+0000 7f1a1c14a700 1 Processor -- start 2023-10-03T10:14:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.279+0000 7f1a1c14a700 1 -- start start 2023-10-03T10:14:14.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a1409e760 0x7f1a1411dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a141338a0 0x7f1a1411e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a14120930 con 0x7f1a141338a0 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1406f640 con 0x7f1a1409de50 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1c14a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a140a0fd0 con 0x7f1a1409e760 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a19ee6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a19ee6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36970/0 (socket says 172.21.15.19:36970) 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a19ee6700 1 -- 172.21.15.19:0/635365751 learned_addr learned my addr 172.21.15.19:0/635365751 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a196e5700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a1409e760 0x7f1a1411dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.280+0000 7f1a1a6e7700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a141338a0 0x7f1a1411e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 -- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a1409e760 msgr2=0x7f1a1411dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a1409e760 0x7f1a1411dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 -- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a141338a0 msgr2=0x7f1a1411e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a141338a0 0x7f1a1411e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 -- 172.21.15.19:0/635365751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009550 con 0x7f1a1409de50 2023-10-03T10:14:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a19ee6700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a141335f0 tx=0x7f1a10004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10025070 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10003850 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1411f290 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10003be0 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.281+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a141216a0 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.282+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f1a10003d40 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.283+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1a100492c0 con 0x7f1a1409de50 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.283+0000 7f1a196e5700 1 -- 172.21.15.19:0/635365751 >> v1:172.21.15.19:6816/126819 conn(0x7f19f802f510 legacy=0x7f19f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.283+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a14120b60 con 0x7f1a1409de50 2023-10-03T10:14:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.292+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a14120b60 con 0x7f1a1409de50 2023-10-03T10:14:14.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 Processor -- start 2023-10-03T10:14:14.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 -- start start 2023-10-03T10:14:14.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22281316c0 0x7f2228131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f222806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222809e130 con 0x7f222806acb0 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22281312b0 con 0x7f22281316c0 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.309+0000 7f222cd6e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222809f6e0 con 0x7f222809d9f0 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22281316c0 0x7f2228131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22281316c0 0x7f2228131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46954/0 (socket says 172.21.15.19:46954) 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 -- 172.21.15.19:0/1161258062 learned_addr learned my addr 172.21.15.19:0/1161258062 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f222806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f75420d0700 1 Processor -- start 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 -- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 msgr2=0x7f222806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f222806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 -- 172.21.15.19:0/1161258062 >> v1:172.21.15.19:6789/0 conn(0x7f222806acb0 legacy=0x7f2228138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 -- 172.21.15.19:0/1161258062 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222809e760 con 0x7f22281316c0 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f222806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:14.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f75420d0700 1 -- start start 2023-10-03T10:14:14.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.310+0000 7f222659c700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22281316c0 0x7f2228131a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22180098f0 tx=0x7f2218009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1296dbd9921c2e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f222559a700 1 -- 172.21.15.19:0/1161258062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2218004230 con 0x7f22281316c0 2023-10-03T10:14:14.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f222559a700 1 -- 172.21.15.19:0/1161258062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2218004390 con 0x7f22281316c0 2023-10-03T10:14:14.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f222559a700 1 -- 172.21.15.19:0/1161258062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22180036a0 con 0x7f22281316c0 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f75420d0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f753c136710 0x7f753c138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f75420d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f75420d0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c06ef30 con 0x7f753c1338a0 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f75420d0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753c06fef0 con 0x7f753c136710 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f75420d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c1334b0 con 0x7f753c139030 2023-10-03T10:14:14.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f753bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f753bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:36986/0 (socket says 172.21.15.19:36986) 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.311+0000 7f753bfff700 1 -- 172.21.15.19:0/840208515 learned_addr learned my addr 172.21.15.19:0/840208515 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 --2- 172.21.15.19:0/840208515 >> v2:172.21.15.19:3300/0 conn(0x7f753c136710 0x7f753c138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 -- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 msgr2=0x7f753c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 -- 172.21.15.19:0/840208515 >> v1:172.21.15.19:6789/0 conn(0x7f753c1338a0 legacy=0x7f753c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 -- 172.21.15.19:0/840208515 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c06fc30 con 0x7f753c136710 2023-10-03T10:14:14.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f753bfff700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 -- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22281316c0 msgr2=0x7f2228131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22281316c0 0x7f2228131a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f22180098f0 tx=0x7f2218009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f7532ffd700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c136710 0x7f753c138af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7524009840 tx=0x7f7524009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904aca5ffb2fff4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 -- 172.21.15.19:0/1161258062 shutdown_connections 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22281316c0 0x7f2228131a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1161258062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f222806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 -- 172.21.15.19:0/1161258062 >> 172.21.15.19:0/1161258062 conn(0x7f2228066f50 msgr2=0x7f222809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 -- 172.21.15.19:0/1161258062 shutdown_connections 2023-10-03T10:14:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f753affd700 1 -- 172.21.15.19:0/840208515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011830 con 0x7f753c136710 2023-10-03T10:14:14.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f222cd6e700 1 -- 172.21.15.19:0/1161258062 wait complete. 2023-10-03T10:14:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f753affd700 1 -- 172.21.15.19:0/840208515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524011990 con 0x7f753c136710 2023-10-03T10:14:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.312+0000 7f753affd700 1 -- 172.21.15.19:0/840208515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7524011d20 con 0x7f753c136710 2023-10-03T10:14:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 -- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c136710 msgr2=0x7f753c138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c136710 0x7f753c138af0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7524009840 tx=0x7f7524009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 -- 172.21.15.19:0/840208515 shutdown_connections 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c139030 0x7f753c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 --2- 172.21.15.19:0/840208515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c136710 0x7f753c138af0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 -- 172.21.15.19:0/840208515 >> 172.21.15.19:0/840208515 conn(0x7f753c0a2aa0 msgr2=0x7f753c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 -- 172.21.15.19:0/840208515 shutdown_connections 2023-10-03T10:14:14.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f75420d0700 1 -- 172.21.15.19:0/840208515 wait complete. 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f222cd6e700 1 Processor -- start 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.314+0000 7f222cd6e700 1 -- start start 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 0x7f22281294d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f2228129a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 0x7f2228129f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222812b160 con 0x7f222806acb0 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222812b900 con 0x7f222809d9f0 2023-10-03T10:14:14.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222cd6e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f222812b5b0 con 0x7f22281316c0 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2226d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 0x7f2228129f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2226d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 0x7f2228129f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34516/0 (socket says 172.21.15.19:34516) 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2226d9d700 1 -- 172.21.15.19:0/1144687498 learned_addr learned my addr 172.21.15.19:0/1144687498 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f2228129a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f75420d0700 1 Processor -- start 2023-10-03T10:14:14.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f222659c700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 0x7f22281294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 -- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 msgr2=0x7f2228129f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 0x7f2228129f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 -- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 msgr2=0x7f22281294d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 0x7f22281294d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.315+0000 7f2225d9b700 1 -- 172.21.15.19:0/1144687498 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218009550 con 0x7f222809d9f0 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f2225d9b700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f2228129a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f221c00e810 tx=0x7f221c00eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 -- start start 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c013610 con 0x7f222809d9f0 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221c013770 con 0x7f222809d9f0 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222812a760 con 0x7f222809d9f0 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221c013ae0 con 0x7f222809d9f0 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222812e6e0 con 0x7f222809d9f0 2023-10-03T10:14:14.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f222659c700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 0x7f22281294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c1338a0 0x7f753c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f753c136710 0x7f753c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c11a0a0 con 0x7f753c139030 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c06f6b0 con 0x7f753c1338a0 2023-10-03T10:14:14.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.316+0000 7f75420d0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f753c0a2430 con 0x7f753c136710 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c1338a0 0x7f753c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46980/0 (socket says 172.21.15.19:46980) 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 -- 172.21.15.19:0/759147452 learned_addr learned my addr 172.21.15.19:0/759147452 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 -- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f753c136710 msgr2=0x7f753c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f753c136710 0x7f753c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 -- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c1338a0 msgr2=0x7f753c118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c1338a0 0x7f753c118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 -- 172.21.15.19:0/759147452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7534009b30 con 0x7f753c139030 2023-10-03T10:14:14.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2228074ea0 con 0x7f222809d9f0 2023-10-03T10:14:14.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.317+0000 7f753bfff700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f753400efc0 tx=0x7f753400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f221c013c40 con 0x7f222809d9f0 2023-10-03T10:14:14.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534018070 con 0x7f753c139030 2023-10-03T10:14:14.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753400f040 con 0x7f753c139030 2023-10-03T10:14:14.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7534003c20 con 0x7f753c139030 2023-10-03T10:14:14.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f221c047350 con 0x7f222809d9f0 2023-10-03T10:14:14.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f222659c700 1 -- 172.21.15.19:0/1144687498 >> v1:172.21.15.19:6816/126819 conn(0x7f221002f5d0 legacy=0x7f2210031a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75240094a0 con 0x7f753c139030 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.318+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c11c280 con 0x7f753c139030 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.319+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f753400c8d0 con 0x7f753c139030 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.320+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f753403fdd0 con 0x7f753c139030 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.320+0000 7f753b7fe700 1 -- 172.21.15.19:0/759147452 >> v1:172.21.15.19:6816/126819 conn(0x7f752802f630 legacy=0x7f7528031ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.320+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c074ea0 con 0x7f753c139030 2023-10-03T10:14:14.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.326+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f221c044060 con 0x7f222809d9f0 2023-10-03T10:14:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.329+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7534014480 con 0x7f753c139030 2023-10-03T10:14:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.425+0000 7f002499e700 1 Processor -- start 2023-10-03T10:14:14.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 -- start start 2023-10-03T10:14:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0020131d10 0x7f0020139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002009ece0 con 0x7f002006b080 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002009e760 con 0x7f0020131d10 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f002499e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002009e040 con 0x7f002006a770 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.426+0000 7f001e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37006/0 (socket says 172.21.15.19:37006) 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 -- 172.21.15.19:0/705058651 learned_addr learned my addr 172.21.15.19:0/705058651 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001ed9d700 1 --2- 172.21.15.19:0/705058651 >> v2:172.21.15.19:3300/0 conn(0x7f0020131d10 0x7f0020139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 -- 172.21.15.19:0/705058651 >> v2:172.21.15.19:3300/0 conn(0x7f0020131d10 msgr2=0x7f0020139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:14.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 --2- 172.21.15.19:0/705058651 >> v2:172.21.15.19:3300/0 conn(0x7f0020131d10 0x7f0020139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 -- 172.21.15.19:0/705058651 >> v1:172.21.15.19:6789/0 conn(0x7f002006b080 legacy=0x7f0020131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 -- 172.21.15.19:0/705058651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002009f630 con 0x7f002006a770 2023-10-03T10:14:14.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001e59c700 1 --2- 172.21.15.19:0/705058651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f001000dd10 tx=0x7f001000f330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e776aee6a3f6288 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001d59a700 1 -- 172.21.15.19:0/705058651 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0010012070 con 0x7f002006a770 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001d59a700 1 -- 172.21.15.19:0/705058651 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000d2e0 con 0x7f002006a770 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.427+0000 7f001d59a700 1 -- 172.21.15.19:0/705058651 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000fbc0 con 0x7f002006a770 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 -- 172.21.15.19:0/705058651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 msgr2=0x7f002006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 --2- 172.21.15.19:0/705058651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f001000dd10 tx=0x7f001000f330 comp rx=0 tx=0).stop 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 -- 172.21.15.19:0/705058651 shutdown_connections 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 --2- 172.21.15.19:0/705058651 >> v2:172.21.15.19:3300/0 conn(0x7f0020131d10 0x7f0020139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 --2- 172.21.15.19:0/705058651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006a770 0x7f002006ab40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 -- 172.21.15.19:0/705058651 >> 172.21.15.19:0/705058651 conn(0x7f0020066f50 msgr2=0x7f002009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 -- 172.21.15.19:0/705058651 shutdown_connections 2023-10-03T10:14:14.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.428+0000 7f002499e700 1 -- 172.21.15.19:0/705058651 wait complete. 2023-10-03T10:14:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.429+0000 7f002499e700 1 Processor -- start 2023-10-03T10:14:14.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 -- start start 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 0x7f002011f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0020131d10 0x7f00201c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0020121ec0 con 0x7f0020131d10 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0020120f90 con 0x7f002006b080 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f002499e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0020130ff0 con 0x7f002006a770 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f001dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f001dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37018/0 (socket says 172.21.15.19:37018) 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f001dd9b700 1 -- 172.21.15.19:0/1286766333 learned_addr learned my addr 172.21.15.19:0/1286766333 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.430+0000 7f001ed9d700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0020131d10 0x7f00201c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001e59c700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 0x7f002011f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:14.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 -- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 msgr2=0x7f002011f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 0x7f002011f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 -- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0020131d10 msgr2=0x7f00201c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0020131d10 0x7f00201c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 -- 172.21.15.19:0/1286766333 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001000d9f0 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001e59c700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 0x7f002011f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f001dd9b700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f001400c4b0 tx=0x7f001400c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00140052d0 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014005430 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0020121c00 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00201228a0 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.431+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014003880 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.432+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040052e0 con 0x7f002006b080 2023-10-03T10:14:14.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.433+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f00140039e0 con 0x7f002006b080 2023-10-03T10:14:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.433+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f001403ef30 con 0x7f002006b080 2023-10-03T10:14:14.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.433+0000 7f001e59c700 1 -- 172.21.15.19:0/1286766333 >> v1:172.21.15.19:6816/126819 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.438+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0014010750 con 0x7f002006b080 2023-10-03T10:14:14.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.484+0000 7f1a196e5700 1 -- 172.21.15.19:0/635365751 >> v1:172.21.15.19:6816/126819 conn(0x7f19f802f510 legacy=0x7f19f80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.510+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a14120b60 con 0x7f1a1409de50 2023-10-03T10:14:14.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.510+0000 7f1a0a7fc700 1 -- 172.21.15.19:0/635365751 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a14120b60 con 0x7f1a1409de50 2023-10-03T10:14:14.510 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 >> v1:172.21.15.19:6816/126819 conn(0x7f19f802f510 legacy=0x7f19f80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 msgr2=0x7f1a1411d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a141335f0 tx=0x7f1a10004750 comp rx=0 tx=0).stop 2023-10-03T10:14:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 shutdown_connections 2023-10-03T10:14:14.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a141338a0 0x7f1a1411e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a1409de50 0x7f1a1411d680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 --2- 172.21.15.19:0/635365751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a1409e760 0x7f1a1411dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 >> 172.21.15.19:0/635365751 conn(0x7f1a140a2aa0 msgr2=0x7f1a141b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 shutdown_connections 2023-10-03T10:14:14.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.513+0000 7f1a1c14a700 1 -- 172.21.15.19:0/635365751 wait complete. 2023-10-03T10:14:14.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.519+0000 7f222659c700 1 -- 172.21.15.19:0/1144687498 >> v1:172.21.15.19:6816/126819 conn(0x7f221002f5d0 legacy=0x7f2210031a80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.521+0000 7f753b7fe700 1 -- 172.21.15.19:0/759147452 >> v1:172.21.15.19:6816/126819 conn(0x7f752802f630 legacy=0x7f7528031ae0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:14.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.538+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2228119d20 con 0x7f222809d9f0 2023-10-03T10:14:14.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.539+0000 7f2216ffd700 1 -- 172.21.15.19:0/1144687498 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f221c044030 con 0x7f222809d9f0 2023-10-03T10:14:14.539 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:14.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 >> v1:172.21.15.19:6816/126819 conn(0x7f221002f5d0 legacy=0x7f2210031a80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:14.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 msgr2=0x7f2228129a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f2228129a10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f221c00e810 tx=0x7f221c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:14.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 shutdown_connections 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22281316c0 0x7f2228129f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f222806acb0 0x7f22281294d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 --2- 172.21.15.19:0/1144687498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f222809d9f0 0x7f2228129a10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 >> 172.21.15.19:0/1144687498 conn(0x7f2228066f50 msgr2=0x7f22280a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 shutdown_connections 2023-10-03T10:14:14.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.541+0000 7f222cd6e700 1 -- 172.21.15.19:0/1144687498 wait complete. 2023-10-03T10:14:14.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:14.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.583+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f753c0a1f80 con 0x7f753c139030 2023-10-03T10:14:14.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.584+0000 7f7538ff9700 1 -- 172.21.15.19:0/759147452 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f753402b090 con 0x7f753c139030 2023-10-03T10:14:14.584 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:14.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 >> v1:172.21.15.19:6816/126819 conn(0x7f752802f630 legacy=0x7f7528031ae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 msgr2=0x7f753c119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f753400efc0 tx=0x7f753400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 shutdown_connections 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f753c139030 0x7f753c119750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f753c1338a0 0x7f753c118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 --2- 172.21.15.19:0/759147452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f753c136710 0x7f753c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 >> 172.21.15.19:0/759147452 conn(0x7f753c0a2aa0 msgr2=0x7f753c0a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 shutdown_connections 2023-10-03T10:14:14.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.586+0000 7f75420d0700 1 -- 172.21.15.19:0/759147452 wait complete. 2023-10-03T10:14:14.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:14.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.634+0000 7f001e59c700 1 -- 172.21.15.19:0/1286766333 >> v1:172.21.15.19:6816/126819 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:14.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.647+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0004005860 con 0x7f002006b080 2023-10-03T10:14:14.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.647+0000 7f000effd700 1 -- 172.21.15.19:0/1286766333 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0014017030 con 0x7f002006b080 2023-10-03T10:14:14.647 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 >> v1:172.21.15.19:6816/126819 conn(0x7f000002f510 legacy=0x7f00000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 msgr2=0x7f002011f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f001400c4b0 tx=0x7f001400c7c0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 shutdown_connections 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0020131d10 0x7f00201c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f002006a770 0x7f002011f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 --2- 172.21.15.19:0/1286766333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f002006b080 0x7f002011f750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 >> 172.21.15.19:0/1286766333 conn(0x7f0020066f50 msgr2=0x7f00200a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 shutdown_connections 2023-10-03T10:14:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:14.650+0000 7f002499e700 1 -- 172.21.15.19:0/1286766333 wait complete. 2023-10-03T10:14:14.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:15.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:15.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:15.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:15.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.691+0000 7f68b2263700 1 Processor -- start 2023-10-03T10:14:15.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.691+0000 7f68b2263700 1 -- start start 2023-10-03T10:14:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b2263700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b2263700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 0x7f68ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b2263700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68ac09f130 con 0x7f68ac09e410 2023-10-03T10:14:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b2263700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68ac09f520 con 0x7f68ac09e000 2023-10-03T10:14:15.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b2263700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac09e930 con 0x7f68ac09d6f0 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68ab7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 0x7f68ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68ab7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 0x7f68ac130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46990/0 (socket says 172.21.15.19:46990) 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68b0800700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f68ac09e410 0x7f68ac130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40880/0 (socket says 172.21.15.19:40880) 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68ab7fe700 1 -- 172.21.15.19:0/906673211 learned_addr learned my addr 172.21.15.19:0/906673211 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68abfff700 1 --2- 172.21.15.19:0/906673211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68abfff700 1 -- 172.21.15.19:0/906673211 >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 msgr2=0x7f68ac130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68abfff700 1 --2- 172.21.15.19:0/906673211 >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 0x7f68ac130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68abfff700 1 -- 172.21.15.19:0/906673211 >> v1:172.21.15.19:6789/0 conn(0x7f68ac09e410 legacy=0x7f68ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.692+0000 7f68abfff700 1 -- 172.21.15.19:0/906673211 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac09b2d0 con 0x7f68ac09d6f0 2023-10-03T10:14:15.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.693+0000 7f68abfff700 1 --2- 172.21.15.19:0/906673211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac09dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f689c009840 tx=0x7f689c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d99458d9ce73c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.693+0000 7f68aaffd700 1 -- 172.21.15.19:0/906673211 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c011830 con 0x7f68ac09d6f0 2023-10-03T10:14:15.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.693+0000 7f68aaffd700 1 -- 172.21.15.19:0/906673211 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c011990 con 0x7f68ac09d6f0 2023-10-03T10:14:15.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.693+0000 7f68aaffd700 1 -- 172.21.15.19:0/906673211 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c011d20 con 0x7f68ac09d6f0 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 -- 172.21.15.19:0/906673211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 msgr2=0x7f68ac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 --2- 172.21.15.19:0/906673211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac09dac0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f689c009840 tx=0x7f689c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 -- 172.21.15.19:0/906673211 shutdown_connections 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 --2- 172.21.15.19:0/906673211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac09dac0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 --2- 172.21.15.19:0/906673211 >> v2:172.21.15.19:3300/0 conn(0x7f68ac09e000 0x7f68ac130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 -- 172.21.15.19:0/906673211 >> 172.21.15.19:0/906673211 conn(0x7f68ac066f50 msgr2=0x7f68ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 -- 172.21.15.19:0/906673211 shutdown_connections 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.694+0000 7f68b2263700 1 -- 172.21.15.19:0/906673211 wait complete. 2023-10-03T10:14:15.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.695+0000 7f68b2263700 1 Processor -- start 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.695+0000 7f68b2263700 1 -- start start 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68ac09e000 0x7f68ac130b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68ac09e410 0x7f68ac139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac13b430 con 0x7f68ac09e000 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac1393e0 con 0x7f68ac09d6f0 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68b2263700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac072600 con 0x7f68ac09e410 2023-10-03T10:14:15.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37042/0 (socket says 172.21.15.19:37042) 2023-10-03T10:14:15.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68abfff700 1 -- 172.21.15.19:0/2506558219 learned_addr learned my addr 172.21.15.19:0/2506558219 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68ab7fe700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68ac09e000 0x7f68ac130b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68abfff700 1 -- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68ac09e410 msgr2=0x7f68ac139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.696+0000 7f68abfff700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68ac09e410 0x7f68ac139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68abfff700 1 -- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68ac09e000 msgr2=0x7f68ac130b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68abfff700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68ac09e000 0x7f68ac130b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68abfff700 1 -- 172.21.15.19:0/2506558219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c0094a0 con 0x7f68ac09d6f0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68abfff700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f689c009b90 tx=0x7f689c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0036a0 con 0x7f68ac09d6f0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c01f070 con 0x7f68ac09d6f0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac09c700 con 0x7f68ac09d6f0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c003a40 con 0x7f68ac09d6f0 2023-10-03T10:14:15.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.697+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac12f830 con 0x7f68ac09d6f0 2023-10-03T10:14:15.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.698+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac131290 con 0x7f68ac09d6f0 2023-10-03T10:14:15.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.698+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f689c003ba0 con 0x7f68ac09d6f0 2023-10-03T10:14:15.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.699+0000 7f68ab7fe700 1 -- 172.21.15.19:0/2506558219 >> v1:172.21.15.19:6816/126819 conn(0x7f689802f510 legacy=0x7f68980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.701+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f689c021070 con 0x7f68ac09d6f0 2023-10-03T10:14:15.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.704+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68ac131290 con 0x7f68ac09d6f0 2023-10-03T10:14:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.732+0000 7fc2f3ff8700 1 Processor -- start 2023-10-03T10:14:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.733+0000 7fc2f3ff8700 1 -- start start 2023-10-03T10:14:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.733+0000 7fc2f3ff8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f3ff8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 0x7fc2ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f3ff8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec09b120 con 0x7fc2ec09e410 2023-10-03T10:14:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f3ff8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec06b460 con 0x7fc2ec09d6f0 2023-10-03T10:14:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f3ff8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec09a7e0 con 0x7fc2ec09e000 2023-10-03T10:14:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 0x7fc2ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f2595700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc2ec09e410 0x7fc2ec133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40884/0 (socket says 172.21.15.19:40884) 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f2595700 1 -- 172.21.15.19:0/3503072087 learned_addr learned my addr 172.21.15.19:0/3503072087 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1d94700 1 --2- 172.21.15.19:0/3503072087 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 -- 172.21.15.19:0/3503072087 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09d6f0 msgr2=0x7fc2ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 --2- 172.21.15.19:0/3503072087 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 -- 172.21.15.19:0/3503072087 >> v1:172.21.15.19:6789/0 conn(0x7fc2ec09e410 legacy=0x7fc2ec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 -- 172.21.15.19:0/3503072087 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec09a500 con 0x7fc2ec09e000 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.734+0000 7fc2f1593700 1 --2- 172.21.15.19:0/3503072087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 0x7fc2ec1339f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009870 tx=0x7fc2dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac99b8e48e1f45b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f0d92700 1 -- 172.21.15.19:0/3503072087 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011830 con 0x7fc2ec09e000 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f0d92700 1 -- 172.21.15.19:0/3503072087 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc011990 con 0x7fc2ec09e000 2023-10-03T10:14:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f0d92700 1 -- 172.21.15.19:0/3503072087 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011d20 con 0x7fc2ec09e000 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/3503072087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 msgr2=0x7fc2ec1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/3503072087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 0x7fc2ec1339f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009870 tx=0x7fc2dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/3503072087 shutdown_connections 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/3503072087 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09d6f0 0x7fc2ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/3503072087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e000 0x7fc2ec1339f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.735+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/3503072087 >> 172.21.15.19:0/3503072087 conn(0x7fc2ec066f50 msgr2=0x7fc2ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.736+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/3503072087 shutdown_connections 2023-10-03T10:14:15.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.736+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/3503072087 wait complete. 2023-10-03T10:14:15.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.737+0000 7fc2f3ff8700 1 Processor -- start 2023-10-03T10:14:15.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.737+0000 7fc2f3ff8700 1 -- start start 2023-10-03T10:14:15.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec1a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 0x7fc2ec1a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a6b00 con 0x7fc2ec09e410 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a8690 con 0x7fc2ec09e000 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f3ff8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a7cb0 con 0x7fc2ec09d6f0 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f1593700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f1593700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37052/0 (socket says 172.21.15.19:37052) 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f1593700 1 -- 172.21.15.19:0/1365762311 learned_addr learned my addr 172.21.15.19:0/1365762311 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.738+0000 7fc2f2595700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 0x7fc2ec1a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 -- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09d6f0 msgr2=0x7fc2ec1a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec1a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 -- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 msgr2=0x7fc2ec1a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 0x7fc2ec1a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 -- 172.21.15.19:0/1365762311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0094a0 con 0x7fc2ec09e000 2023-10-03T10:14:15.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f2595700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 0x7fc2ec1a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:15.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f1593700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000c00 tx=0x7fc2dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0038a0 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc01f070 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc003c40 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0a3190 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.739+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1a8970 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.740+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc2dc026480 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.740+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec1a8330 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.741+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc2dc021070 con 0x7fc2ec09e000 2023-10-03T10:14:15.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.741+0000 7fc2f1d94700 1 -- 172.21.15.19:0/1365762311 >> v1:172.21.15.19:6816/126819 conn(0x7fc2d002f510 legacy=0x7fc2d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.746+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2dc019d40 con 0x7fc2ec09e000 2023-10-03T10:14:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.769+0000 7fcbf7450700 1 Processor -- start 2023-10-03T10:14:15.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.770+0000 7fcbf7450700 1 -- start start 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf7450700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf7450700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e410 0x7fcbf0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf7450700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf009b120 con 0x7fcbf009e000 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf7450700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf006b460 con 0x7fcbf009d6f0 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf7450700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf009a7e0 con 0x7fcbf009e410 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf49eb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcbf009e000 0x7fcbf01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40888/0 (socket says 172.21.15.19:40888) 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf49eb700 1 -- 172.21.15.19:0/2697088299 learned_addr learned my addr 172.21.15.19:0/2697088299 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf51ec700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf59ed700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e410 0x7fcbf0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf51ec700 1 -- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e410 msgr2=0x7fcbf0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf51ec700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e410 0x7fcbf0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf51ec700 1 -- 172.21.15.19:0/2697088299 >> v1:172.21.15.19:6789/0 conn(0x7fcbf009e000 legacy=0x7fcbf01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.771+0000 7fcbf51ec700 1 -- 172.21.15.19:0/2697088299 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf009a500 con 0x7fcbf009d6f0 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.772+0000 7fcbf51ec700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf009dac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009870 tx=0x7fcbec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382f10dbd33c3086 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.772+0000 7fcbe7fff700 1 -- 172.21.15.19:0/2697088299 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec004230 con 0x7fcbf009d6f0 2023-10-03T10:14:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.772+0000 7fcbe7fff700 1 -- 172.21.15.19:0/2697088299 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbec004390 con 0x7fcbf009d6f0 2023-10-03T10:14:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.772+0000 7fcbe7fff700 1 -- 172.21.15.19:0/2697088299 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbec0036a0 con 0x7fcbf009d6f0 2023-10-03T10:14:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 -- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 msgr2=0x7fcbf009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf009dac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcbec009870 tx=0x7fcbec009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:15.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 -- 172.21.15.19:0/2697088299 shutdown_connections 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e410 0x7fcbf0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 --2- 172.21.15.19:0/2697088299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf009dac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 -- 172.21.15.19:0/2697088299 >> 172.21.15.19:0/2697088299 conn(0x7fcbf0066f50 msgr2=0x7fcbf009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 -- 172.21.15.19:0/2697088299 shutdown_connections 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.773+0000 7fcbf7450700 1 -- 172.21.15.19:0/2697088299 wait complete. 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 Processor -- start 2023-10-03T10:14:15.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 -- start start 2023-10-03T10:14:15.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf01225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 0x7fcbf0122b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0124fa0 con 0x7fcbf009e410 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf009c710 con 0x7fcbf009d6f0 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.775+0000 7fcbf7450700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf0125cc0 con 0x7fcbf009e000 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf59ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf59ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47024/0 (socket says 172.21.15.19:47024) 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf59ed700 1 -- 172.21.15.19:0/1857813582 learned_addr learned my addr 172.21.15.19:0/1857813582 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 0x7fcbf0122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf51ec700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf01225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 -- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 msgr2=0x7fcbf01225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf01225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 -- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 msgr2=0x7fcbf0123050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf49eb700 1 -- 172.21.15.19:0/1857813582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec0094a0 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.776+0000 7fcbf59ed700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbf49eb700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 0x7fcbf0122b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c780 tx=0x7fcbe000ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004c80 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf00a1e20 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0004de0 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00072f0 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.777+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf0125fa0 con 0x7fcbf009e000 2023-10-03T10:14:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.778+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fcbe0007450 con 0x7fcbf009e000 2023-10-03T10:14:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.778+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fcbe003f900 con 0x7fcbf009e000 2023-10-03T10:14:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.778+0000 7fcbf51ec700 1 -- 172.21.15.19:0/1857813582 >> v1:172.21.15.19:6816/126819 conn(0x7fcbd402f510 legacy=0x7fcbd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.779+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf0125e00 con 0x7fcbf009e000 2023-10-03T10:14:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.784+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbf0125e00 con 0x7fcbf009e000 2023-10-03T10:14:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.814+0000 7fafba6be700 1 Processor -- start 2023-10-03T10:14:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 -- start start 2023-10-03T10:14:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 0x7fafb4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb409f130 con 0x7fafb409e000 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb409f520 con 0x7fafb409e410 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafba6be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb409e930 con 0x7fafb409d6f0 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37092/0 (socket says 172.21.15.19:37092) 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafb3fff700 1 -- 172.21.15.19:0/1914567844 learned_addr learned my addr 172.21.15.19:0/1914567844 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.815+0000 7fafb8c5b700 1 --2- 172.21.15.19:0/1914567844 >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 0x7fafb4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb3fff700 1 -- 172.21.15.19:0/1914567844 >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 msgr2=0x7fafb4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb3fff700 1 --2- 172.21.15.19:0/1914567844 >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 0x7fafb4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb3fff700 1 -- 172.21.15.19:0/1914567844 >> v1:172.21.15.19:6789/0 conn(0x7fafb409e000 legacy=0x7fafb4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb3fff700 1 -- 172.21.15.19:0/1914567844 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb409b2d0 con 0x7fafb409d6f0 2023-10-03T10:14:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb8c5b700 1 --2- 172.21.15.19:0/1914567844 >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 0x7fafb4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb3fff700 1 --2- 172.21.15.19:0/1914567844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafa40098f0 tx=0x7fafa4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e9a7dcfc70c2bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb2ffd700 1 -- 172.21.15.19:0/1914567844 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4004230 con 0x7fafb409d6f0 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb2ffd700 1 -- 172.21.15.19:0/1914567844 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4004390 con 0x7fafb409d6f0 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.816+0000 7fafb2ffd700 1 -- 172.21.15.19:0/1914567844 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa40036a0 con 0x7fafb409d6f0 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 -- 172.21.15.19:0/1914567844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 msgr2=0x7fafb409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 --2- 172.21.15.19:0/1914567844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fafa40098f0 tx=0x7fafa4009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 -- 172.21.15.19:0/1914567844 shutdown_connections 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 --2- 172.21.15.19:0/1914567844 >> v2:172.21.15.19:3300/0 conn(0x7fafb409e410 0x7fafb4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 --2- 172.21.15.19:0/1914567844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409d6f0 0x7fafb409dac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 -- 172.21.15.19:0/1914567844 >> 172.21.15.19:0/1914567844 conn(0x7fafb4066f50 msgr2=0x7fafb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 -- 172.21.15.19:0/1914567844 shutdown_connections 2023-10-03T10:14:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.817+0000 7fafba6be700 1 -- 172.21.15.19:0/1914567844 wait complete. 2023-10-03T10:14:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.818+0000 7fafba6be700 1 Processor -- start 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.818+0000 7fafba6be700 1 -- start start 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fafb409d6f0 0x7fafb4131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb409e410 0x7fafb41320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4138530 con 0x7fafb409e410 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4132b00 con 0x7fafb409e000 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafba6be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4072590 con 0x7fafb409d6f0 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafb37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafb8c5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb409e410 0x7fafb41320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafb37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37098/0 (socket says 172.21.15.19:37098) 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.819+0000 7fafb37fe700 1 -- 172.21.15.19:0/2354153576 learned_addr learned my addr 172.21.15.19:0/2354153576 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb3fff700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fafb409d6f0 0x7fafb4131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 -- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fafb409d6f0 msgr2=0x7fafb4131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fafb409d6f0 0x7fafb4131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 -- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb409e410 msgr2=0x7fafb41320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb409e410 0x7fafb41320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 -- 172.21.15.19:0/2354153576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4009550 con 0x7fafb409e000 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb37fe700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c4a0 tx=0x7fafa800c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8011790 con 0x7fafb409e000 2023-10-03T10:14:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa80118f0 con 0x7fafb409e000 2023-10-03T10:14:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb4134af0 con 0x7fafb409e000 2023-10-03T10:14:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8011ca0 con 0x7fafb409e000 2023-10-03T10:14:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.820+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb4134470 con 0x7fafb409e000 2023-10-03T10:14:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.822+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fafa801c460 con 0x7fafb409e000 2023-10-03T10:14:15.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.822+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fafa803f940 con 0x7fafb409e000 2023-10-03T10:14:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.822+0000 7fafb3fff700 1 -- 172.21.15.19:0/2354153576 >> v1:172.21.15.19:6816/126819 conn(0x7fafa002f510 legacy=0x7fafa00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.822+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb4133830 con 0x7fafb409e000 2023-10-03T10:14:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.832+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fafa8011e00 con 0x7fafb409e000 2023-10-03T10:14:15.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.900+0000 7f68ab7fe700 1 -- 172.21.15.19:0/2506558219 >> v1:172.21.15.19:6816/126819 conn(0x7f689802f510 legacy=0x7f68980319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.924+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68ac12f200 con 0x7f68ac09d6f0 2023-10-03T10:14:15.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.924+0000 7f68a8ff9700 1 -- 172.21.15.19:0/2506558219 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f689c015030 con 0x7f68ac09d6f0 2023-10-03T10:14:15.924 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 >> v1:172.21.15.19:6816/126819 conn(0x7f689802f510 legacy=0x7f68980319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 msgr2=0x7f68ac1305d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f689c009b90 tx=0x7f689c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 shutdown_connections 2023-10-03T10:14:15.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68ac09e410 0x7f68ac139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68ac09d6f0 0x7f68ac1305d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 --2- 172.21.15.19:0/2506558219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68ac09e000 0x7f68ac130b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 >> 172.21.15.19:0/2506558219 conn(0x7f68ac066f50 msgr2=0x7f68ac0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 shutdown_connections 2023-10-03T10:14:15.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.927+0000 7f68b2263700 1 -- 172.21.15.19:0/2506558219 wait complete. 2023-10-03T10:14:15.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:15.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.942+0000 7fc2f1d94700 1 -- 172.21.15.19:0/1365762311 >> v1:172.21.15.19:6816/126819 conn(0x7fc2d002f510 legacy=0x7fc2d00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.979+0000 7fcbf51ec700 1 -- 172.21.15.19:0/1857813582 >> v1:172.21.15.19:6816/126819 conn(0x7fcbd402f510 legacy=0x7fcbd40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.986+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2ec074ea0 con 0x7fc2ec09e000 2023-10-03T10:14:15.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.986+0000 7fc2e27fc700 1 -- 172.21.15.19:0/1365762311 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2dc02b020 con 0x7fc2ec09e000 2023-10-03T10:14:15.986 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 >> v1:172.21.15.19:6816/126819 conn(0x7fc2d002f510 legacy=0x7fc2d00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 msgr2=0x7fc2ec1a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc000c00 tx=0x7fc2dc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 shutdown_connections 2023-10-03T10:14:15.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e410 0x7fc2ec1a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09d6f0 0x7fc2ec1a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 --2- 172.21.15.19:0/1365762311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09e000 0x7fc2ec1a5390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 >> 172.21.15.19:0/1365762311 conn(0x7fc2ec066f50 msgr2=0x7fc2ec1baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 shutdown_connections 2023-10-03T10:14:15.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:15.989+0000 7fc2f3ff8700 1 -- 172.21.15.19:0/1365762311 wait complete. 2023-10-03T10:14:16.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.010+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbf0125e00 con 0x7fcbf009e000 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.011+0000 7fcbe5ffb700 1 -- 172.21.15.19:0/1857813582 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbf0125e00 con 0x7fcbf009e000 2023-10-03T10:14:16.010 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 >> v1:172.21.15.19:6816/126819 conn(0x7fcbd402f510 legacy=0x7fcbd40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 msgr2=0x7fcbf0122b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 0x7fcbf0122b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c780 tx=0x7fcbe000ca90 comp rx=0 tx=0).stop 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 shutdown_connections 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbf009e410 0x7fcbf0123050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbf009d6f0 0x7fcbf01225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 --2- 172.21.15.19:0/1857813582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbf009e000 0x7fcbf0122b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 >> 172.21.15.19:0/1857813582 conn(0x7fcbf0066f50 msgr2=0x7fcbf006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 shutdown_connections 2023-10-03T10:14:16.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.013+0000 7fcbf7450700 1 -- 172.21.15.19:0/1857813582 wait complete. 2023-10-03T10:14:16.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.023+0000 7fafb3fff700 1 -- 172.21.15.19:0/2354153576 >> v1:172.21.15.19:6816/126819 conn(0x7fafa002f510 legacy=0x7fafa00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:16.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:16.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.046+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fafb4074ea0 con 0x7fafb409e000 2023-10-03T10:14:16.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.046+0000 7fafb0ff9700 1 -- 172.21.15.19:0/2354153576 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafa801a360 con 0x7fafb409e000 2023-10-03T10:14:16.046 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 >> v1:172.21.15.19:6816/126819 conn(0x7fafa002f510 legacy=0x7fafa00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 msgr2=0x7fafb4131b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c4a0 tx=0x7fafa800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 shutdown_connections 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fafb409e410 0x7fafb41320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fafb409d6f0 0x7fafb4131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 --2- 172.21.15.19:0/2354153576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fafb409e000 0x7fafb4131b70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:16.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 >> 172.21.15.19:0/2354153576 conn(0x7fafb4066f50 msgr2=0x7fafb40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:16.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 shutdown_connections 2023-10-03T10:14:16.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:16.049+0000 7fafba6be700 1 -- 172.21.15.19:0/2354153576 wait complete. 2023-10-03T10:14:16.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:16.942 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:17.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:17.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:17.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:17.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.095+0000 7f4934cac700 1 Processor -- start 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.095+0000 7f4934cac700 1 -- start start 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f4934cac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f493006f5d0 0x7f493012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f4934cac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4930135c20 0x7f4930138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f4934cac700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493006fa40 con 0x7f493012cf60 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f4934cac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493012cd90 con 0x7f493006f5d0 2023-10-03T10:14:17.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f4934cac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4930071780 con 0x7f4930135c20 2023-10-03T10:14:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f492dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f493006f5d0 0x7f493012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f492e59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f493012cf60 0x7f493012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50494/0 (socket says 172.21.15.19:50494) 2023-10-03T10:14:17.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.096+0000 7f492e59c700 1 -- 172.21.15.19:0/203271797 learned_addr learned my addr 172.21.15.19:0/203271797 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:17.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492d59a700 1 -- 172.21.15.19:0/203271797 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3630223557 0 0) 0x7f493006fa40 con 0x7f493012cf60 2023-10-03T10:14:17.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492d59a700 1 -- 172.21.15.19:0/203271797 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49180035b0 con 0x7f493012cf60 2023-10-03T10:14:17.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492dd9b700 1 -- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4930135c20 msgr2=0x7f4930138000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492dd9b700 1 --2- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4930135c20 0x7f4930138000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492dd9b700 1 -- 172.21.15.19:0/203271797 >> v1:172.21.15.19:6789/0 conn(0x7f493012cf60 legacy=0x7f493012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492dd9b700 1 -- 172.21.15.19:0/203271797 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4930071a40 con 0x7f493006f5d0 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492dd9b700 1 --2- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493006f5d0 0x7f493012ffc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f492400bae0 tx=0x7f492400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fecbc54decf5890 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492d59a700 1 -- 172.21.15.19:0/203271797 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400dc70 con 0x7f493006f5d0 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492d59a700 1 -- 172.21.15.19:0/203271797 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492400ddd0 con 0x7f493006f5d0 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.097+0000 7f492d59a700 1 -- 172.21.15.19:0/203271797 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924010690 con 0x7f493006f5d0 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 -- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493006f5d0 msgr2=0x7f493012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 --2- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493006f5d0 0x7f493012ffc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f492400bae0 tx=0x7f492400bdf0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 -- 172.21.15.19:0/203271797 shutdown_connections 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 --2- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4930135c20 0x7f4930138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 --2- 172.21.15.19:0/203271797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f493006f5d0 0x7f493012ffc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 -- 172.21.15.19:0/203271797 >> 172.21.15.19:0/203271797 conn(0x7f49300a2aa0 msgr2=0x7f49300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 -- 172.21.15.19:0/203271797 shutdown_connections 2023-10-03T10:14:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.098+0000 7f4934cac700 1 -- 172.21.15.19:0/203271797 wait complete. 2023-10-03T10:14:17.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.099+0000 7f4934cac700 1 Processor -- start 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.099+0000 7f4934cac700 1 -- start start 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 0x7f493009cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 0x7f49301c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493012c080 con 0x7f4930135c20 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4930127ae0 con 0x7f493012cf60 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f4934cac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4930129fa0 con 0x7f493006f5d0 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 0x7f49301c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 0x7f493009cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44078/0 (socket says 172.21.15.19:44078) 2023-10-03T10:14:17.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 0x7f49301c8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59800/0 (socket says 172.21.15.19:59800) 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 0x7f493009cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45556/0 (socket says 172.21.15.19:45556) 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.100+0000 7f492dd9b700 1 -- 172.21.15.19:0/1857359663 learned_addr learned my addr 172.21.15.19:0/1857359663 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 -- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 msgr2=0x7f493009cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 0x7f493009cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 -- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 msgr2=0x7f49301c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 0x7f49301c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 -- 172.21.15.19:0/1857359663 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492400b740 con 0x7f493012cf60 2023-10-03T10:14:17.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f492dd9b700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f4924004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924003bf0 con 0x7f493012cf60 2023-10-03T10:14:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924003d50 con 0x7f493012cf60 2023-10-03T10:14:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493009c650 con 0x7f493012cf60 2023-10-03T10:14:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924010670 con 0x7f493012cf60 2023-10-03T10:14:17.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.101+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493009e930 con 0x7f493012cf60 2023-10-03T10:14:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.102+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4924023440 con 0x7f493012cf60 2023-10-03T10:14:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.103+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4930074ea0 con 0x7f493012cf60 2023-10-03T10:14:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.103+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4924041770 con 0x7f493012cf60 2023-10-03T10:14:17.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.103+0000 7f492e59c700 1 -- 172.21.15.19:0/1857359663 >> v1:172.21.15.19:6816/126819 conn(0x7f491002f540 legacy=0x7f49100319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.109+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49240236f0 con 0x7f493012cf60 2023-10-03T10:14:17.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 Processor -- start 2023-10-03T10:14:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 -- start start 2023-10-03T10:14:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea1c09f410 0x7fea1c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea1c070940 con 0x7fea1c09e930 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea1c06fd60 con 0x7fea1c09f410 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea208ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c06fa80 con 0x7fea1c136fe0 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea1a59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fea1c09e930 0x7fea1c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50500/0 (socket says 172.21.15.19:50500) 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea1a59c700 1 -- 172.21.15.19:0/2122515139 learned_addr learned my addr 172.21.15.19:0/2122515139 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea11d9b700 1 --2- 172.21.15.19:0/2122515139 >> v2:172.21.15.19:3300/0 conn(0x7fea1c09f410 0x7fea1c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.152+0000 7fea1ad9d700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea11d9b700 1 -- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 msgr2=0x7fea1c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea11d9b700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea11d9b700 1 -- 172.21.15.19:0/2122515139 >> v1:172.21.15.19:6789/0 conn(0x7fea1c09e930 legacy=0x7fea1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea11d9b700 1 -- 172.21.15.19:0/2122515139 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea1c09fb60 con 0x7fea1c09f410 2023-10-03T10:14:17.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea19d9b700 1 -- 172.21.15.19:0/2122515139 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317575365 0 0) 0x7fea1c070940 con 0x7fea1c09e930 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea11d9b700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c136aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea04009840 tx=0x7fea04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cfb597e3fa5da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea19d9b700 1 -- 172.21.15.19:0/2122515139 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011830 con 0x7fea1c09f410 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea19d9b700 1 -- 172.21.15.19:0/2122515139 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea04011990 con 0x7fea1c09f410 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.153+0000 7fea19d9b700 1 -- 172.21.15.19:0/2122515139 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea04011d20 con 0x7fea1c09f410 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 -- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 msgr2=0x7fea1c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c136aa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fea04009840 tx=0x7fea04009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 -- 172.21.15.19:0/2122515139 shutdown_connections 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 --2- 172.21.15.19:0/2122515139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c136aa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 -- 172.21.15.19:0/2122515139 >> 172.21.15.19:0/2122515139 conn(0x7fea1c0a4210 msgr2=0x7fea1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 -- 172.21.15.19:0/2122515139 shutdown_connections 2023-10-03T10:14:17.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.154+0000 7fea208ad700 1 -- 172.21.15.19:0/2122515139 wait complete. 2023-10-03T10:14:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 Processor -- start 2023-10-03T10:14:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 -- start start 2023-10-03T10:14:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea1c09e930 0x7fea1c11c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c11fea0 con 0x7fea1c09f410 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c071d20 con 0x7fea1c136fe0 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea208ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea1c11e380 con 0x7fea1c09e930 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea11d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea11d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59806/0 (socket says 172.21.15.19:59806) 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea11d9b700 1 -- 172.21.15.19:0/4057576359 learned_addr learned my addr 172.21.15.19:0/4057576359 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.156+0000 7fea1ad9d700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea1a59c700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea1c09e930 0x7fea1c11c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 -- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea1c09e930 msgr2=0x7fea1c11c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea1c09e930 0x7fea1c11c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 -- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 msgr2=0x7fea1c11d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c11d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 -- 172.21.15.19:0/4057576359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040094a0 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea1ad9d700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c11d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea11d9b700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea04009fd0 tx=0x7fea04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040045d0 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0401f070 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea1c0a3410 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea040038e0 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.157+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea1c1325a0 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.159+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea1c11fb40 con 0x7fea1c09f410 2023-10-03T10:14:17.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.159+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fea04003a40 con 0x7fea1c09f410 2023-10-03T10:14:17.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.159+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fea04021070 con 0x7fea1c09f410 2023-10-03T10:14:17.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.159+0000 7fea1a59c700 1 -- 172.21.15.19:0/4057576359 >> v1:172.21.15.19:6816/126819 conn(0x7fe9fc02f510 legacy=0x7fe9fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.168+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea04010380 con 0x7fea1c09f410 2023-10-03T10:14:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.233+0000 7f5b5447d700 1 Processor -- start 2023-10-03T10:14:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.233+0000 7f5b5447d700 1 -- start start 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b5447d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b5447d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b4c09a1c0 0x7f5b4c1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b5447d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4c09c280 con 0x7f5b4c099680 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b5447d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4c09aaf0 con 0x7f5b4c09a1c0 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b5447d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c09b960 con 0x7f5b4c0954c0 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b52219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b52219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45580/0 (socket says 172.21.15.19:45580) 2023-10-03T10:14:17.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b52219700 1 -- 172.21.15.19:0/291915820 learned_addr learned my addr 172.21.15.19:0/291915820 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:17.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.234+0000 7f5b52a1a700 1 --2- 172.21.15.19:0/291915820 >> v2:172.21.15.19:3300/0 conn(0x7f5b4c09a1c0 0x7f5b4c1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b52219700 1 -- 172.21.15.19:0/291915820 >> v2:172.21.15.19:3300/0 conn(0x7f5b4c09a1c0 msgr2=0x7f5b4c1385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b52219700 1 --2- 172.21.15.19:0/291915820 >> v2:172.21.15.19:3300/0 conn(0x7f5b4c09a1c0 0x7f5b4c1385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b52219700 1 -- 172.21.15.19:0/291915820 >> v1:172.21.15.19:6789/0 conn(0x7f5b4c099680 legacy=0x7f5b4c099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b52219700 1 -- 172.21.15.19:0/291915820 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c09a7b0 con 0x7f5b4c0954c0 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b52219700 1 --2- 172.21.15.19:0/291915820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098f0 tx=0x7f5b48009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb500259365799c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b51217700 1 -- 172.21.15.19:0/291915820 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48011830 con 0x7f5b4c0954c0 2023-10-03T10:14:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b51217700 1 -- 172.21.15.19:0/291915820 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b48011990 con 0x7f5b4c0954c0 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.235+0000 7f5b51217700 1 -- 172.21.15.19:0/291915820 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48011d20 con 0x7f5b4c0954c0 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 -- 172.21.15.19:0/291915820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 msgr2=0x7f5b4c095890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 --2- 172.21.15.19:0/291915820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5b480098f0 tx=0x7f5b48009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 -- 172.21.15.19:0/291915820 shutdown_connections 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 --2- 172.21.15.19:0/291915820 >> v2:172.21.15.19:3300/0 conn(0x7f5b4c09a1c0 0x7f5b4c1385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 --2- 172.21.15.19:0/291915820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c095890 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 -- 172.21.15.19:0/291915820 >> 172.21.15.19:0/291915820 conn(0x7f5b4c0a2360 msgr2=0x7f5b4c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 -- 172.21.15.19:0/291915820 shutdown_connections 2023-10-03T10:14:17.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.236+0000 7f5b5447d700 1 -- 172.21.15.19:0/291915820 wait complete. 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.237+0000 7f5b5447d700 1 Processor -- start 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.237+0000 7f5b5447d700 1 -- start start 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b4c099680 0x7f5b4c1341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c137a10 con 0x7f5b4c09a1c0 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c13b800 con 0x7f5b4c099680 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b5447d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4c135d00 con 0x7f5b4c0954c0 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b52a1a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b52219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b52a1a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59822/0 (socket says 172.21.15.19:59822) 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b52219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45582/0 (socket says 172.21.15.19:45582) 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b52a1a700 1 -- 172.21.15.19:0/1007861334 learned_addr learned my addr 172.21.15.19:0/1007861334 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.238+0000 7f5b51a18700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b4c099680 0x7f5b4c1341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 -- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b4c099680 msgr2=0x7f5b4c1341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b4c099680 0x7f5b4c1341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 -- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 msgr2=0x7f5b4c134730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 -- 172.21.15.19:0/1007861334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48009550 con 0x7f5b4c0954c0 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52a1a700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:17.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b52219700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c09d3e0 tx=0x7f5b48004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b48004400 con 0x7f5b4c0954c0 2023-10-03T10:14:17.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4801f070 con 0x7f5b4c0954c0 2023-10-03T10:14:17.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c137c10 con 0x7f5b4c0954c0 2023-10-03T10:14:17.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b480038e0 con 0x7f5b4c0954c0 2023-10-03T10:14:17.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.239+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4c09b000 con 0x7f5b4c0954c0 2023-10-03T10:14:17.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.240+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f5b48021030 con 0x7f5b4c0954c0 2023-10-03T10:14:17.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.241+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f5b48040f90 con 0x7f5b4c0954c0 2023-10-03T10:14:17.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.241+0000 7f5b51a18700 1 -- 172.21.15.19:0/1007861334 >> v1:172.21.15.19:6816/126819 conn(0x7f5b3002f510 legacy=0x7f5b300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.241+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b4c0712e0 con 0x7f5b4c0954c0 2023-10-03T10:14:17.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.246+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b48004560 con 0x7f5b4c0954c0 2023-10-03T10:14:17.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.280+0000 7f9174623700 1 Processor -- start 2023-10-03T10:14:17.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.280+0000 7f9174623700 1 -- start start 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9174623700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9174623700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9174623700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c09edd0 con 0x7f916c0a0a30 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9174623700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0a18e0 con 0x7f916c139250 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9174623700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f916c09e1f0 con 0x7f916c0a1510 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f91723bf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f916c0a0a30 0x7f916c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50510/0 (socket says 172.21.15.19:50510) 2023-10-03T10:14:17.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f91723bf700 1 -- 172.21.15.19:0/4170252790 learned_addr learned my addr 172.21.15.19:0/4170252790 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9171bbe700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9172bc0700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f91713bd700 1 -- 172.21.15.19:0/4170252790 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2781808492 0 0) 0x7f916c09edd0 con 0x7f916c0a0a30 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f91713bd700 1 -- 172.21.15.19:0/4170252790 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91580035b0 con 0x7f916c0a0a30 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.281+0000 7f9172bc0700 1 -- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 msgr2=0x7f916c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f9172bc0700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f9172bc0700 1 -- 172.21.15.19:0/4170252790 >> v1:172.21.15.19:6789/0 conn(0x7f916c0a0a30 legacy=0x7f916c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f9172bc0700 1 -- 172.21.15.19:0/4170252790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c09dc50 con 0x7f916c139250 2023-10-03T10:14:17.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f9172bc0700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c13b630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9164009dc0 tx=0x7f916400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74986a6a32850221 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f91713bd700 1 -- 172.21.15.19:0/4170252790 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400e070 con 0x7f916c139250 2023-10-03T10:14:17.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f91713bd700 1 -- 172.21.15.19:0/4170252790 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916400bb20 con 0x7f916c139250 2023-10-03T10:14:17.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.282+0000 7f91713bd700 1 -- 172.21.15.19:0/4170252790 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400be90 con 0x7f916c139250 2023-10-03T10:14:17.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 -- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 msgr2=0x7f916c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c13b630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9164009dc0 tx=0x7f916400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 -- 172.21.15.19:0/4170252790 shutdown_connections 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c13b630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 --2- 172.21.15.19:0/4170252790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 -- 172.21.15.19:0/4170252790 >> 172.21.15.19:0/4170252790 conn(0x7f916c0a6550 msgr2=0x7f916c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 -- 172.21.15.19:0/4170252790 shutdown_connections 2023-10-03T10:14:17.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.283+0000 7f9174623700 1 -- 172.21.15.19:0/4170252790 wait complete. 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.284+0000 7f9174623700 1 Processor -- start 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.284+0000 7f9174623700 1 -- start start 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f916c0a0a30 0x7f916c11e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c11eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c133ed0 con 0x7f916c0a0a30 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1344b0 con 0x7f916c139250 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9174623700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0a5510 con 0x7f916c0a1510 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44120/0 (socket says 172.21.15.19:44120) 2023-10-03T10:14:17.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 -- 172.21.15.19:0/2148052631 learned_addr learned my addr 172.21.15.19:0/2148052631 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 -- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 msgr2=0x7f916c11eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c11eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 -- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f916c0a0a30 msgr2=0x7f916c11e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f916c0a0a30 0x7f916c11e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.285+0000 7f9172bc0700 1 -- 172.21.15.19:0/2148052631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009a70 con 0x7f916c139250 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9172bc0700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f916400b370 tx=0x7f9164004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164012630 con 0x7f916c139250 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640127b0 con 0x7f916c139250 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c120a30 con 0x7f916c139250 2023-10-03T10:14:17.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c0a0220 con 0x7f916c139250 2023-10-03T10:14:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.286+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164012b60 con 0x7f916c139250 2023-10-03T10:14:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.288+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91540052e0 con 0x7f916c139250 2023-10-03T10:14:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.288+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9164012cc0 con 0x7f916c139250 2023-10-03T10:14:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.288+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9164043570 con 0x7f916c139250 2023-10-03T10:14:17.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.288+0000 7f91723bf700 1 -- 172.21.15.19:0/2148052631 >> v1:172.21.15.19:6816/126819 conn(0x7f915002f510 legacy=0x7f91500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.293+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9164047060 con 0x7f916c139250 2023-10-03T10:14:17.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.304+0000 7f492e59c700 1 -- 172.21.15.19:0/1857359663 >> v1:172.21.15.19:6816/126819 conn(0x7f491002f540 legacy=0x7f49100319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.360+0000 7fea1a59c700 1 -- 172.21.15.19:0/4057576359 >> v1:172.21.15.19:6816/126819 conn(0x7fe9fc02f510 legacy=0x7fe9fc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.374+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f49300713a0 con 0x7f493012cf60 2023-10-03T10:14:17.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.375+0000 7f491effd700 1 -- 172.21.15.19:0/1857359663 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f492400f3d0 con 0x7f493012cf60 2023-10-03T10:14:17.375 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 >> v1:172.21.15.19:6816/126819 conn(0x7f491002f540 legacy=0x7f49100319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 msgr2=0x7f493009d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4924000c00 tx=0x7f4924004750 comp rx=0 tx=0).stop 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 shutdown_connections 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4930135c20 0x7f49301c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f493006f5d0 0x7f493009cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 --2- 172.21.15.19:0/1857359663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f493012cf60 0x7f493009d0e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 >> 172.21.15.19:0/1857359663 conn(0x7f49300a2aa0 msgr2=0x7f49300a1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 shutdown_connections 2023-10-03T10:14:17.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.377+0000 7f4934cac700 1 -- 172.21.15.19:0/1857359663 wait complete. 2023-10-03T10:14:17.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:17.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.433+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fea1c074ea0 con 0x7fea1c09f410 2023-10-03T10:14:17.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.433+0000 7fea137fe700 1 -- 172.21.15.19:0/4057576359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea04015020 con 0x7fea1c09f410 2023-10-03T10:14:17.433 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 >> v1:172.21.15.19:6816/126819 conn(0x7fe9fc02f510 legacy=0x7fe9fc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 msgr2=0x7fea1c11cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fea04009fd0 tx=0x7fea04004750 comp rx=0 tx=0).stop 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 shutdown_connections 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea1c136fe0 0x7fea1c11d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea1c09e930 0x7fea1c11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.436+0000 7fea208ad700 1 --2- 172.21.15.19:0/4057576359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea1c09f410 0x7fea1c11cba0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.437+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 >> 172.21.15.19:0/4057576359 conn(0x7fea1c0a4210 msgr2=0x7fea1c134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.437+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 shutdown_connections 2023-10-03T10:14:17.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.437+0000 7fea208ad700 1 -- 172.21.15.19:0/4057576359 wait complete. 2023-10-03T10:14:17.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.442+0000 7f5b51a18700 1 -- 172.21.15.19:0/1007861334 >> v1:172.21.15.19:6816/126819 conn(0x7f5b3002f510 legacy=0x7f5b300319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:17.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.471+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b4c074ea0 con 0x7f5b4c0954c0 2023-10-03T10:14:17.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.471+0000 7f5b42ffd700 1 -- 172.21.15.19:0/1007861334 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b48015030 con 0x7f5b4c0954c0 2023-10-03T10:14:17.471 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 >> v1:172.21.15.19:6816/126819 conn(0x7f5b3002f510 legacy=0x7f5b300319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 msgr2=0x7f5b4c13b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c09d3e0 tx=0x7f5b48004750 comp rx=0 tx=0).stop 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 shutdown_connections 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b4c09a1c0 0x7f5b4c134730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b4c0954c0 0x7f5b4c13b2c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 --2- 172.21.15.19:0/1007861334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b4c099680 0x7f5b4c1341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 >> 172.21.15.19:0/1007861334 conn(0x7f5b4c0a2360 msgr2=0x7f5b4c098510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 shutdown_connections 2023-10-03T10:14:17.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.474+0000 7f5b5447d700 1 -- 172.21.15.19:0/1007861334 wait complete. 2023-10-03T10:14:17.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:17.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.489+0000 7f91723bf700 1 -- 172.21.15.19:0/2148052631 >> v1:172.21.15.19:6816/126819 conn(0x7f915002f510 legacy=0x7f91500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:17.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.503+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9154005150 con 0x7f916c139250 2023-10-03T10:14:17.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.503+0000 7f9162ffd700 1 -- 172.21.15.19:0/2148052631 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9164047030 con 0x7f916c139250 2023-10-03T10:14:17.503 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 >> v1:172.21.15.19:6816/126819 conn(0x7f915002f510 legacy=0x7f91500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 msgr2=0x7f916c11f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f916400b370 tx=0x7f9164004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 shutdown_connections 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f916c139250 0x7f916c11f090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f916c0a0a30 0x7f916c11e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 --2- 172.21.15.19:0/2148052631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f916c0a1510 0x7f916c11eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 >> 172.21.15.19:0/2148052631 conn(0x7f916c0a6550 msgr2=0x7f916c136b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 shutdown_connections 2023-10-03T10:14:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:17.505+0000 7f9174623700 1 -- 172.21.15.19:0/2148052631 wait complete. 2023-10-03T10:14:17.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:18.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:18.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:18.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:18.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:18.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.554+0000 7f723b069700 1 Processor -- start 2023-10-03T10:14:18.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.554+0000 7f723b069700 1 -- start start 2023-10-03T10:14:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f723b069700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72341338c0 0x7f7234133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f723b069700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f723b069700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723406f720 con 0x7f723409e390 2023-10-03T10:14:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f723b069700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7234070c80 con 0x7f72341341d0 2023-10-03T10:14:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f723b069700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f723406fce0 con 0x7f72341338c0 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7238e05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72341338c0 0x7f7234133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44132/0 (socket says 172.21.15.19:44132) 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 -- 172.21.15.19:0/2561258976 learned_addr learned my addr 172.21.15.19:0/2561258976 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f72337fe700 1 -- 172.21.15.19:0/2561258976 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504548684 0 0) 0x7f723406f720 con 0x7f723409e390 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f72337fe700 1 -- 172.21.15.19:0/2561258976 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72240035b0 con 0x7f723409e390 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 -- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72341338c0 msgr2=0x7f7234133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 --2- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72341338c0 0x7f7234133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.555+0000 7f7233fff700 1 -- 172.21.15.19:0/2561258976 >> v1:172.21.15.19:6789/0 conn(0x7f723409e390 legacy=0x7f723413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.556+0000 7f7233fff700 1 -- 172.21.15.19:0/2561258976 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72341336a0 con 0x7f72341341d0 2023-10-03T10:14:18.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.556+0000 7f7233fff700 1 --2- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7220009920 tx=0x7f7220009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8d0c24f1fc95230 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.556+0000 7f72337fe700 1 -- 172.21.15.19:0/2561258976 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220011830 con 0x7f72341341d0 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.556+0000 7f72337fe700 1 -- 172.21.15.19:0/2561258976 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7220011990 con 0x7f72341341d0 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.556+0000 7f72337fe700 1 -- 172.21.15.19:0/2561258976 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220011d20 con 0x7f72341341d0 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 -- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 msgr2=0x7f723409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 --2- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7220009920 tx=0x7f7220009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 -- 172.21.15.19:0/2561258976 shutdown_connections 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 --2- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72341338c0 0x7f7234133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 --2- 172.21.15.19:0/2561258976 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723409de50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 -- 172.21.15.19:0/2561258976 >> 172.21.15.19:0/2561258976 conn(0x7f72340a2aa0 msgr2=0x7f72340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 -- 172.21.15.19:0/2561258976 shutdown_connections 2023-10-03T10:14:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.557+0000 7f723b069700 1 -- 172.21.15.19:0/2561258976 wait complete. 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.558+0000 7f723b069700 1 Processor -- start 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.558+0000 7f723b069700 1 -- start start 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72341338c0 0x7f723411aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723411aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723411ba20 con 0x7f72341338c0 2023-10-03T10:14:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723411c180 con 0x7f72341341d0 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f723b069700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f723411d3d0 con 0x7f723409e390 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f7238e05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f7238e05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45626/0 (socket says 172.21.15.19:45626) 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f7238e05700 1 -- 172.21.15.19:0/1113652626 learned_addr learned my addr 172.21.15.19:0/1113652626 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f7239606700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723411aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.559+0000 7f7233fff700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72341338c0 0x7f723411aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 -- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 msgr2=0x7f723411aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723411aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 -- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72341338c0 msgr2=0x7f723411aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72341338c0 0x7f723411aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 -- 172.21.15.19:0/1113652626 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220009550 con 0x7f723409e390 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f7238e05700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f722800e9e0 tx=0x7f722800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228009710 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723411ddb0 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722800ee80 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800ca50 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.560+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7234132040 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.561+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234074ea0 con 0x7f723409e390 2023-10-03T10:14:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.562+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f722800cbb0 con 0x7f723409e390 2023-10-03T10:14:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.563+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7228040420 con 0x7f723409e390 2023-10-03T10:14:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.563+0000 7f7233fff700 1 -- 172.21.15.19:0/1113652626 >> v1:172.21.15.19:6816/126819 conn(0x7f721802f510 legacy=0x7f72180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.567+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f722801a360 con 0x7f723409e390 2023-10-03T10:14:18.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 Processor -- start 2023-10-03T10:14:18.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 -- start start 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47341338a0 0x7f4734133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 0x7f473413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473406ef30 con 0x7f473409de50 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473406fef0 con 0x7f47341338a0 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.606+0000 7f473bea4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47341334b0 con 0x7f473409e930 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4739c40700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47341338a0 0x7f4734133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f473943f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f473409de50 0x7f473409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50526/0 (socket says 172.21.15.19:50526) 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f473943f700 1 -- 172.21.15.19:0/179790033 learned_addr learned my addr 172.21.15.19:0/179790033 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:18.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f473a441700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 0x7f473413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4739c40700 1 -- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 msgr2=0x7f473413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4739c40700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 0x7f473413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4739c40700 1 -- 172.21.15.19:0/179790033 >> v1:172.21.15.19:6789/0 conn(0x7f473409de50 legacy=0x7f473409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4739c40700 1 -- 172.21.15.19:0/179790033 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473406fc30 con 0x7f47341338a0 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f4738c3e700 1 -- 172.21.15.19:0/179790033 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316070259 0 0) 0x7f473406ef30 con 0x7f473409de50 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.607+0000 7f473a441700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 0x7f473413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f4739c40700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47341338a0 0x7f4734133c70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df323ef73ac24f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f4738c3e700 1 -- 172.21.15.19:0/179790033 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011830 con 0x7f47341338a0 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f4738c3e700 1 -- 172.21.15.19:0/179790033 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730011990 con 0x7f47341338a0 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f4738c3e700 1 -- 172.21.15.19:0/179790033 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011d20 con 0x7f47341338a0 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f473bea4700 1 -- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47341338a0 msgr2=0x7f4734133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.608+0000 7f473bea4700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47341338a0 0x7f4734133c70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4730009840 tx=0x7f4730009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 -- 172.21.15.19:0/179790033 shutdown_connections 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409e930 0x7f473413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 --2- 172.21.15.19:0/179790033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47341338a0 0x7f4734133c70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 -- 172.21.15.19:0/179790033 >> 172.21.15.19:0/179790033 conn(0x7f47340a2aa0 msgr2=0x7f47340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 -- 172.21.15.19:0/179790033 shutdown_connections 2023-10-03T10:14:18.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.609+0000 7f473bea4700 1 -- 172.21.15.19:0/179790033 wait complete. 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.610+0000 7f473bea4700 1 Processor -- start 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.610+0000 7f473bea4700 1 -- start start 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.610+0000 7f473bea4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.610+0000 7f473bea4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f473409e930 0x7f473411dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473bea4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 0x7f473411e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473bea4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473411f440 con 0x7f473409e930 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473bea4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473411f250 con 0x7f47341338a0 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473bea4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4734120100 con 0x7f473409de50 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45638/0 (socket says 172.21.15.19:45638) 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 -- 172.21.15.19:0/2269493658 learned_addr learned my addr 172.21.15.19:0/2269493658 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473943f700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f473409e930 0x7f473411dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473a441700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 0x7f473411e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 -- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 msgr2=0x7f473411e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 0x7f473411e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 -- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f473409e930 msgr2=0x7f473411dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f473409e930 0x7f473411dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f4739c40700 1 -- 172.21.15.19:0/2269493658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009a70 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.611+0000 7f473a441700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 0x7f473411e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.612+0000 7f4739c40700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47300090b0 tx=0x7f4730004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.612+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300045d0 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.612+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473001f070 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.612+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47300094a0 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.612+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47340a0d70 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.613+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47300038c0 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.613+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f4730003a20 con 0x7f473409de50 2023-10-03T10:14:18.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.613+0000 7f473943f700 1 -- 172.21.15.19:0/2269493658 >> v1:172.21.15.19:6816/126819 conn(0x7f471802f510 legacy=0x7f47180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.613+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f4730021070 con 0x7f473409de50 2023-10-03T10:14:18.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.614+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c0052e0 con 0x7f473409de50 2023-10-03T10:14:18.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.619+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4730015020 con 0x7f473409de50 2023-10-03T10:14:18.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 Processor -- start 2023-10-03T10:14:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 -- start start 2023-10-03T10:14:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e406f5d0 0x7fe7e412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 0x7fe7e4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e406fa40 con 0x7fe7e412cf60 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e412cd90 con 0x7fe7e406f5d0 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.650+0000 7fe7e89c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4071780 con 0x7fe7e4135c20 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 0x7fe7e4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7e412cf60 0x7fe7e412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50532/0 (socket says 172.21.15.19:50532) 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e259c700 1 -- 172.21.15.19:0/668374756 learned_addr learned my addr 172.21.15.19:0/668374756 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:18.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e1d9b700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e406f5d0 0x7fe7e412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e159a700 1 -- 172.21.15.19:0/668374756 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667402055 0 0) 0x7fe7e406fa40 con 0x7fe7e412cf60 2023-10-03T10:14:18.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e159a700 1 -- 172.21.15.19:0/668374756 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7cc0035b0 con 0x7fe7e412cf60 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 -- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e406f5d0 msgr2=0x7fe7e412ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e406f5d0 0x7fe7e412ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 -- 172.21.15.19:0/668374756 >> v1:172.21.15.19:6789/0 conn(0x7fe7e412cf60 legacy=0x7fe7e412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 -- 172.21.15.19:0/668374756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e4071a40 con 0x7fe7e4135c20 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.651+0000 7fe7e2d9d700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 0x7fe7e4138000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00d050 tx=0x7fe7dc00d360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13132d20d3a343c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.652+0000 7fe7e159a700 1 -- 172.21.15.19:0/668374756 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc010070 con 0x7fe7e4135c20 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.652+0000 7fe7e159a700 1 -- 172.21.15.19:0/668374756 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc00b2e0 con 0x7fe7e4135c20 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.652+0000 7fe7e159a700 1 -- 172.21.15.19:0/668374756 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc00dc60 con 0x7fe7e4135c20 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.652+0000 7fe7e89c7700 1 -- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 msgr2=0x7fe7e4138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.652+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 0x7fe7e4138000 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00d050 tx=0x7fe7dc00d360 comp rx=0 tx=0).stop 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 -- 172.21.15.19:0/668374756 shutdown_connections 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e4135c20 0x7fe7e4138000 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/668374756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e406f5d0 0x7fe7e412ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 -- 172.21.15.19:0/668374756 >> 172.21.15.19:0/668374756 conn(0x7fe7e40a2aa0 msgr2=0x7fe7e40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 -- 172.21.15.19:0/668374756 shutdown_connections 2023-10-03T10:14:18.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.653+0000 7fe7e89c7700 1 -- 172.21.15.19:0/668374756 wait complete. 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 Processor -- start 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 -- start start 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e406f5d0 0x7fe7e409ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e4135c20 0x7fe7e41c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e40a2230 con 0x7fe7e406f5d0 2023-10-03T10:14:18.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e409c4e0 con 0x7fe7e4135c20 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.654+0000 7fe7e89c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e409b550 con 0x7fe7e412cf60 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45650/0 (socket says 172.21.15.19:45650) 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 -- 172.21.15.19:0/688858613 learned_addr learned my addr 172.21.15.19:0/688858613 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e2d9d700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e4135c20 0x7fe7e41c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e259c700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e406f5d0 0x7fe7e409ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 -- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e4135c20 msgr2=0x7fe7e41c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e4135c20 0x7fe7e41c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 -- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e406f5d0 msgr2=0x7fe7e409ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e406f5d0 0x7fe7e409ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 -- 172.21.15.19:0/688858613 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc00bc80 con 0x7fe7e412cf60 2023-10-03T10:14:18.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7e1d9b700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e9e0 tx=0x7fe7d800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.655+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8009710 con 0x7fe7e412cf60 2023-10-03T10:14:18.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.656+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800c850 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.656+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800cbc0 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.656+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e409b7d0 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.656+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e409e840 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.657+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe7d800cd20 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.657+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e4074ea0 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.657+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe7d803fc50 con 0x7fe7e412cf60 2023-10-03T10:14:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.657+0000 7fe7e259c700 1 -- 172.21.15.19:0/688858613 >> v1:172.21.15.19:6816/126819 conn(0x7fe7c402f510 legacy=0x7fe7c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.667+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7d8021080 con 0x7fe7e412cf60 2023-10-03T10:14:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.690+0000 7f215539e700 1 Processor -- start 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.690+0000 7f215539e700 1 -- start start 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f215539e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215006e570 0x7f215006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f215539e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215009eca0 0x7f215006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f215539e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2150070ee0 con 0x7f2150134610 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f215539e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2150071480 con 0x7f215006e570 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f215539e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f215006f3c0 con 0x7f215009eca0 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f214f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2150134610 0x7f2150134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50546/0 (socket says 172.21.15.19:50546) 2023-10-03T10:14:18.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f214f7fe700 1 -- 172.21.15.19:0/1673501109 learned_addr learned my addr 172.21.15.19:0/1673501109 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215009eca0 0x7f215006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.691+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643424195 0 0) 0x7f2150070ee0 con 0x7f2150134610 2023-10-03T10:14:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21380035b0 con 0x7f2150134610 2023-10-03T10:14:18.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214effd700 1 --2- 172.21.15.19:0/1673501109 >> v2:172.21.15.19:3300/0 conn(0x7f215006e570 0x7f215006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2848204398 0 0) 0x7f21380035b0 con 0x7f2150134610 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215009eca0 msgr2=0x7f215006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215009eca0 0x7f215006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 >> v2:172.21.15.19:3300/0 conn(0x7f215006e570 msgr2=0x7f215006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 --2- 172.21.15.19:0/1673501109 >> v2:172.21.15.19:3300/0 conn(0x7f215006e570 0x7f215006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150071b90 con 0x7f2150134610 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f21480019f0 con 0x7f2150134610 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 >> v1:172.21.15.19:6789/0 conn(0x7f2150134610 legacy=0x7f2150134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2138003a00 0x7f2138003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2138004430 0x7f21380048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004f10 0x7f213800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150071480 con 0x7f2138003a00 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215006f3c0 con 0x7f2138004f10 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f213800bf50 con 0x7f2138004430 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215009eca0 0x7f215006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2138004430 0x7f21380048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214f7fe700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004f10 0x7f213800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.692+0000 7f214effd700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2138003a00 0x7f2138003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 -- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004f10 msgr2=0x7f213800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004f10 0x7f213800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 -- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2138003a00 msgr2=0x7f2138003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2138003a00 0x7f2138003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 -- 172.21.15.19:0/1673501109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21380035b0 con 0x7f2138004430 2023-10-03T10:14:18.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214e7fc700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2138004430 0x7f21380048f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f215006b700 tx=0x7f2138005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58762d128b3ae02f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004030 con 0x7f2138004430 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144004190 con 0x7f2138004430 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.693+0000 7f214dffb700 1 -- 172.21.15.19:0/1673501109 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004520 con 0x7f2138004430 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 -- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2138004430 msgr2=0x7f21380048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 --2- 172.21.15.19:0/1673501109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2138004430 0x7f21380048f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f215006b700 tx=0x7f2138005880 comp rx=0 tx=0).stop 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f214f7fe700 1 -- 172.21.15.19:0/1673501109 reap_dead start 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 -- 172.21.15.19:0/1673501109 shutdown_connections 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 -- 172.21.15.19:0/1673501109 >> 172.21.15.19:0/1673501109 conn(0x7f21500a2aa0 msgr2=0x7f21500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 -- 172.21.15.19:0/1673501109 shutdown_connections 2023-10-03T10:14:18.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.694+0000 7f215539e700 1 -- 172.21.15.19:0/1673501109 wait complete. 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.696+0000 7f215539e700 1 Processor -- start 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.696+0000 7f215539e700 1 -- start start 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.696+0000 7f215539e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f215539e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150121a20 0x7f2150121e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f215539e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 0x7f21501d3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f215539e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2150122390 con 0x7f2150121a20 2023-10-03T10:14:18.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f215539e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2150122a90 con 0x7f2138004430 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f215539e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2150124980 con 0x7f21501d0ca0 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 0x7f21501d3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44168/0 (socket says 172.21.15.19:44168) 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 0x7f21501d3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45680/0 (socket says 172.21.15.19:45680) 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 -- 172.21.15.19:0/747392776 learned_addr learned my addr 172.21.15.19:0/747392776 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214e7fc700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150121a20 0x7f2150121e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 -- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 msgr2=0x7f21501d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 0x7f21501d3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 -- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150121a20 msgr2=0x7f2150121e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150121a20 0x7f2150121e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 -- 172.21.15.19:0/747392776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150123d30 con 0x7f2138004430 2023-10-03T10:14:18.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.697+0000 7f214effd700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21400108c0 tx=0x7f2140010bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.698+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140016670 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.698+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400167d0 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.698+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140016b60 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.698+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21500a2180 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.698+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21501246a0 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.699+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2140016cc0 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.699+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215009b1e0 con 0x7f2138004430 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.699+0000 7f214e7fc700 1 -- 172.21.15.19:0/747392776 >> v1:172.21.15.19:6816/126819 conn(0x7f213c02f510 legacy=0x7f213c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.699+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f21400419b0 con 0x7f2138004430 2023-10-03T10:14:18.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.704+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2140045060 con 0x7f2138004430 2023-10-03T10:14:18.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.764+0000 7f7233fff700 1 -- 172.21.15.19:0/1113652626 >> v1:172.21.15.19:6816/126819 conn(0x7f721802f510 legacy=0x7f72180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.785+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f723406b9e0 con 0x7f723409e390 2023-10-03T10:14:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.785+0000 7f72317fa700 1 -- 172.21.15.19:0/1113652626 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7228017070 con 0x7f723409e390 2023-10-03T10:14:18.785 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 >> v1:172.21.15.19:6816/126819 conn(0x7f721802f510 legacy=0x7f72180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 msgr2=0x7f723411a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f722800e9e0 tx=0x7f722800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 shutdown_connections 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72341341d0 0x7f723411aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f723409e390 0x7f723411a570 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 --2- 172.21.15.19:0/1113652626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72341338c0 0x7f723411aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 >> 172.21.15.19:0/1113652626 conn(0x7f72340a2aa0 msgr2=0x7f723412f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.787+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 shutdown_connections 2023-10-03T10:14:18.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.788+0000 7f723b069700 1 -- 172.21.15.19:0/1113652626 wait complete. 2023-10-03T10:14:18.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:18.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.815+0000 7f473943f700 1 -- 172.21.15.19:0/2269493658 >> v1:172.21.15.19:6816/126819 conn(0x7f471802f510 legacy=0x7f47180319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.841+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f471c005860 con 0x7f473409de50 2023-10-03T10:14:18.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.841+0000 7f472a7fc700 1 -- 172.21.15.19:0/2269493658 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4730024380 con 0x7f473409de50 2023-10-03T10:14:18.841 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:18.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 >> v1:172.21.15.19:6816/126819 conn(0x7f471802f510 legacy=0x7f47180319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:18.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 msgr2=0x7f473411d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47300090b0 tx=0x7f4730004750 comp rx=0 tx=0).stop 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 shutdown_connections 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47341338a0 0x7f473411e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f473409de50 0x7f473411d820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 --2- 172.21.15.19:0/2269493658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f473409e930 0x7f473411dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 >> 172.21.15.19:0/2269493658 conn(0x7f47340a2aa0 msgr2=0x7f47341bad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 shutdown_connections 2023-10-03T10:14:18.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.843+0000 7f473bea4700 1 -- 172.21.15.19:0/2269493658 wait complete. 2023-10-03T10:14:18.857 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.858+0000 7fe7e259c700 1 -- 172.21.15.19:0/688858613 >> v1:172.21.15.19:6816/126819 conn(0x7fe7c402f510 legacy=0x7fe7c40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.900+0000 7f214e7fc700 1 -- 172.21.15.19:0/747392776 >> v1:172.21.15.19:6816/126819 conn(0x7f213c02f510 legacy=0x7f213c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:18.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.940+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7e409d880 con 0x7fe7e412cf60 2023-10-03T10:14:18.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.940+0000 7fe7d2ffd700 1 -- 172.21.15.19:0/688858613 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7d8017020 con 0x7fe7e412cf60 2023-10-03T10:14:18.940 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 >> v1:172.21.15.19:6816/126819 conn(0x7fe7c402f510 legacy=0x7fe7c40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 msgr2=0x7fe7e409bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e9e0 tx=0x7fe7d800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 shutdown_connections 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e4135c20 0x7fe7e41c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e406f5d0 0x7fe7e409ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 --2- 172.21.15.19:0/688858613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e412cf60 0x7fe7e409bfa0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 >> 172.21.15.19:0/688858613 conn(0x7fe7e40a2aa0 msgr2=0x7fe7e41bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 shutdown_connections 2023-10-03T10:14:18.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.943+0000 7fe7e89c7700 1 -- 172.21.15.19:0/688858613 wait complete. 2023-10-03T10:14:18.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:18.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.978+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2150074ea0 con 0x7f2138004430 2023-10-03T10:14:18.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.978+0000 7f21377fe700 1 -- 172.21.15.19:0/747392776 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f214001ee10 con 0x7f2138004430 2023-10-03T10:14:18.978 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.980+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 >> v1:172.21.15.19:6816/126819 conn(0x7f213c02f510 legacy=0x7f213c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 msgr2=0x7f21501214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f21400108c0 tx=0x7f2140010bd0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 shutdown_connections 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21501d0ca0 0x7f21501d3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2138004430 0x7f21501214e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 --2- 172.21.15.19:0/747392776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2150121a20 0x7f2150121e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 >> 172.21.15.19:0/747392776 conn(0x7f21500a2aa0 msgr2=0x7f21501bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 shutdown_connections 2023-10-03T10:14:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:18.981+0000 7f215539e700 1 -- 172.21.15.19:0/747392776 wait complete. 2023-10-03T10:14:18.994 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:19.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:19.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.953+0000 7ffa7445f700 1 Processor -- start 2023-10-03T10:14:19.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.953+0000 7ffa7445f700 1 -- start start 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa7445f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 0x7ffa6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa7445f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d630 0x7ffa6c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa7445f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0a2a70 con 0x7ffa6c133930 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa7445f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c0a01d0 con 0x7ffa6c09d630 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa7445f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c09e2b0 con 0x7ffa6c0a0a30 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d630 0x7ffa6c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa721fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 0x7ffa6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d630 0x7ffa6c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59908/0 (socket says 172.21.15.19:59908) 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa729fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffa6c133930 0x7ffa6c133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50556/0 (socket says 172.21.15.19:50556) 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 -- 172.21.15.19:0/923216818 learned_addr learned my addr 172.21.15.19:0/923216818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 -- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 msgr2=0x7ffa6c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 0x7ffa6c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 -- 172.21.15.19:0/923216818 >> v1:172.21.15.19:6789/0 conn(0x7ffa6c133930 legacy=0x7ffa6c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa719fa700 1 -- 172.21.15.19:0/923216818 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c09dc50 con 0x7ffa6c09d630 2023-10-03T10:14:19.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.954+0000 7ffa721fb700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 0x7ffa6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa719fa700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c0a1340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098f0 tx=0x7ffa5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95893ebc74eff78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa711f9700 1 -- 172.21.15.19:0/923216818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c011830 con 0x7ffa6c09d630 2023-10-03T10:14:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa711f9700 1 -- 172.21.15.19:0/923216818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c011990 con 0x7ffa6c09d630 2023-10-03T10:14:19.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa711f9700 1 -- 172.21.15.19:0/923216818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c011d20 con 0x7ffa6c09d630 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa7445f700 1 -- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 msgr2=0x7ffa6c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.955+0000 7ffa7445f700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c0a1340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0098f0 tx=0x7ffa5c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 -- 172.21.15.19:0/923216818 shutdown_connections 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c0a0a30 0x7ffa6c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 --2- 172.21.15.19:0/923216818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c0a1340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 -- 172.21.15.19:0/923216818 >> 172.21.15.19:0/923216818 conn(0x7ffa6c0a3050 msgr2=0x7ffa6c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 -- 172.21.15.19:0/923216818 shutdown_connections 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.956+0000 7ffa7445f700 1 -- 172.21.15.19:0/923216818 wait complete. 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 Processor -- start 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 -- start start 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c1c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:19.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c120a70 con 0x7ffa6c09d630 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c120880 con 0x7ffa6c133930 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa7445f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c121920 con 0x7ffa6c0a0a30 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa729fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa719fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa719fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45688/0 (socket says 172.21.15.19:45688) 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa729fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44186/0 (socket says 172.21.15.19:44186) 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa719fa700 1 -- 172.21.15.19:0/3138998331 learned_addr learned my addr 172.21.15.19:0/3138998331 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.957+0000 7ffa721fb700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c1c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:19.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 -- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 msgr2=0x7ffa6c1c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 -- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 msgr2=0x7ffa6c1c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c1c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 -- 172.21.15.19:0/3138998331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa680094a0 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa721fb700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa719fa700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa729fc700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cb10 tx=0x7ffa6400ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400a9e0 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400ab40 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c009550 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64007070 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.958+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c1224b0 con 0x7ffa6c133930 2023-10-03T10:14:19.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.959+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ffa640071d0 con 0x7ffa6c133930 2023-10-03T10:14:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.959+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c121e90 con 0x7ffa6c133930 2023-10-03T10:14:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.959+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ffa6403f7c0 con 0x7ffa6c133930 2023-10-03T10:14:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.959+0000 7ffa721fb700 1 -- 172.21.15.19:0/3138998331 >> v1:172.21.15.19:6816/126819 conn(0x7ffa5002f510 legacy=0x7ffa500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:19.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:19.964+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa64017020 con 0x7ffa6c133930 2023-10-03T10:14:19.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.004+0000 7f2d86d4a700 1 Processor -- start 2023-10-03T10:14:20.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.004+0000 7f2d86d4a700 1 -- start start 2023-10-03T10:14:20.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d86d4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80131810 0x7f2d80131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d86d4a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d80139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d86d4a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d801313c0 con 0x7f2d80099a40 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d86d4a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8006e8c0 con 0x7f2d80131810 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d86d4a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d80071d20 con 0x7f2d8009a580 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d7ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2d80099a40 0x7f2d80099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50570/0 (socket says 172.21.15.19:50570) 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d7ffff700 1 -- 172.21.15.19:0/3071576759 learned_addr learned my addr 172.21.15.19:0/3071576759 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d84ae6700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80131810 0x7f2d80131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.005+0000 7f2d852e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d80139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d852e7700 1 -- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80131810 msgr2=0x7f2d80131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d852e7700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80131810 0x7f2d80131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d852e7700 1 -- 172.21.15.19:0/3071576759 >> v1:172.21.15.19:6789/0 conn(0x7f2d80099a40 legacy=0x7f2d80099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d7f7fe700 1 -- 172.21.15.19:0/3071576759 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725688256 0 0) 0x7f2d801313c0 con 0x7f2d80099a40 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d852e7700 1 -- 172.21.15.19:0/3071576759 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800721a0 con 0x7f2d8009a580 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d852e7700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d80139660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009dc0 tx=0x7f2d7800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a21ead6f8fa0e437 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d7f7fe700 1 -- 172.21.15.19:0/3071576759 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800e070 con 0x7f2d8009a580 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d7f7fe700 1 -- 172.21.15.19:0/3071576759 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800bb20 con 0x7f2d8009a580 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.006+0000 7f2d7f7fe700 1 -- 172.21.15.19:0/3071576759 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78012430 con 0x7f2d8009a580 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 -- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 msgr2=0x7f2d80139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d80139660 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009dc0 tx=0x7f2d7800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 -- 172.21.15.19:0/3071576759 shutdown_connections 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d80139660 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/3071576759 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80131810 0x7f2d80131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 -- 172.21.15.19:0/3071576759 >> 172.21.15.19:0/3071576759 conn(0x7f2d800a2aa0 msgr2=0x7f2d800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 -- 172.21.15.19:0/3071576759 shutdown_connections 2023-10-03T10:14:20.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.007+0000 7f2d86d4a700 1 -- 172.21.15.19:0/3071576759 wait complete. 2023-10-03T10:14:20.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.009+0000 7f2d86d4a700 1 Processor -- start 2023-10-03T10:14:20.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.009+0000 7f2d86d4a700 1 -- start start 2023-10-03T10:14:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80099a40 0x7f2d8011d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d8011d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8011f100 con 0x7f2d80131810 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8006eb00 con 0x7f2d80099a40 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d86d4a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d800a1b60 con 0x7f2d8009a580 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d852e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d852e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59914/0 (socket says 172.21.15.19:59914) 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d852e7700 1 -- 172.21.15.19:0/2356517549 learned_addr learned my addr 172.21.15.19:0/2356517549 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d7ffff700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d8011d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.010+0000 7f2d84ae6700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80099a40 0x7f2d8011d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 -- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 msgr2=0x7f2d8011d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d8011d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 -- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80099a40 msgr2=0x7f2d8011d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80099a40 0x7f2d8011d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 -- 172.21.15.19:0/2356517549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009a70 con 0x7f2d80131810 2023-10-03T10:14:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d852e7700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d78014040 tx=0x7f2d78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78012430 con 0x7f2d80131810 2023-10-03T10:14:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d78020070 con 0x7f2d80131810 2023-10-03T10:14:20.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.011+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78004280 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.012+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8011f6c0 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.012+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d801204d0 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.013+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f2d780043e0 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.013+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d80074ea0 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.013+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f2d78022070 con 0x7f2d80131810 2023-10-03T10:14:20.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.013+0000 7f2d84ae6700 1 -- 172.21.15.19:0/2356517549 >> v1:172.21.15.19:6816/126819 conn(0x7f2d6402f510 legacy=0x7f2d640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.020+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d7801b400 con 0x7f2d80131810 2023-10-03T10:14:20.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.109+0000 7efe30d8e700 1 Processor -- start 2023-10-03T10:14:20.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.109+0000 7efe30d8e700 1 -- start start 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe30d8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe2c09d6d0 0x7efe2c09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe30d8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c13ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe30d8e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c09a570 con 0x7efe2c09dfe0 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe30d8e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c09b1c0 con 0x7efe2c09d6d0 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe30d8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c09f240 con 0x7efe2c133cd0 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe29d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efe2c09dfe0 0x7efe2c1335c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50574/0 (socket says 172.21.15.19:50574) 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe29d9b700 1 -- 172.21.15.19:0/646052330 learned_addr learned my addr 172.21.15.19:0/646052330 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:20.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/646052330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c13ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe2a59c700 1 --2- 172.21.15.19:0/646052330 >> v2:172.21.15.19:3300/0 conn(0x7efe2c09d6d0 0x7efe2c09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe2959a700 1 -- 172.21.15.19:0/646052330 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171981637 0 0) 0x7efe2c09a570 con 0x7efe2c09dfe0 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe2959a700 1 -- 172.21.15.19:0/646052330 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe140035b0 con 0x7efe2c09dfe0 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.110+0000 7efe2ad9d700 1 -- 172.21.15.19:0/646052330 >> v2:172.21.15.19:3300/0 conn(0x7efe2c09d6d0 msgr2=0x7efe2c09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/646052330 >> v2:172.21.15.19:3300/0 conn(0x7efe2c09d6d0 0x7efe2c09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2ad9d700 1 -- 172.21.15.19:0/646052330 >> v1:172.21.15.19:6789/0 conn(0x7efe2c09dfe0 legacy=0x7efe2c1335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2ad9d700 1 -- 172.21.15.19:0/646052330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c09a2d0 con 0x7efe2c133cd0 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/646052330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c13ba30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe24009d90 tx=0x7efe2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffca90f598bfa1a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2959a700 1 -- 172.21.15.19:0/646052330 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400e070 con 0x7efe2c133cd0 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2959a700 1 -- 172.21.15.19:0/646052330 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400bb20 con 0x7efe2c133cd0 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.111+0000 7efe2959a700 1 -- 172.21.15.19:0/646052330 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24012430 con 0x7efe2c133cd0 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 -- 172.21.15.19:0/646052330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 msgr2=0x7efe2c13ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 --2- 172.21.15.19:0/646052330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c13ba30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efe24009d90 tx=0x7efe2400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 -- 172.21.15.19:0/646052330 shutdown_connections 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 --2- 172.21.15.19:0/646052330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c13ba30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 --2- 172.21.15.19:0/646052330 >> v2:172.21.15.19:3300/0 conn(0x7efe2c09d6d0 0x7efe2c09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 -- 172.21.15.19:0/646052330 >> 172.21.15.19:0/646052330 conn(0x7efe2c099c20 msgr2=0x7efe2c0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 -- 172.21.15.19:0/646052330 shutdown_connections 2023-10-03T10:14:20.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.112+0000 7efe30d8e700 1 -- 172.21.15.19:0/646052330 wait complete. 2023-10-03T10:14:20.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 Processor -- start 2023-10-03T10:14:20.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 -- start start 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 0x7efe2c1d5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c1d5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.114+0000 7efe30d8e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c11e400 con 0x7efe2c09dfe0 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe30d8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c11c7d0 con 0x7efe2c09d6d0 2023-10-03T10:14:20.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe30d8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c09c900 con 0x7efe2c133cd0 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c1d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44214/0 (socket says 172.21.15.19:44214) 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2a59c700 1 -- 172.21.15.19:0/2976471226 learned_addr learned my addr 172.21.15.19:0/2976471226 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe29d9b700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 0x7efe2c1d5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 -- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 msgr2=0x7efe2c1d4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 -- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 msgr2=0x7efe2c1d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 0x7efe2c1d5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 -- 172.21.15.19:0/2976471226 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24009a70 con 0x7efe2c133cd0 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe29d9b700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 0x7efe2c1d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2a59c700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.115+0000 7efe2ad9d700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c1d5690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe24016000 tx=0x7efe24004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.116+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24012e50 con 0x7efe2c133cd0 2023-10-03T10:14:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.116+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24020070 con 0x7efe2c133cd0 2023-10-03T10:14:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.116+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24004280 con 0x7efe2c133cd0 2023-10-03T10:14:20.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.116+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c11e140 con 0x7efe2c133cd0 2023-10-03T10:14:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.116+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c11ee70 con 0x7efe2c133cd0 2023-10-03T10:14:20.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.117+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c11e5b0 con 0x7efe2c133cd0 2023-10-03T10:14:20.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.121+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7efe240043e0 con 0x7efe2c133cd0 2023-10-03T10:14:20.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.122+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7efe24022070 con 0x7efe2c133cd0 2023-10-03T10:14:20.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.122+0000 7efe2a59c700 1 -- 172.21.15.19:0/2976471226 >> v1:172.21.15.19:6816/126819 conn(0x7efe0c02f510 legacy=0x7efe0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.126+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe2401a380 con 0x7efe2c133cd0 2023-10-03T10:14:20.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.152+0000 7fad93439700 1 Processor -- start 2023-10-03T10:14:20.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.152+0000 7fad93439700 1 -- start start 2023-10-03T10:14:20.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.152+0000 7fad93439700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.152+0000 7fad93439700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad93439700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c09ece0 con 0x7fad8c06b080 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad93439700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c09e760 con 0x7fad8c06a770 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45728/0 (socket says 172.21.15.19:45728) 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad93439700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c09e040 con 0x7fad8c131d10 2023-10-03T10:14:20.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 -- 172.21.15.19:0/2184999876 learned_addr learned my addr 172.21.15.19:0/2184999876 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:20.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad911d5700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 -- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 msgr2=0x7fad8c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 -- 172.21.15.19:0/2184999876 >> v1:172.21.15.19:6789/0 conn(0x7fad8c06b080 legacy=0x7fad8c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 -- 172.21.15.19:0/2184999876 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c09f630 con 0x7fad8c131d10 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad911d5700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.153+0000 7fad919d6700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e80 tx=0x7fad8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed16517df42acdc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad83fff700 1 -- 172.21.15.19:0/2184999876 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400e070 con 0x7fad8c131d10 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad83fff700 1 -- 172.21.15.19:0/2184999876 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400b9c0 con 0x7fad8c131d10 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad83fff700 1 -- 172.21.15.19:0/2184999876 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400bd70 con 0x7fad8c131d10 2023-10-03T10:14:20.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 -- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 msgr2=0x7fad8c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e80 tx=0x7fad8400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 -- 172.21.15.19:0/2184999876 shutdown_connections 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c131d10 0x7fad8c139860 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 --2- 172.21.15.19:0/2184999876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 -- 172.21.15.19:0/2184999876 >> 172.21.15.19:0/2184999876 conn(0x7fad8c066f50 msgr2=0x7fad8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 -- 172.21.15.19:0/2184999876 shutdown_connections 2023-10-03T10:14:20.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.154+0000 7fad93439700 1 -- 172.21.15.19:0/2184999876 wait complete. 2023-10-03T10:14:20.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.156+0000 7fad93439700 1 Processor -- start 2023-10-03T10:14:20.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.156+0000 7fad93439700 1 -- start start 2023-10-03T10:14:20.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.156+0000 7fad93439700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.156+0000 7fad93439700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c06b080 0x7fad8c09b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad93439700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad93439700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c09b810 con 0x7fad8c131d10 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad93439700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c125f60 con 0x7fad8c06a770 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad93439700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c131520 con 0x7fad8c06b080 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad919d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44230/0 (socket says 172.21.15.19:44230) 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad919d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59942/0 (socket says 172.21.15.19:59942) 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 -- 172.21.15.19:0/25448532 learned_addr learned my addr 172.21.15.19:0/25448532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad909d4700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c06b080 0x7fad8c09b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 -- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c06b080 msgr2=0x7fad8c09b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c06b080 0x7fad8c09b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 -- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 msgr2=0x7fad8c1c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 -- 172.21.15.19:0/25448532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009b30 con 0x7fad8c06a770 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad919d6700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.157+0000 7fad911d5700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c750 tx=0x7fad8800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.158+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011800 con 0x7fad8c06a770 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.158+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88011960 con 0x7fad8c06a770 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.158+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c09c070 con 0x7fad8c06a770 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.158+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011cd0 con 0x7fad8c06a770 2023-10-03T10:14:20.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.158+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c126740 con 0x7fad8c06a770 2023-10-03T10:14:20.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.159+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c074ea0 con 0x7fad8c06a770 2023-10-03T10:14:20.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.159+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fad88021350 con 0x7fad8c06a770 2023-10-03T10:14:20.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.161+0000 7ffa721fb700 1 -- 172.21.15.19:0/3138998331 >> v1:172.21.15.19:6816/126819 conn(0x7ffa5002f510 legacy=0x7ffa500319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.160+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fad8803fb70 con 0x7fad8c06a770 2023-10-03T10:14:20.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.160+0000 7fad909d4700 1 -- 172.21.15.19:0/25448532 >> v1:172.21.15.19:6816/126819 conn(0x7fad7002f510 legacy=0x7fad700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.169+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad88011e30 con 0x7fad8c06a770 2023-10-03T10:14:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.182+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffa6c074770 con 0x7ffa6c133930 2023-10-03T10:14:20.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.182+0000 7ffa62ffd700 1 -- 172.21.15.19:0/3138998331 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa6401b3b0 con 0x7ffa6c133930 2023-10-03T10:14:20.182 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 >> v1:172.21.15.19:6816/126819 conn(0x7ffa5002f510 legacy=0x7ffa500319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 msgr2=0x7ffa6c1c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400cb10 tx=0x7ffa6400ce20 comp rx=0 tx=0).stop 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 shutdown_connections 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c133930 0x7ffa6c1c8d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d630 0x7ffa6c1c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 --2- 172.21.15.19:0/3138998331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c0a0a30 0x7ffa6c1c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 >> 172.21.15.19:0/3138998331 conn(0x7ffa6c0a3050 msgr2=0x7ffa6c1bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 shutdown_connections 2023-10-03T10:14:20.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.186+0000 7ffa7445f700 1 -- 172.21.15.19:0/3138998331 wait complete. 2023-10-03T10:14:20.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:20.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.215+0000 7f2d84ae6700 1 -- 172.21.15.19:0/2356517549 >> v1:172.21.15.19:6816/126819 conn(0x7f2d6402f510 legacy=0x7f2d640319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.233+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d8006b9e0 con 0x7f2d80131810 2023-10-03T10:14:20.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.233+0000 7f2d7d7fa700 1 -- 172.21.15.19:0/2356517549 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d7802c090 con 0x7f2d80131810 2023-10-03T10:14:20.233 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 >> v1:172.21.15.19:6816/126819 conn(0x7f2d6402f510 legacy=0x7f2d640319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 msgr2=0x7f2d8011db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d78014040 tx=0x7f2d78004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 shutdown_connections 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d80131810 0x7f2d8011db60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d80099a40 0x7f2d8011d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 --2- 172.21.15.19:0/2356517549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8009a580 0x7f2d8011d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 >> 172.21.15.19:0/2356517549 conn(0x7f2d800a2aa0 msgr2=0x7f2d8012fdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 shutdown_connections 2023-10-03T10:14:20.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.237+0000 7f2d86d4a700 1 -- 172.21.15.19:0/2356517549 wait complete. 2023-10-03T10:14:20.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:20.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.323+0000 7efe2a59c700 1 -- 172.21.15.19:0/2976471226 >> v1:172.21.15.19:6816/126819 conn(0x7efe0c02f510 legacy=0x7efe0c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.361+0000 7fad909d4700 1 -- 172.21.15.19:0/25448532 >> v1:172.21.15.19:6816/126819 conn(0x7fad7002f510 legacy=0x7fad700319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.365+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efe2c11e5b0 con 0x7efe2c133cd0 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.366+0000 7efe1affd700 1 -- 172.21.15.19:0/2976471226 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe2c11e5b0 con 0x7efe2c133cd0 2023-10-03T10:14:20.365 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 >> v1:172.21.15.19:6816/126819 conn(0x7efe0c02f510 legacy=0x7efe0c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 msgr2=0x7efe2c1d5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c1d5690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efe24016000 tx=0x7efe24004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 shutdown_connections 2023-10-03T10:14:20.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe2c133cd0 0x7efe2c1d5690 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe2c09d6d0 0x7efe2c1d4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 --2- 172.21.15.19:0/2976471226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe2c09dfe0 0x7efe2c1d5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 >> 172.21.15.19:0/2976471226 conn(0x7efe2c099c20 msgr2=0x7efe2c1bab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 shutdown_connections 2023-10-03T10:14:20.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.368+0000 7efe30d8e700 1 -- 172.21.15.19:0/2976471226 wait complete. 2023-10-03T10:14:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.377+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad8c06c360 con 0x7fad8c06a770 2023-10-03T10:14:20.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.377+0000 7fad81ffb700 1 -- 172.21.15.19:0/25448532 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad8800eae0 con 0x7fad8c06a770 2023-10-03T10:14:20.377 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 >> v1:172.21.15.19:6816/126819 conn(0x7fad7002f510 legacy=0x7fad700319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 msgr2=0x7fad8c09ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c750 tx=0x7fad8800ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 shutdown_connections 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad8c131d10 0x7fad8c1c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad8c06a770 0x7fad8c09ad90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 --2- 172.21.15.19:0/25448532 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad8c06b080 0x7fad8c09b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 >> 172.21.15.19:0/25448532 conn(0x7fad8c066f50 msgr2=0x7fad8c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 shutdown_connections 2023-10-03T10:14:20.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:20.380+0000 7fad93439700 1 -- 172.21.15.19:0/25448532 wait complete. 2023-10-03T10:14:20.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:20.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:21.205 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:21.257 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:21.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.353+0000 7f9e2359c700 1 Processor -- start 2023-10-03T10:14:21.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.353+0000 7f9e2359c700 1 -- start start 2023-10-03T10:14:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e2359c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e2359c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e2359c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1c09edd0 con 0x7f9e1c133fa0 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e2359c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e1c09e1f0 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e2359c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c09dc50 con 0x7f9e1c0a1340 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e20b37700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e20b37700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45742/0 (socket says 172.21.15.19:45742) 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59950/0 (socket says 172.21.15.19:59950) 2023-10-03T10:14:21.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e20b37700 1 -- 172.21.15.19:0/1332690304 learned_addr learned my addr 172.21.15.19:0/1332690304 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21b39700 1 --1- 172.21.15.19:0/1332690304 >> v1:172.21.15.19:6789/0 conn(0x7f9e1c133fa0 0x7f9e1c13ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50594/0 (socket says 172.21.15.19:50594) 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 -- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 msgr2=0x7f9e1c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 -- 172.21.15.19:0/1332690304 >> v1:172.21.15.19:6789/0 conn(0x7f9e1c133fa0 legacy=0x7f9e1c13ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 -- 172.21.15.19:0/1332690304 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1c0a1fe0 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e13fff700 1 -- 172.21.15.19:0/1332690304 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638605276 0 0) 0x7f9e1c09edd0 con 0x7f9e1c133fa0 2023-10-03T10:14:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e20b37700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.354+0000 7f9e21338700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24eccee65a5429a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e13fff700 1 -- 172.21.15.19:0/1332690304 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800e070 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e13fff700 1 -- 172.21.15.19:0/1332690304 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800bb20 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e13fff700 1 -- 172.21.15.19:0/1332690304 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18012430 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 -- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 msgr2=0x7f9e1c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9e18009d90 tx=0x7f9e1800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 -- 172.21.15.19:0/1332690304 shutdown_connections 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c0a0e00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 --2- 172.21.15.19:0/1332690304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c0a1340 0x7f9e1c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 -- 172.21.15.19:0/1332690304 >> 172.21.15.19:0/1332690304 conn(0x7f9e1c0a6550 msgr2=0x7f9e1c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 -- 172.21.15.19:0/1332690304 shutdown_connections 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.355+0000 7f9e2359c700 1 -- 172.21.15.19:0/1332690304 wait complete. 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.356+0000 7f9e2359c700 1 Processor -- start 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.356+0000 7f9e2359c700 1 -- start start 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 0x7f9e1c123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c124cb0 con 0x7f9e1c0a0a30 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c125d80 con 0x7f9e1c0a1340 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e2359c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1c124520 con 0x7f9e1c133fa0 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e21338700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44240/0 (socket says 172.21.15.19:44240) 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 -- 172.21.15.19:0/490610325 learned_addr learned my addr 172.21.15.19:0/490610325 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e21338700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59956/0 (socket says 172.21.15.19:59956) 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e21b39700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 0x7f9e1c123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 -- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 msgr2=0x7f9e1c123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 0x7f9e1c123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 -- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 msgr2=0x7f9e1c122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e20b37700 1 -- 172.21.15.19:0/490610325 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c009550 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e21338700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.357+0000 7f9e21b39700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 0x7f9e1c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e20b37700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00ebe0 tx=0x7f9e0c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00c850 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00c9b0 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e18009a70 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c00cd40 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.358+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1c126040 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.359+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9e0c013470 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.359+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9e0c03fda0 con 0x7f9e1c0a1340 2023-10-03T10:14:21.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.359+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1c1333c0 con 0x7f9e1c0a1340 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.359+0000 7f9e21338700 1 -- 172.21.15.19:0/490610325 >> v1:172.21.15.19:6816/126819 conn(0x7f9e0002f510 legacy=0x7f9e000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.364+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9e0c0232f0 con 0x7f9e1c0a1340 2023-10-03T10:14:21.382 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:21.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 Processor -- start 2023-10-03T10:14:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 -- start start 2023-10-03T10:14:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e410 0x7f8b50133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5006b460 con 0x7f8b5009d6f0 2023-10-03T10:14:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5009b120 con 0x7f8b5009e000 2023-10-03T10:14:21.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b557bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5009a7e0 con 0x7f8b5009e410 2023-10-03T10:14:21.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b4e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b4f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e410 0x7f8b50133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b4e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44254/0 (socket says 172.21.15.19:44254) 2023-10-03T10:14:21.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.400+0000 7f8b4effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 -- 172.21.15.19:0/2936345746 learned_addr learned my addr 172.21.15.19:0/2936345746 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 -- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e410 msgr2=0x7f8b50133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 --2- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e410 0x7f8b50133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 -- 172.21.15.19:0/2936345746 >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 msgr2=0x7f8b5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 --2- 172.21.15.19:0/2936345746 >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 -- 172.21.15.19:0/2936345746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5009a500 con 0x7f8b5009e000 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4effd700 1 --2- 172.21.15.19:0/2936345746 >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:21.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4e7fc700 1 --2- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009920 tx=0x7f8b44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8724deba6ea42794 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4dffb700 1 -- 172.21.15.19:0/2936345746 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011830 con 0x7f8b5009e000 2023-10-03T10:14:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.401+0000 7f8b4dffb700 1 -- 172.21.15.19:0/2936345746 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44011990 con 0x7f8b5009e000 2023-10-03T10:14:21.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.402+0000 7f8b4dffb700 1 -- 172.21.15.19:0/2936345746 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44011d20 con 0x7f8b5009e000 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 -- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 msgr2=0x7f8b501339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 --2- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8b44009920 tx=0x7f8b44009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 -- 172.21.15.19:0/2936345746 shutdown_connections 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 --2- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e410 0x7f8b50133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 --2- 172.21.15.19:0/2936345746 >> v2:172.21.15.19:3300/0 conn(0x7f8b5009d6f0 0x7f8b5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 --2- 172.21.15.19:0/2936345746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009e000 0x7f8b501339f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 -- 172.21.15.19:0/2936345746 >> 172.21.15.19:0/2936345746 conn(0x7f8b50066f50 msgr2=0x7f8b5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 -- 172.21.15.19:0/2936345746 shutdown_connections 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.403+0000 7f8b557bc700 1 -- 172.21.15.19:0/2936345746 wait complete. 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.404+0000 7f8b557bc700 1 Processor -- start 2023-10-03T10:14:21.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.404+0000 7f8b557bc700 1 -- start start 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009d6f0 0x7f8b501a5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e000 0x7f8b501a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501aa1f0 con 0x7f8b5009e410 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501a7920 con 0x7f8b5009d6f0 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b557bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b501a7f40 con 0x7f8b5009e000 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59972/0 (socket says 172.21.15.19:59972) 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 -- 172.21.15.19:0/4184829883 learned_addr learned my addr 172.21.15.19:0/4184829883 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4effd700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009d6f0 0x7f8b501a5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 -- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e000 msgr2=0x7f8b501a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e000 0x7f8b501a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 -- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009d6f0 msgr2=0x7f8b501a5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009d6f0 0x7f8b501a5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.405+0000 7f8b4f7fe700 1 -- 172.21.15.19:0/4184829883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44009550 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b4f7fe700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009dd0 tx=0x7f8b4800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48009c40 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b501a71c0 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800f040 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48014480 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.406+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b500a2000 con 0x7f8b5009e410 2023-10-03T10:14:21.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.407+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b480145e0 con 0x7f8b5009e410 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.407+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8b48041da0 con 0x7f8b5009e410 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.407+0000 7f8b4effd700 1 -- 172.21.15.19:0/4184829883 >> v1:172.21.15.19:6816/126819 conn(0x7f8b3c02f510 legacy=0x7f8b3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.408+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5009c710 con 0x7f8b5009e410 2023-10-03T10:14:21.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.418+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b48018080 con 0x7f8b5009e410 2023-10-03T10:14:21.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 Processor -- start 2023-10-03T10:14:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 -- start start 2023-10-03T10:14:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f726009e410 0x7f7260134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726009b120 con 0x7f726009e000 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726006b460 con 0x7f726009e410 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.526+0000 7f7266e94700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726009a7e0 con 0x7f726009d6f0 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7265431700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f726009e410 0x7f7260134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45778/0 (socket says 172.21.15.19:45778) 2023-10-03T10:14:21.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 -- 172.21.15.19:0/432097316 learned_addr learned my addr 172.21.15.19:0/432097316 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 -- 172.21.15.19:0/432097316 >> v2:172.21.15.19:3300/0 conn(0x7f726009e410 msgr2=0x7f7260134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 --2- 172.21.15.19:0/432097316 >> v2:172.21.15.19:3300/0 conn(0x7f726009e410 0x7f7260134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 -- 172.21.15.19:0/432097316 >> v1:172.21.15.19:6789/0 conn(0x7f726009e000 legacy=0x7f72601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 -- 172.21.15.19:0/432097316 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726009a500 con 0x7f726009d6f0 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f7264c30700 1 --2- 172.21.15.19:0/432097316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7250009920 tx=0x7f7250009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef20100b877e4d3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f725f7fe700 1 -- 172.21.15.19:0/432097316 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250011830 con 0x7f726009d6f0 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f725f7fe700 1 -- 172.21.15.19:0/432097316 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250011990 con 0x7f726009d6f0 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.527+0000 7f725f7fe700 1 -- 172.21.15.19:0/432097316 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250011d20 con 0x7f726009d6f0 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 -- 172.21.15.19:0/432097316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 msgr2=0x7f726009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 --2- 172.21.15.19:0/432097316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7250009920 tx=0x7f7250009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 -- 172.21.15.19:0/432097316 shutdown_connections 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 --2- 172.21.15.19:0/432097316 >> v2:172.21.15.19:3300/0 conn(0x7f726009e410 0x7f7260134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 --2- 172.21.15.19:0/432097316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009d6f0 0x7f726009dac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 -- 172.21.15.19:0/432097316 >> 172.21.15.19:0/432097316 conn(0x7f7260066f50 msgr2=0x7f726009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 -- 172.21.15.19:0/432097316 shutdown_connections 2023-10-03T10:14:21.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.528+0000 7f7266e94700 1 -- 172.21.15.19:0/432097316 wait complete. 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.529+0000 7f7266e94700 1 Processor -- start 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.529+0000 7f7266e94700 1 -- start start 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f726009e000 0x7f72601a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 0x7f72601a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a6ad0 con 0x7f726009d6f0 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a7d20 con 0x7f726009e000 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7266e94700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72601a70c0 con 0x7f726009e410 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7265431700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 0x7f72601a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7264c30700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7265431700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 0x7f72601a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45794/0 (socket says 172.21.15.19:45794) 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7264c30700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59988/0 (socket says 172.21.15.19:59988) 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f7265431700 1 -- 172.21.15.19:0/2452763823 learned_addr learned my addr 172.21.15.19:0/2452763823 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.530+0000 7f725ffff700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f726009e000 0x7f72601a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 -- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 msgr2=0x7f72601a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 0x7f72601a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 -- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f726009e000 msgr2=0x7f72601a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f726009e000 0x7f72601a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 -- 172.21.15.19:0/2452763823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009550 con 0x7f726009d6f0 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f7264c30700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7250016000 tx=0x7f7250004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250004510 con 0x7f726009d6f0 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72500036a0 con 0x7f726009d6f0 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.531+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250003a50 con 0x7f726009d6f0 2023-10-03T10:14:21.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.532+0000 7f7266e94700 1 -- 172.21.15.19:0/2452763823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72601a8170 con 0x7f726009d6f0 2023-10-03T10:14:21.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.532+0000 7f7266e94700 1 -- 172.21.15.19:0/2452763823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726009c710 con 0x7f726009d6f0 2023-10-03T10:14:21.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.533+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72380052e0 con 0x7f726009d6f0 2023-10-03T10:14:21.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.533+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f7250003bb0 con 0x7f726009d6f0 2023-10-03T10:14:21.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.533+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f7250021030 con 0x7f726009d6f0 2023-10-03T10:14:21.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.533+0000 7f725ffff700 1 -- 172.21.15.19:0/2452763823 >> v1:172.21.15.19:6816/126819 conn(0x7f724c02f510 legacy=0x7f724c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.542+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f725001a430 con 0x7f726009d6f0 2023-10-03T10:14:21.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.552+0000 7f9b371c2700 1 Processor -- start 2023-10-03T10:14:21.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.552+0000 7f9b371c2700 1 -- start start 2023-10-03T10:14:21.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.552+0000 7f9b371c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 0x7f9b3009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.552+0000 7f9b371c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 0x7f9b3009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.552+0000 7f9b371c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3009a810 con 0x7f9b3013c1e0 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b371c2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3006ab40 con 0x7f9b3009dc30 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b371c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3009ebc0 con 0x7f9b3006a770 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b3575f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9b3013c1e0 0x7f9b3013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50614/0 (socket says 172.21.15.19:50614) 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b3575f700 1 -- 172.21.15.19:0/4064232721 learned_addr learned my addr 172.21.15.19:0/4064232721 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 --2- 172.21.15.19:0/4064232721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 0x7f9b3009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b2ffff700 1 --2- 172.21.15.19:0/4064232721 >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 0x7f9b3009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 -- 172.21.15.19:0/4064232721 >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 msgr2=0x7f9b3009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 --2- 172.21.15.19:0/4064232721 >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 0x7f9b3009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 -- 172.21.15.19:0/4064232721 >> v1:172.21.15.19:6789/0 conn(0x7f9b3013c1e0 legacy=0x7f9b3013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 -- 172.21.15.19:0/4064232721 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3009e920 con 0x7f9b3006a770 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b2f7fe700 1 -- 172.21.15.19:0/4064232721 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090549459 0 0) 0x7f9b3009a810 con 0x7f9b3013c1e0 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b2ffff700 1 --2- 172.21.15.19:0/4064232721 >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 0x7f9b3009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:21.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.553+0000 7f9b34f5e700 1 --2- 172.21.15.19:0/4064232721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 0x7f9b3009d6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009870 tx=0x7f9b24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e006229de711e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.554+0000 7f9b2f7fe700 1 -- 172.21.15.19:0/4064232721 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24011830 con 0x7f9b3006a770 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.554+0000 7f9b2f7fe700 1 -- 172.21.15.19:0/4064232721 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b24011990 con 0x7f9b3006a770 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.554+0000 7f9b2f7fe700 1 -- 172.21.15.19:0/4064232721 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24011d20 con 0x7f9b3006a770 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 -- 172.21.15.19:0/4064232721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 msgr2=0x7f9b3009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 --2- 172.21.15.19:0/4064232721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 0x7f9b3009d6f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9b24009870 tx=0x7f9b24009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 -- 172.21.15.19:0/4064232721 shutdown_connections 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 --2- 172.21.15.19:0/4064232721 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3006a770 0x7f9b3009d6f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 --2- 172.21.15.19:0/4064232721 >> v2:172.21.15.19:3300/0 conn(0x7f9b3009dc30 0x7f9b3009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 -- 172.21.15.19:0/4064232721 >> 172.21.15.19:0/4064232721 conn(0x7f9b30066f50 msgr2=0x7f9b3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 -- 172.21.15.19:0/4064232721 shutdown_connections 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.555+0000 7f9b371c2700 1 -- 172.21.15.19:0/4064232721 wait complete. 2023-10-03T10:14:21.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.556+0000 7f9b371c2700 1 Processor -- start 2023-10-03T10:14:21.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.556+0000 7f9b371c2700 1 -- start start 2023-10-03T10:14:21.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3006a770 0x7f9b301d4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3013c1e0 0x7f9b301d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b301d4a30 con 0x7f9b3006a770 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b30139a20 con 0x7f9b3013c1e0 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b371c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3013b4b0 con 0x7f9b3009dc30 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45800/0 (socket says 172.21.15.19:45800) 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.557+0000 7f9b2ffff700 1 -- 172.21.15.19:0/724913885 learned_addr learned my addr 172.21.15.19:0/724913885 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b34f5e700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3006a770 0x7f9b301d4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b3575f700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3013c1e0 0x7f9b301d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 -- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3013c1e0 msgr2=0x7f9b301d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3013c1e0 0x7f9b301d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 -- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3006a770 msgr2=0x7f9b301d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3006a770 0x7f9b301d4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 -- 172.21.15.19:0/724913885 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0094a0 con 0x7f9b3009dc30 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2ffff700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00ebb0 tx=0x7f9b1c00eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00c850 con 0x7f9b3009dc30 2023-10-03T10:14:21.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00c9b0 con 0x7f9b3009dc30 2023-10-03T10:14:21.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00cd20 con 0x7f9b3009dc30 2023-10-03T10:14:21.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.558+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b240094a0 con 0x7f9b3009dc30 2023-10-03T10:14:21.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.559+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3013a2c0 con 0x7f9b3009dc30 2023-10-03T10:14:21.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.560+0000 7f9e21338700 1 -- 172.21.15.19:0/490610325 >> v1:172.21.15.19:6816/126819 conn(0x7f9e0002f510 legacy=0x7f9e000319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.560+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b30074ea0 con 0x7f9b3009dc30 2023-10-03T10:14:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.560+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9b1c013470 con 0x7f9b3009dc30 2023-10-03T10:14:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.560+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9b1c03fd50 con 0x7f9b3009dc30 2023-10-03T10:14:21.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.560+0000 7f9b34f5e700 1 -- 172.21.15.19:0/724913885 >> v1:172.21.15.19:6816/126819 conn(0x7f9b1402f510 legacy=0x7f9b140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.565+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b1c0232f0 con 0x7f9b3009dc30 2023-10-03T10:14:21.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.606+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e1c0a1d40 con 0x7f9e1c0a1340 2023-10-03T10:14:21.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.606+0000 7f9e11ffb700 1 -- 172.21.15.19:0/490610325 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9e0c01bb60 con 0x7f9e1c0a1340 2023-10-03T10:14:21.606 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:21.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.608+0000 7f8b4effd700 1 -- 172.21.15.19:0/4184829883 >> v1:172.21.15.19:6816/126819 conn(0x7f8b3c02f510 legacy=0x7f8b3c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 >> v1:172.21.15.19:6816/126819 conn(0x7f9e0002f510 legacy=0x7f9e000319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 msgr2=0x7f9e1c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00ebe0 tx=0x7f9e0c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 shutdown_connections 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9e1c133fa0 0x7f9e1c123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e1c0a0a30 0x7f9e1c122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 --2- 172.21.15.19:0/490610325 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9e1c0a1340 0x7f9e1c122dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 >> 172.21.15.19:0/490610325 conn(0x7f9e1c0a6550 msgr2=0x7f9e1c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 shutdown_connections 2023-10-03T10:14:21.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.609+0000 7f9e2359c700 1 -- 172.21.15.19:0/490610325 wait complete. 2023-10-03T10:14:21.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:21.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.687+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8b50074ea0 con 0x7f8b5009e410 2023-10-03T10:14:21.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.687+0000 7f8b377fe700 1 -- 172.21.15.19:0/4184829883 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b48045060 con 0x7f8b5009e410 2023-10-03T10:14:21.687 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:21.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 >> v1:172.21.15.19:6816/126819 conn(0x7f8b3c02f510 legacy=0x7f8b3c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 msgr2=0x7f8b501a67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b48009dd0 tx=0x7f8b4800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 shutdown_connections 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b5009e410 0x7f8b501a67e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b5009d6f0 0x7f8b501a5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 --2- 172.21.15.19:0/4184829883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b5009e000 0x7f8b501a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 >> 172.21.15.19:0/4184829883 conn(0x7f8b50066f50 msgr2=0x7f8b501bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.690+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 shutdown_connections 2023-10-03T10:14:21.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.691+0000 7f8b557bc700 1 -- 172.21.15.19:0/4184829883 wait complete. 2023-10-03T10:14:21.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:21.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.734+0000 7f725ffff700 1 -- 172.21.15.19:0/2452763823 >> v1:172.21.15.19:6816/126819 conn(0x7f724c02f510 legacy=0x7f724c0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.761+0000 7f9b34f5e700 1 -- 172.21.15.19:0/724913885 >> v1:172.21.15.19:6816/126819 conn(0x7f9b1402f510 legacy=0x7f9b140319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.768+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7238005860 con 0x7f726009d6f0 2023-10-03T10:14:21.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.769+0000 7f725d7fa700 1 -- 172.21.15.19:0/2452763823 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7250015020 con 0x7f726009d6f0 2023-10-03T10:14:21.769 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 >> v1:172.21.15.19:6816/126819 conn(0x7f724c02f510 legacy=0x7f724c0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 msgr2=0x7f72601a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7250016000 tx=0x7f7250004750 comp rx=0 tx=0).stop 2023-10-03T10:14:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 shutdown_connections 2023-10-03T10:14:21.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726009e410 0x7f72601a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726009d6f0 0x7f72601a4ec0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 --2- 172.21.15.19:0/2452763823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f726009e000 0x7f72601a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 >> 172.21.15.19:0/2452763823 conn(0x7f7260066f50 msgr2=0x7f72601bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 shutdown_connections 2023-10-03T10:14:21.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.771+0000 7f7246ffd700 1 -- 172.21.15.19:0/2452763823 wait complete. 2023-10-03T10:14:21.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.805+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b3006c360 con 0x7f9b3009dc30 2023-10-03T10:14:21.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.806+0000 7f9b2d7fa700 1 -- 172.21.15.19:0/724913885 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b1c021030 con 0x7f9b3009dc30 2023-10-03T10:14:21.806 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:21.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 >> v1:172.21.15.19:6816/126819 conn(0x7f9b1402f510 legacy=0x7f9b140319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:21.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 msgr2=0x7f9b301d51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c00ebb0 tx=0x7f9b1c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 shutdown_connections 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3013c1e0 0x7f9b301d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3006a770 0x7f9b301d4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 --2- 172.21.15.19:0/724913885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3009dc30 0x7f9b301d51a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 >> 172.21.15.19:0/724913885 conn(0x7f9b30066f50 msgr2=0x7f9b30071060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 shutdown_connections 2023-10-03T10:14:21.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:21.808+0000 7f9b371c2700 1 -- 172.21.15.19:0/724913885 wait complete. 2023-10-03T10:14:21.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:22.624 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:22.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 Processor -- start 2023-10-03T10:14:22.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 -- start start 2023-10-03T10:14:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 0x7f6fb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fb00a2a70 con 0x7f6fb009d630 2023-10-03T10:14:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fb00a01d0 con 0x7f6fb00a0a30 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.772+0000 7f6fb76b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb009e2b0 con 0x7f6fb0138d80 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb544f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 0x7f6fb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44276/0 (socket says 172.21.15.19:44276) 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 -- 172.21.15.19:0/1290171636 learned_addr learned my addr 172.21.15.19:0/1290171636 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 -- 172.21.15.19:0/1290171636 >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 msgr2=0x7f6fb00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 --2- 172.21.15.19:0/1290171636 >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 0x7f6fb00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 -- 172.21.15.19:0/1290171636 >> v1:172.21.15.19:6789/0 conn(0x7f6fb009d630 legacy=0x7f6fb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 -- 172.21.15.19:0/1290171636 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb009dc50 con 0x7f6fb0138d80 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fa7fff700 1 -- 172.21.15.19:0/1290171636 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461732037 0 0) 0x7f6fb00a2a70 con 0x7f6fb009d630 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb544f700 1 --2- 172.21.15.19:0/1290171636 >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 0x7f6fb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fb5c50700 1 --2- 172.21.15.19:0/1290171636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53dd72fa8fdc942 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.773+0000 7f6fa7fff700 1 -- 172.21.15.19:0/1290171636 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800e070 con 0x7f6fb0138d80 2023-10-03T10:14:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fa7fff700 1 -- 172.21.15.19:0/1290171636 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fa800b910 con 0x7f6fb0138d80 2023-10-03T10:14:22.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fa7fff700 1 -- 172.21.15.19:0/1290171636 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fa800bcc0 con 0x7f6fb0138d80 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 -- 172.21.15.19:0/1290171636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 msgr2=0x7f6fb013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/1290171636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009e50 tx=0x7f6fa800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 -- 172.21.15.19:0/1290171636 shutdown_connections 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/1290171636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb0138d80 0x7f6fb013b160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/1290171636 >> v2:172.21.15.19:3300/0 conn(0x7f6fb00a0a30 0x7f6fb00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 -- 172.21.15.19:0/1290171636 >> 172.21.15.19:0/1290171636 conn(0x7f6fb00a3050 msgr2=0x7f6fb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 -- 172.21.15.19:0/1290171636 shutdown_connections 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.774+0000 7f6fb76b3700 1 -- 172.21.15.19:0/1290171636 wait complete. 2023-10-03T10:14:22.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.775+0000 7f6fb76b3700 1 Processor -- start 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.775+0000 7f6fb76b3700 1 -- start start 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb00a0a30 0x7f6fb0133b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fb0138d80 0x7f6fb01340d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0137170 con 0x7f6fb009d630 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0136060 con 0x7f6fb00a0a30 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb76b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb0136520 con 0x7f6fb0138d80 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb5c50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fb0138d80 0x7f6fb01340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60026/0 (socket says 172.21.15.19:60026) 2023-10-03T10:14:22.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 -- 172.21.15.19:0/323453799 learned_addr learned my addr 172.21.15.19:0/323453799 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb4c4e700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb00a0a30 0x7f6fb0133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 -- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fb0138d80 msgr2=0x7f6fb01340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fb0138d80 0x7f6fb01340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 -- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb00a0a30 msgr2=0x7f6fb0133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb00a0a30 0x7f6fb0133b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 -- 172.21.15.19:0/323453799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fac0094a0 con 0x7f6fb009d630 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.776+0000 7f6fb544f700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ebe0 tx=0x7f6fac00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.777+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00c850 con 0x7f6fb009d630 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.777+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fac00c9b0 con 0x7f6fb009d630 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.777+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fac00cd40 con 0x7f6fb009d630 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.777+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa8009b30 con 0x7f6fb009d630 2023-10-03T10:14:22.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.777+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb0136bd0 con 0x7f6fb009d630 2023-10-03T10:14:22.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.778+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f6fac013470 con 0x7f6fb009d630 2023-10-03T10:14:22.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.778+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f6fac03ffb0 con 0x7f6fb009d630 2023-10-03T10:14:22.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.778+0000 7f6fb4c4e700 1 -- 172.21.15.19:0/323453799 >> v1:172.21.15.19:6816/126819 conn(0x7f6f9402f510 legacy=0x7f6f940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:22.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.778+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb0137d50 con 0x7f6fb009d630 2023-10-03T10:14:22.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.783+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fac021080 con 0x7f6fb009d630 2023-10-03T10:14:22.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:22.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:22.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.854+0000 7ff7f24be700 1 Processor -- start 2023-10-03T10:14:22.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 -- start start 2023-10-03T10:14:22.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 0x7ff7ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7ec09e410 0x7ff7ec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ec09b120 con 0x7ff7ec09e000 2023-10-03T10:14:22.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ec06b460 con 0x7ff7ec09e410 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f24be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec09a7e0 con 0x7ff7ec09d6f0 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7eb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff7ec09e000 0x7ff7ec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50640/0 (socket says 172.21.15.19:50640) 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7f0a5b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff7ec09e410 0x7ff7ec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.855+0000 7ff7eb7fe700 1 -- 172.21.15.19:0/1893008892 learned_addr learned my addr 172.21.15.19:0/1893008892 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7ebfff700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 0x7ff7ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 msgr2=0x7ff7ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7f0a5b700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 0x7ff7ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/1893008892 >> v1:172.21.15.19:6789/0 conn(0x7ff7ec09e000 legacy=0x7ff7ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/1893008892 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec09a500 con 0x7ff7ec09e410 2023-10-03T10:14:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7ebfff700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 0x7ff7ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7f0a5b700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09e410 0x7ff7ec134100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009d90 tx=0x7ff7e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520e4ceb89801957 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7eaffd700 1 -- 172.21.15.19:0/1893008892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400e070 con 0x7ff7ec09e410 2023-10-03T10:14:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7eaffd700 1 -- 172.21.15.19:0/1893008892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e400bbd0 con 0x7ff7ec09e410 2023-10-03T10:14:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.856+0000 7ff7eaffd700 1 -- 172.21.15.19:0/1893008892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4012430 con 0x7ff7ec09e410 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.857+0000 7ff7f24be700 1 -- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09e410 msgr2=0x7ff7ec134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.857+0000 7ff7f24be700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09e410 0x7ff7ec134100 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7e4009d90 tx=0x7ff7e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 -- 172.21.15.19:0/1893008892 shutdown_connections 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09e410 0x7ff7ec134100 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 --2- 172.21.15.19:0/1893008892 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09d6f0 0x7ff7ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 -- 172.21.15.19:0/1893008892 >> 172.21.15.19:0/1893008892 conn(0x7ff7ec066f50 msgr2=0x7ff7ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 -- 172.21.15.19:0/1893008892 shutdown_connections 2023-10-03T10:14:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.858+0000 7ff7f24be700 1 -- 172.21.15.19:0/1893008892 wait complete. 2023-10-03T10:14:22.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.860+0000 7ff7f24be700 1 Processor -- start 2023-10-03T10:14:22.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.860+0000 7ff7f24be700 1 -- start start 2023-10-03T10:14:22.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 0x7ff7ec1cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff7ec09e000 0x7ff7ec1ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec11bdc0 con 0x7ff7ec09d6f0 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec11c930 con 0x7ff7ec09e410 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f24be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec09a0c0 con 0x7ff7ec09e000 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44296/0 (socket says 172.21.15.19:44296) 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/2628715245 learned_addr learned my addr 172.21.15.19:0/2628715245 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7ebfff700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 0x7ff7ec1cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7eb7fe700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff7ec09e000 0x7ff7ec1ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff7ec09e000 msgr2=0x7ff7ec1ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff7ec09e000 0x7ff7ec1ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 msgr2=0x7ff7ec1cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 0x7ff7ec1cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7f0a5b700 1 -- 172.21.15.19:0/2628715245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4009a70 con 0x7ff7ec09e410 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.861+0000 7ff7ebfff700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 0x7ff7ec1cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:22.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7f0a5b700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400b730 tx=0x7ff7e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004830 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e4020070 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40276c0 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ec09c710 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.862+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ec11b030 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.863+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff7e4012430 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.863+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff7e4022070 con 0x7ff7ec09e410 2023-10-03T10:14:22.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.863+0000 7ff7ebfff700 1 -- 172.21.15.19:0/2628715245 >> v1:172.21.15.19:6816/126819 conn(0x7ff7cc02f510 legacy=0x7ff7cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:22.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.865+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ec11ce10 con 0x7ff7ec09e410 2023-10-03T10:14:22.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.870+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff7ec11ce10 con 0x7ff7ec09e410 2023-10-03T10:14:22.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 Processor -- start 2023-10-03T10:14:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 -- start start 2023-10-03T10:14:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f499c09de50 0x7f499c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c06ef30 con 0x7f499c09e760 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c06fef0 con 0x7f499c09de50 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f49a27e9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1334b0 con 0x7f499c1338a0 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f499bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.934+0000 7f499bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45824/0 (socket says 172.21.15.19:45824) 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499bfff700 1 -- 172.21.15.19:0/3021807829 learned_addr learned my addr 172.21.15.19:0/3021807829 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 --2- 172.21.15.19:0/3021807829 >> v2:172.21.15.19:3300/0 conn(0x7f499c09de50 0x7f499c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 -- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 msgr2=0x7f499c133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 --2- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499affd700 1 -- 172.21.15.19:0/3021807829 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745455712 0 0) 0x7f499c06ef30 con 0x7f499c09e760 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 -- 172.21.15.19:0/3021807829 >> v1:172.21.15.19:6789/0 conn(0x7f499c09e760 legacy=0x7f499c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 -- 172.21.15.19:0/3021807829 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c06fc30 con 0x7f499c09de50 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499b7fe700 1 --2- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c09e220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4990009840 tx=0x7f4990009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa337bd08b40378b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499affd700 1 -- 172.21.15.19:0/3021807829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990011830 con 0x7f499c09de50 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.935+0000 7f499affd700 1 -- 172.21.15.19:0/3021807829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4990011990 con 0x7f499c09de50 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f499affd700 1 -- 172.21.15.19:0/3021807829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990011d20 con 0x7f499c09de50 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 -- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 msgr2=0x7f499c09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 --2- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c09e220 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4990009840 tx=0x7f4990009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:22.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 -- 172.21.15.19:0/3021807829 shutdown_connections 2023-10-03T10:14:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 --2- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 --2- 172.21.15.19:0/3021807829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c09e220 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 -- 172.21.15.19:0/3021807829 >> 172.21.15.19:0/3021807829 conn(0x7f499c0a2aa0 msgr2=0x7f499c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 -- 172.21.15.19:0/3021807829 shutdown_connections 2023-10-03T10:14:22.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.936+0000 7f49a27e9700 1 -- 172.21.15.19:0/3021807829 wait complete. 2023-10-03T10:14:22.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.937+0000 7f49a27e9700 1 Processor -- start 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 -- start start 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f499c09e760 0x7f499c11ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c11b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c11c920 con 0x7f499c09de50 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c11e1e0 con 0x7f499c09e760 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f49a27e9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499c11d5b0 con 0x7f499c1338a0 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.938+0000 7f499bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60066/0 (socket says 172.21.15.19:60066) 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 -- 172.21.15.19:0/4195714079 learned_addr learned my addr 172.21.15.19:0/4195714079 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499b7fe700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f499c09e760 0x7f499c11ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f49a0d86700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c11b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 -- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 msgr2=0x7f499c11b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c11b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 -- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f499c09e760 msgr2=0x7f499c11ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f499c09e760 0x7f499c11ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 -- 172.21.15.19:0/4195714079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900094a0 con 0x7f499c09de50 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f499bfff700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e940 tx=0x7f498c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c0096a0 con 0x7f499c09de50 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.939+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00ee90 con 0x7f499c09de50 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.940+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c00ca90 con 0x7f499c09de50 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.940+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c11bb50 con 0x7f499c09de50 2023-10-03T10:14:22.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.940+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c11c2d0 con 0x7f499c09de50 2023-10-03T10:14:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.941+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c074ea0 con 0x7f499c09de50 2023-10-03T10:14:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.942+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f498c00cbf0 con 0x7f499c09de50 2023-10-03T10:14:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.942+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f498c0403d0 con 0x7f499c09de50 2023-10-03T10:14:22.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.942+0000 7f499b7fe700 1 -- 172.21.15.19:0/4195714079 >> v1:172.21.15.19:6816/126819 conn(0x7f498802f510 legacy=0x7f49880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:22.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.950+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f498c013470 con 0x7f499c09de50 2023-10-03T10:14:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.978+0000 7f9bd5a08700 1 Processor -- start 2023-10-03T10:14:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.978+0000 7f9bd5a08700 1 -- start start 2023-10-03T10:14:22.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f6fb4c4e700 1 -- 172.21.15.19:0/323453799 >> v1:172.21.15.19:6816/126819 conn(0x7f6f9402f510 legacy=0x7f6f940319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9bd009e000 0x7f9bd01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009e410 0x7f9bd0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd006b460 con 0x7f9bd009e000 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd009b120 con 0x7f9bd009e410 2023-10-03T10:14:22.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bd5a08700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd009a7e0 con 0x7f9bd009d6f0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45834/0 (socket says 172.21.15.19:45834) 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bceffd700 1 -- 172.21.15.19:0/3960406255 learned_addr learned my addr 172.21.15.19:0/3960406255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bcf7fe700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009e410 0x7f9bd0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.979+0000 7f9bce7fc700 1 --2- 172.21.15.19:0/3960406255 >> v2:172.21.15.19:3300/0 conn(0x7f9bd009e000 0x7f9bd01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 -- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009e410 msgr2=0x7f9bd0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009e410 0x7f9bd0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 -- 172.21.15.19:0/3960406255 >> v2:172.21.15.19:3300/0 conn(0x7f9bd009e000 msgr2=0x7f9bd01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 --2- 172.21.15.19:0/3960406255 >> v2:172.21.15.19:3300/0 conn(0x7f9bd009e000 0x7f9bd01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 -- 172.21.15.19:0/3960406255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd009a500 con 0x7f9bd009d6f0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bceffd700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009920 tx=0x7f9bc0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a031b8afc3d78a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bcdffb700 1 -- 172.21.15.19:0/3960406255 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0011830 con 0x7f9bd009d6f0 2023-10-03T10:14:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bcdffb700 1 -- 172.21.15.19:0/3960406255 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc0011990 con 0x7f9bd009d6f0 2023-10-03T10:14:22.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.980+0000 7f9bcdffb700 1 -- 172.21.15.19:0/3960406255 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0011d20 con 0x7f9bd009d6f0 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 -- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 msgr2=0x7f9bd009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009920 tx=0x7f9bc0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 -- 172.21.15.19:0/3960406255 shutdown_connections 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009e410 0x7f9bd0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/3960406255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009d6f0 0x7f9bd009dac0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/3960406255 >> v2:172.21.15.19:3300/0 conn(0x7f9bd009e000 0x7f9bd01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 -- 172.21.15.19:0/3960406255 >> 172.21.15.19:0/3960406255 conn(0x7f9bd0066f50 msgr2=0x7f9bd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:22.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 -- 172.21.15.19:0/3960406255 shutdown_connections 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.981+0000 7f9bd5a08700 1 -- 172.21.15.19:0/3960406255 wait complete. 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.982+0000 7f9bd5a08700 1 Processor -- start 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 -- start start 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009d6f0 0x7f9bd01a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009e000 0x7f9bd01a6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01a9a90 con 0x7f9bd009e410 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01a8160 con 0x7f9bd009d6f0 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bd5a08700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd01a9220 con 0x7f9bd009e000 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bcf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bcf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60080/0 (socket says 172.21.15.19:60080) 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bcf7fe700 1 -- 172.21.15.19:0/569590100 learned_addr learned my addr 172.21.15.19:0/569590100 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:22.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bceffd700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009d6f0 0x7f9bd01a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.983+0000 7f9bce7fc700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009e000 0x7f9bd01a6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 -- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009e000 msgr2=0x7f9bd01a6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009e000 0x7f9bd01a6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 -- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009d6f0 msgr2=0x7f9bd01a6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009d6f0 0x7f9bd01a6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 -- 172.21.15.19:0/569590100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc0009550 con 0x7f9bd009e410 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bcf7fe700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009dd0 tx=0x7f9bc800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8009c40 con 0x7f9bd009e410 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800f040 con 0x7f9bd009e410 2023-10-03T10:14:22.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800c930 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd009c710 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.984+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd01a7b80 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.985+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f9bc800cab0 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.986+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f9bc8048620 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.986+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd01a8e60 con 0x7f9bd009e410 2023-10-03T10:14:22.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.986+0000 7f9bceffd700 1 -- 172.21.15.19:0/569590100 >> v1:172.21.15.19:6816/126819 conn(0x7f9bbc02f540 legacy=0x7f9bbc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:22.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:22.995+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bc80252c0 con 0x7f9bd009e410 2023-10-03T10:14:23.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.006+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fb00747f0 con 0x7f6fb009d630 2023-10-03T10:14:23.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.007+0000 7f6fa5ffb700 1 -- 172.21.15.19:0/323453799 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fac017070 con 0x7f6fb009d630 2023-10-03T10:14:23.007 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:23.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.009+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 >> v1:172.21.15.19:6816/126819 conn(0x7f6f9402f510 legacy=0x7f6f940319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:23.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.009+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 msgr2=0x7f6fb0133650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.009+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6fac00ebe0 tx=0x7f6fac00eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 shutdown_connections 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fb0138d80 0x7f6fb01340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fb009d630 0x7f6fb0133650 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 --2- 172.21.15.19:0/323453799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fb00a0a30 0x7f6fb0133b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 >> 172.21.15.19:0/323453799 conn(0x7f6fb00a3050 msgr2=0x7f6fb009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 shutdown_connections 2023-10-03T10:14:23.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.012+0000 7f6fb76b3700 1 -- 172.21.15.19:0/323453799 wait complete. 2023-10-03T10:14:23.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:23.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.064+0000 7ff7ebfff700 1 -- 172.21.15.19:0/2628715245 >> v1:172.21.15.19:6816/126819 conn(0x7ff7cc02f510 legacy=0x7ff7cc0319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:23.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.083+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff7ec11ce10 con 0x7ff7ec09e410 2023-10-03T10:14:23.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.083+0000 7ff7e8ff9700 1 -- 172.21.15.19:0/2628715245 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff7e401b400 con 0x7ff7ec09e410 2023-10-03T10:14:23.083 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 >> v1:172.21.15.19:6816/126819 conn(0x7ff7cc02f510 legacy=0x7ff7cc0319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 msgr2=0x7ff7ec1c9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400b730 tx=0x7ff7e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 shutdown_connections 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff7ec09e410 0x7ff7ec1c9000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ec09d6f0 0x7ff7ec1cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 --2- 172.21.15.19:0/2628715245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff7ec09e000 0x7ff7ec1ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.085+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 >> 172.21.15.19:0/2628715245 conn(0x7ff7ec066f50 msgr2=0x7ff7ec06f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.086+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 shutdown_connections 2023-10-03T10:14:23.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.086+0000 7ff7f24be700 1 -- 172.21.15.19:0/2628715245 wait complete. 2023-10-03T10:14:23.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:23.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.143+0000 7f499b7fe700 1 -- 172.21.15.19:0/4195714079 >> v1:172.21.15.19:6816/126819 conn(0x7f498802f510 legacy=0x7f49880319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:23.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.160+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f499c06b9e0 con 0x7f499c09de50 2023-10-03T10:14:23.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.160+0000 7f4998ff9700 1 -- 172.21.15.19:0/4195714079 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f498c017070 con 0x7f499c09de50 2023-10-03T10:14:23.160 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:23.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 >> v1:172.21.15.19:6816/126819 conn(0x7f498802f510 legacy=0x7f49880319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:23.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 msgr2=0x7f499c11a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e940 tx=0x7f498c00ec50 comp rx=0 tx=0).stop 2023-10-03T10:14:23.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 shutdown_connections 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499c1338a0 0x7f499c11b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f499c09de50 0x7f499c11a710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 --2- 172.21.15.19:0/4195714079 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f499c09e760 0x7f499c11ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 >> 172.21.15.19:0/4195714079 conn(0x7f499c0a2aa0 msgr2=0x7f499c12f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 shutdown_connections 2023-10-03T10:14:23.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.163+0000 7f49a27e9700 1 -- 172.21.15.19:0/4195714079 wait complete. 2023-10-03T10:14:23.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.187+0000 7f9bceffd700 1 -- 172.21.15.19:0/569590100 >> v1:172.21.15.19:6816/126819 conn(0x7f9bbc02f540 legacy=0x7f9bbc0319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.221+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bd0074ea0 con 0x7f9bd009e410 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.221+0000 7f9bb7fff700 1 -- 172.21.15.19:0/569590100 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bc8007330 con 0x7f9bd009e410 2023-10-03T10:14:23.221 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 >> v1:172.21.15.19:6816/126819 conn(0x7f9bbc02f540 legacy=0x7f9bbc0319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 msgr2=0x7f9bd01a6a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009dd0 tx=0x7f9bc800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 shutdown_connections 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bd009e410 0x7f9bd01a6a80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bd009d6f0 0x7f9bd01a6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 --2- 172.21.15.19:0/569590100 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bd009e000 0x7f9bd01a6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:23.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 >> 172.21.15.19:0/569590100 conn(0x7f9bd0066f50 msgr2=0x7f9bd01bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:23.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 shutdown_connections 2023-10-03T10:14:23.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:23.224+0000 7f9bd5a08700 1 -- 172.21.15.19:0/569590100 wait complete. 2023-10-03T10:14:23.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:24.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:24.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:24.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.180+0000 7f8e14b75700 1 Processor -- start 2023-10-03T10:14:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.180+0000 7f8e14b75700 1 -- start start 2023-10-03T10:14:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 0x7f8e10066410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e1012d330 con 0x7f8e10130260 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1012cd90 con 0x7f8e1012cf60 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e14b75700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e101306d0 con 0x7f8e1012f8b0 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45856/0 (socket says 172.21.15.19:45856) 2023-10-03T10:14:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2107005202 learned_addr learned my addr 172.21.15.19:0/2107005202 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44342/0 (socket says 172.21.15.19:44342) 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0ed9d700 1 --2- 172.21.15.19:0/2107005202 >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 0x7f8e10066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 msgr2=0x7f8e1006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2107005202 >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 msgr2=0x7f8e10066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 --2- 172.21.15.19:0/2107005202 >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 0x7f8e10066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2107005202 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10071780 con 0x7f8e1012f8b0 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0e59c700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0ed9d700 1 --2- 172.21.15.19:0/2107005202 >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 0x7f8e10066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.181+0000 7f8e0dd9b700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e040098f0 tx=0x7f8e04009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85a2d9fcf6c887b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.182+0000 7f8e0d59a700 1 -- 172.21.15.19:0/2107005202 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04010a90 con 0x7f8e1012f8b0 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.182+0000 7f8e0d59a700 1 -- 172.21.15.19:0/2107005202 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04010bf0 con 0x7f8e1012f8b0 2023-10-03T10:14:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.182+0000 7f8e0d59a700 1 -- 172.21.15.19:0/2107005202 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04018440 con 0x7f8e1012f8b0 2023-10-03T10:14:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.182+0000 7f8e14b75700 1 -- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 msgr2=0x7f8e1012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.182+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e040098f0 tx=0x7f8e04009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 -- 172.21.15.19:0/2107005202 shutdown_connections 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012cf60 0x7f8e1006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2107005202 >> v2:172.21.15.19:3300/0 conn(0x7f8e10130260 0x7f8e10066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2107005202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012f8b0 0x7f8e1012fd20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 -- 172.21.15.19:0/2107005202 >> 172.21.15.19:0/2107005202 conn(0x7f8e100a2aa0 msgr2=0x7f8e100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 -- 172.21.15.19:0/2107005202 shutdown_connections 2023-10-03T10:14:24.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.183+0000 7f8e14b75700 1 -- 172.21.15.19:0/2107005202 wait complete. 2023-10-03T10:14:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.184+0000 7f8e14b75700 1 Processor -- start 2023-10-03T10:14:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.184+0000 7f8e14b75700 1 -- start start 2023-10-03T10:14:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012f8b0 0x7f8e1009c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e10130260 0x7f8e101c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1009ea40 con 0x7f8e10130260 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10129a40 con 0x7f8e1012f8b0 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e14b75700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1009b730 con 0x7f8e1012cf60 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45872/0 (socket says 172.21.15.19:45872) 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 -- 172.21.15.19:0/2358870685 learned_addr learned my addr 172.21.15.19:0/2358870685 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0dd9b700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012f8b0 0x7f8e1009c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0ed9d700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e10130260 0x7f8e101c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 -- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012f8b0 msgr2=0x7f8e1009c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012f8b0 0x7f8e1009c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 -- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e10130260 msgr2=0x7f8e101c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e10130260 0x7f8e101c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.185+0000 7f8e0e59c700 1 -- 172.21.15.19:0/2358870685 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000094a0 con 0x7f8e1012cf60 2023-10-03T10:14:24.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8e0e59c700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000ec10 tx=0x7f8e0000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000c850 con 0x7f8e1012cf60 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000c9b0 con 0x7f8e1012cf60 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e04009550 con 0x7f8e1012cf60 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000cd20 con 0x7f8e1012cf60 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.186+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1009c6a0 con 0x7f8e1012cf60 2023-10-03T10:14:24.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.187+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8e00013470 con 0x7f8e1012cf60 2023-10-03T10:14:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.187+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8e0003fc80 con 0x7f8e1012cf60 2023-10-03T10:14:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.187+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2358870685 >> v1:172.21.15.19:6816/126819 conn(0x7f8df002f510 legacy=0x7f8df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.187+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e1009eb80 con 0x7f8e1012cf60 2023-10-03T10:14:24.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.192+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e1009eb80 con 0x7f8e1012cf60 2023-10-03T10:14:24.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:24.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.249+0000 7ff0cd032700 1 Processor -- start 2023-10-03T10:14:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.249+0000 7ff0cd032700 1 -- start start 2023-10-03T10:14:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0cd032700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0c809e1d0 0x7ff0c8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0cd032700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0cd032700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c809f130 con 0x7ff0c809d6f0 2023-10-03T10:14:24.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0cd032700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c809f520 con 0x7ff0c809e1d0 2023-10-03T10:14:24.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0cd032700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809e930 con 0x7ff0c8135e50 2023-10-03T10:14:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0c659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0c809e1d0 0x7ff0c8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0c659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0c809e1d0 0x7ff0c8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60108/0 (socket says 172.21.15.19:60108) 2023-10-03T10:14:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0c6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0c809d6f0 0x7ff0c809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50668/0 (socket says 172.21.15.19:50668) 2023-10-03T10:14:24.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.250+0000 7ff0c659c700 1 -- 172.21.15.19:0/3709283001 learned_addr learned my addr 172.21.15.19:0/3709283001 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c759e700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c659c700 1 -- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 msgr2=0x7ff0c8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c659c700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c659c700 1 -- 172.21.15.19:0/3709283001 >> v1:172.21.15.19:6789/0 conn(0x7ff0c809d6f0 legacy=0x7ff0c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c659c700 1 -- 172.21.15.19:0/3709283001 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c809b2d0 con 0x7ff0c809e1d0 2023-10-03T10:14:24.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c659c700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809e1d0 0x7ff0c8135910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0098f0 tx=0x7ff0bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263a20c3cb922d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c5d9b700 1 -- 172.21.15.19:0/3709283001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc004230 con 0x7ff0c809e1d0 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c5d9b700 1 -- 172.21.15.19:0/3709283001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0bc004390 con 0x7ff0c809e1d0 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.251+0000 7ff0c5d9b700 1 -- 172.21.15.19:0/3709283001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0bc0036a0 con 0x7ff0c809e1d0 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 -- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809e1d0 msgr2=0x7ff0c8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809e1d0 0x7ff0c8135910 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc0098f0 tx=0x7ff0bc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 -- 172.21.15.19:0/3709283001 shutdown_connections 2023-10-03T10:14:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3709283001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809e1d0 0x7ff0c8135910 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 -- 172.21.15.19:0/3709283001 >> 172.21.15.19:0/3709283001 conn(0x7ff0c8066f50 msgr2=0x7ff0c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.252+0000 7ff0cd032700 1 -- 172.21.15.19:0/3709283001 shutdown_connections 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.253+0000 7ff0cd032700 1 -- 172.21.15.19:0/3709283001 wait complete. 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.254+0000 7ff0cd032700 1 Processor -- start 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.254+0000 7ff0cd032700 1 -- start start 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809d6f0 0x7ff0c811f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 0x7ff0c811fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8119e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c806b400 con 0x7ff0c809d6f0 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c809c700 con 0x7ff0c8135e50 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0cd032700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c811c930 con 0x7ff0c809e1d0 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0c659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 0x7ff0c811fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0c659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 0x7ff0c811fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45882/0 (socket says 172.21.15.19:45882) 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0c659c700 1 -- 172.21.15.19:0/3900579339 learned_addr learned my addr 172.21.15.19:0/3900579339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0c759e700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8119e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.255+0000 7ff0c6d9d700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809d6f0 0x7ff0c811f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 -- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 msgr2=0x7ff0c811fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 0x7ff0c811fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 -- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809d6f0 msgr2=0x7ff0c811f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809d6f0 0x7ff0c811f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 -- 172.21.15.19:0/3900579339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0bc009550 con 0x7ff0c8135e50 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0c759e700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8119e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000efc0 tx=0x7ff0c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c000cc90 con 0x7ff0c8135e50 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c811b2a0 con 0x7ff0c8135e50 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000f040 con 0x7ff0c8135e50 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0009e60 con 0x7ff0c8135e50 2023-10-03T10:14:24.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.256+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c811c650 con 0x7ff0c8135e50 2023-10-03T10:14:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.257+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8074ea0 con 0x7ff0c8135e50 2023-10-03T10:14:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.258+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7ff0c0014480 con 0x7ff0c8135e50 2023-10-03T10:14:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.258+0000 7ff0c6d9d700 1 -- 172.21.15.19:0/3900579339 >> v1:172.21.15.19:6816/126819 conn(0x7ff0b402f510 legacy=0x7ff0b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.259+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7ff0c0014730 con 0x7ff0c8135e50 2023-10-03T10:14:24.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.264+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0c0045060 con 0x7ff0c8135e50 2023-10-03T10:14:24.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.337+0000 7f302ba8f700 1 Processor -- start 2023-10-03T10:14:24.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.337+0000 7f302ba8f700 1 -- start start 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302ba8f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f3024135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302ba8f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3024135e50 0x7f3024138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302ba8f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302409f130 con 0x7f302409d6f0 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302ba8f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302409f520 con 0x7f3024135e50 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302ba8f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302409e930 con 0x7f302409e1d0 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302982b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f302409d6f0 0x7f302409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50680/0 (socket says 172.21.15.19:50680) 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302982b700 1 -- 172.21.15.19:0/3844338210 learned_addr learned my addr 172.21.15.19:0/3844338210 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302902a700 1 --2- 172.21.15.19:0/3844338210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f3024135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302a02c700 1 --2- 172.21.15.19:0/3844338210 >> v2:172.21.15.19:3300/0 conn(0x7f3024135e50 0x7f3024138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f3028829700 1 -- 172.21.15.19:0/3844338210 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408375719 0 0) 0x7f302409f130 con 0x7f302409d6f0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f3028829700 1 -- 172.21.15.19:0/3844338210 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30100035b0 con 0x7f302409d6f0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302902a700 1 -- 172.21.15.19:0/3844338210 >> v2:172.21.15.19:3300/0 conn(0x7f3024135e50 msgr2=0x7f3024138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302902a700 1 --2- 172.21.15.19:0/3844338210 >> v2:172.21.15.19:3300/0 conn(0x7f3024135e50 0x7f3024138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.338+0000 7f302902a700 1 -- 172.21.15.19:0/3844338210 >> v1:172.21.15.19:6789/0 conn(0x7f302409d6f0 legacy=0x7f302409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.339+0000 7f302902a700 1 -- 172.21.15.19:0/3844338210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302409b2d0 con 0x7f302409e1d0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.339+0000 7f302902a700 1 --2- 172.21.15.19:0/3844338210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f3024135910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3014009870 tx=0x7f3014009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a9f5270393dc2fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.339+0000 7f3028829700 1 -- 172.21.15.19:0/3844338210 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014011830 con 0x7f302409e1d0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.339+0000 7f3028829700 1 -- 172.21.15.19:0/3844338210 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014011990 con 0x7f302409e1d0 2023-10-03T10:14:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.339+0000 7f3028829700 1 -- 172.21.15.19:0/3844338210 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014011d00 con 0x7f302409e1d0 2023-10-03T10:14:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 -- 172.21.15.19:0/3844338210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 msgr2=0x7f3024135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 --2- 172.21.15.19:0/3844338210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f3024135910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3014009870 tx=0x7f3014009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 -- 172.21.15.19:0/3844338210 shutdown_connections 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 --2- 172.21.15.19:0/3844338210 >> v2:172.21.15.19:3300/0 conn(0x7f3024135e50 0x7f3024138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 --2- 172.21.15.19:0/3844338210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f3024135910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 -- 172.21.15.19:0/3844338210 >> 172.21.15.19:0/3844338210 conn(0x7f3024066f50 msgr2=0x7f302409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 -- 172.21.15.19:0/3844338210 shutdown_connections 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.340+0000 7f302ba8f700 1 -- 172.21.15.19:0/3844338210 wait complete. 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.341+0000 7f302ba8f700 1 Processor -- start 2023-10-03T10:14:24.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.341+0000 7f302ba8f700 1 -- start start 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f302411ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3024135e50 0x7f302411bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302411e7b0 con 0x7f3024135e50 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302411d930 con 0x7f302409e1d0 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302ba8f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f302409c700 con 0x7f302409d6f0 2023-10-03T10:14:24.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302982b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302982b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45888/0 (socket says 172.21.15.19:45888) 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302982b700 1 -- 172.21.15.19:0/1656367064 learned_addr learned my addr 172.21.15.19:0/1656367064 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.342+0000 7f302a02c700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3024135e50 0x7f302411bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302902a700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f302411ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 -- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 msgr2=0x7f302411ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f302411ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 -- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3024135e50 msgr2=0x7f302411bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3024135e50 0x7f302411bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 -- 172.21.15.19:0/1656367064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30140094a0 con 0x7f302409d6f0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302982b700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f302000c700 tx=0x7f302000cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020005d70 con 0x7f302409d6f0 2023-10-03T10:14:24.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30200070d0 con 0x7f302409d6f0 2023-10-03T10:14:24.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020007460 con 0x7f302409d6f0 2023-10-03T10:14:24.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30241389f0 con 0x7f302409d6f0 2023-10-03T10:14:24.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.343+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302411e360 con 0x7f302409d6f0 2023-10-03T10:14:24.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.345+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f30200075c0 con 0x7f302409d6f0 2023-10-03T10:14:24.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.345+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3024071700 con 0x7f302409d6f0 2023-10-03T10:14:24.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.345+0000 7f302902a700 1 -- 172.21.15.19:0/1656367064 >> v1:172.21.15.19:6816/126819 conn(0x7f300802f510 legacy=0x7f30080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.345+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f302003f1c0 con 0x7f302409d6f0 2023-10-03T10:14:24.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.354+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f302000e280 con 0x7f302409d6f0 2023-10-03T10:14:24.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.388+0000 7f8e0dd9b700 1 -- 172.21.15.19:0/2358870685 >> v1:172.21.15.19:6816/126819 conn(0x7f8df002f510 legacy=0x7f8df00319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.393+0000 7f51d1cd0700 1 Processor -- start 2023-10-03T10:14:24.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.393+0000 7f51d1cd0700 1 -- start start 2023-10-03T10:14:24.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51d1cd0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51cc09d630 0x7f51cc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51d1cd0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc138d80 0x7f51cc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51d1cd0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51cc0a2a70 con 0x7f51cc0a0a30 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51d1cd0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51cc0a01d0 con 0x7f51cc09d630 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51d1cd0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc09e2b0 con 0x7f51cc138d80 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51cc09d630 0x7f51cc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51cc09d630 0x7f51cc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60136/0 (socket says 172.21.15.19:60136) 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 -- 172.21.15.19:0/2298813051 learned_addr learned my addr 172.21.15.19:0/2298813051 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51cbfff700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc138d80 0x7f51cc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 -- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc138d80 msgr2=0x7f51cc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc138d80 0x7f51cc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 -- 172.21.15.19:0/2298813051 >> v1:172.21.15.19:6789/0 conn(0x7f51cc0a0a30 legacy=0x7f51cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.394+0000 7f51caffd700 1 -- 172.21.15.19:0/2298813051 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc09dc50 con 0x7f51cc09d630 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51caffd700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc09d630 0x7f51cc0a1510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f51c00098f0 tx=0x7f51c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b252acae5a45fa0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51ca7fc700 1 -- 172.21.15.19:0/2298813051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c0004230 con 0x7f51cc09d630 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51ca7fc700 1 -- 172.21.15.19:0/2298813051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c0004390 con 0x7f51cc09d630 2023-10-03T10:14:24.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51ca7fc700 1 -- 172.21.15.19:0/2298813051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c00036a0 con 0x7f51cc09d630 2023-10-03T10:14:24.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 -- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc09d630 msgr2=0x7f51cc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc09d630 0x7f51cc0a1510 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f51c00098f0 tx=0x7f51c0009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:24.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 -- 172.21.15.19:0/2298813051 shutdown_connections 2023-10-03T10:14:24.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc138d80 0x7f51cc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/2298813051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc09d630 0x7f51cc0a1510 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.395+0000 7f51d1cd0700 1 -- 172.21.15.19:0/2298813051 >> 172.21.15.19:0/2298813051 conn(0x7f51cc0a3050 msgr2=0x7f51cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.396+0000 7f51d1cd0700 1 -- 172.21.15.19:0/2298813051 shutdown_connections 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.396+0000 7f51d1cd0700 1 -- 172.21.15.19:0/2298813051 wait complete. 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.397+0000 7f51d1cd0700 1 Processor -- start 2023-10-03T10:14:24.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.397+0000 7f51d1cd0700 1 -- start start 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51cc0a0a30 0x7f51cc120fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc138d80 0x7f51cc121500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc124660 con 0x7f51cc138d80 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc123350 con 0x7f51cc09d630 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51d1cd0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51cc0a0410 con 0x7f51cc0a0a30 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51cb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51cb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44406/0 (socket says 172.21.15.19:44406) 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51cb7fe700 1 -- 172.21.15.19:0/3865870822 learned_addr learned my addr 172.21.15.19:0/3865870822 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:24.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51caffd700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51cc0a0a30 0x7f51cc120fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.398+0000 7f51cbfff700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc138d80 0x7f51cc121500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 -- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51cc0a0a30 msgr2=0x7f51cc120fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51cc0a0a30 0x7f51cc120fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 -- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc138d80 msgr2=0x7f51cc121500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc138d80 0x7f51cc121500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 -- 172.21.15.19:0/3865870822 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009550 con 0x7f51cc09d630 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51cb7fe700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c750 tx=0x7f51bc00ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0054e0 con 0x7f51cc09d630 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc003680 con 0x7f51cc09d630 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51cc123f30 con 0x7f51cc09d630 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc003a30 con 0x7f51cc09d630 2023-10-03T10:14:24.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.399+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51cc122550 con 0x7f51cc09d630 2023-10-03T10:14:24.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.401+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f51bc003b90 con 0x7f51cc09d630 2023-10-03T10:14:24.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.401+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51cc124430 con 0x7f51cc09d630 2023-10-03T10:14:24.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.401+0000 7f51caffd700 1 -- 172.21.15.19:0/3865870822 >> v1:172.21.15.19:6816/126819 conn(0x7f51b802f510 legacy=0x7f51b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.401+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f51bc0421c0 con 0x7f51cc09d630 2023-10-03T10:14:24.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.410+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51cc124430 con 0x7f51cc09d630 2023-10-03T10:14:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.422+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e1009eb80 con 0x7f8e1012cf60 2023-10-03T10:14:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.422+0000 7f8dfeffd700 1 -- 172.21.15.19:0/2358870685 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e1009eb80 con 0x7f8e1012cf60 2023-10-03T10:14:24.422 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:24.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 >> v1:172.21.15.19:6816/126819 conn(0x7f8df002f510 legacy=0x7f8df00319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 msgr2=0x7f8e1009bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000ec10 tx=0x7f8e0000ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 shutdown_connections 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e10130260 0x7f8e101c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e1012cf60 0x7f8e1009bc20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 --2- 172.21.15.19:0/2358870685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e1012f8b0 0x7f8e1009c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 >> 172.21.15.19:0/2358870685 conn(0x7f8e100a2aa0 msgr2=0x7f8e1006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 shutdown_connections 2023-10-03T10:14:24.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.424+0000 7f8e14b75700 1 -- 172.21.15.19:0/2358870685 wait complete. 2023-10-03T10:14:24.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:24.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.459+0000 7ff0c6d9d700 1 -- 172.21.15.19:0/3900579339 >> v1:172.21.15.19:6816/126819 conn(0x7ff0b402f510 legacy=0x7ff0b40319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.511+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0c806c360 con 0x7ff0c8135e50 2023-10-03T10:14:24.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.512+0000 7ff0af7fe700 1 -- 172.21.15.19:0/3900579339 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0c0018090 con 0x7ff0c8135e50 2023-10-03T10:14:24.512 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 >> v1:172.21.15.19:6816/126819 conn(0x7ff0b402f510 legacy=0x7ff0b40319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 msgr2=0x7ff0c8119e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8119e30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000efc0 tx=0x7ff0c000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 shutdown_connections 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0c8135e50 0x7ff0c8119e30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0c809d6f0 0x7ff0c811f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.514+0000 7ff0cd032700 1 --2- 172.21.15.19:0/3900579339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0c809e1d0 0x7ff0c811fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.515+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 >> 172.21.15.19:0/3900579339 conn(0x7ff0c8066f50 msgr2=0x7ff0c8134830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.515+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 shutdown_connections 2023-10-03T10:14:24.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.515+0000 7ff0cd032700 1 -- 172.21.15.19:0/3900579339 wait complete. 2023-10-03T10:14:24.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.546+0000 7f302902a700 1 -- 172.21.15.19:0/1656367064 >> v1:172.21.15.19:6816/126819 conn(0x7f300802f510 legacy=0x7f30080319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.591+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3024074ea0 con 0x7f302409d6f0 2023-10-03T10:14:24.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.592+0000 7f301a7fc700 1 -- 172.21.15.19:0/1656367064 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3020017090 con 0x7f302409d6f0 2023-10-03T10:14:24.592 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 >> v1:172.21.15.19:6816/126819 conn(0x7f300802f510 legacy=0x7f30080319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:24.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 msgr2=0x7f302411b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f302000c700 tx=0x7f302000cac0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 shutdown_connections 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3024135e50 0x7f302411bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f302409d6f0 0x7f302411b500 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 --2- 172.21.15.19:0/1656367064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f302409e1d0 0x7f302411ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 >> 172.21.15.19:0/1656367064 conn(0x7f3024066f50 msgr2=0x7f302406e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 shutdown_connections 2023-10-03T10:14:24.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.594+0000 7f302ba8f700 1 -- 172.21.15.19:0/1656367064 wait complete. 2023-10-03T10:14:24.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.602+0000 7f51caffd700 1 -- 172.21.15.19:0/3865870822 >> v1:172.21.15.19:6816/126819 conn(0x7f51b802f510 legacy=0x7f51b80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:24.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:24.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.644+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51cc124430 con 0x7f51cc09d630 2023-10-03T10:14:24.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.644+0000 7f51b3fff700 1 -- 172.21.15.19:0/3865870822 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51cc124430 con 0x7f51cc09d630 2023-10-03T10:14:24.645 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 >> v1:172.21.15.19:6816/126819 conn(0x7f51b802f510 legacy=0x7f51b80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:24.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 msgr2=0x7f51cc120a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00c750 tx=0x7f51bc00ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 shutdown_connections 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51cc138d80 0x7f51cc121500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51cc09d630 0x7f51cc120a80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 --2- 172.21.15.19:0/3865870822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51cc0a0a30 0x7f51cc120fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.646+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 >> 172.21.15.19:0/3865870822 conn(0x7f51cc0a3050 msgr2=0x7f51cc0a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:24.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.647+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 shutdown_connections 2023-10-03T10:14:24.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:24.647+0000 7f51d1cd0700 1 -- 172.21.15.19:0/3865870822 wait complete. 2023-10-03T10:14:24.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:25.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:25.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:25.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.586+0000 7fb7788b2700 1 Processor -- start 2023-10-03T10:14:25.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.586+0000 7fb7788b2700 1 -- start start 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb7740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 0x7fb774134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77409edd0 con 0x7fb774133fa0 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77409e1f0 con 0x7fb7740a1340 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb7788b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb77409dc50 con 0x7fb7740a0a30 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb772d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 0x7fb774134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44422/0 (socket says 172.21.15.19:44422) 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb771d9b700 1 -- 172.21.15.19:0/744445945 learned_addr learned my addr 172.21.15.19:0/744445945 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.587+0000 7fb77259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb7740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 -- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 msgr2=0x7fb7740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 --2- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb7740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 -- 172.21.15.19:0/744445945 >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 msgr2=0x7fb774134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 --2- 172.21.15.19:0/744445945 >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 0x7fb774134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 -- 172.21.15.19:0/744445945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740a1fe0 con 0x7fb7740a1340 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb772d9d700 1 --2- 172.21.15.19:0/744445945 >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 0x7fb774134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb771d9b700 1 --2- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0098f0 tx=0x7fb75c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d711147beb3837 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb77159a700 1 -- 172.21.15.19:0/744445945 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011830 con 0x7fb7740a1340 2023-10-03T10:14:25.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb77159a700 1 -- 172.21.15.19:0/744445945 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c011990 con 0x7fb7740a1340 2023-10-03T10:14:25.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.588+0000 7fb77159a700 1 -- 172.21.15.19:0/744445945 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011d20 con 0x7fb7740a1340 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 -- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 msgr2=0x7fb774133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 --2- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0098f0 tx=0x7fb75c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 -- 172.21.15.19:0/744445945 shutdown_connections 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 --2- 172.21.15.19:0/744445945 >> v2:172.21.15.19:3300/0 conn(0x7fb774133fa0 0x7fb774134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 --2- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb7740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 --2- 172.21.15.19:0/744445945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774133a60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 -- 172.21.15.19:0/744445945 >> 172.21.15.19:0/744445945 conn(0x7fb7740a6550 msgr2=0x7fb7740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 -- 172.21.15.19:0/744445945 shutdown_connections 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.589+0000 7fb7788b2700 1 -- 172.21.15.19:0/744445945 wait complete. 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.590+0000 7fb7788b2700 1 Processor -- start 2023-10-03T10:14:25.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.590+0000 7fb7788b2700 1 -- start start 2023-10-03T10:14:25.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 0x7fb774120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774123c50 con 0x7fb774133fa0 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740a3530 con 0x7fb7740a1340 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb7788b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741233e0 con 0x7fb7740a0a30 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb77259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb771d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44424/0 (socket says 172.21.15.19:44424) 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb77259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45906/0 (socket says 172.21.15.19:45906) 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb771d9b700 1 -- 172.21.15.19:0/3376827339 learned_addr learned my addr 172.21.15.19:0/3376827339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.591+0000 7fb772d9d700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 0x7fb774120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 -- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 msgr2=0x7fb774120130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 -- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 msgr2=0x7fb774120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 0x7fb774120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 -- 172.21.15.19:0/3376827339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094a0 con 0x7fb7740a1340 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb772d9d700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 0x7fb774120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb77259c700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb771d9b700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c004240 con 0x7fb7740a1340 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c01f070 con 0x7fb7740a1340 2023-10-03T10:14:25.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c009550 con 0x7fb7740a1340 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0045c0 con 0x7fb7740a1340 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.592+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774121d40 con 0x7fb7740a1340 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.593+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fb75c021030 con 0x7fb7740a1340 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.593+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7741237d0 con 0x7fb7740a1340 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.594+0000 7fb77259c700 1 -- 172.21.15.19:0/3376827339 >> v1:172.21.15.19:6816/126819 conn(0x7fb75402f510 legacy=0x7fb7540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.594+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fb75c040d60 con 0x7fb7740a1340 2023-10-03T10:14:25.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.598+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7741237d0 con 0x7fb7740a1340 2023-10-03T10:14:25.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:25.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:25.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.676+0000 7fdc0263b700 1 Processor -- start 2023-10-03T10:14:25.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.676+0000 7fdc0263b700 1 -- start start 2023-10-03T10:14:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdc0263b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 0x7fdbfc130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdc0263b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 0x7fdbfc06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdc0263b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0716a0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdc0263b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc09a390 con 0x7fdbfc130e50 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdc0263b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc071290 con 0x7fdbfc130540 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 0x7fdbfc06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdbfb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 0x7fdbfc06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44438/0 (socket says 172.21.15.19:44438) 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdbfb7fe700 1 -- 172.21.15.19:0/1512461213 learned_addr learned my addr 172.21.15.19:0/1512461213 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.677+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 0x7fdbfc130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfaffd700 1 -- 172.21.15.19:0/1512461213 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39957574 0 0) 0x7fdbfc0716a0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfaffd700 1 -- 172.21.15.19:0/1512461213 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe40035b0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfbfff700 1 -- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 msgr2=0x7fdbfc06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 0x7fdbfc06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfbfff700 1 -- 172.21.15.19:0/1512461213 >> v1:172.21.15.19:6789/0 conn(0x7fdbfc06fb20 legacy=0x7fdbfc137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfbfff700 1 -- 172.21.15.19:0/1512461213 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc130340 con 0x7fdbfc130540 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 0x7fdbfc130910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00bb40 tx=0x7fdbec00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cccbb976f2cee3f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfaffd700 1 -- 172.21.15.19:0/1512461213 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00dc30 con 0x7fdbfc130540 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfaffd700 1 -- 172.21.15.19:0/1512461213 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00dd90 con 0x7fdbfc130540 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.678+0000 7fdbfaffd700 1 -- 172.21.15.19:0/1512461213 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec010690 con 0x7fdbfc130540 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 -- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 msgr2=0x7fdbfc130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 0x7fdbfc130910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00bb40 tx=0x7fdbec00be50 comp rx=0 tx=0).stop 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 -- 172.21.15.19:0/1512461213 shutdown_connections 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130540 0x7fdbfc130910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 --2- 172.21.15.19:0/1512461213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130e50 0x7fdbfc06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 -- 172.21.15.19:0/1512461213 >> 172.21.15.19:0/1512461213 conn(0x7fdbfc0a2aa0 msgr2=0x7fdbfc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 -- 172.21.15.19:0/1512461213 shutdown_connections 2023-10-03T10:14:25.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.679+0000 7fdc0263b700 1 -- 172.21.15.19:0/1512461213 wait complete. 2023-10-03T10:14:25.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.681+0000 7fdc0263b700 1 Processor -- start 2023-10-03T10:14:25.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.681+0000 7fdc0263b700 1 -- start start 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 0x7fdbfc11abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130e50 0x7fdbfc11b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc11d4d0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc11bb40 con 0x7fdbfc130540 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc0263b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc11df20 con 0x7fdbfc130e50 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60194/0 (socket says 172.21.15.19:60194) 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 -- 172.21.15.19:0/764306361 learned_addr learned my addr 172.21.15.19:0/764306361 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfb7fe700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 0x7fdbfc11abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdc00bd8700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130e50 0x7fdbfc11b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 -- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130e50 msgr2=0x7fdbfc11b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130e50 0x7fdbfc11b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 -- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 msgr2=0x7fdbfc11abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 0x7fdbfc11abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfbfff700 1 -- 172.21.15.19:0/764306361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec00b740 con 0x7fdbfc06fb20 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.682+0000 7fdbfb7fe700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 0x7fdbfc11abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdbfbfff700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b2c0 tx=0x7fdbec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec003b70 con 0x7fdbfc06fb20 2023-10-03T10:14:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec003cd0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec0106b0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc11d010 con 0x7fdbfc06fb20 2023-10-03T10:14:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.683+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc0718e0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.684+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fdbec019400 con 0x7fdbfc06fb20 2023-10-03T10:14:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.684+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc09cd40 con 0x7fdbfc06fb20 2023-10-03T10:14:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.684+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fdbec0415d0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.684+0000 7fdbfb7fe700 1 -- 172.21.15.19:0/764306361 >> v1:172.21.15.19:6816/126819 conn(0x7fdbe802f510 legacy=0x7fdbe80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.689+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbec019e60 con 0x7fdbfc06fb20 2023-10-03T10:14:25.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.766+0000 7f28f2698700 1 Processor -- start 2023-10-03T10:14:25.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 -- start start 2023-10-03T10:14:25.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec09d630 0x7f28ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec0a2a70 con 0x7f28ec133930 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0a01d0 con 0x7f28ec09d630 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28f2698700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec09e2b0 con 0x7f28ec0a0a30 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.767+0000 7f28ebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45930/0 (socket says 172.21.15.19:45930) 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 -- 172.21.15.19:0/557485209 learned_addr learned my addr 172.21.15.19:0/557485209 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28eb7fe700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec09d630 0x7f28ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 -- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec09d630 msgr2=0x7f28ec0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec09d630 0x7f28ec0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 -- 172.21.15.19:0/557485209 >> v1:172.21.15.19:6789/0 conn(0x7f28ec133930 legacy=0x7f28ec133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 -- 172.21.15.19:0/557485209 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec09dc50 con 0x7f28ec0a0a30 2023-10-03T10:14:25.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28ebfff700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009920 tx=0x7f28dc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49efb8fb0af6c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28eaffd700 1 -- 172.21.15.19:0/557485209 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc011830 con 0x7f28ec0a0a30 2023-10-03T10:14:25.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28eaffd700 1 -- 172.21.15.19:0/557485209 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc011990 con 0x7f28ec0a0a30 2023-10-03T10:14:25.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.768+0000 7f28eaffd700 1 -- 172.21.15.19:0/557485209 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc011d20 con 0x7f28ec0a0a30 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.769+0000 7f28f2698700 1 -- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 msgr2=0x7f28ec0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.769+0000 7f28f2698700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009920 tx=0x7f28dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 -- 172.21.15.19:0/557485209 shutdown_connections 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec0a0a30 0x7f28ec0a0e00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 --2- 172.21.15.19:0/557485209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec09d630 0x7f28ec0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 -- 172.21.15.19:0/557485209 >> 172.21.15.19:0/557485209 conn(0x7f28ec0a3050 msgr2=0x7f28ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 -- 172.21.15.19:0/557485209 shutdown_connections 2023-10-03T10:14:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.770+0000 7f28f2698700 1 -- 172.21.15.19:0/557485209 wait complete. 2023-10-03T10:14:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.771+0000 7f28f2698700 1 Processor -- start 2023-10-03T10:14:25.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.771+0000 7f28f2698700 1 -- start start 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 0x7f28ec121210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec122e20 con 0x7f28ec133930 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec123cb0 con 0x7f28ec0a0a30 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f2698700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec124790 con 0x7f28ec09d630 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f0c35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f0c35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60202/0 (socket says 172.21.15.19:60202) 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44458/0 (socket says 172.21.15.19:44458) 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28f0c35700 1 -- 172.21.15.19:0/3151291615 learned_addr learned my addr 172.21.15.19:0/3151291615 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.772+0000 7f28ebfff700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 0x7f28ec121210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 -- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 msgr2=0x7f28ec121210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 0x7f28ec121210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 -- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 msgr2=0x7f28ec121c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 -- 172.21.15.19:0/3151291615 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc009550 con 0x7f28ec0a0a30 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28ebfff700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 0x7f28ec121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28f0c35700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28eb7fe700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e900 tx=0x7f28e000ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0013680 con 0x7f28ec0a0a30 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e00137e0 con 0x7f28ec0a0a30 2023-10-03T10:14:25.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0013b50 con 0x7f28ec0a0a30 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec124a50 con 0x7f28ec0a0a30 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.773+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec124520 con 0x7f28ec0a0a30 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.774+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f28e0013cb0 con 0x7f28ec0a0a30 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.775+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f28e003fa10 con 0x7f28ec0a0a30 2023-10-03T10:14:25.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.775+0000 7f28ebfff700 1 -- 172.21.15.19:0/3151291615 >> v1:172.21.15.19:6816/126819 conn(0x7f28d802f540 legacy=0x7f28d80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.775+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec11df60 con 0x7f28ec0a0a30 2023-10-03T10:14:25.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.784+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28e0021020 con 0x7f28ec0a0a30 2023-10-03T10:14:25.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.795+0000 7fb77259c700 1 -- 172.21.15.19:0/3376827339 >> v1:172.21.15.19:6816/126819 conn(0x7fb75402f510 legacy=0x7fb7540319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.813+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7741237d0 con 0x7fb7740a1340 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.813+0000 7fb76affd700 1 -- 172.21.15.19:0/3376827339 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7741237d0 con 0x7fb7740a1340 2023-10-03T10:14:25.813 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 >> v1:172.21.15.19:6816/126819 conn(0x7fb75402f510 legacy=0x7fb7540319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 msgr2=0x7fb774120670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb75c000c00 tx=0x7fb75c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 shutdown_connections 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774133fa0 0x7fb774120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7740a0a30 0x7fb774120130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 --2- 172.21.15.19:0/3376827339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7740a1340 0x7fb774120670 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 >> 172.21.15.19:0/3376827339 conn(0x7fb7740a6550 msgr2=0x7fb7741bb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 shutdown_connections 2023-10-03T10:14:25.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.816+0000 7fb7788b2700 1 -- 172.21.15.19:0/3376827339 wait complete. 2023-10-03T10:14:25.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.827+0000 7f137c2ff700 1 Processor -- start 2023-10-03T10:14:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 -- start start 2023-10-03T10:14:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f137409d6f0 0x7f137409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137409f130 con 0x7f137409e410 2023-10-03T10:14:25.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137409f520 con 0x7f137409d6f0 2023-10-03T10:14:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.828+0000 7f137c2ff700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137409e930 con 0x7f137409e000 2023-10-03T10:14:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44466/0 (socket says 172.21.15.19:44466) 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 -- 172.21.15.19:0/2499248845 learned_addr learned my addr 172.21.15.19:0/2499248845 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137a09b700 1 --2- 172.21.15.19:0/2499248845 >> v2:172.21.15.19:3300/0 conn(0x7f137409d6f0 0x7f137409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 -- 172.21.15.19:0/2499248845 >> v2:172.21.15.19:3300/0 conn(0x7f137409d6f0 msgr2=0x7f137409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 --2- 172.21.15.19:0/2499248845 >> v2:172.21.15.19:3300/0 conn(0x7f137409d6f0 0x7f137409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 -- 172.21.15.19:0/2499248845 >> v1:172.21.15.19:6789/0 conn(0x7f137409e410 legacy=0x7f1374130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 -- 172.21.15.19:0/2499248845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137409b2d0 con 0x7f137409e000 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f137989a700 1 --2- 172.21.15.19:0/2499248845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13640098f0 tx=0x7f1364009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a950b58a3e3cd2c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f1379099700 1 -- 172.21.15.19:0/2499248845 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364011830 con 0x7f137409e000 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.829+0000 7f1379099700 1 -- 172.21.15.19:0/2499248845 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1364011990 con 0x7f137409e000 2023-10-03T10:14:25.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f1379099700 1 -- 172.21.15.19:0/2499248845 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364011d20 con 0x7f137409e000 2023-10-03T10:14:25.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 -- 172.21.15.19:0/2499248845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 msgr2=0x7f1374130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 --2- 172.21.15.19:0/2499248845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13640098f0 tx=0x7f1364009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:25.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 -- 172.21.15.19:0/2499248845 shutdown_connections 2023-10-03T10:14:25.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 --2- 172.21.15.19:0/2499248845 >> v2:172.21.15.19:3300/0 conn(0x7f137409d6f0 0x7f137409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 --2- 172.21.15.19:0/2499248845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409e000 0x7f1374130660 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.830+0000 7f137c2ff700 1 -- 172.21.15.19:0/2499248845 >> 172.21.15.19:0/2499248845 conn(0x7f1374066f50 msgr2=0x7f137409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.831+0000 7f137c2ff700 1 -- 172.21.15.19:0/2499248845 shutdown_connections 2023-10-03T10:14:25.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.831+0000 7f137c2ff700 1 -- 172.21.15.19:0/2499248845 wait complete. 2023-10-03T10:14:25.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 Processor -- start 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 -- start start 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f137409e000 0x7f13741305a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f137409e410 0x7f13741c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:25.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137412fe20 con 0x7f137409e410 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137409c770 con 0x7f137409d6f0 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137c2ff700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13741332d0 con 0x7f137409e000 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137a09b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137a09b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44468/0 (socket says 172.21.15.19:44468) 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137a09b700 1 -- 172.21.15.19:0/3087458341 learned_addr learned my addr 172.21.15.19:0/3087458341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137989a700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f137409e000 0x7f13741305a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.832+0000 7f137a89c700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f137409e410 0x7f13741c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 -- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f137409e000 msgr2=0x7f13741305a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f137409e000 0x7f13741305a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 -- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f137409e410 msgr2=0x7f13741c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f137409e410 0x7f13741c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 -- 172.21.15.19:0/3087458341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009550 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137a09b700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f137000e9b0 tx=0x7f137000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370009710 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137000c850 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000cbc0 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1374132a70 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.833+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1374131960 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.834+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f137000cd20 con 0x7f137409d6f0 2023-10-03T10:14:25.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.834+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f1370040060 con 0x7f137409d6f0 2023-10-03T10:14:25.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.834+0000 7f137989a700 1 -- 172.21.15.19:0/3087458341 >> v1:172.21.15.19:6816/126819 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.834+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1374131b50 con 0x7f137409d6f0 2023-10-03T10:14:25.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.839+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1370021080 con 0x7f137409d6f0 2023-10-03T10:14:25.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.885+0000 7fdbfb7fe700 1 -- 172.21.15.19:0/764306361 >> v1:172.21.15.19:6816/126819 conn(0x7fdbe802f510 legacy=0x7fdbe80319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.948+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdbfc074ea0 con 0x7fdbfc06fb20 2023-10-03T10:14:25.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.948+0000 7fdbf8ff9700 1 -- 172.21.15.19:0/764306361 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbec021390 con 0x7fdbfc06fb20 2023-10-03T10:14:25.948 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 >> v1:172.21.15.19:6816/126819 conn(0x7fdbe802f510 legacy=0x7fdbe80319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 msgr2=0x7fdbfc11a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdbec00b2c0 tx=0x7fdbec004750 comp rx=0 tx=0).stop 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 shutdown_connections 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbfc130e50 0x7fdbfc11b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbfc06fb20 0x7fdbfc11a690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 --2- 172.21.15.19:0/764306361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbfc130540 0x7fdbfc11abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 >> 172.21.15.19:0/764306361 conn(0x7fdbfc0a2aa0 msgr2=0x7fdbfc12d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 shutdown_connections 2023-10-03T10:14:25.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.951+0000 7fdc0263b700 1 -- 172.21.15.19:0/764306361 wait complete. 2023-10-03T10:14:25.964 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:25.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.976+0000 7f28ebfff700 1 -- 172.21.15.19:0/3151291615 >> v1:172.21.15.19:6816/126819 conn(0x7f28d802f540 legacy=0x7f28d80319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.995+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f28ec1244c0 con 0x7f28ec0a0a30 2023-10-03T10:14:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.995+0000 7f28e8ff9700 1 -- 172.21.15.19:0/3151291615 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28e001be10 con 0x7f28ec0a0a30 2023-10-03T10:14:25.995 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:25.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 >> v1:172.21.15.19:6816/126819 conn(0x7f28d802f540 legacy=0x7f28d80319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:25.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 msgr2=0x7f28ec121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:25.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f28e000e900 tx=0x7f28e000ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:25.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 shutdown_connections 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28ec133930 0x7f28ec121c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28ec09d630 0x7f28ec121210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 --2- 172.21.15.19:0/3151291615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28ec0a0a30 0x7f28ec121750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 >> 172.21.15.19:0/3151291615 conn(0x7f28ec0a3050 msgr2=0x7f28ec1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 shutdown_connections 2023-10-03T10:14:25.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:25.998+0000 7f28f2698700 1 -- 172.21.15.19:0/3151291615 wait complete. 2023-10-03T10:14:26.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:26.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.035+0000 7f137989a700 1 -- 172.21.15.19:0/3087458341 >> v1:172.21.15.19:6816/126819 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:26.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.078+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1374074ea0 con 0x7f137409d6f0 2023-10-03T10:14:26.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.079+0000 7f136affd700 1 -- 172.21.15.19:0/3087458341 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f137001b3b0 con 0x7f137409d6f0 2023-10-03T10:14:26.079 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 >> v1:172.21.15.19:6816/126819 conn(0x7f135802f510 legacy=0x7f13580319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 msgr2=0x7f1374130060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f137000e9b0 tx=0x7f137000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 shutdown_connections 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f137409e410 0x7f13741c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f137409d6f0 0x7f1374130060 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 --2- 172.21.15.19:0/3087458341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f137409e000 0x7f13741305a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 >> 172.21.15.19:0/3087458341 conn(0x7f1374066f50 msgr2=0x7f13740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 shutdown_connections 2023-10-03T10:14:26.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.081+0000 7f137c2ff700 1 -- 172.21.15.19:0/3087458341 wait complete. 2023-10-03T10:14:26.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:26.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:26.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 Processor -- start 2023-10-03T10:14:26.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 -- start start 2023-10-03T10:14:26.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 0x7fd3e8138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e8130260 con 0x7fd3e8130670 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e809a350 con 0x7fd3e8135e30 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ee9c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8071ff0 con 0x7fd3e8133510 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3e77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.981+0000 7fd3ecf62700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 0x7fd3e8138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44966/0 (socket says 172.21.15.19:44966) 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3ecf62700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 0x7fd3e8138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51024/0 (socket says 172.21.15.19:51024) 2023-10-03T10:14:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 -- 172.21.15.19:0/131045340 learned_addr learned my addr 172.21.15.19:0/131045340 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 -- 172.21.15.19:0/131045340 >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 msgr2=0x7fd3e8138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 --2- 172.21.15.19:0/131045340 >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 0x7fd3e8138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 -- 172.21.15.19:0/131045340 >> v1:172.21.15.19:6789/0 conn(0x7fd3e8130670 legacy=0x7fd3e8130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e6ffd700 1 -- 172.21.15.19:0/131045340 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603470596 0 0) 0x7fd3e8130260 con 0x7fd3e8130670 2023-10-03T10:14:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 -- 172.21.15.19:0/131045340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e809ecf0 con 0x7fd3e8133510 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e77fe700 1 --2- 172.21.15.19:0/131045340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009920 tx=0x7fd3dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4943839539da99d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e6ffd700 1 -- 172.21.15.19:0/131045340 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011830 con 0x7fd3e8133510 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e6ffd700 1 -- 172.21.15.19:0/131045340 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3dc011990 con 0x7fd3e8133510 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.982+0000 7fd3e6ffd700 1 -- 172.21.15.19:0/131045340 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc011d20 con 0x7fd3e8133510 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/131045340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 msgr2=0x7fd3e81358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/131045340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc009920 tx=0x7fd3dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/131045340 shutdown_connections 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/131045340 >> v2:172.21.15.19:3300/0 conn(0x7fd3e8135e30 0x7fd3e8138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/131045340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8133510 0x7fd3e81358f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/131045340 >> 172.21.15.19:0/131045340 conn(0x7fd3e80a2aa0 msgr2=0x7fd3e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/131045340 shutdown_connections 2023-10-03T10:14:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.983+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/131045340 wait complete. 2023-10-03T10:14:26.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.984+0000 7fd3ee9c5700 1 Processor -- start 2023-10-03T10:14:26.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 -- start start 2023-10-03T10:14:26.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3e8130670 0x7fd3e81c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e81baf10 con 0x7fd3e8133510 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e812e130 con 0x7fd3e8135e30 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ee9c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e8071820 con 0x7fd3e8130670 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3e77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ecf62700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3e77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51036/0 (socket says 172.21.15.19:51036) 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3ecf62700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44974/0 (socket says 172.21.15.19:44974) 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3e77fe700 1 -- 172.21.15.19:0/3906757535 learned_addr learned my addr 172.21.15.19:0/3906757535 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:26.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.985+0000 7fd3e7fff700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3e8130670 0x7fd3e81c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 -- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3e8130670 msgr2=0x7fd3e81c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3e8130670 0x7fd3e81c65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 -- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 msgr2=0x7fd3e81c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 -- 172.21.15.19:0/3906757535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc009550 con 0x7fd3e8135e30 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3e77fe700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ecf62700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80713a0 tx=0x7fd3e000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e000cc20 con 0x7fd3e8135e30 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e000f040 con 0x7fd3e8135e30 2023-10-03T10:14:26.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e811c980 con 0x7fd3e8135e30 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e0009e60 con 0x7fd3e8135e30 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.986+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e811a970 con 0x7fd3e8135e30 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.987+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fd3e0014480 con 0x7fd3e8135e30 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.987+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fd3e0040880 con 0x7fd3e8135e30 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.987+0000 7fd3e7fff700 1 -- 172.21.15.19:0/3906757535 >> v1:172.21.15.19:6816/126819 conn(0x7fd3d402f540 legacy=0x7fd3d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:26.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.988+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e8074ea0 con 0x7fd3e8135e30 2023-10-03T10:14:26.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:26.993+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3e0018070 con 0x7fd3e8135e30 2023-10-03T10:14:27.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:27.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.108+0000 7f1142f4e700 1 Processor -- start 2023-10-03T10:14:27.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.108+0000 7f1142f4e700 1 -- start start 2023-10-03T10:14:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1142f4e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1142f4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1142f4e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113c130260 con 0x7f113c130670 2023-10-03T10:14:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1142f4e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c09a350 con 0x7f113c135e30 2023-10-03T10:14:27.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1142f4e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113c071ff0 con 0x7f113c133510 2023-10-03T10:14:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1140cea700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f113c130670 0x7f113c130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55298/0 (socket says 172.21.15.19:55298) 2023-10-03T10:14:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f1140cea700 1 -- 172.21.15.19:0/3122260978 learned_addr learned my addr 172.21.15.19:0/3122260978 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f11414eb700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.109+0000 7f113bfff700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113bfff700 1 -- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 msgr2=0x7f113c138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113bfff700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113bfff700 1 -- 172.21.15.19:0/3122260978 >> v1:172.21.15.19:6789/0 conn(0x7f113c130670 legacy=0x7f113c130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113bfff700 1 -- 172.21.15.19:0/3122260978 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c09ecf0 con 0x7f113c133510 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113bfff700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c1358f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1128009870 tx=0x7f1128009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c137c6ed64ee1e30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113b7fe700 1 -- 172.21.15.19:0/3122260978 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128004230 con 0x7f113c133510 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113b7fe700 1 -- 172.21.15.19:0/3122260978 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1128004390 con 0x7f113c133510 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.110+0000 7f113b7fe700 1 -- 172.21.15.19:0/3122260978 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280036a0 con 0x7f113c133510 2023-10-03T10:14:27.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 -- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 msgr2=0x7f113c1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c1358f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1128009870 tx=0x7f1128009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 -- 172.21.15.19:0/3122260978 shutdown_connections 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 --2- 172.21.15.19:0/3122260978 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c1358f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 -- 172.21.15.19:0/3122260978 >> 172.21.15.19:0/3122260978 conn(0x7f113c0a2aa0 msgr2=0x7f113c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 -- 172.21.15.19:0/3122260978 shutdown_connections 2023-10-03T10:14:27.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.111+0000 7f1142f4e700 1 -- 172.21.15.19:0/3122260978 wait complete. 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.113+0000 7f1142f4e700 1 Processor -- start 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.113+0000 7f1142f4e700 1 -- start start 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c12d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113c09e4a0 con 0x7f113c130670 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113c139130 con 0x7f113c135e30 2023-10-03T10:14:27.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1142f4e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113c13af80 con 0x7f113c133510 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1140cea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1140cea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51044/0 (socket says 172.21.15.19:51044) 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f1140cea700 1 -- 172.21.15.19:0/2081840008 learned_addr learned my addr 172.21.15.19:0/2081840008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.114+0000 7f11414eb700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f113bfff700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c12d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 -- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 msgr2=0x7f113c12d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c12d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 -- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 msgr2=0x7f113c139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 -- 172.21.15.19:0/2081840008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11280094a0 con 0x7f113c130670 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f113bfff700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c12d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f1140cea700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f113000c530 tx=0x7f113000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130005d70 con 0x7f113c130670 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11300070d0 con 0x7f113c130670 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.115+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130007480 con 0x7f113c130670 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.116+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113c13b440 con 0x7f113c130670 2023-10-03T10:14:27.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.116+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f113c071820 con 0x7f113c130670 2023-10-03T10:14:27.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.117+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c074ea0 con 0x7f113c130670 2023-10-03T10:14:27.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.117+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f11300075e0 con 0x7f113c130670 2023-10-03T10:14:27.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.117+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f113003f0d0 con 0x7f113c130670 2023-10-03T10:14:27.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.117+0000 7f113bfff700 1 -- 172.21.15.19:0/2081840008 >> v1:172.21.15.19:6816/126819 conn(0x7f112002f540 legacy=0x7f11200319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.122+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1130018260 con 0x7f113c130670 2023-10-03T10:14:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.156+0000 7f8b2ac3e700 1 Processor -- start 2023-10-03T10:14:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.156+0000 7f8b2ac3e700 1 -- start start 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b2ac3e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b2ac3e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b24130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b2ac3e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b2409f130 con 0x7f8b2409e000 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b2ac3e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2409f520 con 0x7f8b2409d6f0 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b2ac3e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409e930 con 0x7f8b2409e410 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b23fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8b2409e000 0x7f8b24130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55314/0 (socket says 172.21.15.19:55314) 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b23fff700 1 -- 172.21.15.19:0/2286396090 learned_addr learned my addr 172.21.15.19:0/2286396090 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:27.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b291db700 1 --2- 172.21.15.19:0/2286396090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b24130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b289da700 1 --2- 172.21.15.19:0/2286396090 >> v2:172.21.15.19:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b237fe700 1 -- 172.21.15.19:0/2286396090 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 303993605 0 0) 0x7f8b2409f130 con 0x7f8b2409e000 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b237fe700 1 -- 172.21.15.19:0/2286396090 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b140035b0 con 0x7f8b2409e000 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b291db700 1 -- 172.21.15.19:0/2286396090 >> v2:172.21.15.19:3300/0 conn(0x7f8b2409d6f0 msgr2=0x7f8b2409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b291db700 1 --2- 172.21.15.19:0/2286396090 >> v2:172.21.15.19:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b291db700 1 -- 172.21.15.19:0/2286396090 >> v1:172.21.15.19:6789/0 conn(0x7f8b2409e000 legacy=0x7f8b24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.157+0000 7f8b291db700 1 -- 172.21.15.19:0/2286396090 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2409b2d0 con 0x7f8b2409e410 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.158+0000 7f8b291db700 1 --2- 172.21.15.19:0/2286396090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b24130d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6f5f4b13f5258ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.158+0000 7f8b237fe700 1 -- 172.21.15.19:0/2286396090 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00e070 con 0x7f8b2409e410 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.158+0000 7f8b237fe700 1 -- 172.21.15.19:0/2286396090 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c00bb20 con 0x7f8b2409e410 2023-10-03T10:14:27.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.158+0000 7f8b237fe700 1 -- 172.21.15.19:0/2286396090 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c00be90 con 0x7f8b2409e410 2023-10-03T10:14:27.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2286396090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 msgr2=0x7f8b24130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2286396090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b24130d70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009d90 tx=0x7f8b1c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:27.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2286396090 shutdown_connections 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2286396090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b24130d70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2286396090 >> v2:172.21.15.19:3300/0 conn(0x7f8b2409d6f0 0x7f8b2409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2286396090 >> 172.21.15.19:0/2286396090 conn(0x7f8b24066f50 msgr2=0x7f8b2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2286396090 shutdown_connections 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.159+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2286396090 wait complete. 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.161+0000 7f8b2ac3e700 1 Processor -- start 2023-10-03T10:14:27.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.161+0000 7f8b2ac3e700 1 -- start start 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b2409d6f0 0x7f8b2411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b2411fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24120040 con 0x7f8b2409e000 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24125b30 con 0x7f8b2409e410 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b2ac3e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2406eb60 con 0x7f8b2409d6f0 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51068/0 (socket says 172.21.15.19:51068) 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 -- 172.21.15.19:0/2797488308 learned_addr learned my addr 172.21.15.19:0/2797488308 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b291db700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b2411fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b289da700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b2409d6f0 0x7f8b2411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 -- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b2409d6f0 msgr2=0x7f8b2411ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b2409d6f0 0x7f8b2411ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 -- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 msgr2=0x7f8b2411fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b2411fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.162+0000 7f8b23fff700 1 -- 172.21.15.19:0/2797488308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c009a70 con 0x7f8b2409e000 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.163+0000 7f8b23fff700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c700 tx=0x7f8b1000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.163+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10005d70 con 0x7f8b2409e000 2023-10-03T10:14:27.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.163+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b100070d0 con 0x7f8b2409e000 2023-10-03T10:14:27.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.163+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10007440 con 0x7f8b2409e000 2023-10-03T10:14:27.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.164+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2409c700 con 0x7f8b2409e000 2023-10-03T10:14:27.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.164+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2406a9e0 con 0x7f8b2409e000 2023-10-03T10:14:27.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.165+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7f8b100075a0 con 0x7f8b2409e000 2023-10-03T10:14:27.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.165+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24074ea0 con 0x7f8b2409e000 2023-10-03T10:14:27.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.165+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7f8b1003f0d0 con 0x7f8b2409e000 2023-10-03T10:14:27.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.165+0000 7f8b289da700 1 -- 172.21.15.19:0/2797488308 >> v1:172.21.15.19:6816/126819 conn(0x7f8b0802f560 legacy=0x7f8b08031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.170+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b10011d70 con 0x7f8b2409e000 2023-10-03T10:14:27.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.188+0000 7fd3e7fff700 1 -- 172.21.15.19:0/3906757535 >> v1:172.21.15.19:6816/126819 conn(0x7fd3d402f540 legacy=0x7fd3d40319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.209+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3e8072210 con 0x7fd3e8135e30 2023-10-03T10:14:27.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.210+0000 7fd3e4ff9700 1 -- 172.21.15.19:0/3906757535 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3e00076f0 con 0x7fd3e8135e30 2023-10-03T10:14:27.210 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:27.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.213+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 >> v1:172.21.15.19:6816/126819 conn(0x7fd3d402f540 legacy=0x7fd3d40319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.213+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 msgr2=0x7fd3e8118d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.213+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80713a0 tx=0x7fd3e000ef90 comp rx=0 tx=0).stop 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.213+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 shutdown_connections 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3e8135e30 0x7fd3e8118d60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3e8130670 0x7fd3e81c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 --2- 172.21.15.19:0/3906757535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3e8133510 0x7fd3e81c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 >> 172.21.15.19:0/3906757535 conn(0x7fd3e80a2aa0 msgr2=0x7fd3e81312f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 shutdown_connections 2023-10-03T10:14:27.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.214+0000 7fd3ee9c5700 1 -- 172.21.15.19:0/3906757535 wait complete. 2023-10-03T10:14:27.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.243+0000 7fe847fc8700 1 Processor -- start 2023-10-03T10:14:27.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.243+0000 7fe847fc8700 1 -- start start 2023-10-03T10:14:27.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe847fc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe84009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe847fc8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe847fc8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84009b120 con 0x7fe84009e410 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe847fc8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84006b460 con 0x7fe84009e000 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe847fc8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84009a7e0 con 0x7fe84009d6f0 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe845563700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe846565700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe84009e410 0x7fe840133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55330/0 (socket says 172.21.15.19:55330) 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe845563700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51080/0 (socket says 172.21.15.19:51080) 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe845d64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe84009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.244+0000 7fe846565700 1 -- 172.21.15.19:0/856431738 learned_addr learned my addr 172.21.15.19:0/856431738 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845d64700 1 -- 172.21.15.19:0/856431738 >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 msgr2=0x7fe8401339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845d64700 1 --2- 172.21.15.19:0/856431738 >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845d64700 1 -- 172.21.15.19:0/856431738 >> v1:172.21.15.19:6789/0 conn(0x7fe84009e410 legacy=0x7fe840133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe844d62700 1 -- 172.21.15.19:0/856431738 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189569243 0 0) 0x7fe84009b120 con 0x7fe84009e410 2023-10-03T10:14:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845d64700 1 -- 172.21.15.19:0/856431738 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84009a500 con 0x7fe84009d6f0 2023-10-03T10:14:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845563700 1 --2- 172.21.15.19:0/856431738 >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:27.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe845d64700 1 --2- 172.21.15.19:0/856431738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe84009dac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009870 tx=0x7fe83c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4047fad76a2f66d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe844d62700 1 -- 172.21.15.19:0/856431738 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c011830 con 0x7fe84009d6f0 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe844d62700 1 -- 172.21.15.19:0/856431738 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c011990 con 0x7fe84009d6f0 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.245+0000 7fe844d62700 1 -- 172.21.15.19:0/856431738 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c011d20 con 0x7fe84009d6f0 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 -- 172.21.15.19:0/856431738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 msgr2=0x7fe84009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 --2- 172.21.15.19:0/856431738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe84009dac0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe83c009870 tx=0x7fe83c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 -- 172.21.15.19:0/856431738 shutdown_connections 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 --2- 172.21.15.19:0/856431738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe84009dac0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 --2- 172.21.15.19:0/856431738 >> v2:172.21.15.19:3300/0 conn(0x7fe84009e000 0x7fe8401339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 -- 172.21.15.19:0/856431738 >> 172.21.15.19:0/856431738 conn(0x7fe840066f50 msgr2=0x7fe84009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 -- 172.21.15.19:0/856431738 shutdown_connections 2023-10-03T10:14:27.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.246+0000 7fe847fc8700 1 -- 172.21.15.19:0/856431738 wait complete. 2023-10-03T10:14:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.247+0000 7fe847fc8700 1 Processor -- start 2023-10-03T10:14:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.247+0000 7fe847fc8700 1 -- start start 2023-10-03T10:14:27.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe8401c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe84009e000 0x7fe8401c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 0x7fe8401c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8401a8890 con 0x7fe84009e000 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8400a2ff0 con 0x7fe84009d6f0 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe847fc8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe84009c710 con 0x7fe84009e410 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe845d64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe8401c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.248+0000 7fe846565700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 0x7fe8401c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe845d64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe8401c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45022/0 (socket says 172.21.15.19:45022) 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe845d64700 1 -- 172.21.15.19:0/3235555835 learned_addr learned my addr 172.21.15.19:0/3235555835 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe845563700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe84009e000 0x7fe8401c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 -- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 msgr2=0x7fe8401c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe8401c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 -- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe84009e000 msgr2=0x7fe8401c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe84009e000 0x7fe8401c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 -- 172.21.15.19:0/3235555835 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8300094a0 con 0x7fe84009e410 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe846565700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 0x7fe8401c8920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe83800cbe0 tx=0x7fe83800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83800aaa0 con 0x7fe84009e410 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800ac00 con 0x7fe84009e410 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8380070d0 con 0x7fe84009e410 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c0094a0 con 0x7fe84009e410 2023-10-03T10:14:27.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.249+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8401aaf80 con 0x7fe84009e410 2023-10-03T10:14:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.250+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fe838007230 con 0x7fe84009e410 2023-10-03T10:14:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.251+0000 7fe845d64700 1 -- 172.21.15.19:0/3235555835 >> v1:172.21.15.19:6816/126819 conn(0x7fe82402f510 legacy=0x7fe8240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.251+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fe83803f510 con 0x7fe84009e410 2023-10-03T10:14:27.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.251+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe840074ea0 con 0x7fe84009e410 2023-10-03T10:14:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.260+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe838018080 con 0x7fe84009e410 2023-10-03T10:14:27.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.319+0000 7f113bfff700 1 -- 172.21.15.19:0/2081840008 >> v1:172.21.15.19:6816/126819 conn(0x7f112002f540 legacy=0x7f11200319f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.356+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f113c072210 con 0x7f113c130670 2023-10-03T10:14:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.357+0000 7f11397fa700 1 -- 172.21.15.19:0/2081840008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1130017090 con 0x7f113c130670 2023-10-03T10:14:27.357 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 >> v1:172.21.15.19:6816/126819 conn(0x7f112002f540 legacy=0x7f11200319f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:27.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 msgr2=0x7f113c12d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f113000c530 tx=0x7f113000c840 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 shutdown_connections 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113c135e30 0x7f113c139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113c130670 0x7f113c12d1e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 --2- 172.21.15.19:0/2081840008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113c133510 0x7f113c12d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 >> 172.21.15.19:0/2081840008 conn(0x7f113c0a2aa0 msgr2=0x7f113c133c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 shutdown_connections 2023-10-03T10:14:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.359+0000 7f1142f4e700 1 -- 172.21.15.19:0/2081840008 wait complete. 2023-10-03T10:14:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.366+0000 7f8b289da700 1 -- 172.21.15.19:0/2797488308 >> v1:172.21.15.19:6816/126819 conn(0x7f8b0802f560 legacy=0x7f8b08031a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.404+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8b2406c360 con 0x7f8b2409e000 2023-10-03T10:14:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.405+0000 7f8b217fa700 1 -- 172.21.15.19:0/2797488308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b1001ae80 con 0x7f8b2409e000 2023-10-03T10:14:27.405 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 >> v1:172.21.15.19:6816/126819 conn(0x7f8b0802f560 legacy=0x7f8b08031a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 msgr2=0x7f8b2411f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000c700 tx=0x7f8b1000ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 shutdown_connections 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b2409e410 0x7f8b2411fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b2409d6f0 0x7f8b2411ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 --2- 172.21.15.19:0/2797488308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b2409e000 0x7f8b2411f4d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 >> 172.21.15.19:0/2797488308 conn(0x7f8b24066f50 msgr2=0x7f8b24130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 shutdown_connections 2023-10-03T10:14:27.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.407+0000 7f8b2ac3e700 1 -- 172.21.15.19:0/2797488308 wait complete. 2023-10-03T10:14:27.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:27.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.452+0000 7fe845d64700 1 -- 172.21.15.19:0/3235555835 >> v1:172.21.15.19:6816/126819 conn(0x7fe82402f510 legacy=0x7fe8240319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.485+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe84006c360 con 0x7fe84009e410 2023-10-03T10:14:27.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.486+0000 7fe8367fc700 1 -- 172.21.15.19:0/3235555835 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8380074e0 con 0x7fe84009e410 2023-10-03T10:14:27.486 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:27.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 >> v1:172.21.15.19:6816/126819 conn(0x7fe82402f510 legacy=0x7fe8240319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 msgr2=0x7fe8401c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 0x7fe8401c8920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe83800cbe0 tx=0x7fe83800cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 shutdown_connections 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe84009e410 0x7fe8401c8920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe84009d6f0 0x7fe8401c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 --2- 172.21.15.19:0/3235555835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe84009e000 0x7fe8401c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 >> 172.21.15.19:0/3235555835 conn(0x7fe840066f50 msgr2=0x7fe8401bab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 shutdown_connections 2023-10-03T10:14:27.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:27.488+0000 7fe847fc8700 1 -- 172.21.15.19:0/3235555835 wait complete. 2023-10-03T10:14:27.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:28.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:28.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.381+0000 7fc458efa700 1 Processor -- start 2023-10-03T10:14:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.381+0000 7fc458efa700 1 -- start start 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc458efa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc45409e930 0x7fc45409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc458efa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 0x7fc454131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc458efa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc454070940 con 0x7fc45409f240 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc458efa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45406fd60 con 0x7fc45409e930 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc458efa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45406fa80 con 0x7fc45409f650 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc45409e930 0x7fc45409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc451d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc45409f240 0x7fc4541317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55344/0 (socket says 172.21.15.19:55344) 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc451d9b700 1 -- 172.21.15.19:0/2381420598 learned_addr learned my addr 172.21.15.19:0/2381420598 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc45409e930 0x7fc45409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51102/0 (socket says 172.21.15.19:51102) 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc452d9d700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 0x7fc454131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 -- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 msgr2=0x7fc454131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 0x7fc454131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 -- 172.21.15.19:0/2381420598 >> v1:172.21.15.19:6789/0 conn(0x7fc45409f240 legacy=0x7fc4541317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45259c700 1 -- 172.21.15.19:0/2381420598 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45409fb60 con 0x7fc45409e930 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc45159a700 1 -- 172.21.15.19:0/2381420598 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968254234 0 0) 0x7fc454070940 con 0x7fc45409f240 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.382+0000 7fc452d9d700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 0x7fc454131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.383+0000 7fc45259c700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409e930 0x7fc45409ed00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc444009d90 tx=0x7fc44400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905803dbc36d1133 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.383+0000 7fc45159a700 1 -- 172.21.15.19:0/2381420598 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44400e070 con 0x7fc45409e930 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.383+0000 7fc45159a700 1 -- 172.21.15.19:0/2381420598 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44400bb20 con 0x7fc45409e930 2023-10-03T10:14:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.383+0000 7fc45159a700 1 -- 172.21.15.19:0/2381420598 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc444012430 con 0x7fc45409e930 2023-10-03T10:14:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 -- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409e930 msgr2=0x7fc45409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409e930 0x7fc45409ed00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc444009d90 tx=0x7fc44400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 -- 172.21.15.19:0/2381420598 shutdown_connections 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f650 0x7fc454131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 --2- 172.21.15.19:0/2381420598 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409e930 0x7fc45409ed00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 -- 172.21.15.19:0/2381420598 >> 172.21.15.19:0/2381420598 conn(0x7fc4540a4210 msgr2=0x7fc4540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 -- 172.21.15.19:0/2381420598 shutdown_connections 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.384+0000 7fc458efa700 1 -- 172.21.15.19:0/2381420598 wait complete. 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 Processor -- start 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 -- start start 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 0x7fc4541c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 0x7fc4541c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541a7400 con 0x7fc45409f650 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541a4f70 con 0x7fc45409f240 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.385+0000 7fc458efa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541a75e0 con 0x7fc45409e930 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc451d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 0x7fc4541c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51114/0 (socket says 172.21.15.19:51114) 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc45259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 0x7fc4541c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 -- 172.21.15.19:0/1551488349 learned_addr learned my addr 172.21.15.19:0/1551488349 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 -- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 msgr2=0x7fc4541c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 0x7fc4541c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 -- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 msgr2=0x7fc4541c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 0x7fc4541c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 -- 172.21.15.19:0/1551488349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c0094a0 con 0x7fc45409f650 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc45259c700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 0x7fc4541c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc451d9b700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 0x7fc4541c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc452d9d700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00eb90 tx=0x7fc44c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0097a0 con 0x7fc45409f650 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c004020 con 0x7fc45409f650 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc444009a70 con 0x7fc45409f650 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.386+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0043b0 con 0x7fc45409f650 2023-10-03T10:14:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.387+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4540a0190 con 0x7fc45409f650 2023-10-03T10:14:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.388+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4541a6980 con 0x7fc45409f650 2023-10-03T10:14:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.388+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) v1 ==== 35609+0+0 (secure 0 0 0) 0x7fc44c00c850 con 0x7fc45409f650 2023-10-03T10:14:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.389+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4063+0+0 (secure 0 0 0) 0x7fc44c040070 con 0x7fc45409f650 2023-10-03T10:14:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.389+0000 7fc45259c700 1 -- 172.21.15.19:0/1551488349 >> v1:172.21.15.19:6816/126819 conn(0x7fc43402f510 legacy=0x7fc4340319c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.19:6816/126819 2023-10-03T10:14:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.393+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc44c0036a0 con 0x7fc45409f650 2023-10-03T10:14:28.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.464+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc44c06b750 con 0x7fc45409f650 2023-10-03T10:14:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.464+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 >> v1:172.21.15.19:6816/126819 conn(0x7fc43402f510 legacy=0x7fc4340319c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:14:28.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.524+0000 7effd2f00700 1 Processor -- start 2023-10-03T10:14:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.524+0000 7effd2f00700 1 -- start start 2023-10-03T10:14:28.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd2f00700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd2f00700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 0x7effcc13b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd2f00700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc09ea10 con 0x7effcc0a09c0 2023-10-03T10:14:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd2f00700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc09e210 con 0x7effcc0a14a0 2023-10-03T10:14:28.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd2f00700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0a26f0 con 0x7effcc09d5c0 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45050/0 (socket says 172.21.15.19:45050) 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 -- 172.21.15.19:0/1141748218 learned_addr learned my addr 172.21.15.19:0/1141748218 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd149d700 1 --2- 172.21.15.19:0/1141748218 >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 0x7effcc13b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 -- 172.21.15.19:0/1141748218 >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 msgr2=0x7effcc13b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 --2- 172.21.15.19:0/1141748218 >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 0x7effcc13b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 -- 172.21.15.19:0/1141748218 >> v1:172.21.15.19:6789/0 conn(0x7effcc0a09c0 legacy=0x7effcc0a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effcbfff700 1 -- 172.21.15.19:0/1141748218 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc09db70 con 0x7effcc09d5c0 2023-10-03T10:14:28.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.525+0000 7effd149d700 1 --2- 172.21.15.19:0/1141748218 >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 0x7effcc13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.526+0000 7effcbfff700 1 --2- 172.21.15.19:0/1141748218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b6d0bec9aa0cbd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.526+0000 7effcb7fe700 1 -- 172.21.15.19:0/1141748218 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011830 con 0x7effcc09d5c0 2023-10-03T10:14:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.526+0000 7effcb7fe700 1 -- 172.21.15.19:0/1141748218 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8011990 con 0x7effcc09d5c0 2023-10-03T10:14:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.526+0000 7effcb7fe700 1 -- 172.21.15.19:0/1141748218 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8011d20 con 0x7effcc09d5c0 2023-10-03T10:14:28.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 -- 172.21.15.19:0/1141748218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 msgr2=0x7effcc138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 --2- 172.21.15.19:0/1141748218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7effb80098f0 tx=0x7effb8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 -- 172.21.15.19:0/1141748218 shutdown_connections 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 --2- 172.21.15.19:0/1141748218 >> v2:172.21.15.19:3300/0 conn(0x7effcc0a14a0 0x7effcc13b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 --2- 172.21.15.19:0/1141748218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc09d5c0 0x7effcc138d70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 -- 172.21.15.19:0/1141748218 >> 172.21.15.19:0/1141748218 conn(0x7effcc0a2fe0 msgr2=0x7effcc0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 -- 172.21.15.19:0/1141748218 shutdown_connections 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.527+0000 7effd2f00700 1 -- 172.21.15.19:0/1141748218 wait complete. 2023-10-03T10:14:28.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.528+0000 7effd2f00700 1 Processor -- start 2023-10-03T10:14:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 -- start start 2023-10-03T10:14:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc0a09c0 0x7effcc11ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effcc0a14a0 0x7effcc11d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc11fec0 con 0x7effcc0a14a0 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc11e1e0 con 0x7effcc0a09c0 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.529+0000 7effd2f00700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1200c0 con 0x7effcc09d5c0 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41180/0 (socket says 172.21.15.19:41180) 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 -- 172.21.15.19:0/1275311306 learned_addr learned my addr 172.21.15.19:0/1275311306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effcbfff700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc0a09c0 0x7effcc11ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 -- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc0a09c0 msgr2=0x7effcc11ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc0a09c0 0x7effcc11ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 -- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effcc0a14a0 msgr2=0x7effcc11d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effcc0a14a0 0x7effcc11d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 -- 172.21.15.19:0/1275311306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4009a70 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.530+0000 7effd0c9c700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7effc000c4e0 tx=0x7effc000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.531+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00052d0 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.531+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc0005430 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.531+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb8009550 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.531+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00038c0 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.531+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc0a5040 con 0x7effcc09d5c0 2023-10-03T10:14:28.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.532+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effc0003a20 con 0x7effcc09d5c0 2023-10-03T10:14:28.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.532+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effc003ebe0 con 0x7effcc09d5c0 2023-10-03T10:14:28.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.532+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc0747f0 con 0x7effcc09d5c0 2023-10-03T10:14:28.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.538+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effc0017070 con 0x7effcc09d5c0 2023-10-03T10:14:28.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.572+0000 7f7ce2b6e700 1 Processor -- start 2023-10-03T10:14:28.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.572+0000 7f7ce2b6e700 1 -- start start 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce2b6e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce2b6e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cdc136f50 0x7f7cdc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce2b6e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc071a00 con 0x7f7cdc131630 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce2b6e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc131430 con 0x7f7cdc136f50 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce2b6e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc09a510 con 0x7f7cdc134630 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cdc136f50 0x7f7cdc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cdc136f50 0x7f7cdc139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51146/0 (socket says 172.21.15.19:51146) 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 -- 172.21.15.19:0/3074182609 learned_addr learned my addr 172.21.15.19:0/3074182609 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7cdbfff700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 -- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 msgr2=0x7f7cdc136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 -- 172.21.15.19:0/3074182609 >> v1:172.21.15.19:6789/0 conn(0x7f7cdc131630 legacy=0x7f7cdc131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.573+0000 7f7ce110b700 1 -- 172.21.15.19:0/3074182609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0721c0 con 0x7f7cdc136f50 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7ce110b700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc136f50 0x7f7cdc139330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009e50 tx=0x7f7cd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897288c15718a351 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7cdb7fe700 1 -- 172.21.15.19:0/3074182609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400e070 con 0x7f7cdc136f50 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7cdb7fe700 1 -- 172.21.15.19:0/3074182609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd400b9c0 con 0x7f7cdc136f50 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7cdb7fe700 1 -- 172.21.15.19:0/3074182609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd400bd70 con 0x7f7cdc136f50 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc136f50 msgr2=0x7f7cdc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.574+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc136f50 0x7f7cdc139330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009e50 tx=0x7f7cd400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3074182609 shutdown_connections 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc136f50 0x7f7cdc139330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3074182609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3074182609 >> 172.21.15.19:0/3074182609 conn(0x7f7cdc0a2aa0 msgr2=0x7f7cdc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3074182609 shutdown_connections 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.575+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3074182609 wait complete. 2023-10-03T10:14:28.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 Processor -- start 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 -- start start 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc131630 0x7f7cdc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cdc136f50 0x7f7cdc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc12e370 con 0x7f7cdc131630 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc11af40 con 0x7f7cdc136f50 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7ce2b6e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc11c5f0 con 0x7f7cdc134630 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.576+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41190/0 (socket says 172.21.15.19:41190) 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 -- 172.21.15.19:0/3682870629 learned_addr learned my addr 172.21.15.19:0/3682870629 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7ce110b700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cdc136f50 0x7f7cdc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 -- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cdc136f50 msgr2=0x7f7cdc119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cdc136f50 0x7f7cdc119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 -- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc131630 msgr2=0x7f7cdc118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc131630 0x7f7cdc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 -- 172.21.15.19:0/3682870629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009b30 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cdbfff700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800e840 tx=0x7f7cc800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8013610 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc136d20 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc11c310 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8013770 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.577+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8013ae0 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.579+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cc8013c40 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.579+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7cc803f390 con 0x7f7cdc134630 2023-10-03T10:14:28.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.579+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc0052e0 con 0x7f7cdc134630 2023-10-03T10:14:28.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.584+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cc8012370 con 0x7f7cdc134630 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.617+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc4541a7260 con 0x7fc45409f650 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.617+0000 7fc442ffd700 1 -- 172.21.15.19:0/1551488349 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc4541a7260 con 0x7fc45409f650 2023-10-03T10:14:28.617 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 msgr2=0x7fc4541c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00eb90 tx=0x7fc44c00eea0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 shutdown_connections 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc45409f650 0x7fc4541c5e40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc45409e930 0x7fc4541c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 --2- 172.21.15.19:0/1551488349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc45409f240 0x7fc4541c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 >> 172.21.15.19:0/1551488349 conn(0x7fc4540a4210 msgr2=0x7fc4541b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 shutdown_connections 2023-10-03T10:14:28.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.620+0000 7fc458efa700 1 -- 172.21.15.19:0/1551488349 wait complete. 2023-10-03T10:14:28.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.667+0000 7f9f42196700 1 Processor -- start 2023-10-03T10:14:28.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.667+0000 7f9f42196700 1 -- start start 2023-10-03T10:14:28.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f42196700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 0x7f9f3c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f42196700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 0x7f9f3c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f42196700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c09edd0 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f42196700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0a18e0 con 0x7f9f3c0a1510 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f42196700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c09e1f0 con 0x7f9f3c139250 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f3bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 0x7f9f3c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 0x7f9f3c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f3bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 0x7f9f3c13b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41192/0 (socket says 172.21.15.19:41192) 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f3bfff700 1 -- 172.21.15.19:0/2580933095 learned_addr learned my addr 172.21.15.19:0/2580933095 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 -- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 msgr2=0x7f9f3c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:28.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 --2- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 0x7f9f3c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 -- 172.21.15.19:0/2580933095 >> v1:172.21.15.19:6789/0 conn(0x7f9f3c0a0a30 legacy=0x7f9f3c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 -- 172.21.15.19:0/2580933095 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c09dc50 con 0x7f9f3c0a1510 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.668+0000 7f9f32ffd700 1 --2- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 0x7f9f3c138d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009870 tx=0x7f9f24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c53fbb3aa13e693a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f3affd700 1 -- 172.21.15.19:0/2580933095 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24011830 con 0x7f9f3c0a1510 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f3affd700 1 -- 172.21.15.19:0/2580933095 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24011990 con 0x7f9f3c0a1510 2023-10-03T10:14:28.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f3affd700 1 -- 172.21.15.19:0/2580933095 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24011d20 con 0x7f9f3c0a1510 2023-10-03T10:14:28.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 -- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 msgr2=0x7f9f3c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 --2- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 0x7f9f3c138d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009870 tx=0x7f9f24009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 -- 172.21.15.19:0/2580933095 shutdown_connections 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 --2- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c139250 0x7f9f3c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 --2- 172.21.15.19:0/2580933095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a1510 0x7f9f3c138d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 -- 172.21.15.19:0/2580933095 >> 172.21.15.19:0/2580933095 conn(0x7f9f3c0a6550 msgr2=0x7f9f3c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 -- 172.21.15.19:0/2580933095 shutdown_connections 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.669+0000 7f9f42196700 1 -- 172.21.15.19:0/2580933095 wait complete. 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.670+0000 7f9f42196700 1 Processor -- start 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 -- start start 2023-10-03T10:14:28.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 0x7f9f3c1c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c139250 0x7f9f3c1c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c123690 con 0x7f9f3c139250 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c123d70 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f42196700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c138e10 con 0x7f9f3c0a1510 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f32ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f32ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41196/0 (socket says 172.21.15.19:41196) 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f3b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 0x7f9f3c1c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f32ffd700 1 -- 172.21.15.19:0/1658257399 learned_addr learned my addr 172.21.15.19:0/1658257399 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.671+0000 7f9f3bfff700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c139250 0x7f9f3c1c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 -- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 msgr2=0x7f9f3c1c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 -- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c139250 msgr2=0x7f9f3c1c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c139250 0x7f9f3c1c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 -- 172.21.15.19:0/1658257399 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240094a0 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f32ffd700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f3b7fe700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 0x7f9f3c1c8440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c000f60 tx=0x7f9f2c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0052d0 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c005430 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c0a0220 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0038c0 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.672+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c125420 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.673+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f2c003a20 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.673+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c074ea0 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.673+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f2c03e950 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.683+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f2c00ce30 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.764+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effcc0008d0 con 0x7effcc09d5c0 2023-10-03T10:14:28.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.764+0000 7effc97fa700 1 -- 172.21.15.19:0/1275311306 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effc0018260 con 0x7effcc09d5c0 2023-10-03T10:14:28.764 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 msgr2=0x7effcc11c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7effc000c4e0 tx=0x7effc000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 shutdown_connections 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effcc0a14a0 0x7effcc11d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effcc09d5c0 0x7effcc11c7b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 --2- 172.21.15.19:0/1275311306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effcc0a09c0 0x7effcc11ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 >> 172.21.15.19:0/1275311306 conn(0x7effcc0a2fe0 msgr2=0x7effcc09a200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 shutdown_connections 2023-10-03T10:14:28.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.767+0000 7effd2f00700 1 -- 172.21.15.19:0/1275311306 wait complete. 2023-10-03T10:14:28.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:28.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.796+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cbc005590 con 0x7f7cdc134630 2023-10-03T10:14:28.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.796+0000 7f7cd97fa700 1 -- 172.21.15.19:0/3682870629 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cc8021020 con 0x7f7cdc134630 2023-10-03T10:14:28.796 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 msgr2=0x7f7cdc119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800e840 tx=0x7f7cc800eb50 comp rx=0 tx=0).stop 2023-10-03T10:14:28.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 shutdown_connections 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cdc136f50 0x7f7cdc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cdc131630 0x7f7cdc118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 --2- 172.21.15.19:0/3682870629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cdc134630 0x7f7cdc119210 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 >> 172.21.15.19:0/3682870629 conn(0x7f7cdc0a2aa0 msgr2=0x7f7cdc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 shutdown_connections 2023-10-03T10:14:28.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.798+0000 7f7ce2b6e700 1 -- 172.21.15.19:0/3682870629 wait complete. 2023-10-03T10:14:28.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:28.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.893+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f3c0a1d10 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.893+0000 7f9f38ff9700 1 -- 172.21.15.19:0/1658257399 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f2c017030 con 0x7f9f3c0a0a30 2023-10-03T10:14:28.893 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:28.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 msgr2=0x7f9f3c1c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 0x7f9f3c1c8440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c000f60 tx=0x7f9f2c00c730 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 shutdown_connections 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c139250 0x7f9f3c1c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c0a0a30 0x7f9f3c1c8440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 --2- 172.21.15.19:0/1658257399 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c0a1510 0x7f9f3c1c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.895+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 >> 172.21.15.19:0/1658257399 conn(0x7f9f3c0a6550 msgr2=0x7f9f3c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.896+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 shutdown_connections 2023-10-03T10:14:28.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:28.896+0000 7f9f42196700 1 -- 172.21.15.19:0/1658257399 wait complete. 2023-10-03T10:14:28.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:29.640 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:29.782 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.786+0000 7f9de4812700 1 Processor -- start 2023-10-03T10:14:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.786+0000 7f9de4812700 1 -- start start 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9de4812700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9de4812700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9de4812700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de009edd0 con 0x7f9de00a1340 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9de4812700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de009e1f0 con 0x7f9de0134170 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9de4812700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de009dc50 con 0x7f9de00a0a30 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9dd5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9de00a1340 0x7f9de0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55378/0 (socket says 172.21.15.19:55378) 2023-10-03T10:14:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9dd5d9b700 1 -- 172.21.15.19:0/311465012 learned_addr learned my addr 172.21.15.19:0/311465012 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9dded9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9dde59c700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dded9d700 1 -- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 msgr2=0x7f9de00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.787+0000 7f9dddd9b700 1 -- 172.21.15.19:0/311465012 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118456628 0 0) 0x7f9de009edd0 con 0x7f9de00a1340 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dded9d700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dded9d700 1 -- 172.21.15.19:0/311465012 >> v1:172.21.15.19:6789/0 conn(0x7f9de00a1340 legacy=0x7f9de0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dded9d700 1 -- 172.21.15.19:0/311465012 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de00a1fe0 con 0x7f9de0134170 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dde59c700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dded9d700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de013bd30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009dc0 tx=0x7f9dd800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e3973d4e2e3444a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dddd9b700 1 -- 172.21.15.19:0/311465012 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800e070 con 0x7f9de0134170 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dddd9b700 1 -- 172.21.15.19:0/311465012 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd800bb20 con 0x7f9de0134170 2023-10-03T10:14:29.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.788+0000 7f9dddd9b700 1 -- 172.21.15.19:0/311465012 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8012430 con 0x7f9de0134170 2023-10-03T10:14:29.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 -- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 msgr2=0x7f9de013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de013bd30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009dc0 tx=0x7f9dd800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 -- 172.21.15.19:0/311465012 shutdown_connections 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de013bd30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 --2- 172.21.15.19:0/311465012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 -- 172.21.15.19:0/311465012 >> 172.21.15.19:0/311465012 conn(0x7f9de00a6550 msgr2=0x7f9de00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 -- 172.21.15.19:0/311465012 shutdown_connections 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.789+0000 7f9de4812700 1 -- 172.21.15.19:0/311465012 wait complete. 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.790+0000 7f9de4812700 1 Processor -- start 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.790+0000 7f9de4812700 1 -- start start 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de00716e0 con 0x7f9de00a1340 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de0071270 con 0x7f9de0134170 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9de4812700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9de006f6e0 con 0x7f9de00a0a30 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dd5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dded9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dd5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51174/0 (socket says 172.21.15.19:51174) 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dd5d9b700 1 -- 172.21.15.19:0/1149004280 learned_addr learned my addr 172.21.15.19:0/1149004280 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 -- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 msgr2=0x7f9de006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de006e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 -- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 msgr2=0x7f9de006e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dde59c700 1 -- 172.21.15.19:0/1149004280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00094a0 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.791+0000 7f9dd5d9b700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9dde59c700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de006dac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e9b0 tx=0x7f9dd000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000ee50 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd000c850 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000cc00 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8009a70 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.792+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de00a25e0 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.793+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dd0013470 con 0x7f9de00a0a30 2023-10-03T10:14:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.793+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dd003f750 con 0x7f9de00a0a30 2023-10-03T10:14:29.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.793+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de006fe90 con 0x7f9de00a0a30 2023-10-03T10:14:29.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.798+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dd0013720 con 0x7f9de00a0a30 2023-10-03T10:14:29.813 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:29.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:29.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.925+0000 7f1fdfd9d700 1 Processor -- start 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 -- start start 2023-10-03T10:14:29.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 0x7f1fd8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd813b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd806f720 con 0x7f1fd81341d0 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd8070c80 con 0x7f1fd81338c0 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fdfd9d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd806fce0 con 0x7f1fd809e560 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.926+0000 7f1fde33a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd813b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fdd338700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1fd81341d0 0x7f1fd809de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55384/0 (socket says 172.21.15.19:55384) 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fdd338700 1 -- 172.21.15.19:0/1103499550 learned_addr learned my addr 172.21.15.19:0/1103499550 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fddb39700 1 --2- 172.21.15.19:0/1103499550 >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 0x7f1fd8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fde33a700 1 -- 172.21.15.19:0/1103499550 >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 msgr2=0x7f1fd8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1103499550 >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 0x7f1fd8133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fde33a700 1 -- 172.21.15.19:0/1103499550 >> v1:172.21.15.19:6789/0 conn(0x7f1fd81341d0 legacy=0x7f1fd809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fde33a700 1 -- 172.21.15.19:0/1103499550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd81336a0 con 0x7f1fd809e560 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fddb39700 1 --2- 172.21.15.19:0/1103499550 >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 0x7f1fd8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1103499550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd813b860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009d90 tx=0x7f1fd000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d428402d6c7d3fc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fdcb37700 1 -- 172.21.15.19:0/1103499550 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd000e070 con 0x7f1fd809e560 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fdcb37700 1 -- 172.21.15.19:0/1103499550 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000bb20 con 0x7f1fd809e560 2023-10-03T10:14:29.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.927+0000 7f1fdcb37700 1 -- 172.21.15.19:0/1103499550 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012430 con 0x7f1fd809e560 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1103499550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 msgr2=0x7f1fd813b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 --2- 172.21.15.19:0/1103499550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd813b860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009d90 tx=0x7f1fd000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1103499550 shutdown_connections 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 --2- 172.21.15.19:0/1103499550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd813b860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 --2- 172.21.15.19:0/1103499550 >> v2:172.21.15.19:3300/0 conn(0x7f1fd81338c0 0x7f1fd8133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1103499550 >> 172.21.15.19:0/1103499550 conn(0x7f1fd80a2aa0 msgr2=0x7f1fd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1103499550 shutdown_connections 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.928+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1103499550 wait complete. 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.930+0000 7f1fdfd9d700 1 Processor -- start 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.930+0000 7f1fdfd9d700 1 -- start start 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fd81338c0 0x7f1fd811fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 0x7f1fd8120530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80a1220 con 0x7f1fd81341d0 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd806f960 con 0x7f1fd81338c0 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdfd9d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81309a0 con 0x7f1fd809e560 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fddb39700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fddb39700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41240/0 (socket says 172.21.15.19:41240) 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fddb39700 1 -- 172.21.15.19:0/1472624782 learned_addr learned my addr 172.21.15.19:0/1472624782 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 0x7f1fd8120530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fdd338700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fd81338c0 0x7f1fd811fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 -- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 msgr2=0x7f1fd811fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 -- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fd81338c0 msgr2=0x7f1fd811fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fd81338c0 0x7f1fd811fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fde33a700 1 -- 172.21.15.19:0/1472624782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd40094a0 con 0x7f1fd81341d0 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.931+0000 7f1fddb39700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fde33a700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 0x7f1fd8120530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0016000 tx=0x7f1fd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0012430 con 0x7f1fd81341d0 2023-10-03T10:14:29.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd0020070 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0004040 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1472624782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd0009a70 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.932+0000 7f1fdfd9d700 1 -- 172.21.15.19:0/1472624782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd8121700 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.933+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fd00041a0 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.933+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fd0022070 con 0x7f1fd81341d0 2023-10-03T10:14:29.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.934+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd8130540 con 0x7f1fd81341d0 2023-10-03T10:14:29.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.939+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fd0004450 con 0x7f1fd81341d0 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.962+0000 7fe4a3336700 1 Processor -- start 2023-10-03T10:14:29.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.962+0000 7fe4a3336700 1 -- start start 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a3336700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 0x7fe49c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a3336700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 0x7fe49c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a3336700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c09a810 con 0x7fe49c09dc30 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a3336700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c06ab40 con 0x7fe49c06a770 2023-10-03T10:14:29.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a3336700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c09ebc0 con 0x7fe49c13d1f0 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a08d1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe49c09dc30 0x7fe49c09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55392/0 (socket says 172.21.15.19:55392) 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a10d2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 0x7fe49c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a08d1700 1 -- 172.21.15.19:0/125504992 learned_addr learned my addr 172.21.15.19:0/125504992 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:29.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.963+0000 7fe4a18d3700 1 --2- 172.21.15.19:0/125504992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 0x7fe49c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a18d3700 1 -- 172.21.15.19:0/125504992 >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 msgr2=0x7fe49c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a18d3700 1 --2- 172.21.15.19:0/125504992 >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 0x7fe49c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a18d3700 1 -- 172.21.15.19:0/125504992 >> v1:172.21.15.19:6789/0 conn(0x7fe49c09dc30 legacy=0x7fe49c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a18d3700 1 -- 172.21.15.19:0/125504992 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c09e920 con 0x7fe49c13d1f0 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe493fff700 1 -- 172.21.15.19:0/125504992 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759031130 0 0) 0x7fe49c09a810 con 0x7fe49c09dc30 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a10d2700 1 --2- 172.21.15.19:0/125504992 >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 0x7fe49c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe4a18d3700 1 --2- 172.21.15.19:0/125504992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 0x7fe49c13f5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe494009d90 tx=0x7fe49400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6113a5831d99327 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe493fff700 1 -- 172.21.15.19:0/125504992 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400e070 con 0x7fe49c13d1f0 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe493fff700 1 -- 172.21.15.19:0/125504992 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49400bb20 con 0x7fe49c13d1f0 2023-10-03T10:14:29.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.964+0000 7fe493fff700 1 -- 172.21.15.19:0/125504992 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494012430 con 0x7fe49c13d1f0 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 -- 172.21.15.19:0/125504992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 msgr2=0x7fe49c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 --2- 172.21.15.19:0/125504992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 0x7fe49c13f5d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe494009d90 tx=0x7fe49400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 -- 172.21.15.19:0/125504992 shutdown_connections 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 --2- 172.21.15.19:0/125504992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c13d1f0 0x7fe49c13f5d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 --2- 172.21.15.19:0/125504992 >> v2:172.21.15.19:3300/0 conn(0x7fe49c06a770 0x7fe49c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 -- 172.21.15.19:0/125504992 >> 172.21.15.19:0/125504992 conn(0x7fe49c066f50 msgr2=0x7fe49c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 -- 172.21.15.19:0/125504992 shutdown_connections 2023-10-03T10:14:29.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.965+0000 7fe4a3336700 1 -- 172.21.15.19:0/125504992 wait complete. 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.966+0000 7fe4a3336700 1 Processor -- start 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.966+0000 7fe4a3336700 1 -- start start 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 0x7fe49c11bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe49c13d1f0 0x7fe49c11c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c11aca0 con 0x7fe49c13d1f0 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c11a070 con 0x7fe49c09dc30 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a3336700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c119cb0 con 0x7fe49c06a770 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41250/0 (socket says 172.21.15.19:41250) 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 -- 172.21.15.19:0/2307194727 learned_addr learned my addr 172.21.15.19:0/2307194727 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:29.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a08d1700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 0x7fe49c11bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 -- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 msgr2=0x7fe49c11bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 0x7fe49c11bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 -- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe49c13d1f0 msgr2=0x7fe49c11c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe49c13d1f0 0x7fe49c11c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a10d2700 1 -- 172.21.15.19:0/2307194727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4980094a0 con 0x7fe49c06a770 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.967+0000 7fe4a08d1700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 0x7fe49c11bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe4a10d2700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe49800ebe0 tx=0x7fe49800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe498009800 con 0x7fe49c06a770 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49800c910 con 0x7fe49c06a770 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe494009a70 con 0x7fe49c06a770 2023-10-03T10:14:29.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49800cc80 con 0x7fe49c06a770 2023-10-03T10:14:29.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.968+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c09f1a0 con 0x7fe49c06a770 2023-10-03T10:14:29.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.969+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe498013470 con 0x7fe49c06a770 2023-10-03T10:14:29.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.969+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe49803f950 con 0x7fe49c06a770 2023-10-03T10:14:29.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.970+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c11a610 con 0x7fe49c06a770 2023-10-03T10:14:29.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:29.980+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe498021080 con 0x7fe49c06a770 2023-10-03T10:14:30.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.025+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9de0074ea0 con 0x7f9de00a0a30 2023-10-03T10:14:30.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.025+0000 7f9dd77fe700 1 -- 172.21.15.19:0/1149004280 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dd0017020 con 0x7f9de00a0a30 2023-10-03T10:14:30.025 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.027+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 msgr2=0x7f9de006dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.027+0000 7f9de4812700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de006dac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000e9b0 tx=0x7f9dd000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 shutdown_connections 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9de0134170 0x7f9de006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9de00a0a30 0x7f9de006dac0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 --2- 172.21.15.19:0/1149004280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9de00a1340 0x7f9de006e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 >> 172.21.15.19:0/1149004280 conn(0x7f9de00a6550 msgr2=0x7f9de009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 shutdown_connections 2023-10-03T10:14:30.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.028+0000 7f9de4812700 1 -- 172.21.15.19:0/1149004280 wait complete. 2023-10-03T10:14:30.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:30.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 Processor -- start 2023-10-03T10:14:30.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 -- start start 2023-10-03T10:14:30.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5809b120 con 0x7fdc5809e000 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5806b460 con 0x7fdc5809d6f0 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc5ed0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5809a7e0 con 0x7fdc5809e410 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.057+0000 7fdc57fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdc5809e000 0x7fdc581339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55404/0 (socket says 172.21.15.19:55404) 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc57fff700 1 -- 172.21.15.19:0/2256878641 learned_addr learned my addr 172.21.15.19:0/2256878641 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5d2ab700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc577fe700 1 -- 172.21.15.19:0/2256878641 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058579192 0 0) 0x7fdc5809b120 con 0x7fdc5809e000 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc577fe700 1 -- 172.21.15.19:0/2256878641 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc400035b0 con 0x7fdc5809e000 2023-10-03T10:14:30.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 -- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809e410 msgr2=0x7fdc58134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 -- 172.21.15.19:0/2256878641 >> v1:172.21.15.19:6789/0 conn(0x7fdc5809e000 legacy=0x7fdc581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 -- 172.21.15.19:0/2256878641 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc5809a500 con 0x7fdc5809d6f0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5d18d5249e7dfa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.058+0000 7fdc577fe700 1 -- 172.21.15.19:0/2256878641 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011830 con 0x7fdc5809d6f0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc577fe700 1 -- 172.21.15.19:0/2256878641 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c011990 con 0x7fdc5809d6f0 2023-10-03T10:14:30.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc577fe700 1 -- 172.21.15.19:0/2256878641 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c011d20 con 0x7fdc5809d6f0 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 msgr2=0x7fdc5809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/2256878641 shutdown_connections 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809e410 0x7fdc58134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/2256878641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809d6f0 0x7fdc5809dac0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/2256878641 >> 172.21.15.19:0/2256878641 conn(0x7fdc58066f50 msgr2=0x7fdc5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/2256878641 shutdown_connections 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.059+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/2256878641 wait complete. 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.060+0000 7fdc5ed0e700 1 Processor -- start 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.060+0000 7fdc5ed0e700 1 -- start start 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 0x7fdc58122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809e410 0x7fdc58122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58133820 con 0x7fdc5809e000 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc581238b0 con 0x7fdc5809e410 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5ed0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc58124ef0 con 0x7fdc5809d6f0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc57fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 0x7fdc58122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41276/0 (socket says 172.21.15.19:41276) 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 -- 172.21.15.19:0/1448620221 learned_addr learned my addr 172.21.15.19:0/1448620221 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5d2ab700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809e410 0x7fdc58122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 -- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809e410 msgr2=0x7fdc58122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809e410 0x7fdc58122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 -- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 msgr2=0x7fdc58122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 0x7fdc58122990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc5caaa700 1 -- 172.21.15.19:0/1448620221 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c0094a0 con 0x7fdc5809d6f0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.061+0000 7fdc57fff700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 0x7fdc58122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc5caaa700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009840 tx=0x7fdc4c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c004450 con 0x7fdc5809d6f0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c01f070 con 0x7fdc5809d6f0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc58125700 con 0x7fdc5809d6f0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0038e0 con 0x7fdc5809d6f0 2023-10-03T10:14:30.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.062+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc58125c90 con 0x7fdc5809d6f0 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.063+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc4c003a40 con 0x7fdc5809d6f0 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.063+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc4c021070 con 0x7fdc5809d6f0 2023-10-03T10:14:30.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.063+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc581252b0 con 0x7fdc5809d6f0 2023-10-03T10:14:30.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.068+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc4c01a430 con 0x7fdc5809d6f0 2023-10-03T10:14:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.158+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1fd8074ea0 con 0x7f1fd81341d0 2023-10-03T10:14:30.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.158+0000 7f1fce7fc700 1 -- 172.21.15.19:0/1472624782 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fd002c020 con 0x7f1fd81341d0 2023-10-03T10:14:30.158 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 msgr2=0x7f1fd8120530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 0x7f1fd8120530 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0016000 tx=0x7f1fd0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 shutdown_connections 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fd81341d0 0x7f1fd8120530 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fd809e560 0x7f1fd811fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 --2- 172.21.15.19:0/1472624782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fd81338c0 0x7f1fd811fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 >> 172.21.15.19:0/1472624782 conn(0x7f1fd80a2aa0 msgr2=0x7f1fd809fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 shutdown_connections 2023-10-03T10:14:30.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.162+0000 7f1fbbfff700 1 -- 172.21.15.19:0/1472624782 wait complete. 2023-10-03T10:14:30.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:30.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.193+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe49c074ea0 con 0x7fe49c06a770 2023-10-03T10:14:30.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.194+0000 7fe491ffb700 1 -- 172.21.15.19:0/2307194727 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe49801bd90 con 0x7fe49c06a770 2023-10-03T10:14:30.194 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 msgr2=0x7fe49c11b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe49800ebe0 tx=0x7fe49800eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 shutdown_connections 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe49c13d1f0 0x7fe49c11c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe49c06a770 0x7fe49c11b880 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 --2- 172.21.15.19:0/2307194727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe49c09dc30 0x7fe49c11bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 >> 172.21.15.19:0/2307194727 conn(0x7fe49c066f50 msgr2=0x7fe49c13c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 shutdown_connections 2023-10-03T10:14:30.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.196+0000 7fe4a3336700 1 -- 172.21.15.19:0/2307194727 wait complete. 2023-10-03T10:14:30.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:30.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.275+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc58125930 con 0x7fdc5809d6f0 2023-10-03T10:14:30.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.275+0000 7fdc557fa700 1 -- 172.21.15.19:0/1448620221 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc4c02b030 con 0x7fdc5809d6f0 2023-10-03T10:14:30.275 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 msgr2=0x7fdc58122450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009840 tx=0x7fdc4c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 shutdown_connections 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc5809e410 0x7fdc58122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc5809d6f0 0x7fdc58122450 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 --2- 172.21.15.19:0/1448620221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc5809e000 0x7fdc58122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:30.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 >> 172.21.15.19:0/1448620221 conn(0x7fdc58066f50 msgr2=0x7fdc58133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:30.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 shutdown_connections 2023-10-03T10:14:30.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:30.278+0000 7fdc5ed0e700 1 -- 172.21.15.19:0/1448620221 wait complete. 2023-10-03T10:14:30.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:31.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:31.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 Processor -- start 2023-10-03T10:14:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 -- start start 2023-10-03T10:14:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 0x7fbf48138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 0x7fbf4813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4809b120 con 0x7fbf4809d6f0 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4806b460 con 0x7fbf4809e1d0 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4cac9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4809a7e0 con 0x7fbf48139170 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 0x7fbf4813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbf4809d6f0 0x7fbf4809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55420/0 (socket says 172.21.15.19:55420) 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf4659c700 1 -- 172.21.15.19:0/90995213 learned_addr learned my addr 172.21.15.19:0/90995213 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.188+0000 7fbf3dd9b700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 0x7fbf48138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf3dd9b700 1 -- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 msgr2=0x7fbf4813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf3dd9b700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 0x7fbf4813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf45d9b700 1 -- 172.21.15.19:0/90995213 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 272044680 0 0) 0x7fbf4809b120 con 0x7fbf4809d6f0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf3dd9b700 1 -- 172.21.15.19:0/90995213 >> v1:172.21.15.19:6789/0 conn(0x7fbf4809d6f0 legacy=0x7fbf4809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf3dd9b700 1 -- 172.21.15.19:0/90995213 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4809a500 con 0x7fbf4809e1d0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf46d9d700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 0x7fbf4813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf3dd9b700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 0x7fbf48138c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009870 tx=0x7fbf30009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41d72ee625348a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf45d9b700 1 -- 172.21.15.19:0/90995213 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011830 con 0x7fbf4809e1d0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf45d9b700 1 -- 172.21.15.19:0/90995213 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30011990 con 0x7fbf4809e1d0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.189+0000 7fbf45d9b700 1 -- 172.21.15.19:0/90995213 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf30011d20 con 0x7fbf4809e1d0 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 -- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 msgr2=0x7fbf48138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 0x7fbf48138c30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009870 tx=0x7fbf30009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 -- 172.21.15.19:0/90995213 shutdown_connections 2023-10-03T10:14:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf48139170 0x7fbf4813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/90995213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4809e1d0 0x7fbf48138c30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 -- 172.21.15.19:0/90995213 >> 172.21.15.19:0/90995213 conn(0x7fbf48066f50 msgr2=0x7fbf4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 -- 172.21.15.19:0/90995213 shutdown_connections 2023-10-03T10:14:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.190+0000 7fbf4cac9700 1 -- 172.21.15.19:0/90995213 wait complete. 2023-10-03T10:14:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.191+0000 7fbf4cac9700 1 Processor -- start 2023-10-03T10:14:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 -- start start 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 0x7fbf48120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 0x7fbf481211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48122ba0 con 0x7fbf4809e1d0 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48136610 con 0x7fbf48139170 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4cac9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4809c710 con 0x7fbf4809d6f0 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf3dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 0x7fbf48120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41300/0 (socket says 172.21.15.19:41300) 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf4659c700 1 -- 172.21.15.19:0/3609957497 learned_addr learned my addr 172.21.15.19:0/3609957497 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.192+0000 7fbf46d9d700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 0x7fbf481211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 -- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 msgr2=0x7fbf481211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 0x7fbf481211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 -- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 msgr2=0x7fbf48120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 0x7fbf48120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 -- 172.21.15.19:0/3609957497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf40009a70 con 0x7fbf4809d6f0 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf46d9d700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 0x7fbf481211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf3dd9b700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 0x7fbf48120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4659c700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c520 tx=0x7fbf3800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38004c80 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38004e00 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf300094a0 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf38007310 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.193+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48072150 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.194+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf38007470 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.194+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf48123e80 con 0x7fbf4809d6f0 2023-10-03T10:14:31.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.194+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf3803f300 con 0x7fbf4809d6f0 2023-10-03T10:14:31.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.199+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf380133c0 con 0x7fbf4809d6f0 2023-10-03T10:14:31.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:31.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.319+0000 7f0d76891700 1 Processor -- start 2023-10-03T10:14:31.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.319+0000 7f0d76891700 1 -- start start 2023-10-03T10:14:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d701338a0 0x7f0d70133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 0x7f0d7013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7006fef0 con 0x7f0d701338a0 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7006ef30 con 0x7f0d7009de50 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d76891700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701334b0 con 0x7f0d7009e760 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d74e2e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 0x7f0d7013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d6f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d6f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45154/0 (socket says 172.21.15.19:45154) 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d74e2e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 0x7f0d7013a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41308/0 (socket says 172.21.15.19:41308) 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/4046312609 learned_addr learned my addr 172.21.15.19:0/4046312609 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.320+0000 7f0d6ffff700 1 --2- 172.21.15.19:0/4046312609 >> v2:172.21.15.19:3300/0 conn(0x7f0d701338a0 0x7f0d70133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 -- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 msgr2=0x7f0d7013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 0x7f0d7013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 -- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 msgr2=0x7f0d7009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 -- 172.21.15.19:0/4046312609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7006fc30 con 0x7f0d701338a0 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6f7fe700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6ffff700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d701338a0 0x7f0d70133c70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009840 tx=0x7f0d60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb2781d730e94a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6effd700 1 -- 172.21.15.19:0/4046312609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60011830 con 0x7f0d701338a0 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6effd700 1 -- 172.21.15.19:0/4046312609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d60011990 con 0x7f0d701338a0 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.321+0000 7f0d6effd700 1 -- 172.21.15.19:0/4046312609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60011d20 con 0x7f0d701338a0 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 -- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d701338a0 msgr2=0x7f0d70133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d701338a0 0x7f0d70133c70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009840 tx=0x7f0d60009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 -- 172.21.15.19:0/4046312609 shutdown_connections 2023-10-03T10:14:31.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009e760 0x7f0d7013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d701338a0 0x7f0d70133c70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 --2- 172.21.15.19:0/4046312609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.322+0000 7f0d76891700 1 -- 172.21.15.19:0/4046312609 >> 172.21.15.19:0/4046312609 conn(0x7f0d700a2aa0 msgr2=0x7f0d700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.323+0000 7f0d76891700 1 -- 172.21.15.19:0/4046312609 shutdown_connections 2023-10-03T10:14:31.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.323+0000 7f0d76891700 1 -- 172.21.15.19:0/4046312609 wait complete. 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.324+0000 7f0d76891700 1 Processor -- start 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.324+0000 7f0d76891700 1 -- start start 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.324+0000 7f0d76891700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7011b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.324+0000 7f0d76891700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d76891700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d701338a0 0x7f0d7011c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d76891700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7011cbe0 con 0x7f0d7009e760 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d76891700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7011d2f0 con 0x7f0d7009de50 2023-10-03T10:14:31.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d76891700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7011d910 con 0x7f0d701338a0 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51234/0 (socket says 172.21.15.19:51234) 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/1198310132 learned_addr learned my addr 172.21.15.19:0/1198310132 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6ffff700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7011b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d74e2e700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d701338a0 0x7f0d7011c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d701338a0 msgr2=0x7f0d7011c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d701338a0 0x7f0d7011c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 msgr2=0x7f0d7011b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7011b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.325+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/1198310132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d64009550 con 0x7f0d7009e760 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.326+0000 7f0d6f7fe700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400e9e0 tx=0x7f0d6400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.326+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400ee80 con 0x7f0d7009e760 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.326+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6400c850 con 0x7f0d7009e760 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.326+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6400cbc0 con 0x7f0d7009e760 2023-10-03T10:14:31.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.327+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600094a0 con 0x7f0d7009e760 2023-10-03T10:14:31.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.327+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d700a0f90 con 0x7f0d7009e760 2023-10-03T10:14:31.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.327+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d6400cd20 con 0x7f0d7009e760 2023-10-03T10:14:31.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.328+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d6403f700 con 0x7f0d7009e760 2023-10-03T10:14:31.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.328+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7006f640 con 0x7f0d7009e760 2023-10-03T10:14:31.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.333+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d640232f0 con 0x7f0d7009e760 2023-10-03T10:14:31.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.354+0000 7fb5755a0700 1 Processor -- start 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.354+0000 7fb5755a0700 1 -- start start 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.354+0000 7fb5755a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb57012cf60 0x7fb57006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.354+0000 7fb5755a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb57012f8b0 0x7fb57012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb5755a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57012cd90 con 0x7fb570130260 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb5755a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57012d330 con 0x7fb57012f8b0 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb5755a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5701306e0 con 0x7fb57012cf60 2023-10-03T10:14:31.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb57012f8b0 0x7fb57012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb57012f8b0 0x7fb57012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51248/0 (socket says 172.21.15.19:51248) 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 -- 172.21.15.19:0/2879833696 learned_addr learned my addr 172.21.15.19:0/2879833696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56f7fe700 1 --1- 172.21.15.19:0/2879833696 >> v1:172.21.15.19:6789/0 conn(0x7fb570130260 0x7fb570136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55436/0 (socket says 172.21.15.19:55436) 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56effd700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb57012cf60 0x7fb57006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 -- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb57012cf60 msgr2=0x7fb57006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb57012cf60 0x7fb57006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 -- 172.21.15.19:0/2879833696 >> v1:172.21.15.19:6789/0 conn(0x7fb570130260 legacy=0x7fb570136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 -- 172.21.15.19:0/2879833696 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570071780 con 0x7fb57012f8b0 2023-10-03T10:14:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.355+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57012fd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb5640098f0 tx=0x7fb564009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2134dab125306f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb56dffb700 1 -- 172.21.15.19:0/2879833696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011830 con 0x7fb57012f8b0 2023-10-03T10:14:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb56dffb700 1 -- 172.21.15.19:0/2879833696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564011990 con 0x7fb57012f8b0 2023-10-03T10:14:31.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb56dffb700 1 -- 172.21.15.19:0/2879833696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011d20 con 0x7fb57012f8b0 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 -- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 msgr2=0x7fb57012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57012fd20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb5640098f0 tx=0x7fb564009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 -- 172.21.15.19:0/2879833696 shutdown_connections 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb57012cf60 0x7fb57006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 --2- 172.21.15.19:0/2879833696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57012fd20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.356+0000 7fb5755a0700 1 -- 172.21.15.19:0/2879833696 >> 172.21.15.19:0/2879833696 conn(0x7fb5700a2aa0 msgr2=0x7fb5700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.357+0000 7fb5755a0700 1 -- 172.21.15.19:0/2879833696 shutdown_connections 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.357+0000 7fb5755a0700 1 -- 172.21.15.19:0/2879833696 wait complete. 2023-10-03T10:14:31.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 Processor -- start 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 -- start start 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57009c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 0x7fb5701c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb570118d40 con 0x7fb57012f8b0 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57009b690 con 0x7fb57012cf60 2023-10-03T10:14:31.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.358+0000 7fb5755a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb57009c600 con 0x7fb570130260 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 0x7fb5701c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45170/0 (socket says 172.21.15.19:45170) 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 0x7fb5701c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41324/0 (socket says 172.21.15.19:41324) 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56effd700 1 -- 172.21.15.19:0/859237294 learned_addr learned my addr 172.21.15.19:0/859237294 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57009c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 -- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 msgr2=0x7fb5701c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 0x7fb5701c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 -- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 msgr2=0x7fb57009bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 -- 172.21.15.19:0/859237294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009550 con 0x7fb57012f8b0 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56effd700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb56e7fc700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57009c0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb564016000 tx=0x7fb564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640036a0 con 0x7fb57012f8b0 2023-10-03T10:14:31.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564003800 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564003bb0 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.359+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57009e160 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.360+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57009cd70 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.360+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb564021070 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.360+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5640409c0 con 0x7fb57012f8b0 2023-10-03T10:14:31.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.361+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57009e900 con 0x7fb57012f8b0 2023-10-03T10:14:31.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.370+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb57009e900 con 0x7fb57012f8b0 2023-10-03T10:14:31.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.479+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbf48074ea0 con 0x7fbf4809d6f0 2023-10-03T10:14:31.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.479+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/3609957497 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf3800ce60 con 0x7fbf4809d6f0 2023-10-03T10:14:31.479 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 msgr2=0x7fbf48120770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c520 tx=0x7fbf3800c830 comp rx=0 tx=0).stop 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 shutdown_connections 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf48139170 0x7fbf481211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4809d6f0 0x7fbf48120770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 --2- 172.21.15.19:0/3609957497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4809e1d0 0x7fbf48120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 >> 172.21.15.19:0/3609957497 conn(0x7fbf48066f50 msgr2=0x7fbf48136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 shutdown_connections 2023-10-03T10:14:31.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.483+0000 7fbf4cac9700 1 -- 172.21.15.19:0/3609957497 wait complete. 2023-10-03T10:14:31.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.488+0000 7ff00af43700 1 Processor -- start 2023-10-03T10:14:31.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.488+0000 7ff00af43700 1 -- start start 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 0x7ff004133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff00409e760 0x7ff00413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff00406fef0 con 0x7ff00409de50 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00406ef30 con 0x7ff00409e760 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff00af43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041334b0 con 0x7ff0041338a0 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff003fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 0x7ff004133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff003fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51266/0 (socket says 172.21.15.19:51266) 2023-10-03T10:14:31.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff003fff700 1 -- 172.21.15.19:0/110187995 learned_addr learned my addr 172.21.15.19:0/110187995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 -- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff00409e760 msgr2=0x7ff00413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 --2- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff00409e760 0x7ff00413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 -- 172.21.15.19:0/110187995 >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 msgr2=0x7ff00409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 --2- 172.21.15.19:0/110187995 >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff008cdf700 1 -- 172.21.15.19:0/110187995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00406fc30 con 0x7ff0041338a0 2023-10-03T10:14:31.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.489+0000 7ff003fff700 1 --2- 172.21.15.19:0/110187995 >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.490+0000 7ff008cdf700 1 --2- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 0x7ff004133c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feff8009840 tx=0x7feff8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eea021e6ebc02be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.490+0000 7ff0037fe700 1 -- 172.21.15.19:0/110187995 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8011830 con 0x7ff0041338a0 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.490+0000 7ff0037fe700 1 -- 172.21.15.19:0/110187995 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff8011990 con 0x7ff0041338a0 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.490+0000 7ff0037fe700 1 -- 172.21.15.19:0/110187995 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8011d20 con 0x7ff0041338a0 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 -- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 msgr2=0x7ff004133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 --2- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 0x7ff004133c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feff8009840 tx=0x7feff8009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 -- 172.21.15.19:0/110187995 shutdown_connections 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 --2- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff00409e760 0x7ff00413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 --2- 172.21.15.19:0/110187995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0041338a0 0x7ff004133c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 --2- 172.21.15.19:0/110187995 >> v2:172.21.15.19:3300/0 conn(0x7ff00409de50 0x7ff00409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 -- 172.21.15.19:0/110187995 >> 172.21.15.19:0/110187995 conn(0x7ff0040a2aa0 msgr2=0x7ff0040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 -- 172.21.15.19:0/110187995 shutdown_connections 2023-10-03T10:14:31.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.491+0000 7ff00af43700 1 -- 172.21.15.19:0/110187995 wait complete. 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.492+0000 7ff00af43700 1 Processor -- start 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.492+0000 7ff00af43700 1 -- start start 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 0x7ff00411f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0041338a0 0x7ff00411f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff004122780 con 0x7ff00409de50 2023-10-03T10:14:31.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041200c0 con 0x7ff0041338a0 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff00af43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff004120870 con 0x7ff00409e760 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff008cdf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff003fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 0x7ff00411f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff008cdf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51274/0 (socket says 172.21.15.19:51274) 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff008cdf700 1 -- 172.21.15.19:0/1376817321 learned_addr learned my addr 172.21.15.19:0/1376817321 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff008cdf700 1 -- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 msgr2=0x7ff00411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.493+0000 7ff008cdf700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 0x7ff00411f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff008cdf700 1 -- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0041338a0 msgr2=0x7ff00411f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff008cdf700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0041338a0 0x7ff00411f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff008cdf700 1 -- 172.21.15.19:0/1376817321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0009550 con 0x7ff00409de50 2023-10-03T10:14:31.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff003fff700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 0x7ff00411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff008cdf700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feff8009b90 tx=0x7feff8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8004590 con 0x7ff00409de50 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff80036a0 con 0x7ff00409de50 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8003a30 con 0x7ff00409de50 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff80094a0 con 0x7ff00409de50 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.494+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00412fbb0 con 0x7ff00409de50 2023-10-03T10:14:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.495+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feff8003b90 con 0x7ff00409de50 2023-10-03T10:14:31.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.495+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feff80409c0 con 0x7ff00409de50 2023-10-03T10:14:31.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.495+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00406f950 con 0x7ff00409de50 2023-10-03T10:14:31.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:31.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.505+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feff8015080 con 0x7ff00409de50 2023-10-03T10:14:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.553+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d70074ea0 con 0x7f0d7009e760 2023-10-03T10:14:31.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.554+0000 7f0d6cff9700 1 -- 172.21.15.19:0/1198310132 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d64021030 con 0x7f0d7009e760 2023-10-03T10:14:31.554 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 msgr2=0x7f0d7011bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400e9e0 tx=0x7f0d6400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 shutdown_connections 2023-10-03T10:14:31.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d701338a0 0x7f0d7011c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d7009de50 0x7f0d7011b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 --2- 172.21.15.19:0/1198310132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d7009e760 0x7f0d7011bc70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 >> 172.21.15.19:0/1198310132 conn(0x7f0d700a2aa0 msgr2=0x7f0d701306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 shutdown_connections 2023-10-03T10:14:31.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.556+0000 7f0d76891700 1 -- 172.21.15.19:0/1198310132 wait complete. 2023-10-03T10:14:31.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:31.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.582+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb57009e900 con 0x7fb57012f8b0 2023-10-03T10:14:31.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.583+0000 7fb5577fe700 1 -- 172.21.15.19:0/859237294 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb57009e900 con 0x7fb57012f8b0 2023-10-03T10:14:31.583 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 msgr2=0x7fb57009c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57009c0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb564016000 tx=0x7fb564004750 comp rx=0 tx=0).stop 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 shutdown_connections 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb570130260 0x7fb5701c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb57012cf60 0x7fb57009bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 --2- 172.21.15.19:0/859237294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57012f8b0 0x7fb57009c0c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 >> 172.21.15.19:0/859237294 conn(0x7fb5700a2aa0 msgr2=0x7fb57006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 shutdown_connections 2023-10-03T10:14:31.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.585+0000 7fb5755a0700 1 -- 172.21.15.19:0/859237294 wait complete. 2023-10-03T10:14:31.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.716+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff004122300 con 0x7ff00409de50 2023-10-03T10:14:31.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.717+0000 7ff0017fa700 1 -- 172.21.15.19:0/1376817321 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff004122300 con 0x7ff00409de50 2023-10-03T10:14:31.717 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 msgr2=0x7ff00411ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feff8009b90 tx=0x7feff8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 shutdown_connections 2023-10-03T10:14:31.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0041338a0 0x7ff00411f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff00409de50 0x7ff00411ec60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 --2- 172.21.15.19:0/1376817321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff00409e760 0x7ff00411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 >> 172.21.15.19:0/1376817321 conn(0x7ff0040a2aa0 msgr2=0x7ff00409ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 shutdown_connections 2023-10-03T10:14:31.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:31.719+0000 7ff00af43700 1 -- 172.21.15.19:0/1376817321 wait complete. 2023-10-03T10:14:31.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:32.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:32.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:32.601 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.648+0000 7f112785c700 1 Processor -- start 2023-10-03T10:14:32.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 -- start start 2023-10-03T10:14:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112009edd0 con 0x7f1120133fa0 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112009e1f0 con 0x7f11200a0a30 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f112785c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112009dc50 con 0x7f11200a1340 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f11255f8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f1125df9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1120133fa0 0x7f112013ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55446/0 (socket says 172.21.15.19:55446) 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f1125df9700 1 -- 172.21.15.19:0/3702801767 learned_addr learned my addr 172.21.15.19:0/3702801767 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.649+0000 7f1124df7700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f11255f8700 1 -- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 msgr2=0x7f1120133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f11255f8700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f11255f8700 1 -- 172.21.15.19:0/3702801767 >> v1:172.21.15.19:6789/0 conn(0x7f1120133fa0 legacy=0x7f112013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f11255f8700 1 -- 172.21.15.19:0/3702801767 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200a1fe0 con 0x7f11200a0a30 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f1117fff700 1 -- 172.21.15.19:0/3702801767 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194580465 0 0) 0x7f112009edd0 con 0x7f1120133fa0 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f1124df7700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f11255f8700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f11200a0e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84def2d77eb8cca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f1117fff700 1 -- 172.21.15.19:0/3702801767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011830 con 0x7f11200a0a30 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f1117fff700 1 -- 172.21.15.19:0/3702801767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111c011990 con 0x7f11200a0a30 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.650+0000 7f1117fff700 1 -- 172.21.15.19:0/3702801767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111c011d20 con 0x7f11200a0a30 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 -- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 msgr2=0x7f11200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f11200a0e00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f111c009840 tx=0x7f111c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 -- 172.21.15.19:0/3702801767 shutdown_connections 2023-10-03T10:14:32.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 --2- 172.21.15.19:0/3702801767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 -- 172.21.15.19:0/3702801767 >> 172.21.15.19:0/3702801767 conn(0x7f11200a6550 msgr2=0x7f11200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 -- 172.21.15.19:0/3702801767 shutdown_connections 2023-10-03T10:14:32.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.651+0000 7f112785c700 1 -- 172.21.15.19:0/3702801767 wait complete. 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.652+0000 7f112785c700 1 Processor -- start 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.652+0000 7f112785c700 1 -- start start 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120124cb0 con 0x7f1120133fa0 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1120125d80 con 0x7f11200a1340 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f112785c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1120124520 con 0x7f11200a0a30 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f11255f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f11255f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41362/0 (socket says 172.21.15.19:41362) 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f11255f8700 1 -- 172.21.15.19:0/3960590180 learned_addr learned my addr 172.21.15.19:0/3960590180 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51292/0 (socket says 172.21.15.19:51292) 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1124df7700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 -- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 msgr2=0x7f1120122890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 -- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 msgr2=0x7f1120122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1125df9700 1 -- 172.21.15.19:0/3960590180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11100094a0 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f11255f8700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.653+0000 7f1124df7700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f1125df9700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f111800cbe0 tx=0x7f111800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111800aaf0 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111800ac70 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c0094a0 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180070d0 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.654+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1120126040 con 0x7f1120133fa0 2023-10-03T10:14:32.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.655+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11201333c0 con 0x7f1120133fa0 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.655+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1118007230 con 0x7f1120133fa0 2023-10-03T10:14:32.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.655+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f111803f130 con 0x7f1120133fa0 2023-10-03T10:14:32.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.660+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11180074e0 con 0x7f1120133fa0 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.716+0000 7f0157886700 1 Processor -- start 2023-10-03T10:14:32.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.716+0000 7f0157886700 1 -- start start 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0157886700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01500a1510 0x7f0150138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0157886700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f015013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0157886700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015009edd0 con 0x7f01500a0a30 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0157886700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01500a18e0 con 0x7f01500a1510 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0157886700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f015009e1f0 con 0x7f0150139250 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0154e21700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01500a1510 0x7f0150138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0155622700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f01500a0a30 0x7f01500a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55452/0 (socket says 172.21.15.19:55452) 2023-10-03T10:14:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0155622700 1 -- 172.21.15.19:0/275140363 learned_addr learned my addr 172.21.15.19:0/275140363 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.717+0000 7f0155e23700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f015013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0154e21700 1 -- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 msgr2=0x7f015013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0154e21700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f015013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0154e21700 1 -- 172.21.15.19:0/275140363 >> v1:172.21.15.19:6789/0 conn(0x7f01500a0a30 legacy=0x7f01500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0154e21700 1 -- 172.21.15.19:0/275140363 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015009dc50 con 0x7f01500a1510 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0147fff700 1 -- 172.21.15.19:0/275140363 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519070235 0 0) 0x7f015009edd0 con 0x7f01500a0a30 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0154e21700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150138d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0140009840 tx=0x7f0140009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12829e23b0ae3566 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0147fff700 1 -- 172.21.15.19:0/275140363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140011830 con 0x7f01500a1510 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0147fff700 1 -- 172.21.15.19:0/275140363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140011990 con 0x7f01500a1510 2023-10-03T10:14:32.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.718+0000 7f0147fff700 1 -- 172.21.15.19:0/275140363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140011d20 con 0x7f01500a1510 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 -- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 msgr2=0x7f0150138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150138d10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0140009840 tx=0x7f0140009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 -- 172.21.15.19:0/275140363 shutdown_connections 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f015013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 --2- 172.21.15.19:0/275140363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150138d10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 -- 172.21.15.19:0/275140363 >> 172.21.15.19:0/275140363 conn(0x7f01500a6550 msgr2=0x7f01500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 -- 172.21.15.19:0/275140363 shutdown_connections 2023-10-03T10:14:32.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.719+0000 7f0157886700 1 -- 172.21.15.19:0/275140363 wait complete. 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.721+0000 7f0157886700 1 Processor -- start 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.721+0000 7f0157886700 1 -- start start 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f0150123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01501262c0 con 0x7f01500a1510 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0150137ed0 con 0x7f01500a0a30 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0157886700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0150125e70 con 0x7f0150139250 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155622700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f0150123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155622700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45220/0 (socket says 172.21.15.19:45220) 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155622700 1 -- 172.21.15.19:0/214407916 learned_addr learned my addr 172.21.15.19:0/214407916 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:32.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0154e21700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 -- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 msgr2=0x7f01501226b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 -- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 msgr2=0x7f0150122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 -- 172.21.15.19:0/214407916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400094a0 con 0x7f0150139250 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155622700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0154e21700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.722+0000 7f0155e23700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f0150123130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f014800ef90 tx=0x7f014800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.723+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800cc90 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.723+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014800f040 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.723+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0150125040 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.723+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480146c0 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.723+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0150125550 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.724+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0150126a00 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.724+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0148014820 con 0x7f0150139250 2023-10-03T10:14:32.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.725+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01480406a0 con 0x7f0150139250 2023-10-03T10:14:32.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:32.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.734+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0148014ad0 con 0x7f0150139250 2023-10-03T10:14:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.759+0000 7f0cbb51b700 1 Processor -- start 2023-10-03T10:14:32.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.759+0000 7f0cbb51b700 1 -- start start 2023-10-03T10:14:32.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cbb51b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 0x7f0cb4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cbb51b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb406fcf0 0x7f0cb4138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cbb51b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb40716a0 con 0x7f0cb4130e50 2023-10-03T10:14:32.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cbb51b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb409a390 con 0x7f0cb4130540 2023-10-03T10:14:32.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cbb51b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4071290 con 0x7f0cb406fcf0 2023-10-03T10:14:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cb8ab6700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0cb4130e50 0x7f0cb406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55458/0 (socket says 172.21.15.19:55458) 2023-10-03T10:14:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cb8ab6700 1 -- 172.21.15.19:0/2285012016 learned_addr learned my addr 172.21.15.19:0/2285012016 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.760+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 0x7f0cb4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb9ab8700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb406fcf0 0x7f0cb4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb406fcf0 msgr2=0x7f0cb4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb406fcf0 0x7f0cb4138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2285012016 >> v1:172.21.15.19:6789/0 conn(0x7f0cb4130e50 legacy=0x7f0cb406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2285012016 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4130340 con 0x7f0cb4130540 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 0x7f0cb4130910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009870 tx=0x7f0cb0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33510a36cda7d0d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cabfff700 1 -- 172.21.15.19:0/2285012016 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011830 con 0x7f0cb4130540 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cabfff700 1 -- 172.21.15.19:0/2285012016 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0011990 con 0x7f0cb4130540 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.761+0000 7f0cabfff700 1 -- 172.21.15.19:0/2285012016 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011d20 con 0x7f0cb4130540 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 msgr2=0x7f0cb4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 0x7f0cb4130910 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009870 tx=0x7f0cb0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2285012016 shutdown_connections 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb406fcf0 0x7f0cb4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2285012016 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb4130540 0x7f0cb4130910 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2285012016 >> 172.21.15.19:0/2285012016 conn(0x7f0cb40a2aa0 msgr2=0x7f0cb40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2285012016 shutdown_connections 2023-10-03T10:14:32.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.762+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2285012016 wait complete. 2023-10-03T10:14:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 Processor -- start 2023-10-03T10:14:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 -- start start 2023-10-03T10:14:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 0x7f0cb411ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb4130e50 0x7f0cb411f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40718e0 con 0x7f0cb4130540 2023-10-03T10:14:32.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41223b0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cbb51b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb4122a50 con 0x7f0cb4130e50 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cb8ab6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cb8ab6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51312/0 (socket says 172.21.15.19:51312) 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.764+0000 7f0cb8ab6700 1 -- 172.21.15.19:0/2700554910 learned_addr learned my addr 172.21.15.19:0/2700554910 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 0x7f0cb411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb9ab8700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb4130e50 0x7f0cb411f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb4130e50 msgr2=0x7f0cb411f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb4130e50 0x7f0cb411f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 msgr2=0x7f0cb411f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 -- 172.21.15.19:0/2700554910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00094a0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb8ab6700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.765+0000 7f0cb92b7700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 0x7f0cb411ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0016000 tx=0x7f0cb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.766+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0004240 con 0x7f0cb406fcf0 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.766+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb0030070 con 0x7f0cb406fcf0 2023-10-03T10:14:32.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.766+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00036a0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.767+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb412cdc0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.767+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb412c900 con 0x7f0cb406fcf0 2023-10-03T10:14:32.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.768+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0cb0032030 con 0x7f0cb406fcf0 2023-10-03T10:14:32.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.768+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0cb00517b0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.768+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb4074ea0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.773+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0cb0015070 con 0x7f0cb406fcf0 2023-10-03T10:14:32.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.876+0000 7fb8b0c81700 1 Processor -- start 2023-10-03T10:14:32.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 -- start start 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8ac09b120 con 0x7fb8ac09d6f0 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac06b460 con 0x7fb8ac139170 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8b0c81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac09a7e0 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8aa59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb8ac09d6f0 0x7fb8ac09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55468/0 (socket says 172.21.15.19:55468) 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.877+0000 7fb8aa59c700 1 -- 172.21.15.19:0/72218503 learned_addr learned my addr 172.21.15.19:0/72218503 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8aad9d700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a959a700 1 -- 172.21.15.19:0/72218503 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1131621607 0 0) 0x7fb8ac09b120 con 0x7fb8ac09d6f0 2023-10-03T10:14:32.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a959a700 1 -- 172.21.15.19:0/72218503 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8940035b0 con 0x7fb8ac09d6f0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 -- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac139170 msgr2=0x7fb8ac13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 -- 172.21.15.19:0/72218503 >> v1:172.21.15.19:6789/0 conn(0x7fb8ac09d6f0 legacy=0x7fb8ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 -- 172.21.15.19:0/72218503 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac09a500 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.878+0000 7fb8a9d9b700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00098a0 tx=0x7fb8a0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=493e1c25f45ce6b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8a959a700 1 -- 172.21.15.19:0/72218503 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0011830 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8a959a700 1 -- 172.21.15.19:0/72218503 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a0011990 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8a959a700 1 -- 172.21.15.19:0/72218503 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0011d20 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 -- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 msgr2=0x7fb8ac138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00098a0 tx=0x7fb8a0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 -- 172.21.15.19:0/72218503 shutdown_connections 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac139170 0x7fb8ac13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/72218503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09e1d0 0x7fb8ac138c30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 -- 172.21.15.19:0/72218503 >> 172.21.15.19:0/72218503 conn(0x7fb8ac066f50 msgr2=0x7fb8ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 -- 172.21.15.19:0/72218503 shutdown_connections 2023-10-03T10:14:32.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.879+0000 7fb8b0c81700 1 -- 172.21.15.19:0/72218503 wait complete. 2023-10-03T10:14:32.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 Processor -- start 2023-10-03T10:14:32.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 -- start start 2023-10-03T10:14:32.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f11200a1d40 con 0x7f1120133fa0 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 0x7fb8ac121530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac09e1d0 0x7fb8ac121a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac1239f0 con 0x7fb8ac139170 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac125050 con 0x7fb8ac09e1d0 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8b0c81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac1231e0 con 0x7fb8ac09d6f0 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8aad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8aad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51314/0 (socket says 172.21.15.19:51314) 2023-10-03T10:14:32.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.881+0000 7fb8aad9d700 1 -- 172.21.15.19:0/3589958632 learned_addr learned my addr 172.21.15.19:0/3589958632 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:32.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7f1115ffb700 1 -- 172.21.15.19:0/3960590180 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1118018020 con 0x7f1120133fa0 2023-10-03T10:14:32.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8a9d9b700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac09e1d0 0x7fb8ac121a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aa59c700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 0x7fb8ac121530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:32.884 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:32.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aad9d700 1 -- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 msgr2=0x7fb8ac121530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aad9d700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 0x7fb8ac121530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aad9d700 1 -- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac09e1d0 msgr2=0x7fb8ac121a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aad9d700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac09e1d0 0x7fb8ac121a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aad9d700 1 -- 172.21.15.19:0/3589958632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a00094a0 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.882+0000 7fb8aa59c700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 0x7fb8ac121530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb8aad9d700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400efc0 tx=0x7fb8a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4009ea0 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a400f040 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4014480 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac0a1850 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.884+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac1257e0 con 0x7fb8ac139170 2023-10-03T10:14:32.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.885+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8a40145e0 con 0x7fb8ac139170 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.885+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8a40402a0 con 0x7fb8ac139170 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.885+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac124cd0 con 0x7fb8ac139170 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 msgr2=0x7f1120123310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f111800cbe0 tx=0x7f111800cef0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 shutdown_connections 2023-10-03T10:14:32.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1120133fa0 0x7f1120123310 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f1120122890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 --2- 172.21.15.19:0/3960590180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11200a1340 0x7f1120122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.887+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 >> 172.21.15.19:0/3960590180 conn(0x7f11200a6550 msgr2=0x7f112011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.889+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 shutdown_connections 2023-10-03T10:14:32.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.889+0000 7f112785c700 1 -- 172.21.15.19:0/3960590180 wait complete. 2023-10-03T10:14:32.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.891+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8ac124cd0 con 0x7fb8ac139170 2023-10-03T10:14:32.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.952+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0150074ea0 con 0x7f0150139250 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.952+0000 7f0145ffb700 1 -- 172.21.15.19:0/214407916 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f014802a070 con 0x7f0150139250 2023-10-03T10:14:32.952 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:32.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.955+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 msgr2=0x7f0150123130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.955+0000 7f0157886700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f0150123130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f014800ef90 tx=0x7f014800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 shutdown_connections 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0150139250 0x7f0150123130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01500a0a30 0x7f01501226b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 --2- 172.21.15.19:0/214407916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01500a1510 0x7f0150122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 >> 172.21.15.19:0/214407916 conn(0x7f01500a6550 msgr2=0x7f01500a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 shutdown_connections 2023-10-03T10:14:32.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.956+0000 7f0157886700 1 -- 172.21.15.19:0/214407916 wait complete. 2023-10-03T10:14:32.974 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:32.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.990+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0cb406b9e0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.991+0000 7f0ca9ffb700 1 -- 172.21.15.19:0/2700554910 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0cb00349a0 con 0x7f0cb406fcf0 2023-10-03T10:14:32.991 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:32.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 msgr2=0x7f0cb411ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 0x7f0cb411ee30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0016000 tx=0x7f0cb0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 shutdown_connections 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cb4130e50 0x7f0cb411f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cb406fcf0 0x7f0cb411ee30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 --2- 172.21.15.19:0/2700554910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cb4130540 0x7f0cb411f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 >> 172.21.15.19:0/2700554910 conn(0x7f0cb40a2aa0 msgr2=0x7f0cb406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 shutdown_connections 2023-10-03T10:14:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:32.993+0000 7f0cbb51b700 1 -- 172.21.15.19:0/2700554910 wait complete. 2023-10-03T10:14:33.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.111+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8ac124cd0 con 0x7fb8ac139170 2023-10-03T10:14:33.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.112+0000 7fb89affd700 1 -- 172.21.15.19:0/3589958632 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8ac124cd0 con 0x7fb8ac139170 2023-10-03T10:14:33.112 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 msgr2=0x7fb8ac121fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400efc0 tx=0x7fb8a400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 shutdown_connections 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb8ac139170 0x7fb8ac121fb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb8ac09d6f0 0x7fb8ac121530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 --2- 172.21.15.19:0/3589958632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8ac09e1d0 0x7fb8ac121a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 >> 172.21.15.19:0/3589958632 conn(0x7fb8ac066f50 msgr2=0x7fb8ac09b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 shutdown_connections 2023-10-03T10:14:33.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:33.114+0000 7fb8b0c81700 1 -- 172.21.15.19:0/3589958632 wait complete. 2023-10-03T10:14:33.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:33.904 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:33.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:34.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.055+0000 7fdb35845700 1 Processor -- start 2023-10-03T10:14:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.055+0000 7fdb35845700 1 -- start start 2023-10-03T10:14:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb35845700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 0x7fdb30136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb35845700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb30139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb35845700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3009b4f0 con 0x7fdb30131810 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb35845700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb301313c0 con 0x7fdb30134630 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb35845700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3006e8c0 con 0x7fdb30136f50 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb30131810 0x7fdb30131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55478/0 (socket says 172.21.15.19:55478) 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2effd700 1 -- 172.21.15.19:0/544849204 learned_addr learned my addr 172.21.15.19:0/544849204 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2e7fc700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 0x7fdb30136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2f7fe700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb30139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2dffb700 1 -- 172.21.15.19:0/544849204 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927062394 0 0) 0x7fdb3009b4f0 con 0x7fdb30131810 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.056+0000 7fdb2dffb700 1 -- 172.21.15.19:0/544849204 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb180035b0 con 0x7fdb30131810 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 msgr2=0x7fdb30136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2f7fe700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 0x7fdb30136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/544849204 >> v1:172.21.15.19:6789/0 conn(0x7fdb30131810 legacy=0x7fdb30131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/544849204 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb30071d20 con 0x7fdb30136f50 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2e7fc700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 0x7fdb30136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2f7fe700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb30139330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32c0f12567597d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2dffb700 1 -- 172.21.15.19:0/544849204 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2800e070 con 0x7fdb30136f50 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2dffb700 1 -- 172.21.15.19:0/544849204 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2800bb20 con 0x7fdb30136f50 2023-10-03T10:14:34.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.057+0000 7fdb2dffb700 1 -- 172.21.15.19:0/544849204 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb28012430 con 0x7fdb30136f50 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 -- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 msgr2=0x7fdb30139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb30139330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdb28009dc0 tx=0x7fdb2800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 -- 172.21.15.19:0/544849204 shutdown_connections 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb30139330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 --2- 172.21.15.19:0/544849204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30134630 0x7fdb30136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 -- 172.21.15.19:0/544849204 >> 172.21.15.19:0/544849204 conn(0x7fdb300a2aa0 msgr2=0x7fdb300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 -- 172.21.15.19:0/544849204 shutdown_connections 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.058+0000 7fdb35845700 1 -- 172.21.15.19:0/544849204 wait complete. 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.059+0000 7fdb35845700 1 Processor -- start 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.059+0000 7fdb35845700 1 -- start start 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30131810 0x7fdb30137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb301387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3009e7d0 con 0x7fdb30134630 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3009c5f0 con 0x7fdb30131810 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb35845700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb3009baa0 con 0x7fdb30136f50 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51326/0 (socket says 172.21.15.19:51326) 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 -- 172.21.15.19:0/3870829514 learned_addr learned my addr 172.21.15.19:0/3870829514 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2f7fe700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb301387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2effd700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30131810 0x7fdb30137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 -- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 msgr2=0x7fdb301387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb301387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 -- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30131810 msgr2=0x7fdb30137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30131810 0x7fdb30137d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 -- 172.21.15.19:0/3870829514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb240094a0 con 0x7fdb30134630 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2f7fe700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb301387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.060+0000 7fdb2e7fc700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400ebe0 tx=0x7fdb2400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.061+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400c850 con 0x7fdb30134630 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.061+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2400c9b0 con 0x7fdb30134630 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.061+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28009a70 con 0x7fdb30134630 2023-10-03T10:14:34.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.061+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2400cd40 con 0x7fdb30134630 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.061+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3013a130 con 0x7fdb30134630 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.062+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb24013470 con 0x7fdb30134630 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.062+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb2403fb30 con 0x7fdb30134630 2023-10-03T10:14:34.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.062+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb30070d80 con 0x7fdb30134630 2023-10-03T10:14:34.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.067+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb24013720 con 0x7fdb30134630 2023-10-03T10:14:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 Processor -- start 2023-10-03T10:14:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 -- start start 2023-10-03T10:14:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 0x7f6fec136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 0x7f6fec138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec09e130 con 0x7f6fec1316c0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec1321a0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6ff20e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec1312b0 con 0x7f6fec136a70 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6feb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6fec1316c0 0x7f6fec131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55486/0 (socket says 172.21.15.19:55486) 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6feb7fe700 1 -- 172.21.15.19:0/2291251496 learned_addr learned my addr 172.21.15.19:0/2291251496 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6febfff700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 0x7f6fec138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.119+0000 7f6feaffd700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 0x7f6fec136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6fea7fc700 1 -- 172.21.15.19:0/2291251496 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107388470 0 0) 0x7f6fdc001110 con 0x7f6fec1316c0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6fea7fc700 1 -- 172.21.15.19:0/2291251496 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd40035b0 con 0x7f6fec1316c0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6feaffd700 1 -- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 msgr2=0x7f6fec138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6feaffd700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 0x7f6fec138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6feaffd700 1 -- 172.21.15.19:0/2291251496 >> v1:172.21.15.19:6789/0 conn(0x7f6fec1316c0 legacy=0x7f6fec131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6feaffd700 1 -- 172.21.15.19:0/2291251496 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec09f6e0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6febfff700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 0x7f6fec138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6feaffd700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 0x7f6fec136530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009870 tx=0x7f6fe0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2f41b08a47b2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6fea7fc700 1 -- 172.21.15.19:0/2291251496 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0004230 con 0x7f6fec09d9f0 2023-10-03T10:14:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6fea7fc700 1 -- 172.21.15.19:0/2291251496 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0004390 con 0x7f6fec09d9f0 2023-10-03T10:14:34.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.120+0000 7f6fea7fc700 1 -- 172.21.15.19:0/2291251496 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00036a0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 -- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 msgr2=0x7f6fec136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 0x7f6fec136530 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009870 tx=0x7f6fe0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 -- 172.21.15.19:0/2291251496 shutdown_connections 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec136a70 0x7f6fec138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/2291251496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec09d9f0 0x7f6fec136530 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 -- 172.21.15.19:0/2291251496 >> 172.21.15.19:0/2291251496 conn(0x7f6fec066f50 msgr2=0x7f6fec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 -- 172.21.15.19:0/2291251496 shutdown_connections 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.121+0000 7f6ff20e5700 1 -- 172.21.15.19:0/2291251496 wait complete. 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.123+0000 7f6ff20e5700 1 Processor -- start 2023-10-03T10:14:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.123+0000 7f6ff20e5700 1 -- start start 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.123+0000 7f6ff20e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6ff20e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec1316c0 0x7f6fec12b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6ff20e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 0x7f6fec134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6ff20e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec1365c0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6ff20e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec06e980 con 0x7f6fec136a70 2023-10-03T10:14:34.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6ff20e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec12b900 con 0x7f6fec1316c0 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51338/0 (socket says 172.21.15.19:51338) 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 -- 172.21.15.19:0/759610594 learned_addr learned my addr 172.21.15.19:0/759610594 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6febfff700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 0x7f6fec134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feaffd700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec1316c0 0x7f6fec12b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 -- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec1316c0 msgr2=0x7f6fec12b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec1316c0 0x7f6fec12b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 -- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 msgr2=0x7f6fec134530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 0x7f6fec134530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 -- 172.21.15.19:0/759610594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009a70 con 0x7f6fec09d9f0 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6febfff700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 0x7f6fec134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.124+0000 7f6feb7fe700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c730 tx=0x7f6fdc00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.125+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007560 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.125+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0076e0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.125+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc004ab0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.125+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00094a0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.125+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec135f60 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.126+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fdc004c10 con 0x7f6fec09d9f0 2023-10-03T10:14:34.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.126+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec074ea0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.126+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6fdc03f130 con 0x7f6fec09d9f0 2023-10-03T10:14:34.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.131+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fdc01a2b0 con 0x7f6fec09d9f0 2023-10-03T10:14:34.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.164+0000 7fc0b25b8700 1 Processor -- start 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.164+0000 7fc0b25b8700 1 -- start start 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac09eca0 0x7fc0ac06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0ac134610 0x7fc0ac134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0ac070ee0 con 0x7fc0ac134610 2023-10-03T10:14:34.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac071480 con 0x7fc0ac06e570 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b25b8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac06f3c0 con 0x7fc0ac09eca0 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b0b55700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0ac134610 0x7fc0ac134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b0b55700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0ac134610 0x7fc0ac134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51348/0 (socket says 172.21.15.19:51348) 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0b0b55700 1 -- 172.21.15.19:0/3213665435 learned_addr learned my addr 172.21.15.19:0/3213665435 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0ab7fe700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac09eca0 0x7fc0ac06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.165+0000 7fc0abfff700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 -- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac09eca0 msgr2=0x7fc0ac06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac09eca0 0x7fc0ac06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 -- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 msgr2=0x7fc0ac06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 -- 172.21.15.19:0/3213665435 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ac071b90 con 0x7fc0ac134610 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac134610 0x7fc0ac134ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009e50 tx=0x7fc0a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b01edfc2b7f4ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0aaffd700 1 -- 172.21.15.19:0/3213665435 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400e070 con 0x7fc0ac134610 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0aaffd700 1 -- 172.21.15.19:0/3213665435 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400b910 con 0x7fc0ac134610 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.166+0000 7fc0aaffd700 1 -- 172.21.15.19:0/3213665435 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400bcc0 con 0x7fc0ac134610 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 -- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac134610 msgr2=0x7fc0ac134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac134610 0x7fc0ac134ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009e50 tx=0x7fc0a400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 -- 172.21.15.19:0/3213665435 shutdown_connections 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac134610 0x7fc0ac134ab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/3213665435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac09eca0 0x7fc0ac06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 -- 172.21.15.19:0/3213665435 >> 172.21.15.19:0/3213665435 conn(0x7fc0ac0a2aa0 msgr2=0x7fc0ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 -- 172.21.15.19:0/3213665435 shutdown_connections 2023-10-03T10:14:34.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.167+0000 7fc0b25b8700 1 -- 172.21.15.19:0/3213665435 wait complete. 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.168+0000 7fc0b25b8700 1 Processor -- start 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 -- start start 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac134610 0x7fc0ac139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac13bf60 con 0x7fc0ac127950 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac13e5a0 con 0x7fc0ac06e570 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.169+0000 7fc0b25b8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0ac0a1fe0 con 0x7fc0ac134610 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51354/0 (socket says 172.21.15.19:51354) 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 -- 172.21.15.19:0/849059278 learned_addr learned my addr 172.21.15.19:0/849059278 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0ab7fe700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac134610 0x7fc0ac139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0abfff700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 -- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac134610 msgr2=0x7fc0ac139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac134610 0x7fc0ac139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 -- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 msgr2=0x7fc0ac127410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac127410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 -- 172.21.15.19:0/849059278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009b30 con 0x7fc0ac127950 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0b0b55700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac071020 tx=0x7fc0a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.170+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4004450 con 0x7fc0ac127950 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.171+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a40045f0 con 0x7fc0ac127950 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.171+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a40099b0 con 0x7fc0ac127950 2023-10-03T10:14:34.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.171+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac070610 con 0x7fc0ac127950 2023-10-03T10:14:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.171+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0ac13dfd0 con 0x7fc0ac127950 2023-10-03T10:14:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.172+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0a401c410 con 0x7fc0ac127950 2023-10-03T10:14:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.172+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0ac074ea0 con 0x7fc0ac127950 2023-10-03T10:14:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.172+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0a401ca40 con 0x7fc0ac127950 2023-10-03T10:14:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.181+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0a401c6c0 con 0x7fc0ac127950 2023-10-03T10:14:34.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.277+0000 7f877f368700 1 Processor -- start 2023-10-03T10:14:34.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.277+0000 7f877f368700 1 -- start start 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f877809d6f0 0x7f877809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809e410 0x7f8778130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877809f520 con 0x7f877809d6f0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877809f130 con 0x7f877809e000 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877f368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f877809e930 con 0x7f877809e410 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877c903700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.278+0000 7f877c903700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45314/0 (socket says 172.21.15.19:45314) 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877c903700 1 -- 172.21.15.19:0/666799072 learned_addr learned my addr 172.21.15.19:0/666799072 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d905700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809e410 0x7f8778130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 --2- 172.21.15.19:0/666799072 >> v2:172.21.15.19:3300/0 conn(0x7f877809d6f0 0x7f877809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 -- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809e410 msgr2=0x7f8778130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809e410 0x7f8778130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 -- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 msgr2=0x7f8778130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 -- 172.21.15.19:0/666799072 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877809b2d0 con 0x7f877809d6f0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877c903700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f877d104700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809d6f0 0x7f877809dac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8774009870 tx=0x7f8774009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1cfff1835e5296 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f876ffff700 1 -- 172.21.15.19:0/666799072 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011830 con 0x7f877809d6f0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f876ffff700 1 -- 172.21.15.19:0/666799072 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774011990 con 0x7f877809d6f0 2023-10-03T10:14:34.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.279+0000 7f876ffff700 1 -- 172.21.15.19:0/666799072 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774011d20 con 0x7f877809d6f0 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 -- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809d6f0 msgr2=0x7f877809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809d6f0 0x7f877809dac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8774009870 tx=0x7f8774009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 -- 172.21.15.19:0/666799072 shutdown_connections 2023-10-03T10:14:34.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809e410 0x7f8778130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809d6f0 0x7f877809dac0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 --2- 172.21.15.19:0/666799072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.280+0000 7f877f368700 1 -- 172.21.15.19:0/666799072 >> 172.21.15.19:0/666799072 conn(0x7f8778066f50 msgr2=0x7f877809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.281+0000 7f877f368700 1 -- 172.21.15.19:0/666799072 shutdown_connections 2023-10-03T10:14:34.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.281+0000 7f877f368700 1 -- 172.21.15.19:0/666799072 wait complete. 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.282+0000 7f877f368700 1 Processor -- start 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.282+0000 7f877f368700 1 -- start start 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778137650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 0x7f87781c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778139570 con 0x7f877809e410 2023-10-03T10:14:34.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877811a1f0 con 0x7f877809e000 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877f368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8778136c20 con 0x7f877809d6f0 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877d104700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877d104700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41490/0 (socket says 172.21.15.19:41490) 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877d905700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 0x7f87781c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:34.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877d104700 1 -- 172.21.15.19:0/223933639 learned_addr learned my addr 172.21.15.19:0/223933639 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.283+0000 7f877d905700 1 -- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 msgr2=0x7f8778137110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d905700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d905700 1 -- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 msgr2=0x7f8778137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d905700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778137650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d905700 1 -- 172.21.15.19:0/223933639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768009550 con 0x7f877809e410 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d104700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877d905700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 0x7f87781c8170 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f877000efc0 tx=0x7f877000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000cd40 con 0x7f877809e410 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877000f040 con 0x7f877809e410 2023-10-03T10:14:34.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87740094a0 con 0x7f877809e410 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700146c0 con 0x7f877809e410 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.284+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8778072410 con 0x7f877809e410 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.285+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8770014820 con 0x7f877809e410 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.285+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877809c760 con 0x7f877809e410 2023-10-03T10:14:34.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.286+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8770040220 con 0x7f877809e410 2023-10-03T10:14:34.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.290+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb3009c9c0 con 0x7fdb30134630 2023-10-03T10:14:34.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.290+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8770007920 con 0x7f877809e410 2023-10-03T10:14:34.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.291+0000 7fdb17fff700 1 -- 172.21.15.19:0/3870829514 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb24021030 con 0x7fdb30134630 2023-10-03T10:14:34.291 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:34.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 msgr2=0x7fdb30138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb2400ebe0 tx=0x7fdb2400eef0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 shutdown_connections 2023-10-03T10:14:34.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb30136f50 0x7fdb301387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb30131810 0x7fdb30137d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 --2- 172.21.15.19:0/3870829514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb30134630 0x7fdb30138270 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 >> 172.21.15.19:0/3870829514 conn(0x7fdb300a2aa0 msgr2=0x7fdb30133960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 shutdown_connections 2023-10-03T10:14:34.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.293+0000 7fdb35845700 1 -- 172.21.15.19:0/3870829514 wait complete. 2023-10-03T10:14:34.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:34.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.348+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6fec09e130 con 0x7f6fec09d9f0 2023-10-03T10:14:34.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.348+0000 7f6fd3fff700 1 -- 172.21.15.19:0/759610594 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fec09e130 con 0x7f6fec09d9f0 2023-10-03T10:14:34.348 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 msgr2=0x7f6fec12ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c730 tx=0x7f6fdc00ca40 comp rx=0 tx=0).stop 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 shutdown_connections 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fec136a70 0x7f6fec134530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fec09d9f0 0x7f6fec12ae00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 --2- 172.21.15.19:0/759610594 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fec1316c0 0x7f6fec12b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 >> 172.21.15.19:0/759610594 conn(0x7f6fec066f50 msgr2=0x7f6fec136e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 shutdown_connections 2023-10-03T10:14:34.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.351+0000 7f6ff20e5700 1 -- 172.21.15.19:0/759610594 wait complete. 2023-10-03T10:14:34.365 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:34.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.402+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0ac071100 con 0x7fc0ac127950 2023-10-03T10:14:34.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.403+0000 7fc0a8ff9700 1 -- 172.21.15.19:0/849059278 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0a402d020 con 0x7fc0ac127950 2023-10-03T10:14:34.403 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:34.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 msgr2=0x7fc0ac13a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac071020 tx=0x7fc0a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 shutdown_connections 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0ac127950 0x7fc0ac13a3c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0ac06e570 0x7fc0ac127410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 --2- 172.21.15.19:0/849059278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0ac134610 0x7fc0ac139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 >> 172.21.15.19:0/849059278 conn(0x7fc0ac0a2aa0 msgr2=0x7fc0ac137a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 shutdown_connections 2023-10-03T10:14:34.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.405+0000 7fc0b25b8700 1 -- 172.21.15.19:0/849059278 wait complete. 2023-10-03T10:14:34.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:34.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.499+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8778074ea0 con 0x7f877809e410 2023-10-03T10:14:34.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.500+0000 7f876dffb700 1 -- 172.21.15.19:0/223933639 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8770018020 con 0x7f877809e410 2023-10-03T10:14:34.500 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 msgr2=0x7f87781c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 0x7f87781c8170 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f877000efc0 tx=0x7f877000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 shutdown_connections 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f877809e410 0x7f87781c8170 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f877809d6f0 0x7f8778137110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 --2- 172.21.15.19:0/223933639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f877809e000 0x7f8778137650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 >> 172.21.15.19:0/223933639 conn(0x7f8778066f50 msgr2=0x7f877806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 shutdown_connections 2023-10-03T10:14:34.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:34.502+0000 7f877f368700 1 -- 172.21.15.19:0/223933639 wait complete. 2023-10-03T10:14:34.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:35.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:35.366 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:35.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:35.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.458+0000 7f4d37314700 1 Processor -- start 2023-10-03T10:14:35.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.459+0000 7f4d37314700 1 -- start start 2023-10-03T10:14:35.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d37314700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d3012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d37314700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d30135c20 0x7f4d30138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d37314700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3006fa40 con 0x7f4d3012cf60 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d37314700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3012cd90 con 0x7f4d30135c20 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d37314700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d30071780 con 0x7f4d3006f5d0 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d350b0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d3012cf60 0x7f4d3012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55492/0 (socket says 172.21.15.19:55492) 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d350b0700 1 -- 172.21.15.19:0/114832756 learned_addr learned my addr 172.21.15.19:0/114832756 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d348af700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d3012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d358b1700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d30135c20 0x7f4d30138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d27fff700 1 -- 172.21.15.19:0/114832756 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216042042 0 0) 0x7f4d3006fa40 con 0x7f4d3012cf60 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d27fff700 1 -- 172.21.15.19:0/114832756 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d1c0035b0 con 0x7f4d3012cf60 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d348af700 1 -- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d30135c20 msgr2=0x7f4d30138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d348af700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d30135c20 0x7f4d30138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d348af700 1 -- 172.21.15.19:0/114832756 >> v1:172.21.15.19:6789/0 conn(0x7f4d3012cf60 legacy=0x7f4d3012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.460+0000 7f4d348af700 1 -- 172.21.15.19:0/114832756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30071a40 con 0x7f4d3006f5d0 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d348af700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d3012ffc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d200098a0 tx=0x7f4d20009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f544187ebe44d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d27fff700 1 -- 172.21.15.19:0/114832756 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20010830 con 0x7f4d3006f5d0 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d27fff700 1 -- 172.21.15.19:0/114832756 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20010990 con 0x7f4d3006f5d0 2023-10-03T10:14:35.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d27fff700 1 -- 172.21.15.19:0/114832756 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20010d20 con 0x7f4d3006f5d0 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d37314700 1 -- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 msgr2=0x7f4d3012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.461+0000 7f4d37314700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d3012ffc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4d200098a0 tx=0x7f4d20009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 -- 172.21.15.19:0/114832756 shutdown_connections 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d30135c20 0x7f4d30138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 --2- 172.21.15.19:0/114832756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d3012ffc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 -- 172.21.15.19:0/114832756 >> 172.21.15.19:0/114832756 conn(0x7f4d300a2aa0 msgr2=0x7f4d300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 -- 172.21.15.19:0/114832756 shutdown_connections 2023-10-03T10:14:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.462+0000 7f4d37314700 1 -- 172.21.15.19:0/114832756 wait complete. 2023-10-03T10:14:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.463+0000 7f4d37314700 1 Processor -- start 2023-10-03T10:14:35.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.463+0000 7f4d37314700 1 -- start start 2023-10-03T10:14:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d301c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d30135c20 0x7f4d301c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d301336e0 con 0x7f4d30135c20 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3009a080 con 0x7f4d3012cf60 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d37314700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d300a15b0 con 0x7f4d3006f5d0 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d350b0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d301c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45342/0 (socket says 172.21.15.19:45342) 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 -- 172.21.15.19:0/133770417 learned_addr learned my addr 172.21.15.19:0/133770417 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d358b1700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d30135c20 0x7f4d301c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 -- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 msgr2=0x7f4d301c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d301c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 -- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d30135c20 msgr2=0x7f4d301c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d30135c20 0x7f4d301c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.464+0000 7f4d348af700 1 -- 172.21.15.19:0/133770417 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d200094a0 con 0x7f4d3012cf60 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d348af700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000c00 tx=0x7f4d20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2001e070 con 0x7f4d3012cf60 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d20004250 con 0x7f4d3012cf60 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30129fa0 con 0x7f4d3012cf60 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d200045c0 con 0x7f4d3012cf60 2023-10-03T10:14:35.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.465+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d301332e0 con 0x7f4d3012cf60 2023-10-03T10:14:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.466+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d200036a0 con 0x7f4d3012cf60 2023-10-03T10:14:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.466+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d20040530 con 0x7f4d3012cf60 2023-10-03T10:14:35.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.466+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3006fe80 con 0x7f4d3012cf60 2023-10-03T10:14:35.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.472+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d20028080 con 0x7f4d3012cf60 2023-10-03T10:14:35.516 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.519+0000 7f50a3a90700 1 Processor -- start 2023-10-03T10:14:35.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.520+0000 7f50a3a90700 1 -- start start 2023-10-03T10:14:35.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a3a90700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a3a90700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 0x7f509c138500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a3a90700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c09ef50 con 0x7f509c06f640 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a3a90700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c09a370 con 0x7f509c070180 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a3a90700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c070860 con 0x7f509c130790 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a202d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 0x7f509c138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45346/0 (socket says 172.21.15.19:45346) 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 -- 172.21.15.19:0/2465339239 learned_addr learned my addr 172.21.15.19:0/2465339239 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 -- 172.21.15.19:0/2465339239 >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 msgr2=0x7f509c138500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 --2- 172.21.15.19:0/2465339239 >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 0x7f509c138500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 -- 172.21.15.19:0/2465339239 >> v1:172.21.15.19:6789/0 conn(0x7f509c06f640 legacy=0x7f509c06fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 -- 172.21.15.19:0/2465339239 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c1310a0 con 0x7f509c130790 2023-10-03T10:14:35.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a202d700 1 --2- 172.21.15.19:0/2465339239 >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 0x7f509c138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:35.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.521+0000 7f50a182c700 1 --2- 172.21.15.19:0/2465339239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50980131e0 tx=0x7f50980134f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96bda8e62042eaa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.522+0000 7f50a082a700 1 -- 172.21.15.19:0/2465339239 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098016070 con 0x7f509c130790 2023-10-03T10:14:35.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.522+0000 7f50a082a700 1 -- 172.21.15.19:0/2465339239 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5098013df0 con 0x7f509c130790 2023-10-03T10:14:35.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.522+0000 7f50a082a700 1 -- 172.21.15.19:0/2465339239 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5098004250 con 0x7f509c130790 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 -- 172.21.15.19:0/2465339239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 msgr2=0x7f509c130b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 --2- 172.21.15.19:0/2465339239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50980131e0 tx=0x7f50980134f0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 -- 172.21.15.19:0/2465339239 shutdown_connections 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 --2- 172.21.15.19:0/2465339239 >> v2:172.21.15.19:3300/0 conn(0x7f509c070180 0x7f509c138500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 --2- 172.21.15.19:0/2465339239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c130b60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 -- 172.21.15.19:0/2465339239 >> 172.21.15.19:0/2465339239 conn(0x7f509c0a2aa0 msgr2=0x7f509c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 -- 172.21.15.19:0/2465339239 shutdown_connections 2023-10-03T10:14:35.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.523+0000 7f50a3a90700 1 -- 172.21.15.19:0/2465339239 wait complete. 2023-10-03T10:14:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.524+0000 7f50a3a90700 1 Processor -- start 2023-10-03T10:14:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.524+0000 7f50a3a90700 1 -- start start 2023-10-03T10:14:35.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f509c06f640 0x7f509c11b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509c070180 0x7f509c11beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c12eba0 con 0x7f509c070180 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c071800 con 0x7f509c130790 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a3a90700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f509c11d5a0 con 0x7f509c06f640 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a202d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a202d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45362/0 (socket says 172.21.15.19:45362) 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a202d700 1 -- 172.21.15.19:0/4112362203 learned_addr learned my addr 172.21.15.19:0/4112362203 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.525+0000 7f50a102b700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509c070180 0x7f509c11beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a182c700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f509c06f640 0x7f509c11b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 -- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f509c06f640 msgr2=0x7f509c11b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f509c06f640 0x7f509c11b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 -- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509c070180 msgr2=0x7f509c11beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509c070180 0x7f509c11beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 -- 172.21.15.19:0/4112362203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5098011df0 con 0x7f509c130790 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.526+0000 7f50a202d700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5094009fa0 tx=0x7f509400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.527+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400ddb0 con 0x7f509c130790 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.527+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400f040 con 0x7f509c130790 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.527+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c11ee70 con 0x7f509c130790 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.527+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094003c60 con 0x7f509c130790 2023-10-03T10:14:35.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.527+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c11fba0 con 0x7f509c130790 2023-10-03T10:14:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.528+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5094004030 con 0x7f509c130790 2023-10-03T10:14:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.528+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c074ea0 con 0x7f509c130790 2023-10-03T10:14:35.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.528+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f509403f750 con 0x7f509c130790 2023-10-03T10:14:35.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.538+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f509401e3b0 con 0x7f509c130790 2023-10-03T10:14:35.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 Processor -- start 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 -- start start 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 0x7f2a8c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a8c06ee80 0x7f2a8c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8c070ee0 con 0x7f2a8c09eca0 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8c071480 con 0x7f2a8c06ee80 2023-10-03T10:14:35.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a9293a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c071b90 con 0x7f2a8c06e570 2023-10-03T10:14:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.569+0000 7f2a8b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a8c09eca0 0x7f2a8c134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:55516/0 (socket says 172.21.15.19:55516) 2023-10-03T10:14:35.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8b7fe700 1 -- 172.21.15.19:0/420649694 learned_addr learned my addr 172.21.15.19:0/420649694 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/420649694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 0x7f2a8c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a90ed7700 1 --2- 172.21.15.19:0/420649694 >> v2:172.21.15.19:3300/0 conn(0x7f2a8c06ee80 0x7f2a8c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8affd700 1 -- 172.21.15.19:0/420649694 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546021560 0 0) 0x7f2a8c070ee0 con 0x7f2a8c09eca0 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 -- 172.21.15.19:0/420649694 >> v2:172.21.15.19:3300/0 conn(0x7f2a8c06ee80 msgr2=0x7f2a8c134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/420649694 >> v2:172.21.15.19:3300/0 conn(0x7f2a8c06ee80 0x7f2a8c134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 -- 172.21.15.19:0/420649694 >> v1:172.21.15.19:6789/0 conn(0x7f2a8c09eca0 legacy=0x7f2a8c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 -- 172.21.15.19:0/420649694 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c0711a0 con 0x7f2a8c06e570 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/420649694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 0x7f2a8c06e940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009840 tx=0x7f2a7c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321defb24e5057ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8affd700 1 -- 172.21.15.19:0/420649694 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011830 con 0x7f2a8c06e570 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.570+0000 7f2a8affd700 1 -- 172.21.15.19:0/420649694 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c011990 con 0x7f2a8c06e570 2023-10-03T10:14:35.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.571+0000 7f2a8affd700 1 -- 172.21.15.19:0/420649694 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011d20 con 0x7f2a8c06e570 2023-10-03T10:14:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.571+0000 7f2a9293a700 1 -- 172.21.15.19:0/420649694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 msgr2=0x7f2a8c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.571+0000 7f2a9293a700 1 --2- 172.21.15.19:0/420649694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 0x7f2a8c06e940 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009840 tx=0x7f2a7c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 -- 172.21.15.19:0/420649694 shutdown_connections 2023-10-03T10:14:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 --2- 172.21.15.19:0/420649694 >> v2:172.21.15.19:3300/0 conn(0x7f2a8c06ee80 0x7f2a8c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 --2- 172.21.15.19:0/420649694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06e570 0x7f2a8c06e940 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 -- 172.21.15.19:0/420649694 >> 172.21.15.19:0/420649694 conn(0x7f2a8c0a2aa0 msgr2=0x7f2a8c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 -- 172.21.15.19:0/420649694 shutdown_connections 2023-10-03T10:14:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.572+0000 7f2a9293a700 1 -- 172.21.15.19:0/420649694 wait complete. 2023-10-03T10:14:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.573+0000 7f2a9293a700 1 Processor -- start 2023-10-03T10:14:35.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.573+0000 7f2a9293a700 1 -- start start 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 0x7f2a8c1266e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06ee80 0x7f2a8c124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 0x7f2a8c1253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c13c3c0 con 0x7f2a8c13db60 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c13d0c0 con 0x7f2a8c06e570 2023-10-03T10:14:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a9293a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8c1355e0 con 0x7f2a8c06ee80 2023-10-03T10:14:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a90ed7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 0x7f2a8c1253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a90ed7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 0x7f2a8c1253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51412/0 (socket says 172.21.15.19:51412) 2023-10-03T10:14:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a90ed7700 1 -- 172.21.15.19:0/2282736391 learned_addr learned my addr 172.21.15.19:0/2282736391 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.574+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 0x7f2a8c1266e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8b7fe700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06ee80 0x7f2a8c124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8bfff700 1 -- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06ee80 msgr2=0x7f2a8c124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06ee80 0x7f2a8c124e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8bfff700 1 -- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 msgr2=0x7f2a8c1253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 0x7f2a8c1253d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.575+0000 7f2a8bfff700 1 -- 172.21.15.19:0/2282736391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c0094a0 con 0x7f2a8c06e570 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a8bfff700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 0x7f2a8c1266e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c016000 tx=0x7f2a7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0036a0 con 0x7f2a8c06e570 2023-10-03T10:14:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c01f070 con 0x7f2a8c06e570 2023-10-03T10:14:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8c070610 con 0x7f2a8c06e570 2023-10-03T10:14:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c003a20 con 0x7f2a8c06e570 2023-10-03T10:14:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.576+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8c13b750 con 0x7f2a8c06e570 2023-10-03T10:14:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.577+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a7c003b80 con 0x7f2a8c06e570 2023-10-03T10:14:35.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.577+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a7c021070 con 0x7f2a8c06e570 2023-10-03T10:14:35.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.578+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a8c13d5c0 con 0x7f2a8c06e570 2023-10-03T10:14:35.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.583+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a8c13d5c0 con 0x7f2a8c06e570 2023-10-03T10:14:35.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.659+0000 7f1432298700 1 Processor -- start 2023-10-03T10:14:35.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.659+0000 7f1432298700 1 -- start start 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f1432298700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f1432298700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 0x7f142c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f1432298700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142c09ece0 con 0x7f142c131b40 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f1432298700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142c09e760 con 0x7f142c06a770 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f1432298700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c09e040 con 0x7f142c06b080 2023-10-03T10:14:35.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f142bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f142bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51416/0 (socket says 172.21.15.19:51416) 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f142bfff700 1 -- 172.21.15.19:0/2361738334 learned_addr learned my addr 172.21.15.19:0/2361738334 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.660+0000 7f142b7fe700 1 --2- 172.21.15.19:0/2361738334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 0x7f142c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142b7fe700 1 -- 172.21.15.19:0/2361738334 >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 msgr2=0x7f142c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142b7fe700 1 --2- 172.21.15.19:0/2361738334 >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142b7fe700 1 -- 172.21.15.19:0/2361738334 >> v1:172.21.15.19:6789/0 conn(0x7f142c131b40 legacy=0x7f142c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142b7fe700 1 -- 172.21.15.19:0/2361738334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c09f630 con 0x7f142c06b080 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142affd700 1 -- 172.21.15.19:0/2361738334 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916092234 0 0) 0x7f142c09ece0 con 0x7f142c131b40 2023-10-03T10:14:35.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142bfff700 1 --2- 172.21.15.19:0/2361738334 >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142b7fe700 1 --2- 172.21.15.19:0/2361738334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 0x7f142c131600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1420009840 tx=0x7f1420009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fec1fe0ee93b936 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142affd700 1 -- 172.21.15.19:0/2361738334 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420011830 con 0x7f142c06b080 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142affd700 1 -- 172.21.15.19:0/2361738334 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1420011990 con 0x7f142c06b080 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.661+0000 7f142affd700 1 -- 172.21.15.19:0/2361738334 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420011d20 con 0x7f142c06b080 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 -- 172.21.15.19:0/2361738334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 msgr2=0x7f142c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 --2- 172.21.15.19:0/2361738334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 0x7f142c131600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1420009840 tx=0x7f1420009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 -- 172.21.15.19:0/2361738334 shutdown_connections 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 --2- 172.21.15.19:0/2361738334 >> v2:172.21.15.19:3300/0 conn(0x7f142c06a770 0x7f142c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 --2- 172.21.15.19:0/2361738334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c06b080 0x7f142c131600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 -- 172.21.15.19:0/2361738334 >> 172.21.15.19:0/2361738334 conn(0x7f142c066f50 msgr2=0x7f142c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 -- 172.21.15.19:0/2361738334 shutdown_connections 2023-10-03T10:14:35.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.662+0000 7f1432298700 1 -- 172.21.15.19:0/2361738334 wait complete. 2023-10-03T10:14:35.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.664+0000 7f1432298700 1 Processor -- start 2023-10-03T10:14:35.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.664+0000 7f1432298700 1 -- start start 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 0x7f142c1c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c131b40 0x7f142c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c126010 con 0x7f142c06a770 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c09c190 con 0x7f142c06b080 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1432298700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f142c125d50 con 0x7f142c131b40 2023-10-03T10:14:35.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 0x7f142c1c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45378/0 (socket says 172.21.15.19:45378) 2023-10-03T10:14:35.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 -- 172.21.15.19:0/1005776472 learned_addr learned my addr 172.21.15.19:0/1005776472 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:35.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f1430835700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c131b40 0x7f142c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 -- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c131b40 msgr2=0x7f142c1c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c131b40 0x7f142c1c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 -- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 msgr2=0x7f142c1c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 0x7f142c1c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142b7fe700 1 -- 172.21.15.19:0/1005776472 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c009550 con 0x7f142c06b080 2023-10-03T10:14:35.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.665+0000 7f142bfff700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 0x7f142c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f142b7fe700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1420009fd0 tx=0x7f1420004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420004550 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14200094a0 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142c126a80 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142001f070 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.666+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200038a0 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.667+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1420003a00 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.667+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1420021070 con 0x7f142c06b080 2023-10-03T10:14:35.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.667+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0052e0 con 0x7f142c06b080 2023-10-03T10:14:35.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.676+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1420015020 con 0x7f142c06b080 2023-10-03T10:14:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.709+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4d30074ea0 con 0x7f4d3012cf60 2023-10-03T10:14:35.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.710+0000 7f4d25ffb700 1 -- 172.21.15.19:0/133770417 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d20014020 con 0x7f4d3012cf60 2023-10-03T10:14:35.710 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 msgr2=0x7f4d301c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4d20000c00 tx=0x7f4d20004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 shutdown_connections 2023-10-03T10:14:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d30135c20 0x7f4d301c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d3006f5d0 0x7f4d301c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 --2- 172.21.15.19:0/133770417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d3012cf60 0x7f4d301c4730 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 >> 172.21.15.19:0/133770417 conn(0x7f4d300a2aa0 msgr2=0x7f4d3012a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 shutdown_connections 2023-10-03T10:14:35.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.713+0000 7f4d37314700 1 -- 172.21.15.19:0/133770417 wait complete. 2023-10-03T10:14:35.733 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.769+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f509c072210 con 0x7f509c130790 2023-10-03T10:14:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.769+0000 7f50927fc700 1 -- 172.21.15.19:0/4112362203 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f509401a020 con 0x7f509c130790 2023-10-03T10:14:35.769 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 msgr2=0x7f509c11c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5094009fa0 tx=0x7f509400d3b0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 shutdown_connections 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f509c130790 0x7f509c11c3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f509c06f640 0x7f509c11b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 --2- 172.21.15.19:0/4112362203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f509c070180 0x7f509c11beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 >> 172.21.15.19:0/4112362203 conn(0x7f509c0a2aa0 msgr2=0x7f509c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 shutdown_connections 2023-10-03T10:14:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.772+0000 7f50a3a90700 1 -- 172.21.15.19:0/4112362203 wait complete. 2023-10-03T10:14:35.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:35.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.821+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a8c13d5c0 con 0x7f2a8c06e570 2023-10-03T10:14:35.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.822+0000 7f2a88ff9700 1 -- 172.21.15.19:0/2282736391 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a8c13d5c0 con 0x7f2a8c06e570 2023-10-03T10:14:35.822 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:35.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 msgr2=0x7f2a8c1266e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 0x7f2a8c1266e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c016000 tx=0x7f2a7c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 shutdown_connections 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a8c13db60 0x7f2a8c1253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a8c06e570 0x7f2a8c1266e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 --2- 172.21.15.19:0/2282736391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a8c06ee80 0x7f2a8c124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 >> 172.21.15.19:0/2282736391 conn(0x7f2a8c0a2aa0 msgr2=0x7f2a8c0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 shutdown_connections 2023-10-03T10:14:35.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.824+0000 7f2a9293a700 1 -- 172.21.15.19:0/2282736391 wait complete. 2023-10-03T10:14:35.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.906+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f140c005590 con 0x7f142c06b080 2023-10-03T10:14:35.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.906+0000 7f1428ff9700 1 -- 172.21.15.19:0/1005776472 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1420006bd0 con 0x7f142c06b080 2023-10-03T10:14:35.906 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 msgr2=0x7f142c1c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1420009fd0 tx=0x7f1420004750 comp rx=0 tx=0).stop 2023-10-03T10:14:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 shutdown_connections 2023-10-03T10:14:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f142c131b40 0x7f142c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f142c06a770 0x7f142c1c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 --2- 172.21.15.19:0/1005776472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f142c06b080 0x7f142c1c8530 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:35.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 >> 172.21.15.19:0/1005776472 conn(0x7f142c066f50 msgr2=0x7f142c06ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:35.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 shutdown_connections 2023-10-03T10:14:35.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:35.909+0000 7f1432298700 1 -- 172.21.15.19:0/1005776472 wait complete. 2023-10-03T10:14:35.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:36.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:36.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:36.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:36.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.885+0000 7fbeaa2da700 1 Processor -- start 2023-10-03T10:14:36.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.885+0000 7fbeaa2da700 1 -- start start 2023-10-03T10:14:36.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.885+0000 7fbeaa2da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 0x7fbea4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbeaa2da700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbeaa2da700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea41313c0 con 0x7fbea4099a40 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbeaa2da700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea409b580 con 0x7fbea409a580 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbeaa2da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea406e8c0 con 0x7fbea4131810 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea8877700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea8877700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57674/0 (socket says 172.21.15.19:57674) 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea8877700 1 -- 172.21.15.19:0/1040546023 learned_addr learned my addr 172.21.15.19:0/1040546023 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 --2- 172.21.15.19:0/1040546023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 0x7fbea4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 -- 172.21.15.19:0/1040546023 >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 msgr2=0x7fbea4139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 --2- 172.21.15.19:0/1040546023 >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 -- 172.21.15.19:0/1040546023 >> v1:172.21.15.19:6789/0 conn(0x7fbea4099a40 legacy=0x7fbea4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea2ffd700 1 -- 172.21.15.19:0/1040546023 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558794583 0 0) 0x7fbea41313c0 con 0x7fbea4099a40 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 -- 172.21.15.19:0/1040546023 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4071d20 con 0x7fbea4131810 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea8877700 1 --2- 172.21.15.19:0/1040546023 >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.886+0000 7fbea3fff700 1 --2- 172.21.15.19:0/1040546023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 0x7fbea4131be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d1947cbb9353a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.887+0000 7fbea2ffd700 1 -- 172.21.15.19:0/1040546023 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011830 con 0x7fbea4131810 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.887+0000 7fbea2ffd700 1 -- 172.21.15.19:0/1040546023 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe94011990 con 0x7fbea4131810 2023-10-03T10:14:36.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.887+0000 7fbea2ffd700 1 -- 172.21.15.19:0/1040546023 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94011d20 con 0x7fbea4131810 2023-10-03T10:14:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 -- 172.21.15.19:0/1040546023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 msgr2=0x7fbea4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/1040546023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 0x7fbea4131be0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe94009870 tx=0x7fbe94009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 -- 172.21.15.19:0/1040546023 shutdown_connections 2023-10-03T10:14:36.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/1040546023 >> v2:172.21.15.19:3300/0 conn(0x7fbea409a580 0x7fbea4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/1040546023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4131810 0x7fbea4131be0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 -- 172.21.15.19:0/1040546023 >> 172.21.15.19:0/1040546023 conn(0x7fbea40a2aa0 msgr2=0x7fbea40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 -- 172.21.15.19:0/1040546023 shutdown_connections 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.888+0000 7fbeaa2da700 1 -- 172.21.15.19:0/1040546023 wait complete. 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.889+0000 7fbeaa2da700 1 Processor -- start 2023-10-03T10:14:36.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 -- start start 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbea409a580 0x7fbea411ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 0x7fbea411bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea411fa30 con 0x7fbea409a580 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea411d160 con 0x7fbea4131810 2023-10-03T10:14:36.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.890+0000 7fbeaa2da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbea411e3b0 con 0x7fbea4099a40 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48868/0 (socket says 172.21.15.19:48868) 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 -- 172.21.15.19:0/3556269239 learned_addr learned my addr 172.21.15.19:0/3556269239 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea8877700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 0x7fbea411bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea37fe700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbea409a580 0x7fbea411ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 -- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 msgr2=0x7fbea411bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 0x7fbea411bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 -- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbea409a580 msgr2=0x7fbea411ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbea409a580 0x7fbea411ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 -- 172.21.15.19:0/3556269239 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9c009b30 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea8877700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 0x7fbea411bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea3fff700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097c0 tx=0x7fbe94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9401a8b0 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.891+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9401aa10 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.892+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe940094a0 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.892+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9401ada0 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.892+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe940243f0 con 0x7fbea4099a40 2023-10-03T10:14:36.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.892+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea40a1ba0 con 0x7fbea4099a40 2023-10-03T10:14:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.893+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe94019570 con 0x7fbea4099a40 2023-10-03T10:14:36.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.893+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea406eb60 con 0x7fbea4099a40 2023-10-03T10:14:36.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.903+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe94015070 con 0x7fbea4099a40 2023-10-03T10:14:36.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.937+0000 7f2e77758700 1 Processor -- start 2023-10-03T10:14:36.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.937+0000 7f2e77758700 1 -- start start 2023-10-03T10:14:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e701338a0 0x7f2e70133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7009de50 0x7f2e7009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009e760 0x7f2e7013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7006fef0 con 0x7f2e701338a0 2023-10-03T10:14:36.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7006ef30 con 0x7f2e7009de50 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e77758700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701334b0 con 0x7f2e7009e760 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e701338a0 0x7f2e70133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e701338a0 0x7f2e70133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57684/0 (socket says 172.21.15.19:57684) 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 -- 172.21.15.19:0/15354358 learned_addr learned my addr 172.21.15.19:0/15354358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 -- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009e760 msgr2=0x7f2e7013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009e760 0x7f2e7013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 -- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7009de50 msgr2=0x7f2e7009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7009de50 0x7f2e7009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.938+0000 7f2e754f4700 1 -- 172.21.15.19:0/15354358 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7006fc30 con 0x7f2e701338a0 2023-10-03T10:14:36.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.939+0000 7f2e754f4700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e701338a0 0x7f2e70133c70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098f0 tx=0x7f2e6c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c4d841139225d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.939+0000 7f2e67fff700 1 -- 172.21.15.19:0/15354358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00b8a0 con 0x7f2e701338a0 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.939+0000 7f2e67fff700 1 -- 172.21.15.19:0/15354358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00ba00 con 0x7f2e701338a0 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.939+0000 7f2e67fff700 1 -- 172.21.15.19:0/15354358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00bd90 con 0x7f2e701338a0 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 -- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e701338a0 msgr2=0x7f2e70133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e701338a0 0x7f2e70133c70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0098f0 tx=0x7f2e6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 -- 172.21.15.19:0/15354358 shutdown_connections 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009e760 0x7f2e7013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e701338a0 0x7f2e70133c70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 --2- 172.21.15.19:0/15354358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7009de50 0x7f2e7009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 -- 172.21.15.19:0/15354358 >> 172.21.15.19:0/15354358 conn(0x7f2e700a2aa0 msgr2=0x7f2e700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 -- 172.21.15.19:0/15354358 shutdown_connections 2023-10-03T10:14:36.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.940+0000 7f2e77758700 1 -- 172.21.15.19:0/15354358 wait complete. 2023-10-03T10:14:36.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 Processor -- start 2023-10-03T10:14:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 -- start start 2023-10-03T10:14:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 0x7f2e7011d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 0x7f2e7011df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e701338a0 0x7f2e7011e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700a0fb0 con 0x7f2e7009e760 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70130c10 con 0x7f2e701338a0 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.941+0000 7f2e77758700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7006f640 con 0x7f2e7009de50 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e754f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 0x7f2e7011d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e754f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 0x7f2e7011d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48874/0 (socket says 172.21.15.19:48874) 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e754f4700 1 -- 172.21.15.19:0/1282181170 learned_addr learned my addr 172.21.15.19:0/1282181170 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 0x7f2e7011df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 -- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 msgr2=0x7f2e7011d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 0x7f2e7011d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 -- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e701338a0 msgr2=0x7f2e7011e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e701338a0 0x7f2e7011e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 -- 172.21.15.19:0/1282181170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009550 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.942+0000 7f2e74cf3700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 0x7f2e7011df10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000b410 tx=0x7f2e6000b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60011830 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6000be90 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e70120220 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e60011bd0 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e701218a0 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.943+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e60011d30 con 0x7f2e7009e760 2023-10-03T10:14:36.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.944+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e6003f550 con 0x7f2e7009e760 2023-10-03T10:14:36.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.944+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70121210 con 0x7f2e7009e760 2023-10-03T10:14:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.949+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e60015020 con 0x7f2e7009e760 2023-10-03T10:14:36.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.991+0000 7fa55c872700 1 Processor -- start 2023-10-03T10:14:36.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.991+0000 7fa55c872700 1 -- start start 2023-10-03T10:14:36.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55c872700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 0x7fa55806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55c872700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 0x7fa558131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55c872700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55809ece0 con 0x7fa558131b40 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55c872700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55809e760 con 0x7fa55806b080 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55c872700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55809e040 con 0x7fa55806a770 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa555d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 0x7fa558131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa555d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 0x7fa558131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57706/0 (socket says 172.21.15.19:57706) 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 0x7fa55806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa555d9b700 1 -- 172.21.15.19:0/139495436 learned_addr learned my addr 172.21.15.19:0/139495436 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55659c700 1 -- 172.21.15.19:0/139495436 >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 msgr2=0x7fa558131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55659c700 1 --2- 172.21.15.19:0/139495436 >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 0x7fa558131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55659c700 1 -- 172.21.15.19:0/139495436 >> v1:172.21.15.19:6789/0 conn(0x7fa558131b40 legacy=0x7fa558138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.992+0000 7fa55659c700 1 -- 172.21.15.19:0/139495436 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55809f630 con 0x7fa55806a770 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55659c700 1 --2- 172.21.15.19:0/139495436 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 0x7fa55806ab40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa54800dc60 tx=0x7fa54800df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73a1b1362a6d9a76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55559a700 1 -- 172.21.15.19:0/139495436 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548012070 con 0x7fa55806a770 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55559a700 1 -- 172.21.15.19:0/139495436 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800d2e0 con 0x7fa55806a770 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55559a700 1 -- 172.21.15.19:0/139495436 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54800f900 con 0x7fa55806a770 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55c872700 1 -- 172.21.15.19:0/139495436 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 msgr2=0x7fa55806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.993+0000 7fa55c872700 1 --2- 172.21.15.19:0/139495436 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 0x7fa55806ab40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa54800dc60 tx=0x7fa54800df70 comp rx=0 tx=0).stop 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 -- 172.21.15.19:0/139495436 shutdown_connections 2023-10-03T10:14:36.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 --2- 172.21.15.19:0/139495436 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa55806a770 0x7fa55806ab40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 --2- 172.21.15.19:0/139495436 >> v2:172.21.15.19:3300/0 conn(0x7fa55806b080 0x7fa558131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 -- 172.21.15.19:0/139495436 >> 172.21.15.19:0/139495436 conn(0x7fa558066f50 msgr2=0x7fa55809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 -- 172.21.15.19:0/139495436 shutdown_connections 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.994+0000 7fa55c872700 1 -- 172.21.15.19:0/139495436 wait complete. 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.995+0000 7fa55c872700 1 Processor -- start 2023-10-03T10:14:36.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.995+0000 7fa55c872700 1 -- start start 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa55806b080 0x7fa55811f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa558131b40 0x7fa5581c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55811fbb0 con 0x7fa55806b080 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa558130fc0 con 0x7fa558131b40 2023-10-03T10:14:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55c872700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55809c330 con 0x7fa55806a770 2023-10-03T10:14:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48880/0 (socket says 172.21.15.19:48880) 2023-10-03T10:14:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa555d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa55806b080 0x7fa55811f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa55659c700 1 -- 172.21.15.19:0/756571372 learned_addr learned my addr 172.21.15.19:0/756571372 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:36.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.996+0000 7fa556d9d700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa558131b40 0x7fa5581c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 -- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa558131b40 msgr2=0x7fa5581c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa558131b40 0x7fa5581c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 -- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa55806b080 msgr2=0x7fa55811f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa55806b080 0x7fa55811f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 -- 172.21.15.19:0/756571372 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54800d940 con 0x7fa55806a770 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa55659c700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa548004270 tx=0x7fa548004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548006af0 con 0x7fa55806a770 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54800d7c0 con 0x7fa55806a770 2023-10-03T10:14:36.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.997+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5480038a0 con 0x7fa55806a770 2023-10-03T10:14:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.998+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa558071e60 con 0x7fa55806a770 2023-10-03T10:14:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.998+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa558121bd0 con 0x7fa55806a770 2023-10-03T10:14:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.999+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa548003a00 con 0x7fa55806a770 2023-10-03T10:14:36.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:36.999+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5480449e0 con 0x7fa55806a770 2023-10-03T10:14:37.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.000+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa558074ea0 con 0x7fa55806a770 2023-10-03T10:14:37.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.005+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa54800b970 con 0x7fa55806a770 2023-10-03T10:14:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.107+0000 7fb04e112700 1 Processor -- start 2023-10-03T10:14:37.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.107+0000 7fb04e112700 1 -- start start 2023-10-03T10:14:37.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb04e112700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb04809d6f0 0x7fb04809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb04e112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb04e112700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04809b120 con 0x7fb04809e410 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb04e112700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04806b460 con 0x7fb04809d6f0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb04e112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04809a7e0 con 0x7fb04809e000 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.108+0000 7fb046ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42560/0 (socket says 172.21.15.19:42560) 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 -- 172.21.15.19:0/1520347274 learned_addr learned my addr 172.21.15.19:0/1520347274 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:37.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb0477fe700 1 --2- 172.21.15.19:0/1520347274 >> v2:172.21.15.19:3300/0 conn(0x7fb04809d6f0 0x7fb04809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 -- 172.21.15.19:0/1520347274 >> v2:172.21.15.19:3300/0 conn(0x7fb04809d6f0 msgr2=0x7fb04809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 --2- 172.21.15.19:0/1520347274 >> v2:172.21.15.19:3300/0 conn(0x7fb04809d6f0 0x7fb04809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 -- 172.21.15.19:0/1520347274 >> v1:172.21.15.19:6789/0 conn(0x7fb04809e410 legacy=0x7fb048133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 -- 172.21.15.19:0/1520347274 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04809a500 con 0x7fb04809e000 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb046ffd700 1 --2- 172.21.15.19:0/1520347274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009920 tx=0x7fb03c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=337bb3032e5cfff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb0467fc700 1 -- 172.21.15.19:0/1520347274 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011830 con 0x7fb04809e000 2023-10-03T10:14:37.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb0467fc700 1 -- 172.21.15.19:0/1520347274 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c011990 con 0x7fb04809e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.109+0000 7fb0467fc700 1 -- 172.21.15.19:0/1520347274 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c011d20 con 0x7fb04809e000 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 -- 172.21.15.19:0/1520347274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 msgr2=0x7fb0481339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 --2- 172.21.15.19:0/1520347274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb03c009920 tx=0x7fb03c009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 -- 172.21.15.19:0/1520347274 shutdown_connections 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 --2- 172.21.15.19:0/1520347274 >> v2:172.21.15.19:3300/0 conn(0x7fb04809d6f0 0x7fb04809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 --2- 172.21.15.19:0/1520347274 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e000 0x7fb0481339f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 -- 172.21.15.19:0/1520347274 >> 172.21.15.19:0/1520347274 conn(0x7fb048066f50 msgr2=0x7fb04809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 -- 172.21.15.19:0/1520347274 shutdown_connections 2023-10-03T10:14:37.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.110+0000 7fb04e112700 1 -- 172.21.15.19:0/1520347274 wait complete. 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.111+0000 7fb04e112700 1 Processor -- start 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.111+0000 7fb04e112700 1 -- start start 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04809e000 0x7fb0481a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 0x7fb0481a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:37.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481a7380 con 0x7fb04809e000 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481a7ae0 con 0x7fb04809e410 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb04e112700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481a8100 con 0x7fb04809d6f0 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb047fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 0x7fb0481a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48886/0 (socket says 172.21.15.19:48886) 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb047fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 0x7fb0481a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42564/0 (socket says 172.21.15.19:42564) 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb0477fe700 1 -- 172.21.15.19:0/516761783 learned_addr learned my addr 172.21.15.19:0/516761783 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:37.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.112+0000 7fb046ffd700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04809e000 0x7fb0481a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 -- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 msgr2=0x7fb0481a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 0x7fb0481a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 -- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04809e000 msgr2=0x7fb0481a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04809e000 0x7fb0481a6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 -- 172.21.15.19:0/516761783 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009550 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb0477fe700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb03800e8a0 tx=0x7fb03800ebb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb038009590 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb038013680 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0380139f0 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0481a9710 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.113+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0480a31a0 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.114+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb038013b50 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.115+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb03803f580 con 0x7fb04809d6f0 2023-10-03T10:14:37.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.115+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04809c770 con 0x7fb04809d6f0 2023-10-03T10:14:37.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.120+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb038021020 con 0x7fb04809d6f0 2023-10-03T10:14:37.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.129+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbea4074ea0 con 0x7fbea4099a40 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.129+0000 7fbea0ff9700 1 -- 172.21.15.19:0/3556269239 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe94015020 con 0x7fbea4099a40 2023-10-03T10:14:37.129 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 msgr2=0x7fbea411b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097c0 tx=0x7fbe94004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 shutdown_connections 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbea4131810 0x7fbea411bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbea4099a40 0x7fbea411b550 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 --2- 172.21.15.19:0/3556269239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbea409a580 0x7fbea411ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 >> 172.21.15.19:0/3556269239 conn(0x7fbea40a2aa0 msgr2=0x7fbea41b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 shutdown_connections 2023-10-03T10:14:37.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.132+0000 7fbeaa2da700 1 -- 172.21.15.19:0/3556269239 wait complete. 2023-10-03T10:14:37.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:37.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.164+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e70120fb0 con 0x7f2e7009e760 2023-10-03T10:14:37.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.165+0000 7f2e65ffb700 1 -- 172.21.15.19:0/1282181170 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e70120fb0 con 0x7f2e7009e760 2023-10-03T10:14:37.164 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 msgr2=0x7f2e7011df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 0x7f2e7011df10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e6000b410 tx=0x7f2e6000b720 comp rx=0 tx=0).stop 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 shutdown_connections 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e701338a0 0x7f2e7011e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7009de50 0x7f2e7011d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 --2- 172.21.15.19:0/1282181170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7009e760 0x7f2e7011df10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 >> 172.21.15.19:0/1282181170 conn(0x7f2e700a2aa0 msgr2=0x7f2e701b9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 shutdown_connections 2023-10-03T10:14:37.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.167+0000 7f2e77758700 1 -- 172.21.15.19:0/1282181170 wait complete. 2023-10-03T10:14:37.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.263+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa558120ed0 con 0x7fa55806a770 2023-10-03T10:14:37.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.263+0000 7fa546ffd700 1 -- 172.21.15.19:0/756571372 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa54801fb00 con 0x7fa55806a770 2023-10-03T10:14:37.263 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 msgr2=0x7fa55811f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa548004270 tx=0x7fa548004750 comp rx=0 tx=0).stop 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 shutdown_connections 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa558131b40 0x7fa5581c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa55806a770 0x7fa55811f130 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 --2- 172.21.15.19:0/756571372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa55806b080 0x7fa55811f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 >> 172.21.15.19:0/756571372 conn(0x7fa558066f50 msgr2=0x7fa5580a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 shutdown_connections 2023-10-03T10:14:37.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.266+0000 7fa55c872700 1 -- 172.21.15.19:0/756571372 wait complete. 2023-10-03T10:14:37.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:37.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.330+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb048074ea0 con 0x7fb04809d6f0 2023-10-03T10:14:37.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.331+0000 7fb02ffff700 1 -- 172.21.15.19:0/516761783 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb038017070 con 0x7fb04809d6f0 2023-10-03T10:14:37.330 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 msgr2=0x7fb0481a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb03800e8a0 tx=0x7fb03800ebb0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 shutdown_connections 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb04809e410 0x7fb0481a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb04809d6f0 0x7fb0481a5ed0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 --2- 172.21.15.19:0/516761783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb04809e000 0x7fb0481a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 >> 172.21.15.19:0/516761783 conn(0x7fb048066f50 msgr2=0x7fb0481bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:37.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 shutdown_connections 2023-10-03T10:14:37.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:37.333+0000 7fb04e112700 1 -- 172.21.15.19:0/516761783 wait complete. 2023-10-03T10:14:37.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:38.148 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:38.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:38.280 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:38.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.296+0000 7f460b1a0700 1 Processor -- start 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.296+0000 7f460b1a0700 1 -- start start 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460b1a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 0x7f460409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460b1a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460b1a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460409b120 con 0x7f460409e410 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460b1a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460406b460 con 0x7f460409d6f0 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460b1a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f460409a7e0 con 0x7f460409e000 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4608f3c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 0x7f460409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460973d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f460409e410 0x7f4604133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37772/0 (socket says 172.21.15.19:37772) 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f460973d700 1 -- 172.21.15.19:0/3989074383 learned_addr learned my addr 172.21.15.19:0/3989074383 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:38.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f46037fe700 1 -- 172.21.15.19:0/3989074383 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285242758 0 0) 0x7f460409b120 con 0x7f460409e410 2023-10-03T10:14:38.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 -- 172.21.15.19:0/3989074383 >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 msgr2=0x7f460409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 --2- 172.21.15.19:0/3989074383 >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 0x7f460409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 -- 172.21.15.19:0/3989074383 >> v1:172.21.15.19:6789/0 conn(0x7f460409e410 legacy=0x7f4604133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 -- 172.21.15.19:0/3989074383 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460409a500 con 0x7f460409e000 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4608f3c700 1 --2- 172.21.15.19:0/3989074383 >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 0x7f460409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.297+0000 7f4603fff700 1 --2- 172.21.15.19:0/3989074383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041339f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5ac611af9c0ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f46037fe700 1 -- 172.21.15.19:0/3989074383 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0011830 con 0x7f460409e000 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f46037fe700 1 -- 172.21.15.19:0/3989074383 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f0011990 con 0x7f460409e000 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f46037fe700 1 -- 172.21.15.19:0/3989074383 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0011d20 con 0x7f460409e000 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 -- 172.21.15.19:0/3989074383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 msgr2=0x7f46041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 --2- 172.21.15.19:0/3989074383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041339f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009870 tx=0x7f45f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 -- 172.21.15.19:0/3989074383 shutdown_connections 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 --2- 172.21.15.19:0/3989074383 >> v2:172.21.15.19:3300/0 conn(0x7f460409d6f0 0x7f460409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 --2- 172.21.15.19:0/3989074383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041339f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 -- 172.21.15.19:0/3989074383 >> 172.21.15.19:0/3989074383 conn(0x7f4604066f50 msgr2=0x7f460409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.298+0000 7f460b1a0700 1 -- 172.21.15.19:0/3989074383 shutdown_connections 2023-10-03T10:14:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.299+0000 7f460b1a0700 1 -- 172.21.15.19:0/3989074383 wait complete. 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 Processor -- start 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 -- start start 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f460409d6f0 0x7f46041c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46041a7c10 con 0x7f460409e410 2023-10-03T10:14:38.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.300+0000 7f460b1a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46041bcfa0 con 0x7f460409d6f0 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f460b1a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46041a81b0 con 0x7f460409e000 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f460973d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f460973d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57746/0 (socket says 172.21.15.19:57746) 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f460973d700 1 -- 172.21.15.19:0/2442614747 learned_addr learned my addr 172.21.15.19:0/2442614747 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4608f3c700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f460409d6f0 0x7f46041c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 -- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f460409d6f0 msgr2=0x7f46041c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f460409d6f0 0x7f46041c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 -- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 msgr2=0x7f46041a4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 -- 172.21.15.19:0/2442614747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80094a0 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f460973d700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.301+0000 7f4603fff700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041c8840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45f0016000 tx=0x7f45f0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00036a0 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f001f070 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00094a0 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0003a20 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46041a6b00 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.302+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45f0003b80 con 0x7f460409e000 2023-10-03T10:14:38.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.303+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f45f0021070 con 0x7f460409e000 2023-10-03T10:14:38.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.303+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4604074ea0 con 0x7f460409e000 2023-10-03T10:14:38.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.308+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45f001a430 con 0x7f460409e000 2023-10-03T10:14:38.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.338+0000 7f8200097700 1 Processor -- start 2023-10-03T10:14:38.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.338+0000 7f8200097700 1 -- start start 2023-10-03T10:14:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f8200097700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f8200097700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f8200097700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f809edd0 con 0x7f81f8133fa0 2023-10-03T10:14:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f8200097700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f809e1f0 con 0x7f81f80a1340 2023-10-03T10:14:38.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f8200097700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f809dc50 con 0x7f81f80a0a30 2023-10-03T10:14:38.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f81fd632700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f81fe634700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f81f8133fa0 0x7f81f813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37788/0 (socket says 172.21.15.19:37788) 2023-10-03T10:14:38.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f81fe634700 1 -- 172.21.15.19:0/3985018073 learned_addr learned my addr 172.21.15.19:0/3985018073 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:38.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.339+0000 7f81fde33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fce31700 1 -- 172.21.15.19:0/3985018073 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176922753 0 0) 0x7f81f809edd0 con 0x7f81f8133fa0 2023-10-03T10:14:38.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fce31700 1 -- 172.21.15.19:0/3985018073 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81e40035b0 con 0x7f81f8133fa0 2023-10-03T10:14:38.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fde33700 1 -- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 msgr2=0x7f81f8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fde33700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fde33700 1 -- 172.21.15.19:0/3985018073 >> v1:172.21.15.19:6789/0 conn(0x7f81f8133fa0 legacy=0x7f81f813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fde33700 1 -- 172.21.15.19:0/3985018073 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80a1fe0 con 0x7f81f80a0a30 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fd632700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fde33700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f80a0e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009dc0 tx=0x7f81f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d101ff5cf043cec3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fce31700 1 -- 172.21.15.19:0/3985018073 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f400e070 con 0x7f81f80a0a30 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fce31700 1 -- 172.21.15.19:0/3985018073 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f400bb20 con 0x7f81f80a0a30 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.340+0000 7f81fce31700 1 -- 172.21.15.19:0/3985018073 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4012430 con 0x7f81f80a0a30 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 -- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 msgr2=0x7f81f80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f80a0e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009dc0 tx=0x7f81f400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 -- 172.21.15.19:0/3985018073 shutdown_connections 2023-10-03T10:14:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f80a0e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 --2- 172.21.15.19:0/3985018073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 -- 172.21.15.19:0/3985018073 >> 172.21.15.19:0/3985018073 conn(0x7f81f80a6550 msgr2=0x7f81f80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 -- 172.21.15.19:0/3985018073 shutdown_connections 2023-10-03T10:14:38.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.341+0000 7f8200097700 1 -- 172.21.15.19:0/3985018073 wait complete. 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.342+0000 7f8200097700 1 Processor -- start 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 -- start start 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f81c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 0x7f81f81c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8124510 con 0x7f81f8133fa0 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8125210 con 0x7f81f80a1340 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f8200097700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8126420 con 0x7f81f80a0a30 2023-10-03T10:14:38.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f81fd632700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.343+0000 7f81fde33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f81c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fd632700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42598/0 (socket says 172.21.15.19:42598) 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fd632700 1 -- 172.21.15.19:0/1482916704 learned_addr learned my addr 172.21.15.19:0/1482916704 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 0x7f81f81c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 -- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 msgr2=0x7f81f81c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f81c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 -- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 msgr2=0x7f81f81c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 -- 172.21.15.19:0/1482916704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80094a0 con 0x7f81f8133fa0 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fd632700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fde33700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f81c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81fe634700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 0x7f81f81c8d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f0005d70 con 0x7f81f8133fa0 2023-10-03T10:14:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f000ce10 con 0x7f81f8133fa0 2023-10-03T10:14:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f4009a70 con 0x7f81f8133fa0 2023-10-03T10:14:38.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00072d0 con 0x7f81f8133fa0 2023-10-03T10:14:38.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.344+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f80a25e0 con 0x7f81f8133fa0 2023-10-03T10:14:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.345+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f81f0007430 con 0x7f81f8133fa0 2023-10-03T10:14:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.346+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8125de0 con 0x7f81f8133fa0 2023-10-03T10:14:38.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.346+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f81f003e9b0 con 0x7f81f8133fa0 2023-10-03T10:14:38.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.355+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f81f8125de0 con 0x7f81f8133fa0 2023-10-03T10:14:38.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.432+0000 7fc94359e700 1 Processor -- start 2023-10-03T10:14:38.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 -- start start 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc94409a260 0x7fc944135750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94409ab20 con 0x7fc944099780 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94409b890 con 0x7fc94409a260 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.433+0000 7fc94359e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94409bb50 con 0x7fc944135c90 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42600/0 (socket says 172.21.15.19:42600) 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc94259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc944099780 0x7fc944099b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37804/0 (socket says 172.21.15.19:37804) 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 -- 172.21.15.19:0/4228798673 learned_addr learned my addr 172.21.15.19:0/4228798673 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc941d9b700 1 --2- 172.21.15.19:0/4228798673 >> v2:172.21.15.19:3300/0 conn(0x7fc94409a260 0x7fc944135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 -- 172.21.15.19:0/4228798673 >> v2:172.21.15.19:3300/0 conn(0x7fc94409a260 msgr2=0x7fc944135750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 --2- 172.21.15.19:0/4228798673 >> v2:172.21.15.19:3300/0 conn(0x7fc94409a260 0x7fc944135750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 -- 172.21.15.19:0/4228798673 >> v1:172.21.15.19:6789/0 conn(0x7fc944099780 legacy=0x7fc944099b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 -- 172.21.15.19:0/4228798673 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944099210 con 0x7fc944135c90 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc942d9d700 1 --2- 172.21.15.19:0/4228798673 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00bf60 tx=0x7fc93c00bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35336e61325a868e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.434+0000 7fc94159a700 1 -- 172.21.15.19:0/4228798673 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00b4e0 con 0x7fc944135c90 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94159a700 1 -- 172.21.15.19:0/4228798673 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c00da00 con 0x7fc944135c90 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94159a700 1 -- 172.21.15.19:0/4228798673 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00ddb0 con 0x7fc944135c90 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 -- 172.21.15.19:0/4228798673 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 msgr2=0x7fc944138070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 --2- 172.21.15.19:0/4228798673 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00bf60 tx=0x7fc93c00bf90 comp rx=0 tx=0).stop 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 -- 172.21.15.19:0/4228798673 shutdown_connections 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 --2- 172.21.15.19:0/4228798673 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944138070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 --2- 172.21.15.19:0/4228798673 >> v2:172.21.15.19:3300/0 conn(0x7fc94409a260 0x7fc944135750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 -- 172.21.15.19:0/4228798673 >> 172.21.15.19:0/4228798673 conn(0x7fc9440a2540 msgr2=0x7fc9440a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 -- 172.21.15.19:0/4228798673 shutdown_connections 2023-10-03T10:14:38.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.435+0000 7fc94359e700 1 -- 172.21.15.19:0/4228798673 wait complete. 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 Processor -- start 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 -- start start 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc944099780 0x7fc944132530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 0x7fc944132a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94408d960 con 0x7fc94409a260 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94408edd0 con 0x7fc944135c90 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94359e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9440a1d00 con 0x7fc944099780 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc942d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc94259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc944099780 0x7fc944132530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc942d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42614/0 (socket says 172.21.15.19:42614) 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.437+0000 7fc942d9d700 1 -- 172.21.15.19:0/3169716209 learned_addr learned my addr 172.21.15.19:0/3169716209 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc941d9b700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 0x7fc944132a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 -- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc944099780 msgr2=0x7fc944132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc944099780 0x7fc944132530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 -- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 msgr2=0x7fc944132a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 0x7fc944132a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 -- 172.21.15.19:0/3169716209 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c00bd40 con 0x7fc944135c90 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc941d9b700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 0x7fc944132a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:38.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc942d9d700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc93c016000 tx=0x7fc93c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009e30 con 0x7fc944135c90 2023-10-03T10:14:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c022040 con 0x7fc944135c90 2023-10-03T10:14:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94408e830 con 0x7fc944135c90 2023-10-03T10:14:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c012710 con 0x7fc944135c90 2023-10-03T10:14:38.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.438+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94408d6b0 con 0x7fc944135c90 2023-10-03T10:14:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.439+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc93c01c450 con 0x7fc944135c90 2023-10-03T10:14:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.439+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc93c045000 con 0x7fc944135c90 2023-10-03T10:14:38.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.440+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94404f2a0 con 0x7fc944135c90 2023-10-03T10:14:38.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.449+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc93c025940 con 0x7fc944135c90 2023-10-03T10:14:38.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.506+0000 7fddfe26c700 1 Processor -- start 2023-10-03T10:14:38.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.506+0000 7fddfe26c700 1 -- start start 2023-10-03T10:14:38.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddf809f650 0x7fddf8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf8070940 con 0x7fddf809f650 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf806fd60 con 0x7fddf809e930 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfe26c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddf806fa80 con 0x7fddf809f240 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddf77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42630/0 (socket says 172.21.15.19:42630) 2023-10-03T10:14:38.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddfc809700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddf809f650 0x7fddf8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.507+0000 7fddf7fff700 1 -- 172.21.15.19:0/1456939168 learned_addr learned my addr 172.21.15.19:0/1456939168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 -- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 msgr2=0x7fddf81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 -- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 msgr2=0x7fddf809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 -- 172.21.15.19:0/1456939168 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf809fb60 con 0x7fddf809f650 2023-10-03T10:14:38.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddf7fff700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddfc809700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf8131d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009d90 tx=0x7fddf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735476fd8f4fdc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddf6ffd700 1 -- 172.21.15.19:0/1456939168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf000e070 con 0x7fddf809f650 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddf6ffd700 1 -- 172.21.15.19:0/1456939168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf000bb20 con 0x7fddf809f650 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.508+0000 7fddf6ffd700 1 -- 172.21.15.19:0/1456939168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0012430 con 0x7fddf809f650 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 -- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 msgr2=0x7fddf8131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf8131d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009d90 tx=0x7fddf000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 -- 172.21.15.19:0/1456939168 shutdown_connections 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf8131d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 --2- 172.21.15.19:0/1456939168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 -- 172.21.15.19:0/1456939168 >> 172.21.15.19:0/1456939168 conn(0x7fddf80a4210 msgr2=0x7fddf80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 -- 172.21.15.19:0/1456939168 shutdown_connections 2023-10-03T10:14:38.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.509+0000 7fddfe26c700 1 -- 172.21.15.19:0/1456939168 wait complete. 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.510+0000 7fddfe26c700 1 Processor -- start 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 -- start start 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf81a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf81c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81b5310 con 0x7fddf809f650 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81a51d0 con 0x7fddf809e930 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.511+0000 7fddfe26c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81a1f80 con 0x7fddf809f240 2023-10-03T10:14:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf81a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddf7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf81a23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42642/0 (socket says 172.21.15.19:42642) 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddf7fff700 1 -- 172.21.15.19:0/3649859613 learned_addr learned my addr 172.21.15.19:0/3649859613 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf81c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddf77fe700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 -- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 msgr2=0x7fddf81a28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81a28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 -- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 msgr2=0x7fddf81a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf81a23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 -- 172.21.15.19:0/3649859613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde800d9f0 con 0x7fddf809f650 2023-10-03T10:14:38.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddf77fe700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81a28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:38.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.512+0000 7fddfc809700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf81c3c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072a80 tx=0x7fddf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:38.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.513+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0004800 con 0x7fddf809f650 2023-10-03T10:14:38.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.513+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0020070 con 0x7fddf809f650 2023-10-03T10:14:38.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.513+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf0009a70 con 0x7fddf809f650 2023-10-03T10:14:38.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.513+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00276c0 con 0x7fddf809f650 2023-10-03T10:14:38.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.513+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf80a0190 con 0x7fddf809f650 2023-10-03T10:14:38.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.514+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddf0012430 con 0x7fddf809f650 2023-10-03T10:14:38.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.514+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fddf0022070 con 0x7fddf809f650 2023-10-03T10:14:38.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.514+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf8074ea0 con 0x7fddf809f650 2023-10-03T10:14:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.519+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddf001c400 con 0x7fddf809f650 2023-10-03T10:14:38.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.537+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f460406c360 con 0x7f460409e000 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.538+0000 7f46017fa700 1 -- 172.21.15.19:0/2442614747 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45f0015020 con 0x7f460409e000 2023-10-03T10:14:38.538 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 msgr2=0x7f46041c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041c8840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f45f0016000 tx=0x7f45f0004750 comp rx=0 tx=0).stop 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 shutdown_connections 2023-10-03T10:14:38.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f460409e410 0x7f46041a4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f460409d6f0 0x7f46041c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 --2- 172.21.15.19:0/2442614747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f460409e000 0x7f46041c8840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 >> 172.21.15.19:0/2442614747 conn(0x7f4604066f50 msgr2=0x7f46041bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 shutdown_connections 2023-10-03T10:14:38.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.540+0000 7f460b1a0700 1 -- 172.21.15.19:0/2442614747 wait complete. 2023-10-03T10:14:38.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:38.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.576+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f81f8125de0 con 0x7f81f8133fa0 2023-10-03T10:14:38.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.577+0000 7f81ee7fc700 1 -- 172.21.15.19:0/1482916704 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81f8125de0 con 0x7f81f8133fa0 2023-10-03T10:14:38.577 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 msgr2=0x7f81f81c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 0x7f81f81c8d00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c400 tx=0x7f81f000c710 comp rx=0 tx=0).stop 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 shutdown_connections 2023-10-03T10:14:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f81f8133fa0 0x7f81f81c8d00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f81f80a0a30 0x7f81f81c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 --2- 172.21.15.19:0/1482916704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f81f80a1340 0x7f81f81c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 >> 172.21.15.19:0/1482916704 conn(0x7f81f80a6550 msgr2=0x7f81f80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 shutdown_connections 2023-10-03T10:14:38.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.579+0000 7f8200097700 1 -- 172.21.15.19:0/1482916704 wait complete. 2023-10-03T10:14:38.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:38.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.672+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc9440983b0 con 0x7fc944135c90 2023-10-03T10:14:38.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.672+0000 7fc932ffd700 1 -- 172.21.15.19:0/3169716209 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc93c02e370 con 0x7fc944135c90 2023-10-03T10:14:38.672 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 msgr2=0x7fc944132fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc93c016000 tx=0x7fc93c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 shutdown_connections 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc944135c90 0x7fc944132fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc944099780 0x7fc944132530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 --2- 172.21.15.19:0/3169716209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc94409a260 0x7fc944132a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.674+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 >> 172.21.15.19:0/3169716209 conn(0x7fc9440a2540 msgr2=0x7fc944096390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.675+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 shutdown_connections 2023-10-03T10:14:38.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.675+0000 7fc94359e700 1 -- 172.21.15.19:0/3169716209 wait complete. 2023-10-03T10:14:38.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:38.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.741+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fddf80008d0 con 0x7fddf809f650 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.741+0000 7fddf4ff9700 1 -- 172.21.15.19:0/3649859613 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddf002f3a0 con 0x7fddf809f650 2023-10-03T10:14:38.741 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:38.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.743+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 msgr2=0x7fddf81c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.743+0000 7fddfe26c700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf81c3c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fddf8072a80 tx=0x7fddf0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 shutdown_connections 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddf809f650 0x7fddf81c3c40 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddf809e930 0x7fddf81a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 --2- 172.21.15.19:0/3649859613 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddf809f240 0x7fddf81a28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 >> 172.21.15.19:0/3649859613 conn(0x7fddf80a4210 msgr2=0x7fddf81b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 shutdown_connections 2023-10-03T10:14:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:38.744+0000 7fddfe26c700 1 -- 172.21.15.19:0/3649859613 wait complete. 2023-10-03T10:14:38.757 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:39.555 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:39.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:39.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.713+0000 7f1c61173700 1 Processor -- start 2023-10-03T10:14:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.713+0000 7f1c61173700 1 -- start start 2023-10-03T10:14:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.713+0000 7f1c61173700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1c5c0a1510 0x7f1c5c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.713+0000 7f1c61173700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c139250 0x7f1c5c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c61173700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c5c09edd0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c61173700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c5c0a18e0 con 0x7f1c5c0a1510 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c61173700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c09e1f0 con 0x7f1c5c139250 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1c5c0a0a30 0x7f1c5c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37808/0 (socket says 172.21.15.19:37808) 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1c5c0a1510 0x7f1c5c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5ad9d700 1 -- 172.21.15.19:0/1639472498 learned_addr learned my addr 172.21.15.19:0/1639472498 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5b59e700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c139250 0x7f1c5c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 -- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c139250 msgr2=0x7f1c5c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c139250 0x7f1c5c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 -- 172.21.15.19:0/1639472498 >> v1:172.21.15.19:6789/0 conn(0x7f1c5c0a0a30 legacy=0x7f1c5c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 -- 172.21.15.19:0/1639472498 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c09dc50 con 0x7f1c5c0a1510 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c59d9b700 1 -- 172.21.15.19:0/1639472498 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043061944 0 0) 0x7f1c5c09edd0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.714+0000 7f1c5a59c700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c0a1510 0x7f1c5c138d10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009840 tx=0x7f1c50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8b4fd57e21b1f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c59d9b700 1 -- 172.21.15.19:0/1639472498 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011830 con 0x7f1c5c0a1510 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c59d9b700 1 -- 172.21.15.19:0/1639472498 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50011990 con 0x7f1c5c0a1510 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c59d9b700 1 -- 172.21.15.19:0/1639472498 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50011d20 con 0x7f1c5c0a1510 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 -- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c0a1510 msgr2=0x7f1c5c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c0a1510 0x7f1c5c138d10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1c50009840 tx=0x7f1c50009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 -- 172.21.15.19:0/1639472498 shutdown_connections 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c139250 0x7f1c5c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 --2- 172.21.15.19:0/1639472498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c0a1510 0x7f1c5c138d10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 -- 172.21.15.19:0/1639472498 >> 172.21.15.19:0/1639472498 conn(0x7f1c5c0a6550 msgr2=0x7f1c5c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 -- 172.21.15.19:0/1639472498 shutdown_connections 2023-10-03T10:14:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.715+0000 7f1c61173700 1 -- 172.21.15.19:0/1639472498 wait complete. 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.717+0000 7f1c61173700 1 Processor -- start 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.717+0000 7f1c61173700 1 -- start start 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 0x7f1c5c11e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 0x7f1c5c11ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c139250 0x7f1c5c11f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c1221d0 con 0x7f1c5c139250 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0a0220 con 0x7f1c5c0a1510 2023-10-03T10:14:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c61173700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5c0a5040 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 0x7f1c5c11ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 0x7f1c5c11ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42654/0 (socket says 172.21.15.19:42654) 2023-10-03T10:14:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 0x7f1c5c11e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5a59c700 1 -- 172.21.15.19:0/2392182559 learned_addr learned my addr 172.21.15.19:0/2392182559 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5b59e700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c139250 0x7f1c5c11f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 -- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 msgr2=0x7f1c5c11ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 0x7f1c5c11ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 -- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c139250 msgr2=0x7f1c5c11f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c139250 0x7f1c5c11f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.718+0000 7f1c5ad9d700 1 -- 172.21.15.19:0/2392182559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c500094a0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c5ad9d700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 0x7f1c5c11e6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c470 tx=0x7f1c4c00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c015d70 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c019070 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c004ab0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5c120890 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.719+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5c120ab0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.720+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c4c004c10 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.720+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c4c047230 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.720+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c5c074ea0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.729+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c4c01b650 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.747+0000 7f2020bed700 1 Processor -- start 2023-10-03T10:14:39.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.747+0000 7f2020bed700 1 -- start start 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133420 0x7f201c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 0x7f201c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201c06b990 con 0x7f201c134260 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c0a0590 con 0x7f201c133420 2023-10-03T10:14:39.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2020bed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f201c09fb80 con 0x7f201c133e30 2023-10-03T10:14:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2019d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f201ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 0x7f201c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2019d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48968/0 (socket says 172.21.15.19:48968) 2023-10-03T10:14:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f2019d9b700 1 -- 172.21.15.19:0/1104318893 learned_addr learned my addr 172.21.15.19:0/1104318893 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.748+0000 7f201a59c700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133420 0x7f201c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 -- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133420 msgr2=0x7f201c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133420 0x7f201c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 -- 172.21.15.19:0/1104318893 >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 msgr2=0x7f201c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 --2- 172.21.15.19:0/1104318893 >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 0x7f201c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 -- 172.21.15.19:0/1104318893 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0a0030 con 0x7f201c133e30 2023-10-03T10:14:39.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f201ad9d700 1 --2- 172.21.15.19:0/1104318893 >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 0x7f201c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f2019d9b700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20100098f0 tx=0x7f2010009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ade0c6f3c8cb1e14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f201959a700 1 -- 172.21.15.19:0/1104318893 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010011830 con 0x7f201c133e30 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f201959a700 1 -- 172.21.15.19:0/1104318893 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2010011990 con 0x7f201c133e30 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.749+0000 7f201959a700 1 -- 172.21.15.19:0/1104318893 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2010011d20 con 0x7f201c133e30 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 -- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 msgr2=0x7f201c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f20100098f0 tx=0x7f2010009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 -- 172.21.15.19:0/1104318893 shutdown_connections 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133420 0x7f201c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 --2- 172.21.15.19:0/1104318893 >> v2:172.21.15.19:3300/0 conn(0x7f201c134260 0x7f201c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 --2- 172.21.15.19:0/1104318893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c133e30 0x7f201c12ff90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 -- 172.21.15.19:0/1104318893 >> 172.21.15.19:0/1104318893 conn(0x7f201c0a4210 msgr2=0x7f201c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 -- 172.21.15.19:0/1104318893 shutdown_connections 2023-10-03T10:14:39.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.750+0000 7f2020bed700 1 -- 172.21.15.19:0/1104318893 wait complete. 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.751+0000 7f2020bed700 1 Processor -- start 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.751+0000 7f2020bed700 1 -- start start 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201c133420 0x7f201c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 0x7f201c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f201c12d9b0 con 0x7f201c133420 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201c11feb0 con 0x7f201c133e30 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2020bed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f201c120100 con 0x7f201c134260 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2019d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201c133420 0x7f201c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2019d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42666/0 (socket says 172.21.15.19:42666) 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2019d9b700 1 -- 172.21.15.19:0/2948179182 learned_addr learned my addr 172.21.15.19:0/2948179182 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 0x7f201c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 -- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 msgr2=0x7f201c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 -- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201c133420 msgr2=0x7f201c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201c133420 0x7f201c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 -- 172.21.15.19:0/2948179182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2014009a70 con 0x7f201c134260 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f2019d9b700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.752+0000 7f201ad9d700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 0x7f201c09cf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f201400efc0 tx=0x7f201400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.753+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400ca90 con 0x7f201c134260 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.753+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201400f040 con 0x7f201c134260 2023-10-03T10:14:39.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.753+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2010009550 con 0x7f201c134260 2023-10-03T10:14:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.753+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201400ce30 con 0x7f201c134260 2023-10-03T10:14:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.753+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f201c131520 con 0x7f201c134260 2023-10-03T10:14:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.754+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f201c074ea0 con 0x7f201c134260 2023-10-03T10:14:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.754+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2014003a20 con 0x7f201c134260 2023-10-03T10:14:39.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.755+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2014040610 con 0x7f201c134260 2023-10-03T10:14:39.758 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:39.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.759+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f201401c7a0 con 0x7f201c134260 2023-10-03T10:14:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.836+0000 7fb0cfa6b700 1 Processor -- start 2023-10-03T10:14:39.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 -- start start 2023-10-03T10:14:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb0c809e410 0x7fb0c8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c809b120 con 0x7fb0c809e000 2023-10-03T10:14:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c806b460 con 0x7fb0c809e410 2023-10-03T10:14:39.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cfa6b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c809a7e0 con 0x7fb0c809d6f0 2023-10-03T10:14:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cd807700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cd807700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48988/0 (socket says 172.21.15.19:48988) 2023-10-03T10:14:39.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.837+0000 7fb0cd807700 1 -- 172.21.15.19:0/1134146786 learned_addr learned my addr 172.21.15.19:0/1134146786 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0ce008700 1 --2- 172.21.15.19:0/1134146786 >> v2:172.21.15.19:3300/0 conn(0x7fb0c809e410 0x7fb0c8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cd807700 1 -- 172.21.15.19:0/1134146786 >> v2:172.21.15.19:3300/0 conn(0x7fb0c809e410 msgr2=0x7fb0c8134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cd807700 1 --2- 172.21.15.19:0/1134146786 >> v2:172.21.15.19:3300/0 conn(0x7fb0c809e410 0x7fb0c8134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cd807700 1 -- 172.21.15.19:0/1134146786 >> v1:172.21.15.19:6789/0 conn(0x7fb0c809e000 legacy=0x7fb0c81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cd807700 1 -- 172.21.15.19:0/1134146786 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c809a500 con 0x7fb0c809d6f0 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cd807700 1 --2- 172.21.15.19:0/1134146786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009920 tx=0x7fb0c4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a79727a2cb1ded9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cc805700 1 -- 172.21.15.19:0/1134146786 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400ba20 con 0x7fb0c809d6f0 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cc805700 1 -- 172.21.15.19:0/1134146786 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c400bb80 con 0x7fb0c809d6f0 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.838+0000 7fb0cc805700 1 -- 172.21.15.19:0/1134146786 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4009e70 con 0x7fb0c809d6f0 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/1134146786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 msgr2=0x7fb0c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/1134146786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009920 tx=0x7fb0c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/1134146786 shutdown_connections 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/1134146786 >> v2:172.21.15.19:3300/0 conn(0x7fb0c809e410 0x7fb0c8134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/1134146786 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809d6f0 0x7fb0c809dac0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/1134146786 >> 172.21.15.19:0/1134146786 conn(0x7fb0c8066f50 msgr2=0x7fb0c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/1134146786 shutdown_connections 2023-10-03T10:14:39.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.839+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/1134146786 wait complete. 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.840+0000 7fb0cfa6b700 1 Processor -- start 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.840+0000 7fb0cfa6b700 1 -- start start 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 0x7fb0c81a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c809e410 0x7fb0c81a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81a7ac0 con 0x7fb0c809e410 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81a8d10 con 0x7fb0c809d6f0 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cfa6b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c81a80a0 con 0x7fb0c809e000 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49000/0 (socket says 172.21.15.19:49000) 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 -- 172.21.15.19:0/2305359966 learned_addr learned my addr 172.21.15.19:0/2305359966 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0ce008700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c809e410 0x7fb0c81a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd807700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 0x7fb0c81a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 -- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 msgr2=0x7fb0c81a5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 0x7fb0c81a5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 -- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c809e410 msgr2=0x7fb0c81a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c809e410 0x7fb0c81a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd006700 1 -- 172.21.15.19:0/2305359966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4009550 con 0x7fb0c809e000 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.841+0000 7fb0cd807700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 0x7fb0c81a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.842+0000 7fb0cd006700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c4b0 tx=0x7fb0b800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.842+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80052d0 con 0x7fb0c809e000 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.842+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0b8005430 con 0x7fb0c809e000 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.842+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c81a96f0 con 0x7fb0c809e000 2023-10-03T10:14:39.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.842+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c81a91c0 con 0x7fb0c809e000 2023-10-03T10:14:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.843+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80038c0 con 0x7fb0c809e000 2023-10-03T10:14:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.843+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb0b8003a20 con 0x7fb0c809e000 2023-10-03T10:14:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.843+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb0b803e9f0 con 0x7fb0c809e000 2023-10-03T10:14:39.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.844+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b00052e0 con 0x7fb0c809e000 2023-10-03T10:14:39.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.853+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb0b8011590 con 0x7fb0c809e000 2023-10-03T10:14:39.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 Processor -- start 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 -- start start 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f38740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387409d630 0x7f38740a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3874133930 0x7f3874133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38740a2a70 con 0x7f387409d630 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740a01d0 con 0x7f3874133930 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f3879967700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f387409e2b0 con 0x7f38740a0a30 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f38727fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387409d630 0x7f38740a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f38727fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f387409d630 0x7f38740a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57864/0 (socket says 172.21.15.19:57864) 2023-10-03T10:14:39.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.906+0000 7f38727fc700 1 -- 172.21.15.19:0/2694698728 learned_addr learned my addr 172.21.15.19:0/2694698728 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 -- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 msgr2=0x7f38740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f38740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 -- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3874133930 msgr2=0x7f3874133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3874133930 0x7f3874133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 -- 172.21.15.19:0/2694698728 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387409dc50 con 0x7f387409d630 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f38727fc700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387409d630 0x7f38740a1340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38680098f0 tx=0x7f3868009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ffad137b7b6891 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f3871ffb700 1 -- 172.21.15.19:0/2694698728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800b8a0 con 0x7f387409d630 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f3871ffb700 1 -- 172.21.15.19:0/2694698728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386800ba00 con 0x7f387409d630 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.907+0000 7f3871ffb700 1 -- 172.21.15.19:0/2694698728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386800bd90 con 0x7f387409d630 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 -- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387409d630 msgr2=0x7f38740a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387409d630 0x7f38740a1340 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f38680098f0 tx=0x7f3868009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 -- 172.21.15.19:0/2694698728 shutdown_connections 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3874133930 0x7f3874133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f38740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 --2- 172.21.15.19:0/2694698728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f387409d630 0x7f38740a1340 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 -- 172.21.15.19:0/2694698728 >> 172.21.15.19:0/2694698728 conn(0x7f38740a3050 msgr2=0x7f38740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 -- 172.21.15.19:0/2694698728 shutdown_connections 2023-10-03T10:14:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.908+0000 7f3879967700 1 -- 172.21.15.19:0/2694698728 wait complete. 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.909+0000 7f3879967700 1 Processor -- start 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.909+0000 7f3879967700 1 -- start start 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f387409d630 0x7f387411f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f387411fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740a0410 con 0x7f3874133930 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387411f0e0 con 0x7f387409d630 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3879967700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38741220b0 con 0x7f38740a0a30 2023-10-03T10:14:39.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57868/0 (socket says 172.21.15.19:57868) 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 -- 172.21.15.19:0/2694890929 learned_addr learned my addr 172.21.15.19:0/2694890929 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38727fc700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f387411fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f3872ffd700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f387409d630 0x7f387411f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 -- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 msgr2=0x7f387411fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f387411fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 -- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f387409d630 msgr2=0x7f387411f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f387409d630 0x7f387411f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.910+0000 7f38737fe700 1 -- 172.21.15.19:0/2694890929 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868009550 con 0x7f3874133930 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f38737fe700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b970 tx=0x7f386c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00c930 con 0x7f3874133930 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c00cab0 con 0x7f3874133930 2023-10-03T10:14:39.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38741335e0 con 0x7f3874133930 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c00ce60 con 0x7f3874133930 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.911+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3874122de0 con 0x7f3874133930 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.912+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f386c01d3b0 con 0x7f3874133930 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.912+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387406d4c0 con 0x7f3874133930 2023-10-03T10:14:39.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.912+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f386c006e40 con 0x7f3874133930 2023-10-03T10:14:39.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.917+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f386c01d660 con 0x7f3874133930 2023-10-03T10:14:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.950+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c5c0a28e0 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.950+0000 7f1c437fe700 1 -- 172.21.15.19:0/2392182559 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c4c02d020 con 0x7f1c5c0a0a30 2023-10-03T10:14:39.950 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 msgr2=0x7f1c5c11e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 0x7f1c5c11e6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c00c470 tx=0x7f1c4c00c780 comp rx=0 tx=0).stop 2023-10-03T10:14:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 shutdown_connections 2023-10-03T10:14:39.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1c5c139250 0x7f1c5c11f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1c5c0a0a30 0x7f1c5c11e6b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 --2- 172.21.15.19:0/2392182559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1c5c0a1510 0x7f1c5c11ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.953+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 >> 172.21.15.19:0/2392182559 conn(0x7f1c5c0a6550 msgr2=0x7f1c5c09a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.954+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 shutdown_connections 2023-10-03T10:14:39.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:39.954+0000 7f1c61173700 1 -- 172.21.15.19:0/2392182559 wait complete. 2023-10-03T10:14:39.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:40.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.056+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f201c06b250 con 0x7f201c134260 2023-10-03T10:14:40.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.056+0000 7f200affd700 1 -- 172.21.15.19:0/2948179182 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f201402b090 con 0x7f201c134260 2023-10-03T10:14:40.056 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.058+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 msgr2=0x7f201c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.058+0000 7f2020bed700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 0x7f201c09cf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f201400efc0 tx=0x7f201400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 shutdown_connections 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f201c134260 0x7f201c09cf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f201c133420 0x7f201c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 --2- 172.21.15.19:0/2948179182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f201c133e30 0x7f201c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 >> 172.21.15.19:0/2948179182 conn(0x7f201c0a4210 msgr2=0x7f201c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 shutdown_connections 2023-10-03T10:14:40.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.059+0000 7f2020bed700 1 -- 172.21.15.19:0/2948179182 wait complete. 2023-10-03T10:14:40.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:40.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.126+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f38740747f0 con 0x7f3874133930 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.126+0000 7f385bfff700 1 -- 172.21.15.19:0/2694890929 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f386c019030 con 0x7f3874133930 2023-10-03T10:14:40.126 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.128+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 msgr2=0x7f38741c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.128+0000 7f3879967700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f386c00b970 tx=0x7f386c00bc80 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 shutdown_connections 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3874133930 0x7f38741c82a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f387409d630 0x7f387411f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 --2- 172.21.15.19:0/2694890929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38740a0a30 0x7f387411fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 >> 172.21.15.19:0/2694890929 conn(0x7f38740a3050 msgr2=0x7f38740a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 shutdown_connections 2023-10-03T10:14:40.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.129+0000 7f3879967700 1 -- 172.21.15.19:0/2694890929 wait complete. 2023-10-03T10:14:40.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:40.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.147+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb0b0005590 con 0x7fb0c809e000 2023-10-03T10:14:40.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.147+0000 7fb0be7fc700 1 -- 172.21.15.19:0/2305359966 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb0b8017020 con 0x7fb0c809e000 2023-10-03T10:14:40.147 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 msgr2=0x7fb0c81a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800c4b0 tx=0x7fb0b800c870 comp rx=0 tx=0).stop 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 shutdown_connections 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb0c809e410 0x7fb0c81a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb0c809d6f0 0x7fb0c81a5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.149+0000 7fb0cfa6b700 1 --2- 172.21.15.19:0/2305359966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb0c809e000 0x7fb0c81a6480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.150+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 >> 172.21.15.19:0/2305359966 conn(0x7fb0c8066f50 msgr2=0x7fb0c81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.150+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 shutdown_connections 2023-10-03T10:14:40.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:40.150+0000 7fb0cfa6b700 1 -- 172.21.15.19:0/2305359966 wait complete. 2023-10-03T10:14:40.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:40.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:41.074 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.116+0000 7f269b835700 1 Processor -- start 2023-10-03T10:14:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.116+0000 7f269b835700 1 -- start start 2023-10-03T10:14:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f26941317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409f650 0x7f2694131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2694070940 con 0x7f269409e930 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269406fd60 con 0x7f269409f240 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f269b835700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f269406fa80 con 0x7f269409f650 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f26995d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f26941317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f26995d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57884/0 (socket says 172.21.15.19:57884) 2023-10-03T10:14:41.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f26995d1700 1 -- 172.21.15.19:0/1661477228 learned_addr learned my addr 172.21.15.19:0/1661477228 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2699dd2700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409f650 0x7f2694131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 -- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409f650 msgr2=0x7f2694131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409f650 0x7f2694131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 -- 172.21.15.19:0/1661477228 >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 msgr2=0x7f269409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 --2- 172.21.15.19:0/1661477228 >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f2698dd0700 1 -- 172.21.15.19:0/1661477228 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f269409fb60 con 0x7f269409f240 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.117+0000 7f26995d1700 1 --2- 172.21.15.19:0/1661477228 >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f2698dd0700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f26941317f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2684009840 tx=0x7f2684009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7981a0dff4cce5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f268bfff700 1 -- 172.21.15.19:0/1661477228 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684011830 con 0x7f269409f240 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f268bfff700 1 -- 172.21.15.19:0/1661477228 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2684011990 con 0x7f269409f240 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f268bfff700 1 -- 172.21.15.19:0/1661477228 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2684011d20 con 0x7f269409f240 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 -- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 msgr2=0x7f26941317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f26941317f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2684009840 tx=0x7f2684009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 -- 172.21.15.19:0/1661477228 shutdown_connections 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409f650 0x7f2694131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 --2- 172.21.15.19:0/1661477228 >> v2:172.21.15.19:3300/0 conn(0x7f269409e930 0x7f269409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 --2- 172.21.15.19:0/1661477228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f26941317f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.118+0000 7f269b835700 1 -- 172.21.15.19:0/1661477228 >> 172.21.15.19:0/1661477228 conn(0x7f26940a4210 msgr2=0x7f26940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.119+0000 7f269b835700 1 -- 172.21.15.19:0/1661477228 shutdown_connections 2023-10-03T10:14:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.119+0000 7f269b835700 1 -- 172.21.15.19:0/1661477228 wait complete. 2023-10-03T10:14:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 Processor -- start 2023-10-03T10:14:41.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 -- start start 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f269406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26941a9a60 con 0x7f269409f650 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f269406cd10 con 0x7f269409f240 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f269b835700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26941a91f0 con 0x7f269409e930 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f26995d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f2699dd2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f26995d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49020/0 (socket says 172.21.15.19:49020) 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f2699dd2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57888/0 (socket says 172.21.15.19:57888) 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f26995d1700 1 -- 172.21.15.19:0/3541240807 learned_addr learned my addr 172.21.15.19:0/3541240807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.120+0000 7f2698dd0700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f269406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 -- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 msgr2=0x7f269406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f269406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 -- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 msgr2=0x7f269406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 -- 172.21.15.19:0/3541240807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2690009550 con 0x7f269409e930 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f2699dd2700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f26995d1700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f269000ebb0 tx=0x7f269000eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690004030 con 0x7f269409e930 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2690004190 con 0x7f269409e930 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26840094a0 con 0x7f269409e930 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690004520 con 0x7f269409e930 2023-10-03T10:14:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.121+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26940a0190 con 0x7f269409e930 2023-10-03T10:14:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.122+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f269000c850 con 0x7f269409e930 2023-10-03T10:14:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.122+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f269003f890 con 0x7f269409e930 2023-10-03T10:14:41.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.123+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2694071d20 con 0x7f269409e930 2023-10-03T10:14:41.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.128+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26900036a0 con 0x7f269409e930 2023-10-03T10:14:41.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:41.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:41.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.227+0000 7f65614ad700 1 Processor -- start 2023-10-03T10:14:41.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.227+0000 7f65614ad700 1 -- start start 2023-10-03T10:14:41.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.227+0000 7f65614ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 0x7f655c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.227+0000 7f65614ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09e000 0x7f655c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f65614ad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655c09b120 con 0x7f655c09e410 2023-10-03T10:14:41.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f65614ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c06b460 con 0x7f655c09e000 2023-10-03T10:14:41.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f65614ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655c09a7e0 con 0x7f655c09d6f0 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f655c09e410 0x7f655c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37832/0 (socket says 172.21.15.19:37832) 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655b7fe700 1 -- 172.21.15.19:0/1076860347 learned_addr learned my addr 172.21.15.19:0/1076860347 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655a7fc700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09e000 0x7f655c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655affd700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 0x7f655c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655affd700 1 -- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09e000 msgr2=0x7f655c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655affd700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09e000 0x7f655c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655affd700 1 -- 172.21.15.19:0/1076860347 >> v1:172.21.15.19:6789/0 conn(0x7f655c09e410 legacy=0x7f655c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f655affd700 1 -- 172.21.15.19:0/1076860347 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655c09a500 con 0x7f655c09d6f0 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.228+0000 7f6559ffb700 1 -- 172.21.15.19:0/1076860347 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232491321 0 0) 0x7f655c09b120 con 0x7f655c09e410 2023-10-03T10:14:41.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f655affd700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 0x7f655c09dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f654c0098a0 tx=0x7f654c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a85f409169a78a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f6559ffb700 1 -- 172.21.15.19:0/1076860347 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011830 con 0x7f655c09d6f0 2023-10-03T10:14:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f6559ffb700 1 -- 172.21.15.19:0/1076860347 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654c011990 con 0x7f655c09d6f0 2023-10-03T10:14:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f6559ffb700 1 -- 172.21.15.19:0/1076860347 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654c011d20 con 0x7f655c09d6f0 2023-10-03T10:14:41.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f65614ad700 1 -- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 msgr2=0x7f655c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.229+0000 7f65614ad700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 0x7f655c09dac0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f654c0098a0 tx=0x7f654c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 -- 172.21.15.19:0/1076860347 shutdown_connections 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09d6f0 0x7f655c09dac0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 --2- 172.21.15.19:0/1076860347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09e000 0x7f655c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 -- 172.21.15.19:0/1076860347 >> 172.21.15.19:0/1076860347 conn(0x7f655c066f50 msgr2=0x7f655c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 -- 172.21.15.19:0/1076860347 shutdown_connections 2023-10-03T10:14:41.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.230+0000 7f65614ad700 1 -- 172.21.15.19:0/1076860347 wait complete. 2023-10-03T10:14:41.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.231+0000 7f65614ad700 1 Processor -- start 2023-10-03T10:14:41.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 -- start start 2023-10-03T10:14:41.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 0x7f655c1c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 0x7f655c1c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655c09e410 0x7f655c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1a95a0 con 0x7f655c09e410 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1c5a80 con 0x7f655c09d6f0 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f65614ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655c1a7890 con 0x7f655c09e000 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.232+0000 7f655affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 0x7f655c1c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 0x7f655c1c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42728/0 (socket says 172.21.15.19:42728) 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655affd700 1 -- 172.21.15.19:0/1880155806 learned_addr learned my addr 172.21.15.19:0/1880155806 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 0x7f655c1c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655b7fe700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655c09e410 0x7f655c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 -- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 msgr2=0x7f655c1c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 0x7f655c1c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 -- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655c09e410 msgr2=0x7f655c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655c09e410 0x7f655c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 -- 172.21.15.19:0/1880155806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0094a0 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f655a7fc700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 0x7f655c1c5540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f655000e900 tx=0x7f655000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550013680 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65500137e0 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.233+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655c0a3010 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.234+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550013b50 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.234+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655c1a8ae0 con 0x7f655c09e000 2023-10-03T10:14:41.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.235+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6550013cb0 con 0x7f655c09e000 2023-10-03T10:14:41.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.235+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655c074ea0 con 0x7f655c09e000 2023-10-03T10:14:41.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.235+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65500128f0 con 0x7f655c09e000 2023-10-03T10:14:41.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.244+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f655001bc30 con 0x7f655c09e000 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.297+0000 7ffb650a5700 1 Processor -- start 2023-10-03T10:14:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.297+0000 7ffb650a5700 1 -- start start 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb650a5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb650a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 0x7ffb60138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb650a5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6009f130 con 0x7ffb6009d6f0 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb650a5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb6009f520 con 0x7ffb6009e1d0 2023-10-03T10:14:41.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb650a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6009e930 con 0x7ffb60135e50 2023-10-03T10:14:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb5e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb5f59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 0x7ffb60138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb5e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57904/0 (socket says 172.21.15.19:57904) 2023-10-03T10:14:41.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.298+0000 7ffb5e59c700 1 -- 172.21.15.19:0/2937894834 learned_addr learned my addr 172.21.15.19:0/2937894834 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5f59e700 1 -- 172.21.15.19:0/2937894834 >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 msgr2=0x7ffb60135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5f59e700 1 --2- 172.21.15.19:0/2937894834 >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5f59e700 1 -- 172.21.15.19:0/2937894834 >> v1:172.21.15.19:6789/0 conn(0x7ffb6009d6f0 legacy=0x7ffb6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5f59e700 1 -- 172.21.15.19:0/2937894834 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6009b2d0 con 0x7ffb60135e50 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5e59c700 1 --2- 172.21.15.19:0/2937894834 >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5f59e700 1 --2- 172.21.15.19:0/2937894834 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 0x7ffb60138230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009d90 tx=0x7ffb5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b1a6b94bab270a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5dd9b700 1 -- 172.21.15.19:0/2937894834 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800e070 con 0x7ffb60135e50 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5dd9b700 1 -- 172.21.15.19:0/2937894834 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5800bb20 con 0x7ffb60135e50 2023-10-03T10:14:41.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.299+0000 7ffb5dd9b700 1 -- 172.21.15.19:0/2937894834 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58012430 con 0x7ffb60135e50 2023-10-03T10:14:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 -- 172.21.15.19:0/2937894834 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 msgr2=0x7ffb60138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2937894834 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 0x7ffb60138230 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009d90 tx=0x7ffb5800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 -- 172.21.15.19:0/2937894834 shutdown_connections 2023-10-03T10:14:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2937894834 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60135e50 0x7ffb60138230 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2937894834 >> v2:172.21.15.19:3300/0 conn(0x7ffb6009e1d0 0x7ffb60135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 -- 172.21.15.19:0/2937894834 >> 172.21.15.19:0/2937894834 conn(0x7ffb60066f50 msgr2=0x7ffb6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 -- 172.21.15.19:0/2937894834 shutdown_connections 2023-10-03T10:14:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.300+0000 7ffb650a5700 1 -- 172.21.15.19:0/2937894834 wait complete. 2023-10-03T10:14:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.302+0000 7ffb650a5700 1 Processor -- start 2023-10-03T10:14:41.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.302+0000 7ffb650a5700 1 -- start start 2023-10-03T10:14:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb6009e1d0 0x7ffb60132d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb60135e50 0x7ffb60133280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60119a50 con 0x7ffb6009e1d0 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601349c0 con 0x7ffb60135e50 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb650a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60138be0 con 0x7ffb6009d6f0 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb5ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb5ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49068/0 (socket says 172.21.15.19:49068) 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb5ed9d700 1 -- 172.21.15.19:0/2236001095 learned_addr learned my addr 172.21.15.19:0/2236001095 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.303+0000 7ffb5e59c700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb6009e1d0 0x7ffb60132d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 -- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb60135e50 msgr2=0x7ffb60133280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb60135e50 0x7ffb60133280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 -- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb6009e1d0 msgr2=0x7ffb60132d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb6009e1d0 0x7ffb60132d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 -- 172.21.15.19:0/2236001095 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb54009550 con 0x7ffb6009d6f0 2023-10-03T10:14:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb5ed9d700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000c450 tx=0x7ffb5000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500052d0 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50005430 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb500038c0 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb58009a70 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.304+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb60134c00 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.306+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb50003a20 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.306+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb60071700 con 0x7ffb6009d6f0 2023-10-03T10:14:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.306+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb5003eb90 con 0x7ffb6009d6f0 2023-10-03T10:14:41.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.314+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb50017020 con 0x7ffb6009d6f0 2023-10-03T10:14:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.336+0000 7fb17b46a700 1 Processor -- start 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.336+0000 7fb17b46a700 1 -- start start 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb17b46a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb17409de00 0x7fb17409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb17b46a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 0x7fb17413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb17b46a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17409a810 con 0x7fb17406a770 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb17b46a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17406ab40 con 0x7fb17409de00 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb17b46a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17409ebc0 con 0x7fb17413d1f0 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb178a05700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb17409de00 0x7fb17409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb179206700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb17406a770 0x7fb17409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37850/0 (socket says 172.21.15.19:37850) 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb179206700 1 -- 172.21.15.19:0/2335856191 learned_addr learned my addr 172.21.15.19:0/2335856191 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb179a07700 1 --2- 172.21.15.19:0/2335856191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 0x7fb17413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb16bfff700 1 -- 172.21.15.19:0/2335856191 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299015021 0 0) 0x7fb17409a810 con 0x7fb17406a770 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.337+0000 7fb16bfff700 1 -- 172.21.15.19:0/2335856191 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1600035b0 con 0x7fb17406a770 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb179a07700 1 -- 172.21.15.19:0/2335856191 >> v2:172.21.15.19:3300/0 conn(0x7fb17409de00 msgr2=0x7fb17409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb179a07700 1 --2- 172.21.15.19:0/2335856191 >> v2:172.21.15.19:3300/0 conn(0x7fb17409de00 0x7fb17409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb179a07700 1 -- 172.21.15.19:0/2335856191 >> v1:172.21.15.19:6789/0 conn(0x7fb17406a770 legacy=0x7fb17409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb179a07700 1 -- 172.21.15.19:0/2335856191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17409e920 con 0x7fb17413d1f0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb179a07700 1 --2- 172.21.15.19:0/2335856191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 0x7fb17413f5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009d90 tx=0x7fb16c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebee4c3323e3e3e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb16bfff700 1 -- 172.21.15.19:0/2335856191 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c00e070 con 0x7fb17413d1f0 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb16bfff700 1 -- 172.21.15.19:0/2335856191 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16c00bb20 con 0x7fb17413d1f0 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.338+0000 7fb16bfff700 1 -- 172.21.15.19:0/2335856191 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16c012430 con 0x7fb17413d1f0 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 -- 172.21.15.19:0/2335856191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 msgr2=0x7fb17413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2335856191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 0x7fb17413f5d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb16c009d90 tx=0x7fb16c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 -- 172.21.15.19:0/2335856191 shutdown_connections 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2335856191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17413d1f0 0x7fb17413f5d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2335856191 >> v2:172.21.15.19:3300/0 conn(0x7fb17409de00 0x7fb17409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 -- 172.21.15.19:0/2335856191 >> 172.21.15.19:0/2335856191 conn(0x7fb174066f50 msgr2=0x7fb17409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 -- 172.21.15.19:0/2335856191 shutdown_connections 2023-10-03T10:14:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.339+0000 7fb17b46a700 1 -- 172.21.15.19:0/2335856191 wait complete. 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 Processor -- start 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 -- start start 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb17406a770 0x7fb17411c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb17413d1f0 0x7fb17413bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb17411dbf0 con 0x7fb17413d1f0 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb174135c60 con 0x7fb17406a770 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.340+0000 7fb17b46a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb17411ee90 con 0x7fb17409de00 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb179a07700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb17413d1f0 0x7fb17413bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49084/0 (socket says 172.21.15.19:49084) 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 -- 172.21.15.19:0/2771558351 learned_addr learned my addr 172.21.15.19:0/2771558351 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 -- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb17406a770 msgr2=0x7fb17411c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb17406a770 0x7fb17411c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 -- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb17413d1f0 msgr2=0x7fb17413bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb17413d1f0 0x7fb17413bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 -- 172.21.15.19:0/2771558351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb16c009a70 con 0x7fb17409de00 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb178a05700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb16400e810 tx=0x7fb16400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164013610 con 0x7fb17409de00 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb164013770 con 0x7fb17409de00 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17409f1a0 con 0x7fb17409de00 2023-10-03T10:14:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.341+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164013b20 con 0x7fb17409de00 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.342+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17411e260 con 0x7fb17409de00 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.343+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb164013c80 con 0x7fb17409de00 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.343+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb16403f410 con 0x7fb17409de00 2023-10-03T10:14:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.343+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17411d020 con 0x7fb17409de00 2023-10-03T10:14:41.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.348+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb164012370 con 0x7fb17409de00 2023-10-03T10:14:41.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.404+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2694074ea0 con 0x7f269409e930 2023-10-03T10:14:41.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.404+0000 7f2689ffb700 1 -- 172.21.15.19:0/3541240807 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2690011b40 con 0x7f269409e930 2023-10-03T10:14:41.404 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 msgr2=0x7f269406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f269000ebb0 tx=0x7f269000eec0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 shutdown_connections 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f269409f650 0x7f269406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f269409e930 0x7f269406b8b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 --2- 172.21.15.19:0/3541240807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f269409f240 0x7f269406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.407+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 >> 172.21.15.19:0/3541240807 conn(0x7f26940a4210 msgr2=0x7f26941b8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.408+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 shutdown_connections 2023-10-03T10:14:41.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.408+0000 7f269b835700 1 -- 172.21.15.19:0/3541240807 wait complete. 2023-10-03T10:14:41.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:41.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.481+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f655c06c360 con 0x7f655c09e000 2023-10-03T10:14:41.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.481+0000 7f65437fe700 1 -- 172.21.15.19:0/1880155806 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6550017020 con 0x7f655c09e000 2023-10-03T10:14:41.481 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 msgr2=0x7f655c1c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 0x7f655c1c5540 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f655000e900 tx=0x7f655000ec10 comp rx=0 tx=0).stop 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 shutdown_connections 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655c09e410 0x7f655c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f655c09d6f0 0x7f655c1c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 --2- 172.21.15.19:0/1880155806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655c09e000 0x7f655c1c5540 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 >> 172.21.15.19:0/1880155806 conn(0x7f655c066f50 msgr2=0x7f655c1bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 shutdown_connections 2023-10-03T10:14:41.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.483+0000 7f65614ad700 1 -- 172.21.15.19:0/1880155806 wait complete. 2023-10-03T10:14:41.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.556+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb17411eb10 con 0x7fb17409de00 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.557+0000 7fb169ffb700 1 -- 172.21.15.19:0/2771558351 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb17411eb10 con 0x7fb17409de00 2023-10-03T10:14:41.556 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 msgr2=0x7fb17413b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb16400e810 tx=0x7fb16400eb20 comp rx=0 tx=0).stop 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 shutdown_connections 2023-10-03T10:14:41.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb17413d1f0 0x7fb17413bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb17406a770 0x7fb17411c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 --2- 172.21.15.19:0/2771558351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb17409de00 0x7fb17413b590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 >> 172.21.15.19:0/2771558351 conn(0x7fb174066f50 msgr2=0x7fb17409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 shutdown_connections 2023-10-03T10:14:41.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.559+0000 7fb17b46a700 1 -- 172.21.15.19:0/2771558351 wait complete. 2023-10-03T10:14:41.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.564+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb6009c700 con 0x7ffb6009d6f0 2023-10-03T10:14:41.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.564+0000 7ffb477fe700 1 -- 172.21.15.19:0/2236001095 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb50018260 con 0x7ffb6009d6f0 2023-10-03T10:14:41.564 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 msgr2=0x7ffb60132800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000c450 tx=0x7ffb5000c760 comp rx=0 tx=0).stop 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 shutdown_connections 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb60135e50 0x7ffb60133280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb6009d6f0 0x7ffb60132800 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 --2- 172.21.15.19:0/2236001095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb6009e1d0 0x7ffb60132d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:41.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 >> 172.21.15.19:0/2236001095 conn(0x7ffb60066f50 msgr2=0x7ffb6006e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 shutdown_connections 2023-10-03T10:14:41.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:41.567+0000 7ffb650a5700 1 -- 172.21.15.19:0/2236001095 wait complete. 2023-10-03T10:14:41.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:41.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:42.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:42.498 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:42.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:42.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 Processor -- start 2023-10-03T10:14:42.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 -- start start 2023-10-03T10:14:42.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 0x7fc3940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 0x7fc3940a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940a2a70 con 0x7fc394133930 2023-10-03T10:14:42.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940a01d0 con 0x7fc39409d630 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.576+0000 7fc39aea0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc39409e2b0 con 0x7fc3940a0a30 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 0x7fc3940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc39943d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc394133930 0x7fc394133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37860/0 (socket says 172.21.15.19:37860) 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc39943d700 1 -- 172.21.15.19:0/555904472 learned_addr learned my addr 172.21.15.19:0/555904472 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc393fff700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 0x7fc3940a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc3937fe700 1 -- 172.21.15.19:0/555904472 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770396791 0 0) 0x7fc3940a2a70 con 0x7fc394133930 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 -- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 msgr2=0x7fc3940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 0x7fc3940a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 -- 172.21.15.19:0/555904472 >> v1:172.21.15.19:6789/0 conn(0x7fc394133930 legacy=0x7fc394133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 -- 172.21.15.19:0/555904472 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39409dc50 con 0x7fc3940a0a30 2023-10-03T10:14:42.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc393fff700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 0x7fc3940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc398c3c700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 0x7fc3940a0e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc388009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76200050056ac889 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.577+0000 7fc3937fe700 1 -- 172.21.15.19:0/555904472 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011830 con 0x7fc3940a0a30 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc3937fe700 1 -- 172.21.15.19:0/555904472 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc388011990 con 0x7fc3940a0a30 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc3937fe700 1 -- 172.21.15.19:0/555904472 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388011d20 con 0x7fc3940a0a30 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 -- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 msgr2=0x7fc3940a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 0x7fc3940a0e00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc388009870 tx=0x7fc388009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 -- 172.21.15.19:0/555904472 shutdown_connections 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3940a0a30 0x7fc3940a0e00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 --2- 172.21.15.19:0/555904472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc39409d630 0x7fc3940a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 -- 172.21.15.19:0/555904472 >> 172.21.15.19:0/555904472 conn(0x7fc3940a3050 msgr2=0x7fc3940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 -- 172.21.15.19:0/555904472 shutdown_connections 2023-10-03T10:14:42.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.578+0000 7fc39aea0700 1 -- 172.21.15.19:0/555904472 wait complete. 2023-10-03T10:14:42.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.579+0000 7fc39aea0700 1 Processor -- start 2023-10-03T10:14:42.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.579+0000 7fc39aea0700 1 -- start start 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 0x7fc3941c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc394133930 0x7fc3941c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc394121190 con 0x7fc3940a0a30 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940a5360 con 0x7fc394133930 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39aea0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc394120630 con 0x7fc39409d630 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc398c3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc398c3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49102/0 (socket says 172.21.15.19:49102) 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc398c3c700 1 -- 172.21.15.19:0/3024524275 learned_addr learned my addr 172.21.15.19:0/3024524275 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc393fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 0x7fc3941c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.580+0000 7fc39943d700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc394133930 0x7fc3941c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 -- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc394133930 msgr2=0x7fc3941c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc394133930 0x7fc3941c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 -- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 msgr2=0x7fc3941c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 0x7fc3941c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 -- 172.21.15.19:0/3024524275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800094a0 con 0x7fc39409d630 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc393fff700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 0x7fc3941c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc398c3c700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc3880090b0 tx=0x7fc388004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388004510 con 0x7fc39409d630 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38801f070 con 0x7fc39409d630 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880038c0 con 0x7fc39409d630 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3880094a0 con 0x7fc39409d630 2023-10-03T10:14:42.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.581+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc394122190 con 0x7fc39409d630 2023-10-03T10:14:42.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.582+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc388003a20 con 0x7fc39409d630 2023-10-03T10:14:42.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.582+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc388021070 con 0x7fc39409d630 2023-10-03T10:14:42.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.583+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3940747f0 con 0x7fc39409d630 2023-10-03T10:14:42.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:42.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.588+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc388015020 con 0x7fc39409d630 2023-10-03T10:14:42.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.647+0000 7f586450f700 1 Processor -- start 2023-10-03T10:14:42.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.647+0000 7f586450f700 1 -- start start 2023-10-03T10:14:42.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f585c09d6f0 0x7f585c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09e000 0x7f585c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c06b460 con 0x7f585c09d6f0 2023-10-03T10:14:42.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c09b120 con 0x7f585c09e000 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f586450f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f585c09a7e0 con 0x7f585c09e410 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f585c09d6f0 0x7f585c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f585c09d6f0 0x7f585c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57948/0 (socket says 172.21.15.19:57948) 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 -- 172.21.15.19:0/92786097 learned_addr learned my addr 172.21.15.19:0/92786097 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f5861aaa700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09e000 0x7f585c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 -- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 msgr2=0x7f585c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 -- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09e000 msgr2=0x7f585c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09e000 0x7f585c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 -- 172.21.15.19:0/92786097 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c09a500 con 0x7f585c09d6f0 2023-10-03T10:14:42.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.648+0000 7f58622ab700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09d6f0 0x7f585c09dac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f58580098f0 tx=0x7f5858009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6956c14fd80143c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f58612a9700 1 -- 172.21.15.19:0/92786097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011830 con 0x7f585c09d6f0 2023-10-03T10:14:42.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f58612a9700 1 -- 172.21.15.19:0/92786097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5858011990 con 0x7f585c09d6f0 2023-10-03T10:14:42.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f58612a9700 1 -- 172.21.15.19:0/92786097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858011d20 con 0x7f585c09d6f0 2023-10-03T10:14:42.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 -- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09d6f0 msgr2=0x7f585c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09d6f0 0x7f585c09dac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f58580098f0 tx=0x7f5858009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 -- 172.21.15.19:0/92786097 shutdown_connections 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09d6f0 0x7f585c09dac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 --2- 172.21.15.19:0/92786097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09e000 0x7f585c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.649+0000 7f586450f700 1 -- 172.21.15.19:0/92786097 >> 172.21.15.19:0/92786097 conn(0x7f585c066f50 msgr2=0x7f585c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.650+0000 7f586450f700 1 -- 172.21.15.19:0/92786097 shutdown_connections 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.650+0000 7f586450f700 1 -- 172.21.15.19:0/92786097 wait complete. 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 Processor -- start 2023-10-03T10:14:42.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 -- start start 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 0x7f585c1a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c1a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c1a98d0 con 0x7f585c09e000 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c1a9060 con 0x7f585c09d6f0 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f586450f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0a2020 con 0x7f585c09e410 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f58622ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f58622ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42770/0 (socket says 172.21.15.19:42770) 2023-10-03T10:14:42.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.651+0000 7f58622ab700 1 -- 172.21.15.19:0/4168003758 learned_addr learned my addr 172.21.15.19:0/4168003758 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5861aaa700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 0x7f585c1a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5862aac700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c1a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 -- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 msgr2=0x7f585c1a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c1a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 -- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 msgr2=0x7f585c1a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 0x7f585c1a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 -- 172.21.15.19:0/4168003758 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009550 con 0x7f585c09d6f0 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5861aaa700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 0x7f585c1a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f58622ab700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5858009c40 tx=0x7f5858004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5858004300 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585801f070 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58580036a0 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c09c710 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.652+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c1a8c10 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.654+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5858021030 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.654+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c074ea0 con 0x7f585c09d6f0 2023-10-03T10:14:42.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.654+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58580443e0 con 0x7f585c09d6f0 2023-10-03T10:14:42.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.663+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f585800b9d0 con 0x7f585c09d6f0 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.727+0000 7f0225573700 1 Processor -- start 2023-10-03T10:14:42.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.727+0000 7f9bbd436700 1 Processor -- start 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.727+0000 7f0225573700 1 -- start start 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f0225573700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f022009ac90 0x7f022013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f0225573700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f0225573700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0220134980 con 0x7f022006c0e0 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f0225573700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022006c4b0 con 0x7f022009ac90 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f0225573700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022009b0e0 con 0x7f022013d240 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.727+0000 7f9bbd436700 1 -- start start 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bbd436700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bbd436700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bbd436700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb80a2a70 con 0x7f9bb8133930 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bbd436700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80a01d0 con 0x7f9bb80a0a30 2023-10-03T10:14:42.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bbd436700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb809e2b0 con 0x7f9bb809d630 2023-10-03T10:14:42.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42784/0 (socket says 172.21.15.19:42784) 2023-10-03T10:14:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49152/0 (socket says 172.21.15.19:49152) 2023-10-03T10:14:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f021f7fe700 1 -- 172.21.15.19:0/1211211218 learned_addr learned my addr 172.21.15.19:0/1211211218 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.728+0000 7f9bb6ffd700 1 -- 172.21.15.19:0/2944678997 learned_addr learned my addr 172.21.15.19:0/2944678997 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb67fc700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021e7fc700 1 --2- 172.21.15.19:0/1211211218 >> v2:172.21.15.19:3300/0 conn(0x7f022009ac90 0x7f022013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021f7fe700 1 -- 172.21.15.19:0/1211211218 >> v2:172.21.15.19:3300/0 conn(0x7f022009ac90 msgr2=0x7f022013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021f7fe700 1 --2- 172.21.15.19:0/1211211218 >> v2:172.21.15.19:3300/0 conn(0x7f022009ac90 0x7f022013cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021f7fe700 1 -- 172.21.15.19:0/1211211218 >> v1:172.21.15.19:6789/0 conn(0x7f022006c0e0 legacy=0x7f0220134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021f7fe700 1 -- 172.21.15.19:0/1211211218 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02200a0600 con 0x7f022013d240 2023-10-03T10:14:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb6ffd700 1 -- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 msgr2=0x7f9bb80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb6ffd700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb6ffd700 1 -- 172.21.15.19:0/2944678997 >> v1:172.21.15.19:6789/0 conn(0x7f9bb8133930 legacy=0x7f9bb8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb6ffd700 1 -- 172.21.15.19:0/2944678997 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb809dc50 con 0x7f9bb80a0a30 2023-10-03T10:14:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb67fc700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb6ffd700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009920 tx=0x7f9bac009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cf0ad7546570cde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021f7fe700 1 --2- 172.21.15.19:0/1211211218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0218009e50 tx=0x7f021800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a16fe3cf6bed799e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f021dffb700 1 -- 172.21.15.19:0/1211211218 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800e070 con 0x7f022013d240 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f021dffb700 1 -- 172.21.15.19:0/1211211218 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800b9c0 con 0x7f022013d240 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.729+0000 7f9bb5ffb700 1 -- 172.21.15.19:0/2944678997 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00ba60 con 0x7f9bb80a0a30 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bb5ffb700 1 -- 172.21.15.19:0/2944678997 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00bbc0 con 0x7f9bb80a0a30 2023-10-03T10:14:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bb5ffb700 1 -- 172.21.15.19:0/2944678997 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac009e70 con 0x7f9bb80a0a30 2023-10-03T10:14:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f021dffb700 1 -- 172.21.15.19:0/1211211218 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800bd70 con 0x7f022013d240 2023-10-03T10:14:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 -- 172.21.15.19:0/1211211218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 msgr2=0x7f022013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 --2- 172.21.15.19:0/1211211218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0218009e50 tx=0x7f021800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 -- 172.21.15.19:0/1211211218 shutdown_connections 2023-10-03T10:14:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 --2- 172.21.15.19:0/1211211218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022013d240 0x7f022013f620 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 --2- 172.21.15.19:0/1211211218 >> v2:172.21.15.19:3300/0 conn(0x7f022009ac90 0x7f022013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 -- 172.21.15.19:0/1211211218 >> 172.21.15.19:0/1211211218 conn(0x7f02200a4210 msgr2=0x7f02200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 -- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 msgr2=0x7f9bb80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9bac009920 tx=0x7f9bac009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 -- 172.21.15.19:0/1211211218 shutdown_connections 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f0225573700 1 -- 172.21.15.19:0/1211211218 wait complete. 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 -- 172.21.15.19:0/2944678997 shutdown_connections 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb80a0a30 0x7f9bb80a0e00 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2944678997 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.730+0000 7f9bbd436700 1 -- 172.21.15.19:0/2944678997 >> 172.21.15.19:0/2944678997 conn(0x7f9bb80a3050 msgr2=0x7f9bb80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.731+0000 7f9bbd436700 1 -- 172.21.15.19:0/2944678997 shutdown_connections 2023-10-03T10:14:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.731+0000 7f9bbd436700 1 -- 172.21.15.19:0/2944678997 wait complete. 2023-10-03T10:14:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 Processor -- start 2023-10-03T10:14:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 -- start start 2023-10-03T10:14:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 Processor -- start 2023-10-03T10:14:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 -- start start 2023-10-03T10:14:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022006c0e0 0x7f022009b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f022009ac90 0x7f022009bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022009e330 con 0x7f022009ac90 2023-10-03T10:14:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0220139210 con 0x7f022013d240 2023-10-03T10:14:42.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f0225573700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f022009d0b0 con 0x7f022006c0e0 2023-10-03T10:14:42.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb81c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb80a0a30 0x7f9bb81c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 0x7f9bb81c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81207c0 con 0x7f9bb80a0a30 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb81205d0 con 0x7f9bb8133930 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bbd436700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80a4030 con 0x7f9bb809d630 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb81c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb81c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49178/0 (socket says 172.21.15.19:49178) 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb6ffd700 1 -- 172.21.15.19:0/2147258232 learned_addr learned my addr 172.21.15.19:0/2147258232 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 0x7f9bb81c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb67fc700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb80a0a30 0x7f9bb81c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 -- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 msgr2=0x7f9bb81c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb81c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 -- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb80a0a30 msgr2=0x7f9bb81c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb80a0a30 0x7f9bb81c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 -- 172.21.15.19:0/2147258232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac009550 con 0x7f9bb8133930 2023-10-03T10:14:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.732+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:42.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42796/0 (socket says 172.21.15.19:42796) 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 -- 172.21.15.19:0/95893990 learned_addr learned my addr 172.21.15.19:0/95893990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 -- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022006c0e0 msgr2=0x7f022009b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022006c0e0 0x7f022009b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 -- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f022009ac90 msgr2=0x7f022009bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f022009ac90 0x7f022009bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 -- 172.21.15.19:0/95893990 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0218009b30 con 0x7f022013d240 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f021f7fe700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f022006e7c0 tx=0x7f0218004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.733+0000 7f9bb77fe700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 0x7f9bb81c8ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000cb90 tx=0x7f9bb000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0003c00 con 0x7f9bb8133930 2023-10-03T10:14:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218004960 con 0x7f022013d240 2023-10-03T10:14:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0003d60 con 0x7f9bb8133930 2023-10-03T10:14:42.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80a0470 con 0x7f9bb8133930 2023-10-03T10:14:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02180092e0 con 0x7f022013d240 2023-10-03T10:14:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021801c640 con 0x7f022013d240 2023-10-03T10:14:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022013cfb0 con 0x7f022013d240 2023-10-03T10:14:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.735+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02200a03f0 con 0x7f022013d240 2023-10-03T10:14:42.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb000aa80 con 0x7f9bb8133930 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.734+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb8122c70 con 0x7f9bb8133930 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.735+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb8122080 con 0x7f9bb8133930 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.736+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022009e150 con 0x7f022013d240 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.736+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f021801c7a0 con 0x7f022013d240 2023-10-03T10:14:42.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.736+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0218041500 con 0x7f022013d240 2023-10-03T10:14:42.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.736+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9bb000abe0 con 0x7f9bb8133930 2023-10-03T10:14:42.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.736+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9bb0040030 con 0x7f9bb8133930 2023-10-03T10:14:42.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.741+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9bb00050d0 con 0x7f9bb8133930 2023-10-03T10:14:42.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.745+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0218025450 con 0x7f022013d240 2023-10-03T10:14:42.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.811+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc394133350 con 0x7fc39409d630 2023-10-03T10:14:42.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.812+0000 7fc3917fa700 1 -- 172.21.15.19:0/3024524275 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc38801a430 con 0x7fc39409d630 2023-10-03T10:14:42.812 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:42.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 msgr2=0x7fc3941c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc3880090b0 tx=0x7fc388004750 comp rx=0 tx=0).stop 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 shutdown_connections 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc394133930 0x7fc3941c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc39409d630 0x7fc3941c7d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 --2- 172.21.15.19:0/3024524275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3940a0a30 0x7fc3941c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.814+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 >> 172.21.15.19:0/3024524275 conn(0x7fc3940a3050 msgr2=0x7fc3941bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.815+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 shutdown_connections 2023-10-03T10:14:42.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.815+0000 7fc39aea0700 1 -- 172.21.15.19:0/3024524275 wait complete. 2023-10-03T10:14:42.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:42.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.875+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f585c1a93a0 con 0x7f585c09d6f0 2023-10-03T10:14:42.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.875+0000 7f5852ffd700 1 -- 172.21.15.19:0/4168003758 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58580233d0 con 0x7f585c09d6f0 2023-10-03T10:14:42.875 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 msgr2=0x7f585c1a5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5858009c40 tx=0x7f5858004750 comp rx=0 tx=0).stop 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 shutdown_connections 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f585c09e410 0x7f585c1a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f585c09d6f0 0x7f585c1a5db0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 --2- 172.21.15.19:0/4168003758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f585c09e000 0x7f585c1a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 >> 172.21.15.19:0/4168003758 conn(0x7f585c066f50 msgr2=0x7f585c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 shutdown_connections 2023-10-03T10:14:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.879+0000 7f586450f700 1 -- 172.21.15.19:0/4168003758 wait complete. 2023-10-03T10:14:42.893 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:42.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.950+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9bb8074770 con 0x7f9bb8133930 2023-10-03T10:14:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.951+0000 7f9b9f7fe700 1 -- 172.21.15.19:0/2147258232 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9bb0029090 con 0x7f9bb8133930 2023-10-03T10:14:42.951 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 msgr2=0x7f9bb81c8ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 0x7f9bb81c8ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000cb90 tx=0x7f9bb000cea0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 shutdown_connections 2023-10-03T10:14:42.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9bb8133930 0x7f9bb81c8ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9bb809d630 0x7f9bb81c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 --2- 172.21.15.19:0/2147258232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bb80a0a30 0x7f9bb81c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 >> 172.21.15.19:0/2147258232 conn(0x7f9bb80a3050 msgr2=0x7f9bb81bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 shutdown_connections 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.953+0000 7f9bbd436700 1 -- 172.21.15.19:0/2147258232 wait complete. 2023-10-03T10:14:42.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.955+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0220074ea0 con 0x7f022013d240 2023-10-03T10:14:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.955+0000 7f02077fe700 1 -- 172.21.15.19:0/95893990 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0218023b50 con 0x7f022013d240 2023-10-03T10:14:42.955 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 msgr2=0x7f022009c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f022006e7c0 tx=0x7f0218004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 shutdown_connections 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f022013d240 0x7f022009c110 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f022006c0e0 0x7f022009b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 --2- 172.21.15.19:0/95893990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f022009ac90 0x7f022009bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.957+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 >> 172.21.15.19:0/95893990 conn(0x7f02200a4210 msgr2=0x7f02200a2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.958+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 shutdown_connections 2023-10-03T10:14:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:42.958+0000 7f0225573700 1 -- 172.21.15.19:0/95893990 wait complete. 2023-10-03T10:14:42.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:42.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:43.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:43.894 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:43.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:43.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.979+0000 7fa051daa700 1 Processor -- start 2023-10-03T10:14:43.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.979+0000 7fa051daa700 1 -- start start 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa051daa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa04c06a770 0x7fa04c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa051daa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 0x7fa04c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa051daa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa04c09ece0 con 0x7fa04c131b40 2023-10-03T10:14:43.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa051daa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa04c09e760 con 0x7fa04c06a770 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa051daa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c09e040 con 0x7fa04c06b080 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa04b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa04c06a770 0x7fa04c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa04bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa04c131b40 0x7fa04c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37882/0 (socket says 172.21.15.19:37882) 2023-10-03T10:14:43.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa04bfff700 1 -- 172.21.15.19:0/4171980966 learned_addr learned my addr 172.21.15.19:0/4171980966 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:43.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.980+0000 7fa04affd700 1 --2- 172.21.15.19:0/4171980966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 0x7fa04c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04affd700 1 -- 172.21.15.19:0/4171980966 >> v2:172.21.15.19:3300/0 conn(0x7fa04c06a770 msgr2=0x7fa04c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04affd700 1 --2- 172.21.15.19:0/4171980966 >> v2:172.21.15.19:3300/0 conn(0x7fa04c06a770 0x7fa04c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04affd700 1 -- 172.21.15.19:0/4171980966 >> v1:172.21.15.19:6789/0 conn(0x7fa04c131b40 legacy=0x7fa04c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04a7fc700 1 -- 172.21.15.19:0/4171980966 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385150566 0 0) 0x7fa04c09ece0 con 0x7fa04c131b40 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04affd700 1 -- 172.21.15.19:0/4171980966 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c09f630 con 0x7fa04c06b080 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04affd700 1 --2- 172.21.15.19:0/4171980966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 0x7fa04c131600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa040009840 tx=0x7fa040009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e82568a5bf60b099 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04a7fc700 1 -- 172.21.15.19:0/4171980966 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011830 con 0x7fa04c06b080 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04a7fc700 1 -- 172.21.15.19:0/4171980966 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa040011990 con 0x7fa04c06b080 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.981+0000 7fa04a7fc700 1 -- 172.21.15.19:0/4171980966 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa040011d00 con 0x7fa04c06b080 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 -- 172.21.15.19:0/4171980966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 msgr2=0x7fa04c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 --2- 172.21.15.19:0/4171980966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 0x7fa04c131600 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa040009840 tx=0x7fa040009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 -- 172.21.15.19:0/4171980966 shutdown_connections 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 --2- 172.21.15.19:0/4171980966 >> v2:172.21.15.19:3300/0 conn(0x7fa04c06a770 0x7fa04c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 --2- 172.21.15.19:0/4171980966 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06b080 0x7fa04c131600 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 -- 172.21.15.19:0/4171980966 >> 172.21.15.19:0/4171980966 conn(0x7fa04c066f50 msgr2=0x7fa04c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 -- 172.21.15.19:0/4171980966 shutdown_connections 2023-10-03T10:14:43.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.982+0000 7fa051daa700 1 -- 172.21.15.19:0/4171980966 wait complete. 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.984+0000 7fa051daa700 1 Processor -- start 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.984+0000 7fa051daa700 1 -- start start 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 0x7fa04c1c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04c131b40 0x7fa04c1c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c09c190 con 0x7fa04c131b40 2023-10-03T10:14:43.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c120a10 con 0x7fa04c06b080 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa051daa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa04c121ab0 con 0x7fa04c06a770 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 0x7fa04c1c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49198/0 (socket says 172.21.15.19:49198) 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 -- 172.21.15.19:0/3590369606 learned_addr learned my addr 172.21.15.19:0/3590369606 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04bfff700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04c131b40 0x7fa04c1c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 -- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 msgr2=0x7fa04c1c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 0x7fa04c1c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 -- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04c131b40 msgr2=0x7fa04c1c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:43.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04c131b40 0x7fa04c1c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04b7fe700 1 -- 172.21.15.19:0/3590369606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400094a0 con 0x7fa04c06a770 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.985+0000 7fa04affd700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 0x7fa04c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa04b7fe700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00e9e0 tx=0x7fa03c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00ee80 con 0x7fa04c06a770 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c00c850 con 0x7fa04c06a770 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03c00cbc0 con 0x7fa04c06a770 2023-10-03T10:14:43.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa04c1315e0 con 0x7fa04c06a770 2023-10-03T10:14:43.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.986+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa04c071ec0 con 0x7fa04c06a770 2023-10-03T10:14:43.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.987+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa03c00cd20 con 0x7fa04c06a770 2023-10-03T10:14:43.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.987+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa03c03fa20 con 0x7fa04c06a770 2023-10-03T10:14:43.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.987+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa04c121cb0 con 0x7fa04c06a770 2023-10-03T10:14:43.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:43.993+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa04c121cb0 con 0x7fa04c06a770 2023-10-03T10:14:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.059+0000 7fe16e983700 1 Processor -- start 2023-10-03T10:14:44.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.059+0000 7fe16e983700 1 -- start start 2023-10-03T10:14:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16e983700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe168136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16e983700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe168136fe0 0x7fe1681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16e983700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe168070940 con 0x7fe16809e930 2023-10-03T10:14:44.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16e983700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16806fd60 con 0x7fe168136fe0 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16e983700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16806fa80 con 0x7fe16809f410 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe167fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe16809e930 0x7fe16809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37884/0 (socket says 172.21.15.19:37884) 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe167fff700 1 -- 172.21.15.19:0/4034105073 learned_addr learned my addr 172.21.15.19:0/4034105073 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe1677fe700 1 --2- 172.21.15.19:0/4034105073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe168136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.060+0000 7fe16cf20700 1 --2- 172.21.15.19:0/4034105073 >> v2:172.21.15.19:3300/0 conn(0x7fe168136fe0 0x7fe1681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe166ffd700 1 -- 172.21.15.19:0/4034105073 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973019705 0 0) 0x7fe168070940 con 0x7fe16809e930 2023-10-03T10:14:44.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe166ffd700 1 -- 172.21.15.19:0/4034105073 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1500035b0 con 0x7fe16809e930 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe1677fe700 1 -- 172.21.15.19:0/4034105073 >> v2:172.21.15.19:3300/0 conn(0x7fe168136fe0 msgr2=0x7fe1681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe1677fe700 1 --2- 172.21.15.19:0/4034105073 >> v2:172.21.15.19:3300/0 conn(0x7fe168136fe0 0x7fe1681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe1677fe700 1 -- 172.21.15.19:0/4034105073 >> v1:172.21.15.19:6789/0 conn(0x7fe16809e930 legacy=0x7fe16809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe1677fe700 1 -- 172.21.15.19:0/4034105073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16809fb60 con 0x7fe16809f410 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe1677fe700 1 --2- 172.21.15.19:0/4034105073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe168136aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009840 tx=0x7fe15c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8e29c52678338c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe166ffd700 1 -- 172.21.15.19:0/4034105073 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c011830 con 0x7fe16809f410 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe166ffd700 1 -- 172.21.15.19:0/4034105073 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c011990 con 0x7fe16809f410 2023-10-03T10:14:44.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.061+0000 7fe166ffd700 1 -- 172.21.15.19:0/4034105073 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c011d20 con 0x7fe16809f410 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 -- 172.21.15.19:0/4034105073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 msgr2=0x7fe168136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 --2- 172.21.15.19:0/4034105073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe168136aa0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009840 tx=0x7fe15c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 -- 172.21.15.19:0/4034105073 shutdown_connections 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 --2- 172.21.15.19:0/4034105073 >> v2:172.21.15.19:3300/0 conn(0x7fe168136fe0 0x7fe1681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 --2- 172.21.15.19:0/4034105073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe168136aa0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 -- 172.21.15.19:0/4034105073 >> 172.21.15.19:0/4034105073 conn(0x7fe1680a4210 msgr2=0x7fe1680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 -- 172.21.15.19:0/4034105073 shutdown_connections 2023-10-03T10:14:44.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.062+0000 7fe16e983700 1 -- 172.21.15.19:0/4034105073 wait complete. 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.064+0000 7fe16e983700 1 Processor -- start 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.064+0000 7fe16e983700 1 -- start start 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 0x7fe1681c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe168136fe0 0x7fe16806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe168071d90 con 0x7fe16809e930 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe168135060 con 0x7fe16809f410 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16e983700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe16806d640 con 0x7fe168136fe0 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe1677fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe167fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 0x7fe1681c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe1677fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42846/0 (socket says 172.21.15.19:42846) 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe1677fe700 1 -- 172.21.15.19:0/827896128 learned_addr learned my addr 172.21.15.19:0/827896128 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe16cf20700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe168136fe0 0x7fe16806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.065+0000 7fe167fff700 1 -- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe168136fe0 msgr2=0x7fe16806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe167fff700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe168136fe0 0x7fe16806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe167fff700 1 -- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 msgr2=0x7fe1681c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe167fff700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe167fff700 1 -- 172.21.15.19:0/827896128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0094a0 con 0x7fe16809e930 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe1677fe700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe167fff700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 0x7fe1681c85b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c4c0 tx=0x7fe15800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158005d70 con 0x7fe16809e930 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1580070d0 con 0x7fe16809e930 2023-10-03T10:14:44.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1681352a0 con 0x7fe16809e930 2023-10-03T10:14:44.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158007440 con 0x7fe16809e930 2023-10-03T10:14:44.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.066+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16809def0 con 0x7fe16809e930 2023-10-03T10:14:44.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.067+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1580075a0 con 0x7fe16809e930 2023-10-03T10:14:44.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.067+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe15803eac0 con 0x7fe16809e930 2023-10-03T10:14:44.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.068+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe168074ea0 con 0x7fe16809e930 2023-10-03T10:14:44.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.077+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe158017070 con 0x7fe16809e930 2023-10-03T10:14:44.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 Processor -- start 2023-10-03T10:14:44.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 -- start start 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d009a810 con 0x7fe0d013c1e0 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d006ab40 con 0x7fe0d009dc30 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.116+0000 7fe0d7e19700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d009ebc0 con 0x7fe0d006a770 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42862/0 (socket says 172.21.15.19:42862) 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 -- 172.21.15.19:0/3848360101 learned_addr learned my addr 172.21.15.19:0/3848360101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:44.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d5bb5700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 -- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 msgr2=0x7fe0d009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 -- 172.21.15.19:0/3848360101 >> v1:172.21.15.19:6789/0 conn(0x7fe0d013c1e0 legacy=0x7fe0d013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 -- 172.21.15.19:0/3848360101 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d009e920 con 0x7fe0d009dc30 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d5bb5700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.117+0000 7fe0d53b4700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009920 tx=0x7fe0c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c734c9a99878295 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d4bb3700 1 -- 172.21.15.19:0/3848360101 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0011830 con 0x7fe0d009dc30 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d4bb3700 1 -- 172.21.15.19:0/3848360101 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c0011990 con 0x7fe0d009dc30 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d4bb3700 1 -- 172.21.15.19:0/3848360101 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0011d20 con 0x7fe0d009dc30 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 -- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 msgr2=0x7fe0d009e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0c0009920 tx=0x7fe0c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 -- 172.21.15.19:0/3848360101 shutdown_connections 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/3848360101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d009e080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 -- 172.21.15.19:0/3848360101 >> 172.21.15.19:0/3848360101 conn(0x7fe0d0066f50 msgr2=0x7fe0d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 -- 172.21.15.19:0/3848360101 shutdown_connections 2023-10-03T10:14:44.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.118+0000 7fe0d7e19700 1 -- 172.21.15.19:0/3848360101 wait complete. 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.119+0000 7fe0d7e19700 1 Processor -- start 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.119+0000 7fe0d7e19700 1 -- start start 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d013a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d013c1e0 0x7fe0d013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d011d1b0 con 0x7fe0d013c1e0 2023-10-03T10:14:44.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d011bf90 con 0x7fe0d009dc30 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d7e19700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d013bee0 con 0x7fe0d006a770 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49238/0 (socket says 172.21.15.19:49238) 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 -- 172.21.15.19:0/4281595002 learned_addr learned my addr 172.21.15.19:0/4281595002 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 -- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 msgr2=0x7fe0d013a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d013a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 -- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d013c1e0 msgr2=0x7fe0d013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.120+0000 7fe0d5bb5700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d013c1e0 0x7fe0d013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0d5bb5700 1 -- 172.21.15.19:0/4281595002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0cc0094a0 con 0x7fe0d006a770 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0d5bb5700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00ebe0 tx=0x7fe0cc009ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00c910 con 0x7fe0d006a770 2023-10-03T10:14:44.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c0009550 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0cc00ca70 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00cde0 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.121+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d011c780 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.122+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0cc013470 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.122+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe0cc03fa10 con 0x7fe0d006a770 2023-10-03T10:14:44.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.122+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d0074ea0 con 0x7fe0d006a770 2023-10-03T10:14:44.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 Processor -- start 2023-10-03T10:14:44.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 -- start start 2023-10-03T10:14:44.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f376809e000 0x7f3768130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376809f130 con 0x7f376809e410 2023-10-03T10:14:44.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376809f520 con 0x7f376809e000 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f376d379700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f376809e930 con 0x7f376809d6f0 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49252/0 (socket says 172.21.15.19:49252) 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f3766ffd700 1 -- 172.21.15.19:0/1524046344 learned_addr learned my addr 172.21.15.19:0/1524046344 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.131+0000 7f37667fc700 1 --2- 172.21.15.19:0/1524046344 >> v2:172.21.15.19:3300/0 conn(0x7f376809e000 0x7f3768130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3766ffd700 1 -- 172.21.15.19:0/1524046344 >> v2:172.21.15.19:3300/0 conn(0x7f376809e000 msgr2=0x7f3768130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3766ffd700 1 --2- 172.21.15.19:0/1524046344 >> v2:172.21.15.19:3300/0 conn(0x7f376809e000 0x7f3768130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3766ffd700 1 -- 172.21.15.19:0/1524046344 >> v1:172.21.15.19:6789/0 conn(0x7f376809e410 legacy=0x7f3768130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3766ffd700 1 -- 172.21.15.19:0/1524046344 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376809b2d0 con 0x7f376809d6f0 2023-10-03T10:14:44.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0cc017080 con 0x7fe0d006a770 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3766ffd700 1 --2- 172.21.15.19:0/1524046344 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f37580098f0 tx=0x7f3758009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3955c73d77c0ce63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3765ffb700 1 -- 172.21.15.19:0/1524046344 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758011830 con 0x7f376809d6f0 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3765ffb700 1 -- 172.21.15.19:0/1524046344 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758011990 con 0x7f376809d6f0 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.132+0000 7f3765ffb700 1 -- 172.21.15.19:0/1524046344 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758011d20 con 0x7f376809d6f0 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 -- 172.21.15.19:0/1524046344 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 msgr2=0x7f376809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 --2- 172.21.15.19:0/1524046344 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f37580098f0 tx=0x7f3758009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 -- 172.21.15.19:0/1524046344 shutdown_connections 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 --2- 172.21.15.19:0/1524046344 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376809dac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 --2- 172.21.15.19:0/1524046344 >> v2:172.21.15.19:3300/0 conn(0x7f376809e000 0x7f3768130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 -- 172.21.15.19:0/1524046344 >> 172.21.15.19:0/1524046344 conn(0x7f3768066f50 msgr2=0x7f376809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 -- 172.21.15.19:0/1524046344 shutdown_connections 2023-10-03T10:14:44.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.133+0000 7f376d379700 1 -- 172.21.15.19:0/1524046344 wait complete. 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.134+0000 7f376d379700 1 Processor -- start 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.134+0000 7f376d379700 1 -- start start 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f376809e000 0x7f376806ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f376809e410 0x7f376806f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3768125ee0 con 0x7f376809e410 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3768070430 con 0x7f376809e000 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f376d379700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37680a1e10 con 0x7f376809d6f0 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49260/0 (socket says 172.21.15.19:49260) 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f3766ffd700 1 -- 172.21.15.19:0/2763965658 learned_addr learned my addr 172.21.15.19:0/2763965658 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.135+0000 7f37667fc700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f376809e000 0x7f376806ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 -- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f376809e000 msgr2=0x7f376806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f376809e000 0x7f376806ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 -- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f376809e410 msgr2=0x7f376806f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f376809e410 0x7f376806f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 -- 172.21.15.19:0/2763965658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3758009550 con 0x7f376809d6f0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f3766ffd700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3758009c40 tx=0x7f3758004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580043c0 con 0x7f376809d6f0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375801f070 con 0x7f376809d6f0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37580036a0 con 0x7f376809d6f0 2023-10-03T10:14:44.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376809c700 con 0x7f376809d6f0 2023-10-03T10:14:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.136+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3768124770 con 0x7f376809d6f0 2023-10-03T10:14:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.137+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3768125a60 con 0x7f376809d6f0 2023-10-03T10:14:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.138+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3758021030 con 0x7f376809d6f0 2023-10-03T10:14:44.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.138+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3758019570 con 0x7f376809d6f0 2023-10-03T10:14:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.147+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3768125a60 con 0x7f376809d6f0 2023-10-03T10:14:44.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.242+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa04c121cb0 con 0x7fa04c06a770 2023-10-03T10:14:44.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.242+0000 7fa033fff700 1 -- 172.21.15.19:0/3590369606 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa04c121cb0 con 0x7fa04c06a770 2023-10-03T10:14:44.242 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 msgr2=0x7fa04c1c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa03c00e9e0 tx=0x7fa03c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 shutdown_connections 2023-10-03T10:14:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa04c131b40 0x7fa04c1c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa04c06a770 0x7fa04c1c7ff0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 --2- 172.21.15.19:0/3590369606 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa04c06b080 0x7fa04c1c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 >> 172.21.15.19:0/3590369606 conn(0x7fa04c066f50 msgr2=0x7fa04c06ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 shutdown_connections 2023-10-03T10:14:44.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.246+0000 7fa051daa700 1 -- 172.21.15.19:0/3590369606 wait complete. 2023-10-03T10:14:44.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:44.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.304+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe168124fe0 con 0x7fe16809e930 2023-10-03T10:14:44.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.304+0000 7fe164ff9700 1 -- 172.21.15.19:0/827896128 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe15801bb10 con 0x7fe16809e930 2023-10-03T10:14:44.304 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 msgr2=0x7fe1681c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 0x7fe1681c85b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe15800c4c0 tx=0x7fe15800c7d0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 shutdown_connections 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe168136fe0 0x7fe16806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe16809e930 0x7fe1681c85b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 --2- 172.21.15.19:0/827896128 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe16809f410 0x7fe1681c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 >> 172.21.15.19:0/827896128 conn(0x7fe1680a4210 msgr2=0x7fe1680a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 shutdown_connections 2023-10-03T10:14:44.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.307+0000 7fe16e983700 1 -- 172.21.15.19:0/827896128 wait complete. 2023-10-03T10:14:44.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:44.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.341+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0d006c360 con 0x7fe0d006a770 2023-10-03T10:14:44.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.341+0000 7fe0c67fc700 1 -- 172.21.15.19:0/4281595002 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0cc021020 con 0x7fe0d006a770 2023-10-03T10:14:44.341 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:44.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 msgr2=0x7fe0d011b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00ebe0 tx=0x7fe0cc009ec0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 shutdown_connections 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d013c1e0 0x7fe0d013ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d006a770 0x7fe0d011b420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 --2- 172.21.15.19:0/4281595002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d009dc30 0x7fe0d013a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 >> 172.21.15.19:0/4281595002 conn(0x7fe0d0066f50 msgr2=0x7fe0d00a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 shutdown_connections 2023-10-03T10:14:44.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.344+0000 7fe0d7e19700 1 -- 172.21.15.19:0/4281595002 wait complete. 2023-10-03T10:14:44.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.355+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3768125a60 con 0x7f376809d6f0 2023-10-03T10:14:44.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.355+0000 7f374f7fe700 1 -- 172.21.15.19:0/2763965658 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3768125a60 con 0x7f376809d6f0 2023-10-03T10:14:44.355 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:44.358 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 msgr2=0x7f376806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3758009c40 tx=0x7f3758004750 comp rx=0 tx=0).stop 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 shutdown_connections 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f376809e410 0x7f376806f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f376809d6f0 0x7f376806e840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 --2- 172.21.15.19:0/2763965658 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f376809e000 0x7f376806ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 >> 172.21.15.19:0/2763965658 conn(0x7f3768066f50 msgr2=0x7f376806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:44.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 shutdown_connections 2023-10-03T10:14:44.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:44.358+0000 7f376d379700 1 -- 172.21.15.19:0/2763965658 wait complete. 2023-10-03T10:14:44.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:45.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:45.321 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:45.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:45.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.429+0000 7fd450f11700 1 Processor -- start 2023-10-03T10:14:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.429+0000 7fd450f11700 1 -- start start 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd44c099a40 0x7fd44c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c09a3b0 0x7fd44c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c1313c0 con 0x7fd44c099a40 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c06e8c0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd450f11700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c09a820 con 0x7fd44c131810 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49274/0 (socket says 172.21.15.19:49274) 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd44a59c700 1 -- 172.21.15.19:0/953902134 learned_addr learned my addr 172.21.15.19:0/953902134 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd44ad9d700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c09a3b0 0x7fd44c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.430+0000 7fd449d9b700 1 --2- 172.21.15.19:0/953902134 >> v2:172.21.15.19:3300/0 conn(0x7fd44c099a40 0x7fd44c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 -- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c09a3b0 msgr2=0x7fd44c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c09a3b0 0x7fd44c138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 -- 172.21.15.19:0/953902134 >> v2:172.21.15.19:3300/0 conn(0x7fd44c099a40 msgr2=0x7fd44c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 --2- 172.21.15.19:0/953902134 >> v2:172.21.15.19:3300/0 conn(0x7fd44c099a40 0x7fd44c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 -- 172.21.15.19:0/953902134 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c071d20 con 0x7fd44c131810 2023-10-03T10:14:45.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44a59c700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0098f0 tx=0x7fd43c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704a92be9ea7a1fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44959a700 1 -- 172.21.15.19:0/953902134 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c011830 con 0x7fd44c131810 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44959a700 1 -- 172.21.15.19:0/953902134 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c011990 con 0x7fd44c131810 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.431+0000 7fd44959a700 1 -- 172.21.15.19:0/953902134 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c011d20 con 0x7fd44c131810 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.432+0000 7fd450f11700 1 -- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 msgr2=0x7fd44c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.432+0000 7fd450f11700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0098f0 tx=0x7fd43c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.432+0000 7fd450f11700 1 -- 172.21.15.19:0/953902134 shutdown_connections 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.432+0000 7fd450f11700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c09a3b0 0x7fd44c138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.433+0000 7fd450f11700 1 --2- 172.21.15.19:0/953902134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c131810 0x7fd44c131be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.433+0000 7fd450f11700 1 --2- 172.21.15.19:0/953902134 >> v2:172.21.15.19:3300/0 conn(0x7fd44c099a40 0x7fd44c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.433+0000 7fd450f11700 1 -- 172.21.15.19:0/953902134 >> 172.21.15.19:0/953902134 conn(0x7fd44c0a2aa0 msgr2=0x7fd44c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.433+0000 7fd450f11700 1 -- 172.21.15.19:0/953902134 shutdown_connections 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.433+0000 7fd450f11700 1 -- 172.21.15.19:0/953902134 wait complete. 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.434+0000 7fd450f11700 1 Processor -- start 2023-10-03T10:14:45.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 -- start start 2023-10-03T10:14:45.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 0x7fd44c11bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c131810 0x7fd44c11c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c11e8e0 con 0x7fd44c099a40 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c06eb00 con 0x7fd44c131810 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd450f11700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0a1af0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.435+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd44a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58042/0 (socket says 172.21.15.19:58042) 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd44a59c700 1 -- 172.21.15.19:0/1701642672 learned_addr learned my addr 172.21.15.19:0/1701642672 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 0x7fd44c11bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd44ad9d700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c131810 0x7fd44c11c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 -- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c131810 msgr2=0x7fd44c11c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c131810 0x7fd44c11c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 -- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 msgr2=0x7fd44c11b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 -- 172.21.15.19:0/1701642672 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c009550 con 0x7fd44c09a3b0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd44a59c700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd449d9b700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 0x7fd44c11bc00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e8d0 tx=0x7fd44000ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.436+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000c690 con 0x7fd44c09a3b0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.437+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44000c7f0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.437+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44000cb60 con 0x7fd44c09a3b0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.437+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c11d240 con 0x7fd44c09a3b0 2023-10-03T10:14:45.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.438+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c11f650 con 0x7fd44c09a3b0 2023-10-03T10:14:45.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.439+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd44000ccc0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.439+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c074ea0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.439+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd44003f7c0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.445+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd4400232f0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.485+0000 7f38e9315700 1 Processor -- start 2023-10-03T10:14:45.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.485+0000 7f38e9315700 1 -- start start 2023-10-03T10:14:45.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.486+0000 7f38e9315700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.486+0000 7f38e9315700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.486+0000 7f38e9315700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e406b990 con 0x7f38e4133e30 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.486+0000 7f38e9315700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40a0590 con 0x7f38e4133420 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.486+0000 7f38e9315700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38e409fb80 con 0x7f38e4134260 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42908/0 (socket says 172.21.15.19:42908) 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 -- 172.21.15.19:0/3410618794 learned_addr learned my addr 172.21.15.19:0/3410618794 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e27fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38e4133e30 0x7f38e412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37926/0 (socket says 172.21.15.19:37926) 2023-10-03T10:14:45.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e37fe700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 -- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 msgr2=0x7f38e41306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e41306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 -- 172.21.15.19:0/3410618794 >> v1:172.21.15.19:6789/0 conn(0x7f38e4133e30 legacy=0x7f38e412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e1ffb700 1 -- 172.21.15.19:0/3410618794 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080026958 0 0) 0x7f38e406b990 con 0x7f38e4133e30 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 -- 172.21.15.19:0/3410618794 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40a0030 con 0x7f38e4133420 2023-10-03T10:14:45.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e2ffd700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009920 tx=0x7f38d4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee5e5c263071dba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.487+0000 7f38e1ffb700 1 -- 172.21.15.19:0/3410618794 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4011830 con 0x7f38e4133420 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.488+0000 7f38e1ffb700 1 -- 172.21.15.19:0/3410618794 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4011990 con 0x7f38e4133420 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.488+0000 7f38e1ffb700 1 -- 172.21.15.19:0/3410618794 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4011d20 con 0x7f38e4133420 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 -- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 msgr2=0x7f38e41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009920 tx=0x7f38d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 -- 172.21.15.19:0/3410618794 shutdown_connections 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e41306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 --2- 172.21.15.19:0/3410618794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e41337f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 -- 172.21.15.19:0/3410618794 >> 172.21.15.19:0/3410618794 conn(0x7f38e40a4210 msgr2=0x7f38e40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 -- 172.21.15.19:0/3410618794 shutdown_connections 2023-10-03T10:14:45.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.489+0000 7f38e9315700 1 -- 172.21.15.19:0/3410618794 wait complete. 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.490+0000 7f38e9315700 1 Processor -- start 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.490+0000 7f38e9315700 1 -- start start 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.490+0000 7f38e9315700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.490+0000 7f38e9315700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.490+0000 7f38e9315700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e9315700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e409d850 con 0x7f38e4133e30 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e9315700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e409dc70 con 0x7f38e4133420 2023-10-03T10:14:45.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e9315700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38e411ed80 con 0x7f38e4134260 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58046/0 (socket says 172.21.15.19:58046) 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e27fc700 1 -- 172.21.15.19:0/3131009034 learned_addr learned my addr 172.21.15.19:0/3131009034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e2ffd700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 -- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 msgr2=0x7f38e409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 -- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 msgr2=0x7f38e409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e37fe700 1 -- 172.21.15.19:0/3131009034 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4009550 con 0x7f38e4134260 2023-10-03T10:14:45.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.491+0000 7f38e27fc700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38e37fe700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e409cf00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00ef90 tx=0x7f38dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00cc90 con 0x7f38e4134260 2023-10-03T10:14:45.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc00f040 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e41316b0 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0146c0 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.492+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e411f3f0 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.493+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38dc014820 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.493+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e411fcd0 con 0x7f38e4134260 2023-10-03T10:14:45.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.493+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38dc0401b0 con 0x7f38e4134260 2023-10-03T10:14:45.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.503+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38dc014ad0 con 0x7f38e4134260 2023-10-03T10:14:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.520+0000 7f68244d0700 1 Processor -- start 2023-10-03T10:14:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.520+0000 7f68244d0700 1 -- start start 2023-10-03T10:14:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f68244d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f68244d0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f681c09e000 0x7f681c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f68244d0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681c09b120 con 0x7f681c09e410 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f68244d0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f681c06b460 con 0x7f681c09e000 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f68244d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c09a7e0 con 0x7f681c09d6f0 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f682226c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6822a6d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f681c09e410 0x7f681c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:37938/0 (socket says 172.21.15.19:37938) 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6822a6d700 1 -- 172.21.15.19:0/85980927 learned_addr learned my addr 172.21.15.19:0/85980927 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6821a6b700 1 --2- 172.21.15.19:0/85980927 >> v2:172.21.15.19:3300/0 conn(0x7f681c09e000 0x7f681c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6821a6b700 1 -- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 msgr2=0x7f681c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6821a6b700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6821a6b700 1 -- 172.21.15.19:0/85980927 >> v1:172.21.15.19:6789/0 conn(0x7f681c09e410 legacy=0x7f681c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f6821a6b700 1 -- 172.21.15.19:0/85980927 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c09a500 con 0x7f681c09e000 2023-10-03T10:14:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.521+0000 7f682226c700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.522+0000 7f6821a6b700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e000 0x7f681c1339f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f680c009840 tx=0x7f680c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab7b08a1871ffb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.522+0000 7f682126a700 1 -- 172.21.15.19:0/85980927 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c011830 con 0x7f681c09e000 2023-10-03T10:14:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.522+0000 7f682126a700 1 -- 172.21.15.19:0/85980927 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c011990 con 0x7f681c09e000 2023-10-03T10:14:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.522+0000 7f682126a700 1 -- 172.21.15.19:0/85980927 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c011d20 con 0x7f681c09e000 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 -- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e000 msgr2=0x7f681c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e000 0x7f681c1339f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f680c009840 tx=0x7f680c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 -- 172.21.15.19:0/85980927 shutdown_connections 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 --2- 172.21.15.19:0/85980927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e000 0x7f681c1339f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 -- 172.21.15.19:0/85980927 >> 172.21.15.19:0/85980927 conn(0x7f681c066f50 msgr2=0x7f681c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 -- 172.21.15.19:0/85980927 shutdown_connections 2023-10-03T10:14:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.523+0000 7f68244d0700 1 -- 172.21.15.19:0/85980927 wait complete. 2023-10-03T10:14:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.524+0000 7f68244d0700 1 Processor -- start 2023-10-03T10:14:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 -- start start 2023-10-03T10:14:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681c09e000 0x7f681c1a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e410 0x7f681c1a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681c1a7b30 con 0x7f681c09e410 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681c1a8150 con 0x7f681c09d6f0 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f68244d0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f681c1a8d80 con 0x7f681c09e000 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.525+0000 7f682226c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f6822a6d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e410 0x7f681c1a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42942/0 (socket says 172.21.15.19:42942) 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 -- 172.21.15.19:0/1009291806 learned_addr learned my addr 172.21.15.19:0/1009291806 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f6821a6b700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681c09e000 0x7f681c1a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 -- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681c09e000 msgr2=0x7f681c1a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681c09e000 0x7f681c1a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 -- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e410 msgr2=0x7f681c1a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e410 0x7f681c1a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 -- 172.21.15.19:0/1009291806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180094a0 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f682226c700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f681800ec10 tx=0x7f681800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800c910 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800ca70 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c0094a0 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800cde0 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.526+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f681c0a2fd0 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.527+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6818013470 con 0x7f681c09d6f0 2023-10-03T10:14:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.528+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6818043220 con 0x7f681c09d6f0 2023-10-03T10:14:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.528+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681c09c710 con 0x7f681c09d6f0 2023-10-03T10:14:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.533+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6818017020 con 0x7f681c09d6f0 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.558+0000 7f44dd927700 1 Processor -- start 2023-10-03T10:14:45.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.558+0000 7f44dd927700 1 -- start start 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44dd927700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44dd927700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8139030 0x7f44d813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44dd927700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d806ef30 con 0x7f44d81338a0 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44dd927700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806fef0 con 0x7f44d8136710 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44dd927700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81334b0 con 0x7f44d8139030 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42944/0 (socket says 172.21.15.19:42944) 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 -- 172.21.15.19:0/1564996056 learned_addr learned my addr 172.21.15.19:0/1564996056 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d77fe700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8139030 0x7f44d813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 -- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8139030 msgr2=0x7f44d813b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8139030 0x7f44d813b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 -- 172.21.15.19:0/1564996056 >> v1:172.21.15.19:6789/0 conn(0x7f44d81338a0 legacy=0x7f44d8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.559+0000 7f44d67fc700 1 -- 172.21.15.19:0/1564996056 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d806fc30 con 0x7f44d8136710 2023-10-03T10:14:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44d67fc700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009920 tx=0x7f44cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b05b1ad41912ff5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44d5ffb700 1 -- 172.21.15.19:0/1564996056 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011830 con 0x7f44d8136710 2023-10-03T10:14:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44d5ffb700 1 -- 172.21.15.19:0/1564996056 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc011990 con 0x7f44d8136710 2023-10-03T10:14:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44d5ffb700 1 -- 172.21.15.19:0/1564996056 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc011d00 con 0x7f44d8136710 2023-10-03T10:14:45.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44dd927700 1 -- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 msgr2=0x7f44d8138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.560+0000 7f44dd927700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009920 tx=0x7f44cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 -- 172.21.15.19:0/1564996056 shutdown_connections 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8139030 0x7f44d813b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 --2- 172.21.15.19:0/1564996056 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d8136710 0x7f44d8138af0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 -- 172.21.15.19:0/1564996056 >> 172.21.15.19:0/1564996056 conn(0x7f44d80a2aa0 msgr2=0x7f44d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 -- 172.21.15.19:0/1564996056 shutdown_connections 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.561+0000 7f44dd927700 1 -- 172.21.15.19:0/1564996056 wait complete. 2023-10-03T10:14:45.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 Processor -- start 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 -- start start 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d81338a0 0x7f44d811bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d8139030 0x7f44d81c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d811eb00 con 0x7f44d8139030 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d806f640 con 0x7f44d81338a0 2023-10-03T10:14:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44dd927700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d811c760 con 0x7f44d8136710 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.562+0000 7f44d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49320/0 (socket says 172.21.15.19:49320) 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 -- 172.21.15.19:0/2946843514 learned_addr learned my addr 172.21.15.19:0/2946843514 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d8139030 0x7f44d81c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d6ffd700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d81338a0 0x7f44d811bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 -- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d81338a0 msgr2=0x7f44d811bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d81338a0 0x7f44d811bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 -- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d8139030 msgr2=0x7f44d81c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d8139030 0x7f44d81c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 -- 172.21.15.19:0/2946843514 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44cc009550 con 0x7f44d8136710 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44d67fc700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009130 tx=0x7f44cc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:45.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004450 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d811b7d0 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc01f070 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.563+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0038a0 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.564+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d811de70 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.565+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44cc003a00 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.565+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44cc021070 con 0x7f44d8136710 2023-10-03T10:14:45.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.565+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d8136000 con 0x7f44d8136710 2023-10-03T10:14:45.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.574+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44cc015070 con 0x7f44d8136710 2023-10-03T10:14:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.682+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd44c11ecd0 con 0x7fd44c09a3b0 2023-10-03T10:14:45.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.683+0000 7fd43affd700 1 -- 172.21.15.19:0/1701642672 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd440021020 con 0x7fd44c09a3b0 2023-10-03T10:14:45.683 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 msgr2=0x7fd44c11bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 0x7fd44c11bc00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd44000e8d0 tx=0x7fd44000ebe0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 shutdown_connections 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd44c131810 0x7fd44c11c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd44c099a40 0x7fd44c11b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 --2- 172.21.15.19:0/1701642672 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd44c09a3b0 0x7fd44c11bc00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.685+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 >> 172.21.15.19:0/1701642672 conn(0x7fd44c0a2aa0 msgr2=0x7fd44c1b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.686+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 shutdown_connections 2023-10-03T10:14:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.686+0000 7fd450f11700 1 -- 172.21.15.19:0/1701642672 wait complete. 2023-10-03T10:14:45.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:45.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.724+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38e4074ea0 con 0x7f38e4134260 2023-10-03T10:14:45.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.724+0000 7f38cb7fe700 1 -- 172.21.15.19:0/3131009034 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38dc012340 con 0x7f38e4134260 2023-10-03T10:14:45.724 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:45.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 msgr2=0x7f38e409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e409cf00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00ef90 tx=0x7f38dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 shutdown_connections 2023-10-03T10:14:45.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38e4134260 0x7f38e409cf00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38e4133420 0x7f38e409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 --2- 172.21.15.19:0/3131009034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38e4133e30 0x7f38e409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 >> 172.21.15.19:0/3131009034 conn(0x7f38e40a4210 msgr2=0x7f38e40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 shutdown_connections 2023-10-03T10:14:45.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.726+0000 7f38e9315700 1 -- 172.21.15.19:0/3131009034 wait complete. 2023-10-03T10:14:45.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.747+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f681c074ea0 con 0x7f681c09d6f0 2023-10-03T10:14:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.748+0000 7f6812ffd700 1 -- 172.21.15.19:0/1009291806 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68180102b0 con 0x7f681c09d6f0 2023-10-03T10:14:45.748 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 msgr2=0x7f681c1a5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f681800ec10 tx=0x7f681800ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 shutdown_connections 2023-10-03T10:14:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681c09e410 0x7f681c1a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681c09d6f0 0x7f681c1a5fb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 --2- 172.21.15.19:0/1009291806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681c09e000 0x7f681c1a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 >> 172.21.15.19:0/1009291806 conn(0x7f681c066f50 msgr2=0x7f681c1baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 shutdown_connections 2023-10-03T10:14:45.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.750+0000 7f68244d0700 1 -- 172.21.15.19:0/1009291806 wait complete. 2023-10-03T10:14:45.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.785+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44d811e470 con 0x7f44d8136710 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.785+0000 7f44bffff700 1 -- 172.21.15.19:0/2946843514 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44cc00be80 con 0x7f44d8136710 2023-10-03T10:14:45.785 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:45.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 msgr2=0x7f44d811c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f44cc009130 tx=0x7f44cc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 shutdown_connections 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d8139030 0x7f44d81c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d81338a0 0x7f44d811bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 --2- 172.21.15.19:0/2946843514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d8136710 0x7f44d811c220 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.787+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 >> 172.21.15.19:0/2946843514 conn(0x7f44d80a2aa0 msgr2=0x7f44d81344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.788+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 shutdown_connections 2023-10-03T10:14:45.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:45.788+0000 7f44dd927700 1 -- 172.21.15.19:0/2946843514 wait complete. 2023-10-03T10:14:45.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:46.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:46.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:46.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:46.801 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:46.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.859+0000 7f08167fb700 1 Processor -- start 2023-10-03T10:14:46.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.859+0000 7f08167fb700 1 -- start start 2023-10-03T10:14:46.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.859+0000 7f08167fb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f081009d6f0 0x7f081009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.859+0000 7f08167fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f0810130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f08167fb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081009f130 con 0x7f081009e410 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f08167fb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081009f520 con 0x7f081009d6f0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f08167fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f081009e930 con 0x7f081009e000 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f081009d6f0 0x7f081009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f081009d6f0 0x7f081009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48820/0 (socket says 172.21.15.19:48820) 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 -- 172.21.15.19:0/2987980535 learned_addr learned my addr 172.21.15.19:0/2987980535 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080f7fe700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f0810130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 -- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 msgr2=0x7f0810130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f0810130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 -- 172.21.15.19:0/2987980535 >> v1:172.21.15.19:6789/0 conn(0x7f081009e410 legacy=0x7f0810130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080effd700 1 -- 172.21.15.19:0/2987980535 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517820969 0 0) 0x7f081009f130 con 0x7f081009e410 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 -- 172.21.15.19:0/2987980535 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081009b2d0 con 0x7f081009d6f0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.860+0000 7f080ffff700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f081009dac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345539f83d4da450 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f080effd700 1 -- 172.21.15.19:0/2987980535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011830 con 0x7f081009d6f0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f080effd700 1 -- 172.21.15.19:0/2987980535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800011990 con 0x7f081009d6f0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f080effd700 1 -- 172.21.15.19:0/2987980535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800011d20 con 0x7f081009d6f0 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f08167fb700 1 -- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 msgr2=0x7f081009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f08167fb700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f081009dac0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f08000098f0 tx=0x7f0800009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:46.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f08167fb700 1 -- 172.21.15.19:0/2987980535 shutdown_connections 2023-10-03T10:14:46.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.861+0000 7f08167fb700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f081009dac0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.862+0000 7f08167fb700 1 --2- 172.21.15.19:0/2987980535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f0810130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.862+0000 7f08167fb700 1 -- 172.21.15.19:0/2987980535 >> 172.21.15.19:0/2987980535 conn(0x7f0810066f50 msgr2=0x7f081009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.862+0000 7f08167fb700 1 -- 172.21.15.19:0/2987980535 shutdown_connections 2023-10-03T10:14:46.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.862+0000 7f08167fb700 1 -- 172.21.15.19:0/2987980535 wait complete. 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.863+0000 7f08167fb700 1 Processor -- start 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.863+0000 7f08167fb700 1 -- start start 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f08101c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f081009e410 0x7f0810131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100a1e90 con 0x7f081009d6f0 2023-10-03T10:14:46.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0810135120 con 0x7f081009e410 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f08167fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08101c5e20 con 0x7f081009e000 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f080ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f080ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48830/0 (socket says 172.21.15.19:48830) 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f080ffff700 1 -- 172.21.15.19:0/1276350018 learned_addr learned my addr 172.21.15.19:0/1276350018 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.864+0000 7f080f7fe700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f08101c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080ffff700 1 -- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 msgr2=0x7f08101c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080ffff700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f08101c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080ffff700 1 -- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f081009e410 msgr2=0x7f0810131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080ffff700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f081009e410 0x7f0810131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080ffff700 1 -- 172.21.15.19:0/1276350018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009550 con 0x7f081009d6f0 2023-10-03T10:14:46.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.865+0000 7f080f7fe700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f08101c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:46.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.866+0000 7f080ffff700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0800009c40 tx=0x7f0800004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.866+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800004480 con 0x7f081009d6f0 2023-10-03T10:14:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.867+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080001f070 con 0x7f081009d6f0 2023-10-03T10:14:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.867+0000 7f08167fb700 1 -- 172.21.15.19:0/1276350018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08101334a0 con 0x7f081009d6f0 2023-10-03T10:14:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.867+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08000038e0 con 0x7f081009d6f0 2023-10-03T10:14:46.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.867+0000 7f08167fb700 1 -- 172.21.15.19:0/1276350018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08101c6c60 con 0x7f081009d6f0 2023-10-03T10:14:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.868+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80052e0 con 0x7f081009d6f0 2023-10-03T10:14:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.868+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0800021030 con 0x7f081009d6f0 2023-10-03T10:14:46.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.869+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0800040aa0 con 0x7f081009d6f0 2023-10-03T10:14:46.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.874+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0800019960 con 0x7f081009d6f0 2023-10-03T10:14:46.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.901+0000 7f2278501700 1 Processor -- start 2023-10-03T10:14:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.901+0000 7f2278501700 1 -- start start 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2278501700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 0x7f2270135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2278501700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f2270138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2278501700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227009f130 con 0x7f227009d6f0 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2278501700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227009f520 con 0x7f227009e1d0 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2278501700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227009e930 con 0x7f2270135e50 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2275a9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 0x7f2270135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2276a9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f2270138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2275a9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 0x7f2270135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48840/0 (socket says 172.21.15.19:48840) 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2275a9c700 1 -- 172.21.15.19:0/2423193546 learned_addr learned my addr 172.21.15.19:0/2423193546 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2276a9e700 1 -- 172.21.15.19:0/2423193546 >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 msgr2=0x7f2270135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2276a9e700 1 --2- 172.21.15.19:0/2423193546 >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 0x7f2270135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2276a9e700 1 -- 172.21.15.19:0/2423193546 >> v1:172.21.15.19:6789/0 conn(0x7f227009d6f0 legacy=0x7f227009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.902+0000 7f2276a9e700 1 -- 172.21.15.19:0/2423193546 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227009b2d0 con 0x7f2270135e50 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.903+0000 7f2276a9e700 1 --2- 172.21.15.19:0/2423193546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f2270138230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f226800f370 tx=0x7f226800f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54620a270f8a416d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.903+0000 7f227529b700 1 -- 172.21.15.19:0/2423193546 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268012070 con 0x7f2270135e50 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.903+0000 7f227529b700 1 -- 172.21.15.19:0/2423193546 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226800fe70 con 0x7f2270135e50 2023-10-03T10:14:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.903+0000 7f227529b700 1 -- 172.21.15.19:0/2423193546 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800d2f0 con 0x7f2270135e50 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 -- 172.21.15.19:0/2423193546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 msgr2=0x7f2270138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 --2- 172.21.15.19:0/2423193546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f2270138230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f226800f370 tx=0x7f226800f680 comp rx=0 tx=0).stop 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 -- 172.21.15.19:0/2423193546 shutdown_connections 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 --2- 172.21.15.19:0/2423193546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f2270138230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 --2- 172.21.15.19:0/2423193546 >> v2:172.21.15.19:3300/0 conn(0x7f227009e1d0 0x7f2270135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 -- 172.21.15.19:0/2423193546 >> 172.21.15.19:0/2423193546 conn(0x7f2270066f50 msgr2=0x7f227009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 -- 172.21.15.19:0/2423193546 shutdown_connections 2023-10-03T10:14:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.904+0000 7f2278501700 1 -- 172.21.15.19:0/2423193546 wait complete. 2023-10-03T10:14:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 Processor -- start 2023-10-03T10:14:46.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 -- start start 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 0x7f227011b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f227011bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.906+0000 7f2278501700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227011d100 con 0x7f227009d6f0 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f2278501700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227011ec20 con 0x7f2270135e50 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f2278501700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22700a1e20 con 0x7f227009e1d0 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48844/0 (socket says 172.21.15.19:48844) 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 -- 172.21.15.19:0/2051448824 learned_addr learned my addr 172.21.15.19:0/2051448824 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f2275a9c700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 0x7f227011b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f2276a9e700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f227011bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 -- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 msgr2=0x7f227011b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 0x7f227011b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 -- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 msgr2=0x7f227011bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f227011bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 -- 172.21.15.19:0/2051448824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226800f050 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f2275a9c700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 0x7f227011b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.907+0000 7f227629d700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c450 tx=0x7f226c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.908+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0052d0 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.908+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c005430 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.908+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227009c700 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.908+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0038c0 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.908+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227011f690 con 0x7f227009d6f0 2023-10-03T10:14:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.909+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f226c003a20 con 0x7f227009d6f0 2023-10-03T10:14:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.909+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f226c03ea10 con 0x7f227009d6f0 2023-10-03T10:14:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.909+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2270074ea0 con 0x7f227009d6f0 2023-10-03T10:14:46.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.918+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f226c017070 con 0x7f227009d6f0 2023-10-03T10:14:46.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.942+0000 7fb9b1bee700 1 Processor -- start 2023-10-03T10:14:46.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.942+0000 7fb9b1bee700 1 -- start start 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9b1bee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09e930 0x7fb9ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9b1bee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9b1bee700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac070940 con 0x7fb9ac09f650 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9b1bee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac06fd60 con 0x7fb9ac09e930 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9b1bee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac06fa80 con 0x7fb9ac09f240 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46406/0 (socket says 172.21.15.19:46406) 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 -- 172.21.15.19:0/396896355 learned_addr learned my addr 172.21.15.19:0/396896355 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09e930 0x7fb9ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 -- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09e930 msgr2=0x7fb9ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 --2- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09e930 0x7fb9ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 -- 172.21.15.19:0/396896355 >> v1:172.21.15.19:6789/0 conn(0x7fb9ac09f650 legacy=0x7fb9ac131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.943+0000 7fb9aaffd700 1 -- 172.21.15.19:0/396896355 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac09fb60 con 0x7fb9ac09f240 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9aaffd700 1 --2- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009920 tx=0x7fb9a0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afda9a67b2597be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9aa7fc700 1 -- 172.21.15.19:0/396896355 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0004230 con 0x7fb9ac09f240 2023-10-03T10:14:46.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9aa7fc700 1 -- 172.21.15.19:0/396896355 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a0004390 con 0x7fb9ac09f240 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9aa7fc700 1 -- 172.21.15.19:0/396896355 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a00036a0 con 0x7fb9ac09f240 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9b1bee700 1 -- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 msgr2=0x7fb9ac1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.944+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0009920 tx=0x7fb9a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 -- 172.21.15.19:0/396896355 shutdown_connections 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09e930 0x7fb9ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/396896355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09f240 0x7fb9ac1317f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 -- 172.21.15.19:0/396896355 >> 172.21.15.19:0/396896355 conn(0x7fb9ac0a4210 msgr2=0x7fb9ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 -- 172.21.15.19:0/396896355 shutdown_connections 2023-10-03T10:14:46.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.945+0000 7fb9b1bee700 1 -- 172.21.15.19:0/396896355 wait complete. 2023-10-03T10:14:46.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.946+0000 7fb9b1bee700 1 Processor -- start 2023-10-03T10:14:46.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.946+0000 7fb9b1bee700 1 -- start start 2023-10-03T10:14:46.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09f240 0x7fb9ac1a62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ac09f650 0x7fb9ac1a6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac1a7900 con 0x7fb9ac09f650 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac1a8b50 con 0x7fb9ac09f240 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9b1bee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac1a7ef0 con 0x7fb9ac09e930 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9aaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09f240 0x7fb9ac1a62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9ab7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46422/0 (socket says 172.21.15.19:46422) 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9ab7fe700 1 -- 172.21.15.19:0/286835695 learned_addr learned my addr 172.21.15.19:0/286835695 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:46.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.947+0000 7fb9abfff700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ac09f650 0x7fb9ac1a6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 -- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09f240 msgr2=0x7fb9ac1a62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09f240 0x7fb9ac1a62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 -- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ac09f650 msgr2=0x7fb9ac1a6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ac09f650 0x7fb9ac1a6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 -- 172.21.15.19:0/286835695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0009550 con 0x7fb9ac09e930 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9ab7fe700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e9e0 tx=0x7fb99c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c009710 con 0x7fb9ac09e930 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c00ee80 con 0x7fb9ac09e930 2023-10-03T10:14:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0a0190 con 0x7fb9ac09e930 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c00ca50 con 0x7fb9ac09e930 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.948+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac071d20 con 0x7fb9ac09e930 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.949+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb99c00cbb0 con 0x7fb9ac09e930 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.950+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb99c03fa90 con 0x7fb9ac09e930 2023-10-03T10:14:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.950+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac1a2b40 con 0x7fb9ac09e930 2023-10-03T10:14:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:46.955+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb99c021080 con 0x7fb9ac09e930 2023-10-03T10:14:47.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.021+0000 7f02471a2700 1 Processor -- start 2023-10-03T10:14:47.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.021+0000 7f02471a2700 1 -- start start 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02471a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02471a2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0240136e60 0x7f0240139240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02471a2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f024009bd10 con 0x7f0240097cc0 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02471a2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0240096630 con 0x7f0240136e60 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02471a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0240097600 con 0x7f0240134540 2023-10-03T10:14:47.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f024599f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f024599f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45234/0 (socket says 172.21.15.19:45234) 2023-10-03T10:14:47.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f024599f700 1 -- 172.21.15.19:0/4282867864 learned_addr learned my addr 172.21.15.19:0/4282867864 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:47.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.022+0000 7f02469a1700 1 --2- 172.21.15.19:0/4282867864 >> v2:172.21.15.19:3300/0 conn(0x7f0240136e60 0x7f0240139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024599f700 1 -- 172.21.15.19:0/4282867864 >> v2:172.21.15.19:3300/0 conn(0x7f0240136e60 msgr2=0x7f0240139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024599f700 1 --2- 172.21.15.19:0/4282867864 >> v2:172.21.15.19:3300/0 conn(0x7f0240136e60 0x7f0240139240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024599f700 1 -- 172.21.15.19:0/4282867864 >> v1:172.21.15.19:6789/0 conn(0x7f0240097cc0 legacy=0x7f0240098090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024519e700 1 -- 172.21.15.19:0/4282867864 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621078588 0 0) 0x7f024009bd10 con 0x7f0240097cc0 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024599f700 1 -- 172.21.15.19:0/4282867864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024009e690 con 0x7f0240134540 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024599f700 1 --2- 172.21.15.19:0/4282867864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0230009920 tx=0x7f0230009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47727c1ebc9ccc33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024519e700 1 -- 172.21.15.19:0/4282867864 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230011830 con 0x7f0240134540 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024519e700 1 -- 172.21.15.19:0/4282867864 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230011990 con 0x7f0240134540 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.023+0000 7f024519e700 1 -- 172.21.15.19:0/4282867864 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230011d20 con 0x7f0240134540 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 -- 172.21.15.19:0/4282867864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 msgr2=0x7f0240136920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 --2- 172.21.15.19:0/4282867864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0230009920 tx=0x7f0230009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 -- 172.21.15.19:0/4282867864 shutdown_connections 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 --2- 172.21.15.19:0/4282867864 >> v2:172.21.15.19:3300/0 conn(0x7f0240136e60 0x7f0240139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 --2- 172.21.15.19:0/4282867864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f0240136920 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 -- 172.21.15.19:0/4282867864 >> 172.21.15.19:0/4282867864 conn(0x7f02400a2540 msgr2=0x7f02400a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 -- 172.21.15.19:0/4282867864 shutdown_connections 2023-10-03T10:14:47.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.024+0000 7f02471a2700 1 -- 172.21.15.19:0/4282867864 wait complete. 2023-10-03T10:14:47.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.025+0000 7f02471a2700 1 Processor -- start 2023-10-03T10:14:47.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 -- start start 2023-10-03T10:14:47.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 0x7f0240133f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f02400997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024009b450 con 0x7f0240136e60 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0240092e00 con 0x7f0240134540 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02471a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02400a1470 con 0x7f0240097cc0 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02469a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02469a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48868/0 (socket says 172.21.15.19:48868) 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02469a1700 1 -- 172.21.15.19:0/2163023902 learned_addr learned my addr 172.21.15.19:0/2163023902 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f024599f700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f02400997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.026+0000 7f02461a0700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 0x7f0240133f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:47.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 -- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 msgr2=0x7f0240133f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 0x7f0240133f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 -- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 msgr2=0x7f0240099cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 -- 172.21.15.19:0/2163023902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0230009550 con 0x7f0240134540 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f02461a0700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 0x7f0240133f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f02469a1700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f024599f700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f02400997b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0230016000 tx=0x7f0230004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300045d0 con 0x7f0240134540 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f023001f070 con 0x7f0240134540 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300038c0 con 0x7f0240134540 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02400987b0 con 0x7f0240134540 2023-10-03T10:14:47.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.027+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0240093870 con 0x7f0240134540 2023-10-03T10:14:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.029+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0240092c40 con 0x7f0240134540 2023-10-03T10:14:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.029+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0230003a20 con 0x7f0240134540 2023-10-03T10:14:47.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.029+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0230021070 con 0x7f0240134540 2023-10-03T10:14:47.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.034+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f023002f3a0 con 0x7f0240134540 2023-10-03T10:14:47.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.092+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07e8005590 con 0x7f081009d6f0 2023-10-03T10:14:47.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.092+0000 7f080cff9700 1 -- 172.21.15.19:0/1276350018 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0800019730 con 0x7f081009d6f0 2023-10-03T10:14:47.092 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 msgr2=0x7f08101c61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0800009c40 tx=0x7f0800004750 comp rx=0 tx=0).stop 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 shutdown_connections 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f081009e410 0x7f0810131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f081009d6f0 0x7f08101c61e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 --2- 172.21.15.19:0/1276350018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f081009e000 0x7f08101c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 >> 172.21.15.19:0/1276350018 conn(0x7f0810066f50 msgr2=0x7f0810070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 shutdown_connections 2023-10-03T10:14:47.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.096+0000 7f07f67fc700 1 -- 172.21.15.19:0/1276350018 wait complete. 2023-10-03T10:14:47.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:47.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.166+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9ac074ea0 con 0x7fb9ac09e930 2023-10-03T10:14:47.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.167+0000 7fb993fff700 1 -- 172.21.15.19:0/286835695 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb99c017020 con 0x7fb9ac09e930 2023-10-03T10:14:47.166 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 msgr2=0x7fb9ac1a5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00e9e0 tx=0x7fb99c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 shutdown_connections 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9ac09f650 0x7fb9ac1a6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9ac09e930 0x7fb9ac1a5d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 --2- 172.21.15.19:0/286835695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9ac09f240 0x7fb9ac1a62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 >> 172.21.15.19:0/286835695 conn(0x7fb9ac0a4210 msgr2=0x7fb9ac09dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 shutdown_connections 2023-10-03T10:14:47.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.169+0000 7fb9b1bee700 1 -- 172.21.15.19:0/286835695 wait complete. 2023-10-03T10:14:47.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.182+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f227006c360 con 0x7f227009d6f0 2023-10-03T10:14:47.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.182+0000 7f2266ffd700 1 -- 172.21.15.19:0/2051448824 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f226c017020 con 0x7f227009d6f0 2023-10-03T10:14:47.182 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:47.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 msgr2=0x7f227011b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c450 tx=0x7f226c00c760 comp rx=0 tx=0).stop 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 shutdown_connections 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2270135e50 0x7f227011bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f227009d6f0 0x7f227011b480 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 --2- 172.21.15.19:0/2051448824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f227009e1d0 0x7f227011b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 >> 172.21.15.19:0/2051448824 conn(0x7f2270066f50 msgr2=0x7f22700a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 shutdown_connections 2023-10-03T10:14:47.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.185+0000 7f2278501700 1 -- 172.21.15.19:0/2051448824 wait complete. 2023-10-03T10:14:47.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:47.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.240+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f02400a1e40 con 0x7f0240134540 2023-10-03T10:14:47.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.240+0000 7f0236ffd700 1 -- 172.21.15.19:0/2163023902 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f023002b020 con 0x7f0240134540 2023-10-03T10:14:47.240 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 msgr2=0x7f02400997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f02400997b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0230016000 tx=0x7f0230004750 comp rx=0 tx=0).stop 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 shutdown_connections 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0240136e60 0x7f0240099cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0240097cc0 0x7f0240133f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 --2- 172.21.15.19:0/2163023902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0240134540 0x7f02400997b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 >> 172.21.15.19:0/2163023902 conn(0x7f02400a2540 msgr2=0x7f02400a0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 shutdown_connections 2023-10-03T10:14:47.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:47.243+0000 7f02471a2700 1 -- 172.21.15.19:0/2163023902 wait complete. 2023-10-03T10:14:47.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:48.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:48.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:48.199 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:48.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 Processor -- start 2023-10-03T10:14:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 -- start start 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c09ece0 con 0x7f832c131b40 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09e760 con 0x7f832c06a770 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f83315ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09e040 con 0x7f832c06b080 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f832affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f832affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45250/0 (socket says 172.21.15.19:45250) 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f832affd700 1 -- 172.21.15.19:0/1467290157 learned_addr learned my addr 172.21.15.19:0/1467290157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.266+0000 7f832b7fe700 1 --1- 172.21.15.19:0/1467290157 >> v1:172.21.15.19:6789/0 conn(0x7f832c131b40 0x7f832c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44966/0 (socket says 172.21.15.19:44966) 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 -- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 msgr2=0x7f832c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 -- 172.21.15.19:0/1467290157 >> v1:172.21.15.19:6789/0 conn(0x7f832c131b40 legacy=0x7f832c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 -- 172.21.15.19:0/1467290157 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c09f630 con 0x7f832c06b080 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f832a7fc700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c131600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f8320009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a9355f45394bc27 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f8329ffb700 1 -- 172.21.15.19:0/1467290157 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011830 con 0x7f832c06b080 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f8329ffb700 1 -- 172.21.15.19:0/1467290157 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8320011990 con 0x7f832c06b080 2023-10-03T10:14:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.267+0000 7f8329ffb700 1 -- 172.21.15.19:0/1467290157 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011d20 con 0x7f832c06b080 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 -- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 msgr2=0x7f832c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c131600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8320009870 tx=0x7f8320009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 -- 172.21.15.19:0/1467290157 shutdown_connections 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 --2- 172.21.15.19:0/1467290157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c131600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 -- 172.21.15.19:0/1467290157 >> 172.21.15.19:0/1467290157 conn(0x7f832c066f50 msgr2=0x7f832c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 -- 172.21.15.19:0/1467290157 shutdown_connections 2023-10-03T10:14:48.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.268+0000 7f83315ea700 1 -- 172.21.15.19:0/1467290157 wait complete. 2023-10-03T10:14:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.270+0000 7f83315ea700 1 Processor -- start 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.270+0000 7f83315ea700 1 -- start start 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c09b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 0x7f832c1c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09c310 con 0x7f832c131b40 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c121eb0 con 0x7f832c06a770 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f83315ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09a0c0 con 0x7f832c06b080 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f832affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f832b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 0x7f832c1c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f832affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45256/0 (socket says 172.21.15.19:45256) 2023-10-03T10:14:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f832affd700 1 -- 172.21.15.19:0/1120830452 learned_addr learned my addr 172.21.15.19:0/1120830452 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.271+0000 7f832a7fc700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c09b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 -- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 msgr2=0x7f832c09b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c09b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 -- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 msgr2=0x7f832c1c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 0x7f832c1c8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 -- 172.21.15.19:0/1120830452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200094a0 con 0x7f832c06a770 2023-10-03T10:14:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832b7fe700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 0x7f832c1c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f832affd700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f831c00e940 tx=0x7f831c00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0096a0 con 0x7f832c06a770 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c013680 con 0x7f832c06a770 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c013a30 con 0x7f832c06a770 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c09a740 con 0x7f832c06a770 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.272+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c122be0 con 0x7f832c06a770 2023-10-03T10:14:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.273+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f831c013b90 con 0x7f832c06a770 2023-10-03T10:14:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.274+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f831c03f5e0 con 0x7f832c06a770 2023-10-03T10:14:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.274+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c122020 con 0x7f832c06a770 2023-10-03T10:14:48.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.280+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f831c00c450 con 0x7f832c06a770 2023-10-03T10:14:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 Processor -- start 2023-10-03T10:14:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 -- start start 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 0x7f702c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 0x7f702c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702c06b990 con 0x7f702c133e30 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c0a0590 con 0x7f702c133420 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.356+0000 7f70342ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f702c09fb80 con 0x7f702c134260 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f7032049700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 0x7f702c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f7032049700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 0x7f702c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45260/0 (socket says 172.21.15.19:45260) 2023-10-03T10:14:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f7032049700 1 -- 172.21.15.19:0/1071684474 learned_addr learned my addr 172.21.15.19:0/1071684474 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 0x7f702c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f7031047700 1 -- 172.21.15.19:0/1071684474 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474039119 0 0) 0x7f702c06b990 con 0x7f702c133e30 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f7031047700 1 -- 172.21.15.19:0/1071684474 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70180035b0 con 0x7f702c133e30 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 -- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 msgr2=0x7f702c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 0x7f702c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 -- 172.21.15.19:0/1071684474 >> v1:172.21.15.19:6789/0 conn(0x7f702c133e30 legacy=0x7f702c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 -- 172.21.15.19:0/1071684474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c0a0030 con 0x7f702c134260 2023-10-03T10:14:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.357+0000 7f703284a700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 0x7f702c1306a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7024009dc0 tx=0x7f702400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968649b4ba8b5344 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.358+0000 7f7031047700 1 -- 172.21.15.19:0/1071684474 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400e070 con 0x7f702c134260 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.358+0000 7f7031047700 1 -- 172.21.15.19:0/1071684474 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400bb20 con 0x7f702c134260 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.358+0000 7f7031047700 1 -- 172.21.15.19:0/1071684474 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400be90 con 0x7f702c134260 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.358+0000 7f70342ad700 1 -- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 msgr2=0x7f702c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.358+0000 7f70342ad700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 0x7f702c1306a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7024009dc0 tx=0x7f702400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 -- 172.21.15.19:0/1071684474 shutdown_connections 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c134260 0x7f702c1306a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 --2- 172.21.15.19:0/1071684474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133420 0x7f702c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 -- 172.21.15.19:0/1071684474 >> 172.21.15.19:0/1071684474 conn(0x7f702c0a4210 msgr2=0x7f702c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 -- 172.21.15.19:0/1071684474 shutdown_connections 2023-10-03T10:14:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.359+0000 7f70342ad700 1 -- 172.21.15.19:0/1071684474 wait complete. 2023-10-03T10:14:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 Processor -- start 2023-10-03T10:14:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 -- start start 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c133420 0x7f702c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133e30 0x7f702c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702c09ddb0 con 0x7f702c134260 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702c11f3b0 con 0x7f702c133e30 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f70342ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f702c11fab0 con 0x7f702c133420 2023-10-03T10:14:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f703284a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f703284a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48892/0 (socket says 172.21.15.19:48892) 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.360+0000 7f703284a700 1 -- 172.21.15.19:0/1052606504 learned_addr learned my addr 172.21.15.19:0/1052606504 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f7031848700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133e30 0x7f702c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f7032049700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c133420 0x7f702c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 -- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c133420 msgr2=0x7f702c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c133420 0x7f702c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 -- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133e30 msgr2=0x7f702c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133e30 0x7f702c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 -- 172.21.15.19:0/1052606504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009a70 con 0x7f702c134260 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f703284a700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7024009d90 tx=0x7f7024004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7024004970 con 0x7f702c134260 2023-10-03T10:14:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7024012430 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f702c11ed40 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.361+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70240127c0 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.362+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f702c120550 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.363+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7024012920 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.363+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f702c074ea0 con 0x7f702c134260 2023-10-03T10:14:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.363+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7024041870 con 0x7f702c134260 2023-10-03T10:14:48.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.371+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f702402d340 con 0x7f702c134260 2023-10-03T10:14:48.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.376+0000 7fbbded0c700 1 Processor -- start 2023-10-03T10:14:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 -- start start 2023-10-03T10:14:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbd809e000 0x7fbbd8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd809f520 con 0x7fbbd809e000 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd809f130 con 0x7fbbd809d6f0 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbded0c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd809e930 con 0x7fbbd809e410 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbdcaa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbdcaa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45274/0 (socket says 172.21.15.19:45274) 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbdcaa8700 1 -- 172.21.15.19:0/1249699535 learned_addr learned my addr 172.21.15.19:0/1249699535 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.377+0000 7fbbd7fff700 1 --2- 172.21.15.19:0/1249699535 >> v2:172.21.15.19:3300/0 conn(0x7fbbd809e000 0x7fbbd8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 -- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 msgr2=0x7fbbd8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 --2- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 -- 172.21.15.19:0/1249699535 >> v2:172.21.15.19:3300/0 conn(0x7fbbd809e000 msgr2=0x7fbbd8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 --2- 172.21.15.19:0/1249699535 >> v2:172.21.15.19:3300/0 conn(0x7fbbd809e000 0x7fbbd8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 -- 172.21.15.19:0/1249699535 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd809b2d0 con 0x7fbbd809d6f0 2023-10-03T10:14:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbdcaa8700 1 --2- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0098f0 tx=0x7fbbcc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3e884c1dd3a0d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbd77fe700 1 -- 172.21.15.19:0/1249699535 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc012b80 con 0x7fbbd809d6f0 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbd77fe700 1 -- 172.21.15.19:0/1249699535 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc012ce0 con 0x7fbbd809d6f0 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.378+0000 7fbbd77fe700 1 -- 172.21.15.19:0/1249699535 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc01b620 con 0x7fbbd809d6f0 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 -- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 msgr2=0x7fbbd809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 --2- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0098f0 tx=0x7fbbcc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 -- 172.21.15.19:0/1249699535 shutdown_connections 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 --2- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809d6f0 0x7fbbd809dac0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 --2- 172.21.15.19:0/1249699535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 --2- 172.21.15.19:0/1249699535 >> v2:172.21.15.19:3300/0 conn(0x7fbbd809e000 0x7fbbd8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 -- 172.21.15.19:0/1249699535 >> 172.21.15.19:0/1249699535 conn(0x7fbbd8066f50 msgr2=0x7fbbd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 -- 172.21.15.19:0/1249699535 shutdown_connections 2023-10-03T10:14:48.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.379+0000 7fbbded0c700 1 -- 172.21.15.19:0/1249699535 wait complete. 2023-10-03T10:14:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.380+0000 7fbbded0c700 1 Processor -- start 2023-10-03T10:14:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.380+0000 7fbbded0c700 1 -- start start 2023-10-03T10:14:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbd809d6f0 0x7fbbd811e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd811ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8121230 con 0x7fbbd809d6f0 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd811fcd0 con 0x7fbbd809e000 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.381+0000 7fbbded0c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd8121970 con 0x7fbbd809e410 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45288/0 (socket says 172.21.15.19:45288) 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 -- 172.21.15.19:0/2078311094 learned_addr learned my addr 172.21.15.19:0/2078311094 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbdd2a9700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd811ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbdcaa8700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbd809d6f0 0x7fbbd811e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 -- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 msgr2=0x7fbbd811ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd811ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 -- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbd809d6f0 msgr2=0x7fbbd811e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbd809d6f0 0x7fbbd811e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 -- 172.21.15.19:0/2078311094 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc009550 con 0x7fbbd809e000 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbdd2a9700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd811ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.382+0000 7fbbd7fff700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400b420 tx=0x7fbbc400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.383+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4019070 con 0x7fbbd809e000 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.383+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc401d410 con 0x7fbbd809e000 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.383+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd8121be0 con 0x7fbbd809e000 2023-10-03T10:14:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.383+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc4014af0 con 0x7fbbd809e000 2023-10-03T10:14:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.383+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd809c700 con 0x7fbbd809e000 2023-10-03T10:14:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.384+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd8074ea0 con 0x7fbbd809e000 2023-10-03T10:14:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.384+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbc401d780 con 0x7fbbd809e000 2023-10-03T10:14:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.385+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbbc4047c10 con 0x7fbbd809e000 2023-10-03T10:14:48.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.393+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbc402e8e0 con 0x7fbbd809e000 2023-10-03T10:14:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 Processor -- start 2023-10-03T10:14:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 -- start start 2023-10-03T10:14:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 0x7f76cc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc070940 con 0x7f76cc09f240 2023-10-03T10:14:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc06fd60 con 0x7f76cc09f650 2023-10-03T10:14:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.418+0000 7f76d1d50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc06fa80 con 0x7f76cc09e930 2023-10-03T10:14:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45292/0 (socket says 172.21.15.19:45292) 2023-10-03T10:14:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48920/0 (socket says 172.21.15.19:48920) 2023-10-03T10:14:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cbfff700 1 -- 172.21.15.19:0/3854716595 learned_addr learned my addr 172.21.15.19:0/3854716595 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 0x7f76cc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 -- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 msgr2=0x7f76cc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 -- 172.21.15.19:0/3854716595 >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 msgr2=0x7f76cc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 --2- 172.21.15.19:0/3854716595 >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 -- 172.21.15.19:0/3854716595 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc09fb60 con 0x7f76cc09e930 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cbfff700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76caffd700 1 --2- 172.21.15.19:0/3854716595 >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.419+0000 7f76cb7fe700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 0x7f76cc09ed00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009840 tx=0x7f76bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b6ac2078e7026 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76ca7fc700 1 -- 172.21.15.19:0/3854716595 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc011830 con 0x7f76cc09e930 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76ca7fc700 1 -- 172.21.15.19:0/3854716595 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc011990 con 0x7f76cc09e930 2023-10-03T10:14:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76ca7fc700 1 -- 172.21.15.19:0/3854716595 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc011d20 con 0x7f76cc09e930 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 -- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 msgr2=0x7f76cc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 0x7f76cc09ed00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009840 tx=0x7f76bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 -- 172.21.15.19:0/3854716595 shutdown_connections 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 --2- 172.21.15.19:0/3854716595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09e930 0x7f76cc09ed00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 --2- 172.21.15.19:0/3854716595 >> v2:172.21.15.19:3300/0 conn(0x7f76cc09f240 0x7f76cc1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 -- 172.21.15.19:0/3854716595 >> 172.21.15.19:0/3854716595 conn(0x7f76cc0a4210 msgr2=0x7f76cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 -- 172.21.15.19:0/3854716595 shutdown_connections 2023-10-03T10:14:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.420+0000 7f76d1d50700 1 -- 172.21.15.19:0/3854716595 wait complete. 2023-10-03T10:14:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.422+0000 7f76d1d50700 1 Processor -- start 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.422+0000 7f76d1d50700 1 -- start start 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76cc09e930 0x7f76cc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1a9790 con 0x7f76cc09e930 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1a9a70 con 0x7f76cc09f650 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76d1d50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0a3630 con 0x7f76cc09f240 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76caffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76caffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46518/0 (socket says 172.21.15.19:46518) 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76caffd700 1 -- 172.21.15.19:0/1435061419 learned_addr learned my addr 172.21.15.19:0/1435061419 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76cbfff700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.423+0000 7f76cb7fe700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76cc09e930 0x7f76cc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 -- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 msgr2=0x7f76cc06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 -- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76cc09e930 msgr2=0x7f76cc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76cc09e930 0x7f76cc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 -- 172.21.15.19:0/1435061419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c00094a0 con 0x7f76cc09f240 2023-10-03T10:14:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76caffd700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009e20 tx=0x7f76c000ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c0017c60 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c4009b30 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c0017dc0 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c000c840 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.424+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76bc0094a0 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.425+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76c000c9a0 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.425+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc0a3e20 con 0x7f76cc09f240 2023-10-03T10:14:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.426+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76c0047960 con 0x7f76cc09f240 2023-10-03T10:14:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.435+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76c001e990 con 0x7f76cc09f240 2023-10-03T10:14:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.534+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f832c074ea0 con 0x7f832c06a770 2023-10-03T10:14:48.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.535+0000 7f83137fe700 1 -- 172.21.15.19:0/1120830452 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f831c021030 con 0x7f832c06a770 2023-10-03T10:14:48.535 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 msgr2=0x7f832c09ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f831c00e940 tx=0x7f831c00ec50 comp rx=0 tx=0).stop 2023-10-03T10:14:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 shutdown_connections 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832c131b40 0x7f832c1c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832c06a770 0x7f832c09ac70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 --2- 172.21.15.19:0/1120830452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832c06b080 0x7f832c09b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 >> 172.21.15.19:0/1120830452 conn(0x7f832c066f50 msgr2=0x7f832c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 shutdown_connections 2023-10-03T10:14:48.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.538+0000 7f83315ea700 1 -- 172.21.15.19:0/1120830452 wait complete. 2023-10-03T10:14:48.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:48.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.587+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f702c06b250 con 0x7f702c134260 2023-10-03T10:14:48.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.587+0000 7f7022ffd700 1 -- 172.21.15.19:0/1052606504 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7024011b80 con 0x7f702c134260 2023-10-03T10:14:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.589+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 msgr2=0x7f702c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.589+0000 7f70342ad700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7024009d90 tx=0x7f7024004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 shutdown_connections 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f702c134260 0x7f702c09cf00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f702c133420 0x7f702c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 --2- 172.21.15.19:0/1052606504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f702c133e30 0x7f702c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 >> 172.21.15.19:0/1052606504 conn(0x7f702c0a4210 msgr2=0x7f702c1303f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 shutdown_connections 2023-10-03T10:14:48.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.590+0000 7f70342ad700 1 -- 172.21.15.19:0/1052606504 wait complete. 2023-10-03T10:14:48.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.615+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbbd806c360 con 0x7fbbd809e000 2023-10-03T10:14:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.615+0000 7fbbd57fa700 1 -- 172.21.15.19:0/2078311094 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbc4022020 con 0x7fbbd809e000 2023-10-03T10:14:48.615 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:48.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 msgr2=0x7fbbd811e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbbc400b420 tx=0x7fbbc400b730 comp rx=0 tx=0).stop 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 shutdown_connections 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbd809e410 0x7fbbd811ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbd809d6f0 0x7fbbd811e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 --2- 172.21.15.19:0/2078311094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbd809e000 0x7fbbd811e6f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.617+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 >> 172.21.15.19:0/2078311094 conn(0x7fbbd8066f50 msgr2=0x7fbbd80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.618+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 shutdown_connections 2023-10-03T10:14:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.618+0000 7fbbded0c700 1 -- 172.21.15.19:0/2078311094 wait complete. 2023-10-03T10:14:48.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.645+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f76cc074ea0 con 0x7f76cc09f240 2023-10-03T10:14:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.645+0000 7f76b3fff700 1 -- 172.21.15.19:0/1435061419 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76c0024030 con 0x7f76cc09f240 2023-10-03T10:14:48.645 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 msgr2=0x7f76cc06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009e20 tx=0x7f76c000ee90 comp rx=0 tx=0).stop 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 shutdown_connections 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76cc09f650 0x7f76cc06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76cc09e930 0x7f76cc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 --2- 172.21.15.19:0/1435061419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76cc09f240 0x7f76cc06bdf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 >> 172.21.15.19:0/1435061419 conn(0x7f76cc0a4210 msgr2=0x7f76cc1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:48.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 shutdown_connections 2023-10-03T10:14:48.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:48.648+0000 7f76d1d50700 1 -- 172.21.15.19:0/1435061419 wait complete. 2023-10-03T10:14:48.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:49.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:49.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:49.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:49.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:49.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.718+0000 7ff5a9fe2700 1 Processor -- start 2023-10-03T10:14:49.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.718+0000 7ff5a9fe2700 1 -- start start 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a9fe2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e1d0 0x7ff5a4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a9fe2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a9fe2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a409b120 con 0x7ff5a409d6f0 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a9fe2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a406b460 con 0x7ff5a4139170 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a9fe2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a409a7e0 con 0x7ff5a409e1d0 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45310/0 (socket says 172.21.15.19:45310) 2023-10-03T10:14:49.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.719+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1710769668 learned_addr learned my addr 172.21.15.19:0/1710769668 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e1d0 msgr2=0x7ff5a4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a3fff700 1 --2- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e1d0 0x7ff5a4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1710769668 >> v1:172.21.15.19:6789/0 conn(0x7ff5a409d6f0 legacy=0x7ff5a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1710769668 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a409a500 con 0x7ff5a4139170 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a3fff700 1 --2- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009e80 tx=0x7ff59c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb8d18c10a774c12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a27fc700 1 -- 172.21.15.19:0/1710769668 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00e070 con 0x7ff5a4139170 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a27fc700 1 -- 172.21.15.19:0/1710769668 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c00b9c0 con 0x7ff5a4139170 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.720+0000 7ff5a27fc700 1 -- 172.21.15.19:0/1710769668 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c00bd50 con 0x7ff5a4139170 2023-10-03T10:14:49.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 msgr2=0x7ff5a413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009e80 tx=0x7ff59c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1710769668 shutdown_connections 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a4139170 0x7ff5a413b550 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1710769668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e1d0 0x7ff5a4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.721+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1710769668 >> 172.21.15.19:0/1710769668 conn(0x7ff5a4066f50 msgr2=0x7ff5a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.722+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1710769668 shutdown_connections 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.722+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1710769668 wait complete. 2023-10-03T10:14:49.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.723+0000 7ff5a9fe2700 1 Processor -- start 2023-10-03T10:14:49.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.723+0000 7ff5a9fe2700 1 -- start start 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409d6f0 0x7ff5a411e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 0x7ff5a411ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40a2160 con 0x7ff5a4139170 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a409c710 con 0x7ff5a409e1d0 2023-10-03T10:14:49.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a9fe2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4121c20 con 0x7ff5a409d6f0 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 0x7ff5a411ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48936/0 (socket says 172.21.15.19:48936) 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 0x7ff5a411ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45318/0 (socket says 172.21.15.19:45318) 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1887576885 learned_addr learned my addr 172.21.15.19:0/1887576885 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.724+0000 7ff5a37fe700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409d6f0 0x7ff5a411e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409d6f0 msgr2=0x7ff5a411e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409d6f0 0x7ff5a411e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 msgr2=0x7ff5a411ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 0x7ff5a411ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 -- 172.21.15.19:0/1887576885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c009b30 con 0x7ff5a4139170 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.725+0000 7ff5a3fff700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff59c003f50 tx=0x7ff59c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.726+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c004450 con 0x7ff5a4139170 2023-10-03T10:14:49.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.726+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0045b0 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.726+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a41203c0 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.726+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a4122950 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.726+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c004960 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.727+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff59c025460 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.727+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff59c0419f0 con 0x7ff5a4139170 2023-10-03T10:14:49.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.728+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5840052e0 con 0x7ff5a4139170 2023-10-03T10:14:49.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.737+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff59c01c410 con 0x7ff5a4139170 2023-10-03T10:14:49.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.755+0000 7ff62b6d6700 1 Processor -- start 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.755+0000 7ff62b6d6700 1 -- start start 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff62b6d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff62b6d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff62b6d6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff624070ee0 con 0x7ff62406e570 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff62b6d6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff624071980 con 0x7ff62409eca0 2023-10-03T10:14:49.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff62b6d6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff624071480 con 0x7ff62406f050 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff628c71700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff628c71700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45324/0 (socket says 172.21.15.19:45324) 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff628c71700 1 -- 172.21.15.19:0/3039958011 learned_addr learned my addr 172.21.15.19:0/3039958011 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff629c73700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff628c71700 1 -- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 msgr2=0x7ff62413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.756+0000 7ff628c71700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff628c71700 1 -- 172.21.15.19:0/3039958011 >> v1:172.21.15.19:6789/0 conn(0x7ff62406e570 legacy=0x7ff62406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff628c71700 1 -- 172.21.15.19:0/3039958011 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624071b90 con 0x7ff62409eca0 2023-10-03T10:14:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff628c71700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff614009920 tx=0x7ff614009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8b574967f2025c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff61bfff700 1 -- 172.21.15.19:0/3039958011 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011830 con 0x7ff62409eca0 2023-10-03T10:14:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff61bfff700 1 -- 172.21.15.19:0/3039958011 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614011990 con 0x7ff62409eca0 2023-10-03T10:14:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.757+0000 7ff61bfff700 1 -- 172.21.15.19:0/3039958011 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614011d20 con 0x7ff62409eca0 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 -- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 msgr2=0x7ff62413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff614009920 tx=0x7ff614009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 -- 172.21.15.19:0/3039958011 shutdown_connections 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/3039958011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62409eca0 0x7ff62413cea0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 -- 172.21.15.19:0/3039958011 >> 172.21.15.19:0/3039958011 conn(0x7ff6240a2aa0 msgr2=0x7ff6240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 -- 172.21.15.19:0/3039958011 shutdown_connections 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.758+0000 7ff62b6d6700 1 -- 172.21.15.19:0/3039958011 wait complete. 2023-10-03T10:14:49.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 Processor -- start 2023-10-03T10:14:49.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 -- start start 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 0x7ff62413c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62413cb30 0x7ff624129de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff624070680 con 0x7ff62406e570 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62413d510 con 0x7ff62413cb30 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.759+0000 7ff62b6d6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff62413dd80 con 0x7ff62406f050 2023-10-03T10:14:49.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46574/0 (socket says 172.21.15.19:46574) 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 -- 172.21.15.19:0/57869386 learned_addr learned my addr 172.21.15.19:0/57869386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff629c73700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62413cb30 0x7ff624129de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 -- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62413cb30 msgr2=0x7ff624129de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62413cb30 0x7ff624129de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 -- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 msgr2=0x7ff62413c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff629472700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 0x7ff62413c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 0x7ff62413c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 -- 172.21.15.19:0/57869386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614009550 con 0x7ff62406f050 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff629472700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 0x7ff62413c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.760+0000 7ff628c71700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff614013000 tx=0x7ff614004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.761+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004510 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.761+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61401f070 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.761+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62412c920 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.761+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140038e0 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.761+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62412d910 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.762+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff614003a40 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.762+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6240a24f0 con 0x7ff62406f050 2023-10-03T10:14:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.762+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff614021070 con 0x7ff62406f050 2023-10-03T10:14:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.768+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff614003cf0 con 0x7ff62406f050 2023-10-03T10:14:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.800+0000 7f0bd7c37700 1 Processor -- start 2023-10-03T10:14:49.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.800+0000 7f0bd7c37700 1 -- start start 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd7c37700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd7c37700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0bd009f650 0x7f0bd0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd7c37700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd0070940 con 0x7f0bd009f240 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd7c37700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd006fd60 con 0x7f0bd009f650 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd7c37700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd006fa80 con 0x7f0bd009e930 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd59d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd59d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46588/0 (socket says 172.21.15.19:46588) 2023-10-03T10:14:49.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd59d3700 1 -- 172.21.15.19:0/279143678 learned_addr learned my addr 172.21.15.19:0/279143678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.801+0000 7f0bd61d4700 1 --2- 172.21.15.19:0/279143678 >> v2:172.21.15.19:3300/0 conn(0x7f0bd009f650 0x7f0bd0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd59d3700 1 -- 172.21.15.19:0/279143678 >> v2:172.21.15.19:3300/0 conn(0x7f0bd009f650 msgr2=0x7f0bd0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd59d3700 1 --2- 172.21.15.19:0/279143678 >> v2:172.21.15.19:3300/0 conn(0x7f0bd009f650 0x7f0bd0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd59d3700 1 -- 172.21.15.19:0/279143678 >> v1:172.21.15.19:6789/0 conn(0x7f0bd009f240 legacy=0x7f0bd01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd59d3700 1 -- 172.21.15.19:0/279143678 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd009fb60 con 0x7f0bd009e930 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd59d3700 1 --2- 172.21.15.19:0/279143678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098f0 tx=0x7f0bcc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcc12bc9294237ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd49d1700 1 -- 172.21.15.19:0/279143678 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011830 con 0x7f0bd009e930 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd49d1700 1 -- 172.21.15.19:0/279143678 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc011990 con 0x7f0bd009e930 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.802+0000 7f0bd49d1700 1 -- 172.21.15.19:0/279143678 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011d20 con 0x7f0bd009e930 2023-10-03T10:14:49.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 -- 172.21.15.19:0/279143678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 msgr2=0x7f0bd009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/279143678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0098f0 tx=0x7f0bcc009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 -- 172.21.15.19:0/279143678 shutdown_connections 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/279143678 >> v2:172.21.15.19:3300/0 conn(0x7f0bd009f650 0x7f0bd0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/279143678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009e930 0x7f0bd009ed00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 -- 172.21.15.19:0/279143678 >> 172.21.15.19:0/279143678 conn(0x7f0bd00a4210 msgr2=0x7f0bd00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 -- 172.21.15.19:0/279143678 shutdown_connections 2023-10-03T10:14:49.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.803+0000 7f0bd7c37700 1 -- 172.21.15.19:0/279143678 wait complete. 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.804+0000 7f0bd7c37700 1 Processor -- start 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.804+0000 7f0bd7c37700 1 -- start start 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009f240 0x7f0bd0131ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd009f650 0x7f0bd0131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01285e0 con 0x7f0bd009f650 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0071d20 con 0x7f0bd009e930 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd7c37700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd00a33c0 con 0x7f0bd009f240 2023-10-03T10:14:49.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45352/0 (socket says 172.21.15.19:45352) 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 -- 172.21.15.19:0/2369957894 learned_addr learned my addr 172.21.15.19:0/2369957894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 -- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009f240 msgr2=0x7f0bd0131ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009f240 0x7f0bd0131ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 -- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd009f650 msgr2=0x7f0bd0131ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd009f650 0x7f0bd0131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 -- 172.21.15.19:0/2369957894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009550 con 0x7f0bd009e930 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.805+0000 7f0bd59d3700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bd006fbc0 tx=0x7f0bcc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.806+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0036a0 con 0x7f0bd009e930 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.806+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd00a0190 con 0x7f0bd009e930 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.806+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc003800 con 0x7f0bd009e930 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.806+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc003bb0 con 0x7f0bd009e930 2023-10-03T10:14:49.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.806+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd0130120 con 0x7f0bd009e930 2023-10-03T10:14:49.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.807+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd0074ea0 con 0x7f0bd009e930 2023-10-03T10:14:49.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.807+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bcc003d10 con 0x7f0bd009e930 2023-10-03T10:14:49.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.808+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0bcc021030 con 0x7f0bd009e930 2023-10-03T10:14:49.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.817+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bcc00b3e0 con 0x7f0bd009e930 2023-10-03T10:14:49.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.866+0000 7f352c67b700 1 Processor -- start 2023-10-03T10:14:49.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.866+0000 7f352c67b700 1 -- start start 2023-10-03T10:14:49.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352c67b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f352406a770 0x7f352406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352c67b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352c67b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352409ece0 con 0x7f3524131b40 2023-10-03T10:14:49.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352c67b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352409e760 con 0x7f352406a770 2023-10-03T10:14:49.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352c67b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f352409e040 con 0x7f352406b080 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46596/0 (socket says 172.21.15.19:46596) 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 -- 172.21.15.19:0/2131558506 learned_addr learned my addr 172.21.15.19:0/2131558506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f352a417700 1 --2- 172.21.15.19:0/2131558506 >> v2:172.21.15.19:3300/0 conn(0x7f352406a770 0x7f352406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 -- 172.21.15.19:0/2131558506 >> v2:172.21.15.19:3300/0 conn(0x7f352406a770 msgr2=0x7f352406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 --2- 172.21.15.19:0/2131558506 >> v2:172.21.15.19:3300/0 conn(0x7f352406a770 0x7f352406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 -- 172.21.15.19:0/2131558506 >> v1:172.21.15.19:6789/0 conn(0x7f3524131b40 legacy=0x7f3524138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.867+0000 7f3529c16700 1 -- 172.21.15.19:0/2131558506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352409f630 con 0x7f352406b080 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.868+0000 7f3529c16700 1 --2- 172.21.15.19:0/2131558506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35140098f0 tx=0x7f3514009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b06d3dece69569 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.868+0000 7f3529415700 1 -- 172.21.15.19:0/2131558506 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514011830 con 0x7f352406b080 2023-10-03T10:14:49.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.868+0000 7f3529415700 1 -- 172.21.15.19:0/2131558506 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3514011990 con 0x7f352406b080 2023-10-03T10:14:49.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.868+0000 7f3529415700 1 -- 172.21.15.19:0/2131558506 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514011d20 con 0x7f352406b080 2023-10-03T10:14:49.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 -- 172.21.15.19:0/2131558506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 msgr2=0x7f3524131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 --2- 172.21.15.19:0/2131558506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35140098f0 tx=0x7f3514009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:49.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 -- 172.21.15.19:0/2131558506 shutdown_connections 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 --2- 172.21.15.19:0/2131558506 >> v2:172.21.15.19:3300/0 conn(0x7f352406a770 0x7f352406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 --2- 172.21.15.19:0/2131558506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f3524131600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 -- 172.21.15.19:0/2131558506 >> 172.21.15.19:0/2131558506 conn(0x7f3524066f50 msgr2=0x7f352409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 -- 172.21.15.19:0/2131558506 shutdown_connections 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.869+0000 7f352c67b700 1 -- 172.21.15.19:0/2131558506 wait complete. 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 Processor -- start 2023-10-03T10:14:49.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 -- start start 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f35241c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3524131b40 0x7f35241c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.871+0000 7f352c67b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352409bf80 con 0x7f3524131b40 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352c67b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3524122400 con 0x7f352406a770 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352c67b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3524071e60 con 0x7f352406b080 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45358/0 (socket says 172.21.15.19:45358) 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 -- 172.21.15.19:0/413354156 learned_addr learned my addr 172.21.15.19:0/413354156 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f3529c16700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f35241c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352ac18700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3524131b40 0x7f35241c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 -- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 msgr2=0x7f35241c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f35241c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 -- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3524131b40 msgr2=0x7f35241c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3524131b40 0x7f35241c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 -- 172.21.15.19:0/413354156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3514009550 con 0x7f352406a770 2023-10-03T10:14:49.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f352a417700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f352000e9b0 tx=0x7f352000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.872+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000c850 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.873+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352000c9b0 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.873+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3524121d60 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.873+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352000cd20 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.873+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3524122a90 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.874+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3520013470 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.874+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3524074ea0 con 0x7f352406a770 2023-10-03T10:14:49.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.874+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f352003f800 con 0x7f352406a770 2023-10-03T10:14:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.883+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3520017070 con 0x7f352406a770 2023-10-03T10:14:49.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.958+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff584005590 con 0x7ff5a4139170 2023-10-03T10:14:49.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.959+0000 7ff58bfff700 1 -- 172.21.15.19:0/1887576885 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff59c01a3c0 con 0x7ff5a4139170 2023-10-03T10:14:49.959 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 msgr2=0x7ff5a411f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff59c003f50 tx=0x7ff59c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 shutdown_connections 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a4139170 0x7ff5a411f120 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409d6f0 0x7ff5a411e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 --2- 172.21.15.19:0/1887576885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a409e1d0 0x7ff5a411ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 >> 172.21.15.19:0/1887576885 conn(0x7ff5a4066f50 msgr2=0x7ff5a4136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 shutdown_connections 2023-10-03T10:14:49.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:49.961+0000 7ff5a9fe2700 1 -- 172.21.15.19:0/1887576885 wait complete. 2023-10-03T10:14:49.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:50.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.025+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0bd0130350 con 0x7f0bd009e930 2023-10-03T10:14:50.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.025+0000 7f0bc67fc700 1 -- 172.21.15.19:0/2369957894 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bcc02b020 con 0x7f0bd009e930 2023-10-03T10:14:50.025 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.027+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 msgr2=0x7f0bd0131570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.027+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bd006fbc0 tx=0x7f0bcc004750 comp rx=0 tx=0).stop 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 shutdown_connections 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd009f650 0x7f0bd0131ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd009e930 0x7f0bd0131570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 --2- 172.21.15.19:0/2369957894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd009f240 0x7f0bd0131ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 >> 172.21.15.19:0/2369957894 conn(0x7f0bd00a4210 msgr2=0x7f0bd006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 shutdown_connections 2023-10-03T10:14:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.028+0000 7f0bd7c37700 1 -- 172.21.15.19:0/2369957894 wait complete. 2023-10-03T10:14:50.041 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:50.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.053+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff624074ea0 con 0x7ff62406f050 2023-10-03T10:14:50.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.053+0000 7ff619ffb700 1 -- 172.21.15.19:0/57869386 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff614015070 con 0x7ff62406f050 2023-10-03T10:14:50.053 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:50.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.055+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 msgr2=0x7ff62413c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.055+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff614013000 tx=0x7ff614004750 comp rx=0 tx=0).stop 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 shutdown_connections 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff62413cb30 0x7ff624129de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff62406e570 0x7ff62413c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 --2- 172.21.15.19:0/57869386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff62406f050 0x7ff62413c5f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 >> 172.21.15.19:0/57869386 conn(0x7ff6240a2aa0 msgr2=0x7ff62412aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 shutdown_connections 2023-10-03T10:14:50.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.056+0000 7ff62b6d6700 1 -- 172.21.15.19:0/57869386 wait complete. 2023-10-03T10:14:50.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:50.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.120+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f352406c360 con 0x7f352406a770 2023-10-03T10:14:50.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.121+0000 7f351affd700 1 -- 172.21.15.19:0/413354156 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35200232f0 con 0x7f352406a770 2023-10-03T10:14:50.121 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 msgr2=0x7f35241c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f352000e9b0 tx=0x7f352000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 shutdown_connections 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3524131b40 0x7f35241c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f352406a770 0x7f35241c81c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 --2- 172.21.15.19:0/413354156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f352406b080 0x7f35241c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:50.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 >> 172.21.15.19:0/413354156 conn(0x7f3524066f50 msgr2=0x7f35240a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 shutdown_connections 2023-10-03T10:14:50.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:50.123+0000 7f352c67b700 1 -- 172.21.15.19:0/413354156 wait complete. 2023-10-03T10:14:50.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:50.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:51.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:51.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.125+0000 7f978894c700 1 Processor -- start 2023-10-03T10:14:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 -- start start 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 0x7f9784133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978406ef30 con 0x7f978409de50 2023-10-03T10:14:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978406fef0 con 0x7f978409e930 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.126+0000 7f978894c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97841334b0 con 0x7f97841338a0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9781d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f978409de50 0x7f978409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45026/0 (socket says 172.21.15.19:45026) 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9781d9b700 1 -- 172.21.15.19:0/2848067065 learned_addr learned my addr 172.21.15.19:0/2848067065 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:51.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f978259c700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 0x7f9784133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f978159a700 1 -- 172.21.15.19:0/2848067065 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440944379 0 0) 0x7f978406ef30 con 0x7f978409de50 2023-10-03T10:14:51.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 -- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 msgr2=0x7f9784133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 0x7f9784133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 -- 172.21.15.19:0/2848067065 >> v1:172.21.15.19:6789/0 conn(0x7f978409de50 legacy=0x7f978409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 -- 172.21.15.19:0/2848067065 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978406fc30 con 0x7f978409e930 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f978259c700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 0x7f9784133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f9782d9d700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978413b740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f977c009dc0 tx=0x7f977c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9d41bbdc1850aba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f978159a700 1 -- 172.21.15.19:0/2848067065 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00e070 con 0x7f978409e930 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.127+0000 7f978159a700 1 -- 172.21.15.19:0/2848067065 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00bb20 con 0x7f978409e930 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978159a700 1 -- 172.21.15.19:0/2848067065 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c012430 con 0x7f978409e930 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 -- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 msgr2=0x7f978413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978413b740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f977c009dc0 tx=0x7f977c00b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 -- 172.21.15.19:0/2848067065 shutdown_connections 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978413b740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 --2- 172.21.15.19:0/2848067065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97841338a0 0x7f9784133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 -- 172.21.15.19:0/2848067065 >> 172.21.15.19:0/2848067065 conn(0x7f97840a2aa0 msgr2=0x7f97840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 -- 172.21.15.19:0/2848067065 shutdown_connections 2023-10-03T10:14:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.128+0000 7f978894c700 1 -- 172.21.15.19:0/2848067065 wait complete. 2023-10-03T10:14:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 Processor -- start 2023-10-03T10:14:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 -- start start 2023-10-03T10:14:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978411ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97841338a0 0x7f978411bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978411fa10 con 0x7f97841338a0 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978411f050 con 0x7f978409e930 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978894c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f978411e390 con 0x7f978409de50 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f9781d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978411ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46620/0 (socket says 172.21.15.19:46620) 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f978259c700 1 -- 172.21.15.19:0/461974794 learned_addr learned my addr 172.21.15.19:0/461974794 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.130+0000 7f9782d9d700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97841338a0 0x7f978411bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 -- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 msgr2=0x7f978411ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978411ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 -- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97841338a0 msgr2=0x7f978411bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97841338a0 0x7f978411bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 -- 172.21.15.19:0/461974794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740094a0 con 0x7f978409de50 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978259c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f977400ec10 tx=0x7f977400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400c850 con 0x7f978409de50 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977400c9b0 con 0x7f978409de50 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977c009a70 con 0x7f978409de50 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977400cd20 con 0x7f978409de50 2023-10-03T10:14:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.131+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978411d140 con 0x7f978409de50 2023-10-03T10:14:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.132+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9774013470 con 0x7f978409de50 2023-10-03T10:14:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.132+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f977403fb30 con 0x7f978409de50 2023-10-03T10:14:51.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.132+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97841babb0 con 0x7f978409de50 2023-10-03T10:14:51.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.137+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9774021080 con 0x7f978409de50 2023-10-03T10:14:51.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.189+0000 7fb9289b5700 1 Processor -- start 2023-10-03T10:14:51.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 -- start start 2023-10-03T10:14:51.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb92409de50 0x7fb92409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 0x7fb92413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92406fef0 con 0x7fb92409de50 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92406ef30 con 0x7fb9241338a0 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.190+0000 7fb9289b5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9241334b0 con 0x7fb92409e760 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb922d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 0x7fb92413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb92259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb92409de50 0x7fb92409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb922d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 0x7fb92413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46628/0 (socket says 172.21.15.19:46628) 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb92259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45380/0 (socket says 172.21.15.19:45380) 2023-10-03T10:14:51.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb922d9d700 1 -- 172.21.15.19:0/1023489848 learned_addr learned my addr 172.21.15.19:0/1023489848 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 -- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 msgr2=0x7fb92413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 0x7fb92413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 -- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 msgr2=0x7fb924133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 -- 172.21.15.19:0/1023489848 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92406fc30 con 0x7fb92409de50 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb92259c700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb921d9b700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92409de50 0x7fb92409e220 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb918009840 tx=0x7fb918009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a2f4f7ce76c518 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.191+0000 7fb92159a700 1 -- 172.21.15.19:0/1023489848 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918011830 con 0x7fb92409de50 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.192+0000 7fb92159a700 1 -- 172.21.15.19:0/1023489848 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb918011990 con 0x7fb92409de50 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.192+0000 7fb92159a700 1 -- 172.21.15.19:0/1023489848 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb918011d20 con 0x7fb92409de50 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 -- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92409de50 msgr2=0x7fb92409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92409de50 0x7fb92409e220 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb918009840 tx=0x7fb918009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 -- 172.21.15.19:0/1023489848 shutdown_connections 2023-10-03T10:14:51.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9241338a0 0x7fb924133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409e760 0x7fb92413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 --2- 172.21.15.19:0/1023489848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb92409de50 0x7fb92409e220 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 -- 172.21.15.19:0/1023489848 >> 172.21.15.19:0/1023489848 conn(0x7fb9240a2aa0 msgr2=0x7fb9240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 -- 172.21.15.19:0/1023489848 shutdown_connections 2023-10-03T10:14:51.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.193+0000 7fb9289b5700 1 -- 172.21.15.19:0/1023489848 wait complete. 2023-10-03T10:14:51.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.195+0000 7fb9289b5700 1 Processor -- start 2023-10-03T10:14:51.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.195+0000 7fb9289b5700 1 -- start start 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.195+0000 7fb9289b5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.195+0000 7fb9289b5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb92409e760 0x7fb92411db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb9289b5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 0x7fb92411e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb9289b5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924120900 con 0x7fb9241338a0 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb9289b5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92406f640 con 0x7fb92409e760 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb9289b5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240a0ff0 con 0x7fb92409de50 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb92259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 0x7fb92411e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb92259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46638/0 (socket says 172.21.15.19:46638) 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb92259c700 1 -- 172.21.15.19:0/3400237512 learned_addr learned my addr 172.21.15.19:0/3400237512 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb921d9b700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb92409e760 0x7fb92411db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 -- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 msgr2=0x7fb92411d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 -- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb92409e760 msgr2=0x7fb92411db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb92409e760 0x7fb92411db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb922d9d700 1 -- 172.21.15.19:0/3400237512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140094a0 con 0x7fb9241338a0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.196+0000 7fb92259c700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb922d9d700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 0x7fb92411e0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00efc0 tx=0x7fb91c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003c20 con 0x7fb9241338a0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c00f040 con 0x7fb9241338a0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9180094a0 con 0x7fb9241338a0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9241204b0 con 0x7fb9241338a0 2023-10-03T10:14:51.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.197+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009e60 con 0x7fb9241338a0 2023-10-03T10:14:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.198+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9080052e0 con 0x7fb9241338a0 2023-10-03T10:14:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.198+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb91c00c880 con 0x7fb9241338a0 2023-10-03T10:14:51.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.199+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb91c03f940 con 0x7fb9241338a0 2023-10-03T10:14:51.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.208+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb91c013b80 con 0x7fb9241338a0 2023-10-03T10:14:51.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.243+0000 7f665a0d0700 1 Processor -- start 2023-10-03T10:14:51.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.243+0000 7f665a0d0700 1 -- start start 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f665a0d0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 0x7f6654138b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f665a0d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 0x7f665413b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f665a0d0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665406d860 con 0x7f66540a0a30 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f665a0d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665409eaf0 con 0x7f6654139070 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f665a0d0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66540a27c0 con 0x7f66540a1510 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f6653fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 0x7f665413b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f66537fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f66540a0a30 0x7f66540a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45028/0 (socket says 172.21.15.19:45028) 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f66537fe700 1 -- 172.21.15.19:0/474073674 learned_addr learned my addr 172.21.15.19:0/474073674 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:51.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f6652ffd700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 0x7f6654138b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f66527fc700 1 -- 172.21.15.19:0/474073674 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632796051 0 0) 0x7f665406d860 con 0x7f66540a0a30 2023-10-03T10:14:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.244+0000 7f66527fc700 1 -- 172.21.15.19:0/474073674 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c0035b0 con 0x7f66540a0a30 2023-10-03T10:14:51.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6652ffd700 1 -- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 msgr2=0x7f665413b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6652ffd700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 0x7f665413b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6652ffd700 1 -- 172.21.15.19:0/474073674 >> v1:172.21.15.19:6789/0 conn(0x7f66540a0a30 legacy=0x7f66540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6652ffd700 1 -- 172.21.15.19:0/474073674 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665409dbe0 con 0x7f66540a1510 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6653fff700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 0x7f665413b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f6652ffd700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 0x7f6654138b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6648009870 tx=0x7f6648009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11582a62a12cfb6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f66527fc700 1 -- 172.21.15.19:0/474073674 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648011830 con 0x7f66540a1510 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f66527fc700 1 -- 172.21.15.19:0/474073674 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648011990 con 0x7f66540a1510 2023-10-03T10:14:51.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.245+0000 7f66527fc700 1 -- 172.21.15.19:0/474073674 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648011d00 con 0x7f66540a1510 2023-10-03T10:14:51.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 -- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 msgr2=0x7f6654138b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 0x7f6654138b30 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6648009870 tx=0x7f6648009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 -- 172.21.15.19:0/474073674 shutdown_connections 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6654139070 0x7f665413b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 --2- 172.21.15.19:0/474073674 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66540a1510 0x7f6654138b30 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 -- 172.21.15.19:0/474073674 >> 172.21.15.19:0/474073674 conn(0x7f66540a6550 msgr2=0x7f66540a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 -- 172.21.15.19:0/474073674 shutdown_connections 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.246+0000 7f665a0d0700 1 -- 172.21.15.19:0/474073674 wait complete. 2023-10-03T10:14:51.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.248+0000 7f665a0d0700 1 Processor -- start 2023-10-03T10:14:51.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.248+0000 7f665a0d0700 1 -- start start 2023-10-03T10:14:51.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 0x7f665411ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6654139070 0x7f665411f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66540a02e0 con 0x7f66540a1510 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66540a4c40 con 0x7f66540a0a30 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f665a0d0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6654120290 con 0x7f6654139070 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45402/0 (socket says 172.21.15.19:45402) 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 -- 172.21.15.19:0/878163049 learned_addr learned my addr 172.21.15.19:0/878163049 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f6652ffd700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 0x7f665411ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f6653fff700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6654139070 0x7f665411f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 -- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6654139070 msgr2=0x7f665411f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6654139070 0x7f665411f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 -- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 msgr2=0x7f665411ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 0x7f665411ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.249+0000 7f66537fe700 1 -- 172.21.15.19:0/878163049 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c009a70 con 0x7f66540a0a30 2023-10-03T10:14:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f6652ffd700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 0x7f665411ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:51.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f66537fe700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f664400c700 tx=0x7f664400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644005d70 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66440070d0 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66480094a0 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6644007460 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.250+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6654120a80 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.251+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6654122020 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.252+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66440075c0 con 0x7f66540a0a30 2023-10-03T10:14:51.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.252+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f664403ebf0 con 0x7f66540a0a30 2023-10-03T10:14:51.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.257+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f664400e280 con 0x7f66540a0a30 2023-10-03T10:14:51.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.295+0000 7ff07cf01700 1 Processor -- start 2023-10-03T10:14:51.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.295+0000 7ff07cf01700 1 -- start start 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07cf01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff07809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07cf01700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 0x7ff078131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07cf01700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff078070940 con 0x7ff07809f240 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07cf01700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07806fd60 con 0x7ff07809e930 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07cf01700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff07806fa80 con 0x7ff07809f650 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff07809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff07809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45412/0 (socket says 172.21.15.19:45412) 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff07659c700 1 -- 172.21.15.19:0/2906202211 learned_addr learned my addr 172.21.15.19:0/2906202211 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff075d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff07809f240 0x7ff0781317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45044/0 (socket says 172.21.15.19:45044) 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.296+0000 7ff076d9d700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 0x7ff078131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff076d9d700 1 -- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 msgr2=0x7ff07809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff076d9d700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff07809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff076d9d700 1 -- 172.21.15.19:0/2906202211 >> v1:172.21.15.19:6789/0 conn(0x7ff07809f240 legacy=0x7ff0781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff076d9d700 1 -- 172.21.15.19:0/2906202211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07809fb60 con 0x7ff07809f650 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff076d9d700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 0x7ff078131f00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff070009dc0 tx=0x7ff07000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4deafcf5c591943 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff07559a700 1 -- 172.21.15.19:0/2906202211 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000e070 con 0x7ff07809f650 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff07559a700 1 -- 172.21.15.19:0/2906202211 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070003a20 con 0x7ff07809f650 2023-10-03T10:14:51.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.297+0000 7ff07559a700 1 -- 172.21.15.19:0/2906202211 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070003dd0 con 0x7ff07809f650 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 -- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 msgr2=0x7ff078131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 0x7ff078131f00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff070009dc0 tx=0x7ff07000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 -- 172.21.15.19:0/2906202211 shutdown_connections 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f650 0x7ff078131f00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 --2- 172.21.15.19:0/2906202211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff07809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 -- 172.21.15.19:0/2906202211 >> 172.21.15.19:0/2906202211 conn(0x7ff0780a4210 msgr2=0x7ff0780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 -- 172.21.15.19:0/2906202211 shutdown_connections 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.298+0000 7ff07cf01700 1 -- 172.21.15.19:0/2906202211 wait complete. 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.300+0000 7ff07cf01700 1 Processor -- start 2023-10-03T10:14:51.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.300+0000 7ff07cf01700 1 -- start start 2023-10-03T10:14:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff0781a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff07809f650 0x7ff0781a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0781a7080 con 0x7ff07809f650 2023-10-03T10:14:51.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff078071d20 con 0x7ff07809e930 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07cf01700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780a35a0 con 0x7ff07809f240 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff075d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff075d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46682/0 (socket says 172.21.15.19:46682) 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff07659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff0781a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.301+0000 7ff075d9b700 1 -- 172.21.15.19:0/3687950307 learned_addr learned my addr 172.21.15.19:0/3687950307 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 -- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 msgr2=0x7ff0781a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff0781a3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 -- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff07809f650 msgr2=0x7ff0781a48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff07809f650 0x7ff0781a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 -- 172.21.15.19:0/3687950307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009a70 con 0x7ff07809f240 2023-10-03T10:14:51.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff075d9b700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c750 tx=0x7ff06c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c004c80 con 0x7ff07809f240 2023-10-03T10:14:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c004de0 con 0x7ff07809f240 2023-10-03T10:14:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c007310 con 0x7ff07809f240 2023-10-03T10:14:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780a0190 con 0x7ff07809f240 2023-10-03T10:14:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.302+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0781a6c30 con 0x7ff07809f240 2023-10-03T10:14:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.303+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff06c007470 con 0x7ff07809f240 2023-10-03T10:14:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.304+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff06c010db0 con 0x7ff07809f240 2023-10-03T10:14:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.304+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0781a72b0 con 0x7ff07809f240 2023-10-03T10:14:51.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.313+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0781a72b0 con 0x7ff07809f240 2023-10-03T10:14:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.379+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f978411ebf0 con 0x7f978409de50 2023-10-03T10:14:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.379+0000 7f9772ffd700 1 -- 172.21.15.19:0/461974794 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9774013720 con 0x7f978409de50 2023-10-03T10:14:51.379 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 msgr2=0x7f978411b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f977400ec10 tx=0x7f977400ef20 comp rx=0 tx=0).stop 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 shutdown_connections 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97841338a0 0x7f978411bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f978409de50 0x7f978411b530 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.381+0000 7f978894c700 1 --2- 172.21.15.19:0/461974794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f978409e930 0x7f978411ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.382+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 >> 172.21.15.19:0/461974794 conn(0x7f97840a2aa0 msgr2=0x7f9784130510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.382+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 shutdown_connections 2023-10-03T10:14:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.382+0000 7f978894c700 1 -- 172.21.15.19:0/461974794 wait complete. 2023-10-03T10:14:51.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:51.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.428+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb908005590 con 0x7fb9241338a0 2023-10-03T10:14:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.428+0000 7fb912ffd700 1 -- 172.21.15.19:0/3400237512 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb91c014e00 con 0x7fb9241338a0 2023-10-03T10:14:51.428 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:51.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 msgr2=0x7fb92411e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 0x7fb92411e0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00efc0 tx=0x7fb91c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 shutdown_connections 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9241338a0 0x7fb92411e0d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb92409de50 0x7fb92411d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.430+0000 7fb9289b5700 1 --2- 172.21.15.19:0/3400237512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb92409e760 0x7fb92411db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.431+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 >> 172.21.15.19:0/3400237512 conn(0x7fb9240a2aa0 msgr2=0x7fb9241bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.431+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 shutdown_connections 2023-10-03T10:14:51.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.431+0000 7fb9289b5700 1 -- 172.21.15.19:0/3400237512 wait complete. 2023-10-03T10:14:51.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.483+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f665404f2a0 con 0x7f66540a0a30 2023-10-03T10:14:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.483+0000 7f663bfff700 1 -- 172.21.15.19:0/878163049 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6644017070 con 0x7f66540a0a30 2023-10-03T10:14:51.483 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 msgr2=0x7f665411e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f664400c700 tx=0x7f664400ca10 comp rx=0 tx=0).stop 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 shutdown_connections 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6654139070 0x7f665411f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66540a0a30 0x7f665411e680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 --2- 172.21.15.19:0/878163049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66540a1510 0x7f665411ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 >> 172.21.15.19:0/878163049 conn(0x7f66540a6550 msgr2=0x7f66540a2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 shutdown_connections 2023-10-03T10:14:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.486+0000 7f665a0d0700 1 -- 172.21.15.19:0/878163049 wait complete. 2023-10-03T10:14:51.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:51.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.530+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff0781a72b0 con 0x7ff07809f240 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.530+0000 7ff066ffd700 1 -- 172.21.15.19:0/3687950307 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0781a72b0 con 0x7ff07809f240 2023-10-03T10:14:51.530 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:51.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 msgr2=0x7ff0781a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c750 tx=0x7ff06c00ca60 comp rx=0 tx=0).stop 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 shutdown_connections 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff07809f650 0x7ff0781a48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff07809e930 0x7ff0781a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 --2- 172.21.15.19:0/3687950307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff07809f240 0x7ff0781a4360 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 >> 172.21.15.19:0/3687950307 conn(0x7ff0780a4210 msgr2=0x7ff0781b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.532+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 shutdown_connections 2023-10-03T10:14:51.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:51.533+0000 7ff07cf01700 1 -- 172.21.15.19:0/3687950307 wait complete. 2023-10-03T10:14:51.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:52.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:52.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:52.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.546+0000 7fea860b6700 1 Processor -- start 2023-10-03T10:14:52.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.546+0000 7fea860b6700 1 -- start start 2023-10-03T10:14:52.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea860b6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fea801337f0 0x7fea80138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea860b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea860b6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8006b990 con 0x7fea80133420 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea860b6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8009b0e0 con 0x7fea801337f0 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea860b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea80133c20 con 0x7fea80138dc0 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45426/0 (socket says 172.21.15.19:45426) 2023-10-03T10:14:52.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.547+0000 7fea7ffff700 1 -- 172.21.15.19:0/91607440 learned_addr learned my addr 172.21.15.19:0/91607440 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7ffff700 1 -- 172.21.15.19:0/91607440 >> v2:172.21.15.19:3300/0 conn(0x7fea801337f0 msgr2=0x7fea80138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7ffff700 1 --2- 172.21.15.19:0/91607440 >> v2:172.21.15.19:3300/0 conn(0x7fea801337f0 0x7fea80138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7ffff700 1 -- 172.21.15.19:0/91607440 >> v1:172.21.15.19:6789/0 conn(0x7fea80133420 legacy=0x7fea80133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7ffff700 1 -- 172.21.15.19:0/91607440 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea800a0590 con 0x7fea80138dc0 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7ffff700 1 --2- 172.21.15.19:0/91607440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea78009e50 tx=0x7fea7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5d0819d809c7bd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7effd700 1 -- 172.21.15.19:0/91607440 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7800e070 con 0x7fea80138dc0 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7effd700 1 -- 172.21.15.19:0/91607440 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea78003a20 con 0x7fea80138dc0 2023-10-03T10:14:52.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.548+0000 7fea7effd700 1 -- 172.21.15.19:0/91607440 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea78003dd0 con 0x7fea80138dc0 2023-10-03T10:14:52.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 -- 172.21.15.19:0/91607440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 msgr2=0x7fea8013b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 --2- 172.21.15.19:0/91607440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fea78009e50 tx=0x7fea7800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:52.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 -- 172.21.15.19:0/91607440 shutdown_connections 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 --2- 172.21.15.19:0/91607440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea8013b1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 --2- 172.21.15.19:0/91607440 >> v2:172.21.15.19:3300/0 conn(0x7fea801337f0 0x7fea80138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 -- 172.21.15.19:0/91607440 >> 172.21.15.19:0/91607440 conn(0x7fea800a4210 msgr2=0x7fea800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 -- 172.21.15.19:0/91607440 shutdown_connections 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.549+0000 7fea860b6700 1 -- 172.21.15.19:0/91607440 wait complete. 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.550+0000 7fea860b6700 1 Processor -- start 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.550+0000 7fea860b6700 1 -- start start 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 0x7fea800709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea80071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea80072430 con 0x7fea801337f0 2023-10-03T10:14:52.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8009d9b0 con 0x7fea80138dc0 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea860b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea801388a0 con 0x7fea80133420 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49044/0 (socket says 172.21.15.19:49044) 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 -- 172.21.15.19:0/3089446355 learned_addr learned my addr 172.21.15.19:0/3089446355 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea7f7fe700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 0x7fea800709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea7ffff700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea80071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 -- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 msgr2=0x7fea800709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 0x7fea800709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 -- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 msgr2=0x7fea80071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea80071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea77fff700 1 -- 172.21.15.19:0/3089446355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009b30 con 0x7fea801337f0 2023-10-03T10:14:52.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea7f7fe700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 0x7fea800709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:52.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.551+0000 7fea7ffff700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea80071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:14:52.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea77fff700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea6800b530 tx=0x7fea6800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011830 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea680119b0 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8009cb60 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea68011d60 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.552+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8009e170 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.553+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea6801a400 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.553+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea6803f660 con 0x7fea801337f0 2023-10-03T10:14:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.553+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8009c8a0 con 0x7fea801337f0 2023-10-03T10:14:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.563+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea68015080 con 0x7fea801337f0 2023-10-03T10:14:52.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.607+0000 7f566594c700 1 Processor -- start 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.607+0000 7f566594c700 1 -- start start 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f566594c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566006a770 0x7f566009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f566594c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f566009dc30 0x7f566009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f566594c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f566009a810 con 0x7f566013c1e0 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f566594c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f566006ab40 con 0x7f566009dc30 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f566594c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566009ebc0 con 0x7f566006a770 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f565f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f566013c1e0 0x7f566013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45060/0 (socket says 172.21.15.19:45060) 2023-10-03T10:14:52.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f565f7fe700 1 -- 172.21.15.19:0/2424745048 learned_addr learned my addr 172.21.15.19:0/2424745048 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f565e7fc700 1 --2- 172.21.15.19:0/2424745048 >> v2:172.21.15.19:3300/0 conn(0x7f566009dc30 0x7f566009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.608+0000 7f565effd700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566006a770 0x7f566009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565dffb700 1 -- 172.21.15.19:0/2424745048 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261489814 0 0) 0x7f566009a810 con 0x7f566013c1e0 2023-10-03T10:14:52.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565dffb700 1 -- 172.21.15.19:0/2424745048 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56480035b0 con 0x7f566013c1e0 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565e7fc700 1 -- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566006a770 msgr2=0x7f566009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565e7fc700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566006a770 0x7f566009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565e7fc700 1 -- 172.21.15.19:0/2424745048 >> v1:172.21.15.19:6789/0 conn(0x7f566013c1e0 legacy=0x7f566013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565e7fc700 1 -- 172.21.15.19:0/2424745048 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566009e920 con 0x7f566009dc30 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565e7fc700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566009dc30 0x7f566009e080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5654009870 tx=0x7f5654009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19950775a7e5e601 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565dffb700 1 -- 172.21.15.19:0/2424745048 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654011830 con 0x7f566009dc30 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565dffb700 1 -- 172.21.15.19:0/2424745048 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654011990 con 0x7f566009dc30 2023-10-03T10:14:52.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.609+0000 7f565dffb700 1 -- 172.21.15.19:0/2424745048 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654011d20 con 0x7f566009dc30 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 -- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566009dc30 msgr2=0x7f566009e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566009dc30 0x7f566009e080 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5654009870 tx=0x7f5654009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 -- 172.21.15.19:0/2424745048 shutdown_connections 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566006a770 0x7f566009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 --2- 172.21.15.19:0/2424745048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566009dc30 0x7f566009e080 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 -- 172.21.15.19:0/2424745048 >> 172.21.15.19:0/2424745048 conn(0x7f5660066f50 msgr2=0x7f566009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 -- 172.21.15.19:0/2424745048 shutdown_connections 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.610+0000 7f566594c700 1 -- 172.21.15.19:0/2424745048 wait complete. 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.611+0000 7f566594c700 1 Processor -- start 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 -- start start 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f566006a770 0x7f5660138570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 0x7f5660138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566013bdb0 con 0x7f566013c1e0 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566013b3d0 con 0x7f566006a770 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f566594c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f566013baf0 con 0x7f566009dc30 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f565e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f565e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46694/0 (socket says 172.21.15.19:46694) 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f565e7fc700 1 -- 172.21.15.19:0/1934392022 learned_addr learned my addr 172.21.15.19:0/1934392022 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.612+0000 7f565f7fe700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 0x7f5660138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 -- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f566006a770 msgr2=0x7f5660138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f566006a770 0x7f5660138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 -- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 msgr2=0x7f5660138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 0x7f5660138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 -- 172.21.15.19:0/1934392022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540094a0 con 0x7f566009dc30 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565f7fe700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 0x7f5660138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f565e7fc700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f56540090b0 tx=0x7f5654004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540036a0 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565401f070 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654003a40 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566013a730 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.613+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566013a970 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.614+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5654003ba0 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.615+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5654021070 con 0x7f566009dc30 2023-10-03T10:14:52.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.615+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566009c060 con 0x7f566009dc30 2023-10-03T10:14:52.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.625+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f565402b020 con 0x7f566009dc30 2023-10-03T10:14:52.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 Processor -- start 2023-10-03T10:14:52.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 -- start start 2023-10-03T10:14:52.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c806e570 0x7f21c806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c809eca0 0x7f21c806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c8070ee0 con 0x7f21c8134610 2023-10-03T10:14:52.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c8071480 con 0x7f21c806e570 2023-10-03T10:14:52.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21cdde4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c806f3c0 con 0x7f21c809eca0 2023-10-03T10:14:52.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21c77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c806e570 0x7f21c806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c809eca0 0x7f21c806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21c77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c806e570 0x7f21c806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49074/0 (socket says 172.21.15.19:49074) 2023-10-03T10:14:52.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21c77fe700 1 -- 172.21.15.19:0/1158137431 learned_addr learned my addr 172.21.15.19:0/1158137431 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.651+0000 7f21c7fff700 1 --1- 172.21.15.19:0/1158137431 >> v1:172.21.15.19:6789/0 conn(0x7f21c8134610 0x7f21c8134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45066/0 (socket says 172.21.15.19:45066) 2023-10-03T10:14:52.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c77fe700 1 -- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c809eca0 msgr2=0x7f21c806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c77fe700 1 --2- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c809eca0 0x7f21c806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c77fe700 1 -- 172.21.15.19:0/1158137431 >> v1:172.21.15.19:6789/0 conn(0x7f21c8134610 legacy=0x7f21c8134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c77fe700 1 -- 172.21.15.19:0/1158137431 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8071b90 con 0x7f21c806e570 2023-10-03T10:14:52.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c67fc700 1 -- 172.21.15.19:0/1158137431 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103500399 0 0) 0x7f21c8070ee0 con 0x7f21c8134610 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c77fe700 1 --2- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c806e940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f21b80098f0 tx=0x7f21b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7787f0f29d998073 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c67fc700 1 -- 172.21.15.19:0/1158137431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011830 con 0x7f21c806e570 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c67fc700 1 -- 172.21.15.19:0/1158137431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8011990 con 0x7f21c806e570 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.652+0000 7f21c67fc700 1 -- 172.21.15.19:0/1158137431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011d20 con 0x7f21c806e570 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 -- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 msgr2=0x7f21c806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c806e940 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f21b80098f0 tx=0x7f21b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 -- 172.21.15.19:0/1158137431 shutdown_connections 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c806e940 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1158137431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c809eca0 0x7f21c806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 -- 172.21.15.19:0/1158137431 >> 172.21.15.19:0/1158137431 conn(0x7f21c80a2aa0 msgr2=0x7f21c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 -- 172.21.15.19:0/1158137431 shutdown_connections 2023-10-03T10:14:52.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.653+0000 7f21cdde4700 1 -- 172.21.15.19:0/1158137431 wait complete. 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.654+0000 7f21cdde4700 1 Processor -- start 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 -- start start 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 0x7f21c8121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809e480 0x7f21c8121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8124740 con 0x7f21c806e570 2023-10-03T10:14:52.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8122a90 con 0x7f21c8134610 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21cdde4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8123090 con 0x7f21c809e480 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21c77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21c77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49076/0 (socket says 172.21.15.19:49076) 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21c77fe700 1 -- 172.21.15.19:0/1876930517 learned_addr learned my addr 172.21.15.19:0/1876930517 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21c6ffd700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 0x7f21c8121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.655+0000 7f21c7fff700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809e480 0x7f21c8121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 -- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809e480 msgr2=0x7f21c8121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809e480 0x7f21c8121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 -- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 msgr2=0x7f21c8121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 0x7f21c8121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 -- 172.21.15.19:0/1876930517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009550 con 0x7f21c806e570 2023-10-03T10:14:52.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c6ffd700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 0x7f21c8121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21c77fe700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009130 tx=0x7f21b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8004510 con 0x7f21c806e570 2023-10-03T10:14:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b801e070 con 0x7f21c806e570 2023-10-03T10:14:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c8123cc0 con 0x7f21c806e570 2023-10-03T10:14:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80038a0 con 0x7f21c806e570 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.656+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c80a2120 con 0x7f21c806e570 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.657+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21b8003a00 con 0x7f21c806e570 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.657+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c809b1e0 con 0x7f21c806e570 2023-10-03T10:14:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.658+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21b80406b0 con 0x7f21c806e570 2023-10-03T10:14:52.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.663+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21b8003cb0 con 0x7f21c806e570 2023-10-03T10:14:52.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.692+0000 7fe174879700 1 Processor -- start 2023-10-03T10:14:52.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.692+0000 7fe174879700 1 -- start start 2023-10-03T10:14:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.692+0000 7fe174879700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 0x7fe17009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.692+0000 7fe174879700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe17013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe174879700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17009a810 con 0x7fe17009dc30 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe174879700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17006ab40 con 0x7fe17013d1f0 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe174879700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17009ebc0 con 0x7fe17006a770 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16dd9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe17009dc30 0x7fe17009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45078/0 (socket says 172.21.15.19:45078) 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16dd9b700 1 -- 172.21.15.19:0/3828768930 learned_addr learned my addr 172.21.15.19:0/3828768930 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 0x7fe17009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16ed9d700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe17013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 -- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 msgr2=0x7fe17013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe17013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 -- 172.21.15.19:0/3828768930 >> v1:172.21.15.19:6789/0 conn(0x7fe17009dc30 legacy=0x7fe17009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 -- 172.21.15.19:0/3828768930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17009e920 con 0x7fe17006a770 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.693+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 0x7fe17009d6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe160009870 tx=0x7fe160009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=355d06e4076b63f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe16d59a700 1 -- 172.21.15.19:0/3828768930 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160004230 con 0x7fe17006a770 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe16d59a700 1 -- 172.21.15.19:0/3828768930 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160004390 con 0x7fe17006a770 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe16d59a700 1 -- 172.21.15.19:0/3828768930 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600036a0 con 0x7fe17006a770 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 -- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 msgr2=0x7fe17009d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 0x7fe17009d6f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe160009870 tx=0x7fe160009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 -- 172.21.15.19:0/3828768930 shutdown_connections 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe17013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 --2- 172.21.15.19:0/3828768930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17006a770 0x7fe17009d6f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 -- 172.21.15.19:0/3828768930 >> 172.21.15.19:0/3828768930 conn(0x7fe170066f50 msgr2=0x7fe17009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 -- 172.21.15.19:0/3828768930 shutdown_connections 2023-10-03T10:14:52.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.694+0000 7fe174879700 1 -- 172.21.15.19:0/3828768930 wait complete. 2023-10-03T10:14:52.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 Processor -- start 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 -- start start 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 0x7fe1701ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe1701cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17006e8f0 con 0x7fe17006a770 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17009f1a0 con 0x7fe17013d1f0 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe174879700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17013b7c0 con 0x7fe17009dc30 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe16e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe16e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49088/0 (socket says 172.21.15.19:49088) 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe16e59c700 1 -- 172.21.15.19:0/3594340805 learned_addr learned my addr 172.21.15.19:0/3594340805 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:52.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe16dd9b700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 0x7fe1701ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.696+0000 7fe16ed9d700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe1701cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 -- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 msgr2=0x7fe1701ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 0x7fe1701ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 -- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 msgr2=0x7fe1701cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe1701cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 -- 172.21.15.19:0/3594340805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600094a0 con 0x7fe17006a770 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16dd9b700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 0x7fe1701ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16ed9d700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe1701cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe16e59c700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe1600090b0 tx=0x7fe160004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160011630 con 0x7fe17006a770 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16001f070 con 0x7fe17006a770 2023-10-03T10:14:52.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe174879700 1 -- 172.21.15.19:0/3594340805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17006ff00 con 0x7fe17006a770 2023-10-03T10:14:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600119f0 con 0x7fe17006a770 2023-10-03T10:14:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.697+0000 7fe174879700 1 -- 172.21.15.19:0/3594340805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17006eac0 con 0x7fe17006a770 2023-10-03T10:14:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.698+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe160011b50 con 0x7fe17006a770 2023-10-03T10:14:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.699+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe160021070 con 0x7fe17006a770 2023-10-03T10:14:52.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.699+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe170074ea0 con 0x7fe17006a770 2023-10-03T10:14:52.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.704+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe16002b080 con 0x7fe17006a770 2023-10-03T10:14:52.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.860+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea8009d620 con 0x7fea801337f0 2023-10-03T10:14:52.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.861+0000 7fea7cff9700 1 -- 172.21.15.19:0/3089446355 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea6801ae60 con 0x7fea801337f0 2023-10-03T10:14:52.861 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:52.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 msgr2=0x7fea80070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea6800b530 tx=0x7fea6800b8f0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 shutdown_connections 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea80138dc0 0x7fea80071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea80133420 0x7fea800709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 --2- 172.21.15.19:0/3089446355 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea801337f0 0x7fea80070ee0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 >> 172.21.15.19:0/3089446355 conn(0x7fea800a4210 msgr2=0x7fea800a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.864+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 shutdown_connections 2023-10-03T10:14:52.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.865+0000 7fea860b6700 1 -- 172.21.15.19:0/3089446355 wait complete. 2023-10-03T10:14:52.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.883+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21c8074ea0 con 0x7f21c806e570 2023-10-03T10:14:52.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.884+0000 7f21affff700 1 -- 172.21.15.19:0/1876930517 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b8015070 con 0x7f21c806e570 2023-10-03T10:14:52.884 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:52.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 msgr2=0x7f21c81214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009130 tx=0x7f21b8004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 shutdown_connections 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809e480 0x7f21c8121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806e570 0x7f21c81214e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 --2- 172.21.15.19:0/1876930517 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c8134610 0x7f21c8121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.886+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 >> 172.21.15.19:0/1876930517 conn(0x7f21c80a2aa0 msgr2=0x7f21c81bf270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.887+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 shutdown_connections 2023-10-03T10:14:52.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.887+0000 7f21cdde4700 1 -- 172.21.15.19:0/1876930517 wait complete. 2023-10-03T10:14:52.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.898+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5660074ea0 con 0x7f566009dc30 2023-10-03T10:14:52.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.898+0000 7f5647fff700 1 -- 172.21.15.19:0/1934392022 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f565402b020 con 0x7f566009dc30 2023-10-03T10:14:52.898 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:52.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 msgr2=0x7f5660138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f56540090b0 tx=0x7f5654004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 shutdown_connections 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f566013c1e0 0x7f5660138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f566006a770 0x7f5660138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 --2- 172.21.15.19:0/1934392022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f566009dc30 0x7f5660138ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 >> 172.21.15.19:0/1934392022 conn(0x7f5660066f50 msgr2=0x7f56600a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 shutdown_connections 2023-10-03T10:14:52.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.901+0000 7f566594c700 1 -- 172.21.15.19:0/1934392022 wait complete. 2023-10-03T10:14:52.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.911+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe17009a3d0 con 0x7fe17006a770 2023-10-03T10:14:52.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.911+0000 7fe15effd700 1 -- 172.21.15.19:0/3594340805 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe160011e00 con 0x7fe17006a770 2023-10-03T10:14:52.911 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 msgr2=0x7fe1701cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:52.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe1600090b0 tx=0x7fe160004750 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 shutdown_connections 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17013d1f0 0x7fe1701cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17006a770 0x7fe1701cc9c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 --2- 172.21.15.19:0/3594340805 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17009dc30 0x7fe1701ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.913+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 >> 172.21.15.19:0/3594340805 conn(0x7fe170066f50 msgr2=0x7fe17013eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.914+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 shutdown_connections 2023-10-03T10:14:52.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:52.914+0000 7fe15cff9700 1 -- 172.21.15.19:0/3594340805 wait complete. 2023-10-03T10:14:52.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:52.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:53.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:53.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:53.916 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:53.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:54.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.041+0000 7fd3f46f7700 1 Processor -- start 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 -- start start 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 0x7fd3ec06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 0x7fd3ec12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 0x7fd3ec136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec12d330 con 0x7fd3ec12cf60 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec12cd90 con 0x7fd3ec130260 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.042+0000 7fd3f46f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1306d0 con 0x7fd3ec12f8b0 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f1c92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 0x7fd3ec12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2493700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 0x7fd3ec06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f1c92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 0x7fd3ec12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46744/0 (socket says 172.21.15.19:46744) 2023-10-03T10:14:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f1c92700 1 -- 172.21.15.19:0/3517743534 learned_addr learned my addr 172.21.15.19:0/3517743534 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2493700 1 --2- 172.21.15.19:0/3517743534 >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 0x7fd3ec06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49092/0 (socket says 172.21.15.19:49092) 2023-10-03T10:14:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 0x7fd3ec136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 msgr2=0x7fd3ec12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 0x7fd3ec12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3517743534 >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 msgr2=0x7fd3ec06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3517743534 >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 0x7fd3ec06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3517743534 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec071780 con 0x7fd3ec130260 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.043+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 0x7fd3ec136c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009d90 tx=0x7fd3e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4d9096fd693d112 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.044+0000 7fd3f1491700 1 -- 172.21.15.19:0/3517743534 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e400bd20 con 0x7fd3ec130260 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.044+0000 7fd3f1491700 1 -- 172.21.15.19:0/3517743534 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e400be80 con 0x7fd3ec130260 2023-10-03T10:14:54.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.044+0000 7fd3f1491700 1 -- 172.21.15.19:0/3517743534 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4010710 con 0x7fd3ec130260 2023-10-03T10:14:54.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.044+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 msgr2=0x7fd3ec136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.044+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 0x7fd3ec136c20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4009d90 tx=0x7fd3e400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:54.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3517743534 shutdown_connections 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec130260 0x7fd3ec136c20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3517743534 >> v2:172.21.15.19:3300/0 conn(0x7fd3ec12cf60 0x7fd3ec06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3517743534 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec12f8b0 0x7fd3ec12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3517743534 >> 172.21.15.19:0/3517743534 conn(0x7fd3ec0a2aa0 msgr2=0x7fd3ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3517743534 shutdown_connections 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.045+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3517743534 wait complete. 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 Processor -- start 2023-10-03T10:14:54.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 -- start start 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 0x7fd3ec1c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 0x7fd3ec1c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec09ca30 con 0x7fd3ec12cf60 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec1c1d00 con 0x7fd3ec12f8b0 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.046+0000 7fd3f46f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec118f20 con 0x7fd3ec130260 2023-10-03T10:14:54.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2493700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2493700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49100/0 (socket says 172.21.15.19:49100) 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2493700 1 -- 172.21.15.19:0/3976090894 learned_addr learned my addr 172.21.15.19:0/3976090894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 0x7fd3ec1c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f1c92700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 0x7fd3ec1c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 msgr2=0x7fd3ec1c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 0x7fd3ec1c17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 msgr2=0x7fd3ec1c1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 -- 172.21.15.19:0/3976090894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009a70 con 0x7fd3ec130260 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2493700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f1c92700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 0x7fd3ec1c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:54.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.047+0000 7fd3f2c94700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 0x7fd3ec1c42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec072e70 tx=0x7fd3e4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.048+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4010d20 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.048+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e4003e10 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.048+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec12d9d0 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.048+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e4010ea0 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.048+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec09d190 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.049+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3e4004280 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.049+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3e4045210 con 0x7fd3ec130260 2023-10-03T10:14:54.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.049+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec074ea0 con 0x7fd3ec130260 2023-10-03T10:14:54.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.054+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3e4022440 con 0x7fd3ec130260 2023-10-03T10:14:54.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.086+0000 7fdb14eb4700 1 Processor -- start 2023-10-03T10:14:54.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.086+0000 7fdb14eb4700 1 -- start start 2023-10-03T10:14:54.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.086+0000 7f15879af700 1 Processor -- start 2023-10-03T10:14:54.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7f15879af700 1 -- start start 2023-10-03T10:14:54.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7fdb14eb4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb1009e1d0 0x7fdb10138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7fdb14eb4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb10139170 0x7fdb1013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7fdb14eb4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1009b120 con 0x7fdb1009d6f0 2023-10-03T10:14:54.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7fdb14eb4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1006b460 con 0x7fdb1009e1d0 2023-10-03T10:14:54.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.087+0000 7fdb14eb4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1009a7e0 con 0x7fdb10139170 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f158009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 0x7f158009e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1580070c80 con 0x7f158009e390 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158006f720 con 0x7f15801341d0 2023-10-03T10:14:54.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f15879af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f158006fce0 con 0x7f15801338c0 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46750/0 (socket says 172.21.15.19:46750) 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 -- 172.21.15.19:0/3068598956 learned_addr learned my addr 172.21.15.19:0/3068598956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f1584f4a700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f158009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 -- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 msgr2=0x7f158009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f158009de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f1585f4c700 1 --2- 172.21.15.19:0/3068598956 >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 0x7f158009e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 -- 172.21.15.19:0/3068598956 >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 msgr2=0x7f158009e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 --2- 172.21.15.19:0/3068598956 >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 0x7f158009e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f158574b700 1 -- 172.21.15.19:0/3068598956 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15801336a0 con 0x7f15801338c0 2023-10-03T10:14:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7fdb0e59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb1009d6f0 0x7fdb1009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45088/0 (socket says 172.21.15.19:45088) 2023-10-03T10:14:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7fdb0dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb1009e1d0 0x7fdb10138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7fdb0e59c700 1 -- 172.21.15.19:0/3790188842 learned_addr learned my addr 172.21.15.19:0/3790188842 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.088+0000 7f1585f4c700 1 --2- 172.21.15.19:0/3068598956 >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 0x7f158009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:54.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7f158574b700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f157c0098f0 tx=0x7f157c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9afd1e5a53f30bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0dd9b700 1 -- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb10139170 msgr2=0x7fdb1013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0dd9b700 1 --2- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb10139170 0x7fdb1013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0dd9b700 1 -- 172.21.15.19:0/3790188842 >> v1:172.21.15.19:6789/0 conn(0x7fdb1009d6f0 legacy=0x7fdb1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0d59a700 1 -- 172.21.15.19:0/3790188842 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837097914 0 0) 0x7fdb1009b120 con 0x7fdb1009d6f0 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0dd9b700 1 -- 172.21.15.19:0/3790188842 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1009a500 con 0x7fdb1009e1d0 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7f1577fff700 1 -- 172.21.15.19:0/3068598956 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c011830 con 0x7f15801338c0 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7f1577fff700 1 -- 172.21.15.19:0/3068598956 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c011990 con 0x7f15801338c0 2023-10-03T10:14:54.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7f1577fff700 1 -- 172.21.15.19:0/3068598956 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c011d00 con 0x7f15801338c0 2023-10-03T10:14:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0dd9b700 1 --2- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10138c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009870 tx=0x7fdb04009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1522b1e4e0f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0d59a700 1 -- 172.21.15.19:0/3790188842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011830 con 0x7fdb1009e1d0 2023-10-03T10:14:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0d59a700 1 -- 172.21.15.19:0/3790188842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04011990 con 0x7fdb1009e1d0 2023-10-03T10:14:54.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.089+0000 7fdb0d59a700 1 -- 172.21.15.19:0/3790188842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011d20 con 0x7fdb1009e1d0 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 -- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 msgr2=0x7f1580133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f157c0098f0 tx=0x7f157c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 -- 172.21.15.19:0/3068598956 shutdown_connections 2023-10-03T10:14:54.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 --2- 172.21.15.19:0/3068598956 >> v2:172.21.15.19:3300/0 conn(0x7f158009e390 0x7f158009e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580133c90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 --2- 172.21.15.19:0/3068598956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f158009de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 -- 172.21.15.19:0/3068598956 >> 172.21.15.19:0/3068598956 conn(0x7f15800a2aa0 msgr2=0x7f15800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 -- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 msgr2=0x7fdb10138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10138c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009870 tx=0x7fdb04009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 -- 172.21.15.19:0/3068598956 shutdown_connections 2023-10-03T10:14:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 -- 172.21.15.19:0/3790188842 shutdown_connections 2023-10-03T10:14:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb10139170 0x7fdb1013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/3790188842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10138c30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 -- 172.21.15.19:0/3790188842 >> 172.21.15.19:0/3790188842 conn(0x7fdb10066f50 msgr2=0x7fdb1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7f15879af700 1 -- 172.21.15.19:0/3068598956 wait complete. 2023-10-03T10:14:54.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 -- 172.21.15.19:0/3790188842 shutdown_connections 2023-10-03T10:14:54.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.090+0000 7fdb14eb4700 1 -- 172.21.15.19:0/3790188842 wait complete. 2023-10-03T10:14:54.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.091+0000 7f15879af700 1 Processor -- start 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.091+0000 7fdb14eb4700 1 Processor -- start 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.091+0000 7fdb14eb4700 1 -- start start 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb1009d6f0 0x7fdb101218d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10121e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 0x7fdb10122350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101233f0 con 0x7fdb1009e1d0 2023-10-03T10:14:54.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1009c710 con 0x7fdb1009d6f0 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb14eb4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100721c0 con 0x7fdb10139170 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb0dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10121e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb0ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 0x7fdb10122350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb0dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10121e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49134/0 (socket says 172.21.15.19:49134) 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.092+0000 7fdb0dd9b700 1 -- 172.21.15.19:0/1873924131 learned_addr learned my addr 172.21.15.19:0/1873924131 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 -- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb1009d6f0 msgr2=0x7fdb101218d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb1009d6f0 0x7fdb101218d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 -- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 msgr2=0x7fdb10121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10121e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 -- 172.21.15.19:0/1873924131 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040094a0 con 0x7fdb10139170 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb0ed9d700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 0x7fdb10122350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800bdf0 tx=0x7fdb08009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800cc10 con 0x7fdb10139170 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0800cdb0 con 0x7fdb10139170 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb10137310 con 0x7fdb10139170 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb10125ae0 con 0x7fdb10139170 2023-10-03T10:14:54.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08014680 con 0x7fdb10139170 2023-10-03T10:14:54.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.093+0000 7f15879af700 1 -- start start 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f158009e390 0x7f1580123640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580123b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1580124aa0 con 0x7f158009e390 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1580125200 con 0x7f15801341d0 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f15879af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1580131ff0 con 0x7f15801338c0 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f1585f4c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f1585f4c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45534/0 (socket says 172.21.15.19:45534) 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.094+0000 7f1585f4c700 1 -- 172.21.15.19:0/1221717678 learned_addr learned my addr 172.21.15.19:0/1221717678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f158574b700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f158009e390 0x7f1580123640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1584f4a700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580123b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 -- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 msgr2=0x7f1580123b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580123b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 -- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f158009e390 msgr2=0x7f1580123640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f158009e390 0x7f1580123640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 -- 172.21.15.19:0/1221717678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157c009550 con 0x7f15801341d0 2023-10-03T10:14:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40052e0 con 0x7fdb10139170 2023-10-03T10:14:54.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1585f4c700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f157800cef0 tx=0x7f157800cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.095+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157800ad00 con 0x7f15801341d0 2023-10-03T10:14:54.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb0801d3b0 con 0x7fdb10139170 2023-10-03T10:14:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157800ae60 con 0x7f15801341d0 2023-10-03T10:14:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1580126a60 con 0x7f15801341d0 2023-10-03T10:14:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578015680 con 0x7f15801341d0 2023-10-03T10:14:54.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1580127070 con 0x7f15801341d0 2023-10-03T10:14:54.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.096+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb08006e40 con 0x7fdb10139170 2023-10-03T10:14:54.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.097+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1580126c80 con 0x7f15801341d0 2023-10-03T10:14:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.098+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f157800d430 con 0x7f15801341d0 2023-10-03T10:14:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.098+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f157803fd70 con 0x7f15801341d0 2023-10-03T10:14:54.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.103+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb0801bc50 con 0x7fdb10139170 2023-10-03T10:14:54.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.103+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1578008910 con 0x7f15801341d0 2023-10-03T10:14:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.105+0000 7effe6f0d700 1 Processor -- start 2023-10-03T10:14:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 -- start start 2023-10-03T10:14:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 0x7effe009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009e410 0x7effe0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe009f130 con 0x7effe009e000 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe009f520 con 0x7effe009e410 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe6f0d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe009e930 con 0x7effe009d6f0 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effdffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7effe009e000 0x7effe0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45102/0 (socket says 172.21.15.19:45102) 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effdffff700 1 -- 172.21.15.19:0/3338750336 learned_addr learned my addr 172.21.15.19:0/3338750336 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.106+0000 7effe4ca9700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 0x7effe009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effdf7fe700 1 -- 172.21.15.19:0/3338750336 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418106860 0 0) 0x7effe009f130 con 0x7effe009e000 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effdf7fe700 1 -- 172.21.15.19:0/3338750336 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd00035b0 con 0x7effe009e000 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effe4ca9700 1 -- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009e410 msgr2=0x7effe0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:54.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effe4ca9700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009e410 0x7effe0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effe4ca9700 1 -- 172.21.15.19:0/3338750336 >> v1:172.21.15.19:6789/0 conn(0x7effe009e000 legacy=0x7effe0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effe4ca9700 1 -- 172.21.15.19:0/3338750336 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe009b2d0 con 0x7effe009d6f0 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effe4ca9700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 0x7effe009dac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7effd4009870 tx=0x7effd4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec9ae6f8a8fbb22a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effdf7fe700 1 -- 172.21.15.19:0/3338750336 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011830 con 0x7effe009d6f0 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.107+0000 7effdf7fe700 1 -- 172.21.15.19:0/3338750336 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4011990 con 0x7effe009d6f0 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effdf7fe700 1 -- 172.21.15.19:0/3338750336 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4011d20 con 0x7effe009d6f0 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 -- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 msgr2=0x7effe009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 0x7effe009dac0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7effd4009870 tx=0x7effd4009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 -- 172.21.15.19:0/3338750336 shutdown_connections 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009e410 0x7effe0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 --2- 172.21.15.19:0/3338750336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009d6f0 0x7effe009dac0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.108+0000 7effe6f0d700 1 -- 172.21.15.19:0/3338750336 >> 172.21.15.19:0/3338750336 conn(0x7effe0066f50 msgr2=0x7effe009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.109+0000 7effe6f0d700 1 -- 172.21.15.19:0/3338750336 shutdown_connections 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.109+0000 7effe6f0d700 1 -- 172.21.15.19:0/3338750336 wait complete. 2023-10-03T10:14:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.109+0000 7effe6f0d700 1 Processor -- start 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 -- start start 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009d6f0 0x7effe01d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009e000 0x7effe01d57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe009c700 con 0x7effe009e410 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe0072620 con 0x7effe009d6f0 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe6f0d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effe01b83a0 con 0x7effe009e000 2023-10-03T10:14:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.110+0000 7effe54aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49150/0 (socket says 172.21.15.19:49150) 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 -- 172.21.15.19:0/2303859533 learned_addr learned my addr 172.21.15.19:0/2303859533 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effdffff700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009e000 0x7effe01d57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe4ca9700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009d6f0 0x7effe01d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 -- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009e000 msgr2=0x7effe01d57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009e000 0x7effe01d57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 -- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009d6f0 msgr2=0x7effe01d52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009d6f0 0x7effe01d52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 -- 172.21.15.19:0/2303859533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd40094a0 con 0x7effe009e410 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effe54aa700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7effd800b970 tx=0x7effd800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.111+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800d860 con 0x7effe009e410 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.112+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd800d9e0 con 0x7effe009e410 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.112+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd800dd90 con 0x7effe009e410 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.112+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe01b6790 con 0x7effe009e410 2023-10-03T10:14:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.112+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe01b8d60 con 0x7effe009e410 2023-10-03T10:14:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.113+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe0074ea0 con 0x7effe009e410 2023-10-03T10:14:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.114+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effd800e430 con 0x7effe009e410 2023-10-03T10:14:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.114+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effd8006e40 con 0x7effe009e410 2023-10-03T10:14:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.123+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effd800ee40 con 0x7effe009e410 2023-10-03T10:14:54.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.289+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd3ec0713a0 con 0x7fd3ec130260 2023-10-03T10:14:54.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.289+0000 7fd3e2ffd700 1 -- 172.21.15.19:0/3976090894 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3e401d030 con 0x7fd3ec130260 2023-10-03T10:14:54.290 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 msgr2=0x7fd3ec1c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 0x7fd3ec1c42a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec072e70 tx=0x7fd3e4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 shutdown_connections 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3ec130260 0x7fd3ec1c42a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3ec12cf60 0x7fd3ec1c1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 --2- 172.21.15.19:0/3976090894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3ec12f8b0 0x7fd3ec1c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.292+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 >> 172.21.15.19:0/3976090894 conn(0x7fd3ec0a2aa0 msgr2=0x7fd3ec12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.293+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 shutdown_connections 2023-10-03T10:14:54.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.293+0000 7fd3f46f7700 1 -- 172.21.15.19:0/3976090894 wait complete. 2023-10-03T10:14:54.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:54.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.313+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdaf4005150 con 0x7fdb10139170 2023-10-03T10:14:54.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.313+0000 7fdafeffd700 1 -- 172.21.15.19:0/1873924131 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb08019070 con 0x7fdb10139170 2023-10-03T10:14:54.313 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 msgr2=0x7fdb10122350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 0x7fdb10122350 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800bdf0 tx=0x7fdb08009ed0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 shutdown_connections 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb10139170 0x7fdb10122350 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb1009d6f0 0x7fdb101218d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 --2- 172.21.15.19:0/1873924131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb1009e1d0 0x7fdb10121e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 >> 172.21.15.19:0/1873924131 conn(0x7fdb10066f50 msgr2=0x7fdb10070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 shutdown_connections 2023-10-03T10:14:54.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.316+0000 7fdb14eb4700 1 -- 172.21.15.19:0/1873924131 wait complete. 2023-10-03T10:14:54.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.329+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1580074ea0 con 0x7f15801341d0 2023-10-03T10:14:54.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:54.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.329+0000 7f1575ffb700 1 -- 172.21.15.19:0/1221717678 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f157801a070 con 0x7f15801341d0 2023-10-03T10:14:54.331 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 msgr2=0x7f15801240c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f157800cef0 tx=0x7f157800cf20 comp rx=0 tx=0).stop 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 shutdown_connections 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15801341d0 0x7f15801240c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f158009e390 0x7f1580123640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 --2- 172.21.15.19:0/1221717678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15801338c0 0x7f1580123b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 >> 172.21.15.19:0/1221717678 conn(0x7f15800a2aa0 msgr2=0x7f15800a1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 shutdown_connections 2023-10-03T10:14:54.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.332+0000 7f15879af700 1 -- 172.21.15.19:0/1221717678 wait complete. 2023-10-03T10:14:54.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:54.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.356+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7effe01b6980 con 0x7effe009e410 2023-10-03T10:14:54.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.356+0000 7effdd7fa700 1 -- 172.21.15.19:0/2303859533 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effd8025070 con 0x7effe009e410 2023-10-03T10:14:54.357 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 msgr2=0x7effe01d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7effd800b970 tx=0x7effd800bc80 comp rx=0 tx=0).stop 2023-10-03T10:14:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 shutdown_connections 2023-10-03T10:14:54.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effe009e410 0x7effe01d1570 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effe009d6f0 0x7effe01d52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 --2- 172.21.15.19:0/2303859533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effe009e000 0x7effe01d57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 >> 172.21.15.19:0/2303859533 conn(0x7effe0066f50 msgr2=0x7effe0130900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 shutdown_connections 2023-10-03T10:14:54.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:54.359+0000 7effe6f0d700 1 -- 172.21.15.19:0/2303859533 wait complete. 2023-10-03T10:14:54.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:55.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:55.331 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:55.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:55.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.474+0000 7f56eca61700 1 Processor -- start 2023-10-03T10:14:55.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.474+0000 7f56eca61700 1 -- start start 2023-10-03T10:14:55.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.475+0000 7f56eca61700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 0x7f56e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.475+0000 7f56eca61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.475+0000 7f56eca61700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e809f130 con 0x7f56e809e000 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.475+0000 7f56eca61700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e809f520 con 0x7f56e809d6f0 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.475+0000 7f56eca61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e809e930 con 0x7f56e809e410 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46786/0 (socket says 172.21.15.19:46786) 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56e809e000 0x7f56e8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45108/0 (socket says 172.21.15.19:45108) 2023-10-03T10:14:55.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 -- 172.21.15.19:0/599420570 learned_addr learned my addr 172.21.15.19:0/599420570 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e659c700 1 --2- 172.21.15.19:0/599420570 >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 0x7f56e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 -- 172.21.15.19:0/599420570 >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 msgr2=0x7f56e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 --2- 172.21.15.19:0/599420570 >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 0x7f56e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 -- 172.21.15.19:0/599420570 >> v1:172.21.15.19:6789/0 conn(0x7f56e809e000 legacy=0x7f56e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e6d9d700 1 -- 172.21.15.19:0/599420570 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e809b2d0 con 0x7f56e809e410 2023-10-03T10:14:55.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.476+0000 7f56e659c700 1 --2- 172.21.15.19:0/599420570 >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 0x7f56e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.477+0000 7f56e6d9d700 1 --2- 172.21.15.19:0/599420570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56e000d150 tx=0x7f56e000d460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ce703215162d48c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.477+0000 7f56e559a700 1 -- 172.21.15.19:0/599420570 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0010070 con 0x7f56e809e410 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.477+0000 7f56e559a700 1 -- 172.21.15.19:0/599420570 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e000dd10 con 0x7f56e809e410 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.477+0000 7f56e559a700 1 -- 172.21.15.19:0/599420570 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e000b310 con 0x7f56e809e410 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 -- 172.21.15.19:0/599420570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 msgr2=0x7f56e8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 --2- 172.21.15.19:0/599420570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56e000d150 tx=0x7f56e000d460 comp rx=0 tx=0).stop 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 -- 172.21.15.19:0/599420570 shutdown_connections 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 --2- 172.21.15.19:0/599420570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e8130d70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 --2- 172.21.15.19:0/599420570 >> v2:172.21.15.19:3300/0 conn(0x7f56e809d6f0 0x7f56e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 -- 172.21.15.19:0/599420570 >> 172.21.15.19:0/599420570 conn(0x7f56e8066f50 msgr2=0x7f56e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 -- 172.21.15.19:0/599420570 shutdown_connections 2023-10-03T10:14:55.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.478+0000 7f56eca61700 1 -- 172.21.15.19:0/599420570 wait complete. 2023-10-03T10:14:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.480+0000 7f56eca61700 1 Processor -- start 2023-10-03T10:14:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.480+0000 7f56eca61700 1 -- start start 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 0x7f56e811de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e809e000 0x7f56e811e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e811e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8121940 con 0x7f56e809e000 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8120050 con 0x7f56e809d6f0 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56eca61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56e8120d10 con 0x7f56e809e410 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e811e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e811e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46792/0 (socket says 172.21.15.19:46792) 2023-10-03T10:14:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e6d9d700 1 -- 172.21.15.19:0/3036477077 learned_addr learned my addr 172.21.15.19:0/3036477077 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e5d9b700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e809e000 0x7f56e811e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 0x7f56e811de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 -- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 msgr2=0x7f56e811e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e811e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 -- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e809e000 msgr2=0x7f56e811e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e809e000 0x7f56e811e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.481+0000 7f56e659c700 1 -- 172.21.15.19:0/3036477077 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d80094a0 con 0x7f56e809d6f0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56e659c700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 0x7f56e811de20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56d800e9e0 tx=0x7f56d800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800ee80 con 0x7f56e809d6f0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800c850 con 0x7f56e809d6f0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e000bd40 con 0x7f56e809d6f0 2023-10-03T10:14:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d800cc00 con 0x7f56e809d6f0 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.482+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e8072500 con 0x7f56e809d6f0 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.483+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56d800cd60 con 0x7f56e809d6f0 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.483+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56d803fa90 con 0x7f56e809d6f0 2023-10-03T10:14:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.483+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e81214c0 con 0x7f56e809d6f0 2023-10-03T10:14:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.489+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56e81214c0 con 0x7f56e809d6f0 2023-10-03T10:14:55.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.507+0000 7f42b4542700 1 Processor -- start 2023-10-03T10:14:55.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.507+0000 7f42b4542700 1 -- start start 2023-10-03T10:14:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b4542700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09d6f0 0x7f42ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b4542700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42ac09e000 0x7f42ac130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b4542700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac09f130 con 0x7f42ac09e410 2023-10-03T10:14:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b4542700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac09f520 con 0x7f42ac09e000 2023-10-03T10:14:55.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b4542700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac09e930 con 0x7f42ac09d6f0 2023-10-03T10:14:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b1add700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42ac09e000 0x7f42ac130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b2adf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f42ac09e410 0x7f42ac130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45110/0 (socket says 172.21.15.19:45110) 2023-10-03T10:14:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b2adf700 1 -- 172.21.15.19:0/888146051 learned_addr learned my addr 172.21.15.19:0/888146051 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:55.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.508+0000 7f42b22de700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09d6f0 0x7f42ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b1add700 1 -- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09d6f0 msgr2=0x7f42ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b1add700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09d6f0 0x7f42ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b1add700 1 -- 172.21.15.19:0/888146051 >> v1:172.21.15.19:6789/0 conn(0x7f42ac09e410 legacy=0x7f42ac130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b12dc700 1 -- 172.21.15.19:0/888146051 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865291675 0 0) 0x7f42ac09f130 con 0x7f42ac09e410 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b1add700 1 -- 172.21.15.19:0/888146051 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac09b2d0 con 0x7f42ac09e000 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b1add700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e000 0x7f42ac130660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f429c009840 tx=0x7f429c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ed3b64b9f845d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b12dc700 1 -- 172.21.15.19:0/888146051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c011830 con 0x7f42ac09e000 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b12dc700 1 -- 172.21.15.19:0/888146051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c011990 con 0x7f42ac09e000 2023-10-03T10:14:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.509+0000 7f42b12dc700 1 -- 172.21.15.19:0/888146051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c011d20 con 0x7f42ac09e000 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.510+0000 7f42b4542700 1 -- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e000 msgr2=0x7f42ac130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.510+0000 7f42b4542700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e000 0x7f42ac130660 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f429c009840 tx=0x7f429c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 -- 172.21.15.19:0/888146051 shutdown_connections 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09d6f0 0x7f42ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 --2- 172.21.15.19:0/888146051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e000 0x7f42ac130660 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 -- 172.21.15.19:0/888146051 >> 172.21.15.19:0/888146051 conn(0x7f42ac066f50 msgr2=0x7f42ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 -- 172.21.15.19:0/888146051 shutdown_connections 2023-10-03T10:14:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.511+0000 7f42b4542700 1 -- 172.21.15.19:0/888146051 wait complete. 2023-10-03T10:14:55.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.512+0000 7f42b4542700 1 Processor -- start 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.512+0000 7f42b4542700 1 -- start start 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.512+0000 7f42b4542700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42ac09d6f0 0x7f42ac120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.512+0000 7f42b4542700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b4542700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 0x7f42ac120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b4542700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac123b60 con 0x7f42ac09e410 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b4542700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac122270 con 0x7f42ac09e000 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b4542700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac09c770 con 0x7f42ac09d6f0 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45588/0 (socket says 172.21.15.19:45588) 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 -- 172.21.15.19:0/1477515098 learned_addr learned my addr 172.21.15.19:0/1477515098 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b2adf700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 0x7f42ac120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 -- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42ac09d6f0 msgr2=0x7f42ac120040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42ac09d6f0 0x7f42ac120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 -- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 msgr2=0x7f42ac120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 0x7f42ac120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 -- 172.21.15.19:0/1477515098 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c0094a0 con 0x7f42ac09e000 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b2adf700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 0x7f42ac120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.513+0000 7f42b1add700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f429c0090b0 tx=0x7f429c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.514+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0036a0 con 0x7f42ac09e000 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.514+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c01f070 con 0x7f42ac09e000 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.514+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac0a1bf0 con 0x7f42ac09e000 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.514+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c003a40 con 0x7f42ac09e000 2023-10-03T10:14:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.514+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac122440 con 0x7f42ac09e000 2023-10-03T10:14:55.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.515+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f429c003ba0 con 0x7f42ac09e000 2023-10-03T10:14:55.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.516+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac074ea0 con 0x7f42ac09e000 2023-10-03T10:14:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.516+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f429c021070 con 0x7f42ac09e000 2023-10-03T10:14:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.521+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f429c02f3a0 con 0x7f42ac09e000 2023-10-03T10:14:55.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.524+0000 7fd11f833700 1 Processor -- start 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 -- start start 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11806a770 0x7fd11809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd11809dc30 0x7fd11809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11809a810 con 0x7fd11813c1e0 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11806ab40 con 0x7fd11809dc30 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11f833700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11809ebc0 con 0x7fd11806a770 2023-10-03T10:14:55.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11cdce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd11809dc30 0x7fd11809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11cdce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd11809dc30 0x7fd11809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49196/0 (socket says 172.21.15.19:49196) 2023-10-03T10:14:55.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11cdce700 1 -- 172.21.15.19:0/3791519246 learned_addr learned my addr 172.21.15.19:0/3791519246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.525+0000 7fd11d5cf700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11806a770 0x7fd11809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd11cdce700 1 -- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11806a770 msgr2=0x7fd11809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd11cdce700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11806a770 0x7fd11809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd11cdce700 1 -- 172.21.15.19:0/3791519246 >> v1:172.21.15.19:6789/0 conn(0x7fd11813c1e0 legacy=0x7fd11813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd11cdce700 1 -- 172.21.15.19:0/3791519246 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11809e920 con 0x7fd11809dc30 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd11cdce700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11809dc30 0x7fd11809e080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd108009920 tx=0x7fd108009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9712f70a5fe935b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd10ffff700 1 -- 172.21.15.19:0/3791519246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800ba20 con 0x7fd11809dc30 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd10ffff700 1 -- 172.21.15.19:0/3791519246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10800bb80 con 0x7fd11809dc30 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.526+0000 7fd10ffff700 1 -- 172.21.15.19:0/3791519246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108009e70 con 0x7fd11809dc30 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 -- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11809dc30 msgr2=0x7fd11809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11809dc30 0x7fd11809e080 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd108009920 tx=0x7fd108009c30 comp rx=0 tx=0).stop 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 -- 172.21.15.19:0/3791519246 shutdown_connections 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11806a770 0x7fd11809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 --2- 172.21.15.19:0/3791519246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11809dc30 0x7fd11809e080 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 -- 172.21.15.19:0/3791519246 >> 172.21.15.19:0/3791519246 conn(0x7fd118066f50 msgr2=0x7fd11809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 -- 172.21.15.19:0/3791519246 shutdown_connections 2023-10-03T10:14:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.527+0000 7fd11f833700 1 -- 172.21.15.19:0/3791519246 wait complete. 2023-10-03T10:14:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 Processor -- start 2023-10-03T10:14:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 -- start start 2023-10-03T10:14:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd11806a770 0x7fd11813e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11809dc30 0x7fd11813a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118134b90 con 0x7fd11813c1e0 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd11811dae0 con 0x7fd11809dc30 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.529+0000 7fd11f833700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd118071ec0 con 0x7fd11806a770 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49198/0 (socket says 172.21.15.19:49198) 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 -- 172.21.15.19:0/843562281 learned_addr learned my addr 172.21.15.19:0/843562281 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11cdce700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11809dc30 0x7fd11813a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 -- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd11806a770 msgr2=0x7fd11813e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd11806a770 0x7fd11813e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 -- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11809dc30 msgr2=0x7fd11813a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11809dc30 0x7fd11813a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 -- 172.21.15.19:0/843562281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009550 con 0x7fd11813c1e0 2023-10-03T10:14:55.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11ddd0700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd11000cbc0 tx=0x7fd11000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110003c00 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd110003d60 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd11813fb10 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.530+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11000aae0 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.531+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd11809f1f0 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.531+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd11000ac40 con 0x7fd11813c1e0 2023-10-03T10:14:55.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.532+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1100421c0 con 0x7fd11813c1e0 2023-10-03T10:14:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.532+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11813bd40 con 0x7fd11813c1e0 2023-10-03T10:14:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.538+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd110044060 con 0x7fd11813c1e0 2023-10-03T10:14:55.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.549+0000 7f756cfcc700 1 Processor -- start 2023-10-03T10:14:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.549+0000 7f756cfcc700 1 -- start start 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756cfcc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f7568135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756cfcc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 0x7f7568138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756cfcc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756809f130 con 0x7f756809d6f0 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756cfcc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756809f520 con 0x7f7568135e50 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756cfcc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f756809e930 con 0x7f756809e1d0 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7566d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 0x7f7568138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7565d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f7568135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f756809d6f0 0x7f756809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45136/0 (socket says 172.21.15.19:45136) 2023-10-03T10:14:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756659c700 1 -- 172.21.15.19:0/78225905 learned_addr learned my addr 172.21.15.19:0/78225905 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:55.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756559a700 1 -- 172.21.15.19:0/78225905 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300240932 0 0) 0x7f756809f130 con 0x7f756809d6f0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f756559a700 1 -- 172.21.15.19:0/78225905 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75500035b0 con 0x7f756809d6f0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7565d9b700 1 -- 172.21.15.19:0/78225905 >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 msgr2=0x7f7568138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7565d9b700 1 --2- 172.21.15.19:0/78225905 >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 0x7f7568138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7565d9b700 1 -- 172.21.15.19:0/78225905 >> v1:172.21.15.19:6789/0 conn(0x7f756809d6f0 legacy=0x7f756809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7565d9b700 1 -- 172.21.15.19:0/78225905 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756809b2d0 con 0x7f756809e1d0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.550+0000 7f7566d9d700 1 --2- 172.21.15.19:0/78225905 >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 0x7f7568138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f7565d9b700 1 --2- 172.21.15.19:0/78225905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f7568135910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f755c00bb10 tx=0x7f755c00be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7085f9a115a290a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f756559a700 1 -- 172.21.15.19:0/78225905 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00dc30 con 0x7f756809e1d0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f756559a700 1 -- 172.21.15.19:0/78225905 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c00dd90 con 0x7f756809e1d0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f756559a700 1 -- 172.21.15.19:0/78225905 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c010670 con 0x7f756809e1d0 2023-10-03T10:14:55.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f756cfcc700 1 -- 172.21.15.19:0/78225905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 msgr2=0x7f7568135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.551+0000 7f756cfcc700 1 --2- 172.21.15.19:0/78225905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f7568135910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f755c00bb10 tx=0x7f755c00be20 comp rx=0 tx=0).stop 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 -- 172.21.15.19:0/78225905 shutdown_connections 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 --2- 172.21.15.19:0/78225905 >> v2:172.21.15.19:3300/0 conn(0x7f7568135e50 0x7f7568138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 --2- 172.21.15.19:0/78225905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f7568135910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 -- 172.21.15.19:0/78225905 >> 172.21.15.19:0/78225905 conn(0x7f7568066f50 msgr2=0x7f756809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 -- 172.21.15.19:0/78225905 shutdown_connections 2023-10-03T10:14:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.552+0000 7f756cfcc700 1 -- 172.21.15.19:0/78225905 wait complete. 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 Processor -- start 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 -- start start 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f756809d6f0 0x7f7568132360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f75681328a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7568122190 con 0x7f7568135e50 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75681242c0 con 0x7f756809d6f0 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.553+0000 7f756cfcc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7568122740 con 0x7f756809e1d0 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49216/0 (socket says 172.21.15.19:49216) 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 -- 172.21.15.19:0/2853262467 learned_addr learned my addr 172.21.15.19:0/2853262467 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f756659c700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f756809d6f0 0x7f7568132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7565d9b700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f75681328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 -- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 msgr2=0x7f75681328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f75681328a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 -- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f756809d6f0 msgr2=0x7f7568132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f756809d6f0 0x7f7568132360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 -- 172.21.15.19:0/2853262467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560009a70 con 0x7f7568135e50 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.554+0000 7f7566d9d700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f756000efc0 tx=0x7f756000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.555+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000cc90 con 0x7f7568135e50 2023-10-03T10:14:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.555+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c00b740 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.555+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000f040 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.555+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560014480 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.555+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7568123dc0 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.556+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7568074ea0 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.556+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75600145e0 con 0x7f7568135e50 2023-10-03T10:14:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.556+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f756003fff0 con 0x7f7568135e50 2023-10-03T10:14:55.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.565+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7560071750 con 0x7f7568135e50 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.742+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42ac06c360 con 0x7f42ac09e000 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.742+0000 7f42a2ffd700 1 -- 172.21.15.19:0/1477515098 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f429c02b070 con 0x7f42ac09e000 2023-10-03T10:14:55.742 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 msgr2=0x7f42ac120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f429c0090b0 tx=0x7f429c004750 comp rx=0 tx=0).stop 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 shutdown_connections 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42ac09e410 0x7f42ac120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42ac09d6f0 0x7f42ac120040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 --2- 172.21.15.19:0/1477515098 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42ac09e000 0x7f42ac120580 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 >> 172.21.15.19:0/1477515098 conn(0x7f42ac066f50 msgr2=0x7f42ac0711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 shutdown_connections 2023-10-03T10:14:55.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.744+0000 7f42b4542700 1 -- 172.21.15.19:0/1477515098 wait complete. 2023-10-03T10:14:55.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:55.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.769+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f56e81214c0 con 0x7f56e809d6f0 2023-10-03T10:14:55.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.769+0000 7f56d6ffd700 1 -- 172.21.15.19:0/3036477077 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56e81214c0 con 0x7f56e809d6f0 2023-10-03T10:14:55.769 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 msgr2=0x7f56e811de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 0x7f56e811de20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f56d800e9e0 tx=0x7f56d800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 shutdown_connections 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56e809e410 0x7f56e811e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56e809d6f0 0x7f56e811de20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 --2- 172.21.15.19:0/3036477077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56e809e000 0x7f56e811e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 >> 172.21.15.19:0/3036477077 conn(0x7f56e8066f50 msgr2=0x7f56e8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 shutdown_connections 2023-10-03T10:14:55.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.771+0000 7f56eca61700 1 -- 172.21.15.19:0/3036477077 wait complete. 2023-10-03T10:14:55.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.778+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7568122980 con 0x7f7568135e50 2023-10-03T10:14:55.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.779+0000 7f7556ffd700 1 -- 172.21.15.19:0/2853262467 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7560018030 con 0x7f7568135e50 2023-10-03T10:14:55.779 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:55.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 msgr2=0x7f7568120580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f756000efc0 tx=0x7f756000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 shutdown_connections 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568135e50 0x7f7568120580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f756809d6f0 0x7f7568132360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 --2- 172.21.15.19:0/2853262467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f756809e1d0 0x7f75681328a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 >> 172.21.15.19:0/2853262467 conn(0x7f7568066f50 msgr2=0x7f756806edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 shutdown_connections 2023-10-03T10:14:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.781+0000 7f756cfcc700 1 -- 172.21.15.19:0/2853262467 wait complete. 2023-10-03T10:14:55.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:55.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:55.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.806+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd11811e670 con 0x7fd11813c1e0 2023-10-03T10:14:55.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.806+0000 7fd10dffb700 1 -- 172.21.15.19:0/843562281 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1100198f0 con 0x7fd11813c1e0 2023-10-03T10:14:55.806 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 msgr2=0x7fd11813a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd11000cbc0 tx=0x7fd11000ced0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 shutdown_connections 2023-10-03T10:14:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd11813c1e0 0x7fd11813a990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd11806a770 0x7fd11813e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 --2- 172.21.15.19:0/843562281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd11809dc30 0x7fd11813a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 >> 172.21.15.19:0/843562281 conn(0x7fd118066f50 msgr2=0x7fd1180a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 shutdown_connections 2023-10-03T10:14:55.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:55.808+0000 7fd11f833700 1 -- 172.21.15.19:0/843562281 wait complete. 2023-10-03T10:14:55.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:56.759 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:56.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:56.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:56.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.909+0000 7fc0dc8cc700 1 Processor -- start 2023-10-03T10:14:56.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.909+0000 7fc0dc8cc700 1 -- start start 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.910+0000 7fc0dc8cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 0x7fc0d8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.910+0000 7fc0dc8cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.910+0000 7fc0dc8cc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d806f720 con 0x7fc0d81338c0 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.910+0000 7fc0dc8cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d8070c80 con 0x7fc0d8136830 2023-10-03T10:14:56.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.910+0000 7fc0dc8cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d806fce0 con 0x7fc0d8139150 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 0x7fc0d8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc0d81338c0 0x7fc0d8133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48150/0 (socket says 172.21.15.19:48150) 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d659c700 1 -- 172.21.15.19:0/1441015469 learned_addr learned my addr 172.21.15.19:0/1441015469 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/1441015469 >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 msgr2=0x7fc0d8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 --2- 172.21.15.19:0/1441015469 >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 0x7fc0d8138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/1441015469 >> v1:172.21.15.19:6789/0 conn(0x7fc0d81338c0 legacy=0x7fc0d8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/1441015469 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d81336a0 con 0x7fc0d8139150 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d559a700 1 -- 172.21.15.19:0/1441015469 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320231062 0 0) 0x7fc0d806f720 con 0x7fc0d81338c0 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d5d9b700 1 --2- 172.21.15.19:0/1441015469 >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 0x7fc0d8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.911+0000 7fc0d6d9d700 1 --2- 172.21.15.19:0/1441015469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d813b530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a19f6e574d97d53 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.912+0000 7fc0d559a700 1 -- 172.21.15.19:0/1441015469 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d000e070 con 0x7fc0d8139150 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.912+0000 7fc0d559a700 1 -- 172.21.15.19:0/1441015469 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000bb20 con 0x7fc0d8139150 2023-10-03T10:14:56.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.912+0000 7fc0d559a700 1 -- 172.21.15.19:0/1441015469 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0012430 con 0x7fc0d8139150 2023-10-03T10:14:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/1441015469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 msgr2=0x7fc0d813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/1441015469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d813b530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009d90 tx=0x7fc0d000b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/1441015469 shutdown_connections 2023-10-03T10:14:56.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/1441015469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d813b530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/1441015469 >> v2:172.21.15.19:3300/0 conn(0x7fc0d8136830 0x7fc0d8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/1441015469 >> 172.21.15.19:0/1441015469 conn(0x7fc0d80a2aa0 msgr2=0x7fc0d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/1441015469 shutdown_connections 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.913+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/1441015469 wait complete. 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.915+0000 7fc0dc8cc700 1 Processor -- start 2023-10-03T10:14:56.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.915+0000 7fc0dc8cc700 1 -- start start 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 0x7fc0d8119b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0d8136830 0x7fc0d811a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d811d660 con 0x7fc0d81338c0 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d811aff0 con 0x7fc0d8136830 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0dc8cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d811ca10 con 0x7fc0d8139150 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 0x7fc0d8119b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 0x7fc0d8119b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50614/0 (socket says 172.21.15.19:50614) 2023-10-03T10:14:56.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57030/0 (socket says 172.21.15.19:57030) 2023-10-03T10:14:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d659c700 1 -- 172.21.15.19:0/3775191887 learned_addr learned my addr 172.21.15.19:0/3775191887 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:56.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d5d9b700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0d8136830 0x7fc0d811a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0d8136830 msgr2=0x7fc0d811a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0d8136830 0x7fc0d811a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 msgr2=0x7fc0d8119b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 0x7fc0d8119b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.916+0000 7fc0d6d9d700 1 -- 172.21.15.19:0/3775191887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0094a0 con 0x7fc0d8139150 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0d6d9d700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0016000 tx=0x7fc0d0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0012430 con 0x7fc0d8139150 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d0020070 con 0x7fc0d8139150 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d0004280 con 0x7fc0d8139150 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d0009a70 con 0x7fc0d8139150 2023-10-03T10:14:56.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.917+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d806f960 con 0x7fc0d8139150 2023-10-03T10:14:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.918+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0d00043e0 con 0x7fc0d8139150 2023-10-03T10:14:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.918+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d8074ea0 con 0x7fc0d8139150 2023-10-03T10:14:56.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.918+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0d0022070 con 0x7fc0d8139150 2023-10-03T10:14:56.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.927+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0d002c080 con 0x7fc0d8139150 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.958+0000 7fca14c9a700 1 Processor -- start 2023-10-03T10:14:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.958+0000 7fca14c9a700 1 -- start start 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.959+0000 7fca14c9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca100a1510 0x7fca10138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.959+0000 7fca14c9a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 0x7fca1013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca14c9a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1009edd0 con 0x7fca100a0a30 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca14c9a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca100a18e0 con 0x7fca10139250 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca14c9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca1009e1f0 con 0x7fca100a1510 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0e59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca100a0a30 0x7fca100a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48166/0 (socket says 172.21.15.19:48166) 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0e59c700 1 -- 172.21.15.19:0/804732298 learned_addr learned my addr 172.21.15.19:0/804732298 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 0x7fca1013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0d59a700 1 -- 172.21.15.19:0/804732298 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377806227 0 0) 0x7fca1009edd0 con 0x7fca100a0a30 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0d59a700 1 -- 172.21.15.19:0/804732298 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f80035b0 con 0x7fca100a0a30 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 -- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca100a1510 msgr2=0x7fca10138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca100a1510 0x7fca10138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 -- 172.21.15.19:0/804732298 >> v1:172.21.15.19:6789/0 conn(0x7fca100a0a30 legacy=0x7fca100a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 -- 172.21.15.19:0/804732298 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1009dc50 con 0x7fca10139250 2023-10-03T10:14:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.960+0000 7fca0ed9d700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 0x7fca1013b630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca08009dc0 tx=0x7fca0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f244854818062974 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.961+0000 7fca0d59a700 1 -- 172.21.15.19:0/804732298 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800e070 con 0x7fca10139250 2023-10-03T10:14:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.961+0000 7fca0d59a700 1 -- 172.21.15.19:0/804732298 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0800bae0 con 0x7fca10139250 2023-10-03T10:14:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.961+0000 7fca0d59a700 1 -- 172.21.15.19:0/804732298 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0800be90 con 0x7fca10139250 2023-10-03T10:14:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 -- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 msgr2=0x7fca1013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 0x7fca1013b630 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fca08009dc0 tx=0x7fca0800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 -- 172.21.15.19:0/804732298 shutdown_connections 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca10139250 0x7fca1013b630 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 --2- 172.21.15.19:0/804732298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca100a1510 0x7fca10138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 -- 172.21.15.19:0/804732298 >> 172.21.15.19:0/804732298 conn(0x7fca100a6550 msgr2=0x7fca100a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 -- 172.21.15.19:0/804732298 shutdown_connections 2023-10-03T10:14:56.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.962+0000 7fca14c9a700 1 -- 172.21.15.19:0/804732298 wait complete. 2023-10-03T10:14:56.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.963+0000 7f680c120700 1 Processor -- start 2023-10-03T10:14:56.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.963+0000 7f680c120700 1 -- start start 2023-10-03T10:14:56.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.963+0000 7fca14c9a700 1 Processor -- start 2023-10-03T10:14:56.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 -- start start 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680c120700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f680409d6f0 0x7f680409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680c120700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680c120700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680409f130 con 0x7f680409e410 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680c120700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680409f520 con 0x7f680409d6f0 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680c120700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680409e930 con 0x7f680409e000 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680a6bd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f680409e410 0x7f6804130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48172/0 (socket says 172.21.15.19:48172) 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f680a6bd700 1 -- 172.21.15.19:0/2329003742 learned_addr learned my addr 172.21.15.19:0/2329003742 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:56.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f68096bb700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7f6809ebc700 1 --2- 172.21.15.19:0/2329003742 >> v2:172.21.15.19:3300/0 conn(0x7f680409d6f0 0x7f680409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 0x7fca10122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 0x7fca10122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca10139250 0x7fca10123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101389b0 con 0x7fca100a0a30 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca101380b0 con 0x7fca100a1510 2023-10-03T10:14:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.964+0000 7fca14c9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca10124390 con 0x7fca10139250 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 0x7fca10122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 0x7fca10122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50628/0 (socket says 172.21.15.19:50628) 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 0x7fca10122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0e59c700 1 -- 172.21.15.19:0/140022573 learned_addr learned my addr 172.21.15.19:0/140022573 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6808eba700 1 -- 172.21.15.19:0/2329003742 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500396749 0 0) 0x7f680409f130 con 0x7f680409e410 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6808eba700 1 -- 172.21.15.19:0/2329003742 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f00035b0 con 0x7f680409e410 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6809ebc700 1 -- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 msgr2=0x7f6804130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6809ebc700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6809ebc700 1 -- 172.21.15.19:0/2329003742 >> v1:172.21.15.19:6789/0 conn(0x7f680409e410 legacy=0x7f6804130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6809ebc700 1 -- 172.21.15.19:0/2329003742 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680409b2d0 con 0x7f680409d6f0 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 -- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca10139250 msgr2=0x7fca10123200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca10139250 0x7fca10123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 -- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 msgr2=0x7fca10122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 0x7fca10122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 -- 172.21.15.19:0/140022573 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009a70 con 0x7fca100a1510 2023-10-03T10:14:56.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7fca0dd9b700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 0x7fca10122cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca0400b450 tx=0x7fca0400b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.965+0000 7f6809ebc700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f680409dac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6800009840 tx=0x7f6800009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01edf1cf51bbb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04011830 con 0x7fca100a1510 2023-10-03T10:14:56.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca04011990 con 0x7fca100a1510 2023-10-03T10:14:56.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca10124c00 con 0x7fca100a1510 2023-10-03T10:14:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7f6808eba700 1 -- 172.21.15.19:0/2329003742 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011830 con 0x7f680409d6f0 2023-10-03T10:14:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7f6808eba700 1 -- 172.21.15.19:0/2329003742 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800011990 con 0x7f680409d6f0 2023-10-03T10:14:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7f6808eba700 1 -- 172.21.15.19:0/2329003742 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011d20 con 0x7f680409d6f0 2023-10-03T10:14:56.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.966+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca100a0220 con 0x7fca100a1510 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 -- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 msgr2=0x7f680409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f680409dac0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6800009840 tx=0x7f6800009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 -- 172.21.15.19:0/2329003742 shutdown_connections 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f680409dac0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 --2- 172.21.15.19:0/2329003742 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 -- 172.21.15.19:0/2329003742 >> 172.21.15.19:0/2329003742 conn(0x7f6804066f50 msgr2=0x7f680409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7f680c120700 1 -- 172.21.15.19:0/2329003742 shutdown_connections 2023-10-03T10:14:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.968+0000 7f680c120700 1 -- 172.21.15.19:0/2329003742 wait complete. 2023-10-03T10:14:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.967+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca04011d40 con 0x7fca100a1510 2023-10-03T10:14:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.968+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca0401a400 con 0x7fca100a1510 2023-10-03T10:14:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.968+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca0400f4a0 con 0x7fca100a1510 2023-10-03T10:14:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.968+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca10125c40 con 0x7fca100a1510 2023-10-03T10:14:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.969+0000 7f680c120700 1 Processor -- start 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.969+0000 7f680c120700 1 -- start start 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f680409e410 0x7f680413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804132630 con 0x7f680409d6f0 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680413b8d0 con 0x7f680409e000 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680c120700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68040a1e00 con 0x7f680409e410 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f6809ebc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f6809ebc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50642/0 (socket says 172.21.15.19:50642) 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f6809ebc700 1 -- 172.21.15.19:0/3292668413 learned_addr learned my addr 172.21.15.19:0/3292668413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f680a6bd700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f680409e410 0x7f680413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.970+0000 7f68096bb700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 -- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f680409e410 msgr2=0x7f680413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f680409e410 0x7f680413a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 -- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 msgr2=0x7f6804139940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 -- 172.21.15.19:0/3292668413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000094a0 con 0x7f680409e000 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f6809ebc700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.971+0000 7f68096bb700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804139e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e930 tx=0x7f67f400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4013680 con 0x7f680409e000 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f40137e0 con 0x7f680409e000 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f4013b50 con 0x7f680409e000 2023-10-03T10:14:56.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680413abf0 con 0x7f680409e000 2023-10-03T10:14:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca10125c40 con 0x7fca100a1510 2023-10-03T10:14:56.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.974+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680413b3e0 con 0x7f680409e000 2023-10-03T10:14:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.975+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6804074ea0 con 0x7f680409e000 2023-10-03T10:14:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.975+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f67f4013cb0 con 0x7f680409e000 2023-10-03T10:14:56.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.975+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f67f403fa40 con 0x7f680409e000 2023-10-03T10:14:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.985+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67f401abe0 con 0x7f680409e000 2023-10-03T10:14:56.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.995+0000 7fd9424b4700 1 Processor -- start 2023-10-03T10:14:56.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.995+0000 7fd9424b4700 1 -- start start 2023-10-03T10:14:56.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd9424b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd93c131810 0x7fd93c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd9424b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd9424b4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93c1313c0 con 0x7fd93c09a3b0 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd9424b4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93c09b580 con 0x7fd93c131810 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd9424b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c06e8c0 con 0x7fd93c099a40 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd940a51700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd93c09a3b0 0x7fd93c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48174/0 (socket says 172.21.15.19:48174) 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd940a51700 1 -- 172.21.15.19:0/2924279214 learned_addr learned my addr 172.21.15.19:0/2924279214 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93bfff700 1 --2- 172.21.15.19:0/2924279214 >> v2:172.21.15.19:3300/0 conn(0x7fd93c131810 0x7fd93c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93b7fe700 1 -- 172.21.15.19:0/2924279214 >> v2:172.21.15.19:3300/0 conn(0x7fd93c131810 msgr2=0x7fd93c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93b7fe700 1 --2- 172.21.15.19:0/2924279214 >> v2:172.21.15.19:3300/0 conn(0x7fd93c131810 0x7fd93c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93b7fe700 1 -- 172.21.15.19:0/2924279214 >> v1:172.21.15.19:6789/0 conn(0x7fd93c09a3b0 legacy=0x7fd93c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.996+0000 7fd93b7fe700 1 -- 172.21.15.19:0/2924279214 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c09a830 con 0x7fd93c099a40 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd93b7fe700 1 --2- 172.21.15.19:0/2924279214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c099e70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd930009870 tx=0x7fd930009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de4088824485b1b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd93affd700 1 -- 172.21.15.19:0/2924279214 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930011830 con 0x7fd93c099a40 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd93affd700 1 -- 172.21.15.19:0/2924279214 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd930011990 con 0x7fd93c099a40 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd93affd700 1 -- 172.21.15.19:0/2924279214 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd930011d20 con 0x7fd93c099a40 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd9424b4700 1 -- 172.21.15.19:0/2924279214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 msgr2=0x7fd93c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.997+0000 7fd9424b4700 1 --2- 172.21.15.19:0/2924279214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c099e70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd930009870 tx=0x7fd930009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 -- 172.21.15.19:0/2924279214 shutdown_connections 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 --2- 172.21.15.19:0/2924279214 >> v2:172.21.15.19:3300/0 conn(0x7fd93c131810 0x7fd93c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 --2- 172.21.15.19:0/2924279214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c099e70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 -- 172.21.15.19:0/2924279214 >> 172.21.15.19:0/2924279214 conn(0x7fd93c0a2aa0 msgr2=0x7fd93c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 -- 172.21.15.19:0/2924279214 shutdown_connections 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.998+0000 7fd9424b4700 1 -- 172.21.15.19:0/2924279214 wait complete. 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.999+0000 7fd9424b4700 1 Processor -- start 2023-10-03T10:14:56.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:56.999+0000 7fd9424b4700 1 -- start start 2023-10-03T10:14:57.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd93c09a3b0 0x7fd93c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 0x7fd93c070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:57.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c120df0 con 0x7fd93c131810 2023-10-03T10:14:57.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c12e710 con 0x7fd93c099a40 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd9424b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd93c0a1ec0 con 0x7fd93c09a3b0 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd93bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd93bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52076/0 (socket says 172.21.15.19:52076) 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd93bfff700 1 -- 172.21.15.19:0/796823770 learned_addr learned my addr 172.21.15.19:0/796823770 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.000+0000 7fd940a51700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 0x7fd93c070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 -- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd93c09a3b0 msgr2=0x7fd93c06fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd93c09a3b0 0x7fd93c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 -- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 msgr2=0x7fd93c070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 0x7fd93c070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 -- 172.21.15.19:0/796823770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9300094a0 con 0x7fd93c099a40 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd940a51700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 0x7fd93c070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd93bfff700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e9b0 tx=0x7fd92c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c009710 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c00c850 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd93c071dd0 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00cbc0 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.001+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd93c1210e0 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.002+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd93c074ea0 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.003+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd92c00cd20 con 0x7fd93c099a40 2023-10-03T10:14:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.003+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd92c03fb40 con 0x7fd93c099a40 2023-10-03T10:14:57.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.012+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd92c01b3b0 con 0x7fd93c099a40 2023-10-03T10:14:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.140+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0d811de50 con 0x7fc0d8139150 2023-10-03T10:14:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.141+0000 7fc0c6ffd700 1 -- 172.21.15.19:0/3775191887 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0d00269d0 con 0x7fc0d8139150 2023-10-03T10:14:57.141 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 msgr2=0x7fc0d811a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0016000 tx=0x7fc0d0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 shutdown_connections 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0d8139150 0x7fc0d811a610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0d81338c0 0x7fc0d8119b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 --2- 172.21.15.19:0/3775191887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0d8136830 0x7fc0d811a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 >> 172.21.15.19:0/3775191887 conn(0x7fc0d80a2aa0 msgr2=0x7fc0d809de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 shutdown_connections 2023-10-03T10:14:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.143+0000 7fc0dc8cc700 1 -- 172.21.15.19:0/3775191887 wait complete. 2023-10-03T10:14:57.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:57.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.197+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca10125c40 con 0x7fca100a1510 2023-10-03T10:14:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.197+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f680406c360 con 0x7f680409e000 2023-10-03T10:14:57.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.197+0000 7f67fa7fc700 1 -- 172.21.15.19:0/3292668413 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f67f4017070 con 0x7f680409e000 2023-10-03T10:14:57.197 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:57.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.197+0000 7fc9feffd700 1 -- 172.21.15.19:0/140022573 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca10125c40 con 0x7fca100a1510 2023-10-03T10:14:57.198 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:57.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 msgr2=0x7f6804139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 msgr2=0x7fca10122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804139e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f67f400e930 tx=0x7f67f400ec40 comp rx=0 tx=0).stop 2023-10-03T10:14:57.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 0x7fca10122cc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fca0400b450 tx=0x7fca0400b760 comp rx=0 tx=0).stop 2023-10-03T10:14:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 shutdown_connections 2023-10-03T10:14:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f680409e410 0x7f680413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f680409d6f0 0x7f6804139940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 --2- 172.21.15.19:0/3292668413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f680409e000 0x7f6804139e80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 >> 172.21.15.19:0/3292668413 conn(0x7f6804066f50 msgr2=0x7f6804070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 shutdown_connections 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca10139250 0x7fca10123200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca100a0a30 0x7fca10122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 --2- 172.21.15.19:0/140022573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca100a1510 0x7fca10122cc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 >> 172.21.15.19:0/140022573 conn(0x7fca100a6550 msgr2=0x7fca1009a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 shutdown_connections 2023-10-03T10:14:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 shutdown_connections 2023-10-03T10:14:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7fca14c9a700 1 -- 172.21.15.19:0/140022573 wait complete. 2023-10-03T10:14:57.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.200+0000 7f680c120700 1 -- 172.21.15.19:0/3292668413 wait complete. 2023-10-03T10:14:57.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:57.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:57.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.229+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd93c0a23d0 con 0x7fd93c099a40 2023-10-03T10:14:57.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.230+0000 7fd938ff9700 1 -- 172.21.15.19:0/796823770 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd92c021070 con 0x7fd93c099a40 2023-10-03T10:14:57.229 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 msgr2=0x7fd93c06f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e9b0 tx=0x7fd92c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 shutdown_connections 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd93c131810 0x7fd93c070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd93c099a40 0x7fd93c06f610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 --2- 172.21.15.19:0/796823770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd93c09a3b0 0x7fd93c06fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 >> 172.21.15.19:0/796823770 conn(0x7fd93c0a2aa0 msgr2=0x7fd93c09d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:57.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 shutdown_connections 2023-10-03T10:14:57.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:57.232+0000 7fd9424b4700 1 -- 172.21.15.19:0/796823770 wait complete. 2023-10-03T10:14:57.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:58.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:58.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:58.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:58.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:58.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.323+0000 7f33417e6700 1 Processor -- start 2023-10-03T10:14:58.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.323+0000 7f33417e6700 1 -- start start 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f33417e6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 0x7f333c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f33417e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 0x7f333c13fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f33417e6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333c134980 con 0x7f333c134ec0 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f33417e6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333c06c4b0 con 0x7f333c06c0e0 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f33417e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c0a09c0 con 0x7f333c1380f0 2023-10-03T10:14:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f333affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 0x7f333c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f333a7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f333c134ec0 0x7f333c1379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48188/0 (socket says 172.21.15.19:48188) 2023-10-03T10:14:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f333b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 0x7f333c13fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.324+0000 7f333a7fc700 1 -- 172.21.15.19:0/2200230621 learned_addr learned my addr 172.21.15.19:0/2200230621 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333b7fe700 1 -- 172.21.15.19:0/2200230621 >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 msgr2=0x7f333c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333b7fe700 1 --2- 172.21.15.19:0/2200230621 >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 0x7f333c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333b7fe700 1 -- 172.21.15.19:0/2200230621 >> v1:172.21.15.19:6789/0 conn(0x7f333c134ec0 legacy=0x7f333c1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333b7fe700 1 -- 172.21.15.19:0/2200230621 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333c0a0600 con 0x7f333c1380f0 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333affd700 1 --2- 172.21.15.19:0/2200230621 >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 0x7f333c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f333b7fe700 1 --2- 172.21.15.19:0/2200230621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 0x7f333c13fd20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9efd9687b95789f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f3339ffb700 1 -- 172.21.15.19:0/2200230621 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400e070 con 0x7f333c1380f0 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f3339ffb700 1 -- 172.21.15.19:0/2200230621 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400bb20 con 0x7f333c1380f0 2023-10-03T10:14:58.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.325+0000 7f3339ffb700 1 -- 172.21.15.19:0/2200230621 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334012430 con 0x7f333c1380f0 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 -- 172.21.15.19:0/2200230621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 msgr2=0x7f333c13fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 --2- 172.21.15.19:0/2200230621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 0x7f333c13fd20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333400b330 comp rx=0 tx=0).stop 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 -- 172.21.15.19:0/2200230621 shutdown_connections 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 --2- 172.21.15.19:0/2200230621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c1380f0 0x7f333c13fd20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 --2- 172.21.15.19:0/2200230621 >> v2:172.21.15.19:3300/0 conn(0x7f333c06c0e0 0x7f333c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 -- 172.21.15.19:0/2200230621 >> 172.21.15.19:0/2200230621 conn(0x7f333c0a4210 msgr2=0x7f333c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.326+0000 7f33417e6700 1 -- 172.21.15.19:0/2200230621 shutdown_connections 2023-10-03T10:14:58.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.327+0000 7f33417e6700 1 -- 172.21.15.19:0/2200230621 wait complete. 2023-10-03T10:14:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 Processor -- start 2023-10-03T10:14:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 -- start start 2023-10-03T10:14:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c06c0e0 0x7f333c11a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f333c134ec0 0x7f333c11ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333c1341f0 con 0x7f333c1380f0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333c11ba70 con 0x7f333c06c0e0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f33417e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f333c11ec10 con 0x7f333c134ec0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f333b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f333b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50682/0 (socket says 172.21.15.19:50682) 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.328+0000 7f333b7fe700 1 -- 172.21.15.19:0/1611581488 learned_addr learned my addr 172.21.15.19:0/1611581488 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333affd700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c06c0e0 0x7f333c11a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333a7fc700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f333c134ec0 0x7f333c11ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 -- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f333c134ec0 msgr2=0x7f333c11ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f333c134ec0 0x7f333c11ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 -- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c06c0e0 msgr2=0x7f333c11a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c06c0e0 0x7f333c11a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 -- 172.21.15.19:0/1611581488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f332c0094a0 con 0x7f333c1380f0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f333b7fe700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3334014040 tx=0x7f3334004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3334012430 con 0x7f333c1380f0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334020070 con 0x7f333c1380f0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340044a0 con 0x7f333c1380f0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3334009a70 con 0x7f333c1380f0 2023-10-03T10:14:58.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.329+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333c0a0440 con 0x7f333c1380f0 2023-10-03T10:14:58.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.330+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3334004600 con 0x7f333c1380f0 2023-10-03T10:14:58.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.331+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3334022070 con 0x7f333c1380f0 2023-10-03T10:14:58.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.331+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333c074ea0 con 0x7f333c1380f0 2023-10-03T10:14:58.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.336+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f333401b400 con 0x7f333c1380f0 2023-10-03T10:14:58.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.372+0000 7f1ed7b50700 1 Processor -- start 2023-10-03T10:14:58.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 -- start start 2023-10-03T10:14:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 0x7f1ed0136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed0136d80 0x7f1ed0139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed009ece0 con 0x7f1ed006a770 2023-10-03T10:14:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed006b640 con 0x7f1ed006b250 2023-10-03T10:14:58.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed7b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed009e760 con 0x7f1ed0136d80 2023-10-03T10:14:58.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.373+0000 7f1ed58ec700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ed006a770 0x7f1ed006ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48196/0 (socket says 172.21.15.19:48196) 2023-10-03T10:14:58.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed58ec700 1 -- 172.21.15.19:0/950710229 learned_addr learned my addr 172.21.15.19:0/950710229 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 0x7f1ed0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed60ed700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed0136d80 0x7f1ed0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed48ea700 1 -- 172.21.15.19:0/950710229 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863312413 0 0) 0x7f1ed009ece0 con 0x7f1ed006a770 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed48ea700 1 -- 172.21.15.19:0/950710229 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ebc0035b0 con 0x7f1ed006a770 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 -- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed0136d80 msgr2=0x7f1ed0139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed0136d80 0x7f1ed0139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 -- 172.21.15.19:0/950710229 >> v1:172.21.15.19:6789/0 conn(0x7f1ed006a770 legacy=0x7f1ed006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 -- 172.21.15.19:0/950710229 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed009e040 con 0x7f1ed006b250 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed50eb700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 0x7f1ed0136840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009870 tx=0x7f1ec0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a4565361b0075e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed48ea700 1 -- 172.21.15.19:0/950710229 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0011830 con 0x7f1ed006b250 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed48ea700 1 -- 172.21.15.19:0/950710229 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec0011990 con 0x7f1ed006b250 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.374+0000 7f1ed48ea700 1 -- 172.21.15.19:0/950710229 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0011d20 con 0x7f1ed006b250 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 -- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 msgr2=0x7f1ed0136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 0x7f1ed0136840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009870 tx=0x7f1ec0009b80 comp rx=0 tx=0).stop 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 -- 172.21.15.19:0/950710229 shutdown_connections 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed0136d80 0x7f1ed0139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/950710229 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed006b250 0x7f1ed0136840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 -- 172.21.15.19:0/950710229 >> 172.21.15.19:0/950710229 conn(0x7f1ed0066f50 msgr2=0x7f1ed009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 -- 172.21.15.19:0/950710229 shutdown_connections 2023-10-03T10:14:58.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.375+0000 7f1ed7b50700 1 -- 172.21.15.19:0/950710229 wait complete. 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 Processor -- start 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 -- start start 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed006b250 0x7f1ed011b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed0136d80 0x7f1ed011bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed011ef90 con 0x7f1ed006a770 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed011d120 con 0x7f1ed0136d80 2023-10-03T10:14:58.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.377+0000 7f1ed7b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed011e340 con 0x7f1ed006b250 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50692/0 (socket says 172.21.15.19:50692) 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 -- 172.21.15.19:0/781741792 learned_addr learned my addr 172.21.15.19:0/781741792 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed60ed700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed0136d80 0x7f1ed011bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed50eb700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed006b250 0x7f1ed011b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 -- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed006b250 msgr2=0x7f1ed011b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed006b250 0x7f1ed011b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 -- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed0136d80 msgr2=0x7f1ed011bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed0136d80 0x7f1ed011bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 -- 172.21.15.19:0/781741792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00094a0 con 0x7f1ed006a770 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ed58ec700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc001eb0 tx=0x7f1ecc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.378+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc005d70 con 0x7f1ed006a770 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.379+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc0070d0 con 0x7f1ed006a770 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.379+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed009a6f0 con 0x7f1ed006a770 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.379+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc007460 con 0x7f1ed006a770 2023-10-03T10:14:58.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.379+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed011f720 con 0x7f1ed006a770 2023-10-03T10:14:58.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.380+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb80052e0 con 0x7f1ed006a770 2023-10-03T10:14:58.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.381+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ecc0075c0 con 0x7f1ed006a770 2023-10-03T10:14:58.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.381+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ecc03eff0 con 0x7f1ed006a770 2023-10-03T10:14:58.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.386+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ecc01bb10 con 0x7f1ed006a770 2023-10-03T10:14:58.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 Processor -- start 2023-10-03T10:14:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 -- start start 2023-10-03T10:14:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d4012cf60 0x7f5d4006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d4012f8b0 0x7f5d4012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4012cd90 con 0x7f5d40130260 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.412+0000 7f5d483c9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4012d330 con 0x7f5d4012f8b0 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d483c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d401306e0 con 0x7f5d4012cf60 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d4012f8b0 0x7f5d4012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d46966700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5d40130260 0x7f5d40136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48200/0 (socket says 172.21.15.19:48200) 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d4012f8b0 0x7f5d4012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50704/0 (socket says 172.21.15.19:50704) 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d46966700 1 -- 172.21.15.19:0/2096561045 learned_addr learned my addr 172.21.15.19:0/2096561045 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d46165700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d4012cf60 0x7f5d4006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 -- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d4012cf60 msgr2=0x7f5d4006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d4012cf60 0x7f5d4006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 -- 172.21.15.19:0/2096561045 >> v1:172.21.15.19:6789/0 conn(0x7f5d40130260 legacy=0x7f5d40136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 -- 172.21.15.19:0/2096561045 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d40071780 con 0x7f5d4012f8b0 2023-10-03T10:14:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45163700 1 -- 172.21.15.19:0/2096561045 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117374328 0 0) 0x7f5d4012cd90 con 0x7f5d40130260 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.413+0000 7f5d45964700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d4012fd20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000a9e0 tx=0x7f5d3000acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d07664c4d84140 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d45163700 1 -- 172.21.15.19:0/2096561045 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000cb70 con 0x7f5d4012f8b0 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d45163700 1 -- 172.21.15.19:0/2096561045 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000ccd0 con 0x7f5d4012f8b0 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d45163700 1 -- 172.21.15.19:0/2096561045 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30010640 con 0x7f5d4012f8b0 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 -- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 msgr2=0x7f5d4012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d4012fd20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5d3000a9e0 tx=0x7f5d3000acf0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 -- 172.21.15.19:0/2096561045 shutdown_connections 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d4012cf60 0x7f5d4006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 --2- 172.21.15.19:0/2096561045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d4012fd20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 -- 172.21.15.19:0/2096561045 >> 172.21.15.19:0/2096561045 conn(0x7f5d400a2aa0 msgr2=0x7f5d400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.414+0000 7f5d483c9700 1 -- 172.21.15.19:0/2096561045 shutdown_connections 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.415+0000 7f5d483c9700 1 -- 172.21.15.19:0/2096561045 wait complete. 2023-10-03T10:14:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.415+0000 7f5d483c9700 1 Processor -- start 2023-10-03T10:14:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 -- start start 2023-10-03T10:14:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d4012cf60 0x7f5d40128de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d40129320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4009cf60 con 0x7f5d4012f8b0 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4009cd70 con 0x7f5d40130260 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d483c9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4009d230 con 0x7f5d4012cf60 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d46966700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d46966700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52122/0 (socket says 172.21.15.19:52122) 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d46966700 1 -- 172.21.15.19:0/3032931720 learned_addr learned my addr 172.21.15.19:0/3032931720 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d45964700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d40129320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.416+0000 7f5d46165700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d4012cf60 0x7f5d40128de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 -- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d4012cf60 msgr2=0x7f5d40128de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d4012cf60 0x7f5d40128de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 -- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 msgr2=0x7f5d40129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d40129320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 -- 172.21.15.19:0/3032931720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3000a640 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d46966700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d38002230 tx=0x7f5d3800cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800ab70 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d40129860 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4009e730 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800acd0 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.417+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380072d0 con 0x7f5d40130260 2023-10-03T10:14:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.418+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d38007430 con 0x7f5d40130260 2023-10-03T10:14:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.418+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d3803f510 con 0x7f5d40130260 2023-10-03T10:14:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.419+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d280052e0 con 0x7f5d40130260 2023-10-03T10:14:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.429+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d38018020 con 0x7f5d40130260 2023-10-03T10:14:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.440+0000 7f359c036700 1 Processor -- start 2023-10-03T10:14:58.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.440+0000 7f359c036700 1 -- start start 2023-10-03T10:14:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359c036700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35940a1510 0x7f3594138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359c036700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 0x7f359413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359c036700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359409edd0 con 0x7f35940a0a30 2023-10-03T10:14:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359c036700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35940a18e0 con 0x7f35940a1510 2023-10-03T10:14:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359c036700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f359409e1f0 con 0x7f3594139250 2023-10-03T10:14:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f35995d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35940a1510 0x7f3594138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f3599dd2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35940a0a30 0x7f35940a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48202/0 (socket says 172.21.15.19:48202) 2023-10-03T10:14:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f3599dd2700 1 -- 172.21.15.19:0/2339670286 learned_addr learned my addr 172.21.15.19:0/2339670286 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.441+0000 7f359a5d3700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 0x7f359413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f35995d1700 1 -- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 msgr2=0x7f359413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f35995d1700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 0x7f359413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f35995d1700 1 -- 172.21.15.19:0/2339670286 >> v1:172.21.15.19:6789/0 conn(0x7f35940a0a30 legacy=0x7f35940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f35995d1700 1 -- 172.21.15.19:0/2339670286 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359409dc50 con 0x7f35940a1510 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f359a5d3700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 0x7f359413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:58.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f35995d1700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f3594138d10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3584009840 tx=0x7f3584009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d0763070bdb4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f3598dd0700 1 -- 172.21.15.19:0/2339670286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011830 con 0x7f35940a1510 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f3598dd0700 1 -- 172.21.15.19:0/2339670286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3584011990 con 0x7f35940a1510 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.442+0000 7f3598dd0700 1 -- 172.21.15.19:0/2339670286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584011d20 con 0x7f35940a1510 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 -- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 msgr2=0x7f3594138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f3594138d10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3584009840 tx=0x7f3584009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 -- 172.21.15.19:0/2339670286 shutdown_connections 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3594139250 0x7f359413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 --2- 172.21.15.19:0/2339670286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f3594138d10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 -- 172.21.15.19:0/2339670286 >> 172.21.15.19:0/2339670286 conn(0x7f35940a6550 msgr2=0x7f35940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 -- 172.21.15.19:0/2339670286 shutdown_connections 2023-10-03T10:14:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.443+0000 7f359c036700 1 -- 172.21.15.19:0/2339670286 wait complete. 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.444+0000 7f359c036700 1 Processor -- start 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.444+0000 7f359c036700 1 -- start start 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35940a0a30 0x7f35941c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3594139250 0x7f3594121840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35941c92f0 con 0x7f35940a1510 2023-10-03T10:14:58.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3594123450 con 0x7f3594139250 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359c036700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3594123a70 con 0x7f35940a0a30 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f3599dd2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35940a0a30 0x7f35941c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50724/0 (socket says 172.21.15.19:50724) 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 -- 172.21.15.19:0/1243860679 learned_addr learned my addr 172.21.15.19:0/1243860679 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f359a5d3700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3594139250 0x7f3594121840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 -- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35940a0a30 msgr2=0x7f35941c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35940a0a30 0x7f35941c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 -- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3594139250 msgr2=0x7f3594121840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3594139250 0x7f3594121840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.445+0000 7f35995d1700 1 -- 172.21.15.19:0/1243860679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c009a70 con 0x7f35940a1510 2023-10-03T10:14:58.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f35995d1700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f35840090b0 tx=0x7f3584004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35840036a0 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358401f070 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3584003a20 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840094a0 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.446+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35940a0220 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.447+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3584003b80 con 0x7f35940a1510 2023-10-03T10:14:58.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.447+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3594074ea0 con 0x7f35940a1510 2023-10-03T10:14:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.448+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3584021070 con 0x7f35940a1510 2023-10-03T10:14:58.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.452+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f358402f3a0 con 0x7f35940a1510 2023-10-03T10:14:58.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.636+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f333c11de40 con 0x7f333c1380f0 2023-10-03T10:14:58.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.636+0000 7f33237fe700 1 -- 172.21.15.19:0/1611581488 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f333402c020 con 0x7f333c1380f0 2023-10-03T10:14:58.636 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 msgr2=0x7f333c1d4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3334014040 tx=0x7f3334004ad0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 shutdown_connections 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f333c1380f0 0x7f333c1d4ec0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f333c06c0e0 0x7f333c11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 --2- 172.21.15.19:0/1611581488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f333c134ec0 0x7f333c11ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 >> 172.21.15.19:0/1611581488 conn(0x7f333c0a4210 msgr2=0x7f333c099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.638+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 shutdown_connections 2023-10-03T10:14:58.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.639+0000 7f33417e6700 1 -- 172.21.15.19:0/1611581488 wait complete. 2023-10-03T10:14:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.649+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1eb8005860 con 0x7f1ed006a770 2023-10-03T10:14:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.649+0000 7f1ec67fc700 1 -- 172.21.15.19:0/781741792 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ecc017070 con 0x7f1ed006a770 2023-10-03T10:14:58.649 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:14:58.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 msgr2=0x7f1ed011b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc001eb0 tx=0x7f1ecc00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 shutdown_connections 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed0136d80 0x7f1ed011bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed006a770 0x7f1ed011b470 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 --2- 172.21.15.19:0/781741792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed006b250 0x7f1ed011b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 >> 172.21.15.19:0/781741792 conn(0x7f1ed0066f50 msgr2=0x7f1ed00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:14:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 shutdown_connections 2023-10-03T10:14:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.653+0000 7f1ed7b50700 1 -- 172.21.15.19:0/781741792 wait complete. 2023-10-03T10:14:58.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:14:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.680+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5d28005590 con 0x7f5d40130260 2023-10-03T10:14:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.680+0000 7f5d36ffd700 1 -- 172.21.15.19:0/3032931720 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d3800ae40 con 0x7f5d40130260 2023-10-03T10:14:58.680 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 msgr2=0x7f5d401c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d38002230 tx=0x7f5d3800cf50 comp rx=0 tx=0).stop 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 shutdown_connections 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d40130260 0x7f5d401c3eb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d4012cf60 0x7f5d40128de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 --2- 172.21.15.19:0/3032931720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d4012f8b0 0x7f5d40129320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 >> 172.21.15.19:0/3032931720 conn(0x7f5d400a2aa0 msgr2=0x7f5d400a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 shutdown_connections 2023-10-03T10:14:58.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.683+0000 7f5d483c9700 1 -- 172.21.15.19:0/3032931720 wait complete. 2023-10-03T10:14:58.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.702+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f35940a28e0 con 0x7f35940a1510 2023-10-03T10:14:58.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.703+0000 7f358a7fc700 1 -- 172.21.15.19:0/1243860679 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f358402b070 con 0x7f35940a1510 2023-10-03T10:14:58.703 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 msgr2=0x7f35941c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f35840090b0 tx=0x7f3584004750 comp rx=0 tx=0).stop 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 shutdown_connections 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3594139250 0x7f3594121840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35940a0a30 0x7f35941c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 --2- 172.21.15.19:0/1243860679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35940a1510 0x7f35941c8db0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 >> 172.21.15.19:0/1243860679 conn(0x7f35940a6550 msgr2=0x7f3594137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 shutdown_connections 2023-10-03T10:14:58.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:58.705+0000 7f359c036700 1 -- 172.21.15.19:0/1243860679 wait complete. 2023-10-03T10:14:58.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:14:59.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:14:59.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:14:59.697 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:14:59.719 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.812+0000 7fe38858e700 1 Processor -- start 2023-10-03T10:14:59.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.812+0000 7fe38858e700 1 -- start start 2023-10-03T10:14:59.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe38858e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe3801338a0 0x7fe380133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe38858e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe38858e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38006ef30 con 0x7fe38009de50 2023-10-03T10:14:59.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe38858e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38006fef0 con 0x7fe3801338a0 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe38858e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801334b0 con 0x7fe38009e930 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe386b2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe386b2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57128/0 (socket says 172.21.15.19:57128) 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe385b29700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe38009de50 0x7fe38009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48208/0 (socket says 172.21.15.19:48208) 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.813+0000 7fe386b2b700 1 -- 172.21.15.19:0/16636822 learned_addr learned my addr 172.21.15.19:0/16636822 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe386b2b700 1 -- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe3801338a0 msgr2=0x7fe380133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe386b2b700 1 --2- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe3801338a0 0x7fe380133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe386b2b700 1 -- 172.21.15.19:0/16636822 >> v1:172.21.15.19:6789/0 conn(0x7fe38009de50 legacy=0x7fe38009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe386b2b700 1 -- 172.21.15.19:0/16636822 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38006fc30 con 0x7fe38009e930 2023-10-03T10:14:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe386b2b700 1 --2- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe378009e80 tx=0x7fe37800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae22853d002b7a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe385328700 1 -- 172.21.15.19:0/16636822 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800e070 con 0x7fe38009e930 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe385328700 1 -- 172.21.15.19:0/16636822 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800b9c0 con 0x7fe38009e930 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.814+0000 7fe385328700 1 -- 172.21.15.19:0/16636822 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800bd70 con 0x7fe38009e930 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 -- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 msgr2=0x7fe38013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 --2- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe378009e80 tx=0x7fe37800b330 comp rx=0 tx=0).stop 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 -- 172.21.15.19:0/16636822 shutdown_connections 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 --2- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe38009e930 0x7fe38013b740 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 --2- 172.21.15.19:0/16636822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe3801338a0 0x7fe380133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 -- 172.21.15.19:0/16636822 >> 172.21.15.19:0/16636822 conn(0x7fe3800a2aa0 msgr2=0x7fe3800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 -- 172.21.15.19:0/16636822 shutdown_connections 2023-10-03T10:14:59.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.815+0000 7fe38858e700 1 -- 172.21.15.19:0/16636822 wait complete. 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.816+0000 7fe38858e700 1 Processor -- start 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.816+0000 7fe38858e700 1 -- start start 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 0x7fe38011a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe38009e930 0x7fe38011ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38011db40 con 0x7fe38009de50 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38011c2e0 con 0x7fe38009e930 2023-10-03T10:14:59.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38858e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe38011d490 con 0x7fe3801338a0 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57138/0 (socket says 172.21.15.19:57138) 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 -- 172.21.15.19:0/3183896142 learned_addr learned my addr 172.21.15.19:0/3183896142 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38632a700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 0x7fe38011a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 -- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe38009e930 msgr2=0x7fe38011ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe38009e930 0x7fe38011ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 -- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 msgr2=0x7fe38011a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 0x7fe38011a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe386b2b700 1 -- 172.21.15.19:0/3183896142 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009b30 con 0x7fe3801338a0 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.817+0000 7fe38632a700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 0x7fe38011a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe386b2b700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe37800b370 tx=0x7fe378004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3780042d0 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378004450 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38006f640 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378004800 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.818+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38011e0e0 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.819+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe37801c440 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.819+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38011dcb0 con 0x7fe3801338a0 2023-10-03T10:14:59.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.819+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe3780424f0 con 0x7fe3801338a0 2023-10-03T10:14:59.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.828+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe378019940 con 0x7fe3801338a0 2023-10-03T10:14:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.847+0000 7f7b7345f700 1 Processor -- start 2023-10-03T10:14:59.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 -- start start 2023-10-03T10:14:59.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 0x7f7b6c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b6c134170 0x7f7b6c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c09edd0 con 0x7f7b6c0a1340 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c09e1f0 con 0x7f7b6c134170 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.848+0000 7f7b7345f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c09dc50 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b719fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7b6c134170 0x7f7b6c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b709fa700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7b6c0a1340 0x7f7b6c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48220/0 (socket says 172.21.15.19:48220) 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b709fa700 1 -- 172.21.15.19:0/4217935358 learned_addr learned my addr 172.21.15.19:0/4217935358 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:59.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 --2- 172.21.15.19:0/4217935358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 0x7f7b6c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 -- 172.21.15.19:0/4217935358 >> v2:172.21.15.19:3300/0 conn(0x7f7b6c134170 msgr2=0x7f7b6c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 --2- 172.21.15.19:0/4217935358 >> v2:172.21.15.19:3300/0 conn(0x7f7b6c134170 0x7f7b6c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 -- 172.21.15.19:0/4217935358 >> v1:172.21.15.19:6789/0 conn(0x7f7b6c0a1340 legacy=0x7f7b6c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 -- 172.21.15.19:0/4217935358 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0a1fe0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b711fb700 1 --2- 172.21.15.19:0/4217935358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 0x7f7b6c0a0e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009840 tx=0x7f7b68009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=893969448b78d39a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.849+0000 7f7b63fff700 1 -- 172.21.15.19:0/4217935358 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011830 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b63fff700 1 -- 172.21.15.19:0/4217935358 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b68011990 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b63fff700 1 -- 172.21.15.19:0/4217935358 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68011d20 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 -- 172.21.15.19:0/4217935358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 msgr2=0x7f7b6c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 --2- 172.21.15.19:0/4217935358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 0x7f7b6c0a0e00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7b68009840 tx=0x7f7b68009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 -- 172.21.15.19:0/4217935358 shutdown_connections 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 --2- 172.21.15.19:0/4217935358 >> v2:172.21.15.19:3300/0 conn(0x7f7b6c134170 0x7f7b6c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 --2- 172.21.15.19:0/4217935358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c0a0a30 0x7f7b6c0a0e00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 -- 172.21.15.19:0/4217935358 >> 172.21.15.19:0/4217935358 conn(0x7f7b6c0a6550 msgr2=0x7f7b6c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.850+0000 7f7b7345f700 1 -- 172.21.15.19:0/4217935358 shutdown_connections 2023-10-03T10:14:59.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.851+0000 7f7b7345f700 1 -- 172.21.15.19:0/4217935358 wait complete. 2023-10-03T10:14:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.852+0000 7f7b7345f700 1 Processor -- start 2023-10-03T10:14:59.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 -- start start 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 0x7f7b6c1234b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c134170 0x7f7b6c1c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c125f70 con 0x7f7b6c0a1340 2023-10-03T10:14:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1251c0 con 0x7f7b6c134170 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b7345f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c122e20 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b709fa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b709fa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50734/0 (socket says 172.21.15.19:50734) 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b709fa700 1 -- 172.21.15.19:0/2484620409 learned_addr learned my addr 172.21.15.19:0/2484620409 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b711fb700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 0x7f7b6c1234b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.853+0000 7f7b719fc700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c134170 0x7f7b6c1c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 -- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c134170 msgr2=0x7f7b6c1c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c134170 0x7f7b6c1c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 -- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 msgr2=0x7f7b6c1239f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 -- 172.21.15.19:0/2484620409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680094a0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b709fa700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b711fb700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 0x7f7b6c1234b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b68016000 tx=0x7f7b68004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b680036a0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6801f070 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b68003a40 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.854+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c123060 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.855+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c126b60 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.856+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b68003ba0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.856+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c074ea0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.856+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b68021070 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.862+0000 7f60a1d7f700 1 Processor -- start 2023-10-03T10:14:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 -- start start 2023-10-03T10:14:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f609c09e410 0x7f609c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609c09f130 con 0x7f609c09e000 2023-10-03T10:14:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f609c09f520 con 0x7f609c09e410 2023-10-03T10:14:59.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.863+0000 7f60a1d7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c09e930 con 0x7f609c09d6f0 2023-10-03T10:14:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f609c09e410 0x7f609c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609affd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f609c09e000 0x7f609c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48224/0 (socket says 172.21.15.19:48224) 2023-10-03T10:14:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609affd700 1 -- 172.21.15.19:0/2863397917 learned_addr learned my addr 172.21.15.19:0/2863397917 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:14:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609b7fe700 1 --2- 172.21.15.19:0/2863397917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b6802f3a0 con 0x7f7b6c0a0a30 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609b7fe700 1 -- 172.21.15.19:0/2863397917 >> v2:172.21.15.19:3300/0 conn(0x7f609c09e410 msgr2=0x7f609c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609b7fe700 1 --2- 172.21.15.19:0/2863397917 >> v2:172.21.15.19:3300/0 conn(0x7f609c09e410 0x7f609c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609b7fe700 1 -- 172.21.15.19:0/2863397917 >> v1:172.21.15.19:6789/0 conn(0x7f609c09e000 legacy=0x7f609c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609a7fc700 1 -- 172.21.15.19:0/2863397917 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632605922 0 0) 0x7f609c09f130 con 0x7f609c09e000 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.865+0000 7f609b7fe700 1 -- 172.21.15.19:0/2863397917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c09b2d0 con 0x7f609c09d6f0 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.866+0000 7f609b7fe700 1 --2- 172.21.15.19:0/2863397917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c09dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f608c009840 tx=0x7f608c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf7c7d84ae3a7b1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.866+0000 7f609a7fc700 1 -- 172.21.15.19:0/2863397917 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011830 con 0x7f609c09d6f0 2023-10-03T10:14:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.866+0000 7f609a7fc700 1 -- 172.21.15.19:0/2863397917 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c011990 con 0x7f609c09d6f0 2023-10-03T10:14:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.866+0000 7f609a7fc700 1 -- 172.21.15.19:0/2863397917 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011d20 con 0x7f609c09d6f0 2023-10-03T10:14:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 -- 172.21.15.19:0/2863397917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 msgr2=0x7f609c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/2863397917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c09dac0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f608c009840 tx=0x7f608c009b50 comp rx=0 tx=0).stop 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 -- 172.21.15.19:0/2863397917 shutdown_connections 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/2863397917 >> v2:172.21.15.19:3300/0 conn(0x7f609c09e410 0x7f609c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/2863397917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c09dac0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 -- 172.21.15.19:0/2863397917 >> 172.21.15.19:0/2863397917 conn(0x7f609c066f50 msgr2=0x7f609c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 -- 172.21.15.19:0/2863397917 shutdown_connections 2023-10-03T10:14:59.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.867+0000 7f60a1d7f700 1 -- 172.21.15.19:0/2863397917 wait complete. 2023-10-03T10:14:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.868+0000 7f60a1d7f700 1 Processor -- start 2023-10-03T10:14:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 -- start start 2023-10-03T10:14:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f609c09e000 0x7f609c13a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c09e410 0x7f609c13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609c1302c0 con 0x7f609c09e410 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609c131060 con 0x7f609c09d6f0 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.869+0000 7f60a1d7f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f609c0a1e20 con 0x7f609c09e000 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52188/0 (socket says 172.21.15.19:52188) 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 -- 172.21.15.19:0/1245772762 learned_addr learned my addr 172.21.15.19:0/1245772762 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609affd700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f609c09e000 0x7f609c13a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609bfff700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c09e410 0x7f609c13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 -- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f609c09e000 msgr2=0x7f609c13a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f609c09e000 0x7f609c13a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 -- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c09e410 msgr2=0x7f609c13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c09e410 0x7f609c13a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 -- 172.21.15.19:0/1245772762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608c0094a0 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.870+0000 7f609b7fe700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f608c009b90 tx=0x7f608c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c0036a0 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c01e070 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c003a20 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c09c700 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609c130aa0 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.871+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f608c003b80 con 0x7f609c09d6f0 2023-10-03T10:14:59.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.872+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f608c040500 con 0x7f609c09d6f0 2023-10-03T10:14:59.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.873+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609c074ea0 con 0x7f609c09d6f0 2023-10-03T10:14:59.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.883+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f608c015080 con 0x7f609c09d6f0 2023-10-03T10:14:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.898+0000 7f88232f9700 1 Processor -- start 2023-10-03T10:14:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 -- start start 2023-10-03T10:14:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f881c138d80 0x7f881c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c0a2a70 con 0x7f881c0a0a30 2023-10-03T10:14:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0a01d0 con 0x7f881c138d80 2023-10-03T10:14:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f88232f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c09e2b0 con 0x7f881c09d630 2023-10-03T10:14:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f8820894700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f8820894700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52190/0 (socket says 172.21.15.19:52190) 2023-10-03T10:14:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.899+0000 7f8820894700 1 -- 172.21.15.19:0/4125306998 learned_addr learned my addr 172.21.15.19:0/4125306998 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8821896700 1 --2- 172.21.15.19:0/4125306998 >> v2:172.21.15.19:3300/0 conn(0x7f881c138d80 0x7f881c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8820894700 1 -- 172.21.15.19:0/4125306998 >> v2:172.21.15.19:3300/0 conn(0x7f881c138d80 msgr2=0x7f881c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8820894700 1 --2- 172.21.15.19:0/4125306998 >> v2:172.21.15.19:3300/0 conn(0x7f881c138d80 0x7f881c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8820894700 1 -- 172.21.15.19:0/4125306998 >> v1:172.21.15.19:6789/0 conn(0x7f881c0a0a30 legacy=0x7f881c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8820894700 1 -- 172.21.15.19:0/4125306998 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c09dc50 con 0x7f881c09d630 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8820894700 1 --2- 172.21.15.19:0/4125306998 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f880c0098f0 tx=0x7f880c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccca5cafbfeffbc8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8813fff700 1 -- 172.21.15.19:0/4125306998 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c011830 con 0x7f881c09d630 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8813fff700 1 -- 172.21.15.19:0/4125306998 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c011990 con 0x7f881c09d630 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.900+0000 7f8813fff700 1 -- 172.21.15.19:0/4125306998 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c011d20 con 0x7f881c09d630 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 -- 172.21.15.19:0/4125306998 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 msgr2=0x7f881c0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 --2- 172.21.15.19:0/4125306998 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f880c0098f0 tx=0x7f880c009c00 comp rx=0 tx=0).stop 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 -- 172.21.15.19:0/4125306998 shutdown_connections 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 --2- 172.21.15.19:0/4125306998 >> v2:172.21.15.19:3300/0 conn(0x7f881c138d80 0x7f881c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 --2- 172.21.15.19:0/4125306998 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c09d630 0x7f881c0a1510 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 -- 172.21.15.19:0/4125306998 >> 172.21.15.19:0/4125306998 conn(0x7f881c0a3050 msgr2=0x7f881c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 -- 172.21.15.19:0/4125306998 shutdown_connections 2023-10-03T10:14:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.901+0000 7f88232f9700 1 -- 172.21.15.19:0/4125306998 wait complete. 2023-10-03T10:14:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.902+0000 7f88232f9700 1 Processor -- start 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.902+0000 7f88232f9700 1 -- start start 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f881c0a0a30 0x7f881c120a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c121490 0x7f881c1371a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1241c0 con 0x7f881c138d80 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1234a0 con 0x7f881c121490 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f88232f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881c122a50 con 0x7f881c0a0a30 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50762/0 (socket says 172.21.15.19:50762) 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 -- 172.21.15.19:0/2764949931 learned_addr learned my addr 172.21.15.19:0/2764949931 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8821095700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f881c0a0a30 0x7f881c120a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8821896700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c121490 0x7f881c1371a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 -- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f881c0a0a30 msgr2=0x7f881c120a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f881c0a0a30 0x7f881c120a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 -- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c121490 msgr2=0x7f881c1371a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c121490 0x7f881c1371a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 -- 172.21.15.19:0/2764949931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009550 con 0x7f881c138d80 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.903+0000 7f8820894700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f880c009c40 tx=0x7f880c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.904+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0045d0 con 0x7f881c138d80 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.904+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0036a0 con 0x7f881c138d80 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.904+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c0a4e20 con 0x7f881c138d80 2023-10-03T10:14:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.904+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c003a10 con 0x7f881c138d80 2023-10-03T10:14:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.904+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c124c30 con 0x7f881c138d80 2023-10-03T10:14:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.905+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0747f0 con 0x7f881c138d80 2023-10-03T10:14:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.906+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f880c021070 con 0x7f881c138d80 2023-10-03T10:14:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.906+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f880c040b00 con 0x7f881c138d80 2023-10-03T10:14:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:14:59.911+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f880c00b3e0 con 0x7f881c138d80 2023-10-03T10:15:00.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.067+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe380074ea0 con 0x7fe3801338a0 2023-10-03T10:15:00.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.067+0000 7fe376ffd700 1 -- 172.21.15.19:0/3183896142 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe37801b3a0 con 0x7fe3801338a0 2023-10-03T10:15:00.068 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 msgr2=0x7fe38011b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe37800b370 tx=0x7fe378004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 shutdown_connections 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe3801338a0 0x7fe38011b040 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe38009de50 0x7fe38011a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 --2- 172.21.15.19:0/3183896142 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe38009e930 0x7fe38011ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 >> 172.21.15.19:0/3183896142 conn(0x7fe3800a2aa0 msgr2=0x7fe380130710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 shutdown_connections 2023-10-03T10:15:00.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.070+0000 7fe38858e700 1 -- 172.21.15.19:0/3183896142 wait complete. 2023-10-03T10:15:00.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.081+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7b6c1336f0 con 0x7f7b6c0a0a30 2023-10-03T10:15:00.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.081+0000 7f7b61ffb700 1 -- 172.21.15.19:0/2484620409 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b6802b030 con 0x7f7b6c0a0a30 2023-10-03T10:15:00.082 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:00.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 msgr2=0x7f7b6c1234b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 0x7f7b6c1234b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7b68016000 tx=0x7f7b68004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 shutdown_connections 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c134170 0x7f7b6c1c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c0a0a30 0x7f7b6c1234b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 --2- 172.21.15.19:0/2484620409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c0a1340 0x7f7b6c1239f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 >> 172.21.15.19:0/2484620409 conn(0x7f7b6c0a6550 msgr2=0x7f7b6c09ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 shutdown_connections 2023-10-03T10:15:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.084+0000 7f7b7345f700 1 -- 172.21.15.19:0/2484620409 wait complete. 2023-10-03T10:15:00.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.107+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f609c06c360 con 0x7f609c09d6f0 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.107+0000 7f6083fff700 1 -- 172.21.15.19:0/1245772762 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f608c02d450 con 0x7f609c09d6f0 2023-10-03T10:15:00.108 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 msgr2=0x7f609c139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f608c009b90 tx=0x7f608c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 shutdown_connections 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f609c09e410 0x7f609c13a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f609c09d6f0 0x7f609c139eb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 --2- 172.21.15.19:0/1245772762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f609c09e000 0x7f609c13a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 >> 172.21.15.19:0/1245772762 conn(0x7f609c066f50 msgr2=0x7f609c070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 shutdown_connections 2023-10-03T10:15:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.110+0000 7f60a1d7f700 1 -- 172.21.15.19:0/1245772762 wait complete. 2023-10-03T10:15:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.117+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f881c072980 con 0x7f881c138d80 2023-10-03T10:15:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.118+0000 7f8811ffb700 1 -- 172.21.15.19:0/2764949931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f880c015020 con 0x7f881c138d80 2023-10-03T10:15:00.119 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 msgr2=0x7f881c120f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f880c009c40 tx=0x7f880c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 shutdown_connections 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f881c121490 0x7f881c1371a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f881c0a0a30 0x7f881c120a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 --2- 172.21.15.19:0/2764949931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f881c138d80 0x7f881c120f50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 >> 172.21.15.19:0/2764949931 conn(0x7f881c0a3050 msgr2=0x7f881c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 shutdown_connections 2023-10-03T10:15:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:00.120+0000 7f88232f9700 1 -- 172.21.15.19:0/2764949931 wait complete. 2023-10-03T10:15:00.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:00.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:01.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:01.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:01.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:01.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:01.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.236+0000 7f2ecc941700 1 Processor -- start 2023-10-03T10:15:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.237+0000 7f2ecc941700 1 -- start start 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ecc941700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8136830 0x7f2ec8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ecc941700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ec8139150 0x7f2ec813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ecc941700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec806f720 con 0x7f2ec81338c0 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ecc941700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec8070c80 con 0x7f2ec8139150 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ecc941700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec806fce0 con 0x7f2ec8136830 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2ec81338c0 0x7f2ec8133c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48246/0 (socket says 172.21.15.19:48246) 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec659c700 1 -- 172.21.15.19:0/445213406 learned_addr learned my addr 172.21.15.19:0/445213406 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/445213406 >> v2:172.21.15.19:3300/0 conn(0x7f2ec8139150 0x7f2ec813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec5d9b700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8136830 0x7f2ec8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec559a700 1 -- 172.21.15.19:0/445213406 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676524558 0 0) 0x7f2ec806f720 con 0x7f2ec81338c0 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec559a700 1 -- 172.21.15.19:0/445213406 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eb00035b0 con 0x7f2ec81338c0 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8136830 msgr2=0x7f2ec8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8136830 0x7f2ec8138c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/445213406 >> v1:172.21.15.19:6789/0 conn(0x7f2ec81338c0 legacy=0x7f2ec8133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.238+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/445213406 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec81336a0 con 0x7f2ec8139150 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.239+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec8139150 0x7f2ec813b530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009d90 tx=0x7f2ec000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f776470d8e90425f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.239+0000 7f2ec559a700 1 -- 172.21.15.19:0/445213406 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000e070 con 0x7f2ec8139150 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.239+0000 7f2ec559a700 1 -- 172.21.15.19:0/445213406 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000bae0 con 0x7f2ec8139150 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.239+0000 7f2ec559a700 1 -- 172.21.15.19:0/445213406 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec000be90 con 0x7f2ec8139150 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 -- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec8139150 msgr2=0x7f2ec813b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec8139150 0x7f2ec813b530 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009d90 tx=0x7f2ec000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 -- 172.21.15.19:0/445213406 shutdown_connections 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec8139150 0x7f2ec813b530 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 --2- 172.21.15.19:0/445213406 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8136830 0x7f2ec8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 -- 172.21.15.19:0/445213406 >> 172.21.15.19:0/445213406 conn(0x7f2ec80a2aa0 msgr2=0x7f2ec80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 -- 172.21.15.19:0/445213406 shutdown_connections 2023-10-03T10:15:01.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.240+0000 7f2ecc941700 1 -- 172.21.15.19:0/445213406 wait complete. 2023-10-03T10:15:01.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.241+0000 7f2ecc941700 1 Processor -- start 2023-10-03T10:15:01.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.241+0000 7f2ecc941700 1 -- start start 2023-10-03T10:15:01.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 0x7f2ec8119d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ec8136830 0x7f2ec811a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 0x7f2ec811a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec806f960 con 0x7f2ec81338c0 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec811c0d0 con 0x7f2ec8139150 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ecc941700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec812fb50 con 0x7f2ec8136830 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 0x7f2ec8119d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 0x7f2ec8119d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50778/0 (socket says 172.21.15.19:50778) 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 0x7f2ec811a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec659c700 1 -- 172.21.15.19:0/961016981 learned_addr learned my addr 172.21.15.19:0/961016981 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ec8136830 msgr2=0x7f2ec811a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ec8136830 0x7f2ec811a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 msgr2=0x7f2ec8119d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 0x7f2ec8119d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.242+0000 7f2ec6d9d700 1 -- 172.21.15.19:0/961016981 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009a70 con 0x7f2ec8139150 2023-10-03T10:15:01.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.243+0000 7f2ec6d9d700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 0x7f2ec811a780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0015000 tx=0x7f2ec0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.243+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0004540 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.243+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec00046c0 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.243+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0012430 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.244+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec811b910 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.244+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec811ce70 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.245+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ec0012590 con 0x7f2ec8139150 2023-10-03T10:15:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.245+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8074ea0 con 0x7f2ec8139150 2023-10-03T10:15:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.245+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ec00412f0 con 0x7f2ec8139150 2023-10-03T10:15:01.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.254+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ec002d940 con 0x7f2ec8139150 2023-10-03T10:15:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.279+0000 7f211fa90700 1 Processor -- start 2023-10-03T10:15:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.279+0000 7f211fa90700 1 -- start start 2023-10-03T10:15:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211fa90700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211fa90700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 0x7f211813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211fa90700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211809b120 con 0x7f211809d6f0 2023-10-03T10:15:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211fa90700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211806b460 con 0x7f2118139170 2023-10-03T10:15:01.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211fa90700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211809a7e0 con 0x7f211809e1d0 2023-10-03T10:15:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211d82c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f211809d6f0 0x7f211809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48260/0 (socket says 172.21.15.19:48260) 2023-10-03T10:15:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211d82c700 1 -- 172.21.15.19:0/2379650766 learned_addr learned my addr 172.21.15.19:0/2379650766 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211d02b700 1 --2- 172.21.15.19:0/2379650766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211c82a700 1 -- 172.21.15.19:0/2379650766 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2589313584 0 0) 0x7f211809b120 con 0x7f211809d6f0 2023-10-03T10:15:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.280+0000 7f211c82a700 1 -- 172.21.15.19:0/2379650766 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21040035b0 con 0x7f211809d6f0 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211e02d700 1 --2- 172.21.15.19:0/2379650766 >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 0x7f211813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211d02b700 1 -- 172.21.15.19:0/2379650766 >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 msgr2=0x7f211813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211d02b700 1 --2- 172.21.15.19:0/2379650766 >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 0x7f211813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211d02b700 1 -- 172.21.15.19:0/2379650766 >> v1:172.21.15.19:6789/0 conn(0x7f211809d6f0 legacy=0x7f211809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211d02b700 1 -- 172.21.15.19:0/2379650766 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211809a500 con 0x7f211809e1d0 2023-10-03T10:15:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211e02d700 1 --2- 172.21.15.19:0/2379650766 >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 0x7f211813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211d02b700 1 --2- 172.21.15.19:0/2379650766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118138c30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2108009870 tx=0x7f2108009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c7e645629f2b11 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211c82a700 1 -- 172.21.15.19:0/2379650766 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108011830 con 0x7f211809e1d0 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211c82a700 1 -- 172.21.15.19:0/2379650766 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2108011990 con 0x7f211809e1d0 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.281+0000 7f211c82a700 1 -- 172.21.15.19:0/2379650766 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108011d20 con 0x7f211809e1d0 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 -- 172.21.15.19:0/2379650766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 msgr2=0x7f2118138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 --2- 172.21.15.19:0/2379650766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118138c30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2108009870 tx=0x7f2108009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 -- 172.21.15.19:0/2379650766 shutdown_connections 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 --2- 172.21.15.19:0/2379650766 >> v2:172.21.15.19:3300/0 conn(0x7f2118139170 0x7f211813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 --2- 172.21.15.19:0/2379650766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118138c30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 -- 172.21.15.19:0/2379650766 >> 172.21.15.19:0/2379650766 conn(0x7f2118066f50 msgr2=0x7f211809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 -- 172.21.15.19:0/2379650766 shutdown_connections 2023-10-03T10:15:01.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.282+0000 7f211fa90700 1 -- 172.21.15.19:0/2379650766 wait complete. 2023-10-03T10:15:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.283+0000 7f91ae7ce700 1 Processor -- start 2023-10-03T10:15:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.283+0000 7f211fa90700 1 Processor -- start 2023-10-03T10:15:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.283+0000 7f211fa90700 1 -- start start 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 -- start start 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211809d6f0 0x7f21181215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f91a809d6f0 0x7f91a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a809f130 con 0x7f91a809e000 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a809f520 con 0x7f91a809d6f0 2023-10-03T10:15:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f91ae7ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a809e930 con 0x7f91a809e410 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2118139170 0x7f2118122040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21181250e0 con 0x7f2118139170 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2118123fd0 con 0x7f211809d6f0 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.284+0000 7f211fa90700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2118123270 con 0x7f211809e1d0 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57202/0 (socket says 172.21.15.19:57202) 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 -- 172.21.15.19:0/523721831 learned_addr learned my addr 172.21.15.19:0/523721831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 -- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211809d6f0 msgr2=0x7f21181215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211809d6f0 0x7f21181215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 -- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2118139170 msgr2=0x7f2118122040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2118139170 0x7f2118122040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 -- 172.21.15.19:0/523721831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21080094a0 con 0x7f211809e1d0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211d02b700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c00 tx=0x7f2108004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080038a0 con 0x7f211809e1d0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210801f070 con 0x7f211809e1d0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2108003c40 con 0x7f211809e1d0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21180a1730 con 0x7f211809e1d0 2023-10-03T10:15:01.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.285+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118124490 con 0x7f211809e1d0 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.286+0000 7f91acd6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.286+0000 7f91acd6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52230/0 (socket says 172.21.15.19:52230) 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.286+0000 7f91acd6b700 1 -- 172.21.15.19:0/2748578256 learned_addr learned my addr 172.21.15.19:0/2748578256 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91a7fff700 1 --2- 172.21.15.19:0/2748578256 >> v2:172.21.15.19:3300/0 conn(0x7f91a809d6f0 0x7f91a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91acd6b700 1 -- 172.21.15.19:0/2748578256 >> v2:172.21.15.19:3300/0 conn(0x7f91a809d6f0 msgr2=0x7f91a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91acd6b700 1 --2- 172.21.15.19:0/2748578256 >> v2:172.21.15.19:3300/0 conn(0x7f91a809d6f0 0x7f91a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91acd6b700 1 -- 172.21.15.19:0/2748578256 >> v1:172.21.15.19:6789/0 conn(0x7f91a809e000 legacy=0x7f91a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91acd6b700 1 -- 172.21.15.19:0/2748578256 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a809b2d0 con 0x7f91a809e410 2023-10-03T10:15:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.286+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2108026480 con 0x7f211809e1d0 2023-10-03T10:15:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2108021070 con 0x7f211809e1d0 2023-10-03T10:15:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2118074ea0 con 0x7f211809e1d0 2023-10-03T10:15:01.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91acd6b700 1 --2- 172.21.15.19:0/2748578256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d150 tx=0x7f91a000d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85c853feaee5d7d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91a6ffd700 1 -- 172.21.15.19:0/2748578256 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0010070 con 0x7f91a809e410 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91a6ffd700 1 -- 172.21.15.19:0/2748578256 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a000dd10 con 0x7f91a809e410 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.287+0000 7f91a6ffd700 1 -- 172.21.15.19:0/2748578256 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000b310 con 0x7f91a809e410 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.288+0000 7f91ae7ce700 1 -- 172.21.15.19:0/2748578256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 msgr2=0x7f91a8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.288+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/2748578256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91a000d150 tx=0x7f91a000d460 comp rx=0 tx=0).stop 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.289+0000 7f91ae7ce700 1 -- 172.21.15.19:0/2748578256 shutdown_connections 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.289+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/2748578256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809e410 0x7f91a8130d70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.289+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/2748578256 >> v2:172.21.15.19:3300/0 conn(0x7f91a809d6f0 0x7f91a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.289+0000 7f91ae7ce700 1 -- 172.21.15.19:0/2748578256 >> 172.21.15.19:0/2748578256 conn(0x7f91a8066f50 msgr2=0x7f91a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.292+0000 7f91ae7ce700 1 -- 172.21.15.19:0/2748578256 shutdown_connections 2023-10-03T10:15:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.292+0000 7f91ae7ce700 1 -- 172.21.15.19:0/2748578256 wait complete. 2023-10-03T10:15:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.292+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f210802b070 con 0x7f211809e1d0 2023-10-03T10:15:01.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.293+0000 7f91ae7ce700 1 Processor -- start 2023-10-03T10:15:01.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.293+0000 7f91ae7ce700 1 -- start start 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 0x7f91a8122250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 0x7f91a8122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 0x7f91a8122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a809c700 con 0x7f91a809e000 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8125a90 con 0x7f91a809d6f0 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91ae7ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8123f70 con 0x7f91a809e410 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91a77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 0x7f91a8122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91a77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 0x7f91a8122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50796/0 (socket says 172.21.15.19:50796) 2023-10-03T10:15:01.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91a77fe700 1 -- 172.21.15.19:0/364021222 learned_addr learned my addr 172.21.15.19:0/364021222 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91a7fff700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 0x7f91a8122250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.294+0000 7f91acd6b700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 0x7f91a8122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 -- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 msgr2=0x7f91a8122250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 0x7f91a8122250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 -- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 msgr2=0x7f91a8122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 0x7f91a8122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 -- 172.21.15.19:0/364021222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a000bd40 con 0x7f91a809e410 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91a7fff700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 0x7f91a8122250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91acd6b700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 0x7f91a8122cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91a8072a80 tx=0x7f91a0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a000b4c0 con 0x7f91a809e410 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a0009810 con 0x7f91a809e410 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a8072590 con 0x7f91a809e410 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a0009be0 con 0x7f91a809e410 2023-10-03T10:15:01.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.295+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a8126500 con 0x7f91a809e410 2023-10-03T10:15:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.296+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91a0009d40 con 0x7f91a809e410 2023-10-03T10:15:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.297+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91a0004890 con 0x7f91a809e410 2023-10-03T10:15:01.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.297+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a8074ea0 con 0x7f91a809e410 2023-10-03T10:15:01.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.302+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91a001d430 con 0x7f91a809e410 2023-10-03T10:15:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 Processor -- start 2023-10-03T10:15:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 -- start start 2023-10-03T10:15:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009d6f0 0x7f240009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f240009e000 0x7f24001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240009b120 con 0x7f240009e410 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.329+0000 7f2407022700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240006b460 con 0x7f240009e000 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f2407022700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240009a7e0 con 0x7f240009d6f0 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f240009e000 0x7f24001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f24055bf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f240009e410 0x7f2400133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48278/0 (socket says 172.21.15.19:48278) 2023-10-03T10:15:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f24055bf700 1 -- 172.21.15.19:0/111074402 learned_addr learned my addr 172.21.15.19:0/111074402 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f2404dbe700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009d6f0 0x7f240009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 -- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009d6f0 msgr2=0x7f240009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009d6f0 0x7f240009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 -- 172.21.15.19:0/111074402 >> v1:172.21.15.19:6789/0 conn(0x7f240009e410 legacy=0x7f2400133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 -- 172.21.15.19:0/111074402 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240009a500 con 0x7f240009e000 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.330+0000 7f23fffff700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001339f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009840 tx=0x7f23ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3759cd3873f9f7e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f23ff7fe700 1 -- 172.21.15.19:0/111074402 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec011830 con 0x7f240009e000 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f23ff7fe700 1 -- 172.21.15.19:0/111074402 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec011990 con 0x7f240009e000 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f23ff7fe700 1 -- 172.21.15.19:0/111074402 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec011d20 con 0x7f240009e000 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 -- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 msgr2=0x7f24001339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001339f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23ec009840 tx=0x7f23ec009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 -- 172.21.15.19:0/111074402 shutdown_connections 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009d6f0 0x7f240009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 --2- 172.21.15.19:0/111074402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001339f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 -- 172.21.15.19:0/111074402 >> 172.21.15.19:0/111074402 conn(0x7f2400066f50 msgr2=0x7f240009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 -- 172.21.15.19:0/111074402 shutdown_connections 2023-10-03T10:15:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.331+0000 7f2407022700 1 -- 172.21.15.19:0/111074402 wait complete. 2023-10-03T10:15:01.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.332+0000 7f2407022700 1 Processor -- start 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 -- start start 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f240009d6f0 0x7f24001a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009e410 0x7f24001a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24001a8800 con 0x7f240009e000 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24001a6510 con 0x7f240009e410 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f2407022700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24000a2fd0 con 0x7f240009d6f0 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f23fffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f23fffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50818/0 (socket says 172.21.15.19:50818) 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.333+0000 7f23fffff700 1 -- 172.21.15.19:0/1047889246 learned_addr learned my addr 172.21.15.19:0/1047889246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f2404dbe700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f240009d6f0 0x7f24001a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f24055bf700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009e410 0x7f24001a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 -- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f240009d6f0 msgr2=0x7f24001a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f240009d6f0 0x7f24001a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 -- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009e410 msgr2=0x7f24001a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009e410 0x7f24001a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 -- 172.21.15.19:0/1047889246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec0094a0 con 0x7f240009e000 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fffff700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0090b0 tx=0x7f23ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0038a0 con 0x7f240009e000 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec01f070 con 0x7f240009e000 2023-10-03T10:15:01.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24001a6ce0 con 0x7f240009e000 2023-10-03T10:15:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24001a7e20 con 0x7f240009e000 2023-10-03T10:15:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.334+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec003c20 con 0x7f240009e000 2023-10-03T10:15:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.335+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23ec01a430 con 0x7f240009e000 2023-10-03T10:15:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.336+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23ec021070 con 0x7f240009e000 2023-10-03T10:15:01.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.336+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e00052e0 con 0x7f240009e000 2023-10-03T10:15:01.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.341+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23ec015020 con 0x7f240009e000 2023-10-03T10:15:01.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.474+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2ec812fd90 con 0x7f2ec8139150 2023-10-03T10:15:01.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.474+0000 7f2eb6ffd700 1 -- 172.21.15.19:0/961016981 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ec002a030 con 0x7f2ec8139150 2023-10-03T10:15:01.475 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:01.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 msgr2=0x7f2ec811a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 0x7f2ec811a780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0015000 tx=0x7f2ec0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 shutdown_connections 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ec8139150 0x7f2ec811a780 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ec81338c0 0x7f2ec8119d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 --2- 172.21.15.19:0/961016981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ec8136830 0x7f2ec811a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.476+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 >> 172.21.15.19:0/961016981 conn(0x7f2ec80a2aa0 msgr2=0x7f2ec809de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.477+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 shutdown_connections 2023-10-03T10:15:01.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.477+0000 7f2ecc941700 1 -- 172.21.15.19:0/961016981 wait complete. 2023-10-03T10:15:01.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:01.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.514+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f211809f420 con 0x7f211809e1d0 2023-10-03T10:15:01.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.514+0000 7f210e7fc700 1 -- 172.21.15.19:0/523721831 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2108015030 con 0x7f211809e1d0 2023-10-03T10:15:01.515 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 msgr2=0x7f2118121b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2108000c00 tx=0x7f2108004750 comp rx=0 tx=0).stop 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 shutdown_connections 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2118139170 0x7f2118122040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211809d6f0 0x7f21181215c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 --2- 172.21.15.19:0/523721831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211809e1d0 0x7f2118121b00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 >> 172.21.15.19:0/523721831 conn(0x7f2118066f50 msgr2=0x7f211809b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 shutdown_connections 2023-10-03T10:15:01.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.517+0000 7f211fa90700 1 -- 172.21.15.19:0/523721831 wait complete. 2023-10-03T10:15:01.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.538+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f91a81258d0 con 0x7f91a809e410 2023-10-03T10:15:01.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.538+0000 7f91a4ff9700 1 -- 172.21.15.19:0/364021222 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91a00253c0 con 0x7f91a809e410 2023-10-03T10:15:01.539 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 msgr2=0x7f91a8122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 0x7f91a8122cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f91a8072a80 tx=0x7f91a0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 shutdown_connections 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91a809e410 0x7f91a8122cd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91a809d6f0 0x7f91a8122250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 --2- 172.21.15.19:0/364021222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91a809e000 0x7f91a8122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 >> 172.21.15.19:0/364021222 conn(0x7f91a8066f50 msgr2=0x7f91a8130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 shutdown_connections 2023-10-03T10:15:01.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.541+0000 7f91ae7ce700 1 -- 172.21.15.19:0/364021222 wait complete. 2023-10-03T10:15:01.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:01.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.564+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f23e0005590 con 0x7f240009e000 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.564+0000 7f23fd7fa700 1 -- 172.21.15.19:0/1047889246 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23ec003d80 con 0x7f240009e000 2023-10-03T10:15:01.565 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 msgr2=0x7f24001a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0090b0 tx=0x7f23ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 shutdown_connections 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f240009e410 0x7f24001a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f240009d6f0 0x7f24001a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 --2- 172.21.15.19:0/1047889246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f240009e000 0x7f24001a5660 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 >> 172.21.15.19:0/1047889246 conn(0x7f2400066f50 msgr2=0x7f24001bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 shutdown_connections 2023-10-03T10:15:01.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:01.567+0000 7f2407022700 1 -- 172.21.15.19:0/1047889246 wait complete. 2023-10-03T10:15:01.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:02.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:02.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:02.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:02.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.650+0000 7f1e08b81700 1 Processor -- start 2023-10-03T10:15:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.650+0000 7f1e08b81700 1 -- start start 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e08b81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 0x7f1e0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e08b81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 0x7f1e04134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e08b81700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e0409b120 con 0x7f1e0409e000 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e08b81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0406b460 con 0x7f1e0409e410 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e08b81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0409a7e0 con 0x7f1e0409d6f0 2023-10-03T10:15:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e01d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1e0409e000 0x7f1e041339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48292/0 (socket says 172.21.15.19:48292) 2023-10-03T10:15:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e01d9b700 1 -- 172.21.15.19:0/1811618984 learned_addr learned my addr 172.21.15.19:0/1811618984 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e0259c700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 0x7f1e0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.651+0000 7f1e02d9d700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 0x7f1e04134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0259c700 1 -- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 msgr2=0x7f1e04134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0259c700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 0x7f1e04134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0159a700 1 -- 172.21.15.19:0/1811618984 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920043489 0 0) 0x7f1e0409b120 con 0x7f1e0409e000 2023-10-03T10:15:02.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0259c700 1 -- 172.21.15.19:0/1811618984 >> v1:172.21.15.19:6789/0 conn(0x7f1e0409e000 legacy=0x7f1e041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0259c700 1 -- 172.21.15.19:0/1811618984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0409a500 con 0x7f1e0409d6f0 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e02d9d700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 0x7f1e04134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0259c700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 0x7f1e0409dac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1df40098a0 tx=0x7f1df4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3efac3db06b6b3da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0159a700 1 -- 172.21.15.19:0/1811618984 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4011830 con 0x7f1e0409d6f0 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0159a700 1 -- 172.21.15.19:0/1811618984 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df4011990 con 0x7f1e0409d6f0 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.652+0000 7f1e0159a700 1 -- 172.21.15.19:0/1811618984 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4011d20 con 0x7f1e0409d6f0 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 -- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 msgr2=0x7f1e0409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 0x7f1e0409dac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1df40098a0 tx=0x7f1df4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 -- 172.21.15.19:0/1811618984 shutdown_connections 2023-10-03T10:15:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409e410 0x7f1e04134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 --2- 172.21.15.19:0/1811618984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409d6f0 0x7f1e0409dac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 -- 172.21.15.19:0/1811618984 >> 172.21.15.19:0/1811618984 conn(0x7f1e04066f50 msgr2=0x7f1e0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 -- 172.21.15.19:0/1811618984 shutdown_connections 2023-10-03T10:15:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.653+0000 7f1e08b81700 1 -- 172.21.15.19:0/1811618984 wait complete. 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.655+0000 7f1e08b81700 1 Processor -- start 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.655+0000 7f1e08b81700 1 -- start start 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 0x7f1e041224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0409e000 0x7f1e04122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 0x7f1e04122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e040a1b10 con 0x7f1e0409e000 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0409c710 con 0x7f1e0409d6f0 2023-10-03T10:15:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e08b81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e04124f10 con 0x7f1e0409e410 2023-10-03T10:15:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e02d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 0x7f1e04122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e01d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0409e000 0x7f1e04122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e02d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 0x7f1e04122f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57224/0 (socket says 172.21.15.19:57224) 2023-10-03T10:15:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e02d9d700 1 -- 172.21.15.19:0/2886976994 learned_addr learned my addr 172.21.15.19:0/2886976994 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 0x7f1e041224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 -- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 msgr2=0x7f1e04122f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 0x7f1e04122f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 -- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0409e000 msgr2=0x7f1e04122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0409e000 0x7f1e04122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.656+0000 7f1e0259c700 1 -- 172.21.15.19:0/2886976994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc009a70 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.657+0000 7f1e0259c700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 0x7f1e041224e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1df4016000 tx=0x7f1df4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.657+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df4004450 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.657+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df401f070 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.657+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40094a0 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.657+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40038c0 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.658+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e04125d20 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.658+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1df4003a20 con 0x7f1e0409d6f0 2023-10-03T10:15:02.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.658+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1df4021070 con 0x7f1e0409d6f0 2023-10-03T10:15:02.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.659+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e04074ea0 con 0x7f1e0409d6f0 2023-10-03T10:15:02.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.664+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1df4015070 con 0x7f1e0409d6f0 2023-10-03T10:15:02.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.691+0000 7f048bfd7700 1 Processor -- start 2023-10-03T10:15:02.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.691+0000 7f048bfd7700 1 -- start start 2023-10-03T10:15:02.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.692+0000 7f048bfd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.692+0000 7f048bfd7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0484099a40 0x7f0484099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.692+0000 7f048bfd7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f048409a850 con 0x7f048409a3b0 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.692+0000 7f048bfd7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f048409b580 con 0x7f0484099a40 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.692+0000 7f048bfd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f04841313c0 con 0x7f0484131810 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f048a574700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f048409a3b0 0x7f0484138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48300/0 (socket says 172.21.15.19:48300) 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f048a574700 1 -- 172.21.15.19:0/2870818169 learned_addr learned my addr 172.21.15.19:0/2870818169 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 --2- 172.21.15.19:0/2870818169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489572700 1 --2- 172.21.15.19:0/2870818169 >> v2:172.21.15.19:3300/0 conn(0x7f0484099a40 0x7f0484099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 -- 172.21.15.19:0/2870818169 >> v2:172.21.15.19:3300/0 conn(0x7f0484099a40 msgr2=0x7f0484099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 --2- 172.21.15.19:0/2870818169 >> v2:172.21.15.19:3300/0 conn(0x7f0484099a40 0x7f0484099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 -- 172.21.15.19:0/2870818169 >> v1:172.21.15.19:6789/0 conn(0x7f048409a3b0 legacy=0x7f0484138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 -- 172.21.15.19:0/2870818169 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048406e8c0 con 0x7f0484131810 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0488d71700 1 -- 172.21.15.19:0/2870818169 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108962207 0 0) 0x7f048409a850 con 0x7f048409a3b0 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0489d73700 1 --2- 172.21.15.19:0/2870818169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484131be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f0480009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70e793aba3832e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0488d71700 1 -- 172.21.15.19:0/2870818169 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480011830 con 0x7f0484131810 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.693+0000 7f0488d71700 1 -- 172.21.15.19:0/2870818169 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480011990 con 0x7f0484131810 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f0488d71700 1 -- 172.21.15.19:0/2870818169 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480011d20 con 0x7f0484131810 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 -- 172.21.15.19:0/2870818169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 msgr2=0x7f0484131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 --2- 172.21.15.19:0/2870818169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484131be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0480009870 tx=0x7f0480009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 -- 172.21.15.19:0/2870818169 shutdown_connections 2023-10-03T10:15:02.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 --2- 172.21.15.19:0/2870818169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484131be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 --2- 172.21.15.19:0/2870818169 >> v2:172.21.15.19:3300/0 conn(0x7f0484099a40 0x7f0484099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 -- 172.21.15.19:0/2870818169 >> 172.21.15.19:0/2870818169 conn(0x7f04840a2aa0 msgr2=0x7f04840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 -- 172.21.15.19:0/2870818169 shutdown_connections 2023-10-03T10:15:02.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.694+0000 7f048bfd7700 1 -- 172.21.15.19:0/2870818169 wait complete. 2023-10-03T10:15:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.695+0000 7f048bfd7700 1 Processor -- start 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 -- start start 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 0x7f048406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 0x7f048406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04841222d0 con 0x7f048409a3b0 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04841233e0 con 0x7f0484099a40 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f048bfd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0484122e40 con 0x7f0484131810 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f0489d73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 0x7f048406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f0489572700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 0x7f048406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f0489d73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 0x7f048406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52296/0 (socket says 172.21.15.19:52296) 2023-10-03T10:15:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.696+0000 7f0489d73700 1 -- 172.21.15.19:0/3137291505 learned_addr learned my addr 172.21.15.19:0/3137291505 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 -- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 msgr2=0x7f0484070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 -- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 msgr2=0x7f048406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 0x7f048406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 -- 172.21.15.19:0/3137291505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04800094a0 con 0x7f048409a3b0 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f0489572700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 0x7f048406fb50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f047400e8d0 tx=0x7f047400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400c690 con 0x7f048409a3b0 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400c7f0 con 0x7f048409a3b0 2023-10-03T10:15:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04840a17b0 con 0x7f048409a3b0 2023-10-03T10:15:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0484123100 con 0x7f048409a3b0 2023-10-03T10:15:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.697+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400cb60 con 0x7f048409a3b0 2023-10-03T10:15:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.698+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f047400ccc0 con 0x7f048409a3b0 2023-10-03T10:15:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.699+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f048411a470 con 0x7f048409a3b0 2023-10-03T10:15:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.699+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0474024d80 con 0x7f048409a3b0 2023-10-03T10:15:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.704+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0474021070 con 0x7f048409a3b0 2023-10-03T10:15:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.729+0000 7fb2d7fae700 1 Processor -- start 2023-10-03T10:15:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.729+0000 7fb2d7fae700 1 -- start start 2023-10-03T10:15:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d7fae700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2d0130540 0x7fb2d0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d7fae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d7fae700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d00716a0 con 0x7fb2d0130e50 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d7fae700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d009a390 con 0x7fb2d0130540 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d7fae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0071290 con 0x7fb2d006fcf0 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52306/0 (socket says 172.21.15.19:52306) 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 -- 172.21.15.19:0/1679856291 learned_addr learned my addr 172.21.15.19:0/1679856291 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d5d4a700 1 --2- 172.21.15.19:0/1679856291 >> v2:172.21.15.19:3300/0 conn(0x7fb2d0130540 0x7fb2d0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 -- 172.21.15.19:0/1679856291 >> v2:172.21.15.19:3300/0 conn(0x7fb2d0130540 msgr2=0x7fb2d0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 --2- 172.21.15.19:0/1679856291 >> v2:172.21.15.19:3300/0 conn(0x7fb2d0130540 0x7fb2d0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d654b700 1 -- 172.21.15.19:0/1679856291 >> v1:172.21.15.19:6789/0 conn(0x7fb2d0130e50 legacy=0x7fb2d006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.730+0000 7fb2d4d48700 1 -- 172.21.15.19:0/1679856291 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867923505 0 0) 0x7fb2d00716a0 con 0x7fb2d0130e50 2023-10-03T10:15:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.731+0000 7fb2d654b700 1 -- 172.21.15.19:0/1679856291 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0130340 con 0x7fb2d006fcf0 2023-10-03T10:15:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.731+0000 7fb2d654b700 1 --2- 172.21.15.19:0/1679856291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e80 tx=0x7fb2c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f3e5f16f2b2b089 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.731+0000 7fb2d4d48700 1 -- 172.21.15.19:0/1679856291 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800e070 con 0x7fb2d006fcf0 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.731+0000 7fb2d4d48700 1 -- 172.21.15.19:0/1679856291 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c800b8d0 con 0x7fb2d006fcf0 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.731+0000 7fb2d4d48700 1 -- 172.21.15.19:0/1679856291 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c800bc80 con 0x7fb2d006fcf0 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 -- 172.21.15.19:0/1679856291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 msgr2=0x7fb2d0138570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/1679856291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8009e80 tx=0x7fb2c800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 -- 172.21.15.19:0/1679856291 shutdown_connections 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/1679856291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d006fcf0 0x7fb2d0138570 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/1679856291 >> v2:172.21.15.19:3300/0 conn(0x7fb2d0130540 0x7fb2d0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 -- 172.21.15.19:0/1679856291 >> 172.21.15.19:0/1679856291 conn(0x7fb2d00a2aa0 msgr2=0x7fb2d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 -- 172.21.15.19:0/1679856291 shutdown_connections 2023-10-03T10:15:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.732+0000 7fb2d7fae700 1 -- 172.21.15.19:0/1679856291 wait complete. 2023-10-03T10:15:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 Processor -- start 2023-10-03T10:15:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 -- start start 2023-10-03T10:15:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 0x7fb2d012cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 0x7fb2d012d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d012db40 con 0x7fb2d006fcf0 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d012a7b0 con 0x7fb2d0130540 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.733+0000 7fb2d7fae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d0139640 con 0x7fb2d0130e50 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5d4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5d4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50876/0 (socket says 172.21.15.19:50876) 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5d4a700 1 -- 172.21.15.19:0/3057874949 learned_addr learned my addr 172.21.15.19:0/3057874949 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 0x7fb2d012d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5549700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 0x7fb2d012cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 -- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 msgr2=0x7fb2d012cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 0x7fb2d012cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 -- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 msgr2=0x7fb2d012ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 -- 172.21.15.19:0/3057874949 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c8009b30 con 0x7fb2d0130e50 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5d4a700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d5549700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 0x7fb2d012cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.734+0000 7fb2d654b700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 0x7fb2d012d510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8015000 tx=0x7fb2c8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.735+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c8004930 con 0x7fb2d0130e50 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.735+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d00718e0 con 0x7fb2d0130e50 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.735+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c80092e0 con 0x7fb2d0130e50 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.735+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c801c660 con 0x7fb2d0130e50 2023-10-03T10:15:02.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.735+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d012b910 con 0x7fb2d0130e50 2023-10-03T10:15:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.736+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d0130910 con 0x7fb2d0130e50 2023-10-03T10:15:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.736+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2c801c7c0 con 0x7fb2d0130e50 2023-10-03T10:15:02.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.737+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2c8041090 con 0x7fb2d0130e50 2023-10-03T10:15:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.746+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2c8024980 con 0x7fb2d0130e50 2023-10-03T10:15:02.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.765+0000 7fc539926700 1 Processor -- start 2023-10-03T10:15:02.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 -- start start 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc53412f8b0 0x7fc53412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc534130260 0x7fc534136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53412d330 con 0x7fc534130260 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53412cd90 con 0x7fc53412cf60 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.766+0000 7fc539926700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5341306d0 con 0x7fc53412f8b0 2023-10-03T10:15:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52320/0 (socket says 172.21.15.19:52320) 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 -- 172.21.15.19:0/2251232072 learned_addr learned my addr 172.21.15.19:0/2251232072 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc5327fc700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc53412f8b0 0x7fc53412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc5337fe700 1 --2- 172.21.15.19:0/2251232072 >> v2:172.21.15.19:3300/0 conn(0x7fc534130260 0x7fc534136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 -- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc53412f8b0 msgr2=0x7fc53412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc53412f8b0 0x7fc53412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 -- 172.21.15.19:0/2251232072 >> v2:172.21.15.19:3300/0 conn(0x7fc534130260 msgr2=0x7fc534136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 --2- 172.21.15.19:0/2251232072 >> v2:172.21.15.19:3300/0 conn(0x7fc534130260 0x7fc534136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 -- 172.21.15.19:0/2251232072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534071780 con 0x7fc53412cf60 2023-10-03T10:15:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.767+0000 7fc532ffd700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5240098f0 tx=0x7fc524009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70df9b9f8d4756a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.768+0000 7fc531ffb700 1 -- 172.21.15.19:0/2251232072 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011830 con 0x7fc53412cf60 2023-10-03T10:15:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.768+0000 7fc531ffb700 1 -- 172.21.15.19:0/2251232072 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524011990 con 0x7fc53412cf60 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.768+0000 7fc531ffb700 1 -- 172.21.15.19:0/2251232072 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524011d00 con 0x7fc53412cf60 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 -- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 msgr2=0x7fc53406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc5240098f0 tx=0x7fc524009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 -- 172.21.15.19:0/2251232072 shutdown_connections 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412cf60 0x7fc53406f5d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 --2- 172.21.15.19:0/2251232072 >> v2:172.21.15.19:3300/0 conn(0x7fc534130260 0x7fc534136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 --2- 172.21.15.19:0/2251232072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc53412f8b0 0x7fc53412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 -- 172.21.15.19:0/2251232072 >> 172.21.15.19:0/2251232072 conn(0x7fc5340a2aa0 msgr2=0x7fc5340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 -- 172.21.15.19:0/2251232072 shutdown_connections 2023-10-03T10:15:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.769+0000 7fc539926700 1 -- 172.21.15.19:0/2251232072 wait complete. 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.770+0000 7fc539926700 1 Processor -- start 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.770+0000 7fc539926700 1 -- start start 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 0x7fc5341c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 0x7fc5341c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 0x7fc5341c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53409d810 con 0x7fc53412cf60 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc534129fa0 con 0x7fc53412f8b0 2023-10-03T10:15:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc539926700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc53409ceb0 con 0x7fc534130260 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc5327fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 0x7fc5341c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc5327fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 0x7fc5341c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52336/0 (socket says 172.21.15.19:52336) 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.771+0000 7fc5327fc700 1 -- 172.21.15.19:0/3935341695 learned_addr learned my addr 172.21.15.19:0/3935341695 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 0x7fc5341c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc532ffd700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 0x7fc5341c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 -- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 msgr2=0x7fc5341c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 0x7fc5341c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 -- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 msgr2=0x7fc5341c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 0x7fc5341c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 -- 172.21.15.19:0/3935341695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc524009550 con 0x7fc534130260 2023-10-03T10:15:02.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc532ffd700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 0x7fc5341c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:02.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.772+0000 7fc5337fe700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 0x7fc5341c48a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00efc0 tx=0x7fc52c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:02.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.773+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00cc90 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.773+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00f040 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.773+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53409e6a0 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.773+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53409d9a0 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.773+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c009e60 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.774+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc52c014480 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.774+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc52c03fdb0 con 0x7fc534130260 2023-10-03T10:15:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.774+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5140052e0 con 0x7fc534130260 2023-10-03T10:15:02.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.784+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc52c018020 con 0x7fc534130260 2023-10-03T10:15:02.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.925+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0484071db0 con 0x7f048409a3b0 2023-10-03T10:15:02.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.926+0000 7f047a7fc700 1 -- 172.21.15.19:0/3137291505 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0474017030 con 0x7f048409a3b0 2023-10-03T10:15:02.927 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:02.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 msgr2=0x7f048406fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 0x7f048406fb50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f047400e8d0 tx=0x7f047400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 shutdown_connections 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0484131810 0x7f0484070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0484099a40 0x7f048406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 --2- 172.21.15.19:0/3137291505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f048409a3b0 0x7f048406fb50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.928+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 >> 172.21.15.19:0/3137291505 conn(0x7f04840a2aa0 msgr2=0x7f048409e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.929+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 shutdown_connections 2023-10-03T10:15:02.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.929+0000 7f048bfd7700 1 -- 172.21.15.19:0/3137291505 wait complete. 2023-10-03T10:15:02.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.933+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e0409dde0 con 0x7f1e0409d6f0 2023-10-03T10:15:02.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.934+0000 7f1df2ffd700 1 -- 172.21.15.19:0/2886976994 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1df4015020 con 0x7f1e0409d6f0 2023-10-03T10:15:02.935 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.936+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 msgr2=0x7f1e041224e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.936+0000 7f1e08b81700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 0x7f1e041224e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1df4016000 tx=0x7f1df4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 shutdown_connections 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e0409e410 0x7f1e04122f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e0409d6f0 0x7f1e041224e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 --2- 172.21.15.19:0/2886976994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0409e000 0x7f1e04122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 >> 172.21.15.19:0/2886976994 conn(0x7f1e04066f50 msgr2=0x7f1e04133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 shutdown_connections 2023-10-03T10:15:02.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.937+0000 7f1e08b81700 1 -- 172.21.15.19:0/2886976994 wait complete. 2023-10-03T10:15:02.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:02.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:02.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.959+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb2d0074ea0 con 0x7fb2d0130e50 2023-10-03T10:15:02.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.959+0000 7fb2c67fc700 1 -- 172.21.15.19:0/3057874949 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2c80243b0 con 0x7fb2d0130e50 2023-10-03T10:15:02.960 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 msgr2=0x7fb2d012d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 0x7fb2d012d510 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8015000 tx=0x7fb2c8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 shutdown_connections 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2d0130e50 0x7fb2d012d510 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2d006fcf0 0x7fb2d012ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 --2- 172.21.15.19:0/3057874949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2d0130540 0x7fb2d012cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 >> 172.21.15.19:0/3057874949 conn(0x7fb2d00a2aa0 msgr2=0x7fb2d006e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 shutdown_connections 2023-10-03T10:15:02.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:02.962+0000 7fb2d7fae700 1 -- 172.21.15.19:0/3057874949 wait complete. 2023-10-03T10:15:02.976 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:03.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.004+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc514005590 con 0x7fc534130260 2023-10-03T10:15:03.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.005+0000 7fc51bfff700 1 -- 172.21.15.19:0/3935341695 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc52c0114a0 con 0x7fc534130260 2023-10-03T10:15:03.006 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 msgr2=0x7fc5341c48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 0x7fc5341c48a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00efc0 tx=0x7fc52c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 shutdown_connections 2023-10-03T10:15:03.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc534130260 0x7fc5341c48a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc53412cf60 0x7fc5341c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 --2- 172.21.15.19:0/3935341695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc53412f8b0 0x7fc5341c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 >> 172.21.15.19:0/3935341695 conn(0x7fc5340a2aa0 msgr2=0x7fc53412de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 shutdown_connections 2023-10-03T10:15:03.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:03.007+0000 7fc539926700 1 -- 172.21.15.19:0/3935341695 wait complete. 2023-10-03T10:15:03.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:03.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:03.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:03.978 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:04.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:04.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.100+0000 7ff4f47ec700 1 Processor -- start 2023-10-03T10:15:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.100+0000 7ff4f47ec700 1 -- start start 2023-10-03T10:15:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f47ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 0x7ff4ec135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f47ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 0x7ff4ec138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f47ec700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4ec09f130 con 0x7ff4ec09d6f0 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f47ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec09f520 con 0x7ff4ec135e50 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f47ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec09e930 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f2588700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff4ec09d6f0 0x7ff4ec09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48328/0 (socket says 172.21.15.19:48328) 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f2588700 1 -- 172.21.15.19:0/3134317359 learned_addr learned my addr 172.21.15.19:0/3134317359 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:04.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f1d87700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 0x7ff4ec135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.101+0000 7ff4f2d89700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 0x7ff4ec138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1d87700 1 -- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 msgr2=0x7ff4ec138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1d87700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 0x7ff4ec138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1d87700 1 -- 172.21.15.19:0/3134317359 >> v1:172.21.15.19:6789/0 conn(0x7ff4ec09d6f0 legacy=0x7ff4ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1d87700 1 -- 172.21.15.19:0/3134317359 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec09b2d0 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f2d89700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 0x7ff4ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1d87700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 0x7ff4ec135910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009870 tx=0x7ff4dc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3f7edf0e46fe075 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1586700 1 -- 172.21.15.19:0/3134317359 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011830 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1586700 1 -- 172.21.15.19:0/3134317359 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc011990 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.102+0000 7ff4f1586700 1 -- 172.21.15.19:0/3134317359 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011d20 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 msgr2=0x7ff4ec135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 0x7ff4ec135910 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc009870 tx=0x7ff4dc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3134317359 shutdown_connections 2023-10-03T10:15:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec135e50 0x7ff4ec138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3134317359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec09e1d0 0x7ff4ec135910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3134317359 >> 172.21.15.19:0/3134317359 conn(0x7ff4ec066f50 msgr2=0x7ff4ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3134317359 shutdown_connections 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.103+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3134317359 wait complete. 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.104+0000 7ff4f47ec700 1 Processor -- start 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.104+0000 7ff4f47ec700 1 -- start start 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 0x7ff4ec1350d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec09e1d0 0x7ff4ec135610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 0x7ff4ec139780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec09c700 con 0x7ff4ec09d6f0 2023-10-03T10:15:04.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec13ab70 con 0x7ff4ec09e1d0 2023-10-03T10:15:04.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f47ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4ec13b2f0 con 0x7ff4ec135e50 2023-10-03T10:15:04.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2588700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 0x7ff4ec1350d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 0x7ff4ec139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2588700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 0x7ff4ec1350d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50900/0 (socket says 172.21.15.19:50900) 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2588700 1 -- 172.21.15.19:0/3525877521 learned_addr learned my addr 172.21.15.19:0/3525877521 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f1d87700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec09e1d0 0x7ff4ec135610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 -- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec09e1d0 msgr2=0x7ff4ec135610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec09e1d0 0x7ff4ec135610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 -- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 msgr2=0x7ff4ec1350d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 0x7ff4ec1350d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.105+0000 7ff4f2d89700 1 -- 172.21.15.19:0/3525877521 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e4009a70 con 0x7ff4ec135e50 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4f2d89700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 0x7ff4ec139780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400ef90 tx=0x7ff4e400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400ca90 con 0x7ff4ec135e50 2023-10-03T10:15:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e400f040 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e400ce30 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4dc0094a0 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.106+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4ec132130 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.107+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4e4014480 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.107+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4ec074ea0 con 0x7ff4ec135e50 2023-10-03T10:15:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.107+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4e403fc20 con 0x7ff4ec135e50 2023-10-03T10:15:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.117+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4e4012910 con 0x7ff4ec135e50 2023-10-03T10:15:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.139+0000 7f0f2fc83700 1 Processor -- start 2023-10-03T10:15:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.139+0000 7f0f2fc83700 1 -- start start 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2fc83700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 0x7f0f28138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2fc83700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f28139170 0x7f0f2813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2fc83700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f2809b120 con 0x7f0f2809d6f0 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2fc83700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2806b460 con 0x7f0f28139170 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2fc83700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2809a7e0 con 0x7f0f2809e1d0 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2da1f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0f2809d6f0 0x7f0f2809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48332/0 (socket says 172.21.15.19:48332) 2023-10-03T10:15:04.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2da1f700 1 -- 172.21.15.19:0/543300833 learned_addr learned my addr 172.21.15.19:0/543300833 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/543300833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 0x7f0f28138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2ca1d700 1 -- 172.21.15.19:0/543300833 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353102387 0 0) 0x7f0f2809b120 con 0x7f0f2809d6f0 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2ca1d700 1 -- 172.21.15.19:0/543300833 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f140035b0 con 0x7f0f2809d6f0 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2d21e700 1 -- 172.21.15.19:0/543300833 >> v2:172.21.15.19:3300/0 conn(0x7f0f28139170 msgr2=0x7f0f2813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/543300833 >> v2:172.21.15.19:3300/0 conn(0x7f0f28139170 0x7f0f2813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2d21e700 1 -- 172.21.15.19:0/543300833 >> v1:172.21.15.19:6789/0 conn(0x7f0f2809d6f0 legacy=0x7f0f2809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.140+0000 7f0f2d21e700 1 -- 172.21.15.19:0/543300833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2809a500 con 0x7f0f2809e1d0 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.141+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/543300833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 0x7f0f28138c30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009870 tx=0x7f0f18009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4dea695179d1c60 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.141+0000 7f0f2ca1d700 1 -- 172.21.15.19:0/543300833 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011830 con 0x7f0f2809e1d0 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.141+0000 7f0f2ca1d700 1 -- 172.21.15.19:0/543300833 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18011990 con 0x7f0f2809e1d0 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.141+0000 7f0f2ca1d700 1 -- 172.21.15.19:0/543300833 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011d00 con 0x7f0f2809e1d0 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 -- 172.21.15.19:0/543300833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 msgr2=0x7f0f28138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/543300833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 0x7f0f28138c30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009870 tx=0x7f0f18009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:04.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 -- 172.21.15.19:0/543300833 shutdown_connections 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/543300833 >> v2:172.21.15.19:3300/0 conn(0x7f0f28139170 0x7f0f2813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/543300833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809e1d0 0x7f0f28138c30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 -- 172.21.15.19:0/543300833 >> 172.21.15.19:0/543300833 conn(0x7f0f28066f50 msgr2=0x7f0f2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 -- 172.21.15.19:0/543300833 shutdown_connections 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.142+0000 7f0f2fc83700 1 -- 172.21.15.19:0/543300833 wait complete. 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 Processor -- start 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 -- start start 2023-10-03T10:15:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 0x7f0f281c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f28139170 0x7f0f281206d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f281be250 con 0x7f0f2809e1d0 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28123fa0 con 0x7f0f2809d6f0 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.143+0000 7f0f2fc83700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2809c710 con 0x7f0f28139170 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50916/0 (socket says 172.21.15.19:50916) 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 -- 172.21.15.19:0/3127990968 learned_addr learned my addr 172.21.15.19:0/3127990968 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2da1f700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 0x7f0f281c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2e220700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f28139170 0x7f0f281206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 -- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f28139170 msgr2=0x7f0f281206d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f28139170 0x7f0f281206d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 -- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 msgr2=0x7f0f281c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 0x7f0f281c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 -- 172.21.15.19:0/3127990968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180094a0 con 0x7f0f2809e1d0 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2da1f700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 0x7f0f281c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.144+0000 7f0f2d21e700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000c00 tx=0x7f0f18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.145+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004550 con 0x7f0f2809e1d0 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.145+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1801f070 con 0x7f0f2809e1d0 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.145+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180038e0 con 0x7f0f2809e1d0 2023-10-03T10:15:04.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.145+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f281241f0 con 0x7f0f2809e1d0 2023-10-03T10:15:04.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.145+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f28123c50 con 0x7f0f2809e1d0 2023-10-03T10:15:04.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.146+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f28074ea0 con 0x7f0f2809e1d0 2023-10-03T10:15:04.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.146+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f18003a40 con 0x7f0f2809e1d0 2023-10-03T10:15:04.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.147+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f18021070 con 0x7f0f2809e1d0 2023-10-03T10:15:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.150+0000 7f8785267700 1 Processor -- start 2023-10-03T10:15:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 -- start start 2023-10-03T10:15:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e410 0x7f8780130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878009f520 con 0x7f878009d6f0 2023-10-03T10:15:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878009f130 con 0x7f878009e000 2023-10-03T10:15:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.151+0000 7f8785267700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f878009e930 con 0x7f878009e410 2023-10-03T10:15:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52374/0 (socket says 172.21.15.19:52374) 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 -- 172.21.15.19:0/507255293 learned_addr learned my addr 172.21.15.19:0/507255293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877f7fe700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e410 0x7f8780130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877effd700 1 --2- 172.21.15.19:0/507255293 >> v2:172.21.15.19:3300/0 conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 -- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e410 msgr2=0x7f8780130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e410 0x7f8780130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 -- 172.21.15.19:0/507255293 >> v2:172.21.15.19:3300/0 conn(0x7f878009d6f0 msgr2=0x7f878009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 --2- 172.21.15.19:0/507255293 >> v2:172.21.15.19:3300/0 conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 -- 172.21.15.19:0/507255293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878009b2d0 con 0x7f878009e000 2023-10-03T10:15:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877e7fc700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87740098f0 tx=0x7f8774009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d0768072e76d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877dffb700 1 -- 172.21.15.19:0/507255293 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774010a90 con 0x7f878009e000 2023-10-03T10:15:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877dffb700 1 -- 172.21.15.19:0/507255293 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8774010bf0 con 0x7f878009e000 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.152+0000 7f877dffb700 1 -- 172.21.15.19:0/507255293 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774018440 con 0x7f878009e000 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.153+0000 7f8785267700 1 -- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 msgr2=0x7f8780130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.153+0000 7f8785267700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f87740098f0 tx=0x7f8774009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 -- 172.21.15.19:0/507255293 shutdown_connections 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e410 0x7f8780130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 --2- 172.21.15.19:0/507255293 >> v2:172.21.15.19:3300/0 conn(0x7f878009d6f0 0x7f878009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 --2- 172.21.15.19:0/507255293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009e000 0x7f8780130660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 -- 172.21.15.19:0/507255293 >> 172.21.15.19:0/507255293 conn(0x7f8780066f50 msgr2=0x7f878009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 -- 172.21.15.19:0/507255293 shutdown_connections 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.154+0000 7f8785267700 1 -- 172.21.15.19:0/507255293 wait complete. 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.155+0000 7f8785267700 1 Processor -- start 2023-10-03T10:15:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 -- start start 2023-10-03T10:15:04.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f1806c750 con 0x7f0f2809e1d0 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e000 0x7f878011e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f878009e410 0x7f878011ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8780121480 con 0x7f878009e410 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87801204c0 con 0x7f878009d6f0 2023-10-03T10:15:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f8785267700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8780121da0 con 0x7f878009e000 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f877effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f877effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52382/0 (socket says 172.21.15.19:52382) 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.156+0000 7f877effd700 1 -- 172.21.15.19:0/1269571590 learned_addr learned my addr 172.21.15.19:0/1269571590 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877f7fe700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f878009e410 0x7f878011ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877e7fc700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e000 0x7f878011e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 -- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e000 msgr2=0x7f878011e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e000 0x7f878011e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 -- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f878009e410 msgr2=0x7f878011ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f878009e410 0x7f878011ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 -- 172.21.15.19:0/1269571590 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009550 con 0x7f878009d6f0 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.157+0000 7f877effd700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f877000e810 tx=0x7f877000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.158+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000c070 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.158+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770013610 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.158+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87801301e0 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.158+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700139a0 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.158+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8780121ac0 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.159+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8770013b00 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.159+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8780121720 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.159+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f877003f3b0 con 0x7f878009d6f0 2023-10-03T10:15:04.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.164+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87700108e0 con 0x7f878009d6f0 2023-10-03T10:15:04.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.195+0000 7f90aee98700 1 Processor -- start 2023-10-03T10:15:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.195+0000 7f90aee98700 1 -- start start 2023-10-03T10:15:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90aee98700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90a806a770 0x7f90a809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90aee98700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90aee98700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a809a810 con 0x7f90a809dc30 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90aee98700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a806ab40 con 0x7f90a806a770 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90aee98700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a809ebc0 con 0x7f90a813d1f0 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90acc34700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90a806a770 0x7f90a809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90a7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f90a809dc30 0x7f90a809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48348/0 (socket says 172.21.15.19:48348) 2023-10-03T10:15:04.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90a7fff700 1 -- 172.21.15.19:0/3543036255 learned_addr learned my addr 172.21.15.19:0/3543036255 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90ad435700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90acc34700 1 -- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 msgr2=0x7f90a813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90acc34700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90acc34700 1 -- 172.21.15.19:0/3543036255 >> v1:172.21.15.19:6789/0 conn(0x7f90a809dc30 legacy=0x7f90a809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90acc34700 1 -- 172.21.15.19:0/3543036255 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a809e920 con 0x7f90a806a770 2023-10-03T10:15:04.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.196+0000 7f90a77fe700 1 -- 172.21.15.19:0/3543036255 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817242560 0 0) 0x7f90a809a810 con 0x7f90a809dc30 2023-10-03T10:15:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.197+0000 7f90ad435700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.197+0000 7f90acc34700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a809d6f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f909c009840 tx=0x7f909c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b68fccac5b66874 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.197+0000 7f90a77fe700 1 -- 172.21.15.19:0/3543036255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011830 con 0x7f90a806a770 2023-10-03T10:15:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.197+0000 7f90a77fe700 1 -- 172.21.15.19:0/3543036255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c011990 con 0x7f90a806a770 2023-10-03T10:15:04.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.197+0000 7f90a77fe700 1 -- 172.21.15.19:0/3543036255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011d20 con 0x7f90a806a770 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 -- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 msgr2=0x7f90a809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a809d6f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f909c009840 tx=0x7f909c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 -- 172.21.15.19:0/3543036255 shutdown_connections 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 --2- 172.21.15.19:0/3543036255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a809d6f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 -- 172.21.15.19:0/3543036255 >> 172.21.15.19:0/3543036255 conn(0x7f90a8066f50 msgr2=0x7f90a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 -- 172.21.15.19:0/3543036255 shutdown_connections 2023-10-03T10:15:04.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.198+0000 7f90aee98700 1 -- 172.21.15.19:0/3543036255 wait complete. 2023-10-03T10:15:04.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.199+0000 7f90aee98700 1 Processor -- start 2023-10-03T10:15:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.199+0000 7f90aee98700 1 -- start start 2023-10-03T10:15:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a811c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90a809dc30 0x7f90a813b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:04.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811eff0 con 0x7f90a806a770 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811ccb0 con 0x7f90a809dc30 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90aee98700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90a811e950 con 0x7f90a813d1f0 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90acc34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a811c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90acc34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a811c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50956/0 (socket says 172.21.15.19:50956) 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90acc34700 1 -- 172.21.15.19:0/1018609417 learned_addr learned my addr 172.21.15.19:0/1018609417 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90a7fff700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90a809dc30 0x7f90a813b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:04.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 -- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90a809dc30 msgr2=0x7f90a813b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90a809dc30 0x7f90a813b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 -- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 msgr2=0x7f90a811c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a811c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.200+0000 7f90ad435700 1 -- 172.21.15.19:0/1018609417 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009a70 con 0x7f90a813d1f0 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.201+0000 7f90ad435700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813bac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f90a000ef90 tx=0x7f90a000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.201+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000ca90 con 0x7f90a813d1f0 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.201+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a000f040 con 0x7f90a813d1f0 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.201+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c0094a0 con 0x7f90a813d1f0 2023-10-03T10:15:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.201+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a811f680 con 0x7f90a813d1f0 2023-10-03T10:15:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.202+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000ce30 con 0x7f90a813d1f0 2023-10-03T10:15:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.202+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90a0014480 con 0x7f90a813d1f0 2023-10-03T10:15:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.202+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90a003fd00 con 0x7f90a813d1f0 2023-10-03T10:15:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.202+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90880052e0 con 0x7f90a813d1f0 2023-10-03T10:15:04.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.207+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90a0012700 con 0x7f90a813d1f0 2023-10-03T10:15:04.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.335+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4ec06c360 con 0x7ff4ec135e50 2023-10-03T10:15:04.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.335+0000 7ff4e2ffd700 1 -- 172.21.15.19:0/3525877521 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4e4009cc0 con 0x7ff4ec135e50 2023-10-03T10:15:04.336 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.338+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 msgr2=0x7ff4ec139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.338+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 0x7ff4ec139780 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400ef90 tx=0x7ff4e400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 shutdown_connections 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4ec135e50 0x7ff4ec139780 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4ec09d6f0 0x7ff4ec1350d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 --2- 172.21.15.19:0/3525877521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4ec09e1d0 0x7ff4ec135610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 >> 172.21.15.19:0/3525877521 conn(0x7ff4ec066f50 msgr2=0x7ff4ec12f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 shutdown_connections 2023-10-03T10:15:04.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.339+0000 7ff4f47ec700 1 -- 172.21.15.19:0/3525877521 wait complete. 2023-10-03T10:15:04.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:04.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.365+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0f2809f420 con 0x7f0f2809e1d0 2023-10-03T10:15:04.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.365+0000 7f0f1e7fc700 1 -- 172.21.15.19:0/3127990968 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f1802b020 con 0x7f0f2809e1d0 2023-10-03T10:15:04.366 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 msgr2=0x7f0f281c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0f18000c00 tx=0x7f0f18004750 comp rx=0 tx=0).stop 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 shutdown_connections 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f28139170 0x7f0f281206d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f2809d6f0 0x7f0f281c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 --2- 172.21.15.19:0/3127990968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f2809e1d0 0x7f0f281c8ac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 >> 172.21.15.19:0/3127990968 conn(0x7f0f28066f50 msgr2=0x7f0f28070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 shutdown_connections 2023-10-03T10:15:04.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.368+0000 7f0f2fc83700 1 -- 172.21.15.19:0/3127990968 wait complete. 2023-10-03T10:15:04.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:04.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.384+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8780074ea0 con 0x7f878009d6f0 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.384+0000 7f87677fe700 1 -- 172.21.15.19:0/1269571590 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8770010310 con 0x7f878009d6f0 2023-10-03T10:15:04.385 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 msgr2=0x7f878011e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f877000e810 tx=0x7f877000eb20 comp rx=0 tx=0).stop 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 shutdown_connections 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f878009e410 0x7f878011ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f878009d6f0 0x7f878011e280 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 --2- 172.21.15.19:0/1269571590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f878009e000 0x7f878011e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 >> 172.21.15.19:0/1269571590 conn(0x7f8780066f50 msgr2=0x7f878006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 shutdown_connections 2023-10-03T10:15:04.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.386+0000 7f8785267700 1 -- 172.21.15.19:0/1269571590 wait complete. 2023-10-03T10:15:04.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:04.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.416+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9088005590 con 0x7f90a813d1f0 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.416+0000 7f90a57fa700 1 -- 172.21.15.19:0/1018609417 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90a0009cc0 con 0x7f90a813d1f0 2023-10-03T10:15:04.417 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 msgr2=0x7f90a813bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813bac0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f90a000ef90 tx=0x7f90a000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 shutdown_connections 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90a813d1f0 0x7f90a813bac0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90a806a770 0x7f90a811c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 --2- 172.21.15.19:0/1018609417 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90a809dc30 0x7f90a813b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 >> 172.21.15.19:0/1018609417 conn(0x7f90a8066f50 msgr2=0x7f90a809b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.418+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 shutdown_connections 2023-10-03T10:15:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:04.419+0000 7f90aee98700 1 -- 172.21.15.19:0/1018609417 wait complete. 2023-10-03T10:15:04.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:05.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:05.383 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:05.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:05.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:05.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.513+0000 7f5a1e23f700 1 Processor -- start 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.513+0000 7f5a1e23f700 1 -- start start 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.513+0000 7f5a1e23f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.513+0000 7f5a1e23f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a1e23f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a18130260 0x7f5a18136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a1e23f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1812d330 con 0x7f5a18130260 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a1e23f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1812cd90 con 0x7f5a1812cf60 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a1e23f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a181306d0 con 0x7f5a1812f8b0 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a16ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52406/0 (socket says 172.21.15.19:52406) 2023-10-03T10:15:05.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 -- 172.21.15.19:0/1290676157 learned_addr learned my addr 172.21.15.19:0/1290676157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 -- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 msgr2=0x7f5a1812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 --2- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 -- 172.21.15.19:0/1290676157 >> v2:172.21.15.19:3300/0 conn(0x7f5a18130260 msgr2=0x7f5a18136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 --2- 172.21.15.19:0/1290676157 >> v2:172.21.15.19:3300/0 conn(0x7f5a18130260 0x7f5a18136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.514+0000 7f5a177fe700 1 -- 172.21.15.19:0/1290676157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a18071780 con 0x7f5a1812cf60 2023-10-03T10:15:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.515+0000 7f5a177fe700 1 --2- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a080098f0 tx=0x7f5a08009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3771af3b33c2058 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.515+0000 7f5a167fc700 1 -- 172.21.15.19:0/1290676157 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08013c90 con 0x7f5a1812cf60 2023-10-03T10:15:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.515+0000 7f5a167fc700 1 -- 172.21.15.19:0/1290676157 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08013df0 con 0x7f5a1812cf60 2023-10-03T10:15:05.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.515+0000 7f5a167fc700 1 -- 172.21.15.19:0/1290676157 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0801b620 con 0x7f5a1812cf60 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 -- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 msgr2=0x7f5a1806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5a080098f0 tx=0x7f5a08009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 -- 172.21.15.19:0/1290676157 shutdown_connections 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1806f5d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/1290676157 >> v2:172.21.15.19:3300/0 conn(0x7f5a18130260 0x7f5a18136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/1290676157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 -- 172.21.15.19:0/1290676157 >> 172.21.15.19:0/1290676157 conn(0x7f5a180a2aa0 msgr2=0x7f5a180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 -- 172.21.15.19:0/1290676157 shutdown_connections 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.516+0000 7f5a1e23f700 1 -- 172.21.15.19:0/1290676157 wait complete. 2023-10-03T10:15:05.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.517+0000 7f5a1e23f700 1 Processor -- start 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.517+0000 7f5a1e23f700 1 -- start start 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1809be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1809c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 0x7f5a181c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1812f560 con 0x7f5a18130260 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a18129fa0 con 0x7f5a1812cf60 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a1e23f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1809ea70 con 0x7f5a1812f8b0 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a16ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1809c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 0x7f5a181c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a16ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1809c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57332/0 (socket says 172.21.15.19:57332) 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a16ffd700 1 -- 172.21.15.19:0/2362025586 learned_addr learned my addr 172.21.15.19:0/2362025586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a177fe700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1809be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 -- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 msgr2=0x7f5a1809c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1809c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 -- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 msgr2=0x7f5a1809be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1809be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.518+0000 7f5a17fff700 1 -- 172.21.15.19:0/2362025586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009550 con 0x7f5a18130260 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f5a17fff700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 0x7f5a181c4130 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000bdf0 tx=0x7f5a10009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000cb30 con 0x7f5a18130260 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a1000cc90 con 0x7f5a18130260 2023-10-03T10:15:05.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1809c8e0 con 0x7f5a18130260 2023-10-03T10:15:05.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10014440 con 0x7f5a18130260 2023-10-03T10:15:05.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.519+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1809d1a0 con 0x7f5a18130260 2023-10-03T10:15:05.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.520+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a1001d3b0 con 0x7f5a18130260 2023-10-03T10:15:05.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.520+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a10006e40 con 0x7f5a18130260 2023-10-03T10:15:05.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.520+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a18074ea0 con 0x7f5a18130260 2023-10-03T10:15:05.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.530+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a10019070 con 0x7f5a18130260 2023-10-03T10:15:05.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.556+0000 7ff749467700 1 Processor -- start 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.556+0000 7ff749467700 1 -- start start 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff74409d6f0 0x7ff74409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409e000 0x7ff744130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 0x7ff744130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74409f520 con 0x7ff74409d6f0 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74409f130 con 0x7ff74409e410 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff749467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff74409e930 con 0x7ff74409e000 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff7437fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 0x7ff744130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff74409d6f0 0x7ff74409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff7437fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 0x7ff744130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52426/0 (socket says 172.21.15.19:52426) 2023-10-03T10:15:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff7437fe700 1 -- 172.21.15.19:0/1064725988 learned_addr learned my addr 172.21.15.19:0/1064725988 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff7427fc700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409e000 0x7ff744130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 -- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409e000 msgr2=0x7ff744130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409e000 0x7ff744130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 -- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 msgr2=0x7ff744130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 0x7ff744130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.557+0000 7ff742ffd700 1 -- 172.21.15.19:0/1064725988 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74409b2d0 con 0x7ff74409d6f0 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.558+0000 7ff742ffd700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409d6f0 0x7ff74409dac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff734009870 tx=0x7ff734009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427c816d6e397b4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.558+0000 7ff741ffb700 1 -- 172.21.15.19:0/1064725988 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400f8a0 con 0x7ff74409d6f0 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.558+0000 7ff741ffb700 1 -- 172.21.15.19:0/1064725988 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400fa00 con 0x7ff74409d6f0 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.558+0000 7ff741ffb700 1 -- 172.21.15.19:0/1064725988 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400fd90 con 0x7ff74409d6f0 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 -- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409d6f0 msgr2=0x7ff74409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409d6f0 0x7ff74409dac0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff734009870 tx=0x7ff734009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 -- 172.21.15.19:0/1064725988 shutdown_connections 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e410 0x7ff744130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409d6f0 0x7ff74409dac0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 --2- 172.21.15.19:0/1064725988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409e000 0x7ff744130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 -- 172.21.15.19:0/1064725988 >> 172.21.15.19:0/1064725988 conn(0x7ff744066f50 msgr2=0x7ff74409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 -- 172.21.15.19:0/1064725988 shutdown_connections 2023-10-03T10:15:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.559+0000 7ff749467700 1 -- 172.21.15.19:0/1064725988 wait complete. 2023-10-03T10:15:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.560+0000 7ff749467700 1 Processor -- start 2023-10-03T10:15:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.560+0000 7ff749467700 1 -- start start 2023-10-03T10:15:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.560+0000 7f472b98d700 1 Processor -- start 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409d6f0 0x7ff7441cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e000 0x7ff7441ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441299c0 con 0x7ff74409e410 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff74409c700 con 0x7ff74409e000 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff749467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441274a0 con 0x7ff74409d6f0 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51000/0 (socket says 172.21.15.19:51000) 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7427fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e000 0x7ff7441ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 -- 172.21.15.19:0/3079788915 learned_addr learned my addr 172.21.15.19:0/3079788915 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff742ffd700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409d6f0 0x7ff7441cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.560+0000 7f472b98d700 1 -- start start 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7f472b98d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f472409de00 0x7f472409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7f472b98d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7f472b98d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472409a810 con 0x7f472406a770 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7f472b98d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472406ab40 con 0x7f472409de00 2023-10-03T10:15:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7f472b98d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472409ebc0 con 0x7f472413d1f0 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 -- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409d6f0 msgr2=0x7ff7441cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409d6f0 0x7ff7441cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 -- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e000 msgr2=0x7ff7441ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e000 0x7ff7441ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.561+0000 7ff7437fe700 1 -- 172.21.15.19:0/3079788915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340094a0 con 0x7ff74409e410 2023-10-03T10:15:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f472409de00 0x7f472409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f472409de00 0x7f472409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51012/0 (socket says 172.21.15.19:51012) 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 -- 172.21.15.19:0/4099855379 learned_addr learned my addr 172.21.15.19:0/4099855379 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4729f2a700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff7437fe700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00efc0 tx=0x7ff73c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 -- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 msgr2=0x7f472413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 -- 172.21.15.19:0/4099855379 >> v1:172.21.15.19:6789/0 conn(0x7f472406a770 legacy=0x7f472409d6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 -- 172.21.15.19:0/4099855379 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472409e920 con 0x7f472409de00 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c003c20 con 0x7ff74409e410 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c00f040 con 0x7ff74409e410 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff744128740 con 0x7ff74409e410 2023-10-03T10:15:05.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7f4728f28700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472409e250 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47140098f0 tx=0x7f4714009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b172c49885c9a0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74411cd90 con 0x7ff74409e410 2023-10-03T10:15:05.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.562+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c009e60 con 0x7ff74409e410 2023-10-03T10:15:05.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.563+0000 7f471bfff700 1 -- 172.21.15.19:0/4099855379 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714004230 con 0x7f472409de00 2023-10-03T10:15:05.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.563+0000 7f471bfff700 1 -- 172.21.15.19:0/4099855379 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4714004390 con 0x7f472409de00 2023-10-03T10:15:05.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.563+0000 7f471bfff700 1 -- 172.21.15.19:0/4099855379 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140036a0 con 0x7f472409de00 2023-10-03T10:15:05.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.563+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff73c00c880 con 0x7ff74409e410 2023-10-03T10:15:05.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.563+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff73c03f950 con 0x7ff74409e410 2023-10-03T10:15:05.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7240052e0 con 0x7ff74409e410 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 -- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 msgr2=0x7f472409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472409e250 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47140098f0 tx=0x7f4714009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 -- 172.21.15.19:0/4099855379 shutdown_connections 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 --2- 172.21.15.19:0/4099855379 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472409e250 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 -- 172.21.15.19:0/4099855379 >> 172.21.15.19:0/4099855379 conn(0x7f4724066f50 msgr2=0x7f472409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 -- 172.21.15.19:0/4099855379 shutdown_connections 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.564+0000 7f472b98d700 1 -- 172.21.15.19:0/4099855379 wait complete. 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.565+0000 7f472b98d700 1 Processor -- start 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 -- start start 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472412ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472412f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472413f6e0 con 0x7f472409de00 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472409f1a0 con 0x7f472406a770 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.566+0000 7f472b98d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47241321b0 con 0x7f472413d1f0 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52430/0 (socket says 172.21.15.19:52430) 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 -- 172.21.15.19:0/1100907309 learned_addr learned my addr 172.21.15.19:0/1100907309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4728f28700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472412ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 -- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 msgr2=0x7f472412f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472412f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 -- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 msgr2=0x7f472412ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472412ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 -- 172.21.15.19:0/1100907309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4714009550 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.567+0000 7f4729729700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f472000b550 tx=0x7f472000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.568+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720011830 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.568+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200119d0 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.568+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720011d80 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.568+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4724131340 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.568+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4724132940 con 0x7f472406a770 2023-10-03T10:15:05.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.569+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47200193b0 con 0x7f472406a770 2023-10-03T10:15:05.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.569+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff73c01c360 con 0x7ff74409e410 2023-10-03T10:15:05.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.569+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4720040c70 con 0x7f472406a770 2023-10-03T10:15:05.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.569+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4724074ea0 con 0x7f472406a770 2023-10-03T10:15:05.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.575+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4720044060 con 0x7f472406a770 2023-10-03T10:15:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.608+0000 7fc5febab700 1 Processor -- start 2023-10-03T10:15:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.608+0000 7fc5febab700 1 -- start start 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5f809e930 0x7fc5f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809f650 0x7fc5f8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f8070940 con 0x7fc5f809e930 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f806fd60 con 0x7fc5f809f650 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5febab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f806fa80 con 0x7fc5f809f240 2023-10-03T10:15:05.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5fc947700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5f809e930 0x7fc5f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5fc947700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5f809e930 0x7fc5f809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51018/0 (socket says 172.21.15.19:51018) 2023-10-03T10:15:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5fc947700 1 -- 172.21.15.19:0/1557170014 learned_addr learned my addr 172.21.15.19:0/1557170014 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.609+0000 7fc5f7fff700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 -- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 msgr2=0x7fc5f81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 -- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809f650 msgr2=0x7fc5f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809f650 0x7fc5f8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 -- 172.21.15.19:0/1557170014 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f809fb60 con 0x7fc5f809e930 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5fc947700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809e930 0x7fc5f809ed00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098f0 tx=0x7fc5ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f224c3a64ec28c25 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5f77fe700 1 -- 172.21.15.19:0/1557170014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011830 con 0x7fc5f809e930 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5f77fe700 1 -- 172.21.15.19:0/1557170014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec011990 con 0x7fc5f809e930 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.610+0000 7fc5f77fe700 1 -- 172.21.15.19:0/1557170014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec011d20 con 0x7fc5f809e930 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 -- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809e930 msgr2=0x7fc5f809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809e930 0x7fc5f809ed00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec0098f0 tx=0x7fc5ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 -- 172.21.15.19:0/1557170014 shutdown_connections 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809f650 0x7fc5f8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809e930 0x7fc5f809ed00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 --2- 172.21.15.19:0/1557170014 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 -- 172.21.15.19:0/1557170014 >> 172.21.15.19:0/1557170014 conn(0x7fc5f80a4210 msgr2=0x7fc5f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 -- 172.21.15.19:0/1557170014 shutdown_connections 2023-10-03T10:15:05.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.611+0000 7fc5febab700 1 -- 172.21.15.19:0/1557170014 wait complete. 2023-10-03T10:15:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.613+0000 7fc5febab700 1 Processor -- start 2023-10-03T10:15:05.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.613+0000 7fc5febab700 1 -- start start 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809e930 0x7fc5f81a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81a6fa0 con 0x7fc5f809f650 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81a58c0 con 0x7fc5f809e930 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5febab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f81a7450 con 0x7fc5f809f240 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51020/0 (socket says 172.21.15.19:51020) 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 -- 172.21.15.19:0/779295608 learned_addr learned my addr 172.21.15.19:0/779295608 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:05.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5f7fff700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fc947700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809e930 0x7fc5f81a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 -- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 msgr2=0x7fc5f81a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 -- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809e930 msgr2=0x7fc5f81a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809e930 0x7fc5f81a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5fd148700 1 -- 172.21.15.19:0/779295608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec009550 con 0x7fc5f809f650 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.614+0000 7fc5f7fff700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5fd148700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b970 tx=0x7fc5f000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000c930 con 0x7fc5f809f650 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f000cab0 con 0x7fc5f809f650 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f000ce60 con 0x7fc5f809f650 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f80a0190 con 0x7fc5f809f650 2023-10-03T10:15:05.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.615+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f80a36c0 con 0x7fc5f809f650 2023-10-03T10:15:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.616+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5f001d3b0 con 0x7fc5f809f650 2023-10-03T10:15:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.616+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f8074ea0 con 0x7fc5f809f650 2023-10-03T10:15:05.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.617+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5f0006e40 con 0x7fc5f809f650 2023-10-03T10:15:05.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.626+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5f0007370 con 0x7fc5f809f650 2023-10-03T10:15:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.750+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a1812f020 con 0x7f5a18130260 2023-10-03T10:15:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.751+0000 7f59fffff700 1 -- 172.21.15.19:0/2362025586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a1001be60 con 0x7f5a18130260 2023-10-03T10:15:05.752 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 msgr2=0x7f5a181c4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 0x7f5a181c4130 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5a1000bdf0 tx=0x7f5a10009ed0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 shutdown_connections 2023-10-03T10:15:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a18130260 0x7f5a181c4130 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a1812cf60 0x7f5a1809be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 --2- 172.21.15.19:0/2362025586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a1812f8b0 0x7f5a1809c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 >> 172.21.15.19:0/2362025586 conn(0x7f5a180a2aa0 msgr2=0x7f5a1806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 shutdown_connections 2023-10-03T10:15:05.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.754+0000 7f5a1e23f700 1 -- 172.21.15.19:0/2362025586 wait complete. 2023-10-03T10:15:05.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:05.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.789+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f472409a3d0 con 0x7f472406a770 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.789+0000 7f4719ffb700 1 -- 172.21.15.19:0/1100907309 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f472000e650 con 0x7f472406a770 2023-10-03T10:15:05.790 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.790+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff724005590 con 0x7ff74409e410 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.790+0000 7ff72b7fe700 1 -- 172.21.15.19:0/3079788915 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff73c014e00 con 0x7ff74409e410 2023-10-03T10:15:05.791 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:05.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 msgr2=0x7f4724071750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f472000b550 tx=0x7f472000b860 comp rx=0 tx=0).stop 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 shutdown_connections 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472413d1f0 0x7f472412f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406a770 0x7f4724071750 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 --2- 172.21.15.19:0/1100907309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f472409de00 0x7f472412ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.791+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 >> 172.21.15.19:0/1100907309 conn(0x7f4724066f50 msgr2=0x7f472409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 shutdown_connections 2023-10-03T10:15:05.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7f472b98d700 1 -- 172.21.15.19:0/1100907309 wait complete. 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 msgr2=0x7ff7441cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00efc0 tx=0x7ff73c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 shutdown_connections 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff74409e410 0x7ff7441cd000 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff74409d6f0 0x7ff7441cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 --2- 172.21.15.19:0/3079788915 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff74409e000 0x7ff7441ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 >> 172.21.15.19:0/3079788915 conn(0x7ff744066f50 msgr2=0x7ff744130350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 shutdown_connections 2023-10-03T10:15:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.792+0000 7ff749467700 1 -- 172.21.15.19:0/3079788915 wait complete. 2023-10-03T10:15:05.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:05.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:05.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.846+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc5f806b250 con 0x7fc5f809f650 2023-10-03T10:15:05.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.847+0000 7fc5f57fa700 1 -- 172.21.15.19:0/779295608 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5f0019070 con 0x7fc5f809f650 2023-10-03T10:15:05.848 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:05.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 msgr2=0x7fc5f81a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:05.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc5f000b970 tx=0x7fc5f000bc80 comp rx=0 tx=0).stop 2023-10-03T10:15:05.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 shutdown_connections 2023-10-03T10:15:05.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5f809f650 0x7fc5f81a4690 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5f809e930 0x7fc5f81a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 --2- 172.21.15.19:0/779295608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5f809f240 0x7fc5f81a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 >> 172.21.15.19:0/779295608 conn(0x7fc5f80a4210 msgr2=0x7fc5f81b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 shutdown_connections 2023-10-03T10:15:05.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:05.849+0000 7fc5febab700 1 -- 172.21.15.19:0/779295608 wait complete. 2023-10-03T10:15:05.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:06.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:06.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:06.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:06.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:06.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 Processor -- start 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 -- start start 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca8135e50 0x7f2ca8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca809f130 con 0x7f2ca809d6f0 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca809f520 con 0x7f2ca809e1d0 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2caede0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca809e930 con 0x7f2ca8135e50 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.933+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45494/0 (socket says 172.21.15.19:45494) 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 -- 172.21.15.19:0/1411462243 learned_addr learned my addr 172.21.15.19:0/1411462243 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:06.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2cacb7c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2ca809d6f0 0x7f2ca809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35140/0 (socket says 172.21.15.19:35140) 2023-10-03T10:15:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2cad37d700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca8135e50 0x7f2ca8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 -- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca8135e50 msgr2=0x7f2ca8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca8135e50 0x7f2ca8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 -- 172.21.15.19:0/1411462243 >> v1:172.21.15.19:6789/0 conn(0x7f2ca809d6f0 legacy=0x7f2ca809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 -- 172.21.15.19:0/1411462243 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca809b2d0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.934+0000 7f2ca7fff700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009920 tx=0x7f2c94009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c425be28033c533 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2ca77fe700 1 -- 172.21.15.19:0/1411462243 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94011830 con 0x7f2ca809e1d0 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2ca77fe700 1 -- 172.21.15.19:0/1411462243 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c94011990 con 0x7f2ca809e1d0 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2ca77fe700 1 -- 172.21.15.19:0/1411462243 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94011d20 con 0x7f2ca809e1d0 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 -- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 msgr2=0x7f2ca8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c94009920 tx=0x7f2c94009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 -- 172.21.15.19:0/1411462243 shutdown_connections 2023-10-03T10:15:06.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca8135e50 0x7f2ca8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 --2- 172.21.15.19:0/1411462243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809e1d0 0x7f2ca8135910 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 -- 172.21.15.19:0/1411462243 >> 172.21.15.19:0/1411462243 conn(0x7f2ca8066f50 msgr2=0x7f2ca809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.935+0000 7f2caede0700 1 -- 172.21.15.19:0/1411462243 shutdown_connections 2023-10-03T10:15:06.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.936+0000 7f2caede0700 1 -- 172.21.15.19:0/1411462243 wait complete. 2023-10-03T10:15:06.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.936+0000 7f2caede0700 1 Processor -- start 2023-10-03T10:15:06.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 -- start start 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809d6f0 0x7f2ca8133370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 0x7f2ca811f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca8121180 con 0x7f2ca8135e50 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80a2080 con 0x7f2ca809d6f0 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2caede0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca81232b0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2ca7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56690/0 (socket says 172.21.15.19:56690) 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2ca7fff700 1 -- 172.21.15.19:0/761298745 learned_addr learned my addr 172.21.15.19:0/761298745 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.937+0000 7f2cad37d700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 0x7f2ca811f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2cacb7c700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809d6f0 0x7f2ca8133370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 -- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809d6f0 msgr2=0x7f2ca8133370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809d6f0 0x7f2ca8133370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 -- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 msgr2=0x7f2ca811f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 0x7f2ca811f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 -- 172.21.15.19:0/761298745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c94009550 con 0x7f2ca809e1d0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2cad37d700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 0x7f2ca811f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca7fff700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c94004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.938+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c94004450 con 0x7f2ca809e1d0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.939+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c940045b0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.939+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca8122db0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.939+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c940038c0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.939+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca8121780 con 0x7f2ca809e1d0 2023-10-03T10:15:06.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.940+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c94003a20 con 0x7f2ca809e1d0 2023-10-03T10:15:06.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.940+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c94021030 con 0x7f2ca809e1d0 2023-10-03T10:15:06.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.940+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca8074ea0 con 0x7f2ca809e1d0 2023-10-03T10:15:06.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.950+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c94015080 con 0x7f2ca809e1d0 2023-10-03T10:15:06.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.967+0000 7ffbc55ec700 1 Processor -- start 2023-10-03T10:15:06.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 -- start start 2023-10-03T10:15:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc0139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc009ece0 con 0x7ffbc006b080 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc009e760 con 0x7ffbc0131d10 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbc55ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc009e040 con 0x7ffbc006a770 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbbe7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffbc006b080 0x7ffbc0131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35148/0 (socket says 172.21.15.19:35148) 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbbe7fc700 1 -- 172.21.15.19:0/1107706447 learned_addr learned my addr 172.21.15.19:0/1107706447 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.968+0000 7ffbbf7fe700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc0139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbf7fe700 1 -- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 msgr2=0x7ffbc006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbf7fe700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbf7fe700 1 -- 172.21.15.19:0/1107706447 >> v1:172.21.15.19:6789/0 conn(0x7ffbc006b080 legacy=0x7ffbc0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbdffb700 1 -- 172.21.15.19:0/1107706447 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222279701 0 0) 0x7ffbc009ece0 con 0x7ffbc006b080 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbf7fe700 1 -- 172.21.15.19:0/1107706447 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc009f630 con 0x7ffbc0131d10 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbf7fe700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc0139860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009dc0 tx=0x7ffbb800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d35fa6e70c13ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbdffb700 1 -- 172.21.15.19:0/1107706447 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb800e070 con 0x7ffbc0131d10 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbdffb700 1 -- 172.21.15.19:0/1107706447 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb800bb20 con 0x7ffbc0131d10 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.969+0000 7ffbbdffb700 1 -- 172.21.15.19:0/1107706447 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb8012430 con 0x7ffbc0131d10 2023-10-03T10:15:06.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 msgr2=0x7ffbc0139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc0139860 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ffbb8009dc0 tx=0x7ffbb800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1107706447 shutdown_connections 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc0139860 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1107706447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1107706447 >> 172.21.15.19:0/1107706447 conn(0x7ffbc0066f50 msgr2=0x7ffbc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1107706447 shutdown_connections 2023-10-03T10:15:06.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.970+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1107706447 wait complete. 2023-10-03T10:15:06.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.971+0000 7ffbc55ec700 1 Processor -- start 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 -- start start 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc01c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc01c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0125e40 con 0x7ffbc006b080 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0124f80 con 0x7ffbc0131d10 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbc55ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc009c010 con 0x7ffbc006a770 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbbe7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbbe7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32826/0 (socket says 172.21.15.19:32826) 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbbe7fc700 1 -- 172.21.15.19:0/1012091777 learned_addr learned my addr 172.21.15.19:0/1012091777 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:06.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbbf7fe700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc01c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.972+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc01c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 -- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 msgr2=0x7ffbc01c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc01c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 -- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 msgr2=0x7ffbc01c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 -- 172.21.15.19:0/1012091777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00094a0 con 0x7ffbc006a770 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbf7fe700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc01c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbe7fc700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbbeffd700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc01c8010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e9b0 tx=0x7ffbb000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000ee50 con 0x7ffbc006a770 2023-10-03T10:15:06.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000c850 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000cc00 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb8009a70 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.973+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc009a7c0 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.974+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbb0013470 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.974+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffbb003f6c0 con 0x7ffbc006a770 2023-10-03T10:15:06.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.975+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0074ea0 con 0x7ffbc006a770 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.975+0000 7f5fdeb3a700 1 Processor -- start 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.975+0000 7f5fdeb3a700 1 -- start start 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdeb3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 0x7f5fd8130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdeb3a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 0x7f5fd8133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdeb3a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd8099ef0 con 0x7f5fd8130d50 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdeb3a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd8099500 con 0x7f5fd8130960 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdeb3a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8099c10 con 0x7f5fd8071b40 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fd7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 0x7f5fd8133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fd7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 0x7f5fd8133570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32834/0 (socket says 172.21.15.19:32834) 2023-10-03T10:15:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fd7fff700 1 -- 172.21.15.19:0/1519974172 learned_addr learned my addr 172.21.15.19:0/1519974172 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.976+0000 7f5fdc8d6700 1 --2- 172.21.15.19:0/1519974172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 0x7f5fd8130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fdc8d6700 1 -- 172.21.15.19:0/1519974172 >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 msgr2=0x7f5fd8133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fdc8d6700 1 --2- 172.21.15.19:0/1519974172 >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 0x7f5fd8133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fdc8d6700 1 -- 172.21.15.19:0/1519974172 >> v1:172.21.15.19:6789/0 conn(0x7f5fd8130d50 legacy=0x7f5fd8133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fdc8d6700 1 -- 172.21.15.19:0/1519974172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd809e370 con 0x7f5fd8071b40 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fdc8d6700 1 --2- 172.21.15.19:0/1519974172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 0x7f5fd8130420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d982a92abc75091 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fd77fe700 1 -- 172.21.15.19:0/1519974172 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc004230 con 0x7f5fd8071b40 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fd77fe700 1 -- 172.21.15.19:0/1519974172 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc004390 con 0x7f5fd8071b40 2023-10-03T10:15:06.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.977+0000 7f5fd77fe700 1 -- 172.21.15.19:0/1519974172 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0036a0 con 0x7f5fd8071b40 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.978+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/1519974172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 msgr2=0x7f5fd8130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.978+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/1519974172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 0x7f5fd8130420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc009840 tx=0x7f5fcc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.978+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/1519974172 shutdown_connections 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.978+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/1519974172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8071b40 0x7f5fd8130420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.979+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/1519974172 >> v2:172.21.15.19:3300/0 conn(0x7f5fd8130960 0x7f5fd8133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.979+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/1519974172 >> 172.21.15.19:0/1519974172 conn(0x7f5fd809e7e0 msgr2=0x7f5fd809ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:06.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.979+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/1519974172 shutdown_connections 2023-10-03T10:15:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.980+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbb0021080 con 0x7ffbc006a770 2023-10-03T10:15:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.979+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/1519974172 wait complete. 2023-10-03T10:15:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.980+0000 7f5fdeb3a700 1 Processor -- start 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.980+0000 7f5fdeb3a700 1 -- start start 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8071b40 0x7f5fd8098700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8130960 0x7f5fd813a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8139260 con 0x7f5fd8071b40 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8139520 con 0x7f5fd8130960 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdeb3a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8139f90 con 0x7f5fd8130d50 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdd0d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdd0d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56724/0 (socket says 172.21.15.19:56724) 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdd0d7700 1 -- 172.21.15.19:0/3640785550 learned_addr learned my addr 172.21.15.19:0/3640785550 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.981+0000 7f5fdc8d6700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8071b40 0x7f5fd8098700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fd7fff700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8130960 0x7f5fd813a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 -- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8130960 msgr2=0x7f5fd813a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8130960 0x7f5fd813a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 -- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8071b40 msgr2=0x7f5fd8098700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8071b40 0x7f5fd8098700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 -- 172.21.15.19:0/3640785550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fcc0094a0 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdd0d7700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c780 tx=0x7f5fd000ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0003e10 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd0005070 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd0005420 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.982+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd8138070 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.983+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd8098c40 con 0x7f5fd8130d50 2023-10-03T10:15:06.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.984+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fd0005580 con 0x7f5fd8130d50 2023-10-03T10:15:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.984+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd8137ec0 con 0x7f5fd8130d50 2023-10-03T10:15:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.984+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5fd003e8a0 con 0x7f5fd8130d50 2023-10-03T10:15:06.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:06.989+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5fd0017020 con 0x7f5fd8130d50 2023-10-03T10:15:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.020+0000 7fe97a102700 1 Processor -- start 2023-10-03T10:15:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.020+0000 7fe97a102700 1 -- start start 2023-10-03T10:15:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe97a102700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe97409d6f0 0x7fe97409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe97a102700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe97a102700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97409b120 con 0x7fe97409e000 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe97a102700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97406b460 con 0x7fe97409d6f0 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe97a102700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97409a7e0 con 0x7fe97409e440 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56728/0 (socket says 172.21.15.19:56728) 2023-10-03T10:15:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 -- 172.21.15.19:0/2371974448 learned_addr learned my addr 172.21.15.19:0/2371974448 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe9737fe700 1 --2- 172.21.15.19:0/2371974448 >> v2:172.21.15.19:3300/0 conn(0x7fe97409d6f0 0x7fe97409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 -- 172.21.15.19:0/2371974448 >> v2:172.21.15.19:3300/0 conn(0x7fe97409d6f0 msgr2=0x7fe97409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 --2- 172.21.15.19:0/2371974448 >> v2:172.21.15.19:3300/0 conn(0x7fe97409d6f0 0x7fe97409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 -- 172.21.15.19:0/2371974448 >> v1:172.21.15.19:6789/0 conn(0x7fe97409e000 legacy=0x7fe9741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.021+0000 7fe973fff700 1 -- 172.21.15.19:0/2371974448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97409a500 con 0x7fe97409e440 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.022+0000 7fe973fff700 1 --2- 172.21.15.19:0/2371974448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009e80 tx=0x7fe96c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c22c269a38874e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.022+0000 7fe9727fc700 1 -- 172.21.15.19:0/2371974448 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00e070 con 0x7fe97409e440 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.022+0000 7fe9727fc700 1 -- 172.21.15.19:0/2371974448 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c00b8d0 con 0x7fe97409e440 2023-10-03T10:15:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.022+0000 7fe9727fc700 1 -- 172.21.15.19:0/2371974448 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c00bc80 con 0x7fe97409e440 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 -- 172.21.15.19:0/2371974448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 msgr2=0x7fe974134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 --2- 172.21.15.19:0/2371974448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009e80 tx=0x7fe96c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 -- 172.21.15.19:0/2371974448 shutdown_connections 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 --2- 172.21.15.19:0/2371974448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e440 0x7fe974134100 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 --2- 172.21.15.19:0/2371974448 >> v2:172.21.15.19:3300/0 conn(0x7fe97409d6f0 0x7fe97409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 -- 172.21.15.19:0/2371974448 >> 172.21.15.19:0/2371974448 conn(0x7fe974066f50 msgr2=0x7fe97409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 -- 172.21.15.19:0/2371974448 shutdown_connections 2023-10-03T10:15:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.023+0000 7fe97a102700 1 -- 172.21.15.19:0/2371974448 wait complete. 2023-10-03T10:15:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.024+0000 7fe97a102700 1 Processor -- start 2023-10-03T10:15:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 -- start start 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97409d6f0 0x7fe9741a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 0x7fe9741a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741a81f0 con 0x7fe97409d6f0 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741a6b10 con 0x7fe97409e440 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.025+0000 7fe97a102700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9741a86a0 con 0x7fe97409e000 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 0x7fe9741a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45538/0 (socket says 172.21.15.19:45538) 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe972ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 0x7fe9741a53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56734/0 (socket says 172.21.15.19:56734) 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 -- 172.21.15.19:0/3715552227 learned_addr learned my addr 172.21.15.19:0/3715552227 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe9737fe700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97409d6f0 0x7fe9741a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 -- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 msgr2=0x7fe9741a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 0x7fe9741a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 -- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97409d6f0 msgr2=0x7fe9741a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97409d6f0 0x7fe9741a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 -- 172.21.15.19:0/3715552227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009b30 con 0x7fe97409e440 2023-10-03T10:15:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe973fff700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe97409a920 tx=0x7fe96c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c0048b0 con 0x7fe97409e440 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0092e0 con 0x7fe97409e440 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.026+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9740a1fb0 con 0x7fe97409e440 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.027+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c01c660 con 0x7fe97409e440 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.027+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9741a8980 con 0x7fe97409e440 2023-10-03T10:15:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.028+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe96c01c7c0 con 0x7fe97409e440 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.028+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe974074ea0 con 0x7fe97409e440 2023-10-03T10:15:07.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.028+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe96c041070 con 0x7fe97409e440 2023-10-03T10:15:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.033+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe96c024980 con 0x7fe97409e440 2023-10-03T10:15:07.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.167+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ca806c360 con 0x7f2ca809e1d0 2023-10-03T10:15:07.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.167+0000 7f2ca57fa700 1 -- 172.21.15.19:0/761298745 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c9402b020 con 0x7f2ca809e1d0 2023-10-03T10:15:07.168 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 msgr2=0x7f2ca81338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2c94000c00 tx=0x7f2c94004750 comp rx=0 tx=0).stop 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 shutdown_connections 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ca8135e50 0x7f2ca811f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ca809d6f0 0x7f2ca8133370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 --2- 172.21.15.19:0/761298745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ca809e1d0 0x7f2ca81338b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 >> 172.21.15.19:0/761298745 conn(0x7f2ca8066f50 msgr2=0x7f2ca806b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 shutdown_connections 2023-10-03T10:15:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.170+0000 7f2caede0700 1 -- 172.21.15.19:0/761298745 wait complete. 2023-10-03T10:15:07.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:07.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.194+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbc01310e0 con 0x7ffbc006a770 2023-10-03T10:15:07.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.194+0000 7ffba77fe700 1 -- 172.21.15.19:0/1012091777 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbb0017020 con 0x7ffbc006a770 2023-10-03T10:15:07.195 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 msgr2=0x7ffbc01c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc01c8010 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000e9b0 tx=0x7ffbb000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 shutdown_connections 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc0131d10 0x7ffbc01c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc006a770 0x7ffbc01c8010 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 --2- 172.21.15.19:0/1012091777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc006b080 0x7ffbc01c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 >> 172.21.15.19:0/1012091777 conn(0x7ffbc0066f50 msgr2=0x7ffbc0070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 shutdown_connections 2023-10-03T10:15:07.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.197+0000 7ffbc55ec700 1 -- 172.21.15.19:0/1012091777 wait complete. 2023-10-03T10:15:07.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.201+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5fd8098ef0 con 0x7f5fd8130d50 2023-10-03T10:15:07.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.201+0000 7f5fd57fa700 1 -- 172.21.15.19:0/3640785550 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5fd000eb00 con 0x7f5fd8130d50 2023-10-03T10:15:07.202 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:07.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.203+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 msgr2=0x7f5fd813acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.203+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5fd000c780 tx=0x7f5fd000ca90 comp rx=0 tx=0).stop 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 shutdown_connections 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5fd8130d50 0x7f5fd813acd0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8071b40 0x7f5fd8098700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 --2- 172.21.15.19:0/3640785550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5fd8130960 0x7f5fd813a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 >> 172.21.15.19:0/3640785550 conn(0x7f5fd809e7e0 msgr2=0x7f5fd809c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 shutdown_connections 2023-10-03T10:15:07.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.204+0000 7f5fdeb3a700 1 -- 172.21.15.19:0/3640785550 wait complete. 2023-10-03T10:15:07.213 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:07.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.242+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe97409f420 con 0x7fe97409e440 2023-10-03T10:15:07.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.243+0000 7fe95bfff700 1 -- 172.21.15.19:0/3715552227 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe96c0243b0 con 0x7fe97409e440 2023-10-03T10:15:07.243 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 msgr2=0x7fe9741a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:07.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe97409a920 tx=0x7fe96c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 shutdown_connections 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe97409e440 0x7fe9741a58e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97409d6f0 0x7fe9741a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 --2- 172.21.15.19:0/3715552227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe97409e000 0x7fe9741a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 >> 172.21.15.19:0/3715552227 conn(0x7fe974066f50 msgr2=0x7fe9741b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 shutdown_connections 2023-10-03T10:15:07.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:07.245+0000 7fe97a102700 1 -- 172.21.15.19:0/3715552227 wait complete. 2023-10-03T10:15:07.261 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:08.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:08.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:08.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:08.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.350+0000 7ffac1580700 1 Processor -- start 2023-10-03T10:15:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.350+0000 7ffac1580700 1 -- start start 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.350+0000 7ffac1580700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffabc1338a0 0x7ffabc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffac1580700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 0x7ffabc13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffac1580700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffabc06ef30 con 0x7ffabc09de50 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffac1580700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffabc06fef0 con 0x7ffabc1338a0 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffac1580700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc1334b0 con 0x7ffabc09e930 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffabc1338a0 0x7ffabc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffabc1338a0 0x7ffabc133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32864/0 (socket says 172.21.15.19:32864) 2023-10-03T10:15:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 -- 172.21.15.19:0/2246987112 learned_addr learned my addr 172.21.15.19:0/2246987112 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffaba7fc700 1 --1- 172.21.15.19:0/2246987112 >> v1:172.21.15.19:6789/0 conn(0x7ffabc09de50 0x7ffabc09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35162/0 (socket says 172.21.15.19:35162) 2023-10-03T10:15:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabb7fe700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 0x7ffabc13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 -- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 msgr2=0x7ffabc13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 0x7ffabc13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 -- 172.21.15.19:0/2246987112 >> v1:172.21.15.19:6789/0 conn(0x7ffabc09de50 legacy=0x7ffabc09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabaffd700 1 -- 172.21.15.19:0/2246987112 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc06fc30 con 0x7ffabc1338a0 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffab9ffb700 1 -- 172.21.15.19:0/2246987112 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253382498 0 0) 0x7ffabc06ef30 con 0x7ffabc09de50 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.351+0000 7ffabb7fe700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 0x7ffabc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.352+0000 7ffabaffd700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc133c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098f0 tx=0x7ffaac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5075a3f1753aaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.352+0000 7ffab9ffb700 1 -- 172.21.15.19:0/2246987112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011830 con 0x7ffabc1338a0 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.352+0000 7ffab9ffb700 1 -- 172.21.15.19:0/2246987112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011990 con 0x7ffabc1338a0 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.352+0000 7ffab9ffb700 1 -- 172.21.15.19:0/2246987112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011d20 con 0x7ffabc1338a0 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 -- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 msgr2=0x7ffabc133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc133c70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffaac0098f0 tx=0x7ffaac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 -- 172.21.15.19:0/2246987112 shutdown_connections 2023-10-03T10:15:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09e930 0x7ffabc13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 --2- 172.21.15.19:0/2246987112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc133c70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 -- 172.21.15.19:0/2246987112 >> 172.21.15.19:0/2246987112 conn(0x7ffabc0a2aa0 msgr2=0x7ffabc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 -- 172.21.15.19:0/2246987112 shutdown_connections 2023-10-03T10:15:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.353+0000 7ffac1580700 1 -- 172.21.15.19:0/2246987112 wait complete. 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.354+0000 7ffac1580700 1 Processor -- start 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.354+0000 7ffac1580700 1 -- start start 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 0x7ffabc11d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc11e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc11f320 con 0x7ffabc1338a0 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc120570 con 0x7ffabc09e930 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffac1580700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc11f910 con 0x7ffabc09de50 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffaba7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffaba7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45554/0 (socket says 172.21.15.19:45554) 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffabaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 0x7ffabc11d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffaba7fc700 1 -- 172.21.15.19:0/2071001127 learned_addr learned my addr 172.21.15.19:0/2071001127 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.355+0000 7ffabb7fe700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc11e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 -- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 msgr2=0x7ffabc11d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 0x7ffabc11d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 -- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 msgr2=0x7ffabc11e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc11e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 -- 172.21.15.19:0/2071001127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4009a70 con 0x7ffabc09e930 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffabaffd700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 0x7ffabc11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaba7fc700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c550 tx=0x7ffab000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0004c80 con 0x7ffabc09e930 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab0004e00 con 0x7ffabc09e930 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac009550 con 0x7ffabc09e930 2023-10-03T10:15:08.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab0007310 con 0x7ffabc09e930 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.356+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc06f640 con 0x7ffabc09e930 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.357+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffab0007470 con 0x7ffabc09e930 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.357+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc074ea0 con 0x7ffabc09e930 2023-10-03T10:15:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.358+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffab003f260 con 0x7ffabc09e930 2023-10-03T10:15:08.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.363+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffab00133c0 con 0x7ffabc09e930 2023-10-03T10:15:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.381+0000 7fd5e3613700 1 Processor -- start 2023-10-03T10:15:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.381+0000 7fd5e3613700 1 -- start start 2023-10-03T10:15:08.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e3613700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5dc09d6f0 0x7fd5dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e3613700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e3613700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc09f130 con 0x7fd5dc09e000 2023-10-03T10:15:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e3613700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc09f520 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e3613700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc09e930 con 0x7fd5dc09e410 2023-10-03T10:15:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e13af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5dc09d6f0 0x7fd5dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e0bae700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5dc09e000 0x7fd5dc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35166/0 (socket says 172.21.15.19:35166) 2023-10-03T10:15:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e0bae700 1 -- 172.21.15.19:0/1336277058 learned_addr learned my addr 172.21.15.19:0/1336277058 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e1bb0700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7f696c117700 1 Processor -- start 2023-10-03T10:15:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e13af700 1 -- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 msgr2=0x7fd5dc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e13af700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e13af700 1 -- 172.21.15.19:0/1336277058 >> v1:172.21.15.19:6789/0 conn(0x7fd5dc09e000 legacy=0x7fd5dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.382+0000 7fd5e13af700 1 -- 172.21.15.19:0/1336277058 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc09b2d0 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 -- start start 2023-10-03T10:15:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7fd5e13af700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc09dac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800bae0 tx=0x7fd5d800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2e925d505ea2a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7fd5d3fff700 1 -- 172.21.15.19:0/1336277058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d800dc70 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7fd5d3fff700 1 -- 172.21.15.19:0/1336277058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d800ddd0 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7fd5d3fff700 1 -- 172.21.15.19:0/1336277058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d8010690 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 0x7f6964130710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f6964131990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696409a390 con 0x7f6964130340 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640716a0 con 0x7f6964131530 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f696c117700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6964071290 con 0x7f6964130c50 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f69696b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f69696b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56778/0 (socket says 172.21.15.19:56778) 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.383+0000 7f69696b2700 1 -- 172.21.15.19:0/1602741002 learned_addr learned my addr 172.21.15.19:0/1602741002 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f696a6b4700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f6964131990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 -- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 msgr2=0x7fd5dc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc09dac0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800bae0 tx=0x7fd5d800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f6969eb3700 1 --2- 172.21.15.19:0/1602741002 >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 0x7f6964130710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 -- 172.21.15.19:0/1336277058 shutdown_connections 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 --2- 172.21.15.19:0/1336277058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc09dac0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 -- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 msgr2=0x7f6964131990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f6964131990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 -- 172.21.15.19:0/1602741002 >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 msgr2=0x7f6964130710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 --2- 172.21.15.19:0/1602741002 >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 0x7f6964130710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 -- 172.21.15.19:0/1336277058 >> 172.21.15.19:0/1336277058 conn(0x7fd5dc066f50 msgr2=0x7fd5dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 -- 172.21.15.19:0/1602741002 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964070b80 con 0x7f6964130c50 2023-10-03T10:15:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f6969eb3700 1 --2- 172.21.15.19:0/1602741002 >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 0x7f6964130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 -- 172.21.15.19:0/1336277058 shutdown_connections 2023-10-03T10:15:08.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7fd5e3613700 1 -- 172.21.15.19:0/1336277058 wait complete. 2023-10-03T10:15:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.384+0000 7f69696b2700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6960009920 tx=0x7f6960009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a8914c3d140a987 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.385+0000 7f6968eb1700 1 -- 172.21.15.19:0/1602741002 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011830 con 0x7f6964130c50 2023-10-03T10:15:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.385+0000 7f6968eb1700 1 -- 172.21.15.19:0/1602741002 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6960011990 con 0x7f6964130c50 2023-10-03T10:15:08.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.385+0000 7f6968eb1700 1 -- 172.21.15.19:0/1602741002 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6960011d20 con 0x7f6964130c50 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.385+0000 7fd5e3613700 1 Processor -- start 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.385+0000 7fd5e3613700 1 -- start start 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 -- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 msgr2=0x7f6964135750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6960009920 tx=0x7f6960009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 -- 172.21.15.19:0/1602741002 shutdown_connections 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f6964131990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 --2- 172.21.15.19:0/1602741002 >> v2:172.21.15.19:3300/0 conn(0x7f6964130340 0x7f6964130710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 --2- 172.21.15.19:0/1602741002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130c50 0x7f6964135750 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 -- 172.21.15.19:0/1602741002 >> 172.21.15.19:0/1602741002 conn(0x7f69640a2aa0 msgr2=0x7f69640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 -- 172.21.15.19:0/1602741002 shutdown_connections 2023-10-03T10:15:08.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7f696c117700 1 -- 172.21.15.19:0/1602741002 wait complete. 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5dc09e000 0x7fd5dc122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc123ee0 con 0x7fd5dc09d6f0 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc124770 con 0x7fd5dc09e000 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e3613700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc125df0 con 0x7fd5dc09e410 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e1bb0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e13af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e1bb0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56794/0 (socket says 172.21.15.19:56794) 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.386+0000 7fd5e1bb0700 1 -- 172.21.15.19:0/883297818 learned_addr learned my addr 172.21.15.19:0/883297818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 -- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5dc09e000 msgr2=0x7fd5dc122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5dc09e000 0x7fd5dc122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 -- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 msgr2=0x7fd5dc122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 -- 172.21.15.19:0/883297818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d800b740 con 0x7fd5dc09e410 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e13af700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7f696c117700 1 Processor -- start 2023-10-03T10:15:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e1bb0700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400efc0 tx=0x7fd5d400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4009ea0 con 0x7fd5dc09e410 2023-10-03T10:15:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d400f040 con 0x7fd5dc09e410 2023-10-03T10:15:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4014480 con 0x7fd5dc09e410 2023-10-03T10:15:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7f696c117700 1 -- start start 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7f696c117700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7f696c117700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6964130c50 0x7f696412d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f696c117700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f69641cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f696c117700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640718e0 con 0x7f6964130c50 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f696c117700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696412db00 con 0x7f6964131530 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f696c117700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f696412b5c0 con 0x7f6964130340 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56800/0 (socket says 172.21.15.19:56800) 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 -- 172.21.15.19:0/3706875806 learned_addr learned my addr 172.21.15.19:0/3706875806 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f696a6b4700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f69641cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 -- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 msgr2=0x7f69641cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f69641cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 -- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6964130c50 msgr2=0x7f696412d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6964130c50 0x7f696412d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7f6969eb3700 1 -- 172.21.15.19:0/3706875806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6960009550 con 0x7f6964130340 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7f696a6b4700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f69641cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.387+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0a1d00 con 0x7fd5dc09e410 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.388+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc125b10 con 0x7fd5dc09e410 2023-10-03T10:15:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7f6969eb3700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f695400e760 tx=0x7f695400ea70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5d40145e0 con 0x7fd5dc09e410 2023-10-03T10:15:08.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954013610 con 0x7f6964130340 2023-10-03T10:15:08.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5d403ff30 con 0x7fd5dc09e410 2023-10-03T10:15:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696412a440 con 0x7f6964130340 2023-10-03T10:15:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.389+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6964129c50 con 0x7f6964130340 2023-10-03T10:15:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.390+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954013770 con 0x7f6964130340 2023-10-03T10:15:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.390+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954013b20 con 0x7f6964130340 2023-10-03T10:15:08.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.390+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc074ea0 con 0x7fd5dc09e410 2023-10-03T10:15:08.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.390+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696412fa50 con 0x7f6964130340 2023-10-03T10:15:08.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.392+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6954013c80 con 0x7f6964130340 2023-10-03T10:15:08.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.392+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f695403f850 con 0x7f6964130340 2023-10-03T10:15:08.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.396+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5d4018070 con 0x7fd5dc09e410 2023-10-03T10:15:08.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.400+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6954026430 con 0x7f6964130340 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.422+0000 7fc765272700 1 Processor -- start 2023-10-03T10:15:08.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.422+0000 7fc765272700 1 -- start start 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc765272700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 0x7fc760138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc765272700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc760138dc0 0x7fc76013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc765272700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76006b990 con 0x7fc760133420 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc765272700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76009b0e0 con 0x7fc760138dc0 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc765272700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc760133c20 con 0x7fc7601337f0 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc760133420 0x7fc760133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35174/0 (socket says 172.21.15.19:35174) 2023-10-03T10:15:08.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75effd700 1 -- 172.21.15.19:0/627385124 learned_addr learned my addr 172.21.15.19:0/627385124 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:08.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75e7fc700 1 --2- 172.21.15.19:0/627385124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 0x7fc760138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75f7fe700 1 --2- 172.21.15.19:0/627385124 >> v2:172.21.15.19:3300/0 conn(0x7fc760138dc0 0x7fc76013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75dffb700 1 -- 172.21.15.19:0/627385124 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648052299 0 0) 0x7fc76006b990 con 0x7fc760133420 2023-10-03T10:15:08.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.423+0000 7fc75dffb700 1 -- 172.21.15.19:0/627385124 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480035b0 con 0x7fc760133420 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75e7fc700 1 -- 172.21.15.19:0/627385124 >> v2:172.21.15.19:3300/0 conn(0x7fc760138dc0 msgr2=0x7fc76013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75e7fc700 1 --2- 172.21.15.19:0/627385124 >> v2:172.21.15.19:3300/0 conn(0x7fc760138dc0 0x7fc76013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75e7fc700 1 -- 172.21.15.19:0/627385124 >> v1:172.21.15.19:6789/0 conn(0x7fc760133420 legacy=0x7fc760133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75e7fc700 1 -- 172.21.15.19:0/627385124 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600a0590 con 0x7fc7601337f0 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75e7fc700 1 --2- 172.21.15.19:0/627385124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 0x7fc760138880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc754009840 tx=0x7fc754009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=692222145b4fc9dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75dffb700 1 -- 172.21.15.19:0/627385124 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011830 con 0x7fc7601337f0 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75dffb700 1 -- 172.21.15.19:0/627385124 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754011990 con 0x7fc7601337f0 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.424+0000 7fc75dffb700 1 -- 172.21.15.19:0/627385124 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc754011d20 con 0x7fc7601337f0 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 -- 172.21.15.19:0/627385124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 msgr2=0x7fc760138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 --2- 172.21.15.19:0/627385124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 0x7fc760138880 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc754009840 tx=0x7fc754009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 -- 172.21.15.19:0/627385124 shutdown_connections 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 --2- 172.21.15.19:0/627385124 >> v2:172.21.15.19:3300/0 conn(0x7fc760138dc0 0x7fc76013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 --2- 172.21.15.19:0/627385124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7601337f0 0x7fc760138880 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 -- 172.21.15.19:0/627385124 >> 172.21.15.19:0/627385124 conn(0x7fc7600a4210 msgr2=0x7fc7600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 -- 172.21.15.19:0/627385124 shutdown_connections 2023-10-03T10:15:08.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.425+0000 7fc765272700 1 -- 172.21.15.19:0/627385124 wait complete. 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.426+0000 7fc765272700 1 Processor -- start 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.426+0000 7fc765272700 1 -- start start 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 0x7fc760070a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 0x7fc760070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 0x7fc760071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76009c9c0 con 0x7fc760138dc0 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76009b8b0 con 0x7fc7601337f0 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc765272700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc76009c720 con 0x7fc760133420 2023-10-03T10:15:08.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 0x7fc760070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 0x7fc760070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 0x7fc760070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56816/0 (socket says 172.21.15.19:56816) 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 0x7fc760070f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45586/0 (socket says 172.21.15.19:45586) 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75effd700 1 -- 172.21.15.19:0/535110468 learned_addr learned my addr 172.21.15.19:0/535110468 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 0x7fc760071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 -- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 msgr2=0x7fc760070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 0x7fc760070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 -- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 msgr2=0x7fc760070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 0x7fc760070f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 -- 172.21.15.19:0/535110468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7540094a0 con 0x7fc760138dc0 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.427+0000 7fc75f7fe700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 0x7fc760071480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc75800efc0 tx=0x7fc75800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:08.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.428+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75800cc90 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.428+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75800f040 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.428+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc760132f70 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.428+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758009e60 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.428+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc760072610 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.429+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc758014480 con 0x7fc760138dc0 2023-10-03T10:15:08.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.429+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc75803fe50 con 0x7fc760138dc0 2023-10-03T10:15:08.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.429+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc760074ea0 con 0x7fc760138dc0 2023-10-03T10:15:08.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.438+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc758018020 con 0x7fc760138dc0 2023-10-03T10:15:08.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.593+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffabc06b9e0 con 0x7ffabc09e930 2023-10-03T10:15:08.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.594+0000 7ffaa37fe700 1 -- 172.21.15.19:0/2071001127 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffab0011360 con 0x7ffabc09e930 2023-10-03T10:15:08.595 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 msgr2=0x7ffabc11dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffab000c550 tx=0x7ffab000c860 comp rx=0 tx=0).stop 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 shutdown_connections 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffabc1338a0 0x7ffabc11e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffabc09de50 0x7ffabc11d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 --2- 172.21.15.19:0/2071001127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffabc09e930 0x7ffabc11dd80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 >> 172.21.15.19:0/2071001127 conn(0x7ffabc0a2aa0 msgr2=0x7ffabc1b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 shutdown_connections 2023-10-03T10:15:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.596+0000 7ffac1580700 1 -- 172.21.15.19:0/2071001127 wait complete. 2023-10-03T10:15:08.611 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:08.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.612+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5dc09c700 con 0x7fd5dc09e410 2023-10-03T10:15:08.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.612+0000 7fd5d1ffb700 1 -- 172.21.15.19:0/883297818 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5d401a4a0 con 0x7fd5dc09e410 2023-10-03T10:15:08.613 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 msgr2=0x7fd5dc122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400efc0 tx=0x7fd5d400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 shutdown_connections 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5dc09e410 0x7fd5dc122da0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5dc09d6f0 0x7fd5dc122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.614+0000 7fd5e3613700 1 --2- 172.21.15.19:0/883297818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5dc09e000 0x7fd5dc122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.615+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 >> 172.21.15.19:0/883297818 conn(0x7fd5dc066f50 msgr2=0x7fd5dc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.615+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 shutdown_connections 2023-10-03T10:15:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.615+0000 7fd5e3613700 1 -- 172.21.15.19:0/883297818 wait complete. 2023-10-03T10:15:08.629 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:08.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.630+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f696412b780 con 0x7f6964130340 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.630+0000 7f695a7fc700 1 -- 172.21.15.19:0/3706875806 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6954021020 con 0x7f6964130340 2023-10-03T10:15:08.631 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 msgr2=0x7f696412ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f695400e760 tx=0x7f695400ea70 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 shutdown_connections 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6964131530 0x7f69641cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6964130340 0x7f696412ccf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 --2- 172.21.15.19:0/3706875806 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6964130c50 0x7f696412d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 >> 172.21.15.19:0/3706875806 conn(0x7f69640a2aa0 msgr2=0x7f696406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 shutdown_connections 2023-10-03T10:15:08.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.633+0000 7f696c117700 1 -- 172.21.15.19:0/3706875806 wait complete. 2023-10-03T10:15:08.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:08.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.646+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc76006b250 con 0x7fc760138dc0 2023-10-03T10:15:08.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.647+0000 7fc7477fe700 1 -- 172.21.15.19:0/535110468 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc758011680 con 0x7fc760138dc0 2023-10-03T10:15:08.648 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 msgr2=0x7fc760071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 0x7fc760071480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc75800efc0 tx=0x7fc75800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 shutdown_connections 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc760138dc0 0x7fc760071480 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc760133420 0x7fc760070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 --2- 172.21.15.19:0/535110468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7601337f0 0x7fc760070f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 >> 172.21.15.19:0/535110468 conn(0x7fc7600a4210 msgr2=0x7fc7600a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 shutdown_connections 2023-10-03T10:15:08.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:08.649+0000 7fc765272700 1 -- 172.21.15.19:0/535110468 wait complete. 2023-10-03T10:15:08.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:09.612 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:09.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:09.648 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:09.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 Processor -- start 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 -- start start 2023-10-03T10:15:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e000 0x7f5e68130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6809f520 con 0x7f5e6809d6f0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6809f130 con 0x7f5e6809e000 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.765+0000 7f5e6cb24700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6809e930 con 0x7f5e6809e410 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e6659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56828/0 (socket says 172.21.15.19:56828) 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e6659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32938/0 (socket says 172.21.15.19:32938) 2023-10-03T10:15:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 -- 172.21.15.19:0/3035724816 learned_addr learned my addr 172.21.15.19:0/3035724816 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 -- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e000 msgr2=0x7f5e68130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e000 0x7f5e68130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 -- 172.21.15.19:0/3035724816 >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 msgr2=0x7f5e6809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/3035724816 >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 -- 172.21.15.19:0/3035724816 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6809b2d0 con 0x7f5e6809e410 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e6659c700 1 --2- 172.21.15.19:0/3035724816 >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.766+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009e80 tx=0x7f5e6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3ec96c573c8147 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.767+0000 7f5e6559a700 1 -- 172.21.15.19:0/3035724816 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000e070 con 0x7f5e6809e410 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.767+0000 7f5e6559a700 1 -- 172.21.15.19:0/3035724816 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000b8d0 con 0x7f5e6809e410 2023-10-03T10:15:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.767+0000 7f5e6559a700 1 -- 172.21.15.19:0/3035724816 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000bc80 con 0x7f5e6809e410 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 -- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 msgr2=0x7f5e68130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009e80 tx=0x7f5e6000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 -- 172.21.15.19:0/3035724816 shutdown_connections 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e410 0x7f5e68130ba0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/3035724816 >> v2:172.21.15.19:3300/0 conn(0x7f5e6809d6f0 0x7f5e6809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/3035724816 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e000 0x7f5e68130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 -- 172.21.15.19:0/3035724816 >> 172.21.15.19:0/3035724816 conn(0x7f5e68066f50 msgr2=0x7f5e6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 -- 172.21.15.19:0/3035724816 shutdown_connections 2023-10-03T10:15:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.768+0000 7f5e6cb24700 1 -- 172.21.15.19:0/3035724816 wait complete. 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.769+0000 7f5e6cb24700 1 Processor -- start 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.769+0000 7f5e6cb24700 1 -- start start 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 0x7f5e681374c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 0x7f5e681c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68130e30 con 0x7f5e6809d6f0 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6809c700 con 0x7f5e6809e410 2023-10-03T10:15:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6cb24700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68119a30 con 0x7f5e6809e000 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32954/0 (socket says 172.21.15.19:32954) 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6659c700 1 -- 172.21.15.19:0/237647953 learned_addr learned my addr 172.21.15.19:0/237647953 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e65d9b700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 0x7f5e681374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 0x7f5e681c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 -- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 msgr2=0x7f5e681374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 0x7f5e681374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 -- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 msgr2=0x7f5e68136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e66d9d700 1 -- 172.21.15.19:0/237647953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580094a0 con 0x7f5e6809e410 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e65d9b700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 0x7f5e681374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.770+0000 7f5e6659c700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e66d9d700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 0x7f5e681c8100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e60015000 tx=0x7f5e60004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004450 con 0x7f5e6809e410 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e60009b30 con 0x7f5e6809e410 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e681382c0 con 0x7f5e6809e410 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e600045f0 con 0x7f5e6809e410 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.771+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600092e0 con 0x7f5e6809e410 2023-10-03T10:15:09.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.772+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4c0052e0 con 0x7f5e6809e410 2023-10-03T10:15:09.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.773+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e60025460 con 0x7f5e6809e410 2023-10-03T10:15:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.773+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e60025710 con 0x7f5e6809e410 2023-10-03T10:15:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.782+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e60046060 con 0x7f5e6809e410 2023-10-03T10:15:09.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.805+0000 7f8cfe3d0700 1 Processor -- start 2023-10-03T10:15:09.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 -- start start 2023-10-03T10:15:09.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cf809d6f0 0x7f8cf809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf809b120 con 0x7f8cf809e410 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf806b460 con 0x7f8cf809d6f0 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfe3d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf809a7e0 con 0x7f8cf809e000 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfc96d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8cf809e410 0x7f8cf8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35184/0 (socket says 172.21.15.19:35184) 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cfc96d700 1 -- 172.21.15.19:0/1306558922 learned_addr learned my addr 172.21.15.19:0/1306558922 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.806+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/1306558922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf7fff700 1 --2- 172.21.15.19:0/1306558922 >> v2:172.21.15.19:3300/0 conn(0x7f8cf809d6f0 0x7f8cf809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f6d65947700 1 Processor -- start 2023-10-03T10:15:09.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f6d65947700 1 -- start start 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf77fe700 1 -- 172.21.15.19:0/1306558922 >> v2:172.21.15.19:3300/0 conn(0x7f8cf809d6f0 msgr2=0x7f8cf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/1306558922 >> v2:172.21.15.19:3300/0 conn(0x7f8cf809d6f0 0x7f8cf809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf77fe700 1 -- 172.21.15.19:0/1306558922 >> v1:172.21.15.19:6789/0 conn(0x7f8cf809e410 legacy=0x7f8cf8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf77fe700 1 -- 172.21.15.19:0/1306558922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf809a500 con 0x7f8cf809e000 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/1306558922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81339f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009870 tx=0x7f8cec009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45d77f9776d276a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf6ffd700 1 -- 172.21.15.19:0/1306558922 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec011830 con 0x7f8cf809e000 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf6ffd700 1 -- 172.21.15.19:0/1306558922 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec011990 con 0x7f8cf809e000 2023-10-03T10:15:09.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.807+0000 7f8cf6ffd700 1 -- 172.21.15.19:0/1306558922 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec011d20 con 0x7f8cf809e000 2023-10-03T10:15:09.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d65947700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d65947700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6d60139170 0x7f6d6013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d65947700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6009b120 con 0x7f6d6009d6f0 2023-10-03T10:15:09.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d65947700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6006b460 con 0x7f6d60139170 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d65947700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6009a7e0 con 0x7f6d6009e1d0 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45618/0 (socket says 172.21.15.19:45618) 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/156441597 learned_addr learned my addr 172.21.15.19:0/156441597 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/156441597 >> v2:172.21.15.19:3300/0 conn(0x7f6d60139170 msgr2=0x7f6d6013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 --2- 172.21.15.19:0/156441597 >> v2:172.21.15.19:3300/0 conn(0x7f6d60139170 0x7f6d6013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/156441597 >> v1:172.21.15.19:6789/0 conn(0x7f6d6009d6f0 legacy=0x7f6d6009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/156441597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6009a500 con 0x7f6d6009e1d0 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/1306558922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 msgr2=0x7f8cf81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/1306558922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81339f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009870 tx=0x7f8cec009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:09.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.808+0000 7f6d5e7fc700 1 --2- 172.21.15.19:0/156441597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009920 tx=0x7f6d54009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=579e498fd3675419 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f6d5dffb700 1 -- 172.21.15.19:0/156441597 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54004230 con 0x7f6d6009e1d0 2023-10-03T10:15:09.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f6d5dffb700 1 -- 172.21.15.19:0/156441597 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54004390 con 0x7f6d6009e1d0 2023-10-03T10:15:09.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/1306558922 shutdown_connections 2023-10-03T10:15:09.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f6d5dffb700 1 -- 172.21.15.19:0/156441597 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54009e70 con 0x7f6d6009e1d0 2023-10-03T10:15:09.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/1306558922 >> v2:172.21.15.19:3300/0 conn(0x7f8cf809d6f0 0x7f8cf809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/1306558922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81339f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/1306558922 >> 172.21.15.19:0/1306558922 conn(0x7f8cf8066f50 msgr2=0x7f8cf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/1306558922 shutdown_connections 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.809+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/1306558922 wait complete. 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 -- 172.21.15.19:0/156441597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 msgr2=0x7f6d60138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 --2- 172.21.15.19:0/156441597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009920 tx=0x7f6d54009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 -- 172.21.15.19:0/156441597 shutdown_connections 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 --2- 172.21.15.19:0/156441597 >> v2:172.21.15.19:3300/0 conn(0x7f6d60139170 0x7f6d6013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 --2- 172.21.15.19:0/156441597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d6009e1d0 0x7f6d60138c30 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009920 tx=0x7f6d54009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:09.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 -- 172.21.15.19:0/156441597 >> 172.21.15.19:0/156441597 conn(0x7f6d60066f50 msgr2=0x7f6d6009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f8cfe3d0700 1 Processor -- start 2023-10-03T10:15:09.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f6d65947700 1 -- 172.21.15.19:0/156441597 shutdown_connections 2023-10-03T10:15:09.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.810+0000 7f8cfe3d0700 1 -- start start 2023-10-03T10:15:09.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 0x7f8cf81a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cf809e410 0x7f8cf81a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81a7460 con 0x7f8cf809d6f0 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81a7b00 con 0x7f8cf809e000 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf81a8120 con 0x7f8cf809e410 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45628/0 (socket says 172.21.15.19:45628) 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 -- 172.21.15.19:0/3679486991 learned_addr learned my addr 172.21.15.19:0/3679486991 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f6d65947700 1 -- 172.21.15.19:0/156441597 wait complete. 2023-10-03T10:15:09.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf7fff700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 0x7f8cf81a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 -- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cf809e410 msgr2=0x7f8cf81a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cf809e410 0x7f8cf81a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 -- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 msgr2=0x7f8cf81a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 0x7f8cf81a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 -- 172.21.15.19:0/3679486991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0094a0 con 0x7f8cf809e000 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf77fe700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0090b0 tx=0x7f8cec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0036a0 con 0x7f8cf809e000 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cec01f070 con 0x7f8cf809e000 2023-10-03T10:15:09.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.811+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf81a9730 con 0x7f8cf809e000 2023-10-03T10:15:09.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.812+0000 7f6d65947700 1 Processor -- start 2023-10-03T10:15:09.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 -- start start 2023-10-03T10:15:09.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.812+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cec003a00 con 0x7f8cf809e000 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.812+0000 7f8cf7fff700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 0x7f8cf81a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.812+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf809c710 con 0x7f8cf809e000 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cec003b60 con 0x7f8cf809e000 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8cec021070 con 0x7f8cf809e000 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf8074ea0 con 0x7f8cf809e000 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d6009d6f0 0x7f6d6011f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d601c85e0 0x7f6d601c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6011f210 con 0x7f6d60139170 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601345e0 con 0x7f6d601c85e0 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.813+0000 7f6d65947700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6d601224f0 con 0x7f6d6009d6f0 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32980/0 (socket says 172.21.15.19:32980) 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/1181728528 learned_addr learned my addr 172.21.15.19:0/1181728528 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d6009d6f0 msgr2=0x7f6d6011f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d6009d6f0 0x7f6d6011f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d601c85e0 msgr2=0x7f6d601c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d601c85e0 0x7f6d601c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 -- 172.21.15.19:0/1181728528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d54009550 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d5e7fc700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009870 tx=0x7f6d54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5400bc90 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5401f070 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.814+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d540036a0 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.815+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d60120e70 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.815+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d600a2d20 con 0x7f6d60139170 2023-10-03T10:15:09.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.816+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6d54021030 con 0x7f6d60139170 2023-10-03T10:15:09.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.816+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6d54040c60 con 0x7f6d60139170 2023-10-03T10:15:09.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.819+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cec02b020 con 0x7f8cf809e000 2023-10-03T10:15:09.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.819+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d60122170 con 0x7f6d60139170 2023-10-03T10:15:09.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.829+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6d60122170 con 0x7f6d60139170 2023-10-03T10:15:09.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 Processor -- start 2023-10-03T10:15:09.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 -- start start 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3dd8130540 0x7f3dd8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 0x7f3dd806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd806fb20 0x7f3dd806ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd809a390 con 0x7f3dd8130540 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80716a0 con 0x7f3dd8130e50 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.865+0000 7f3ddf16d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8071290 con 0x7f3dd806fb20 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3dd8130540 0x7f3dd8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3dd7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 0x7f3dd806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3dd8130540 0x7f3dd8130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32992/0 (socket says 172.21.15.19:32992) 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 -- 172.21.15.19:0/2452674482 learned_addr learned my addr 172.21.15.19:0/2452674482 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddd70a700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd806fb20 0x7f3dd806ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 -- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd806fb20 msgr2=0x7f3dd806ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd806fb20 0x7f3dd806ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 -- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 msgr2=0x7f3dd806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 0x7f3dd806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 -- 172.21.15.19:0/2452674482 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8130340 con 0x7f3dd8130540 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3dd7fff700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 0x7f3dd806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.866+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd8130910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00b9a0 tx=0x7f3dcc00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c475b35504cdaf94 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.867+0000 7f3dd77fe700 1 -- 172.21.15.19:0/2452674482 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00caa0 con 0x7f3dd8130540 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.867+0000 7f3dd77fe700 1 -- 172.21.15.19:0/2452674482 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00cc00 con 0x7f3dd8130540 2023-10-03T10:15:09.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.867+0000 7f3dd77fe700 1 -- 172.21.15.19:0/2452674482 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00f460 con 0x7f3dd8130540 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 -- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 msgr2=0x7f3dd8130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd8130910 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc00b9a0 tx=0x7f3dcc00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 -- 172.21.15.19:0/2452674482 shutdown_connections 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd806fb20 0x7f3dd806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd8130910 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/2452674482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd8130e50 0x7f3dd806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 -- 172.21.15.19:0/2452674482 >> 172.21.15.19:0/2452674482 conn(0x7f3dd80a2aa0 msgr2=0x7f3dd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 -- 172.21.15.19:0/2452674482 shutdown_connections 2023-10-03T10:15:09.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.868+0000 7f3ddf16d700 1 -- 172.21.15.19:0/2452674482 wait complete. 2023-10-03T10:15:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.869+0000 7f3ddf16d700 1 Processor -- start 2023-10-03T10:15:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.869+0000 7f3ddf16d700 1 -- start start 2023-10-03T10:15:09.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.870+0000 7f3ddf16d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.870+0000 7f3ddf16d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd81c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.870+0000 7f3ddf16d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd8130e50 0x7f3dd8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.870+0000 7f3ddf16d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd811bc90 con 0x7f3dd8130540 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.870+0000 7f3ddf16d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd811b240 con 0x7f3dd806fb20 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45660/0 (socket says 172.21.15.19:45660) 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 -- 172.21.15.19:0/1503100212 learned_addr learned my addr 172.21.15.19:0/1503100212 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3dd7fff700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd81c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddd70a700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd8130e50 0x7f3dd8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:09.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80718e0 con 0x7f3dd8130e50 2023-10-03T10:15:09.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 -- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd8130e50 msgr2=0x7f3dd8118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd8130e50 0x7f3dd8118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 -- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 msgr2=0x7f3dd81c0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd81c0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc400d940 con 0x7f3dd806fb20 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.871+0000 7f3ddcf09700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0090b0 tx=0x7f3dcc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.872+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc01c070 con 0x7f3dd806fb20 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.872+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00cd70 con 0x7f3dd806fb20 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.872+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc00b600 con 0x7f3dd806fb20 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.872+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00cee0 con 0x7f3dd806fb20 2023-10-03T10:15:09.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.872+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd80a0ae0 con 0x7f3dd806fb20 2023-10-03T10:15:09.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.873+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd811baf0 con 0x7f3dd806fb20 2023-10-03T10:15:09.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.873+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3dcc020070 con 0x7f3dd806fb20 2023-10-03T10:15:09.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.873+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3dcc0409f0 con 0x7f3dd806fb20 2023-10-03T10:15:09.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.878+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3dd811baf0 con 0x7f3dd806fb20 2023-10-03T10:15:09.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.998+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5e4c005590 con 0x7f5e6809e410 2023-10-03T10:15:09.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:09.998+0000 7f5e56ffd700 1 -- 172.21.15.19:0/237647953 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e60046070 con 0x7f5e6809e410 2023-10-03T10:15:09.999 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:10.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.000+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 msgr2=0x7f5e681c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.000+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 0x7f5e681c8100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5e60015000 tx=0x7f5e60004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 shutdown_connections 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e6809e410 0x7f5e681c8100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e6809d6f0 0x7f5e68136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 --2- 172.21.15.19:0/237647953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e6809e000 0x7f5e681374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 >> 172.21.15.19:0/237647953 conn(0x7f5e68066f50 msgr2=0x7f5e680a1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 shutdown_connections 2023-10-03T10:15:10.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.001+0000 7f5e6cb24700 1 -- 172.21.15.19:0/237647953 wait complete. 2023-10-03T10:15:10.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:10.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.037+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8cf806c360 con 0x7f8cf809e000 2023-10-03T10:15:10.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.037+0000 7f8cf4ff9700 1 -- 172.21.15.19:0/3679486991 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cec015070 con 0x7f8cf809e000 2023-10-03T10:15:10.038 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 msgr2=0x7f8cf81a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0090b0 tx=0x7f8cec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 shutdown_connections 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cf809e410 0x7f8cf81a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cf809d6f0 0x7f8cf81a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 --2- 172.21.15.19:0/3679486991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cf809e000 0x7f8cf81a6510 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 >> 172.21.15.19:0/3679486991 conn(0x7f8cf8066f50 msgr2=0x7f8cf81badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 shutdown_connections 2023-10-03T10:15:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.040+0000 7f8cfe3d0700 1 -- 172.21.15.19:0/3679486991 wait complete. 2023-10-03T10:15:10.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.046+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6d60122170 con 0x7f6d60139170 2023-10-03T10:15:10.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.046+0000 7f6d47fff700 1 -- 172.21.15.19:0/1181728528 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6d60122170 con 0x7f6d60139170 2023-10-03T10:15:10.047 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.048+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 msgr2=0x7f6d6011fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.048+0000 7f6d65947700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009870 tx=0x7f6d54004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 shutdown_connections 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6d601c85e0 0x7f6d601c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6d6009d6f0 0x7f6d6011f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 --2- 172.21.15.19:0/1181728528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d60139170 0x7f6d6011fbd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 >> 172.21.15.19:0/1181728528 conn(0x7f6d60066f50 msgr2=0x7f6d60138220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 shutdown_connections 2023-10-03T10:15:10.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.049+0000 7f6d65947700 1 -- 172.21.15.19:0/1181728528 wait complete. 2023-10-03T10:15:10.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:10.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.088+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3dd811baf0 con 0x7f3dd806fb20 2023-10-03T10:15:10.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.089+0000 7f3dd57fa700 1 -- 172.21.15.19:0/1503100212 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3dd811baf0 con 0x7f3dd806fb20 2023-10-03T10:15:10.090 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:10.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 msgr2=0x7f3dd81c0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:10.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc0090b0 tx=0x7f3dcc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:10.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 shutdown_connections 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3dd8130e50 0x7f3dd8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3dd806fb20 0x7f3dd81c0a20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 --2- 172.21.15.19:0/1503100212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3dd8130540 0x7f3dd81c0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 >> 172.21.15.19:0/1503100212 conn(0x7f3dd80a2aa0 msgr2=0x7f3dd812d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 shutdown_connections 2023-10-03T10:15:10.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:10.091+0000 7f3ddf16d700 1 -- 172.21.15.19:0/1503100212 wait complete. 2023-10-03T10:15:10.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:11.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:11.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:11.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:11.106 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:11.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.165+0000 7f7ca2f8b700 1 Processor -- start 2023-10-03T10:15:11.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 -- start start 2023-10-03T10:15:11.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c133540 0x7f7c9c135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c9c135e60 0x7f7c9c138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c0716a0 con 0x7f7c9c130540 2023-10-03T10:15:11.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c071290 con 0x7f7c9c135e60 2023-10-03T10:15:11.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca2f8b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c130340 con 0x7f7c9c133540 2023-10-03T10:15:11.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca0d27700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c9c130540 0x7f7c9c130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35190/0 (socket says 172.21.15.19:35190) 2023-10-03T10:15:11.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca0d27700 1 -- 172.21.15.19:0/3102312025 learned_addr learned my addr 172.21.15.19:0/3102312025 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:11.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.166+0000 7f7ca1528700 1 --2- 172.21.15.19:0/3102312025 >> v2:172.21.15.19:3300/0 conn(0x7f7c9c135e60 0x7f7c9c138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7c9b7fe700 1 -- 172.21.15.19:0/3102312025 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267506401 0 0) 0x7f7c9c0716a0 con 0x7f7c9c130540 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7c9b7fe700 1 -- 172.21.15.19:0/3102312025 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c8c0035b0 con 0x7f7c9c130540 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7ca1528700 1 -- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c133540 msgr2=0x7f7c9c135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7ca1528700 1 --2- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c133540 0x7f7c9c135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7ca1528700 1 -- 172.21.15.19:0/3102312025 >> v1:172.21.15.19:6789/0 conn(0x7f7c9c130540 legacy=0x7f7c9c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7ca1528700 1 -- 172.21.15.19:0/3102312025 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c070b80 con 0x7f7c9c135e60 2023-10-03T10:15:11.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7ca1528700 1 --2- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c135e60 0x7f7c9c138240 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009dc0 tx=0x7f7c9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=534d39231890c929 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7c9b7fe700 1 -- 172.21.15.19:0/3102312025 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400e070 con 0x7f7c9c135e60 2023-10-03T10:15:11.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7c9b7fe700 1 -- 172.21.15.19:0/3102312025 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400bae0 con 0x7f7c9c135e60 2023-10-03T10:15:11.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.167+0000 7f7c9b7fe700 1 -- 172.21.15.19:0/3102312025 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400be90 con 0x7f7c9c135e60 2023-10-03T10:15:11.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c135e60 msgr2=0x7f7c9c138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c135e60 0x7f7c9c138240 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7c94009dc0 tx=0x7f7c9400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/3102312025 shutdown_connections 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c135e60 0x7f7c9c138240 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/3102312025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c133540 0x7f7c9c135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/3102312025 >> 172.21.15.19:0/3102312025 conn(0x7f7c9c0a2aa0 msgr2=0x7f7c9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/3102312025 shutdown_connections 2023-10-03T10:15:11.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.168+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/3102312025 wait complete. 2023-10-03T10:15:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.170+0000 7f7ca2f8b700 1 Processor -- start 2023-10-03T10:15:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.170+0000 7f7ca2f8b700 1 -- start start 2023-10-03T10:15:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 0x7f7c9c09aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 0x7f7c9c09b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c09e2f0 con 0x7f7c9c133540 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c09cde0 con 0x7f7c9c130540 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca2f8b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c09c760 con 0x7f7c9c135e60 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca0d27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca0d27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45672/0 (socket says 172.21.15.19:45672) 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7ca0d27700 1 -- 172.21.15.19:0/2003247934 learned_addr learned my addr 172.21.15.19:0/2003247934 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.171+0000 7f7c9bfff700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 0x7f7c9c09aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca1528700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 0x7f7c9c09b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 -- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 msgr2=0x7f7c9c09b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 0x7f7c9c09b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 -- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 msgr2=0x7f7c9c09aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 0x7f7c9c09aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 -- 172.21.15.19:0/2003247934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94009a70 con 0x7f7c9c130540 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7c9bfff700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 0x7f7c9c09aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca1528700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 0x7f7c9c09b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca0d27700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c700 tx=0x7f7c9000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90005d70 con 0x7f7c9c130540 2023-10-03T10:15:11.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c900070d0 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c09ca20 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c90007460 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.172+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c09d8e0 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.173+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c900075c0 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.173+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c09cc10 con 0x7f7c9c130540 2023-10-03T10:15:11.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.174+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c9003ebf0 con 0x7f7c9c130540 2023-10-03T10:15:11.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.180+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c9000e280 con 0x7f7c9c130540 2023-10-03T10:15:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.211+0000 7f514c866700 1 Processor -- start 2023-10-03T10:15:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 -- start start 2023-10-03T10:15:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 0x7f514809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514809b120 con 0x7f514809e000 2023-10-03T10:15:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514806b460 con 0x7f514809e410 2023-10-03T10:15:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f514c866700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514809a7e0 con 0x7f514809d6f0 2023-10-03T10:15:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.212+0000 7f5146d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f5146d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33016/0 (socket says 172.21.15.19:33016) 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f5146d9d700 1 -- 172.21.15.19:0/234495338 learned_addr learned my addr 172.21.15.19:0/234495338 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 --2- 172.21.15.19:0/234495338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 0x7f514809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 -- 172.21.15.19:0/234495338 >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 msgr2=0x7f5148134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514559a700 1 -- 172.21.15.19:0/234495338 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499910615 0 0) 0x7f514809b120 con 0x7f514809e000 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 --2- 172.21.15.19:0/234495338 >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 -- 172.21.15.19:0/234495338 >> v1:172.21.15.19:6789/0 conn(0x7f514809e000 legacy=0x7f51481339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 -- 172.21.15.19:0/234495338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514809a500 con 0x7f514809d6f0 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f5146d9d700 1 --2- 172.21.15.19:0/234495338 >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514659c700 1 --2- 172.21.15.19:0/234495338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 0x7f514809dac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f5138009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c2e916279e4c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.213+0000 7f514559a700 1 -- 172.21.15.19:0/234495338 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011830 con 0x7f514809d6f0 2023-10-03T10:15:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514559a700 1 -- 172.21.15.19:0/234495338 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138011990 con 0x7f514809d6f0 2023-10-03T10:15:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514559a700 1 -- 172.21.15.19:0/234495338 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138011d20 con 0x7f514809d6f0 2023-10-03T10:15:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 -- 172.21.15.19:0/234495338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 msgr2=0x7f514809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 --2- 172.21.15.19:0/234495338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 0x7f514809dac0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5138009870 tx=0x7f5138009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 -- 172.21.15.19:0/234495338 shutdown_connections 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 --2- 172.21.15.19:0/234495338 >> v2:172.21.15.19:3300/0 conn(0x7f514809e410 0x7f5148134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 --2- 172.21.15.19:0/234495338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809d6f0 0x7f514809dac0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 -- 172.21.15.19:0/234495338 >> 172.21.15.19:0/234495338 conn(0x7f5148066f50 msgr2=0x7f514809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.214+0000 7f514c866700 1 -- 172.21.15.19:0/234495338 shutdown_connections 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.215+0000 7f514c866700 1 -- 172.21.15.19:0/234495338 wait complete. 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 Processor -- start 2023-10-03T10:15:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 -- start start 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 0x7f51481c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514809e000 0x7f51481c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51481a6660 con 0x7f514809d6f0 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51481a6430 con 0x7f514809e000 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.216+0000 7f514c866700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51481a70a0 con 0x7f514809e410 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f514659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 0x7f51481c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56906/0 (socket says 172.21.15.19:56906) 2023-10-03T10:15:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f514659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 0x7f51481c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33032/0 (socket says 172.21.15.19:33032) 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 -- 172.21.15.19:0/4008643296 learned_addr learned my addr 172.21.15.19:0/4008643296 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5145d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514809e000 0x7f51481c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 -- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514809e000 msgr2=0x7f51481c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514809e000 0x7f51481c85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 -- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 msgr2=0x7f51481c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 0x7f51481c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 -- 172.21.15.19:0/4008643296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009b30 con 0x7f514809e410 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.217+0000 7f5146d9d700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5140009f10 tx=0x7f514000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.218+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140018070 con 0x7f514809e410 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.218+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514000f040 con 0x7f514809e410 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.218+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51380094a0 con 0x7f514809e410 2023-10-03T10:15:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.218+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140003c40 con 0x7f514809e410 2023-10-03T10:15:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.218+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514809c710 con 0x7f514809e410 2023-10-03T10:15:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.219+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5148074ea0 con 0x7f514809e410 2023-10-03T10:15:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.221+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f514000c940 con 0x7f514809e410 2023-10-03T10:15:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.222+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5140040510 con 0x7f514809e410 2023-10-03T10:15:11.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.225+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f514000cbf0 con 0x7f514809e410 2023-10-03T10:15:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.253+0000 7f86c9916700 1 Processor -- start 2023-10-03T10:15:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.253+0000 7f86c9916700 1 -- start start 2023-10-03T10:15:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c9916700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c9916700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4139030 0x7f86c413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c9916700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c406ef30 con 0x7f86c41338a0 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c9916700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c406fef0 con 0x7f86c4139030 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c9916700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41334b0 con 0x7f86c4136710 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86c41338a0 0x7f86c4133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35214/0 (socket says 172.21.15.19:35214) 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56912/0 (socket says 172.21.15.19:56912) 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c2ffd700 1 -- 172.21.15.19:0/1944812356 learned_addr learned my addr 172.21.15.19:0/1944812356 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 -- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4139030 msgr2=0x7f86c413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 --2- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4139030 0x7f86c413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 -- 172.21.15.19:0/1944812356 >> v1:172.21.15.19:6789/0 conn(0x7f86c41338a0 legacy=0x7f86c4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c1ffb700 1 -- 172.21.15.19:0/1944812356 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846610871 0 0) 0x7f86c406ef30 con 0x7f86c41338a0 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.254+0000 7f86c27fc700 1 -- 172.21.15.19:0/1944812356 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c406fc30 con 0x7f86c4136710 2023-10-03T10:15:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.255+0000 7f86c27fc700 1 --2- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009870 tx=0x7f86b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70401d1b41a69bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.255+0000 7f86c1ffb700 1 -- 172.21.15.19:0/1944812356 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011830 con 0x7f86c4136710 2023-10-03T10:15:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.255+0000 7f86c1ffb700 1 -- 172.21.15.19:0/1944812356 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8011990 con 0x7f86c4136710 2023-10-03T10:15:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.255+0000 7f86c1ffb700 1 -- 172.21.15.19:0/1944812356 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011d20 con 0x7f86c4136710 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 -- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 msgr2=0x7f86c4138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 --2- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009870 tx=0x7f86b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 -- 172.21.15.19:0/1944812356 shutdown_connections 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 --2- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4139030 0x7f86c413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 --2- 172.21.15.19:0/1944812356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c4136710 0x7f86c4138af0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 -- 172.21.15.19:0/1944812356 >> 172.21.15.19:0/1944812356 conn(0x7f86c40a2aa0 msgr2=0x7f86c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 -- 172.21.15.19:0/1944812356 shutdown_connections 2023-10-03T10:15:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.256+0000 7f86c9916700 1 -- 172.21.15.19:0/1944812356 wait complete. 2023-10-03T10:15:11.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.258+0000 7f86c9916700 1 Processor -- start 2023-10-03T10:15:11.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.258+0000 7f86c9916700 1 -- start start 2023-10-03T10:15:11.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 0x7f86c41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4136710 0x7f86c41c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 0x7f86c411acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c411e350 con 0x7f86c4139030 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c411e530 con 0x7f86c4136710 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c9916700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c41be110 con 0x7f86c41338a0 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 0x7f86c41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 0x7f86c41c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56918/0 (socket says 172.21.15.19:56918) 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c2ffd700 1 -- 172.21.15.19:0/1572883261 learned_addr learned my addr 172.21.15.19:0/1572883261 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 0x7f86c411acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c27fc700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4136710 0x7f86c41c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 -- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 msgr2=0x7f86c41c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 0x7f86c41c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 -- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4136710 msgr2=0x7f86c41c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4136710 0x7f86c41c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 -- 172.21.15.19:0/1572883261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80094a0 con 0x7f86c4139030 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.259+0000 7f86c37fe700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 0x7f86c411acf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00bdf0 tx=0x7f86bc009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.260+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc00cb30 con 0x7f86c4139030 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.260+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86bc00ccb0 con 0x7f86c4139030 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.260+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c40a2450 con 0x7f86c4139030 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.260+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86bc014680 con 0x7f86c4139030 2023-10-03T10:15:11.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.260+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c411c900 con 0x7f86c4139030 2023-10-03T10:15:11.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.261+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86bc01d3b0 con 0x7f86c4139030 2023-10-03T10:15:11.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.261+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c4074ea0 con 0x7f86c4139030 2023-10-03T10:15:11.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.261+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86bc006e40 con 0x7f86c4139030 2023-10-03T10:15:11.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.271+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86bc019070 con 0x7f86c4139030 2023-10-03T10:15:11.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.296+0000 7f7dce31c700 1 Processor -- start 2023-10-03T10:15:11.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 -- start start 2023-10-03T10:15:11.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7dc806e570 0x7f7dc806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc8070ee0 con 0x7f7dc8134610 2023-10-03T10:15:11.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc8071480 con 0x7f7dc806e570 2023-10-03T10:15:11.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dce31c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc806f3c0 con 0x7f7dc809eca0 2023-10-03T10:15:11.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dc77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dc77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56926/0 (socket says 172.21.15.19:56926) 2023-10-03T10:15:11.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.297+0000 7f7dc77fe700 1 -- 172.21.15.19:0/3707909862 learned_addr learned my addr 172.21.15.19:0/3707909862 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc7fff700 1 --2- 172.21.15.19:0/3707909862 >> v2:172.21.15.19:3300/0 conn(0x7f7dc806e570 0x7f7dc806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc77fe700 1 -- 172.21.15.19:0/3707909862 >> v2:172.21.15.19:3300/0 conn(0x7f7dc806e570 msgr2=0x7f7dc806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc77fe700 1 --2- 172.21.15.19:0/3707909862 >> v2:172.21.15.19:3300/0 conn(0x7f7dc806e570 0x7f7dc806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc77fe700 1 -- 172.21.15.19:0/3707909862 >> v1:172.21.15.19:6789/0 conn(0x7f7dc8134610 legacy=0x7f7dc8134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc77fe700 1 -- 172.21.15.19:0/3707909862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8071b90 con 0x7f7dc809eca0 2023-10-03T10:15:11.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc77fe700 1 --2- 172.21.15.19:0/3707909862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098f0 tx=0x7f7dbc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e934dc19760dc39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc6ffd700 1 -- 172.21.15.19:0/3707909862 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00b8a0 con 0x7f7dc809eca0 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc6ffd700 1 -- 172.21.15.19:0/3707909862 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dbc00ba00 con 0x7f7dc809eca0 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.298+0000 7f7dc6ffd700 1 -- 172.21.15.19:0/3707909862 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00bd90 con 0x7f7dc809eca0 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 -- 172.21.15.19:0/3707909862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 msgr2=0x7f7dc806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 --2- 172.21.15.19:0/3707909862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0098f0 tx=0x7f7dbc009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 -- 172.21.15.19:0/3707909862 shutdown_connections 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 --2- 172.21.15.19:0/3707909862 >> v2:172.21.15.19:3300/0 conn(0x7f7dc806e570 0x7f7dc806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 --2- 172.21.15.19:0/3707909862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc809eca0 0x7f7dc806ee80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 -- 172.21.15.19:0/3707909862 >> 172.21.15.19:0/3707909862 conn(0x7f7dc80a2aa0 msgr2=0x7f7dc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 -- 172.21.15.19:0/3707909862 shutdown_connections 2023-10-03T10:15:11.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.299+0000 7f7dce31c700 1 -- 172.21.15.19:0/3707909862 wait complete. 2023-10-03T10:15:11.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.300+0000 7f7dce31c700 1 Processor -- start 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 -- start start 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc8134610 0x7f7dc813e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc813eeb0 0x7f7dc813f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc813cc80 con 0x7f7dc8134610 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8134330 con 0x7f7dc806e570 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.301+0000 7f7dce31c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc8070610 con 0x7f7dc813eeb0 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45718/0 (socket says 172.21.15.19:45718) 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 -- 172.21.15.19:0/1888469913 learned_addr learned my addr 172.21.15.19:0/1888469913 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dcc8b9700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc813eeb0 0x7f7dc813f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc77fe700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc8134610 0x7f7dc813e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:11.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 -- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc813eeb0 msgr2=0x7f7dc813f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc813eeb0 0x7f7dc813f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 -- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc8134610 msgr2=0x7f7dc813e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc8134610 0x7f7dc813e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 -- 172.21.15.19:0/1888469913 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009550 con 0x7f7dc806e570 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.302+0000 7f7dc7fff700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7db800e840 tx=0x7f7db800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.303+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8013610 con 0x7f7dc806e570 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.303+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8013770 con 0x7f7dc806e570 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.303+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8013b20 con 0x7f7dc806e570 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.303+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc813d140 con 0x7f7dc806e570 2023-10-03T10:15:11.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.303+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc813dab0 con 0x7f7dc806e570 2023-10-03T10:15:11.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.304+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7db8013c80 con 0x7f7dc806e570 2023-10-03T10:15:11.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.305+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7db803f2b0 con 0x7f7dc806e570 2023-10-03T10:15:11.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.305+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc8074ea0 con 0x7f7dc806e570 2023-10-03T10:15:11.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.314+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7db8012370 con 0x7f7dc806e570 2023-10-03T10:15:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.405+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c9c132640 con 0x7f7c9c130540 2023-10-03T10:15:11.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.405+0000 7f7c997fa700 1 -- 172.21.15.19:0/2003247934 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c90017070 con 0x7f7c9c130540 2023-10-03T10:15:11.406 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 msgr2=0x7f7c9c09a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000c700 tx=0x7f7c9000ca10 comp rx=0 tx=0).stop 2023-10-03T10:15:11.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 shutdown_connections 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9c135e60 0x7f7c9c09b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9c130540 0x7f7c9c09a590 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 --2- 172.21.15.19:0/2003247934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9c133540 0x7f7c9c09aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 >> 172.21.15.19:0/2003247934 conn(0x7f7c9c0a2aa0 msgr2=0x7f7c9c135210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 shutdown_connections 2023-10-03T10:15:11.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.408+0000 7f7ca2f8b700 1 -- 172.21.15.19:0/2003247934 wait complete. 2023-10-03T10:15:11.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:11.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.448+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f514806c360 con 0x7f514809e410 2023-10-03T10:15:11.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.448+0000 7f5136ffd700 1 -- 172.21.15.19:0/4008643296 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5140013bd0 con 0x7f514809e410 2023-10-03T10:15:11.449 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 msgr2=0x7f51481c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5140009f10 tx=0x7f514000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 shutdown_connections 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514809e410 0x7f51481c8b10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514809d6f0 0x7f51481c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 --2- 172.21.15.19:0/4008643296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514809e000 0x7f51481c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 >> 172.21.15.19:0/4008643296 conn(0x7f5148066f50 msgr2=0x7f51481bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 shutdown_connections 2023-10-03T10:15:11.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.451+0000 7f514c866700 1 -- 172.21.15.19:0/4008643296 wait complete. 2023-10-03T10:15:11.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.483+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86c411e670 con 0x7f86c4139030 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.483+0000 7f86abfff700 1 -- 172.21.15.19:0/1572883261 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86c411e670 con 0x7f86c4139030 2023-10-03T10:15:11.484 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:11.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 msgr2=0x7f86c411acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 0x7f86c411acf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00bdf0 tx=0x7f86bc009ed0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 shutdown_connections 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86c4139030 0x7f86c411acf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86c41338a0 0x7f86c41c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 --2- 172.21.15.19:0/1572883261 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86c4136710 0x7f86c41c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.485+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 >> 172.21.15.19:0/1572883261 conn(0x7f86c40a2aa0 msgr2=0x7f86c41344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.486+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 shutdown_connections 2023-10-03T10:15:11.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.486+0000 7f86c9916700 1 -- 172.21.15.19:0/1572883261 wait complete. 2023-10-03T10:15:11.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:11.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.532+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7dc8071100 con 0x7f7dc806e570 2023-10-03T10:15:11.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.532+0000 7f7dc4ff9700 1 -- 172.21.15.19:0/1888469913 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7db8010310 con 0x7f7dc806e570 2023-10-03T10:15:11.533 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 msgr2=0x7f7dc8140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7db800e840 tx=0x7f7db800eb50 comp rx=0 tx=0).stop 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 shutdown_connections 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7dc813eeb0 0x7f7dc813f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7dc806e570 0x7f7dc8140280 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.534+0000 7f7dce31c700 1 --2- 172.21.15.19:0/1888469913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7dc8134610 0x7f7dc813e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.535+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 >> 172.21.15.19:0/1888469913 conn(0x7f7dc80a2aa0 msgr2=0x7f7dc8137f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.535+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 shutdown_connections 2023-10-03T10:15:11.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:11.535+0000 7f7dce31c700 1 -- 172.21.15.19:0/1888469913 wait complete. 2023-10-03T10:15:11.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:12.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:12.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:12.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:12.550 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:12.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.577+0000 7fa2a1d8f700 1 Processor -- start 2023-10-03T10:15:12.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.577+0000 7fa2a1d8f700 1 -- start start 2023-10-03T10:15:12.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa2a1d8f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa29c09d6f0 0x7fa29c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa2a1d8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 0x7fa29c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa2a1d8f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c09b120 con 0x7fa29c09e000 2023-10-03T10:15:12.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa2a1d8f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c06b460 con 0x7fa29c09d6f0 2023-10-03T10:15:12.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa2a1d8f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c09a7e0 con 0x7fa29c09e440 2023-10-03T10:15:12.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa29affd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa29c09e000 0x7fa29c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35232/0 (socket says 172.21.15.19:35232) 2023-10-03T10:15:12.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa29affd700 1 -- 172.21.15.19:0/1074504755 learned_addr learned my addr 172.21.15.19:0/1074504755 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:12.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa29bfff700 1 --2- 172.21.15.19:0/1074504755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 0x7fa29c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.578+0000 7fa29b7fe700 1 --2- 172.21.15.19:0/1074504755 >> v2:172.21.15.19:3300/0 conn(0x7fa29c09d6f0 0x7fa29c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29bfff700 1 -- 172.21.15.19:0/1074504755 >> v2:172.21.15.19:3300/0 conn(0x7fa29c09d6f0 msgr2=0x7fa29c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29bfff700 1 --2- 172.21.15.19:0/1074504755 >> v2:172.21.15.19:3300/0 conn(0x7fa29c09d6f0 0x7fa29c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29bfff700 1 -- 172.21.15.19:0/1074504755 >> v1:172.21.15.19:6789/0 conn(0x7fa29c09e000 legacy=0x7fa29c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29bfff700 1 -- 172.21.15.19:0/1074504755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c09a500 con 0x7fa29c09e440 2023-10-03T10:15:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29bfff700 1 --2- 172.21.15.19:0/1074504755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 0x7fa29c134100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa294009dc0 tx=0x7fa29400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbbe8d92078a1418 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29a7fc700 1 -- 172.21.15.19:0/1074504755 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400e070 con 0x7fa29c09e440 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29a7fc700 1 -- 172.21.15.19:0/1074504755 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29400bae0 con 0x7fa29c09e440 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.579+0000 7fa29a7fc700 1 -- 172.21.15.19:0/1074504755 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29400be90 con 0x7fa29c09e440 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/1074504755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 msgr2=0x7fa29c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/1074504755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 0x7fa29c134100 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa294009dc0 tx=0x7fa29400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/1074504755 shutdown_connections 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/1074504755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e440 0x7fa29c134100 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/1074504755 >> v2:172.21.15.19:3300/0 conn(0x7fa29c09d6f0 0x7fa29c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/1074504755 >> 172.21.15.19:0/1074504755 conn(0x7fa29c066f50 msgr2=0x7fa29c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.580+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/1074504755 shutdown_connections 2023-10-03T10:15:12.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.581+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/1074504755 wait complete. 2023-10-03T10:15:12.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.582+0000 7fa2a1d8f700 1 Processor -- start 2023-10-03T10:15:12.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.582+0000 7fa2a1d8f700 1 -- start start 2023-10-03T10:15:12.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 0x7fa29c1c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa29c09e440 0x7fa29c1c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1a80b0 con 0x7fa29c09e440 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0a1f90 con 0x7fa29c09d6f0 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa2a1d8f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1b9550 con 0x7fa29c09e000 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa29affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa29affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:56962/0 (socket says 172.21.15.19:56962) 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa29affd700 1 -- 172.21.15.19:0/2770708525 learned_addr learned my addr 172.21.15.19:0/2770708525 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa29b7fe700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 0x7fa29c1c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.583+0000 7fa29bfff700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa29c09e440 0x7fa29c1c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 -- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 msgr2=0x7fa29c1c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 -- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa29c09e440 msgr2=0x7fa29c1c49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa29c09e440 0x7fa29c1c49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 -- 172.21.15.19:0/2770708525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294009a70 con 0x7fa29c09d6f0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29affd700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa29b7fe700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 0x7fa29c1c8560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e900 tx=0x7fa28c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c013680 con 0x7fa29c09d6f0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0137e0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c1a8980 con 0x7fa29c09d6f0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c013b50 con 0x7fa29c09d6f0 2023-10-03T10:15:12.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.584+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c1a79c0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.585+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa28c013cb0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.585+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa28c03f730 con 0x7fa29c09d6f0 2023-10-03T10:15:12.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.586+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c1a79c0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.591+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa29c1a79c0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 Processor -- start 2023-10-03T10:15:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 -- start start 2023-10-03T10:15:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a4133930 0x7f43a4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a40a2a70 con 0x7f43a4133930 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40a01d0 con 0x7f43a40a0a30 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.619+0000 7f43a8954700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a409e2b0 con 0x7f43a409d630 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a4133930 0x7f43a4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43a4133930 0x7f43a4133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33094/0 (socket says 172.21.15.19:33094) 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 -- 172.21.15.19:0/1222840228 learned_addr learned my addr 172.21.15.19:0/1222840228 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a259c700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 -- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 msgr2=0x7f43a40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 -- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 msgr2=0x7f43a40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 -- 172.21.15.19:0/1222840228 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a409dc50 con 0x7f43a4133930 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4133dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f439c009e50 tx=0x7f439c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f708adc659729e69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a1d9b700 1 -- 172.21.15.19:0/1222840228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00e070 con 0x7f43a4133930 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.620+0000 7f43a1d9b700 1 -- 172.21.15.19:0/1222840228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c00b910 con 0x7f43a4133930 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a1d9b700 1 -- 172.21.15.19:0/1222840228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00bcc0 con 0x7f43a4133930 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 -- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 msgr2=0x7f43a4133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4133dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f439c009e50 tx=0x7f439c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 -- 172.21.15.19:0/1222840228 shutdown_connections 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4133dd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 --2- 172.21.15.19:0/1222840228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 -- 172.21.15.19:0/1222840228 >> 172.21.15.19:0/1222840228 conn(0x7f43a40a3050 msgr2=0x7f43a40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 -- 172.21.15.19:0/1222840228 shutdown_connections 2023-10-03T10:15:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.621+0000 7f43a8954700 1 -- 172.21.15.19:0/1222840228 wait complete. 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 Processor -- start 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 -- start start 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a4132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a4121e40 con 0x7f43a4133930 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a4121240 con 0x7f43a40a0a30 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a8954700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43a41204d0 con 0x7f43a409d630 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f439bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f439bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45752/0 (socket says 172.21.15.19:45752) 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f439bfff700 1 -- 172.21.15.19:0/294007831 learned_addr learned my addr 172.21.15.19:0/294007831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.623+0000 7f43a259c700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a4132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 -- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 msgr2=0x7f43a4132340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a4132340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 -- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 msgr2=0x7f43a4132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 -- 172.21.15.19:0/294007831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009b30 con 0x7f43a4133930 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f439bfff700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a2d9d700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4132dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f439c015000 tx=0x7f439c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c004450 con 0x7f43a4133930 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0045f0 con 0x7f43a4133930 2023-10-03T10:15:12.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a40a40c0 con 0x7f43a4133930 2023-10-03T10:15:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0092e0 con 0x7f43a4133930 2023-10-03T10:15:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.624+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a4133370 con 0x7f43a4133930 2023-10-03T10:15:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.625+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f439c01c410 con 0x7f43a4133930 2023-10-03T10:15:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.626+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f439c0413e0 con 0x7f43a4133930 2023-10-03T10:15:12.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.626+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a40747f0 con 0x7f43a4133930 2023-10-03T10:15:12.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.631+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f439c0123f0 con 0x7f43a4133930 2023-10-03T10:15:12.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.676+0000 7f1a8546b700 1 Processor -- start 2023-10-03T10:15:12.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.676+0000 7f1a8546b700 1 -- start start 2023-10-03T10:15:12.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a8546b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8006a770 0x7f1a8006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a8546b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 0x7f1a80131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a8546b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8009ece0 con 0x7f1a80131b40 2023-10-03T10:15:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a8546b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8009e760 con 0x7f1a8006a770 2023-10-03T10:15:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a8546b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8009e040 con 0x7f1a8006b080 2023-10-03T10:15:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a7effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8006a770 0x7f1a8006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a7effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8006a770 0x7f1a8006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33114/0 (socket says 172.21.15.19:33114) 2023-10-03T10:15:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.677+0000 7f1a7effd700 1 -- 172.21.15.19:0/3733172182 learned_addr learned my addr 172.21.15.19:0/3733172182 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7e7fc700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 0x7f1a80131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7effd700 1 -- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 msgr2=0x7f1a80131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7effd700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 0x7f1a80131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7effd700 1 -- 172.21.15.19:0/3733172182 >> v1:172.21.15.19:6789/0 conn(0x7f1a80131b40 legacy=0x7f1a80138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7dffb700 1 -- 172.21.15.19:0/3733172182 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823724992 0 0) 0x7f1a8009ece0 con 0x7f1a80131b40 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7effd700 1 -- 172.21.15.19:0/3733172182 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8009f630 con 0x7f1a8006a770 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7e7fc700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 0x7f1a80131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7effd700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006a770 0x7f1a8006ab40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098f0 tx=0x7f1a70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b3b85f534f42b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7dffb700 1 -- 172.21.15.19:0/3733172182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011830 con 0x7f1a8006a770 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7dffb700 1 -- 172.21.15.19:0/3733172182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70011990 con 0x7f1a8006a770 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.678+0000 7f1a7dffb700 1 -- 172.21.15.19:0/3733172182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011d20 con 0x7f1a8006a770 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 -- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006a770 msgr2=0x7f1a8006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006a770 0x7f1a8006ab40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098f0 tx=0x7f1a70009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 -- 172.21.15.19:0/3733172182 shutdown_connections 2023-10-03T10:15:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006a770 0x7f1a8006ab40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 --2- 172.21.15.19:0/3733172182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006b080 0x7f1a80131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 -- 172.21.15.19:0/3733172182 >> 172.21.15.19:0/3733172182 conn(0x7f1a80066f50 msgr2=0x7f1a8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 -- 172.21.15.19:0/3733172182 shutdown_connections 2023-10-03T10:15:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.679+0000 7f1a8546b700 1 -- 172.21.15.19:0/3733172182 wait complete. 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.681+0000 7f1a8546b700 1 Processor -- start 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.681+0000 7f1a8546b700 1 -- start start 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006b080 0x7f1a801c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a80131b40 0x7f1a801c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8011eb00 con 0x7f1a8006b080 2023-10-03T10:15:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8011e340 con 0x7f1a80131b40 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a8546b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8006b470 con 0x7f1a8006a770 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a7effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a7e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006b080 0x7f1a801c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a7effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57008/0 (socket says 172.21.15.19:57008) 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a7effd700 1 -- 172.21.15.19:0/703644917 learned_addr learned my addr 172.21.15.19:0/703644917 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.682+0000 7f1a7f7fe700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a80131b40 0x7f1a801c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 -- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a80131b40 msgr2=0x7f1a801c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a80131b40 0x7f1a801c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 -- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006b080 msgr2=0x7f1a801c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006b080 0x7f1a801c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 -- 172.21.15.19:0/703644917 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740094a0 con 0x7f1a8006a770 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a7effd700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1a8009ee70 tx=0x7f1a70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70004340 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7001f070 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700036a0 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a70009550 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.683+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801310d0 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.685+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a70021030 con 0x7f1a8006a770 2023-10-03T10:15:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.685+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a8011ffa0 con 0x7f1a8006a770 2023-10-03T10:15:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.685+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a70040a60 con 0x7f1a8006a770 2023-10-03T10:15:12.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.694+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a8011ffa0 con 0x7f1a8006a770 2023-10-03T10:15:12.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.703+0000 7f486c9b6700 1 Processor -- start 2023-10-03T10:15:12.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.703+0000 7f486c9b6700 1 -- start start 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486c9b6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f486809d6f0 0x7f486809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486c9b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486c9b6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486809f130 con 0x7f486809e000 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486c9b6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486809f520 con 0x7f486809d6f0 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486c9b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486809e930 con 0x7f486809e410 2023-10-03T10:15:12.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4865d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f486809e000 0x7f4868130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35238/0 (socket says 172.21.15.19:35238) 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4865d9b700 1 -- 172.21.15.19:0/1615622201 learned_addr learned my addr 172.21.15.19:0/1615622201 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486659c700 1 --2- 172.21.15.19:0/1615622201 >> v2:172.21.15.19:3300/0 conn(0x7f486809d6f0 0x7f486809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4866d9d700 1 --2- 172.21.15.19:0/1615622201 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486559a700 1 -- 172.21.15.19:0/1615622201 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850117317 0 0) 0x7f486809f130 con 0x7f486809e000 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f486559a700 1 -- 172.21.15.19:0/1615622201 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48500035b0 con 0x7f486809e000 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4866d9d700 1 -- 172.21.15.19:0/1615622201 >> v2:172.21.15.19:3300/0 conn(0x7f486809d6f0 msgr2=0x7f486809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4866d9d700 1 --2- 172.21.15.19:0/1615622201 >> v2:172.21.15.19:3300/0 conn(0x7f486809d6f0 0x7f486809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4866d9d700 1 -- 172.21.15.19:0/1615622201 >> v1:172.21.15.19:6789/0 conn(0x7f486809e000 legacy=0x7f4868130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.704+0000 7f4866d9d700 1 -- 172.21.15.19:0/1615622201 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486809b2d0 con 0x7f486809e410 2023-10-03T10:15:12.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.705+0000 7f4866d9d700 1 --2- 172.21.15.19:0/1615622201 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868130d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4860009d90 tx=0x7f486000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6251813220ad9b8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.705+0000 7f486559a700 1 -- 172.21.15.19:0/1615622201 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000e070 con 0x7f486809e410 2023-10-03T10:15:12.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.705+0000 7f486559a700 1 -- 172.21.15.19:0/1615622201 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000bb20 con 0x7f486809e410 2023-10-03T10:15:12.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.705+0000 7f486559a700 1 -- 172.21.15.19:0/1615622201 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860012430 con 0x7f486809e410 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 -- 172.21.15.19:0/1615622201 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 msgr2=0x7f4868130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 --2- 172.21.15.19:0/1615622201 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868130d70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4860009d90 tx=0x7f486000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 -- 172.21.15.19:0/1615622201 shutdown_connections 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 --2- 172.21.15.19:0/1615622201 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868130d70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 --2- 172.21.15.19:0/1615622201 >> v2:172.21.15.19:3300/0 conn(0x7f486809d6f0 0x7f486809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 -- 172.21.15.19:0/1615622201 >> 172.21.15.19:0/1615622201 conn(0x7f4868066f50 msgr2=0x7f486809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 -- 172.21.15.19:0/1615622201 shutdown_connections 2023-10-03T10:15:12.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.706+0000 7f486c9b6700 1 -- 172.21.15.19:0/1615622201 wait complete. 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.707+0000 7f486c9b6700 1 Processor -- start 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.707+0000 7f486c9b6700 1 -- start start 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f486809d6f0 0x7f4868134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f486809e000 0x7f4868134bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48681377f0 con 0x7f486809d6f0 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486809c770 con 0x7f486809e410 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486c9b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4868136af0 con 0x7f486809e000 2023-10-03T10:15:12.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45776/0 (socket says 172.21.15.19:45776) 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 -- 172.21.15.19:0/329808876 learned_addr learned my addr 172.21.15.19:0/329808876 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f486659c700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f486809d6f0 0x7f4868134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 -- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f486809e000 msgr2=0x7f4868134bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f486809e000 0x7f4868134bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 -- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f486809d6f0 msgr2=0x7f4868134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f486809d6f0 0x7f4868134680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 -- 172.21.15.19:0/329808876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860009a70 con 0x7f486809e410 2023-10-03T10:15:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.708+0000 7f4866d9d700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f486809ea70 tx=0x7f4860004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.709+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860012430 con 0x7f486809e410 2023-10-03T10:15:12.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.709+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4860020070 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.709+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4868136840 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.709+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4868137c00 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.709+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860003ea0 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.710+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c0052e0 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.710+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4860004280 con 0x7f486809e410 2023-10-03T10:15:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.710+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4860022070 con 0x7f486809e410 2023-10-03T10:15:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.715+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f486001c400 con 0x7f486809e410 2023-10-03T10:15:12.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.842+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43a4072980 con 0x7f43a4133930 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.843+0000 7f439affd700 1 -- 172.21.15.19:0/294007831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f439c034090 con 0x7f43a4133930 2023-10-03T10:15:12.844 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 msgr2=0x7f43a4132dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4132dc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f439c015000 tx=0x7f439c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 shutdown_connections 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4133930 0x7f43a4132dc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43a409d630 0x7f43a4132340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 --2- 172.21.15.19:0/294007831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43a40a0a30 0x7f43a4132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 >> 172.21.15.19:0/294007831 conn(0x7f43a40a3050 msgr2=0x7f43a409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 shutdown_connections 2023-10-03T10:15:12.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.845+0000 7f43a8954700 1 -- 172.21.15.19:0/294007831 wait complete. 2023-10-03T10:15:12.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.854+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa29c1a79c0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.854+0000 7fa283fff700 1 -- 172.21.15.19:0/2770708525 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa29c1a79c0 con 0x7fa29c09d6f0 2023-10-03T10:15:12.855 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:12.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.857+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 msgr2=0x7fa29c1c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.857+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 0x7fa29c1c8560 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e900 tx=0x7fa28c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:12.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 shutdown_connections 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa29c09e440 0x7fa29c1c49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa29c09d6f0 0x7fa29c1c8560 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 --2- 172.21.15.19:0/2770708525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa29c09e000 0x7fa29c1c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 >> 172.21.15.19:0/2770708525 conn(0x7fa29c066f50 msgr2=0x7fa29c1bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 shutdown_connections 2023-10-03T10:15:12.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.858+0000 7fa2a1d8f700 1 -- 172.21.15.19:0/2770708525 wait complete. 2023-10-03T10:15:12.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:12.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:12.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.926+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1a8011ffa0 con 0x7f1a8006a770 2023-10-03T10:15:12.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.927+0000 7f1a677fe700 1 -- 172.21.15.19:0/703644917 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a8011ffa0 con 0x7f1a8006a770 2023-10-03T10:15:12.928 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 msgr2=0x7f1a801c6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1a8009ee70 tx=0x7f1a70004750 comp rx=0 tx=0).stop 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 shutdown_connections 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a80131b40 0x7f1a801c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8006a770 0x7f1a801c6290 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 --2- 172.21.15.19:0/703644917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8006b080 0x7f1a801c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 >> 172.21.15.19:0/703644917 conn(0x7f1a80066f50 msgr2=0x7f1a801b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 shutdown_connections 2023-10-03T10:15:12.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.929+0000 7f1a8546b700 1 -- 172.21.15.19:0/703644917 wait complete. 2023-10-03T10:15:12.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.930+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f484c005590 con 0x7f486809e410 2023-10-03T10:15:12.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.930+0000 7f4856ffd700 1 -- 172.21.15.19:0/329808876 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f486002c030 con 0x7f486809e410 2023-10-03T10:15:12.932 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 msgr2=0x7f4868135100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f486809ea70 tx=0x7f4860004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 shutdown_connections 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f486809e410 0x7f4868135100 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f486809d6f0 0x7f4868134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 --2- 172.21.15.19:0/329808876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f486809e000 0x7f4868134bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 >> 172.21.15.19:0/329808876 conn(0x7f4868066f50 msgr2=0x7f486806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:12.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 shutdown_connections 2023-10-03T10:15:12.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:12.933+0000 7f486c9b6700 1 -- 172.21.15.19:0/329808876 wait complete. 2023-10-03T10:15:12.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:12.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:13.862 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:13.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:13.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:13.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:14.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.028+0000 7f10d3cdf700 1 Processor -- start 2023-10-03T10:15:14.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.029+0000 7f10d3cdf700 1 -- start start 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d3cdf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d3cdf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 0x7f10cc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d3cdf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10cc06bc00 con 0x7f10cc12ff20 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d3cdf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc06c570 con 0x7f10cc130a40 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d3cdf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0a0040 con 0x7f10cc133a80 2023-10-03T10:15:14.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d1a7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d1a7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57028/0 (socket says 172.21.15.19:57028) 2023-10-03T10:15:14.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d1a7b700 1 -- 172.21.15.19:0/666466669 learned_addr learned my addr 172.21.15.19:0/666466669 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d227c700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 0x7f10cc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d227c700 1 -- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 msgr2=0x7f10cc133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d227c700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d227c700 1 -- 172.21.15.19:0/666466669 >> v1:172.21.15.19:6789/0 conn(0x7f10cc12ff20 legacy=0x7f10cc130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d0a79700 1 -- 172.21.15.19:0/666466669 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537368469 0 0) 0x7f10cc06bc00 con 0x7f10cc12ff20 2023-10-03T10:15:14.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.030+0000 7f10d227c700 1 -- 172.21.15.19:0/666466669 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc133860 con 0x7f10cc130a40 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.031+0000 7f10d227c700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 0x7f10cc13b850 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009dc0 tx=0x7f10c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6df1624ecd1690db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.031+0000 7f10d0a79700 1 -- 172.21.15.19:0/666466669 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c400e070 con 0x7f10cc130a40 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.031+0000 7f10d0a79700 1 -- 172.21.15.19:0/666466669 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c400bb20 con 0x7f10cc130a40 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.031+0000 7f10d0a79700 1 -- 172.21.15.19:0/666466669 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4012430 con 0x7f10cc130a40 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 -- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 msgr2=0x7f10cc13b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 0x7f10cc13b850 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009dc0 tx=0x7f10c400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 -- 172.21.15.19:0/666466669 shutdown_connections 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc130a40 0x7f10cc13b850 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/666466669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 -- 172.21.15.19:0/666466669 >> 172.21.15.19:0/666466669 conn(0x7f10cc0a4210 msgr2=0x7f10cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 -- 172.21.15.19:0/666466669 shutdown_connections 2023-10-03T10:15:14.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.032+0000 7f10d3cdf700 1 -- 172.21.15.19:0/666466669 wait complete. 2023-10-03T10:15:14.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.033+0000 7f10d3cdf700 1 Processor -- start 2023-10-03T10:15:14.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 -- start start 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc12ff20 0x7f10cc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc130a40 0x7f10cc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc09df20 con 0x7f10cc130a40 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc09dd30 con 0x7f10cc12ff20 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d3cdf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10cc0a2030 con 0x7f10cc133a80 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d227c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d127a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc130a40 0x7f10cc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.034+0000 7f10d227c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57042/0 (socket says 172.21.15.19:57042) 2023-10-03T10:15:14.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 -- 172.21.15.19:0/1397549973 learned_addr learned my addr 172.21.15.19:0/1397549973 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d1a7b700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc12ff20 0x7f10cc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 -- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc12ff20 msgr2=0x7f10cc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc12ff20 0x7f10cc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 -- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc130a40 msgr2=0x7f10cc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc130a40 0x7f10cc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 -- 172.21.15.19:0/1397549973 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009a70 con 0x7f10cc133a80 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10d227c700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10cc06c6b0 tx=0x7f10c4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.035+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4004840 con 0x7f10cc133a80 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.036+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4020070 con 0x7f10cc133a80 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.036+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40276c0 con 0x7f10cc133a80 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.037+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10cc120240 con 0x7f10cc133a80 2023-10-03T10:15:14.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.037+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10cc11fe50 con 0x7f10cc133a80 2023-10-03T10:15:14.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.038+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10c4012430 con 0x7f10cc133a80 2023-10-03T10:15:14.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.038+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10c4022070 con 0x7f10cc133a80 2023-10-03T10:15:14.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.038+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10cc074ea0 con 0x7f10cc133a80 2023-10-03T10:15:14.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.047+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10c4012e40 con 0x7f10cc133a80 2023-10-03T10:15:14.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.062+0000 7fa157a5c700 1 Processor -- start 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 -- start start 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1500a0a30 0x7fa1500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1500a1340 0x7fa150133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 0x7fa150134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15009edd0 con 0x7fa1500a1340 2023-10-03T10:15:14.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15009e1f0 con 0x7fa1500a0a30 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa157a5c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa15009dc50 con 0x7fa150133fa0 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa154ff7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1500a1340 0x7fa150133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa154ff7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1500a1340 0x7fa150133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33160/0 (socket says 172.21.15.19:33160) 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa155ff9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 0x7fa150134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa154ff7700 1 -- 172.21.15.19:0/1893941269 learned_addr learned my addr 172.21.15.19:0/1893941269 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.063+0000 7fa1557f8700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1500a0a30 0x7fa1500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 -- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 msgr2=0x7fa150134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 0x7fa150134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 -- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1500a0a30 msgr2=0x7fa1500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1500a0a30 0x7fa1500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 -- 172.21.15.19:0/1893941269 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1500a1fe0 con 0x7fa1500a1340 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa155ff9700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 0x7fa150134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa154ff7700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa150133a60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098f0 tx=0x7fa140009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfe6a943217496b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa147fff700 1 -- 172.21.15.19:0/1893941269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140011830 con 0x7fa1500a1340 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa147fff700 1 -- 172.21.15.19:0/1893941269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140011990 con 0x7fa1500a1340 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.064+0000 7fa147fff700 1 -- 172.21.15.19:0/1893941269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140011d20 con 0x7fa1500a1340 2023-10-03T10:15:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 -- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 msgr2=0x7fa150133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa150133a60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa1400098f0 tx=0x7fa140009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 -- 172.21.15.19:0/1893941269 shutdown_connections 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1500a0a30 0x7fa1500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa150133fa0 0x7fa150134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 --2- 172.21.15.19:0/1893941269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa150133a60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 -- 172.21.15.19:0/1893941269 >> 172.21.15.19:0/1893941269 conn(0x7fa1500a6550 msgr2=0x7fa1500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 -- 172.21.15.19:0/1893941269 shutdown_connections 2023-10-03T10:15:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.065+0000 7fa157a5c700 1 -- 172.21.15.19:0/1893941269 wait complete. 2023-10-03T10:15:14.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.066+0000 7fa157a5c700 1 Processor -- start 2023-10-03T10:15:14.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.066+0000 7fa157a5c700 1 -- start start 2023-10-03T10:15:14.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1500a0a30 0x7fa150120190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 0x7fa150120c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1501245f0 con 0x7fa1500a1340 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500a3630 con 0x7fa150133fa0 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa157a5c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1500a0220 con 0x7fa1500a0a30 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33162/0 (socket says 172.21.15.19:33162) 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 -- 172.21.15.19:0/4244839431 learned_addr learned my addr 172.21.15.19:0/4244839431 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa1557f8700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1500a0a30 0x7fa150120190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa155ff9700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 0x7fa150120c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 -- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1500a0a30 msgr2=0x7fa150120190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1500a0a30 0x7fa150120190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 -- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 msgr2=0x7fa150120c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 0x7fa150120c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa154ff7700 1 -- 172.21.15.19:0/4244839431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148009a70 con 0x7fa1500a1340 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.067+0000 7fa155ff9700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 0x7fa150120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa154ff7700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa140009f50 tx=0x7fa140004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140004300 con 0x7fa1500a1340 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14001f070 con 0x7fa1500a1340 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa140009550 con 0x7fa1500a1340 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400036a0 con 0x7fa1500a1340 2023-10-03T10:15:14.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.068+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa150121e10 con 0x7fa1500a1340 2023-10-03T10:15:14.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.069+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa140021030 con 0x7fa1500a1340 2023-10-03T10:15:14.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.069+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1400408a0 con 0x7fa1500a1340 2023-10-03T10:15:14.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.069+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa150074ea0 con 0x7fa1500a1340 2023-10-03T10:15:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.074+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1400199a0 con 0x7fa1500a1340 2023-10-03T10:15:14.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.095+0000 7f3f69b94700 1 Processor -- start 2023-10-03T10:15:14.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.095+0000 7f3f69b94700 1 -- start start 2023-10-03T10:15:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.096+0000 7f3f69b94700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f6409f410 0x7f3f64136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.096+0000 7f3f69b94700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f64136fe0 0x7f3f641393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.096+0000 7f3f69b94700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f64070940 con 0x7f3f6409e930 2023-10-03T10:15:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.096+0000 7f3f69b94700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6406fd60 con 0x7f3f6409f410 2023-10-03T10:15:14.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.096+0000 7f3f69b94700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6406fa80 con 0x7f3f64136fe0 2023-10-03T10:15:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f6409f410 0x7f3f64136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f637fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f6409e930 0x7f3f6409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35248/0 (socket says 172.21.15.19:35248) 2023-10-03T10:15:14.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f637fe700 1 -- 172.21.15.19:0/669975718 learned_addr learned my addr 172.21.15.19:0/669975718 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:14.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f63fff700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f64136fe0 0x7f3f641393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 -- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f64136fe0 msgr2=0x7f3f641393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f64136fe0 0x7f3f641393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 -- 172.21.15.19:0/669975718 >> v1:172.21.15.19:6789/0 conn(0x7f3f6409e930 legacy=0x7f3f6409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 -- 172.21.15.19:0/669975718 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6409fb60 con 0x7f3f6409f410 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f627fc700 1 -- 172.21.15.19:0/669975718 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743055848 0 0) 0x7f3f64070940 con 0x7f3f6409e930 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f62ffd700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409f410 0x7f3f64136aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f095c5e4af92ea77 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f627fc700 1 -- 172.21.15.19:0/669975718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011830 con 0x7f3f6409f410 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f627fc700 1 -- 172.21.15.19:0/669975718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f58011990 con 0x7f3f6409f410 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.099+0000 7f3f627fc700 1 -- 172.21.15.19:0/669975718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58011d20 con 0x7f3f6409f410 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 -- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409f410 msgr2=0x7f3f64136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409f410 0x7f3f64136aa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3f58009840 tx=0x7f3f58009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 -- 172.21.15.19:0/669975718 shutdown_connections 2023-10-03T10:15:14.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f64136fe0 0x7f3f641393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 --2- 172.21.15.19:0/669975718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409f410 0x7f3f64136aa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 -- 172.21.15.19:0/669975718 >> 172.21.15.19:0/669975718 conn(0x7f3f640a4210 msgr2=0x7f3f640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 -- 172.21.15.19:0/669975718 shutdown_connections 2023-10-03T10:15:14.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.100+0000 7f3f69b94700 1 -- 172.21.15.19:0/669975718 wait complete. 2023-10-03T10:15:14.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.101+0000 7f3f69b94700 1 Processor -- start 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 -- start start 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e930 0x7f3f641c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 0x7f3f641c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 0x7f3f6406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f64071d90 con 0x7f3f6409e930 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f641340c0 con 0x7f3f6409f410 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f69b94700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6406d640 con 0x7f3f64136fe0 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f62ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 0x7f3f641c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e930 0x7f3f641c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f62ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 0x7f3f641c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45826/0 (socket says 172.21.15.19:45826) 2023-10-03T10:15:14.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f62ffd700 1 -- 172.21.15.19:0/3235470596 learned_addr learned my addr 172.21.15.19:0/3235470596 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.102+0000 7f3f63fff700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 0x7f3f6406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 -- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 msgr2=0x7f3f641c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 0x7f3f641c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 -- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e930 msgr2=0x7f3f641c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e930 0x7f3f641c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 -- 172.21.15.19:0/3235470596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580094a0 con 0x7f3f64136fe0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f63fff700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 0x7f3f6406b8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00efc0 tx=0x7f3f5c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c00cc90 con 0x7f3f64136fe0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5c00f040 con 0x7f3f64136fe0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f64134300 con 0x7f3f64136fe0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c0146c0 con 0x7f3f64136fe0 2023-10-03T10:15:14.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.103+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6409dec0 con 0x7f3f64136fe0 2023-10-03T10:15:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.105+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f5c014820 con 0x7f3f64136fe0 2023-10-03T10:15:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.105+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f64074ea0 con 0x7f3f64136fe0 2023-10-03T10:15:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.105+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f5c040200 con 0x7f3f64136fe0 2023-10-03T10:15:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.114+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f5c014ad0 con 0x7f3f64136fe0 2023-10-03T10:15:14.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 Processor -- start 2023-10-03T10:15:14.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 -- start start 2023-10-03T10:15:14.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48a413d240 0x7f48a413f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a4134980 con 0x7f48a406c0e0 2023-10-03T10:15:14.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a406c4b0 con 0x7f48a413d240 2023-10-03T10:15:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.126+0000 7f48ab046700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a409b0e0 con 0x7f48a409ac90 2023-10-03T10:15:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57086/0 (socket says 172.21.15.19:57086) 2023-10-03T10:15:14.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 -- 172.21.15.19:0/2403002019 learned_addr learned my addr 172.21.15.19:0/2403002019 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a95e3700 1 --2- 172.21.15.19:0/2403002019 >> v2:172.21.15.19:3300/0 conn(0x7f48a413d240 0x7f48a413f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 -- 172.21.15.19:0/2403002019 >> v2:172.21.15.19:3300/0 conn(0x7f48a413d240 msgr2=0x7f48a413f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 --2- 172.21.15.19:0/2403002019 >> v2:172.21.15.19:3300/0 conn(0x7f48a413d240 0x7f48a413f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 -- 172.21.15.19:0/2403002019 >> v1:172.21.15.19:6789/0 conn(0x7f48a406c0e0 legacy=0x7f48a4134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 -- 172.21.15.19:0/2403002019 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a40a0600 con 0x7f48a409ac90 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.127+0000 7f48a3fff700 1 --2- 172.21.15.19:0/2403002019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48900098f0 tx=0x7f4890009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8984dac6bc5d297b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48a37fe700 1 -- 172.21.15.19:0/2403002019 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011830 con 0x7f48a409ac90 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48a37fe700 1 -- 172.21.15.19:0/2403002019 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4890011990 con 0x7f48a409ac90 2023-10-03T10:15:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48a37fe700 1 -- 172.21.15.19:0/2403002019 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4890011d20 con 0x7f48a409ac90 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 -- 172.21.15.19:0/2403002019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 msgr2=0x7f48a413cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 --2- 172.21.15.19:0/2403002019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48900098f0 tx=0x7f4890009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 -- 172.21.15.19:0/2403002019 shutdown_connections 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 --2- 172.21.15.19:0/2403002019 >> v2:172.21.15.19:3300/0 conn(0x7f48a413d240 0x7f48a413f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 --2- 172.21.15.19:0/2403002019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a413cd00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.128+0000 7f48ab046700 1 -- 172.21.15.19:0/2403002019 >> 172.21.15.19:0/2403002019 conn(0x7f48a40a4210 msgr2=0x7f48a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.129+0000 7f48ab046700 1 -- 172.21.15.19:0/2403002019 shutdown_connections 2023-10-03T10:15:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.129+0000 7f48ab046700 1 -- 172.21.15.19:0/2403002019 wait complete. 2023-10-03T10:15:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.130+0000 7f48ab046700 1 Processor -- start 2023-10-03T10:15:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.130+0000 7f48ab046700 1 -- start start 2023-10-03T10:15:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a406c0e0 0x7f48a4132de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a4133320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a409e410 con 0x7f48a413d240 2023-10-03T10:15:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41341c0 con 0x7f48a406c0e0 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48ab046700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48a413f630 con 0x7f48a409ac90 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48a95e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48a95e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33206/0 (socket says 172.21.15.19:33206) 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48a95e3700 1 -- 172.21.15.19:0/1643443740 learned_addr learned my addr 172.21.15.19:0/1643443740 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48a8de2700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a406c0e0 0x7f48a4132de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.131+0000 7f48a3fff700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a4133320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 -- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 msgr2=0x7f48a4133320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a4133320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 -- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a406c0e0 msgr2=0x7f48a4132de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a406c0e0 0x7f48a4132de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 -- 172.21.15.19:0/1643443740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4890009550 con 0x7f48a413d240 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a3fff700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a4133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a95e3700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f489c00ef90 tx=0x7f489c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00cd40 con 0x7f48a413d240 2023-10-03T10:15:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c00f040 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a40a03f0 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00cea0 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.132+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4137f30 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.134+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a4074ea0 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.134+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f489c0146c0 con 0x7f48a413d240 2023-10-03T10:15:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.134+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f489c040460 con 0x7f48a413d240 2023-10-03T10:15:14.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.144+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f489c012520 con 0x7f48a413d240 2023-10-03T10:15:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.287+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f10cc06b250 con 0x7f10cc133a80 2023-10-03T10:15:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.288+0000 7f10c27fc700 1 -- 172.21.15.19:0/1397549973 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10c4011390 con 0x7f10cc133a80 2023-10-03T10:15:14.289 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:14.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 msgr2=0x7f10cc09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10cc06c6b0 tx=0x7f10c4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 shutdown_connections 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10cc133a80 0x7f10cc09cf00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10cc12ff20 0x7f10cc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 --2- 172.21.15.19:0/1397549973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10cc130a40 0x7f10cc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 >> 172.21.15.19:0/1397549973 conn(0x7f10cc0a4210 msgr2=0x7f10cc0a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 shutdown_connections 2023-10-03T10:15:14.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.290+0000 7f10d3cdf700 1 -- 172.21.15.19:0/1397549973 wait complete. 2023-10-03T10:15:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.294+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa1500a28e0 con 0x7fa1500a1340 2023-10-03T10:15:14.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.295+0000 7fa145ffb700 1 -- 172.21.15.19:0/4244839431 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa140015020 con 0x7fa1500a1340 2023-10-03T10:15:14.297 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 msgr2=0x7fa1501206d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa140009f50 tx=0x7fa140004750 comp rx=0 tx=0).stop 2023-10-03T10:15:14.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 shutdown_connections 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa150133fa0 0x7fa150120c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1500a0a30 0x7fa150120190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 --2- 172.21.15.19:0/4244839431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1500a1340 0x7fa1501206d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 >> 172.21.15.19:0/4244839431 conn(0x7fa1500a6550 msgr2=0x7fa1500a4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 shutdown_connections 2023-10-03T10:15:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.299+0000 7fa157a5c700 1 -- 172.21.15.19:0/4244839431 wait complete. 2023-10-03T10:15:14.310 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:14.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:14.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.329+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3f64124040 con 0x7f3f64136fe0 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.329+0000 7f3f4bfff700 1 -- 172.21.15.19:0/3235470596 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f5c012340 con 0x7f3f64136fe0 2023-10-03T10:15:14.330 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:14.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 msgr2=0x7f3f6406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 0x7f3f6406b8b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c00efc0 tx=0x7f3f5c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 shutdown_connections 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f64136fe0 0x7f3f6406b8b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e930 0x7f3f641c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 --2- 172.21.15.19:0/3235470596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409f410 0x7f3f641c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.331+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 >> 172.21.15.19:0/3235470596 conn(0x7f3f640a4210 msgr2=0x7f3f64134900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.332+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 shutdown_connections 2023-10-03T10:15:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.332+0000 7f3f69b94700 1 -- 172.21.15.19:0/3235470596 wait complete. 2023-10-03T10:15:14.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:14.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.351+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48a4138210 con 0x7f48a413d240 2023-10-03T10:15:14.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.352+0000 7f48a17fa700 1 -- 172.21.15.19:0/1643443740 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f489c012340 con 0x7f48a413d240 2023-10-03T10:15:14.353 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:14.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 msgr2=0x7f48a4133860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:14.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f489c00ef90 tx=0x7f489c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 shutdown_connections 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48a413d240 0x7f48a4133860 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48a406c0e0 0x7f48a4132de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 --2- 172.21.15.19:0/1643443740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48a409ac90 0x7f48a4133320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 >> 172.21.15.19:0/1643443740 conn(0x7f48a40a4210 msgr2=0x7f48a40a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 shutdown_connections 2023-10-03T10:15:14.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:14.354+0000 7f48ab046700 1 -- 172.21.15.19:0/1643443740 wait complete. 2023-10-03T10:15:14.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:15.311 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:15.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:15.346 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:15.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.464+0000 7fb9059f9700 1 Processor -- start 2023-10-03T10:15:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.464+0000 7fb9059f9700 1 -- start start 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb90009d6f0 0x7fb90009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb900133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90006b460 con 0x7fb90009d6f0 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90009b120 con 0x7fb90009e410 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb9059f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb90009a7e0 con 0x7fb90009e000 2023-10-03T10:15:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb90009d6f0 0x7fb90009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb90009d6f0 0x7fb90009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33208/0 (socket says 172.21.15.19:33208) 2023-10-03T10:15:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 -- 172.21.15.19:0/3751148041 learned_addr learned my addr 172.21.15.19:0/3751148041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8ff7fe700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb900133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8fe7fc700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 -- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 msgr2=0x7fb9001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 -- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 msgr2=0x7fb900133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb900133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.465+0000 7fb8feffd700 1 -- 172.21.15.19:0/3751148041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90009a500 con 0x7fb90009d6f0 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.466+0000 7fb8feffd700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb90009dac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0013db0 tx=0x7fb8f0009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dfaa6d6edeaef0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.466+0000 7fb8fdffb700 1 -- 172.21.15.19:0/3751148041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0012ae0 con 0x7fb90009d6f0 2023-10-03T10:15:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.466+0000 7fb8fdffb700 1 -- 172.21.15.19:0/3751148041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0012c40 con 0x7fb90009d6f0 2023-10-03T10:15:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.466+0000 7fb8fdffb700 1 -- 172.21.15.19:0/3751148041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0013050 con 0x7fb90009d6f0 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 -- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 msgr2=0x7fb90009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb90009dac0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb8f0013db0 tx=0x7fb8f0009710 comp rx=0 tx=0).stop 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 -- 172.21.15.19:0/3751148041 shutdown_connections 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb900133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb90009dac0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 --2- 172.21.15.19:0/3751148041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 -- 172.21.15.19:0/3751148041 >> 172.21.15.19:0/3751148041 conn(0x7fb900066f50 msgr2=0x7fb90009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 -- 172.21.15.19:0/3751148041 shutdown_connections 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.467+0000 7fb9059f9700 1 -- 172.21.15.19:0/3751148041 wait complete. 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.468+0000 7fb9059f9700 1 Processor -- start 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.468+0000 7fb9059f9700 1 -- start start 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb9001a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9001b51b0 con 0x7fb90009d6f0 2023-10-03T10:15:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9001a5260 con 0x7fb90009e410 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb9059f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9000a2090 con 0x7fb90009e000 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45834/0 (socket says 172.21.15.19:45834) 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 -- 172.21.15.19:0/163702969 learned_addr learned my addr 172.21.15.19:0/163702969 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8fe7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8feffd700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb9001a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 -- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 msgr2=0x7fb9001a1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001a1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 -- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 msgr2=0x7fb9001a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb9001a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.469+0000 7fb8ff7fe700 1 -- 172.21.15.19:0/163702969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f0013a10 con 0x7fb90009e410 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb8ff7fe700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800efc0 tx=0x7fb8f800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8009ea0 con 0x7fb90009e410 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f800f040 con 0x7fb90009e410 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9001a35d0 con 0x7fb90009e410 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ced0 con 0x7fb90009e410 2023-10-03T10:15:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.470+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9001a4330 con 0x7fb90009e410 2023-10-03T10:15:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.471+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8f8014480 con 0x7fb90009e410 2023-10-03T10:15:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.471+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8f8040220 con 0x7fb90009e410 2023-10-03T10:15:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.471+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9001a53a0 con 0x7fb90009e410 2023-10-03T10:15:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.476+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb8f8012930 con 0x7fb90009e410 2023-10-03T10:15:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.503+0000 7f9c99408700 1 Processor -- start 2023-10-03T10:15:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.503+0000 7f9c99408700 1 -- start start 2023-10-03T10:15:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f1fc7f8c700 1 Processor -- start 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f1fc7f8c700 1 -- start start 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c9409d6f0 0x7f9c9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 0x7f9c941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 0x7f9c94133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9406b460 con 0x7f9c9409d6f0 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9409b120 con 0x7f9c9409e000 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c99408700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9409a7e0 con 0x7f9c9409e410 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c92ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c9409d6f0 0x7f9c9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c927fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 0x7f9c941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c92ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c9409d6f0 0x7f9c9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33222/0 (socket says 172.21.15.19:33222) 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3857758734 learned_addr learned my addr 172.21.15.19:0/3857758734 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.504+0000 7f1fc7f8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 0x7f1fc006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc7f8c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fc012f8b0 0x7f1fc012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c937fe700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 0x7f9c94133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 msgr2=0x7f9c94133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 0x7f9c94133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 msgr2=0x7f9c941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 0x7f9c941339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3857758734 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9409a500 con 0x7f9c9409d6f0 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c937fe700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 0x7f9c94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc7f8c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc012cd90 con 0x7f1fc0130260 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc7f8c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc012d330 con 0x7f1fc012f8b0 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc7f8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01306e0 con 0x7f1fc012cf60 2023-10-03T10:15:15.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fc012f8b0 0x7f1fc012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5d28700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 0x7f1fc006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc6529700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1fc0130260 0x7f1fc0136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35268/0 (socket says 172.21.15.19:35268) 2023-10-03T10:15:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc6529700 1 -- 172.21.15.19:0/2970961368 learned_addr learned my addr 172.21.15.19:0/2970961368 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fc012f8b0 0x7f1fc012fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33234/0 (socket says 172.21.15.19:33234) 2023-10-03T10:15:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c9409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c840098f0 tx=0x7f9c84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56181e843a97feb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 -- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 msgr2=0x7f1fc006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 0x7f1fc006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 -- 172.21.15.19:0/2970961368 >> v1:172.21.15.19:6789/0 conn(0x7f1fc0130260 legacy=0x7f1fc0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5527700 1 -- 172.21.15.19:0/2970961368 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0071780 con 0x7f1fc012f8b0 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f1fc5d28700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 0x7f1fc006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.505+0000 7f9c927fc700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 0x7f9c941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f1fc5527700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012f8b0 0x7f1fc012fd20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009840 tx=0x7f1fb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c1c2c89eb092f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f1fc4d26700 1 -- 172.21.15.19:0/2970961368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0011830 con 0x7f1fc012f8b0 2023-10-03T10:15:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f9c91ffb700 1 -- 172.21.15.19:0/3857758734 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011830 con 0x7f9c9409d6f0 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f1fc4d26700 1 -- 172.21.15.19:0/2970961368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0011990 con 0x7f1fc012f8b0 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f1fc4d26700 1 -- 172.21.15.19:0/2970961368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0011d20 con 0x7f1fc012f8b0 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f9c91ffb700 1 -- 172.21.15.19:0/3857758734 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84011990 con 0x7f9c9409d6f0 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.506+0000 7f9c91ffb700 1 -- 172.21.15.19:0/3857758734 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84011d00 con 0x7f9c9409d6f0 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012f8b0 msgr2=0x7f1fc012fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012f8b0 0x7f1fc012fd20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009840 tx=0x7f1fb0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 -- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 msgr2=0x7f9c9409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c9409dac0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c840098f0 tx=0x7f9c84009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 -- 172.21.15.19:0/3857758734 shutdown_connections 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e410 0x7f9c94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c9409dac0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 --2- 172.21.15.19:0/3857758734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e000 0x7f9c941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 -- 172.21.15.19:0/3857758734 >> 172.21.15.19:0/3857758734 conn(0x7f9c94066f50 msgr2=0x7f9c9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2970961368 shutdown_connections 2023-10-03T10:15:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc012cf60 0x7f1fc006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2970961368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012f8b0 0x7f1fc012fd20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2970961368 >> 172.21.15.19:0/2970961368 conn(0x7f1fc00a2aa0 msgr2=0x7f1fc00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 -- 172.21.15.19:0/3857758734 shutdown_connections 2023-10-03T10:15:15.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f9c99408700 1 -- 172.21.15.19:0/3857758734 wait complete. 2023-10-03T10:15:15.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.507+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2970961368 shutdown_connections 2023-10-03T10:15:15.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.508+0000 7f9c99408700 1 Processor -- start 2023-10-03T10:15:15.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.508+0000 7f9c99408700 1 -- start start 2023-10-03T10:15:15.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e000 0x7f9c941abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.508+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2970961368 wait complete. 2023-10-03T10:15:15.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f1fc7f8c700 1 Processor -- start 2023-10-03T10:15:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e410 0x7f9c941ac360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941babf0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941acd40 con 0x7f9c9409e410 2023-10-03T10:15:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c99408700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941aedc0 con 0x7f9c9409e000 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33246/0 (socket says 172.21.15.19:33246) 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3909909856 learned_addr learned my addr 172.21.15.19:0/3909909856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e000 msgr2=0x7f9c941abe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e000 0x7f9c941abe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e410 msgr2=0x7f9c941ac360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e410 0x7f9c941ac360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f9c92ffd700 1 -- 172.21.15.19:0/3909909856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c880094a0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c92ffd700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c84000c00 tx=0x7f9c84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84004590 con 0x7f9c9409d6f0 2023-10-03T10:15:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c840036a0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003a50 con 0x7f9c9409d6f0 2023-10-03T10:15:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c99408700 1 -- 172.21.15.19:0/3909909856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c84009550 con 0x7f9c9409d6f0 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.509+0000 7f1fc7f8c700 1 -- start start 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012cf60 0x7f1fc01cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 0x7f1fc01391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc013b860 con 0x7f1fc012cf60 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc013c670 con 0x7f1fc012f8b0 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc7f8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01cc870 con 0x7f1fc0130260 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc5527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc5527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45872/0 (socket says 172.21.15.19:45872) 2023-10-03T10:15:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc5527700 1 -- 172.21.15.19:0/2631743678 learned_addr learned my addr 172.21.15.19:0/2631743678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc5d28700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012cf60 0x7f1fc01cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f1fc6529700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 0x7f1fc01391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 -- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 msgr2=0x7f1fc01391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 0x7f1fc01391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 -- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012cf60 msgr2=0x7f1fc01cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012cf60 0x7f1fc01cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 -- 172.21.15.19:0/2631743678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fbc0094a0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc6529700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 0x7f1fc01391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:15.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fc5527700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00090b0 tx=0x7f1fb0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.510+0000 7f9c99408700 1 -- 172.21.15.19:0/3909909856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c941aeaf0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00036a0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb001f070 con 0x7f1fc012f8b0 2023-10-03T10:15:15.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.511+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0003a60 con 0x7f1fc012f8b0 2023-10-03T10:15:15.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.512+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb00094a0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.512+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c84003bb0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.512+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c0052e0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.512+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c84021030 con 0x7f9c9409d6f0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.512+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc01405e0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.513+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fb0003bc0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.513+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fb0021070 con 0x7f1fc012f8b0 2023-10-03T10:15:15.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.513+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0074ea0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.517+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c8401a430 con 0x7f9c9409d6f0 2023-10-03T10:15:15.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.522+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fb0010790 con 0x7f1fc012f8b0 2023-10-03T10:15:15.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.574+0000 7fa5ebfe8700 1 Processor -- start 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.574+0000 7fa5ebfe8700 1 -- start start 2023-10-03T10:15:15.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ebfe8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 0x7fa5e40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ebfe8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ebfe8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e409edd0 con 0x7fa5e40a1340 2023-10-03T10:15:15.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ebfe8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e409e1f0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ebfe8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e409dc50 con 0x7fa5e4134170 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5e9d84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 0x7fa5e40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5e9d84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 0x7fa5e40a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33266/0 (socket says 172.21.15.19:33266) 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45876/0 (socket says 172.21.15.19:45876) 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5e9d84700 1 -- 172.21.15.19:0/1730271091 learned_addr learned my addr 172.21.15.19:0/1730271091 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5e9583700 1 --1- 172.21.15.19:0/1730271091 >> v1:172.21.15.19:6789/0 conn(0x7fa5e40a1340 0x7fa5e4133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35274/0 (socket says 172.21.15.19:35274) 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 -- 172.21.15.19:0/1730271091 >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 msgr2=0x7fa5e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 --2- 172.21.15.19:0/1730271091 >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 0x7fa5e40a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 -- 172.21.15.19:0/1730271091 >> v1:172.21.15.19:6789/0 conn(0x7fa5e40a1340 legacy=0x7fa5e4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.575+0000 7fa5ea585700 1 -- 172.21.15.19:0/1730271091 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e40a1fe0 con 0x7fa5e4134170 2023-10-03T10:15:15.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.576+0000 7fa5ea585700 1 --2- 172.21.15.19:0/1730271091 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009d90 tx=0x7fa5dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9cd45003fe170b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.576+0000 7fa5e8d82700 1 -- 172.21.15.19:0/1730271091 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00e070 con 0x7fa5e4134170 2023-10-03T10:15:15.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.576+0000 7fa5e8d82700 1 -- 172.21.15.19:0/1730271091 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00bb20 con 0x7fa5e4134170 2023-10-03T10:15:15.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.576+0000 7fa5e8d82700 1 -- 172.21.15.19:0/1730271091 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc012430 con 0x7fa5e4134170 2023-10-03T10:15:15.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.576+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1730271091 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 msgr2=0x7fa5e413bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1730271091 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009d90 tx=0x7fa5dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1730271091 shutdown_connections 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1730271091 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e4134170 0x7fa5e413bd30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1730271091 >> v2:172.21.15.19:3300/0 conn(0x7fa5e40a0a30 0x7fa5e40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1730271091 >> 172.21.15.19:0/1730271091 conn(0x7fa5e40a6550 msgr2=0x7fa5e40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1730271091 shutdown_connections 2023-10-03T10:15:15.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.577+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1730271091 wait complete. 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 Processor -- start 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 -- start start 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5e40a1340 0x7fa5e41333d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5e4134170 0x7fa5e41b92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41bb060 con 0x7fa5e4134170 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41bae30 con 0x7fa5e40a0a30 2023-10-03T10:15:15.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.578+0000 7fa5ebfe8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41bce40 con 0x7fa5e40a1340 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45880/0 (socket says 172.21.15.19:45880) 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 -- 172.21.15.19:0/1641731009 learned_addr learned my addr 172.21.15.19:0/1641731009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5ea585700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5e4134170 0x7fa5e41b92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9583700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5e40a1340 0x7fa5e41333d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 -- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5e40a1340 msgr2=0x7fa5e41333d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5e40a1340 0x7fa5e41333d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 -- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5e4134170 msgr2=0x7fa5e41b92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5e4134170 0x7fa5e41b92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 -- 172.21.15.19:0/1641731009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc009a70 con 0x7fa5e40a0a30 2023-10-03T10:15:15.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5e9d84700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e970 tx=0x7fa5e000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:15.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00096a0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.579+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e000eec0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.580+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e40a25e0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.580+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000ca50 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.580+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e41bc7a0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.581+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5e000cbb0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.581+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5e003f700 con 0x7fa5e40a0a30 2023-10-03T10:15:15.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.581+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4074ea0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.591+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5e00232f0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.702+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb900074ea0 con 0x7fb90009e410 2023-10-03T10:15:15.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.703+0000 7fb8e7fff700 1 -- 172.21.15.19:0/163702969 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8f802c090 con 0x7fb90009e410 2023-10-03T10:15:15.704 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:15.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 msgr2=0x7fb9001a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800efc0 tx=0x7fb8f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 shutdown_connections 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb90009e410 0x7fb9001a2520 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb90009d6f0 0x7fb9001a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 --2- 172.21.15.19:0/163702969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb90009e000 0x7fb9001a1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 >> 172.21.15.19:0/163702969 conn(0x7fb900066f50 msgr2=0x7fb9001b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 shutdown_connections 2023-10-03T10:15:15.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.705+0000 7fb9059f9700 1 -- 172.21.15.19:0/163702969 wait complete. 2023-10-03T10:15:15.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.731+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9c6c005590 con 0x7f9c9409d6f0 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.731+0000 7f9c7b7fe700 1 -- 172.21.15.19:0/3909909856 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c8400bbd0 con 0x7f9c9409d6f0 2023-10-03T10:15:15.734 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 msgr2=0x7f9c941ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c84000c00 tx=0x7f9c84004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 shutdown_connections 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c9409e410 0x7f9c941ac360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c9409d6f0 0x7f9c941ab8e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 --2- 172.21.15.19:0/3909909856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c9409e000 0x7f9c941abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 >> 172.21.15.19:0/3909909856 conn(0x7f9c94066f50 msgr2=0x7f9c94071360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 shutdown_connections 2023-10-03T10:15:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.733+0000 7f9c797fa700 1 -- 172.21.15.19:0/3909909856 wait complete. 2023-10-03T10:15:15.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.779+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fc01cd740 con 0x7f1fc012f8b0 2023-10-03T10:15:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.779+0000 7f1fb67fc700 1 -- 172.21.15.19:0/2631743678 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fb00193b0 con 0x7f1fc012f8b0 2023-10-03T10:15:15.780 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 msgr2=0x7f1fc01cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00090b0 tx=0x7f1fb0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 shutdown_connections 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fc0130260 0x7f1fc01391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fc012cf60 0x7f1fc01cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 --2- 172.21.15.19:0/2631743678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fc012f8b0 0x7f1fc01cd200 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 >> 172.21.15.19:0/2631743678 conn(0x7f1fc00a2aa0 msgr2=0x7f1fc006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 shutdown_connections 2023-10-03T10:15:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.782+0000 7f1fc7f8c700 1 -- 172.21.15.19:0/2631743678 wait complete. 2023-10-03T10:15:15.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:15.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.816+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa5e40a28e0 con 0x7fa5e40a0a30 2023-10-03T10:15:15.817 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:15.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.816+0000 7fa5da7fc700 1 -- 172.21.15.19:0/1641731009 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5e0021020 con 0x7fa5e40a0a30 2023-10-03T10:15:15.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 msgr2=0x7fa5e4132e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e970 tx=0x7fa5e000ec80 comp rx=0 tx=0).stop 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 shutdown_connections 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5e4134170 0x7fa5e41b92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5e40a0a30 0x7fa5e4132e90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 --2- 172.21.15.19:0/1641731009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5e40a1340 0x7fa5e41333d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.818+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 >> 172.21.15.19:0/1641731009 conn(0x7fa5e40a6550 msgr2=0x7fa5e409ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.819+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 shutdown_connections 2023-10-03T10:15:15.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:15.819+0000 7fa5ebfe8700 1 -- 172.21.15.19:0/1641731009 wait complete. 2023-10-03T10:15:15.833 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:16.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:16.749 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:16.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:16.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:16.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 Processor -- start 2023-10-03T10:15:16.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 -- start start 2023-10-03T10:15:16.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 0x7fd9fc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9fc09b4f0 con 0x7fd9fc131810 2023-10-03T10:15:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc1313c0 con 0x7fd9fc134630 2023-10-03T10:15:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.877+0000 7fda02a65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc06e8c0 con 0x7fd9fc136f50 2023-10-03T10:15:16.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda00801700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd9fc131810 0x7fd9fc131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54584/0 (socket says 172.21.15.19:54584) 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 0x7fd9fc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda00801700 1 -- 172.21.15.19:0/77313902 learned_addr learned my addr 172.21.15.19:0/77313902 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fd9fbfff700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 -- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 msgr2=0x7fd9fc136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 -- 172.21.15.19:0/77313902 >> v1:172.21.15.19:6789/0 conn(0x7fd9fc131810 legacy=0x7fd9fc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 -- 172.21.15.19:0/77313902 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc071d20 con 0x7fd9fc136f50 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fda01002700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 0x7fd9fc139330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009dc0 tx=0x7fd9f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb0c080eb99cce64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.878+0000 7fd9fb7fe700 1 -- 172.21.15.19:0/77313902 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f400e070 con 0x7fd9fc136f50 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fd9fb7fe700 1 -- 172.21.15.19:0/77313902 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f400bbd0 con 0x7fd9fc136f50 2023-10-03T10:15:16.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fd9fb7fe700 1 -- 172.21.15.19:0/77313902 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4012430 con 0x7fd9fc136f50 2023-10-03T10:15:16.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 -- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 msgr2=0x7fd9fc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 0x7fd9fc139330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4009dc0 tx=0x7fd9f400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 -- 172.21.15.19:0/77313902 shutdown_connections 2023-10-03T10:15:16.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc136f50 0x7fd9fc139330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 --2- 172.21.15.19:0/77313902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 -- 172.21.15.19:0/77313902 >> 172.21.15.19:0/77313902 conn(0x7fd9fc0a2aa0 msgr2=0x7fd9fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.879+0000 7fda02a65700 1 -- 172.21.15.19:0/77313902 shutdown_connections 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.880+0000 7fda02a65700 1 -- 172.21.15.19:0/77313902 wait complete. 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.880+0000 7fda02a65700 1 Processor -- start 2023-10-03T10:15:16.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.881+0000 7fda02a65700 1 -- start start 2023-10-03T10:15:16.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc131810 0x7fd9fc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9fc136f50 0x7fd9fc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc11c4e0 con 0x7fd9fc136f50 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc11bf30 con 0x7fd9fc134630 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda02a65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9fc11a9c0 con 0x7fd9fc131810 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51876/0 (socket says 172.21.15.19:51876) 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 -- 172.21.15.19:0/2833936632 learned_addr learned my addr 172.21.15.19:0/2833936632 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda01002700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9fc136f50 0x7fd9fc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fda00801700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc131810 0x7fd9fc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 -- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc131810 msgr2=0x7fd9fc118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc131810 0x7fd9fc118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 -- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9fc136f50 msgr2=0x7fd9fc119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9fc136f50 0x7fd9fc119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 -- 172.21.15.19:0/2833936632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4009a70 con 0x7fd9fc134630 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.882+0000 7fd9fbfff700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e840 tx=0x7fd9e800ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.883+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8013610 con 0x7fd9fc134630 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.883+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e8013770 con 0x7fd9fc134630 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.883+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9fc0a2080 con 0x7fd9fc134630 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.883+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8013b20 con 0x7fd9fc134630 2023-10-03T10:15:16.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.883+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9fc11cf50 con 0x7fd9fc134630 2023-10-03T10:15:16.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.884+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9fc11c620 con 0x7fd9fc134630 2023-10-03T10:15:16.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.884+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9e8013c80 con 0x7fd9fc134630 2023-10-03T10:15:16.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.885+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd9e803f440 con 0x7fd9fc134630 2023-10-03T10:15:16.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.890+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd9fc11c620 con 0x7fd9fc134630 2023-10-03T10:15:16.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 Processor -- start 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 -- start start 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 0x7f6558135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 0x7f6558138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f655809f130 con 0x7f655809d6f0 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.917+0000 7f655e0e3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f655809f520 con 0x7f655809e1d0 2023-10-03T10:15:16.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f655e0e3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655809e930 con 0x7f6558135e50 2023-10-03T10:15:16.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6556ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 0x7f6558135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6556ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 0x7f6558135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34570/0 (socket says 172.21.15.19:34570) 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f65577fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f655809d6f0 0x7f655809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54598/0 (socket says 172.21.15.19:54598) 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6556ffd700 1 -- 172.21.15.19:0/4177920480 learned_addr learned my addr 172.21.15.19:0/4177920480 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 --2- 172.21.15.19:0/4177920480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 0x7f6558138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f65567fc700 1 -- 172.21.15.19:0/4177920480 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030996256 0 0) 0x7f655809f130 con 0x7f655809d6f0 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 -- 172.21.15.19:0/4177920480 >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 msgr2=0x7f6558135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 --2- 172.21.15.19:0/4177920480 >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 0x7f6558135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 -- 172.21.15.19:0/4177920480 >> v1:172.21.15.19:6789/0 conn(0x7f655809d6f0 legacy=0x7f655809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 -- 172.21.15.19:0/4177920480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f655809b2d0 con 0x7f6558135e50 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.918+0000 7f6557fff700 1 --2- 172.21.15.19:0/4177920480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 0x7f6558138230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6550009d90 tx=0x7f655000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=312b70c1f14293d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f65567fc700 1 -- 172.21.15.19:0/4177920480 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655000e070 con 0x7f6558135e50 2023-10-03T10:15:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f65567fc700 1 -- 172.21.15.19:0/4177920480 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f655000bb20 con 0x7f6558135e50 2023-10-03T10:15:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f65567fc700 1 -- 172.21.15.19:0/4177920480 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6550012430 con 0x7f6558135e50 2023-10-03T10:15:16.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 -- 172.21.15.19:0/4177920480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 msgr2=0x7f6558138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 --2- 172.21.15.19:0/4177920480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 0x7f6558138230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6550009d90 tx=0x7f655000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 -- 172.21.15.19:0/4177920480 shutdown_connections 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 --2- 172.21.15.19:0/4177920480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6558135e50 0x7f6558138230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 --2- 172.21.15.19:0/4177920480 >> v2:172.21.15.19:3300/0 conn(0x7f655809e1d0 0x7f6558135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.919+0000 7f655e0e3700 1 -- 172.21.15.19:0/4177920480 >> 172.21.15.19:0/4177920480 conn(0x7f6558066f50 msgr2=0x7f655809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.920+0000 7f655e0e3700 1 -- 172.21.15.19:0/4177920480 shutdown_connections 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.920+0000 7f655e0e3700 1 -- 172.21.15.19:0/4177920480 wait complete. 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 Processor -- start 2023-10-03T10:15:16.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 -- start start 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 0x7f65581c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 0x7f65581c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6558135e50 0x7f65581c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655811caf0 con 0x7f655809d6f0 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65581c8ea0 con 0x7f6558135e50 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.921+0000 7f655e0e3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f655811a8a0 con 0x7f655809e1d0 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 0x7f65581c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f6556ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 0x7f65581c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33960/0 (socket says 172.21.15.19:33960) 2023-10-03T10:15:16.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 0x7f65581c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f6556ffd700 1 -- 172.21.15.19:0/753305697 learned_addr learned my addr 172.21.15.19:0/753305697 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f6557fff700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6558135e50 0x7f65581c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 -- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 msgr2=0x7f65581c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 0x7f65581c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 -- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6558135e50 msgr2=0x7f65581c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6558135e50 0x7f65581c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 -- 172.21.15.19:0/753305697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6550009a70 con 0x7f655809d6f0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.922+0000 7f65577fe700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 0x7f65581c8420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f654800c470 tx=0x7f654800c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.923+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548004c80 con 0x7f655809d6f0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.923+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6548004de0 con 0x7f655809d6f0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.923+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6548007310 con 0x7f655809d6f0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.923+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655811b650 con 0x7f655809d6f0 2023-10-03T10:15:16.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.923+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655811ccf0 con 0x7f655809d6f0 2023-10-03T10:15:16.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.924+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6548007470 con 0x7f655809d6f0 2023-10-03T10:15:16.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.924+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f654803f290 con 0x7f655809d6f0 2023-10-03T10:15:16.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.924+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6558074ea0 con 0x7f655809d6f0 2023-10-03T10:15:16.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.929+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6548007720 con 0x7f655809d6f0 2023-10-03T10:15:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.993+0000 7f0bd97ab700 1 Processor -- start 2023-10-03T10:15:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.993+0000 7f0bd97ab700 1 -- start start 2023-10-03T10:15:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0bd41316c0 0x7f0bd4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd406acb0 0x7f0bd406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd409e130 con 0x7f0bd41316c0 2023-10-03T10:15:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd41312b0 con 0x7f0bd406acb0 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd97ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd409f6e0 con 0x7f0bd409d9f0 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd406acb0 0x7f0bd406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33976/0 (socket says 172.21.15.19:33976) 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd27fc700 1 -- 172.21.15.19:0/109912462 learned_addr learned my addr 172.21.15.19:0/109912462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.994+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/109912462 >> v2:172.21.15.19:3300/0 conn(0x7f0bd41316c0 0x7f0bd4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:16.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 -- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 msgr2=0x7f0bd406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 -- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd406acb0 msgr2=0x7f0bd406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd406acb0 0x7f0bd406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 -- 172.21.15.19:0/109912462 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd409e760 con 0x7f0bd41316c0 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd27fc700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd41316c0 0x7f0bd4131a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009840 tx=0x7f0bc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24871872b090515d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/109912462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011830 con 0x7f0bd41316c0 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/109912462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4011990 con 0x7f0bd41316c0 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.995+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/109912462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011d20 con 0x7f0bd41316c0 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 -- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd41316c0 msgr2=0x7f0bd4131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd41316c0 0x7f0bd4131a90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009840 tx=0x7f0bc4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 -- 172.21.15.19:0/109912462 shutdown_connections 2023-10-03T10:15:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd406acb0 0x7f0bd406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd41316c0 0x7f0bd4131a90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/109912462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd409d9f0 0x7f0bd406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 -- 172.21.15.19:0/109912462 >> 172.21.15.19:0/109912462 conn(0x7f0bd4066f50 msgr2=0x7f0bd409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 -- 172.21.15.19:0/109912462 shutdown_connections 2023-10-03T10:15:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.996+0000 7f0bd97ab700 1 -- 172.21.15.19:0/109912462 wait complete. 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.997+0000 7f0bd97ab700 1 Processor -- start 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.997+0000 7f0bd97ab700 1 -- start start 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 0x7f0bd4070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 0x7f0bd4071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd411b3c0 con 0x7f0bd409d9f0 2023-10-03T10:15:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd411a780 con 0x7f0bd41316c0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd97ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd411a0d0 con 0x7f0bd406acb0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34598/0 (socket says 172.21.15.19:34598) 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 -- 172.21.15.19:0/1517639859 learned_addr learned my addr 172.21.15.19:0/1517639859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd37fe700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 0x7f0bd4071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 0x7f0bd4070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 -- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 msgr2=0x7f0bd4070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 0x7f0bd4070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 -- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 msgr2=0x7f0bd4071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 0x7f0bd4071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd27fc700 1 -- 172.21.15.19:0/1517639859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009550 con 0x7f0bd409d9f0 2023-10-03T10:15:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd2ffd700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 0x7f0bd4070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.998+0000 7f0bd37fe700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 0x7f0bd4071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bd27fc700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800ebe0 tx=0x7f0bc8009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800c8b0 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800ca10 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc40094a0 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800cd80 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:16.999+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd4119710 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.000+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bc8013470 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.000+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0bc803f890 con 0x7f0bd409d9f0 2023-10-03T10:15:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.001+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd411ad70 con 0x7f0bd409d9f0 2023-10-03T10:15:17.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.005+0000 7f5e2426c700 1 Processor -- start 2023-10-03T10:15:17.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bc8021080 con 0x7f0bd409d9f0 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.005+0000 7f5e2426c700 1 -- start start 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e2426c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 0x7f5e1c09e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e2426c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e2426c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c09a810 con 0x7f5e1c06a770 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e2426c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1c06ab40 con 0x7f5e1c09de00 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e2426c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c09ebc0 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e21807700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 0x7f5e1c09e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51918/0 (socket says 172.21.15.19:51918) 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 -- 172.21.15.19:0/3720801744 learned_addr learned my addr 172.21.15.19:0/3720801744 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 -- 172.21.15.19:0/3720801744 >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 msgr2=0x7f5e1c09e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 --2- 172.21.15.19:0/3720801744 >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 0x7f5e1c09e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 -- 172.21.15.19:0/3720801744 >> v1:172.21.15.19:6789/0 conn(0x7f5e1c06a770 legacy=0x7f5e1c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 -- 172.21.15.19:0/3720801744 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c09e920 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e21807700 1 --2- 172.21.15.19:0/3720801744 >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 0x7f5e1c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.006+0000 7f5e22809700 1 --2- 172.21.15.19:0/3720801744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009e50 tx=0x7f5e1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2c639f3bd18449 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e21006700 1 -- 172.21.15.19:0/3720801744 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400e070 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e21006700 1 -- 172.21.15.19:0/3720801744 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14003a20 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e21006700 1 -- 172.21.15.19:0/3720801744 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14003dd0 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 -- 172.21.15.19:0/3720801744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 msgr2=0x7f5e1c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 --2- 172.21.15.19:0/3720801744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009e50 tx=0x7f5e1400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:17.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 -- 172.21.15.19:0/3720801744 shutdown_connections 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 --2- 172.21.15.19:0/3720801744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c13d1f0 0x7f5e1c13f5d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 --2- 172.21.15.19:0/3720801744 >> v2:172.21.15.19:3300/0 conn(0x7f5e1c09de00 0x7f5e1c09e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.007+0000 7f5e2426c700 1 -- 172.21.15.19:0/3720801744 >> 172.21.15.19:0/3720801744 conn(0x7f5e1c066f50 msgr2=0x7f5e1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.008+0000 7f5e2426c700 1 -- 172.21.15.19:0/3720801744 shutdown_connections 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.008+0000 7f5e2426c700 1 -- 172.21.15.19:0/3720801744 wait complete. 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 Processor -- start 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 -- start start 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 0x7f5e1c13bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e1c13d1f0 0x7f5e1c13c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c072450 con 0x7f5e1c09de00 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c1382a0 con 0x7f5e1c06a770 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e2426c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c13f700 con 0x7f5e1c13d1f0 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e22008700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e22008700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51930/0 (socket says 172.21.15.19:51930) 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e22008700 1 -- 172.21.15.19:0/665127846 learned_addr learned my addr 172.21.15.19:0/665127846 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.009+0000 7f5e22809700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e1c13d1f0 0x7f5e1c13c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 -- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e1c13d1f0 msgr2=0x7f5e1c13c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e1c13d1f0 0x7f5e1c13c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 -- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 msgr2=0x7f5e1c13bdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e21807700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 0x7f5e1c13bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 0x7f5e1c13bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 -- 172.21.15.19:0/665127846 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0094a0 con 0x7f5e1c06a770 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e21807700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 0x7f5e1c13bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e22008700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800c4d0 tx=0x7f5e1800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e180054e0 con 0x7f5e1c06a770 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e18003680 con 0x7f5e1c06a770 2023-10-03T10:15:17.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18003a30 con 0x7f5e1c06a770 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e14009b30 con 0x7f5e1c06a770 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.010+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c11e560 con 0x7f5e1c06a770 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.012+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c074ea0 con 0x7f5e1c06a770 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.012+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e18003b90 con 0x7f5e1c06a770 2023-10-03T10:15:17.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.013+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e1803e9d0 con 0x7f5e1c06a770 2023-10-03T10:15:17.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.017+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e18003e40 con 0x7f5e1c06a770 2023-10-03T10:15:17.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.144+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f655811c8e0 con 0x7f655809d6f0 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.145+0000 7f653ffff700 1 -- 172.21.15.19:0/753305697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6548011e80 con 0x7f655809d6f0 2023-10-03T10:15:17.146 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.148+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 msgr2=0x7f65581c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.148+0000 7f655e0e3700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 0x7f65581c8420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f654800c470 tx=0x7f654800c780 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 shutdown_connections 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6558135e50 0x7f65581c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f655809d6f0 0x7f65581c8420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 --2- 172.21.15.19:0/753305697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f655809e1d0 0x7f65581c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 >> 172.21.15.19:0/753305697 conn(0x7f6558066f50 msgr2=0x7f6558070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 shutdown_connections 2023-10-03T10:15:17.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.149+0000 7f655e0e3700 1 -- 172.21.15.19:0/753305697 wait complete. 2023-10-03T10:15:17.168 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:17.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.175+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd9fc11c620 con 0x7fd9fc134630 2023-10-03T10:15:17.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.175+0000 7fd9f97fa700 1 -- 172.21.15.19:0/2833936632 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9fc11c620 con 0x7fd9fc134630 2023-10-03T10:15:17.176 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.177+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 msgr2=0x7fd9fc119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.177+0000 7fda02a65700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e840 tx=0x7fd9e800ec00 comp rx=0 tx=0).stop 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 shutdown_connections 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9fc136f50 0x7fd9fc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd9fc131810 0x7fd9fc118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 --2- 172.21.15.19:0/2833936632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd9fc134630 0x7fd9fc119210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 >> 172.21.15.19:0/2833936632 conn(0x7fd9fc0a2aa0 msgr2=0x7fd9fc133170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 shutdown_connections 2023-10-03T10:15:17.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.178+0000 7fda02a65700 1 -- 172.21.15.19:0/2833936632 wait complete. 2023-10-03T10:15:17.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.227+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e1c11def0 con 0x7f5e1c06a770 2023-10-03T10:15:17.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.227+0000 7f5e12ffd700 1 -- 172.21.15.19:0/665127846 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e18017020 con 0x7f5e1c06a770 2023-10-03T10:15:17.228 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.228+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0bd4074ea0 con 0x7f0bd409d9f0 2023-10-03T10:15:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.229+0000 7f0bbb7fe700 1 -- 172.21.15.19:0/1517639859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bc80232f0 con 0x7f0bd409d9f0 2023-10-03T10:15:17.230 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 msgr2=0x7f5e1c13b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800c4d0 tx=0x7f5e1800c7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 shutdown_connections 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e1c13d1f0 0x7f5e1c13c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e1c06a770 0x7f5e1c13b890 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 --2- 172.21.15.19:0/665127846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e1c09de00 0x7f5e1c13bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 >> 172.21.15.19:0/665127846 conn(0x7f5e1c066f50 msgr2=0x7f5e1c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 shutdown_connections 2023-10-03T10:15:17.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.230+0000 7f5e2426c700 1 -- 172.21.15.19:0/665127846 wait complete. 2023-10-03T10:15:17.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 msgr2=0x7f0bd4070fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800ebe0 tx=0x7f0bc8009e70 comp rx=0 tx=0).stop 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 shutdown_connections 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bd41316c0 0x7f0bd4071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bd406acb0 0x7f0bd4070a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 --2- 172.21.15.19:0/1517639859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bd409d9f0 0x7f0bd4070fc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 >> 172.21.15.19:0/1517639859 conn(0x7f0bd4066f50 msgr2=0x7f0bd4130150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 shutdown_connections 2023-10-03T10:15:17.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:17.231+0000 7f0bd97ab700 1 -- 172.21.15.19:0/1517639859 wait complete. 2023-10-03T10:15:17.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:17.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:18.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:18.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:18.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:18.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:18.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.332+0000 7fc7c171c700 1 Processor -- start 2023-10-03T10:15:18.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.332+0000 7fc7c171c700 1 -- start start 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7c171c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7bc133a80 0x7fc7bc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7c171c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc130a70 0x7fc7bc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7c171c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7bc06bc00 con 0x7fc7bc12ff20 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7c171c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7bc06c570 con 0x7fc7bc133a80 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7c171c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0a0040 con 0x7fc7bc130a70 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7baffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc7bc133a80 0x7fc7bc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7ba7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc7bc12ff20 0x7fc7bc130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54622/0 (socket says 172.21.15.19:54622) 2023-10-03T10:15:18.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7bb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc130a70 0x7fc7bc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.333+0000 7fc7ba7fc700 1 -- 172.21.15.19:0/4052375608 learned_addr learned my addr 172.21.15.19:0/4052375608 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7baffd700 1 -- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc130a70 msgr2=0x7fc7bc13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7baffd700 1 --2- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc130a70 0x7fc7bc13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7baffd700 1 -- 172.21.15.19:0/4052375608 >> v1:172.21.15.19:6789/0 conn(0x7fc7bc12ff20 legacy=0x7fc7bc130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7baffd700 1 -- 172.21.15.19:0/4052375608 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc133860 con 0x7fc7bc133a80 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7baffd700 1 --2- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc133a80 0x7fc7bc133e50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009840 tx=0x7fc7ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24d23c2639b4fbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7b9ffb700 1 -- 172.21.15.19:0/4052375608 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac004230 con 0x7fc7bc133a80 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7b9ffb700 1 -- 172.21.15.19:0/4052375608 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ac004390 con 0x7fc7bc133a80 2023-10-03T10:15:18.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.334+0000 7fc7b9ffb700 1 -- 172.21.15.19:0/4052375608 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0036a0 con 0x7fc7bc133a80 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.335+0000 7fc7c171c700 1 -- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc133a80 msgr2=0x7fc7bc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.335+0000 7fc7c171c700 1 --2- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc133a80 0x7fc7bc133e50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac009840 tx=0x7fc7ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 -- 172.21.15.19:0/4052375608 shutdown_connections 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 --2- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc130a70 0x7fc7bc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 --2- 172.21.15.19:0/4052375608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc133a80 0x7fc7bc133e50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 -- 172.21.15.19:0/4052375608 >> 172.21.15.19:0/4052375608 conn(0x7fc7bc0a4210 msgr2=0x7fc7bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 -- 172.21.15.19:0/4052375608 shutdown_connections 2023-10-03T10:15:18.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.336+0000 7fc7c171c700 1 -- 172.21.15.19:0/4052375608 wait complete. 2023-10-03T10:15:18.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.337+0000 7fc7c171c700 1 Processor -- start 2023-10-03T10:15:18.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.337+0000 7fc7c171c700 1 -- start start 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 0x7fc7bc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc130a70 0x7fc7bc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc12d770 con 0x7fc7bc130a70 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc0a20e0 con 0x7fc7bc133a80 2023-10-03T10:15:18.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7c171c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc11fd30 con 0x7fc7bc12ff20 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7bb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7ba7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc130a70 0x7fc7bc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7bb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51948/0 (socket says 172.21.15.19:51948) 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.338+0000 7fc7bb7fe700 1 -- 172.21.15.19:0/3444679391 learned_addr learned my addr 172.21.15.19:0/3444679391 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7baffd700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 0x7fc7bc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 -- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 msgr2=0x7fc7bc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 0x7fc7bc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 -- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc130a70 msgr2=0x7fc7bc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc130a70 0x7fc7bc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 -- 172.21.15.19:0/3444679391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ac0094a0 con 0x7fc7bc133a80 2023-10-03T10:15:18.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7baffd700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 0x7fc7bc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7bb7fe700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400efc0 tx=0x7fc7b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4009ea0 con 0x7fc7bc133a80 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc12d330 con 0x7fc7bc133a80 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b400f040 con 0x7fc7bc133a80 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.339+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b400ced0 con 0x7fc7bc133a80 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.340+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc120a60 con 0x7fc7bc133a80 2023-10-03T10:15:18.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.340+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7b4014480 con 0x7fc7bc133a80 2023-10-03T10:15:18.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.341+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7b4040220 con 0x7fc7bc133a80 2023-10-03T10:15:18.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.341+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c0052e0 con 0x7fc7bc133a80 2023-10-03T10:15:18.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.350+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7b4018020 con 0x7fc7bc133a80 2023-10-03T10:15:18.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 Processor -- start 2023-10-03T10:15:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 -- start start 2023-10-03T10:15:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3748130260 0x7f3748136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374812d330 con 0x7f3748130260 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374812cd90 con 0x7f374812f8b0 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.371+0000 7f374e46c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37481306d0 con 0x7f374812cf60 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3748130260 0x7f3748136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f37477fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3748130260 0x7f3748136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34640/0 (socket says 172.21.15.19:34640) 2023-10-03T10:15:18.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 -- 172.21.15.19:0/311558565 learned_addr learned my addr 172.21.15.19:0/311558565 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:18.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f3747fff700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 -- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 msgr2=0x7f374806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 -- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 msgr2=0x7f374812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 -- 172.21.15.19:0/311558565 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748071780 con 0x7f3748130260 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f3747fff700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f37477fe700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.372+0000 7f374ca09700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f3748136c20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f374000d150 tx=0x7f374000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb53e72895b6605 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f3746ffd700 1 -- 172.21.15.19:0/311558565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740010070 con 0x7f3748130260 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f3746ffd700 1 -- 172.21.15.19:0/311558565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000db00 con 0x7f3748130260 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f3746ffd700 1 -- 172.21.15.19:0/311558565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740016400 con 0x7f3748130260 2023-10-03T10:15:18.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 -- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 msgr2=0x7f3748136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f3748136c20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f374000d150 tx=0x7f374000d460 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 -- 172.21.15.19:0/311558565 shutdown_connections 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f3748136c20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 --2- 172.21.15.19:0/311558565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 -- 172.21.15.19:0/311558565 >> 172.21.15.19:0/311558565 conn(0x7f37480a2aa0 msgr2=0x7f37480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 -- 172.21.15.19:0/311558565 shutdown_connections 2023-10-03T10:15:18.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.373+0000 7f374e46c700 1 -- 172.21.15.19:0/311558565 wait complete. 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.374+0000 7f374e46c700 1 Processor -- start 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 -- start start 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374809bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374809c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f37481c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3748129b90 con 0x7f3748130260 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374809e8a0 con 0x7f374812f8b0 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374e46c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f374812da40 con 0x7f374812cf60 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f3747fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374809bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f3747fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374809bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34010/0 (socket says 172.21.15.19:34010) 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f3747fff700 1 -- 172.21.15.19:0/2815292419 learned_addr learned my addr 172.21.15.19:0/2815292419 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.375+0000 7f374ca09700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f37481c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f37477fe700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374809c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 -- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 msgr2=0x7f374809bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374809bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 -- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 msgr2=0x7f374809c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374809c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 -- 172.21.15.19:0/2815292419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0094a0 con 0x7f3748130260 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374ca09700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f37481c3eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3748071670 tx=0x7f3740004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400206c0 con 0x7f3748130260 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3740020860 con 0x7f3748130260 2023-10-03T10:15:18.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374000bd40 con 0x7f3748130260 2023-10-03T10:15:18.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.376+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3740020c10 con 0x7f3748130260 2023-10-03T10:15:18.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.377+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374809b570 con 0x7f3748130260 2023-10-03T10:15:18.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.377+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37400040c0 con 0x7f3748130260 2023-10-03T10:15:18.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.377+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748129a00 con 0x7f3748130260 2023-10-03T10:15:18.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.378+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3740044990 con 0x7f3748130260 2023-10-03T10:15:18.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.383+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3740027770 con 0x7f3748130260 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.408+0000 7ff9a9ed8700 1 Processor -- start 2023-10-03T10:15:18.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.408+0000 7ff9a9ed8700 1 -- start start 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a9ed8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 0x7ff9a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a9ed8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 0x7ff9a4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a9ed8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a409f130 con 0x7ff9a409e000 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a9ed8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a409f520 con 0x7ff9a409e410 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a9ed8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a409e930 con 0x7ff9a409d6f0 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff9a409e000 0x7ff9a4130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54632/0 (socket says 172.21.15.19:54632) 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a2ffd700 1 -- 172.21.15.19:0/2541218478 learned_addr learned my addr 172.21.15.19:0/2541218478 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:18.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/2541218478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 0x7ff9a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.409+0000 7ff9a3fff700 1 --2- 172.21.15.19:0/2541218478 >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 0x7ff9a4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a37fe700 1 -- 172.21.15.19:0/2541218478 >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 msgr2=0x7ff9a4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/2541218478 >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 0x7ff9a4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a37fe700 1 -- 172.21.15.19:0/2541218478 >> v1:172.21.15.19:6789/0 conn(0x7ff9a409e000 legacy=0x7ff9a4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a37fe700 1 -- 172.21.15.19:0/2541218478 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a409b2d0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a3fff700 1 --2- 172.21.15.19:0/2541218478 >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 0x7ff9a4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/2541218478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 0x7ff9a409dac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b1330fc65cbc3d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a27fc700 1 -- 172.21.15.19:0/2541218478 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994010a90 con 0x7ff9a409d6f0 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a27fc700 1 -- 172.21.15.19:0/2541218478 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994010bf0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.410+0000 7ff9a27fc700 1 -- 172.21.15.19:0/2541218478 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994018440 con 0x7ff9a409d6f0 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/2541218478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 msgr2=0x7ff9a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/2541218478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 0x7ff9a409dac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff994009840 tx=0x7ff994009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/2541218478 shutdown_connections 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/2541218478 >> v2:172.21.15.19:3300/0 conn(0x7ff9a409e410 0x7ff9a4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/2541218478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409d6f0 0x7ff9a409dac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/2541218478 >> 172.21.15.19:0/2541218478 conn(0x7ff9a4066f50 msgr2=0x7ff9a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/2541218478 shutdown_connections 2023-10-03T10:15:18.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.411+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/2541218478 wait complete. 2023-10-03T10:15:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.413+0000 7ff9a9ed8700 1 Processor -- start 2023-10-03T10:15:18.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.413+0000 7ff9a9ed8700 1 -- start start 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 0x7ff9a411e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a409e410 0x7ff9a411eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a411f490 con 0x7ff9a409e410 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40a1e20 con 0x7ff9a409d6f0 2023-10-03T10:15:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a9ed8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a409c700 con 0x7ff9a409e000 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51982/0 (socket says 172.21.15.19:51982) 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 -- 172.21.15.19:0/699975123 learned_addr learned my addr 172.21.15.19:0/699975123 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a2ffd700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 0x7ff9a411e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a3fff700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a409e410 0x7ff9a411eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 -- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 msgr2=0x7ff9a411e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 0x7ff9a411e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 -- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a409e410 msgr2=0x7ff9a411eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a409e410 0x7ff9a411eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a37fe700 1 -- 172.21.15.19:0/699975123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c009a70 con 0x7ff9a409d6f0 2023-10-03T10:15:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.414+0000 7ff9a2ffd700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 0x7ff9a411e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff9a37fe700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff994009fd0 tx=0x7ff994004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994003c70 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994003dd0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994023690 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940094a0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.415+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a41215d0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.416+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff99401f070 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.416+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff9940452a0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.416+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a4120e50 con 0x7ff9a409d6f0 2023-10-03T10:15:18.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.421+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff99401d020 con 0x7ff9a409d6f0 2023-10-03T10:15:18.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.429+0000 7fd86c7ab700 1 Processor -- start 2023-10-03T10:15:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.429+0000 7fd86c7ab700 1 -- start start 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86c7ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd864136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86c7ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd8641393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86c7ab700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd864070940 con 0x7fd86409e930 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86c7ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86406fd60 con 0x7fd864136fe0 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86c7ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86406fa80 con 0x7fd86409f410 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86a547700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd86409e930 0x7fd86409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54634/0 (socket says 172.21.15.19:54634) 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86a547700 1 -- 172.21.15.19:0/17819218 learned_addr learned my addr 172.21.15.19:0/17819218 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869d46700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd864136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86ad48700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd8641393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869d46700 1 -- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 msgr2=0x7fd8641393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869d46700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd8641393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869d46700 1 -- 172.21.15.19:0/17819218 >> v1:172.21.15.19:6789/0 conn(0x7fd86409e930 legacy=0x7fd86409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869d46700 1 -- 172.21.15.19:0/17819218 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86409fb60 con 0x7fd86409f410 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd869545700 1 -- 172.21.15.19:0/17819218 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183143314 0 0) 0x7fd864070940 con 0x7fd86409e930 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.430+0000 7fd86ad48700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd8641393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.431+0000 7fd869d46700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd864136aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd854009870 tx=0x7fd854009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50095eb9ee2fe876 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.431+0000 7fd869545700 1 -- 172.21.15.19:0/17819218 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011830 con 0x7fd86409f410 2023-10-03T10:15:18.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.431+0000 7fd869545700 1 -- 172.21.15.19:0/17819218 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd854011990 con 0x7fd86409f410 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.431+0000 7fd869545700 1 -- 172.21.15.19:0/17819218 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854011d20 con 0x7fd86409f410 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 -- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 msgr2=0x7fd864136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd864136aa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd854009870 tx=0x7fd854009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 -- 172.21.15.19:0/17819218 shutdown_connections 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd8641393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/17819218 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd864136aa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 -- 172.21.15.19:0/17819218 >> 172.21.15.19:0/17819218 conn(0x7fd8640a4210 msgr2=0x7fd8640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 -- 172.21.15.19:0/17819218 shutdown_connections 2023-10-03T10:15:18.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.432+0000 7fd86c7ab700 1 -- 172.21.15.19:0/17819218 wait complete. 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.433+0000 7fd86c7ab700 1 Processor -- start 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.433+0000 7fd86c7ab700 1 -- start start 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd86406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd864071d90 con 0x7fd86409e930 2023-10-03T10:15:18.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86406d640 con 0x7fd864136fe0 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86c7ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd864134660 con 0x7fd86409f410 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86a547700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34036/0 (socket says 172.21.15.19:34036) 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 -- 172.21.15.19:0/2582452629 learned_addr learned my addr 172.21.15.19:0/2582452629 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86a547700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34700/0 (socket says 172.21.15.19:34700) 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86ad48700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd86406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 -- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 msgr2=0x7fd86406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd86406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 -- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 msgr2=0x7fd86406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd869d46700 1 -- 172.21.15.19:0/2582452629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c009a70 con 0x7fd86409f410 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86ad48700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd86406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.434+0000 7fd86a547700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd869d46700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd854009840 tx=0x7fd854004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854004590 con 0x7fd86409f410 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85401f070 con 0x7fd86409f410 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8540094a0 con 0x7fd86409f410 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8540038e0 con 0x7fd86409f410 2023-10-03T10:15:18.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.435+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8641341f0 con 0x7fd86409f410 2023-10-03T10:15:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.436+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd854003a40 con 0x7fd86409f410 2023-10-03T10:15:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.436+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd854021070 con 0x7fd86409f410 2023-10-03T10:15:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.436+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864074ea0 con 0x7fd86409f410 2023-10-03T10:15:18.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.446+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd85402b070 con 0x7fd86409f410 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.598+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc79c005150 con 0x7fc7bc133a80 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.598+0000 7fc7a37fe700 1 -- 172.21.15.19:0/3444679391 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7b402b090 con 0x7fc7bc133a80 2023-10-03T10:15:18.599 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 msgr2=0x7fc7bc09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400efc0 tx=0x7fc7b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 shutdown_connections 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7bc133a80 0x7fc7bc09cf00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7bc12ff20 0x7fc7bc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 --2- 172.21.15.19:0/3444679391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7bc130a70 0x7fc7bc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 >> 172.21.15.19:0/3444679391 conn(0x7fc7bc0a4210 msgr2=0x7fc7bc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 shutdown_connections 2023-10-03T10:15:18.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.601+0000 7fc7c171c700 1 -- 172.21.15.19:0/3444679391 wait complete. 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.605+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f374809e6a0 con 0x7f3748130260 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.605+0000 7f3744ff9700 1 -- 172.21.15.19:0/2815292419 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f374002e020 con 0x7f3748130260 2023-10-03T10:15:18.606 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 msgr2=0x7f37481c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f37481c3eb0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3748071670 tx=0x7f3740004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 shutdown_connections 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3748130260 0x7f37481c3eb0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f374812cf60 0x7f374809bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 --2- 172.21.15.19:0/2815292419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f374812f8b0 0x7f374809c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 >> 172.21.15.19:0/2815292419 conn(0x7f37480a2aa0 msgr2=0x7f37480a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 shutdown_connections 2023-10-03T10:15:18.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.608+0000 7f374e46c700 1 -- 172.21.15.19:0/2815292419 wait complete. 2023-10-03T10:15:18.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:18.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.634+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff9a4074ea0 con 0x7ff9a409d6f0 2023-10-03T10:15:18.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.635+0000 7ff98bfff700 1 -- 172.21.15.19:0/699975123 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff99403a090 con 0x7ff9a409d6f0 2023-10-03T10:15:18.636 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 msgr2=0x7ff9a411e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff994009fd0 tx=0x7ff994004750 comp rx=0 tx=0).stop 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 shutdown_connections 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a409e410 0x7ff9a411eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a409d6f0 0x7ff9a411e030 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 --2- 172.21.15.19:0/699975123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a409e000 0x7ff9a411e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 >> 172.21.15.19:0/699975123 conn(0x7ff9a4066f50 msgr2=0x7ff9a406f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 shutdown_connections 2023-10-03T10:15:18.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.637+0000 7ff9a9ed8700 1 -- 172.21.15.19:0/699975123 wait complete. 2023-10-03T10:15:18.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.657+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd864122ae0 con 0x7fd86409f410 2023-10-03T10:15:18.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.657+0000 7fd85affd700 1 -- 172.21.15.19:0/2582452629 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd854015030 con 0x7fd86409f410 2023-10-03T10:15:18.658 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.659+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 msgr2=0x7fd86406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.659+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd854009840 tx=0x7fd854004750 comp rx=0 tx=0).stop 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 shutdown_connections 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd864136fe0 0x7fd86406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86409e930 0x7fd86406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 --2- 172.21.15.19:0/2582452629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86409f410 0x7fd86406bdf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 >> 172.21.15.19:0/2582452629 conn(0x7fd8640a4210 msgr2=0x7fd864134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 shutdown_connections 2023-10-03T10:15:18.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:18.660+0000 7fd86c7ab700 1 -- 172.21.15.19:0/2582452629 wait complete. 2023-10-03T10:15:18.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:19.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:19.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:19.652 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:19.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:19.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.776+0000 7ff838d66700 1 Processor -- start 2023-10-03T10:15:19.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.776+0000 7ff838d66700 1 -- start start 2023-10-03T10:15:19.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.776+0000 7ff838d66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 0x7ff83409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.776+0000 7ff838d66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 0x7ff834130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff838d66700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83409f130 con 0x7ff83409e000 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff838d66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409f520 con 0x7ff83409e410 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff838d66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff83409e930 con 0x7ff83409d6f0 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff831d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff83409e000 0x7ff834130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54650/0 (socket says 172.21.15.19:54650) 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff831d9b700 1 -- 172.21.15.19:0/259779616 learned_addr learned my addr 172.21.15.19:0/259779616 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83259c700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 0x7ff83409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff832d9d700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 0x7ff834130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83259c700 1 -- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 msgr2=0x7ff834130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83259c700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 0x7ff834130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83259c700 1 -- 172.21.15.19:0/259779616 >> v1:172.21.15.19:6789/0 conn(0x7ff83409e000 legacy=0x7ff834130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83259c700 1 -- 172.21.15.19:0/259779616 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83409b2d0 con 0x7ff83409d6f0 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff83159a700 1 -- 172.21.15.19:0/259779616 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801962148 0 0) 0x7ff83409f130 con 0x7ff83409e000 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.777+0000 7ff832d9d700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 0x7ff834130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.778+0000 7ff83259c700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 0x7ff83409dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff824009870 tx=0x7ff824009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f31c730dd6ce58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.778+0000 7ff83159a700 1 -- 172.21.15.19:0/259779616 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011830 con 0x7ff83409d6f0 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.778+0000 7ff83159a700 1 -- 172.21.15.19:0/259779616 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff824011990 con 0x7ff83409d6f0 2023-10-03T10:15:19.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.778+0000 7ff83159a700 1 -- 172.21.15.19:0/259779616 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824011d20 con 0x7ff83409d6f0 2023-10-03T10:15:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 -- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 msgr2=0x7ff83409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 0x7ff83409dac0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff824009870 tx=0x7ff824009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 -- 172.21.15.19:0/259779616 shutdown_connections 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409e410 0x7ff834130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 --2- 172.21.15.19:0/259779616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409d6f0 0x7ff83409dac0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 -- 172.21.15.19:0/259779616 >> 172.21.15.19:0/259779616 conn(0x7ff834066f50 msgr2=0x7ff83409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 -- 172.21.15.19:0/259779616 shutdown_connections 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.779+0000 7ff838d66700 1 -- 172.21.15.19:0/259779616 wait complete. 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.780+0000 7ff838d66700 1 Processor -- start 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.780+0000 7ff838d66700 1 -- start start 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 0x7ff834120010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 0x7ff834120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409e410 0x7ff834120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340a1bf0 con 0x7ff83409e000 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff834123b30 con 0x7ff83409d6f0 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff838d66700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff834122440 con 0x7ff83409e410 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff83259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 0x7ff834120010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 0x7ff834120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff83259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 0x7ff834120010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52016/0 (socket says 172.21.15.19:52016) 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff83259c700 1 -- 172.21.15.19:0/1914114008 learned_addr learned my addr 172.21.15.19:0/1914114008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff832d9d700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409e410 0x7ff834120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 -- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409e410 msgr2=0x7ff834120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409e410 0x7ff834120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 -- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 msgr2=0x7ff834120010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 0x7ff834120010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.781+0000 7ff831d9b700 1 -- 172.21.15.19:0/1914114008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009a70 con 0x7ff83409e000 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff831d9b700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 0x7ff834120550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff8340a3e20 tx=0x7ff82800c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828004c80 con 0x7ff83409e000 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff828004de0 con 0x7ff83409e000 2023-10-03T10:15:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8240094a0 con 0x7ff83409e000 2023-10-03T10:15:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828007310 con 0x7ff83409e000 2023-10-03T10:15:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.782+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff834122e70 con 0x7ff83409e000 2023-10-03T10:15:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.783+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8341236b0 con 0x7ff83409e000 2023-10-03T10:15:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.783+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff828007470 con 0x7ff83409e000 2023-10-03T10:15:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.784+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff82803f200 con 0x7ff83409e000 2023-10-03T10:15:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.788+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8341236b0 con 0x7ff83409e000 2023-10-03T10:15:19.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.814+0000 7fd797715700 1 Processor -- start 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.814+0000 7fd797715700 1 -- start start 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd797715700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd79009d6f0 0x7fd79009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd797715700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009e440 0x7fd790134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd797715700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79009b120 con 0x7fd79009e000 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd797715700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79006b460 con 0x7fd79009d6f0 2023-10-03T10:15:19.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd797715700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79009a7e0 con 0x7fd79009e440 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd794cb0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd79009e000 0x7fd7901339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54658/0 (socket says 172.21.15.19:54658) 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd795cb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009e440 0x7fd790134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.815+0000 7fd794cb0700 1 -- 172.21.15.19:0/1795642582 learned_addr learned my addr 172.21.15.19:0/1795642582 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:19.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 --2- 172.21.15.19:0/1795642582 >> v2:172.21.15.19:3300/0 conn(0x7fd79009d6f0 0x7fd79009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd787fff700 1 -- 172.21.15.19:0/1795642582 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732488545 0 0) 0x7fd79009b120 con 0x7fd79009e000 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd787fff700 1 -- 172.21.15.19:0/1795642582 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c0035b0 con 0x7fd79009e000 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 -- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009e440 msgr2=0x7fd790134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 --2- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009e440 0x7fd790134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 -- 172.21.15.19:0/1795642582 >> v1:172.21.15.19:6789/0 conn(0x7fd79009e000 legacy=0x7fd7901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 -- 172.21.15.19:0/1795642582 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79009a500 con 0x7fd79009d6f0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd7954b1700 1 --2- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009d6f0 0x7fd79009dac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4b351d13ebe324 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.816+0000 7fd787fff700 1 -- 172.21.15.19:0/1795642582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c011830 con 0x7fd79009d6f0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.817+0000 7fd787fff700 1 -- 172.21.15.19:0/1795642582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c011990 con 0x7fd79009d6f0 2023-10-03T10:15:19.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.817+0000 7fd787fff700 1 -- 172.21.15.19:0/1795642582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c011d00 con 0x7fd79009d6f0 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 -- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009d6f0 msgr2=0x7fd79009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 --2- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009d6f0 0x7fd79009dac0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd78c009870 tx=0x7fd78c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 -- 172.21.15.19:0/1795642582 shutdown_connections 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 --2- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009e440 0x7fd790134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 --2- 172.21.15.19:0/1795642582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009d6f0 0x7fd79009dac0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 -- 172.21.15.19:0/1795642582 >> 172.21.15.19:0/1795642582 conn(0x7fd790066f50 msgr2=0x7fd79009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 -- 172.21.15.19:0/1795642582 shutdown_connections 2023-10-03T10:15:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.818+0000 7fd797715700 1 -- 172.21.15.19:0/1795642582 wait complete. 2023-10-03T10:15:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.819+0000 7f8ce84a1700 1 Processor -- start 2023-10-03T10:15:19.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.819+0000 7f8ce84a1700 1 -- start start 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.819+0000 7fd797715700 1 Processor -- start 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.819+0000 7fd797715700 1 -- start start 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce84a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ce0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd79009e000 0x7fd7901c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009e440 0x7fd7901c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901a8210 con 0x7fd79009e440 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7901a4880 con 0x7fd79009d6f0 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd797715700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7900a2d10 con 0x7fd79009e000 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce84a1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce84a1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce01313c0 con 0x7f8ce0099a40 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce84a1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce006e8c0 con 0x7f8ce0131810 2023-10-03T10:15:19.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce84a1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0071d20 con 0x7f8ce009a580 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd7954b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd7954b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52046/0 (socket says 172.21.15.19:52046) 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd7954b1700 1 -- 172.21.15.19:0/2594204767 learned_addr learned my addr 172.21.15.19:0/2594204767 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7fd795cb2700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009e440 0x7fd7901c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce5a3c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8ce0099a40 0x7f8ce0099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54668/0 (socket says 172.21.15.19:54668) 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce5a3c700 1 -- 172.21.15.19:0/734088546 learned_addr learned my addr 172.21.15.19:0/734088546 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:19.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce623d700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ce0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 -- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd79009e000 msgr2=0x7fd7901c84f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd79009e000 0x7fd7901c84f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 -- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009e440 msgr2=0x7fd7901c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009e440 0x7fd7901c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 -- 172.21.15.19:0/2594204767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0094a0 con 0x7fd79009d6f0 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.820+0000 7f8ce6a3e700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275373918 0 0) 0x7f8ce01313c0 con 0x7f8ce0099a40 2023-10-03T10:15:19.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ccc0035b0 con 0x7f8ce0099a40 2023-10-03T10:15:19.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd7954b1700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000c00 tx=0x7fd78c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3523009439 0 0) 0x7f8ccc0035b0 con 0x7f8ce0099a40 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 msgr2=0x7f8ce0139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 msgr2=0x7f8ce0131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ce0131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00721a0 con 0x7f8ce0099a40 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f8cd0001670 con 0x7f8ce0099a40 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 >> v1:172.21.15.19:6789/0 conn(0x7f8ce0099a40 legacy=0x7f8ce0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ccc003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 0x7f8ccc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ccc004d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce006e8c0 con 0x7f8ccc003f80 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0071d20 con 0x7f8ce0131810 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc005320 con 0x7f8ce009a580 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce5a3c700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 0x7f8ccc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c004550 con 0x7fd79009d6f0 2023-10-03T10:15:19.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.821+0000 7f8ce6a3e700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ccc004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c01f070 con 0x7fd79009d6f0 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0038c0 con 0x7fd79009d6f0 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce623d700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ccc003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 -- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 msgr2=0x7f8ccc004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ccc004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 -- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 msgr2=0x7f8ccc003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ccc003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 -- 172.21.15.19:0/734088546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0035b0 con 0x7f8ccc003f80 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7f8ce5a3c700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 0x7f8ccc004850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c160 tx=0x7f8ccc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff78671675b60f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79009c710 con 0x7fd79009d6f0 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.822+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7901a6af0 con 0x7fd79009d6f0 2023-10-03T10:15:19.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.823+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0007b70 con 0x7f8ccc003f80 2023-10-03T10:15:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.823+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd000cd00 con 0x7f8ccc003f80 2023-10-03T10:15:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.823+0000 7f8ce523b700 1 -- 172.21.15.19:0/734088546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0005ba0 con 0x7f8ccc003f80 2023-10-03T10:15:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.823+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd78c003a20 con 0x7fd79009d6f0 2023-10-03T10:15:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.823+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd790074ea0 con 0x7fd79009d6f0 2023-10-03T10:15:19.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd78c021070 con 0x7fd79009d6f0 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 -- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 msgr2=0x7f8ccc004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 0x7f8ccc004850 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000c160 tx=0x7f8ccc005880 comp rx=0 tx=0).stop 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 -- 172.21.15.19:0/734088546 shutdown_connections 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ccc004d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ccc003f80 0x7f8ccc004850 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/734088546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ce0131810 0x7f8ccc003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 -- 172.21.15.19:0/734088546 >> 172.21.15.19:0/734088546 conn(0x7f8ce00a2aa0 msgr2=0x7f8ce00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 -- 172.21.15.19:0/734088546 shutdown_connections 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.824+0000 7f8ce84a1700 1 -- 172.21.15.19:0/734088546 wait complete. 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.825+0000 7f8ce84a1700 1 Processor -- start 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.825+0000 7f8ce84a1700 1 -- start start 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.825+0000 7f8ce84a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ccc003f80 0x7f8ce0119550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.825+0000 7f8ce84a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 0x7f8ce0119a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce84a1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0119fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce84a1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce011d9e0 con 0x7f8ce0099a40 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce84a1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce011d020 con 0x7f8ccc003f80 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce84a1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce011c360 con 0x7f8ce009a580 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce5a3c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 0x7f8ce0119a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0119fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce5a3c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 0x7f8ce0119a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34768/0 (socket says 172.21.15.19:34768) 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce5a3c700 1 -- 172.21.15.19:0/3788075798 learned_addr learned my addr 172.21.15.19:0/3788075798 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 -- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ccc003f80 msgr2=0x7f8ce0119550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ccc003f80 0x7f8ce0119550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 -- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 msgr2=0x7f8ce0119a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 0x7f8ce0119a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 -- 172.21.15.19:0/3788075798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00a1740 con 0x7f8ce009a580 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.826+0000 7f8ce6a3e700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0119fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011ca0 tx=0x7f8cd800f1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.827+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800e040 con 0x7f8ce009a580 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.827+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800f040 con 0x7f8ce009a580 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.827+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce006eb00 con 0x7f8ce009a580 2023-10-03T10:15:19.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.827+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800fa40 con 0x7f8ce009a580 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.827+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce011c7b0 con 0x7f8ce009a580 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.828+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0067c30 con 0x7f8ce009a580 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.828+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8cd800fba0 con 0x7f8ce009a580 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.829+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8cd801cc60 con 0x7f8ce009a580 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.829+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd78c015030 con 0x7fd79009d6f0 2023-10-03T10:15:19.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.833+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8cd8045060 con 0x7f8ce009a580 2023-10-03T10:15:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.858+0000 7fbc48c9d700 1 Processor -- start 2023-10-03T10:15:19.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.858+0000 7fbc48c9d700 1 -- start start 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc48c9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc4409d6f0 0x7fbc4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc48c9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 0x7fbc44130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc48c9d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4409f130 con 0x7fbc4409e000 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc48c9d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4409f520 con 0x7fbc4409d6f0 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc48c9d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4409e930 con 0x7fbc4409e410 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc41d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbc4409e000 0x7fbc44130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54676/0 (socket says 172.21.15.19:54676) 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc41d9b700 1 -- 172.21.15.19:0/874827965 learned_addr learned my addr 172.21.15.19:0/874827965 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc4259c700 1 --2- 172.21.15.19:0/874827965 >> v2:172.21.15.19:3300/0 conn(0x7fbc4409d6f0 0x7fbc4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc42d9d700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 0x7fbc44130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc4159a700 1 -- 172.21.15.19:0/874827965 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342985576 0 0) 0x7fbc4409f130 con 0x7fbc4409e000 2023-10-03T10:15:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.859+0000 7fbc4159a700 1 -- 172.21.15.19:0/874827965 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c0035b0 con 0x7fbc4409e000 2023-10-03T10:15:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4259c700 1 -- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 msgr2=0x7fbc44130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:19.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4259c700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 0x7fbc44130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4259c700 1 -- 172.21.15.19:0/874827965 >> v1:172.21.15.19:6789/0 conn(0x7fbc4409e000 legacy=0x7fbc44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4259c700 1 -- 172.21.15.19:0/874827965 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4409b2d0 con 0x7fbc4409d6f0 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc42d9d700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 0x7fbc44130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4259c700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409d6f0 0x7fbc4409dac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009840 tx=0x7fbc34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c937ca9b36d140b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4159a700 1 -- 172.21.15.19:0/874827965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011830 con 0x7fbc4409d6f0 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4159a700 1 -- 172.21.15.19:0/874827965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34011990 con 0x7fbc4409d6f0 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.860+0000 7fbc4159a700 1 -- 172.21.15.19:0/874827965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34011d20 con 0x7fbc4409d6f0 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 -- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409d6f0 msgr2=0x7fbc4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409d6f0 0x7fbc4409dac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fbc34009840 tx=0x7fbc34009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 -- 172.21.15.19:0/874827965 shutdown_connections 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409e410 0x7fbc44130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/874827965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409d6f0 0x7fbc4409dac0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 -- 172.21.15.19:0/874827965 >> 172.21.15.19:0/874827965 conn(0x7fbc44066f50 msgr2=0x7fbc4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 -- 172.21.15.19:0/874827965 shutdown_connections 2023-10-03T10:15:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.861+0000 7fbc48c9d700 1 -- 172.21.15.19:0/874827965 wait complete. 2023-10-03T10:15:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.863+0000 7fbc48c9d700 1 Processor -- start 2023-10-03T10:15:19.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.863+0000 7fbc48c9d700 1 -- start start 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 0x7fbc441c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409e410 0x7fbc441c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44131f50 con 0x7fbc4409e410 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4409c700 con 0x7fbc4409d6f0 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc48c9d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441321f0 con 0x7fbc4409e000 2023-10-03T10:15:19.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc41d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 0x7fbc441c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52086/0 (socket says 172.21.15.19:52086) 2023-10-03T10:15:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc4259c700 1 -- 172.21.15.19:0/3706537567 learned_addr learned my addr 172.21.15.19:0/3706537567 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:19.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.864+0000 7fbc42d9d700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409e410 0x7fbc441c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 -- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 msgr2=0x7fbc441c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 0x7fbc441c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 -- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409e410 msgr2=0x7fbc441c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409e410 0x7fbc441c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 -- 172.21.15.19:0/3706537567 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009a70 con 0x7fbc4409d6f0 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc41d9b700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 0x7fbc441c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc4259c700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc340090b0 tx=0x7fbc34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34004550 con 0x7fbc4409d6f0 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3401f070 con 0x7fbc4409d6f0 2023-10-03T10:15:19.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc340094a0 con 0x7fbc4409d6f0 2023-10-03T10:15:19.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc340038e0 con 0x7fbc4409d6f0 2023-10-03T10:15:19.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.865+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc44132f20 con 0x7fbc4409d6f0 2023-10-03T10:15:19.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.866+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc34003a40 con 0x7fbc4409d6f0 2023-10-03T10:15:19.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.867+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc44131290 con 0x7fbc4409d6f0 2023-10-03T10:15:19.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.867+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbc34021070 con 0x7fbc4409d6f0 2023-10-03T10:15:19.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:19.876+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc44131290 con 0x7fbc4409d6f0 2023-10-03T10:15:20.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.010+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff8341236b0 con 0x7ff83409e000 2023-10-03T10:15:20.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.010+0000 7ff822ffd700 1 -- 172.21.15.19:0/1914114008 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8341236b0 con 0x7ff83409e000 2023-10-03T10:15:20.011 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:20.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.013+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 msgr2=0x7ff834120550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.013+0000 7ff838d66700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 0x7ff834120550 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff8340a3e20 tx=0x7ff82800c750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.013+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 shutdown_connections 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.013+0000 7ff838d66700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff83409e410 0x7ff834120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.013+0000 7ff838d66700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff83409d6f0 0x7ff834120010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.014+0000 7ff838d66700 1 --2- 172.21.15.19:0/1914114008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff83409e000 0x7ff834120550 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.014+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 >> 172.21.15.19:0/1914114008 conn(0x7ff834066f50 msgr2=0x7ff834071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.014+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 shutdown_connections 2023-10-03T10:15:20.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.014+0000 7ff838d66700 1 -- 172.21.15.19:0/1914114008 wait complete. 2023-10-03T10:15:20.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.043+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ce011cbc0 con 0x7f8ce009a580 2023-10-03T10:15:20.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.044+0000 7f8cd6ffd700 1 -- 172.21.15.19:0/3788075798 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8cd8045020 con 0x7f8ce009a580 2023-10-03T10:15:20.045 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:20.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd79009f420 con 0x7fd79009d6f0 2023-10-03T10:15:20.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 msgr2=0x7f8ce0119fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0119fd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8011ca0 tx=0x7f8cd800f1b0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 shutdown_connections 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ce009a580 0x7f8ce0119fd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ccc003f80 0x7f8ce0119550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 --2- 172.21.15.19:0/3788075798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ce0099a40 0x7f8ce0119a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 >> 172.21.15.19:0/3788075798 conn(0x7f8ce00a2aa0 msgr2=0x7f8ce012e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7fd785ffb700 1 -- 172.21.15.19:0/2594204767 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd78c015070 con 0x7fd79009d6f0 2023-10-03T10:15:20.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.046+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 shutdown_connections 2023-10-03T10:15:20.049 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:20.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.047+0000 7f8ce84a1700 1 -- 172.21.15.19:0/3788075798 wait complete. 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 msgr2=0x7fd7901c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd78c000c00 tx=0x7fd78c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 shutdown_connections 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd79009e440 0x7fd7901c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd79009d6f0 0x7fd7901c7fb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 --2- 172.21.15.19:0/2594204767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd79009e000 0x7fd7901c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 >> 172.21.15.19:0/2594204767 conn(0x7fd790066f50 msgr2=0x7fd7901bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 shutdown_connections 2023-10-03T10:15:20.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.049+0000 7fd797715700 1 -- 172.21.15.19:0/2594204767 wait complete. 2023-10-03T10:15:20.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:20.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:20.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.095+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbc44131290 con 0x7fbc4409d6f0 2023-10-03T10:15:20.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.095+0000 7fbc32ffd700 1 -- 172.21.15.19:0/3706537567 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc44131290 con 0x7fbc4409d6f0 2023-10-03T10:15:20.096 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:20.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 msgr2=0x7fbc4412f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:20.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbc340090b0 tx=0x7fbc34004750 comp rx=0 tx=0).stop 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 shutdown_connections 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc4409e410 0x7fbc441c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc4409d6f0 0x7fbc4412f890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 --2- 172.21.15.19:0/3706537567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc4409e000 0x7fbc441c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 >> 172.21.15.19:0/3706537567 conn(0x7fbc44066f50 msgr2=0x7fbc44070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 shutdown_connections 2023-10-03T10:15:20.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:20.097+0000 7fbc48c9d700 1 -- 172.21.15.19:0/3706537567 wait complete. 2023-10-03T10:15:20.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:21.034 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:21.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:21.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:21.112 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.187+0000 7f528fd0e700 1 Processor -- start 2023-10-03T10:15:21.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.187+0000 7f528fd0e700 1 -- start start 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 0x7f528809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f528813c1e0 0x7f528813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528806ab40 con 0x7f528813c1e0 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528809ebc0 con 0x7f528806a770 2023-10-03T10:15:21.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528fd0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f528809a810 con 0x7f528809dc30 2023-10-03T10:15:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528d2a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528d2a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34082/0 (socket says 172.21.15.19:34082) 2023-10-03T10:15:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528d2a9700 1 -- 172.21.15.19:0/3808222578 learned_addr learned my addr 172.21.15.19:0/3808222578 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528daaa700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 0x7f528809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528e2ab700 1 --2- 172.21.15.19:0/3808222578 >> v2:172.21.15.19:3300/0 conn(0x7f528813c1e0 0x7f528813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.188+0000 7f528d2a9700 1 -- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 msgr2=0x7f528809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528d2a9700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 0x7f528809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528d2a9700 1 -- 172.21.15.19:0/3808222578 >> v2:172.21.15.19:3300/0 conn(0x7f528813c1e0 msgr2=0x7f528813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528d2a9700 1 --2- 172.21.15.19:0/3808222578 >> v2:172.21.15.19:3300/0 conn(0x7f528813c1e0 0x7f528813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528d2a9700 1 -- 172.21.15.19:0/3808222578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528809e920 con 0x7f528809dc30 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528daaa700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 0x7f528809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528d2a9700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5278009920 tx=0x7f5278009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0e237f8440ac7e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528caa8700 1 -- 172.21.15.19:0/3808222578 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011830 con 0x7f528809dc30 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528caa8700 1 -- 172.21.15.19:0/3808222578 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278011990 con 0x7f528809dc30 2023-10-03T10:15:21.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.189+0000 7f528caa8700 1 -- 172.21.15.19:0/3808222578 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278011d20 con 0x7f528809dc30 2023-10-03T10:15:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 -- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 msgr2=0x7f528809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5278009920 tx=0x7f5278009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 -- 172.21.15.19:0/3808222578 shutdown_connections 2023-10-03T10:15:21.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528806a770 0x7f528809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 --2- 172.21.15.19:0/3808222578 >> v2:172.21.15.19:3300/0 conn(0x7f528813c1e0 0x7f528813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 --2- 172.21.15.19:0/3808222578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528809dc30 0x7f528809e080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 -- 172.21.15.19:0/3808222578 >> 172.21.15.19:0/3808222578 conn(0x7f5288066f50 msgr2=0x7f528809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 -- 172.21.15.19:0/3808222578 shutdown_connections 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.190+0000 7f528fd0e700 1 -- 172.21.15.19:0/3808222578 wait complete. 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.191+0000 7f528fd0e700 1 Processor -- start 2023-10-03T10:15:21.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.191+0000 7f528fd0e700 1 -- start start 2023-10-03T10:15:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528809dc30 0x7f528813a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f528813c1e0 0x7f528813aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528811fdc0 con 0x7f528813c1e0 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528811ffa0 con 0x7f528809dc30 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528fd0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f528811f2e0 con 0x7f528806a770 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34098/0 (socket says 172.21.15.19:34098) 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 -- 172.21.15.19:0/1516145413 learned_addr learned my addr 172.21.15.19:0/1516145413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528d2a9700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528809dc30 0x7f528813a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528e2ab700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f528813c1e0 0x7f528813aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 -- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528809dc30 msgr2=0x7f528813a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528809dc30 0x7f528813a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 -- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f528813c1e0 msgr2=0x7f528813aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f528813c1e0 0x7f528813aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.192+0000 7f528daaa700 1 -- 172.21.15.19:0/1516145413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840094a0 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f528daaa700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f528400ec40 tx=0x7f528400ef50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400c850 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528400c9b0 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5278009550 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528400cd20 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.193+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f528811cdb0 con 0x7f528806a770 2023-10-03T10:15:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.194+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5284013470 con 0x7f528806a770 2023-10-03T10:15:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.194+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f528403f7f0 con 0x7f528806a770 2023-10-03T10:15:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.194+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528811fbe0 con 0x7f528806a770 2023-10-03T10:15:21.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.199+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5284017080 con 0x7f528806a770 2023-10-03T10:15:21.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.226+0000 7f72e4745700 1 Processor -- start 2023-10-03T10:15:21.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.226+0000 7f72e4745700 1 -- start start 2023-10-03T10:15:21.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e4745700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e4745700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72dc139170 0x7f72dc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e4745700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72dc09b120 con 0x7f72dc09d6f0 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e4745700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72dc06b460 con 0x7f72dc139170 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e4745700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc09a7e0 con 0x7f72dc09e1d0 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e1ce0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e1ce0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34108/0 (socket says 172.21.15.19:34108) 2023-10-03T10:15:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e24e1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f72dc09d6f0 0x7f72dc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54682/0 (socket says 172.21.15.19:54682) 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e1ce0700 1 -- 172.21.15.19:0/1657833350 learned_addr learned my addr 172.21.15.19:0/1657833350 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.227+0000 7f72e2ce2700 1 --2- 172.21.15.19:0/1657833350 >> v2:172.21.15.19:3300/0 conn(0x7f72dc139170 0x7f72dc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e1ce0700 1 -- 172.21.15.19:0/1657833350 >> v2:172.21.15.19:3300/0 conn(0x7f72dc139170 msgr2=0x7f72dc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e1ce0700 1 --2- 172.21.15.19:0/1657833350 >> v2:172.21.15.19:3300/0 conn(0x7f72dc139170 0x7f72dc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e1ce0700 1 -- 172.21.15.19:0/1657833350 >> v1:172.21.15.19:6789/0 conn(0x7f72dc09d6f0 legacy=0x7f72dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e1ce0700 1 -- 172.21.15.19:0/1657833350 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72dc09a500 con 0x7f72dc09e1d0 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e1ce0700 1 --2- 172.21.15.19:0/1657833350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009920 tx=0x7f72cc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25c9d18f32cfef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e14df700 1 -- 172.21.15.19:0/1657833350 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011830 con 0x7f72dc09e1d0 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e14df700 1 -- 172.21.15.19:0/1657833350 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc011990 con 0x7f72dc09e1d0 2023-10-03T10:15:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.228+0000 7f72e14df700 1 -- 172.21.15.19:0/1657833350 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc011d20 con 0x7f72dc09e1d0 2023-10-03T10:15:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 -- 172.21.15.19:0/1657833350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 msgr2=0x7f72dc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 --2- 172.21.15.19:0/1657833350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009920 tx=0x7f72cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 -- 172.21.15.19:0/1657833350 shutdown_connections 2023-10-03T10:15:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 --2- 172.21.15.19:0/1657833350 >> v2:172.21.15.19:3300/0 conn(0x7f72dc139170 0x7f72dc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 --2- 172.21.15.19:0/1657833350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc09e1d0 0x7f72dc138c30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 -- 172.21.15.19:0/1657833350 >> 172.21.15.19:0/1657833350 conn(0x7f72dc066f50 msgr2=0x7f72dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 -- 172.21.15.19:0/1657833350 shutdown_connections 2023-10-03T10:15:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.229+0000 7f72e4745700 1 -- 172.21.15.19:0/1657833350 wait complete. 2023-10-03T10:15:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.230+0000 7f72e4745700 1 Processor -- start 2023-10-03T10:15:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.230+0000 7f72e4745700 1 -- start start 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 0x7f72dc11e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc139170 0x7f72dc11f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1341c0 con 0x7f72dc09d6f0 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc120540 con 0x7f72dc09e1d0 2023-10-03T10:15:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e4745700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72dc1220d0 con 0x7f72dc139170 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e24e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 0x7f72dc11e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e2ce2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc139170 0x7f72dc11f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52116/0 (socket says 172.21.15.19:52116) 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 -- 172.21.15.19:0/656282433 learned_addr learned my addr 172.21.15.19:0/656282433 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e24e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 0x7f72dc11e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34824/0 (socket says 172.21.15.19:34824) 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 -- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc139170 msgr2=0x7f72dc11f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc139170 0x7f72dc11f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.231+0000 7f72e1ce0700 1 -- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 msgr2=0x7f72dc11e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72e1ce0700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 0x7f72dc11e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72e1ce0700 1 -- 172.21.15.19:0/656282433 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc009550 con 0x7f72dc09e1d0 2023-10-03T10:15:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72e1ce0700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc004300 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc01f070 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc0036a0 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72dc0a2190 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.232+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72dc122b40 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.233+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72dc074ea0 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.233+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72cc021030 con 0x7f72dc09e1d0 2023-10-03T10:15:21.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.233+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72cc019570 con 0x7f72dc09e1d0 2023-10-03T10:15:21.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.242+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72cc00b9d0 con 0x7f72dc09e1d0 2023-10-03T10:15:21.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.243+0000 7ff538f05700 1 Processor -- start 2023-10-03T10:15:21.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.243+0000 7ff538f05700 1 -- start start 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.243+0000 7ff538f05700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff53409de00 0x7ff53409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff538f05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff538f05700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53409a810 con 0x7ff53406a770 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff538f05700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53406ab40 con 0x7ff53409de00 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff538f05700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53409ebc0 con 0x7ff53413d1f0 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff53409de00 0x7ff53409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff53259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff53406a770 0x7ff53409d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54692/0 (socket says 172.21.15.19:54692) 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff53259c700 1 -- 172.21.15.19:0/891121385 learned_addr learned my addr 172.21.15.19:0/891121385 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:21.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff532d9d700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 -- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 msgr2=0x7ff53413f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 -- 172.21.15.19:0/891121385 >> v1:172.21.15.19:6789/0 conn(0x7ff53406a770 legacy=0x7ff53409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 -- 172.21.15.19:0/891121385 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53409e920 con 0x7ff53409de00 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff53159a700 1 -- 172.21.15.19:0/891121385 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144324204 0 0) 0x7ff53409a810 con 0x7ff53406a770 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff532d9d700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.244+0000 7ff531d9b700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53409e250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff528009840 tx=0x7ff528009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f047417c6b1f6c17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.245+0000 7ff53159a700 1 -- 172.21.15.19:0/891121385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528011830 con 0x7ff53409de00 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.245+0000 7ff53159a700 1 -- 172.21.15.19:0/891121385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff528011990 con 0x7ff53409de00 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.245+0000 7ff53159a700 1 -- 172.21.15.19:0/891121385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528011d20 con 0x7ff53409de00 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 -- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 msgr2=0x7ff53409e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53409e250 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff528009840 tx=0x7ff528009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 -- 172.21.15.19:0/891121385 shutdown_connections 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 --2- 172.21.15.19:0/891121385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53409e250 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 -- 172.21.15.19:0/891121385 >> 172.21.15.19:0/891121385 conn(0x7ff534066f50 msgr2=0x7ff53409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 -- 172.21.15.19:0/891121385 shutdown_connections 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.246+0000 7ff538f05700 1 -- 172.21.15.19:0/891121385 wait complete. 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 Processor -- start 2023-10-03T10:15:21.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 -- start start 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53406a770 0x7ff53411c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53413b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534135c50 con 0x7ff53409de00 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53411cf70 con 0x7ff53413d1f0 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.248+0000 7ff538f05700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53411e8e0 con 0x7ff53406a770 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff532d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff532d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52132/0 (socket says 172.21.15.19:52132) 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff532d9d700 1 -- 172.21.15.19:0/901559977 learned_addr learned my addr 172.21.15.19:0/901559977 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53413b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 -- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53406a770 msgr2=0x7ff53411c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53406a770 0x7ff53411c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 -- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 msgr2=0x7ff53413ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 -- 172.21.15.19:0/901559977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280094a0 con 0x7ff53409de00 2023-10-03T10:15:21.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff532d9d700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.249+0000 7ff531d9b700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53413b510 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff528016000 tx=0x7ff528004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.250+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280036a0 con 0x7ff53409de00 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.250+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52801f070 con 0x7ff53409de00 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.250+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528003a20 con 0x7ff53409de00 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.250+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53413cc80 con 0x7ff53409de00 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.250+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53411e290 con 0x7ff53409de00 2023-10-03T10:15:21.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.251+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff534074ea0 con 0x7ff53409de00 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.252+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff528003b80 con 0x7ff53409de00 2023-10-03T10:15:21.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.252+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff528021070 con 0x7ff53409de00 2023-10-03T10:15:21.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.261+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff52802f970 con 0x7ff53409de00 2023-10-03T10:15:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.275+0000 7fa5c8b7b700 1 Processor -- start 2023-10-03T10:15:21.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.275+0000 7fa5c8b7b700 1 -- start start 2023-10-03T10:15:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c8b7b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5c41337f0 0x7fa5c4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c8b7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4138dc0 0x7fa5c413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c8b7b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c406b990 con 0x7fa5c4133420 2023-10-03T10:15:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c8b7b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c409b0e0 con 0x7fa5c41337f0 2023-10-03T10:15:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c8b7b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4133c20 con 0x7fa5c4138dc0 2023-10-03T10:15:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5c41337f0 0x7fa5c4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa5c41337f0 0x7fa5c4138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34864/0 (socket says 172.21.15.19:34864) 2023-10-03T10:15:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.276+0000 7fa5c1d9b700 1 -- 172.21.15.19:0/3686184221 learned_addr learned my addr 172.21.15.19:0/3686184221 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c2d9d700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4138dc0 0x7fa5c413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c1d9b700 1 -- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4138dc0 msgr2=0x7fa5c413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c1d9b700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4138dc0 0x7fa5c413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c1d9b700 1 -- 172.21.15.19:0/3686184221 >> v1:172.21.15.19:6789/0 conn(0x7fa5c4133420 legacy=0x7fa5c4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c1d9b700 1 -- 172.21.15.19:0/3686184221 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c40a0590 con 0x7fa5c41337f0 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c1d9b700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c41337f0 0x7fa5c4138880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098f0 tx=0x7fa5b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a4dc987c8c35b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c159a700 1 -- 172.21.15.19:0/3686184221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011830 con 0x7fa5c41337f0 2023-10-03T10:15:21.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c159a700 1 -- 172.21.15.19:0/3686184221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b8011990 con 0x7fa5c41337f0 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.277+0000 7fa5c159a700 1 -- 172.21.15.19:0/3686184221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8011d20 con 0x7fa5c41337f0 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c41337f0 msgr2=0x7fa5c4138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c41337f0 0x7fa5c4138880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098f0 tx=0x7fa5b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3686184221 shutdown_connections 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4138dc0 0x7fa5c413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3686184221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c41337f0 0x7fa5c4138880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3686184221 >> 172.21.15.19:0/3686184221 conn(0x7fa5c40a4210 msgr2=0x7fa5c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3686184221 shutdown_connections 2023-10-03T10:15:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.278+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3686184221 wait complete. 2023-10-03T10:15:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.280+0000 7fa5c8b7b700 1 Processor -- start 2023-10-03T10:15:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.280+0000 7fa5c8b7b700 1 -- start start 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4133420 0x7fa5c412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5c41337f0 0x7fa5c412f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c409d9b0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c41388a0 con 0x7fa5c41337f0 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c8b7b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c409c590 con 0x7fa5c4133420 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34874/0 (socket says 172.21.15.19:34874) 2023-10-03T10:15:21.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 -- 172.21.15.19:0/3041260635 learned_addr learned my addr 172.21.15.19:0/3041260635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 -- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4133420 msgr2=0x7fa5c412ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4133420 0x7fa5c412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 -- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5c41337f0 msgr2=0x7fa5c412f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5c41337f0 0x7fa5c412f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.281+0000 7fa5c2d9d700 1 -- 172.21.15.19:0/3041260635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009550 con 0x7fa5c4138dc0 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5c2d9d700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00efc0 tx=0x7fa5bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:21.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00cd40 con 0x7fa5c4138dc0 2023-10-03T10:15:21.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc00f040 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc00cea0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c409b6b0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.282+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c409d2d0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.283+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c409ffb0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.283+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa5bc0146c0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.284+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa5bc0403b0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.289+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa5bc007920 con 0x7fa5c4138dc0 2023-10-03T10:15:21.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.437+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5288074ea0 con 0x7f528806a770 2023-10-03T10:15:21.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.438+0000 7f527e7fc700 1 -- 172.21.15.19:0/1516145413 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5284013720 con 0x7f528806a770 2023-10-03T10:15:21.439 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:21.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 msgr2=0x7f528813b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f528400ec40 tx=0x7f528400ef50 comp rx=0 tx=0).stop 2023-10-03T10:15:21.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 shutdown_connections 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f528813c1e0 0x7f528813aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f528806a770 0x7f528813b930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 --2- 172.21.15.19:0/1516145413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f528809dc30 0x7f528813a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 >> 172.21.15.19:0/1516145413 conn(0x7f5288066f50 msgr2=0x7f528813c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.440+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 shutdown_connections 2023-10-03T10:15:21.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.441+0000 7f528fd0e700 1 -- 172.21.15.19:0/1516145413 wait complete. 2023-10-03T10:15:21.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:21.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.456+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72dc09c690 con 0x7f72dc09e1d0 2023-10-03T10:15:21.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.457+0000 7f72d2ffd700 1 -- 172.21.15.19:0/656282433 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72cc041020 con 0x7f72dc09e1d0 2023-10-03T10:15:21.458 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 msgr2=0x7f72dc11edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009870 tx=0x7f72cc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 shutdown_connections 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72dc139170 0x7f72dc11f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72dc09d6f0 0x7f72dc11e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 --2- 172.21.15.19:0/656282433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72dc09e1d0 0x7f72dc11edd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 >> 172.21.15.19:0/656282433 conn(0x7f72dc066f50 msgr2=0x7f72dc136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 shutdown_connections 2023-10-03T10:15:21.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.460+0000 7f72e4745700 1 -- 172.21.15.19:0/656282433 wait complete. 2023-10-03T10:15:21.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.478+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff53411e290 con 0x7ff53409de00 2023-10-03T10:15:21.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.479+0000 7ff522ffd700 1 -- 172.21.15.19:0/901559977 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff53411e290 con 0x7ff53409de00 2023-10-03T10:15:21.480 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:21.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:21.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 msgr2=0x7ff53413b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53413b510 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ff528016000 tx=0x7ff528004750 comp rx=0 tx=0).stop 2023-10-03T10:15:21.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 shutdown_connections 2023-10-03T10:15:21.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53413d1f0 0x7ff53413ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53406a770 0x7ff53411c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 --2- 172.21.15.19:0/901559977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53409de00 0x7ff53413b510 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 >> 172.21.15.19:0/901559977 conn(0x7ff534066f50 msgr2=0x7ff53409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 shutdown_connections 2023-10-03T10:15:21.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.481+0000 7ff538f05700 1 -- 172.21.15.19:0/901559977 wait complete. 2023-10-03T10:15:21.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:21.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.508+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa5c4074ea0 con 0x7fa5c4138dc0 2023-10-03T10:15:21.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.509+0000 7fa5b2ffd700 1 -- 172.21.15.19:0/3041260635 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa5bc007330 con 0x7fa5c4138dc0 2023-10-03T10:15:21.510 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 msgr2=0x7fa5c412f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00efc0 tx=0x7fa5bc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 shutdown_connections 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa5c4138dc0 0x7fa5c412f8d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa5c4133420 0x7fa5c412ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 --2- 172.21.15.19:0/3041260635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa5c41337f0 0x7fa5c412f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 >> 172.21.15.19:0/3041260635 conn(0x7fa5c40a4210 msgr2=0x7fa5c4131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 shutdown_connections 2023-10-03T10:15:21.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:21.511+0000 7fa5c8b7b700 1 -- 172.21.15.19:0/3041260635 wait complete. 2023-10-03T10:15:21.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:22.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:22.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:22.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:22.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:22.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.611+0000 7f9b40b49700 1 Processor -- start 2023-10-03T10:15:22.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.611+0000 7f9b40b49700 1 -- start start 2023-10-03T10:15:22.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b40b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 0x7f9b3c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b40b49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9b3c06f050 0x7f9b3c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b40b49700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3c070ee0 con 0x7f9b3c06e570 2023-10-03T10:15:22.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b40b49700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3c071980 con 0x7f9b3c06f050 2023-10-03T10:15:22.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b40b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c071480 con 0x7f9b3c09eca0 2023-10-03T10:15:22.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b39d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 0x7f9b3c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b3a59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9b3c06e570 0x7f9b3c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54708/0 (socket says 172.21.15.19:54708) 2023-10-03T10:15:22.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.612+0000 7f9b3a59c700 1 -- 172.21.15.19:0/1138480746 learned_addr learned my addr 172.21.15.19:0/1138480746 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:22.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b3ad9d700 1 --2- 172.21.15.19:0/1138480746 >> v2:172.21.15.19:3300/0 conn(0x7f9b3c06f050 0x7f9b3c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b39d9b700 1 -- 172.21.15.19:0/1138480746 >> v2:172.21.15.19:3300/0 conn(0x7f9b3c06f050 msgr2=0x7f9b3c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b39d9b700 1 --2- 172.21.15.19:0/1138480746 >> v2:172.21.15.19:3300/0 conn(0x7f9b3c06f050 0x7f9b3c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b39d9b700 1 -- 172.21.15.19:0/1138480746 >> v1:172.21.15.19:6789/0 conn(0x7f9b3c06e570 legacy=0x7f9b3c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b39d9b700 1 -- 172.21.15.19:0/1138480746 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c071b90 con 0x7f9b3c09eca0 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b39d9b700 1 --2- 172.21.15.19:0/1138480746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 0x7f9b3c13cea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009840 tx=0x7f9b30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a0b4c462f4e3760 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b3959a700 1 -- 172.21.15.19:0/1138480746 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011830 con 0x7f9b3c09eca0 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b3959a700 1 -- 172.21.15.19:0/1138480746 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b30011990 con 0x7f9b3c09eca0 2023-10-03T10:15:22.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.613+0000 7f9b3959a700 1 -- 172.21.15.19:0/1138480746 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b30011d20 con 0x7f9b3c09eca0 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.614+0000 7f9b40b49700 1 -- 172.21.15.19:0/1138480746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 msgr2=0x7f9b3c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.614+0000 7f9b40b49700 1 --2- 172.21.15.19:0/1138480746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 0x7f9b3c13cea0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009840 tx=0x7f9b30009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 -- 172.21.15.19:0/1138480746 shutdown_connections 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 --2- 172.21.15.19:0/1138480746 >> v2:172.21.15.19:3300/0 conn(0x7f9b3c06f050 0x7f9b3c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 --2- 172.21.15.19:0/1138480746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c09eca0 0x7f9b3c13cea0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 -- 172.21.15.19:0/1138480746 >> 172.21.15.19:0/1138480746 conn(0x7f9b3c0a2aa0 msgr2=0x7f9b3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 -- 172.21.15.19:0/1138480746 shutdown_connections 2023-10-03T10:15:22.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.615+0000 7f9b40b49700 1 -- 172.21.15.19:0/1138480746 wait complete. 2023-10-03T10:15:22.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 Processor -- start 2023-10-03T10:15:22.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 -- start start 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c06e570 0x7f9b3c13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 0x7f9b3c13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.616+0000 7f9b40b49700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c12d4b0 con 0x7f9b3c12e140 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b40b49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c13e010 con 0x7f9b3c06f050 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b40b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3c12c0b0 con 0x7f9b3c06e570 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34898/0 (socket says 172.21.15.19:34898) 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c06e570 0x7f9b3c13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 -- 172.21.15.19:0/774253440 learned_addr learned my addr 172.21.15.19:0/774253440 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:22.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b39d9b700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 0x7f9b3c13d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 -- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c06e570 msgr2=0x7f9b3c13cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c06e570 0x7f9b3c13cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 -- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 msgr2=0x7f9b3c13d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 0x7f9b3c13d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 -- 172.21.15.19:0/774253440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b300094a0 con 0x7f9b3c12e140 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b39d9b700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 0x7f9b3c13d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.617+0000 7f9b3ad9d700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400efc0 tx=0x7f9b3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.618+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34009ea0 con 0x7f9b3c12e140 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.618+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3400f040 con 0x7f9b3c12e140 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.618+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b34014480 con 0x7f9b3c12e140 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.618+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3c070610 con 0x7f9b3c12e140 2023-10-03T10:15:22.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.618+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3c12d960 con 0x7f9b3c12e140 2023-10-03T10:15:22.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.619+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b340145e0 con 0x7f9b3c12e140 2023-10-03T10:15:22.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.619+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3c071220 con 0x7f9b3c12e140 2023-10-03T10:15:22.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.619+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b340401f0 con 0x7f9b3c12e140 2023-10-03T10:15:22.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.628+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b34018030 con 0x7f9b3c12e140 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.654+0000 7f65ca3fd700 1 Processor -- start 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.654+0000 7f65ca3fd700 1 -- start start 2023-10-03T10:15:22.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65ca3fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65c412cf60 0x7f65c406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65ca3fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65ca3fd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c412cd90 con 0x7f65c412f8b0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65ca3fd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c412d330 con 0x7f65c412cf60 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65ca3fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c4071780 con 0x7f65c4130430 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f65c412f8b0 0x7f65c412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54712/0 (socket says 172.21.15.19:54712) 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c37fe700 1 -- 172.21.15.19:0/2090976291 learned_addr learned my addr 172.21.15.19:0/2090976291 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c3fff700 1 --2- 172.21.15.19:0/2090976291 >> v2:172.21.15.19:3300/0 conn(0x7f65c412cf60 0x7f65c406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c3fff700 1 -- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 msgr2=0x7f65c4137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c3fff700 1 --2- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c3fff700 1 -- 172.21.15.19:0/2090976291 >> v1:172.21.15.19:6789/0 conn(0x7f65c412f8b0 legacy=0x7f65c412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.655+0000 7f65c3fff700 1 -- 172.21.15.19:0/2090976291 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c4071a40 con 0x7f65c412cf60 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7fe1dee7c700 1 Processor -- start 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7f65c3fff700 1 --2- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412cf60 0x7f65c406f5d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f65b400a950 tx=0x7f65b400ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d791bc30e370e6c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7fe1dee7c700 1 -- start start 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7f65c2ffd700 1 -- 172.21.15.19:0/2090976291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400aea0 con 0x7f65c412cf60 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dee7c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d806f5d0 0x7fe1d812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dee7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d8135c20 0x7fe1d8138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dee7c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d806fa40 con 0x7fe1d812cf60 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dee7c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d812cd90 con 0x7fe1d806f5d0 2023-10-03T10:15:22.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dee7c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8071780 con 0x7fe1d8135c20 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7f65c2ffd700 1 -- 172.21.15.19:0/2090976291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b400ca60 con 0x7f65c412cf60 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.656+0000 7f65c2ffd700 1 -- 172.21.15.19:0/2090976291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b400cdf0 con 0x7f65c412cf60 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 -- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412cf60 msgr2=0x7f65c406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 --2- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412cf60 0x7f65c406f5d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f65b400a950 tx=0x7f65b400ac60 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d806f5d0 0x7fe1d812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dcc18700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe1d812cf60 0x7fe1d812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54716/0 (socket says 172.21.15.19:54716) 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d806f5d0 0x7fe1d812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34908/0 (socket says 172.21.15.19:34908) 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dcc18700 1 -- 172.21.15.19:0/4134483943 learned_addr learned my addr 172.21.15.19:0/4134483943 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1dd419700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d8135c20 0x7fe1d8138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 -- 172.21.15.19:0/2090976291 shutdown_connections 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 --2- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c4137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 --2- 172.21.15.19:0/2090976291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412cf60 0x7f65c406f5d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 -- 172.21.15.19:0/2090976291 >> 172.21.15.19:0/2090976291 conn(0x7f65c40a2aa0 msgr2=0x7f65c40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 -- 172.21.15.19:0/2090976291 shutdown_connections 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 -- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d8135c20 msgr2=0x7fe1d8138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d8135c20 0x7fe1d8138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 -- 172.21.15.19:0/4134483943 >> v1:172.21.15.19:6789/0 conn(0x7fe1d812cf60 legacy=0x7fe1d812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d77fe700 1 -- 172.21.15.19:0/4134483943 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712870229 0 0) 0x7fe1d806fa40 con 0x7fe1d812cf60 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7fe1d7fff700 1 -- 172.21.15.19:0/4134483943 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d8071a40 con 0x7fe1d806f5d0 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.657+0000 7f65ca3fd700 1 -- 172.21.15.19:0/2090976291 wait complete. 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.658+0000 7fe1d7fff700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d812ffc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400bae0 tx=0x7fe1c400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76ae6bb18fc2291 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.658+0000 7fe1d77fe700 1 -- 172.21.15.19:0/4134483943 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400db60 con 0x7fe1d806f5d0 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.658+0000 7fe1d77fe700 1 -- 172.21.15.19:0/4134483943 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400dcc0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.658+0000 7fe1d77fe700 1 -- 172.21.15.19:0/4134483943 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c4017630 con 0x7fe1d806f5d0 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.658+0000 7f65ca3fd700 1 Processor -- start 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 -- start start 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 -- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 msgr2=0x7fe1d812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d812ffc0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe1c400bae0 tx=0x7fe1c400bdf0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 -- 172.21.15.19:0/4134483943 shutdown_connections 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d8135c20 0x7fe1d8138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/4134483943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d812ffc0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 -- 172.21.15.19:0/4134483943 >> 172.21.15.19:0/4134483943 conn(0x7fe1d80a2aa0 msgr2=0x7fe1d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 -- 172.21.15.19:0/4134483943 shutdown_connections 2023-10-03T10:15:22.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7fe1dee7c700 1 -- 172.21.15.19:0/4134483943 wait complete. 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c412cf60 0x7f65c41c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c409afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c41b8e30 con 0x7f65c412f8b0 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c409e510 con 0x7f65c4130430 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.659+0000 7f65ca3fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65c412f460 con 0x7f65c412cf60 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34918/0 (socket says 172.21.15.19:34918) 2023-10-03T10:15:22.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 -- 172.21.15.19:0/1137304397 learned_addr learned my addr 172.21.15.19:0/1137304397 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c3fff700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c412cf60 0x7f65c41c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c899a700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c409afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 -- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c412cf60 msgr2=0x7f65c41c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c412cf60 0x7f65c41c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 -- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 msgr2=0x7f65c409afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c409afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 -- 172.21.15.19:0/1137304397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b400a5b0 con 0x7f65c412f8b0 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.660+0000 7f65c37fe700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f65b800c520 tx=0x7f65b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8005d70 con 0x7f65c412f8b0 2023-10-03T10:15:22.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7fe1dee7c700 1 Processor -- start 2023-10-03T10:15:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b80070d0 con 0x7f65c412f8b0 2023-10-03T10:15:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7f65ca3fd700 1 -- 172.21.15.19:0/1137304397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c4129fa0 con 0x7f65c412f8b0 2023-10-03T10:15:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8007440 con 0x7f65c412f8b0 2023-10-03T10:15:22.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7f65ca3fd700 1 -- 172.21.15.19:0/1137304397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c4119040 con 0x7f65c412f8b0 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.661+0000 7fe1dee7c700 1 -- start start 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d812cf60 0x7fe1d81c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 0x7fe1d81c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8128c70 con 0x7fe1d806f5d0 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8119090 con 0x7fe1d812cf60 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dee7c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d80a22a0 con 0x7fe1d8135c20 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34926/0 (socket says 172.21.15.19:34926) 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 -- 172.21.15.19:0/3104346430 learned_addr learned my addr 172.21.15.19:0/3104346430 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:22.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1d7fff700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d812cf60 0x7fe1d81c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dd419700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 0x7fe1d81c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 -- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 msgr2=0x7fe1d81c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 0x7fe1d81c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 -- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d812cf60 msgr2=0x7fe1d81c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d812cf60 0x7fe1d81c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dcc18700 1 -- 172.21.15.19:0/3104346430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c400b740 con 0x7fe1d806f5d0 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.662+0000 7fe1dd419700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 0x7fe1d81c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1dcc18700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c520 tx=0x7fe1cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c4074ea0 con 0x7f65c412f8b0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc004c80 con 0x7fe1d806f5d0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc004de0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc007310 con 0x7fe1d806f5d0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65b80075a0 con 0x7f65c412f8b0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8119880 con 0x7fe1d806f5d0 2023-10-03T10:15:22.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d809e160 con 0x7fe1d806f5d0 2023-10-03T10:15:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.663+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65b803eb30 con 0x7f65c412f8b0 2023-10-03T10:15:22.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.664+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b80052e0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.672+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65b8019d20 con 0x7f65c412f8b0 2023-10-03T10:15:22.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.673+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1cc007470 con 0x7fe1d806f5d0 2023-10-03T10:15:22.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.673+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1cc03f9e0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.682+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1cc0133c0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.705+0000 7f494d343700 1 Processor -- start 2023-10-03T10:15:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.705+0000 7f494d343700 1 -- start start 2023-10-03T10:15:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.706+0000 7f494d343700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.706+0000 7f494d343700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4948134ec0 0x7f49481379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.706+0000 7f494d343700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4948134980 con 0x7f4948137f20 2023-10-03T10:15:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.706+0000 7f494d343700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494806c4b0 con 0x7f4948134ec0 2023-10-03T10:15:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.706+0000 7f494d343700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480a09c0 con 0x7f494806c0e0 2023-10-03T10:15:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f4946ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4948134ec0 0x7f49481379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f49477fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4948137f20 0x7f494813ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54720/0 (socket says 172.21.15.19:54720) 2023-10-03T10:15:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f49477fe700 1 -- 172.21.15.19:0/1157436411 learned_addr learned my addr 172.21.15.19:0/1157436411 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 -- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 msgr2=0x7f494809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 -- 172.21.15.19:0/1157436411 >> v1:172.21.15.19:6789/0 conn(0x7f4948137f20 legacy=0x7f494813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 -- 172.21.15.19:0/1157436411 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480a0600 con 0x7f4948134ec0 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f4946ffd700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f49467fc700 1 -- 172.21.15.19:0/1157436411 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606268468 0 0) 0x7f4948134980 con 0x7f4948137f20 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f493ffff700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948134ec0 0x7f49481379e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4930009840 tx=0x7f4930009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b2c92b02a0e867 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.707+0000 7f49467fc700 1 -- 172.21.15.19:0/1157436411 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930011830 con 0x7f4948134ec0 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.708+0000 7f49467fc700 1 -- 172.21.15.19:0/1157436411 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4930011990 con 0x7f4948134ec0 2023-10-03T10:15:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.708+0000 7f49467fc700 1 -- 172.21.15.19:0/1157436411 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930011d20 con 0x7f4948134ec0 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 -- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948134ec0 msgr2=0x7f49481379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948134ec0 0x7f49481379e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4930009840 tx=0x7f4930009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 -- 172.21.15.19:0/1157436411 shutdown_connections 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 --2- 172.21.15.19:0/1157436411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948134ec0 0x7f49481379e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 -- 172.21.15.19:0/1157436411 >> 172.21.15.19:0/1157436411 conn(0x7f49480a4210 msgr2=0x7f49480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 -- 172.21.15.19:0/1157436411 shutdown_connections 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.709+0000 7f494d343700 1 -- 172.21.15.19:0/1157436411 wait complete. 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 Processor -- start 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 -- start start 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 0x7f494811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948137f20 0x7f494811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494811ba70 con 0x7f4948137f20 2023-10-03T10:15:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494811bf90 con 0x7f494806c0e0 2023-10-03T10:15:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.710+0000 7f494d343700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f494811c230 con 0x7f4948134ec0 2023-10-03T10:15:22.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f4946ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f4946ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52220/0 (socket says 172.21.15.19:52220) 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f4946ffd700 1 -- 172.21.15.19:0/3372460635 learned_addr learned my addr 172.21.15.19:0/3372460635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 0x7f494811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f49477fe700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948137f20 0x7f494811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 -- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 msgr2=0x7f494811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 -- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948137f20 msgr2=0x7f494811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948137f20 0x7f494811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 -- 172.21.15.19:0/3372460635 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094a0 con 0x7f4948134ec0 2023-10-03T10:15:22.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f4946ffd700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.711+0000 7f493ffff700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 0x7f494811abc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4930016000 tx=0x7f4930004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.712+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49300036a0 con 0x7f4948134ec0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.712+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493001f070 con 0x7f4948134ec0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.712+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930003a40 con 0x7f4948134ec0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.712+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49300094a0 con 0x7f4948134ec0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.713+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494811d740 con 0x7f4948134ec0 2023-10-03T10:15:22.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.713+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4948074ea0 con 0x7f4948134ec0 2023-10-03T10:15:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.714+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4930003ba0 con 0x7f4948134ec0 2023-10-03T10:15:22.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.714+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4930021070 con 0x7f4948134ec0 2023-10-03T10:15:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.723+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4930019d80 con 0x7f4948134ec0 2023-10-03T10:15:22.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.853+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9b3c074ea0 con 0x7f9b3c12e140 2023-10-03T10:15:22.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.854+0000 7f9b2affd700 1 -- 172.21.15.19:0/774253440 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b3402b090 con 0x7f9b3c12e140 2023-10-03T10:15:22.855 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 msgr2=0x7f9b3c13d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400efc0 tx=0x7f9b3400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 shutdown_connections 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b3c12e140 0x7f9b3c13d5e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b3c06e570 0x7f9b3c13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 --2- 172.21.15.19:0/774253440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b3c06f050 0x7f9b3c13d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 >> 172.21.15.19:0/774253440 conn(0x7f9b3c0a2aa0 msgr2=0x7f9b3c09cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 shutdown_connections 2023-10-03T10:15:22.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.857+0000 7f9b40b49700 1 -- 172.21.15.19:0/774253440 wait complete. 2023-10-03T10:15:22.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:22.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.888+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65c40713a0 con 0x7f65c412f8b0 2023-10-03T10:15:22.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.888+0000 7f65c0ff9700 1 -- 172.21.15.19:0/1137304397 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65b8017030 con 0x7f65c412f8b0 2023-10-03T10:15:22.889 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 msgr2=0x7f65c41c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f65b800c520 tx=0x7f65b800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 shutdown_connections 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c4130430 0x7f65c409afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c412cf60 0x7f65c41c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 --2- 172.21.15.19:0/1137304397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c412f8b0 0x7f65c41c4970 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 >> 172.21.15.19:0/1137304397 conn(0x7f65c40a2aa0 msgr2=0x7f65c406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 shutdown_connections 2023-10-03T10:15:22.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.891+0000 7f65aa7fc700 1 -- 172.21.15.19:0/1137304397 wait complete. 2023-10-03T10:15:22.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.908+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1b8005860 con 0x7fe1d806f5d0 2023-10-03T10:15:22.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.908+0000 7fe1d57fa700 1 -- 172.21.15.19:0/3104346430 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1cc01a2b0 con 0x7fe1d806f5d0 2023-10-03T10:15:22.909 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 msgr2=0x7fe1d81c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00c520 tx=0x7fe1cc00c830 comp rx=0 tx=0).stop 2023-10-03T10:15:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 shutdown_connections 2023-10-03T10:15:22.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d8135c20 0x7fe1d81c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d806f5d0 0x7fe1d81c53c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 --2- 172.21.15.19:0/3104346430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d812cf60 0x7fe1d81c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 >> 172.21.15.19:0/3104346430 conn(0x7fe1d80a2aa0 msgr2=0x7fe1d8129300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 shutdown_connections 2023-10-03T10:15:22.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.910+0000 7fe1dee7c700 1 -- 172.21.15.19:0/3104346430 wait complete. 2023-10-03T10:15:22.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.930+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f494806b250 con 0x7f4948134ec0 2023-10-03T10:15:22.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.931+0000 7f493f7fe700 1 -- 172.21.15.19:0/3372460635 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4930015030 con 0x7f4948134ec0 2023-10-03T10:15:22.932 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 msgr2=0x7f494811abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 0x7f494811abc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4930016000 tx=0x7f4930004750 comp rx=0 tx=0).stop 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 shutdown_connections 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4948137f20 0x7f494811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f494806c0e0 0x7f494811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 --2- 172.21.15.19:0/3372460635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4948134ec0 0x7f494811abc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 >> 172.21.15.19:0/3372460635 conn(0x7f49480a4210 msgr2=0x7f49480a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 shutdown_connections 2023-10-03T10:15:22.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:22.933+0000 7f494d343700 1 -- 172.21.15.19:0/3372460635 wait complete. 2023-10-03T10:15:22.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:23.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:23.907 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:23.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:24.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 Processor -- start 2023-10-03T10:15:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 -- start start 2023-10-03T10:15:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 0x7f467012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467006fa40 con 0x7f467012cf60 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467012cd90 con 0x7f467006f5d0 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.033+0000 7f46769e4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4670071780 con 0x7f4670135c20 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f466f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 0x7f467012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52224/0 (socket says 172.21.15.19:52224) 2023-10-03T10:15:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 -- 172.21.15.19:0/614849311 learned_addr learned my addr 172.21.15.19:0/614849311 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 -- 172.21.15.19:0/614849311 >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 msgr2=0x7f467012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 --2- 172.21.15.19:0/614849311 >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 0x7f467012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 -- 172.21.15.19:0/614849311 >> v1:172.21.15.19:6789/0 conn(0x7f467012cf60 legacy=0x7f467012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 -- 172.21.15.19:0/614849311 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670071a40 con 0x7f4670135c20 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f466f7fe700 1 --2- 172.21.15.19:0/614849311 >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 0x7f467012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.034+0000 7f4674f81700 1 --2- 172.21.15.19:0/614849311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f466800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e31d52f9a7f3e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.035+0000 7f466effd700 1 -- 172.21.15.19:0/614849311 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800e070 con 0x7f4670135c20 2023-10-03T10:15:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.035+0000 7f466effd700 1 -- 172.21.15.19:0/614849311 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466800b910 con 0x7f4670135c20 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.035+0000 7f466effd700 1 -- 172.21.15.19:0/614849311 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466800bcc0 con 0x7f4670135c20 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 -- 172.21.15.19:0/614849311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 msgr2=0x7f4670138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 --2- 172.21.15.19:0/614849311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4668009e50 tx=0x7f466800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 -- 172.21.15.19:0/614849311 shutdown_connections 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 --2- 172.21.15.19:0/614849311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4670135c20 0x7f4670138000 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 --2- 172.21.15.19:0/614849311 >> v2:172.21.15.19:3300/0 conn(0x7f467006f5d0 0x7f467012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 -- 172.21.15.19:0/614849311 >> 172.21.15.19:0/614849311 conn(0x7f46700a2aa0 msgr2=0x7f46700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 -- 172.21.15.19:0/614849311 shutdown_connections 2023-10-03T10:15:24.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.036+0000 7f46769e4700 1 -- 172.21.15.19:0/614849311 wait complete. 2023-10-03T10:15:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.037+0000 7f46769e4700 1 Processor -- start 2023-10-03T10:15:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 -- start start 2023-10-03T10:15:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f467006f5d0 0x7f4670129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 0x7f46701c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467009c920 con 0x7f467012cf60 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467009b2a0 con 0x7f467006f5d0 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.038+0000 7f46769e4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46700a1620 con 0x7f4670135c20 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f4674f81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 0x7f46701c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34958/0 (socket says 172.21.15.19:34958) 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 -- 172.21.15.19:0/4164188308 learned_addr learned my addr 172.21.15.19:0/4164188308 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 -- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 msgr2=0x7f46701c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 0x7f46701c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 -- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f467006f5d0 msgr2=0x7f4670129190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f467006f5d0 0x7f4670129190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 -- 172.21.15.19:0/4164188308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466400a640 con 0x7f467012cf60 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f4674f81700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 0x7f46701c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.039+0000 7f466f7fe700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f466400e9a0 tx=0x7f466400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.040+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466400cb50 con 0x7f467012cf60 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.040+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466400ccb0 con 0x7f467012cf60 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.040+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4668009b30 con 0x7f467012cf60 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.040+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46640115f0 con 0x7f467012cf60 2023-10-03T10:15:24.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.040+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4670129c10 con 0x7f467012cf60 2023-10-03T10:15:24.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.041+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4664011750 con 0x7f467012cf60 2023-10-03T10:15:24.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.041+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467009c5a0 con 0x7f467012cf60 2023-10-03T10:15:24.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.041+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f466403f4a0 con 0x7f467012cf60 2023-10-03T10:15:24.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.050+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f467009c5a0 con 0x7f467012cf60 2023-10-03T10:15:24.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.076+0000 7fab88d96700 1 Processor -- start 2023-10-03T10:15:24.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.076+0000 7fab88d96700 1 -- start start 2023-10-03T10:15:24.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab88d96700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab840a0a30 0x7fab840a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab88d96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab84134170 0x7fab8413bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab88d96700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab8409edd0 con 0x7fab840a1340 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab88d96700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8409e1f0 con 0x7fab840a0a30 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab88d96700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab8409dc50 con 0x7fab84134170 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab8259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab840a0a30 0x7fab840a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab79d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fab840a1340 0x7fab84133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54730/0 (socket says 172.21.15.19:54730) 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab79d9b700 1 -- 172.21.15.19:0/81662877 learned_addr learned my addr 172.21.15.19:0/81662877 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab82d9d700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab84134170 0x7fab8413bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab8259c700 1 -- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab84134170 msgr2=0x7fab8413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab8259c700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab84134170 0x7fab8413bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab8259c700 1 -- 172.21.15.19:0/81662877 >> v1:172.21.15.19:6789/0 conn(0x7fab840a1340 legacy=0x7fab84133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.077+0000 7fab8259c700 1 -- 172.21.15.19:0/81662877 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840a1fe0 con 0x7fab840a0a30 2023-10-03T10:15:24.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab8259c700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab840a0a30 0x7fab840a0e00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fab74009840 tx=0x7fab74009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbea7f27d0de0e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab81d9b700 1 -- 172.21.15.19:0/81662877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74011830 con 0x7fab840a0a30 2023-10-03T10:15:24.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab81d9b700 1 -- 172.21.15.19:0/81662877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab74011990 con 0x7fab840a0a30 2023-10-03T10:15:24.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab81d9b700 1 -- 172.21.15.19:0/81662877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab74011d20 con 0x7fab840a0a30 2023-10-03T10:15:24.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab88d96700 1 -- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab840a0a30 msgr2=0x7fab840a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.078+0000 7fab88d96700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab840a0a30 0x7fab840a0e00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fab74009840 tx=0x7fab74009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 -- 172.21.15.19:0/81662877 shutdown_connections 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab84134170 0x7fab8413bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 --2- 172.21.15.19:0/81662877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab840a0a30 0x7fab840a0e00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 -- 172.21.15.19:0/81662877 >> 172.21.15.19:0/81662877 conn(0x7fab840a6550 msgr2=0x7fab840a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 -- 172.21.15.19:0/81662877 shutdown_connections 2023-10-03T10:15:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.079+0000 7fab88d96700 1 -- 172.21.15.19:0/81662877 wait complete. 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.080+0000 7fab88d96700 1 Processor -- start 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.080+0000 7fab88d96700 1 -- start start 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab840a0a30 0x7fab84122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab84123e00 con 0x7fab84134170 2023-10-03T10:15:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab841244b0 con 0x7fab840a0a30 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab88d96700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab841263c0 con 0x7fab840a1340 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab79d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34968/0 (socket says 172.21.15.19:34968) 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab79d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34204/0 (socket says 172.21.15.19:34204) 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 -- 172.21.15.19:0/1522419359 learned_addr learned my addr 172.21.15.19:0/1522419359 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab8259c700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab840a0a30 0x7fab84122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 -- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 msgr2=0x7fab84122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 -- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab840a0a30 msgr2=0x7fab84122930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab840a0a30 0x7fab84122930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.081+0000 7fab82d9d700 1 -- 172.21.15.19:0/1522419359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740094a0 con 0x7fab84134170 2023-10-03T10:15:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab79d9b700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab82d9d700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00efc0 tx=0x7fab7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c009ea0 con 0x7fab84134170 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c00f040 con 0x7fab84134170 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab840a25e0 con 0x7fab84134170 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c00ced0 con 0x7fab84134170 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.082+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab841260e0 con 0x7fab84134170 2023-10-03T10:15:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.083+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab7c014480 con 0x7fab84134170 2023-10-03T10:15:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.083+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab84125d80 con 0x7fab84134170 2023-10-03T10:15:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.083+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab7c03ff00 con 0x7fab84134170 2023-10-03T10:15:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.088+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab84125d80 con 0x7fab84134170 2023-10-03T10:15:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.113+0000 7fc0023f0700 1 Processor -- start 2023-10-03T10:15:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.113+0000 7fc0023f0700 1 -- start start 2023-10-03T10:15:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc0023f0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbffc134630 0x7fbffc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc0023f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc0023f0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbffc09b4f0 con 0x7fbffc131810 2023-10-03T10:15:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc0023f0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbffc1313c0 con 0x7fbffc134630 2023-10-03T10:15:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc0023f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc06e8c0 con 0x7fbffc136f50 2023-10-03T10:15:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fbffbfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbffc131810 0x7fbffc131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54732/0 (socket says 172.21.15.19:54732) 2023-10-03T10:15:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fbffbfff700 1 -- 172.21.15.19:0/94435951 learned_addr learned my addr 172.21.15.19:0/94435951 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/94435951 >> v2:172.21.15.19:3300/0 conn(0x7fbffc134630 0x7fbffc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fc00098d700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.114+0000 7fbffaffd700 1 -- 172.21.15.19:0/94435951 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782995828 0 0) 0x7fbffc09b4f0 con 0x7fbffc131810 2023-10-03T10:15:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffaffd700 1 -- 172.21.15.19:0/94435951 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe40079c0 con 0x7fbffc131810 2023-10-03T10:15:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffb7fe700 1 -- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 msgr2=0x7fbffc139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffb7fe700 1 -- 172.21.15.19:0/94435951 >> v1:172.21.15.19:6789/0 conn(0x7fbffc131810 legacy=0x7fbffc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffb7fe700 1 -- 172.21.15.19:0/94435951 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbffc071d20 con 0x7fbffc134630 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc134630 0x7fbffc136a10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009840 tx=0x7fbff0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707f028d03069f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffaffd700 1 -- 172.21.15.19:0/94435951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0011830 con 0x7fbffc134630 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffaffd700 1 -- 172.21.15.19:0/94435951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff0011990 con 0x7fbffc134630 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.115+0000 7fbffaffd700 1 -- 172.21.15.19:0/94435951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0011d20 con 0x7fbffc134630 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 -- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc134630 msgr2=0x7fbffc136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc134630 0x7fbffc136a10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbff0009840 tx=0x7fbff0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 -- 172.21.15.19:0/94435951 shutdown_connections 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 --2- 172.21.15.19:0/94435951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc134630 0x7fbffc136a10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 -- 172.21.15.19:0/94435951 >> 172.21.15.19:0/94435951 conn(0x7fbffc0a2aa0 msgr2=0x7fbffc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 -- 172.21.15.19:0/94435951 shutdown_connections 2023-10-03T10:15:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.116+0000 7fc0023f0700 1 -- 172.21.15.19:0/94435951 wait complete. 2023-10-03T10:15:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.117+0000 7fc0023f0700 1 Processor -- start 2023-10-03T10:15:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 -- start start 2023-10-03T10:15:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 0x7fbffc09c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc09ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc11a4a0 con 0x7fbffc131810 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc09e040 con 0x7fbffc134630 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.118+0000 7fc0023f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbffc130d30 con 0x7fbffc136f50 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 0x7fbffc09c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52260/0 (socket says 172.21.15.19:52260) 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 0x7fbffc09c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34982/0 (socket says 172.21.15.19:34982) 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 -- 172.21.15.19:0/1719462019 learned_addr learned my addr 172.21.15.19:0/1719462019 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fc00098d700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc09ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 -- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 msgr2=0x7fbffc09ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc09ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 -- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 msgr2=0x7fbffc09c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 0x7fbffc09c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 -- 172.21.15.19:0/1719462019 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff00094a0 con 0x7fbffc134630 2023-10-03T10:15:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.119+0000 7fbffb7fe700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000c00 tx=0x7fbff0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.120+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff00036a0 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.120+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff001f070 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.120+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbffc06eb00 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.120+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff0003a60 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.120+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbffc118f80 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.121+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbff0003bc0 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.121+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbff0021070 con 0x7fbffc134630 2023-10-03T10:15:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.121+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbffc074ea0 con 0x7fbffc134630 2023-10-03T10:15:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.126+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbff001a430 con 0x7fbffc134630 2023-10-03T10:15:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.140+0000 7f5fa0278700 1 Processor -- start 2023-10-03T10:15:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.140+0000 7f5fa0278700 1 -- start start 2023-10-03T10:15:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5fa0278700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5fa0278700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5fa0278700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9809f130 con 0x7f5f9809e410 2023-10-03T10:15:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5fa0278700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9809f520 con 0x7f5f9809d6f0 2023-10-03T10:15:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5fa0278700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9809e930 con 0x7f5f9809e000 2023-10-03T10:15:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5f9e815700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5f9809e410 0x7f5f98130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54742/0 (socket says 172.21.15.19:54742) 2023-10-03T10:15:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5f9e815700 1 -- 172.21.15.19:0/2490223906 learned_addr learned my addr 172.21.15.19:0/2490223906 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.141+0000 7f5f9e014700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d813700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d012700 1 -- 172.21.15.19:0/2490223906 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809398374 0 0) 0x7f5f9809f130 con 0x7f5f9809e410 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d012700 1 -- 172.21.15.19:0/2490223906 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f840035b0 con 0x7f5f9809e410 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9e014700 1 -- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 msgr2=0x7f5f98130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9e014700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9e014700 1 -- 172.21.15.19:0/2490223906 >> v1:172.21.15.19:6789/0 conn(0x7f5f9809e410 legacy=0x7f5f98130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9e014700 1 -- 172.21.15.19:0/2490223906 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9809b2d0 con 0x7f5f9809d6f0 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d813700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9e014700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f9809dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f94009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a15ea34012f0de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d012700 1 -- 172.21.15.19:0/2490223906 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400f8a0 con 0x7f5f9809d6f0 2023-10-03T10:15:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d012700 1 -- 172.21.15.19:0/2490223906 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9400fa00 con 0x7f5f9809d6f0 2023-10-03T10:15:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.142+0000 7f5f9d012700 1 -- 172.21.15.19:0/2490223906 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9400fd90 con 0x7f5f9809d6f0 2023-10-03T10:15:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.143+0000 7f5fa0278700 1 -- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 msgr2=0x7f5f9809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.143+0000 7f5fa0278700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f9809dac0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009870 tx=0x7f5f94009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 -- 172.21.15.19:0/2490223906 shutdown_connections 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f9809dac0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 --2- 172.21.15.19:0/2490223906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 -- 172.21.15.19:0/2490223906 >> 172.21.15.19:0/2490223906 conn(0x7f5f98066f50 msgr2=0x7f5f9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 -- 172.21.15.19:0/2490223906 shutdown_connections 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.144+0000 7f5fa0278700 1 -- 172.21.15.19:0/2490223906 wait complete. 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 Processor -- start 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 -- start start 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98122620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f9809e410 0x7f5f98122b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98125c00 con 0x7f5f9809e410 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f980a3b80 con 0x7f5f9809d6f0 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5fa0278700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9809c700 con 0x7f5f9809e000 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5f9e014700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5f9e014700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52282/0 (socket says 172.21.15.19:52282) 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5f9e014700 1 -- 172.21.15.19:0/542088499 learned_addr learned my addr 172.21.15.19:0/542088499 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.145+0000 7f5f9d813700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98122620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9e815700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f9809e410 0x7f5f98122b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 -- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 msgr2=0x7f5f981220e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 -- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f9809e410 msgr2=0x7f5f98122b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f9809e410 0x7f5f98122b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 -- 172.21.15.19:0/542088499 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f940094a0 con 0x7f5f9809e000 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9e014700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f9d813700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98122620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f88014f10 tx=0x7f5f88007320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88017070 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f88010ad0 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.146+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98124f40 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.147+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88010e80 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.147+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f981244e0 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.148+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9811ac20 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.148+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5f88004030 con 0x7f5f9809e000 2023-10-03T10:15:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.148+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5f88046ef0 con 0x7f5f9809e000 2023-10-03T10:15:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.154+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5f8801a980 con 0x7f5f9809e000 2023-10-03T10:15:24.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.300+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fab84125d80 con 0x7fab84134170 2023-10-03T10:15:24.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.301+0000 7fab7b7fe700 1 -- 172.21.15.19:0/1522419359 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab84125d80 con 0x7fab84134170 2023-10-03T10:15:24.302 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 msgr2=0x7fab841233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00efc0 tx=0x7fab7c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 shutdown_connections 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab84134170 0x7fab841233b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab840a0a30 0x7fab84122930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 --2- 172.21.15.19:0/1522419359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab840a1340 0x7fab84122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.303+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 >> 172.21.15.19:0/1522419359 conn(0x7fab840a6550 msgr2=0x7fab8409c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.304+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 shutdown_connections 2023-10-03T10:15:24.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.304+0000 7fab88d96700 1 -- 172.21.15.19:0/1522419359 wait complete. 2023-10-03T10:15:24.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.319+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f467009c5a0 con 0x7f467012cf60 2023-10-03T10:15:24.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.320+0000 7f466cff9700 1 -- 172.21.15.19:0/4164188308 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f467009c5a0 con 0x7f467012cf60 2023-10-03T10:15:24.320 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 msgr2=0x7f46701296d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f466400e9a0 tx=0x7f466400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 shutdown_connections 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4670135c20 0x7f46701c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f467006f5d0 0x7f4670129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 --2- 172.21.15.19:0/4164188308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f467012cf60 0x7f46701296d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 >> 172.21.15.19:0/4164188308 conn(0x7f46700a2aa0 msgr2=0x7f467012f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 shutdown_connections 2023-10-03T10:15:24.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.322+0000 7f46769e4700 1 -- 172.21.15.19:0/4164188308 wait complete. 2023-10-03T10:15:24.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.335+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbffc06b9e0 con 0x7fbffc134630 2023-10-03T10:15:24.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.335+0000 7fbff8ff9700 1 -- 172.21.15.19:0/1719462019 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbff00193b0 con 0x7fbffc134630 2023-10-03T10:15:24.337 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:24.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 msgr2=0x7fbffc09c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbff0000c00 tx=0x7fbff0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 shutdown_connections 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbffc136f50 0x7fbffc09ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbffc131810 0x7fbffc09c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 --2- 172.21.15.19:0/1719462019 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbffc134630 0x7fbffc09c970 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 >> 172.21.15.19:0/1719462019 conn(0x7fbffc0a2aa0 msgr2=0x7fbffc06f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 shutdown_connections 2023-10-03T10:15:24.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.338+0000 7fc0023f0700 1 -- 172.21.15.19:0/1719462019 wait complete. 2023-10-03T10:15:24.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:24.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.379+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f98074ea0 con 0x7f5f9809e000 2023-10-03T10:15:24.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.379+0000 7f5f8effd700 1 -- 172.21.15.19:0/542088499 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5f88020070 con 0x7f5f9809e000 2023-10-03T10:15:24.380 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.381+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 msgr2=0x7f5f98122620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.381+0000 7f5fa0278700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98122620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5f88014f10 tx=0x7f5f88007320 comp rx=0 tx=0).stop 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 shutdown_connections 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f9809e410 0x7f5f98122b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5f9809d6f0 0x7f5f981220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 --2- 172.21.15.19:0/542088499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5f9809e000 0x7f5f98122620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 >> 172.21.15.19:0/542088499 conn(0x7f5f98066f50 msgr2=0x7f5f98130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 shutdown_connections 2023-10-03T10:15:24.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:24.382+0000 7f5fa0278700 1 -- 172.21.15.19:0/542088499 wait complete. 2023-10-03T10:15:24.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:25.320 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:25.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:25.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:25.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:25.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.483+0000 7fb362106700 1 Processor -- start 2023-10-03T10:15:25.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.483+0000 7fb362106700 1 -- start start 2023-10-03T10:15:25.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb362106700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb362106700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09f240 0x7fb35c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb362106700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35c070940 con 0x7fb35c09f650 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb362106700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06fd60 con 0x7fb35c09f240 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb362106700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06fa80 con 0x7fb35c09e930 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb35b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb35b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34238/0 (socket says 172.21.15.19:34238) 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.484+0000 7fb35b7fe700 1 -- 172.21.15.19:0/3803353192 learned_addr learned my addr 172.21.15.19:0/3803353192 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35affd700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09f240 0x7fb35c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35b7fe700 1 -- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09f240 msgr2=0x7fb35c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35b7fe700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09f240 0x7fb35c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35b7fe700 1 -- 172.21.15.19:0/3803353192 >> v1:172.21.15.19:6789/0 conn(0x7fb35c09f650 legacy=0x7fb35c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35b7fe700 1 -- 172.21.15.19:0/3803353192 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb35c09fb60 con 0x7fb35c09e930 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35b7fe700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009920 tx=0x7fb34c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c8966c90f5aaeb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35a7fc700 1 -- 172.21.15.19:0/3803353192 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011830 con 0x7fb35c09e930 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35a7fc700 1 -- 172.21.15.19:0/3803353192 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c011990 con 0x7fb35c09e930 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.485+0000 7fb35a7fc700 1 -- 172.21.15.19:0/3803353192 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c011d20 con 0x7fb35c09e930 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 -- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 msgr2=0x7fb35c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009920 tx=0x7fb34c009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 -- 172.21.15.19:0/3803353192 shutdown_connections 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09e930 0x7fb35c09ed00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 --2- 172.21.15.19:0/3803353192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09f240 0x7fb35c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 -- 172.21.15.19:0/3803353192 >> 172.21.15.19:0/3803353192 conn(0x7fb35c0a4210 msgr2=0x7fb35c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 -- 172.21.15.19:0/3803353192 shutdown_connections 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.486+0000 7fb362106700 1 -- 172.21.15.19:0/3803353192 wait complete. 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.488+0000 7fb362106700 1 Processor -- start 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.488+0000 7fb362106700 1 -- start start 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35c09f240 0x7fb35c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 0x7fb35c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c06cd80 con 0x7fb35c09f240 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c1b72d0 con 0x7fb35c09e930 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb362106700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb35c1a9480 con 0x7fb35c09f650 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 0x7fb35c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52294/0 (socket says 172.21.15.19:52294) 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35b7fe700 1 -- 172.21.15.19:0/1312947408 learned_addr learned my addr 172.21.15.19:0/1312947408 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35affd700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35c09f240 0x7fb35c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 -- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 msgr2=0x7fb35c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 -- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35c09f240 msgr2=0x7fb35c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35c09f240 0x7fb35c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35bfff700 1 -- 172.21.15.19:0/1312947408 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb34c009550 con 0x7fb35c09f650 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.489+0000 7fb35b7fe700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb35bfff700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 0x7fb35c06c330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb35400cb90 tx=0x7fb35400cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354003c00 con 0x7fb35c09f650 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354003d60 con 0x7fb35c09f650 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb35c0a0190 con 0x7fb35c09f650 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35400aa40 con 0x7fb35c09f650 2023-10-03T10:15:25.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.490+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35c1a91b0 con 0x7fb35c09f650 2023-10-03T10:15:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.491+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35c0a37d0 con 0x7fb35c09f650 2023-10-03T10:15:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.491+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb35400aba0 con 0x7fb35c09f650 2023-10-03T10:15:25.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.492+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb35403f560 con 0x7fb35c09f650 2023-10-03T10:15:25.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.496+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb354019710 con 0x7fb35c09f650 2023-10-03T10:15:25.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.511+0000 7f9053cc9700 1 Processor -- start 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 -- start start 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f904c06e570 0x7f904c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 0x7f904c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c070ee0 con 0x7f904c134610 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c071480 con 0x7f904c06e570 2023-10-03T10:15:25.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9053cc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c06f3c0 con 0x7f904c09eca0 2023-10-03T10:15:25.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9051264700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 0x7f904c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.512+0000 7f9051264700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 0x7f904c06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52310/0 (socket says 172.21.15.19:52310) 2023-10-03T10:15:25.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051264700 1 -- 172.21.15.19:0/2708946105 learned_addr learned my addr 172.21.15.19:0/2708946105 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 --2- 172.21.15.19:0/2708946105 >> v2:172.21.15.19:3300/0 conn(0x7f904c06e570 0x7f904c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 -- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 msgr2=0x7f904c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 --2- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 0x7f904c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 -- 172.21.15.19:0/2708946105 >> v1:172.21.15.19:6789/0 conn(0x7f904c134610 legacy=0x7f904c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 -- 172.21.15.19:0/2708946105 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c071b90 con 0x7f904c06e570 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9050a63700 1 -- 172.21.15.19:0/2708946105 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612606303 0 0) 0x7f904c070ee0 con 0x7f904c134610 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9051a65700 1 --2- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c06e570 0x7f904c06e940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f9048009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1f8dbef2ab88e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9050a63700 1 -- 172.21.15.19:0/2708946105 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048011830 con 0x7f904c06e570 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9050a63700 1 -- 172.21.15.19:0/2708946105 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048011990 con 0x7f904c06e570 2023-10-03T10:15:25.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.513+0000 7f9050a63700 1 -- 172.21.15.19:0/2708946105 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048011d20 con 0x7f904c06e570 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 -- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c06e570 msgr2=0x7f904c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 --2- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c06e570 0x7f904c06e940 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f9048009840 tx=0x7f9048009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 -- 172.21.15.19:0/2708946105 shutdown_connections 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 --2- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c06e570 0x7f904c06e940 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 --2- 172.21.15.19:0/2708946105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c09eca0 0x7f904c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.514+0000 7f9053cc9700 1 -- 172.21.15.19:0/2708946105 >> 172.21.15.19:0/2708946105 conn(0x7f904c0a2aa0 msgr2=0x7f904c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.515+0000 7f9053cc9700 1 -- 172.21.15.19:0/2708946105 shutdown_connections 2023-10-03T10:15:25.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.515+0000 7f9053cc9700 1 -- 172.21.15.19:0/2708946105 wait complete. 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 Processor -- start 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 -- start start 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f904c06e570 0x7f904c13ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c13e3a0 0x7f904c13f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c13c880 con 0x7f904c134610 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c13d900 con 0x7f904c13e3a0 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9053cc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0a1dd0 con 0x7f904c06e570 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9051264700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9051264700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35026/0 (socket says 172.21.15.19:35026) 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9051264700 1 -- 172.21.15.19:0/4174436307 learned_addr learned my addr 172.21.15.19:0/4174436307 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.516+0000 7f9052266700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c13e3a0 0x7f904c13f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 -- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f904c06e570 msgr2=0x7f904c13ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f904c06e570 0x7f904c13ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 -- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c13e3a0 msgr2=0x7f904c13f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c13e3a0 0x7f904c13f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 -- 172.21.15.19:0/4174436307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480094a0 con 0x7f904c134610 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9051264700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e910 tx=0x7f903c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00ee60 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00c850 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c070610 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c13dbc0 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.517+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00cbc0 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.518+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90340052e0 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.518+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f903c00cd20 con 0x7f904c134610 2023-10-03T10:15:25.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.519+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f903c03f9d0 con 0x7f904c134610 2023-10-03T10:15:25.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.521+0000 7f582cff2700 1 Processor -- start 2023-10-03T10:15:25.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.521+0000 7f582cff2700 1 -- start start 2023-10-03T10:15:25.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f582cff2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f582809eca0 0x7f582813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f582cff2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f582cff2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5828070ee0 con 0x7f582806e570 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f582cff2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5828071980 con 0x7f582809eca0 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f582cff2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5828071480 con 0x7f582806f050 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34276/0 (socket says 172.21.15.19:34276) 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 -- 172.21.15.19:0/479091601 learned_addr learned my addr 172.21.15.19:0/479091601 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5825d9b700 1 --2- 172.21.15.19:0/479091601 >> v2:172.21.15.19:3300/0 conn(0x7f582809eca0 0x7f582813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 -- 172.21.15.19:0/479091601 >> v2:172.21.15.19:3300/0 conn(0x7f582809eca0 msgr2=0x7f582813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 --2- 172.21.15.19:0/479091601 >> v2:172.21.15.19:3300/0 conn(0x7f582809eca0 0x7f582813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 -- 172.21.15.19:0/479091601 >> v1:172.21.15.19:6789/0 conn(0x7f582806e570 legacy=0x7f582806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 -- 172.21.15.19:0/479091601 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828071b90 con 0x7f582806f050 2023-10-03T10:15:25.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.522+0000 7f5826d9d700 1 --2- 172.21.15.19:0/479091601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e50 tx=0x7f582000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a583f4895e498191 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582559a700 1 -- 172.21.15.19:0/479091601 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582000e070 con 0x7f582806f050 2023-10-03T10:15:25.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582559a700 1 -- 172.21.15.19:0/479091601 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820003a20 con 0x7f582806f050 2023-10-03T10:15:25.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582559a700 1 -- 172.21.15.19:0/479091601 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820003dd0 con 0x7f582806f050 2023-10-03T10:15:25.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 -- 172.21.15.19:0/479091601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 msgr2=0x7f582813f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 --2- 172.21.15.19:0/479091601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e50 tx=0x7f582000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 -- 172.21.15.19:0/479091601 shutdown_connections 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 --2- 172.21.15.19:0/479091601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f582813f3f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 --2- 172.21.15.19:0/479091601 >> v2:172.21.15.19:3300/0 conn(0x7f582809eca0 0x7f582813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.523+0000 7f582cff2700 1 -- 172.21.15.19:0/479091601 >> 172.21.15.19:0/479091601 conn(0x7f58280a2aa0 msgr2=0x7f58280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.524+0000 7f582cff2700 1 -- 172.21.15.19:0/479091601 shutdown_connections 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.524+0000 7f582cff2700 1 -- 172.21.15.19:0/479091601 wait complete. 2023-10-03T10:15:25.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.524+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f903c01adc0 con 0x7f904c134610 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 Processor -- start 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 -- start start 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582806e570 0x7f58281ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f58281cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 0x7f582813adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58281214e0 con 0x7f582806e570 2023-10-03T10:15:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582813cd10 con 0x7f582813a950 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.525+0000 7f582cff2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f582809a2c0 con 0x7f582806f050 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5825d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f58281cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5825d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f58281cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34292/0 (socket says 172.21.15.19:34292) 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5825d9b700 1 -- 172.21.15.19:0/2012703525 learned_addr learned my addr 172.21.15.19:0/2012703525 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 0x7f582813adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f582659c700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582806e570 0x7f58281ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 -- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 msgr2=0x7f58281cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f58281cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 -- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582806e570 msgr2=0x7f58281ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582806e570 0x7f58281ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 -- 172.21.15.19:0/2012703525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5820009b30 con 0x7f582813a950 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5826d9d700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 0x7f582813adf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5820014000 tx=0x7f5820004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820004440 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5828070610 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58200045c0 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.526+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820004970 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.527+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582813db20 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.528+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582813dcb0 con 0x7f582813a950 2023-10-03T10:15:25.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.528+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5820012430 con 0x7f582813a950 2023-10-03T10:15:25.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.528+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5820040a50 con 0x7f582813a950 2023-10-03T10:15:25.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.537+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5820024d80 con 0x7f582813a950 2023-10-03T10:15:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.567+0000 7f93d0d2d700 1 Processor -- start 2023-10-03T10:15:25.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.567+0000 7f93d0d2d700 1 -- start start 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 0x7f93cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93cc0a1340 0x7f93cc13c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc13c640 0x7f93cc13ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc09d920 con 0x7f93cc0a1340 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc09d020 con 0x7f93cc0a0a30 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93d0d2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc0a2010 con 0x7f93cc13c640 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93c9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93cc0a1340 0x7f93cc13c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93ca59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 0x7f93cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93c9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93cc0a1340 0x7f93cc13c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35052/0 (socket says 172.21.15.19:35052) 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93c9d9b700 1 -- 172.21.15.19:0/2886406527 learned_addr learned my addr 172.21.15.19:0/2886406527 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.568+0000 7f93cad9d700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc13c640 0x7f93cc13ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 -- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc13c640 msgr2=0x7f93cc13ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc13c640 0x7f93cc13ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 -- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 msgr2=0x7f93cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 0x7f93cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 -- 172.21.15.19:0/2886406527 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc09dbe0 con 0x7f93cc0a1340 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93ca59c700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 0x7f93cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c9d9b700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc13c100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098f0 tx=0x7f93c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db13dc66fd89dbfb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c959a700 1 -- 172.21.15.19:0/2886406527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0011830 con 0x7f93cc0a1340 2023-10-03T10:15:25.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c959a700 1 -- 172.21.15.19:0/2886406527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c0011990 con 0x7f93cc0a1340 2023-10-03T10:15:25.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.569+0000 7f93c959a700 1 -- 172.21.15.19:0/2886406527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0011d20 con 0x7f93cc0a1340 2023-10-03T10:15:25.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 msgr2=0x7f93cc13c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc13c100 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098f0 tx=0x7f93c0009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2886406527 shutdown_connections 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc0a0a30 0x7f93cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc13c640 0x7f93cc13ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2886406527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc13c100 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2886406527 >> 172.21.15.19:0/2886406527 conn(0x7f93cc0a6550 msgr2=0x7f93cc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2886406527 shutdown_connections 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.570+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2886406527 wait complete. 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 Processor -- start 2023-10-03T10:15:25.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 -- start start 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc127450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 0x7f93cc127990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc129140 con 0x7f93cc0a1340 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc09ff90 con 0x7f93cc13c640 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.572+0000 7f93d0d2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc128b20 con 0x7f93cc0a0a30 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34316/0 (socket says 172.21.15.19:34316) 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 -- 172.21.15.19:0/2761771232 learned_addr learned my addr 172.21.15.19:0/2761771232 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:25.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93cad9d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 0x7f93cc127990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93c9d9b700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc127450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 -- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 msgr2=0x7f93cc127990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 0x7f93cc127990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 -- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 msgr2=0x7f93cc127450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc127450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 -- 172.21.15.19:0/2761771232 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc0094a0 con 0x7f93cc0a0a30 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93cad9d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 0x7f93cc127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.573+0000 7f93ca59c700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00ebe0 tx=0x7f93bc00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.574+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00c850 con 0x7f93cc0a0a30 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.574+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc00c9b0 con 0x7f93cc0a0a30 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.574+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc00cd40 con 0x7f93cc0a0a30 2023-10-03T10:15:25.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.574+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0009550 con 0x7f93cc0a0a30 2023-10-03T10:15:25.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.574+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc129310 con 0x7f93cc0a0a30 2023-10-03T10:15:25.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.575+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc071e20 con 0x7f93cc0a0a30 2023-10-03T10:15:25.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.576+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93bc013470 con 0x7f93cc0a0a30 2023-10-03T10:15:25.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.576+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93bc03fc40 con 0x7f93cc0a0a30 2023-10-03T10:15:25.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.586+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93bc013720 con 0x7f93cc0a0a30 2023-10-03T10:15:25.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.713+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb35c1a0b30 con 0x7fb35c09f650 2023-10-03T10:15:25.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.714+0000 7fb343fff700 1 -- 172.21.15.19:0/1312947408 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb35401a360 con 0x7fb35c09f650 2023-10-03T10:15:25.716 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 msgr2=0x7fb35c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 0x7fb35c06c330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb35400cb90 tx=0x7fb35400cea0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 shutdown_connections 2023-10-03T10:15:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb35c09f650 0x7fb35c06c330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb35c09e930 0x7fb35c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 --2- 172.21.15.19:0/1312947408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb35c09f240 0x7fb35c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 >> 172.21.15.19:0/1312947408 conn(0x7fb35c0a4210 msgr2=0x7fb35c1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.716+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 shutdown_connections 2023-10-03T10:15:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.717+0000 7fb362106700 1 -- 172.21.15.19:0/1312947408 wait complete. 2023-10-03T10:15:25.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:25.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.742+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9034005590 con 0x7f904c134610 2023-10-03T10:15:25.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.742+0000 7f90427fc700 1 -- 172.21.15.19:0/4174436307 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f903c017070 con 0x7f904c134610 2023-10-03T10:15:25.743 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.744+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 msgr2=0x7f904c13efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.744+0000 7f9053cc9700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f903c00e910 tx=0x7f903c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 shutdown_connections 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f904c13e3a0 0x7f904c13f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f904c06e570 0x7f904c13ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 --2- 172.21.15.19:0/4174436307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f904c134610 0x7f904c13efc0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 >> 172.21.15.19:0/4174436307 conn(0x7f904c0a2aa0 msgr2=0x7f904c1381e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 shutdown_connections 2023-10-03T10:15:25.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.745+0000 7f9053cc9700 1 -- 172.21.15.19:0/4174436307 wait complete. 2023-10-03T10:15:25.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:25.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.783+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5828074ea0 con 0x7f582813a950 2023-10-03T10:15:25.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.784+0000 7f5816ffd700 1 -- 172.21.15.19:0/2012703525 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5820017030 con 0x7f582813a950 2023-10-03T10:15:25.785 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 msgr2=0x7f582813adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 0x7f582813adf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5820014000 tx=0x7f5820004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 shutdown_connections 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f582813a950 0x7f582813adf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582806e570 0x7f58281ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 --2- 172.21.15.19:0/2012703525 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f582806f050 0x7f58281cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 >> 172.21.15.19:0/2012703525 conn(0x7f58280a2aa0 msgr2=0x7f58280a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 shutdown_connections 2023-10-03T10:15:25.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.786+0000 7f582cff2700 1 -- 172.21.15.19:0/2012703525 wait complete. 2023-10-03T10:15:25.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.821+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93cc09df20 con 0x7f93cc0a0a30 2023-10-03T10:15:25.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.822+0000 7f93baffd700 1 -- 172.21.15.19:0/2761771232 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93bc017020 con 0x7f93cc0a0a30 2023-10-03T10:15:25.823 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 msgr2=0x7f93cc126f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93bc00ebe0 tx=0x7f93bc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 shutdown_connections 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93cc13c640 0x7f93cc127990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93cc0a0a30 0x7f93cc126f10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 --2- 172.21.15.19:0/2761771232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93cc0a1340 0x7f93cc127450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:25.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 >> 172.21.15.19:0/2761771232 conn(0x7f93cc0a6550 msgr2=0x7f93cc0a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:25.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 shutdown_connections 2023-10-03T10:15:25.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:25.824+0000 7f93d0d2d700 1 -- 172.21.15.19:0/2761771232 wait complete. 2023-10-03T10:15:25.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:26.733 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:26.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:26.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:26.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:26.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.884+0000 7f18f0f1b700 1 Processor -- start 2023-10-03T10:15:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.884+0000 7f18f0f1b700 1 -- start start 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18f0f1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18f0f1b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 0x7f18ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18f0f1b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18ec09f130 con 0x7f18ec09e410 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18f0f1b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18ec09f520 con 0x7f18ec09e000 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18f0f1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec09e930 con 0x7f18ec09d6f0 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50960/0 (socket says 172.21.15.19:50960) 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.885+0000 7f18ea59c700 1 -- 172.21.15.19:0/2159056300 learned_addr learned my addr 172.21.15.19:0/2159056300 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18e9d9b700 1 --2- 172.21.15.19:0/2159056300 >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 0x7f18ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18ea59c700 1 -- 172.21.15.19:0/2159056300 >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 msgr2=0x7f18ec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18ea59c700 1 --2- 172.21.15.19:0/2159056300 >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 0x7f18ec130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18ea59c700 1 -- 172.21.15.19:0/2159056300 >> v1:172.21.15.19:6789/0 conn(0x7f18ec09e410 legacy=0x7f18ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18ea59c700 1 -- 172.21.15.19:0/2159056300 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec09b2d0 con 0x7f18ec09d6f0 2023-10-03T10:15:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18e9d9b700 1 --2- 172.21.15.19:0/2159056300 >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 0x7f18ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18ea59c700 1 --2- 172.21.15.19:0/2159056300 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00bb90 tx=0x7f18dc00bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78463ae93474479d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18e959a700 1 -- 172.21.15.19:0/2159056300 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00dd50 con 0x7f18ec09d6f0 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18e959a700 1 -- 172.21.15.19:0/2159056300 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc010470 con 0x7f18ec09d6f0 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.886+0000 7f18e959a700 1 -- 172.21.15.19:0/2159056300 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc010800 con 0x7f18ec09d6f0 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 -- 172.21.15.19:0/2159056300 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 msgr2=0x7f18ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/2159056300 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00bb90 tx=0x7f18dc00bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 -- 172.21.15.19:0/2159056300 shutdown_connections 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/2159056300 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09d6f0 0x7f18ec09dac0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/2159056300 >> v2:172.21.15.19:3300/0 conn(0x7f18ec09e000 0x7f18ec130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.887+0000 7f18f0f1b700 1 -- 172.21.15.19:0/2159056300 >> 172.21.15.19:0/2159056300 conn(0x7f18ec066f50 msgr2=0x7f18ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.888+0000 7f18f0f1b700 1 -- 172.21.15.19:0/2159056300 shutdown_connections 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.888+0000 7f18f0f1b700 1 -- 172.21.15.19:0/2159056300 wait complete. 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.889+0000 7f18f0f1b700 1 Processor -- start 2023-10-03T10:15:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.889+0000 7f18f0f1b700 1 -- start start 2023-10-03T10:15:26.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f18ec09e000 0x7f18ec11e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09e410 0x7f18ec11eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec121bb0 con 0x7f18ec09d6f0 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec0a1d00 con 0x7f18ec09e410 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18f0f1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18ec09c700 con 0x7f18ec09e000 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18ea59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33720/0 (socket says 172.21.15.19:33720) 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18ea59c700 1 -- 172.21.15.19:0/1953091429 learned_addr learned my addr 172.21.15.19:0/1953091429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18ead9d700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09e410 0x7f18ec11eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.890+0000 7f18e9d9b700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f18ec09e000 0x7f18ec11e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 -- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f18ec09e000 msgr2=0x7f18ec11e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f18ec09e000 0x7f18ec11e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 -- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09e410 msgr2=0x7f18ec11eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09e410 0x7f18ec11eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 -- 172.21.15.19:0/1953091429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc00b7f0 con 0x7f18ec09d6f0 2023-10-03T10:15:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18ea59c700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00bee0 tx=0x7f18dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc01f070 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc0038b0 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc003c60 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18ec121610 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.891+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec1201f0 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.893+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f18dc023400 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.893+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18ec120f80 con 0x7f18ec09d6f0 2023-10-03T10:15:26.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.893+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f18dc044c30 con 0x7f18ec09d6f0 2023-10-03T10:15:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.902+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f18dc048060 con 0x7f18ec09d6f0 2023-10-03T10:15:26.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.925+0000 7fa325f12700 1 Processor -- start 2023-10-03T10:15:26.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.925+0000 7fa325f12700 1 -- start start 2023-10-03T10:15:26.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa325f12700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa325f12700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 0x7fa32013b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa325f12700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32006ef30 con 0x7fa3201338a0 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa325f12700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32006fef0 con 0x7fa320136710 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa325f12700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3201334b0 con 0x7fa320139030 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50976/0 (socket says 172.21.15.19:50976) 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 -- 172.21.15.19:0/3113066028 learned_addr learned my addr 172.21.15.19:0/3113066028 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31ffff700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 0x7fa32013b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 -- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 msgr2=0x7fa32013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 0x7fa32013b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 -- 172.21.15.19:0/3113066028 >> v1:172.21.15.19:6789/0 conn(0x7fa3201338a0 legacy=0x7fa320133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31e7fc700 1 -- 172.21.15.19:0/3113066028 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900156846 0 0) 0x7fa32006ef30 con 0x7fa3201338a0 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31effd700 1 -- 172.21.15.19:0/3113066028 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32006fc30 con 0x7fa320136710 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.926+0000 7fa31ffff700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 0x7fa32013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.927+0000 7fa31effd700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa314009920 tx=0x7fa314009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba68894ce07ce3a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.927+0000 7fa31e7fc700 1 -- 172.21.15.19:0/3113066028 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011830 con 0x7fa320136710 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.927+0000 7fa31e7fc700 1 -- 172.21.15.19:0/3113066028 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa314011990 con 0x7fa320136710 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.927+0000 7fa31e7fc700 1 -- 172.21.15.19:0/3113066028 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314011d20 con 0x7fa320136710 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 -- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 msgr2=0x7fa320138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa314009920 tx=0x7fa314009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:26.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 -- 172.21.15.19:0/3113066028 shutdown_connections 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa320139030 0x7fa32013b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 --2- 172.21.15.19:0/3113066028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320136710 0x7fa320138af0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 -- 172.21.15.19:0/3113066028 >> 172.21.15.19:0/3113066028 conn(0x7fa3200a2aa0 msgr2=0x7fa3200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 -- 172.21.15.19:0/3113066028 shutdown_connections 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.928+0000 7fa325f12700 1 -- 172.21.15.19:0/3113066028 wait complete. 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.929+0000 7fa325f12700 1 Processor -- start 2023-10-03T10:15:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 -- start start 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3201338a0 0x7fa32011add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 0x7fa32011b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa320138d90 con 0x7fa320136710 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32006f640 con 0x7fa320139030 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa325f12700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa32011c9d0 con 0x7fa3201338a0 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa31effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa31effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33728/0 (socket says 172.21.15.19:33728) 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa31effd700 1 -- 172.21.15.19:0/907593615 learned_addr learned my addr 172.21.15.19:0/907593615 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.930+0000 7fa31ffff700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 0x7fa32011b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31f7fe700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3201338a0 0x7fa32011add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 -- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3201338a0 msgr2=0x7fa32011add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3201338a0 0x7fa32011add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 -- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 msgr2=0x7fa32011b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 0x7fa32011b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 -- 172.21.15.19:0/907593615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa318009a70 con 0x7fa320136710 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31ffff700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 0x7fa32011b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa31effd700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa31400a010 tx=0x7fa314004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314004240 con 0x7fa320136710 2023-10-03T10:15:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31401f070 con 0x7fa320136710 2023-10-03T10:15:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.931+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa314009550 con 0x7fa320136710 2023-10-03T10:15:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.932+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140045c0 con 0x7fa320136710 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.932+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32011d0b0 con 0x7fa320136710 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.932+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa314021030 con 0x7fa320136710 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.933+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa3140409c0 con 0x7fa320136710 2023-10-03T10:15:26.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.933+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa320074ea0 con 0x7fa320136710 2023-10-03T10:15:26.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.938+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa31401a450 con 0x7fa320136710 2023-10-03T10:15:26.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.970+0000 7f786a7bb700 1 Processor -- start 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.970+0000 7f786a7bb700 1 -- start start 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f786a7bb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f786409e930 0x7f786409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f786a7bb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f786a7bb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7864070940 con 0x7f786409f650 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f786a7bb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786406fd60 con 0x7f786409e930 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f786a7bb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f786406fa80 con 0x7f786409f240 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f78637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f78637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36710/0 (socket says 172.21.15.19:36710) 2023-10-03T10:15:26.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f7863fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f786409e930 0x7f786409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.971+0000 7f78637fe700 1 -- 172.21.15.19:0/511953190 learned_addr learned my addr 172.21.15.19:0/511953190 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f78637fe700 1 -- 172.21.15.19:0/511953190 >> v2:172.21.15.19:3300/0 conn(0x7f786409e930 msgr2=0x7f786409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f78637fe700 1 --2- 172.21.15.19:0/511953190 >> v2:172.21.15.19:3300/0 conn(0x7f786409e930 0x7f786409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f78637fe700 1 -- 172.21.15.19:0/511953190 >> v1:172.21.15.19:6789/0 conn(0x7f786409f650 legacy=0x7f7864131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f78637fe700 1 -- 172.21.15.19:0/511953190 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786409fb60 con 0x7f786409f240 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f78637fe700 1 --2- 172.21.15.19:0/511953190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78580098f0 tx=0x7f7858009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2dce0875af49e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f7862ffd700 1 -- 172.21.15.19:0/511953190 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858011830 con 0x7f786409f240 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f7862ffd700 1 -- 172.21.15.19:0/511953190 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858011990 con 0x7f786409f240 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.972+0000 7f7862ffd700 1 -- 172.21.15.19:0/511953190 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858011d20 con 0x7f786409f240 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 -- 172.21.15.19:0/511953190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 msgr2=0x7f78641317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 --2- 172.21.15.19:0/511953190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f78580098f0 tx=0x7f7858009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:26.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 -- 172.21.15.19:0/511953190 shutdown_connections 2023-10-03T10:15:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 --2- 172.21.15.19:0/511953190 >> v2:172.21.15.19:3300/0 conn(0x7f786409e930 0x7f786409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 --2- 172.21.15.19:0/511953190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f78641317f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 -- 172.21.15.19:0/511953190 >> 172.21.15.19:0/511953190 conn(0x7f78640a4210 msgr2=0x7f78640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 -- 172.21.15.19:0/511953190 shutdown_connections 2023-10-03T10:15:26.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.973+0000 7f786a7bb700 1 -- 172.21.15.19:0/511953190 wait complete. 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.975+0000 7f786a7bb700 1 Processor -- start 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.975+0000 7f786a7bb700 1 -- start start 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f786409e930 0x7f786406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f786409f650 0x7f786406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78641b7280 con 0x7f786409f650 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78641a9430 con 0x7f786409e930 2023-10-03T10:15:26.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f786a7bb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78641a8950 con 0x7f786409f240 2023-10-03T10:15:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36722/0 (socket says 172.21.15.19:36722) 2023-10-03T10:15:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 -- 172.21.15.19:0/2696929969 learned_addr learned my addr 172.21.15.19:0/2696929969 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f7863fff700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f786409e930 0x7f786406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f7868d58700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f786409f650 0x7f786406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 -- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f786409e930 msgr2=0x7f786406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f786409e930 0x7f786406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 -- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f786409f650 msgr2=0x7f786406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f786409f650 0x7f786406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.976+0000 7f78637fe700 1 -- 172.21.15.19:0/2696929969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7858009550 con 0x7f786409f240 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f78637fe700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7858009c40 tx=0x7f7858004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858004400 con 0x7f786409f240 2023-10-03T10:15:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785801f070 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f786a7bb700 1 -- 172.21.15.19:0/2696929969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78640a0190 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580038e0 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.977+0000 7f786a7bb700 1 -- 172.21.15.19:0/2696929969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864071d20 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.978+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7858021030 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.978+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7858040b20 con 0x7f786409f240 2023-10-03T10:15:26.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.978+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c0052e0 con 0x7f786409f240 2023-10-03T10:15:26.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:26.983+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7858004560 con 0x7f786409f240 2023-10-03T10:15:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.058+0000 7fd71fa34700 1 Processor -- start 2023-10-03T10:15:27.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.058+0000 7fd71fa34700 1 -- start start 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71fa34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 0x7fd7180a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71fa34700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd718138d80 0x7fd71813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71fa34700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7180a2a70 con 0x7fd7180a0a30 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71fa34700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7180a01d0 con 0x7fd718138d80 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71fa34700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71809e2b0 con 0x7fd71809d630 2023-10-03T10:15:27.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71d7d0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd7180a0a30 0x7fd7180a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35900/0 (socket says 172.21.15.19:35900) 2023-10-03T10:15:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71d7d0700 1 -- 172.21.15.19:0/2921855564 learned_addr learned my addr 172.21.15.19:0/2921855564 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71cfcf700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 0x7fd7180a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd71dfd1700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd718138d80 0x7fd71813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.059+0000 7fd70ffff700 1 -- 172.21.15.19:0/2921855564 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119356002 0 0) 0x7fd7180a2a70 con 0x7fd7180a0a30 2023-10-03T10:15:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd70ffff700 1 -- 172.21.15.19:0/2921855564 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7040035b0 con 0x7fd7180a0a30 2023-10-03T10:15:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd71cfcf700 1 -- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd718138d80 msgr2=0x7fd71813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd71cfcf700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd718138d80 0x7fd71813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd71cfcf700 1 -- 172.21.15.19:0/2921855564 >> v1:172.21.15.19:6789/0 conn(0x7fd7180a0a30 legacy=0x7fd7180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd71cfcf700 1 -- 172.21.15.19:0/2921855564 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71809dc50 con 0x7fd71809d630 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd71cfcf700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 0x7fd7180a1510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd708009870 tx=0x7fd708009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3e052fc89529c4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd70ffff700 1 -- 172.21.15.19:0/2921855564 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011830 con 0x7fd71809d630 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd70ffff700 1 -- 172.21.15.19:0/2921855564 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708011990 con 0x7fd71809d630 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.060+0000 7fd70ffff700 1 -- 172.21.15.19:0/2921855564 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708011d20 con 0x7fd71809d630 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 -- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 msgr2=0x7fd7180a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 0x7fd7180a1510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd708009870 tx=0x7fd708009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 -- 172.21.15.19:0/2921855564 shutdown_connections 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd718138d80 0x7fd71813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 --2- 172.21.15.19:0/2921855564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d630 0x7fd7180a1510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 -- 172.21.15.19:0/2921855564 >> 172.21.15.19:0/2921855564 conn(0x7fd7180a3050 msgr2=0x7fd7180a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 -- 172.21.15.19:0/2921855564 shutdown_connections 2023-10-03T10:15:27.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.061+0000 7fd71fa34700 1 -- 172.21.15.19:0/2921855564 wait complete. 2023-10-03T10:15:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.062+0000 7fd71fa34700 1 Processor -- start 2023-10-03T10:15:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.062+0000 7fd71fa34700 1 -- start start 2023-10-03T10:15:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 0x7fd718133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 0x7fd718134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd718136250 con 0x7fd71809d630 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd718136f70 con 0x7fd7180a0a30 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71fa34700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71813ace0 con 0x7fd718138d80 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33740/0 (socket says 172.21.15.19:33740) 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 -- 172.21.15.19:0/3910888225 learned_addr learned my addr 172.21.15.19:0/3910888225 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71dfd1700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 0x7fd718134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71cfcf700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 0x7fd718133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 -- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 msgr2=0x7fd718134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 0x7fd718134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 -- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 msgr2=0x7fd718133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 0x7fd718133d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71d7d0700 1 -- 172.21.15.19:0/3910888225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080094a0 con 0x7fd71809d630 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71cfcf700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 0x7fd718133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.063+0000 7fd71dfd1700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 0x7fd718134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd71d7d0700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd714001bc0 tx=0x7fd714014050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714017070 con 0x7fd71809d630 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714005b70 con 0x7fd71809d630 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7180a0410 con 0x7fd71809d630 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7140120d0 con 0x7fd71809d630 2023-10-03T10:15:27.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.064+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7181379e0 con 0x7fd71809d630 2023-10-03T10:15:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.065+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd718137e90 con 0x7fd71809d630 2023-10-03T10:15:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.065+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd714012230 con 0x7fd71809d630 2023-10-03T10:15:27.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.065+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd714047220 con 0x7fd71809d630 2023-10-03T10:15:27.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.074+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd718137e90 con 0x7fd71809d630 2023-10-03T10:15:27.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.152+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa32006b9e0 con 0x7fa320136710 2023-10-03T10:15:27.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.152+0000 7fa307fff700 1 -- 172.21.15.19:0/907593615 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa314015030 con 0x7fa320136710 2023-10-03T10:15:27.153 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 msgr2=0x7fa32011b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fa31400a010 tx=0x7fa314004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 shutdown_connections 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa320139030 0x7fa32011b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3201338a0 0x7fa32011add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 --2- 172.21.15.19:0/907593615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa320136710 0x7fa32011b310 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 >> 172.21.15.19:0/907593615 conn(0x7fa3200a2aa0 msgr2=0x7fa3200a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 shutdown_connections 2023-10-03T10:15:27.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.155+0000 7fa325f12700 1 -- 172.21.15.19:0/907593615 wait complete. 2023-10-03T10:15:27.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:27.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.180+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18ec074ea0 con 0x7f18ec09d6f0 2023-10-03T10:15:27.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.180+0000 7f18daffd700 1 -- 172.21.15.19:0/1953091429 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18dc003dc0 con 0x7f18ec09d6f0 2023-10-03T10:15:27.181 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 msgr2=0x7f18ec11e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00bee0 tx=0x7f18dc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 shutdown_connections 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f18ec09e410 0x7f18ec11eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18ec09d6f0 0x7f18ec11e0e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 --2- 172.21.15.19:0/1953091429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f18ec09e000 0x7f18ec11e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 >> 172.21.15.19:0/1953091429 conn(0x7f18ec066f50 msgr2=0x7f18ec06f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 shutdown_connections 2023-10-03T10:15:27.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.183+0000 7f18f0f1b700 1 -- 172.21.15.19:0/1953091429 wait complete. 2023-10-03T10:15:27.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.198+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f783c005590 con 0x7f786409f240 2023-10-03T10:15:27.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.198+0000 7f7860ff9700 1 -- 172.21.15.19:0/2696929969 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7858015020 con 0x7f786409f240 2023-10-03T10:15:27.199 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.200+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 msgr2=0x7f786406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.200+0000 7f784a7fc700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7858009c40 tx=0x7f7858004750 comp rx=0 tx=0).stop 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 shutdown_connections 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f786409f650 0x7f786406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f786409e930 0x7f786406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 --2- 172.21.15.19:0/2696929969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f786409f240 0x7f786406bdf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 >> 172.21.15.19:0/2696929969 conn(0x7f78640a4210 msgr2=0x7f78641b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 shutdown_connections 2023-10-03T10:15:27.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.201+0000 7f784a7fc700 1 -- 172.21.15.19:0/2696929969 wait complete. 2023-10-03T10:15:27.215 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.284+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd718137e90 con 0x7fd71809d630 2023-10-03T10:15:27.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.284+0000 7fd70dffb700 1 -- 172.21.15.19:0/3910888225 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd718137e90 con 0x7fd71809d630 2023-10-03T10:15:27.285 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 msgr2=0x7fd7181337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd714001bc0 tx=0x7fd714014050 comp rx=0 tx=0).stop 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 shutdown_connections 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd718138d80 0x7fd718134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809d630 0x7fd7181337c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 --2- 172.21.15.19:0/3910888225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7180a0a30 0x7fd718133d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.286+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 >> 172.21.15.19:0/3910888225 conn(0x7fd7180a3050 msgr2=0x7fd71809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.287+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 shutdown_connections 2023-10-03T10:15:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:27.287+0000 7fd71fa34700 1 -- 172.21.15.19:0/3910888225 wait complete. 2023-10-03T10:15:27.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:28.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:28.198 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:28.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:28.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:28.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.333+0000 7fdc06d74700 1 Processor -- start 2023-10-03T10:15:28.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.333+0000 7fdc06d74700 1 -- start start 2023-10-03T10:15:28.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc06d74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009d6f0 0x7fdc0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc06d74700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 0x7fdc001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc06d74700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0009b120 con 0x7fdc0009e410 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc06d74700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0006b460 con 0x7fdc0009d6f0 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc06d74700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0009a7e0 con 0x7fdc0009e000 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc05311700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdc0009e410 0x7fdc00133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35912/0 (socket says 172.21.15.19:35912) 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc05311700 1 -- 172.21.15.19:0/233593678 learned_addr learned my addr 172.21.15.19:0/233593678 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdbfffff700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 0x7fdc001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.334+0000 7fdc04b10700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009d6f0 0x7fdc0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbfffff700 1 -- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009d6f0 msgr2=0x7fdc0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbfffff700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009d6f0 0x7fdc0009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbfffff700 1 -- 172.21.15.19:0/233593678 >> v1:172.21.15.19:6789/0 conn(0x7fdc0009e410 legacy=0x7fdc00133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbfffff700 1 -- 172.21.15.19:0/233593678 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0009a500 con 0x7fdc0009e000 2023-10-03T10:15:28.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbff7fe700 1 -- 172.21.15.19:0/233593678 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836660420 0 0) 0x7fdc0009b120 con 0x7fdc0009e410 2023-10-03T10:15:28.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbfffff700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 0x7fdc001339f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0098a0 tx=0x7fdbec009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c25a15404705575 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbff7fe700 1 -- 172.21.15.19:0/233593678 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec011830 con 0x7fdc0009e000 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbff7fe700 1 -- 172.21.15.19:0/233593678 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec011990 con 0x7fdc0009e000 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.335+0000 7fdbff7fe700 1 -- 172.21.15.19:0/233593678 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec011d40 con 0x7fdc0009e000 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.336+0000 7fdc06d74700 1 -- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 msgr2=0x7fdc001339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.336+0000 7fdc06d74700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 0x7fdc001339f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0098a0 tx=0x7fdbec009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.336+0000 7fdc06d74700 1 -- 172.21.15.19:0/233593678 shutdown_connections 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.336+0000 7fdc06d74700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009d6f0 0x7fdc0009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.337+0000 7fdc06d74700 1 --2- 172.21.15.19:0/233593678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e000 0x7fdc001339f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.337+0000 7fdc06d74700 1 -- 172.21.15.19:0/233593678 >> 172.21.15.19:0/233593678 conn(0x7fdc00066f50 msgr2=0x7fdc0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.337+0000 7fdc06d74700 1 -- 172.21.15.19:0/233593678 shutdown_connections 2023-10-03T10:15:28.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.337+0000 7fdc06d74700 1 -- 172.21.15.19:0/233593678 wait complete. 2023-10-03T10:15:28.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.338+0000 7fdc06d74700 1 Processor -- start 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.338+0000 7fdc06d74700 1 -- start start 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009e000 0x7fdc00122970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 0x7fdc00122eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00124eb0 con 0x7fdc0009d6f0 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc001252e0 con 0x7fdc0009e000 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc06d74700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00133770 con 0x7fdc0009e410 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc04b10700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc05311700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 0x7fdc00122eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc04b10700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33750/0 (socket says 172.21.15.19:33750) 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.339+0000 7fdc04b10700 1 -- 172.21.15.19:0/3901338283 learned_addr learned my addr 172.21.15.19:0/3901338283 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdbfffff700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009e000 0x7fdc00122970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 -- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009e000 msgr2=0x7fdc00122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009e000 0x7fdc00122970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 -- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 msgr2=0x7fdc00122430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 -- 172.21.15.19:0/3901338283 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0094a0 con 0x7fdc0009e410 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc04b10700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdc05311700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 0x7fdc00122eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc0009e8b0 tx=0x7fdbf800cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.340+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800aa40 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.341+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800abc0 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.341+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc00123890 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.341+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf80070d0 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.341+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0009c710 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.342+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbf8007230 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.342+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdbf803f490 con 0x7fdc0009e410 2023-10-03T10:15:28.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.342+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0011f030 con 0x7fdc0009e410 2023-10-03T10:15:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.352+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbf8018020 con 0x7fdc0009e410 2023-10-03T10:15:28.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 Processor -- start 2023-10-03T10:15:28.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 -- start start 2023-10-03T10:15:28.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 0x7f271812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271806fa40 con 0x7f271812cf60 2023-10-03T10:15:28.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271812cd90 con 0x7f271806f5d0 2023-10-03T10:15:28.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.371+0000 7f271e71f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2718071780 con 0x7f2718135c20 2023-10-03T10:15:28.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f27177fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 0x7f271812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51036/0 (socket says 172.21.15.19:51036) 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f27177fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 0x7f271812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33762/0 (socket says 172.21.15.19:33762) 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 -- 172.21.15.19:0/1372406037 learned_addr learned my addr 172.21.15.19:0/1372406037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 -- 172.21.15.19:0/1372406037 >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 msgr2=0x7f271812ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 --2- 172.21.15.19:0/1372406037 >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 0x7f271812ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 -- 172.21.15.19:0/1372406037 >> v1:172.21.15.19:6789/0 conn(0x7f271812cf60 legacy=0x7f271812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 -- 172.21.15.19:0/1372406037 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718071a40 con 0x7f2718135c20 2023-10-03T10:15:28.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7fa00a0d3700 1 Processor -- start 2023-10-03T10:15:28.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7f271ccbc700 1 --2- 172.21.15.19:0/1372406037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2710009ed0 tx=0x7f271000d540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4864f90a98d5bc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.372+0000 7fa00a0d3700 1 -- start start 2023-10-03T10:15:28.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7f2716ffd700 1 -- 172.21.15.19:0/1372406037 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000dce0 con 0x7f2718135c20 2023-10-03T10:15:28.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7f2716ffd700 1 -- 172.21.15.19:0/1372406037 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000de40 con 0x7f2718135c20 2023-10-03T10:15:28.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7f2716ffd700 1 -- 172.21.15.19:0/1372406037 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710003c40 con 0x7f2718135c20 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 0x7fa004131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa004099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00409a3b0 0x7fa004138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00409b580 con 0x7fa00409a3b0 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041313c0 con 0x7fa004131810 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa00a0d3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa00406e8c0 con 0x7fa004099a40 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa0037fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 0x7fa004131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa003fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00409a3b0 0x7fa004138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7f271e71f700 1 -- 172.21.15.19:0/1372406037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 msgr2=0x7f2718138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7f271e71f700 1 --2- 172.21.15.19:0/1372406037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2710009ed0 tx=0x7f271000d540 comp rx=0 tx=0).stop 2023-10-03T10:15:28.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa0037fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 0x7fa004131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51050/0 (socket says 172.21.15.19:51050) 2023-10-03T10:15:28.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa0037fe700 1 -- 172.21.15.19:0/1251406008 learned_addr learned my addr 172.21.15.19:0/1251406008 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.373+0000 7fa003fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa00409a3b0 0x7fa004138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33778/0 (socket says 172.21.15.19:33778) 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa002ffd700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa004099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 -- 172.21.15.19:0/1372406037 shutdown_connections 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 --2- 172.21.15.19:0/1372406037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f2718138000 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 --2- 172.21.15.19:0/1372406037 >> v2:172.21.15.19:3300/0 conn(0x7f271806f5d0 0x7f271812ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 -- 172.21.15.19:0/1372406037 >> 172.21.15.19:0/1372406037 conn(0x7f27180a2aa0 msgr2=0x7f27180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 -- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 msgr2=0x7fa004099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa004099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 -- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 msgr2=0x7fa004131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 0x7fa004131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 -- 172.21.15.19:0/1251406008 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00409a820 con 0x7fa00409a3b0 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 -- 172.21.15.19:0/1372406037 shutdown_connections 2023-10-03T10:15:28.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7f271e71f700 1 -- 172.21.15.19:0/1372406037 wait complete. 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa003fff700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00409a3b0 0x7fa004138650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009840 tx=0x7f9ff4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c09fbe596e1a9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa0027fc700 1 -- 172.21.15.19:0/1251406008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4011830 con 0x7fa00409a3b0 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa0027fc700 1 -- 172.21.15.19:0/1251406008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4011990 con 0x7fa00409a3b0 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.374+0000 7fa0027fc700 1 -- 172.21.15.19:0/1251406008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4011d20 con 0x7fa00409a3b0 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 -- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00409a3b0 msgr2=0x7fa004138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00409a3b0 0x7fa004138650 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009840 tx=0x7f9ff4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7f271e71f700 1 Processor -- start 2023-10-03T10:15:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 -- 172.21.15.19:0/1251406008 shutdown_connections 2023-10-03T10:15:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa004131810 0x7fa004131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa00409a3b0 0x7fa004138650 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.375+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/1251406008 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa004099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7fa00a0d3700 1 -- 172.21.15.19:0/1251406008 >> 172.21.15.19:0/1251406008 conn(0x7fa0040a2aa0 msgr2=0x7fa0040a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7fa00a0d3700 1 -- 172.21.15.19:0/1251406008 shutdown_connections 2023-10-03T10:15:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7f271e71f700 1 -- start start 2023-10-03T10:15:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7f271e71f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f271806f5d0 0x7f2718129190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7f271e71f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f271e71f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f27181c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f271e71f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271809b4c0 con 0x7f271806f5d0 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f271e71f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271809c900 con 0x7f2718135c20 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f271e71f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f271809b280 con 0x7f271812cf60 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.376+0000 7fa00a0d3700 1 -- 172.21.15.19:0/1251406008 wait complete. 2023-10-03T10:15:28.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7fa00a0d3700 1 Processor -- start 2023-10-03T10:15:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36774/0 (socket says 172.21.15.19:36774) 2023-10-03T10:15:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 -- 172.21.15.19:0/3527208009 learned_addr learned my addr 172.21.15.19:0/3527208009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 -- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 msgr2=0x7f27181c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f27181c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 -- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f271806f5d0 msgr2=0x7f2718129190 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f271806f5d0 0x7f2718129190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 -- 172.21.15.19:0/3527208009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009b30 con 0x7f271812cf60 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7f27177fe700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f270c00ae70 tx=0x7f270c008430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c008e40 con 0x7f271812cf60 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c015040 con 0x7f271812cf60 2023-10-03T10:15:28.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27180a1620 con 0x7f271812cf60 2023-10-03T10:15:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.377+0000 7fa00a0d3700 1 -- start start 2023-10-03T10:15:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa00411cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa00409a3b0 0x7fa00411d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00412cba0 con 0x7fa004131810 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00411a0d0 con 0x7fa00409a3b0 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa00a0d3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa004130990 con 0x7fa004099a40 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa003fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa003fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33792/0 (socket says 172.21.15.19:33792) 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa0037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa00411cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa003fff700 1 -- 172.21.15.19:0/3301886023 learned_addr learned my addr 172.21.15.19:0/3301886023 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2718099d50 con 0x7f271812cf60 2023-10-03T10:15:28.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0195f0 con 0x7f271812cf60 2023-10-03T10:15:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.378+0000 7fa002ffd700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa00409a3b0 0x7fa00411d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 -- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 msgr2=0x7fa00411cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa00411cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 -- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa00409a3b0 msgr2=0x7fa00411d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa00409a3b0 0x7fa00411d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 -- 172.21.15.19:0/3301886023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40094a0 con 0x7fa004131810 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa0037fe700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa00411cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa003fff700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009fd0 tx=0x7f9ff4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4004450 con 0x7fa004131810 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2718074ea0 con 0x7f271812cf60 2023-10-03T10:15:28.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff401f070 con 0x7fa004131810 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff40038e0 con 0x7fa004131810 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00411a520 con 0x7fa004131810 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.379+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00406eb00 con 0x7fa004131810 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.380+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ff4003a40 con 0x7fa004131810 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.380+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f270c019750 con 0x7f271812cf60 2023-10-03T10:15:28.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.380+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f270c0436f0 con 0x7f271812cf60 2023-10-03T10:15:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.380+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ff4021070 con 0x7fa004131810 2023-10-03T10:15:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.381+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe40052e0 con 0x7fa004131810 2023-10-03T10:15:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.386+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ff4015080 con 0x7fa004131810 2023-10-03T10:15:28.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.389+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f270c00b040 con 0x7f271812cf60 2023-10-03T10:15:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.455+0000 7f96beebd700 1 Processor -- start 2023-10-03T10:15:28.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.455+0000 7f96beebd700 1 -- start start 2023-10-03T10:15:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96beebd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 0x7f96b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96beebd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96b809ace0 0x7f96b809e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96beebd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b809b150 con 0x7f96b81339f0 2023-10-03T10:15:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96beebd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b809a500 con 0x7f96b809ace0 2023-10-03T10:15:28.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96beebd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b809e540 con 0x7f96b809d6f0 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96bcc59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 0x7f96b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96bcc59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 0x7f96b809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36794/0 (socket says 172.21.15.19:36794) 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96bcc59700 1 -- 172.21.15.19:0/2613757302 learned_addr learned my addr 172.21.15.19:0/2613757302 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2613757302 >> v2:172.21.15.19:3300/0 conn(0x7f96b809ace0 0x7f96b809e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.456+0000 7f96b77fe700 1 -- 172.21.15.19:0/2613757302 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360418295 0 0) 0x7f96b809b150 con 0x7f96b81339f0 2023-10-03T10:15:28.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b77fe700 1 -- 172.21.15.19:0/2613757302 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96a80035b0 con 0x7f96b81339f0 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b7fff700 1 -- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 msgr2=0x7f96b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 0x7f96b809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b7fff700 1 -- 172.21.15.19:0/2613757302 >> v1:172.21.15.19:6789/0 conn(0x7f96b81339f0 legacy=0x7f96b8133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b7fff700 1 -- 172.21.15.19:0/2613757302 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b809f720 con 0x7f96b809ace0 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809ace0 0x7f96b809e000 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009840 tx=0x7f96a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561a1fc5c1d0e027 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b77fe700 1 -- 172.21.15.19:0/2613757302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4011830 con 0x7f96b809ace0 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b77fe700 1 -- 172.21.15.19:0/2613757302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4011990 con 0x7f96b809ace0 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.457+0000 7f96b77fe700 1 -- 172.21.15.19:0/2613757302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4011d00 con 0x7f96b809ace0 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 -- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809ace0 msgr2=0x7f96b809e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 --2- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809ace0 0x7f96b809e000 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009840 tx=0x7f96a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 -- 172.21.15.19:0/2613757302 shutdown_connections 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 --2- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b809d6f0 0x7f96b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 --2- 172.21.15.19:0/2613757302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809ace0 0x7f96b809e000 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 -- 172.21.15.19:0/2613757302 >> 172.21.15.19:0/2613757302 conn(0x7f96b8066f50 msgr2=0x7f96b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 -- 172.21.15.19:0/2613757302 shutdown_connections 2023-10-03T10:15:28.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.458+0000 7f96beebd700 1 -- 172.21.15.19:0/2613757302 wait complete. 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.459+0000 7f96beebd700 1 Processor -- start 2023-10-03T10:15:28.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.459+0000 7f96beebd700 1 -- start start 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 0x7f96b81c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 0x7f96b81c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8120ee0 con 0x7f96b809d6f0 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b8120790 con 0x7f96b809ace0 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96beebd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96b80a2790 con 0x7f96b81339f0 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33806/0 (socket says 172.21.15.19:33806) 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 -- 172.21.15.19:0/2111515306 learned_addr learned my addr 172.21.15.19:0/2111515306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96bd45a700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 0x7f96b81c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 -- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 msgr2=0x7f96b81c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 0x7f96b81c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96bcc59700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 0x7f96b81c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 -- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 msgr2=0x7f96b81c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 0x7f96b81c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96b7fff700 1 -- 172.21.15.19:0/2111515306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40094a0 con 0x7f96b809d6f0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96bd45a700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 0x7f96b81c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.460+0000 7f96bcc59700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 0x7f96b81c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96b7fff700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f96a4000c00 tx=0x7f96a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40043c0 con 0x7f96b809d6f0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a401f070 con 0x7f96b809d6f0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b8121f80 con 0x7f96b809d6f0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a40036a0 con 0x7f96b809d6f0 2023-10-03T10:15:28.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.461+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b8122cb0 con 0x7f96b809d6f0 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.462+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96a4021030 con 0x7f96b809d6f0 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.462+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f96a4044290 con 0x7f96b809d6f0 2023-10-03T10:15:28.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.463+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b80747f0 con 0x7f96b809d6f0 2023-10-03T10:15:28.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.467+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96a4015020 con 0x7f96b809d6f0 2023-10-03T10:15:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.594+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9fe4005590 con 0x7fa004131810 2023-10-03T10:15:28.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.594+0000 7f9febfff700 1 -- 172.21.15.19:0/3301886023 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9ff401a430 con 0x7fa004131810 2023-10-03T10:15:28.595 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 msgr2=0x7fa00406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009fd0 tx=0x7f9ff4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 shutdown_connections 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa004131810 0x7fa00406f5e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa004099a40 0x7fa00411cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 --2- 172.21.15.19:0/3301886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa00409a3b0 0x7fa00411d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 >> 172.21.15.19:0/3301886023 conn(0x7fa0040a2aa0 msgr2=0x7fa00412e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 shutdown_connections 2023-10-03T10:15:28.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.598+0000 7fa00a0d3700 1 -- 172.21.15.19:0/3301886023 wait complete. 2023-10-03T10:15:28.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.604+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdc00074ea0 con 0x7fdc0009e410 2023-10-03T10:15:28.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.605+0000 7fdbfd7fa700 1 -- 172.21.15.19:0/3901338283 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbf80074e0 con 0x7fdc0009e410 2023-10-03T10:15:28.605 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:28.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 msgr2=0x7fdc00122eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 0x7fdc00122eb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdc0009e8b0 tx=0x7fdbf800cec0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 shutdown_connections 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc0009e410 0x7fdc00122eb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc0009d6f0 0x7fdc00122430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 --2- 172.21.15.19:0/3901338283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc0009e000 0x7fdc00122970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 >> 172.21.15.19:0/3901338283 conn(0x7fdc00066f50 msgr2=0x7fdc00133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 shutdown_connections 2023-10-03T10:15:28.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.607+0000 7fdc06d74700 1 -- 172.21.15.19:0/3901338283 wait complete. 2023-10-03T10:15:28.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.614+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f271809c580 con 0x7f271812cf60 2023-10-03T10:15:28.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.614+0000 7f2714ff9700 1 -- 172.21.15.19:0/3527208009 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f271809c580 con 0x7f271812cf60 2023-10-03T10:15:28.616 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 msgr2=0x7f27181296d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f270c00ae70 tx=0x7f270c008430 comp rx=0 tx=0).stop 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 shutdown_connections 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2718135c20 0x7f27181c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f271806f5d0 0x7f2718129190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 --2- 172.21.15.19:0/3527208009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f271812cf60 0x7f27181296d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 >> 172.21.15.19:0/3527208009 conn(0x7f27180a2aa0 msgr2=0x7f271812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 shutdown_connections 2023-10-03T10:15:28.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.617+0000 7f271e71f700 1 -- 172.21.15.19:0/3527208009 wait complete. 2023-10-03T10:15:28.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:28.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.705+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f96b8122170 con 0x7f96b809d6f0 2023-10-03T10:15:28.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.706+0000 7f96b57fa700 1 -- 172.21.15.19:0/2111515306 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96a4010970 con 0x7f96b809d6f0 2023-10-03T10:15:28.707 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:28.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 msgr2=0x7f96b81c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:28.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f96a4000c00 tx=0x7f96a4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:28.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 shutdown_connections 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96b81339f0 0x7f96b81c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96b809ace0 0x7f96b81c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 --2- 172.21.15.19:0/2111515306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96b809d6f0 0x7f96b81c8620 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 >> 172.21.15.19:0/2111515306 conn(0x7f96b8066f50 msgr2=0x7f96b80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 shutdown_connections 2023-10-03T10:15:28.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:28.708+0000 7f96beebd700 1 -- 172.21.15.19:0/2111515306 wait complete. 2023-10-03T10:15:28.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:29.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:29.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:29.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:29.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.777+0000 7f5245f72700 1 Processor -- start 2023-10-03T10:15:29.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.777+0000 7f5245f72700 1 -- start start 2023-10-03T10:15:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 0x7f5240130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f5240130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524009f520 con 0x7f524009e000 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524009f130 con 0x7f524009e410 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f5245f72700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f524009e930 con 0x7f524009d6f0 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f523effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 0x7f5240130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f523f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.778+0000 7f523effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 0x7f5240130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33816/0 (socket says 172.21.15.19:33816) 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523effd700 1 -- 172.21.15.19:0/731585796 learned_addr learned my addr 172.21.15.19:0/731585796 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523ffff700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f5240130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 -- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 msgr2=0x7f5240130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f5240130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 -- 172.21.15.19:0/731585796 >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 msgr2=0x7f5240130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 --2- 172.21.15.19:0/731585796 >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 0x7f5240130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 -- 172.21.15.19:0/731585796 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524009b2d0 con 0x7f524009d6f0 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523f7fe700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524009dac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f523000dc90 tx=0x7f523000f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a6839e477c20ce2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523e7fc700 1 -- 172.21.15.19:0/731585796 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230012070 con 0x7f524009d6f0 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523e7fc700 1 -- 172.21.15.19:0/731585796 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523000d2e0 con 0x7f524009d6f0 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.779+0000 7f523e7fc700 1 -- 172.21.15.19:0/731585796 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523000f8b0 con 0x7f524009d6f0 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.780+0000 7f5245f72700 1 -- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 msgr2=0x7f524009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.780+0000 7f5245f72700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524009dac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f523000dc90 tx=0x7f523000f050 comp rx=0 tx=0).stop 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 -- 172.21.15.19:0/731585796 shutdown_connections 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f5240130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 --2- 172.21.15.19:0/731585796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524009dac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 --2- 172.21.15.19:0/731585796 >> v2:172.21.15.19:3300/0 conn(0x7f524009e000 0x7f5240130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 -- 172.21.15.19:0/731585796 >> 172.21.15.19:0/731585796 conn(0x7f5240066f50 msgr2=0x7f524009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 -- 172.21.15.19:0/731585796 shutdown_connections 2023-10-03T10:15:29.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.781+0000 7f5245f72700 1 -- 172.21.15.19:0/731585796 wait complete. 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 Processor -- start 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 -- start start 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524011e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f524011ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.782+0000 7f5245f72700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524009c770 con 0x7f524009e000 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f5245f72700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52400a3b10 con 0x7f524009e410 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f5245f72700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52401205a0 con 0x7f524009d6f0 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33822/0 (socket says 172.21.15.19:33822) 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523effd700 1 -- 172.21.15.19:0/3993579767 learned_addr learned my addr 172.21.15.19:0/3993579767 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523f7fe700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524011e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f524011ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 -- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 msgr2=0x7f524011e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524011e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 -- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 msgr2=0x7f524011e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 -- 172.21.15.19:0/3993579767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523000d940 con 0x7f524009e410 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523f7fe700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523effd700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.783+0000 7f523ffff700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f524011ebb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5238007d90 tx=0x7f523800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.784+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238018070 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.784+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523800eb30 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.784+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52401202f0 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.784+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238003a20 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.784+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52401213e0 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.785+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5238014420 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.785+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524011ac20 con 0x7f524009e410 2023-10-03T10:15:29.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.785+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f523803f640 con 0x7f524009e410 2023-10-03T10:15:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.794+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52380126a0 con 0x7f524009e410 2023-10-03T10:15:29.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.811+0000 7fbaaa3cb700 1 Processor -- start 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.811+0000 7fbaaa3cb700 1 -- start start 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaaa3cb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaaa3cb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbaa4135c20 0x7fbaa4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaaa3cb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa406fa40 con 0x7fbaa412cf60 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaaa3cb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa412cd90 con 0x7fbaa4135c20 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaaa3cb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4071780 con 0x7fbaa406f5d0 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbaa412cf60 0x7fbaa412f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35940/0 (socket says 172.21.15.19:35940) 2023-10-03T10:15:29.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa3fff700 1 -- 172.21.15.19:0/4121308277 learned_addr learned my addr 172.21.15.19:0/4121308277 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa37fe700 1 --2- 172.21.15.19:0/4121308277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa8968700 1 --2- 172.21.15.19:0/4121308277 >> v2:172.21.15.19:3300/0 conn(0x7fbaa4135c20 0x7fbaa4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa2ffd700 1 -- 172.21.15.19:0/4121308277 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240477383 0 0) 0x7fbaa406fa40 con 0x7fbaa412cf60 2023-10-03T10:15:29.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa2ffd700 1 -- 172.21.15.19:0/4121308277 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba8c0046c0 con 0x7fbaa412cf60 2023-10-03T10:15:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa37fe700 1 -- 172.21.15.19:0/4121308277 >> v2:172.21.15.19:3300/0 conn(0x7fbaa4135c20 msgr2=0x7fbaa4138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa37fe700 1 --2- 172.21.15.19:0/4121308277 >> v2:172.21.15.19:3300/0 conn(0x7fbaa4135c20 0x7fbaa4138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa37fe700 1 -- 172.21.15.19:0/4121308277 >> v1:172.21.15.19:6789/0 conn(0x7fbaa412cf60 legacy=0x7fbaa412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.812+0000 7fbaa37fe700 1 -- 172.21.15.19:0/4121308277 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4071a40 con 0x7fbaa406f5d0 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.813+0000 7fbaa37fe700 1 --2- 172.21.15.19:0/4121308277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa412ffc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba98009840 tx=0x7fba98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7ea7bcd67255fde server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.813+0000 7fbaa2ffd700 1 -- 172.21.15.19:0/4121308277 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011830 con 0x7fbaa406f5d0 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.813+0000 7fbaa2ffd700 1 -- 172.21.15.19:0/4121308277 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba98011990 con 0x7fbaa406f5d0 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.813+0000 7fbaa2ffd700 1 -- 172.21.15.19:0/4121308277 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba98011d20 con 0x7fbaa406f5d0 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/4121308277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 msgr2=0x7fbaa412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/4121308277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa412ffc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fba98009840 tx=0x7fba98009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/4121308277 shutdown_connections 2023-10-03T10:15:29.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/4121308277 >> v2:172.21.15.19:3300/0 conn(0x7fbaa4135c20 0x7fbaa4138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/4121308277 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa412ffc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/4121308277 >> 172.21.15.19:0/4121308277 conn(0x7fbaa40a2aa0 msgr2=0x7fbaa40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/4121308277 shutdown_connections 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/4121308277 wait complete. 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7f1d1bbf0700 1 Processor -- start 2023-10-03T10:15:29.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7fbaaa3cb700 1 Processor -- start 2023-10-03T10:15:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.814+0000 7f1d1bbf0700 1 -- start start 2023-10-03T10:15:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d1409e410 0x7f1d14130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1409f520 con 0x7f1d1409e410 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1409f130 con 0x7f1d1409e000 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1bbf0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1409e930 con 0x7f1d1409d6f0 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1998c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1998c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36842/0 (socket says 172.21.15.19:36842) 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1998c700 1 -- 172.21.15.19:0/2051097699 learned_addr learned my addr 172.21.15.19:0/2051097699 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7f1d1a18d700 1 --2- 172.21.15.19:0/2051097699 >> v2:172.21.15.19:3300/0 conn(0x7f1d1409e410 0x7f1d14130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 -- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 msgr2=0x7f1d1409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 -- 172.21.15.19:0/2051097699 >> v2:172.21.15.19:3300/0 conn(0x7f1d1409e410 msgr2=0x7f1d14130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2051097699 >> v2:172.21.15.19:3300/0 conn(0x7f1d1409e410 0x7f1d14130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 -- 172.21.15.19:0/2051097699 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1409b2d0 con 0x7f1d1409e000 2023-10-03T10:15:29.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1998c700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.815+0000 7fbaaa3cb700 1 -- start start 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaa412cf60 0x7fbaa409c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4131590 con 0x7fbaa4135c20 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4131770 con 0x7fbaa412cf60 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaaa3cb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40a14d0 con 0x7fbaa406f5d0 2023-10-03T10:15:29.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14130660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009870 tx=0x7f1d04009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72cfaa26f41ae249 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaa8968700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaa8968700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33850/0 (socket says 172.21.15.19:33850) 2023-10-03T10:15:29.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7fbaa8968700 1 -- 172.21.15.19:0/3141338377 learned_addr learned my addr 172.21.15.19:0/3141338377 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1898a700 1 -- 172.21.15.19:0/2051097699 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011830 con 0x7f1d1409e000 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1898a700 1 -- 172.21.15.19:0/2051097699 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04011990 con 0x7f1d1409e000 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.816+0000 7f1d1898a700 1 -- 172.21.15.19:0/2051097699 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011d20 con 0x7f1d1409e000 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 -- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 msgr2=0x7fbaa409c2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa409c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 -- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaa412cf60 msgr2=0x7fbaa409c800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:29.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaa412cf60 0x7fbaa409c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 -- 172.21.15.19:0/3141338377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba980094a0 con 0x7fbaa4135c20 2023-10-03T10:15:29.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 msgr2=0x7f1d14130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14130660 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009870 tx=0x7f1d04009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:29.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7fbaa8968700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007e10 tx=0x7fba9c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2051097699 shutdown_connections 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 --2- 172.21.15.19:0/2051097699 >> v2:172.21.15.19:3300/0 conn(0x7f1d1409e410 0x7f1d14130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d1409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 --2- 172.21.15.19:0/2051097699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14130660 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2051097699 >> 172.21.15.19:0/2051097699 conn(0x7f1d14066f50 msgr2=0x7f1d1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2051097699 shutdown_connections 2023-10-03T10:15:29.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.817+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2051097699 wait complete. 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c00eea0 con 0x7fbaa4135c20 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c014420 con 0x7fbaa4135c20 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0147b0 con 0x7fbaa4135c20 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7f1d1bbf0700 1 Processor -- start 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7f1d1bbf0700 1 -- start start 2023-10-03T10:15:29.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d14122590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d1409e410 0x7f1d14123010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4129fa0 con 0x7fbaa4135c20 2023-10-03T10:15:29.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.818+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa409eb50 con 0x7fbaa4135c20 2023-10-03T10:15:29.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14126cb0 con 0x7f1d1409e410 2023-10-03T10:15:29.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d141257a0 con 0x7f1d1409e000 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1bbf0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14072570 con 0x7f1d1409d6f0 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51112/0 (socket says 172.21.15.19:51112) 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 -- 172.21.15.19:0/2566620152 learned_addr learned my addr 172.21.15.19:0/2566620152 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1998c700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d14122590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 -- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 msgr2=0x7f1d14122590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d14122590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 -- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d1409e410 msgr2=0x7f1d14123010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d1409e410 0x7f1d14123010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1918b700 1 -- 172.21.15.19:0/2566620152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1000b7f0 con 0x7f1d1409e000 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.819+0000 7f1d1998c700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d14122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:29.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d1918b700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d04013000 tx=0x7f1d04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d040044d0 con 0x7f1d1409e000 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0401f070 con 0x7f1d1409e000 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2566620152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d040094a0 con 0x7f1d1409e000 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d040038e0 con 0x7f1d1409e000 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.821+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba9c014910 con 0x7fbaa4135c20 2023-10-03T10:15:29.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.821+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba9c03ffb0 con 0x7fbaa4135c20 2023-10-03T10:15:29.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.820+0000 7f1d1bbf0700 1 -- 172.21.15.19:0/2566620152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1409c750 con 0x7f1d1409e000 2023-10-03T10:15:29.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.822+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf00052e0 con 0x7f1d1409e000 2023-10-03T10:15:29.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.822+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa41313d0 con 0x7fbaa4135c20 2023-10-03T10:15:29.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.823+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d04003a40 con 0x7f1d1409e000 2023-10-03T10:15:29.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.823+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d04021070 con 0x7f1d1409e000 2023-10-03T10:15:29.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.827+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d04010380 con 0x7f1d1409e000 2023-10-03T10:15:29.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.831+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba9c0122e0 con 0x7fbaa4135c20 2023-10-03T10:15:29.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 Processor -- start 2023-10-03T10:15:29.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 -- start start 2023-10-03T10:15:29.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 0x7f7900135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 0x7f7900138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f790009f130 con 0x7f790009d6f0 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790009f520 con 0x7f790009e1d0 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f7905319700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f790009e930 con 0x7f7900135e50 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.873+0000 7f78fe7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 0x7f7900135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78fe7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 0x7f7900135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33862/0 (socket says 172.21.15.19:33862) 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78fe7fc700 1 -- 172.21.15.19:0/523824753 learned_addr learned my addr 172.21.15.19:0/523824753 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 --2- 172.21.15.19:0/523824753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 0x7f7900138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78feffd700 1 --1- 172.21.15.19:0/523824753 >> v1:172.21.15.19:6789/0 conn(0x7f790009d6f0 0x7f790009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35956/0 (socket says 172.21.15.19:35956) 2023-10-03T10:15:29.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 -- 172.21.15.19:0/523824753 >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 msgr2=0x7f7900135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 --2- 172.21.15.19:0/523824753 >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 0x7f7900135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 -- 172.21.15.19:0/523824753 >> v1:172.21.15.19:6789/0 conn(0x7f790009d6f0 legacy=0x7f790009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 -- 172.21.15.19:0/523824753 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790009b2d0 con 0x7f7900135e50 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78fdffb700 1 -- 172.21.15.19:0/523824753 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137312239 0 0) 0x7f790009f130 con 0x7f790009d6f0 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78ff7fe700 1 --2- 172.21.15.19:0/523824753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 0x7f7900138230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fbcdacb70a04ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.874+0000 7f78fdffb700 1 -- 172.21.15.19:0/523824753 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f800e070 con 0x7f7900135e50 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f78fdffb700 1 -- 172.21.15.19:0/523824753 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f800bb20 con 0x7f7900135e50 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f78fdffb700 1 -- 172.21.15.19:0/523824753 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8012430 con 0x7f7900135e50 2023-10-03T10:15:29.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 -- 172.21.15.19:0/523824753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 msgr2=0x7f7900138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 --2- 172.21.15.19:0/523824753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 0x7f7900138230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009d90 tx=0x7f78f800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 -- 172.21.15.19:0/523824753 shutdown_connections 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 --2- 172.21.15.19:0/523824753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7900135e50 0x7f7900138230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 --2- 172.21.15.19:0/523824753 >> v2:172.21.15.19:3300/0 conn(0x7f790009e1d0 0x7f7900135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 -- 172.21.15.19:0/523824753 >> 172.21.15.19:0/523824753 conn(0x7f7900066f50 msgr2=0x7f790009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 -- 172.21.15.19:0/523824753 shutdown_connections 2023-10-03T10:15:29.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.875+0000 7f7905319700 1 -- 172.21.15.19:0/523824753 wait complete. 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.877+0000 7f7905319700 1 Processor -- start 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.877+0000 7f7905319700 1 -- start start 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790009d6f0 0x7f790011b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7900135e50 0x7f790011bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790011d4f0 con 0x7f7900135e50 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790011ee00 con 0x7f790009d6f0 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f7905319700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7900072630 con 0x7f790009e1d0 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78feffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790009d6f0 0x7f790011b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36866/0 (socket says 172.21.15.19:36866) 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 -- 172.21.15.19:0/3191745009 learned_addr learned my addr 172.21.15.19:0/3191745009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78ff7fe700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7900135e50 0x7f790011bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 -- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790009d6f0 msgr2=0x7f790011b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790009d6f0 0x7f790011b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 -- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7900135e50 msgr2=0x7f790011bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7900135e50 0x7f790011bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.878+0000 7f78fe7fc700 1 -- 172.21.15.19:0/3191745009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009a70 con 0x7f790009e1d0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f78fe7fc700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78f400e8e0 tx=0x7f78f400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4009600 con 0x7f790009e1d0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4013680 con 0x7f790009e1d0 2023-10-03T10:15:29.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790009c700 con 0x7f790009e1d0 2023-10-03T10:15:29.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4013a30 con 0x7f790009e1d0 2023-10-03T10:15:29.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.879+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f790011e590 con 0x7f790009e1d0 2023-10-03T10:15:29.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.880+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7900074ea0 con 0x7f790009e1d0 2023-10-03T10:15:29.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.880+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78f4013b90 con 0x7f790009e1d0 2023-10-03T10:15:29.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.881+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78f403f980 con 0x7f790009e1d0 2023-10-03T10:15:29.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:29.890+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78f40119a0 con 0x7f790009e1d0 2023-10-03T10:15:30.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.011+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5240074ea0 con 0x7f524009e410 2023-10-03T10:15:30.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.011+0000 7f5227fff700 1 -- 172.21.15.19:0/3993579767 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52380122e0 con 0x7f524009e410 2023-10-03T10:15:30.012 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 msgr2=0x7f524011ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f524011ebb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5238007d90 tx=0x7f523800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 shutdown_connections 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f524009e410 0x7f524011ebb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f524009d6f0 0x7f524011e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 --2- 172.21.15.19:0/3993579767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f524009e000 0x7f524011e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 >> 172.21.15.19:0/3993579767 conn(0x7f5240066f50 msgr2=0x7f5240130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 shutdown_connections 2023-10-03T10:15:30.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.014+0000 7f5245f72700 1 -- 172.21.15.19:0/3993579767 wait complete. 2023-10-03T10:15:30.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:30.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.041+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1cf0005860 con 0x7f1d1409e000 2023-10-03T10:15:30.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.042+0000 7f1d0a7fc700 1 -- 172.21.15.19:0/2566620152 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d0402b020 con 0x7f1d1409e000 2023-10-03T10:15:30.043 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:30.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 msgr2=0x7f1d14122ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1d04013000 tx=0x7f1d04004750 comp rx=0 tx=0).stop 2023-10-03T10:15:30.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 shutdown_connections 2023-10-03T10:15:30.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d1409e410 0x7f1d14123010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d1409d6f0 0x7f1d14122590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 --2- 172.21.15.19:0/2566620152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d1409e000 0x7f1d14122ad0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 >> 172.21.15.19:0/2566620152 conn(0x7f1d14066f50 msgr2=0x7f1d140a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 shutdown_connections 2023-10-03T10:15:30.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.044+0000 7f1cf7fff700 1 -- 172.21.15.19:0/2566620152 wait complete. 2023-10-03T10:15:30.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.047+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbaa4074ea0 con 0x7fbaa4135c20 2023-10-03T10:15:30.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.047+0000 7fbaa0ff9700 1 -- 172.21.15.19:0/3141338377 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba9c01bb00 con 0x7fbaa4135c20 2023-10-03T10:15:30.048 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:30.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 msgr2=0x7fbaa409cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fba9c007e10 tx=0x7fba9c00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 shutdown_connections 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaa4135c20 0x7fbaa409cd40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaa406f5d0 0x7fbaa409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 --2- 172.21.15.19:0/3141338377 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaa412cf60 0x7fbaa409c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 >> 172.21.15.19:0/3141338377 conn(0x7fbaa40a2aa0 msgr2=0x7fbaa406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.049+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 shutdown_connections 2023-10-03T10:15:30.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.050+0000 7fbaaa3cb700 1 -- 172.21.15.19:0/3141338377 wait complete. 2023-10-03T10:15:30.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:30.065 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:30.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.098+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f790011e140 con 0x7f790009e1d0 2023-10-03T10:15:30.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.098+0000 7f78e77fe700 1 -- 172.21.15.19:0/3191745009 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78f4011350 con 0x7f790009e1d0 2023-10-03T10:15:30.099 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 msgr2=0x7f790011b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f78f400e8e0 tx=0x7f78f400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 shutdown_connections 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7900135e50 0x7f790011bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790009d6f0 0x7f790011b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.100+0000 7f7905319700 1 --2- 172.21.15.19:0/3191745009 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790009e1d0 0x7f790011b820 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.101+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 >> 172.21.15.19:0/3191745009 conn(0x7f7900066f50 msgr2=0x7f79000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.101+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 shutdown_connections 2023-10-03T10:15:30.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:30.101+0000 7f7905319700 1 -- 172.21.15.19:0/3191745009 wait complete. 2023-10-03T10:15:30.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:31.030 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:31.061 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:31.066 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:31.116 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.185+0000 7f319df74700 1 Processor -- start 2023-10-03T10:15:31.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.185+0000 7f319df74700 1 -- start start 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f319df74700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 0x7f319809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f319df74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 0x7f31981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f319df74700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319809b120 con 0x7f319809e410 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f319df74700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319806b460 con 0x7f319809d6f0 2023-10-03T10:15:31.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f319df74700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319809a7e0 con 0x7f319809e000 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f31977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 0x7f319809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 0x7f31981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f31977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 0x7f319809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33878/0 (socket says 172.21.15.19:33878) 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f31977fe700 1 -- 172.21.15.19:0/123750709 learned_addr learned my addr 172.21.15.19:0/123750709 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.186+0000 7f3197fff700 1 --1- 172.21.15.19:0/123750709 >> v1:172.21.15.19:6789/0 conn(0x7f319809e410 0x7f3198133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35968/0 (socket says 172.21.15.19:35968) 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f3196ffd700 1 -- 172.21.15.19:0/123750709 >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 msgr2=0x7f319809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f3196ffd700 1 --2- 172.21.15.19:0/123750709 >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 0x7f319809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f3196ffd700 1 -- 172.21.15.19:0/123750709 >> v1:172.21.15.19:6789/0 conn(0x7f319809e410 legacy=0x7f3198133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f3196ffd700 1 -- 172.21.15.19:0/123750709 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319809a500 con 0x7f319809e000 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f3196ffd700 1 --2- 172.21.15.19:0/123750709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 0x7f31981339f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e930b8af569c7c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f31967fc700 1 -- 172.21.15.19:0/123750709 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c011830 con 0x7f319809e000 2023-10-03T10:15:31.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f31967fc700 1 -- 172.21.15.19:0/123750709 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318c011990 con 0x7f319809e000 2023-10-03T10:15:31.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.187+0000 7f31967fc700 1 -- 172.21.15.19:0/123750709 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318c011d20 con 0x7f319809e000 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 -- 172.21.15.19:0/123750709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 msgr2=0x7f31981339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 --2- 172.21.15.19:0/123750709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 0x7f31981339f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f318c009870 tx=0x7f318c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 -- 172.21.15.19:0/123750709 shutdown_connections 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 --2- 172.21.15.19:0/123750709 >> v2:172.21.15.19:3300/0 conn(0x7f319809d6f0 0x7f319809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 --2- 172.21.15.19:0/123750709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e000 0x7f31981339f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 -- 172.21.15.19:0/123750709 >> 172.21.15.19:0/123750709 conn(0x7f3198066f50 msgr2=0x7f319809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 -- 172.21.15.19:0/123750709 shutdown_connections 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.188+0000 7f319df74700 1 -- 172.21.15.19:0/123750709 wait complete. 2023-10-03T10:15:31.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.190+0000 7f319df74700 1 Processor -- start 2023-10-03T10:15:31.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.190+0000 7f319df74700 1 -- start start 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.190+0000 7f319df74700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f319809d6f0 0x7f31981a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.190+0000 7f319df74700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 0x7f31981a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f319df74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 0x7f31981a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f319df74700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a7340 con 0x7f319809e000 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f319df74700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a9920 con 0x7f319809e410 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f319df74700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a8cd0 con 0x7f319809d6f0 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 0x7f31981a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 0x7f31981a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 0x7f31981a63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33880/0 (socket says 172.21.15.19:33880) 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3196ffd700 1 -- 172.21.15.19:0/3795321493 learned_addr learned my addr 172.21.15.19:0/3795321493 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 -- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f319809d6f0 msgr2=0x7f31981a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f319809d6f0 0x7f31981a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 -- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 msgr2=0x7f31981a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 0x7f31981a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 -- 172.21.15.19:0/3795321493 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318c0094a0 con 0x7f319809e410 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.191+0000 7f3197fff700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 0x7f31981a6910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f319000cb10 tx=0x7f319000ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.192+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000aaa0 con 0x7f319809e410 2023-10-03T10:15:31.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.192+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319000ac00 con 0x7f319809e410 2023-10-03T10:15:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.192+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31981a7b10 con 0x7f319809e410 2023-10-03T10:15:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.192+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190007070 con 0x7f319809e410 2023-10-03T10:15:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.192+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981a8810 con 0x7f319809e410 2023-10-03T10:15:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.193+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198074ea0 con 0x7f319809e410 2023-10-03T10:15:31.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.194+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31900071d0 con 0x7f319809e410 2023-10-03T10:15:31.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.194+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f319003fa60 con 0x7f319809e410 2023-10-03T10:15:31.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.202+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3190007480 con 0x7f319809e410 2023-10-03T10:15:31.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.225+0000 7f7f20e09700 1 Processor -- start 2023-10-03T10:15:31.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.225+0000 7f7f20e09700 1 -- start start 2023-10-03T10:15:31.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f20e09700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09e930 0x7f7f1c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f20e09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f1c09f240 0x7f7f1c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f20e09700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c070940 con 0x7f7f1c09f650 2023-10-03T10:15:31.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f20e09700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c06fd60 con 0x7f7f1c09f240 2023-10-03T10:15:31.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f20e09700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06fa80 con 0x7f7f1c09e930 2023-10-03T10:15:31.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f1ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7f1c09f650 0x7f7f1c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35980/0 (socket says 172.21.15.19:35980) 2023-10-03T10:15:31.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f1ad9d700 1 -- 172.21.15.19:0/2499449955 learned_addr learned my addr 172.21.15.19:0/2499449955 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:31.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f19d9b700 1 --2- 172.21.15.19:0/2499449955 >> v2:172.21.15.19:3300/0 conn(0x7f7f1c09f240 0x7f7f1c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.226+0000 7f7f1a59c700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09e930 0x7f7f1c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f19d9b700 1 -- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09e930 msgr2=0x7f7f1c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f19d9b700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09e930 0x7f7f1c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f19d9b700 1 -- 172.21.15.19:0/2499449955 >> v1:172.21.15.19:6789/0 conn(0x7f7f1c09f650 legacy=0x7f7f1c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f19d9b700 1 -- 172.21.15.19:0/2499449955 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c09fb60 con 0x7f7f1c09f240 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f19d9b700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c1317f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009840 tx=0x7f7f10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda20de0bdf5fc57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f1959a700 1 -- 172.21.15.19:0/2499449955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011830 con 0x7f7f1c09f240 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f1959a700 1 -- 172.21.15.19:0/2499449955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f10011990 con 0x7f7f1c09f240 2023-10-03T10:15:31.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.227+0000 7f7f1959a700 1 -- 172.21.15.19:0/2499449955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10011d20 con 0x7f7f1c09f240 2023-10-03T10:15:31.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 -- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 msgr2=0x7f7f1c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c1317f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009840 tx=0x7f7f10009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:31.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 -- 172.21.15.19:0/2499449955 shutdown_connections 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09e930 0x7f7f1c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2499449955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c1317f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 -- 172.21.15.19:0/2499449955 >> 172.21.15.19:0/2499449955 conn(0x7f7f1c0a4210 msgr2=0x7f7f1c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 -- 172.21.15.19:0/2499449955 shutdown_connections 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.228+0000 7f7f20e09700 1 -- 172.21.15.19:0/2499449955 wait complete. 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.229+0000 7f7f20e09700 1 Processor -- start 2023-10-03T10:15:31.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 -- start start 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 0x7f7f1c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 0x7f7f1c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1a78e0 con 0x7f7f1c09f240 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1a88f0 con 0x7f7f1c09e930 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f20e09700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06cd10 con 0x7f7f1c09f650 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 0x7f7f1c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f1a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 0x7f7f1c06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51148/0 (socket says 172.21.15.19:51148) 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f1a59c700 1 -- 172.21.15.19:0/2724939962 learned_addr learned my addr 172.21.15.19:0/2724939962 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.230+0000 7f7f1ad9d700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 0x7f7f1c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f19d9b700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 -- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 msgr2=0x7f7f1c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 0x7f7f1c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 -- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 msgr2=0x7f7f1c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 -- 172.21.15.19:0/2724939962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100094a0 con 0x7f7f1c09f650 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f1ad9d700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 0x7f7f1c06c330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400cad0 tx=0x7f7f1400cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400a960 con 0x7f7f1c09f650 2023-10-03T10:15:31.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1400aac0 con 0x7f7f1c09f650 2023-10-03T10:15:31.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400ae30 con 0x7f7f1c09f650 2023-10-03T10:15:31.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c0a0190 con 0x7f7f1c09f650 2023-10-03T10:15:31.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.231+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c1a80e0 con 0x7f7f1c09f650 2023-10-03T10:15:31.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.233+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f1401b3b0 con 0x7f7f1c09f650 2023-10-03T10:15:31.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.233+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c074ea0 con 0x7f7f1c09f650 2023-10-03T10:15:31.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.233+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f1403f170 con 0x7f7f1c09f650 2023-10-03T10:15:31.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.235+0000 7f77c5f9d700 1 Processor -- start 2023-10-03T10:15:31.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 -- start start 2023-10-03T10:15:31.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 0x7f77c0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77c0130e50 0x7f77c006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c00716a0 con 0x7f77c006fb20 2023-10-03T10:15:31.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c009a390 con 0x7f77c0130e50 2023-10-03T10:15:31.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77c5f9d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0071290 con 0x7f77c0130540 2023-10-03T10:15:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77bf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 0x7f77c0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77beffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77c0130e50 0x7f77c006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77bf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 0x7f77c0130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51162/0 (socket says 172.21.15.19:51162) 2023-10-03T10:15:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.236+0000 7f77bf7fe700 1 -- 172.21.15.19:0/3791179843 learned_addr learned my addr 172.21.15.19:0/3791179843 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77beffd700 1 -- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 msgr2=0x7f77c0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77beffd700 1 --2- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 0x7f77c0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77be7fc700 1 -- 172.21.15.19:0/3791179843 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026282677 0 0) 0x7f77c00716a0 con 0x7f77c006fb20 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77beffd700 1 -- 172.21.15.19:0/3791179843 >> v1:172.21.15.19:6789/0 conn(0x7f77c006fb20 legacy=0x7f77c0137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77beffd700 1 -- 172.21.15.19:0/3791179843 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0130340 con 0x7f77c0130e50 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77beffd700 1 --2- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130e50 0x7f77c006f5e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009840 tx=0x7f77b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45e7a645bf342b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77be7fc700 1 -- 172.21.15.19:0/3791179843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4011830 con 0x7f77c0130e50 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77be7fc700 1 -- 172.21.15.19:0/3791179843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4011990 con 0x7f77c0130e50 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.237+0000 7f77be7fc700 1 -- 172.21.15.19:0/3791179843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4011d20 con 0x7f77c0130e50 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130e50 msgr2=0x7f77c006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130e50 0x7f77c006f5e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f77b4009840 tx=0x7f77b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3791179843 shutdown_connections 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130540 0x7f77c0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3791179843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130e50 0x7f77c006f5e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3791179843 >> 172.21.15.19:0/3791179843 conn(0x7f77c00a2aa0 msgr2=0x7f77c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3791179843 shutdown_connections 2023-10-03T10:15:31.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.238+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3791179843 wait complete. 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.240+0000 7f77c5f9d700 1 Processor -- start 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.240+0000 7f77c5f9d700 1 -- start start 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 0x7f77c0138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 0x7f77c01387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130e50 0x7f77c01c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0139940 con 0x7f77c0130540 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0136e20 con 0x7f77c0130e50 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77c5f9d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77c0139030 con 0x7f77c006fb20 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77bf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 0x7f77c0138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 0x7f77c01387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77bf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 0x7f77c0138290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36896/0 (socket says 172.21.15.19:36896) 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77bf7fe700 1 -- 172.21.15.19:0/3226625373 learned_addr learned my addr 172.21.15.19:0/3226625373 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77bffff700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130e50 0x7f77c01c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 -- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 msgr2=0x7f77c0138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 0x7f77c0138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 -- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130e50 msgr2=0x7f77c01c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130e50 0x7f77c01c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.241+0000 7f77beffd700 1 -- 172.21.15.19:0/3226625373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40094a0 con 0x7f77c0130540 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77beffd700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 0x7f77c01387d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f77c00a35d0 tx=0x7f77b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4004220 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b4024070 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c0136b60 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40045c0 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c0138d10 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.243+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77b401b6c0 con 0x7f77c0130540 2023-10-03T10:15:31.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.243+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77b4026070 con 0x7f77c0130540 2023-10-03T10:15:31.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.242+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f1401b660 con 0x7f7f1c09f650 2023-10-03T10:15:31.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.243+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00052e0 con 0x7f77c0130540 2023-10-03T10:15:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.248+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77b4015070 con 0x7f77c0130540 2023-10-03T10:15:31.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.272+0000 7ff21b23a700 1 Processor -- start 2023-10-03T10:15:31.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.272+0000 7ff21b23a700 1 -- start start 2023-10-03T10:15:31.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff21b23a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff21409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff21b23a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff214134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff21b23a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21409b120 con 0x7ff21409e000 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff21b23a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21406b460 con 0x7ff21409d6f0 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff21b23a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff21409a7e0 con 0x7ff21409e410 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff218fd6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff21409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff213fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff21409e000 0x7ff2141339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36004/0 (socket says 172.21.15.19:36004) 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff213fff700 1 -- 172.21.15.19:0/2426048927 learned_addr learned my addr 172.21.15.19:0/2426048927 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff218fd6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff21409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51182/0 (socket says 172.21.15.19:51182) 2023-10-03T10:15:31.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2197d7700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff214134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2137fe700 1 -- 172.21.15.19:0/2426048927 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442359770 0 0) 0x7ff21409b120 con 0x7ff21409e000 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2137fe700 1 -- 172.21.15.19:0/2426048927 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2040035b0 con 0x7ff21409e000 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2197d7700 1 -- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 msgr2=0x7ff21409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2197d7700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff21409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2197d7700 1 -- 172.21.15.19:0/2426048927 >> v1:172.21.15.19:6789/0 conn(0x7ff21409e000 legacy=0x7ff2141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.273+0000 7ff2197d7700 1 -- 172.21.15.19:0/2426048927 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21409a500 con 0x7ff21409e410 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff2197d7700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff214134100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009df0 tx=0x7ff20c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=984bcd76d00fb129 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff2137fe700 1 -- 172.21.15.19:0/2426048927 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00e070 con 0x7ff21409e410 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff2137fe700 1 -- 172.21.15.19:0/2426048927 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00baa0 con 0x7ff21409e410 2023-10-03T10:15:31.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff2137fe700 1 -- 172.21.15.19:0/2426048927 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00be50 con 0x7ff21409e410 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff21b23a700 1 -- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 msgr2=0x7ff214134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.274+0000 7ff21b23a700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff214134100 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff20c009df0 tx=0x7ff20c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 -- 172.21.15.19:0/2426048927 shutdown_connections 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff214134100 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 --2- 172.21.15.19:0/2426048927 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff21409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 -- 172.21.15.19:0/2426048927 >> 172.21.15.19:0/2426048927 conn(0x7ff214066f50 msgr2=0x7ff21409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 -- 172.21.15.19:0/2426048927 shutdown_connections 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.275+0000 7ff21b23a700 1 -- 172.21.15.19:0/2426048927 wait complete. 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.276+0000 7ff21b23a700 1 Processor -- start 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.276+0000 7ff21b23a700 1 -- start start 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff2141b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21409e000 0x7ff2141b8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2141a6a00 con 0x7ff21409e000 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2140a1d00 con 0x7ff21409d6f0 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff21b23a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff21409c710 con 0x7ff21409e410 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff213fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21409e000 0x7ff2141b8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36912/0 (socket says 172.21.15.19:36912) 2023-10-03T10:15:31.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 -- 172.21.15.19:0/3988977489 learned_addr learned my addr 172.21.15.19:0/3988977489 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff218fd6700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff2141b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 -- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 msgr2=0x7ff2141b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff2141b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 -- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21409e000 msgr2=0x7ff2141b8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21409e000 0x7ff2141b8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 -- 172.21.15.19:0/3988977489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009a70 con 0x7ff21409e410 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff218fd6700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff2141b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:31.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.277+0000 7ff2197d7700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff21409a970 tx=0x7ff20c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.278+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0048a0 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.278+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c003e10 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.278+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c026680 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.278+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2141a7fe0 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.278+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2141b9090 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.279+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff20c0267e0 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.279+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff20c041850 con 0x7ff21409e410 2023-10-03T10:15:31.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.279+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2141a7e40 con 0x7ff21409e410 2023-10-03T10:15:31.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.288+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2141a7e40 con 0x7ff21409e410 2023-10-03T10:15:31.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.454+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f31981a7ab0 con 0x7f319809e410 2023-10-03T10:15:31.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.455+0000 7f317ffff700 1 -- 172.21.15.19:0/3795321493 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3190017030 con 0x7f319809e410 2023-10-03T10:15:31.456 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:31.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 msgr2=0x7f31981a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 0x7f31981a6910 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f319000cb10 tx=0x7f319000ce20 comp rx=0 tx=0).stop 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 shutdown_connections 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f319809e410 0x7f31981a6910 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f319809d6f0 0x7f31981a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 --2- 172.21.15.19:0/3795321493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f319809e000 0x7f31981a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.458+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 >> 172.21.15.19:0/3795321493 conn(0x7f3198066f50 msgr2=0x7f31981badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.459+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 shutdown_connections 2023-10-03T10:15:31.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.459+0000 7f319df74700 1 -- 172.21.15.19:0/3795321493 wait complete. 2023-10-03T10:15:31.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:31.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.484+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f77a0005590 con 0x7f77c0130540 2023-10-03T10:15:31.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.485+0000 7f77a7fff700 1 -- 172.21.15.19:0/3226625373 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77b4015020 con 0x7f77c0130540 2023-10-03T10:15:31.486 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:31.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 msgr2=0x7f77c01387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 0x7f77c01387d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f77c00a35d0 tx=0x7f77b4004750 comp rx=0 tx=0).stop 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 shutdown_connections 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77c0130e50 0x7f77c01c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77c006fb20 0x7f77c0138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 --2- 172.21.15.19:0/3226625373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77c0130540 0x7f77c01387d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 >> 172.21.15.19:0/3226625373 conn(0x7f77c00a2aa0 msgr2=0x7f77c006e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 shutdown_connections 2023-10-03T10:15:31.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.487+0000 7f77c5f9d700 1 -- 172.21.15.19:0/3226625373 wait complete. 2023-10-03T10:15:31.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.492+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f1c1a80e0 con 0x7f7f1c09f650 2023-10-03T10:15:31.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.492+0000 7f7f0affd700 1 -- 172.21.15.19:0/2724939962 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f1c1a80e0 con 0x7f7f1c09f650 2023-10-03T10:15:31.493 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.494+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 msgr2=0x7f7f1c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.494+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 0x7f7f1c06c330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400cad0 tx=0x7f7f1400cde0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 shutdown_connections 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1c09f650 0x7f7f1c06c330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1c09e930 0x7f7f1c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 --2- 172.21.15.19:0/2724939962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1c09f240 0x7f7f1c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 >> 172.21.15.19:0/2724939962 conn(0x7f7f1c0a4210 msgr2=0x7f7f1c1b8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 shutdown_connections 2023-10-03T10:15:31.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.495+0000 7f7f20e09700 1 -- 172.21.15.19:0/2724939962 wait complete. 2023-10-03T10:15:31.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:31.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.523+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff2141a7e40 con 0x7ff21409e410 2023-10-03T10:15:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.523+0000 7ff2117fa700 1 -- 172.21.15.19:0/3988977489 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2141a7e40 con 0x7ff21409e410 2023-10-03T10:15:31.524 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 msgr2=0x7ff2141c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff21409a970 tx=0x7ff20c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 shutdown_connections 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21409e410 0x7ff2141c8020 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21409d6f0 0x7ff2141b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 --2- 172.21.15.19:0/3988977489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21409e000 0x7ff2141b8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:31.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 >> 172.21.15.19:0/3988977489 conn(0x7ff214066f50 msgr2=0x7ff2141bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:31.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 shutdown_connections 2023-10-03T10:15:31.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:31.526+0000 7ff21b23a700 1 -- 172.21.15.19:0/3988977489 wait complete. 2023-10-03T10:15:31.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:32.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:32.504 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:32.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:32.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.635+0000 7f401861e700 1 Processor -- start 2023-10-03T10:15:32.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.635+0000 7f401861e700 1 -- start start 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f401861e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4010131810 0x7f4010131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f401861e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4010099a40 0x7f4010099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f401861e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401009a850 con 0x7f401009a3b0 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f401861e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f401009b580 con 0x7f4010099a40 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f401861e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40101313c0 con 0x7f4010131810 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4010099a40 0x7f4010099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4010099a40 0x7f4010099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33960/0 (socket says 172.21.15.19:33960) 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f40163ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4010131810 0x7f4010131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 -- 172.21.15.19:0/504364477 learned_addr learned my addr 172.21.15.19:0/504364477 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 -- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4010131810 msgr2=0x7f4010131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 --2- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4010131810 0x7f4010131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 -- 172.21.15.19:0/504364477 >> v1:172.21.15.19:6789/0 conn(0x7f401009a3b0 legacy=0x7f4010138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f4015bb9700 1 -- 172.21.15.19:0/504364477 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401006e8c0 con 0x7f4010099a40 2023-10-03T10:15:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.636+0000 7f40153b8700 1 -- 172.21.15.19:0/504364477 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181985450 0 0) 0x7f401009a850 con 0x7f401009a3b0 2023-10-03T10:15:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.637+0000 7f4015bb9700 1 --2- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f4010099e70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4000009920 tx=0x7f4000009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1922be258b5882c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.637+0000 7f40153b8700 1 -- 172.21.15.19:0/504364477 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011830 con 0x7f4010099a40 2023-10-03T10:15:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.637+0000 7f40153b8700 1 -- 172.21.15.19:0/504364477 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4000011990 con 0x7f4010099a40 2023-10-03T10:15:32.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.637+0000 7f40153b8700 1 -- 172.21.15.19:0/504364477 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000011d20 con 0x7f4010099a40 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 -- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 msgr2=0x7f4010099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 --2- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f4010099e70 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4000009920 tx=0x7f4000009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 -- 172.21.15.19:0/504364477 shutdown_connections 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 --2- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4010131810 0x7f4010131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 --2- 172.21.15.19:0/504364477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f4010099e70 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 -- 172.21.15.19:0/504364477 >> 172.21.15.19:0/504364477 conn(0x7f40100a2aa0 msgr2=0x7f40100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 -- 172.21.15.19:0/504364477 shutdown_connections 2023-10-03T10:15:32.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.638+0000 7f401861e700 1 -- 172.21.15.19:0/504364477 wait complete. 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.640+0000 7f401861e700 1 Processor -- start 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.640+0000 7f401861e700 1 -- start start 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.640+0000 7f401861e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.640+0000 7f401861e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f401009a3b0 0x7f4010119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f401861e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4010131810 0x7f401011a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f401861e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401011b710 con 0x7f4010099a40 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f401861e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401011c7d0 con 0x7f4010131810 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f401861e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f401006eb00 con 0x7f401009a3b0 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33968/0 (socket says 172.21.15.19:33968) 2023-10-03T10:15:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 -- 172.21.15.19:0/340581860 learned_addr learned my addr 172.21.15.19:0/340581860 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f4016bbb700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4010131810 0x7f401011a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f4015bb9700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f401009a3b0 0x7f4010119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 -- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f401009a3b0 msgr2=0x7f4010119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f401009a3b0 0x7f4010119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 -- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4010131810 msgr2=0x7f401011a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4010131810 0x7f401011a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 -- 172.21.15.19:0/340581860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009550 con 0x7f4010099a40 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.641+0000 7f40163ba700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f400c012fc0 tx=0x7f400c0100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.642+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00dbb0 con 0x7f4010099a40 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.642+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c013040 con 0x7f4010099a40 2023-10-03T10:15:32.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.642+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40100a1a90 con 0x7f4010099a40 2023-10-03T10:15:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.642+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c010b40 con 0x7f4010099a40 2023-10-03T10:15:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.642+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401011c380 con 0x7f4010099a40 2023-10-03T10:15:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.643+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f400c010ca0 con 0x7f4010099a40 2023-10-03T10:15:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.643+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4010074ea0 con 0x7f4010099a40 2023-10-03T10:15:32.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.643+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f400c0436e0 con 0x7f4010099a40 2023-10-03T10:15:32.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.649+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f400c016750 con 0x7f4010099a40 2023-10-03T10:15:32.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.670+0000 7f01bd061700 1 Processor -- start 2023-10-03T10:15:32.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.670+0000 7f7c5aa86700 1 Processor -- start 2023-10-03T10:15:32.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.670+0000 7f01bd061700 1 -- start start 2023-10-03T10:15:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.670+0000 7f7c5aa86700 1 -- start start 2023-10-03T10:15:32.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01bd061700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01bd061700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f01b8136f50 0x7f01b8139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01bd061700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b809b4f0 con 0x7f01b8131810 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01bd061700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b81313c0 con 0x7f01b8136f50 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01bd061700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b806e8c0 con 0x7f01b8134630 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51202/0 (socket says 172.21.15.19:51202) 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 -- 172.21.15.19:0/3189506009 learned_addr learned my addr 172.21.15.19:0/3189506009 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f7c5aa86700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c54133510 0x7f7c541358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f7c5aa86700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f7c5aa86700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c54130260 con 0x7f7c54130670 2023-10-03T10:15:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f7c5aa86700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5409a350 con 0x7f7c54133510 2023-10-03T10:15:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f7c5aa86700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54071ff0 con 0x7f7c54135e30 2023-10-03T10:15:32.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 -- 172.21.15.19:0/3189506009 >> v2:172.21.15.19:3300/0 conn(0x7f01b8136f50 msgr2=0x7f01b8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 --2- 172.21.15.19:0/3189506009 >> v2:172.21.15.19:3300/0 conn(0x7f01b8136f50 0x7f01b8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 -- 172.21.15.19:0/3189506009 >> v1:172.21.15.19:6789/0 conn(0x7f01b8131810 legacy=0x7f01b8131be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.671+0000 7f01b659c700 1 -- 172.21.15.19:0/3189506009 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8071d20 con 0x7f01b8134630 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f01b659c700 1 --2- 172.21.15.19:0/3189506009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0098f0 tx=0x7f01ac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3686be63b660f023 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51210/0 (socket says 172.21.15.19:51210) 2023-10-03T10:15:32.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 -- 172.21.15.19:0/3403125683 learned_addr learned my addr 172.21.15.19:0/3403125683 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f01b5d9b700 1 -- 172.21.15.19:0/3189506009 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac004230 con 0x7f01b8134630 2023-10-03T10:15:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f01b5d9b700 1 -- 172.21.15.19:0/3189506009 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac004390 con 0x7f01b8134630 2023-10-03T10:15:32.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f01b5d9b700 1 -- 172.21.15.19:0/3189506009 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac0036a0 con 0x7f01b8134630 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 -- 172.21.15.19:0/3403125683 >> v2:172.21.15.19:3300/0 conn(0x7f7c54133510 msgr2=0x7f7c541358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 --2- 172.21.15.19:0/3403125683 >> v2:172.21.15.19:3300/0 conn(0x7f7c54133510 0x7f7c541358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 -- 172.21.15.19:0/3403125683 >> v1:172.21.15.19:6789/0 conn(0x7f7c54130670 legacy=0x7f7c54130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 -- 172.21.15.19:0/3403125683 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5409ecf0 con 0x7f7c54135e30 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c59023700 1 --2- 172.21.15.19:0/3403125683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d150 tx=0x7f7c4c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287f03ea33b88c7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c537fe700 1 -- 172.21.15.19:0/3403125683 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c010070 con 0x7f7c54135e30 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c537fe700 1 -- 172.21.15.19:0/3403125683 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4c00dd80 con 0x7f7c54135e30 2023-10-03T10:15:32.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.672+0000 7f7c537fe700 1 -- 172.21.15.19:0/3403125683 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4c00b310 con 0x7f7c54135e30 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 -- 172.21.15.19:0/3189506009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 msgr2=0x7f01b8136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 --2- 172.21.15.19:0/3189506009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0098f0 tx=0x7f01ac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 -- 172.21.15.19:0/3189506009 shutdown_connections 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 --2- 172.21.15.19:0/3189506009 >> v2:172.21.15.19:3300/0 conn(0x7f01b8136f50 0x7f01b8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 --2- 172.21.15.19:0/3189506009 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8134630 0x7f01b8136a10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 -- 172.21.15.19:0/3189506009 >> 172.21.15.19:0/3189506009 conn(0x7f01b80a2aa0 msgr2=0x7f01b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 -- 172.21.15.19:0/3189506009 shutdown_connections 2023-10-03T10:15:32.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f01bd061700 1 -- 172.21.15.19:0/3189506009 wait complete. 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f7c5aa86700 1 -- 172.21.15.19:0/3403125683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 msgr2=0x7f7c54138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.673+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/3403125683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c00d150 tx=0x7f7c4c00d460 comp rx=0 tx=0).stop 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 -- 172.21.15.19:0/3403125683 shutdown_connections 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/3403125683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54135e30 0x7f7c54138210 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/3403125683 >> v2:172.21.15.19:3300/0 conn(0x7f7c54133510 0x7f7c541358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 -- 172.21.15.19:0/3403125683 >> 172.21.15.19:0/3403125683 conn(0x7f7c540a2aa0 msgr2=0x7f7c540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 -- 172.21.15.19:0/3403125683 shutdown_connections 2023-10-03T10:15:32.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f7c5aa86700 1 -- 172.21.15.19:0/3403125683 wait complete. 2023-10-03T10:15:32.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f01bd061700 1 Processor -- start 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.674+0000 7f01bd061700 1 -- start start 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8136f50 0x7f01b81c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f01b812c910 0x7f01b812cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b809e680 con 0x7f01b81c67f0 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8118cd0 con 0x7f01b8136f50 2023-10-03T10:15:32.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f01bd061700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01b81c7120 con 0x7f01b812c910 2023-10-03T10:15:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f7c5aa86700 1 Processor -- start 2023-10-03T10:15:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.675+0000 7f7c5aa86700 1 -- start start 2023-10-03T10:15:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c54130670 0x7f7c5409c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c54135e30 0x7f7c5409cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c541226c0 con 0x7f7c54130670 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54135b20 con 0x7f7c54133510 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c5aa86700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5412d350 con 0x7f7c54135e30 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.676+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51214/0 (socket says 172.21.15.19:51214) 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 -- 172.21.15.19:0/227941755 learned_addr learned my addr 172.21.15.19:0/227941755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c58822700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c54130670 0x7f7c5409c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 -- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c54135e30 msgr2=0x7f7c5409cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c54135e30 0x7f7c5409cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 -- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c54130670 msgr2=0x7f7c5409c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c54130670 0x7f7c5409c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 -- 172.21.15.19:0/227941755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c00bd40 con 0x7f7c54133510 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34006/0 (socket says 172.21.15.19:34006) 2023-10-03T10:15:32.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 -- 172.21.15.19:0/658469141 learned_addr learned my addr 172.21.15.19:0/658469141 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c53fff700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000b560 tx=0x7f7c4000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40011830 con 0x7f7c54133510 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c40011990 con 0x7f7c54133510 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40011d40 con 0x7f7c54133510 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.678+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c54071820 con 0x7f7c54133510 2023-10-03T10:15:32.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.678+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5409e490 con 0x7f7c54133510 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 -- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f01b812c910 msgr2=0x7f01b812cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f01b812c910 0x7f01b812cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 -- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8136f50 msgr2=0x7f01b81c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.677+0000 7f01b659c700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8136f50 0x7f01b81c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.678+0000 7f01b659c700 1 -- 172.21.15.19:0/658469141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac009550 con 0x7f01b81c67f0 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.678+0000 7f01b659c700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004000 tx=0x7f01ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.679+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c541231f0 con 0x7f7c54133510 2023-10-03T10:15:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.679+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c4001a400 con 0x7f7c54133510 2023-10-03T10:15:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.680+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c4003f700 con 0x7f7c54133510 2023-10-03T10:15:32.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.681+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac003db0 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.681+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac01f070 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.681+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b811b6e0 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.681+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00b880 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.681+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b80a1f70 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.682+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01ac021070 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.682+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f01ac040bc0 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.683+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b81309c0 con 0x7f01b81c67f0 2023-10-03T10:15:32.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.685+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c4000f8d0 con 0x7f7c54133510 2023-10-03T10:15:32.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.688+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f01ac024470 con 0x7f01b81c67f0 2023-10-03T10:15:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.738+0000 7f40bb43d700 1 Processor -- start 2023-10-03T10:15:32.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.739+0000 7f40bb43d700 1 -- start start 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40bb43d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409d6f0 0x7f40b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40bb43d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 0x7f40b4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40bb43d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b409b120 con 0x7f40b409e000 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40bb43d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b406b460 con 0x7f40b409d6f0 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40bb43d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b409a7e0 con 0x7f40b409e410 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b89d8700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f40b409e000 0x7f40b41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36034/0 (socket says 172.21.15.19:36034) 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b89d8700 1 -- 172.21.15.19:0/4042783309 learned_addr learned my addr 172.21.15.19:0/4042783309 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b91d9700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409d6f0 0x7f40b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b99da700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 0x7f40b4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40abfff700 1 -- 172.21.15.19:0/4042783309 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707394066 0 0) 0x7f40b409b120 con 0x7f40b409e000 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40abfff700 1 -- 172.21.15.19:0/4042783309 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a00035b0 con 0x7f40b409e000 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b99da700 1 -- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409d6f0 msgr2=0x7f40b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b99da700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409d6f0 0x7f40b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b99da700 1 -- 172.21.15.19:0/4042783309 >> v1:172.21.15.19:6789/0 conn(0x7f40b409e000 legacy=0x7f40b41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.740+0000 7f40b99da700 1 -- 172.21.15.19:0/4042783309 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b409a500 con 0x7f40b409e410 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.741+0000 7f40b99da700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 0x7f40b4134100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009df0 tx=0x7f40ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f62a638ad93a9bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.741+0000 7f40abfff700 1 -- 172.21.15.19:0/4042783309 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00e070 con 0x7f40b409e410 2023-10-03T10:15:32.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.741+0000 7f40abfff700 1 -- 172.21.15.19:0/4042783309 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00bae0 con 0x7f40b409e410 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.741+0000 7f40abfff700 1 -- 172.21.15.19:0/4042783309 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00be70 con 0x7f40b409e410 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 -- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 msgr2=0x7f40b4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 0x7f40b4134100 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009df0 tx=0x7f40ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 -- 172.21.15.19:0/4042783309 shutdown_connections 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e410 0x7f40b4134100 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 --2- 172.21.15.19:0/4042783309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409d6f0 0x7f40b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 -- 172.21.15.19:0/4042783309 >> 172.21.15.19:0/4042783309 conn(0x7f40b4066f50 msgr2=0x7f40b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 -- 172.21.15.19:0/4042783309 shutdown_connections 2023-10-03T10:15:32.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.742+0000 7f40bb43d700 1 -- 172.21.15.19:0/4042783309 wait complete. 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.743+0000 7f40bb43d700 1 Processor -- start 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.743+0000 7f40bb43d700 1 -- start start 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40b409d6f0 0x7f40b41226f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 0x7f40b4123170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4125a90 con 0x7f40b409d6f0 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4125c70 con 0x7f40b409e410 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40bb43d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4133280 con 0x7f40b409e000 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40b89d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40b89d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36964/0 (socket says 172.21.15.19:36964) 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40b99da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 0x7f40b4123170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.744+0000 7f40b89d8700 1 -- 172.21.15.19:0/3638661315 learned_addr learned my addr 172.21.15.19:0/3638661315 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b91d9700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40b409d6f0 0x7f40b41226f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 -- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 msgr2=0x7f40b4123170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 0x7f40b4123170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 -- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40b409d6f0 msgr2=0x7f40b41226f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40b409d6f0 0x7f40b41226f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 -- 172.21.15.19:0/3638661315 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009a70 con 0x7f40b409e000 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b99da700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 0x7f40b4123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40b89d8700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c700 tx=0x7f40a400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4005d70 con 0x7f40b409e000 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a40070d0 con 0x7f40b409e000 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.745+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4126210 con 0x7f40b409e000 2023-10-03T10:15:32.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.746+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b4125f30 con 0x7f40b409e000 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.746+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4007460 con 0x7f40b409e000 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.747+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40a40075c0 con 0x7f40b409e000 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.747+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40a4011e50 con 0x7f40b409e000 2023-10-03T10:15:32.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.747+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b4074ea0 con 0x7f40b409e000 2023-10-03T10:15:32.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.757+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40a4017020 con 0x7f40b409e000 2023-10-03T10:15:32.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.874+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f401006b9e0 con 0x7f4010099a40 2023-10-03T10:15:32.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.874+0000 7f4006ffd700 1 -- 172.21.15.19:0/340581860 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f400c020370 con 0x7f4010099a40 2023-10-03T10:15:32.875 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.876+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 msgr2=0x7f40101195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.876+0000 7f401861e700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f400c012fc0 tx=0x7f400c0100c0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 shutdown_connections 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4010131810 0x7f401011a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4010099a40 0x7f40101195c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 --2- 172.21.15.19:0/340581860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f401009a3b0 0x7f4010119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 >> 172.21.15.19:0/340581860 conn(0x7f40100a2aa0 msgr2=0x7f401012e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 shutdown_connections 2023-10-03T10:15:32.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.877+0000 7f401861e700 1 -- 172.21.15.19:0/340581860 wait complete. 2023-10-03T10:15:32.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:32.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.908+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c5409ead0 con 0x7f7c54133510 2023-10-03T10:15:32.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.908+0000 7f7c517fa700 1 -- 172.21.15.19:0/227941755 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c40015030 con 0x7f7c54133510 2023-10-03T10:15:32.909 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:32.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 msgr2=0x7f7c5409c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000b560 tx=0x7f7c4000b920 comp rx=0 tx=0).stop 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 shutdown_connections 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c54135e30 0x7f7c5409cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c54130670 0x7f7c5409c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 --2- 172.21.15.19:0/227941755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c54133510 0x7f7c5409c5d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 >> 172.21.15.19:0/227941755 conn(0x7f7c540a2aa0 msgr2=0x7f7c5412d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 shutdown_connections 2023-10-03T10:15:32.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.911+0000 7f7c5aa86700 1 -- 172.21.15.19:0/227941755 wait complete. 2023-10-03T10:15:32.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.933+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f01b8074ea0 con 0x7f01b81c67f0 2023-10-03T10:15:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.934+0000 7f019f7fe700 1 -- 172.21.15.19:0/658469141 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01ac02dba0 con 0x7f01b81c67f0 2023-10-03T10:15:32.935 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:32.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 msgr2=0x7f01b81c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004000 tx=0x7f01ac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:32.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 shutdown_connections 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f01b812c910 0x7f01b812cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f01b8136f50 0x7f01b81c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 --2- 172.21.15.19:0/658469141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f01b81c67f0 0x7f01b81c6be0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 >> 172.21.15.19:0/658469141 conn(0x7f01b80a2aa0 msgr2=0x7f01b812e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 shutdown_connections 2023-10-03T10:15:32.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.936+0000 7f01bd061700 1 -- 172.21.15.19:0/658469141 wait complete. 2023-10-03T10:15:32.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.967+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40b4071e90 con 0x7f40b409e000 2023-10-03T10:15:32.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.968+0000 7f40a9ffb700 1 -- 172.21.15.19:0/3638661315 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40a4044060 con 0x7f40b409e000 2023-10-03T10:15:32.969 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 msgr2=0x7f40b4122c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40a400c700 tx=0x7f40a400ca10 comp rx=0 tx=0).stop 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 shutdown_connections 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40b409e410 0x7f40b4123170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40b409d6f0 0x7f40b41226f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 --2- 172.21.15.19:0/3638661315 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40b409e000 0x7f40b4122c30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 >> 172.21.15.19:0/3638661315 conn(0x7f40b4066f50 msgr2=0x7f40b4133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 shutdown_connections 2023-10-03T10:15:32.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:32.970+0000 7f40bb43d700 1 -- 172.21.15.19:0/3638661315 wait complete. 2023-10-03T10:15:32.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:33.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:33.932 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:33.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:33.985 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:34.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 Processor -- start 2023-10-03T10:15:34.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 -- start start 2023-10-03T10:15:34.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 0x7f43e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43e409e000 0x7f43e41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e406b460 con 0x7f43e409e000 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e409b120 con 0x7f43e409d6f0 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43ea0b7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43e409a7e0 con 0x7f43e409e410 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43e3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43e3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36976/0 (socket says 172.21.15.19:36976) 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.044+0000 7f43e3fff700 1 -- 172.21.15.19:0/1008148311 learned_addr learned my addr 172.21.15.19:0/1008148311 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e37fe700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 0x7f43e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e2ffd700 1 --2- 172.21.15.19:0/1008148311 >> v2:172.21.15.19:3300/0 conn(0x7f43e409e000 0x7f43e41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 -- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 msgr2=0x7f43e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 0x7f43e409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 -- 172.21.15.19:0/1008148311 >> v2:172.21.15.19:3300/0 conn(0x7f43e409e000 msgr2=0x7f43e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 --2- 172.21.15.19:0/1008148311 >> v2:172.21.15.19:3300/0 conn(0x7f43e409e000 0x7f43e41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 -- 172.21.15.19:0/1008148311 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e409a500 con 0x7f43e409e410 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e37fe700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 0x7f43e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e3fff700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e80 tx=0x7f43dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a424c0ca4150fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e27fc700 1 -- 172.21.15.19:0/1008148311 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00e070 con 0x7f43e409e410 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e27fc700 1 -- 172.21.15.19:0/1008148311 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00b8d0 con 0x7f43e409e410 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.045+0000 7f43e27fc700 1 -- 172.21.15.19:0/1008148311 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00bc80 con 0x7f43e409e410 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 -- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 msgr2=0x7f43e4133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e80 tx=0x7f43dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 -- 172.21.15.19:0/1008148311 shutdown_connections 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409d6f0 0x7f43e409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/1008148311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409e410 0x7f43e4133f30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/1008148311 >> v2:172.21.15.19:3300/0 conn(0x7f43e409e000 0x7f43e41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 -- 172.21.15.19:0/1008148311 >> 172.21.15.19:0/1008148311 conn(0x7f43e4066f50 msgr2=0x7f43e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.046+0000 7f43ea0b7700 1 -- 172.21.15.19:0/1008148311 shutdown_connections 2023-10-03T10:15:34.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.050+0000 7f43ea0b7700 1 -- 172.21.15.19:0/1008148311 wait complete. 2023-10-03T10:15:34.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.050+0000 7f43ea0b7700 1 Processor -- start 2023-10-03T10:15:34.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 -- start start 2023-10-03T10:15:34.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e409e000 0x7f43e41c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409e410 0x7f43e41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41a7240 con 0x7f43e409e000 2023-10-03T10:15:34.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41c5ad0 con 0x7f43e409e410 2023-10-03T10:15:34.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.051+0000 7f43ea0b7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41a9820 con 0x7f43e409d6f0 2023-10-03T10:15:34.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36982/0 (socket says 172.21.15.19:36982) 2023-10-03T10:15:34.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 -- 172.21.15.19:0/3383375421 learned_addr learned my addr 172.21.15.19:0/3383375421 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e2ffd700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e409e000 0x7f43e41c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e3fff700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409e410 0x7f43e41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 -- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409e410 msgr2=0x7f43e41c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409e410 0x7f43e41c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 -- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e409e000 msgr2=0x7f43e41c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e409e000 0x7f43e41c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 -- 172.21.15.19:0/3383375421 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40094a0 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43e37fe700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ec10 tx=0x7f43d400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.052+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d400c850 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.053+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d400c9b0 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.053+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d400cd20 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.053+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc009b30 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.053+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41a8b60 con 0x7f43e409d6f0 2023-10-03T10:15:34.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.054+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e41a7970 con 0x7f43e409d6f0 2023-10-03T10:15:34.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.056+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43d4013470 con 0x7f43e409d6f0 2023-10-03T10:15:34.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.056+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43d403f890 con 0x7f43e409d6f0 2023-10-03T10:15:34.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.060+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43d4013720 con 0x7f43e409d6f0 2023-10-03T10:15:34.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.089+0000 7f52c534e700 1 Processor -- start 2023-10-03T10:15:34.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.089+0000 7f52c534e700 1 -- start start 2023-10-03T10:15:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52c534e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52c534e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52c534e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00a2a70 con 0x7f52c00a0a30 2023-10-03T10:15:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52c534e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a01d0 con 0x7f52c009d630 2023-10-03T10:15:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52c534e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c009e2b0 con 0x7f52c0138d80 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51266/0 (socket says 172.21.15.19:51266) 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 -- 172.21.15.19:0/944324707 learned_addr learned my addr 172.21.15.19:0/944324707 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 -- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 msgr2=0x7f52c013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 -- 172.21.15.19:0/944324707 >> v1:172.21.15.19:6789/0 conn(0x7f52c00a0a30 legacy=0x7f52c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52be7fc700 1 -- 172.21.15.19:0/944324707 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c009dc50 con 0x7f52c009d630 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.090+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:34.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.091+0000 7f52be7fc700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009920 tx=0x7f52b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff04f9c043418ade server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.091+0000 7f52bdffb700 1 -- 172.21.15.19:0/944324707 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b400ba60 con 0x7f52c009d630 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.091+0000 7f52bdffb700 1 -- 172.21.15.19:0/944324707 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b400bbc0 con 0x7f52c009d630 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.091+0000 7f52bdffb700 1 -- 172.21.15.19:0/944324707 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b4009e70 con 0x7f52c009d630 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 -- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 msgr2=0x7f52c00a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f52b4009920 tx=0x7f52b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:34.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 -- 172.21.15.19:0/944324707 shutdown_connections 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 --2- 172.21.15.19:0/944324707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c009d630 0x7f52c00a1510 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 -- 172.21.15.19:0/944324707 >> 172.21.15.19:0/944324707 conn(0x7f52c00a3050 msgr2=0x7f52c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 -- 172.21.15.19:0/944324707 shutdown_connections 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.092+0000 7f52c534e700 1 -- 172.21.15.19:0/944324707 wait complete. 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.093+0000 7f52c534e700 1 Processor -- start 2023-10-03T10:15:34.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 -- start start 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 0x7f52c0120ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c0121530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a4e50 con 0x7f52c009d630 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00a0410 con 0x7f52c00a0a30 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52c534e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0123cd0 con 0x7f52c0138d80 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52beffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52beffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34040/0 (socket says 172.21.15.19:34040) 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52beffd700 1 -- 172.21.15.19:0/2052636636 learned_addr learned my addr 172.21.15.19:0/2052636636 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.094+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c0121530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52be7fc700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 0x7f52c0120ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 -- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 msgr2=0x7f52c0120ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 0x7f52c0120ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 -- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 msgr2=0x7f52c0120ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 -- 172.21.15.19:0/2052636636 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4009550 con 0x7f52c0138d80 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52beffd700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52be7fc700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 0x7f52c0120ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:34.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52bf7fe700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c0121530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52c00a23a0 tx=0x7f52b800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800ddd0 con 0x7f52c0138d80 2023-10-03T10:15:34.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800f040 con 0x7f52c0138d80 2023-10-03T10:15:34.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c0124260 con 0x7f52c0138d80 2023-10-03T10:15:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8003c40 con 0x7f52c0138d80 2023-10-03T10:15:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.095+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c0124cd0 con 0x7f52c0138d80 2023-10-03T10:15:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.097+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c01225f0 con 0x7f52c0138d80 2023-10-03T10:15:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.097+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52b8004030 con 0x7f52c0138d80 2023-10-03T10:15:34.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.098+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52b803fbe0 con 0x7f52c0138d80 2023-10-03T10:15:34.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.102+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f52b801d360 con 0x7f52c0138d80 2023-10-03T10:15:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.128+0000 7ff031acd700 1 Processor -- start 2023-10-03T10:15:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.128+0000 7ff031acd700 1 -- start start 2023-10-03T10:15:34.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff031acd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c06c0e0 0x7ff02c09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff031acd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 0x7ff02c1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff031acd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c134980 con 0x7ff02c137f20 2023-10-03T10:15:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff031acd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c06c4b0 con 0x7ff02c134ec0 2023-10-03T10:15:34.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff031acd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0a09c0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff02c137f20 0x7ff02c13ed10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36050/0 (socket says 172.21.15.19:36050) 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02bfff700 1 -- 172.21.15.19:0/3865200462 learned_addr learned my addr 172.21.15.19:0/3865200462 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02affd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 0x7ff02c1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02b7fe700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c06c0e0 0x7ff02c09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02affd700 1 -- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c06c0e0 msgr2=0x7ff02c09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02affd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c06c0e0 0x7ff02c09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02affd700 1 -- 172.21.15.19:0/3865200462 >> v1:172.21.15.19:6789/0 conn(0x7ff02c137f20 legacy=0x7ff02c13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.129+0000 7ff02affd700 1 -- 172.21.15.19:0/3865200462 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0a0600 con 0x7ff02c134ec0 2023-10-03T10:15:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.130+0000 7ff02affd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 0x7ff02c1379e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff020009870 tx=0x7ff020009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c48f9e724fa227f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.130+0000 7ff02a7fc700 1 -- 172.21.15.19:0/3865200462 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020011830 con 0x7ff02c134ec0 2023-10-03T10:15:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.130+0000 7ff02a7fc700 1 -- 172.21.15.19:0/3865200462 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff020011990 con 0x7ff02c134ec0 2023-10-03T10:15:34.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.130+0000 7ff02a7fc700 1 -- 172.21.15.19:0/3865200462 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020011d20 con 0x7ff02c134ec0 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 -- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 msgr2=0x7ff02c1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 0x7ff02c1379e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff020009870 tx=0x7ff020009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 -- 172.21.15.19:0/3865200462 shutdown_connections 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c06c0e0 0x7ff02c09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 --2- 172.21.15.19:0/3865200462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c134ec0 0x7ff02c1379e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 -- 172.21.15.19:0/3865200462 >> 172.21.15.19:0/3865200462 conn(0x7ff02c0a4210 msgr2=0x7ff02c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 -- 172.21.15.19:0/3865200462 shutdown_connections 2023-10-03T10:15:34.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.131+0000 7ff031acd700 1 -- 172.21.15.19:0/3865200462 wait complete. 2023-10-03T10:15:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.132+0000 7ff031acd700 1 Processor -- start 2023-10-03T10:15:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 -- start start 2023-10-03T10:15:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c134ec0 0x7ff02c09b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 0x7ff02c09beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c09e090 con 0x7ff02c137f20 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c09cf00 con 0x7ff02c06c0e0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff031acd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c11ab70 con 0x7ff02c134ec0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.133+0000 7ff02b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51300/0 (socket says 172.21.15.19:51300) 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 -- 172.21.15.19:0/2842281689 learned_addr learned my addr 172.21.15.19:0/2842281689 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02affd700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c134ec0 0x7ff02c09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02bfff700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 0x7ff02c09beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 -- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c134ec0 msgr2=0x7ff02c09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c134ec0 0x7ff02c09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 -- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 msgr2=0x7ff02c09beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 0x7ff02c09beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 -- 172.21.15.19:0/2842281689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200094a0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02bfff700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 0x7ff02c09beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff02b7fe700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e870 tx=0x7ff01c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c009590 con 0x7ff02c06c0e0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c013680 con 0x7ff02c06c0e0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c0139f0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c0a1fc0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.134+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c11b5e0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.135+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff01c013b50 con 0x7ff02c06c0e0 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.136+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff01c03f7b0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.136+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c074ea0 con 0x7ff02c06c0e0 2023-10-03T10:15:34.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.141+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff01c017020 con 0x7ff02c06c0e0 2023-10-03T10:15:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 Processor -- start 2023-10-03T10:15:34.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 -- start start 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009d6d0 0x7f2ae009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ae009dfe0 0x7f2ae0130600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 0x7f2ae0130fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae009a920 con 0x7f2ae009dfe0 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae009b940 con 0x7f2ae0130b40 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae68cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae009ab10 con 0x7f2ae009d6d0 2023-10-03T10:15:34.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2adf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ae009dfe0 0x7f2ae0130600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2adffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009d6d0 0x7f2ae009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2adf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ae009dfe0 0x7f2ae0130600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34054/0 (socket says 172.21.15.19:34054) 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2adf7fe700 1 -- 172.21.15.19:0/1435670409 learned_addr learned my addr 172.21.15.19:0/1435670409 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.214+0000 7f2ae4e69700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 0x7f2ae0130fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 -- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009d6d0 msgr2=0x7f2ae009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009d6d0 0x7f2ae009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 -- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 msgr2=0x7f2ae0130fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 0x7f2ae0130fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 -- 172.21.15.19:0/1435670409 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae009c520 con 0x7f2ae009dfe0 2023-10-03T10:15:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2ae4e69700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 0x7f2ae0130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adf7fe700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae009dfe0 0x7f2ae0130600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400bb90 tx=0x7f2ad400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe1b793f0332e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adeffd700 1 -- 172.21.15.19:0/1435670409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400dc70 con 0x7f2ae009dfe0 2023-10-03T10:15:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adeffd700 1 -- 172.21.15.19:0/1435670409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400ddd0 con 0x7f2ae009dfe0 2023-10-03T10:15:34.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.215+0000 7f2adeffd700 1 -- 172.21.15.19:0/1435670409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4012990 con 0x7f2ae009dfe0 2023-10-03T10:15:34.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 -- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae009dfe0 msgr2=0x7f2ae0130600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae009dfe0 0x7f2ae0130600 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400bb90 tx=0x7f2ad400bea0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 -- 172.21.15.19:0/1435670409 shutdown_connections 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae0130b40 0x7f2ae0130fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009d6d0 0x7f2ae009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/1435670409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae009dfe0 0x7f2ae0130600 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 -- 172.21.15.19:0/1435670409 >> 172.21.15.19:0/1435670409 conn(0x7f2ae0099c20 msgr2=0x7f2ae00a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 -- 172.21.15.19:0/1435670409 shutdown_connections 2023-10-03T10:15:34.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.216+0000 7f2ae68cc700 1 -- 172.21.15.19:0/1435670409 wait complete. 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.217+0000 7f2ae68cc700 1 Processor -- start 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 -- start start 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009dfe0 0x7f2ae011d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 0x7f2ae011d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0120810 con 0x7f2ae0130b40 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae012f310 con 0x7f2ae009d6d0 2023-10-03T10:15:34.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae68cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae011fd90 con 0x7f2ae009dfe0 2023-10-03T10:15:34.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51318/0 (socket says 172.21.15.19:51318) 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 -- 172.21.15.19:0/912010965 learned_addr learned my addr 172.21.15.19:0/912010965 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae4e69700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 0x7f2ae011d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adf7fe700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009dfe0 0x7f2ae011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 -- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009dfe0 msgr2=0x7f2ae011d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009dfe0 0x7f2ae011d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 -- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 msgr2=0x7f2ae011d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 0x7f2ae011d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 -- 172.21.15.19:0/912010965 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad400b7f0 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2ae4e69700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 0x7f2ae011d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.219+0000 7f2adffff700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000e870 tx=0x7f2ad000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.220+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0009590 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.220+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0013680 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.220+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00139f0 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.220+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae011f120 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.220+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae009c740 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.222+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae004f2a0 con 0x7f2ae009d6d0 2023-10-03T10:15:34.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.222+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ad0013b50 con 0x7f2ae009d6d0 2023-10-03T10:15:34.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.223+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ad003fa60 con 0x7f2ae009d6d0 2023-10-03T10:15:34.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.231+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ad001adc0 con 0x7f2ae009d6d0 2023-10-03T10:15:34.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.326+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f43e4074ea0 con 0x7f43e409d6f0 2023-10-03T10:15:34.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.326+0000 7f43cbfff700 1 -- 172.21.15.19:0/3383375421 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43d4021070 con 0x7f43e409d6f0 2023-10-03T10:15:34.326 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 msgr2=0x7f43e41c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43d400ec10 tx=0x7f43d400ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 shutdown_connections 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43e409e410 0x7f43e41c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43e409d6f0 0x7f43e41c5050 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 --2- 172.21.15.19:0/3383375421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43e409e000 0x7f43e41c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 >> 172.21.15.19:0/3383375421 conn(0x7f43e4066f50 msgr2=0x7f43e41bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 shutdown_connections 2023-10-03T10:15:34.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.330+0000 7f43ea0b7700 1 -- 172.21.15.19:0/3383375421 wait complete. 2023-10-03T10:15:34.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.346+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52c00a5990 con 0x7f52c0138d80 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.347+0000 7f52a77fe700 1 -- 172.21.15.19:0/2052636636 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52b801a030 con 0x7f52c0138d80 2023-10-03T10:15:34.347 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:34.348 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:34.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 msgr2=0x7f52c0121530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c0121530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f52c00a23a0 tx=0x7f52b800d3b0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 shutdown_connections 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52c0138d80 0x7f52c0121530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52c009d630 0x7f52c0120ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 --2- 172.21.15.19:0/2052636636 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52c00a0a30 0x7f52c0120ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 >> 172.21.15.19:0/2052636636 conn(0x7f52c00a3050 msgr2=0x7f52c00a5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 shutdown_connections 2023-10-03T10:15:34.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.349+0000 7f52c534e700 1 -- 172.21.15.19:0/2052636636 wait complete. 2023-10-03T10:15:34.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.418+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff02c11a810 con 0x7ff02c06c0e0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.418+0000 7ff013fff700 1 -- 172.21.15.19:0/2842281689 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff01c00c970 con 0x7ff02c06c0e0 2023-10-03T10:15:34.418 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.420+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 msgr2=0x7ff02c09b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.420+0000 7ff031acd700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff01c00e870 tx=0x7ff01c00eb80 comp rx=0 tx=0).stop 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 shutdown_connections 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff02c137f20 0x7ff02c09beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff02c06c0e0 0x7ff02c09b430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 --2- 172.21.15.19:0/2842281689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff02c134ec0 0x7ff02c09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 >> 172.21.15.19:0/2842281689 conn(0x7ff02c0a4210 msgr2=0x7ff02c0a0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 shutdown_connections 2023-10-03T10:15:34.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.421+0000 7ff031acd700 1 -- 172.21.15.19:0/2842281689 wait complete. 2023-10-03T10:15:34.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:34.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.465+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ae009b5c0 con 0x7f2ae009d6d0 2023-10-03T10:15:34.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.466+0000 7f2adcff9700 1 -- 172.21.15.19:0/912010965 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ad0017020 con 0x7f2ae009d6d0 2023-10-03T10:15:34.466 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 msgr2=0x7f2ae011cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:34.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000e870 tx=0x7f2ad000eb80 comp rx=0 tx=0).stop 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 shutdown_connections 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ae0130b40 0x7f2ae011d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ae009d6d0 0x7f2ae011cf30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 --2- 172.21.15.19:0/912010965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ae009dfe0 0x7f2ae011d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 >> 172.21.15.19:0/912010965 conn(0x7f2ae0099c20 msgr2=0x7f2ae012fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 shutdown_connections 2023-10-03T10:15:34.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:34.468+0000 7f2ae68cc700 1 -- 172.21.15.19:0/912010965 wait complete. 2023-10-03T10:15:34.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:35.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:35.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:35.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:35.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.503+0000 7f5dff3b0700 1 Processor -- start 2023-10-03T10:15:35.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.503+0000 7f5dff3b0700 1 -- start start 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dff3b0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5df809e1d0 0x7f5df8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dff3b0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dff3b0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df809b120 con 0x7f5df809d6f0 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dff3b0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df806b460 con 0x7f5df809e1d0 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dff3b0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df809a7e0 con 0x7f5df8139170 2023-10-03T10:15:35.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dfc94b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5df809e1d0 0x7f5df8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dfc94b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5df809e1d0 0x7f5df8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34080/0 (socket says 172.21.15.19:34080) 2023-10-03T10:15:35.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dfc94b700 1 -- 172.21.15.19:0/188884556 learned_addr learned my addr 172.21.15.19:0/188884556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.504+0000 7f5dfd94d700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfc94b700 1 -- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 msgr2=0x7f5df813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfc94b700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfc94b700 1 -- 172.21.15.19:0/188884556 >> v1:172.21.15.19:6789/0 conn(0x7f5df809d6f0 legacy=0x7f5df809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfc94b700 1 -- 172.21.15.19:0/188884556 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df809a500 con 0x7f5df809e1d0 2023-10-03T10:15:35.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfd94d700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5dfc94b700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e1d0 0x7f5df8138c30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009920 tx=0x7f5de8009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e245a64f0c5896b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5deffff700 1 -- 172.21.15.19:0/188884556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8004230 con 0x7f5df809e1d0 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5deffff700 1 -- 172.21.15.19:0/188884556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8004390 con 0x7f5df809e1d0 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.505+0000 7f5deffff700 1 -- 172.21.15.19:0/188884556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de80036a0 con 0x7f5df809e1d0 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 -- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e1d0 msgr2=0x7f5df8138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e1d0 0x7f5df8138c30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009920 tx=0x7f5de8009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 -- 172.21.15.19:0/188884556 shutdown_connections 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/188884556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e1d0 0x7f5df8138c30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 -- 172.21.15.19:0/188884556 >> 172.21.15.19:0/188884556 conn(0x7f5df8066f50 msgr2=0x7f5df809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 -- 172.21.15.19:0/188884556 shutdown_connections 2023-10-03T10:15:35.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.506+0000 7f5dff3b0700 1 -- 172.21.15.19:0/188884556 wait complete. 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.508+0000 7f5dff3b0700 1 Processor -- start 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.508+0000 7f5dff3b0700 1 -- start start 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 0x7f5df811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df809c7a0 con 0x7f5df809d6f0 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8120540 con 0x7f5df809e1d0 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dff3b0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8122690 con 0x7f5df8139170 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51324/0 (socket says 172.21.15.19:51324) 2023-10-03T10:15:35.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 -- 172.21.15.19:0/82550304 learned_addr learned my addr 172.21.15.19:0/82550304 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfd14c700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 0x7f5df811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfd94d700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 -- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 msgr2=0x7f5df811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df811f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 -- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 msgr2=0x7f5df811ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 0x7f5df811ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfc94b700 1 -- 172.21.15.19:0/82550304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0009a70 con 0x7f5df809e1d0 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfd14c700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 0x7f5df811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.509+0000 7f5dfd94d700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dfc94b700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009130 tx=0x7f5de8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003ae0 con 0x7f5df809e1d0 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de801f070 con 0x7f5df809e1d0 2023-10-03T10:15:35.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de8009550 con 0x7f5df809e1d0 2023-10-03T10:15:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003ea0 con 0x7f5df809e1d0 2023-10-03T10:15:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.510+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80a1d60 con 0x7f5df809e1d0 2023-10-03T10:15:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.511+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5de8021030 con 0x7f5df809e1d0 2023-10-03T10:15:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.511+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5de80443b0 con 0x7f5df809e1d0 2023-10-03T10:15:35.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.512+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8121e10 con 0x7f5df809e1d0 2023-10-03T10:15:35.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.517+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5de8010970 con 0x7f5df809e1d0 2023-10-03T10:15:35.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.543+0000 7fab7e5b4700 1 Processor -- start 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.543+0000 7fab7e5b4700 1 -- start start 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7e5b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7e5b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 0x7fab7813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7e5b4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab78070ee0 con 0x7fab7806e570 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7e5b4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab78071980 con 0x7fab7806f050 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7e5b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab78071480 con 0x7fab7809eca0 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7cb51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 0x7fab7813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37084/0 (socket says 172.21.15.19:37084) 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab7cb51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 0x7fab7813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34102/0 (socket says 172.21.15.19:34102) 2023-10-03T10:15:35.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 -- 172.21.15.19:0/546052061 learned_addr learned my addr 172.21.15.19:0/546052061 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 -- 172.21.15.19:0/546052061 >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 msgr2=0x7fab7813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 --2- 172.21.15.19:0/546052061 >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 0x7fab7813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 -- 172.21.15.19:0/546052061 >> v1:172.21.15.19:6789/0 conn(0x7fab7806e570 legacy=0x7fab7806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.544+0000 7fab777fe700 1 -- 172.21.15.19:0/546052061 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78071b90 con 0x7fab7809eca0 2023-10-03T10:15:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.545+0000 7fab777fe700 1 --2- 172.21.15.19:0/546052061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0098f0 tx=0x7fab6c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73a957c116dcdfac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.545+0000 7fab76ffd700 1 -- 172.21.15.19:0/546052061 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011830 con 0x7fab7809eca0 2023-10-03T10:15:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.545+0000 7fab76ffd700 1 -- 172.21.15.19:0/546052061 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6c011990 con 0x7fab7809eca0 2023-10-03T10:15:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.545+0000 7fab76ffd700 1 -- 172.21.15.19:0/546052061 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011d20 con 0x7fab7809eca0 2023-10-03T10:15:35.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 -- 172.21.15.19:0/546052061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 msgr2=0x7fab7813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/546052061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0098f0 tx=0x7fab6c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 -- 172.21.15.19:0/546052061 shutdown_connections 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/546052061 >> v2:172.21.15.19:3300/0 conn(0x7fab7806f050 0x7fab7813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/546052061 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7809eca0 0x7fab7813cea0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 -- 172.21.15.19:0/546052061 >> 172.21.15.19:0/546052061 conn(0x7fab780a2aa0 msgr2=0x7fab780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 -- 172.21.15.19:0/546052061 shutdown_connections 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.546+0000 7fab7e5b4700 1 -- 172.21.15.19:0/546052061 wait complete. 2023-10-03T10:15:35.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.548+0000 7fab7e5b4700 1 Processor -- start 2023-10-03T10:15:35.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.548+0000 7fab7e5b4700 1 -- start start 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 0x7fab7813cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 0x7fab7812adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7812dc60 con 0x7fab7813d9d0 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab78070610 con 0x7fab7806f050 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7e5b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab7812d910 con 0x7fab7806e570 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51340/0 (socket says 172.21.15.19:51340) 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab777fe700 1 -- 172.21.15.19:0/2095850191 learned_addr learned my addr 172.21.15.19:0/2095850191 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 0x7fab7813cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7cb51700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 0x7fab7812adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 -- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 msgr2=0x7fab7813d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 -- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 msgr2=0x7fab7812adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 0x7fab7812adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab77fff700 1 -- 172.21.15.19:0/2095850191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c009550 con 0x7fab7806e570 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab7cb51700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 0x7fab7812adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.549+0000 7fab777fe700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab77fff700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 0x7fab7813cf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab68000f60 tx=0x7fab6800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680052d0 con 0x7fab7806e570 2023-10-03T10:15:35.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab68005430 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680038c0 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7812deb0 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.550+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7812c0a0 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.551+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78074ea0 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.552+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab68003a20 con 0x7fab7806e570 2023-10-03T10:15:35.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.552+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab6803ebc0 con 0x7fab7806e570 2023-10-03T10:15:35.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.556+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab68011590 con 0x7fab7806e570 2023-10-03T10:15:35.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.600+0000 7f1ed8047700 1 Processor -- start 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.600+0000 7f1ed8047700 1 -- start start 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed8047700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ed0130040 0x7f1ed012c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed8047700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012ccb0 0x7f1ed0137950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed8047700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed009be70 con 0x7f1ed012fc70 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed8047700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed009a6e0 con 0x7f1ed0130040 2023-10-03T10:15:35.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed8047700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed009ac80 con 0x7f1ed012ccb0 2023-10-03T10:15:35.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed65e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012ccb0 0x7f1ed0137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed5de3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ed012fc70 0x7f1ed012c060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36060/0 (socket says 172.21.15.19:36060) 2023-10-03T10:15:35.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.601+0000 7f1ed5de3700 1 -- 172.21.15.19:0/2820437599 learned_addr learned my addr 172.21.15.19:0/2820437599 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:35.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 --2- 172.21.15.19:0/2820437599 >> v2:172.21.15.19:3300/0 conn(0x7f1ed0130040 0x7f1ed012c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed4de1700 1 -- 172.21.15.19:0/2820437599 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3756004402 0 0) 0x7f1ed009be70 con 0x7f1ed012fc70 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed4de1700 1 -- 172.21.15.19:0/2820437599 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ebc0035b0 con 0x7f1ed012fc70 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 -- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012ccb0 msgr2=0x7f1ed0137950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 --2- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012ccb0 0x7f1ed0137950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 -- 172.21.15.19:0/2820437599 >> v1:172.21.15.19:6789/0 conn(0x7f1ed012fc70 legacy=0x7f1ed012c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 -- 172.21.15.19:0/2820437599 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed0099b00 con 0x7f1ed0130040 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.602+0000 7f1ed55e2700 1 --2- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed012c770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009840 tx=0x7f1ecc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8843ab76048a02f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.603+0000 7f1ed4de1700 1 -- 172.21.15.19:0/2820437599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011830 con 0x7f1ed0130040 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.603+0000 7f1ed4de1700 1 -- 172.21.15.19:0/2820437599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ecc011990 con 0x7f1ed0130040 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.603+0000 7f1ed4de1700 1 -- 172.21.15.19:0/2820437599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc011d20 con 0x7f1ed0130040 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.604+0000 7f1ed8047700 1 -- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 msgr2=0x7f1ed012c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.604+0000 7f1ed8047700 1 --2- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed012c770 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc009840 tx=0x7f1ecc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 -- 172.21.15.19:0/2820437599 shutdown_connections 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 --2- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012ccb0 0x7f1ed0137950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 --2- 172.21.15.19:0/2820437599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed012c770 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 -- 172.21.15.19:0/2820437599 >> 172.21.15.19:0/2820437599 conn(0x7f1ed009e7e0 msgr2=0x7f1ed009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 -- 172.21.15.19:0/2820437599 shutdown_connections 2023-10-03T10:15:35.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.605+0000 7f1ed8047700 1 -- 172.21.15.19:0/2820437599 wait complete. 2023-10-03T10:15:35.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.606+0000 7f1ed8047700 1 Processor -- start 2023-10-03T10:15:35.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.606+0000 7f1ed8047700 1 -- start start 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012fc70 0x7f1ed006ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed006f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed0129de0 con 0x7f1ed0130040 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed009db40 con 0x7f1ed012fc70 2023-10-03T10:15:35.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed8047700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed006fe70 con 0x7f1ed012ccb0 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed5de3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed5de3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37102/0 (socket says 172.21.15.19:37102) 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed5de3700 1 -- 172.21.15.19:0/359333520 learned_addr learned my addr 172.21.15.19:0/359333520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.607+0000 7f1ed65e4700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed006f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 -- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012fc70 msgr2=0x7f1ed006ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012fc70 0x7f1ed006ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 -- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 msgr2=0x7f1ed006f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed006f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 -- 172.21.15.19:0/359333520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ecc0094a0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed65e4700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed006f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.608+0000 7f1ed5de3700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c8b0 tx=0x7f1ec000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.609+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0010860 con 0x7f1ed012ccb0 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.609+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec00109c0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.609+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec0010d50 con 0x7f1ed012ccb0 2023-10-03T10:15:35.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.610+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed0071090 con 0x7f1ed012ccb0 2023-10-03T10:15:35.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.610+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed0070bd0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.611+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ec000e3d0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.611+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00994b0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.611+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ec0009030 con 0x7f1ed012ccb0 2023-10-03T10:15:35.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.621+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ec0020300 con 0x7f1ed012ccb0 2023-10-03T10:15:35.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 Processor -- start 2023-10-03T10:15:35.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 -- start start 2023-10-03T10:15:35.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bcc133a80 0x7f6bcc133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc06bc00 con 0x7f6bcc12ff20 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc06c570 con 0x7f6bcc133a80 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.638+0000 7f6bd2b8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc0a0040 con 0x7f6bcc130a70 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bcc133a80 0x7f6bcc133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd112b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bcbfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6bcc12ff20 0x7f6bcc130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36076/0 (socket says 172.21.15.19:36076) 2023-10-03T10:15:35.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bcbfff700 1 -- 172.21.15.19:0/160414295 learned_addr learned my addr 172.21.15.19:0/160414295 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 -- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 msgr2=0x7f6bcc13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 -- 172.21.15.19:0/160414295 >> v1:172.21.15.19:6789/0 conn(0x7f6bcc12ff20 legacy=0x7f6bcc130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 -- 172.21.15.19:0/160414295 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc133860 con 0x7f6bcc133a80 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd112b700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bd092a700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc133e50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009d90 tx=0x7f6bbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86cdc4e5c33eb0a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bcb7fe700 1 -- 172.21.15.19:0/160414295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00e070 con 0x7f6bcc133a80 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bcb7fe700 1 -- 172.21.15.19:0/160414295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc00bb20 con 0x7f6bcc133a80 2023-10-03T10:15:35.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.639+0000 7f6bcb7fe700 1 -- 172.21.15.19:0/160414295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc012430 con 0x7f6bcc133a80 2023-10-03T10:15:35.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.640+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 msgr2=0x7f6bcc133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.640+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc133e50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009d90 tx=0x7f6bbc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.640+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/160414295 shutdown_connections 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.641+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.641+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/160414295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc133e50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.641+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/160414295 >> 172.21.15.19:0/160414295 conn(0x7f6bcc0a4210 msgr2=0x7f6bcc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.641+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/160414295 shutdown_connections 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.641+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/160414295 wait complete. 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 Processor -- start 2023-10-03T10:15:35.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 -- start start 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc11ed70 con 0x7f6bcc133a80 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc11ea90 con 0x7f6bcc12ff20 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd2b8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc120090 con 0x7f6bcc130a70 2023-10-03T10:15:35.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd092a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd092a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51368/0 (socket says 172.21.15.19:51368) 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.642+0000 7f6bd092a700 1 -- 172.21.15.19:0/2860474753 learned_addr learned my addr 172.21.15.19:0/2860474753 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd112b700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bcbfff700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 -- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 msgr2=0x7f6bcc09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 -- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 msgr2=0x7f6bcc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 -- 172.21.15.19:0/2860474753 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc40094a0 con 0x7f6bcc12ff20 2023-10-03T10:15:35.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.643+0000 7f6bd092a700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc06c6b0 tx=0x7f6bbc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.644+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc012430 con 0x7f6bcc12ff20 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.644+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc009a70 con 0x7f6bcc12ff20 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.644+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc020070 con 0x7f6bcc12ff20 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.644+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004280 con 0x7f6bcc12ff20 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.644+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc12d300 con 0x7f6bcc12ff20 2023-10-03T10:15:35.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.645+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc074ea0 con 0x7f6bcc12ff20 2023-10-03T10:15:35.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.653+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bbc0043e0 con 0x7f6bcc12ff20 2023-10-03T10:15:35.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.653+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bbc022070 con 0x7f6bcc12ff20 2023-10-03T10:15:35.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.653+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bbc02f580 con 0x7f6bcc12ff20 2023-10-03T10:15:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.750+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5df8121e10 con 0x7f5df809e1d0 2023-10-03T10:15:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.750+0000 7f5dedffb700 1 -- 172.21.15.19:0/82550304 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5de80193c0 con 0x7f5df809e1d0 2023-10-03T10:15:35.751 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 msgr2=0x7f5df811ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009130 tx=0x7f5de8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 shutdown_connections 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df8139170 0x7f5df811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809d6f0 0x7f5df811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 --2- 172.21.15.19:0/82550304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809e1d0 0x7f5df811ef40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.753+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 >> 172.21.15.19:0/82550304 conn(0x7f5df8066f50 msgr2=0x7f5df8138090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.754+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 shutdown_connections 2023-10-03T10:15:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.754+0000 7f5dff3b0700 1 -- 172.21.15.19:0/82550304 wait complete. 2023-10-03T10:15:35.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.812+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fab7812d1f0 con 0x7fab7806e570 2023-10-03T10:15:35.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.812+0000 7fab74ff9700 1 -- 172.21.15.19:0/2095850191 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab68017020 con 0x7fab7806e570 2023-10-03T10:15:35.813 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 msgr2=0x7fab7813cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 0x7fab7813cf50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fab68000f60 tx=0x7fab6800c730 comp rx=0 tx=0).stop 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 shutdown_connections 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab7813d9d0 0x7fab7812adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab7806e570 0x7fab7813cf50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 --2- 172.21.15.19:0/2095850191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab7806f050 0x7fab7813d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 >> 172.21.15.19:0/2095850191 conn(0x7fab780a2aa0 msgr2=0x7fab7809cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 shutdown_connections 2023-10-03T10:15:35.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.815+0000 7fab7e5b4700 1 -- 172.21.15.19:0/2095850191 wait complete. 2023-10-03T10:15:35.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:35.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.861+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6bcc09de50 con 0x7f6bcc12ff20 2023-10-03T10:15:35.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.862+0000 7f6bc97fa700 1 -- 172.21.15.19:0/2860474753 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bbc02f900 con 0x7f6bcc12ff20 2023-10-03T10:15:35.862 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:35.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 msgr2=0x7f6bcc09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc06c6b0 tx=0x7f6bbc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 shutdown_connections 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bcc133a80 0x7f6bcc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bcc12ff20 0x7f6bcc09c480 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 --2- 172.21.15.19:0/2860474753 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bcc130a70 0x7f6bcc09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 >> 172.21.15.19:0/2860474753 conn(0x7f6bcc0a4210 msgr2=0x7f6bcc09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 shutdown_connections 2023-10-03T10:15:35.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.864+0000 7f6bd2b8e700 1 -- 172.21.15.19:0/2860474753 wait complete. 2023-10-03T10:15:35.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.867+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1ed00747f0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.867+0000 7f1ec67fc700 1 -- 172.21.15.19:0/359333520 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ec0018ba0 con 0x7f1ed012ccb0 2023-10-03T10:15:35.867 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.869+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 msgr2=0x7f1ed006e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.869+0000 7f1ed8047700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000c8b0 tx=0x7f1ec000cbc0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 shutdown_connections 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ed0130040 0x7f1ed006f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ed012ccb0 0x7f1ed006e780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 --2- 172.21.15.19:0/359333520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ed012fc70 0x7f1ed006ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:35.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 >> 172.21.15.19:0/359333520 conn(0x7f1ed009e7e0 msgr2=0x7f1ed012c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:35.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 shutdown_connections 2023-10-03T10:15:35.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:35.870+0000 7f1ed8047700 1 -- 172.21.15.19:0/359333520 wait complete. 2023-10-03T10:15:35.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:35.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:36.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:36.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:36.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:36.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:36.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.919+0000 7f1a9b1e5700 1 Processor -- start 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.919+0000 7f1a9b1e5700 1 -- start start 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a9b1e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a9409e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a9b1e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a9b1e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a9409a810 con 0x7f1a9406a770 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a9b1e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9406ab40 con 0x7f1a9413d1f0 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a9b1e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9409ebc0 con 0x7f1a9409de00 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a9409e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a99782700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a9409e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33578/0 (socket says 172.21.15.19:33578) 2023-10-03T10:15:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a99782700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59996/0 (socket says 172.21.15.19:59996) 2023-10-03T10:15:36.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.920+0000 7f1a93fff700 1 -- 172.21.15.19:0/1173400777 learned_addr learned my addr 172.21.15.19:0/1173400777 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a99782700 1 -- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 msgr2=0x7f1a9409e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a99782700 1 --2- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a9409e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a99782700 1 -- 172.21.15.19:0/1173400777 >> v1:172.21.15.19:6789/0 conn(0x7f1a9406a770 legacy=0x7f1a9409d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a99782700 1 -- 172.21.15.19:0/1173400777 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9409e920 con 0x7f1a9413d1f0 2023-10-03T10:15:36.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a99782700 1 --2- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009dc0 tx=0x7f1a8c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3fd05df0141ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a937fe700 1 -- 172.21.15.19:0/1173400777 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00e070 con 0x7f1a9413d1f0 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a937fe700 1 -- 172.21.15.19:0/1173400777 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00bb20 con 0x7f1a9413d1f0 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.921+0000 7f1a937fe700 1 -- 172.21.15.19:0/1173400777 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c012430 con 0x7f1a9413d1f0 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 msgr2=0x7f1a9413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c009dc0 tx=0x7f1a8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1173400777 shutdown_connections 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a9413f5d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1173400777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a9409e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1173400777 >> 172.21.15.19:0/1173400777 conn(0x7f1a94066f50 msgr2=0x7f1a9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1173400777 shutdown_connections 2023-10-03T10:15:36.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.922+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1173400777 wait complete. 2023-10-03T10:15:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.923+0000 7f1a9b1e5700 1 Processor -- start 2023-10-03T10:15:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.923+0000 7f1a9b1e5700 1 -- start start 2023-10-03T10:15:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 0x7f1a941cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a941ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a941cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a940a1b70 con 0x7f1a9406a770 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94072450 con 0x7f1a9413d1f0 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a9b1e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9409f1a0 con 0x7f1a9409de00 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a98f81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 0x7f1a941cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a98f81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 0x7f1a941cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49888/0 (socket says 172.21.15.19:49888) 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a98f81700 1 -- 172.21.15.19:0/1841099560 learned_addr learned my addr 172.21.15.19:0/1841099560 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a99782700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a941cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.924+0000 7f1a93fff700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a941ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 -- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 msgr2=0x7f1a941ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a941ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 -- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 msgr2=0x7f1a941cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 0x7f1a941cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 -- 172.21.15.19:0/1841099560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8c009a70 con 0x7f1a9413d1f0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a93fff700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a941ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a99782700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a941cd440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c016000 tx=0x7f1a8c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c004800 con 0x7f1a9413d1f0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c020070 con 0x7f1a9413d1f0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9406ea80 con 0x7f1a9413d1f0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c0276c0 con 0x7f1a9413d1f0 2023-10-03T10:15:36.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.925+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a94070880 con 0x7f1a9413d1f0 2023-10-03T10:15:36.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.926+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a8c012430 con 0x7f1a9413d1f0 2023-10-03T10:15:36.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.926+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a8c022070 con 0x7f1a9413d1f0 2023-10-03T10:15:36.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.927+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9406fa60 con 0x7f1a9413d1f0 2023-10-03T10:15:36.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.932+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a8c0269d0 con 0x7f1a9413d1f0 2023-10-03T10:15:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.979+0000 7fc90ffd6700 1 Processor -- start 2023-10-03T10:15:36.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 -- start start 2023-10-03T10:15:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc9081338a0 0x7fc908133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 0x7fc90813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806ef30 con 0x7fc90809de50 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90806fef0 con 0x7fc9081338a0 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90ffd6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081334b0 con 0x7fc90809e930 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90d571700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc90809de50 0x7fc90809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44958/0 (socket says 172.21.15.19:44958) 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90d571700 1 -- 172.21.15.19:0/3239703769 learned_addr learned my addr 172.21.15.19:0/3239703769 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.980+0000 7fc90dd72700 1 --2- 172.21.15.19:0/3239703769 >> v2:172.21.15.19:3300/0 conn(0x7fc9081338a0 0x7fc908133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90e573700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 0x7fc90813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90dd72700 1 -- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 msgr2=0x7fc90813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90dd72700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 0x7fc90813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90dd72700 1 -- 172.21.15.19:0/3239703769 >> v1:172.21.15.19:6789/0 conn(0x7fc90809de50 legacy=0x7fc90809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90cd70700 1 -- 172.21.15.19:0/3239703769 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1696351439 0 0) 0x7fc90806ef30 con 0x7fc90809de50 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90dd72700 1 -- 172.21.15.19:0/3239703769 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90806fc30 con 0x7fc9081338a0 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90e573700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 0x7fc90813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90dd72700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9081338a0 0x7fc908133c70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc904009840 tx=0x7fc904009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c663273695bd953d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.981+0000 7fc90cd70700 1 -- 172.21.15.19:0/3239703769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904011830 con 0x7fc9081338a0 2023-10-03T10:15:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.982+0000 7fc90cd70700 1 -- 172.21.15.19:0/3239703769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc904011990 con 0x7fc9081338a0 2023-10-03T10:15:36.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.982+0000 7fc90cd70700 1 -- 172.21.15.19:0/3239703769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc904011d20 con 0x7fc9081338a0 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.982+0000 7fc90ffd6700 1 -- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9081338a0 msgr2=0x7fc908133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.982+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9081338a0 0x7fc908133c70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc904009840 tx=0x7fc904009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 -- 172.21.15.19:0/3239703769 shutdown_connections 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc90809e930 0x7fc90813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/3239703769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9081338a0 0x7fc908133c70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 -- 172.21.15.19:0/3239703769 >> 172.21.15.19:0/3239703769 conn(0x7fc9080a2aa0 msgr2=0x7fc9080a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 -- 172.21.15.19:0/3239703769 shutdown_connections 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.983+0000 7fc90ffd6700 1 -- 172.21.15.19:0/3239703769 wait complete. 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 Processor -- start 2023-10-03T10:15:36.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 -- start start 2023-10-03T10:15:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc90809de50 0x7fc90811d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 0x7fc90811dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908120ef0 con 0x7fc90809e930 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081210f0 con 0x7fc90809de50 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90ffd6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc90811ffe0 con 0x7fc9081338a0 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90e573700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90d571700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 0x7fc90811dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.984+0000 7fc90e573700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33610/0 (socket says 172.21.15.19:33610) 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 -- 172.21.15.19:0/1461358026 learned_addr learned my addr 172.21.15.19:0/1461358026 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90dd72700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc90809de50 0x7fc90811d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 -- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc90809de50 msgr2=0x7fc90811d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc90809de50 0x7fc90811d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 -- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 msgr2=0x7fc90811dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 0x7fc90811dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 -- 172.21.15.19:0/1461358026 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009a70 con 0x7fc9081338a0 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90d571700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 0x7fc90811dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90e573700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc900009f00 tx=0x7fc90000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc900009d70 con 0x7fc9081338a0 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9040094a0 con 0x7fc9081338a0 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90000f040 con 0x7fc9081338a0 2023-10-03T10:15:36.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90000ce20 con 0x7fc9081338a0 2023-10-03T10:15:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.985+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9080a0d20 con 0x7fc9081338a0 2023-10-03T10:15:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.987+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc900014480 con 0x7fc9081338a0 2023-10-03T10:15:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.987+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90811a470 con 0x7fc9081338a0 2023-10-03T10:15:36.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.987+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc9000417e0 con 0x7fc9081338a0 2023-10-03T10:15:36.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:36.996+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc900045060 con 0x7fc9081338a0 2023-10-03T10:15:37.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.038+0000 7f0263742700 1 Processor -- start 2023-10-03T10:15:37.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.038+0000 7f0263742700 1 -- start start 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f025c09f650 0x7f025c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c070940 con 0x7f025c09f650 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c06fd60 con 0x7f025c09f240 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0263742700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c06fa80 con 0x7f025c09e930 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0261cdf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f025c09f650 0x7f025c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0261cdf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f025c09f650 0x7f025c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49912/0 (socket says 172.21.15.19:49912) 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f02614de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0261cdf700 1 -- 172.21.15.19:0/4038575696 learned_addr learned my addr 172.21.15.19:0/4038575696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.039+0000 7f0260cdd700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 -- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 msgr2=0x7f025c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 -- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 msgr2=0x7f025c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 -- 172.21.15.19:0/4038575696 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c09fb60 con 0x7f025c09f650 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0260cdd700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0261cdf700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c131d30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0254009e50 tx=0x7f025400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0324fd6ad8d453 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0253fff700 1 -- 172.21.15.19:0/4038575696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400e070 con 0x7f025c09f650 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0253fff700 1 -- 172.21.15.19:0/4038575696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400b910 con 0x7f025c09f650 2023-10-03T10:15:37.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.040+0000 7f0253fff700 1 -- 172.21.15.19:0/4038575696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400bcc0 con 0x7f025c09f650 2023-10-03T10:15:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 -- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 msgr2=0x7f025c131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c131d30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0254009e50 tx=0x7f025400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 -- 172.21.15.19:0/4038575696 shutdown_connections 2023-10-03T10:15:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c131d30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 --2- 172.21.15.19:0/4038575696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 -- 172.21.15.19:0/4038575696 >> 172.21.15.19:0/4038575696 conn(0x7f025c0a4210 msgr2=0x7f025c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 -- 172.21.15.19:0/4038575696 shutdown_connections 2023-10-03T10:15:37.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.041+0000 7f0263742700 1 -- 172.21.15.19:0/4038575696 wait complete. 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.043+0000 7f0263742700 1 Processor -- start 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.043+0000 7f0263742700 1 -- start start 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c1c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1a2440 con 0x7f025c09f650 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1a40e0 con 0x7f025c09f240 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0263742700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025c1a3450 con 0x7f025c09e930 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33636/0 (socket says 172.21.15.19:33636) 2023-10-03T10:15:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 -- 172.21.15.19:0/1398077850 learned_addr learned my addr 172.21.15.19:0/1398077850 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0261cdf700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c1c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f0260cdd700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 -- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 msgr2=0x7f025c1c44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1c44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 -- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 msgr2=0x7f025c1c4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c1c4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.044+0000 7f02614de700 1 -- 172.21.15.19:0/1398077850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c0094a0 con 0x7f025c09e930 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f02614de700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0258012ed0 tx=0x7f0258012f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0258014040 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025800f860 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0254009b30 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025800fbd0 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.045+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c0a0190 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.046+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c09a460 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.047+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f025800fd30 con 0x7f025c09e930 2023-10-03T10:15:37.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.047+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0258043150 con 0x7f025c09e930 2023-10-03T10:15:37.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.052+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f025800b450 con 0x7f025c09e930 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.082+0000 7fc13204b700 1 Processor -- start 2023-10-03T10:15:37.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.082+0000 7fc13204b700 1 -- start start 2023-10-03T10:15:37.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.083+0000 7fc13204b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.083+0000 7fc13204b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 0x7fc12c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc13204b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c070940 con 0x7fc12c09e930 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc13204b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c06fd60 con 0x7fc12c136fe0 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc13204b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c06fa80 con 0x7fc12c09f410 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc12c09e930 0x7fc12c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44966/0 (socket says 172.21.15.19:44966) 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12b7fe700 1 -- 172.21.15.19:0/3969468134 learned_addr learned my addr 172.21.15.19:0/3969468134 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12bfff700 1 --2- 172.21.15.19:0/3969468134 >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 0x7fc12c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 --2- 172.21.15.19:0/3969468134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 -- 172.21.15.19:0/3969468134 >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 msgr2=0x7fc12c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 --2- 172.21.15.19:0/3969468134 >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 0x7fc12c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 -- 172.21.15.19:0/3969468134 >> v1:172.21.15.19:6789/0 conn(0x7fc12c09e930 legacy=0x7fc12c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 -- 172.21.15.19:0/3969468134 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c09fb60 con 0x7fc12c09f410 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12bfff700 1 --2- 172.21.15.19:0/3969468134 >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 0x7fc12c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.084+0000 7fc12affd700 1 --2- 172.21.15.19:0/3969468134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c136aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc120009840 tx=0x7fc120009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0bf39b411d1203b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc12a7fc700 1 -- 172.21.15.19:0/3969468134 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120011830 con 0x7fc12c09f410 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc12a7fc700 1 -- 172.21.15.19:0/3969468134 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc120011990 con 0x7fc12c09f410 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc12a7fc700 1 -- 172.21.15.19:0/3969468134 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc120011d20 con 0x7fc12c09f410 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 -- 172.21.15.19:0/3969468134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 msgr2=0x7fc12c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 --2- 172.21.15.19:0/3969468134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c136aa0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc120009840 tx=0x7fc120009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:37.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 -- 172.21.15.19:0/3969468134 shutdown_connections 2023-10-03T10:15:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 --2- 172.21.15.19:0/3969468134 >> v2:172.21.15.19:3300/0 conn(0x7fc12c136fe0 0x7fc12c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 --2- 172.21.15.19:0/3969468134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c136aa0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.085+0000 7fc13204b700 1 -- 172.21.15.19:0/3969468134 >> 172.21.15.19:0/3969468134 conn(0x7fc12c0a4210 msgr2=0x7fc12c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.086+0000 7fc13204b700 1 -- 172.21.15.19:0/3969468134 shutdown_connections 2023-10-03T10:15:37.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.086+0000 7fc13204b700 1 -- 172.21.15.19:0/3969468134 wait complete. 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.087+0000 7fc13204b700 1 Processor -- start 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.087+0000 7fc13204b700 1 -- start start 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 0x7fc12c11b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c11be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12c136fe0 0x7fc12c11c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:37.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c136d40 con 0x7fc12c136fe0 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c11cd90 con 0x7fc12c09e930 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc13204b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c11e730 con 0x7fc12c09f410 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc12affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c11be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc12affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c11be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33660/0 (socket says 172.21.15.19:33660) 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc12affd700 1 -- 172.21.15.19:0/2720267934 learned_addr learned my addr 172.21.15.19:0/2720267934 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:37.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc12b7fe700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 0x7fc12c11b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.088+0000 7fc12bfff700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12c136fe0 0x7fc12c11c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 -- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 msgr2=0x7fc12c11be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c11be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 -- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12c136fe0 msgr2=0x7fc12c11c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12c136fe0 0x7fc12c11c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 -- 172.21.15.19:0/2720267934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009a70 con 0x7fc12c09e930 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc12b7fe700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 0x7fc12c11b930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc11c001e70 tx=0x7fc11c00c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c005d70 con 0x7fc12c09e930 2023-10-03T10:15:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c00ce60 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c015b60 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200094a0 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.089+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c11eb80 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.090+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc11c01b020 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.091+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c06d410 con 0x7fc12c09e930 2023-10-03T10:15:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.091+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc11c046ec0 con 0x7fc12c09e930 2023-10-03T10:15:37.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.100+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc11c007590 con 0x7fc12c09e930 2023-10-03T10:15:37.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.150+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a94074ea0 con 0x7f1a9413d1f0 2023-10-03T10:15:37.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.151+0000 7f1a917fa700 1 -- 172.21.15.19:0/1841099560 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a8c0263e0 con 0x7f1a9413d1f0 2023-10-03T10:15:37.150 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 msgr2=0x7f1a941cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a941cd440 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c016000 tx=0x7f1a8c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 shutdown_connections 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a9413d1f0 0x7f1a941cd440 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a9406a770 0x7f1a941cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 --2- 172.21.15.19:0/1841099560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a9409de00 0x7f1a941ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 >> 172.21.15.19:0/1841099560 conn(0x7f1a94066f50 msgr2=0x7f1a9413c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 shutdown_connections 2023-10-03T10:15:37.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.153+0000 7f1a9b1e5700 1 -- 172.21.15.19:0/1841099560 wait complete. 2023-10-03T10:15:37.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:37.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.220+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc90806f640 con 0x7fc9081338a0 2023-10-03T10:15:37.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.220+0000 7fc8fe7fc700 1 -- 172.21.15.19:0/1461358026 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc900045020 con 0x7fc9081338a0 2023-10-03T10:15:37.220 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:37.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 msgr2=0x7fc90811e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc900009f00 tx=0x7fc90000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 shutdown_connections 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc9081338a0 0x7fc90811e130 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc90809de50 0x7fc90811d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 --2- 172.21.15.19:0/1461358026 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc90809e930 0x7fc90811dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.222+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 >> 172.21.15.19:0/1461358026 conn(0x7fc9080a2aa0 msgr2=0x7fc9081bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.223+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 shutdown_connections 2023-10-03T10:15:37.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.223+0000 7fc90ffd6700 1 -- 172.21.15.19:0/1461358026 wait complete. 2023-10-03T10:15:37.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.289+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f025c071d20 con 0x7f025c09e930 2023-10-03T10:15:37.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.289+0000 7f0251ffb700 1 -- 172.21.15.19:0/1398077850 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0258017360 con 0x7f025c09e930 2023-10-03T10:15:37.289 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 msgr2=0x7f025c1c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0258012ed0 tx=0x7f0258012f00 comp rx=0 tx=0).stop 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 shutdown_connections 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025c09f650 0x7f025c1c4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025c09e930 0x7f025c1c3fa0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 --2- 172.21.15.19:0/1398077850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f025c09f240 0x7f025c1c44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 >> 172.21.15.19:0/1398077850 conn(0x7f025c0a4210 msgr2=0x7f025c06c460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 shutdown_connections 2023-10-03T10:15:37.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.292+0000 7f0263742700 1 -- 172.21.15.19:0/1398077850 wait complete. 2023-10-03T10:15:37.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:37.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.329+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc12c071d20 con 0x7fc12c09e930 2023-10-03T10:15:37.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.329+0000 7fc113fff700 1 -- 172.21.15.19:0/2720267934 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc11c023020 con 0x7fc12c09e930 2023-10-03T10:15:37.329 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 msgr2=0x7fc12c11b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 0x7fc12c11b930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc11c001e70 tx=0x7fc11c00c7e0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 shutdown_connections 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc12c136fe0 0x7fc12c11c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc12c09e930 0x7fc12c11b930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.331+0000 7fc13204b700 1 --2- 172.21.15.19:0/2720267934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc12c09f410 0x7fc12c11be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.332+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 >> 172.21.15.19:0/2720267934 conn(0x7fc12c0a4210 msgr2=0x7fc12c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.332+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 shutdown_connections 2023-10-03T10:15:37.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:37.332+0000 7fc13204b700 1 -- 172.21.15.19:0/2720267934 wait complete. 2023-10-03T10:15:37.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:38.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:38.237 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:38.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.314+0000 7f45621cd700 1 Processor -- start 2023-10-03T10:15:38.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.314+0000 7f45621cd700 1 -- start start 2023-10-03T10:15:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f45621cd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f45621cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f45621cd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455c09b120 con 0x7f455c09e000 2023-10-03T10:15:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f45621cd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455c06b460 con 0x7f455c09d6f0 2023-10-03T10:15:38.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f45621cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f455c09a7e0 con 0x7f455c09e440 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f455bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f455b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f4552ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f455c09e000 0x7f455c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44972/0 (socket says 172.21.15.19:44972) 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.315+0000 7f4552ffd700 1 -- 172.21.15.19:0/270700605 learned_addr learned my addr 172.21.15.19:0/270700605 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455b7fe700 1 -- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 msgr2=0x7f455c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455b7fe700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455b7fe700 1 -- 172.21.15.19:0/270700605 >> v1:172.21.15.19:6789/0 conn(0x7f455c09e000 legacy=0x7f455c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455b7fe700 1 -- 172.21.15.19:0/270700605 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c09a500 con 0x7f455c09d6f0 2023-10-03T10:15:38.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455affd700 1 -- 172.21.15.19:0/270700605 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087241301 0 0) 0x7f455c09b120 con 0x7f455c09e000 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455bfff700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455b7fe700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c09dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cec482bc543f4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455affd700 1 -- 172.21.15.19:0/270700605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011830 con 0x7f455c09d6f0 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455affd700 1 -- 172.21.15.19:0/270700605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c011990 con 0x7f455c09d6f0 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.316+0000 7f455affd700 1 -- 172.21.15.19:0/270700605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c011d20 con 0x7f455c09d6f0 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 -- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 msgr2=0x7f455c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c09dac0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f454c009870 tx=0x7f454c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 -- 172.21.15.19:0/270700605 shutdown_connections 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 --2- 172.21.15.19:0/270700605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c09dac0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 -- 172.21.15.19:0/270700605 >> 172.21.15.19:0/270700605 conn(0x7f455c066f50 msgr2=0x7f455c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 -- 172.21.15.19:0/270700605 shutdown_connections 2023-10-03T10:15:38.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.317+0000 7f45621cd700 1 -- 172.21.15.19:0/270700605 wait complete. 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.318+0000 7f45621cd700 1 Processor -- start 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 -- start start 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c1a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c1c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c1a8110 con 0x7f455c09d6f0 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c1b9180 con 0x7f455c09e000 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.319+0000 7f45621cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f455c1a8310 con 0x7f455c09e440 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60062/0 (socket says 172.21.15.19:60062) 2023-10-03T10:15:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 -- 172.21.15.19:0/915082240 learned_addr learned my addr 172.21.15.19:0/915082240 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f455bfff700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c1c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f455b7fe700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c1a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 -- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 msgr2=0x7f455c1c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c1c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 -- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 msgr2=0x7f455c1a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c1a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 -- 172.21.15.19:0/915082240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009a70 con 0x7f455c09e000 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f455b7fe700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c1a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f455bfff700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c1c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4552ffd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f454400c520 tx=0x7f454400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.320+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544004c80 con 0x7f455c09e000 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.321+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544004e00 con 0x7f455c09e000 2023-10-03T10:15:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.321+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544007310 con 0x7f455c09e000 2023-10-03T10:15:38.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.321+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c0094a0 con 0x7f455c09e000 2023-10-03T10:15:38.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.321+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c1a6400 con 0x7f455c09e000 2023-10-03T10:15:38.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.322+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c09c710 con 0x7f455c09e000 2023-10-03T10:15:38.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.323+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4544007470 con 0x7f455c09e000 2023-10-03T10:15:38.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.323+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f454403fa10 con 0x7f455c09e000 2023-10-03T10:15:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.327+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45440133c0 con 0x7f455c09e000 2023-10-03T10:15:38.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:38.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.393+0000 7ff5d71e2700 1 Processor -- start 2023-10-03T10:15:38.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.393+0000 7ff5d71e2700 1 -- start start 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d71e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 0x7ff5d0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d71e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d0135e50 0x7ff5d0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d71e2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d009f130 con 0x7ff5d009d6f0 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d71e2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d009f520 con 0x7ff5d009e1d0 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d71e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d009e930 con 0x7ff5d0135e50 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d4f7e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff5d009d6f0 0x7ff5d009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44978/0 (socket says 172.21.15.19:44978) 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d4f7e700 1 -- 172.21.15.19:0/3060677668 learned_addr learned my addr 172.21.15.19:0/3060677668 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:38.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5d577f700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d0135e50 0x7ff5d0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 0x7ff5d0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3060677668 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976208226 0 0) 0x7ff5d009f130 con 0x7ff5d009d6f0 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3060677668 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c00035b0 con 0x7ff5d009d6f0 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cffff700 1 -- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d0135e50 msgr2=0x7ff5d0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d0135e50 0x7ff5d0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cffff700 1 -- 172.21.15.19:0/3060677668 >> v1:172.21.15.19:6789/0 conn(0x7ff5d009d6f0 legacy=0x7ff5d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.394+0000 7ff5cffff700 1 -- 172.21.15.19:0/3060677668 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d009b2d0 con 0x7ff5d009e1d0 2023-10-03T10:15:38.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.395+0000 7ff5cffff700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 0x7ff5d0135910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36c6a013f9553d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.395+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3060677668 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011830 con 0x7ff5d009e1d0 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.395+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3060677668 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc011990 con 0x7ff5d009e1d0 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.395+0000 7ff5cf7fe700 1 -- 172.21.15.19:0/3060677668 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc011d20 con 0x7ff5d009e1d0 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 -- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 msgr2=0x7ff5d0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 0x7ff5d0135910 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 -- 172.21.15.19:0/3060677668 shutdown_connections 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d0135e50 0x7ff5d0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/3060677668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009e1d0 0x7ff5d0135910 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 -- 172.21.15.19:0/3060677668 >> 172.21.15.19:0/3060677668 conn(0x7ff5d0066f50 msgr2=0x7ff5d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 -- 172.21.15.19:0/3060677668 shutdown_connections 2023-10-03T10:15:38.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.396+0000 7ff5d71e2700 1 -- 172.21.15.19:0/3060677668 wait complete. 2023-10-03T10:15:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.397+0000 7ff5d71e2700 1 Processor -- start 2023-10-03T10:15:38.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.397+0000 7ff5d71e2700 1 -- start start 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d009e1d0 0x7ff5d0130e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 0x7ff5d01313c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d013a080 con 0x7ff5d0135e50 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d00a2160 con 0x7ff5d009d6f0 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d71e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d013b300 con 0x7ff5d009e1d0 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d4f7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d4f7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60086/0 (socket says 172.21.15.19:60086) 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d4f7e700 1 -- 172.21.15.19:0/2276568433 learned_addr learned my addr 172.21.15.19:0/2276568433 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5d577f700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 0x7ff5d01313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.398+0000 7ff5cffff700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d009e1d0 0x7ff5d0130e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 -- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d009e1d0 msgr2=0x7ff5d0130e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d009e1d0 0x7ff5d0130e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 -- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 msgr2=0x7ff5d01324f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 -- 172.21.15.19:0/2276568433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0094a0 con 0x7ff5d0135e50 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d4f7e700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:38.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d577f700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 0x7ff5d01313c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ef90 tx=0x7ff5c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800cc30 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800f040 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d01392b0 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8009e60 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.399+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d0132a30 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.400+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff5c8014480 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.401+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5c8041780 con 0x7ff5d0135e50 2023-10-03T10:15:38.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.401+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d0074ea0 con 0x7ff5d0135e50 2023-10-03T10:15:38.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.406+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5c8018020 con 0x7ff5d0135e50 2023-10-03T10:15:38.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 Processor -- start 2023-10-03T10:15:38.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 -- start start 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130540 0x7fe7e8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7e806fb20 0x7fe7e806ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e809a390 con 0x7fe7e806fb20 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e80716a0 con 0x7fe7e8130540 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.455+0000 7fe7ed5f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8071290 con 0x7fe7e8130e50 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33698/0 (socket says 172.21.15.19:33698) 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 -- 172.21.15.19:0/1453066324 learned_addr learned my addr 172.21.15.19:0/1453066324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e6ffd700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130540 0x7fe7e8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e77fe700 1 --2- 172.21.15.19:0/1453066324 >> v2:172.21.15.19:3300/0 conn(0x7fe7e806fb20 0x7fe7e806ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 -- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130540 msgr2=0x7fe7e8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130540 0x7fe7e8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 -- 172.21.15.19:0/1453066324 >> v2:172.21.15.19:3300/0 conn(0x7fe7e806fb20 msgr2=0x7fe7e806ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 --2- 172.21.15.19:0/1453066324 >> v2:172.21.15.19:3300/0 conn(0x7fe7e806fb20 0x7fe7e806ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 -- 172.21.15.19:0/1453066324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e8130340 con 0x7fe7e8130e50 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.456+0000 7fe7e67fc700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009920 tx=0x7fe7dc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac833b35056471c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.457+0000 7fe7e5ffb700 1 -- 172.21.15.19:0/1453066324 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc012b80 con 0x7fe7e8130e50 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.457+0000 7fe7e5ffb700 1 -- 172.21.15.19:0/1453066324 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc012ce0 con 0x7fe7e8130e50 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.457+0000 7fe7e5ffb700 1 -- 172.21.15.19:0/1453066324 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc01b620 con 0x7fe7e8130e50 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 msgr2=0x7fe7e806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009920 tx=0x7fe7dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/1453066324 shutdown_connections 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130540 0x7fe7e8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/1453066324 >> v2:172.21.15.19:3300/0 conn(0x7fe7e806fb20 0x7fe7e806ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/1453066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e8130e50 0x7fe7e806f5e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/1453066324 >> 172.21.15.19:0/1453066324 conn(0x7fe7e80a2aa0 msgr2=0x7fe7e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/1453066324 shutdown_connections 2023-10-03T10:15:38.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.458+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/1453066324 wait complete. 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.459+0000 7fe7ed5f7700 1 Processor -- start 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.459+0000 7fe7ed5f7700 1 -- start start 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e8130540 0x7fe7e8118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130e50 0x7fe7e8119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e81c3ad0 con 0x7fe7e8130540 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e81c3d70 con 0x7fe7e8130e50 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7ed5f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e811b890 con 0x7fe7e806fb20 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33712/0 (socket says 172.21.15.19:33712) 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 -- 172.21.15.19:0/2970271856 learned_addr learned my addr 172.21.15.19:0/2970271856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:38.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e77fe700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130e50 0x7fe7e8119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e67fc700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e8130540 0x7fe7e8118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 -- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130e50 msgr2=0x7fe7e8119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130e50 0x7fe7e8119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 -- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e8130540 msgr2=0x7fe7e8118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e8130540 0x7fe7e8118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 -- 172.21.15.19:0/2970271856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc009550 con 0x7fe7e806fb20 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.460+0000 7fe7e6ffd700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e9b0 tx=0x7fe7d800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.461+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8009710 con 0x7fe7e806fb20 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.461+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d800ee50 con 0x7fe7e806fb20 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.461+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e811bb50 con 0x7fe7e806fb20 2023-10-03T10:15:38.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.461+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800ca50 con 0x7fe7e806fb20 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.461+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e81c4700 con 0x7fe7e806fb20 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.462+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e8074ea0 con 0x7fe7e806fb20 2023-10-03T10:15:38.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.462+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7d800cbb0 con 0x7fe7e806fb20 2023-10-03T10:15:38.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.462+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7d803f6a0 con 0x7fe7e806fb20 2023-10-03T10:15:38.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.467+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7d801be10 con 0x7fe7e806fb20 2023-10-03T10:15:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 Processor -- start 2023-10-03T10:15:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 -- start start 2023-10-03T10:15:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409e410 0x7fcf44130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4409f130 con 0x7fcf4409e000 2023-10-03T10:15:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4409f520 con 0x7fcf4409d6f0 2023-10-03T10:15:38.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.493+0000 7fcf4a338700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4409e930 con 0x7fcf4409e410 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf437fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcf4409e000 0x7fcf44130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44984/0 (socket says 172.21.15.19:44984) 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf437fe700 1 -- 172.21.15.19:0/100445683 learned_addr learned my addr 172.21.15.19:0/100445683 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 --2- 172.21.15.19:0/100445683 >> v2:172.21.15.19:3300/0 conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf488d5700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409e410 0x7fcf44130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 -- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409e410 msgr2=0x7fcf44130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409e410 0x7fcf44130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 -- 172.21.15.19:0/100445683 >> v1:172.21.15.19:6789/0 conn(0x7fcf4409e000 legacy=0x7fcf44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 -- 172.21.15.19:0/100445683 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4409b2d0 con 0x7fcf4409d6f0 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf42ffd700 1 -- 172.21.15.19:0/100445683 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328357584 0 0) 0x7fcf4409f130 con 0x7fcf4409e000 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.494+0000 7fcf43fff700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009840 tx=0x7fcf34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694f666a125d8ce8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf42ffd700 1 -- 172.21.15.19:0/100445683 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34011830 con 0x7fcf4409d6f0 2023-10-03T10:15:38.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf42ffd700 1 -- 172.21.15.19:0/100445683 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34011990 con 0x7fcf4409d6f0 2023-10-03T10:15:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf42ffd700 1 -- 172.21.15.19:0/100445683 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34011d20 con 0x7fcf4409d6f0 2023-10-03T10:15:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 -- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fcf34009840 tx=0x7fcf34009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 -- 172.21.15.19:0/100445683 shutdown_connections 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409e410 0x7fcf44130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 --2- 172.21.15.19:0/100445683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409d6f0 0x7fcf4409dac0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 -- 172.21.15.19:0/100445683 >> 172.21.15.19:0/100445683 conn(0x7fcf44066f50 msgr2=0x7fcf4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 -- 172.21.15.19:0/100445683 shutdown_connections 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.495+0000 7fcf4a338700 1 -- 172.21.15.19:0/100445683 wait complete. 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.496+0000 7fcf4a338700 1 Processor -- start 2023-10-03T10:15:38.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 -- start start 2023-10-03T10:15:38.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409d6f0 0x7fcf4411dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf4409e410 0x7fcf4411e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf44121570 con 0x7fcf4409e000 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4411fa50 con 0x7fcf4409e410 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf4a338700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440a2020 con 0x7fcf4409d6f0 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf43fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409d6f0 0x7fcf4411dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.497+0000 7fcf437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49990/0 (socket says 172.21.15.19:49990) 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 -- 172.21.15.19:0/3240813221 learned_addr learned my addr 172.21.15.19:0/3240813221 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf488d5700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf4409e410 0x7fcf4411e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:38.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 -- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409d6f0 msgr2=0x7fcf4411dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409d6f0 0x7fcf4411dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 -- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf4409e410 msgr2=0x7fcf4411e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf4409e410 0x7fcf4411e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 -- 172.21.15.19:0/3240813221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf340094a0 con 0x7fcf4409e000 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf437fe700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf38010c20 tx=0x7fcf38010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800eaa0 con 0x7fcf4409e000 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4409c700 con 0x7fcf4409e000 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3800ec00 con 0x7fcf4409e000 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.498+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800b0d0 con 0x7fcf4409e000 2023-10-03T10:15:38.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.499+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf44121850 con 0x7fcf4409e000 2023-10-03T10:15:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.500+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf3800b230 con 0x7fcf4409e000 2023-10-03T10:15:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.500+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf38043140 con 0x7fcf4409e000 2023-10-03T10:15:38.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.500+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4411ac20 con 0x7fcf4409e000 2023-10-03T10:15:38.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.505+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf3801c070 con 0x7fcf4409e000 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.545+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f455c09f420 con 0x7f455c09e000 2023-10-03T10:15:38.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.546+0000 7f4558ff9700 1 -- 172.21.15.19:0/915082240 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4544011360 con 0x7f455c09e000 2023-10-03T10:15:38.546 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 msgr2=0x7f455c1a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f454400c520 tx=0x7f454400c8e0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 shutdown_connections 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f455c09e440 0x7f455c1c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f455c09d6f0 0x7f455c1a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 --2- 172.21.15.19:0/915082240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f455c09e000 0x7f455c1a58c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 >> 172.21.15.19:0/915082240 conn(0x7f455c066f50 msgr2=0x7f455c1bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 shutdown_connections 2023-10-03T10:15:38.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.548+0000 7f45621cd700 1 -- 172.21.15.19:0/915082240 wait complete. 2023-10-03T10:15:38.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:38.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.639+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5d006c360 con 0x7ff5d0135e50 2023-10-03T10:15:38.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.639+0000 7ff5cd7fa700 1 -- 172.21.15.19:0/2276568433 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff5c8045060 con 0x7ff5d0135e50 2023-10-03T10:15:38.639 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.641+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 msgr2=0x7ff5d01313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.641+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 0x7ff5d01313c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800ef90 tx=0x7ff5c800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 shutdown_connections 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5d0135e50 0x7ff5d01313c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5d009d6f0 0x7ff5d01324f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 --2- 172.21.15.19:0/2276568433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5d009e1d0 0x7ff5d0130e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 >> 172.21.15.19:0/2276568433 conn(0x7ff5d0066f50 msgr2=0x7ff5d0132ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 shutdown_connections 2023-10-03T10:15:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.642+0000 7ff5d71e2700 1 -- 172.21.15.19:0/2276568433 wait complete. 2023-10-03T10:15:38.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:38.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.703+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe7e81c4950 con 0x7fe7e806fb20 2023-10-03T10:15:38.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.703+0000 7fe7cf7fe700 1 -- 172.21.15.19:0/2970271856 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7d801b3b0 con 0x7fe7e806fb20 2023-10-03T10:15:38.703 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.706+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 msgr2=0x7fe7e81c41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.706+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800e9b0 tx=0x7fe7d800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 shutdown_connections 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7e8130e50 0x7fe7e8119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7e806fb20 0x7fe7e81c41c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 --2- 172.21.15.19:0/2970271856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7e8130540 0x7fe7e8118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 >> 172.21.15.19:0/2970271856 conn(0x7fe7e80a2aa0 msgr2=0x7fe7e812d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 shutdown_connections 2023-10-03T10:15:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.707+0000 7fe7ed5f7700 1 -- 172.21.15.19:0/2970271856 wait complete. 2023-10-03T10:15:38.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.724+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf44074ea0 con 0x7fcf4409e000 2023-10-03T10:15:38.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.724+0000 7fcf40ff9700 1 -- 172.21.15.19:0/3240813221 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf3801d860 con 0x7fcf4409e000 2023-10-03T10:15:38.724 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:38.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 msgr2=0x7fcf4411e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf38010c20 tx=0x7fcf38010f30 comp rx=0 tx=0).stop 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 shutdown_connections 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf4409e410 0x7fcf4411e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf4409d6f0 0x7fcf4411dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 --2- 172.21.15.19:0/3240813221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf4409e000 0x7fcf4411e270 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 >> 172.21.15.19:0/3240813221 conn(0x7fcf44066f50 msgr2=0x7fcf44130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 shutdown_connections 2023-10-03T10:15:38.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:38.727+0000 7fcf4a338700 1 -- 172.21.15.19:0/3240813221 wait complete. 2023-10-03T10:15:38.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:39.564 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:39.655 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.711+0000 7f6f73cdd700 1 Processor -- start 2023-10-03T10:15:39.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 -- start start 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 0x7f6f6c1384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c09c190 con 0x7f6f6c09d6f0 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c09b090 con 0x7f6f6c09e250 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f73cdd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c09a6c0 con 0x7f6f6c130750 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f71a79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f71a79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60118/0 (socket says 172.21.15.19:60118) 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f71a79700 1 -- 172.21.15.19:0/510253133 learned_addr learned my addr 172.21.15.19:0/510253133 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.712+0000 7f6f7227a700 1 --2- 172.21.15.19:0/510253133 >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 0x7f6f6c1384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f71a79700 1 -- 172.21.15.19:0/510253133 >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 msgr2=0x7f6f6c1384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f71a79700 1 --2- 172.21.15.19:0/510253133 >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 0x7f6f6c1384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f71a79700 1 -- 172.21.15.19:0/510253133 >> v1:172.21.15.19:6789/0 conn(0x7f6f6c09d6f0 legacy=0x7f6f6c09db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f71a79700 1 -- 172.21.15.19:0/510253133 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c131060 con 0x7f6f6c130750 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f70a77700 1 -- 172.21.15.19:0/510253133 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484353723 0 0) 0x7f6f6c09c190 con 0x7f6f6c09d6f0 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f7227a700 1 --2- 172.21.15.19:0/510253133 >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 0x7f6f6c1384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f71a79700 1 --2- 172.21.15.19:0/510253133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098f0 tx=0x7f6f64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44a21dc0cc423b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f70a77700 1 -- 172.21.15.19:0/510253133 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011830 con 0x7f6f6c130750 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f70a77700 1 -- 172.21.15.19:0/510253133 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64011990 con 0x7f6f6c130750 2023-10-03T10:15:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.713+0000 7f6f70a77700 1 -- 172.21.15.19:0/510253133 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64011d20 con 0x7f6f6c130750 2023-10-03T10:15:39.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 -- 172.21.15.19:0/510253133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 msgr2=0x7f6f6c130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/510253133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6f640098f0 tx=0x7f6f64009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 -- 172.21.15.19:0/510253133 shutdown_connections 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/510253133 >> v2:172.21.15.19:3300/0 conn(0x7f6f6c09e250 0x7f6f6c1384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/510253133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c130750 0x7f6f6c130b20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 -- 172.21.15.19:0/510253133 >> 172.21.15.19:0/510253133 conn(0x7f6f6c09f470 msgr2=0x7f6f6c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 -- 172.21.15.19:0/510253133 shutdown_connections 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.714+0000 7f6f73cdd700 1 -- 172.21.15.19:0/510253133 wait complete. 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 Processor -- start 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 -- start start 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 0x7f6f6c12dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c09e250 0x7f6f6c12e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 0x7f6f6c12e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c08bad0 con 0x7f6f6c130750 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c09b2b0 con 0x7f6f6c09e250 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f73cdd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c12fc40 con 0x7f6f6c09d6f0 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f71a79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 0x7f6f6c12dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f7227a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 0x7f6f6c12e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.715+0000 7f6f71278700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c09e250 0x7f6f6c12e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f71a79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 0x7f6f6c12dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33736/0 (socket says 172.21.15.19:33736) 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f71a79700 1 -- 172.21.15.19:0/1443652092 learned_addr learned my addr 172.21.15.19:0/1443652092 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 -- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 msgr2=0x7f6f6c12dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 0x7f6f6c12dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 -- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c09e250 msgr2=0x7f6f6c12e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c09e250 0x7f6f6c12e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 -- 172.21.15.19:0/1443652092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c009a70 con 0x7f6f6c130750 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f7227a700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 0x7f6f6c12e550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00efc0 tx=0x7f6f5c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c009e80 con 0x7f6f6c130750 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c00f040 con 0x7f6f6c130750 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f64009550 con 0x7f6f6c130750 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c00ccd0 con 0x7f6f6c130750 2023-10-03T10:15:39.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.716+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c08be40 con 0x7f6f6c130750 2023-10-03T10:15:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.717+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f5c014480 con 0x7f6f6c130750 2023-10-03T10:15:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.717+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0747f0 con 0x7f6f6c130750 2023-10-03T10:15:39.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.717+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f5c03fcb0 con 0x7f6f6c130750 2023-10-03T10:15:39.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.722+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f5c012750 con 0x7f6f6c130750 2023-10-03T10:15:39.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:39.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:39.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.800+0000 7faec1f2b700 1 Processor -- start 2023-10-03T10:15:39.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 -- start start 2023-10-03T10:15:39.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc06b080 0x7faebc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faebc131b40 0x7faebc131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faebc09ece0 con 0x7faebc131b40 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc09e760 con 0x7faebc06b080 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faec1f2b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc09e040 con 0x7faebc06a770 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.801+0000 7faebb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33742/0 (socket says 172.21.15.19:33742) 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 -- 172.21.15.19:0/841965293 learned_addr learned my addr 172.21.15.19:0/841965293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebaffd700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc06b080 0x7faebc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebbfff700 1 --2- 172.21.15.19:0/841965293 >> v2:172.21.15.19:3300/0 conn(0x7faebc131b40 0x7faebc131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 -- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc06b080 msgr2=0x7faebc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc06b080 0x7faebc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 -- 172.21.15.19:0/841965293 >> v2:172.21.15.19:3300/0 conn(0x7faebc131b40 msgr2=0x7faebc131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 --2- 172.21.15.19:0/841965293 >> v2:172.21.15.19:3300/0 conn(0x7faebc131b40 0x7faebc131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 -- 172.21.15.19:0/841965293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faebc09f630 con 0x7faebc06a770 2023-10-03T10:15:39.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faebb7fe700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faeac0098f0 tx=0x7faeac009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf9186f6d837342 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.802+0000 7faeba7fc700 1 -- 172.21.15.19:0/841965293 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac011830 con 0x7faebc06a770 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faeba7fc700 1 -- 172.21.15.19:0/841965293 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac011990 con 0x7faebc06a770 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faeba7fc700 1 -- 172.21.15.19:0/841965293 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac011d20 con 0x7faebc06a770 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 -- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 msgr2=0x7faebc06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faeac0098f0 tx=0x7faeac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:39.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 -- 172.21.15.19:0/841965293 shutdown_connections 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 --2- 172.21.15.19:0/841965293 >> v2:172.21.15.19:3300/0 conn(0x7faebc131b40 0x7faebc131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc06ab40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.803+0000 7faec1f2b700 1 --2- 172.21.15.19:0/841965293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc06b080 0x7faebc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.804+0000 7faec1f2b700 1 -- 172.21.15.19:0/841965293 >> 172.21.15.19:0/841965293 conn(0x7faebc066f50 msgr2=0x7faebc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.804+0000 7faec1f2b700 1 -- 172.21.15.19:0/841965293 shutdown_connections 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.804+0000 7faec1f2b700 1 -- 172.21.15.19:0/841965293 wait complete. 2023-10-03T10:15:39.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.806+0000 7faec1f2b700 1 Processor -- start 2023-10-03T10:15:39.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.806+0000 7faec1f2b700 1 -- start start 2023-10-03T10:15:39.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faebc06b080 0x7faebc1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc131b40 0x7faebc119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc11bd40 con 0x7faebc06b080 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faebc11a8d0 con 0x7faebc131b40 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faec1f2b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faebc071e60 con 0x7faebc06a770 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faebb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faebb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33746/0 (socket says 172.21.15.19:33746) 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faebb7fe700 1 -- 172.21.15.19:0/3733819589 learned_addr learned my addr 172.21.15.19:0/3733819589 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faebbfff700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc131b40 0x7faebc119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.807+0000 7faebaffd700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faebc06b080 0x7faebc1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 -- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc131b40 msgr2=0x7faebc119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc131b40 0x7faebc119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 -- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faebc06b080 msgr2=0x7faebc1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faebc06b080 0x7faebc1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 -- 172.21.15.19:0/3733819589 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac009550 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faebb7fe700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faeac009c40 tx=0x7faeac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac004450 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeac01f070 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc09a3d0 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac0038e0 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.808+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc1380e0 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.809+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeac003a40 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.809+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc074ea0 con 0x7faebc06a770 2023-10-03T10:15:39.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.810+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faeac021070 con 0x7faebc06a770 2023-10-03T10:15:39.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.815+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeac010380 con 0x7faebc06a770 2023-10-03T10:15:39.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 Processor -- start 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 -- start start 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 0x7f2c1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 0x7f2c10130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1009f130 con 0x7f2c1009e000 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1009f520 con 0x7f2c1009d6f0 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.887+0000 7f2c158df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009e930 con 0x7f2c1009e410 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 0x7f2c1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0e7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2c1009e000 0x7f2c10130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45002/0 (socket says 172.21.15.19:45002) 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 0x7f2c1009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50024/0 (socket says 172.21.15.19:50024) 2023-10-03T10:15:39.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0e7fc700 1 -- 172.21.15.19:0/4107476462 learned_addr learned my addr 172.21.15.19:0/4107476462 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 --2- 172.21.15.19:0/4107476462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 0x7f2c10130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0dffb700 1 -- 172.21.15.19:0/4107476462 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106399172 0 0) 0x7f2c1009f130 con 0x7f2c1009e000 2023-10-03T10:15:39.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0dffb700 1 -- 172.21.15.19:0/4107476462 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf80035b0 con 0x7f2c1009e000 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 -- 172.21.15.19:0/4107476462 >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 msgr2=0x7f2c1009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 --2- 172.21.15.19:0/4107476462 >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 0x7f2c1009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 -- 172.21.15.19:0/4107476462 >> v1:172.21.15.19:6789/0 conn(0x7f2c1009e000 legacy=0x7f2c10130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 -- 172.21.15.19:0/4107476462 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1009b2d0 con 0x7f2c1009e410 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.888+0000 7f2c0f7fe700 1 --2- 172.21.15.19:0/4107476462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 0x7f2c10130d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a8f9f78ec1fc358 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.889+0000 7f2c0dffb700 1 -- 172.21.15.19:0/4107476462 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800e070 con 0x7f2c1009e410 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.889+0000 7f2c0dffb700 1 -- 172.21.15.19:0/4107476462 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0800bb20 con 0x7f2c1009e410 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.889+0000 7f2c0dffb700 1 -- 172.21.15.19:0/4107476462 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0800be90 con 0x7f2c1009e410 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 -- 172.21.15.19:0/4107476462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 msgr2=0x7f2c10130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 --2- 172.21.15.19:0/4107476462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 0x7f2c10130d70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009d90 tx=0x7f2c0800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 -- 172.21.15.19:0/4107476462 shutdown_connections 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 --2- 172.21.15.19:0/4107476462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009e410 0x7f2c10130d70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 --2- 172.21.15.19:0/4107476462 >> v2:172.21.15.19:3300/0 conn(0x7f2c1009d6f0 0x7f2c1009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 -- 172.21.15.19:0/4107476462 >> 172.21.15.19:0/4107476462 conn(0x7f2c10066f50 msgr2=0x7f2c1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 -- 172.21.15.19:0/4107476462 shutdown_connections 2023-10-03T10:15:39.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.890+0000 7f2c158df700 1 -- 172.21.15.19:0/4107476462 wait complete. 2023-10-03T10:15:39.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.891+0000 7f2c158df700 1 Processor -- start 2023-10-03T10:15:39.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.892+0000 7f2c158df700 1 -- start start 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.892+0000 7f2c158df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.892+0000 7f2c158df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.892+0000 7f2c158df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 0x7f2c1011e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c158df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10120cc0 con 0x7f2c1009e410 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c158df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c10120090 con 0x7f2c1009d6f0 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c158df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1009c700 con 0x7f2c1009e000 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60164/0 (socket says 172.21.15.19:60164) 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33754/0 (socket says 172.21.15.19:33754) 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0effd700 1 -- 172.21.15.19:0/405418930 learned_addr learned my addr 172.21.15.19:0/405418930 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0f7fe700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 0x7f2c1011e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 -- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 msgr2=0x7f2c1011df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 -- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 msgr2=0x7f2c1011e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 0x7f2c1011e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0e7fc700 1 -- 172.21.15.19:0/405418930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c08009a70 con 0x7f2c1009e000 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0f7fe700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 0x7f2c1011e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.893+0000 7f2c0effd700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2c0e7fc700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c4c0 tx=0x7f2c0400c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04005d70 con 0x7f2c1009e000 2023-10-03T10:15:39.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c040070d0 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1009a0c0 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04007440 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.894+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c101216a0 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.895+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c10074ea0 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.896+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c040075a0 con 0x7f2c1009e000 2023-10-03T10:15:39.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.896+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c04040ab0 con 0x7f2c1009e000 2023-10-03T10:15:39.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.905+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c04044060 con 0x7f2c1009e000 2023-10-03T10:15:39.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.934+0000 7fbf8fde5700 1 Processor -- start 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.934+0000 7fbf8fde5700 1 -- start start 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.934+0000 7fbf8fde5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.934+0000 7fbf8fde5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.934+0000 7fbf8fde5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 0x7fbf88130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8fde5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8809f520 con 0x7fbf8809d6f0 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8fde5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8809f130 con 0x7fbf8809e410 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8fde5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8809e930 con 0x7fbf8809e000 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33770/0 (socket says 172.21.15.19:33770) 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 -- 172.21.15.19:0/4101159294 learned_addr learned my addr 172.21.15.19:0/4101159294 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8e382700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 0x7fbf88130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8db81700 1 --2- 172.21.15.19:0/4101159294 >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 -- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 msgr2=0x7fbf88130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 0x7fbf88130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 -- 172.21.15.19:0/4101159294 >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 msgr2=0x7fbf8809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 --2- 172.21.15.19:0/4101159294 >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8d380700 1 -- 172.21.15.19:0/4101159294 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8809b2d0 con 0x7fbf8809e000 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8e382700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 0x7fbf88130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.935+0000 7fbf8db81700 1 --2- 172.21.15.19:0/4101159294 >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8d380700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009920 tx=0x7fbf78009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86602a720d86f055 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8cb7f700 1 -- 172.21.15.19:0/4101159294 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011830 con 0x7fbf8809e000 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8cb7f700 1 -- 172.21.15.19:0/4101159294 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf78011990 con 0x7fbf8809e000 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8cb7f700 1 -- 172.21.15.19:0/4101159294 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78011d20 con 0x7fbf8809e000 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8fde5700 1 -- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 msgr2=0x7fbf88130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.936+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009920 tx=0x7fbf78009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 -- 172.21.15.19:0/4101159294 shutdown_connections 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e410 0x7fbf88130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/4101159294 >> v2:172.21.15.19:3300/0 conn(0x7fbf8809d6f0 0x7fbf8809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/4101159294 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e000 0x7fbf88130660 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 -- 172.21.15.19:0/4101159294 >> 172.21.15.19:0/4101159294 conn(0x7fbf88066f50 msgr2=0x7fbf8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 -- 172.21.15.19:0/4101159294 shutdown_connections 2023-10-03T10:15:39.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.937+0000 7fbf8fde5700 1 -- 172.21.15.19:0/4101159294 wait complete. 2023-10-03T10:15:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 Processor -- start 2023-10-03T10:15:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 -- start start 2023-10-03T10:15:39.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 0x7fbf8811e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 0x7fbf8811ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8811f4d0 con 0x7fbf8809d6f0 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf881303e0 con 0x7fbf8809e000 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8fde5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf88120e60 con 0x7fbf8809e410 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8d380700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8db81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 0x7fbf8811e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8d380700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60178/0 (socket says 172.21.15.19:60178) 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.938+0000 7fbf8d380700 1 -- 172.21.15.19:0/1441353284 learned_addr learned my addr 172.21.15.19:0/1441353284 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8e382700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 0x7fbf8811ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 -- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 msgr2=0x7fbf8811ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 0x7fbf8811ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 -- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 msgr2=0x7fbf8811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 0x7fbf8811e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 -- 172.21.15.19:0/1441353284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840094a0 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8e382700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 0x7fbf8811ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8db81700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 0x7fbf8811e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8d380700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf78000c00 tx=0x7fbf78004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78004300 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7801f070 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf780036a0 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.939+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf80009a70 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.940+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf78009550 con 0x7fbf8809e000 2023-10-03T10:15:39.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.941+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf78021030 con 0x7fbf8809e000 2023-10-03T10:15:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.941+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf780407d0 con 0x7fbf8809e000 2023-10-03T10:15:39.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.941+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8811ac20 con 0x7fbf8809e000 2023-10-03T10:15:39.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.946+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f6c06b250 con 0x7f6f6c130750 2023-10-03T10:15:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.946+0000 7f6f6a7fc700 1 -- 172.21.15.19:0/1443652092 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f5c012340 con 0x7f6f6c130750 2023-10-03T10:15:39.946 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:39.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.946+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf78015080 con 0x7fbf8809e000 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 msgr2=0x7f6f6c12e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 0x7f6f6c12e550 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00efc0 tx=0x7f6f5c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 shutdown_connections 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f6c130750 0x7f6f6c12e550 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f6c09d6f0 0x7f6f6c12dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 --2- 172.21.15.19:0/1443652092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f6c09e250 0x7f6f6c12e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.948+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 >> 172.21.15.19:0/1443652092 conn(0x7f6f6c09f470 msgr2=0x7f6f6c0992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.949+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 shutdown_connections 2023-10-03T10:15:39.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:39.949+0000 7f6f73cdd700 1 -- 172.21.15.19:0/1443652092 wait complete. 2023-10-03T10:15:39.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.031+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faebc06c360 con 0x7faebc06a770 2023-10-03T10:15:40.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.032+0000 7faea3fff700 1 -- 172.21.15.19:0/3733819589 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeac015020 con 0x7faebc06a770 2023-10-03T10:15:40.032 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 msgr2=0x7faebc119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7faeac009c40 tx=0x7faeac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 shutdown_connections 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faebc131b40 0x7faebc119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faebc06a770 0x7faebc119480 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 --2- 172.21.15.19:0/3733819589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faebc06b080 0x7faebc1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 >> 172.21.15.19:0/3733819589 conn(0x7faebc066f50 msgr2=0x7faebc0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 shutdown_connections 2023-10-03T10:15:40.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.034+0000 7faec1f2b700 1 -- 172.21.15.19:0/3733819589 wait complete. 2023-10-03T10:15:40.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:40.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.116+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2c100a3cb0 con 0x7f2c1009e000 2023-10-03T10:15:40.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.117+0000 7f2bf7fff700 1 -- 172.21.15.19:0/405418930 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c04044020 con 0x7f2c1009e000 2023-10-03T10:15:40.117 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:40.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 msgr2=0x7f2c1011e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400c4c0 tx=0x7f2c0400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 shutdown_connections 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c1009e410 0x7f2c1011e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c1009d6f0 0x7f2c1011df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 --2- 172.21.15.19:0/405418930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c1009e000 0x7f2c1011e4a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 >> 172.21.15.19:0/405418930 conn(0x7f2c10066f50 msgr2=0x7f2c10070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 shutdown_connections 2023-10-03T10:15:40.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.119+0000 7f2c158df700 1 -- 172.21.15.19:0/405418930 wait complete. 2023-10-03T10:15:40.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:40.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.155+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf881212b0 con 0x7fbf8809e000 2023-10-03T10:15:40.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.155+0000 7fbf7e7fc700 1 -- 172.21.15.19:0/1441353284 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf78019770 con 0x7fbf8809e000 2023-10-03T10:15:40.155 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 msgr2=0x7fbf8811e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbf78000c00 tx=0x7fbf78004750 comp rx=0 tx=0).stop 2023-10-03T10:15:40.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 shutdown_connections 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf8809e410 0x7fbf8811ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf8809d6f0 0x7fbf8811e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 --2- 172.21.15.19:0/1441353284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf8809e000 0x7fbf8811e540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 >> 172.21.15.19:0/1441353284 conn(0x7fbf88066f50 msgr2=0x7fbf88130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 shutdown_connections 2023-10-03T10:15:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:40.157+0000 7fbf8fde5700 1 -- 172.21.15.19:0/1441353284 wait complete. 2023-10-03T10:15:40.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:40.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:41.049 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:41.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.113+0000 7f426a82f700 1 Processor -- start 2023-10-03T10:15:41.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.113+0000 7f426a82f700 1 -- start start 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f426409d630 0x7f42640a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4264133930 0x7f4264133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640a2a70 con 0x7f426409d630 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640a01d0 con 0x7f42640a0a30 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f426a82f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f426409e2b0 con 0x7f4264133930 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f42637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f426409d630 0x7f42640a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f4263fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f4268dcc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4264133930 0x7f4264133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f4263fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60186/0 (socket says 172.21.15.19:60186) 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f42637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f426409d630 0x7f42640a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50068/0 (socket says 172.21.15.19:50068) 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.114+0000 7f4263fff700 1 -- 172.21.15.19:0/730483238 learned_addr learned my addr 172.21.15.19:0/730483238 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 -- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4264133930 msgr2=0x7f4264133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4264133930 0x7f4264133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 -- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 msgr2=0x7f42640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 -- 172.21.15.19:0/730483238 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426409dc50 con 0x7f426409d630 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f4263fff700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f42637fe700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f426409d630 0x7f42640a1340 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4258009840 tx=0x7f4258009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719d3f974f00a514 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f4262ffd700 1 -- 172.21.15.19:0/730483238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258011830 con 0x7f426409d630 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f4262ffd700 1 -- 172.21.15.19:0/730483238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258011990 con 0x7f426409d630 2023-10-03T10:15:41.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.115+0000 7f4262ffd700 1 -- 172.21.15.19:0/730483238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258011d20 con 0x7f426409d630 2023-10-03T10:15:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 -- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f426409d630 msgr2=0x7f42640a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f426409d630 0x7f42640a1340 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4258009840 tx=0x7f4258009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 -- 172.21.15.19:0/730483238 shutdown_connections 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42640a0a30 0x7f42640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4264133930 0x7f4264133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 --2- 172.21.15.19:0/730483238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f426409d630 0x7f42640a1340 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 -- 172.21.15.19:0/730483238 >> 172.21.15.19:0/730483238 conn(0x7f42640a3050 msgr2=0x7f42640a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 -- 172.21.15.19:0/730483238 shutdown_connections 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.116+0000 7f426a82f700 1 -- 172.21.15.19:0/730483238 wait complete. 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.117+0000 7f426a82f700 1 Processor -- start 2023-10-03T10:15:41.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 -- start start 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42640a0a30 0x7f42641c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 0x7f42641c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42641206b0 con 0x7f4264133930 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42641204c0 con 0x7f426409d630 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f426a82f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42641223d0 con 0x7f42640a0a30 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f4263fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f4268dcc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 0x7f42641c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f4263fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60202/0 (socket says 172.21.15.19:60202) 2023-10-03T10:15:41.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f4263fff700 1 -- 172.21.15.19:0/3975009241 learned_addr learned my addr 172.21.15.19:0/3975009241 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.118+0000 7f42637fe700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42640a0a30 0x7f42641c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 -- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42640a0a30 msgr2=0x7f42641c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42640a0a30 0x7f42641c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 -- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 msgr2=0x7f42641c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 -- 172.21.15.19:0/3975009241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4254009550 con 0x7f4264133930 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4263fff700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4268dcc700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 0x7f42641c8b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f425c00efc0 tx=0x7f425c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00cc90 con 0x7f4264133930 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00f040 con 0x7f4264133930 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42580094a0 con 0x7f4264133930 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0146c0 con 0x7f4264133930 2023-10-03T10:15:41.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.119+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42641220f0 con 0x7f4264133930 2023-10-03T10:15:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.120+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f425c014820 con 0x7f4264133930 2023-10-03T10:15:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.120+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640747f0 con 0x7f4264133930 2023-10-03T10:15:41.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.121+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f425c040130 con 0x7f4264133930 2023-10-03T10:15:41.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.125+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f425c014ad0 con 0x7f4264133930 2023-10-03T10:15:41.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:41.172 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 Processor -- start 2023-10-03T10:15:41.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 -- start start 2023-10-03T10:15:41.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 0x7f178409db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1784130f10 0x7f1784138ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178409c520 con 0x7f178409e070 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178409a940 con 0x7f1784130f10 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.202+0000 7f178986c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f178409a3d0 con 0x7f178409d760 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f17827fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f178409e070 0x7f1784130800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45014/0 (socket says 172.21.15.19:45014) 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f17827fc700 1 -- 172.21.15.19:0/4127749860 learned_addr learned my addr 172.21.15.19:0/4127749860 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 --2- 172.21.15.19:0/4127749860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 0x7f178409db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f17837fe700 1 --2- 172.21.15.19:0/4127749860 >> v2:172.21.15.19:3300/0 conn(0x7f1784130f10 0x7f1784138ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1781ffb700 1 -- 172.21.15.19:0/4127749860 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158730322 0 0) 0x7f178409c520 con 0x7f178409e070 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 -- 172.21.15.19:0/4127749860 >> v2:172.21.15.19:3300/0 conn(0x7f1784130f10 msgr2=0x7f1784138ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 --2- 172.21.15.19:0/4127749860 >> v2:172.21.15.19:3300/0 conn(0x7f1784130f10 0x7f1784138ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 -- 172.21.15.19:0/4127749860 >> v1:172.21.15.19:6789/0 conn(0x7f178409e070 legacy=0x7f1784130800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 -- 172.21.15.19:0/4127749860 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178409f1a0 con 0x7f178409d760 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.203+0000 7f1782ffd700 1 --2- 172.21.15.19:0/4127749860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 0x7f178409db30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1774009840 tx=0x7f1774009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c149eb6eb2daf032 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.204+0000 7f1781ffb700 1 -- 172.21.15.19:0/4127749860 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774011830 con 0x7f178409d760 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.204+0000 7f1781ffb700 1 -- 172.21.15.19:0/4127749860 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1774011990 con 0x7f178409d760 2023-10-03T10:15:41.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.204+0000 7f1781ffb700 1 -- 172.21.15.19:0/4127749860 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774011d20 con 0x7f178409d760 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 -- 172.21.15.19:0/4127749860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 msgr2=0x7f178409db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 --2- 172.21.15.19:0/4127749860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 0x7f178409db30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1774009840 tx=0x7f1774009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 -- 172.21.15.19:0/4127749860 shutdown_connections 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 --2- 172.21.15.19:0/4127749860 >> v2:172.21.15.19:3300/0 conn(0x7f1784130f10 0x7f1784138ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 --2- 172.21.15.19:0/4127749860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409d760 0x7f178409db30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 -- 172.21.15.19:0/4127749860 >> 172.21.15.19:0/4127749860 conn(0x7f1784066f50 msgr2=0x7f17840a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 -- 172.21.15.19:0/4127749860 shutdown_connections 2023-10-03T10:15:41.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.205+0000 7f178986c700 1 -- 172.21.15.19:0/4127749860 wait complete. 2023-10-03T10:15:41.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.206+0000 7f178986c700 1 Processor -- start 2023-10-03T10:15:41.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 -- start start 2023-10-03T10:15:41.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f178409d760 0x7f1784139010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 0x7f1784139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178413a280 con 0x7f1784130f10 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178412f160 con 0x7f178409d760 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f178986c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1784119f60 con 0x7f178409e070 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f17827fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f17827fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33820/0 (socket says 172.21.15.19:33820) 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f17827fc700 1 -- 172.21.15.19:0/3900084020 learned_addr learned my addr 172.21.15.19:0/3900084020 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.207+0000 7f17837fe700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 0x7f1784139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f1782ffd700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f178409d760 0x7f1784139010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 -- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 msgr2=0x7f1784139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 -- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f178409d760 msgr2=0x7f1784139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f178409d760 0x7f1784139010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 -- 172.21.15.19:0/3900084020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740094a0 con 0x7f1784130f10 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17827fc700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f17837fe700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 0x7f1784139a90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f177c00efc0 tx=0x7f177c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00cd40 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00f040 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784137c90 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c0146c0 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.208+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178413a960 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.209+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f177c014820 con 0x7f1784130f10 2023-10-03T10:15:41.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.210+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f177c040270 con 0x7f1784130f10 2023-10-03T10:15:41.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.210+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784119b80 con 0x7f1784130f10 2023-10-03T10:15:41.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.215+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f177c018030 con 0x7f1784130f10 2023-10-03T10:15:41.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.279+0000 7f0af08fb700 1 Processor -- start 2023-10-03T10:15:41.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 -- start start 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 0x7f0aec06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec070ee0 con 0x7f0aec09eca0 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec071480 con 0x7f0aec06ee80 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.280+0000 7f0af08fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec071b90 con 0x7f0aec06e570 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0ae9d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0aec09eca0 0x7f0aec134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45018/0 (socket says 172.21.15.19:45018) 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0ae9d9b700 1 -- 172.21.15.19:0/237289641 learned_addr learned my addr 172.21.15.19:0/237289641 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aea59c700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 0x7f0aec06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 -- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 msgr2=0x7f0aec06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 0x7f0aec06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 -- 172.21.15.19:0/237289641 >> v1:172.21.15.19:6789/0 conn(0x7f0aec09eca0 legacy=0x7f0aec134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0ae959a700 1 -- 172.21.15.19:0/237289641 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543282451 0 0) 0x7f0aec070ee0 con 0x7f0aec09eca0 2023-10-03T10:15:41.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 -- 172.21.15.19:0/237289641 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec0711a0 con 0x7f0aec06ee80 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aea59c700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 0x7f0aec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.281+0000 7f0aead9d700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec134d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009dc0 tx=0x7f0ae400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce2fe9fd1e997e1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.282+0000 7f0ae959a700 1 -- 172.21.15.19:0/237289641 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400e070 con 0x7f0aec06ee80 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.282+0000 7f0ae959a700 1 -- 172.21.15.19:0/237289641 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae400bb20 con 0x7f0aec06ee80 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.282+0000 7f0ae959a700 1 -- 172.21.15.19:0/237289641 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4012430 con 0x7f0aec06ee80 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 -- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 msgr2=0x7f0aec134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec134d20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009dc0 tx=0x7f0ae400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 -- 172.21.15.19:0/237289641 shutdown_connections 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec134d20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 --2- 172.21.15.19:0/237289641 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec06e570 0x7f0aec06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 -- 172.21.15.19:0/237289641 >> 172.21.15.19:0/237289641 conn(0x7f0aec0a2aa0 msgr2=0x7f0aec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 -- 172.21.15.19:0/237289641 shutdown_connections 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.283+0000 7f0af08fb700 1 -- 172.21.15.19:0/237289641 wait complete. 2023-10-03T10:15:41.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.284+0000 7f0af08fb700 1 Processor -- start 2023-10-03T10:15:41.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 -- start start 2023-10-03T10:15:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec124e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 0x7f0aec1253d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec1355b0 con 0x7f0aec06e570 2023-10-03T10:15:41.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec13d7b0 con 0x7f0aec06ee80 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0af08fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec070610 con 0x7f0aec13dbb0 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0aea59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50102/0 (socket says 172.21.15.19:50102) 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0aea59c700 1 -- 172.21.15.19:0/2426953146 learned_addr learned my addr 172.21.15.19:0/2426953146 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.285+0000 7f0aead9d700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 0x7f0aec1253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0ae9d9b700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 -- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 msgr2=0x7f0aec1253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 0x7f0aec1253d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 -- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 msgr2=0x7f0aec124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec124e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 -- 172.21.15.19:0/2426953146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc0094a0 con 0x7f0aec06e570 2023-10-03T10:15:41.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aead9d700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 0x7f0aec1253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0ae9d9b700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0aea59c700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00ebe0 tx=0x7f0adc009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00c910 con 0x7f0aec06e570 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc00ca70 con 0x7f0aec06e570 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4009a70 con 0x7f0aec06e570 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc00cde0 con 0x7f0aec06e570 2023-10-03T10:15:41.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.286+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec13b7a0 con 0x7f0aec06e570 2023-10-03T10:15:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.288+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec13d5f0 con 0x7f0aec06e570 2023-10-03T10:15:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.288+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0adc004020 con 0x7f0aec06e570 2023-10-03T10:15:41.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.288+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0adc03ff40 con 0x7f0aec06e570 2023-10-03T10:15:41.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.297+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0adc0042d0 con 0x7f0aec06e570 2023-10-03T10:15:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.335+0000 7fa7e53d5700 1 Processor -- start 2023-10-03T10:15:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.335+0000 7fa7e53d5700 1 -- start start 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7e53d5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7e006f5d0 0x7fa7e012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7e53d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7e53d5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e006fa40 con 0x7fa7e012cf60 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7e53d5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e012cd90 con 0x7fa7e006f5d0 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7e53d5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0071780 con 0x7fa7e0135c20 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33842/0 (socket says 172.21.15.19:33842) 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 -- 172.21.15.19:0/823020965 learned_addr learned my addr 172.21.15.19:0/823020965 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7de7fc700 1 --2- 172.21.15.19:0/823020965 >> v2:172.21.15.19:3300/0 conn(0x7fa7e006f5d0 0x7fa7e012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 -- 172.21.15.19:0/823020965 >> v2:172.21.15.19:3300/0 conn(0x7fa7e006f5d0 msgr2=0x7fa7e012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 --2- 172.21.15.19:0/823020965 >> v2:172.21.15.19:3300/0 conn(0x7fa7e006f5d0 0x7fa7e012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 -- 172.21.15.19:0/823020965 >> v1:172.21.15.19:6789/0 conn(0x7fa7e012cf60 legacy=0x7fa7e012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 -- 172.21.15.19:0/823020965 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0071a40 con 0x7fa7e0135c20 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.336+0000 7fa7df7fe700 1 --2- 172.21.15.19:0/823020965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b4d11225440ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.337+0000 7fa7ddffb700 1 -- 172.21.15.19:0/823020965 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800e070 con 0x7fa7e0135c20 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.337+0000 7fa7ddffb700 1 -- 172.21.15.19:0/823020965 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8003a20 con 0x7fa7e0135c20 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.337+0000 7fa7ddffb700 1 -- 172.21.15.19:0/823020965 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8003dd0 con 0x7fa7e0135c20 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 -- 172.21.15.19:0/823020965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 msgr2=0x7fa7e0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/823020965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:41.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 -- 172.21.15.19:0/823020965 shutdown_connections 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/823020965 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e0135c20 0x7fa7e0138000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/823020965 >> v2:172.21.15.19:3300/0 conn(0x7fa7e006f5d0 0x7fa7e012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 -- 172.21.15.19:0/823020965 >> 172.21.15.19:0/823020965 conn(0x7fa7e00a2aa0 msgr2=0x7fa7e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 -- 172.21.15.19:0/823020965 shutdown_connections 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.338+0000 7fa7e53d5700 1 -- 172.21.15.19:0/823020965 wait complete. 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.339+0000 7fa7e53d5700 1 Processor -- start 2023-10-03T10:15:41.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 -- start start 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 0x7fa7e0130900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7e0135c20 0x7fa7e0131380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0132fe0 con 0x7fa7e0135c20 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0132460 con 0x7fa7e006f5d0 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7e53d5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00a1040 con 0x7fa7e012cf60 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.340+0000 7fa7de7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33846/0 (socket says 172.21.15.19:33846) 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 -- 172.21.15.19:0/1452744439 learned_addr learned my addr 172.21.15.19:0/1452744439 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7deffd700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 0x7fa7e0130900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7df7fe700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7e0135c20 0x7fa7e0131380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 -- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 msgr2=0x7fa7e0130900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 0x7fa7e0130900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 -- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7e0135c20 msgr2=0x7fa7e0131380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7e0135c20 0x7fa7e0131380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 -- 172.21.15.19:0/1452744439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009b30 con 0x7fa7e012cf60 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7deffd700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 0x7fa7e0130900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7de7fc700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400e9e0 tx=0x7fa7d400ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4009710 con 0x7fa7e012cf60 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.341+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d400ee80 con 0x7fa7e012cf60 2023-10-03T10:15:41.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.342+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e0129fa0 con 0x7fa7e012cf60 2023-10-03T10:15:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.342+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d400ca50 con 0x7fa7e012cf60 2023-10-03T10:15:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.342+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e0134980 con 0x7fa7e012cf60 2023-10-03T10:15:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.343+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7d400cbb0 con 0x7fa7e012cf60 2023-10-03T10:15:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.343+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e0134020 con 0x7fa7e012cf60 2023-10-03T10:15:41.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.343+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7d403fbd0 con 0x7fa7e012cf60 2023-10-03T10:15:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.350+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4264120cb0 con 0x7f4264133930 2023-10-03T10:15:41.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.350+0000 7f4260ff9700 1 -- 172.21.15.19:0/3975009241 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f425c007330 con 0x7f4264133930 2023-10-03T10:15:41.350 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:41.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.352+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7d401b3b0 con 0x7fa7e012cf60 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 msgr2=0x7f42641c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 0x7f42641c8b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f425c00efc0 tx=0x7f425c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 shutdown_connections 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4264133930 0x7f42641c8b80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f426409d630 0x7f42641c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 --2- 172.21.15.19:0/3975009241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42640a0a30 0x7f42641c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.353+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 >> 172.21.15.19:0/3975009241 conn(0x7f42640a3050 msgr2=0x7f426409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.354+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 shutdown_connections 2023-10-03T10:15:41.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.355+0000 7f426a82f700 1 -- 172.21.15.19:0/3975009241 wait complete. 2023-10-03T10:15:41.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:41.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.448+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f178409e440 con 0x7f1784130f10 2023-10-03T10:15:41.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.448+0000 7f176bfff700 1 -- 172.21.15.19:0/3900084020 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f177c02b090 con 0x7f1784130f10 2023-10-03T10:15:41.448 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:41.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 msgr2=0x7f1784139a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 0x7f1784139a90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f177c00efc0 tx=0x7f177c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 shutdown_connections 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1784130f10 0x7f1784139a90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f178409d760 0x7f1784139010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 --2- 172.21.15.19:0/3900084020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f178409e070 0x7f1784139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 >> 172.21.15.19:0/3900084020 conn(0x7f1784066f50 msgr2=0x7f178412f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.450+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 shutdown_connections 2023-10-03T10:15:41.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.451+0000 7f178986c700 1 -- 172.21.15.19:0/3900084020 wait complete. 2023-10-03T10:15:41.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:41.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.511+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0aec13d5f0 con 0x7f0aec06e570 2023-10-03T10:15:41.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.511+0000 7f0adaffd700 1 -- 172.21.15.19:0/2426953146 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0aec13d5f0 con 0x7f0aec06e570 2023-10-03T10:15:41.511 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 msgr2=0x7f0aec126620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f0adc00ebe0 tx=0x7f0adc009ec0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 shutdown_connections 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0aec13dbb0 0x7f0aec1253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aec06e570 0x7f0aec126620 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 --2- 172.21.15.19:0/2426953146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0aec06ee80 0x7f0aec124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 >> 172.21.15.19:0/2426953146 conn(0x7f0aec0a2aa0 msgr2=0x7f0aec0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 shutdown_connections 2023-10-03T10:15:41.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.514+0000 7f0af08fb700 1 -- 172.21.15.19:0/2426953146 wait complete. 2023-10-03T10:15:41.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:41.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.559+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7e0074ea0 con 0x7fa7e012cf60 2023-10-03T10:15:41.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.559+0000 7fa7c77fe700 1 -- 172.21.15.19:0/1452744439 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7d4021020 con 0x7fa7e012cf60 2023-10-03T10:15:41.559 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:41.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 msgr2=0x7fa7e0130e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:41.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa7d400e9e0 tx=0x7fa7d400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 shutdown_connections 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7e0135c20 0x7fa7e0131380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7e006f5d0 0x7fa7e0130900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 --2- 172.21.15.19:0/1452744439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7e012cf60 0x7fa7e0130e40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 >> 172.21.15.19:0/1452744439 conn(0x7fa7e00a2aa0 msgr2=0x7fa7e006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 shutdown_connections 2023-10-03T10:15:41.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:41.561+0000 7fa7e53d5700 1 -- 172.21.15.19:0/1452744439 wait complete. 2023-10-03T10:15:41.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:42.370 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:42.466 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 Processor -- start 2023-10-03T10:15:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 -- start start 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48700a0a30 0x7f48700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700a2a70 con 0x7f487009d630 2023-10-03T10:15:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700a01d0 con 0x7f48700a0a30 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f487513e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f487009e2b0 con 0x7f4870138d80 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f486f59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f486ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48700a0a30 0x7f48700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f486f59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33858/0 (socket says 172.21.15.19:33858) 2023-10-03T10:15:42.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.520+0000 7f486f59e700 1 -- 172.21.15.19:0/154061206 learned_addr learned my addr 172.21.15.19:0/154061206 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486f59e700 1 -- 172.21.15.19:0/154061206 >> v2:172.21.15.19:3300/0 conn(0x7f48700a0a30 msgr2=0x7f48700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486f59e700 1 --2- 172.21.15.19:0/154061206 >> v2:172.21.15.19:3300/0 conn(0x7f48700a0a30 0x7f48700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486f59e700 1 -- 172.21.15.19:0/154061206 >> v1:172.21.15.19:6789/0 conn(0x7f487009d630 legacy=0x7f48700a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486f59e700 1 -- 172.21.15.19:0/154061206 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487009dc50 con 0x7f4870138d80 2023-10-03T10:15:42.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486f59e700 1 --2- 172.21.15.19:0/154061206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48680098f0 tx=0x7f4868009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f21493a68481f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486dd9b700 1 -- 172.21.15.19:0/154061206 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011830 con 0x7f4870138d80 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486dd9b700 1 -- 172.21.15.19:0/154061206 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4868011990 con 0x7f4870138d80 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.521+0000 7f486dd9b700 1 -- 172.21.15.19:0/154061206 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868011d20 con 0x7f4870138d80 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 -- 172.21.15.19:0/154061206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 msgr2=0x7f487013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 --2- 172.21.15.19:0/154061206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f48680098f0 tx=0x7f4868009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 -- 172.21.15.19:0/154061206 shutdown_connections 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 --2- 172.21.15.19:0/154061206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4870138d80 0x7f487013b160 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 --2- 172.21.15.19:0/154061206 >> v2:172.21.15.19:3300/0 conn(0x7f48700a0a30 0x7f48700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 -- 172.21.15.19:0/154061206 >> 172.21.15.19:0/154061206 conn(0x7f48700a3050 msgr2=0x7f48700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 -- 172.21.15.19:0/154061206 shutdown_connections 2023-10-03T10:15:42.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.522+0000 7f487513e700 1 -- 172.21.15.19:0/154061206 wait complete. 2023-10-03T10:15:42.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.523+0000 7f487513e700 1 Processor -- start 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.523+0000 7f487513e700 1 -- start start 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 0x7f4870133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 0x7f4870133f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4870136b90 con 0x7f48700a0a30 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4870138090 con 0x7f4870138d80 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f487513e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48701374b0 con 0x7f487009d630 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 0x7f4870133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486f59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486f59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60240/0 (socket says 172.21.15.19:60240) 2023-10-03T10:15:42.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 0x7f4870133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33866/0 (socket says 172.21.15.19:33866) 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486f59e700 1 -- 172.21.15.19:0/3048049766 learned_addr learned my addr 172.21.15.19:0/3048049766 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 0x7f4870133f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 -- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 msgr2=0x7f4870133a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 0x7f4870133a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 -- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 msgr2=0x7f48701344b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486e59c700 1 -- 172.21.15.19:0/3048049766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009550 con 0x7f48700a0a30 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.524+0000 7f486f59e700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f486e59c700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 0x7f4870133f70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f486400c450 tx=0x7f486400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640052d0 con 0x7f48700a0a30 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4864005430 con 0x7f48700a0a30 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487013afc0 con 0x7f48700a0a30 2023-10-03T10:15:42.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48640038c0 con 0x7f48700a0a30 2023-10-03T10:15:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.525+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4870135d90 con 0x7f48700a0a30 2023-10-03T10:15:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.526+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4864003a20 con 0x7f48700a0a30 2023-10-03T10:15:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.526+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4870136e70 con 0x7f48700a0a30 2023-10-03T10:15:42.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.526+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f486403e9a0 con 0x7f48700a0a30 2023-10-03T10:15:42.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:42.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.531+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4870136e70 con 0x7f48700a0a30 2023-10-03T10:15:42.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:42.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.611+0000 7f5a86d92700 1 Processor -- start 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 -- start start 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8009f130 con 0x7f5a8009d6f0 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8009f520 con 0x7f5a8009e1d0 2023-10-03T10:15:42.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a86d92700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8009e930 con 0x7f5a80135e50 2023-10-03T10:15:42.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60248/0 (socket says 172.21.15.19:60248) 2023-10-03T10:15:42.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a7ffff700 1 -- 172.21.15.19:0/2406148204 learned_addr learned my addr 172.21.15.19:0/2406148204 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.612+0000 7f5a8532f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7ffff700 1 -- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 msgr2=0x7f5a80138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7ffff700 1 --2- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7ffff700 1 -- 172.21.15.19:0/2406148204 >> v1:172.21.15.19:6789/0 conn(0x7f5a8009d6f0 legacy=0x7f5a8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7ffff700 1 -- 172.21.15.19:0/2406148204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8009b2d0 con 0x7f5a8009e1d0 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7ffff700 1 --2- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b9d0 tx=0x7f5a6c00bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fba12603330c9bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7f7fe700 1 -- 172.21.15.19:0/2406148204 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00cc20 con 0x7f5a8009e1d0 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7f7fe700 1 -- 172.21.15.19:0/2406148204 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c00cd80 con 0x7f5a8009e1d0 2023-10-03T10:15:42.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.613+0000 7f5a7f7fe700 1 -- 172.21.15.19:0/2406148204 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c004230 con 0x7f5a8009e1d0 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.614+0000 7f5a86d92700 1 -- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 msgr2=0x7f5a80135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.614+0000 7f5a86d92700 1 --2- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00b9d0 tx=0x7f5a6c00bce0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 -- 172.21.15.19:0/2406148204 shutdown_connections 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 --2- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 --2- 172.21.15.19:0/2406148204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a80135910 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 -- 172.21.15.19:0/2406148204 >> 172.21.15.19:0/2406148204 conn(0x7f5a80066f50 msgr2=0x7f5a8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 -- 172.21.15.19:0/2406148204 shutdown_connections 2023-10-03T10:15:42.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.615+0000 7f5a86d92700 1 -- 172.21.15.19:0/2406148204 wait complete. 2023-10-03T10:15:42.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 Processor -- start 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 -- start start 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a801c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80119720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8011ce50 con 0x7f5a8009d6f0 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8011c870 con 0x7f5a8009e1d0 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.616+0000 7f5a86d92700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800a1d00 con 0x7f5a80135e50 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50140/0 (socket says 172.21.15.19:50140) 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 -- 172.21.15.19:0/229106083 learned_addr learned my addr 172.21.15.19:0/229106083 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a7ffff700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a801c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 -- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 msgr2=0x7f5a80119720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80119720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 -- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 msgr2=0x7f5a801c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a801c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 -- 172.21.15.19:0/229106083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c00b600 con 0x7f5a8009d6f0 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a7ffff700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a801c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.617+0000 7f5a84b2e700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400b420 tx=0x7f5a7400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.618+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011830 con 0x7f5a8009d6f0 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.618+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74011990 con 0x7f5a8009d6f0 2023-10-03T10:15:42.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.618+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8009c700 con 0x7f5a8009d6f0 2023-10-03T10:15:42.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.618+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011d40 con 0x7f5a8009d6f0 2023-10-03T10:15:42.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.618+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8011d850 con 0x7f5a8009d6f0 2023-10-03T10:15:42.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.619+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a7401a400 con 0x7f5a8009d6f0 2023-10-03T10:15:42.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.619+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8011ccb0 con 0x7f5a8009d6f0 2023-10-03T10:15:42.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.619+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a7403f260 con 0x7f5a8009d6f0 2023-10-03T10:15:42.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.628+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a8011ccb0 con 0x7f5a8009d6f0 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.681+0000 7f8371901700 1 Processor -- start 2023-10-03T10:15:42.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.681+0000 7f8371901700 1 -- start start 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 0x7f836c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c070940 con 0x7f836c09f650 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c06fd60 con 0x7f836c09e930 2023-10-03T10:15:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f8371901700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836c06fa80 con 0x7f836c09f240 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 0x7f836c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 0x7f836c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50144/0 (socket says 172.21.15.19:50144) 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33896/0 (socket says 172.21.15.19:33896) 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836b7fe700 1 -- 172.21.15.19:0/4273017931 learned_addr learned my addr 172.21.15.19:0/4273017931 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.682+0000 7f836affd700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 -- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 msgr2=0x7f836c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 -- 172.21.15.19:0/4273017931 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 msgr2=0x7f836c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 --2- 172.21.15.19:0/4273017931 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 0x7f836c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 -- 172.21.15.19:0/4273017931 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c09fb60 con 0x7f836c09f240 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f836a7fc700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8360009840 tx=0x7f8360009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e62b0fd2919f722 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f8369ffb700 1 -- 172.21.15.19:0/4273017931 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360011830 con 0x7f836c09f240 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f8369ffb700 1 -- 172.21.15.19:0/4273017931 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360011990 con 0x7f836c09f240 2023-10-03T10:15:42.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.683+0000 7f8369ffb700 1 -- 172.21.15.19:0/4273017931 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360011d20 con 0x7f836c09f240 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 -- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 msgr2=0x7f836c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8360009840 tx=0x7f8360009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 -- 172.21.15.19:0/4273017931 shutdown_connections 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 --2- 172.21.15.19:0/4273017931 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f650 0x7f836c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 --2- 172.21.15.19:0/4273017931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f240 0x7f836c1317f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 -- 172.21.15.19:0/4273017931 >> 172.21.15.19:0/4273017931 conn(0x7f836c0a4210 msgr2=0x7f836c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 -- 172.21.15.19:0/4273017931 shutdown_connections 2023-10-03T10:15:42.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.684+0000 7f8371901700 1 -- 172.21.15.19:0/4273017931 wait complete. 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.686+0000 7f8371901700 1 Processor -- start 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.686+0000 7f8371901700 1 -- start start 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c09f240 0x7f836c1a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f650 0x7f836c1a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1a6050 con 0x7f836c09f240 2023-10-03T10:15:42.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c071d20 con 0x7f836c09e930 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f8371901700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1a3840 con 0x7f836c09f650 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60270/0 (socket says 172.21.15.19:60270) 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 -- 172.21.15.19:0/401044119 learned_addr learned my addr 172.21.15.19:0/401044119 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836a7fc700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c09f240 0x7f836c1a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836b7fe700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f650 0x7f836c1a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 -- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f650 msgr2=0x7f836c1a2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f650 0x7f836c1a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 -- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c09f240 msgr2=0x7f836c1a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c09f240 0x7f836c1a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.687+0000 7f836affd700 1 -- 172.21.15.19:0/401044119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600094a0 con 0x7f836c09e930 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f836affd700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f835c00e930 tx=0x7f835c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c013680 con 0x7f836c09e930 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0137e0 con 0x7f836c09e930 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c013b70 con 0x7f836c09e930 2023-10-03T10:15:42.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c0a0190 con 0x7f836c09e930 2023-10-03T10:15:42.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.688+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0a3440 con 0x7f836c09e930 2023-10-03T10:15:42.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.689+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c1a4a50 con 0x7f836c09e930 2023-10-03T10:15:42.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.690+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f835c013cd0 con 0x7f836c09e930 2023-10-03T10:15:42.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.690+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f835c03f670 con 0x7f836c09e930 2023-10-03T10:15:42.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.695+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f835c00c970 con 0x7f836c09e930 2023-10-03T10:15:42.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.731+0000 7fb7180dd700 1 Processor -- start 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.731+0000 7fb7180dd700 1 -- start start 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.731+0000 7fb7180dd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7101338a0 0x7fb710133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.731+0000 7fb7180dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb7180dd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71006ef30 con 0x7fb71009e760 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb7180dd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71006fef0 con 0x7fb7101338a0 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb7180dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101334b0 con 0x7fb71009de50 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33904/0 (socket says 172.21.15.19:33904) 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 -- 172.21.15.19:0/2657868666 learned_addr learned my addr 172.21.15.19:0/2657868666 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715e79700 1 --2- 172.21.15.19:0/2657868666 >> v2:172.21.15.19:3300/0 conn(0x7fb7101338a0 0x7fb710133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 -- 172.21.15.19:0/2657868666 >> v2:172.21.15.19:3300/0 conn(0x7fb7101338a0 msgr2=0x7fb710133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 --2- 172.21.15.19:0/2657868666 >> v2:172.21.15.19:3300/0 conn(0x7fb7101338a0 0x7fb710133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 -- 172.21.15.19:0/2657868666 >> v1:172.21.15.19:6789/0 conn(0x7fb71009e760 legacy=0x7fb71013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 -- 172.21.15.19:0/2657868666 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71006fc30 con 0x7fb71009de50 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.732+0000 7fb715678700 1 --2- 172.21.15.19:0/2657868666 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb7000098f0 tx=0x7fb700009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32355f5bd373496 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb714e77700 1 -- 172.21.15.19:0/2657868666 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000b8a0 con 0x7fb71009de50 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb714e77700 1 -- 172.21.15.19:0/2657868666 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000ba00 con 0x7fb71009de50 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb714e77700 1 -- 172.21.15.19:0/2657868666 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000bd90 con 0x7fb71009de50 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 -- 172.21.15.19:0/2657868666 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 msgr2=0x7fb71009e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2657868666 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb7000098f0 tx=0x7fb700009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 -- 172.21.15.19:0/2657868666 shutdown_connections 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2657868666 >> v2:172.21.15.19:3300/0 conn(0x7fb7101338a0 0x7fb710133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2657868666 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71009e220 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 -- 172.21.15.19:0/2657868666 >> 172.21.15.19:0/2657868666 conn(0x7fb7100a2aa0 msgr2=0x7fb7100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.733+0000 7fb7180dd700 1 -- 172.21.15.19:0/2657868666 shutdown_connections 2023-10-03T10:15:42.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.734+0000 7fb7180dd700 1 -- 172.21.15.19:0/2657868666 wait complete. 2023-10-03T10:15:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.735+0000 7fb7180dd700 1 Processor -- start 2023-10-03T10:15:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.735+0000 7fb7180dd700 1 -- start start 2023-10-03T10:15:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71009e760 0x7fb71011bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7101338a0 0x7fb71011c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71011cd40 con 0x7fb7101338a0 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71012ec60 con 0x7fb71009e760 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb7180dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71011daa0 con 0x7fb71009de50 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33906/0 (socket says 172.21.15.19:33906) 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 -- 172.21.15.19:0/2606621050 learned_addr learned my addr 172.21.15.19:0/2606621050 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb71667a700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7101338a0 0x7fb71011c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 -- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71009e760 msgr2=0x7fb71011bdb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71009e760 0x7fb71011bdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 -- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7101338a0 msgr2=0x7fb71011c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7101338a0 0x7fb71011c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 -- 172.21.15.19:0/2606621050 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700009550 con 0x7fb71009de50 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.736+0000 7fb715e79700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e840 tx=0x7fb70c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:42.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.737+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c013610 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.737+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c013770 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.737+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71011f0b0 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.737+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70c013b00 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.737+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71006f640 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.738+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71004ea50 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.738+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb70c013c60 con 0x7fb71009de50 2023-10-03T10:15:42.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.739+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb70c03f760 con 0x7fb71009de50 2023-10-03T10:15:42.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.747+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb70c026430 con 0x7fb71009de50 2023-10-03T10:15:42.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.752+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4870136e70 con 0x7f48700a0a30 2023-10-03T10:15:42.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.752+0000 7f48577fe700 1 -- 172.21.15.19:0/3048049766 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4870136e70 con 0x7f48700a0a30 2023-10-03T10:15:42.752 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 msgr2=0x7f4870133f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 0x7f4870133f70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f486400c450 tx=0x7f486400c760 comp rx=0 tx=0).stop 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 shutdown_connections 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4870138d80 0x7f48701344b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f487009d630 0x7f4870133a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 --2- 172.21.15.19:0/3048049766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48700a0a30 0x7f4870133f70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 >> 172.21.15.19:0/3048049766 conn(0x7f48700a3050 msgr2=0x7f487009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 shutdown_connections 2023-10-03T10:15:42.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.755+0000 7f487513e700 1 -- 172.21.15.19:0/3048049766 wait complete. 2023-10-03T10:15:42.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:42.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.845+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a8011ccb0 con 0x7f5a8009d6f0 2023-10-03T10:15:42.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.846+0000 7f5a7d7fa700 1 -- 172.21.15.19:0/229106083 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a8011ccb0 con 0x7f5a8009d6f0 2023-10-03T10:15:42.846 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 msgr2=0x7f5a801c4420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400b420 tx=0x7f5a7400b730 comp rx=0 tx=0).stop 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 shutdown_connections 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a80135e50 0x7f5a80119720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a8009d6f0 0x7f5a801c4420 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 --2- 172.21.15.19:0/229106083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a8009e1d0 0x7f5a801c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 >> 172.21.15.19:0/229106083 conn(0x7f5a80066f50 msgr2=0x7f5a800a2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 shutdown_connections 2023-10-03T10:15:42.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.848+0000 7f5a86d92700 1 -- 172.21.15.19:0/229106083 wait complete. 2023-10-03T10:15:42.862 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:42.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.932+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f836c074ea0 con 0x7f836c09e930 2023-10-03T10:15:42.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.932+0000 7f8353fff700 1 -- 172.21.15.19:0/401044119 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f835c021070 con 0x7f836c09e930 2023-10-03T10:15:42.932 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:42.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 msgr2=0x7f836c1a1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f835c00e930 tx=0x7f835c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 shutdown_connections 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09f650 0x7f836c1a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e930 0x7f836c1a1b90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 --2- 172.21.15.19:0/401044119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c09f240 0x7f836c1a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.934+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 >> 172.21.15.19:0/401044119 conn(0x7f836c0a4210 msgr2=0x7f836c1b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.935+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 shutdown_connections 2023-10-03T10:15:42.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.935+0000 7f8371901700 1 -- 172.21.15.19:0/401044119 wait complete. 2023-10-03T10:15:42.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:42.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.980+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb710074ea0 con 0x7fb71009de50 2023-10-03T10:15:42.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.981+0000 7fb7067fc700 1 -- 172.21.15.19:0/2606621050 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb70c02a090 con 0x7fb71009de50 2023-10-03T10:15:42.981 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 msgr2=0x7fb71011b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb70c00e840 tx=0x7fb70c00eb50 comp rx=0 tx=0).stop 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 shutdown_connections 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7101338a0 0x7fb71011c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb71009de50 0x7fb71011b870 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 --2- 172.21.15.19:0/2606621050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb71009e760 0x7fb71011bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 >> 172.21.15.19:0/2606621050 conn(0x7fb7100a2aa0 msgr2=0x7fb710130610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 shutdown_connections 2023-10-03T10:15:42.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:42.983+0000 7fb7180dd700 1 -- 172.21.15.19:0/2606621050 wait complete. 2023-10-03T10:15:42.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:43.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:43.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.919+0000 7f3950b0f700 1 Processor -- start 2023-10-03T10:15:43.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.919+0000 7f3950b0f700 1 -- start start 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3950b0f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f394c0a0a30 0x7f394c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3950b0f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3950b0f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c09edd0 con 0x7f394c0a1340 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3950b0f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c09e1f0 con 0x7f394c0a0a30 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3950b0f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c09dc50 con 0x7f394c134170 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f394c0a0a30 0x7f394c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f394c0a0a30 0x7f394c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50180/0 (socket says 172.21.15.19:50180) 2023-10-03T10:15:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f3949d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f394c0a1340 0x7f394c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45062/0 (socket says 172.21.15.19:45062) 2023-10-03T10:15:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60280/0 (socket says 172.21.15.19:60280) 2023-10-03T10:15:43.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 -- 172.21.15.19:0/2055338254 learned_addr learned my addr 172.21.15.19:0/2055338254 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 -- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 msgr2=0x7f394c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.920+0000 7f394a59c700 1 -- 172.21.15.19:0/2055338254 >> v1:172.21.15.19:6789/0 conn(0x7f394c0a1340 legacy=0x7f394c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394a59c700 1 -- 172.21.15.19:0/2055338254 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c0a1fe0 con 0x7f394c0a0a30 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394959a700 1 -- 172.21.15.19:0/2055338254 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959459771 0 0) 0x7f394c09edd0 con 0x7f394c0a1340 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394ad9d700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394a59c700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c0a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098f0 tx=0x7f393c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f011dcfc8c9a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394959a700 1 -- 172.21.15.19:0/2055338254 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c011830 con 0x7f394c0a0a30 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394959a700 1 -- 172.21.15.19:0/2055338254 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c011990 con 0x7f394c0a0a30 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.921+0000 7f394959a700 1 -- 172.21.15.19:0/2055338254 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c011d20 con 0x7f394c0a0a30 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 -- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 msgr2=0x7f394c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c0a0e00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f393c0098f0 tx=0x7f393c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 -- 172.21.15.19:0/2055338254 shutdown_connections 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c134170 0x7f394c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 --2- 172.21.15.19:0/2055338254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c0a0e00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 -- 172.21.15.19:0/2055338254 >> 172.21.15.19:0/2055338254 conn(0x7f394c0a6550 msgr2=0x7f394c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 -- 172.21.15.19:0/2055338254 shutdown_connections 2023-10-03T10:15:43.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.922+0000 7f3950b0f700 1 -- 172.21.15.19:0/2055338254 wait complete. 2023-10-03T10:15:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.923+0000 7f3950b0f700 1 Processor -- start 2023-10-03T10:15:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.923+0000 7f3950b0f700 1 -- start start 2023-10-03T10:15:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c122670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f394c134170 0x7f394c1230f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c126190 con 0x7f394c0a0a30 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c125bf0 con 0x7f394c0a1340 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3950b0f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f394c124320 con 0x7f394c134170 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3949d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f394a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c122670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3949d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60286/0 (socket says 172.21.15.19:60286) 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f3949d9b700 1 -- 172.21.15.19:0/691035544 learned_addr learned my addr 172.21.15.19:0/691035544 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.924+0000 7f394ad9d700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f394c134170 0x7f394c1230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 -- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f394c134170 msgr2=0x7f394c1230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f394c134170 0x7f394c1230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 -- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 msgr2=0x7f394c122670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c122670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:43.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 -- 172.21.15.19:0/691035544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3944009a70 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f394a59c700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3949d9b700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f394000c550 tx=0x7f394000c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940004c80 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3940004e00 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3940007310 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c009550 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.925+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c0a25e0 con 0x7f394c0a1340 2023-10-03T10:15:43.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.926+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0a0220 con 0x7f394c0a1340 2023-10-03T10:15:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.926+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3940007470 con 0x7f394c0a1340 2023-10-03T10:15:43.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.926+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f394003f260 con 0x7f394c0a1340 2023-10-03T10:15:43.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:43.931+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39400133c0 con 0x7f394c0a1340 2023-10-03T10:15:43.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:43.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:44.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.004+0000 7f2b3fcf5700 1 Processor -- start 2023-10-03T10:15:44.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 -- start start 2023-10-03T10:15:44.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b3809d6f0 0x7f2b3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e000 0x7f2b38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3809f130 con 0x7f2b3809e410 2023-10-03T10:15:44.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3809f520 con 0x7f2b3809d6f0 2023-10-03T10:15:44.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3fcf5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3809e930 con 0x7f2b3809e000 2023-10-03T10:15:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3da91700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b3809d6f0 0x7f2b3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3e292700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b3809e410 0x7f2b38130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45076/0 (socket says 172.21.15.19:45076) 2023-10-03T10:15:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3e292700 1 -- 172.21.15.19:0/4117087842 learned_addr learned my addr 172.21.15.19:0/4117087842 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:44.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.005+0000 7f2b3d290700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e000 0x7f2b38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3da91700 1 -- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e000 msgr2=0x7f2b38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3da91700 1 --2- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e000 0x7f2b38130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3da91700 1 -- 172.21.15.19:0/4117087842 >> v1:172.21.15.19:6789/0 conn(0x7f2b3809e410 legacy=0x7f2b38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3da91700 1 -- 172.21.15.19:0/4117087842 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3809b2d0 con 0x7f2b3809d6f0 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3da91700 1 --2- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809d6f0 0x7f2b3809dac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c73900b3c68f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3ca8f700 1 -- 172.21.15.19:0/4117087842 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011830 con 0x7f2b3809d6f0 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3ca8f700 1 -- 172.21.15.19:0/4117087842 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34011990 con 0x7f2b3809d6f0 2023-10-03T10:15:44.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.006+0000 7f2b3ca8f700 1 -- 172.21.15.19:0/4117087842 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34011d20 con 0x7f2b3809d6f0 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809d6f0 msgr2=0x7f2b3809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809d6f0 0x7f2b3809dac0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/4117087842 shutdown_connections 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809d6f0 0x7f2b3809dac0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/4117087842 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e000 0x7f2b38130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.007+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/4117087842 >> 172.21.15.19:0/4117087842 conn(0x7f2b38066f50 msgr2=0x7f2b3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.008+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/4117087842 shutdown_connections 2023-10-03T10:15:44.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.008+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/4117087842 wait complete. 2023-10-03T10:15:44.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 Processor -- start 2023-10-03T10:15:44.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 -- start start 2023-10-03T10:15:44.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 0x7f2b38120150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 0x7f2b38120690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e410 0x7f2b38120bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38121d60 con 0x7f2b3809e000 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38122380 con 0x7f2b3809e410 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3fcf5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b38123990 con 0x7f2b3809d6f0 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3da91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 0x7f2b38120150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3da91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 0x7f2b38120150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33922/0 (socket says 172.21.15.19:33922) 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3da91700 1 -- 172.21.15.19:0/3228594661 learned_addr learned my addr 172.21.15.19:0/3228594661 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.009+0000 7f2b3d290700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 0x7f2b38120690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3e292700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e410 0x7f2b38120bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 -- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 msgr2=0x7f2b38120150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 0x7f2b38120150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 -- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e410 msgr2=0x7f2b38120bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e410 0x7f2b38120bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 -- 172.21.15.19:0/3228594661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094a0 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b3d290700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 0x7f2b38120690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800e900 tx=0x7f2b2800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800ee50 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2800c850 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.010+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2800cbc0 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.011+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380a1e10 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.011+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b38122550 con 0x7f2b3809e000 2023-10-03T10:15:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.012+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b381244c0 con 0x7f2b3809e000 2023-10-03T10:15:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.012+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b2800cd20 con 0x7f2b3809e000 2023-10-03T10:15:44.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.012+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b2803f880 con 0x7f2b3809e000 2023-10-03T10:15:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.018+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b2801be10 con 0x7f2b3809e000 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 Processor -- start 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 -- start start 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac7809de50 0x7fac7809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7806fef0 con 0x7fac7809e760 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7806ef30 con 0x7fac781338a0 2023-10-03T10:15:44.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac7d467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac781334b0 con 0x7fac7809de50 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac777fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac76ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac777fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50220/0 (socket says 172.21.15.19:50220) 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac777fe700 1 -- 172.21.15.19:0/1333103160 learned_addr learned my addr 172.21.15.19:0/1333103160 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.094+0000 7fac76ffd700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60312/0 (socket says 172.21.15.19:60312) 2023-10-03T10:15:44.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac767fc700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac7809de50 0x7fac7809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 -- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac7809de50 msgr2=0x7fac7809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac7809de50 0x7fac7809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 -- 172.21.15.19:0/1333103160 >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 msgr2=0x7fac7813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 --2- 172.21.15.19:0/1333103160 >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 -- 172.21.15.19:0/1333103160 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7806fc30 con 0x7fac781338a0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac777fe700 1 --2- 172.21.15.19:0/1333103160 >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac76ffd700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac68009870 tx=0x7fac68009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c0ea56a5ae317c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac75ffb700 1 -- 172.21.15.19:0/1333103160 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68011830 con 0x7fac781338a0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac75ffb700 1 -- 172.21.15.19:0/1333103160 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac68011990 con 0x7fac781338a0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.095+0000 7fac75ffb700 1 -- 172.21.15.19:0/1333103160 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68011d20 con 0x7fac781338a0 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 -- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 msgr2=0x7fac78133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fac68009870 tx=0x7fac68009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 -- 172.21.15.19:0/1333103160 shutdown_connections 2023-10-03T10:15:44.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac781338a0 0x7fac78133c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 --2- 172.21.15.19:0/1333103160 >> v2:172.21.15.19:3300/0 conn(0x7fac7809e760 0x7fac7813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 --2- 172.21.15.19:0/1333103160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac7809de50 0x7fac7809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 -- 172.21.15.19:0/1333103160 >> 172.21.15.19:0/1333103160 conn(0x7fac780a2aa0 msgr2=0x7fac780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 -- 172.21.15.19:0/1333103160 shutdown_connections 2023-10-03T10:15:44.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.096+0000 7fac7d467700 1 -- 172.21.15.19:0/1333103160 wait complete. 2023-10-03T10:15:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.097+0000 7fac7d467700 1 Processor -- start 2023-10-03T10:15:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 -- start start 2023-10-03T10:15:44.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac7809e760 0x7fac7811ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 0x7fac7811f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac78122510 con 0x7fac7809de50 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7806f640 con 0x7fac7809e760 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac7d467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac781206a0 con 0x7fac781338a0 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac76ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac76ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50232/0 (socket says 172.21.15.19:50232) 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac76ffd700 1 -- 172.21.15.19:0/996863994 learned_addr learned my addr 172.21.15.19:0/996863994 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac767fc700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac7809e760 0x7fac7811ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.098+0000 7fac777fe700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 0x7fac7811f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 -- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac7809e760 msgr2=0x7fac7811ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac7809e760 0x7fac7811ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 -- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 msgr2=0x7fac7811e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 -- 172.21.15.19:0/996863994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac70009b30 con 0x7fac781338a0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac76ffd700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac777fe700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 0x7fac7811f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac7000efc0 tx=0x7fac7000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70018070 con 0x7fac781338a0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7000f040 con 0x7fac781338a0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac70003c60 con 0x7fac781338a0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac680094a0 con 0x7fac781338a0 2023-10-03T10:15:44.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.099+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7812f570 con 0x7fac781338a0 2023-10-03T10:15:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.101+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fac7000c880 con 0x7fac781338a0 2023-10-03T10:15:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.101+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fac7003f6c0 con 0x7fac781338a0 2023-10-03T10:15:44.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.101+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac78122150 con 0x7fac781338a0 2023-10-03T10:15:44.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.106+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fac70003dc0 con 0x7fac781338a0 2023-10-03T10:15:44.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.144+0000 7f5c5030d700 1 Processor -- start 2023-10-03T10:15:44.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.144+0000 7f5c5030d700 1 -- start start 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c5030d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c5030d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 0x7f5c48130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c5030d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4809f130 con 0x7f5c4809e000 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c5030d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4809f520 con 0x7f5c4809d6f0 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c5030d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4809e930 con 0x7f5c4809e410 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60326/0 (socket says 172.21.15.19:60326) 2023-10-03T10:15:44.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 -- 172.21.15.19:0/178252598 learned_addr learned my addr 172.21.15.19:0/178252598 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e8aa700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 0x7f5c48130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 -- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 msgr2=0x7f5c48130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 0x7f5c48130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 -- 172.21.15.19:0/178252598 >> v1:172.21.15.19:6789/0 conn(0x7f5c4809e000 legacy=0x7f5c48130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e0a9700 1 -- 172.21.15.19:0/178252598 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4809b2d0 con 0x7f5c4809d6f0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.145+0000 7f5c4e8aa700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 0x7f5c48130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.146+0000 7f5c4e0a9700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009920 tx=0x7f5c44009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85e788122f90e019 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.146+0000 7f5c4d0a7700 1 -- 172.21.15.19:0/178252598 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44004230 con 0x7f5c4809d6f0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.146+0000 7f5c4d0a7700 1 -- 172.21.15.19:0/178252598 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44004390 con 0x7f5c4809d6f0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.146+0000 7f5c4d0a7700 1 -- 172.21.15.19:0/178252598 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44009e70 con 0x7f5c4809d6f0 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 -- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 msgr2=0x7f5c4809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5c44009920 tx=0x7f5c44009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 -- 172.21.15.19:0/178252598 shutdown_connections 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e410 0x7f5c48130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 --2- 172.21.15.19:0/178252598 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809d6f0 0x7f5c4809dac0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 -- 172.21.15.19:0/178252598 >> 172.21.15.19:0/178252598 conn(0x7f5c48066f50 msgr2=0x7f5c4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 -- 172.21.15.19:0/178252598 shutdown_connections 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.147+0000 7f5c5030d700 1 -- 172.21.15.19:0/178252598 wait complete. 2023-10-03T10:15:44.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.148+0000 7f5c5030d700 1 Processor -- start 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.148+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f394c074ea0 con 0x7f394c0a1340 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.148+0000 7f5c5030d700 1 -- start start 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.148+0000 7f393affd700 1 -- 172.21.15.19:0/691035544 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3940011360 con 0x7f394c0a1340 2023-10-03T10:15:44.149 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.148+0000 7f5c5030d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 0x7f5c4812dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c5030d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 0x7f5c4812e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c5030d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c5030d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48132000 con 0x7f5c4809d6f0 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c5030d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4812f290 con 0x7f5c4809e410 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c5030d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48072490 con 0x7f5c4809e000 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4d8a8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 0x7f5c4812e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60328/0 (socket says 172.21.15.19:60328) 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4d8a8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 0x7f5c4812e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33964/0 (socket says 172.21.15.19:33964) 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 -- 172.21.15.19:0/2026030224 learned_addr learned my addr 172.21.15.19:0/2026030224 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e0a9700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 0x7f5c4812dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:44.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 -- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 msgr2=0x7f5c4812e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 0x7f5c4812e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 -- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 msgr2=0x7f5c4812dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 0x7f5c4812dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 -- 172.21.15.19:0/2026030224 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c44009550 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e0a9700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 0x7f5c4812dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.149+0000 7f5c4e8aa700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c4001df30 tx=0x7f5c4001df60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.150+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4000ade0 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.150+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c40026440 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.150+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400267f0 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.150+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c481305d0 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.150+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48131b70 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.151+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c4001cd60 con 0x7f5c4809e410 2023-10-03T10:15:44.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.151+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4806f550 con 0x7f5c4809e410 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.151+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c4003fc00 con 0x7f5c4809e410 2023-10-03T10:15:44.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 msgr2=0x7f394c122bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f394000c550 tx=0x7f394000c860 comp rx=0 tx=0).stop 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 shutdown_connections 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f394c134170 0x7f394c1230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f394c0a0a30 0x7f394c122670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 --2- 172.21.15.19:0/691035544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f394c0a1340 0x7f394c122bb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.154+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 >> 172.21.15.19:0/691035544 conn(0x7f394c0a6550 msgr2=0x7f394c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.155+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 shutdown_connections 2023-10-03T10:15:44.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.155+0000 7f3950b0f700 1 -- 172.21.15.19:0/691035544 wait complete. 2023-10-03T10:15:44.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.156+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c40025bc0 con 0x7f5c4809e410 2023-10-03T10:15:44.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.232+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b38074ea0 con 0x7f2b3809e000 2023-10-03T10:15:44.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.233+0000 7f2b2e7fc700 1 -- 172.21.15.19:0/3228594661 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b2801b3b0 con 0x7f2b3809e000 2023-10-03T10:15:44.233 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 msgr2=0x7f2b38120690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 0x7f2b38120690 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800e900 tx=0x7f2b2800ec10 comp rx=0 tx=0).stop 2023-10-03T10:15:44.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 shutdown_connections 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b3809e410 0x7f2b38120bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b3809d6f0 0x7f2b38120150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 --2- 172.21.15.19:0/3228594661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b3809e000 0x7f2b38120690 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 >> 172.21.15.19:0/3228594661 conn(0x7f2b38066f50 msgr2=0x7f2b3806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 shutdown_connections 2023-10-03T10:15:44.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.235+0000 7f2b3fcf5700 1 -- 172.21.15.19:0/3228594661 wait complete. 2023-10-03T10:15:44.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:44.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.318+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac7812fdf0 con 0x7fac781338a0 2023-10-03T10:15:44.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.318+0000 7fac5f7fe700 1 -- 172.21.15.19:0/996863994 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fac7001cbb0 con 0x7fac781338a0 2023-10-03T10:15:44.318 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 msgr2=0x7fac7811f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 0x7fac7811f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fac7000efc0 tx=0x7fac7000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 shutdown_connections 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac781338a0 0x7fac7811f470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac7809de50 0x7fac7811e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 --2- 172.21.15.19:0/996863994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac7809e760 0x7fac7811ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 >> 172.21.15.19:0/996863994 conn(0x7fac780a2aa0 msgr2=0x7fac7809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 shutdown_connections 2023-10-03T10:15:44.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.321+0000 7fac7d467700 1 -- 172.21.15.19:0/996863994 wait complete. 2023-10-03T10:15:44.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.363+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5c4809d160 con 0x7f5c4809e410 2023-10-03T10:15:44.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.364+0000 7f5c3effd700 1 -- 172.21.15.19:0/2026030224 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c40025bc0 con 0x7f5c4809e410 2023-10-03T10:15:44.364 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 msgr2=0x7f5c4812e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5c4001df30 tx=0x7f5c4001df60 comp rx=0 tx=0).stop 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 shutdown_connections 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4809e410 0x7f5c4812e940 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c4809d6f0 0x7f5c4812dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 --2- 172.21.15.19:0/2026030224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4809e000 0x7f5c4812e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 >> 172.21.15.19:0/2026030224 conn(0x7f5c48066f50 msgr2=0x7f5c480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 shutdown_connections 2023-10-03T10:15:44.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:44.366+0000 7f5c5030d700 1 -- 172.21.15.19:0/2026030224 wait complete. 2023-10-03T10:15:44.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:45.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:45.250 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:45.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.318+0000 7f73e7dad700 1 Processor -- start 2023-10-03T10:15:45.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.318+0000 7f73e7dad700 1 -- start start 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e7dad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e7dad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e7dad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e009edd0 con 0x7f73e00a1340 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e7dad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e009e1f0 con 0x7f73e0134170 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e7dad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73e009dc50 con 0x7f73e00a0a30 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e634a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33974/0 (socket says 172.21.15.19:33974) 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e634a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60340/0 (socket says 172.21.15.19:60340) 2023-10-03T10:15:45.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 -- 172.21.15.19:0/4226288686 learned_addr learned my addr 172.21.15.19:0/4226288686 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5348700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f73e00a1340 0x7f73e0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45094/0 (socket says 172.21.15.19:45094) 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 -- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 msgr2=0x7f73e013bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e4b47700 1 -- 172.21.15.19:0/4226288686 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197721830 0 0) 0x7f73e009edd0 con 0x7f73e00a1340 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 -- 172.21.15.19:0/4226288686 >> v1:172.21.15.19:6789/0 conn(0x7f73e00a1340 legacy=0x7f73e0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e5b49700 1 -- 172.21.15.19:0/4226288686 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e00a1fe0 con 0x7f73e00a0a30 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.319+0000 7f73e634a700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.320+0000 7f73e5b49700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009e80 tx=0x7f73dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70ffe8d49e1fc714 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.320+0000 7f73e4b47700 1 -- 172.21.15.19:0/4226288686 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00e070 con 0x7f73e00a0a30 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.320+0000 7f73e4b47700 1 -- 172.21.15.19:0/4226288686 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00b910 con 0x7f73e00a0a30 2023-10-03T10:15:45.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.320+0000 7f73e4b47700 1 -- 172.21.15.19:0/4226288686 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00bcc0 con 0x7f73e00a0a30 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 -- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 msgr2=0x7f73e00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009e80 tx=0x7f73dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 -- 172.21.15.19:0/4226288686 shutdown_connections 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e0134170 0x7f73e013bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 --2- 172.21.15.19:0/4226288686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e00a0e00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 -- 172.21.15.19:0/4226288686 >> 172.21.15.19:0/4226288686 conn(0x7f73e00a6550 msgr2=0x7f73e00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 -- 172.21.15.19:0/4226288686 shutdown_connections 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.321+0000 7f73e7dad700 1 -- 172.21.15.19:0/4226288686 wait complete. 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.322+0000 7f73e7dad700 1 Processor -- start 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.322+0000 7f73e7dad700 1 -- start start 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.322+0000 7f73e7dad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.322+0000 7f73e7dad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 0x7f73e0122c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.322+0000 7f73e7dad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 0x7f73e01231b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e7dad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01261c0 con 0x7f73e0134170 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e7dad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0125c20 con 0x7f73e00a1340 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e7dad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0124350 con 0x7f73e00a0a30 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e634a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 0x7f73e01231b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33986/0 (socket says 172.21.15.19:33986) 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5348700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 0x7f73e0122c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 -- 172.21.15.19:0/2067157180 learned_addr learned my addr 172.21.15.19:0/2067157180 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 -- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 msgr2=0x7f73e0122c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 0x7f73e0122c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 -- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 msgr2=0x7f73e01231b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 0x7f73e01231b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 -- 172.21.15.19:0/2067157180 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80094a0 con 0x7f73e00a0a30 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5348700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 0x7f73e0122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e634a700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 0x7f73e01231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73e5b49700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b680 tx=0x7f73dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0099b0 con 0x7f73e00a0a30 2023-10-03T10:15:45.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.323+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc004250 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.324+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73dc009b30 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.324+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc004600 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.324+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e00a25e0 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.324+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73dc004760 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.324+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73dc040ad0 con 0x7f73e00a0a30 2023-10-03T10:15:45.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.325+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e00a0280 con 0x7f73e00a0a30 2023-10-03T10:15:45.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.330+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73dc019760 con 0x7f73e00a0a30 2023-10-03T10:15:45.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:45.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.412+0000 7f2d41574700 1 Processor -- start 2023-10-03T10:15:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.412+0000 7f2d41574700 1 -- start start 2023-10-03T10:15:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12f8b0 0x7f2d3c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c12d330 con 0x7f2d3c130260 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c12cd90 con 0x7f2d3c12f8b0 2023-10-03T10:15:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d41574700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1306d0 con 0x7f2d3c12cf60 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d3affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d3b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d3affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33998/0 (socket says 172.21.15.19:33998) 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d3b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50270/0 (socket says 172.21.15.19:50270) 2023-10-03T10:15:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.413+0000 7f2d3affd700 1 -- 172.21.15.19:0/3964578707 learned_addr learned my addr 172.21.15.19:0/3964578707 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 -- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12f8b0 msgr2=0x7f2d3c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 --2- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12f8b0 0x7f2d3c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 -- 172.21.15.19:0/3964578707 >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 msgr2=0x7f2d3c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 --2- 172.21.15.19:0/3964578707 >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 -- 172.21.15.19:0/3964578707 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c071780 con 0x7f2d3c12cf60 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3b7fe700 1 --2- 172.21.15.19:0/3964578707 >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d3affd700 1 --2- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098f0 tx=0x7f2d2c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657bd0bdb19cff9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d39ffb700 1 -- 172.21.15.19:0/3964578707 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011830 con 0x7f2d3c12cf60 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d39ffb700 1 -- 172.21.15.19:0/3964578707 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c011990 con 0x7f2d3c12cf60 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.414+0000 7f2d39ffb700 1 -- 172.21.15.19:0/3964578707 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c011d20 con 0x7f2d3c12cf60 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 -- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 msgr2=0x7f2d3c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 --2- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c0098f0 tx=0x7f2d2c009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 -- 172.21.15.19:0/3964578707 shutdown_connections 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 --2- 172.21.15.19:0/3964578707 >> v2:172.21.15.19:3300/0 conn(0x7f2d3c130260 0x7f2d3c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 --2- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c12cf60 0x7f2d3c06f5d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 --2- 172.21.15.19:0/3964578707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12f8b0 0x7f2d3c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 -- 172.21.15.19:0/3964578707 >> 172.21.15.19:0/3964578707 conn(0x7f2d3c0a2aa0 msgr2=0x7f2d3c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 -- 172.21.15.19:0/3964578707 shutdown_connections 2023-10-03T10:15:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.415+0000 7f2d41574700 1 -- 172.21.15.19:0/3964578707 wait complete. 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 Processor -- start 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 -- start start 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 0x7f2d3c1309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 0x7f2d3c130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c130260 0x7f2d3c131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c09eb30 con 0x7f2d3c12f8b0 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c09e900 con 0x7f2d3c12cf60 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d41574700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1333d0 con 0x7f2d3c130260 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 0x7f2d3c130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d3a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 0x7f2d3c130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50272/0 (socket says 172.21.15.19:50272) 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.417+0000 7f2d3a7fc700 1 -- 172.21.15.19:0/7488859 learned_addr learned my addr 172.21.15.19:0/7488859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 0x7f2d3c1309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3b7fe700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c130260 0x7f2d3c131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 -- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c130260 msgr2=0x7f2d3c131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c130260 0x7f2d3c131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 -- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 msgr2=0x7f2d3c130f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 0x7f2d3c130f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 -- 172.21.15.19:0/7488859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34009a70 con 0x7f2d3c12cf60 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d3affd700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 0x7f2d3c1309e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c016000 tx=0x7f2d2c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004240 con 0x7f2d3c12cf60 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2c009550 con 0x7f2d3c12cf60 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.418+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c132d50 con 0x7f2d3c12cf60 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.419+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c01f070 con 0x7f2d3c12cf60 2023-10-03T10:15:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.419+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c0045e0 con 0x7f2d3c12cf60 2023-10-03T10:15:45.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.419+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d2c021030 con 0x7f2d3c12cf60 2023-10-03T10:15:45.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.419+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d2c040430 con 0x7f2d3c12cf60 2023-10-03T10:15:45.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.420+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c074ea0 con 0x7f2d3c12cf60 2023-10-03T10:15:45.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.425+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d2c015020 con 0x7f2d3c12cf60 2023-10-03T10:15:45.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.517+0000 7f3d60528700 1 Processor -- start 2023-10-03T10:15:45.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.517+0000 7f3d60528700 1 -- start start 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d60528700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d60528700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 0x7f3d58134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d60528700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5809b120 con 0x7f3d5809e000 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d60528700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5806b460 con 0x7f3d5809e410 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d60528700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5809a7e0 con 0x7f3d5809d6f0 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d5e2c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.518+0000 7f3d5e2c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60368/0 (socket says 172.21.15.19:60368) 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 -- 172.21.15.19:0/635112027 learned_addr learned my addr 172.21.15.19:0/635112027 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5eac5700 1 --2- 172.21.15.19:0/635112027 >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 0x7f3d58134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 -- 172.21.15.19:0/635112027 >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 msgr2=0x7f3d58134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 --2- 172.21.15.19:0/635112027 >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 0x7f3d58134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 -- 172.21.15.19:0/635112027 >> v1:172.21.15.19:6789/0 conn(0x7f3d5809e000 legacy=0x7f3d581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 -- 172.21.15.19:0/635112027 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5809a500 con 0x7f3d5809d6f0 2023-10-03T10:15:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5eac5700 1 --2- 172.21.15.19:0/635112027 >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 0x7f3d58134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:45.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5e2c4700 1 --2- 172.21.15.19:0/635112027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009920 tx=0x7f3d54009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a195e8566b4f5b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5d2c2700 1 -- 172.21.15.19:0/635112027 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5400ba20 con 0x7f3d5809d6f0 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5d2c2700 1 -- 172.21.15.19:0/635112027 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5400bb80 con 0x7f3d5809d6f0 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.519+0000 7f3d5d2c2700 1 -- 172.21.15.19:0/635112027 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54009e70 con 0x7f3d5809d6f0 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 -- 172.21.15.19:0/635112027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 msgr2=0x7f3d5809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 --2- 172.21.15.19:0/635112027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3d54009920 tx=0x7f3d54009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 -- 172.21.15.19:0/635112027 shutdown_connections 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 --2- 172.21.15.19:0/635112027 >> v2:172.21.15.19:3300/0 conn(0x7f3d5809e410 0x7f3d58134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 --2- 172.21.15.19:0/635112027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809d6f0 0x7f3d5809dac0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 -- 172.21.15.19:0/635112027 >> 172.21.15.19:0/635112027 conn(0x7f3d58066f50 msgr2=0x7f3d5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 -- 172.21.15.19:0/635112027 shutdown_connections 2023-10-03T10:15:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.520+0000 7f3d60528700 1 -- 172.21.15.19:0/635112027 wait complete. 2023-10-03T10:15:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 Processor -- start 2023-10-03T10:15:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 Processor -- start 2023-10-03T10:15:45.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 -- start start 2023-10-03T10:15:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 -- start start 2023-10-03T10:15:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d5809d6f0 0x7f3d581a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 0x7f3d581a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581a7300 con 0x7f3d5809d6f0 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581a7a60 con 0x7f3d5809e410 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d60528700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d581a8cb0 con 0x7f3d5809e000 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7f3d5dac3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34022/0 (socket says 172.21.15.19:34022) 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 -- 172.21.15.19:0/2079637033 learned_addr learned my addr 172.21.15.19:0/2079637033 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5eac5700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 0x7f3d581a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 0x7fde5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 0x7fde501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde5009e410 0x7fde50133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5006b460 con 0x7fde5009e410 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5009b120 con 0x7fde5009e000 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.522+0000 7fde557f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5009a7e0 con 0x7fde5009d6f0 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 0x7fde501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 0x7fde501339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60398/0 (socket says 172.21.15.19:60398) 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4e7fc700 1 -- 172.21.15.19:0/4274966444 learned_addr learned my addr 172.21.15.19:0/4274966444 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 0x7fde5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 -- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 msgr2=0x7f3d581a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 0x7f3d581a68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 -- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d5809d6f0 msgr2=0x7f3d581a5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d5809d6f0 0x7f3d581a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 -- 172.21.15.19:0/2079637033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d54009550 con 0x7f3d5809e000 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5eac5700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 0x7f3d581a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 -- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 msgr2=0x7fde501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 0x7fde501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 -- 172.21.15.19:0/4274966444 >> v2:172.21.15.19:3300/0 conn(0x7fde5009e410 msgr2=0x7fde50133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:45.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 --2- 172.21.15.19:0/4274966444 >> v2:172.21.15.19:3300/0 conn(0x7fde5009e410 0x7fde50133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7f3d5dac3700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c4e0 tx=0x7f3d4c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.523+0000 7fde4effd700 1 -- 172.21.15.19:0/4274966444 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5009a500 con 0x7fde5009d6f0 2023-10-03T10:15:45.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0052d0 con 0x7f3d5809e000 2023-10-03T10:15:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4c005430 con 0x7f3d5809e000 2023-10-03T10:15:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c0038c0 con 0x7f3d5809e000 2023-10-03T10:15:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7fde4effd700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 0x7fde5009dac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fde40009870 tx=0x7fde40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd497ab5710bbc07 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d581a9690 con 0x7f3d5809e000 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d580a3250 con 0x7f3d5809e000 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d4c003a20 con 0x7f3d5809e000 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d4c03eae0 con 0x7f3d5809e000 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7fde4dffb700 1 -- 172.21.15.19:0/4274966444 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011830 con 0x7fde5009d6f0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7fde4dffb700 1 -- 172.21.15.19:0/4274966444 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40011990 con 0x7fde5009d6f0 2023-10-03T10:15:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.524+0000 7fde4dffb700 1 -- 172.21.15.19:0/4274966444 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40011d20 con 0x7fde5009d6f0 2023-10-03T10:15:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5809c770 con 0x7f3d5809e000 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7fde557f3700 1 -- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 msgr2=0x7fde5009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7fde557f3700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 0x7fde5009dac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fde40009870 tx=0x7fde40009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7fde557f3700 1 -- 172.21.15.19:0/4274966444 shutdown_connections 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7fde557f3700 1 --2- 172.21.15.19:0/4274966444 >> v2:172.21.15.19:3300/0 conn(0x7fde5009e410 0x7fde50133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.525+0000 7fde557f3700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009d6f0 0x7fde5009dac0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.526+0000 7fde557f3700 1 --2- 172.21.15.19:0/4274966444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e000 0x7fde501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.526+0000 7fde557f3700 1 -- 172.21.15.19:0/4274966444 >> 172.21.15.19:0/4274966444 conn(0x7fde50066f50 msgr2=0x7fde5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.526+0000 7fde557f3700 1 -- 172.21.15.19:0/4274966444 shutdown_connections 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.526+0000 7fde557f3700 1 -- 172.21.15.19:0/4274966444 wait complete. 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.527+0000 7fde557f3700 1 Processor -- start 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.527+0000 7fde557f3700 1 -- start start 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde5009d6f0 0x7fde50122500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e410 0x7fde50122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:45.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde50124ed0 con 0x7fde5009d6f0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500a2c20 con 0x7fde5009e410 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde557f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde5009c710 con 0x7fde5009e000 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde4e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34038/0 (socket says 172.21.15.19:34038) 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde4e7fc700 1 -- 172.21.15.19:0/4251839231 learned_addr learned my addr 172.21.15.19:0/4251839231 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde4f7fe700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e410 0x7fde50122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.528+0000 7fde4effd700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde5009d6f0 0x7fde50122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:45.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 -- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e410 msgr2=0x7fde50122f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e410 0x7fde50122f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 -- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde5009d6f0 msgr2=0x7fde50122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde5009d6f0 0x7fde50122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 -- 172.21.15.19:0/4251839231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400094a0 con 0x7fde5009e000 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.529+0000 7fde4e7fc700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e8e0 tx=0x7fde4400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44013680 con 0x7fde5009e000 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde440137e0 con 0x7fde5009e000 2023-10-03T10:15:45.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde50125d70 con 0x7fde5009e000 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44013b50 con 0x7fde5009e000 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde50125aa0 con 0x7fde5009e000 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.531+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d4c018260 con 0x7f3d5809e000 2023-10-03T10:15:45.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.533+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde44013cb0 con 0x7fde5009e000 2023-10-03T10:15:45.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.533+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde50125aa0 con 0x7fde5009e000 2023-10-03T10:15:45.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.533+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde44012750 con 0x7fde5009e000 2023-10-03T10:15:45.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.538+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde50125aa0 con 0x7fde5009e000 2023-10-03T10:15:45.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.560+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73e0074ea0 con 0x7f73e00a0a30 2023-10-03T10:15:45.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.560+0000 7f73d67fc700 1 -- 172.21.15.19:0/2067157180 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73dc01b3a0 con 0x7f73e00a0a30 2023-10-03T10:15:45.560 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:45.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 msgr2=0x7f73e0122730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f73dc00b680 tx=0x7f73dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 shutdown_connections 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e0134170 0x7f73e01231b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e00a0a30 0x7f73e0122730 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 --2- 172.21.15.19:0/2067157180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e00a1340 0x7f73e0122c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.563+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 >> 172.21.15.19:0/2067157180 conn(0x7f73e00a6550 msgr2=0x7f73e009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.564+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 shutdown_connections 2023-10-03T10:15:45.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.564+0000 7f73e7dad700 1 -- 172.21.15.19:0/2067157180 wait complete. 2023-10-03T10:15:45.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:45.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.686+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2d3c0713a0 con 0x7f2d3c12cf60 2023-10-03T10:15:45.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.686+0000 7f2d237fe700 1 -- 172.21.15.19:0/7488859 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d2c024480 con 0x7f2d3c12cf60 2023-10-03T10:15:45.686 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:45.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 msgr2=0x7f2d3c1309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 0x7f2d3c1309e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c016000 tx=0x7f2d2c004750 comp rx=0 tx=0).stop 2023-10-03T10:15:45.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 shutdown_connections 2023-10-03T10:15:45.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d3c130260 0x7f2d3c131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d3c12cf60 0x7f2d3c1309e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 --2- 172.21.15.19:0/7488859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d3c12f8b0 0x7f2d3c130f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 >> 172.21.15.19:0/7488859 conn(0x7f2d3c0a2aa0 msgr2=0x7f2d3c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 shutdown_connections 2023-10-03T10:15:45.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.688+0000 7f2d41574700 1 -- 172.21.15.19:0/7488859 wait complete. 2023-10-03T10:15:45.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.738+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3d58074ea0 con 0x7f3d5809e000 2023-10-03T10:15:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.739+0000 7f3d4affd700 1 -- 172.21.15.19:0/2079637033 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d4c017020 con 0x7f3d5809e000 2023-10-03T10:15:45.739 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 msgr2=0x7f3d581a6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c00c4e0 tx=0x7f3d4c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 shutdown_connections 2023-10-03T10:15:45.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d5809e410 0x7f3d581a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d5809d6f0 0x7f3d581a5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 --2- 172.21.15.19:0/2079637033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d5809e000 0x7f3d581a6390 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 >> 172.21.15.19:0/2079637033 conn(0x7f3d58066f50 msgr2=0x7f3d581badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 shutdown_connections 2023-10-03T10:15:45.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.741+0000 7f3d60528700 1 -- 172.21.15.19:0/2079637033 wait complete. 2023-10-03T10:15:45.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.754+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde50125aa0 con 0x7fde5009e000 2023-10-03T10:15:45.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.754+0000 7fde377fe700 1 -- 172.21.15.19:0/4251839231 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde50125aa0 con 0x7fde5009e000 2023-10-03T10:15:45.754 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:45.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 msgr2=0x7fde50122a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e8e0 tx=0x7fde4400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 shutdown_connections 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde5009e410 0x7fde50122f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde5009d6f0 0x7fde50122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 --2- 172.21.15.19:0/4251839231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde5009e000 0x7fde50122a40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.756+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 >> 172.21.15.19:0/4251839231 conn(0x7fde50066f50 msgr2=0x7fde500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:45.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.757+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 shutdown_connections 2023-10-03T10:15:45.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:45.757+0000 7fde557f3700 1 -- 172.21.15.19:0/4251839231 wait complete. 2023-10-03T10:15:45.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:46.579 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:46.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 Processor -- start 2023-10-03T10:15:46.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 -- start start 2023-10-03T10:15:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0250130750 0x7f0250130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025009c190 con 0x7f025009d6f0 2023-10-03T10:15:46.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025009b090 con 0x7f0250130750 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f025501c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f025009a6c0 con 0x7f025009e250 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f024f59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f024f59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35014/0 (socket says 172.21.15.19:35014) 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f024f59e700 1 -- 172.21.15.19:0/4268276071 learned_addr learned my addr 172.21.15.19:0/4268276071 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.725+0000 7f024ed9d700 1 --2- 172.21.15.19:0/4268276071 >> v2:172.21.15.19:3300/0 conn(0x7f0250130750 0x7f0250130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024ed9d700 1 -- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 msgr2=0x7f02501384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024ed9d700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024ed9d700 1 -- 172.21.15.19:0/4268276071 >> v1:172.21.15.19:6789/0 conn(0x7f025009d6f0 legacy=0x7f025009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024ed9d700 1 -- 172.21.15.19:0/4268276071 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0250131060 con 0x7f0250130750 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024dd9b700 1 -- 172.21.15.19:0/4268276071 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849825995 0 0) 0x7f025009c190 con 0x7f025009d6f0 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024f59e700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024ed9d700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0250130750 0x7f0250130b20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0240009840 tx=0x7f0240009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1111699dd814b4d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024dd9b700 1 -- 172.21.15.19:0/4268276071 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011830 con 0x7f0250130750 2023-10-03T10:15:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024dd9b700 1 -- 172.21.15.19:0/4268276071 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240011990 con 0x7f0250130750 2023-10-03T10:15:46.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.726+0000 7f024dd9b700 1 -- 172.21.15.19:0/4268276071 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240011d20 con 0x7f0250130750 2023-10-03T10:15:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 -- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0250130750 msgr2=0x7f0250130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0250130750 0x7f0250130b20 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0240009840 tx=0x7f0240009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 -- 172.21.15.19:0/4268276071 shutdown_connections 2023-10-03T10:15:46.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009e250 0x7f02501384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 --2- 172.21.15.19:0/4268276071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0250130750 0x7f0250130b20 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 -- 172.21.15.19:0/4268276071 >> 172.21.15.19:0/4268276071 conn(0x7f025009f470 msgr2=0x7f02500a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 -- 172.21.15.19:0/4268276071 shutdown_connections 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.727+0000 7f025501c700 1 -- 172.21.15.19:0/4268276071 wait complete. 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 Processor -- start 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 -- start start 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 0x7f0250127880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02501296d0 con 0x7f025009e250 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02501284b0 con 0x7f0250130750 2023-10-03T10:15:46.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f025501c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02500a0bf0 con 0x7f025009d6f0 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35024/0 (socket says 172.21.15.19:35024) 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41196/0 (socket says 172.21.15.19:41196) 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024ed9d700 1 -- 172.21.15.19:0/3914614082 learned_addr learned my addr 172.21.15.19:0/3914614082 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.729+0000 7f024f59e700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 0x7f0250127880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 -- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 msgr2=0x7f0250127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 0x7f0250127880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 -- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 msgr2=0x7f0250127340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 -- 172.21.15.19:0/3914614082 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248009b30 con 0x7f025009d6f0 2023-10-03T10:15:46.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024e59c700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024f59e700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 0x7f0250127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f024ed9d700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02400090b0 tx=0x7f0240004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240004300 con 0x7f025009d6f0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024001f070 con 0x7f025009d6f0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02400094a0 con 0x7f025009d6f0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400036a0 con 0x7f025009d6f0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.730+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0250129210 con 0x7f025009d6f0 2023-10-03T10:15:46.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.731+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0240021030 con 0x7f025009d6f0 2023-10-03T10:15:46.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.731+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0240040660 con 0x7f025009d6f0 2023-10-03T10:15:46.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.731+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02500747f0 con 0x7f025009d6f0 2023-10-03T10:15:46.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.737+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0240015020 con 0x7f025009d6f0 2023-10-03T10:15:46.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:46.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:46.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.848+0000 7f1aa9af3700 1 Processor -- start 2023-10-03T10:15:46.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.848+0000 7f1aa9af3700 1 -- start start 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa9af3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa9af3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1aa409e410 0x7f1aa4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa9af3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa409b120 con 0x7f1aa409e000 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa9af3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa406b460 con 0x7f1aa409e410 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa9af3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa409a7e0 con 0x7f1aa409d6f0 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1aa409e410 0x7f1aa4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1aa409e000 0x7f1aa41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52470/0 (socket says 172.21.15.19:52470) 2023-10-03T10:15:46.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa2ffd700 1 -- 172.21.15.19:0/3179924372 learned_addr learned my addr 172.21.15.19:0/3179924372 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:46.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa3fff700 1 -- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409d6f0 msgr2=0x7f1aa409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa3fff700 1 --2- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa3fff700 1 -- 172.21.15.19:0/3179924372 >> v1:172.21.15.19:6789/0 conn(0x7f1aa409e000 legacy=0x7f1aa41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.849+0000 7f1aa3fff700 1 -- 172.21.15.19:0/3179924372 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa409a500 con 0x7f1aa409e410 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.850+0000 7f1aa3fff700 1 --2- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e410 0x7f1aa4134100 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009d90 tx=0x7f1a9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab3d8fee007e5d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.850+0000 7f1aa27fc700 1 -- 172.21.15.19:0/3179924372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00e070 con 0x7f1aa409e410 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.850+0000 7f1aa27fc700 1 -- 172.21.15.19:0/3179924372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00bbd0 con 0x7f1aa409e410 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.850+0000 7f1aa27fc700 1 -- 172.21.15.19:0/3179924372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012430 con 0x7f1aa409e410 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e410 msgr2=0x7f1aa4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e410 0x7f1aa4134100 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009d90 tx=0x7f1a9c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3179924372 shutdown_connections 2023-10-03T10:15:46.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e410 0x7f1aa4134100 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3179924372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409d6f0 0x7f1aa409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3179924372 >> 172.21.15.19:0/3179924372 conn(0x7f1aa4066f50 msgr2=0x7f1aa409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3179924372 shutdown_connections 2023-10-03T10:15:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.851+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3179924372 wait complete. 2023-10-03T10:15:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.852+0000 7f1aa9af3700 1 Processor -- start 2023-10-03T10:15:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.852+0000 7f1aa9af3700 1 -- start start 2023-10-03T10:15:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.852+0000 7f1aa9af3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1aa409d6f0 0x7f1aa41a6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.852+0000 7f1aa9af3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa9af3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 0x7f1aa41a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa9af3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41a8eb0 con 0x7f1aa409e000 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa9af3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41a7520 con 0x7f1aa409e410 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa9af3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa41a9900 con 0x7f1aa409d6f0 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41220/0 (socket says 172.21.15.19:41220) 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 -- 172.21.15.19:0/3128583605 learned_addr learned my addr 172.21.15.19:0/3128583605 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa3fff700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 0x7f1aa41a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 -- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1aa409d6f0 msgr2=0x7f1aa41a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1aa409d6f0 0x7f1aa41a6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 -- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 msgr2=0x7f1aa41a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 0x7f1aa41a6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 -- 172.21.15.19:0/3128583605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c009a70 con 0x7f1aa409e000 2023-10-03T10:15:46.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa3fff700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 0x7f1aa41a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:46.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.853+0000 7f1aa2ffd700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c500 tx=0x7f1a9800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.854+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98005d70 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.854+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a980070d0 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.854+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa41a89f0 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.854+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98007440 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.854+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa409c710 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.855+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a980075a0 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.855+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a9803eac0 con 0x7f1aa409e000 2023-10-03T10:15:46.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.855+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa4074ea0 con 0x7f1aa409e000 2023-10-03T10:15:46.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.860+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a98017020 con 0x7f1aa409e000 2023-10-03T10:15:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.901+0000 7f572e4ac700 1 Processor -- start 2023-10-03T10:15:46.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.901+0000 7f572e4ac700 1 -- start start 2023-10-03T10:15:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572e4ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f5728136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572e4ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728136f50 0x7f5728139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572e4ac700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572809b4f0 con 0x7f5728131810 2023-10-03T10:15:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572e4ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57281313c0 con 0x7f5728136f50 2023-10-03T10:15:46.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572e4ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572806e8c0 con 0x7f5728134630 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f57277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f5728136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f5727fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5728131810 0x7f5728131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52480/0 (socket says 172.21.15.19:52480) 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f5727fff700 1 -- 172.21.15.19:0/3880329255 learned_addr learned my addr 172.21.15.19:0/3880329255 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f572ca49700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728136f50 0x7f5728139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f57277fe700 1 -- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728136f50 msgr2=0x7f5728139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f57277fe700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728136f50 0x7f5728139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.902+0000 7f57277fe700 1 -- 172.21.15.19:0/3880329255 >> v1:172.21.15.19:6789/0 conn(0x7f5728131810 legacy=0x7f5728131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.903+0000 7f57277fe700 1 -- 172.21.15.19:0/3880329255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728071d20 con 0x7f5728134630 2023-10-03T10:15:46.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.903+0000 7f57277fe700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f5728136a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f571c009870 tx=0x7f571c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68370ec14c78b9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.903+0000 7f5726ffd700 1 -- 172.21.15.19:0/3880329255 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c011830 con 0x7f5728134630 2023-10-03T10:15:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.903+0000 7f5726ffd700 1 -- 172.21.15.19:0/3880329255 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c011990 con 0x7f5728134630 2023-10-03T10:15:46.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.903+0000 7f5726ffd700 1 -- 172.21.15.19:0/3880329255 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c011d20 con 0x7f5728134630 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 -- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 msgr2=0x7f5728136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f5728136a10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f571c009870 tx=0x7f571c009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 -- 172.21.15.19:0/3880329255 shutdown_connections 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728136f50 0x7f5728139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 --2- 172.21.15.19:0/3880329255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f5728136a10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 -- 172.21.15.19:0/3880329255 >> 172.21.15.19:0/3880329255 conn(0x7f57280a2aa0 msgr2=0x7f57280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 -- 172.21.15.19:0/3880329255 shutdown_connections 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.904+0000 7f572e4ac700 1 -- 172.21.15.19:0/3880329255 wait complete. 2023-10-03T10:15:46.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.905+0000 7f572e4ac700 1 Processor -- start 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.905+0000 7f572e4ac700 1 -- start start 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f57280704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 0x7f57281c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728130e80 con 0x7f5728136f50 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572812e940 con 0x7f5728131810 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572e4ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f572811e800 con 0x7f5728134630 2023-10-03T10:15:46.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572ca49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 0x7f57281c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33126/0 (socket says 172.21.15.19:33126) 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 -- 172.21.15.19:0/1316425548 learned_addr learned my addr 172.21.15.19:0/1316425548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f572ca49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 0x7f57281c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41234/0 (socket says 172.21.15.19:41234) 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f57277fe700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f57280704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 -- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 msgr2=0x7f57280704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f57280704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 -- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 msgr2=0x7f57281c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 0x7f57281c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.906+0000 7f5727fff700 1 -- 172.21.15.19:0/1316425548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0094a0 con 0x7f5728131810 2023-10-03T10:15:46.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f5727fff700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f571800c520 tx=0x7f571800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718005d70 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57180070d0 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572806faa0 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718007440 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.907+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572811f270 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.908+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57180075a0 con 0x7f5728131810 2023-10-03T10:15:46.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.908+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5728074ea0 con 0x7f5728131810 2023-10-03T10:15:46.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.908+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f571803eb10 con 0x7f5728131810 2023-10-03T10:15:46.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.917+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5718019b40 con 0x7f5728131810 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.949+0000 7f63b26be700 1 Processor -- start 2023-10-03T10:15:46.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.949+0000 7f63b26be700 1 -- start start 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63b26be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63b26be700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f63ac09e000 0x7f63ac1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63b26be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ac09b120 con 0x7f63ac09e410 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63b26be700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ac06b460 con 0x7f63ac09e000 2023-10-03T10:15:46.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63b26be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac09a7e0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33138/0 (socket says 172.21.15.19:33138) 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63abfff700 1 -- 172.21.15.19:0/836436771 learned_addr learned my addr 172.21.15.19:0/836436771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.950+0000 7f63ab7fe700 1 --2- 172.21.15.19:0/836436771 >> v2:172.21.15.19:3300/0 conn(0x7f63ac09e000 0x7f63ac1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63ab7fe700 1 -- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 msgr2=0x7f63ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63ab7fe700 1 --2- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63ab7fe700 1 -- 172.21.15.19:0/836436771 >> v1:172.21.15.19:6789/0 conn(0x7f63ac09e410 legacy=0x7f63ac133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63aaffd700 1 -- 172.21.15.19:0/836436771 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011146636 0 0) 0x7f63ac09b120 con 0x7f63ac09e410 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63ab7fe700 1 -- 172.21.15.19:0/836436771 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac09a500 con 0x7f63ac09e000 2023-10-03T10:15:46.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63ab7fe700 1 --2- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e000 0x7f63ac1339f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009840 tx=0x7f63a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5edc577c2fdcfe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63aaffd700 1 -- 172.21.15.19:0/836436771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011830 con 0x7f63ac09e000 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63aaffd700 1 -- 172.21.15.19:0/836436771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0011990 con 0x7f63ac09e000 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.951+0000 7f63aaffd700 1 -- 172.21.15.19:0/836436771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a0011d20 con 0x7f63ac09e000 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 -- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e000 msgr2=0x7f63ac1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 --2- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e000 0x7f63ac1339f0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009840 tx=0x7f63a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 -- 172.21.15.19:0/836436771 shutdown_connections 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 --2- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 --2- 172.21.15.19:0/836436771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e000 0x7f63ac1339f0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 -- 172.21.15.19:0/836436771 >> 172.21.15.19:0/836436771 conn(0x7f63ac066f50 msgr2=0x7f63ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 -- 172.21.15.19:0/836436771 shutdown_connections 2023-10-03T10:15:46.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.952+0000 7f63b26be700 1 -- 172.21.15.19:0/836436771 wait complete. 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.953+0000 7f63b26be700 1 Processor -- start 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 -- start start 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63ac09e000 0x7f63ac1c5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e410 0x7f63ac1c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac1a8760 con 0x7f63ac09e410 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac1a8b20 con 0x7f63ac09d6f0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63b26be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63ac1a9260 con 0x7f63ac09e000 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.954+0000 7f63abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33148/0 (socket says 172.21.15.19:33148) 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 -- 172.21.15.19:0/3629442246 learned_addr learned my addr 172.21.15.19:0/3629442246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63ab7fe700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63ac09e000 0x7f63ac1c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63b0c5b700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e410 0x7f63ac1c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 -- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63ac09e000 msgr2=0x7f63ac1c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63ac09e000 0x7f63ac1c5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 -- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e410 msgr2=0x7f63ac1c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e410 0x7f63ac1c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 -- 172.21.15.19:0/3629442246 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a00094a0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63abfff700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e910 tx=0x7f639c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c0096a0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c00c850 con 0x7f63ac09d6f0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ac1a9520 con 0x7f63ac09d6f0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.955+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00cc00 con 0x7f63ac09d6f0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.956+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ac1a7ad0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.957+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f639c00cd60 con 0x7f63ac09d6f0 2023-10-03T10:15:46.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.957+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ac074ea0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.957+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f639c047350 con 0x7f63ac09d6f0 2023-10-03T10:15:46.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.959+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0250071f30 con 0x7f025009d6f0 2023-10-03T10:15:46.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.960+0000 7f02377fe700 1 -- 172.21.15.19:0/3914614082 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02400239c0 con 0x7f025009d6f0 2023-10-03T10:15:46.960 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:46.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.962+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 msgr2=0x7f0250126e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:46.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.962+0000 7f025501c700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f02400090b0 tx=0x7f0240004750 comp rx=0 tx=0).stop 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.962+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 shutdown_connections 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0250130750 0x7f0250127880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f025009d6f0 0x7f0250126e00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 --2- 172.21.15.19:0/3914614082 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f025009e250 0x7f0250127340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 >> 172.21.15.19:0/3914614082 conn(0x7f025009f470 msgr2=0x7f0250137b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 shutdown_connections 2023-10-03T10:15:46.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.963+0000 7f025501c700 1 -- 172.21.15.19:0/3914614082 wait complete. 2023-10-03T10:15:46.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:46.966+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f63ac1a7ad0 con 0x7f63ac09d6f0 2023-10-03T10:15:46.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.079+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1aa41a96f0 con 0x7f1aa409e000 2023-10-03T10:15:47.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.080+0000 7f1a8bfff700 1 -- 172.21.15.19:0/3128583605 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a98019d20 con 0x7f1aa409e000 2023-10-03T10:15:47.080 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:47.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 msgr2=0x7f1aa41a65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1a9800c500 tx=0x7f1a9800c810 comp rx=0 tx=0).stop 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 shutdown_connections 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1aa409e410 0x7f1aa41a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1aa409d6f0 0x7f1aa41a6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 --2- 172.21.15.19:0/3128583605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1aa409e000 0x7f1aa41a65b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 >> 172.21.15.19:0/3128583605 conn(0x7f1aa4066f50 msgr2=0x7f1aa41baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 shutdown_connections 2023-10-03T10:15:47.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.082+0000 7f1aa9af3700 1 -- 172.21.15.19:0/3128583605 wait complete. 2023-10-03T10:15:47.096 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.127+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f572806b9e0 con 0x7f5728131810 2023-10-03T10:15:47.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.127+0000 7f5724ff9700 1 -- 172.21.15.19:0/1316425548 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5718017070 con 0x7f5728131810 2023-10-03T10:15:47.127 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 msgr2=0x7f572806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f571800c520 tx=0x7f571800c830 comp rx=0 tx=0).stop 2023-10-03T10:15:47.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 shutdown_connections 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5728136f50 0x7f57281c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5728131810 0x7f572806ff70 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 --2- 172.21.15.19:0/1316425548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5728134630 0x7f57280704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 >> 172.21.15.19:0/1316425548 conn(0x7f57280a2aa0 msgr2=0x7f57281332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 shutdown_connections 2023-10-03T10:15:47.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.130+0000 7f572e4ac700 1 -- 172.21.15.19:0/1316425548 wait complete. 2023-10-03T10:15:47.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:47.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.174+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f63ac1a7ad0 con 0x7f63ac09d6f0 2023-10-03T10:15:47.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.175+0000 7f63a8ff9700 1 -- 172.21.15.19:0/3629442246 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f63ac1a7ad0 con 0x7f63ac09d6f0 2023-10-03T10:15:47.175 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:47.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 msgr2=0x7f63ac1c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:47.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e910 tx=0x7f639c00ecd0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 shutdown_connections 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f63ac09e410 0x7f63ac1c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f63ac09d6f0 0x7f63ac1c50d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 --2- 172.21.15.19:0/3629442246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f63ac09e000 0x7f63ac1c5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 >> 172.21.15.19:0/3629442246 conn(0x7f63ac066f50 msgr2=0x7f63ac1bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 shutdown_connections 2023-10-03T10:15:47.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:47.177+0000 7f63b26be700 1 -- 172.21.15.19:0/3629442246 wait complete. 2023-10-03T10:15:47.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:47.979 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:48.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:48.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 Processor -- start 2023-10-03T10:15:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 -- start start 2023-10-03T10:15:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e809b120 con 0x7f47e809e000 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e806b460 con 0x7f47e809d6f0 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.127+0000 7f47efc9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e809a7e0 con 0x7f47e809e440 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eda36700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35076/0 (socket says 172.21.15.19:35076) 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 -- 172.21.15.19:0/2137049516 learned_addr learned my addr 172.21.15.19:0/2137049516 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eda36700 1 --2- 172.21.15.19:0/2137049516 >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41272/0 (socket says 172.21.15.19:41272) 2023-10-03T10:15:48.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 -- 172.21.15.19:0/2137049516 >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 msgr2=0x7f47e809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 --2- 172.21.15.19:0/2137049516 >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 -- 172.21.15.19:0/2137049516 >> v1:172.21.15.19:6789/0 conn(0x7f47e809e000 legacy=0x7f47e81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 -- 172.21.15.19:0/2137049516 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e809a500 con 0x7f47e809e440 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eca34700 1 -- 172.21.15.19:0/2137049516 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550262126 0 0) 0x7f47e809b120 con 0x7f47e809e000 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eda36700 1 --2- 172.21.15.19:0/2137049516 >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47ee237700 1 --2- 172.21.15.19:0/2137049516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e80 tx=0x7f47e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aef85f02ac6c7ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eca34700 1 -- 172.21.15.19:0/2137049516 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000e070 con 0x7f47e809e440 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eca34700 1 -- 172.21.15.19:0/2137049516 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000b8d0 con 0x7f47e809e440 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.128+0000 7f47eca34700 1 -- 172.21.15.19:0/2137049516 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000bc80 con 0x7f47e809e440 2023-10-03T10:15:48.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 -- 172.21.15.19:0/2137049516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 msgr2=0x7f47e8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 --2- 172.21.15.19:0/2137049516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f47e0009e80 tx=0x7f47e000b330 comp rx=0 tx=0).stop 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 -- 172.21.15.19:0/2137049516 shutdown_connections 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 --2- 172.21.15.19:0/2137049516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e440 0x7f47e8134100 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 --2- 172.21.15.19:0/2137049516 >> v2:172.21.15.19:3300/0 conn(0x7f47e809d6f0 0x7f47e809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 -- 172.21.15.19:0/2137049516 >> 172.21.15.19:0/2137049516 conn(0x7f47e8066f50 msgr2=0x7f47e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 -- 172.21.15.19:0/2137049516 shutdown_connections 2023-10-03T10:15:48.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.129+0000 7f47efc9a700 1 -- 172.21.15.19:0/2137049516 wait complete. 2023-10-03T10:15:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.130+0000 7f47efc9a700 1 Processor -- start 2023-10-03T10:15:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.130+0000 7f47efc9a700 1 -- start start 2023-10-03T10:15:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 0x7f47e81c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47e809e440 0x7f47e81c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81a65d0 con 0x7f47e809d6f0 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81a63e0 con 0x7f47e809e440 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47efc9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80a2bb0 con 0x7f47e809e000 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47eda36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 0x7f47e81c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47eda36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41280/0 (socket says 172.21.15.19:41280) 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47eda36700 1 -- 172.21.15.19:0/3757752754 learned_addr learned my addr 172.21.15.19:0/3757752754 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ee237700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47e809e440 0x7f47e81c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 -- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47e809e440 msgr2=0x7f47e81c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47e809e440 0x7f47e81c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 -- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 msgr2=0x7f47e81c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.131+0000 7f47ed235700 1 -- 172.21.15.19:0/3757752754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e40094a0 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47eda36700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47ed235700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 0x7f47e81c8510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47d800c460 tx=0x7f47d800c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80054e0 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800ce30 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e0009b30 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80038c0 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.132+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e81a8010 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.133+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47d8003a20 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.133+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47d803ea00 con 0x7f47e809e000 2023-10-03T10:15:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.133+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e81a8200 con 0x7f47e809e000 2023-10-03T10:15:48.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.138+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47d8017080 con 0x7f47e809e000 2023-10-03T10:15:48.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:48.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.239+0000 7f15f9357700 1 Processor -- start 2023-10-03T10:15:48.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.239+0000 7f15f9357700 1 -- start start 2023-10-03T10:15:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f9357700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f4133c50 0x7f15f4134020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f9357700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 0x7f15f409d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f9357700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f409a0a0 con 0x7f15f409db40 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f9357700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f409ac60 con 0x7f15f409d1b0 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f9357700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15f409a3f0 con 0x7f15f4133c50 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f15f409db40 0x7f15f413aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52504/0 (socket says 172.21.15.19:52504) 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f37fe700 1 -- 172.21.15.19:0/2711483366 learned_addr learned my addr 172.21.15.19:0/2711483366 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f27fc700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 0x7f15f409d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f1ffb700 1 -- 172.21.15.19:0/2711483366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000445132 0 0) 0x7f15f409a0a0 con 0x7f15f409db40 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f1ffb700 1 -- 172.21.15.19:0/2711483366 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15dc0035b0 con 0x7f15f409db40 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f2ffd700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f4133c50 0x7f15f4134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f27fc700 1 -- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f4133c50 msgr2=0x7f15f4134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f27fc700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f4133c50 0x7f15f4134020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f27fc700 1 -- 172.21.15.19:0/2711483366 >> v1:172.21.15.19:6789/0 conn(0x7f15f409db40 legacy=0x7f15f413aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.240+0000 7f15f27fc700 1 -- 172.21.15.19:0/2711483366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f4133820 con 0x7f15f409d1b0 2023-10-03T10:15:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.241+0000 7f15f27fc700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 0x7f15f409d600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009850 tx=0x7f15e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363a99aa299365b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.241+0000 7f15f1ffb700 1 -- 172.21.15.19:0/2711483366 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e8005e30 con 0x7f15f409d1b0 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.241+0000 7f15f1ffb700 1 -- 172.21.15.19:0/2711483366 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e8006030 con 0x7f15f409d1b0 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.241+0000 7f15f1ffb700 1 -- 172.21.15.19:0/2711483366 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e80063e0 con 0x7f15f409d1b0 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 -- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 msgr2=0x7f15f409d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 0x7f15f409d600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15e8009850 tx=0x7f15e8009b60 comp rx=0 tx=0).stop 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 -- 172.21.15.19:0/2711483366 shutdown_connections 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f4133c50 0x7f15f4134020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 --2- 172.21.15.19:0/2711483366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409d1b0 0x7f15f409d600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 -- 172.21.15.19:0/2711483366 >> 172.21.15.19:0/2711483366 conn(0x7f15f40a25a0 msgr2=0x7f15f40a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 -- 172.21.15.19:0/2711483366 shutdown_connections 2023-10-03T10:15:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.242+0000 7f15f9357700 1 -- 172.21.15.19:0/2711483366 wait complete. 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.243+0000 7f15f9357700 1 Processor -- start 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.243+0000 7f15f9357700 1 -- start start 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 0x7f15f41d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 0x7f15f41d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 0x7f15f41d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41d50d0 con 0x7f15f4133c50 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f409c320 con 0x7f15f409db40 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f9357700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15f412cfa0 con 0x7f15f409d1b0 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 0x7f15f41d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 0x7f15f41d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35116/0 (socket says 172.21.15.19:35116) 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f2ffd700 1 -- 172.21.15.19:0/222620943 learned_addr learned my addr 172.21.15.19:0/222620943 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f27fc700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 0x7f15f41d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.244+0000 7f15f37fe700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 0x7f15f41d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 -- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 msgr2=0x7f15f41d52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 0x7f15f41d52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 -- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 msgr2=0x7f15f41d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 0x7f15f41d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 -- 172.21.15.19:0/222620943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8009430 con 0x7f15f4133c50 2023-10-03T10:15:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f27fc700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 0x7f15f41d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f37fe700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 0x7f15f41d17a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00ca80 tx=0x7f15ec00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00a9e0 con 0x7f15f4133c50 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f412c7f0 con 0x7f15f4133c50 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.245+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec00ab40 con 0x7f15f4133c50 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.246+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec012400 con 0x7f15f4133c50 2023-10-03T10:15:48.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.246+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f412b630 con 0x7f15f4133c50 2023-10-03T10:15:48.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.247+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f406ca70 con 0x7f15f4133c50 2023-10-03T10:15:48.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.247+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f15ec01b3b0 con 0x7f15f4133c50 2023-10-03T10:15:48.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.248+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f15ec03f7c0 con 0x7f15f4133c50 2023-10-03T10:15:48.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.252+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f15ec0192c0 con 0x7f15f4133c50 2023-10-03T10:15:48.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.289+0000 7fe487da3700 1 Processor -- start 2023-10-03T10:15:48.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 -- start start 2023-10-03T10:15:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe48009e7e0 0x7fe48009ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe48006bd70 con 0x7fe480137ff0 2023-10-03T10:15:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe48006cc30 con 0x7fe48009e7e0 2023-10-03T10:15:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.290+0000 7fe487da3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe48006d870 con 0x7fe48009f0f0 2023-10-03T10:15:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe485b3f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe48009e7e0 0x7fe48009ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe486340700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe480137ff0 0x7fe48013a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52520/0 (socket says 172.21.15.19:52520) 2023-10-03T10:15:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe486340700 1 -- 172.21.15.19:0/1782161889 learned_addr learned my addr 172.21.15.19:0/1782161889 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 --2- 172.21.15.19:0/1782161889 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe484b3d700 1 -- 172.21.15.19:0/1782161889 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846919381 0 0) 0x7fe48006bd70 con 0x7fe480137ff0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 -- 172.21.15.19:0/1782161889 >> v2:172.21.15.19:3300/0 conn(0x7fe48009e7e0 msgr2=0x7fe48009ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 --2- 172.21.15.19:0/1782161889 >> v2:172.21.15.19:3300/0 conn(0x7fe48009e7e0 0x7fe48009ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 -- 172.21.15.19:0/1782161889 >> v1:172.21.15.19:6789/0 conn(0x7fe480137ff0 legacy=0x7fe48013a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 -- 172.21.15.19:0/1782161889 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48006bab0 con 0x7fe48009f0f0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe48533e700 1 --2- 172.21.15.19:0/1782161889 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480137ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe470009840 tx=0x7fe470009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=433f750069381d93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.291+0000 7fe484b3d700 1 -- 172.21.15.19:0/1782161889 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470011830 con 0x7fe48009f0f0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe484b3d700 1 -- 172.21.15.19:0/1782161889 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470011990 con 0x7fe48009f0f0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe484b3d700 1 -- 172.21.15.19:0/1782161889 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470011d20 con 0x7fe48009f0f0 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 -- 172.21.15.19:0/1782161889 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 msgr2=0x7fe480137ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 --2- 172.21.15.19:0/1782161889 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480137ab0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe470009840 tx=0x7fe470009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 -- 172.21.15.19:0/1782161889 shutdown_connections 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 --2- 172.21.15.19:0/1782161889 >> v2:172.21.15.19:3300/0 conn(0x7fe48009e7e0 0x7fe48009ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 --2- 172.21.15.19:0/1782161889 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480137ab0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 -- 172.21.15.19:0/1782161889 >> 172.21.15.19:0/1782161889 conn(0x7fe4800a4300 msgr2=0x7fe4800a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.292+0000 7fe487da3700 1 -- 172.21.15.19:0/1782161889 shutdown_connections 2023-10-03T10:15:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.293+0000 7fe487da3700 1 -- 172.21.15.19:0/1782161889 wait complete. 2023-10-03T10:15:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.294+0000 7fe487da3700 1 Processor -- start 2023-10-03T10:15:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.294+0000 7fe487da3700 1 -- start start 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 0x7fe480122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe480137ff0 0x7fe480123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801372b0 con 0x7fe48009e7e0 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801244b0 con 0x7fe480137ff0 2023-10-03T10:15:48.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe487da3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800a05d0 con 0x7fe48009f0f0 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe485b3f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 0x7fe480122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe485b3f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 0x7fe480122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41314/0 (socket says 172.21.15.19:41314) 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe485b3f700 1 -- 172.21.15.19:0/1686850168 learned_addr learned my addr 172.21.15.19:0/1686850168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe486340700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe480137ff0 0x7fe480123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 -- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe480137ff0 msgr2=0x7fe480123280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe480137ff0 0x7fe480123280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 -- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 msgr2=0x7fe480122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 0x7fe480122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.295+0000 7fe48533e700 1 -- 172.21.15.19:0/1686850168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4700094a0 con 0x7fe48009f0f0 2023-10-03T10:15:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe48533e700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480122d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe470016000 tx=0x7fe470004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700036a0 con 0x7fe48009f0f0 2023-10-03T10:15:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47001f070 con 0x7fe48009f0f0 2023-10-03T10:15:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480137770 con 0x7fe48009f0f0 2023-10-03T10:15:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470003a60 con 0x7fe48009f0f0 2023-10-03T10:15:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.296+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480125a90 con 0x7fe48009f0f0 2023-10-03T10:15:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.297+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe470003bc0 con 0x7fe48009f0f0 2023-10-03T10:15:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.297+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe470021070 con 0x7fe48009f0f0 2023-10-03T10:15:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.297+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48004f2a0 con 0x7fe48009f0f0 2023-10-03T10:15:48.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.302+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe470015070 con 0x7fe48009f0f0 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 Processor -- start 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 -- start start 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbaec09e930 0x7fbaec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 0x7fbaec131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaec070940 con 0x7fbaec09e930 2023-10-03T10:15:48.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec06fd60 con 0x7fbaec09f650 2023-10-03T10:15:48.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaf1dce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec06fa80 con 0x7fbaec09f240 2023-10-03T10:15:48.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaeaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35154/0 (socket says 172.21.15.19:35154) 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaeaffd700 1 -- 172.21.15.19:0/426080879 learned_addr learned my addr 172.21.15.19:0/426080879 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaeb7fe700 1 --2- 172.21.15.19:0/426080879 >> v2:172.21.15.19:3300/0 conn(0x7fbaec09e930 0x7fbaec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.341+0000 7fbaebfff700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 0x7fbaec131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 -- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 msgr2=0x7fbaec131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 0x7fbaec131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 -- 172.21.15.19:0/426080879 >> v2:172.21.15.19:3300/0 conn(0x7fbaec09e930 msgr2=0x7fbaec09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 --2- 172.21.15.19:0/426080879 >> v2:172.21.15.19:3300/0 conn(0x7fbaec09e930 0x7fbaec09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 -- 172.21.15.19:0/426080879 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec09fb60 con 0x7fbaec09f240 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaebfff700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 0x7fbaec131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaeaffd700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbae0013db0 tx=0x7fbae0009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a04b9897050612e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaea7fc700 1 -- 172.21.15.19:0/426080879 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0012ae0 con 0x7fbaec09f240 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaea7fc700 1 -- 172.21.15.19:0/426080879 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0012c40 con 0x7fbaec09f240 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.342+0000 7fbaea7fc700 1 -- 172.21.15.19:0/426080879 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0013050 con 0x7fbaec09f240 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 -- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 msgr2=0x7fbaec1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fbae0013db0 tx=0x7fbae0009710 comp rx=0 tx=0).stop 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 -- 172.21.15.19:0/426080879 shutdown_connections 2023-10-03T10:15:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f650 0x7fbaec131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/426080879 >> v2:172.21.15.19:3300/0 conn(0x7fbaec09e930 0x7fbaec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/426080879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f240 0x7fbaec1317f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 -- 172.21.15.19:0/426080879 >> 172.21.15.19:0/426080879 conn(0x7fbaec0a4210 msgr2=0x7fbaec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 -- 172.21.15.19:0/426080879 shutdown_connections 2023-10-03T10:15:48.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.343+0000 7fbaf1dce700 1 -- 172.21.15.19:0/426080879 wait complete. 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.344+0000 7fbaf1dce700 1 Processor -- start 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.344+0000 7fbaf1dce700 1 -- start start 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 0x7fbaec11d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f240 0x7fbaec11d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec11f750 con 0x7fbaec09e930 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec11f430 con 0x7fbaec09f240 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaf1dce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbaec0a2fd0 con 0x7fbaec09f650 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35170/0 (socket says 172.21.15.19:35170) 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaebfff700 1 -- 172.21.15.19:0/2367241343 learned_addr learned my addr 172.21.15.19:0/2367241343 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.345+0000 7fbaeaffd700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f240 0x7fbaec11d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaeb7fe700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 0x7fbaec11d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 -- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f240 msgr2=0x7fbaec11d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f240 0x7fbaec11d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 -- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 msgr2=0x7fbaec11d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 0x7fbaec11d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 -- 172.21.15.19:0/2367241343 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae4009a70 con 0x7fbaec09f650 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaeb7fe700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 0x7fbaec11d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaebfff700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbae400efc0 tx=0x7fbae400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4009d70 con 0x7fbaec09f650 2023-10-03T10:15:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae400f040 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae0013a10 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae400ce00 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.346+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaec0a0190 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.347+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaec120700 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.348+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbae4014480 con 0x7fbaec09f650 2023-10-03T10:15:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.348+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbae4041890 con 0x7fbaec09f650 2023-10-03T10:15:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.353+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbae4045060 con 0x7fbaec09f650 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.368+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47e809f420 con 0x7f47e809e000 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.368+0000 7f47de7fc700 1 -- 172.21.15.19:0/3757752754 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47d8019b20 con 0x7f47e809e000 2023-10-03T10:15:48.368 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 msgr2=0x7f47e81c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 0x7f47e81c8510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f47d800c460 tx=0x7f47d800c770 comp rx=0 tx=0).stop 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 shutdown_connections 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47e809e440 0x7f47e81c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47e809d6f0 0x7f47e81c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 --2- 172.21.15.19:0/3757752754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47e809e000 0x7f47e81c8510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 >> 172.21.15.19:0/3757752754 conn(0x7f47e8066f50 msgr2=0x7f47e80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 shutdown_connections 2023-10-03T10:15:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.372+0000 7f47efc9a700 1 -- 172.21.15.19:0/3757752754 wait complete. 2023-10-03T10:15:48.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.484+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f15f40747f0 con 0x7f15f4133c50 2023-10-03T10:15:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.484+0000 7f15db7fe700 1 -- 172.21.15.19:0/222620943 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f15ec017070 con 0x7f15f4133c50 2023-10-03T10:15:48.484 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 msgr2=0x7f15f41d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 0x7f15f41d17a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00ca80 tx=0x7f15ec00cd90 comp rx=0 tx=0).stop 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 shutdown_connections 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15f4133c50 0x7f15f41d17a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15f409d1b0 0x7f15f41d52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 --2- 172.21.15.19:0/222620943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f15f409db40 0x7f15f41d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 >> 172.21.15.19:0/222620943 conn(0x7f15f40a25a0 msgr2=0x7f15f4132140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 shutdown_connections 2023-10-03T10:15:48.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.486+0000 7f15f9357700 1 -- 172.21.15.19:0/222620943 wait complete. 2023-10-03T10:15:48.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:48.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.531+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe480125f60 con 0x7fe48009f0f0 2023-10-03T10:15:48.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.532+0000 7fe4767fc700 1 -- 172.21.15.19:0/1686850168 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe470015020 con 0x7fe48009f0f0 2023-10-03T10:15:48.532 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 msgr2=0x7fe480122d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480122d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe470016000 tx=0x7fe470004750 comp rx=0 tx=0).stop 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 shutdown_connections 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe480137ff0 0x7fe480123280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe48009e7e0 0x7fe480122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 --2- 172.21.15.19:0/1686850168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe48009f0f0 0x7fe480122d40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 >> 172.21.15.19:0/1686850168 conn(0x7fe4800a4300 msgr2=0x7fe480070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 shutdown_connections 2023-10-03T10:15:48.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.534+0000 7fe487da3700 1 -- 172.21.15.19:0/1686850168 wait complete. 2023-10-03T10:15:48.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:48.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.563+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbaec120ec0 con 0x7fbaec09f650 2023-10-03T10:15:48.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.563+0000 7fbad3fff700 1 -- 172.21.15.19:0/2367241343 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbae4045020 con 0x7fbaec09f650 2023-10-03T10:15:48.563 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 msgr2=0x7fbaec11de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbae400efc0 tx=0x7fbae400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 shutdown_connections 2023-10-03T10:15:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbaec09f650 0x7fbaec11de20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbaec09e930 0x7fbaec11d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 --2- 172.21.15.19:0/2367241343 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbaec09f240 0x7fbaec11d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 >> 172.21.15.19:0/2367241343 conn(0x7fbaec0a4210 msgr2=0x7fbaec0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 shutdown_connections 2023-10-03T10:15:48.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:48.565+0000 7fbaf1dce700 1 -- 172.21.15.19:0/2367241343 wait complete. 2023-10-03T10:15:48.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:49.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:49.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.533+0000 7f58f7079700 1 Processor -- start 2023-10-03T10:15:49.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.533+0000 7f58f7079700 1 -- start start 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f7079700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 0x7f58f006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f7079700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f7079700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f009ece0 con 0x7f58f006b080 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f7079700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f009e760 con 0x7f58f006a770 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f7079700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f009e040 con 0x7f58f0131d10 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f5616700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58f4e15700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 0x7f58f006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58e7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f58f006b080 0x7f58f0131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52532/0 (socket says 172.21.15.19:52532) 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.534+0000 7f58e7fff700 1 -- 172.21.15.19:0/1388196183 learned_addr learned my addr 172.21.15.19:0/1388196183 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58e77fe700 1 -- 172.21.15.19:0/1388196183 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566860232 0 0) 0x7f58f009ece0 con 0x7f58f006b080 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f5616700 1 -- 172.21.15.19:0/1388196183 >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 msgr2=0x7f58f006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f5616700 1 --2- 172.21.15.19:0/1388196183 >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 0x7f58f006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f5616700 1 -- 172.21.15.19:0/1388196183 >> v1:172.21.15.19:6789/0 conn(0x7f58f006b080 legacy=0x7f58f0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f5616700 1 -- 172.21.15.19:0/1388196183 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f009f630 con 0x7f58f0131d10 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f4e15700 1 --2- 172.21.15.19:0/1388196183 >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 0x7f58f006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58f5616700 1 --2- 172.21.15.19:0/1388196183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0139860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009d90 tx=0x7f58e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ef2b90466d89343 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58e77fe700 1 -- 172.21.15.19:0/1388196183 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800e070 con 0x7f58f0131d10 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58e77fe700 1 -- 172.21.15.19:0/1388196183 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800bb20 con 0x7f58f0131d10 2023-10-03T10:15:49.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.535+0000 7f58e77fe700 1 -- 172.21.15.19:0/1388196183 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8012430 con 0x7f58f0131d10 2023-10-03T10:15:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 -- 172.21.15.19:0/1388196183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 msgr2=0x7f58f0139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 --2- 172.21.15.19:0/1388196183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0139860 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009d90 tx=0x7f58e800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 -- 172.21.15.19:0/1388196183 shutdown_connections 2023-10-03T10:15:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 --2- 172.21.15.19:0/1388196183 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0139860 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 --2- 172.21.15.19:0/1388196183 >> v2:172.21.15.19:3300/0 conn(0x7f58f006a770 0x7f58f006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 -- 172.21.15.19:0/1388196183 >> 172.21.15.19:0/1388196183 conn(0x7f58f0066f50 msgr2=0x7f58f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 -- 172.21.15.19:0/1388196183 shutdown_connections 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.536+0000 7f58f7079700 1 -- 172.21.15.19:0/1388196183 wait complete. 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.537+0000 7f58f7079700 1 Processor -- start 2023-10-03T10:15:49.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.537+0000 7f58f7079700 1 -- start start 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58f006a770 0x7f58f0120480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 0x7f58f01209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f0131360 con 0x7f58f006a770 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f0123920 con 0x7f58f0131d10 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f7079700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58f01220c0 con 0x7f58f006b080 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f5616700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58e7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 0x7f58f01209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f5616700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33216/0 (socket says 172.21.15.19:33216) 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f5616700 1 -- 172.21.15.19:0/3370641127 learned_addr learned my addr 172.21.15.19:0/3370641127 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.538+0000 7f58f4e15700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58f006a770 0x7f58f0120480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 -- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 msgr2=0x7f58f01209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 0x7f58f01209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 -- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58f006a770 msgr2=0x7f58f0120480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58f006a770 0x7f58f0120480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 -- 172.21.15.19:0/3370641127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec0094a0 con 0x7f58f0131d10 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58e7fff700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 0x7f58f01209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f5616700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58f009e180 tx=0x7f58e8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8012430 con 0x7f58f0131d10 2023-10-03T10:15:49.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8020070 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e8009a70 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8004280 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.539+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f0124650 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.540+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58e80043e0 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.540+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f58e8022070 con 0x7f58f0131d10 2023-10-03T10:15:49.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.541+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f0074ea0 con 0x7f58f0131d10 2023-10-03T10:15:49.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.546+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f58e801b400 con 0x7f58f0131d10 2023-10-03T10:15:49.548 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:49.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.650+0000 7fe8c5a2d700 1 Processor -- start 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.650+0000 7fe8c5a2d700 1 -- start start 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8c5a2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c00a0a30 0x7fe8c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8c5a2d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c0138d80 0x7fe8c013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8c5a2d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c00a2a70 con 0x7fe8c009d630 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8c5a2d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c00a01d0 con 0x7fe8c0138d80 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8c5a2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c009e2b0 con 0x7fe8c00a0a30 2023-10-03T10:15:49.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c0138d80 0x7fe8c013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8be7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8c009d630 0x7fe8c00a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52534/0 (socket says 172.21.15.19:52534) 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c0138d80 0x7fe8c013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41370/0 (socket says 172.21.15.19:41370) 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8be7fc700 1 -- 172.21.15.19:0/1160099335 learned_addr learned my addr 172.21.15.19:0/1160099335 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8beffd700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c00a0a30 0x7fe8c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 -- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c00a0a30 msgr2=0x7fe8c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c00a0a30 0x7fe8c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 -- 172.21.15.19:0/1160099335 >> v1:172.21.15.19:6789/0 conn(0x7fe8c009d630 legacy=0x7fe8c00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.651+0000 7fe8bf7fe700 1 -- 172.21.15.19:0/1160099335 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c009dc50 con 0x7fe8c0138d80 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.652+0000 7fe8bf7fe700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c013b160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009d90 tx=0x7fe8b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967f8a72c4b94429 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.652+0000 7fe8bdffb700 1 -- 172.21.15.19:0/1160099335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b800e070 con 0x7fe8c0138d80 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.652+0000 7fe8bdffb700 1 -- 172.21.15.19:0/1160099335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b800bb20 con 0x7fe8c0138d80 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.652+0000 7fe8bdffb700 1 -- 172.21.15.19:0/1160099335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8012430 con 0x7fe8c0138d80 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 msgr2=0x7fe8c013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c013b160 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009d90 tx=0x7fe8b800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1160099335 shutdown_connections 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c013b160 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1160099335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c00a0a30 0x7fe8c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1160099335 >> 172.21.15.19:0/1160099335 conn(0x7fe8c00a3050 msgr2=0x7fe8c00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1160099335 shutdown_connections 2023-10-03T10:15:49.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.653+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1160099335 wait complete. 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.654+0000 7fe8c5a2d700 1 Processor -- start 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.655+0000 7fe8c5a2d700 1 -- start start 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c00a0a30 0x7fe8c011f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c01c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c0121a20 con 0x7fe8c0138d80 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c011f0a0 con 0x7fe8c009d630 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8c5a2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00a0410 con 0x7fe8c00a0a30 2023-10-03T10:15:49.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33242/0 (socket says 172.21.15.19:33242) 2023-10-03T10:15:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 -- 172.21.15.19:0/1363740617 learned_addr learned my addr 172.21.15.19:0/1363740617 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8be7fc700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c00a0a30 0x7fe8c011f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8bf7fe700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c01c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 -- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c00a0a30 msgr2=0x7fe8c011f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c00a0a30 0x7fe8c011f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 -- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 msgr2=0x7fe8c01c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c01c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8beffd700 1 -- 172.21.15.19:0/1363740617 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8009a70 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.656+0000 7fe8bf7fe700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c01c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8beffd700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0017100 tx=0x7fe8b0017410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0013c80 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0019040 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b001f600 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c01220d0 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.657+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c0122e00 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.658+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8b001f760 con 0x7fe8c009d630 2023-10-03T10:15:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.658+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c00a4720 con 0x7fe8c009d630 2023-10-03T10:15:49.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.658+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8b0047930 con 0x7fe8c009d630 2023-10-03T10:15:49.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.667+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8b001d8d0 con 0x7fe8c009d630 2023-10-03T10:15:49.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.695+0000 7feb609d7700 1 Processor -- start 2023-10-03T10:15:49.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.695+0000 7feb609d7700 1 -- start start 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09d6f0 0x7feb5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb5c09e000 0x7feb5c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5c06b460 con 0x7feb5c09e000 2023-10-03T10:15:49.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c09b120 con 0x7feb5c09e410 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb609d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c09a7e0 con 0x7feb5c09d6f0 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb59d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb5c09e000 0x7feb5c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb5ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb59d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb5c09e000 0x7feb5c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41396/0 (socket says 172.21.15.19:41396) 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb59d9b700 1 -- 172.21.15.19:0/4029502160 learned_addr learned my addr 172.21.15.19:0/4029502160 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:49.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.696+0000 7feb5a59c700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09d6f0 0x7feb5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 -- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09d6f0 msgr2=0x7feb5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09d6f0 0x7feb5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 -- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 msgr2=0x7feb5c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 -- 172.21.15.19:0/4029502160 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c09a500 con 0x7feb5c09e000 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb59d9b700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09e000 0x7feb5c1339f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7feb500098f0 tx=0x7feb50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c3c27c171bdee3c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb5959a700 1 -- 172.21.15.19:0/4029502160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50011830 con 0x7feb5c09e000 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb5959a700 1 -- 172.21.15.19:0/4029502160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb50011990 con 0x7feb5c09e000 2023-10-03T10:15:49.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.697+0000 7feb5959a700 1 -- 172.21.15.19:0/4029502160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb50011d00 con 0x7feb5c09e000 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 -- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09e000 msgr2=0x7feb5c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09e000 0x7feb5c1339f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7feb500098f0 tx=0x7feb50009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 -- 172.21.15.19:0/4029502160 shutdown_connections 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09d6f0 0x7feb5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 --2- 172.21.15.19:0/4029502160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09e000 0x7feb5c1339f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 -- 172.21.15.19:0/4029502160 >> 172.21.15.19:0/4029502160 conn(0x7feb5c066f50 msgr2=0x7feb5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 -- 172.21.15.19:0/4029502160 shutdown_connections 2023-10-03T10:15:49.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.698+0000 7feb609d7700 1 -- 172.21.15.19:0/4029502160 wait complete. 2023-10-03T10:15:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.699+0000 7feb609d7700 1 Processor -- start 2023-10-03T10:15:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.699+0000 7feb609d7700 1 -- start start 2023-10-03T10:15:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09d6f0 0x7feb5c1a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09e000 0x7feb5c1a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c1a8890 con 0x7feb5c09d6f0 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c1a9a40 con 0x7feb5c09e410 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb609d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0a1eb0 con 0x7feb5c09e000 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09d6f0 0x7feb5c1a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33264/0 (socket says 172.21.15.19:33264) 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 -- 172.21.15.19:0/1868227124 learned_addr learned my addr 172.21.15.19:0/1868227124 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb59d9b700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09e000 0x7feb5c1a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 -- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09e000 msgr2=0x7feb5c1a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09e000 0x7feb5c1a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 -- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09d6f0 msgr2=0x7feb5c1a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09d6f0 0x7feb5c1a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.700+0000 7feb5ad9d700 1 -- 172.21.15.19:0/1868227124 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb50009550 con 0x7feb5c09e410 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb5ad9d700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb54009dd0 tx=0x7feb5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54009c40 con 0x7feb5c09e410 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400f040 con 0x7feb5c09e410 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400ceb0 con 0x7feb5c09e410 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c09c710 con 0x7feb5c09e410 2023-10-03T10:15:49.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.701+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c1a9760 con 0x7feb5c09e410 2023-10-03T10:15:49.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.702+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb54014480 con 0x7feb5c09e410 2023-10-03T10:15:49.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.702+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c1a9400 con 0x7feb5c09e410 2023-10-03T10:15:49.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.705+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb54012740 con 0x7feb5c09e410 2023-10-03T10:15:49.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.711+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb5c1a9400 con 0x7feb5c09e410 2023-10-03T10:15:49.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 Processor -- start 2023-10-03T10:15:49.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 -- start start 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac0a2a70 con 0x7f4dac09d630 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac0a01d0 con 0x7f4dac0a0a30 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.742+0000 7f4db4564700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac09e2b0 con 0x7f4dac138d80 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db1aff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4dac09d630 0x7f4dac0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52542/0 (socket says 172.21.15.19:52542) 2023-10-03T10:15:49.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db1aff700 1 -- 172.21.15.19:0/10414876 learned_addr learned my addr 172.21.15.19:0/10414876 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2b01700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db12fe700 1 -- 172.21.15.19:0/10414876 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622090019 0 0) 0x7f4dac0a2a70 con 0x7f4dac09d630 2023-10-03T10:15:49.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db12fe700 1 -- 172.21.15.19:0/10414876 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d980035b0 con 0x7f4dac09d630 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 -- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 msgr2=0x7f4dac13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 -- 172.21.15.19:0/10414876 >> v1:172.21.15.19:6789/0 conn(0x7f4dac09d630 legacy=0x7f4dac0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 -- 172.21.15.19:0/10414876 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac09dc50 con 0x7f4dac0a0a30 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.743+0000 7f4db2300700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac0a0e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009870 tx=0x7f4da8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5b14bd4bf4beef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db12fe700 1 -- 172.21.15.19:0/10414876 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8011830 con 0x7f4dac0a0a30 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db12fe700 1 -- 172.21.15.19:0/10414876 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8011990 con 0x7f4dac0a0a30 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db12fe700 1 -- 172.21.15.19:0/10414876 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8011d20 con 0x7f4dac0a0a30 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 -- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 msgr2=0x7f4dac0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac0a0e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009870 tx=0x7f4da8009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 -- 172.21.15.19:0/10414876 shutdown_connections 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 --2- 172.21.15.19:0/10414876 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac0a0e00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.744+0000 7f4db4564700 1 -- 172.21.15.19:0/10414876 >> 172.21.15.19:0/10414876 conn(0x7f4dac0a3050 msgr2=0x7f4dac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.745+0000 7f4db4564700 1 -- 172.21.15.19:0/10414876 shutdown_connections 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.745+0000 7f4db4564700 1 -- 172.21.15.19:0/10414876 wait complete. 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 Processor -- start 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 -- start start 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac1341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac134c20 con 0x7f4dac09d630 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac136590 con 0x7f4dac0a0a30 2023-10-03T10:15:49.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db4564700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac136f00 con 0x7f4dac138d80 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db1aff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db2300700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db1aff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33282/0 (socket says 172.21.15.19:33282) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db2300700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41406/0 (socket says 172.21.15.19:41406) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.746+0000 7f4db1aff700 1 -- 172.21.15.19:0/1960077331 learned_addr learned my addr 172.21.15.19:0/1960077331 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2b01700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac1341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 -- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 msgr2=0x7f4dac1341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac1341d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 -- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 msgr2=0x7f4dac133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 -- 172.21.15.19:0/1960077331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80094a0 con 0x7f4dac09d630 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2b01700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db1aff700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db2300700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4da8016000 tx=0x7f4da8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8004300 con 0x7f4dac09d630 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da801f070 con 0x7f4dac09d630 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80036a0 con 0x7f4dac09d630 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac0a4ab0 con 0x7f4dac09d630 2023-10-03T10:15:49.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.747+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac1371e0 con 0x7f4dac09d630 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.748+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac0747f0 con 0x7f4dac09d630 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.749+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4da8021030 con 0x7f4dac09d630 2023-10-03T10:15:49.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.749+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4da8040c60 con 0x7f4dac09d630 2023-10-03T10:15:49.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.758+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4da80239c0 con 0x7f4dac09d630 2023-10-03T10:15:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.793+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f58f006c360 con 0x7f58f0131d10 2023-10-03T10:15:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.793+0000 7f58e57fa700 1 -- 172.21.15.19:0/3370641127 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f58e801a7f0 con 0x7f58f0131d10 2023-10-03T10:15:49.793 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 msgr2=0x7f58f0120f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f58f009e180 tx=0x7f58e8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 shutdown_connections 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f58f0131d10 0x7f58f0120f00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f58f006a770 0x7f58f0120480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 --2- 172.21.15.19:0/3370641127 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f58f006b080 0x7f58f01209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 >> 172.21.15.19:0/3370641127 conn(0x7f58f0066f50 msgr2=0x7f58f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 shutdown_connections 2023-10-03T10:15:49.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.796+0000 7f58f7079700 1 -- 172.21.15.19:0/3370641127 wait complete. 2023-10-03T10:15:49.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.883+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8c00747f0 con 0x7fe8c009d630 2023-10-03T10:15:49.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.883+0000 7fe8a7fff700 1 -- 172.21.15.19:0/1363740617 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8b0024030 con 0x7fe8c009d630 2023-10-03T10:15:49.883 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 msgr2=0x7fe8c011f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0017100 tx=0x7fe8b0017410 comp rx=0 tx=0).stop 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 shutdown_connections 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c0138d80 0x7fe8c01c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c009d630 0x7fe8c011f4b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 --2- 172.21.15.19:0/1363740617 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c00a0a30 0x7fe8c011f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 >> 172.21.15.19:0/1363740617 conn(0x7fe8c00a3050 msgr2=0x7fe8c00710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 shutdown_connections 2023-10-03T10:15:49.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.886+0000 7fe8c5a2d700 1 -- 172.21.15.19:0/1363740617 wait complete. 2023-10-03T10:15:49.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:49.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.927+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feb5c1a9400 con 0x7feb5c09e410 2023-10-03T10:15:49.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.927+0000 7feb4affd700 1 -- 172.21.15.19:0/1868227124 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb5c1a9400 con 0x7feb5c09e410 2023-10-03T10:15:49.927 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:49.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 msgr2=0x7feb5c1a6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb54009dd0 tx=0x7feb5400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 shutdown_connections 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb5c09e410 0x7feb5c1a6a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb5c09d6f0 0x7feb5c1a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 --2- 172.21.15.19:0/1868227124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb5c09e000 0x7feb5c1a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 >> 172.21.15.19:0/1868227124 conn(0x7feb5c066f50 msgr2=0x7feb5c1bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.929+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 shutdown_connections 2023-10-03T10:15:49.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.930+0000 7feb609d7700 1 -- 172.21.15.19:0/1868227124 wait complete. 2023-10-03T10:15:49.943 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:49.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.980+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4dac072980 con 0x7f4dac09d630 2023-10-03T10:15:49.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.981+0000 7f4da2ffd700 1 -- 172.21.15.19:0/1960077331 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4da8015030 con 0x7f4dac09d630 2023-10-03T10:15:49.981 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 msgr2=0x7f4dac133750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4da8016000 tx=0x7f4da8004750 comp rx=0 tx=0).stop 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 shutdown_connections 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4dac138d80 0x7f4dac1341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4dac09d630 0x7f4dac133750 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 --2- 172.21.15.19:0/1960077331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4dac0a0a30 0x7f4dac133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 >> 172.21.15.19:0/1960077331 conn(0x7f4dac0a3050 msgr2=0x7f4dac09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:49.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 shutdown_connections 2023-10-03T10:15:49.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:49.983+0000 7f4db4564700 1 -- 172.21.15.19:0/1960077331 wait complete. 2023-10-03T10:15:49.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:50.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:50.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:50.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:50.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.960+0000 7f3d80cd1700 1 Processor -- start 2023-10-03T10:15:50.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.960+0000 7f3d80cd1700 1 -- start start 2023-10-03T10:15:50.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 0x7f3d7c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d7c09a3b0 0x7f3d7c138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c09b580 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c1313c0 con 0x7f3d7c131810 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d80cd1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c06e8c0 con 0x7f3d7c099a40 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d7c09a3b0 0x7f3d7c138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d7c09a3b0 0x7f3d7c138650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41420/0 (socket says 172.21.15.19:41420) 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d79d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 0x7f3d7c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/1922391684 learned_addr learned my addr 172.21.15.19:0/1922391684 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7a59c700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 msgr2=0x7f3d7c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 0x7f3d7c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 msgr2=0x7f3d7c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/1922391684 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c09a820 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.961+0000 7f3d79d9b700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 0x7f3d7c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.962+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c09a3b0 0x7f3d7c138650 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac8732290df814 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.962+0000 7f3d7959a700 1 -- 172.21.15.19:0/1922391684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400e070 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.962+0000 7f3d7959a700 1 -- 172.21.15.19:0/1922391684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7400b910 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.962+0000 7f3d7959a700 1 -- 172.21.15.19:0/1922391684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400bcc0 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 -- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c09a3b0 msgr2=0x7f3d7c138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c09a3b0 0x7f3d7c138650 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 -- 172.21.15.19:0/1922391684 shutdown_connections 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c09a3b0 0x7f3d7c138650 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/1922391684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c099a40 0x7f3d7c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 -- 172.21.15.19:0/1922391684 >> 172.21.15.19:0/1922391684 conn(0x7f3d7c0a2aa0 msgr2=0x7f3d7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 -- 172.21.15.19:0/1922391684 shutdown_connections 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.963+0000 7f3d80cd1700 1 -- 172.21.15.19:0/1922391684 wait complete. 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 Processor -- start 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 -- start start 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 0x7f3d7c11ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c09a3b0 0x7f3d7c11f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c11f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.964+0000 7f3d80cd1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c1228b0 con 0x7f3d7c099a40 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d80cd1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c1305e0 con 0x7f3d7c131810 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d80cd1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c1209a0 con 0x7f3d7c09a3b0 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 0x7f3d7c11ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 0x7f3d7c11ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41422/0 (socket says 172.21.15.19:41422) 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7a59c700 1 -- 172.21.15.19:0/2567097640 learned_addr learned my addr 172.21.15.19:0/2567097640 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c11f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d79d9b700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c09a3b0 0x7f3d7c11f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c09a3b0 msgr2=0x7f3d7c11f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c09a3b0 0x7f3d7c11f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 msgr2=0x7f3d7c11ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 0x7f3d7c11ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 -- 172.21.15.19:0/2567097640 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700094a0 con 0x7f3d7c131810 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.965+0000 7f3d7ad9d700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c11f860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d74015000 tx=0x7f3d74004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.966+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740092e0 con 0x7f3d7c131810 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.966+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74004040 con 0x7f3d7c131810 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.966+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d74009b30 con 0x7f3d7c131810 2023-10-03T10:15:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.966+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740043f0 con 0x7f3d7c131810 2023-10-03T10:15:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.966+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c122fb0 con 0x7f3d7c131810 2023-10-03T10:15:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.967+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d74004550 con 0x7f3d7c131810 2023-10-03T10:15:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.967+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d74040890 con 0x7f3d7c131810 2023-10-03T10:15:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.967+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c122450 con 0x7f3d7c131810 2023-10-03T10:15:50.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:50.972+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d74019350 con 0x7f3d7c131810 2023-10-03T10:15:50.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:51.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.054+0000 7f44c09b3700 1 Processor -- start 2023-10-03T10:15:51.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.054+0000 7f44c09b3700 1 -- start start 2023-10-03T10:15:51.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44c09b3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44c09b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44c09b3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44bc06b990 con 0x7f44bc133420 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44c09b3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44bc09b0e0 con 0x7f44bc1337f0 2023-10-03T10:15:51.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44c09b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc133c20 con 0x7f44bc138dc0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44bad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44b9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44b9d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41438/0 (socket says 172.21.15.19:41438) 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44bad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33296/0 (socket says 172.21.15.19:33296) 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.055+0000 7f44b9d9b700 1 -- 172.21.15.19:0/4259032631 learned_addr learned my addr 172.21.15.19:0/4259032631 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44bad9d700 1 -- 172.21.15.19:0/4259032631 >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 msgr2=0x7f44bc138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44bad9d700 1 --2- 172.21.15.19:0/4259032631 >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44bad9d700 1 -- 172.21.15.19:0/4259032631 >> v1:172.21.15.19:6789/0 conn(0x7f44bc133420 legacy=0x7f44bc133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44bad9d700 1 -- 172.21.15.19:0/4259032631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44bc0a0590 con 0x7f44bc138dc0 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44b959a700 1 -- 172.21.15.19:0/4259032631 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387378945 0 0) 0x7f44bc06b990 con 0x7f44bc133420 2023-10-03T10:15:51.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44b9d9b700 1 --2- 172.21.15.19:0/4259032631 >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.056+0000 7f44bad9d700 1 --2- 172.21.15.19:0/4259032631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009d90 tx=0x7f44b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e97cf4206f151c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.057+0000 7f44b959a700 1 -- 172.21.15.19:0/4259032631 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b400e070 con 0x7f44bc138dc0 2023-10-03T10:15:51.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.057+0000 7f44b959a700 1 -- 172.21.15.19:0/4259032631 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b400bb20 con 0x7f44bc138dc0 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.057+0000 7f44b959a700 1 -- 172.21.15.19:0/4259032631 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4012430 con 0x7f44bc138dc0 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.057+0000 7f44c09b3700 1 -- 172.21.15.19:0/4259032631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 msgr2=0x7f44bc13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.057+0000 7f44c09b3700 1 --2- 172.21.15.19:0/4259032631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009d90 tx=0x7f44b400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.058+0000 7f44c09b3700 1 -- 172.21.15.19:0/4259032631 shutdown_connections 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.058+0000 7f44c09b3700 1 --2- 172.21.15.19:0/4259032631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc138dc0 0x7f44bc13b1a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.058+0000 7f44c09b3700 1 --2- 172.21.15.19:0/4259032631 >> v2:172.21.15.19:3300/0 conn(0x7f44bc1337f0 0x7f44bc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.058+0000 7f44c09b3700 1 -- 172.21.15.19:0/4259032631 >> 172.21.15.19:0/4259032631 conn(0x7f44bc0a4210 msgr2=0x7f44bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.062+0000 7f44c09b3700 1 -- 172.21.15.19:0/4259032631 shutdown_connections 2023-10-03T10:15:51.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.062+0000 7f44c09b3700 1 -- 172.21.15.19:0/4259032631 wait complete. 2023-10-03T10:15:51.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 Processor -- start 2023-10-03T10:15:51.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 -- start start 2023-10-03T10:15:51.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44bc133420 0x7f44bc0709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44bc138dc0 0x7f44bc071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc138a30 con 0x7f44bc138dc0 2023-10-03T10:15:51.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc09caf0 con 0x7f44bc1337f0 2023-10-03T10:15:51.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.063+0000 7f44c09b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc09cf40 con 0x7f44bc133420 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33304/0 (socket says 172.21.15.19:33304) 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 -- 172.21.15.19:0/2258798953 learned_addr learned my addr 172.21.15.19:0/2258798953 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44ba59c700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44bc133420 0x7f44bc0709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44bad9d700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44bc138dc0 0x7f44bc071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 -- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44bc133420 msgr2=0x7f44bc0709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44bc133420 0x7f44bc0709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 -- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44bc138dc0 msgr2=0x7f44bc071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44bc138dc0 0x7f44bc071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.064+0000 7f44b9d9b700 1 -- 172.21.15.19:0/2258798953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b0009550 con 0x7f44bc1337f0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44b9d9b700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f44b000ebe0 tx=0x7f44b000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000c850 con 0x7f44bc1337f0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b000c9b0 con 0x7f44bc1337f0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b000cd20 con 0x7f44bc1337f0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b4009a70 con 0x7f44bc1337f0 2023-10-03T10:15:51.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.065+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc09c830 con 0x7f44bc1337f0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.066+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44b0013470 con 0x7f44bc1337f0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.066+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44b003f3d0 con 0x7f44bc1337f0 2023-10-03T10:15:51.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.067+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc074ea0 con 0x7f44bc1337f0 2023-10-03T10:15:51.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.072+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44b00102b0 con 0x7f44bc1337f0 2023-10-03T10:15:51.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.112+0000 7f38e37aa700 1 Processor -- start 2023-10-03T10:15:51.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.112+0000 7f38e37aa700 1 -- start start 2023-10-03T10:15:51.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e37aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 0x7f38dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e37aa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f38dc09e410 0x7f38dc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e37aa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc09f130 con 0x7f38dc09e000 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e37aa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc09f520 con 0x7f38dc09e410 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e37aa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc09e930 con 0x7f38dc09d6f0 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e0d45700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f38dc09e000 0x7f38dc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52554/0 (socket says 172.21.15.19:52554) 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e0d45700 1 -- 172.21.15.19:0/659439687 learned_addr learned my addr 172.21.15.19:0/659439687 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1d47700 1 --2- 172.21.15.19:0/659439687 >> v2:172.21.15.19:3300/0 conn(0x7f38dc09e410 0x7f38dc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1546700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 0x7f38dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38d3fff700 1 -- 172.21.15.19:0/659439687 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127884793 0 0) 0x7f38dc09f130 con 0x7f38dc09e000 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1d47700 1 -- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 msgr2=0x7f38dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1d47700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 0x7f38dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1d47700 1 -- 172.21.15.19:0/659439687 >> v1:172.21.15.19:6789/0 conn(0x7f38dc09e000 legacy=0x7f38dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.113+0000 7f38e1d47700 1 -- 172.21.15.19:0/659439687 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc09b2d0 con 0x7f38dc09e410 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.114+0000 7f38e1546700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 0x7f38dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.114+0000 7f38e1d47700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09e410 0x7f38dc130d70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009d90 tx=0x7f38d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4574110078768ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.114+0000 7f38d3fff700 1 -- 172.21.15.19:0/659439687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d400e070 con 0x7f38dc09e410 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.114+0000 7f38d3fff700 1 -- 172.21.15.19:0/659439687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d400bd20 con 0x7f38dc09e410 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.114+0000 7f38d3fff700 1 -- 172.21.15.19:0/659439687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4012920 con 0x7f38dc09e410 2023-10-03T10:15:51.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 -- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09e410 msgr2=0x7f38dc130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09e410 0x7f38dc130d70 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009d90 tx=0x7f38d400b330 comp rx=0 tx=0).stop 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 -- 172.21.15.19:0/659439687 shutdown_connections 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09e410 0x7f38dc130d70 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 --2- 172.21.15.19:0/659439687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09d6f0 0x7f38dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 -- 172.21.15.19:0/659439687 >> 172.21.15.19:0/659439687 conn(0x7f38dc066f50 msgr2=0x7f38dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 -- 172.21.15.19:0/659439687 shutdown_connections 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.115+0000 7f38e37aa700 1 -- 172.21.15.19:0/659439687 wait complete. 2023-10-03T10:15:51.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.116+0000 7f38e37aa700 1 Processor -- start 2023-10-03T10:15:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.116+0000 7f38e37aa700 1 -- start start 2023-10-03T10:15:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38dc09e000 0x7f38dc11e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc09c790 con 0x7f38dc09d6f0 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc09a0c0 con 0x7f38dc09e000 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e37aa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc120480 con 0x7f38dc09e410 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e1d47700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e1546700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e1d47700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35248/0 (socket says 172.21.15.19:35248) 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e1546700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41454/0 (socket says 172.21.15.19:41454) 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.117+0000 7f38e1d47700 1 -- 172.21.15.19:0/4025650533 learned_addr learned my addr 172.21.15.19:0/4025650533 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e0d45700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38dc09e000 0x7f38dc11e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 -- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 msgr2=0x7f38dc11ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 -- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38dc09e000 msgr2=0x7f38dc11e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38dc09e000 0x7f38dc11e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 -- 172.21.15.19:0/4025650533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d80094a0 con 0x7f38dc09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1d47700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e1546700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38d800e9e0 tx=0x7f38d800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800c850 con 0x7f38dc09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d800c9b0 con 0x7f38dc09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d4009a70 con 0x7f38dc09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.118+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800cd60 con 0x7f38dc09d6f0 2023-10-03T10:15:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.119+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc121850 con 0x7f38dc09d6f0 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.120+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f38d8013470 con 0x7f38dc09d6f0 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.120+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f38d803f770 con 0x7f38dc09d6f0 2023-10-03T10:15:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.120+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc074ea0 con 0x7f38dc09d6f0 2023-10-03T10:15:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.125+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f38d8021080 con 0x7f38dc09d6f0 2023-10-03T10:15:51.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.144+0000 7f9c3327b700 1 Processor -- start 2023-10-03T10:15:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.144+0000 7f9c3327b700 1 -- start start 2023-10-03T10:15:51.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c3327b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9c2c1338a0 0x7f9c2c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c3327b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09e930 0x7f9c2c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c3327b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c2c06ef30 con 0x7f9c2c09de50 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c3327b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c2c06fef0 con 0x7f9c2c1338a0 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c3327b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1334b0 con 0x7f9c2c09e930 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c30816700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9c2c09de50 0x7f9c2c09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52558/0 (socket says 172.21.15.19:52558) 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c30816700 1 -- 172.21.15.19:0/1303046786 learned_addr learned my addr 172.21.15.19:0/1303046786 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:51.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c31017700 1 --2- 172.21.15.19:0/1303046786 >> v2:172.21.15.19:3300/0 conn(0x7f9c2c1338a0 0x7f9c2c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c31017700 1 -- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09e930 msgr2=0x7f9c2c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:51.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c31017700 1 --2- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09e930 0x7f9c2c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c31017700 1 -- 172.21.15.19:0/1303046786 >> v1:172.21.15.19:6789/0 conn(0x7f9c2c09de50 legacy=0x7f9c2c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c23fff700 1 -- 172.21.15.19:0/1303046786 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694590586 0 0) 0x7f9c2c06ef30 con 0x7f9c2c09de50 2023-10-03T10:15:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.145+0000 7f9c31017700 1 -- 172.21.15.19:0/1303046786 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c06fc30 con 0x7f9c2c1338a0 2023-10-03T10:15:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.146+0000 7f9c31017700 1 --2- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c133c70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009840 tx=0x7f9c28009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10eaa5677678196c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.146+0000 7f9c23fff700 1 -- 172.21.15.19:0/1303046786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011830 con 0x7f9c2c1338a0 2023-10-03T10:15:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.146+0000 7f9c23fff700 1 -- 172.21.15.19:0/1303046786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c28011990 con 0x7f9c2c1338a0 2023-10-03T10:15:51.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.146+0000 7f9c23fff700 1 -- 172.21.15.19:0/1303046786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c28011d20 con 0x7f9c2c1338a0 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 -- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 msgr2=0x7f9c2c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 --2- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c133c70 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9c28009840 tx=0x7f9c28009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 -- 172.21.15.19:0/1303046786 shutdown_connections 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 --2- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09e930 0x7f9c2c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 --2- 172.21.15.19:0/1303046786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c133c70 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 -- 172.21.15.19:0/1303046786 >> 172.21.15.19:0/1303046786 conn(0x7f9c2c0a2aa0 msgr2=0x7f9c2c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 -- 172.21.15.19:0/1303046786 shutdown_connections 2023-10-03T10:15:51.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.147+0000 7f9c3327b700 1 -- 172.21.15.19:0/1303046786 wait complete. 2023-10-03T10:15:51.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 Processor -- start 2023-10-03T10:15:51.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 -- start start 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c2c09e930 0x7f9c2c11dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c11e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c121050 con 0x7f9c2c1338a0 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c130b60 con 0x7f9c2c09de50 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.149+0000 7f9c3327b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2c1205d0 con 0x7f9c2c09e930 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31818700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c11e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33330/0 (socket says 172.21.15.19:33330) 2023-10-03T10:15:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 -- 172.21.15.19:0/79672900 learned_addr learned my addr 172.21.15.19:0/79672900 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:51.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c30816700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c2c09e930 0x7f9c2c11dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 -- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c2c09e930 msgr2=0x7f9c2c11dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c2c09e930 0x7f9c2c11dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 -- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 msgr2=0x7f9c2c11e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c11e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 -- 172.21.15.19:0/79672900 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280094a0 con 0x7f9c2c09de50 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c31017700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000c00 tx=0x7f9c28004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:51.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.150+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280045d0 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.151+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2801f070 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.151+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2c120a20 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.151+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c280038e0 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.151+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2c0a0d70 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.152+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9c28003a40 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.152+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2c074ea0 con 0x7f9c2c09de50 2023-10-03T10:15:51.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.152+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9c28021070 con 0x7f9c2c09de50 2023-10-03T10:15:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.161+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9c2800b3e0 con 0x7f9c2c09de50 2023-10-03T10:15:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.200+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d7c072180 con 0x7f3d7c131810 2023-10-03T10:15:51.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.201+0000 7f3d6affd700 1 -- 172.21.15.19:0/2567097640 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d7c072180 con 0x7f3d7c131810 2023-10-03T10:15:51.201 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 msgr2=0x7f3d7c11f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c11f860 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3d74015000 tx=0x7f3d74004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 shutdown_connections 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7c131810 0x7f3d7c11f860 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7c099a40 0x7f3d7c11ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 --2- 172.21.15.19:0/2567097640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d7c09a3b0 0x7f3d7c11f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 >> 172.21.15.19:0/2567097640 conn(0x7f3d7c0a2aa0 msgr2=0x7f3d7c0a1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 shutdown_connections 2023-10-03T10:15:51.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.203+0000 7f3d80cd1700 1 -- 172.21.15.19:0/2567097640 wait complete. 2023-10-03T10:15:51.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:51.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.301+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f44bc09cd30 con 0x7f44bc1337f0 2023-10-03T10:15:51.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.301+0000 7f44aaffd700 1 -- 172.21.15.19:0/2258798953 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44b0021030 con 0x7f44bc1337f0 2023-10-03T10:15:51.301 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 msgr2=0x7f44bc070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f44b000ebe0 tx=0x7f44b000eef0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 shutdown_connections 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44bc138dc0 0x7f44bc071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44bc133420 0x7f44bc0709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 --2- 172.21.15.19:0/2258798953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44bc1337f0 0x7f44bc070ee0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.304+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 >> 172.21.15.19:0/2258798953 conn(0x7f44bc0a4210 msgr2=0x7f44bc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.305+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 shutdown_connections 2023-10-03T10:15:51.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.305+0000 7f44c09b3700 1 -- 172.21.15.19:0/2258798953 wait complete. 2023-10-03T10:15:51.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:51.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.350+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f38dc0a21b0 con 0x7f38dc09d6f0 2023-10-03T10:15:51.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.350+0000 7f38d1ffb700 1 -- 172.21.15.19:0/4025650533 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f38d80232f0 con 0x7f38dc09d6f0 2023-10-03T10:15:51.350 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.352+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 msgr2=0x7f38dc11e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.352+0000 7f38e37aa700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f38d800e9e0 tx=0x7f38d800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 shutdown_connections 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f38dc09e410 0x7f38dc11ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f38dc09d6f0 0x7f38dc11e010 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 --2- 172.21.15.19:0/4025650533 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f38dc09e000 0x7f38dc11e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 >> 172.21.15.19:0/4025650533 conn(0x7f38dc066f50 msgr2=0x7f38dc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 shutdown_connections 2023-10-03T10:15:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.353+0000 7f38e37aa700 1 -- 172.21.15.19:0/4025650533 wait complete. 2023-10-03T10:15:51.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.368+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9c2c120c50 con 0x7f9c2c09de50 2023-10-03T10:15:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.368+0000 7f9c21ffb700 1 -- 172.21.15.19:0/79672900 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9c2802eb90 con 0x7f9c2c09de50 2023-10-03T10:15:51.368 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 msgr2=0x7f9c2c11d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c28000c00 tx=0x7f9c28004750 comp rx=0 tx=0).stop 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 shutdown_connections 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c2c1338a0 0x7f9c2c11e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9c2c09de50 0x7f9c2c11d8a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 --2- 172.21.15.19:0/79672900 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9c2c09e930 0x7f9c2c11dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 >> 172.21.15.19:0/79672900 conn(0x7f9c2c0a2aa0 msgr2=0x7f9c2c1b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 shutdown_connections 2023-10-03T10:15:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:51.371+0000 7f9c3327b700 1 -- 172.21.15.19:0/79672900 wait complete. 2023-10-03T10:15:51.384 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:52.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:52.324 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.364+0000 7f262bd55700 1 Processor -- start 2023-10-03T10:15:52.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.364+0000 7f262bd55700 1 -- start start 2023-10-03T10:15:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 0x7f2624133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f262409edd0 con 0x7f2624133fa0 2023-10-03T10:15:52.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262409e1f0 con 0x7f26240a0a30 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262bd55700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f262409dc50 con 0x7f26240a1340 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262a2f2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f2629af1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f262a2f2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41476/0 (socket says 172.21.15.19:41476) 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.365+0000 7f2629af1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33336/0 (socket says 172.21.15.19:33336) 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f262a2f2700 1 -- 172.21.15.19:0/41980802 learned_addr learned my addr 172.21.15.19:0/41980802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f26292f0700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 0x7f2624133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 -- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 msgr2=0x7f2624133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 0x7f2624133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 -- 172.21.15.19:0/41980802 >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 msgr2=0x7f2624134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 --2- 172.21.15.19:0/41980802 >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 -- 172.21.15.19:0/41980802 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26240a1fe0 con 0x7f26240a0a30 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f262a2f2700 1 --2- 172.21.15.19:0/41980802 >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f26292f0700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 0x7f2624133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2629af1700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f261c009840 tx=0x7f261c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e59916f1b507984 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2628aef700 1 -- 172.21.15.19:0/41980802 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011830 con 0x7f26240a0a30 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2628aef700 1 -- 172.21.15.19:0/41980802 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261c011990 con 0x7f26240a0a30 2023-10-03T10:15:52.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.366+0000 7f2628aef700 1 -- 172.21.15.19:0/41980802 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c011d20 con 0x7f26240a0a30 2023-10-03T10:15:52.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 -- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 msgr2=0x7f26240a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f261c009840 tx=0x7f261c009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 -- 172.21.15.19:0/41980802 shutdown_connections 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26240a0a30 0x7f26240a0e00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 --2- 172.21.15.19:0/41980802 >> v2:172.21.15.19:3300/0 conn(0x7f2624133fa0 0x7f2624134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 --2- 172.21.15.19:0/41980802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a1340 0x7f2624133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 -- 172.21.15.19:0/41980802 >> 172.21.15.19:0/41980802 conn(0x7f26240a6550 msgr2=0x7f26240a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 -- 172.21.15.19:0/41980802 shutdown_connections 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.367+0000 7f262bd55700 1 -- 172.21.15.19:0/41980802 wait complete. 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 Processor -- start 2023-10-03T10:15:52.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 -- start start 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 0x7f26241212f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2624124e10 con 0x7f26240a1340 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2624123d90 con 0x7f2624133fa0 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.369+0000 7f262bd55700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2624124870 con 0x7f26240a0a30 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26292f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f2629af1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 0x7f26241212f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33346/0 (socket says 172.21.15.19:33346) 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f2629af1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 0x7f26241212f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35272/0 (socket says 172.21.15.19:35272) 2023-10-03T10:15:52.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26292f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41480/0 (socket says 172.21.15.19:41480) 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 -- 172.21.15.19:0/1284939782 learned_addr learned my addr 172.21.15.19:0/1284939782 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 -- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 msgr2=0x7f26241212f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 0x7f26241212f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 -- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 msgr2=0x7f2624121830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 -- 172.21.15.19:0/1284939782 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26180094a0 con 0x7f2624133fa0 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26292f0700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262a2f2700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2614009f10 tx=0x7f261400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614018070 con 0x7f2624133fa0 2023-10-03T10:15:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261400f040 con 0x7f2624133fa0 2023-10-03T10:15:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614003c40 con 0x7f2624133fa0 2023-10-03T10:15:52.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.370+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2614009b30 con 0x7f2624133fa0 2023-10-03T10:15:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.371+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c0094a0 con 0x7f2624133fa0 2023-10-03T10:15:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.371+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f261400c940 con 0x7f2624133fa0 2023-10-03T10:15:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.371+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f261403f6a0 con 0x7f2624133fa0 2023-10-03T10:15:52.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.372+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26240a0220 con 0x7f2624133fa0 2023-10-03T10:15:52.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.377+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2614014480 con 0x7f2624133fa0 2023-10-03T10:15:52.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:52.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.474+0000 7f1f699aa700 1 Processor -- start 2023-10-03T10:15:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.474+0000 7f1f699aa700 1 -- start start 2023-10-03T10:15:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f699aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f699aa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 0x7f1f6413b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f699aa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6406f720 con 0x7f1f641338c0 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f699aa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f64070c80 con 0x7f1f64139150 2023-10-03T10:15:52.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f699aa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6406fce0 con 0x7f1f64136830 2023-10-03T10:15:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f627fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f627fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33362/0 (socket says 172.21.15.19:33362) 2023-10-03T10:15:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f627fc700 1 -- 172.21.15.19:0/508245956 learned_addr learned my addr 172.21.15.19:0/508245956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f637fe700 1 --2- 172.21.15.19:0/508245956 >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 0x7f1f6413b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f61ffb700 1 -- 172.21.15.19:0/508245956 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636259870 0 0) 0x7f1f6406f720 con 0x7f1f641338c0 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f61ffb700 1 -- 172.21.15.19:0/508245956 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f4c0035b0 con 0x7f1f641338c0 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.475+0000 7f1f627fc700 1 -- 172.21.15.19:0/508245956 >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 msgr2=0x7f1f6413b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f627fc700 1 --2- 172.21.15.19:0/508245956 >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 0x7f1f6413b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f627fc700 1 -- 172.21.15.19:0/508245956 >> v1:172.21.15.19:6789/0 conn(0x7f1f641338c0 legacy=0x7f1f64133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f627fc700 1 -- 172.21.15.19:0/508245956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f641336a0 con 0x7f1f64136830 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f637fe700 1 --2- 172.21.15.19:0/508245956 >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 0x7f1f6413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f627fc700 1 --2- 172.21.15.19:0/508245956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f580098f0 tx=0x7f1f58009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=434cfea0da8f0786 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f61ffb700 1 -- 172.21.15.19:0/508245956 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58011830 con 0x7f1f64136830 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f61ffb700 1 -- 172.21.15.19:0/508245956 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f58011990 con 0x7f1f64136830 2023-10-03T10:15:52.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.476+0000 7f1f61ffb700 1 -- 172.21.15.19:0/508245956 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58011d20 con 0x7f1f64136830 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 -- 172.21.15.19:0/508245956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 msgr2=0x7f1f64138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 --2- 172.21.15.19:0/508245956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1f580098f0 tx=0x7f1f58009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 -- 172.21.15.19:0/508245956 shutdown_connections 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 --2- 172.21.15.19:0/508245956 >> v2:172.21.15.19:3300/0 conn(0x7f1f64139150 0x7f1f6413b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 --2- 172.21.15.19:0/508245956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64136830 0x7f1f64138c10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 -- 172.21.15.19:0/508245956 >> 172.21.15.19:0/508245956 conn(0x7f1f640a2aa0 msgr2=0x7f1f640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 -- 172.21.15.19:0/508245956 shutdown_connections 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.477+0000 7f1f699aa700 1 -- 172.21.15.19:0/508245956 wait complete. 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.479+0000 7f1f699aa700 1 Processor -- start 2023-10-03T10:15:52.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.479+0000 7f1f699aa700 1 -- start start 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 0x7f1f641c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 0x7f1f641c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6411bac0 con 0x7f1f641338c0 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6411b190 con 0x7f1f64139150 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f699aa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6411b8d0 con 0x7f1f64136830 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f637fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f62ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 0x7f1f641c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f637fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33364/0 (socket says 172.21.15.19:33364) 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f637fe700 1 -- 172.21.15.19:0/3922361784 learned_addr learned my addr 172.21.15.19:0/3922361784 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f627fc700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 0x7f1f641c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.480+0000 7f1f637fe700 1 -- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 msgr2=0x7f1f641c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f637fe700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 0x7f1f641c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f637fe700 1 -- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 msgr2=0x7f1f641c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f637fe700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 0x7f1f641c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f637fe700 1 -- 172.21.15.19:0/3922361784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c009a70 con 0x7f1f64139150 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f62ffd700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 0x7f1f641c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f627fc700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 0x7f1f641c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f637fe700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00efc0 tx=0x7f1f5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c00ce00 con 0x7f1f64139150 2023-10-03T10:15:52.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f5c00f040 con 0x7f1f64139150 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f58009550 con 0x7f1f64139150 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c0146c0 con 0x7f1f64139150 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.481+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6406f960 con 0x7f1f64139150 2023-10-03T10:15:52.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.482+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6412fbf0 con 0x7f1f64139150 2023-10-03T10:15:52.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.483+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f5c014820 con 0x7f1f64139150 2023-10-03T10:15:52.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.483+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f5c040980 con 0x7f1f64139150 2023-10-03T10:15:52.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.492+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f5c012930 con 0x7f1f64139150 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.515+0000 7f1d83897700 1 Processor -- start 2023-10-03T10:15:52.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.515+0000 7f1d83897700 1 -- start start 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d83897700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d83897700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d83897700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7c09b4f0 con 0x7f1d7c131810 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d83897700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c1313c0 con 0x7f1d7c134630 2023-10-03T10:15:52.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d83897700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c06e8c0 con 0x7f1d7c136f50 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d81633700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1d7c131810 0x7f1d7c131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52576/0 (socket says 172.21.15.19:52576) 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d81633700 1 -- 172.21.15.19:0/3186124780 learned_addr learned my addr 172.21.15.19:0/3186124780 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d80e32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.516+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d73fff700 1 -- 172.21.15.19:0/3186124780 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706599620 0 0) 0x7f1d7c09b4f0 con 0x7f1d7c131810 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d81e34700 1 -- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 msgr2=0x7f1d7c136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d81e34700 1 -- 172.21.15.19:0/3186124780 >> v1:172.21.15.19:6789/0 conn(0x7f1d7c131810 legacy=0x7f1d7c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d81e34700 1 -- 172.21.15.19:0/3186124780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c071d20 con 0x7f1d7c136f50 2023-10-03T10:15:52.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c139330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400f3a0 tx=0x7f1d7400f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc13a6606bd44781 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d73fff700 1 -- 172.21.15.19:0/3186124780 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74012070 con 0x7f1d7c136f50 2023-10-03T10:15:52.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d73fff700 1 -- 172.21.15.19:0/3186124780 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400d0d0 con 0x7f1d7c136f50 2023-10-03T10:15:52.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.517+0000 7f1d73fff700 1 -- 172.21.15.19:0/3186124780 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400fea0 con 0x7f1d7c136f50 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 -- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 msgr2=0x7f1d7c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c139330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400f3a0 tx=0x7f1d7400f6b0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 -- 172.21.15.19:0/3186124780 shutdown_connections 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c139330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 --2- 172.21.15.19:0/3186124780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 -- 172.21.15.19:0/3186124780 >> 172.21.15.19:0/3186124780 conn(0x7f1d7c0a2aa0 msgr2=0x7f1d7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 -- 172.21.15.19:0/3186124780 shutdown_connections 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.518+0000 7f1d83897700 1 -- 172.21.15.19:0/3186124780 wait complete. 2023-10-03T10:15:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.519+0000 7f1d83897700 1 Processor -- start 2023-10-03T10:15:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 -- start start 2023-10-03T10:15:52.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 0x7f1d7c09c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c09ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c11a5b0 con 0x7f1d7c131810 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c11a000 con 0x7f1d7c134630 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.520+0000 7f1d83897700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7c071600 con 0x7f1d7c136f50 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81633700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 0x7f1d7c09c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81633700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 0x7f1d7c09c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41520/0 (socket says 172.21.15.19:41520) 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35298/0 (socket says 172.21.15.19:35298) 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81633700 1 -- 172.21.15.19:0/3556752839 learned_addr learned my addr 172.21.15.19:0/3556752839 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d80e32700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c09ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 -- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 msgr2=0x7f1d7c09ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c09ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 -- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 msgr2=0x7f1d7c09c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 0x7f1d7c09c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 -- 172.21.15.19:0/3556752839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7400f050 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d81e34700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d74019000 tx=0x7f1d74004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.521+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7400fea0 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.522+0000 7f1d83897700 1 -- 172.21.15.19:0/3556752839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d7c06eb60 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.522+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400bc50 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.522+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74004040 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.522+0000 7f1d83897700 1 -- 172.21.15.19:0/3556752839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7c11a230 con 0x7f1d7c136f50 2023-10-03T10:15:52.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.523+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d540052e0 con 0x7f1d7c136f50 2023-10-03T10:15:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.524+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d740041a0 con 0x7f1d7c136f50 2023-10-03T10:15:52.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.524+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d74045760 con 0x7f1d7c136f50 2023-10-03T10:15:52.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.533+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d74004450 con 0x7f1d7c136f50 2023-10-03T10:15:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.555+0000 7ff2c86ed700 1 Processor -- start 2023-10-03T10:15:52.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.555+0000 7ff2c86ed700 1 -- start start 2023-10-03T10:15:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c86ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 0x7ff2c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c86ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 0x7ff2c0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c86ed700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c009f130 con 0x7ff2c009e000 2023-10-03T10:15:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c86ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c009f520 con 0x7ff2c009d6f0 2023-10-03T10:15:52.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c86ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c009e930 con 0x7ff2c009e410 2023-10-03T10:15:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c5c88700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff2c009e000 0x7ff2c0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52588/0 (socket says 172.21.15.19:52588) 2023-10-03T10:15:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c6489700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 0x7ff2c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c5c88700 1 -- 172.21.15.19:0/4140006839 learned_addr learned my addr 172.21.15.19:0/4140006839 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:52.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.556+0000 7ff2c6c8a700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 0x7ff2c0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c5487700 1 -- 172.21.15.19:0/4140006839 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506565026 0 0) 0x7ff2c009f130 con 0x7ff2c009e000 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6489700 1 -- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 msgr2=0x7ff2c0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6489700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 0x7ff2c0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6489700 1 -- 172.21.15.19:0/4140006839 >> v1:172.21.15.19:6789/0 conn(0x7ff2c009e000 legacy=0x7ff2c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6489700 1 -- 172.21.15.19:0/4140006839 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c009b2d0 con 0x7ff2c009d6f0 2023-10-03T10:15:52.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6c8a700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 0x7ff2c0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c6489700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 0x7ff2c009dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009870 tx=0x7ff2bc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc5ea2178072e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c5487700 1 -- 172.21.15.19:0/4140006839 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc011830 con 0x7ff2c009d6f0 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c5487700 1 -- 172.21.15.19:0/4140006839 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc011990 con 0x7ff2c009d6f0 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.557+0000 7ff2c5487700 1 -- 172.21.15.19:0/4140006839 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc011d20 con 0x7ff2c009d6f0 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 -- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 msgr2=0x7ff2c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 0x7ff2c009dac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc009870 tx=0x7ff2bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 -- 172.21.15.19:0/4140006839 shutdown_connections 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e410 0x7ff2c0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/4140006839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009d6f0 0x7ff2c009dac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 -- 172.21.15.19:0/4140006839 >> 172.21.15.19:0/4140006839 conn(0x7ff2c0066f50 msgr2=0x7ff2c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 -- 172.21.15.19:0/4140006839 shutdown_connections 2023-10-03T10:15:52.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.558+0000 7ff2c86ed700 1 -- 172.21.15.19:0/4140006839 wait complete. 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 Processor -- start 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 -- start start 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 0x7ff2c011e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 0x7ff2c011e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009e410 0x7ff2c011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:52.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0121b50 con 0x7ff2c009d6f0 2023-10-03T10:15:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c009c770 con 0x7ff2c009e410 2023-10-03T10:15:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.560+0000 7ff2c86ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c0072150 con 0x7ff2c009e000 2023-10-03T10:15:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c6489700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 0x7ff2c011e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 0x7ff2c011e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c6489700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 0x7ff2c011e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41536/0 (socket says 172.21.15.19:41536) 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c6489700 1 -- 172.21.15.19:0/296688231 learned_addr learned my addr 172.21.15.19:0/296688231 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c6c8a700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009e410 0x7ff2c011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 -- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009e410 msgr2=0x7ff2c011eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009e410 0x7ff2c011eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 -- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 msgr2=0x7ff2c011e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 0x7ff2c011e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 -- 172.21.15.19:0/296688231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009a70 con 0x7ff2c009e000 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.561+0000 7ff2c5c88700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 0x7ff2c011e570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00a3e20 tx=0x7ff2b000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.562+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0004a70 con 0x7ff2c009e000 2023-10-03T10:15:52.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.562+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b0004bd0 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.562+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc0094a0 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.562+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b00070d0 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.562+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c01215b0 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.563+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2b0007230 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.563+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c0120e90 con 0x7ff2c009e000 2023-10-03T10:15:52.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.563+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2b0040e20 con 0x7ff2c009e000 2023-10-03T10:15:52.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.572+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2b0044060 con 0x7ff2c009e000 2023-10-03T10:15:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.599+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2624074ea0 con 0x7f2624133fa0 2023-10-03T10:15:52.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.599+0000 7f26227fc700 1 -- 172.21.15.19:0/1284939782 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f261401cb60 con 0x7f2624133fa0 2023-10-03T10:15:52.599 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 msgr2=0x7f2624121d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2614009f10 tx=0x7f261400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 shutdown_connections 2023-10-03T10:15:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2624133fa0 0x7f2624121d70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26240a0a30 0x7f26241212f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 --2- 172.21.15.19:0/1284939782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26240a1340 0x7f2624121830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 >> 172.21.15.19:0/1284939782 conn(0x7f26240a6550 msgr2=0x7f26240a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 shutdown_connections 2023-10-03T10:15:52.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.602+0000 7f262bd55700 1 -- 172.21.15.19:0/1284939782 wait complete. 2023-10-03T10:15:52.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:52.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.726+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1f64074ea0 con 0x7f1f64139150 2023-10-03T10:15:52.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.726+0000 7f1f4bfff700 1 -- 172.21.15.19:0/3922361784 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f5c02a020 con 0x7f1f64139150 2023-10-03T10:15:52.727 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:52.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 msgr2=0x7f1f64119cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c00efc0 tx=0x7f1f5c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 shutdown_connections 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f64139150 0x7f1f64119cc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f641338c0 0x7f1f641c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 --2- 172.21.15.19:0/3922361784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f64136830 0x7f1f641c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 >> 172.21.15.19:0/3922361784 conn(0x7f1f640a2aa0 msgr2=0x7f1f64134cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 shutdown_connections 2023-10-03T10:15:52.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.729+0000 7f1f699aa700 1 -- 172.21.15.19:0/3922361784 wait complete. 2023-10-03T10:15:52.743 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:52.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.776+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1d54005860 con 0x7f1d7c136f50 2023-10-03T10:15:52.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.777+0000 7f1d71ffb700 1 -- 172.21.15.19:0/3556752839 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d74036020 con 0x7f1d7c136f50 2023-10-03T10:15:52.777 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:52.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 msgr2=0x7f1d7c09cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1d74019000 tx=0x7f1d74004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 shutdown_connections 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d7c136f50 0x7f1d7c09cfa0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c131810 0x7f1d7c09c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 --2- 172.21.15.19:0/3556752839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d7c134630 0x7f1d7c09ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 >> 172.21.15.19:0/3556752839 conn(0x7f1d7c0a2aa0 msgr2=0x7f1d7c132410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 shutdown_connections 2023-10-03T10:15:52.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.780+0000 7f1d677fe700 1 -- 172.21.15.19:0/3556752839 wait complete. 2023-10-03T10:15:52.798 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:52.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.818+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2c011ac20 con 0x7ff2c009e000 2023-10-03T10:15:52.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.818+0000 7ff2b6ffd700 1 -- 172.21.15.19:0/296688231 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2b001ab30 con 0x7ff2c009e000 2023-10-03T10:15:52.818 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 msgr2=0x7ff2c011e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 0x7ff2c011e570 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00a3e20 tx=0x7ff2b000c750 comp rx=0 tx=0).stop 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 shutdown_connections 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c009e410 0x7ff2c011eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c009d6f0 0x7ff2c011e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 --2- 172.21.15.19:0/296688231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c009e000 0x7ff2c011e570 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:52.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 >> 172.21.15.19:0/296688231 conn(0x7ff2c0066f50 msgr2=0x7ff2c0130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:52.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 shutdown_connections 2023-10-03T10:15:52.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:52.821+0000 7ff2c86ed700 1 -- 172.21.15.19:0/296688231 wait complete. 2023-10-03T10:15:52.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:53.618 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:53.744 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:53.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 Processor -- start 2023-10-03T10:15:53.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 -- start start 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 0x7fce700a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce700a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700a2a70 con 0x7fce70133930 2023-10-03T10:15:53.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce700a01d0 con 0x7fce7009d630 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.765+0000 7fce7592b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce7009e2b0 con 0x7fce700a0a30 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce700a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 0x7fce700a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41542/0 (socket says 172.21.15.19:41542) 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6f7fe700 1 -- 172.21.15.19:0/1546333526 learned_addr learned my addr 172.21.15.19:0/1546333526 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 -- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 msgr2=0x7fce700a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 0x7fce700a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 -- 172.21.15.19:0/1546333526 >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 msgr2=0x7fce70133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 --2- 172.21.15.19:0/1546333526 >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 -- 172.21.15.19:0/1546333526 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7009dc50 con 0x7fce7009d630 2023-10-03T10:15:53.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6effd700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 0x7fce700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6f7fe700 1 --2- 172.21.15.19:0/1546333526 >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6e7fc700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce700a1340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce58009840 tx=0x7fce58009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b6bd0d17930f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6dffb700 1 -- 172.21.15.19:0/1546333526 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58011830 con 0x7fce7009d630 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6dffb700 1 -- 172.21.15.19:0/1546333526 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58011990 con 0x7fce7009d630 2023-10-03T10:15:53.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.766+0000 7fce6dffb700 1 -- 172.21.15.19:0/1546333526 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58011d20 con 0x7fce7009d630 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 -- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 msgr2=0x7fce700a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce700a1340 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce58009840 tx=0x7fce58009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 -- 172.21.15.19:0/1546333526 shutdown_connections 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 --2- 172.21.15.19:0/1546333526 >> v2:172.21.15.19:3300/0 conn(0x7fce70133930 0x7fce70133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce700a0a30 0x7fce700a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 --2- 172.21.15.19:0/1546333526 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce700a1340 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 -- 172.21.15.19:0/1546333526 >> 172.21.15.19:0/1546333526 conn(0x7fce700a3050 msgr2=0x7fce700a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.767+0000 7fce7592b700 1 -- 172.21.15.19:0/1546333526 shutdown_connections 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.768+0000 7fce7592b700 1 -- 172.21.15.19:0/1546333526 wait complete. 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.768+0000 7fce7592b700 1 Processor -- start 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 -- start start 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce701c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 0x7fce701c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 0x7fce7011e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701c8f40 con 0x7fce700a0a30 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce70120400 con 0x7fce7009d630 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce7592b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce700a4150 con 0x7fce70133930 2023-10-03T10:15:53.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce6e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 0x7fce701c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce6effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce701c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce6e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 0x7fce701c8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41556/0 (socket says 172.21.15.19:41556) 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce6e7fc700 1 -- 172.21.15.19:0/3340920368 learned_addr learned my addr 172.21.15.19:0/3340920368 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.769+0000 7fce6f7fe700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 0x7fce7011e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 -- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 msgr2=0x7fce7011e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 0x7fce7011e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 -- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 msgr2=0x7fce701c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 0x7fce701c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 -- 172.21.15.19:0/3340920368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009a70 con 0x7fce7009d630 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6f7fe700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 0x7fce7011e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce6effd700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce701c84c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce6000efc0 tx=0x7fce6000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000cd10 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000f040 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce68009550 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce600146a0 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.770+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce580094a0 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.771+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce60014800 con 0x7fce7009d630 2023-10-03T10:15:53.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.771+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce700747f0 con 0x7fce7009d630 2023-10-03T10:15:53.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.771+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce600404d0 con 0x7fce7009d630 2023-10-03T10:15:53.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.776+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce60014d40 con 0x7fce7009d630 2023-10-03T10:15:53.800 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:53.834 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.894+0000 7f664926c700 1 Processor -- start 2023-10-03T10:15:53.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.894+0000 7f664926c700 1 -- start start 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f664409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 0x7f66441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 0x7f6644133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f664406b460 con 0x7f664409e000 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f664409b120 con 0x7f664409d6f0 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f664926c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f664409a7e0 con 0x7f664409e410 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f66427fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 0x7f66441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f66427fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 0x7f66441339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41568/0 (socket says 172.21.15.19:41568) 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f66427fc700 1 -- 172.21.15.19:0/3664676570 learned_addr learned my addr 172.21.15.19:0/3664676570 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.895+0000 7f6642ffd700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f664409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 0x7f6644133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 -- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 msgr2=0x7f664409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f664409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 -- 172.21.15.19:0/3664676570 >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 msgr2=0x7f66441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 --2- 172.21.15.19:0/3664676570 >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 0x7f66441339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 -- 172.21.15.19:0/3664676570 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664409a500 con 0x7f664409e410 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f66437fe700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 0x7f6644133f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f663c009dc0 tx=0x7f663c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79865bd061d400ab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.896+0000 7f6641ffb700 1 -- 172.21.15.19:0/3664676570 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00e070 con 0x7f664409e410 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.897+0000 7f6641ffb700 1 -- 172.21.15.19:0/3664676570 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c00bae0 con 0x7f664409e410 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.897+0000 7f6641ffb700 1 -- 172.21.15.19:0/3664676570 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00be90 con 0x7f664409e410 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 -- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 msgr2=0x7f6644133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 0x7f6644133f30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f663c009dc0 tx=0x7f663c00b330 comp rx=0 tx=0).stop 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 -- 172.21.15.19:0/3664676570 shutdown_connections 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f664409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 --2- 172.21.15.19:0/3664676570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e410 0x7f6644133f30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 --2- 172.21.15.19:0/3664676570 >> v2:172.21.15.19:3300/0 conn(0x7f664409e000 0x7f66441339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 -- 172.21.15.19:0/3664676570 >> 172.21.15.19:0/3664676570 conn(0x7f6644066f50 msgr2=0x7f664409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 -- 172.21.15.19:0/3664676570 shutdown_connections 2023-10-03T10:15:53.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.898+0000 7f664926c700 1 -- 172.21.15.19:0/3664676570 wait complete. 2023-10-03T10:15:53.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.899+0000 7f664926c700 1 Processor -- start 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.899+0000 7f664926c700 1 -- start start 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.899+0000 7f664926c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f66441c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f664926c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 0x7f66441c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f664926c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f664926c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66441a8170 con 0x7f664409e410 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f664926c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66441a6460 con 0x7f664409d6f0 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f664926c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66440a2000 con 0x7f664409e000 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41582/0 (socket says 172.21.15.19:41582) 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 -- 172.21.15.19:0/843999632 learned_addr learned my addr 172.21.15.19:0/843999632 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f6642ffd700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f66441c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66427fc700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 0x7f66441c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 -- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 msgr2=0x7f66441c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 0x7f66441c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 -- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 msgr2=0x7f66441c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f66441c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66437fe700 1 -- 172.21.15.19:0/843999632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c009a70 con 0x7f664409e410 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.900+0000 7f66427fc700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 0x7f66441c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f66437fe700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b370 tx=0x7f663c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c0044d0 con 0x7f664409e410 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f663c020070 con 0x7f664409e410 2023-10-03T10:15:53.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664409c710 con 0x7f664409e410 2023-10-03T10:15:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66441a8b00 con 0x7f664409e410 2023-10-03T10:15:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.901+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c0048b0 con 0x7f664409e410 2023-10-03T10:15:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.902+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f663c012430 con 0x7f664409e410 2023-10-03T10:15:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.902+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66240052e0 con 0x7f664409e410 2023-10-03T10:15:53.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.902+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f663c022070 con 0x7f664409e410 2023-10-03T10:15:53.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.907+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f663c01a740 con 0x7f664409e410 2023-10-03T10:15:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.945+0000 7f1ef68b6700 1 Processor -- start 2023-10-03T10:15:53.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.945+0000 7f1ef68b6700 1 -- start start 2023-10-03T10:15:53.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef68b6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ef009d6f0 0x7f1ef009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef68b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef68b6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef009b120 con 0x7f1ef009e000 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef68b6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef006b460 con 0x7f1ef009d6f0 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef68b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef009a7e0 con 0x7f1ef009e440 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef4e53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1eeffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1ef009d6f0 0x7f1ef009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef4e53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35358/0 (socket says 172.21.15.19:35358) 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.946+0000 7f1ef4e53700 1 -- 172.21.15.19:0/2610889951 learned_addr learned my addr 172.21.15.19:0/2610889951 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeffff700 1 -- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 msgr2=0x7f1ef0134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeffff700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeffff700 1 -- 172.21.15.19:0/2610889951 >> v1:172.21.15.19:6789/0 conn(0x7f1ef009e000 legacy=0x7f1ef01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeffff700 1 -- 172.21.15.19:0/2610889951 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef009a500 con 0x7f1ef009d6f0 2023-10-03T10:15:53.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeeffd700 1 -- 172.21.15.19:0/2610889951 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824992483 0 0) 0x7f1ef009b120 con 0x7f1ef009e000 2023-10-03T10:15:53.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1ef4e53700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeffff700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009d6f0 0x7f1ef009dac0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009870 tx=0x7f1ee0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4752c364f7ea79f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeeffd700 1 -- 172.21.15.19:0/2610889951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011830 con 0x7f1ef009d6f0 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeeffd700 1 -- 172.21.15.19:0/2610889951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0011990 con 0x7f1ef009d6f0 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.947+0000 7f1eeeffd700 1 -- 172.21.15.19:0/2610889951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0011d20 con 0x7f1ef009d6f0 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 -- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009d6f0 msgr2=0x7f1ef009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009d6f0 0x7f1ef009dac0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f1ee0009870 tx=0x7f1ee0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 -- 172.21.15.19:0/2610889951 shutdown_connections 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009e440 0x7f1ef0134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/2610889951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009d6f0 0x7f1ef009dac0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 -- 172.21.15.19:0/2610889951 >> 172.21.15.19:0/2610889951 conn(0x7f1ef0066f50 msgr2=0x7f1ef009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 -- 172.21.15.19:0/2610889951 shutdown_connections 2023-10-03T10:15:53.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.948+0000 7f1ef68b6700 1 -- 172.21.15.19:0/2610889951 wait complete. 2023-10-03T10:15:53.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.950+0000 7f1ef68b6700 1 Processor -- start 2023-10-03T10:15:53.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.950+0000 7f1ef68b6700 1 -- start start 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ef009e440 0x7f1ef01c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01a8110 con 0x7f1ef009e000 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01b9180 con 0x7f1ef009e440 2023-10-03T10:15:53.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef68b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef01a8310 con 0x7f1ef009d6f0 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1eeffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1eef7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41604/0 (socket says 172.21.15.19:41604) 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1eeffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35362/0 (socket says 172.21.15.19:35362) 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1eef7fe700 1 -- 172.21.15.19:0/845552744 learned_addr learned my addr 172.21.15.19:0/845552744 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.951+0000 7f1ef4e53700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ef009e440 0x7f1ef01c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 -- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 msgr2=0x7f1ef01a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 -- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ef009e440 msgr2=0x7f1ef01c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ef009e440 0x7f1ef01c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 -- 172.21.15.19:0/845552744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee8009b30 con 0x7f1ef009e000 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eeffff700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eef7fe700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001eb0 tx=0x7f1ee400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40054e0 con 0x7f1ef009e000 2023-10-03T10:15:53.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee4003680 con 0x7f1ef009e000 2023-10-03T10:15:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee00094a0 con 0x7f1ef009e000 2023-10-03T10:15:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.952+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef01a4d90 con 0x7f1ef009e000 2023-10-03T10:15:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.953+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee40039f0 con 0x7f1ef009e000 2023-10-03T10:15:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.954+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1ee4003b50 con 0x7f1ef009e000 2023-10-03T10:15:53.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.954+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1ee4040ae0 con 0x7f1ef009e000 2023-10-03T10:15:53.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.954+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef009c710 con 0x7f1ef009e000 2023-10-03T10:15:53.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.959+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1ee4017070 con 0x7f1ef009e000 2023-10-03T10:15:53.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 Processor -- start 2023-10-03T10:15:53.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 -- start start 2023-10-03T10:15:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 0x7f8f481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 0x7f8f481304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4806b990 con 0x7f8f48134260 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480a0590 con 0x7f8f48133420 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.991+0000 7f8f4ed7f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4809fb80 con 0x7f8f48133e30 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f4cb1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 0x7f8f481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f4cb1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 0x7f8f481337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33456/0 (socket says 172.21.15.19:33456) 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f4cb1b700 1 -- 172.21.15.19:0/3012772309 learned_addr learned my addr 172.21.15.19:0/3012772309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f4d31c700 1 --2- 172.21.15.19:0/3012772309 >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 0x7f8f481304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 -- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 msgr2=0x7f8f481337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 --2- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 0x7f8f481337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 -- 172.21.15.19:0/3012772309 >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 msgr2=0x7f8f481304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 --2- 172.21.15.19:0/3012772309 >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 0x7f8f481304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 -- 172.21.15.19:0/3012772309 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480a0030 con 0x7f8f48133e30 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f4d31c700 1 --2- 172.21.15.19:0/3012772309 >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 0x7f8f481304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f47fff700 1 --2- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4812ff90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009840 tx=0x7f8f34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f968fcecd1ca357a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f477fe700 1 -- 172.21.15.19:0/3012772309 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011830 con 0x7f8f48133e30 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f477fe700 1 -- 172.21.15.19:0/3012772309 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f34011990 con 0x7f8f48133e30 2023-10-03T10:15:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.992+0000 7f8f477fe700 1 -- 172.21.15.19:0/3012772309 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34011d20 con 0x7f8f48133e30 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 msgr2=0x7f8f4812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4812ff90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8f34009840 tx=0x7f8f34009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/3012772309 shutdown_connections 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48133420 0x7f8f481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/3012772309 >> v2:172.21.15.19:3300/0 conn(0x7f8f48134260 0x7f8f481304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/3012772309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4812ff90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/3012772309 >> 172.21.15.19:0/3012772309 conn(0x7f8f480a4210 msgr2=0x7f8f480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/3012772309 shutdown_connections 2023-10-03T10:15:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.993+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/3012772309 wait complete. 2023-10-03T10:15:53.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.994+0000 7f8f4ed7f700 1 Processor -- start 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.995+0000 7f8f4ed7f700 1 -- start start 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.995+0000 7f8f4ed7f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f48133420 0x7f8f4809bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.995+0000 7f8f4ed7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4809c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.995+0000 7f8f4ed7f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 0x7f8f4809c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4ed7f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4812dbb0 con 0x7f8f48133420 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4ed7f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4811b430 con 0x7f8f48134260 2023-10-03T10:15:53.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4ed7f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f48131400 con 0x7f8f48133e30 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4d31c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 0x7f8f4809c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4d31c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 0x7f8f4809c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33464/0 (socket says 172.21.15.19:33464) 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4d31c700 1 -- 172.21.15.19:0/1998363802 learned_addr learned my addr 172.21.15.19:0/1998363802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4809c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f4cb1b700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f48133420 0x7f8f4809bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 -- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 msgr2=0x7f8f4809c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 0x7f8f4809c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 -- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f48133420 msgr2=0x7f8f4809bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:53.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f48133420 0x7f8f4809bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.996+0000 7f8f47fff700 1 -- 172.21.15.19:0/1998363802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340094a0 con 0x7f8f48133e30 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f47fff700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4809c4a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f34016000 tx=0x7f8f34004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f34004240 con 0x7f8f48133e30 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3401f070 con 0x7f8f48133e30 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340045c0 con 0x7f8f48133e30 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4811a820 con 0x7f8f48133e30 2023-10-03T10:15:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.997+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4811ba60 con 0x7f8f48133e30 2023-10-03T10:15:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.998+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f34021030 con 0x7f8f48133e30 2023-10-03T10:15:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.998+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f48074ea0 con 0x7f8f48133e30 2023-10-03T10:15:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.998+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f34040910 con 0x7f8f48133e30 2023-10-03T10:15:54.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:53.999+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fce70072980 con 0x7fce7009d630 2023-10-03T10:15:54.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.003+0000 7fce67fff700 1 -- 172.21.15.19:0/3340920368 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce60012340 con 0x7fce7009d630 2023-10-03T10:15:54.003 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.004+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f340237e0 con 0x7f8f48133e30 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.005+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 msgr2=0x7fce701c84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.005+0000 7fce7592b700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce701c84c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fce6000efc0 tx=0x7fce6000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.006+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 shutdown_connections 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.006+0000 7fce7592b700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce70133930 0x7fce7011e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.006+0000 7fce7592b700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce7009d630 0x7fce701c84c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.006+0000 7fce7592b700 1 --2- 172.21.15.19:0/3340920368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce700a0a30 0x7fce701c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.006+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 >> 172.21.15.19:0/3340920368 conn(0x7fce700a3050 msgr2=0x7fce7009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.009+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 shutdown_connections 2023-10-03T10:15:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.009+0000 7fce7592b700 1 -- 172.21.15.19:0/3340920368 wait complete. 2023-10-03T10:15:54.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.120+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6624005590 con 0x7f664409e410 2023-10-03T10:15:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.120+0000 7f662b7fe700 1 -- 172.21.15.19:0/843999632 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f663c01a380 con 0x7f664409e410 2023-10-03T10:15:54.120 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 msgr2=0x7f66441c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f663c00b370 tx=0x7f663c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 shutdown_connections 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f664409e410 0x7f66441c8b30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f664409d6f0 0x7f66441c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 --2- 172.21.15.19:0/843999632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f664409e000 0x7f66441c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 >> 172.21.15.19:0/843999632 conn(0x7f6644066f50 msgr2=0x7f664406f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 shutdown_connections 2023-10-03T10:15:54.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.122+0000 7f664926c700 1 -- 172.21.15.19:0/843999632 wait complete. 2023-10-03T10:15:54.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:54.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.169+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ef009f420 con 0x7f1ef009e000 2023-10-03T10:15:54.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.169+0000 7f1eecff9700 1 -- 172.21.15.19:0/845552744 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ee4017030 con 0x7f1ef009e000 2023-10-03T10:15:54.169 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 msgr2=0x7f1ef01a58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4001eb0 tx=0x7f1ee400c800 comp rx=0 tx=0).stop 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 shutdown_connections 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ef009e440 0x7f1ef01c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ef009d6f0 0x7f1ef01a5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 --2- 172.21.15.19:0/845552744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ef009e000 0x7f1ef01a58c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 >> 172.21.15.19:0/845552744 conn(0x7f1ef0066f50 msgr2=0x7f1ef01bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.171+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 shutdown_connections 2023-10-03T10:15:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.172+0000 7f1ef68b6700 1 -- 172.21.15.19:0/845552744 wait complete. 2023-10-03T10:15:54.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:54.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.221+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f4806b250 con 0x7f8f48133e30 2023-10-03T10:15:54.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.221+0000 7f8f457fa700 1 -- 172.21.15.19:0/1998363802 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f34015070 con 0x7f8f48133e30 2023-10-03T10:15:54.221 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 msgr2=0x7f8f4809c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4809c4a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8f34016000 tx=0x7f8f34004750 comp rx=0 tx=0).stop 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 shutdown_connections 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f48134260 0x7f8f4809c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f48133420 0x7f8f4809bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 --2- 172.21.15.19:0/1998363802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f48133e30 0x7f8f4809c4a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 >> 172.21.15.19:0/1998363802 conn(0x7f8f480a4210 msgr2=0x7f8f481301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 shutdown_connections 2023-10-03T10:15:54.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:54.224+0000 7f8f4ed7f700 1 -- 172.21.15.19:0/1998363802 wait complete. 2023-10-03T10:15:54.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:55.029 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:55.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.176+0000 7f53c6ea2700 1 Processor -- start 2023-10-03T10:15:55.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.176+0000 7f53c6ea2700 1 -- start start 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c6ea2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009d6f0 0x7f53c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c6ea2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53c009e410 0x7f53c0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c6ea2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c009b120 con 0x7f53c009e000 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c6ea2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c006b460 con 0x7f53c009e410 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c6ea2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c009a7e0 con 0x7f53c009d6f0 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c543f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f53c009e410 0x7f53c0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53bffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f53c009e000 0x7f53c01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52618/0 (socket says 172.21.15.19:52618) 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53bffff700 1 -- 172.21.15.19:0/2245211062 learned_addr learned my addr 172.21.15.19:0/2245211062 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c4c3e700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009d6f0 0x7f53c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c543f700 1 -- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009d6f0 msgr2=0x7f53c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c543f700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009d6f0 0x7f53c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c543f700 1 -- 172.21.15.19:0/2245211062 >> v1:172.21.15.19:6789/0 conn(0x7f53c009e000 legacy=0x7f53c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53c543f700 1 -- 172.21.15.19:0/2245211062 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c009a500 con 0x7f53c009e410 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.177+0000 7f53bf7fe700 1 -- 172.21.15.19:0/2245211062 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667161797 0 0) 0x7f53c009b120 con 0x7f53c009e000 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c543f700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e410 0x7f53c0134100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009840 tx=0x7f53b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dcae032ed615524 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53bf7fe700 1 -- 172.21.15.19:0/2245211062 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8011830 con 0x7f53c009e410 2023-10-03T10:15:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53bf7fe700 1 -- 172.21.15.19:0/2245211062 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8011990 con 0x7f53c009e410 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53bf7fe700 1 -- 172.21.15.19:0/2245211062 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8011d20 con 0x7f53c009e410 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 -- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e410 msgr2=0x7f53c0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e410 0x7f53c0134100 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f53b8009840 tx=0x7f53b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 -- 172.21.15.19:0/2245211062 shutdown_connections 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e410 0x7f53c0134100 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/2245211062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009d6f0 0x7f53c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.178+0000 7f53c6ea2700 1 -- 172.21.15.19:0/2245211062 >> 172.21.15.19:0/2245211062 conn(0x7f53c0066f50 msgr2=0x7f53c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.179+0000 7f53c6ea2700 1 -- 172.21.15.19:0/2245211062 shutdown_connections 2023-10-03T10:15:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.179+0000 7f53c6ea2700 1 -- 172.21.15.19:0/2245211062 wait complete. 2023-10-03T10:15:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 Processor -- start 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 -- start start 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f53c009d6f0 0x7f53c01a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009e410 0x7f53c01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01a8120 con 0x7f53c009e000 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01a8300 con 0x7f53c009e410 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c6ea2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53c01b9170 con 0x7f53c009d6f0 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53c4c3e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f53c009d6f0 0x7f53c01a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41646/0 (socket says 172.21.15.19:41646) 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.180+0000 7f53bffff700 1 -- 172.21.15.19:0/3455570635 learned_addr learned my addr 172.21.15.19:0/3455570635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53c543f700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009e410 0x7f53c01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 -- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f53c009d6f0 msgr2=0x7f53c01a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f53c009d6f0 0x7f53c01a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 -- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009e410 msgr2=0x7f53c01c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009e410 0x7f53c01c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 -- 172.21.15.19:0/3455570635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80094a0 con 0x7f53c009e000 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bffff700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c520 tx=0x7f53b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4004c80 con 0x7f53c009e000 2023-10-03T10:15:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b4004de0 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c01a4ca0 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4007310 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.181+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c01a7b00 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.182+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f53b4007470 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.182+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c01a5cc0 con 0x7f53c009e000 2023-10-03T10:15:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.183+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f53b403f260 con 0x7f53c009e000 2023-10-03T10:15:55.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:55.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.187+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f53b40133c0 con 0x7f53c009e000 2023-10-03T10:15:55.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.281+0000 7f6039973700 1 Processor -- start 2023-10-03T10:15:55.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.281+0000 7f6039973700 1 -- start start 2023-10-03T10:15:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f603409e000 0x7f60341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409e410 0x7f6034133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603406b460 con 0x7f603409e000 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603409b120 con 0x7f603409e410 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6039973700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f603409a7e0 con 0x7f603409d6f0 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6032ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f60337fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409e410 0x7f6034133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6032ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35408/0 (socket says 172.21.15.19:35408) 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.282+0000 7f6032ffd700 1 -- 172.21.15.19:0/878263117 learned_addr learned my addr 172.21.15.19:0/878263117 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 -- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409e410 msgr2=0x7f6034133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 --2- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409e410 0x7f6034133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 -- 172.21.15.19:0/878263117 >> v2:172.21.15.19:3300/0 conn(0x7f603409e000 msgr2=0x7f60341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 --2- 172.21.15.19:0/878263117 >> v2:172.21.15.19:3300/0 conn(0x7f603409e000 0x7f60341339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 -- 172.21.15.19:0/878263117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603409a500 con 0x7f603409d6f0 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6032ffd700 1 --2- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6024009920 tx=0x7f6024009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32754b419b6afc7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6031ffb700 1 -- 172.21.15.19:0/878263117 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024011830 con 0x7f603409d6f0 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6031ffb700 1 -- 172.21.15.19:0/878263117 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024011990 con 0x7f603409d6f0 2023-10-03T10:15:55.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.283+0000 7f6031ffb700 1 -- 172.21.15.19:0/878263117 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024011d20 con 0x7f603409d6f0 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 -- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 msgr2=0x7f603409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 --2- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6024009920 tx=0x7f6024009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 -- 172.21.15.19:0/878263117 shutdown_connections 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 --2- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409e410 0x7f6034133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 --2- 172.21.15.19:0/878263117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409d6f0 0x7f603409dac0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 --2- 172.21.15.19:0/878263117 >> v2:172.21.15.19:3300/0 conn(0x7f603409e000 0x7f60341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 -- 172.21.15.19:0/878263117 >> 172.21.15.19:0/878263117 conn(0x7f6034066f50 msgr2=0x7f603409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 -- 172.21.15.19:0/878263117 shutdown_connections 2023-10-03T10:15:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.284+0000 7f6039973700 1 -- 172.21.15.19:0/878263117 wait complete. 2023-10-03T10:15:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.285+0000 7f6039973700 1 Processor -- start 2023-10-03T10:15:55.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.285+0000 7f6039973700 1 -- start start 2023-10-03T10:15:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409d6f0 0x7f60341a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 0x7f60341a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a7c60 con 0x7f603409e410 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a8eb0 con 0x7f603409d6f0 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6039973700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60341a8240 con 0x7f603409e000 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60327fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 0x7f60341a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41658/0 (socket says 172.21.15.19:41658) 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60327fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 0x7f60341a6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35424/0 (socket says 172.21.15.19:35424) 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 -- 172.21.15.19:0/3634296679 learned_addr learned my addr 172.21.15.19:0/3634296679 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f6032ffd700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409d6f0 0x7f60341a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 -- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 msgr2=0x7f60341a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 0x7f60341a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 -- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409d6f0 msgr2=0x7f60341a60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409d6f0 0x7f60341a60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.286+0000 7f60337fe700 1 -- 172.21.15.19:0/3634296679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009550 con 0x7f603409e410 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f60337fe700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f602c009dd0 tx=0x7f602c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c009c40 con 0x7f603409e410 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c00f040 con 0x7f603409e410 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60341a9890 con 0x7f603409e410 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c014480 con 0x7f603409e410 2023-10-03T10:15:55.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.287+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603409c710 con 0x7f603409e410 2023-10-03T10:15:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.288+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f602c0145e0 con 0x7f603409e410 2023-10-03T10:15:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.288+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034074ea0 con 0x7f603409e410 2023-10-03T10:15:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.289+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f602c0401b0 con 0x7f603409e410 2023-10-03T10:15:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.294+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f602c007920 con 0x7f603409e410 2023-10-03T10:15:55.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 Processor -- start 2023-10-03T10:15:55.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 -- start start 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 0x7fdfb813ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb809a570 con 0x7fdfb809dfe0 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb809b1c0 con 0x7fdfb8133cd0 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbed04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb809f240 con 0x7fdfb809d6d0 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbcaa0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbcaa0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33506/0 (socket says 172.21.15.19:33506) 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.330+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/1850809802 learned_addr learned my addr 172.21.15.19:0/1850809802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbd2a1700 1 --2- 172.21.15.19:0/1850809802 >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 0x7fdfb813ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/1850809802 >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 msgr2=0x7fdfb813ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbcaa0700 1 --2- 172.21.15.19:0/1850809802 >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 0x7fdfb813ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/1850809802 >> v1:172.21.15.19:6789/0 conn(0x7fdfb809dfe0 legacy=0x7fdfb81335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/1850809802 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb809a2d0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbd2a1700 1 --2- 172.21.15.19:0/1850809802 >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 0x7fdfb813ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:15:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfbcaa0700 1 --2- 172.21.15.19:0/1850809802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0098f0 tx=0x7fdfac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fddf0ed787166756 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfb77fe700 1 -- 172.21.15.19:0/1850809802 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac004230 con 0x7fdfb809d6d0 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfb77fe700 1 -- 172.21.15.19:0/1850809802 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac004390 con 0x7fdfb809d6d0 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.331+0000 7fdfb77fe700 1 -- 172.21.15.19:0/1850809802 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0036a0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 -- 172.21.15.19:0/1850809802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 msgr2=0x7fdfb809daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 --2- 172.21.15.19:0/1850809802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0098f0 tx=0x7fdfac009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 -- 172.21.15.19:0/1850809802 shutdown_connections 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 --2- 172.21.15.19:0/1850809802 >> v2:172.21.15.19:3300/0 conn(0x7fdfb8133cd0 0x7fdfb813ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 --2- 172.21.15.19:0/1850809802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb809d6d0 0x7fdfb809daa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 -- 172.21.15.19:0/1850809802 >> 172.21.15.19:0/1850809802 conn(0x7fdfb8099c20 msgr2=0x7fdfb80a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 -- 172.21.15.19:0/1850809802 shutdown_connections 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.332+0000 7fdfbed04700 1 -- 172.21.15.19:0/1850809802 wait complete. 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.333+0000 7fdfbed04700 1 Processor -- start 2023-10-03T10:15:55.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.333+0000 7fdfbed04700 1 -- start start 2023-10-03T10:15:55.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 0x7fdfb811f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 0x7fdfb811f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb8133cd0 0x7fdfb811fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81327a0 con 0x7fdfb809dfe0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb809c900 con 0x7fdfb8133cd0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbed04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8122e60 con 0x7fdfb809d6d0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 0x7fdfb811f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfbcaa0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 0x7fdfb811f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfb7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 0x7fdfb811f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41664/0 (socket says 172.21.15.19:41664) 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.334+0000 7fdfb7fff700 1 -- 172.21.15.19:0/2637762165 learned_addr learned my addr 172.21.15.19:0/2637762165 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbd2a1700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb8133cd0 0x7fdfb811fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb8133cd0 msgr2=0x7fdfb811fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb8133cd0 0x7fdfb811fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 msgr2=0x7fdfb811f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 0x7fdfb811f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 -- 172.21.15.19:0/2637762165 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac009550 con 0x7fdfb809d6d0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbcaa0700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 0x7fdfb811f340 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdfac015000 tx=0x7fdfac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00b660 con 0x7fdfb809d6d0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac00b800 con 0x7fdfb809d6d0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb8121500 con 0x7fdfb809d6d0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00bbb0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.335+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb81225f0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.337+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb81345d0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.338+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdfac00bd10 con 0x7fdfb809d6d0 2023-10-03T10:15:55.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.338+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdfac0413c0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.346+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdfac02dd70 con 0x7fdfb809d6d0 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.396+0000 7fcf2d99e700 1 Processor -- start 2023-10-03T10:15:55.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 -- start start 2023-10-03T10:15:55.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf2813b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2809e770 con 0x7fcf280a0800 2023-10-03T10:15:55.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a1aa0 con 0x7fcf280a12e0 2023-10-03T10:15:55.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.397+0000 7fcf2d99e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2809cc80 con 0x7fcf28139110 2023-10-03T10:15:55.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33518/0 (socket says 172.21.15.19:33518) 2023-10-03T10:15:55.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 -- 172.21.15.19:0/4217158368 learned_addr learned my addr 172.21.15.19:0/4217158368 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf2d19d700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf2813b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 -- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 msgr2=0x7fcf2813b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf2813b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 -- 172.21.15.19:0/4217158368 >> v1:172.21.15.19:6789/0 conn(0x7fcf280a0800 legacy=0x7fcf280a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 -- 172.21.15.19:0/4217158368 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280a1c70 con 0x7fcf280a12e0 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf27fff700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009920 tx=0x7fcf14009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c972ae19ea4100a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf277fe700 1 -- 172.21.15.19:0/4217158368 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011830 con 0x7fcf280a12e0 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf277fe700 1 -- 172.21.15.19:0/4217158368 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14011990 con 0x7fcf280a12e0 2023-10-03T10:15:55.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.398+0000 7fcf277fe700 1 -- 172.21.15.19:0/4217158368 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011d20 con 0x7fcf280a12e0 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 -- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 msgr2=0x7fcf28138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009920 tx=0x7fcf14009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 -- 172.21.15.19:0/4217158368 shutdown_connections 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf2813b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/4217158368 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a12e0 0x7fcf28138bd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.399+0000 7fcf2d99e700 1 -- 172.21.15.19:0/4217158368 >> 172.21.15.19:0/4217158368 conn(0x7fcf280a6140 msgr2=0x7fcf280a6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.400+0000 7fcf2d99e700 1 -- 172.21.15.19:0/4217158368 shutdown_connections 2023-10-03T10:15:55.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.400+0000 7fcf2d99e700 1 -- 172.21.15.19:0/4217158368 wait complete. 2023-10-03T10:15:55.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.401+0000 7fcf2d99e700 1 Processor -- start 2023-10-03T10:15:55.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.401+0000 7fcf2d99e700 1 -- start start 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a0800 0x7fcf28122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf28123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280a5150 con 0x7fcf280a12e0 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28126340 con 0x7fcf280a0800 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d99e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281259e0 con 0x7fcf28139110 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf27fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41676/0 (socket says 172.21.15.19:41676) 2023-10-03T10:15:55.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf27fff700 1 -- 172.21.15.19:0/141821262 learned_addr learned my addr 172.21.15.19:0/141821262 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:55.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2d19d700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf28123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf2c99c700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a0800 0x7fcf28122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.402+0000 7fcf27fff700 1 -- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 msgr2=0x7fcf28123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf27fff700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf28123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf27fff700 1 -- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a0800 msgr2=0x7fcf28122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf27fff700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a0800 0x7fcf28122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf27fff700 1 -- 172.21.15.19:0/141821262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14009550 con 0x7fcf280a12e0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf27fff700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009f80 tx=0x7fcf14004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004240 con 0x7fcf280a12e0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1401f070 con 0x7fcf280a12e0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf28125c90 con 0x7fcf280a12e0 2023-10-03T10:15:55.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140045a0 con 0x7fcf280a12e0 2023-10-03T10:15:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.403+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28124ad0 con 0x7fcf280a12e0 2023-10-03T10:15:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.404+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf14021030 con 0x7fcf280a12e0 2023-10-03T10:15:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.404+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf14040840 con 0x7fcf280a12e0 2023-10-03T10:15:55.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.404+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2804f2a0 con 0x7fcf280a12e0 2023-10-03T10:15:55.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.409+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf14015080 con 0x7fcf280a12e0 2023-10-03T10:15:55.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.424+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f53c0074ea0 con 0x7f53c009e000 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.424+0000 7f53bd7fa700 1 -- 172.21.15.19:0/3455570635 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53b40102c0 con 0x7f53c009e000 2023-10-03T10:15:55.424 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.426+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 msgr2=0x7f53c01a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.426+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c520 tx=0x7f53b400c830 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 shutdown_connections 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f53c009e410 0x7f53c01c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f53c009d6f0 0x7f53c01a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 --2- 172.21.15.19:0/3455570635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f53c009e000 0x7f53c01a5780 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 >> 172.21.15.19:0/3455570635 conn(0x7f53c0066f50 msgr2=0x7f53c006f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 shutdown_connections 2023-10-03T10:15:55.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.427+0000 7f53c6ea2700 1 -- 172.21.15.19:0/3455570635 wait complete. 2023-10-03T10:15:55.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.519+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f603406c360 con 0x7f603409e410 2023-10-03T10:15:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.520+0000 7f601bfff700 1 -- 172.21.15.19:0/3634296679 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f602c02c090 con 0x7f603409e410 2023-10-03T10:15:55.520 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:55.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 msgr2=0x7f60341a6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f602c009dd0 tx=0x7f602c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 shutdown_connections 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603409e410 0x7f60341a6b60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603409d6f0 0x7f60341a60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 --2- 172.21.15.19:0/3634296679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603409e000 0x7f60341a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 >> 172.21.15.19:0/3634296679 conn(0x7f6034066f50 msgr2=0x7f60341baf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 shutdown_connections 2023-10-03T10:15:55.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.522+0000 7f6039973700 1 -- 172.21.15.19:0/3634296679 wait complete. 2023-10-03T10:15:55.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:55.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.574+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdfb806a9e0 con 0x7fdfb809d6d0 2023-10-03T10:15:55.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.575+0000 7fdfb57fa700 1 -- 172.21.15.19:0/2637762165 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdfac02db90 con 0x7fdfb809d6d0 2023-10-03T10:15:55.575 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:55.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 msgr2=0x7fdfb811f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 0x7fdfb811f340 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdfac015000 tx=0x7fdfac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 shutdown_connections 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdfb8133cd0 0x7fdfb811fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdfb809d6d0 0x7fdfb811f340 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 --2- 172.21.15.19:0/2637762165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb809dfe0 0x7fdfb811f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 >> 172.21.15.19:0/2637762165 conn(0x7fdfb8099c20 msgr2=0x7fdfb80a1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 shutdown_connections 2023-10-03T10:15:55.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.577+0000 7fdfbed04700 1 -- 172.21.15.19:0/2637762165 wait complete. 2023-10-03T10:15:55.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:55.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.618+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcf2809cec0 con 0x7fcf280a12e0 2023-10-03T10:15:55.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.619+0000 7fcf257fa700 1 -- 172.21.15.19:0/141821262 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf140036a0 con 0x7fcf280a12e0 2023-10-03T10:15:55.619 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:55.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 msgr2=0x7fcf28122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:55.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009f80 tx=0x7fcf14004750 comp rx=0 tx=0).stop 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 shutdown_connections 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf28139110 0x7fcf28123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf280a0800 0x7fcf28122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 --2- 172.21.15.19:0/141821262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf280a12e0 0x7fcf28122c50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 >> 172.21.15.19:0/141821262 conn(0x7fcf280a6140 msgr2=0x7fcf2811c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 shutdown_connections 2023-10-03T10:15:55.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:55.621+0000 7fcf2d99e700 1 -- 172.21.15.19:0/141821262 wait complete. 2023-10-03T10:15:55.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:56.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:56.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:56.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.591+0000 7f7c09870700 1 Processor -- start 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 -- start start 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 0x7f7c0409ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 0x7f7c0409cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0409ba70 con 0x7f7c04131970 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0409d4a0 con 0x7f7c040a0090 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.592+0000 7f7c09870700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0409e8f0 con 0x7f7c0409c650 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c037fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c04131970 0x7f7c04131e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34924/0 (socket says 172.21.15.19:34924) 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 0x7f7c0409cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c02ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 0x7f7c0409ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c037fe700 1 -- 172.21.15.19:0/589408288 learned_addr learned my addr 172.21.15.19:0/589408288 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c01ffb700 1 -- 172.21.15.19:0/589408288 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594877747 0 0) 0x7f7c0409ba70 con 0x7f7c04131970 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 -- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 msgr2=0x7f7c0409ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 0x7f7c0409ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 -- 172.21.15.19:0/589408288 >> v1:172.21.15.19:6789/0 conn(0x7f7c04131970 legacy=0x7f7c04131e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 -- 172.21.15.19:0/589408288 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040a0760 con 0x7f7c040a0090 2023-10-03T10:15:56.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c02ffd700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 0x7f7c0409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c027fc700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 0x7f7c0409cf60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0098a0 tx=0x7f7bec009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719385a9520c1c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c01ffb700 1 -- 172.21.15.19:0/589408288 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec011830 con 0x7f7c040a0090 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c01ffb700 1 -- 172.21.15.19:0/589408288 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec011990 con 0x7f7c040a0090 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.593+0000 7f7c01ffb700 1 -- 172.21.15.19:0/589408288 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bec011d20 con 0x7f7c040a0090 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 -- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 msgr2=0x7f7c0409cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 0x7f7c0409cf60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7bec0098a0 tx=0x7f7bec009bb0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 -- 172.21.15.19:0/589408288 shutdown_connections 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c0409c650 0x7f7c0409ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 --2- 172.21.15.19:0/589408288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c040a0090 0x7f7c0409cf60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 -- 172.21.15.19:0/589408288 >> 172.21.15.19:0/589408288 conn(0x7f7c040a3f70 msgr2=0x7f7c040a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 -- 172.21.15.19:0/589408288 shutdown_connections 2023-10-03T10:15:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.594+0000 7f7c09870700 1 -- 172.21.15.19:0/589408288 wait complete. 2023-10-03T10:15:56.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.596+0000 7f7c09870700 1 Processor -- start 2023-10-03T10:15:56.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.596+0000 7f7c09870700 1 -- start start 2023-10-03T10:15:56.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 0x7f7c0411bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 0x7f7c0411c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c04131970 0x7f7c0411c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0411e090 con 0x7f7c040a0090 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0411f150 con 0x7f7c0409c650 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c09870700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0409d980 con 0x7f7c04131970 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c027fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 0x7f7c0411c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 0x7f7c0411bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c027fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 0x7f7c0411c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38580/0 (socket says 172.21.15.19:38580) 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c027fc700 1 -- 172.21.15.19:0/3244184381 learned_addr learned my addr 172.21.15.19:0/3244184381 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c037fe700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c04131970 0x7f7c0411c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 -- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c04131970 msgr2=0x7f7c0411c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c04131970 0x7f7c0411c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 -- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 msgr2=0x7f7c0411c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 0x7f7c0411c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.597+0000 7f7c02ffd700 1 -- 172.21.15.19:0/3244184381 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf40094a0 con 0x7f7c0409c650 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7c02ffd700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 0x7f7c0411bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e9b0 tx=0x7f7bf400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf400ee50 con 0x7f7c0409c650 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf4013860 con 0x7f7c0409c650 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec0094a0 con 0x7f7c0409c650 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4013c10 con 0x7f7c0409c650 2023-10-03T10:15:56.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.598+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0411dab0 con 0x7f7c0409c650 2023-10-03T10:15:56.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.599+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c040747f0 con 0x7f7c0409c650 2023-10-03T10:15:56.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.599+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7bf400c640 con 0x7f7c0409c650 2023-10-03T10:15:56.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.600+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7bf4043aa0 con 0x7f7c0409c650 2023-10-03T10:15:56.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.604+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7bf401b440 con 0x7f7c0409c650 2023-10-03T10:15:56.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:56.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.693+0000 7f631c226700 1 Processor -- start 2023-10-03T10:15:56.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 -- start start 2023-10-03T10:15:56.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 0x7f63141339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f631409e410 0x7f6314133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631406b460 con 0x7f631409e410 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631409b120 con 0x7f631409d6f0 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.694+0000 7f631c226700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631409a7e0 con 0x7f631409e000 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38640/0 (socket says 172.21.15.19:38640) 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 -- 172.21.15.19:0/4197027453 learned_addr learned my addr 172.21.15.19:0/4197027453 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f631a7c3700 1 --2- 172.21.15.19:0/4197027453 >> v2:172.21.15.19:3300/0 conn(0x7f631409e410 0x7f6314133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f63197c1700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 0x7f63141339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 -- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 msgr2=0x7f63141339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 0x7f63141339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 -- 172.21.15.19:0/4197027453 >> v2:172.21.15.19:3300/0 conn(0x7f631409e410 msgr2=0x7f6314133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 --2- 172.21.15.19:0/4197027453 >> v2:172.21.15.19:3300/0 conn(0x7f631409e410 0x7f6314133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 -- 172.21.15.19:0/4197027453 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631409a500 con 0x7f631409d6f0 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f63197c1700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 0x7f63141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.695+0000 7f6319fc2700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6310009920 tx=0x7f6310009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6d8879327fb7a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.696+0000 7f6318fc0700 1 -- 172.21.15.19:0/4197027453 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310011830 con 0x7f631409d6f0 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.696+0000 7f6318fc0700 1 -- 172.21.15.19:0/4197027453 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310011990 con 0x7f631409d6f0 2023-10-03T10:15:56.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.696+0000 7f6318fc0700 1 -- 172.21.15.19:0/4197027453 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310011d20 con 0x7f631409d6f0 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 -- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 msgr2=0x7f631409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6310009920 tx=0x7f6310009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 -- 172.21.15.19:0/4197027453 shutdown_connections 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409d6f0 0x7f631409dac0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 --2- 172.21.15.19:0/4197027453 >> v2:172.21.15.19:3300/0 conn(0x7f631409e410 0x7f6314133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 --2- 172.21.15.19:0/4197027453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e000 0x7f63141339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 -- 172.21.15.19:0/4197027453 >> 172.21.15.19:0/4197027453 conn(0x7f6314066f50 msgr2=0x7f631409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 -- 172.21.15.19:0/4197027453 shutdown_connections 2023-10-03T10:15:56.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.697+0000 7f631c226700 1 -- 172.21.15.19:0/4197027453 wait complete. 2023-10-03T10:15:56.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.698+0000 7f631c226700 1 Processor -- start 2023-10-03T10:15:56.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.698+0000 7f631c226700 1 -- start start 2023-10-03T10:15:56.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631409d6f0 0x7f63141a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e410 0x7f63141a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63141aa310 con 0x7f631409d6f0 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63141a7a40 con 0x7f631409e000 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f631c226700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63141a8c90 con 0x7f631409e410 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f63197c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f63197c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38646/0 (socket says 172.21.15.19:38646) 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f63197c1700 1 -- 172.21.15.19:0/3476021637 learned_addr learned my addr 172.21.15.19:0/3476021637 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.699+0000 7f6319fc2700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631409d6f0 0x7f63141a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f631a7c3700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e410 0x7f63141a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 -- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e410 msgr2=0x7f63141a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e410 0x7f63141a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 -- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631409d6f0 msgr2=0x7f63141a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631409d6f0 0x7f63141a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 -- 172.21.15.19:0/3476021637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63040094a0 con 0x7f631409e000 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f63197c1700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6304009f50 tx=0x7f630400ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6304017c60 con 0x7f631409e000 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6304017dc0 con 0x7f631409e000 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400c7e0 con 0x7f631409e000 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.700+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6310009550 con 0x7f631409e000 2023-10-03T10:15:56.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.701+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63140a20b0 con 0x7f631409e000 2023-10-03T10:15:56.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.702+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6314074ea0 con 0x7f631409e000 2023-10-03T10:15:56.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.702+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f630400c940 con 0x7f631409e000 2023-10-03T10:15:56.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.702+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f630401ee00 con 0x7f631409e000 2023-10-03T10:15:56.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.711+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f630404d060 con 0x7f631409e000 2023-10-03T10:15:56.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 Processor -- start 2023-10-03T10:15:56.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 -- start start 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee9409e000 0x7fee941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e410 0x7fee94133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9406b460 con 0x7fee9409e000 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409b120 con 0x7fee9409d6f0 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.747+0000 7fee9ac8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee9409a7e0 con 0x7fee9409e410 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee98a2a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee98a2a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38660/0 (socket says 172.21.15.19:38660) 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee9409e000 0x7fee941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee98a2a700 1 -- 172.21.15.19:0/105272909 learned_addr learned my addr 172.21.15.19:0/105272909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee9922b700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e410 0x7fee94133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 -- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e410 msgr2=0x7fee94133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e410 0x7fee94133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 -- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 msgr2=0x7fee9409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 -- 172.21.15.19:0/105272909 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9409a500 con 0x7fee9409e000 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee98a2a700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee93fff700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409e000 0x7fee941339f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fee80009840 tx=0x7fee80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7707d3ed69b78d7e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.748+0000 7fee937fe700 1 -- 172.21.15.19:0/105272909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80011830 con 0x7fee9409e000 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee937fe700 1 -- 172.21.15.19:0/105272909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee80011990 con 0x7fee9409e000 2023-10-03T10:15:56.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee937fe700 1 -- 172.21.15.19:0/105272909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80011d20 con 0x7fee9409e000 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 -- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409e000 msgr2=0x7fee941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409e000 0x7fee941339f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fee80009840 tx=0x7fee80009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 -- 172.21.15.19:0/105272909 shutdown_connections 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409d6f0 0x7fee9409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e410 0x7fee94133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/105272909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409e000 0x7fee941339f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 -- 172.21.15.19:0/105272909 >> 172.21.15.19:0/105272909 conn(0x7fee94066f50 msgr2=0x7fee9409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 -- 172.21.15.19:0/105272909 shutdown_connections 2023-10-03T10:15:56.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.749+0000 7fee9ac8e700 1 -- 172.21.15.19:0/105272909 wait complete. 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.750+0000 7fee9ac8e700 1 Processor -- start 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.750+0000 7fee9ac8e700 1 -- start start 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 0x7fee941a6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409e410 0x7fee941a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee941a7520 con 0x7fee9409d6f0 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee941a9b20 con 0x7fee9409e410 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9ac8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee941a8230 con 0x7fee9409e000 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee98a2a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee98a2a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38616/0 (socket says 172.21.15.19:38616) 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee98a2a700 1 -- 172.21.15.19:0/1171080404 learned_addr learned my addr 172.21.15.19:0/1171080404 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee9922b700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409e410 0x7fee941a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.751+0000 7fee93fff700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 0x7fee941a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 -- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 msgr2=0x7fee941a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 0x7fee941a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 -- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409e410 msgr2=0x7fee941a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409e410 0x7fee941a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 -- 172.21.15.19:0/1171080404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009550 con 0x7fee9409d6f0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee93fff700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 0x7fee941a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee98a2a700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ec10 tx=0x7fee8800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800c850 con 0x7fee9409d6f0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800c9b0 con 0x7fee9409d6f0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800cd20 con 0x7fee9409d6f0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee800094a0 con 0x7fee9409d6f0 2023-10-03T10:15:56.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.752+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee940a1fb0 con 0x7fee9409d6f0 2023-10-03T10:15:56.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.753+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee88013470 con 0x7fee9409d6f0 2023-10-03T10:15:56.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.753+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee94074ea0 con 0x7fee9409d6f0 2023-10-03T10:15:56.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.754+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee8803f9b0 con 0x7fee9409d6f0 2023-10-03T10:15:56.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.763+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee880232f0 con 0x7fee9409d6f0 2023-10-03T10:15:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 Processor -- start 2023-10-03T10:15:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 -- start start 2023-10-03T10:15:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809e930 0x7f06f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06f809f240 0x7f06f81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809f650 0x7f06f8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f8070940 con 0x7f06f809f240 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f806fd60 con 0x7f06f809f650 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.818+0000 7f06fd547700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f806fa80 con 0x7f06f809e930 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06f809f240 0x7f06f81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06f809f240 0x7f06f81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38622/0 (socket says 172.21.15.19:38622) 2023-10-03T10:15:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 -- 172.21.15.19:0/2699905471 learned_addr learned my addr 172.21.15.19:0/2699905471 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f77fe700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809f650 0x7f06f8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 -- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809e930 msgr2=0x7f06f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809e930 0x7f06f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 -- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809f650 msgr2=0x7f06f8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809f650 0x7f06f8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 -- 172.21.15.19:0/2699905471 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f809fb60 con 0x7f06f809f240 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.819+0000 7f06f67fc700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81317f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0098f0 tx=0x7f06ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e531739c8e7c586 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06f5ffb700 1 -- 172.21.15.19:0/2699905471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00b8a0 con 0x7f06f809f240 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06f5ffb700 1 -- 172.21.15.19:0/2699905471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00ba00 con 0x7f06f809f240 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06f5ffb700 1 -- 172.21.15.19:0/2699905471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00bd90 con 0x7f06f809f240 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 -- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 msgr2=0x7f06f81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81317f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f06ec0098f0 tx=0x7f06ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 -- 172.21.15.19:0/2699905471 shutdown_connections 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809f650 0x7f06f8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809e930 0x7f06f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 --2- 172.21.15.19:0/2699905471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81317f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 -- 172.21.15.19:0/2699905471 >> 172.21.15.19:0/2699905471 conn(0x7f06f80a4210 msgr2=0x7f06f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 -- 172.21.15.19:0/2699905471 shutdown_connections 2023-10-03T10:15:56.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.820+0000 7f06fd547700 1 -- 172.21.15.19:0/2699905471 wait complete. 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 Processor -- start 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 -- start start 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809e930 0x7f06f81a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809f650 0x7f06f81a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:56.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81a4930 con 0x7f06f809f240 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81a5b80 con 0x7f06f809e930 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06fd547700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81a4f10 con 0x7f06f809f650 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06f67fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38628/0 (socket says 172.21.15.19:38628) 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06f67fc700 1 -- 172.21.15.19:0/988636735 learned_addr learned my addr 172.21.15.19:0/988636735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.822+0000 7f06f77fe700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809f650 0x7f06f81a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f6ffd700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809e930 0x7f06f81a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 -- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809f650 msgr2=0x7f06f81a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809f650 0x7f06f81a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 -- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809e930 msgr2=0x7f06f81a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809e930 0x7f06f81a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 -- 172.21.15.19:0/988636735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009550 con 0x7f06f809f240 2023-10-03T10:15:56.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06f67fc700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009c40 tx=0x7f06ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:56.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec004400 con 0x7f06f809f240 2023-10-03T10:15:56.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec01f070 con 0x7f06f809f240 2023-10-03T10:15:56.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f80a0190 con 0x7f06f809f240 2023-10-03T10:15:56.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0038e0 con 0x7f06f809f240 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.823+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f80a3900 con 0x7f06f809f240 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.825+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06ec021030 con 0x7f06f809f240 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.825+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06ec004560 con 0x7f06f809f240 2023-10-03T10:15:56.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.825+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f8071d80 con 0x7f06f809f240 2023-10-03T10:15:56.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.831+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c0411ed00 con 0x7f7c0409c650 2023-10-03T10:15:56.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.832+0000 7f7bfbfff700 1 -- 172.21.15.19:0/3244184381 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7bf4020070 con 0x7f7c0409c650 2023-10-03T10:15:56.831 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:56.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.833+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06ec015030 con 0x7f06f809f240 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 msgr2=0x7f7c0411bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 0x7f7c0411bf30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400e9b0 tx=0x7f7bf400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 shutdown_connections 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c04131970 0x7f7c0411c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c0409c650 0x7f7c0411bf30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 --2- 172.21.15.19:0/3244184381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c040a0090 0x7f7c0411c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 >> 172.21.15.19:0/3244184381 conn(0x7f7c040a3f70 msgr2=0x7f7c041b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 shutdown_connections 2023-10-03T10:15:56.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.835+0000 7f7c09870700 1 -- 172.21.15.19:0/3244184381 wait complete. 2023-10-03T10:15:56.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.984+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fee941a96c0 con 0x7fee9409d6f0 2023-10-03T10:15:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.984+0000 7fee917fa700 1 -- 172.21.15.19:0/1171080404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee941a96c0 con 0x7fee9409d6f0 2023-10-03T10:15:56.984 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:56.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.987+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 msgr2=0x7fee941a6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.987+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fee8800ec10 tx=0x7fee8800ef20 comp rx=0 tx=0).stop 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 shutdown_connections 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee9409e410 0x7fee941a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee9409d6f0 0x7fee941a6050 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 --2- 172.21.15.19:0/1171080404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee9409e000 0x7fee941a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 >> 172.21.15.19:0/1171080404 conn(0x7fee94066f50 msgr2=0x7fee941bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 shutdown_connections 2023-10-03T10:15:56.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:56.988+0000 7fee9ac8e700 1 -- 172.21.15.19:0/1171080404 wait complete. 2023-10-03T10:15:57.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:57.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.011+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f631406c360 con 0x7f631409e000 2023-10-03T10:15:57.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.012+0000 7f630a7fc700 1 -- 172.21.15.19:0/3476021637 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6304024020 con 0x7f631409e000 2023-10-03T10:15:57.012 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:57.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 msgr2=0x7f63141a6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6304009f50 tx=0x7f630400ee10 comp rx=0 tx=0).stop 2023-10-03T10:15:57.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 shutdown_connections 2023-10-03T10:15:57.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631409e410 0x7f63141a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631409d6f0 0x7f63141a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 --2- 172.21.15.19:0/3476021637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631409e000 0x7f63141a6370 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 >> 172.21.15.19:0/3476021637 conn(0x7f6314066f50 msgr2=0x7f63141baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 shutdown_connections 2023-10-03T10:15:57.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.014+0000 7f631c226700 1 -- 172.21.15.19:0/3476021637 wait complete. 2023-10-03T10:15:57.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.097+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f06f8074ea0 con 0x7f06f809f240 2023-10-03T10:15:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.097+0000 7f06df7fe700 1 -- 172.21.15.19:0/988636735 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06ec0199a0 con 0x7f06f809f240 2023-10-03T10:15:57.097 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:57.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 msgr2=0x7f06f81a3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:57.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009c40 tx=0x7f06ec004750 comp rx=0 tx=0).stop 2023-10-03T10:15:57.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 shutdown_connections 2023-10-03T10:15:57.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06f809f650 0x7f06f81a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06f809e930 0x7f06f81a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 --2- 172.21.15.19:0/988636735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06f809f240 0x7f06f81a3260 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 >> 172.21.15.19:0/988636735 conn(0x7f06f80a4210 msgr2=0x7f06f81b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 shutdown_connections 2023-10-03T10:15:57.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:57.099+0000 7f06fd547700 1 -- 172.21.15.19:0/988636735 wait complete. 2023-10-03T10:15:57.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:57.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:58.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 Processor -- start 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 -- start start 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bc809d5c0 0x7f5bc80a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc80a1810 con 0x7f5bc8133920 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc809ea10 con 0x7f5bc809d5c0 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bcd77e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc809e210 con 0x7f5bc80a09c0 2023-10-03T10:15:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.001+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50444/0 (socket says 172.21.15.19:50444) 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bc809d5c0 0x7f5bc80a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5bc8133920 0x7f5bc8133da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34940/0 (socket says 172.21.15.19:34940) 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc6ffd700 1 -- 172.21.15.19:0/1996286996 learned_addr learned my addr 172.21.15.19:0/1996286996 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 -- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 msgr2=0x7f5bc80a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 -- 172.21.15.19:0/1996286996 >> v1:172.21.15.19:6789/0 conn(0x7f5bc8133920 legacy=0x7f5bc8133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 -- 172.21.15.19:0/1996286996 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80a26f0 con 0x7f5bc809d5c0 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc5ffb700 1 -- 172.21.15.19:0/1996286996 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984739560 0 0) 0x7f5bc80a1810 con 0x7f5bc8133920 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc6ffd700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc67fc700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc80a12d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009840 tx=0x7f5bbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936119bd4a3fcbff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc5ffb700 1 -- 172.21.15.19:0/1996286996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011830 con 0x7f5bc809d5c0 2023-10-03T10:15:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc5ffb700 1 -- 172.21.15.19:0/1996286996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc011990 con 0x7f5bc809d5c0 2023-10-03T10:15:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.002+0000 7f5bc5ffb700 1 -- 172.21.15.19:0/1996286996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc011d20 con 0x7f5bc809d5c0 2023-10-03T10:15:58.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 -- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 msgr2=0x7f5bc80a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc80a12d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc009840 tx=0x7f5bbc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 -- 172.21.15.19:0/1996286996 shutdown_connections 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc80a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/1996286996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc80a12d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 -- 172.21.15.19:0/1996286996 >> 172.21.15.19:0/1996286996 conn(0x7f5bc80a2fe0 msgr2=0x7f5bc80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 -- 172.21.15.19:0/1996286996 shutdown_connections 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.003+0000 7f5bcd77e700 1 -- 172.21.15.19:0/1996286996 wait complete. 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.004+0000 7f5bcd77e700 1 Processor -- start 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.004+0000 7f5bcd77e700 1 -- start start 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 0x7f5bc811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc81bcd50 con 0x7f5bc809d5c0 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8122430 con 0x7f5bc8133920 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bcd77e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc8120420 con 0x7f5bc80a09c0 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38656/0 (socket says 172.21.15.19:38656) 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc6ffd700 1 -- 172.21.15.19:0/537476046 learned_addr learned my addr 172.21.15.19:0/537476046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 0x7f5bc811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 -- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 msgr2=0x7f5bc811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 -- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 msgr2=0x7f5bc81c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 -- 172.21.15.19:0/537476046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb8009550 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc6ffd700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc67fc700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5bc77fe700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 0x7f5bc811ed50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000cbe0 tx=0x7f5bc000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.005+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc000aa40 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.006+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bc000abc0 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.006+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc0094a0 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.006+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc00070d0 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.006+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc809cec0 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.006+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc80747f0 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.007+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bc0007230 con 0x7f5bc8133920 2023-10-03T10:15:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.007+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bc003f710 con 0x7f5bc8133920 2023-10-03T10:15:58.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.012+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bc00074e0 con 0x7f5bc8133920 2023-10-03T10:15:58.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:58.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 Processor -- start 2023-10-03T10:15:58.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 -- start start 2023-10-03T10:15:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f998009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998009e000 0x7f99801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998009b120 con 0x7f998009e410 2023-10-03T10:15:58.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998006b460 con 0x7f998009e000 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f9985876700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998009a7e0 con 0x7f998009d6f0 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.153+0000 7f997e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998009e000 0x7f99801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998009e000 0x7f99801339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38658/0 (socket says 172.21.15.19:38658) 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 -- 172.21.15.19:0/806784537 learned_addr learned my addr 172.21.15.19:0/806784537 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 -- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 msgr2=0x7f998009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 --2- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f998009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 -- 172.21.15.19:0/806784537 >> v1:172.21.15.19:6789/0 conn(0x7f998009e410 legacy=0x7f9980133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 -- 172.21.15.19:0/806784537 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998009a500 con 0x7f998009e000 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997e7fc700 1 --2- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801339f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f99740098f0 tx=0x7f9974009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53434fcb034b4daf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997dffb700 1 -- 172.21.15.19:0/806784537 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400b8a0 con 0x7f998009e000 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997dffb700 1 -- 172.21.15.19:0/806784537 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997400ba00 con 0x7f998009e000 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.154+0000 7f997dffb700 1 -- 172.21.15.19:0/806784537 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997400bd90 con 0x7f998009e000 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.155+0000 7f9985876700 1 -- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 msgr2=0x7f99801339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.155+0000 7f9985876700 1 --2- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801339f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f99740098f0 tx=0x7f9974009c00 comp rx=0 tx=0).stop 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 -- 172.21.15.19:0/806784537 shutdown_connections 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 --2- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f998009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 --2- 172.21.15.19:0/806784537 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801339f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 -- 172.21.15.19:0/806784537 >> 172.21.15.19:0/806784537 conn(0x7f9980066f50 msgr2=0x7f998009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 -- 172.21.15.19:0/806784537 shutdown_connections 2023-10-03T10:15:58.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.156+0000 7f9985876700 1 -- 172.21.15.19:0/806784537 wait complete. 2023-10-03T10:15:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.157+0000 7f9985876700 1 Processor -- start 2023-10-03T10:15:58.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.157+0000 7f9985876700 1 -- start start 2023-10-03T10:15:58.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99801a7b10 con 0x7f998009e000 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99801a7450 con 0x7f998009d6f0 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f9985876700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99801a8380 con 0x7f998009e410 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f997f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f997effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f997f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50462/0 (socket says 172.21.15.19:50462) 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f997effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38724/0 (socket says 172.21.15.19:38724) 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.158+0000 7f997f7fe700 1 -- 172.21.15.19:0/1048452581 learned_addr learned my addr 172.21.15.19:0/1048452581 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997e7fc700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 -- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 msgr2=0x7f99801a6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 -- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 msgr2=0x7f99801a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801a65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 -- 172.21.15.19:0/1048452581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009550 con 0x7f998009e410 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997effd700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f997f7fe700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f997800cc50 tx=0x7f997800cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9978003c00 con 0x7f998009e410 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.159+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9978003d60 con 0x7f998009e410 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.160+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99800a3210 con 0x7f998009e410 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.160+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800aab0 con 0x7f998009e410 2023-10-03T10:15:58.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.160+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99801a8930 con 0x7f998009e410 2023-10-03T10:15:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.161+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99801a9450 con 0x7f998009e410 2023-10-03T10:15:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.161+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f997800ac10 con 0x7f998009e410 2023-10-03T10:15:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.161+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f997803f5f0 con 0x7f998009e410 2023-10-03T10:15:58.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.166+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99801a9450 con 0x7f998009e410 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.198+0000 7ffb5650b700 1 Processor -- start 2023-10-03T10:15:58.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 -- start start 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009d6f0 0x7ffb5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5009f130 con 0x7ffb5009e000 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5009f520 con 0x7ffb5009e410 2023-10-03T10:15:58.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.199+0000 7ffb5650b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5009e930 con 0x7ffb5009d6f0 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38728/0 (socket says 172.21.15.19:38728) 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 -- 172.21.15.19:0/1073104197 learned_addr learned my addr 172.21.15.19:0/1073104197 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb4ffff700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009d6f0 0x7ffb5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 -- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009d6f0 msgr2=0x7ffb5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009d6f0 0x7ffb5009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 -- 172.21.15.19:0/1073104197 >> v1:172.21.15.19:6789/0 conn(0x7ffb5009e000 legacy=0x7ffb50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 -- 172.21.15.19:0/1073104197 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5009b2d0 con 0x7ffb5009e410 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb54aa8700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009e80 tx=0x7ffb4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ee26fe66cb9061d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.200+0000 7ffb4effd700 1 -- 172.21.15.19:0/1073104197 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4800e070 con 0x7ffb5009e410 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb4effd700 1 -- 172.21.15.19:0/1073104197 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48003a20 con 0x7ffb5009e410 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb4effd700 1 -- 172.21.15.19:0/1073104197 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48003dd0 con 0x7ffb5009e410 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 -- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 msgr2=0x7ffb50130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009e80 tx=0x7ffb4800b330 comp rx=0 tx=0).stop 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 -- 172.21.15.19:0/1073104197 shutdown_connections 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e410 0x7ffb50130d70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 --2- 172.21.15.19:0/1073104197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009d6f0 0x7ffb5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 -- 172.21.15.19:0/1073104197 >> 172.21.15.19:0/1073104197 conn(0x7ffb50066f50 msgr2=0x7ffb5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 -- 172.21.15.19:0/1073104197 shutdown_connections 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.201+0000 7ffb5650b700 1 -- 172.21.15.19:0/1073104197 wait complete. 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.203+0000 7ffb5650b700 1 Processor -- start 2023-10-03T10:15:58.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.203+0000 7ffb5650b700 1 -- start start 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 0x7ffb501c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009e410 0x7ffb501c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501c5c20 con 0x7ffb5009d6f0 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50132550 con 0x7ffb5009e000 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb5650b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50072250 con 0x7ffb5009e410 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38668/0 (socket says 172.21.15.19:38668) 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 -- 172.21.15.19:0/2697693544 learned_addr learned my addr 172.21.15.19:0/2697693544 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4f7fe700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 0x7ffb501c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb54aa8700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009e410 0x7ffb501c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 -- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009e410 msgr2=0x7ffb501c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009e410 0x7ffb501c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 -- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 msgr2=0x7ffb501c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 0x7ffb501c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.204+0000 7ffb4ffff700 1 -- 172.21.15.19:0/2697693544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009b30 con 0x7ffb5009d6f0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb4f7fe700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 0x7ffb501c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb4ffff700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e9b0 tx=0x7ffb4000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40009710 con 0x7ffb5009d6f0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000c850 con 0x7ffb5009d6f0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5009c700 con 0x7ffb5009d6f0 2023-10-03T10:15:58.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000cbc0 con 0x7ffb5009d6f0 2023-10-03T10:15:58.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.205+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb50130e90 con 0x7ffb5009d6f0 2023-10-03T10:15:58.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.206+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb50074ea0 con 0x7ffb5009d6f0 2023-10-03T10:15:58.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.207+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb4000cd20 con 0x7ffb5009d6f0 2023-10-03T10:15:58.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.211+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb40012d90 con 0x7ffb5009d6f0 2023-10-03T10:15:58.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.212+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb400102b0 con 0x7ffb5009d6f0 2023-10-03T10:15:58.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.230+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bc81332c0 con 0x7f5bc8133920 2023-10-03T10:15:58.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.231+0000 7f5baf7fe700 1 -- 172.21.15.19:0/537476046 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bc0018020 con 0x7f5bc8133920 2023-10-03T10:15:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 msgr2=0x7f5bc811ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 0x7f5bc811ed50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bc000cbe0 tx=0x7f5bc000cef0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 shutdown_connections 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bc8133920 0x7f5bc811ed50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bc809d5c0 0x7f5bc81c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 --2- 172.21.15.19:0/537476046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bc80a09c0 0x7f5bc811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 >> 172.21.15.19:0/537476046 conn(0x7f5bc80a2fe0 msgr2=0x7f5bc809ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 shutdown_connections 2023-10-03T10:15:58.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.233+0000 7f5bcd77e700 1 -- 172.21.15.19:0/537476046 wait complete. 2023-10-03T10:15:58.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.265+0000 7f386cc15700 1 Processor -- start 2023-10-03T10:15:58.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 -- start start 2023-10-03T10:15:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 0x7f386809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 0x7f38681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386809b120 con 0x7f386809e410 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386806b460 con 0x7f386809e000 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386cc15700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386809a7e0 con 0x7f386809d6f0 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f386659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 0x7f386809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f3865d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 0x7f38681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f3866d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f386809e410 0x7f3868133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34956/0 (socket says 172.21.15.19:34956) 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.266+0000 7f3866d9d700 1 -- 172.21.15.19:0/1395420404 learned_addr learned my addr 172.21.15.19:0/1395420404 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:58.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386559a700 1 -- 172.21.15.19:0/1395420404 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332315214 0 0) 0x7f386809b120 con 0x7f386809e410 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386659c700 1 -- 172.21.15.19:0/1395420404 >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 msgr2=0x7f38681339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386659c700 1 --2- 172.21.15.19:0/1395420404 >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 0x7f38681339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386659c700 1 -- 172.21.15.19:0/1395420404 >> v1:172.21.15.19:6789/0 conn(0x7f386809e410 legacy=0x7f3868133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386659c700 1 -- 172.21.15.19:0/1395420404 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386809a500 con 0x7f386809d6f0 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f3865d9b700 1 --2- 172.21.15.19:0/1395420404 >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 0x7f38681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386659c700 1 --2- 172.21.15.19:0/1395420404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 0x7f386809dac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3858009870 tx=0x7f3858009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a8bdd4a5eda720 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386559a700 1 -- 172.21.15.19:0/1395420404 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858011830 con 0x7f386809d6f0 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386559a700 1 -- 172.21.15.19:0/1395420404 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3858011990 con 0x7f386809d6f0 2023-10-03T10:15:58.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.267+0000 7f386559a700 1 -- 172.21.15.19:0/1395420404 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858011d20 con 0x7f386809d6f0 2023-10-03T10:15:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 -- 172.21.15.19:0/1395420404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 msgr2=0x7f386809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 --2- 172.21.15.19:0/1395420404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 0x7f386809dac0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3858009870 tx=0x7f3858009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 -- 172.21.15.19:0/1395420404 shutdown_connections 2023-10-03T10:15:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 --2- 172.21.15.19:0/1395420404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809d6f0 0x7f386809dac0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 --2- 172.21.15.19:0/1395420404 >> v2:172.21.15.19:3300/0 conn(0x7f386809e000 0x7f38681339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 -- 172.21.15.19:0/1395420404 >> 172.21.15.19:0/1395420404 conn(0x7f3868066f50 msgr2=0x7f386809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 -- 172.21.15.19:0/1395420404 shutdown_connections 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.268+0000 7f386cc15700 1 -- 172.21.15.19:0/1395420404 wait complete. 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.269+0000 7f386cc15700 1 Processor -- start 2023-10-03T10:15:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.269+0000 7f386cc15700 1 -- start start 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 0x7f38681c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 0x7f38681c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f386809e410 0x7f38681c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386809c710 con 0x7f386809d6f0 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38681a80e0 con 0x7f386809e000 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386cc15700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38681a63d0 con 0x7f386809e410 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f3865d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 0x7f38681c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f3865d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 0x7f38681c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38750/0 (socket says 172.21.15.19:38750) 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f3865d9b700 1 -- 172.21.15.19:0/3019126245 learned_addr learned my addr 172.21.15.19:0/3019126245 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 0x7f38681c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f3866d9d700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f386809e410 0x7f38681c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 -- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f386809e410 msgr2=0x7f38681c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f386809e410 0x7f38681c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 -- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 msgr2=0x7f38681c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 0x7f38681c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.270+0000 7f386659c700 1 -- 172.21.15.19:0/3019126245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c0094a0 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f386659c700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 0x7f38681c8020 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f386809ac00 tx=0x7f3858004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38580036a0 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385801f070 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38580094a0 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3858003a40 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.271+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38681a6bc0 con 0x7f386809d6f0 2023-10-03T10:15:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.272+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3858003ba0 con 0x7f386809d6f0 2023-10-03T10:15:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.272+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38681a70a0 con 0x7f386809d6f0 2023-10-03T10:15:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.272+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3858021070 con 0x7f386809d6f0 2023-10-03T10:15:58.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.281+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3858026480 con 0x7f386809d6f0 2023-10-03T10:15:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.394+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f99801a9450 con 0x7f998009e410 2023-10-03T10:15:58.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.394+0000 7f9967fff700 1 -- 172.21.15.19:0/1048452581 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99801a9450 con 0x7f998009e410 2023-10-03T10:15:58.394 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 msgr2=0x7f99801a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f997800cc50 tx=0x7f997800cf60 comp rx=0 tx=0).stop 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 shutdown_connections 2023-10-03T10:15:58.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998009e410 0x7f99801a6b00 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009d6f0 0x7f99801a6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 --2- 172.21.15.19:0/1048452581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009e000 0x7f99801a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 >> 172.21.15.19:0/1048452581 conn(0x7f9980066f50 msgr2=0x7f99801baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 shutdown_connections 2023-10-03T10:15:58.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.396+0000 7f9985876700 1 -- 172.21.15.19:0/1048452581 wait complete. 2023-10-03T10:15:58.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:58.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.441+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb5006c360 con 0x7ffb5009d6f0 2023-10-03T10:15:58.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.442+0000 7ffb4cff9700 1 -- 172.21.15.19:0/2697693544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb40017070 con 0x7ffb5009d6f0 2023-10-03T10:15:58.442 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 msgr2=0x7ffb501c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e9b0 tx=0x7ffb4000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 shutdown_connections 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5009e410 0x7ffb501c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5009d6f0 0x7ffb501c51a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 --2- 172.21.15.19:0/2697693544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009e000 0x7ffb501c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 >> 172.21.15.19:0/2697693544 conn(0x7ffb50066f50 msgr2=0x7ffb500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 shutdown_connections 2023-10-03T10:15:58.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.444+0000 7ffb5650b700 1 -- 172.21.15.19:0/2697693544 wait complete. 2023-10-03T10:15:58.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:58.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.491+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3868074ea0 con 0x7f386809d6f0 2023-10-03T10:15:58.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.491+0000 7f3856ffd700 1 -- 172.21.15.19:0/3019126245 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f385802b020 con 0x7f386809d6f0 2023-10-03T10:15:58.491 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 msgr2=0x7f38681c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 0x7f38681c8020 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f386809ac00 tx=0x7f3858004750 comp rx=0 tx=0).stop 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 shutdown_connections 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f386809e410 0x7f38681c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f386809d6f0 0x7f38681c8020 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.493+0000 7f386cc15700 1 --2- 172.21.15.19:0/3019126245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f386809e000 0x7f38681c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.494+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 >> 172.21.15.19:0/3019126245 conn(0x7f3868066f50 msgr2=0x7f38681bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.494+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 shutdown_connections 2023-10-03T10:15:58.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:58.494+0000 7f386cc15700 1 -- 172.21.15.19:0/3019126245 wait complete. 2023-10-03T10:15:58.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:15:59.249 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:15:59.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.395+0000 7f02f9771700 1 Processor -- start 2023-10-03T10:15:59.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.395+0000 7f02f9771700 1 -- start start 2023-10-03T10:15:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f9771700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f9771700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f02f409f240 0x7f02f41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f9771700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f4070940 con 0x7f02f409f650 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f9771700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f406fd60 con 0x7f02f409f240 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f9771700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f406fa80 con 0x7f02f409e930 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38754/0 (socket says 172.21.15.19:38754) 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f2ffd700 1 -- 172.21.15.19:0/1402197309 learned_addr learned my addr 172.21.15.19:0/1402197309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f27fc700 1 --2- 172.21.15.19:0/1402197309 >> v2:172.21.15.19:3300/0 conn(0x7f02f409f240 0x7f02f41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f27fc700 1 -- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 msgr2=0x7f02f409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f27fc700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f27fc700 1 -- 172.21.15.19:0/1402197309 >> v1:172.21.15.19:6789/0 conn(0x7f02f409f650 legacy=0x7f02f4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f27fc700 1 -- 172.21.15.19:0/1402197309 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f409fb60 con 0x7f02f409f240 2023-10-03T10:15:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f2ffd700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.396+0000 7f02f1ffb700 1 -- 172.21.15.19:0/1402197309 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029171633 0 0) 0x7f02f4070940 con 0x7f02f409f650 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f27fc700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f41317f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009840 tx=0x7f02dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5313fd063e42d332 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f1ffb700 1 -- 172.21.15.19:0/1402197309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc011830 con 0x7f02f409f240 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f1ffb700 1 -- 172.21.15.19:0/1402197309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc011990 con 0x7f02f409f240 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f1ffb700 1 -- 172.21.15.19:0/1402197309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc011d20 con 0x7f02f409f240 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 -- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 msgr2=0x7f02f41317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f41317f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f02dc009840 tx=0x7f02dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 -- 172.21.15.19:0/1402197309 shutdown_connections 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409e930 0x7f02f409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 --2- 172.21.15.19:0/1402197309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f41317f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 -- 172.21.15.19:0/1402197309 >> 172.21.15.19:0/1402197309 conn(0x7f02f40a4210 msgr2=0x7f02f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 -- 172.21.15.19:0/1402197309 shutdown_connections 2023-10-03T10:15:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.397+0000 7f02f9771700 1 -- 172.21.15.19:0/1402197309 wait complete. 2023-10-03T10:15:59.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 Processor -- start 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 -- start start 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 0x7f02f406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 0x7f02f406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41b72c0 con 0x7f02f409f240 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41a9470 con 0x7f02f409f650 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f9771700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41a8980 con 0x7f02f409e930 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 0x7f02f406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 0x7f02f406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f27fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 0x7f02f406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50496/0 (socket says 172.21.15.19:50496) 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.399+0000 7f02f2ffd700 1 -- 172.21.15.19:0/2199895342 learned_addr learned my addr 172.21.15.19:0/2199895342 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 -- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 msgr2=0x7f02f406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 0x7f02f406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 -- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 msgr2=0x7f02f406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 0x7f02f406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 -- 172.21.15.19:0/2199895342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4009550 con 0x7f02f409f240 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f37fe700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 0x7f02f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f27fc700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f406bdf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f02dc016000 tx=0x7f02dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0036a0 con 0x7f02f409f240 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc01f070 con 0x7f02f409f240 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f9771700 1 -- 172.21.15.19:0/2199895342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0094a0 con 0x7f02f409f240 2023-10-03T10:15:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003a40 con 0x7f02f409f240 2023-10-03T10:15:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.400+0000 7f02f9771700 1 -- 172.21.15.19:0/2199895342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f40a0190 con 0x7f02f409f240 2023-10-03T10:15:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.401+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02dc003ba0 con 0x7f02f409f240 2023-10-03T10:15:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.401+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f02dc021070 con 0x7f02f409f240 2023-10-03T10:15:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.401+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc0052e0 con 0x7f02f409f240 2023-10-03T10:15:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.407+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02dc02b080 con 0x7f02f409f240 2023-10-03T10:15:59.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:15:59.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:15:59.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:15:59.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.562+0000 7f5af635f700 1 Processor -- start 2023-10-03T10:15:59.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.562+0000 7f5af635f700 1 -- start start 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af635f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 0x7f5af009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af635f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af635f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af009b120 con 0x7f5af009e410 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af635f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af006b460 con 0x7f5af009d6f0 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af635f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af009a7e0 con 0x7f5af009e000 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af48fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5af009e410 0x7f5af0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34974/0 (socket says 172.21.15.19:34974) 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5af48fc700 1 -- 172.21.15.19:0/795067476 learned_addr learned my addr 172.21.15.19:0/795067476 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aef7fe700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeffff700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 0x7f5af009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeeffd700 1 -- 172.21.15.19:0/795067476 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705971645 0 0) 0x7f5af009b120 con 0x7f5af009e410 2023-10-03T10:15:59.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeeffd700 1 -- 172.21.15.19:0/795067476 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ad80035b0 con 0x7f5af009e410 2023-10-03T10:15:59.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeffff700 1 -- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 msgr2=0x7f5af01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeffff700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeffff700 1 -- 172.21.15.19:0/795067476 >> v1:172.21.15.19:6789/0 conn(0x7f5af009e410 legacy=0x7f5af0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aeffff700 1 -- 172.21.15.19:0/795067476 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af009a500 con 0x7f5af009d6f0 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.563+0000 7f5aef7fe700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.564+0000 7f5aeffff700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 0x7f5af009dac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2081b743c67a30c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.564+0000 7f5aeeffd700 1 -- 172.21.15.19:0/795067476 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0004230 con 0x7f5af009d6f0 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.564+0000 7f5aeeffd700 1 -- 172.21.15.19:0/795067476 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0004390 con 0x7f5af009d6f0 2023-10-03T10:15:59.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.564+0000 7f5aeeffd700 1 -- 172.21.15.19:0/795067476 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00036a0 con 0x7f5af009d6f0 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 -- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 msgr2=0x7f5af009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 0x7f5af009dac0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae0009b80 comp rx=0 tx=0).stop 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 -- 172.21.15.19:0/795067476 shutdown_connections 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009d6f0 0x7f5af009dac0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 --2- 172.21.15.19:0/795067476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 -- 172.21.15.19:0/795067476 >> 172.21.15.19:0/795067476 conn(0x7f5af0066f50 msgr2=0x7f5af009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 -- 172.21.15.19:0/795067476 shutdown_connections 2023-10-03T10:15:59.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.565+0000 7f5af635f700 1 -- 172.21.15.19:0/795067476 wait complete. 2023-10-03T10:15:59.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.567+0000 7f5af635f700 1 Processor -- start 2023-10-03T10:15:59.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.567+0000 7f5af635f700 1 -- start start 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af0122a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009e410 0x7f5af0122f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0124f40 con 0x7f5af009d6f0 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af0133800 con 0x7f5af009e410 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af635f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5af01238e0 con 0x7f5af009e000 2023-10-03T10:15:59.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38718/0 (socket says 172.21.15.19:38718) 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 -- 172.21.15.19:0/1699298101 learned_addr learned my addr 172.21.15.19:0/1699298101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aef7fe700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af0122a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5af48fc700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009e410 0x7f5af0122f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 -- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 msgr2=0x7f5af0122a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af0122a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 -- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009e410 msgr2=0x7f5af0122f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009e410 0x7f5af0122f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.568+0000 7f5aeffff700 1 -- 172.21.15.19:0/1699298101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40094a0 con 0x7f5af009d6f0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5aeffff700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0000c00 tx=0x7f5ae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0003cf0 con 0x7f5af009d6f0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae001e070 con 0x7f5af009d6f0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011870 con 0x7f5af009d6f0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00094a0 con 0x7f5af009d6f0 2023-10-03T10:15:59.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.569+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af00a2bd0 con 0x7f5af009d6f0 2023-10-03T10:15:59.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.570+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af011f030 con 0x7f5af009d6f0 2023-10-03T10:15:59.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.571+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ae00119d0 con 0x7f5af009d6f0 2023-10-03T10:15:59.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.571+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ae0041020 con 0x7f5af009d6f0 2023-10-03T10:15:59.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.576+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ae0011c80 con 0x7f5af009d6f0 2023-10-03T10:15:59.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.610+0000 7fe5a0f84700 1 Processor -- start 2023-10-03T10:15:59.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.610+0000 7fe5a0f84700 1 -- start start 2023-10-03T10:15:59.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe5a0f84700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12fc70 0x7fe59c130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe5a0f84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe59c12c060 0x7fe59c12c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe5a0f84700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c09be70 con 0x7fe59c12c970 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe5a0f84700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c130580 con 0x7fe59c12c060 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe5a0f84700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c09a6e0 con 0x7fe59c12fc70 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe599d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe59c12c060 0x7fe59c12c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe59ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe59c12c970 0x7fe59c136940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34982/0 (socket says 172.21.15.19:34982) 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe59ad9d700 1 -- 172.21.15.19:0/3733861395 learned_addr learned my addr 172.21.15.19:0/3733861395 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe59a59c700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12fc70 0x7fe59c130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe599d9b700 1 -- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12fc70 msgr2=0x7fe59c130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe599d9b700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12fc70 0x7fe59c130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe599d9b700 1 -- 172.21.15.19:0/3733861395 >> v1:172.21.15.19:6789/0 conn(0x7fe59c12c970 legacy=0x7fe59c136940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.611+0000 7fe599d9b700 1 -- 172.21.15.19:0/3733861395 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c09ac80 con 0x7fe59c12c060 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.612+0000 7fe599d9b700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c060 0x7fe59c12c430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe590009840 tx=0x7fe590009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ffddb1d8698523 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.612+0000 7fe59959a700 1 -- 172.21.15.19:0/3733861395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011830 con 0x7fe59c12c060 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.612+0000 7fe59959a700 1 -- 172.21.15.19:0/3733861395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590011990 con 0x7fe59c12c060 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.612+0000 7fe59959a700 1 -- 172.21.15.19:0/3733861395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011d20 con 0x7fe59c12c060 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 -- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c060 msgr2=0x7fe59c12c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c060 0x7fe59c12c430 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe590009840 tx=0x7fe590009b50 comp rx=0 tx=0).stop 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 -- 172.21.15.19:0/3733861395 shutdown_connections 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12fc70 0x7fe59c130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/3733861395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c060 0x7fe59c12c430 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 -- 172.21.15.19:0/3733861395 >> 172.21.15.19:0/3733861395 conn(0x7fe59c09e7e0 msgr2=0x7fe59c09ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 -- 172.21.15.19:0/3733861395 shutdown_connections 2023-10-03T10:15:59.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.613+0000 7fe5a0f84700 1 -- 172.21.15.19:0/3733861395 wait complete. 2023-10-03T10:15:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.615+0000 7fe5a0f84700 1 Processor -- start 2023-10-03T10:15:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.615+0000 7fe5a0f84700 1 -- start start 2023-10-03T10:15:59.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c970 0x7fe59c093d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe59c12fc70 0x7fe59c094260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c094c30 con 0x7fe59c12c970 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0a2680 con 0x7fe59c12fc70 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe5a0f84700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c096eb0 con 0x7fe59c12c060 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50536/0 (socket says 172.21.15.19:50536) 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe599d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c970 0x7fe59c093d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 -- 172.21.15.19:0/1212743490 learned_addr learned my addr 172.21.15.19:0/1212743490 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 -- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe59c12fc70 msgr2=0x7fe59c094260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe59c12fc70 0x7fe59c094260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 -- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c970 msgr2=0x7fe59c093d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c970 0x7fe59c093d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 -- 172.21.15.19:0/1212743490 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900094a0 con 0x7fe59c12c060 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.616+0000 7fe59a59c700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe594008a50 tx=0x7fe59400d390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.617+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59400da00 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.617+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59400db60 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.617+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59400ded0 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.617+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c094e20 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.617+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c129c60 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.618+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe59400a0d0 con 0x7fe59c12c060 2023-10-03T10:15:59.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.618+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c09e520 con 0x7fe59c12c060 2023-10-03T10:15:59.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.624+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe594010070 con 0x7fe59c12c060 2023-10-03T10:15:59.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.628+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe594044060 con 0x7fe59c12c060 2023-10-03T10:15:59.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.649+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02cc005590 con 0x7f02f409f240 2023-10-03T10:15:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.649+0000 7f02eb7fe700 1 -- 172.21.15.19:0/2199895342 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02dc015020 con 0x7f02f409f240 2023-10-03T10:15:59.649 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 msgr2=0x7f02f406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f406bdf0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f02dc016000 tx=0x7f02dc004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 shutdown_connections 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02f409f650 0x7f02f406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02f409e930 0x7f02f406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 --2- 172.21.15.19:0/2199895342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f409f240 0x7f02f406bdf0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.652+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 >> 172.21.15.19:0/2199895342 conn(0x7f02f40a4210 msgr2=0x7f02f41b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.653+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 shutdown_connections 2023-10-03T10:15:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.653+0000 7f02e97fa700 1 -- 172.21.15.19:0/2199895342 wait complete. 2023-10-03T10:15:59.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.661+0000 7f62be7c3700 1 Processor -- start 2023-10-03T10:15:59.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.661+0000 7f62be7c3700 1 -- start start 2023-10-03T10:15:59.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62be7c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62be7c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62be7c3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b809edd0 con 0x7f62b80a0a30 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62be7c3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80a18e0 con 0x7f62b8139250 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62be7c3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b809e1f0 con 0x7f62b80a1510 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50538/0 (socket says 172.21.15.19:50538) 2023-10-03T10:15:59.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 -- 172.21.15.19:0/3170703677 learned_addr learned my addr 172.21.15.19:0/3170703677 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b6ffd700 1 -- 172.21.15.19:0/3170703677 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204357263 0 0) 0x7f62b809edd0 con 0x7f62b80a0a30 2023-10-03T10:15:59.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 -- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 msgr2=0x7f62b813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 --2- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 -- 172.21.15.19:0/3170703677 >> v1:172.21.15.19:6789/0 conn(0x7f62b80a0a30 legacy=0x7f62b80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.662+0000 7f62b77fe700 1 -- 172.21.15.19:0/3170703677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b809dc50 con 0x7f62b80a1510 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.663+0000 7f62b77fe700 1 --2- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009920 tx=0x7f62ac009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b240ad511f655072 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.663+0000 7f62b6ffd700 1 -- 172.21.15.19:0/3170703677 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac00ba60 con 0x7f62b80a1510 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.663+0000 7f62b6ffd700 1 -- 172.21.15.19:0/3170703677 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac00bbc0 con 0x7f62b80a1510 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.663+0000 7f62b6ffd700 1 -- 172.21.15.19:0/3170703677 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac009e70 con 0x7f62b80a1510 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 -- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 msgr2=0x7f62b8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 --2- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f62ac009920 tx=0x7f62ac009c30 comp rx=0 tx=0).stop 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 -- 172.21.15.19:0/3170703677 shutdown_connections 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 --2- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 --2- 172.21.15.19:0/3170703677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a1510 0x7f62b8138d10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 -- 172.21.15.19:0/3170703677 >> 172.21.15.19:0/3170703677 conn(0x7f62b80a6550 msgr2=0x7f62b80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 -- 172.21.15.19:0/3170703677 shutdown_connections 2023-10-03T10:15:59.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.664+0000 7f62be7c3700 1 -- 172.21.15.19:0/3170703677 wait complete. 2023-10-03T10:15:59.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.665+0000 7f62be7c3700 1 Processor -- start 2023-10-03T10:15:59.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.665+0000 7f62be7c3700 1 -- start start 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a0a30 0x7f62b81c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b81227d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81243e0 con 0x7f62b80a1510 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8125d50 con 0x7f62b8139250 2023-10-03T10:15:59.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62be7c3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8125a80 con 0x7f62b80a0a30 2023-10-03T10:15:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38748/0 (socket says 172.21.15.19:38748) 2023-10-03T10:15:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62b77fe700 1 -- 172.21.15.19:0/285407064 learned_addr learned my addr 172.21.15.19:0/285407064 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:15:59.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.666+0000 7f62b7fff700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a0a30 0x7f62b81c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 -- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a0a30 msgr2=0x7f62b81c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a0a30 0x7f62b81c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 -- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 msgr2=0x7f62b81227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b81227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 -- 172.21.15.19:0/285407064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac009550 con 0x7f62b80a1510 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b77fe700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f62ac000c00 tx=0x7f62ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac004340 con 0x7f62b80a1510 2023-10-03T10:15:59.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac01f070 con 0x7f62b80a1510 2023-10-03T10:15:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0036a0 con 0x7f62b80a1510 2023-10-03T10:15:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.667+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b81263d0 con 0x7f62b80a1510 2023-10-03T10:15:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.668+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b81389e0 con 0x7f62b80a1510 2023-10-03T10:15:59.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.669+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8074ea0 con 0x7f62b80a1510 2023-10-03T10:15:59.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:15:59.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.670+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62ac021030 con 0x7f62b80a1510 2023-10-03T10:15:59.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.670+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62ac040f10 con 0x7f62b80a1510 2023-10-03T10:15:59.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.678+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62ac0199a0 con 0x7f62b80a1510 2023-10-03T10:15:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.804+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5af0074ea0 con 0x7f5af009d6f0 2023-10-03T10:15:59.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.804+0000 7f5aecff9700 1 -- 172.21.15.19:0/1699298101 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ae00233b0 con 0x7f5af009d6f0 2023-10-03T10:15:59.804 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 msgr2=0x7f5af01224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0000c00 tx=0x7f5ae0004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 shutdown_connections 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5af009e410 0x7f5af0122f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5af009d6f0 0x7f5af01224f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 --2- 172.21.15.19:0/1699298101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5af009e000 0x7f5af0122a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 >> 172.21.15.19:0/1699298101 conn(0x7f5af0066f50 msgr2=0x7f5af0133d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 shutdown_connections 2023-10-03T10:15:59.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.807+0000 7f5af635f700 1 -- 172.21.15.19:0/1699298101 wait complete. 2023-10-03T10:15:59.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:15:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.859+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe59c0747f0 con 0x7fe59c12c060 2023-10-03T10:15:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.860+0000 7fe58affd700 1 -- 172.21.15.19:0/1212743490 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe594044070 con 0x7fe59c12c060 2023-10-03T10:15:59.860 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:15:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 msgr2=0x7fe59c0937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe594008a50 tx=0x7fe59400d390 comp rx=0 tx=0).stop 2023-10-03T10:15:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 shutdown_connections 2023-10-03T10:15:59.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe59c12fc70 0x7fe59c094260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe59c12c060 0x7fe59c0937e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 --2- 172.21.15.19:0/1212743490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe59c12c970 0x7fe59c093d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 >> 172.21.15.19:0/1212743490 conn(0x7fe59c09e7e0 msgr2=0x7fe59c09fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 shutdown_connections 2023-10-03T10:15:59.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.862+0000 7fe5a0f84700 1 -- 172.21.15.19:0/1212743490 wait complete. 2023-10-03T10:15:59.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:15:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.908+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62b80a28e0 con 0x7f62b80a1510 2023-10-03T10:15:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.908+0000 7f62b4ff9700 1 -- 172.21.15.19:0/285407064 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62ac0193b0 con 0x7f62b80a1510 2023-10-03T10:15:59.908 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:15:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 msgr2=0x7f62b81c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:15:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f62ac000c00 tx=0x7f62ac004750 comp rx=0 tx=0).stop 2023-10-03T10:15:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 shutdown_connections 2023-10-03T10:15:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8139250 0x7f62b81227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b80a0a30 0x7f62b81c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 --2- 172.21.15.19:0/285407064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b80a1510 0x7f62b81c8af0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 >> 172.21.15.19:0/285407064 conn(0x7f62b80a6550 msgr2=0x7f62b80a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 shutdown_connections 2023-10-03T10:15:59.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:15:59.910+0000 7f62be7c3700 1 -- 172.21.15.19:0/285407064 wait complete. 2023-10-03T10:15:59.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:00.673 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:00.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.819+0000 7fec9400c700 1 Processor -- start 2023-10-03T10:16:00.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.819+0000 7fec9400c700 1 -- start start 2023-10-03T10:16:00.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec9400c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 0x7fec8c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec9400c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 0x7fec8c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec9400c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c09d2f0 con 0x7fec8c09d6f0 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec9400c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c09b0f0 con 0x7fec8c09e1d0 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec9400c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c09a810 con 0x7fec8c139170 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 0x7fec8c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec915a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 0x7fec8c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec91da8700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fec8c09d6f0 0x7fec8c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35004/0 (socket says 172.21.15.19:35004) 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec91da8700 1 -- 172.21.15.19:0/3065260738 learned_addr learned my addr 172.21.15.19:0/3065260738 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 -- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 msgr2=0x7fec8c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 0x7fec8c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec90da6700 1 -- 172.21.15.19:0/3065260738 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702926983 0 0) 0x7fec8c09d2f0 con 0x7fec8c09d6f0 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 -- 172.21.15.19:0/3065260738 >> v1:172.21.15.19:6789/0 conn(0x7fec8c09d6f0 legacy=0x7fec8c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 -- 172.21.15.19:0/3065260738 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c09a470 con 0x7fec8c139170 2023-10-03T10:16:00.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec915a7700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 0x7fec8c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.820+0000 7fec925a9700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 0x7fec8c13b550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec84009dc0 tx=0x7fec8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c823188d4fb89d89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec90da6700 1 -- 172.21.15.19:0/3065260738 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8400e070 con 0x7fec8c139170 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec90da6700 1 -- 172.21.15.19:0/3065260738 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8400bb20 con 0x7fec8c139170 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec90da6700 1 -- 172.21.15.19:0/3065260738 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84012430 con 0x7fec8c139170 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 -- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 msgr2=0x7fec8c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 0x7fec8c13b550 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fec84009dc0 tx=0x7fec8400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 -- 172.21.15.19:0/3065260738 shutdown_connections 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c139170 0x7fec8c13b550 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 --2- 172.21.15.19:0/3065260738 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09e1d0 0x7fec8c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 -- 172.21.15.19:0/3065260738 >> 172.21.15.19:0/3065260738 conn(0x7fec8c066f50 msgr2=0x7fec8c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 -- 172.21.15.19:0/3065260738 shutdown_connections 2023-10-03T10:16:00.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.821+0000 7fec9400c700 1 -- 172.21.15.19:0/3065260738 wait complete. 2023-10-03T10:16:00.824 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:00.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 Processor -- start 2023-10-03T10:16:00.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 -- start start 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 0x7fec8c11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 0x7fec8c11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c09bf80 con 0x7fec8c139170 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c122100 con 0x7fec8c09d6f0 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.823+0000 7fec9400c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c1347b0 con 0x7fec8c09e1d0 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 0x7fec8c11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec925a9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec925a9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38762/0 (socket says 172.21.15.19:38762) 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec925a9700 1 -- 172.21.15.19:0/1576135584 learned_addr learned my addr 172.21.15.19:0/1576135584 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:00.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec91da8700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 0x7fec8c11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 -- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 msgr2=0x7fec8c11e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 0x7fec8c11e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 -- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 msgr2=0x7fec8c11f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 -- 172.21.15.19:0/1576135584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800094a0 con 0x7fec8c09e1d0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec925a9700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec91da8700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 0x7fec8c11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec915a7700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 0x7fec8c11ee00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e9b0 tx=0x7fec8000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000ee50 con 0x7fec8c09e1d0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8000c850 con 0x7fec8c09e1d0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8000cc00 con 0x7fec8c09e1d0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec84009a70 con 0x7fec8c09e1d0 2023-10-03T10:16:00.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.824+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c120ae0 con 0x7fec8c09e1d0 2023-10-03T10:16:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.825+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec80013470 con 0x7fec8c09e1d0 2023-10-03T10:16:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.826+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c121d20 con 0x7fec8c09e1d0 2023-10-03T10:16:00.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.826+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec8003f570 con 0x7fec8c09e1d0 2023-10-03T10:16:00.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.830+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec80017020 con 0x7fec8c09e1d0 2023-10-03T10:16:00.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:00.924 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.971+0000 7f7a62627700 1 Processor -- start 2023-10-03T10:16:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.971+0000 7f7a62627700 1 -- start start 2023-10-03T10:16:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.972+0000 7f7a62627700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a5c09d6f0 0x7f7a5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.972+0000 7f7a62627700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 0x7f7a5c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.972+0000 7f7a62627700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c09b120 con 0x7f7a5c09e410 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.972+0000 7f7a62627700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c06b460 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.972+0000 7f7a62627700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c09a7e0 con 0x7f7a5c09e000 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 0x7f7a5c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 0x7f7a5c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50578/0 (socket says 172.21.15.19:50578) 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5b7fe700 1 -- 172.21.15.19:0/386051066 learned_addr learned my addr 172.21.15.19:0/386051066 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 --2- 172.21.15.19:0/386051066 >> v2:172.21.15.19:3300/0 conn(0x7f7a5c09d6f0 0x7f7a5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 -- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 msgr2=0x7f7a5c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:00.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 --2- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 0x7f7a5c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 -- 172.21.15.19:0/386051066 >> v1:172.21.15.19:6789/0 conn(0x7f7a5c09e410 legacy=0x7f7a5c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 -- 172.21.15.19:0/386051066 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c09a500 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.973+0000 7f7a5bfff700 1 --2- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09d6f0 0x7f7a5c09dac0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009840 tx=0x7f7a4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3706f2ea7650f307 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.974+0000 7f7a5affd700 1 -- 172.21.15.19:0/386051066 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c011830 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.974+0000 7f7a5affd700 1 -- 172.21.15.19:0/386051066 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c011990 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.974+0000 7f7a5affd700 1 -- 172.21.15.19:0/386051066 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c011d20 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.974+0000 7f7a62627700 1 -- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09d6f0 msgr2=0x7f7a5c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.974+0000 7f7a62627700 1 --2- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09d6f0 0x7f7a5c09dac0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009840 tx=0x7f7a4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 -- 172.21.15.19:0/386051066 shutdown_connections 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 --2- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09d6f0 0x7f7a5c09dac0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 --2- 172.21.15.19:0/386051066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09e000 0x7f7a5c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 -- 172.21.15.19:0/386051066 >> 172.21.15.19:0/386051066 conn(0x7f7a5c066f50 msgr2=0x7f7a5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 -- 172.21.15.19:0/386051066 shutdown_connections 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.975+0000 7f7a62627700 1 -- 172.21.15.19:0/386051066 wait complete. 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.976+0000 7f7a62627700 1 Processor -- start 2023-10-03T10:16:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.976+0000 7f7a62627700 1 -- start start 2023-10-03T10:16:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 0x7f7a5c1a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a5c09e410 0x7f7a5c1a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1a9960 con 0x7f7a5c09e000 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1a7af0 con 0x7f7a5c09e410 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a62627700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c0a32f0 con 0x7f7a5c09d6f0 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a5bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a5bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50590/0 (socket says 172.21.15.19:50590) 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a5bfff700 1 -- 172.21.15.19:0/3430509336 learned_addr learned my addr 172.21.15.19:0/3430509336 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.977+0000 7f7a5b7fe700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 0x7f7a5c1a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a60bc4700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a5c09e410 0x7f7a5c1a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 -- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 msgr2=0x7f7a5c1a5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 -- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a5c09e410 msgr2=0x7f7a5c1a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a5c09e410 0x7f7a5c1a6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 -- 172.21.15.19:0/3430509336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c0094a0 con 0x7f7a5c09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5bfff700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a5b7fe700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 0x7f7a5c1a63d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000e810 tx=0x7f7a5000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5000c070 con 0x7f7a5c09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a50013610 con 0x7f7a5c09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.978+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a500139a0 con 0x7f7a5c09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.979+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c09c710 con 0x7f7a5c09e000 2023-10-03T10:16:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.979+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c1a8850 con 0x7f7a5c09e000 2023-10-03T10:16:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.980+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a50013b00 con 0x7f7a5c09e000 2023-10-03T10:16:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.980+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a5003f480 con 0x7f7a5c09e000 2023-10-03T10:16:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.980+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c074ea0 con 0x7f7a5c09e000 2023-10-03T10:16:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:00.990+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a50010900 con 0x7f7a5c09e000 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.028+0000 7f5b3d74c700 1 Processor -- start 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 -- start start 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 0x7f5b3809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 0x7f5b3809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3809a810 con 0x7f5b3813c1e0 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3806ab40 con 0x7f5b3809dc30 2023-10-03T10:16:01.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b3d74c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3809ebc0 con 0x7f5b3806a770 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b367fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 0x7f5b3809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b377fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5b3813c1e0 0x7f5b3813e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35026/0 (socket says 172.21.15.19:35026) 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b377fe700 1 -- 172.21.15.19:0/912976960 learned_addr learned my addr 172.21.15.19:0/912976960 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.029+0000 7f5b36ffd700 1 --2- 172.21.15.19:0/912976960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 0x7f5b3809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b36ffd700 1 -- 172.21.15.19:0/912976960 >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 msgr2=0x7f5b3809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b36ffd700 1 --2- 172.21.15.19:0/912976960 >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 0x7f5b3809e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b36ffd700 1 -- 172.21.15.19:0/912976960 >> v1:172.21.15.19:6789/0 conn(0x7f5b3813c1e0 legacy=0x7f5b3813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b36ffd700 1 -- 172.21.15.19:0/912976960 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3809e920 con 0x7f5b3806a770 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b35ffb700 1 -- 172.21.15.19:0/912976960 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503859044 0 0) 0x7f5b3809a810 con 0x7f5b3813c1e0 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b367fc700 1 --2- 172.21.15.19:0/912976960 >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 0x7f5b3809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b36ffd700 1 --2- 172.21.15.19:0/912976960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 0x7f5b3809d6f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009870 tx=0x7f5b28009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d5a7092a3c1de62 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b35ffb700 1 -- 172.21.15.19:0/912976960 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28011830 con 0x7f5b3806a770 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b35ffb700 1 -- 172.21.15.19:0/912976960 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b28011990 con 0x7f5b3806a770 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.030+0000 7f5b35ffb700 1 -- 172.21.15.19:0/912976960 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b28011d20 con 0x7f5b3806a770 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 -- 172.21.15.19:0/912976960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 msgr2=0x7f5b3809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/912976960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 0x7f5b3809d6f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5b28009870 tx=0x7f5b28009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 -- 172.21.15.19:0/912976960 shutdown_connections 2023-10-03T10:16:01.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/912976960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3806a770 0x7f5b3809d6f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/912976960 >> v2:172.21.15.19:3300/0 conn(0x7f5b3809dc30 0x7f5b3809e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 -- 172.21.15.19:0/912976960 >> 172.21.15.19:0/912976960 conn(0x7f5b38066f50 msgr2=0x7f5b3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 -- 172.21.15.19:0/912976960 shutdown_connections 2023-10-03T10:16:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.031+0000 7f5b3d74c700 1 -- 172.21.15.19:0/912976960 wait complete. 2023-10-03T10:16:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.033+0000 7f5b3d74c700 1 Processor -- start 2023-10-03T10:16:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.033+0000 7f5b3d74c700 1 -- start start 2023-10-03T10:16:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.033+0000 7f5b3d74c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b3806a770 0x7f5b38127130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.033+0000 7f5b3d74c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b3d74c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b3d74c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b38128cf0 con 0x7f5b3809dc30 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b3d74c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3812ace0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b3d74c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3809c060 con 0x7f5b3806a770 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b367fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b367fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38784/0 (socket says 172.21.15.19:38784) 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38842/0 (socket says 172.21.15.19:38842) 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b367fc700 1 -- 172.21.15.19:0/2565325501 learned_addr learned my addr 172.21.15.19:0/2565325501 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 -- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b3806a770 msgr2=0x7f5b38127130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b3806a770 0x7f5b38127130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 -- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 msgr2=0x7f5b38127670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 -- 172.21.15.19:0/2565325501 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0094a0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b367fc700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b377fe700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b3809c740 tx=0x7f5b3000cec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.034+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3000aaa0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.035+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3000ac00 con 0x7f5b3813c1e0 2023-10-03T10:16:01.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.035+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b300070d0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.035+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b280094a0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.035+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3812a660 con 0x7f5b3813c1e0 2023-10-03T10:16:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.036+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5b30007230 con 0x7f5b3813c1e0 2023-10-03T10:16:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.036+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b38074ea0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.037+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5b3003eff0 con 0x7f5b3813c1e0 2023-10-03T10:16:01.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.042+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5b30070750 con 0x7f5b3813c1e0 2023-10-03T10:16:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.049+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec8c122240 con 0x7fec8c09e1d0 2023-10-03T10:16:01.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.049+0000 7fec7e7fc700 1 -- 172.21.15.19:0/1576135584 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec8c122240 con 0x7fec8c09e1d0 2023-10-03T10:16:01.049 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.051+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 msgr2=0x7fec8c11ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.051+0000 7fec9400c700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 0x7fec8c11ee00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fec8000e9b0 tx=0x7fec8000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 shutdown_connections 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec8c139170 0x7fec8c11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec8c09d6f0 0x7fec8c11e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 --2- 172.21.15.19:0/1576135584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec8c09e1d0 0x7fec8c11ee00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 >> 172.21.15.19:0/1576135584 conn(0x7fec8c066f50 msgr2=0x7fec8c136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 shutdown_connections 2023-10-03T10:16:01.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.052+0000 7fec9400c700 1 -- 172.21.15.19:0/1576135584 wait complete. 2023-10-03T10:16:01.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 Processor -- start 2023-10-03T10:16:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 -- start start 2023-10-03T10:16:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 0x7fba0809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08134370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0806bec0 con 0x7fba0809f160 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba080a0030 con 0x7fba0809e850 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba0d8a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba080a0830 con 0x7fba0809f5b0 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.112+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 0x7fba0809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba067fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba0809f160 0x7fba08133c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35030/0 (socket says 172.21.15.19:35030) 2023-10-03T10:16:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba067fc700 1 -- 172.21.15.19:0/3788836898 learned_addr learned my addr 172.21.15.19:0/3788836898 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba077fe700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08134370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba06ffd700 1 -- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 msgr2=0x7fba08134370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba06ffd700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08134370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba06ffd700 1 -- 172.21.15.19:0/3788836898 >> v1:172.21.15.19:6789/0 conn(0x7fba0809f160 legacy=0x7fba08133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba06ffd700 1 -- 172.21.15.19:0/3788836898 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0806caa0 con 0x7fba0809e850 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba06ffd700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 0x7fba0809ec20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2246a1970d1ba11b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba05ffb700 1 -- 172.21.15.19:0/3788836898 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8011830 con 0x7fba0809e850 2023-10-03T10:16:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba05ffb700 1 -- 172.21.15.19:0/3788836898 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8011990 con 0x7fba0809e850 2023-10-03T10:16:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.113+0000 7fba05ffb700 1 -- 172.21.15.19:0/3788836898 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8011d20 con 0x7fba0809e850 2023-10-03T10:16:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 -- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 msgr2=0x7fba0809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 0x7fba0809ec20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8009870 tx=0x7fb9f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 -- 172.21.15.19:0/3788836898 shutdown_connections 2023-10-03T10:16:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08134370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/3788836898 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809e850 0x7fba0809ec20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 -- 172.21.15.19:0/3788836898 >> 172.21.15.19:0/3788836898 conn(0x7fba080a3f70 msgr2=0x7fba080a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 -- 172.21.15.19:0/3788836898 shutdown_connections 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.114+0000 7fba0d8a4700 1 -- 172.21.15.19:0/3788836898 wait complete. 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.116+0000 7fba0d8a4700 1 Processor -- start 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.116+0000 7fba0d8a4700 1 -- start start 2023-10-03T10:16:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 0x7fba08120a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08120fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba08124070 con 0x7fba0809e850 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba08123000 con 0x7fba0809f160 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba0d8a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba08123420 con 0x7fba0809f5b0 2023-10-03T10:16:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38794/0 (socket says 172.21.15.19:38794) 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba067fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 0x7fba08120a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 -- 172.21.15.19:0/1912580893 learned_addr learned my addr 172.21.15.19:0/1912580893 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba077fe700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08120fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 -- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 msgr2=0x7fba08120fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08120fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 -- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 msgr2=0x7fba08120a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 0x7fba08120a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 -- 172.21.15.19:0/1912580893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f80094a0 con 0x7fba0809e850 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba067fc700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 0x7fba08120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.117+0000 7fba06ffd700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80090b0 tx=0x7fb9f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.118+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8004510 con 0x7fba0809e850 2023-10-03T10:16:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.118+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f801e070 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.118+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80038e0 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.118+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba080a3770 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.118+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba08133960 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.119+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9f8003a40 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.119+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0809caf0 con 0x7fba0809e850 2023-10-03T10:16:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.119+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9f80404e0 con 0x7fba0809e850 2023-10-03T10:16:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.124+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9f802d7d0 con 0x7fba0809e850 2023-10-03T10:16:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.252+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7a5c06c360 con 0x7f7a5c09e000 2023-10-03T10:16:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.253+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5b3813bb90 con 0x7f5b3813c1e0 2023-10-03T10:16:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.253+0000 7f7a58ff9700 1 -- 172.21.15.19:0/3430509336 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a50010310 con 0x7f7a5c09e000 2023-10-03T10:16:01.253 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:01.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.253+0000 7f5b1f7fe700 1 -- 172.21.15.19:0/2565325501 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b30018020 con 0x7f5b3813c1e0 2023-10-03T10:16:01.254 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 msgr2=0x7f7a5c1a63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 0x7f7a5c1a63d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000e810 tx=0x7f7a5000eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 shutdown_connections 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a5c09e410 0x7f7a5c1a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a5c09d6f0 0x7f7a5c1a5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.256+0000 7f7a62627700 1 --2- 172.21.15.19:0/3430509336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a5c09e000 0x7f7a5c1a63d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 >> 172.21.15.19:0/3430509336 conn(0x7f7a5c066f50 msgr2=0x7f7a5c1bae40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 msgr2=0x7f5b38127bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5b3809c740 tx=0x7f5b3000cec0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 shutdown_connections 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5b3813c1e0 0x7f5b38127bb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5b3806a770 0x7f5b38127130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 --2- 172.21.15.19:0/2565325501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b3809dc30 0x7f5b38127670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 >> 172.21.15.19:0/2565325501 conn(0x7f5b38066f50 msgr2=0x7f5b380a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 shutdown_connections 2023-10-03T10:16:01.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f7a62627700 1 -- 172.21.15.19:0/3430509336 wait complete. 2023-10-03T10:16:01.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 shutdown_connections 2023-10-03T10:16:01.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.257+0000 7f5b3d74c700 1 -- 172.21.15.19:0/2565325501 wait complete. 2023-10-03T10:16:01.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:01.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.330+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba080747f0 con 0x7fba0809e850 2023-10-03T10:16:01.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.331+0000 7fb9effff700 1 -- 172.21.15.19:0/1912580893 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9f8023ba0 con 0x7fba0809e850 2023-10-03T10:16:01.331 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 msgr2=0x7fba08120550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:01.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb9f80090b0 tx=0x7fb9f8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 shutdown_connections 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba0809f5b0 0x7fba08120fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0809e850 0x7fba08120550 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 --2- 172.21.15.19:0/1912580893 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0809f160 0x7fba08120a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 >> 172.21.15.19:0/1912580893 conn(0x7fba080a3f70 msgr2=0x7fba081bb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 shutdown_connections 2023-10-03T10:16:01.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:01.333+0000 7fba0d8a4700 1 -- 172.21.15.19:0/1912580893 wait complete. 2023-10-03T10:16:01.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:02.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.213+0000 7f2ad87f7700 1 Processor -- start 2023-10-03T10:16:02.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.213+0000 7f2ad87f7700 1 -- start start 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 0x7f2ad01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2ad009e410 0x7f2ad0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad006b460 con 0x7f2ad009e410 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad009b120 con 0x7f2ad009d6f0 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad87f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad009a7e0 con 0x7f2ad009e000 2023-10-03T10:16:02.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad6593700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad5d92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 0x7f2ad01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad6593700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38868/0 (socket says 172.21.15.19:38868) 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad6593700 1 -- 172.21.15.19:0/3835256444 learned_addr learned my addr 172.21.15.19:0/3835256444 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.214+0000 7f2ad6d94700 1 --2- 172.21.15.19:0/3835256444 >> v2:172.21.15.19:3300/0 conn(0x7f2ad009e410 0x7f2ad0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 -- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 msgr2=0x7f2ad01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 0x7f2ad01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 -- 172.21.15.19:0/3835256444 >> v2:172.21.15.19:3300/0 conn(0x7f2ad009e410 msgr2=0x7f2ad0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 --2- 172.21.15.19:0/3835256444 >> v2:172.21.15.19:3300/0 conn(0x7f2ad009e410 0x7f2ad0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 -- 172.21.15.19:0/3835256444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad009a500 con 0x7f2ad009d6f0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad5d92700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 0x7f2ad01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad6593700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009920 tx=0x7f2ac4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcd1796305d52d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad5591700 1 -- 172.21.15.19:0/3835256444 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011830 con 0x7f2ad009d6f0 2023-10-03T10:16:02.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad5591700 1 -- 172.21.15.19:0/3835256444 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4011990 con 0x7f2ad009d6f0 2023-10-03T10:16:02.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.215+0000 7f2ad5591700 1 -- 172.21.15.19:0/3835256444 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4011d20 con 0x7f2ad009d6f0 2023-10-03T10:16:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 msgr2=0x7f2ad009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009920 tx=0x7f2ac4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3835256444 shutdown_connections 2023-10-03T10:16:02.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009d6f0 0x7f2ad009dac0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3835256444 >> v2:172.21.15.19:3300/0 conn(0x7f2ad009e410 0x7f2ad0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3835256444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e000 0x7f2ad01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3835256444 >> 172.21.15.19:0/3835256444 conn(0x7f2ad0066f50 msgr2=0x7f2ad009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3835256444 shutdown_connections 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.216+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3835256444 wait complete. 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 Processor -- start 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 -- start start 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01a9c30 con 0x7f2ad009d6f0 2023-10-03T10:16:02.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01a8340 con 0x7f2ad009e000 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad87f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01a9000 con 0x7f2ad009e410 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad6593700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad6d94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad5d92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad6593700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38800/0 (socket says 172.21.15.19:38800) 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad6d94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50620/0 (socket says 172.21.15.19:50620) 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad5d92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38872/0 (socket says 172.21.15.19:38872) 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.217+0000 7f2ad6593700 1 -- 172.21.15.19:0/3774285975 learned_addr learned my addr 172.21.15.19:0/3774285975 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 -- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 msgr2=0x7f2ad01a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 -- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 msgr2=0x7f2ad01a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 -- 172.21.15.19:0/3774285975 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0094a0 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad6d94700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad6593700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad5d92700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00e980 tx=0x7f2acc00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00c690 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00c7f0 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac4009550 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00cb80 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.218+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad00a2190 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.219+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2acc00cce0 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.219+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2acc03fa70 con 0x7f2ad009e000 2023-10-03T10:16:02.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.219+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00a1e00 con 0x7f2ad009e000 2023-10-03T10:16:02.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.225+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2acc01b3b0 con 0x7f2ad009e000 2023-10-03T10:16:02.278 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:02.278 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:02.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:02.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.419+0000 7fe1ba273700 1 Processor -- start 2023-10-03T10:16:02.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.419+0000 7fe1ba273700 1 -- start start 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7ff237ca6700 1 Processor -- start 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1ba273700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1b409e930 0x7fe1b409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1ba273700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f240 0x7fe1b41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1ba273700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b4070940 con 0x7fe1b409f650 2023-10-03T10:16:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1ba273700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b406fd60 con 0x7fe1b409e930 2023-10-03T10:16:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1ba273700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406fa80 con 0x7fe1b409f240 2023-10-03T10:16:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7ff237ca6700 1 -- start start 2023-10-03T10:16:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1b409e930 0x7fe1b409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1b409e930 0x7fe1b409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38804/0 (socket says 172.21.15.19:38804) 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 -- 172.21.15.19:0/3413209217 learned_addr learned my addr 172.21.15.19:0/3413209217 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 -- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f240 msgr2=0x7fe1b41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 --2- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f240 0x7fe1b41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 -- 172.21.15.19:0/3413209217 >> v1:172.21.15.19:6789/0 conn(0x7fe1b409f650 legacy=0x7fe1b4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.420+0000 7fe1b3fff700 1 -- 172.21.15.19:0/3413209217 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b409fb60 con 0x7fe1b409e930 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff237ca6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff237ca6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff230139170 0x7ff23013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7fe1b3fff700 1 --2- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b409ed00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40098f0 tx=0x7fe1a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb704ac824be0b82 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff237ca6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23009b120 con 0x7ff23009d6f0 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff237ca6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23006b460 con 0x7ff230139170 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff237ca6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23009a7e0 con 0x7ff23009e1d0 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38886/0 (socket says 172.21.15.19:38886) 2023-10-03T10:16:02.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 -- 172.21.15.19:0/3648050559 learned_addr learned my addr 172.21.15.19:0/3648050559 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7fe1b2ffd700 1 -- 172.21.15.19:0/3413209217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4004230 con 0x7fe1b409e930 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7fe1b2ffd700 1 -- 172.21.15.19:0/3413209217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4004390 con 0x7fe1b409e930 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7fe1b2ffd700 1 -- 172.21.15.19:0/3413209217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40036a0 con 0x7fe1b409e930 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 -- 172.21.15.19:0/3648050559 >> v2:172.21.15.19:3300/0 conn(0x7ff230139170 msgr2=0x7ff23013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 --2- 172.21.15.19:0/3648050559 >> v2:172.21.15.19:3300/0 conn(0x7ff230139170 0x7ff23013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 -- 172.21.15.19:0/3648050559 >> v1:172.21.15.19:6789/0 conn(0x7ff23009d6f0 legacy=0x7ff23009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.421+0000 7ff235241700 1 -- 172.21.15.19:0/3648050559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23009a500 con 0x7ff23009e1d0 2023-10-03T10:16:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7ff235241700 1 --2- 172.21.15.19:0/3648050559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff220009920 tx=0x7ff220009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9904ded1b9718f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7ff234a40700 1 -- 172.21.15.19:0/3648050559 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22000ba20 con 0x7ff23009e1d0 2023-10-03T10:16:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7ff234a40700 1 -- 172.21.15.19:0/3648050559 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22000bb80 con 0x7ff23009e1d0 2023-10-03T10:16:02.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7ff234a40700 1 -- 172.21.15.19:0/3648050559 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff220009e70 con 0x7ff23009e1d0 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 -- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 msgr2=0x7fe1b409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 --2- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b409ed00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe1a40098f0 tx=0x7fe1a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 -- 172.21.15.19:0/3413209217 shutdown_connections 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 --2- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b409ed00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 --2- 172.21.15.19:0/3413209217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f240 0x7fe1b41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 -- 172.21.15.19:0/3413209217 >> 172.21.15.19:0/3413209217 conn(0x7fe1b40a4210 msgr2=0x7fe1b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 -- 172.21.15.19:0/3413209217 shutdown_connections 2023-10-03T10:16:02.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.422+0000 7fe1ba273700 1 -- 172.21.15.19:0/3413209217 wait complete. 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 -- 172.21.15.19:0/3648050559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 msgr2=0x7ff230138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 --2- 172.21.15.19:0/3648050559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff220009920 tx=0x7ff220009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 -- 172.21.15.19:0/3648050559 shutdown_connections 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 --2- 172.21.15.19:0/3648050559 >> v2:172.21.15.19:3300/0 conn(0x7ff230139170 0x7ff23013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 --2- 172.21.15.19:0/3648050559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009e1d0 0x7ff230138c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 -- 172.21.15.19:0/3648050559 >> 172.21.15.19:0/3648050559 conn(0x7ff230066f50 msgr2=0x7ff23009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 -- 172.21.15.19:0/3648050559 shutdown_connections 2023-10-03T10:16:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7ff237ca6700 1 -- 172.21.15.19:0/3648050559 wait complete. 2023-10-03T10:16:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.423+0000 7fe1ba273700 1 Processor -- start 2023-10-03T10:16:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7ff237ca6700 1 Processor -- start 2023-10-03T10:16:02.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7ff237ca6700 1 -- start start 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 -- start start 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b41b57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f650 0x7fe1b41a5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a41c0 con 0x7fe1b409e930 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a3200 con 0x7fe1b409f240 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1ba273700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41a34b0 con 0x7fe1b409f650 2023-10-03T10:16:02.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.424+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b41b57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38888/0 (socket says 172.21.15.19:38888) 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b37fe700 1 -- 172.21.15.19:0/1329574645 learned_addr learned my addr 172.21.15.19:0/1329574645 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b8810700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f650 0x7fe1b41a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff23009e1d0 0x7ff2301c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 -- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f650 msgr2=0x7fe1b41a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f650 0x7fe1b41a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 -- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 msgr2=0x7fe1b41b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 -- 172.21.15.19:0/1329574645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4009550 con 0x7fe1b409e930 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b37fe700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff230139170 0x7ff23011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2300a2b50 con 0x7ff23009e1d0 2023-10-03T10:16:02.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff230121d10 con 0x7ff23009d6f0 2023-10-03T10:16:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7ff237ca6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2301be2f0 con 0x7ff230139170 2023-10-03T10:16:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b3fff700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b41b57e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4015000 tx=0x7fe1a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4003dc0 con 0x7fe1b409e930 2023-10-03T10:16:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a401f070 con 0x7fe1b409e930 2023-10-03T10:16:02.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.425+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40a0190 con 0x7fe1b409e930 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400b8a0 con 0x7fe1b409e930 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b41a38c0 con 0x7fe1b409e930 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38896/0 (socket says 172.21.15.19:38896) 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 -- 172.21.15.19:0/1037952171 learned_addr learned my addr 172.21.15.19:0/1037952171 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 -- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff230139170 msgr2=0x7ff23011e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff230139170 0x7ff23011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 -- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff23009e1d0 msgr2=0x7ff2301c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff23009e1d0 0x7ff2301c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.426+0000 7ff235a42700 1 -- 172.21.15.19:0/1037952171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220009550 con 0x7ff23009d6f0 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1a4021030 con 0x7fe1b409e930 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4071d80 con 0x7fe1b409e930 2023-10-03T10:16:02.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff235a42700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c4e0 tx=0x7ff22c00c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1a4040d30 con 0x7fe1b409e930 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0052d0 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c005430 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff230134660 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0038c0 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.427+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2301c90c0 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.428+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff22c003a20 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.428+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff22c03ec00 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.429+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff230074ea0 con 0x7ff23009d6f0 2023-10-03T10:16:02.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.434+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff22c017080 con 0x7ff23009d6f0 2023-10-03T10:16:02.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.436+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1a4023da0 con 0x7fe1b409e930 2023-10-03T10:16:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.448+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2ad0074ea0 con 0x7f2ad009e000 2023-10-03T10:16:02.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.448+0000 7f2ac2ffd700 1 -- 172.21.15.19:0/3774285975 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2acc017020 con 0x7f2ad009e000 2023-10-03T10:16:02.448 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 msgr2=0x7f2ad01a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00e980 tx=0x7f2acc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 shutdown_connections 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ad009e410 0x7f2ad01a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ad009d6f0 0x7f2ad01a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 --2- 172.21.15.19:0/3774285975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ad009e000 0x7f2ad01a6730 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 >> 172.21.15.19:0/3774285975 conn(0x7f2ad0066f50 msgr2=0x7f2ad01baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 shutdown_connections 2023-10-03T10:16:02.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.451+0000 7f2ad87f7700 1 -- 172.21.15.19:0/3774285975 wait complete. 2023-10-03T10:16:02.466 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:02.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 Processor -- start 2023-10-03T10:16:02.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 -- start start 2023-10-03T10:16:02.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 0x7f3f64134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f6409b120 con 0x7f3f6409e000 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f6406b460 con 0x7f3f6409e410 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.497+0000 7f3f6a918700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6409a7e0 con 0x7f3f6409d6f0 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f637fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f6409e000 0x7f3f641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35052/0 (socket says 172.21.15.19:35052) 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f637fe700 1 -- 172.21.15.19:0/4142117149 learned_addr learned my addr 172.21.15.19:0/4142117149 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 --2- 172.21.15.19:0/4142117149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f68eb5700 1 --2- 172.21.15.19:0/4142117149 >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 0x7f3f64134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f62ffd700 1 -- 172.21.15.19:0/4142117149 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845215574 0 0) 0x7f3f6409b120 con 0x7f3f6409e000 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f62ffd700 1 -- 172.21.15.19:0/4142117149 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f4c0035b0 con 0x7f3f6409e000 2023-10-03T10:16:02.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 -- 172.21.15.19:0/4142117149 >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 msgr2=0x7f3f64134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 --2- 172.21.15.19:0/4142117149 >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 0x7f3f64134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 -- 172.21.15.19:0/4142117149 >> v1:172.21.15.19:6789/0 conn(0x7f3f6409e000 legacy=0x7f3f641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 -- 172.21.15.19:0/4142117149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6409a500 con 0x7f3f6409d6f0 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f68eb5700 1 --2- 172.21.15.19:0/4142117149 >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 0x7f3f64134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.498+0000 7f3f63fff700 1 --2- 172.21.15.19:0/4142117149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f6409dac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009870 tx=0x7f3f54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=724d50e59ac09054 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f62ffd700 1 -- 172.21.15.19:0/4142117149 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54011830 con 0x7f3f6409d6f0 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f62ffd700 1 -- 172.21.15.19:0/4142117149 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f54011990 con 0x7f3f6409d6f0 2023-10-03T10:16:02.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f62ffd700 1 -- 172.21.15.19:0/4142117149 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f54011d20 con 0x7f3f6409d6f0 2023-10-03T10:16:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 -- 172.21.15.19:0/4142117149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 msgr2=0x7f3f6409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 --2- 172.21.15.19:0/4142117149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f6409dac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f54009870 tx=0x7f3f54009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 -- 172.21.15.19:0/4142117149 shutdown_connections 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 --2- 172.21.15.19:0/4142117149 >> v2:172.21.15.19:3300/0 conn(0x7f3f6409e410 0x7f3f64134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 --2- 172.21.15.19:0/4142117149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f6409dac0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.499+0000 7f3f6a918700 1 -- 172.21.15.19:0/4142117149 >> 172.21.15.19:0/4142117149 conn(0x7f3f64066f50 msgr2=0x7f3f6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.500+0000 7f3f6a918700 1 -- 172.21.15.19:0/4142117149 shutdown_connections 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.500+0000 7f3f6a918700 1 -- 172.21.15.19:0/4142117149 wait complete. 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 Processor -- start 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 -- start start 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f641c8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 0x7f3f641c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:02.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f641b91e0 con 0x7f3f6409e410 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f641bcfa0 con 0x7f3f6409e000 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.501+0000 7f3f6a918700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f641a8140 con 0x7f3f6409d6f0 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f68eb5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 0x7f3f641c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f68eb5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38852/0 (socket says 172.21.15.19:38852) 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f68eb5700 1 -- 172.21.15.19:0/1396895601 learned_addr learned my addr 172.21.15.19:0/1396895601 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f63fff700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f641c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 -- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 msgr2=0x7f3f641c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f641c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 -- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 msgr2=0x7f3f641a4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 -- 172.21.15.19:0/1396895601 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c009a70 con 0x7f3f6409e000 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f63fff700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f641c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f68eb5700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f637fe700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 0x7f3f641c88d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c460 tx=0x7f3f5800c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58005d70 con 0x7f3f6409e000 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f580070d0 con 0x7f3f6409e000 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.502+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540094a0 con 0x7f3f6409e000 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.503+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f58007440 con 0x7f3f6409e000 2023-10-03T10:16:02.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.503+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f641a7ba0 con 0x7f3f6409e000 2023-10-03T10:16:02.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.503+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f580075a0 con 0x7f3f6409e000 2023-10-03T10:16:02.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.503+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f5803eaa0 con 0x7f3f6409e000 2023-10-03T10:16:02.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.504+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f641c8e70 con 0x7f3f6409e000 2023-10-03T10:16:02.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.509+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f5801bb10 con 0x7f3f6409e000 2023-10-03T10:16:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.642+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff23009f420 con 0x7ff23009d6f0 2023-10-03T10:16:02.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.642+0000 7ff2267fc700 1 -- 172.21.15.19:0/1037952171 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff22c00e280 con 0x7ff23009d6f0 2023-10-03T10:16:02.642 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 msgr2=0x7ff2301c8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c4e0 tx=0x7ff22c00c8a0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 shutdown_connections 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff230139170 0x7ff23011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff23009d6f0 0x7ff2301c8640 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 --2- 172.21.15.19:0/1037952171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff23009e1d0 0x7ff2301c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 >> 172.21.15.19:0/1037952171 conn(0x7ff230066f50 msgr2=0x7ff2300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 shutdown_connections 2023-10-03T10:16:02.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.644+0000 7ff237ca6700 1 -- 172.21.15.19:0/1037952171 wait complete. 2023-10-03T10:16:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.646+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe1b4071d80 con 0x7fe1b409e930 2023-10-03T10:16:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.646+0000 7fe1b0ff9700 1 -- 172.21.15.19:0/1329574645 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1a4023bc0 con 0x7fe1b409e930 2023-10-03T10:16:02.646 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 msgr2=0x7fe1b41b57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b41b57e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4015000 tx=0x7fe1a4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 shutdown_connections 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1b409f650 0x7fe1b41a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1b409e930 0x7fe1b41b57e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 --2- 172.21.15.19:0/1329574645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1b409f240 0x7fe1b41b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 >> 172.21.15.19:0/1329574645 conn(0x7fe1b40a4210 msgr2=0x7fe1b41b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 shutdown_connections 2023-10-03T10:16:02.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.649+0000 7fe1ba273700 1 -- 172.21.15.19:0/1329574645 wait complete. 2023-10-03T10:16:02.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:02.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.714+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3f64074ea0 con 0x7f3f6409e000 2023-10-03T10:16:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.715+0000 7f3f60ff9700 1 -- 172.21.15.19:0/1396895601 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f580192c0 con 0x7f3f6409e000 2023-10-03T10:16:02.715 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 msgr2=0x7f3f641c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 0x7f3f641c88d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800c460 tx=0x7f3f5800c770 comp rx=0 tx=0).stop 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 shutdown_connections 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f6409e410 0x7f3f641a4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f6409d6f0 0x7f3f641c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 --2- 172.21.15.19:0/1396895601 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f6409e000 0x7f3f641c88d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 >> 172.21.15.19:0/1396895601 conn(0x7f3f64066f50 msgr2=0x7f3f640a3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 shutdown_connections 2023-10-03T10:16:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:02.717+0000 7f3f6a918700 1 -- 172.21.15.19:0/1396895601 wait complete. 2023-10-03T10:16:02.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:03.467 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 Processor -- start 2023-10-03T10:16:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 -- start start 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 0x7f183c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183c070940 con 0x7f183c09e930 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c06fd60 con 0x7f183c09f650 2023-10-03T10:16:03.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f18429ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f183c06fa80 con 0x7f183c09f240 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f1840f8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f1840f8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38912/0 (socket says 172.21.15.19:38912) 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f183bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 0x7f183c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f1840f8a700 1 -- 172.21.15.19:0/2241828503 learned_addr learned my addr 172.21.15.19:0/2241828503 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.613+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50690/0 (socket says 172.21.15.19:50690) 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 -- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 msgr2=0x7f183c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 -- 172.21.15.19:0/2241828503 >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 msgr2=0x7f183c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 --2- 172.21.15.19:0/2241828503 >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 0x7f183c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 -- 172.21.15.19:0/2241828503 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f183c09fb60 con 0x7f183c09f650 2023-10-03T10:16:03.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f183bfff700 1 --2- 172.21.15.19:0/2241828503 >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 0x7f183c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f183b7fe700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f1840f8a700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f183400f370 tx=0x7f183400f680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cb3a4afd935629f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f183affd700 1 -- 172.21.15.19:0/2241828503 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1834012070 con 0x7f183c09f650 2023-10-03T10:16:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f183affd700 1 -- 172.21.15.19:0/2241828503 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183400d0d0 con 0x7f183c09f650 2023-10-03T10:16:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.614+0000 7f183affd700 1 -- 172.21.15.19:0/2241828503 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183400d480 con 0x7f183c09f650 2023-10-03T10:16:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 -- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 msgr2=0x7f183c131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f183400f370 tx=0x7f183400f680 comp rx=0 tx=0).stop 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 -- 172.21.15.19:0/2241828503 shutdown_connections 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09f650 0x7f183c131d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 --2- 172.21.15.19:0/2241828503 >> v2:172.21.15.19:3300/0 conn(0x7f183c09e930 0x7f183c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 --2- 172.21.15.19:0/2241828503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 -- 172.21.15.19:0/2241828503 >> 172.21.15.19:0/2241828503 conn(0x7f183c0a4210 msgr2=0x7f183c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 -- 172.21.15.19:0/2241828503 shutdown_connections 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.615+0000 7f18429ed700 1 -- 172.21.15.19:0/2241828503 wait complete. 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.616+0000 7f18429ed700 1 Processor -- start 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.616+0000 7f18429ed700 1 -- start start 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.616+0000 7f18429ed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.616+0000 7f18429ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 0x7f183c1c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1a2e00 con 0x7f183c09f650 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1a3ae0 con 0x7f183c09e930 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f183c1b4e60 con 0x7f183c09f240 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38926/0 (socket says 172.21.15.19:38926) 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 -- 172.21.15.19:0/56020897 learned_addr learned my addr 172.21.15.19:0/56020897 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f1840f8a700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 0x7f183c1c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 -- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 msgr2=0x7f183c1a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 -- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 msgr2=0x7f183c1c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 0x7f183c1c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 -- 172.21.15.19:0/56020897 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0094a0 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f1840f8a700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 0x7f183c1c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183b7fe700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f183bfff700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f182c00ebe0 tx=0x7f182c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c009780 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182c00c850 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18300094a0 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182c00cbe0 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.617+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183400f050 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.618+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f182c00cd40 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.618+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c0a31d0 con 0x7f183c09e930 2023-10-03T10:16:03.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.618+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f182c03fa20 con 0x7f183c09e930 2023-10-03T10:16:03.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.623+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f182c017020 con 0x7f183c09e930 2023-10-03T10:16:03.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:03.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:03.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.802+0000 7fc16759e700 1 Processor -- start 2023-10-03T10:16:03.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.802+0000 7fc16759e700 1 -- start start 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc16809d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc16809d640 0x7fc16809dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc16809aa80 con 0x7fc16809d640 2023-10-03T10:16:03.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc168099780 con 0x7fc168134180 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16759e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc168133650 con 0x7fc168133870 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50700/0 (socket says 172.21.15.19:50700) 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 -- 172.21.15.19:0/337268877 learned_addr learned my addr 172.21.15.19:0/337268877 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc165d9b700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc16809d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc166d9d700 1 --2- 172.21.15.19:0/337268877 >> v2:172.21.15.19:3300/0 conn(0x7fc16809d640 0x7fc16809dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 -- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 msgr2=0x7fc16809d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc16809d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 -- 172.21.15.19:0/337268877 >> v2:172.21.15.19:3300/0 conn(0x7fc16809d640 msgr2=0x7fc16809dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 --2- 172.21.15.19:0/337268877 >> v2:172.21.15.19:3300/0 conn(0x7fc16809d640 0x7fc16809dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 -- 172.21.15.19:0/337268877 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16809ebc0 con 0x7fc168133870 2023-10-03T10:16:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.803+0000 7fc16659c700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e694439885982be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.804+0000 7fc16559a700 1 -- 172.21.15.19:0/337268877 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158005e30 con 0x7fc168133870 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.804+0000 7fc16559a700 1 -- 172.21.15.19:0/337268877 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158004030 con 0x7fc168133870 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.804+0000 7fc16559a700 1 -- 172.21.15.19:0/337268877 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1580043e0 con 0x7fc168133870 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.804+0000 7fc16759e700 1 -- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 msgr2=0x7fc168133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.804+0000 7fc16759e700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc158006fd0 tx=0x7fc158009bd0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 -- 172.21.15.19:0/337268877 shutdown_connections 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 --2- 172.21.15.19:0/337268877 >> v2:172.21.15.19:3300/0 conn(0x7fc16809d640 0x7fc16809dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc168133c40 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 --2- 172.21.15.19:0/337268877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc16809d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 -- 172.21.15.19:0/337268877 >> 172.21.15.19:0/337268877 conn(0x7fc1680a2540 msgr2=0x7fc1680a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 -- 172.21.15.19:0/337268877 shutdown_connections 2023-10-03T10:16:03.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.805+0000 7fc16759e700 1 -- 172.21.15.19:0/337268877 wait complete. 2023-10-03T10:16:03.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.806+0000 7fc16759e700 1 Processor -- start 2023-10-03T10:16:03.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.806+0000 7fc16759e700 1 -- start start 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.806+0000 7fc16759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.806+0000 7fc16759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc1681c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.806+0000 7fc16759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc1681c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc168099120 con 0x7fc16809d640 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16759e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc16812f910 con 0x7fc168134180 2023-10-03T10:16:03.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16759e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc168131bb0 con 0x7fc168133870 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc166d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc1681c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38880/0 (socket says 172.21.15.19:38880) 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 -- 172.21.15.19:0/1538321375 learned_addr learned my addr 172.21.15.19:0/1538321375 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc165d9b700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc1681c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 -- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 msgr2=0x7fc1681c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc1681c8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 -- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 msgr2=0x7fc1681c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc1681c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 -- 172.21.15.19:0/1538321375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc158009500 con 0x7fc16809d640 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc166d9d700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc1681c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.807+0000 7fc16659c700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc158009c10 tx=0x7fc158004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.808+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158003c70 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.808+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc158003df0 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.808+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc158011660 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.808+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16809bfd0 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.808+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc168130640 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.809+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1580117c0 con 0x7fc16809d640 2023-10-03T10:16:03.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.809+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16804f2a0 con 0x7fc16809d640 2023-10-03T10:16:03.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.809+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc158041d70 con 0x7fc16809d640 2023-10-03T10:16:03.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.818+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc158045060 con 0x7fc16809d640 2023-10-03T10:16:03.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.842+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f183c1a3c50 con 0x7f183c09e930 2023-10-03T10:16:03.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.842+0000 7f1838ff9700 1 -- 172.21.15.19:0/56020897 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f182c01b3b0 con 0x7f183c09e930 2023-10-03T10:16:03.842 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 msgr2=0x7f183c1a0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f182c00ebe0 tx=0x7f182c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 shutdown_connections 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f183c09f650 0x7f183c1c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f183c09e930 0x7f183c1a0fd0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 --2- 172.21.15.19:0/56020897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f183c09f240 0x7f183c1a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 >> 172.21.15.19:0/56020897 conn(0x7f183c0a4210 msgr2=0x7f183c06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 shutdown_connections 2023-10-03T10:16:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.845+0000 7f18429ed700 1 -- 172.21.15.19:0/56020897 wait complete. 2023-10-03T10:16:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.846+0000 7f47f759e700 1 Processor -- start 2023-10-03T10:16:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.846+0000 7f47f759e700 1 -- start start 2023-10-03T10:16:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 0x7f47f8138aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f813b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f759e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f8099e10 con 0x7f47f809d800 2023-10-03T10:16:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f759e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f809f560 con 0x7f47f8138fe0 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f759e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47f809e6b0 con 0x7f47f809e2e0 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f47f809d800 0x7f47f809dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35066/0 (socket says 172.21.15.19:35066) 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f659c700 1 -- 172.21.15.19:0/2283160795 learned_addr learned my addr 172.21.15.19:0/2283160795 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.847+0000 7f47f5d9b700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 0x7f47f8138aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f559a700 1 -- 172.21.15.19:0/2283160795 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522739960 0 0) 0x7f47f8099e10 con 0x7f47f809d800 2023-10-03T10:16:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f559a700 1 -- 172.21.15.19:0/2283160795 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e00035b0 con 0x7f47f809d800 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f5d9b700 1 -- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 msgr2=0x7f47f813b3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f5d9b700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f813b3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f5d9b700 1 -- 172.21.15.19:0/2283160795 >> v1:172.21.15.19:6789/0 conn(0x7f47f809d800 legacy=0x7f47f809dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f5d9b700 1 -- 172.21.15.19:0/2283160795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f806b4d0 con 0x7f47f809e2e0 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f5d9b700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 0x7f47f8138aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009850 tx=0x7f47ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=446d7544caa74016 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f559a700 1 -- 172.21.15.19:0/2283160795 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec005e30 con 0x7f47f809e2e0 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f559a700 1 -- 172.21.15.19:0/2283160795 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ec006030 con 0x7f47f809e2e0 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.848+0000 7f47f559a700 1 -- 172.21.15.19:0/2283160795 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0063e0 con 0x7f47f809e2e0 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.849+0000 7f47f759e700 1 -- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 msgr2=0x7f47f8138aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.849+0000 7f47f759e700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 0x7f47f8138aa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47ec009850 tx=0x7f47ec009b60 comp rx=0 tx=0).stop 2023-10-03T10:16:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 -- 172.21.15.19:0/2283160795 shutdown_connections 2023-10-03T10:16:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f813b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 --2- 172.21.15.19:0/2283160795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809e2e0 0x7f47f8138aa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 -- 172.21.15.19:0/2283160795 >> 172.21.15.19:0/2283160795 conn(0x7f47f80a2e20 msgr2=0x7f47f80a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 -- 172.21.15.19:0/2283160795 shutdown_connections 2023-10-03T10:16:03.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.852+0000 7f47f759e700 1 -- 172.21.15.19:0/2283160795 wait complete. 2023-10-03T10:16:03.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.853+0000 7f47f759e700 1 Processor -- start 2023-10-03T10:16:03.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 -- start start 2023-10-03T10:16:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 0x7f47f81c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8120440 con 0x7f47f809e2e0 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8122070 con 0x7f47f8138fe0 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.854+0000 7f47f759e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47f806cf40 con 0x7f47f809d800 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38960/0 (socket says 172.21.15.19:38960) 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 -- 172.21.15.19:0/3426119633 learned_addr learned my addr 172.21.15.19:0/3426119633 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f5d9b700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38882/0 (socket says 172.21.15.19:38882) 2023-10-03T10:16:03.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f659c700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 0x7f47f81c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 -- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 msgr2=0x7f47f81c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 0x7f47f81c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 -- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 msgr2=0x7f47f81c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 -- 172.21.15.19:0/3426119633 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009430 con 0x7f47f8138fe0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f659c700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 0x7f47f81c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f5d9b700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.855+0000 7f47f6d9d700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47f000be60 tx=0x7f47f0009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.856+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000cc30 con 0x7f47f8138fe0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.856+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000cdd0 con 0x7f47f8138fe0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.856+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f809c510 con 0x7f47f8138fe0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.856+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0014680 con 0x7f47f8138fe0 2023-10-03T10:16:03.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.856+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f8122ae0 con 0x7f47f8138fe0 2023-10-03T10:16:03.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.857+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f804f2a0 con 0x7f47f8138fe0 2023-10-03T10:16:03.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.857+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47f00147e0 con 0x7f47f8138fe0 2023-10-03T10:16:03.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.860+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47f0012c60 con 0x7f47f8138fe0 2023-10-03T10:16:03.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.862+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f47f0045060 con 0x7f47f8138fe0 2023-10-03T10:16:03.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:03.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.892+0000 7f0544e29700 1 Processor -- start 2023-10-03T10:16:03.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.892+0000 7f0544e29700 1 -- start start 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f0544e29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f0544e29700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0540138d80 0x7f054013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f0544e29700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05400a2a70 con 0x7f05400a0a30 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f0544e29700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05400a01d0 con 0x7f0540138d80 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f0544e29700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054009e2b0 con 0x7f054009d630 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0540138d80 0x7f054013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38972/0 (socket says 172.21.15.19:38972) 2023-10-03T10:16:03.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 -- 172.21.15.19:0/2877874264 learned_addr learned my addr 172.21.15.19:0/2877874264 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 -- 172.21.15.19:0/2877874264 >> v2:172.21.15.19:3300/0 conn(0x7f0540138d80 msgr2=0x7f054013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 --2- 172.21.15.19:0/2877874264 >> v2:172.21.15.19:3300/0 conn(0x7f0540138d80 0x7f054013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 -- 172.21.15.19:0/2877874264 >> v1:172.21.15.19:6789/0 conn(0x7f05400a0a30 legacy=0x7f05400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053d59a700 1 -- 172.21.15.19:0/2877874264 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238608172 0 0) 0x7f05400a2a70 con 0x7f05400a0a30 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.893+0000 7f053dd9b700 1 -- 172.21.15.19:0/2877874264 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054009dc50 con 0x7f054009d630 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f053dd9b700 1 --2- 172.21.15.19:0/2877874264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05340098f0 tx=0x7f0534009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2c1ff6a31f1f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f053d59a700 1 -- 172.21.15.19:0/2877874264 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534011830 con 0x7f054009d630 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f053d59a700 1 -- 172.21.15.19:0/2877874264 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0534011990 con 0x7f054009d630 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f053d59a700 1 -- 172.21.15.19:0/2877874264 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0534011d20 con 0x7f054009d630 2023-10-03T10:16:03.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f0544e29700 1 -- 172.21.15.19:0/2877874264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 msgr2=0x7f05400a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.894+0000 7f0544e29700 1 --2- 172.21.15.19:0/2877874264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f05340098f0 tx=0x7f0534009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 -- 172.21.15.19:0/2877874264 shutdown_connections 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 --2- 172.21.15.19:0/2877874264 >> v2:172.21.15.19:3300/0 conn(0x7f0540138d80 0x7f054013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 --2- 172.21.15.19:0/2877874264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f05400a1510 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 -- 172.21.15.19:0/2877874264 >> 172.21.15.19:0/2877874264 conn(0x7f05400a3050 msgr2=0x7f05400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 -- 172.21.15.19:0/2877874264 shutdown_connections 2023-10-03T10:16:03.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.895+0000 7f0544e29700 1 -- 172.21.15.19:0/2877874264 wait complete. 2023-10-03T10:16:03.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 Processor -- start 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 -- start start 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 0x7f0540133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540138d80 0x7f05401341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0540134ba0 con 0x7f0540138d80 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0540136580 con 0x7f054009d630 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f0544e29700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0540136ef0 con 0x7f05400a0a30 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f053e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f053e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38988/0 (socket says 172.21.15.19:38988) 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f053e59c700 1 -- 172.21.15.19:0/2619281826 learned_addr learned my addr 172.21.15.19:0/2619281826 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.896+0000 7f053dd9b700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 0x7f0540133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053ed9d700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540138d80 0x7f05401341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 -- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 msgr2=0x7f0540133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 0x7f0540133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 -- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540138d80 msgr2=0x7f05401341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540138d80 0x7f05401341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 -- 172.21.15.19:0/2619281826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009550 con 0x7f054009d630 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053dd9b700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 0x7f0540133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f053e59c700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f053000c8c0 tx=0x7f053000cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530003e30 con 0x7f054009d630 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0530005070 con 0x7f054009d630 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054013ac80 con 0x7f054009d630 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530005400 con 0x7f054009d630 2023-10-03T10:16:03.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.897+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0540137960 con 0x7f054009d630 2023-10-03T10:16:03.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.898+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0530005560 con 0x7f054009d630 2023-10-03T10:16:03.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.899+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f053003ed80 con 0x7f054009d630 2023-10-03T10:16:03.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.899+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05400a1810 con 0x7f054009d630 2023-10-03T10:16:03.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:03.908+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f053000ad10 con 0x7f054009d630 2023-10-03T10:16:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.035+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc168099d20 con 0x7fc16809d640 2023-10-03T10:16:04.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.035+0000 7fc156ffd700 1 -- 172.21.15.19:0/1538321375 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc158020090 con 0x7fc16809d640 2023-10-03T10:16:04.035 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 msgr2=0x7fc1681c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc158009c10 tx=0x7fc158004750 comp rx=0 tx=0).stop 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 shutdown_connections 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc168134180 0x7fc1681c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc16809d640 0x7fc1681c86b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 --2- 172.21.15.19:0/1538321375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc168133870 0x7fc1681c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 >> 172.21.15.19:0/1538321375 conn(0x7fc1680a2540 msgr2=0x7fc1680a0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 shutdown_connections 2023-10-03T10:16:04.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.038+0000 7fc16759e700 1 -- 172.21.15.19:0/1538321375 wait complete. 2023-10-03T10:16:04.052 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.070+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47f809a260 con 0x7f47f8138fe0 2023-10-03T10:16:04.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.070+0000 7f47e6ffd700 1 -- 172.21.15.19:0/3426119633 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f47f0045030 con 0x7f47f8138fe0 2023-10-03T10:16:04.070 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 msgr2=0x7f47f81c8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f47f000be60 tx=0x7f47f0009f30 comp rx=0 tx=0).stop 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 shutdown_connections 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f47f8138fe0 0x7f47f81c8c50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f47f809d800 0x7f47f81c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 --2- 172.21.15.19:0/3426119633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47f809e2e0 0x7f47f81c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 >> 172.21.15.19:0/3426119633 conn(0x7f47f80a2e20 msgr2=0x7f47f806ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 shutdown_connections 2023-10-03T10:16:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.072+0000 7f47f759e700 1 -- 172.21.15.19:0/3426119633 wait complete. 2023-10-03T10:16:04.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:04.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.116+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05400747f0 con 0x7f054009d630 2023-10-03T10:16:04.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.117+0000 7f052effd700 1 -- 172.21.15.19:0/2619281826 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f053000a300 con 0x7f054009d630 2023-10-03T10:16:04.118 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:04.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 msgr2=0x7f0540133740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f053000c8c0 tx=0x7f053000cbd0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 shutdown_connections 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0540138d80 0x7f05401341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054009d630 0x7f0540133740 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 --2- 172.21.15.19:0/2619281826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f05400a0a30 0x7f0540133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 >> 172.21.15.19:0/2619281826 conn(0x7f05400a3050 msgr2=0x7f05400a6780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 shutdown_connections 2023-10-03T10:16:04.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:04.119+0000 7f0544e29700 1 -- 172.21.15.19:0/2619281826 wait complete. 2023-10-03T10:16:04.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:04.864 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:05.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 Processor -- start 2023-10-03T10:16:05.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 -- start start 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 0x7f66e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809f240 0x7f66e81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e8070940 con 0x7f66e809f650 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.010+0000 7f66ee571700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e806fd60 con 0x7f66e809e930 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66ee571700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66e806fa80 con 0x7f66e809f240 2023-10-03T10:16:05.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 0x7f66e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66ecb0e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f66e809f650 0x7f66e8131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35096/0 (socket says 172.21.15.19:35096) 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66ecb0e700 1 -- 172.21.15.19:0/4022814153 learned_addr learned my addr 172.21.15.19:0/4022814153 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e77fe700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809f240 0x7f66e81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 -- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809f240 msgr2=0x7f66e81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809f240 0x7f66e81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 -- 172.21.15.19:0/4022814153 >> v1:172.21.15.19:6789/0 conn(0x7f66e809f650 legacy=0x7f66e8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 -- 172.21.15.19:0/4022814153 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e809fb60 con 0x7f66e809e930 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e6ffd700 1 -- 172.21.15.19:0/4022814153 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622086653 0 0) 0x7f66e8070940 con 0x7f66e809f650 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e7fff700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 0x7f66e809ed00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009870 tx=0x7f66d8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a87fb2ef8d7d01c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e6ffd700 1 -- 172.21.15.19:0/4022814153 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8011830 con 0x7f66e809e930 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e6ffd700 1 -- 172.21.15.19:0/4022814153 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d8011990 con 0x7f66e809e930 2023-10-03T10:16:05.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.011+0000 7f66e6ffd700 1 -- 172.21.15.19:0/4022814153 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8011d20 con 0x7f66e809e930 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 -- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 msgr2=0x7f66e809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 0x7f66e809ed00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009870 tx=0x7f66d8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 -- 172.21.15.19:0/4022814153 shutdown_connections 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809e930 0x7f66e809ed00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 --2- 172.21.15.19:0/4022814153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809f240 0x7f66e81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 -- 172.21.15.19:0/4022814153 >> 172.21.15.19:0/4022814153 conn(0x7f66e80a4210 msgr2=0x7f66e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 -- 172.21.15.19:0/4022814153 shutdown_connections 2023-10-03T10:16:05.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.012+0000 7f66ee571700 1 -- 172.21.15.19:0/4022814153 wait complete. 2023-10-03T10:16:05.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.013+0000 7f66ee571700 1 Processor -- start 2023-10-03T10:16:05.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.013+0000 7f66ee571700 1 -- start start 2023-10-03T10:16:05.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809e930 0x7f66e806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 0x7f66e806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81a8830 con 0x7f66e809f650 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e81a9840 con 0x7f66e809f240 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ee571700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66e806cd10 con 0x7f66e809e930 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ecb0e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 0x7f66e806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38998/0 (socket says 172.21.15.19:38998) 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 -- 172.21.15.19:0/2989532693 learned_addr learned my addr 172.21.15.19:0/2989532693 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809e930 0x7f66e806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 -- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809e930 msgr2=0x7f66e806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809e930 0x7f66e806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 -- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 msgr2=0x7f66e806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 0x7f66e806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66e77fe700 1 -- 172.21.15.19:0/2989532693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d80094a0 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.014+0000 7f66ecb0e700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 0x7f66e806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66e77fe700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e980 tx=0x7f66dc00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc009710 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc00c690 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e80a0190 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00ca20 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.015+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e806d4c0 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.016+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66dc00cb80 con 0x7f66e809f240 2023-10-03T10:16:05.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.016+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66dc03f6c0 con 0x7f66e809f240 2023-10-03T10:16:05.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.016+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e81a0b30 con 0x7f66e809f240 2023-10-03T10:16:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.021+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66dc021080 con 0x7f66e809f240 2023-10-03T10:16:05.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:05.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:05.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:05.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.197+0000 7f80af49c700 1 Processor -- start 2023-10-03T10:16:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 -- start start 2023-10-03T10:16:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f80a806e570 0x7f80a806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a8070ee0 con 0x7f80a8134610 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a8071480 con 0x7f80a806e570 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80af49c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a806f3c0 con 0x7f80a809eca0 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80aca37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80aca37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39014/0 (socket says 172.21.15.19:39014) 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80aca37700 1 -- 172.21.15.19:0/492669206 learned_addr learned my addr 172.21.15.19:0/492669206 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.198+0000 7f80ad238700 1 --2- 172.21.15.19:0/492669206 >> v2:172.21.15.19:3300/0 conn(0x7f80a806e570 0x7f80a806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f809ffff700 1 -- 172.21.15.19:0/492669206 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567086496 0 0) 0x7f80a8070ee0 con 0x7f80a8134610 2023-10-03T10:16:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80ad238700 1 -- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 msgr2=0x7f80a806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80ad238700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80ad238700 1 -- 172.21.15.19:0/492669206 >> v1:172.21.15.19:6789/0 conn(0x7f80a8134610 legacy=0x7f80a8134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80ad238700 1 -- 172.21.15.19:0/492669206 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a8071b90 con 0x7f80a806e570 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80aca37700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f80ad238700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a806e940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009840 tx=0x7f80a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c73af46cc3920b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f809ffff700 1 -- 172.21.15.19:0/492669206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011830 con 0x7f80a806e570 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f809ffff700 1 -- 172.21.15.19:0/492669206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4011990 con 0x7f80a806e570 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.199+0000 7f809ffff700 1 -- 172.21.15.19:0/492669206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4011d20 con 0x7f80a806e570 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 -- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 msgr2=0x7f80a806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a806e940 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009840 tx=0x7f80a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 -- 172.21.15.19:0/492669206 shutdown_connections 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a806e940 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 --2- 172.21.15.19:0/492669206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a809eca0 0x7f80a806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 -- 172.21.15.19:0/492669206 >> 172.21.15.19:0/492669206 conn(0x7f80a80a2aa0 msgr2=0x7f80a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 -- 172.21.15.19:0/492669206 shutdown_connections 2023-10-03T10:16:05.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.200+0000 7f80af49c700 1 -- 172.21.15.19:0/492669206 wait complete. 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.202+0000 7f80af49c700 1 Processor -- start 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.202+0000 7f80af49c700 1 -- start start 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80a8134610 0x7f80a8132630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a813a0d0 0x7f80a8132b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a813b7e0 con 0x7f80a806e570 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80a1e30 con 0x7f80a813a0d0 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80af49c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a8070610 con 0x7f80a8134610 2023-10-03T10:16:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38952/0 (socket says 172.21.15.19:38952) 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 -- 172.21.15.19:0/2962659592 learned_addr learned my addr 172.21.15.19:0/2962659592 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80aca37700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80a8134610 0x7f80a8132630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ada39700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a813a0d0 0x7f80a8132b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 -- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80a8134610 msgr2=0x7f80a8132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80a8134610 0x7f80a8132630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 -- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a813a0d0 msgr2=0x7f80a8132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a813a0d0 0x7f80a8132b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 -- 172.21.15.19:0/2962659592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098009550 con 0x7f80a806e570 2023-10-03T10:16:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.203+0000 7f80ad238700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009fd0 tx=0x7f80a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.204+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40036a0 con 0x7f80a806e570 2023-10-03T10:16:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.204+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a401f070 con 0x7f80a806e570 2023-10-03T10:16:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.204+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a40094a0 con 0x7f80a806e570 2023-10-03T10:16:05.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.204+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4003a20 con 0x7f80a806e570 2023-10-03T10:16:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.204+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a813abb0 con 0x7f80a806e570 2023-10-03T10:16:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.205+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8135120 con 0x7f80a806e570 2023-10-03T10:16:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.206+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80a4003b80 con 0x7f80a806e570 2023-10-03T10:16:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.206+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80a4021070 con 0x7f80a806e570 2023-10-03T10:16:05.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.214+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80a4010b70 con 0x7f80a806e570 2023-10-03T10:16:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.244+0000 7fc959e1f700 1 Processor -- start 2023-10-03T10:16:05.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.244+0000 7fc959e1f700 1 -- start start 2023-10-03T10:16:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc959e1f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc959e1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 0x7fc9541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc959e1f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95409b120 con 0x7fc95409e410 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc959e1f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95406b460 con 0x7fc95409d6f0 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc959e1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409a7e0 con 0x7fc95409e000 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc9537fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc9537fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38964/0 (socket says 172.21.15.19:38964) 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc9537fe700 1 -- 172.21.15.19:0/3592164933 learned_addr learned my addr 172.21.15.19:0/3592164933 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc94affd700 1 --2- 172.21.15.19:0/3592164933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 0x7fc9541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc94affd700 1 -- 172.21.15.19:0/3592164933 >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 msgr2=0x7fc95409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc94affd700 1 --2- 172.21.15.19:0/3592164933 >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc94affd700 1 -- 172.21.15.19:0/3592164933 >> v1:172.21.15.19:6789/0 conn(0x7fc95409e410 legacy=0x7fc954133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc94affd700 1 -- 172.21.15.19:0/3592164933 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95409a500 con 0x7fc95409e000 2023-10-03T10:16:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.245+0000 7fc9537fe700 1 --2- 172.21.15.19:0/3592164933 >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.246+0000 7fc94affd700 1 --2- 172.21.15.19:0/3592164933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 0x7fc9541339f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba405306c14c34e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.246+0000 7fc952ffd700 1 -- 172.21.15.19:0/3592164933 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c004230 con 0x7fc95409e000 2023-10-03T10:16:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.246+0000 7fc952ffd700 1 -- 172.21.15.19:0/3592164933 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c004390 con 0x7fc95409e000 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.246+0000 7fc952ffd700 1 -- 172.21.15.19:0/3592164933 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0036a0 con 0x7fc95409e000 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 -- 172.21.15.19:0/3592164933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 msgr2=0x7fc9541339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 --2- 172.21.15.19:0/3592164933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 0x7fc9541339f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009870 tx=0x7fc93c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 -- 172.21.15.19:0/3592164933 shutdown_connections 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 --2- 172.21.15.19:0/3592164933 >> v2:172.21.15.19:3300/0 conn(0x7fc95409d6f0 0x7fc95409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 --2- 172.21.15.19:0/3592164933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e000 0x7fc9541339f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 -- 172.21.15.19:0/3592164933 >> 172.21.15.19:0/3592164933 conn(0x7fc954066f50 msgr2=0x7fc95409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 -- 172.21.15.19:0/3592164933 shutdown_connections 2023-10-03T10:16:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.247+0000 7fc959e1f700 1 -- 172.21.15.19:0/3592164933 wait complete. 2023-10-03T10:16:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.248+0000 7fc959e1f700 1 Processor -- start 2023-10-03T10:16:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 -- start start 2023-10-03T10:16:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 0x7fc9541ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e410 0x7fc9541ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95409c710 con 0x7fc95409e000 2023-10-03T10:16:05.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9541ad7a0 con 0x7fc95409e410 2023-10-03T10:16:05.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.249+0000 7fc959e1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc9541aef60 con 0x7fc95409d6f0 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc9537fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc9537fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50768/0 (socket says 172.21.15.19:50768) 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc9537fe700 1 -- 172.21.15.19:0/2813953007 learned_addr learned my addr 172.21.15.19:0/2813953007 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 0x7fc9541ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc953fff700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e410 0x7fc9541ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 -- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 msgr2=0x7fc9541abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 -- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e410 msgr2=0x7fc9541ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e410 0x7fc9541ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 -- 172.21.15.19:0/2813953007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc944009550 con 0x7fc95409e000 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc9537fe700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.250+0000 7fc94affd700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 0x7fc9541ac340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc93c015000 tx=0x7fc93c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.251+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c011630 con 0x7fc95409e000 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.251+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c01e070 con 0x7fc95409e000 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.251+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c0119f0 con 0x7fc95409e000 2023-10-03T10:16:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.251+0000 7fc959e1f700 1 -- 172.21.15.19:0/2813953007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0094a0 con 0x7fc95409e000 2023-10-03T10:16:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.251+0000 7fc959e1f700 1 -- 172.21.15.19:0/2813953007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9541bac90 con 0x7fc95409e000 2023-10-03T10:16:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.253+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc93c011b50 con 0x7fc95409e000 2023-10-03T10:16:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.253+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92c0052e0 con 0x7fc95409e000 2023-10-03T10:16:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.253+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc93c040630 con 0x7fc95409e000 2023-10-03T10:16:05.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.262+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc93c02d970 con 0x7fc95409e000 2023-10-03T10:16:05.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.271+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66e8074ea0 con 0x7f66e809f240 2023-10-03T10:16:05.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.272+0000 7f66e4ff9700 1 -- 172.21.15.19:0/2989532693 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66dc0232f0 con 0x7f66e809f240 2023-10-03T10:16:05.272 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:05.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 msgr2=0x7f66e806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00e980 tx=0x7f66dc00ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 shutdown_connections 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66e809f650 0x7f66e806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66e809e930 0x7f66e806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 --2- 172.21.15.19:0/2989532693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66e809f240 0x7f66e806bdf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 >> 172.21.15.19:0/2989532693 conn(0x7f66e80a4210 msgr2=0x7f66e81b8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 shutdown_connections 2023-10-03T10:16:05.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.274+0000 7f66ee571700 1 -- 172.21.15.19:0/2989532693 wait complete. 2023-10-03T10:16:05.289 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:05.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.290+0000 7efddcee7700 1 Processor -- start 2023-10-03T10:16:05.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.290+0000 7efddcee7700 1 -- start start 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efddcee7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efddcee7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdd809e000 0x7efdd81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efddcee7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd809b120 con 0x7efdd809e410 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efddcee7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd806b460 con 0x7efdd809e000 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efddcee7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd809a7e0 con 0x7efdd809d6f0 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efdd659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efdd5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdd809e000 0x7efdd81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efdd5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efdd809e000 0x7efdd81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38976/0 (socket says 172.21.15.19:38976) 2023-10-03T10:16:05.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efdd659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50784/0 (socket says 172.21.15.19:50784) 2023-10-03T10:16:05.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.291+0000 7efdd5d9b700 1 -- 172.21.15.19:0/3100231988 learned_addr learned my addr 172.21.15.19:0/3100231988 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd5d9b700 1 -- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 msgr2=0x7efdd809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd5d9b700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd5d9b700 1 -- 172.21.15.19:0/3100231988 >> v1:172.21.15.19:6789/0 conn(0x7efdd809e410 legacy=0x7efdd8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd5d9b700 1 -- 172.21.15.19:0/3100231988 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd809a500 con 0x7efdd809e000 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd559a700 1 -- 172.21.15.19:0/3100231988 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681657733 0 0) 0x7efdd809b120 con 0x7efdd809e410 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd659c700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd5d9b700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809e000 0x7efdd81339f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0098f0 tx=0x7efdcc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197f3eedfbfc569a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd559a700 1 -- 172.21.15.19:0/3100231988 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc011830 con 0x7efdd809e000 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd559a700 1 -- 172.21.15.19:0/3100231988 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc011990 con 0x7efdd809e000 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.292+0000 7efdd559a700 1 -- 172.21.15.19:0/3100231988 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc011d20 con 0x7efdd809e000 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 -- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809e000 msgr2=0x7efdd81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809e000 0x7efdd81339f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0098f0 tx=0x7efdcc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 -- 172.21.15.19:0/3100231988 shutdown_connections 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809d6f0 0x7efdd809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 --2- 172.21.15.19:0/3100231988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809e000 0x7efdd81339f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 -- 172.21.15.19:0/3100231988 >> 172.21.15.19:0/3100231988 conn(0x7efdd8066f50 msgr2=0x7efdd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 -- 172.21.15.19:0/3100231988 shutdown_connections 2023-10-03T10:16:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.293+0000 7efddcee7700 1 -- 172.21.15.19:0/3100231988 wait complete. 2023-10-03T10:16:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.294+0000 7efddcee7700 1 Processor -- start 2023-10-03T10:16:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.294+0000 7efddcee7700 1 -- start start 2023-10-03T10:16:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efdd809e000 0x7efdd81a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 0x7efdd81a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd81a9150 con 0x7efdd809d6f0 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd809c710 con 0x7efdd809e000 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efddcee7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80a2e40 con 0x7efdd809e410 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38988/0 (socket says 172.21.15.19:38988) 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 -- 172.21.15.19:0/1895908380 learned_addr learned my addr 172.21.15.19:0/1895908380 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd6d9d700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 0x7efdd81a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd5d9b700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efdd809e000 0x7efdd81a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 -- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 msgr2=0x7efdd81a6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 0x7efdd81a6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 -- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efdd809e000 msgr2=0x7efdd81a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efdd809e000 0x7efdd81a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd659c700 1 -- 172.21.15.19:0/1895908380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc80094a0 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.295+0000 7efdd6d9d700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 0x7efdd81a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efdd659c700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdc800ebe0 tx=0x7efdc800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800c850 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc800c9b0 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc009550 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc800cd40 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.296+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd81a8d00 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.297+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdc8013470 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.297+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdc803f770 con 0x7efdd809d6f0 2023-10-03T10:16:05.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.297+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd81a9380 con 0x7efdd809d6f0 2023-10-03T10:16:05.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.302+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdd81a9380 con 0x7efdd809d6f0 2023-10-03T10:16:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.440+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f80a8074ea0 con 0x7f80a806e570 2023-10-03T10:16:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.440+0000 7f809dffb700 1 -- 172.21.15.19:0/2962659592 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80a4015030 con 0x7f80a806e570 2023-10-03T10:16:05.440 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 msgr2=0x7f80a8139b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009fd0 tx=0x7f80a4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 shutdown_connections 2023-10-03T10:16:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80a813a0d0 0x7f80a8132b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80a806e570 0x7f80a8139b90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 --2- 172.21.15.19:0/2962659592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80a8134610 0x7f80a8132630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 >> 172.21.15.19:0/2962659592 conn(0x7f80a80a2aa0 msgr2=0x7f80a81253f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 shutdown_connections 2023-10-03T10:16:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.443+0000 7f80af49c700 1 -- 172.21.15.19:0/2962659592 wait complete. 2023-10-03T10:16:05.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.473+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc92c005590 con 0x7fc95409e000 2023-10-03T10:16:05.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.473+0000 7fc950ff9700 1 -- 172.21.15.19:0/2813953007 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc93c010b70 con 0x7fc95409e000 2023-10-03T10:16:05.473 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 msgr2=0x7fc9541ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 0x7fc9541ac340 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc93c015000 tx=0x7fc93c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 shutdown_connections 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc95409e410 0x7fc9541ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc95409d6f0 0x7fc9541abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 --2- 172.21.15.19:0/2813953007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc95409e000 0x7fc9541ac340 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 >> 172.21.15.19:0/2813953007 conn(0x7fc954066f50 msgr2=0x7fc9540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 shutdown_connections 2023-10-03T10:16:05.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.476+0000 7fc949ffb700 1 -- 172.21.15.19:0/2813953007 wait complete. 2023-10-03T10:16:05.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.513+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efdd81a9380 con 0x7efdd809d6f0 2023-10-03T10:16:05.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.513+0000 7efdc6ffd700 1 -- 172.21.15.19:0/1895908380 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdd81a9380 con 0x7efdd809d6f0 2023-10-03T10:16:05.513 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 msgr2=0x7efdd81a5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7efdc800ebe0 tx=0x7efdc800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 shutdown_connections 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efdd809e410 0x7efdd81a6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdd809d6f0 0x7efdd81a5ea0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 --2- 172.21.15.19:0/1895908380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efdd809e000 0x7efdd81a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.515+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 >> 172.21.15.19:0/1895908380 conn(0x7efdd8066f50 msgr2=0x7efdd81bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.516+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 shutdown_connections 2023-10-03T10:16:05.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:05.516+0000 7efddcee7700 1 -- 172.21.15.19:0/1895908380 wait complete. 2023-10-03T10:16:05.529 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:06.290 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.437+0000 7f886eb03700 1 Processor -- start 2023-10-03T10:16:06.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.437+0000 7f886eb03700 1 -- start start 2023-10-03T10:16:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f886809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f886809e000 0x7f88681339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886806b460 con 0x7f886809e000 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886809b120 con 0x7f886809e410 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886eb03700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f886809a7e0 con 0x7f886809d6f0 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886d0a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f886809e000 0x7f88681339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886c89f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f886809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886d0a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57542/0 (socket says 172.21.15.19:57542) 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f886809e000 0x7f88681339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44572/0 (socket says 172.21.15.19:44572) 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886d0a0700 1 -- 172.21.15.19:0/461720967 learned_addr learned my addr 172.21.15.19:0/461720967 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886c89f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f886809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50440/0 (socket says 172.21.15.19:50440) 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 -- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 msgr2=0x7f886809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f886809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 -- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 msgr2=0x7f8868133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f8867fff700 1 -- 172.21.15.19:0/461720967 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886809a500 con 0x7f886809e000 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.438+0000 7f886d0a0700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f8867fff700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e000 0x7f88681339f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8854009840 tx=0x7f8854009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f683c076ad965666 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f88677fe700 1 -- 172.21.15.19:0/461720967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854011830 con 0x7f886809e000 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f88677fe700 1 -- 172.21.15.19:0/461720967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854011990 con 0x7f886809e000 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f88677fe700 1 -- 172.21.15.19:0/461720967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854011d20 con 0x7f886809e000 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 -- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e000 msgr2=0x7f88681339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e000 0x7f88681339f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8854009840 tx=0x7f8854009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 -- 172.21.15.19:0/461720967 shutdown_connections 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e410 0x7f8868133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f886809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 --2- 172.21.15.19:0/461720967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e000 0x7f88681339f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 -- 172.21.15.19:0/461720967 >> 172.21.15.19:0/461720967 conn(0x7f8868066f50 msgr2=0x7f886809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 -- 172.21.15.19:0/461720967 shutdown_connections 2023-10-03T10:16:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.439+0000 7f886eb03700 1 -- 172.21.15.19:0/461720967 wait complete. 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.440+0000 7f886eb03700 1 Processor -- start 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 -- start start 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e000 0x7f88681c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e410 0x7f88681c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88681a5590 con 0x7f886809e410 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88681a53a0 con 0x7f886809e000 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886eb03700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88680a1fe0 con 0x7f886809d6f0 2023-10-03T10:16:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886c89f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886c89f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50450/0 (socket says 172.21.15.19:50450) 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886c89f700 1 -- 172.21.15.19:0/2697691936 learned_addr learned my addr 172.21.15.19:0/2697691936 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f8867fff700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e000 0x7f88681c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.441+0000 7f886d0a0700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e410 0x7f88681c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 -- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e000 msgr2=0x7f88681c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e000 0x7f88681c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 -- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e410 msgr2=0x7f88681c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e410 0x7f88681c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 -- 172.21.15.19:0/2697691936 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009b30 con 0x7f886809d6f0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886c89f700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9b0 tx=0x7f885c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c009710 con 0x7f886809d6f0 2023-10-03T10:16:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00ee50 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88540094a0 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00ca50 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.442+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88681a7320 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.443+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f885c00cbb0 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.443+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f885c03f860 con 0x7f886809d6f0 2023-10-03T10:16:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.443+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8868074ea0 con 0x7f886809d6f0 2023-10-03T10:16:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.448+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f885c021030 con 0x7f886809d6f0 2023-10-03T10:16:06.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:06.492 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:06.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.600+0000 7fb1d58af700 1 Processor -- start 2023-10-03T10:16:06.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.600+0000 7fb1d58af700 1 -- start start 2023-10-03T10:16:06.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1d58af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 0x7fb1d0138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1d58af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1d00a14a0 0x7fb1d013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1d58af700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d009ea10 con 0x7fb1d00a09c0 2023-10-03T10:16:06.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1d58af700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d009e210 con 0x7fb1d00a14a0 2023-10-03T10:16:06.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1d58af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d00a26f0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ceffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb1d00a09c0 0x7fb1d00a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52944/0 (socket says 172.21.15.19:52944) 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ceffd700 1 -- 172.21.15.19:0/608249714 learned_addr learned my addr 172.21.15.19:0/608249714 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ce7fc700 1 --2- 172.21.15.19:0/608249714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 0x7fb1d0138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1cf7fe700 1 --2- 172.21.15.19:0/608249714 >> v2:172.21.15.19:3300/0 conn(0x7fb1d00a14a0 0x7fb1d013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1cdffb700 1 -- 172.21.15.19:0/608249714 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800287746 0 0) 0x7fb1d009ea10 con 0x7fb1d00a09c0 2023-10-03T10:16:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1cdffb700 1 -- 172.21.15.19:0/608249714 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1b80035b0 con 0x7fb1d00a09c0 2023-10-03T10:16:06.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ce7fc700 1 -- 172.21.15.19:0/608249714 >> v2:172.21.15.19:3300/0 conn(0x7fb1d00a14a0 msgr2=0x7fb1d013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ce7fc700 1 --2- 172.21.15.19:0/608249714 >> v2:172.21.15.19:3300/0 conn(0x7fb1d00a14a0 0x7fb1d013b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.601+0000 7fb1ce7fc700 1 -- 172.21.15.19:0/608249714 >> v1:172.21.15.19:6789/0 conn(0x7fb1d00a09c0 legacy=0x7fb1d00a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.602+0000 7fb1ce7fc700 1 -- 172.21.15.19:0/608249714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d009db70 con 0x7fb1d009d5c0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.602+0000 7fb1ce7fc700 1 --2- 172.21.15.19:0/608249714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 0x7fb1d0138d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009840 tx=0x7fb1c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d878b3b4d6dcffdb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.602+0000 7fb1cdffb700 1 -- 172.21.15.19:0/608249714 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c4004230 con 0x7fb1d009d5c0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.602+0000 7fb1cdffb700 1 -- 172.21.15.19:0/608249714 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c4004390 con 0x7fb1d009d5c0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.602+0000 7fb1cdffb700 1 -- 172.21.15.19:0/608249714 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40036a0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 -- 172.21.15.19:0/608249714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 msgr2=0x7fb1d0138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 --2- 172.21.15.19:0/608249714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 0x7fb1d0138d70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009840 tx=0x7fb1c4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 -- 172.21.15.19:0/608249714 shutdown_connections 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 --2- 172.21.15.19:0/608249714 >> v2:172.21.15.19:3300/0 conn(0x7fb1d00a14a0 0x7fb1d013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 --2- 172.21.15.19:0/608249714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d009d5c0 0x7fb1d0138d70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 -- 172.21.15.19:0/608249714 >> 172.21.15.19:0/608249714 conn(0x7fb1d00a2fe0 msgr2=0x7fb1d00a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 -- 172.21.15.19:0/608249714 shutdown_connections 2023-10-03T10:16:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.603+0000 7fb1d58af700 1 -- 172.21.15.19:0/608249714 wait complete. 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.604+0000 7fb1d58af700 1 Processor -- start 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.604+0000 7fb1d58af700 1 -- start start 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 0x7fb1d0138620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d00a09c0 0x7fb1d0138b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 0x7fb1d01390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d007a490 con 0x7fb1d00a14a0 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d007a670 con 0x7fb1d00a09c0 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1d58af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d007b250 con 0x7fb1d009d5c0 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1cf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 0x7fb1d01390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 0x7fb1d0138620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1cf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 0x7fb1d01390a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44608/0 (socket says 172.21.15.19:44608) 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1cf7fe700 1 -- 172.21.15.19:0/786841210 learned_addr learned my addr 172.21.15.19:0/786841210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ce7fc700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d00a09c0 0x7fb1d0138b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 -- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d00a09c0 msgr2=0x7fb1d0138b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d00a09c0 0x7fb1d0138b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 -- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 msgr2=0x7fb1d01390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 0x7fb1d01390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.605+0000 7fb1ceffd700 1 -- 172.21.15.19:0/786841210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40094a0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1ceffd700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 0x7fb1d0138620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c4e0 tx=0x7fb1c000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0004c80 con 0x7fb1d009d5c0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0004de0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00072f0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d009c340 con 0x7fb1d009d5c0 2023-10-03T10:16:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.606+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d007a0d0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.607+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1c0007450 con 0x7fb1d009d5c0 2023-10-03T10:16:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.607+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d008ab60 con 0x7fb1d009d5c0 2023-10-03T10:16:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.608+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1c003f460 con 0x7fb1d009d5c0 2023-10-03T10:16:06.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.617+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1c0007700 con 0x7fb1d009d5c0 2023-10-03T10:16:06.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.643+0000 7f9dd7b94700 1 Processor -- start 2023-10-03T10:16:06.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 -- start start 2023-10-03T10:16:06.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009e410 0x7f9dd0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd009f130 con 0x7f9dd009e000 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd009f520 con 0x7f9dd009e410 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd7b94700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd009e930 con 0x7f9dd009d6f0 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd5930700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd5930700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50464/0 (socket says 172.21.15.19:50464) 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd5930700 1 -- 172.21.15.19:0/1073349266 learned_addr learned my addr 172.21.15.19:0/1073349266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd512f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9dd009e000 0x7f9dd0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52954/0 (socket says 172.21.15.19:52954) 2023-10-03T10:16:06.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.644+0000 7f9dd6131700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009e410 0x7f9dd0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd5930700 1 -- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009e410 msgr2=0x7f9dd0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd492e700 1 -- 172.21.15.19:0/1073349266 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463079638 0 0) 0x7f9dd009f130 con 0x7f9dd009e000 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd5930700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009e410 0x7f9dd0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd5930700 1 -- 172.21.15.19:0/1073349266 >> v1:172.21.15.19:6789/0 conn(0x7f9dd009e000 legacy=0x7f9dd0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd5930700 1 -- 172.21.15.19:0/1073349266 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd009b2d0 con 0x7f9dd009d6f0 2023-10-03T10:16:06.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd5930700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00bbc0 tx=0x7f9dcc00bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1265dcb77164082 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd492e700 1 -- 172.21.15.19:0/1073349266 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc00dd30 con 0x7f9dd009d6f0 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd492e700 1 -- 172.21.15.19:0/1073349266 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dcc00de90 con 0x7f9dd009d6f0 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.645+0000 7f9dd492e700 1 -- 172.21.15.19:0/1073349266 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dcc010690 con 0x7f9dd009d6f0 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 -- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 msgr2=0x7f9dd009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00bbc0 tx=0x7f9dcc00bed0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 -- 172.21.15.19:0/1073349266 shutdown_connections 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009e410 0x7f9dd0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/1073349266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009d6f0 0x7f9dd009dac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 -- 172.21.15.19:0/1073349266 >> 172.21.15.19:0/1073349266 conn(0x7f9dd0066f50 msgr2=0x7f9dd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 -- 172.21.15.19:0/1073349266 shutdown_connections 2023-10-03T10:16:06.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.646+0000 7f9dd7b94700 1 -- 172.21.15.19:0/1073349266 wait complete. 2023-10-03T10:16:06.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.647+0000 7f9dd7b94700 1 Processor -- start 2023-10-03T10:16:06.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.647+0000 7f9dd7b94700 1 -- start start 2023-10-03T10:16:06.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009d6f0 0x7f9dd011e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9dd009e410 0x7f9dd011eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd0120230 con 0x7f9dd009e410 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd00a1d00 con 0x7f9dd009d6f0 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd7b94700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd0121320 con 0x7f9dd009e000 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50470/0 (socket says 172.21.15.19:50470) 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 -- 172.21.15.19:0/302501506 learned_addr learned my addr 172.21.15.19:0/302501506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd6131700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9dd009e410 0x7f9dd011eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd5930700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009d6f0 0x7f9dd011e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 -- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009d6f0 msgr2=0x7f9dd011e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009d6f0 0x7f9dd011e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 -- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9dd009e410 msgr2=0x7f9dd011eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.648+0000 7f9dd512f700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9dd009e410 0x7f9dd011eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dd512f700 1 -- 172.21.15.19:0/302501506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc00b7f0 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dd512f700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0001eb0 tx=0x7f9dc000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0004c80 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc0004de0 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0007310 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd01218b0 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.649+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd01ca420 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.650+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd011ac20 con 0x7f9dd009e000 2023-10-03T10:16:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.650+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9dc0007470 con 0x7f9dd009e000 2023-10-03T10:16:06.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.650+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9dc003f270 con 0x7f9dd009e000 2023-10-03T10:16:06.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.659+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9dc00133c0 con 0x7f9dd009e000 2023-10-03T10:16:06.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.694+0000 7f1024566700 1 Processor -- start 2023-10-03T10:16:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.694+0000 7f1024566700 1 -- start start 2023-10-03T10:16:06.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.694+0000 7f1024566700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f101c06e570 0x7f101c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.694+0000 7f1024566700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.694+0000 7f1024566700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f101c070ee0 con 0x7f101c134610 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1024566700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f101c071480 con 0x7f101c06e570 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1024566700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c06f3c0 con 0x7f101c09eca0 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1021b01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1021b01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57592/0 (socket says 172.21.15.19:57592) 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1021b01700 1 -- 172.21.15.19:0/1887653215 learned_addr learned my addr 172.21.15.19:0/1887653215 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 --2- 172.21.15.19:0/1887653215 >> v2:172.21.15.19:3300/0 conn(0x7f101c06e570 0x7f101c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 -- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 msgr2=0x7f101c06ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 -- 172.21.15.19:0/1887653215 >> v1:172.21.15.19:6789/0 conn(0x7f101c134610 legacy=0x7f101c134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:06.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 -- 172.21.15.19:0/1887653215 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c071b90 con 0x7f101c06e570 2023-10-03T10:16:06.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1021b01700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:06.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.695+0000 7f1022302700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c06e570 0x7f101c06e940 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1018009840 tx=0x7f1018009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4339cb7c04d7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1021300700 1 -- 172.21.15.19:0/1887653215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018004230 con 0x7f101c06e570 2023-10-03T10:16:06.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1021300700 1 -- 172.21.15.19:0/1887653215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018004390 con 0x7f101c06e570 2023-10-03T10:16:06.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1021300700 1 -- 172.21.15.19:0/1887653215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10180036a0 con 0x7f101c06e570 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 -- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c06e570 msgr2=0x7f101c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c06e570 0x7f101c06e940 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1018009840 tx=0x7f1018009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 -- 172.21.15.19:0/1887653215 shutdown_connections 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c06e570 0x7f101c06e940 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 --2- 172.21.15.19:0/1887653215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c09eca0 0x7f101c06ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 -- 172.21.15.19:0/1887653215 >> 172.21.15.19:0/1887653215 conn(0x7f101c0a2aa0 msgr2=0x7f101c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 -- 172.21.15.19:0/1887653215 shutdown_connections 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.696+0000 7f1024566700 1 -- 172.21.15.19:0/1887653215 wait complete. 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.698+0000 7f1024566700 1 Processor -- start 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.698+0000 7f1024566700 1 -- start start 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.698+0000 7f1024566700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1024566700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c134610 0x7f101c13f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1024566700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c13f900 0x7f101c132e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1024566700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101c13fda0 con 0x7f101c13f900 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1024566700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101c140b40 con 0x7f101c134610 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1024566700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f101c13daa0 con 0x7f101c06e570 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50484/0 (socket says 172.21.15.19:50484) 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 -- 172.21.15.19:0/1475986780 learned_addr learned my addr 172.21.15.19:0/1475986780 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1021b01700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c134610 0x7f101c13f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022b03700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c13f900 0x7f101c132e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 -- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c134610 msgr2=0x7f101c13f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c134610 0x7f101c13f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 -- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c13f900 msgr2=0x7f101c132e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c13f900 0x7f101c132e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 -- 172.21.15.19:0/1475986780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009550 con 0x7f101c06e570 2023-10-03T10:16:06.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.699+0000 7f1022302700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1018000c00 tx=0x7f1018004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:06.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.700+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018003cb0 con 0x7f101c06e570 2023-10-03T10:16:06.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.700+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10180094a0 con 0x7f101c06e570 2023-10-03T10:16:06.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.700+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1018003e10 con 0x7f101c06e570 2023-10-03T10:16:06.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.700+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1018011870 con 0x7f101c06e570 2023-10-03T10:16:06.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.700+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f101c0a1fe0 con 0x7f101c06e570 2023-10-03T10:16:06.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.701+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1018018040 con 0x7f101c06e570 2023-10-03T10:16:06.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.701+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f101803ff20 con 0x7f101c06e570 2023-10-03T10:16:06.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.701+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101c074ea0 con 0x7f101c06e570 2023-10-03T10:16:06.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.706+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f101802b080 con 0x7f101c06e570 2023-10-03T10:16:06.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.723+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f88681a6fd0 con 0x7f886809d6f0 2023-10-03T10:16:06.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.723+0000 7f88657fa700 1 -- 172.21.15.19:0/2697691936 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f885c02a090 con 0x7f886809d6f0 2023-10-03T10:16:06.723 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 msgr2=0x7f88681c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f885c00e9b0 tx=0x7f885c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 shutdown_connections 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f886809e410 0x7f88681c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f886809d6f0 0x7f88681c8190 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 --2- 172.21.15.19:0/2697691936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f886809e000 0x7f88681c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 >> 172.21.15.19:0/2697691936 conn(0x7f8868066f50 msgr2=0x7f88681bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 shutdown_connections 2023-10-03T10:16:06.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.726+0000 7f886eb03700 1 -- 172.21.15.19:0/2697691936 wait complete. 2023-10-03T10:16:06.746 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:06.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.867+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9dd009ca30 con 0x7f9dd009e000 2023-10-03T10:16:06.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.867+0000 7f9dc67fc700 1 -- 172.21.15.19:0/302501506 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9dc0011360 con 0x7f9dd009e000 2023-10-03T10:16:06.867 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 msgr2=0x7f9dd011e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0001eb0 tx=0x7f9dc000c800 comp rx=0 tx=0).stop 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 shutdown_connections 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9dd009e410 0x7f9dd011eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9dd009d6f0 0x7f9dd011e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.869+0000 7f9dd7b94700 1 --2- 172.21.15.19:0/302501506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9dd009e000 0x7f9dd011e5b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.870+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 >> 172.21.15.19:0/302501506 conn(0x7f9dd0066f50 msgr2=0x7f9dd0130b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.870+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 shutdown_connections 2023-10-03T10:16:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.870+0000 7f9dd7b94700 1 -- 172.21.15.19:0/302501506 wait complete. 2023-10-03T10:16:06.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.886+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb1d00747f0 con 0x7fb1d009d5c0 2023-10-03T10:16:06.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.886+0000 7fb1b7fff700 1 -- 172.21.15.19:0/786841210 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1c0011360 con 0x7fb1d009d5c0 2023-10-03T10:16:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 msgr2=0x7fb1d0138620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 0x7fb1d0138620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c4e0 tx=0x7fb1c000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 shutdown_connections 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1d00a14a0 0x7fb1d01390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1d009d5c0 0x7fb1d0138620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 --2- 172.21.15.19:0/786841210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1d00a09c0 0x7fb1d0138b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 >> 172.21.15.19:0/786841210 conn(0x7fb1d00a2fe0 msgr2=0x7fb1d0137030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 shutdown_connections 2023-10-03T10:16:06.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.889+0000 7fb1d58af700 1 -- 172.21.15.19:0/786841210 wait complete. 2023-10-03T10:16:06.902 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:06.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.917+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f101c071100 con 0x7f101c06e570 2023-10-03T10:16:06.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.917+0000 7f1012ffd700 1 -- 172.21.15.19:0/1475986780 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1018016020 con 0x7f101c06e570 2023-10-03T10:16:06.917 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:06.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 msgr2=0x7f101c13ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:06.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1018000c00 tx=0x7f1018004750 comp rx=0 tx=0).stop 2023-10-03T10:16:06.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 shutdown_connections 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f101c13f900 0x7f101c132e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f101c06e570 0x7f101c13ee80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 --2- 172.21.15.19:0/1475986780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f101c134610 0x7f101c13f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 >> 172.21.15.19:0/1475986780 conn(0x7f101c0a2aa0 msgr2=0x7f101c1367d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 shutdown_connections 2023-10-03T10:16:06.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:06.919+0000 7f1024566700 1 -- 172.21.15.19:0/1475986780 wait complete. 2023-10-03T10:16:06.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:07.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:07.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.893+0000 7efc78c59700 1 Processor -- start 2023-10-03T10:16:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.893+0000 7efc78c59700 1 -- start start 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc78c59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc74135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc78c59700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efc74135e50 0x7efc74138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc78c59700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7409f130 con 0x7efc7409d6f0 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc78c59700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7409f520 con 0x7efc74135e50 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc78c59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc7409e930 con 0x7efc7409e1d0 2023-10-03T10:16:07.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc72d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efc74135e50 0x7efc74138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc74135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc7259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc7409d6f0 0x7efc7409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52978/0 (socket says 172.21.15.19:52978) 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc7259c700 1 -- 172.21.15.19:0/4154553362 learned_addr learned my addr 172.21.15.19:0/4154553362 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.894+0000 7efc72d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efc74135e50 0x7efc74138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44624/0 (socket says 172.21.15.19:44624) 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc72d9d700 1 -- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 msgr2=0x7efc74135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc72d9d700 1 --2- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc74135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc72d9d700 1 -- 172.21.15.19:0/4154553362 >> v1:172.21.15.19:6789/0 conn(0x7efc7409d6f0 legacy=0x7efc7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc72d9d700 1 -- 172.21.15.19:0/4154553362 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7409b2d0 con 0x7efc74135e50 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc72d9d700 1 --2- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc74135e50 0x7efc74138230 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009dc0 tx=0x7efc6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a365783c285942 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc7159a700 1 -- 172.21.15.19:0/4154553362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00e070 con 0x7efc74135e50 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc7159a700 1 -- 172.21.15.19:0/4154553362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c00bae0 con 0x7efc74135e50 2023-10-03T10:16:07.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.895+0000 7efc7159a700 1 -- 172.21.15.19:0/4154553362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c00be90 con 0x7efc74135e50 2023-10-03T10:16:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 -- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc74135e50 msgr2=0x7efc74138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 --2- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc74135e50 0x7efc74138230 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009dc0 tx=0x7efc6c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 -- 172.21.15.19:0/4154553362 shutdown_connections 2023-10-03T10:16:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 --2- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc74135e50 0x7efc74138230 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 --2- 172.21.15.19:0/4154553362 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc74135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 -- 172.21.15.19:0/4154553362 >> 172.21.15.19:0/4154553362 conn(0x7efc74066f50 msgr2=0x7efc7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 -- 172.21.15.19:0/4154553362 shutdown_connections 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.896+0000 7efc78c59700 1 -- 172.21.15.19:0/4154553362 wait complete. 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 Processor -- start 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 -- start start 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 0x7efc7411fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74122e70 con 0x7efc7409d6f0 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc741225e0 con 0x7efc74135e50 2023-10-03T10:16:07.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc78c59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc740a1da0 con 0x7efc7409e1d0 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc7259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc72d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 0x7efc7411fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc7259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44632/0 (socket says 172.21.15.19:44632) 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc7259c700 1 -- 172.21.15.19:0/175097486 learned_addr learned my addr 172.21.15.19:0/175097486 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.898+0000 7efc71d9b700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50504/0 (socket says 172.21.15.19:50504) 2023-10-03T10:16:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 -- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 msgr2=0x7efc7411f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 -- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 msgr2=0x7efc7411fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 0x7efc7411fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 -- 172.21.15.19:0/175097486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009a70 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc72d9d700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 0x7efc7411fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc71d9b700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc7259c700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c520 tx=0x7efc6400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64005d70 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640070d0 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7409c700 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64007440 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.899+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc741342e0 con 0x7efc7409d6f0 2023-10-03T10:16:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.900+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc640075a0 con 0x7efc7409d6f0 2023-10-03T10:16:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.900+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc6403ea20 con 0x7efc7409d6f0 2023-10-03T10:16:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.900+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc74074ea0 con 0x7efc7409d6f0 2023-10-03T10:16:07.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:07.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:07.905+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc64017020 con 0x7efc7409d6f0 2023-10-03T10:16:07.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:08.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 Processor -- start 2023-10-03T10:16:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 -- start start 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c0954c0 0x7ff94c095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c1385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c09c280 con 0x7ff94c099680 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09aaf0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff951854700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c09b960 con 0x7ff94c0954c0 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff94a7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff94c099680 0x7ff94c099ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52984/0 (socket says 172.21.15.19:52984) 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.030+0000 7ff94a7fc700 1 -- 172.21.15.19:0/3040591117 learned_addr learned my addr 172.21.15.19:0/3040591117 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c1385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94affd700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c0954c0 0x7ff94c095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 -- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c0954c0 msgr2=0x7ff94c095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff949ffb700 1 -- 172.21.15.19:0/3040591117 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694342388 0 0) 0x7ff94c09c280 con 0x7ff94c099680 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c0954c0 0x7ff94c095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 -- 172.21.15.19:0/3040591117 >> v1:172.21.15.19:6789/0 conn(0x7ff94c099680 legacy=0x7ff94c099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 -- 172.21.15.19:0/3040591117 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09a7b0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c1385a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d25ac33340280f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff949ffb700 1 -- 172.21.15.19:0/3040591117 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c09a1c0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff949ffb700 1 -- 172.21.15.19:0/3040591117 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400bb20 con 0x7ff94c09a1c0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.031+0000 7ff949ffb700 1 -- 172.21.15.19:0/3040591117 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012430 con 0x7ff94c09a1c0 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 -- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 msgr2=0x7ff94c1385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c1385a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff944009dc0 tx=0x7ff94400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 -- 172.21.15.19:0/3040591117 shutdown_connections 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c1385a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 --2- 172.21.15.19:0/3040591117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c0954c0 0x7ff94c095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 -- 172.21.15.19:0/3040591117 >> 172.21.15.19:0/3040591117 conn(0x7ff94c0a2360 msgr2=0x7ff94c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 -- 172.21.15.19:0/3040591117 shutdown_connections 2023-10-03T10:16:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.032+0000 7ff951854700 1 -- 172.21.15.19:0/3040591117 wait complete. 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.033+0000 7ff951854700 1 Processor -- start 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 -- start start 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 0x7ff94c093260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c099680 0x7ff94c0937a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c093ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c093040 con 0x7ff94c0954c0 2023-10-03T10:16:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0923a0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.034+0000 7ff951854700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c13b840 con 0x7ff94c099680 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 0x7ff94c093260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 0x7ff94c093260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44638/0 (socket says 172.21.15.19:44638) 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94affd700 1 -- 172.21.15.19:0/1382189605 learned_addr learned my addr 172.21.15.19:0/1382189605 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c093ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94a7fc700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c099680 0x7ff94c0937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 -- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c099680 msgr2=0x7ff94c0937a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c099680 0x7ff94c0937a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 -- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 msgr2=0x7ff94c093260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 0x7ff94c093260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 -- 172.21.15.19:0/1382189605 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009a70 con 0x7ff94c09a1c0 2023-10-03T10:16:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.035+0000 7ff94b7fe700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c093ce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff944016000 tx=0x7ff944004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.036+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944004880 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.036+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944020070 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.036+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c09f210 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.036+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440276c0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.036+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c090f60 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.037+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff944027820 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.037+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff944022070 con 0x7ff94c09a1c0 2023-10-03T10:16:08.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.037+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c092200 con 0x7ff94c09a1c0 2023-10-03T10:16:08.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.042+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff94c092200 con 0x7ff94c09a1c0 2023-10-03T10:16:08.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 Processor -- start 2023-10-03T10:16:08.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 -- start start 2023-10-03T10:16:08.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe568131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe568099a40 0x7fe568099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56809a850 con 0x7fe56809a3b0 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.047+0000 7fe56f666700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56809b580 con 0x7fe568099a40 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe56f666700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681313c0 con 0x7fe568131810 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe56dc03700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe56809a3b0 0x7fe568138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52996/0 (socket says 172.21.15.19:52996) 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe56dc03700 1 -- 172.21.15.19:0/4159284582 learned_addr learned my addr 172.21.15.19:0/4159284582 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe56cc01700 1 --2- 172.21.15.19:0/4159284582 >> v2:172.21.15.19:3300/0 conn(0x7fe568099a40 0x7fe568099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe56d402700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe568131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229315781 0 0) 0x7fe56809a850 con 0x7fe56809a3b0 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5540035b0 con 0x7fe56809a3b0 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.048+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149561858 0 0) 0x7fe5540035b0 con 0x7fe56809a3b0 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe56cc01700 1 -- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 msgr2=0x7fe568131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe56cc01700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe568131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe56cc01700 1 -- 172.21.15.19:0/4159284582 >> v1:172.21.15.19:6789/0 conn(0x7fe56809a3b0 legacy=0x7fe568138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe56cc01700 1 -- 172.21.15.19:0/4159284582 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56806e8c0 con 0x7fe568099a40 2023-10-03T10:16:08.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe56cc01700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568099e70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe558009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839458fff26f0c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5600019f0 con 0x7fe568099a40 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558004030 con 0x7fe568099a40 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.049+0000 7fe55ffff700 1 -- 172.21.15.19:0/4159284582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580043c0 con 0x7fe568099a40 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 -- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 msgr2=0x7fe568099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568099e70 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe558009870 tx=0x7fe558009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 -- 172.21.15.19:0/4159284582 shutdown_connections 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe568131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 --2- 172.21.15.19:0/4159284582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568099e70 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 -- 172.21.15.19:0/4159284582 >> 172.21.15.19:0/4159284582 conn(0x7fe5680a2aa0 msgr2=0x7fe5680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 -- 172.21.15.19:0/4159284582 shutdown_connections 2023-10-03T10:16:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.050+0000 7fe56f666700 1 -- 172.21.15.19:0/4159284582 wait complete. 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.051+0000 7fe56f666700 1 Processor -- start 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.051+0000 7fe56f666700 1 -- start start 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe56809a3b0 0x7fe568119b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe56811a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56811ce30 con 0x7fe568099a40 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56811d080 con 0x7fe56809a3b0 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56f666700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56811bf70 con 0x7fe568131810 2023-10-03T10:16:08.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44658/0 (socket says 172.21.15.19:44658) 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 -- 172.21.15.19:0/3517796236 learned_addr learned my addr 172.21.15.19:0/3517796236 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56dc03700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe56811a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56cc01700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe56809a3b0 0x7fe568119b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 -- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 msgr2=0x7fe56811a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe56811a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 -- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe56809a3b0 msgr2=0x7fe568119b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe56809a3b0 0x7fe568119b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.052+0000 7fe56d402700 1 -- 172.21.15.19:0/3517796236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5580094a0 con 0x7fe568099a40 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe56d402700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9b0 tx=0x7fe56400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe564009710 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56400c850 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5680a18b0 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56811c430 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.053+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56400cbc0 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.054+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe56400cd20 con 0x7fe568099a40 2023-10-03T10:16:08.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.054+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480052e0 con 0x7fe568099a40 2023-10-03T10:16:08.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.054+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe56403f790 con 0x7fe568099a40 2023-10-03T10:16:08.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.059+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5640232f0 con 0x7fe568099a40 2023-10-03T10:16:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.110+0000 7fe83ba5a700 1 Processor -- start 2023-10-03T10:16:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.110+0000 7fe83ba5a700 1 -- start start 2023-10-03T10:16:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 0x7fe834133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe834134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83409edd0 con 0x7fe8340a1340 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409e1f0 con 0x7fe8340a0a30 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe83ba5a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83409dc50 con 0x7fe834133fa0 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe8397f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe838ff5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 0x7fe834133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe8397f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57640/0 (socket says 172.21.15.19:57640) 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe8397f6700 1 -- 172.21.15.19:0/369295685 learned_addr learned my addr 172.21.15.19:0/369295685 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:08.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.111+0000 7fe839ff7700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe834134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 -- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 msgr2=0x7fe834134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe834134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 -- 172.21.15.19:0/369295685 >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 msgr2=0x7fe834133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 --2- 172.21.15.19:0/369295685 >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 0x7fe834133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 -- 172.21.15.19:0/369295685 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340a1fe0 con 0x7fe8340a0a30 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe838ff5700 1 --2- 172.21.15.19:0/369295685 >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 0x7fe834133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe8397f6700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe830009920 tx=0x7fe830009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d2750756bdafd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe82bfff700 1 -- 172.21.15.19:0/369295685 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011830 con 0x7fe8340a0a30 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe82bfff700 1 -- 172.21.15.19:0/369295685 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe830011990 con 0x7fe8340a0a30 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.112+0000 7fe82bfff700 1 -- 172.21.15.19:0/369295685 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830011d20 con 0x7fe8340a0a30 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 -- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 msgr2=0x7fe8340a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe830009920 tx=0x7fe830009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 -- 172.21.15.19:0/369295685 shutdown_connections 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8340a0e00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/369295685 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe834134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/369295685 >> v2:172.21.15.19:3300/0 conn(0x7fe8340a1340 0x7fe834133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.113+0000 7fe83ba5a700 1 -- 172.21.15.19:0/369295685 >> 172.21.15.19:0/369295685 conn(0x7fe8340a6550 msgr2=0x7fe8340a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.114+0000 7fe83ba5a700 1 -- 172.21.15.19:0/369295685 shutdown_connections 2023-10-03T10:16:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.114+0000 7fe83ba5a700 1 -- 172.21.15.19:0/369295685 wait complete. 2023-10-03T10:16:08.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.115+0000 7fe83ba5a700 1 Processor -- start 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.115+0000 7fe83ba5a700 1 -- start start 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8340a1340 0x7fe8341cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe83406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83406ff60 con 0x7fe8340a1340 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83406f690 con 0x7fe8340a0a30 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe8397f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe8397f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57642/0 (socket says 172.21.15.19:57642) 2023-10-03T10:16:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe8397f6700 1 -- 172.21.15.19:0/3195934708 learned_addr learned my addr 172.21.15.19:0/3195934708 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe83406fc70 con 0x7fe834133fa0 2023-10-03T10:16:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe839ff7700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe83406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.116+0000 7fe838ff5700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8340a1340 0x7fe8341cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 -- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 msgr2=0x7fe83406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe83406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 -- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8340a1340 msgr2=0x7fe8341cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8340a1340 0x7fe8341cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8240094a0 con 0x7fe8340a0a30 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe8397f6700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe830009c70 tx=0x7fe830004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe830004240 con 0x7fe8340a0a30 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83001f070 con 0x7fe8340a0a30 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8300045c0 con 0x7fe8340a0a30 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.117+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe830009550 con 0x7fe8340a0a30 2023-10-03T10:16:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.118+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8340a0220 con 0x7fe8340a0a30 2023-10-03T10:16:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.119+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe830021030 con 0x7fe8340a0a30 2023-10-03T10:16:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.119+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe834074ea0 con 0x7fe8340a0a30 2023-10-03T10:16:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.119+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe830001cf0 con 0x7fe8340a0a30 2023-10-03T10:16:08.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.128+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe830045060 con 0x7fe8340a0a30 2023-10-03T10:16:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.133+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc7406c360 con 0x7efc7409d6f0 2023-10-03T10:16:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.134+0000 7efc62ffd700 1 -- 172.21.15.19:0/175097486 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc64019b40 con 0x7efc7409d6f0 2023-10-03T10:16:08.134 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 msgr2=0x7efc7411f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efc6400c520 tx=0x7efc6400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 shutdown_connections 2023-10-03T10:16:08.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc74135e50 0x7efc7411fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc7409d6f0 0x7efc7411f350 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 --2- 172.21.15.19:0/175097486 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc7409e1d0 0x7efc7411f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 >> 172.21.15.19:0/175097486 conn(0x7efc74066f50 msgr2=0x7efc740711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 shutdown_connections 2023-10-03T10:16:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.136+0000 7efc78c59700 1 -- 172.21.15.19:0/175097486 wait complete. 2023-10-03T10:16:08.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:08.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.268+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe548005590 con 0x7fe568099a40 2023-10-03T10:16:08.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.269+0000 7fe55dffb700 1 -- 172.21.15.19:0/3517796236 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe56401ae80 con 0x7fe568099a40 2023-10-03T10:16:08.269 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 msgr2=0x7fe568119620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe56400e9b0 tx=0x7fe56400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 shutdown_connections 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe568131810 0x7fe56811a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe568099a40 0x7fe568119620 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 --2- 172.21.15.19:0/3517796236 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe56809a3b0 0x7fe568119b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 >> 172.21.15.19:0/3517796236 conn(0x7fe5680a2aa0 msgr2=0x7fe56812e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 shutdown_connections 2023-10-03T10:16:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.271+0000 7fe56f666700 1 -- 172.21.15.19:0/3517796236 wait complete. 2023-10-03T10:16:08.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:08.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.309+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff94c0924e0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.309+0000 7ff933fff700 1 -- 172.21.15.19:0/1382189605 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff94c0924e0 con 0x7ff94c09a1c0 2023-10-03T10:16:08.309 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:08.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 msgr2=0x7ff94c093ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c093ce0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff944016000 tx=0x7ff944004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 shutdown_connections 2023-10-03T10:16:08.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff94c09a1c0 0x7ff94c093ce0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff94c0954c0 0x7ff94c093260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 --2- 172.21.15.19:0/1382189605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff94c099680 0x7ff94c0937a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 >> 172.21.15.19:0/1382189605 conn(0x7ff94c0a2360 msgr2=0x7ff94c097fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 shutdown_connections 2023-10-03T10:16:08.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.312+0000 7ff951854700 1 -- 172.21.15.19:0/1382189605 wait complete. 2023-10-03T10:16:08.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:08.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.363+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe8340a28e0 con 0x7fe8340a0a30 2023-10-03T10:16:08.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.363+0000 7fe829ffb700 1 -- 172.21.15.19:0/3195934708 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe83000b9d0 con 0x7fe8340a0a30 2023-10-03T10:16:08.363 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:08.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.365+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 msgr2=0x7fe8341cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.365+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe830009c70 tx=0x7fe830004750 comp rx=0 tx=0).stop 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.365+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 shutdown_connections 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe834133fa0 0x7fe83406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8340a0a30 0x7fe8341cce10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 --2- 172.21.15.19:0/3195934708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8340a1340 0x7fe8341cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 >> 172.21.15.19:0/3195934708 conn(0x7fe8340a6550 msgr2=0x7fe8341bb170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 shutdown_connections 2023-10-03T10:16:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:08.366+0000 7fe83ba5a700 1 -- 172.21.15.19:0/3195934708 wait complete. 2023-10-03T10:16:08.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:09.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:09.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.297+0000 7fe4d6df6700 1 Processor -- start 2023-10-03T10:16:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.297+0000 7fe4d6df6700 1 -- start start 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d6df6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 0x7fe4d006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d6df6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 0x7fe4d0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d6df6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d012cd90 con 0x7fe4d012f8b0 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d6df6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d012d330 con 0x7fe4d012cf60 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d6df6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0071780 con 0x7fe4d0130430 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d4b92700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 0x7fe4d006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4cffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe4d012f8b0 0x7fe4d012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:52998/0 (socket says 172.21.15.19:52998) 2023-10-03T10:16:09.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4cffff700 1 -- 172.21.15.19:0/3129558802 learned_addr learned my addr 172.21.15.19:0/3129558802 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:09.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d5393700 1 --2- 172.21.15.19:0/3129558802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 0x7fe4d0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d5393700 1 -- 172.21.15.19:0/3129558802 >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 msgr2=0x7fe4d006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d5393700 1 --2- 172.21.15.19:0/3129558802 >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 0x7fe4d006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d5393700 1 -- 172.21.15.19:0/3129558802 >> v1:172.21.15.19:6789/0 conn(0x7fe4d012f8b0 legacy=0x7fe4d012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d5393700 1 -- 172.21.15.19:0/3129558802 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0071a40 con 0x7fe4d0130430 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.298+0000 7fe4d4b92700 1 --2- 172.21.15.19:0/3129558802 >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 0x7fe4d006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4d5393700 1 --2- 172.21.15.19:0/3129558802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 0x7fe4d0137c30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009d90 tx=0x7fe4c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd4054a79fee4679 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4cf7fe700 1 -- 172.21.15.19:0/3129558802 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800e070 con 0x7fe4d0130430 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4cf7fe700 1 -- 172.21.15.19:0/3129558802 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c800bb20 con 0x7fe4d0130430 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4cf7fe700 1 -- 172.21.15.19:0/3129558802 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8012430 con 0x7fe4d0130430 2023-10-03T10:16:09.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4d6df6700 1 -- 172.21.15.19:0/3129558802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 msgr2=0x7fe4d0137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.299+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/3129558802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 0x7fe4d0137c30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009d90 tx=0x7fe4c800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 -- 172.21.15.19:0/3129558802 shutdown_connections 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/3129558802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d0130430 0x7fe4d0137c30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/3129558802 >> v2:172.21.15.19:3300/0 conn(0x7fe4d012cf60 0x7fe4d006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 -- 172.21.15.19:0/3129558802 >> 172.21.15.19:0/3129558802 conn(0x7fe4d00a2aa0 msgr2=0x7fe4d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 -- 172.21.15.19:0/3129558802 shutdown_connections 2023-10-03T10:16:09.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.300+0000 7fe4d6df6700 1 -- 172.21.15.19:0/3129558802 wait complete. 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 Processor -- start 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 -- start start 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 0x7fe4d009b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 0x7fe4d009bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d009c5d0 con 0x7fe4d012cf60 2023-10-03T10:16:09.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d0129fa0 con 0x7fe4d012f8b0 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.301+0000 7fe4d6df6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d012da40 con 0x7fe4d0130430 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57666/0 (socket says 172.21.15.19:57666) 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cffff700 1 -- 172.21.15.19:0/1244321539 learned_addr learned my addr 172.21.15.19:0/1244321539 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 0x7fe4d009bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d4b92700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 0x7fe4d009b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 -- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 msgr2=0x7fe4d009b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 -- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 msgr2=0x7fe4d009b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 0x7fe4d009b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 -- 172.21.15.19:0/1244321539 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c400b740 con 0x7fe4d0130430 2023-10-03T10:16:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cffff700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d4b92700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 0x7fe4d009b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d5393700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 0x7fe4d009bc10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8016000 tx=0x7fe4c8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8012430 con 0x7fe4d0130430 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8020070 con 0x7fe4d0130430 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c8009a70 con 0x7fe4d0130430 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8004280 con 0x7fe4d0130430 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.302+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d009e400 con 0x7fe4d0130430 2023-10-03T10:16:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.303+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4c80043e0 con 0x7fe4d0130430 2023-10-03T10:16:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.304+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4c8022070 con 0x7fe4d0130430 2023-10-03T10:16:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.304+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d009e5f0 con 0x7fe4d0130430 2023-10-03T10:16:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.309+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4c801c400 con 0x7fe4d0130430 2023-10-03T10:16:09.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:09.379 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.430+0000 7f5c4677e700 1 Processor -- start 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.430+0000 7f5c4677e700 1 -- start start 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.430+0000 7f5c4677e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4006e570 0x7f5c4006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.430+0000 7f5c4677e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 0x7f5c4006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c4677e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 0x7f5c40134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c4677e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c40070ee0 con 0x7f5c40134610 2023-10-03T10:16:09.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c4677e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40071480 con 0x7f5c4006e570 2023-10-03T10:16:09.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c4677e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4006f3c0 con 0x7f5c4009eca0 2023-10-03T10:16:09.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c44d1b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 0x7f5c40134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c44d1b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 0x7f5c40134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44710/0 (socket says 172.21.15.19:44710) 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c44d1b700 1 -- 172.21.15.19:0/3132807338 learned_addr learned my addr 172.21.15.19:0/3132807338 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 0x7f5c4006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3ffff700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4006e570 0x7f5c4006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 -- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4006e570 msgr2=0x7f5c4006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4006e570 0x7f5c4006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 -- 172.21.15.19:0/3132807338 >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 msgr2=0x7f5c40134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 --2- 172.21.15.19:0/3132807338 >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 0x7f5c40134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.431+0000 7f5c3f7fe700 1 -- 172.21.15.19:0/3132807338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40071b90 con 0x7f5c4009eca0 2023-10-03T10:16:09.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.432+0000 7f5c3f7fe700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 0x7f5c4006ee80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009840 tx=0x7f5c34009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f23b0bd43c22f388 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.432+0000 7f5c3effd700 1 -- 172.21.15.19:0/3132807338 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011830 con 0x7f5c4009eca0 2023-10-03T10:16:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.432+0000 7f5c3effd700 1 -- 172.21.15.19:0/3132807338 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34011990 con 0x7f5c4009eca0 2023-10-03T10:16:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.432+0000 7f5c3effd700 1 -- 172.21.15.19:0/3132807338 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34011d20 con 0x7f5c4009eca0 2023-10-03T10:16:09.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 -- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 msgr2=0x7f5c4006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 0x7f5c4006ee80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009840 tx=0x7f5c34009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 -- 172.21.15.19:0/3132807338 shutdown_connections 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4006e570 0x7f5c4006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 --2- 172.21.15.19:0/3132807338 >> v2:172.21.15.19:3300/0 conn(0x7f5c40134610 0x7f5c40134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 --2- 172.21.15.19:0/3132807338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4009eca0 0x7f5c4006ee80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 -- 172.21.15.19:0/3132807338 >> 172.21.15.19:0/3132807338 conn(0x7f5c400a2aa0 msgr2=0x7f5c400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 -- 172.21.15.19:0/3132807338 shutdown_connections 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.433+0000 7f5c4677e700 1 -- 172.21.15.19:0/3132807338 wait complete. 2023-10-03T10:16:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.434+0000 7f5c4677e700 1 Processor -- start 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.434+0000 7f5c4677e700 1 -- start start 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c40134610 0x7f5c40121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4009e410 0x7f5c40121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40124870 con 0x7f5c40134610 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40122f40 con 0x7f5c4009e410 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c4677e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40124000 con 0x7f5c4006e570 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50600/0 (socket says 172.21.15.19:50600) 2023-10-03T10:16:09.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 -- 172.21.15.19:0/1439618338 learned_addr learned my addr 172.21.15.19:0/1439618338 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c44d1b700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4009e410 0x7f5c40121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3f7fe700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c40134610 0x7f5c40121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 -- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4009e410 msgr2=0x7f5c40121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4009e410 0x7f5c40121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 -- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c40134610 msgr2=0x7f5c40121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c40134610 0x7f5c40121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 -- 172.21.15.19:0/1439618338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c340094a0 con 0x7f5c4006e570 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.435+0000 7f5c3ffff700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000e9e0 tx=0x7f5c3000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.436+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30009710 con 0x7f5c4006e570 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.436+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000c850 con 0x7f5c4006e570 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.436+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c40070610 con 0x7f5c4006e570 2023-10-03T10:16:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.436+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000cbc0 con 0x7f5c4006e570 2023-10-03T10:16:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.436+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c40122960 con 0x7f5c4006e570 2023-10-03T10:16:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.437+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c3000cd20 con 0x7f5c4006e570 2023-10-03T10:16:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.437+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40123c40 con 0x7f5c4006e570 2023-10-03T10:16:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.437+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c3003f8b0 con 0x7f5c4006e570 2023-10-03T10:16:09.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.442+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c300232f0 con 0x7f5c4006e570 2023-10-03T10:16:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.481+0000 7fa38ebcf700 1 Processor -- start 2023-10-03T10:16:09.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.481+0000 7fa38ebcf700 1 -- start start 2023-10-03T10:16:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38ebcf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa38809d6f0 0x7fa38809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38ebcf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa3881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38ebcf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38809d2f0 con 0x7fa388133f30 2023-10-03T10:16:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38ebcf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38809a810 con 0x7fa38809d6f0 2023-10-03T10:16:09.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38ebcf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38809a470 con 0x7fa38809e000 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa387fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa3881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa38c96b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa38809d6f0 0x7fa38809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa387fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa3881339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57692/0 (socket says 172.21.15.19:57692) 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.482+0000 7fa387fff700 1 -- 172.21.15.19:0/655932960 learned_addr learned my addr 172.21.15.19:0/655932960 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa38c96b700 1 -- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 msgr2=0x7fa3881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa38c96b700 1 --2- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa3881339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa38c96b700 1 -- 172.21.15.19:0/655932960 >> v1:172.21.15.19:6789/0 conn(0x7fa388133f30 legacy=0x7fa38813ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa38c96b700 1 -- 172.21.15.19:0/655932960 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38809ec40 con 0x7fa38809d6f0 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa38c96b700 1 --2- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa38809d6f0 0x7fa38809dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009840 tx=0x7fa37c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd825534794a54d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa3877fe700 1 -- 172.21.15.19:0/655932960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c011830 con 0x7fa38809d6f0 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa3877fe700 1 -- 172.21.15.19:0/655932960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37c011990 con 0x7fa38809d6f0 2023-10-03T10:16:09.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.483+0000 7fa3877fe700 1 -- 172.21.15.19:0/655932960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c011d20 con 0x7fa38809d6f0 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 -- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa38809d6f0 msgr2=0x7fa38809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa38809d6f0 0x7fa38809dac0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009840 tx=0x7fa37c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 -- 172.21.15.19:0/655932960 shutdown_connections 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa38809d6f0 0x7fa38809dac0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/655932960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa3881339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 -- 172.21.15.19:0/655932960 >> 172.21.15.19:0/655932960 conn(0x7fa388066f50 msgr2=0x7fa38809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 -- 172.21.15.19:0/655932960 shutdown_connections 2023-10-03T10:16:09.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.484+0000 7fa38ebcf700 1 -- 172.21.15.19:0/655932960 wait complete. 2023-10-03T10:16:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.485+0000 7fa38ebcf700 1 Processor -- start 2023-10-03T10:16:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 -- start start 2023-10-03T10:16:09.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa38809d6f0 0x7fa38811e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 0x7fa38811f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881221e0 con 0x7fa388133f30 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa388133630 con 0x7fa38809e000 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.486+0000 7fa38ebcf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa388120370 con 0x7fa38809d6f0 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57702/0 (socket says 172.21.15.19:57702) 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 -- 172.21.15.19:0/3819716168 learned_addr learned my addr 172.21.15.19:0/3819716168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa38d16c700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 0x7fa38811f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 -- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa38809d6f0 msgr2=0x7fa38811e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa38809d6f0 0x7fa38811e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 -- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 msgr2=0x7fa38811f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 0x7fa38811f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 -- 172.21.15.19:0/3819716168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37c0094a0 con 0x7fa38809e000 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa38d16c700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 0x7fa38811f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.487+0000 7fa387fff700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e940 tx=0x7fa37400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.488+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3740096a0 con 0x7fa38809e000 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.488+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37400ee90 con 0x7fa38809e000 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.488+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38809c640 con 0x7fa38809e000 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.488+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37400ca90 con 0x7fa38809e000 2023-10-03T10:16:09.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.488+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa388122970 con 0x7fa38809e000 2023-10-03T10:16:09.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.489+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa388121e20 con 0x7fa38809e000 2023-10-03T10:16:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.495+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa37400cbf0 con 0x7fa38809e000 2023-10-03T10:16:09.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.495+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa37403fff0 con 0x7fa38809e000 2023-10-03T10:16:09.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.499+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa374013470 con 0x7fa38809e000 2023-10-03T10:16:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.527+0000 7fee8a219700 1 Processor -- start 2023-10-03T10:16:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.527+0000 7fee8a219700 1 -- start start 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee8a219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee8a219700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee8406ae80 0x7fee84139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee8a219700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8409e130 con 0x7fee8409d9f0 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee8a219700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee841312b0 con 0x7fee8406ae80 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee8a219700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee8409f6e0 con 0x7fee841316c0 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee83fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee8406ae80 0x7fee84139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50614/0 (socket says 172.21.15.19:50614) 2023-10-03T10:16:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee837fe700 1 -- 172.21.15.19:0/3142911184 learned_addr learned my addr 172.21.15.19:0/3142911184 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee83fff700 1 -- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 msgr2=0x7fee84131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:09.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee83fff700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.528+0000 7fee83fff700 1 -- 172.21.15.19:0/3142911184 >> v1:172.21.15.19:6789/0 conn(0x7fee8409d9f0 legacy=0x7fee8406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee827fc700 1 -- 172.21.15.19:0/3142911184 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956997083 0 0) 0x7fee78001110 con 0x7fee8409d9f0 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee83fff700 1 -- 172.21.15.19:0/3142911184 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8409e760 con 0x7fee8406ae80 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee837fe700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee83fff700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee84139550 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009d90 tx=0x7fee7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2cccf45dd7bc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee827fc700 1 -- 172.21.15.19:0/3142911184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c00e070 con 0x7fee8406ae80 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee827fc700 1 -- 172.21.15.19:0/3142911184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c00bb20 con 0x7fee8406ae80 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.529+0000 7fee827fc700 1 -- 172.21.15.19:0/3142911184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c012430 con 0x7fee8406ae80 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 -- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 msgr2=0x7fee84139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee84139550 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009d90 tx=0x7fee7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 -- 172.21.15.19:0/3142911184 shutdown_connections 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee84139550 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 --2- 172.21.15.19:0/3142911184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee84131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 -- 172.21.15.19:0/3142911184 >> 172.21.15.19:0/3142911184 conn(0x7fee84066f50 msgr2=0x7fee8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 -- 172.21.15.19:0/3142911184 shutdown_connections 2023-10-03T10:16:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.530+0000 7fee8a219700 1 -- 172.21.15.19:0/3142911184 wait complete. 2023-10-03T10:16:09.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.532+0000 7fee8a219700 1 Processor -- start 2023-10-03T10:16:09.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.532+0000 7fee8a219700 1 -- start start 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee841c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 0x7fee841c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee841c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee84133d70 con 0x7fee8406ae80 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee84133280 con 0x7fee8409d9f0 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee8a219700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee84134a10 con 0x7fee841316c0 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee82ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 0x7fee841c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee82ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 0x7fee841c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57710/0 (socket says 172.21.15.19:57710) 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee82ffd700 1 -- 172.21.15.19:0/1132703367 learned_addr learned my addr 172.21.15.19:0/1132703367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee841c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee837fe700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee841c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 -- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 msgr2=0x7fee841c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 0x7fee841c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 -- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 msgr2=0x7fee841c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee841c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.533+0000 7fee83fff700 1 -- 172.21.15.19:0/1132703367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74009550 con 0x7fee841316c0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee83fff700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee841c8900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee7c016000 tx=0x7fee7c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c012430 con 0x7fee841316c0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7c020070 con 0x7fee841316c0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c009a70 con 0x7fee841316c0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7c009410 con 0x7fee841316c0 2023-10-03T10:16:09.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.534+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee84132300 con 0x7fee841316c0 2023-10-03T10:16:09.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.535+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee7c004040 con 0x7fee841316c0 2023-10-03T10:16:09.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.535+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee7c022070 con 0x7fee841316c0 2023-10-03T10:16:09.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.535+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee84133f00 con 0x7fee841316c0 2023-10-03T10:16:09.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.542+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe4d0074ea0 con 0x7fe4d0130430 2023-10-03T10:16:09.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.545+0000 7fe4cd7fa700 1 -- 172.21.15.19:0/1244321539 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4c8035090 con 0x7fe4d0130430 2023-10-03T10:16:09.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.545+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee84133f00 con 0x7fee841316c0 2023-10-03T10:16:09.545 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:09.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 msgr2=0x7fe4d009bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 0x7fe4d009bc10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8016000 tx=0x7fe4c8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 shutdown_connections 2023-10-03T10:16:09.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4d0130430 0x7fe4d009bc10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d012cf60 0x7fe4d009b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 --2- 172.21.15.19:0/1244321539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4d012f8b0 0x7fe4d009b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 >> 172.21.15.19:0/1244321539 conn(0x7fe4d00a2aa0 msgr2=0x7fe4d006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 shutdown_connections 2023-10-03T10:16:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.547+0000 7fe4d6df6700 1 -- 172.21.15.19:0/1244321539 wait complete. 2023-10-03T10:16:09.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:09.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.665+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c4009b1e0 con 0x7f5c4006e570 2023-10-03T10:16:09.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.665+0000 7f5c3cff9700 1 -- 172.21.15.19:0/1439618338 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c30021020 con 0x7f5c4006e570 2023-10-03T10:16:09.665 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:09.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 msgr2=0x7f5c401214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000e9e0 tx=0x7f5c3000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 shutdown_connections 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c4009e410 0x7f5c40121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c4006e570 0x7f5c401214e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 --2- 172.21.15.19:0/1439618338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c40134610 0x7f5c40121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.667+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 >> 172.21.15.19:0/1439618338 conn(0x7f5c400a2aa0 msgr2=0x7f5c401bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.668+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 shutdown_connections 2023-10-03T10:16:09.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.668+0000 7f5c4677e700 1 -- 172.21.15.19:0/1439618338 wait complete. 2023-10-03T10:16:09.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:09.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.715+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa38809eeb0 con 0x7fa38809e000 2023-10-03T10:16:09.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.715+0000 7fa3857fa700 1 -- 172.21.15.19:0/3819716168 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa38809eeb0 con 0x7fa38809e000 2023-10-03T10:16:09.715 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 msgr2=0x7fa38811ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa37400e940 tx=0x7fa37400ec50 comp rx=0 tx=0).stop 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 shutdown_connections 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa388133f30 0x7fa38811f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa38809d6f0 0x7fa38811e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 --2- 172.21.15.19:0/3819716168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa38809e000 0x7fa38811ec50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 >> 172.21.15.19:0/3819716168 conn(0x7fa388066f50 msgr2=0x7fa388070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 shutdown_connections 2023-10-03T10:16:09.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.718+0000 7fa38ebcf700 1 -- 172.21.15.19:0/3819716168 wait complete. 2023-10-03T10:16:09.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:09.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.755+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fee84133eb0 con 0x7fee841316c0 2023-10-03T10:16:09.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.755+0000 7fee6bfff700 1 -- 172.21.15.19:0/1132703367 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee7c02f980 con 0x7fee841316c0 2023-10-03T10:16:09.755 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 msgr2=0x7fee841c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee841c8900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fee7c016000 tx=0x7fee7c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 shutdown_connections 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee841316c0 0x7fee841c8900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee8406ae80 0x7fee841c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 --2- 172.21.15.19:0/1132703367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee8409d9f0 0x7fee841c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.757+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 >> 172.21.15.19:0/1132703367 conn(0x7fee84066f50 msgr2=0x7fee840a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.758+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 shutdown_connections 2023-10-03T10:16:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:09.758+0000 7fee8a219700 1 -- 172.21.15.19:0/1132703367 wait complete. 2023-10-03T10:16:09.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:10.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:10.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 Processor -- start 2023-10-03T10:16:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 -- start start 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f750809e930 0x7f750809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f650 0x7f7508131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7508070940 con 0x7f750809f240 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750806fd60 con 0x7f750809e930 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ecf2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750806fa80 con 0x7f750809f650 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ca8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f750809e930 0x7f750809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.711+0000 7f750ca8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f750809e930 0x7f750809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44754/0 (socket says 172.21.15.19:44754) 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 -- 172.21.15.19:0/1947366708 learned_addr learned my addr 172.21.15.19:0/1947366708 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750d28f700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f650 0x7f7508131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 -- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f650 msgr2=0x7f7508131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f650 0x7f7508131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 -- 172.21.15.19:0/1947366708 >> v1:172.21.15.19:6789/0 conn(0x7f750809f240 legacy=0x7f75081317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 -- 172.21.15.19:0/1947366708 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750809fb60 con 0x7f750809e930 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f75077fe700 1 -- 172.21.15.19:0/1947366708 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035574777 0 0) 0x7f7508070940 con 0x7f750809f240 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f750ca8e700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809e930 0x7f750809ed00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0098f0 tx=0x7f74fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2315efb662f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f75077fe700 1 -- 172.21.15.19:0/1947366708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011830 con 0x7f750809e930 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f75077fe700 1 -- 172.21.15.19:0/1947366708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc011990 con 0x7f750809e930 2023-10-03T10:16:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.712+0000 7f75077fe700 1 -- 172.21.15.19:0/1947366708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011d20 con 0x7f750809e930 2023-10-03T10:16:10.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 -- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809e930 msgr2=0x7f750809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809e930 0x7f750809ed00 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0098f0 tx=0x7f74fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 -- 172.21.15.19:0/1947366708 shutdown_connections 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f650 0x7f7508131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 --2- 172.21.15.19:0/1947366708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809e930 0x7f750809ed00 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 -- 172.21.15.19:0/1947366708 >> 172.21.15.19:0/1947366708 conn(0x7f75080a4210 msgr2=0x7f75080a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 -- 172.21.15.19:0/1947366708 shutdown_connections 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.713+0000 7f750ecf2700 1 -- 172.21.15.19:0/1947366708 wait complete. 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.714+0000 7f750ecf2700 1 Processor -- start 2023-10-03T10:16:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.714+0000 7f750ecf2700 1 -- start start 2023-10-03T10:16:10.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 0x7f75081c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 0x7f75081c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081a73a0 con 0x7f750809f650 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75081c38a0 con 0x7f750809f240 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ecf2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7508071d20 con 0x7f750809e930 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750d28f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f7507fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 0x7f75081c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750d28f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44756/0 (socket says 172.21.15.19:44756) 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750d28f700 1 -- 172.21.15.19:0/113788696 learned_addr learned my addr 172.21.15.19:0/113788696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.715+0000 7f750ca8e700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 0x7f75081c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 -- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 msgr2=0x7f75081c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 0x7f75081c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 -- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 msgr2=0x7f75081c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 -- 172.21.15.19:0/113788696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc009550 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f750d28f700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f750ca8e700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 0x7f75081c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f7507fff700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 0x7f75081c3360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c430 tx=0x7f74f400c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40054e0 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f400ce40 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75080a0190 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40038c0 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.716+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75081a56e0 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.717+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74f4003a20 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.717+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74f403ea70 con 0x7f750809f240 2023-10-03T10:16:10.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.718+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75080a3410 con 0x7f750809f240 2023-10-03T10:16:10.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.723+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74f4017080 con 0x7f750809f240 2023-10-03T10:16:10.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:10.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.829+0000 7f42f494a700 1 Processor -- start 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 -- start start 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f42f009d6f0 0x7f42f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e000 0x7f42f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f009f520 con 0x7f42f009d6f0 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009f130 con 0x7f42f009e410 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42f494a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009e930 con 0x7f42f009e000 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.830+0000 7f42eed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57752/0 (socket says 172.21.15.19:57752) 2023-10-03T10:16:10.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 -- 172.21.15.19:0/1787036356 learned_addr learned my addr 172.21.15.19:0/1787036356 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42edd9b700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e000 0x7f42f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42ee59c700 1 --2- 172.21.15.19:0/1787036356 >> v2:172.21.15.19:3300/0 conn(0x7f42f009d6f0 0x7f42f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 -- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e000 msgr2=0x7f42f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e000 0x7f42f0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 -- 172.21.15.19:0/1787036356 >> v2:172.21.15.19:3300/0 conn(0x7f42f009d6f0 msgr2=0x7f42f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 --2- 172.21.15.19:0/1787036356 >> v2:172.21.15.19:3300/0 conn(0x7f42f009d6f0 0x7f42f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 -- 172.21.15.19:0/1787036356 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f009b2d0 con 0x7f42f009e410 2023-10-03T10:16:10.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42eed9d700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42e800d150 tx=0x7f42e800d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dfa7f2fd980c177 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42ed59a700 1 -- 172.21.15.19:0/1787036356 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8010070 con 0x7f42f009e410 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42ed59a700 1 -- 172.21.15.19:0/1787036356 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800dd10 con 0x7f42f009e410 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.831+0000 7f42ed59a700 1 -- 172.21.15.19:0/1787036356 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800b310 con 0x7f42f009e410 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 -- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 msgr2=0x7f42f0130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42e800d150 tx=0x7f42e800d460 comp rx=0 tx=0).stop 2023-10-03T10:16:10.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 -- 172.21.15.19:0/1787036356 shutdown_connections 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009e410 0x7f42f0130ba0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 --2- 172.21.15.19:0/1787036356 >> v2:172.21.15.19:3300/0 conn(0x7f42f009d6f0 0x7f42f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 --2- 172.21.15.19:0/1787036356 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e000 0x7f42f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 -- 172.21.15.19:0/1787036356 >> 172.21.15.19:0/1787036356 conn(0x7f42f0066f50 msgr2=0x7f42f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 -- 172.21.15.19:0/1787036356 shutdown_connections 2023-10-03T10:16:10.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.832+0000 7f42f494a700 1 -- 172.21.15.19:0/1787036356 wait complete. 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.834+0000 7f42f494a700 1 Processor -- start 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.834+0000 7f42f494a700 1 -- start start 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42f009e000 0x7f42f011e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e410 0x7f42f011ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f011fdb0 con 0x7f42f009e000 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01214f0 con 0x7f42f009d6f0 2023-10-03T10:16:10.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42f494a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42f009c770 con 0x7f42f009e410 2023-10-03T10:16:10.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57768/0 (socket says 172.21.15.19:57768) 2023-10-03T10:16:10.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 -- 172.21.15.19:0/2610348554 learned_addr learned my addr 172.21.15.19:0/2610348554 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42eed9d700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e410 0x7f42f011ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42edd9b700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42f009e000 0x7f42f011e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 -- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e410 msgr2=0x7f42f011ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e410 0x7f42f011ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 -- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42f009e000 msgr2=0x7f42f011e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.835+0000 7f42ee59c700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42f009e000 0x7f42f011e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42ee59c700 1 -- 172.21.15.19:0/2610348554 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e800bd40 con 0x7f42f009d6f0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42ee59c700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e840 tx=0x7f42e000eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000c070 con 0x7f42f009d6f0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e0013610 con 0x7f42f009d6f0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f01219e0 con 0x7f42f009d6f0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0013980 con 0x7f42f009d6f0 2023-10-03T10:16:10.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.836+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f0121720 con 0x7f42f009d6f0 2023-10-03T10:16:10.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.837+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42e0013ae0 con 0x7f42f009d6f0 2023-10-03T10:16:10.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.838+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f011ac20 con 0x7f42f009d6f0 2023-10-03T10:16:10.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.838+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f42e003f400 con 0x7f42f009d6f0 2023-10-03T10:16:10.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.843+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f42e001c400 con 0x7f42f009d6f0 2023-10-03T10:16:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.877+0000 7fef68ae2700 1 Processor -- start 2023-10-03T10:16:10.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.877+0000 7fef68ae2700 1 -- start start 2023-10-03T10:16:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.878+0000 7fef68ae2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef64138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.878+0000 7fef68ae2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef64139170 0x7fef6413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.878+0000 7fef68ae2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6409b120 con 0x7fef6409d6f0 2023-10-03T10:16:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.878+0000 7fef68ae2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6406b460 con 0x7fef64139170 2023-10-03T10:16:10.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.878+0000 7fef68ae2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef6409a7e0 con 0x7fef6409e1d0 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef61d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef64138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef6259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef6409d6f0 0x7fef6409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53028/0 (socket says 172.21.15.19:53028) 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef61d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef64138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50666/0 (socket says 172.21.15.19:50666) 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef6259c700 1 -- 172.21.15.19:0/3314827813 learned_addr learned my addr 172.21.15.19:0/3314827813 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 --2- 172.21.15.19:0/3314827813 >> v2:172.21.15.19:3300/0 conn(0x7fef64139170 0x7fef6413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 -- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 msgr2=0x7fef64138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 --2- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef64138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 -- 172.21.15.19:0/3314827813 >> v1:172.21.15.19:6789/0 conn(0x7fef6409d6f0 legacy=0x7fef6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 -- 172.21.15.19:0/3314827813 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6409a500 con 0x7fef64139170 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.879+0000 7fef62d9d700 1 --2- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef6413b550 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d90 tx=0x7fef5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26efbb6a6e345786 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.880+0000 7fef6159a700 1 -- 172.21.15.19:0/3314827813 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00e070 con 0x7fef64139170 2023-10-03T10:16:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.880+0000 7fef6159a700 1 -- 172.21.15.19:0/3314827813 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00bb20 con 0x7fef64139170 2023-10-03T10:16:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.880+0000 7fef6159a700 1 -- 172.21.15.19:0/3314827813 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c012430 con 0x7fef64139170 2023-10-03T10:16:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 -- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 msgr2=0x7fef6413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 --2- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef6413b550 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d90 tx=0x7fef5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 -- 172.21.15.19:0/3314827813 shutdown_connections 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 --2- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef6413b550 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 --2- 172.21.15.19:0/3314827813 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef64138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 -- 172.21.15.19:0/3314827813 >> 172.21.15.19:0/3314827813 conn(0x7fef64066f50 msgr2=0x7fef6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 -- 172.21.15.19:0/3314827813 shutdown_connections 2023-10-03T10:16:10.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.881+0000 7fef68ae2700 1 -- 172.21.15.19:0/3314827813 wait complete. 2023-10-03T10:16:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.882+0000 7fef68ae2700 1 Processor -- start 2023-10-03T10:16:10.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.882+0000 7fef68ae2700 1 -- start start 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef6411f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef641c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef64122510 con 0x7fef64139170 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef64121ee0 con 0x7fef6409d6f0 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef68ae2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef640a3b10 con 0x7fef6409e1d0 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef6259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef6259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57782/0 (socket says 172.21.15.19:57782) 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef6259c700 1 -- 172.21.15.19:0/1327316219 learned_addr learned my addr 172.21.15.19:0/1327316219 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef62d9d700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef641c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.883+0000 7fef61d9b700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef6411f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 -- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 msgr2=0x7fef6411f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef6411f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 -- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 msgr2=0x7fef6411f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 -- 172.21.15.19:0/1327316219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009a70 con 0x7fef64139170 2023-10-03T10:16:10.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef6259c700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef62d9d700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef641c8360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d90 tx=0x7fef5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c012430 con 0x7fef64139170 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c020070 con 0x7fef64139170 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6409c710 con 0x7fef64139170 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.884+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6411fdc0 con 0x7fef64139170 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.885+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c004280 con 0x7fef64139170 2023-10-03T10:16:10.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.885+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef5c0043e0 con 0x7fef64139170 2023-10-03T10:16:10.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.886+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef5c022070 con 0x7fef64139170 2023-10-03T10:16:10.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.886+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef480052e0 con 0x7fef64139170 2023-10-03T10:16:10.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.891+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef5c01b400 con 0x7fef64139170 2023-10-03T10:16:10.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.921+0000 7ff2588dd700 1 Processor -- start 2023-10-03T10:16:10.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.921+0000 7ff2588dd700 1 -- start start 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff2588dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff25409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff2588dd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 0x7ff254131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff2588dd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff254070940 con 0x7ff25409f240 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff2588dd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff25406fd60 con 0x7ff25409f650 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff2588dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff25406fa80 con 0x7ff25409e930 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff252d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 0x7ff254131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff251d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff25409f240 0x7ff2541317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53032/0 (socket says 172.21.15.19:53032) 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff252d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 0x7ff254131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44806/0 (socket says 172.21.15.19:44806) 2023-10-03T10:16:10.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff251d9b700 1 -- 172.21.15.19:0/475405179 learned_addr learned my addr 172.21.15.19:0/475405179 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25259c700 1 --2- 172.21.15.19:0/475405179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff25409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25159a700 1 -- 172.21.15.19:0/475405179 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2990047014 0 0) 0x7ff254070940 con 0x7ff25409f240 2023-10-03T10:16:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25259c700 1 -- 172.21.15.19:0/475405179 >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 msgr2=0x7ff254131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:10.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25259c700 1 --2- 172.21.15.19:0/475405179 >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 0x7ff254131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25259c700 1 -- 172.21.15.19:0/475405179 >> v1:172.21.15.19:6789/0 conn(0x7ff25409f240 legacy=0x7ff2541317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.922+0000 7ff25259c700 1 -- 172.21.15.19:0/475405179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25409fb60 con 0x7ff25409e930 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.923+0000 7ff25259c700 1 --2- 172.21.15.19:0/475405179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff25409ed00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff244009840 tx=0x7ff244009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19bc50724d9a34a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.923+0000 7ff25159a700 1 -- 172.21.15.19:0/475405179 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244010a90 con 0x7ff25409e930 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.923+0000 7ff25159a700 1 -- 172.21.15.19:0/475405179 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244010bf0 con 0x7ff25409e930 2023-10-03T10:16:10.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.923+0000 7ff25159a700 1 -- 172.21.15.19:0/475405179 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244018440 con 0x7ff25409e930 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 -- 172.21.15.19:0/475405179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 msgr2=0x7ff25409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 --2- 172.21.15.19:0/475405179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff25409ed00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff244009840 tx=0x7ff244009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 -- 172.21.15.19:0/475405179 shutdown_connections 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 --2- 172.21.15.19:0/475405179 >> v2:172.21.15.19:3300/0 conn(0x7ff25409f650 0x7ff254131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 --2- 172.21.15.19:0/475405179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff25409ed00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 -- 172.21.15.19:0/475405179 >> 172.21.15.19:0/475405179 conn(0x7ff2540a4210 msgr2=0x7ff2540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 -- 172.21.15.19:0/475405179 shutdown_connections 2023-10-03T10:16:10.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.924+0000 7ff2588dd700 1 -- 172.21.15.19:0/475405179 wait complete. 2023-10-03T10:16:10.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.926+0000 7ff2588dd700 1 Processor -- start 2023-10-03T10:16:10.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.926+0000 7ff2588dd700 1 -- start start 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff2541c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 0x7ff2541c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff25409f650 0x7ff2541c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541a2250 con 0x7ff25409f240 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541a2060 con 0x7ff25409f650 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff2588dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2541a3f70 con 0x7ff25409e930 2023-10-03T10:16:10.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff251d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 0x7ff2541c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff251d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 0x7ff2541c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44822/0 (socket says 172.21.15.19:44822) 2023-10-03T10:16:10.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff251d9b700 1 -- 172.21.15.19:0/4070403275 learned_addr learned my addr 172.21.15.19:0/4070403275 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:10.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff25259c700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff2541c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.927+0000 7ff252d9d700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff25409f650 0x7ff2541c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 -- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff25409f650 msgr2=0x7ff2541c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff25409f650 0x7ff2541c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 -- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 msgr2=0x7ff2541c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 0x7ff2541c4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 -- 172.21.15.19:0/4070403275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2440094a0 con 0x7ff25409e930 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff25259c700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff2541c3c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff24401a000 tx=0x7ff244004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff244003ab0 con 0x7ff25409e930 2023-10-03T10:16:10.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff244003c10 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2540a0190 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2440185f0 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.928+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2541a3c90 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.929+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2541a3930 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.930+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff24401f040 con 0x7ff25409e930 2023-10-03T10:16:10.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.930+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff244045290 con 0x7ff25409e930 2023-10-03T10:16:10.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.938+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff244020390 con 0x7ff25409e930 2023-10-03T10:16:10.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.953+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7508074ea0 con 0x7f750809f240 2023-10-03T10:16:10.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.954+0000 7f75057fa700 1 -- 172.21.15.19:0/113788696 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74f4019b20 con 0x7f750809f240 2023-10-03T10:16:10.954 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:10.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 msgr2=0x7f75081c3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:10.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 0x7f75081c3360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c430 tx=0x7f74f400c740 comp rx=0 tx=0).stop 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 shutdown_connections 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f750809f650 0x7f75081c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f750809e930 0x7f75081c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 --2- 172.21.15.19:0/113788696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f750809f240 0x7f75081c3360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.956+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 >> 172.21.15.19:0/113788696 conn(0x7f75080a4210 msgr2=0x7f75081b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.957+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 shutdown_connections 2023-10-03T10:16:10.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:10.957+0000 7f750ecf2700 1 -- 172.21.15.19:0/113788696 wait complete. 2023-10-03T10:16:10.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.063+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f42f0074ea0 con 0x7f42f009d6f0 2023-10-03T10:16:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.063+0000 7f42deffd700 1 -- 172.21.15.19:0/2610348554 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f42e0010310 con 0x7f42f009d6f0 2023-10-03T10:16:11.063 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 msgr2=0x7f42f011e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e840 tx=0x7f42e000eb50 comp rx=0 tx=0).stop 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 shutdown_connections 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f42f009e410 0x7f42f011ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f42f009d6f0 0x7f42f011e1a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 --2- 172.21.15.19:0/2610348554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f42f009e000 0x7f42f011e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 >> 172.21.15.19:0/2610348554 conn(0x7f42f0066f50 msgr2=0x7f42f0130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 shutdown_connections 2023-10-03T10:16:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.067+0000 7f42f494a700 1 -- 172.21.15.19:0/2610348554 wait complete. 2023-10-03T10:16:11.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:11.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.104+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef48005590 con 0x7fef64139170 2023-10-03T10:16:11.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.104+0000 7fef52ffd700 1 -- 172.21.15.19:0/1327316219 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef5c034090 con 0x7fef64139170 2023-10-03T10:16:11.104 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.106+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 msgr2=0x7fef641c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.106+0000 7fef68ae2700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef641c8360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009d90 tx=0x7fef5c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 shutdown_connections 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef64139170 0x7fef641c8360 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef6409d6f0 0x7fef6411f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 --2- 172.21.15.19:0/1327316219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef6409e1d0 0x7fef6411f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 >> 172.21.15.19:0/1327316219 conn(0x7fef64066f50 msgr2=0x7fef64136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 shutdown_connections 2023-10-03T10:16:11.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.107+0000 7fef68ae2700 1 -- 172.21.15.19:0/1327316219 wait complete. 2023-10-03T10:16:11.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:11.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.160+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2541a3930 con 0x7ff25409e930 2023-10-03T10:16:11.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.160+0000 7ff242ffd700 1 -- 172.21.15.19:0/4070403275 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff244027020 con 0x7ff25409e930 2023-10-03T10:16:11.160 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 msgr2=0x7ff2541c3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff2541c3c20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff24401a000 tx=0x7ff244004750 comp rx=0 tx=0).stop 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 shutdown_connections 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff25409f650 0x7ff2541c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff25409e930 0x7ff2541c3c20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 --2- 172.21.15.19:0/4070403275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff25409f240 0x7ff2541c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 >> 172.21.15.19:0/4070403275 conn(0x7ff2540a4210 msgr2=0x7ff2540a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 shutdown_connections 2023-10-03T10:16:11.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:11.163+0000 7ff2588dd700 1 -- 172.21.15.19:0/4070403275 wait complete. 2023-10-03T10:16:11.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:11.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:12.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.117+0000 7fd5bc5af700 1 Processor -- start 2023-10-03T10:16:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.117+0000 7fd5bc5af700 1 -- start start 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bc5af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bc5af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5b406b080 0x7fd5b4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bc5af700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b409ece0 con 0x7fd5b4131b40 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bc5af700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b409e760 con 0x7fd5b406b080 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bc5af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b409e040 con 0x7fd5b406a770 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5b9b4a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5b406b080 0x7fd5b4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5ba34b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bab4c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd5b4131b40 0x7fd5b4138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53036/0 (socket says 172.21.15.19:53036) 2023-10-03T10:16:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5bab4c700 1 -- 172.21.15.19:0/2997799519 learned_addr learned my addr 172.21.15.19:0/2997799519 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5b9b4a700 1 -- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 msgr2=0x7fd5b406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5b9b4a700 1 --2- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5b9b4a700 1 -- 172.21.15.19:0/2997799519 >> v1:172.21.15.19:6789/0 conn(0x7fd5b4131b40 legacy=0x7fd5b4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.118+0000 7fd5b9349700 1 -- 172.21.15.19:0/2997799519 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774329379 0 0) 0x7fd5b409ece0 con 0x7fd5b4131b40 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.119+0000 7fd5b9b4a700 1 -- 172.21.15.19:0/2997799519 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b409f630 con 0x7fd5b406b080 2023-10-03T10:16:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.119+0000 7fd5b9b4a700 1 --2- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b4131600 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009840 tx=0x7fd5a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18b2c81ea04db6b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.119+0000 7fd5b9349700 1 -- 172.21.15.19:0/2997799519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011830 con 0x7fd5b406b080 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.119+0000 7fd5b9349700 1 -- 172.21.15.19:0/2997799519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a4011990 con 0x7fd5b406b080 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.119+0000 7fd5b9349700 1 -- 172.21.15.19:0/2997799519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4011d20 con 0x7fd5b406b080 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 -- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 msgr2=0x7fd5b4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b4131600 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009840 tx=0x7fd5a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 -- 172.21.15.19:0/2997799519 shutdown_connections 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/2997799519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b4131600 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 -- 172.21.15.19:0/2997799519 >> 172.21.15.19:0/2997799519 conn(0x7fd5b4066f50 msgr2=0x7fd5b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 -- 172.21.15.19:0/2997799519 shutdown_connections 2023-10-03T10:16:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.120+0000 7fd5bc5af700 1 -- 172.21.15.19:0/2997799519 wait complete. 2023-10-03T10:16:12.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 Processor -- start 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 -- start start 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b41c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4124ba0 con 0x7fd5b406b080 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b4126250 con 0x7fd5b406a770 2023-10-03T10:16:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.121+0000 7fd5bc5af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b409c010 con 0x7fd5b4131b40 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5b9b4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5b9b4a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44836/0 (socket says 172.21.15.19:44836) 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5b9b4a700 1 -- 172.21.15.19:0/254373928 learned_addr learned my addr 172.21.15.19:0/254373928 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50720/0 (socket says 172.21.15.19:50720) 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5ba34b700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b41c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 -- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 msgr2=0x7fd5b41c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b41c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 -- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 msgr2=0x7fd5b41c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 -- 172.21.15.19:0/254373928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a40094a0 con 0x7fd5b4131b40 2023-10-03T10:16:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5b9b4a700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bab4c700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c460 tx=0x7fd5ac00c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac004c80 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac004e00 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b4071e60 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac007310 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.122+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b4131180 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.123+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5ac007470 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.123+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b41260b0 con 0x7fd5b4131b40 2023-10-03T10:16:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.124+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5ac03f2c0 con 0x7fd5b4131b40 2023-10-03T10:16:12.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.129+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5b41260b0 con 0x7fd5b4131b40 2023-10-03T10:16:12.177 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.229+0000 7fbcb88c4700 1 Processor -- start 2023-10-03T10:16:12.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.229+0000 7fbcb88c4700 1 -- start start 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb88c4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcb409e1b0 0x7fbcb4138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb88c4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb4138f50 0x7fbcb413b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb88c4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcb409a570 con 0x7fbcb409d6d0 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb88c4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb409e5a0 con 0x7fbcb409e1b0 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb88c4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb409b1c0 con 0x7fbcb4138f50 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcb409e1b0 0x7fbcb4138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcb409e1b0 0x7fbcb4138a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44840/0 (socket says 172.21.15.19:44840) 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 -- 172.21.15.19:0/2487734922 learned_addr learned my addr 172.21.15.19:0/2487734922 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb2d9d700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb4138f50 0x7fbcb413b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 -- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb4138f50 msgr2=0x7fbcb413b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb4138f50 0x7fbcb413b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 -- 172.21.15.19:0/2487734922 >> v1:172.21.15.19:6789/0 conn(0x7fbcb409d6d0 legacy=0x7fbcb409daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.230+0000 7fbcb1d9b700 1 -- 172.21.15.19:0/2487734922 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb409f240 con 0x7fbcb409e1b0 2023-10-03T10:16:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.231+0000 7fbcb1d9b700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb409e1b0 0x7fbcb4138a10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbca80098f0 tx=0x7fbca8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bb06f67ea171cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.231+0000 7fbcb159a700 1 -- 172.21.15.19:0/2487734922 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011830 con 0x7fbcb409e1b0 2023-10-03T10:16:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.231+0000 7fbcb159a700 1 -- 172.21.15.19:0/2487734922 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8011990 con 0x7fbcb409e1b0 2023-10-03T10:16:12.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.231+0000 7fbcb159a700 1 -- 172.21.15.19:0/2487734922 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8011d20 con 0x7fbcb409e1b0 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 -- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb409e1b0 msgr2=0x7fbcb4138a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb409e1b0 0x7fbcb4138a10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbca80098f0 tx=0x7fbca8009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 -- 172.21.15.19:0/2487734922 shutdown_connections 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb4138f50 0x7fbcb413b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/2487734922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb409e1b0 0x7fbcb4138a10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 -- 172.21.15.19:0/2487734922 >> 172.21.15.19:0/2487734922 conn(0x7fbcb4099c20 msgr2=0x7fbcb40a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 -- 172.21.15.19:0/2487734922 shutdown_connections 2023-10-03T10:16:12.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.232+0000 7fbcb88c4700 1 -- 172.21.15.19:0/2487734922 wait complete. 2023-10-03T10:16:12.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.233+0000 7fbcb88c4700 1 Processor -- start 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 -- start start 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcb409d6d0 0x7fbcb411a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 0x7fbcb411a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 0x7fbcb41c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4119d20 con 0x7fbcb4138f50 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41380f0 con 0x7fbcb409d6d0 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.234+0000 7fbcb88c4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb409c900 con 0x7fbcb409e1b0 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 0x7fbcb411a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcb409d6d0 0x7fbcb411a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 0x7fbcb411a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50734/0 (socket says 172.21.15.19:50734) 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb1d9b700 1 -- 172.21.15.19:0/3688502092 learned_addr learned my addr 172.21.15.19:0/3688502092 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 0x7fbcb41c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 -- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 msgr2=0x7fbcb411a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 0x7fbcb411a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 -- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcb409d6d0 msgr2=0x7fbcb411a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcb409d6d0 0x7fbcb411a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 -- 172.21.15.19:0/3688502092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca8009550 con 0x7fbcb4138f50 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.235+0000 7fbcb2d9d700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 0x7fbcb41c8140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ef90 tx=0x7fbcac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.236+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00cc90 con 0x7fbcb4138f50 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.236+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00f040 con 0x7fbcb4138f50 2023-10-03T10:16:12.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.236+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0146c0 con 0x7fbcb4138f50 2023-10-03T10:16:12.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.236+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb411caf0 con 0x7fbcb4138f50 2023-10-03T10:16:12.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.236+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb411d820 con 0x7fbcb4138f50 2023-10-03T10:16:12.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.237+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcac014820 con 0x7fbcb4138f50 2023-10-03T10:16:12.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.237+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb404f2a0 con 0x7fbcb4138f50 2023-10-03T10:16:12.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.237+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcac040180 con 0x7fbcb4138f50 2023-10-03T10:16:12.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.242+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcac014ad0 con 0x7fbcb4138f50 2023-10-03T10:16:12.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.267+0000 7f8695b8a700 1 Processor -- start 2023-10-03T10:16:12.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.267+0000 7f8695b8a700 1 -- start start 2023-10-03T10:16:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f8695b8a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f869012cc20 0x7f869012f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f8695b8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f8695b8a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869009a510 con 0x7f869012c2f0 2023-10-03T10:16:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f8695b8a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869012c7d0 con 0x7f869012cc20 2023-10-03T10:16:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f8695b8a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869009c190 con 0x7f869012cff0 2023-10-03T10:16:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f868effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f869012c2f0 0x7f869012fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53054/0 (socket says 172.21.15.19:53054) 2023-10-03T10:16:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f868effd700 1 -- 172.21.15.19:0/2399285813 learned_addr learned my addr 172.21.15.19:0/2399285813 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f868f7fe700 1 --2- 172.21.15.19:0/2399285813 >> v2:172.21.15.19:3300/0 conn(0x7f869012cc20 0x7f869012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.268+0000 7f868ffff700 1 --2- 172.21.15.19:0/2399285813 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868e7fc700 1 -- 172.21.15.19:0/2399285813 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2809053118 0 0) 0x7f869009a510 con 0x7f869012c2f0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868e7fc700 1 -- 172.21.15.19:0/2399285813 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86780035b0 con 0x7f869012c2f0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868ffff700 1 -- 172.21.15.19:0/2399285813 >> v2:172.21.15.19:3300/0 conn(0x7f869012cc20 msgr2=0x7f869012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868ffff700 1 --2- 172.21.15.19:0/2399285813 >> v2:172.21.15.19:3300/0 conn(0x7f869012cc20 0x7f869012f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868ffff700 1 -- 172.21.15.19:0/2399285813 >> v1:172.21.15.19:6789/0 conn(0x7f869012c2f0 legacy=0x7f869012fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868ffff700 1 -- 172.21.15.19:0/2399285813 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869009b540 con 0x7f869012cff0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868ffff700 1 --2- 172.21.15.19:0/2399285813 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690137cd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f868800be30 tx=0x7f8688009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3622d9d27b8a692d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868e7fc700 1 -- 172.21.15.19:0/2399285813 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868800c890 con 0x7f869012cff0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868e7fc700 1 -- 172.21.15.19:0/2399285813 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868800c9f0 con 0x7f869012cff0 2023-10-03T10:16:12.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.269+0000 7f868e7fc700 1 -- 172.21.15.19:0/2399285813 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868800cd60 con 0x7f869012cff0 2023-10-03T10:16:12.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 -- 172.21.15.19:0/2399285813 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 msgr2=0x7f8690137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 --2- 172.21.15.19:0/2399285813 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690137cd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f868800be30 tx=0x7f8688009290 comp rx=0 tx=0).stop 2023-10-03T10:16:12.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 -- 172.21.15.19:0/2399285813 shutdown_connections 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 --2- 172.21.15.19:0/2399285813 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690137cd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 --2- 172.21.15.19:0/2399285813 >> v2:172.21.15.19:3300/0 conn(0x7f869012cc20 0x7f869012f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 -- 172.21.15.19:0/2399285813 >> 172.21.15.19:0/2399285813 conn(0x7f869009f470 msgr2=0x7f86900a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 -- 172.21.15.19:0/2399285813 shutdown_connections 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.270+0000 7f8695b8a700 1 -- 172.21.15.19:0/2399285813 wait complete. 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.271+0000 7f8695b8a700 1 Processor -- start 2023-10-03T10:16:12.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 -- start start 2023-10-03T10:16:12.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 0x7f8690128090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 0x7f86901285d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690128b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869012b570 con 0x7f869012c2f0 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8690129f10 con 0x7f869012cff0 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f8695b8a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8690129bf0 con 0x7f869012cc20 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f868ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690128b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f868ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690128b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57830/0 (socket says 172.21.15.19:57830) 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f868ffff700 1 -- 172.21.15.19:0/935781909 learned_addr learned my addr 172.21.15.19:0/935781909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f868effd700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 0x7f86901285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.272+0000 7f868f7fe700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 0x7f8690128090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 -- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 msgr2=0x7f8690128b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690128b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 -- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 msgr2=0x7f8690128090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 0x7f8690128090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 -- 172.21.15.19:0/935781909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868800ba90 con 0x7f869012cc20 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868f7fe700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 0x7f8690128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f868effd700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 0x7f86901285d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f868400c460 tx=0x7f868400c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684005d70 con 0x7f869012cc20 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86840070d0 con 0x7f869012cc20 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684007440 con 0x7f869012cc20 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86900724a0 con 0x7f869012cc20 2023-10-03T10:16:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.273+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869006f8a0 con 0x7f869012cc20 2023-10-03T10:16:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.274+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86840075a0 con 0x7f869012cc20 2023-10-03T10:16:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.275+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f868403e6b0 con 0x7f869012cc20 2023-10-03T10:16:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.275+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86900747f0 con 0x7f869012cc20 2023-10-03T10:16:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.280+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8684017080 con 0x7f869012cc20 2023-10-03T10:16:12.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.321+0000 7f65bc12d700 1 Processor -- start 2023-10-03T10:16:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 -- start start 2023-10-03T10:16:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 0x7f65b413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b4134980 con 0x7f65b4134ec0 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b406c4b0 con 0x7f65b406c0e0 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65bc12d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40a09c0 con 0x7f65b41380f0 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65b9ec9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65b9ec9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44868/0 (socket says 172.21.15.19:44868) 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.322+0000 7f65b9ec9700 1 -- 172.21.15.19:0/309474313 learned_addr learned my addr 172.21.15.19:0/309474313 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 --2- 172.21.15.19:0/309474313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 0x7f65b413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 -- 172.21.15.19:0/309474313 >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 msgr2=0x7f65b409ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 --2- 172.21.15.19:0/309474313 >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 -- 172.21.15.19:0/309474313 >> v1:172.21.15.19:6789/0 conn(0x7f65b4134ec0 legacy=0x7f65b41379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65b8ec7700 1 -- 172.21.15.19:0/309474313 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815966979 0 0) 0x7f65b4134980 con 0x7f65b4134ec0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 -- 172.21.15.19:0/309474313 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b40a0600 con 0x7f65b41380f0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65b9ec9700 1 --2- 172.21.15.19:0/309474313 >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65ba6ca700 1 --2- 172.21.15.19:0/309474313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 0x7f65b413fd20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009d90 tx=0x7f65ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e696137cf35e57cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65b8ec7700 1 -- 172.21.15.19:0/309474313 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00e070 con 0x7f65b41380f0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.323+0000 7f65b8ec7700 1 -- 172.21.15.19:0/309474313 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00bb20 con 0x7f65b41380f0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65b8ec7700 1 -- 172.21.15.19:0/309474313 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac012430 con 0x7f65b41380f0 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 -- 172.21.15.19:0/309474313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 msgr2=0x7f65b413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 --2- 172.21.15.19:0/309474313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 0x7f65b413fd20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009d90 tx=0x7f65ac00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 -- 172.21.15.19:0/309474313 shutdown_connections 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 --2- 172.21.15.19:0/309474313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b41380f0 0x7f65b413fd20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 --2- 172.21.15.19:0/309474313 >> v2:172.21.15.19:3300/0 conn(0x7f65b406c0e0 0x7f65b409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.324+0000 7f65bc12d700 1 -- 172.21.15.19:0/309474313 >> 172.21.15.19:0/309474313 conn(0x7f65b40a4210 msgr2=0x7f65b40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.325+0000 7f65bc12d700 1 -- 172.21.15.19:0/309474313 shutdown_connections 2023-10-03T10:16:12.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.325+0000 7f65bc12d700 1 -- 172.21.15.19:0/309474313 wait complete. 2023-10-03T10:16:12.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.326+0000 7f65bc12d700 1 Processor -- start 2023-10-03T10:16:12.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.326+0000 7f65bc12d700 1 -- start start 2023-10-03T10:16:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 0x7f65b411abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41380f0 0x7f65b411b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b411dcc0 con 0x7f65b406c0e0 2023-10-03T10:16:12.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b411b9e0 con 0x7f65b4134ec0 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65bc12d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b40a3b10 con 0x7f65b41380f0 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65b9ec9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65b9ec9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44874/0 (socket says 172.21.15.19:44874) 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65b9ec9700 1 -- 172.21.15.19:0/970275271 learned_addr learned my addr 172.21.15.19:0/970275271 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65b96c8700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 0x7f65b411abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65ba6ca700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41380f0 0x7f65b411b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.327+0000 7f65b9ec9700 1 -- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41380f0 msgr2=0x7f65b411b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b9ec9700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41380f0 0x7f65b411b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b9ec9700 1 -- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 msgr2=0x7f65b411abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b9ec9700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 0x7f65b411abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b9ec9700 1 -- 172.21.15.19:0/970275271 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0009550 con 0x7f65b406c0e0 2023-10-03T10:16:12.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b96c8700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 0x7f65b411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65b9ec9700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f65b000e9b0 tx=0x7f65b000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000ee50 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b000c850 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000cbc0 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ac009a70 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.328+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b411d3b0 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.329+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65b000cd20 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.329+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b411c560 con 0x7f65b406c0e0 2023-10-03T10:16:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.329+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65b003f710 con 0x7f65b406c0e0 2023-10-03T10:16:12.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.339+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65b00232f0 con 0x7f65b406c0e0 2023-10-03T10:16:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.376+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd5b41260b0 con 0x7fd5b4131b40 2023-10-03T10:16:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.377+0000 7fd5aaffd700 1 -- 172.21.15.19:0/254373928 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5b41260b0 con 0x7fd5b4131b40 2023-10-03T10:16:12.377 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:12.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 msgr2=0x7fd5b41c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00c460 tx=0x7fd5ac00c770 comp rx=0 tx=0).stop 2023-10-03T10:16:12.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 shutdown_connections 2023-10-03T10:16:12.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b4131b40 0x7fd5b41c8980 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b406a770 0x7fd5b41c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 --2- 172.21.15.19:0/254373928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b406b080 0x7fd5b41c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 >> 172.21.15.19:0/254373928 conn(0x7fd5b4066f50 msgr2=0x7fd5b4070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 shutdown_connections 2023-10-03T10:16:12.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.379+0000 7fd5bc5af700 1 -- 172.21.15.19:0/254373928 wait complete. 2023-10-03T10:16:12.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.456+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcb411cce0 con 0x7fbcb4138f50 2023-10-03T10:16:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.456+0000 7fbca2ffd700 1 -- 172.21.15.19:0/3688502092 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcac007330 con 0x7fbcb4138f50 2023-10-03T10:16:12.456 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:12.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 msgr2=0x7fbcb41c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 0x7fbcb41c8140 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbcac00ef90 tx=0x7fbcac00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 shutdown_connections 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcb4138f50 0x7fbcb41c8140 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcb409d6d0 0x7fbcb411a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.458+0000 7fbcb88c4700 1 --2- 172.21.15.19:0/3688502092 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcb409e1b0 0x7fbcb411a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.459+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 >> 172.21.15.19:0/3688502092 conn(0x7fbcb4099c20 msgr2=0x7fbcb4133f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.459+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 shutdown_connections 2023-10-03T10:16:12.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.459+0000 7fbcb88c4700 1 -- 172.21.15.19:0/3688502092 wait complete. 2023-10-03T10:16:12.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:12.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.504+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f869006ead0 con 0x7f869012cc20 2023-10-03T10:16:12.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.505+0000 7f8677fff700 1 -- 172.21.15.19:0/935781909 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8684018af0 con 0x7f869012cc20 2023-10-03T10:16:12.505 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 msgr2=0x7f86901285d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 0x7f86901285d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f868400c460 tx=0x7f868400c770 comp rx=0 tx=0).stop 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 shutdown_connections 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f869012cff0 0x7f8690128b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f869012c2f0 0x7f8690128090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 --2- 172.21.15.19:0/935781909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f869012cc20 0x7f86901285d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 >> 172.21.15.19:0/935781909 conn(0x7f869009f470 msgr2=0x7f86900992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 shutdown_connections 2023-10-03T10:16:12.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.507+0000 7f8695b8a700 1 -- 172.21.15.19:0/935781909 wait complete. 2023-10-03T10:16:12.520 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:12.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.546+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65b4074ea0 con 0x7f65b406c0e0 2023-10-03T10:16:12.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.547+0000 7f65aa7fc700 1 -- 172.21.15.19:0/970275271 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65b0017030 con 0x7f65b406c0e0 2023-10-03T10:16:12.547 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:12.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 msgr2=0x7f65b411a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:12.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f65b000e9b0 tx=0x7f65b000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 shutdown_connections 2023-10-03T10:16:12.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b41380f0 0x7f65b411b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b406c0e0 0x7f65b411a680 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 --2- 172.21.15.19:0/970275271 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4134ec0 0x7f65b411abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:12.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 >> 172.21.15.19:0/970275271 conn(0x7f65b40a4210 msgr2=0x7f65b4137130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:12.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 shutdown_connections 2023-10-03T10:16:12.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:12.549+0000 7f65bc12d700 1 -- 172.21.15.19:0/970275271 wait complete. 2023-10-03T10:16:12.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:13.395 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:13.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:13.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.549+0000 7f4f4c149700 1 Processor -- start 2023-10-03T10:16:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.549+0000 7f4f4c149700 1 -- start start 2023-10-03T10:16:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f4c149700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4409d6f0 0x7f4f4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f4c149700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 0x7f4f44134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f4c149700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4409b120 con 0x7f4f4409e000 2023-10-03T10:16:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f4c149700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4406b460 con 0x7f4f4409d6f0 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f4c149700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4409a7e0 con 0x7f4f4409e440 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.550+0000 7f4f49ee5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4409d6f0 0x7f4f4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f496e4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f4409e000 0x7f4f441339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53080/0 (socket says 172.21.15.19:53080) 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4f4409d6f0 0x7f4f4409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44882/0 (socket says 172.21.15.19:44882) 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f4a6e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 0x7f4f44134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f496e4700 1 -- 172.21.15.19:0/602901378 learned_addr learned my addr 172.21.15.19:0/602901378 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f48ee3700 1 -- 172.21.15.19:0/602901378 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425463572 0 0) 0x7f4f4409b120 con 0x7f4f4409e000 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 -- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 msgr2=0x7f4f44134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 0x7f4f44134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 -- 172.21.15.19:0/602901378 >> v1:172.21.15.19:6789/0 conn(0x7f4f4409e000 legacy=0x7f4f441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 -- 172.21.15.19:0/602901378 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4409a500 con 0x7f4f4409d6f0 2023-10-03T10:16:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f4a6e6700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 0x7f4f44134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f49ee5700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409d6f0 0x7f4f4409dac0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8b712dcf3afaef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f48ee3700 1 -- 172.21.15.19:0/602901378 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40011830 con 0x7f4f4409d6f0 2023-10-03T10:16:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f48ee3700 1 -- 172.21.15.19:0/602901378 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f40011990 con 0x7f4f4409d6f0 2023-10-03T10:16:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.551+0000 7f4f48ee3700 1 -- 172.21.15.19:0/602901378 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40011d20 con 0x7f4f4409d6f0 2023-10-03T10:16:13.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 -- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409d6f0 msgr2=0x7f4f4409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409d6f0 0x7f4f4409dac0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009870 tx=0x7f4f40009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 -- 172.21.15.19:0/602901378 shutdown_connections 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e440 0x7f4f44134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 --2- 172.21.15.19:0/602901378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409d6f0 0x7f4f4409dac0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 -- 172.21.15.19:0/602901378 >> 172.21.15.19:0/602901378 conn(0x7f4f44066f50 msgr2=0x7f4f4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 -- 172.21.15.19:0/602901378 shutdown_connections 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.552+0000 7f4f4c149700 1 -- 172.21.15.19:0/602901378 wait complete. 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 Processor -- start 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 -- start start 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 0x7f4f441a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 0x7f4f441a58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409e440 0x7f4f441c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f441a8110 con 0x7f4f4409e440 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f441b9180 con 0x7f4f4409e000 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4c149700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f441a8310 con 0x7f4f4409d6f0 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f496e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 0x7f4f441a58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f49ee5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 0x7f4f441a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f496e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 0x7f4f441a58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57856/0 (socket says 172.21.15.19:57856) 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f496e4700 1 -- 172.21.15.19:0/997095715 learned_addr learned my addr 172.21.15.19:0/997095715 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.554+0000 7f4f4a6e6700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409e440 0x7f4f441c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 -- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 msgr2=0x7f4f441a58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 0x7f4f441a58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 -- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409e440 msgr2=0x7f4f441c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409e440 0x7f4f441c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 -- 172.21.15.19:0/997095715 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009a70 con 0x7f4f4409d6f0 2023-10-03T10:16:13.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f49ee5700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 0x7f4f441a5380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f40016000 tx=0x7f4f40004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f400036a0 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4001f070 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f40003a00 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f4c149700 1 -- 172.21.15.19:0/997095715 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f400094a0 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.555+0000 7f4f4c149700 1 -- 172.21.15.19:0/997095715 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f441a6400 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.556+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f40003b60 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.556+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f40021070 con 0x7f4f4409d6f0 2023-10-03T10:16:13.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.557+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f200052e0 con 0x7f4f4409d6f0 2023-10-03T10:16:13.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.562+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f40015020 con 0x7f4f4409d6f0 2023-10-03T10:16:13.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.645+0000 7f73f610f700 1 Processor -- start 2023-10-03T10:16:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 -- start start 2023-10-03T10:16:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 0x7f73f0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 0x7f73f0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f009f520 con 0x7f73f009e000 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f009f130 con 0x7f73f009d6f0 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73f610f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f009e930 con 0x7f73f009e410 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73ef7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57866/0 (socket says 172.21.15.19:57866) 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73eeffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 0x7f73f0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.646+0000 7f73ef7fe700 1 -- 172.21.15.19:0/611333068 learned_addr learned my addr 172.21.15.19:0/611333068 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73effff700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 0x7f73f0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 -- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 msgr2=0x7f73f0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 0x7f73f0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 -- 172.21.15.19:0/611333068 >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 msgr2=0x7f73f0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 --2- 172.21.15.19:0/611333068 >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 0x7f73f0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 -- 172.21.15.19:0/611333068 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f009b2d0 con 0x7f73f009d6f0 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73eeffd700 1 --2- 172.21.15.19:0/611333068 >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 0x7f73f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73effff700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 0x7f73f0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ef7fe700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ced02d204f4959d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ee7fc700 1 -- 172.21.15.19:0/611333068 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0011830 con 0x7f73f009d6f0 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ee7fc700 1 -- 172.21.15.19:0/611333068 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e0011990 con 0x7f73f009d6f0 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.647+0000 7f73ee7fc700 1 -- 172.21.15.19:0/611333068 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0011d20 con 0x7f73f009d6f0 2023-10-03T10:16:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 -- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 msgr2=0x7f73f009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 -- 172.21.15.19:0/611333068 shutdown_connections 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f009dac0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 --2- 172.21.15.19:0/611333068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e410 0x7f73f0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 --2- 172.21.15.19:0/611333068 >> v2:172.21.15.19:3300/0 conn(0x7f73f009e000 0x7f73f0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 -- 172.21.15.19:0/611333068 >> 172.21.15.19:0/611333068 conn(0x7f73f0066f50 msgr2=0x7f73f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 -- 172.21.15.19:0/611333068 shutdown_connections 2023-10-03T10:16:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.648+0000 7f73f610f700 1 -- 172.21.15.19:0/611333068 wait complete. 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.649+0000 7f73f610f700 1 Processor -- start 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 -- start start 2023-10-03T10:16:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f0122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 0x7f73f0122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0130450 con 0x7f73f009e410 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0124250 con 0x7f73f009d6f0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73f610f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0125ab0 con 0x7f73f009e000 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73eeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73eeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50776/0 (socket says 172.21.15.19:50776) 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.650+0000 7f73eeffd700 1 -- 172.21.15.19:0/555263975 learned_addr learned my addr 172.21.15.19:0/555263975 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73effff700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 0x7f73f0122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 -- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 msgr2=0x7f73f0122530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f0122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 -- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 msgr2=0x7f73f0122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 0x7f73f0122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 -- 172.21.15.19:0/555263975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40094a0 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73effff700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 0x7f73f0122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73eeffd700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ebb0 tx=0x7f73e400ef70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400c850 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400c9b0 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e0009550 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.651+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400cd40 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.652+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0124930 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.652+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73e4013470 con 0x7f73f009e000 2023-10-03T10:16:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.652+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73e403f930 con 0x7f73f009e000 2023-10-03T10:16:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.653+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f01246f0 con 0x7f73f009e000 2023-10-03T10:16:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.658+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73e40232f0 con 0x7f73f009e000 2023-10-03T10:16:13.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.681+0000 7f61d0103700 1 Processor -- start 2023-10-03T10:16:13.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.681+0000 7f61d0103700 1 -- start start 2023-10-03T10:16:13.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61d0103700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61d0103700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 0x7f61c8130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61d0103700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61c806bc00 con 0x7f61c8130870 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61d0103700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c806c570 con 0x7f61c812ff20 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61d0103700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c80a0040 con 0x7f61c8133a80 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cde9f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cde9f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50780/0 (socket says 172.21.15.19:50780) 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cde9f700 1 -- 172.21.15.19:0/610896263 learned_addr learned my addr 172.21.15.19:0/610896263 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cd69e700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 0x7f61c8130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cd69e700 1 -- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 msgr2=0x7f61c8133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cd69e700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cd69e700 1 -- 172.21.15.19:0/610896263 >> v1:172.21.15.19:6789/0 conn(0x7f61c8130870 legacy=0x7f61c813a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.682+0000 7f61cd69e700 1 -- 172.21.15.19:0/610896263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8133860 con 0x7f61c812ff20 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.683+0000 7f61cde9f700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.683+0000 7f61cd69e700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 0x7f61c8130330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009870 tx=0x7f61b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=563a2815af543768 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.683+0000 7f61cce9d700 1 -- 172.21.15.19:0/610896263 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011830 con 0x7f61c812ff20 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.683+0000 7f61cce9d700 1 -- 172.21.15.19:0/610896263 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8011990 con 0x7f61c812ff20 2023-10-03T10:16:13.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.683+0000 7f61cce9d700 1 -- 172.21.15.19:0/610896263 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8011d20 con 0x7f61c812ff20 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 -- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 msgr2=0x7f61c8130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 0x7f61c8130330 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009870 tx=0x7f61b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 -- 172.21.15.19:0/610896263 shutdown_connections 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8133a80 0x7f61c8133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 --2- 172.21.15.19:0/610896263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c812ff20 0x7f61c8130330 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 -- 172.21.15.19:0/610896263 >> 172.21.15.19:0/610896263 conn(0x7f61c80a4210 msgr2=0x7f61c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 -- 172.21.15.19:0/610896263 shutdown_connections 2023-10-03T10:16:13.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.684+0000 7f61d0103700 1 -- 172.21.15.19:0/610896263 wait complete. 2023-10-03T10:16:13.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.686+0000 7f61d0103700 1 Processor -- start 2023-10-03T10:16:13.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.686+0000 7f61d0103700 1 -- start start 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.686+0000 7f61d0103700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61d0103700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 0x7f61c809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61d0103700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c8133a80 0x7f61c809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61d0103700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c809e260 con 0x7f61c812ff20 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61d0103700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c812db80 con 0x7f61c8133a80 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61d0103700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c812d750 con 0x7f61c8130870 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cde9f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 0x7f61c809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cde9f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44916/0 (socket says 172.21.15.19:44916) 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cde9f700 1 -- 172.21.15.19:0/3884771234 learned_addr learned my addr 172.21.15.19:0/3884771234 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61ce6a0700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c8133a80 0x7f61c809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 -- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c8133a80 msgr2=0x7f61c809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c8133a80 0x7f61c809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 -- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 msgr2=0x7f61c809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 -- 172.21.15.19:0/3884771234 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c4009550 con 0x7f61c8130870 2023-10-03T10:16:13.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cde9f700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.687+0000 7f61cd69e700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 0x7f61c809c9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61c809fd90 tx=0x7f61b8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.688+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8004450 con 0x7f61c8130870 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.688+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b801f070 con 0x7f61c8130870 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.688+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b80038e0 con 0x7f61c8130870 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.688+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b80094a0 con 0x7f61c8130870 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.688+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c8120a40 con 0x7f61c8130870 2023-10-03T10:16:13.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.689+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c8074ea0 con 0x7f61c8130870 2023-10-03T10:16:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.689+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61b8003a40 con 0x7f61c8130870 2023-10-03T10:16:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.690+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61b8021070 con 0x7f61c8130870 2023-10-03T10:16:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.701+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61b802f3a0 con 0x7f61c8130870 2023-10-03T10:16:13.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.711+0000 7f7d82044700 1 Processor -- start 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.711+0000 7f7d82044700 1 -- start start 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d82044700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 0x7f7d7c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d82044700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 0x7f7d7c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d82044700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c0a2a70 con 0x7f7d7c133930 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d82044700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c0a01d0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d82044700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c09e2b0 con 0x7f7d7c09d630 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d7b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 0x7f7d7c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d7b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 0x7f7d7c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44924/0 (socket says 172.21.15.19:44924) 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d7b7fe700 1 -- 172.21.15.19:0/1173766707 learned_addr learned my addr 172.21.15.19:0/1173766707 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.712+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1173766707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 0x7f7d7c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7a7fc700 1 -- 172.21.15.19:0/1173766707 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873799651 0 0) 0x7f7d7c0a2a70 con 0x7f7d7c133930 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7a7fc700 1 -- 172.21.15.19:0/1173766707 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d640035b0 con 0x7f7d7c133930 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7affd700 1 -- 172.21.15.19:0/1173766707 >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 msgr2=0x7f7d7c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1173766707 >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 0x7f7d7c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7affd700 1 -- 172.21.15.19:0/1173766707 >> v1:172.21.15.19:6789/0 conn(0x7f7d7c133930 legacy=0x7f7d7c133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7affd700 1 -- 172.21.15.19:0/1173766707 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c09dc50 con 0x7f7d7c09d630 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1173766707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 0x7f7d7c0a1340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009840 tx=0x7f7d70009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db09e72f6230659 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7a7fc700 1 -- 172.21.15.19:0/1173766707 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011830 con 0x7f7d7c09d630 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7a7fc700 1 -- 172.21.15.19:0/1173766707 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d70011990 con 0x7f7d7c09d630 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.713+0000 7f7d7a7fc700 1 -- 172.21.15.19:0/1173766707 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70011d20 con 0x7f7d7c09d630 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 -- 172.21.15.19:0/1173766707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 msgr2=0x7f7d7c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 --2- 172.21.15.19:0/1173766707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 0x7f7d7c0a1340 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7d70009840 tx=0x7f7d70009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 -- 172.21.15.19:0/1173766707 shutdown_connections 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 --2- 172.21.15.19:0/1173766707 >> v2:172.21.15.19:3300/0 conn(0x7f7d7c0a0a30 0x7f7d7c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 --2- 172.21.15.19:0/1173766707 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c09d630 0x7f7d7c0a1340 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.714+0000 7f7d82044700 1 -- 172.21.15.19:0/1173766707 >> 172.21.15.19:0/1173766707 conn(0x7f7d7c0a3050 msgr2=0x7f7d7c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.715+0000 7f7d82044700 1 -- 172.21.15.19:0/1173766707 shutdown_connections 2023-10-03T10:16:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.715+0000 7f7d82044700 1 -- 172.21.15.19:0/1173766707 wait complete. 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.716+0000 7f7d82044700 1 Processor -- start 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.716+0000 7f7d82044700 1 -- start start 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d7c09d630 0x7f7d7c11f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d7c133930 0x7f7d7c1c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c121ea0 con 0x7f7d7c09d630 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c122440 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d82044700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c11fd10 con 0x7f7d7c133930 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57898/0 (socket says 172.21.15.19:57898) 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d7affd700 1 -- 172.21.15.19:0/1197699302 learned_addr learned my addr 172.21.15.19:0/1197699302 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.717+0000 7f7d7bfff700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d7c133930 0x7f7d7c1c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 -- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d7c133930 msgr2=0x7f7d7c1c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d7c133930 0x7f7d7c1c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 -- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d7c09d630 msgr2=0x7f7d7c11f290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d7c09d630 0x7f7d7c11f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 -- 172.21.15.19:0/1197699302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700094a0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d7affd700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7d700090b0 tx=0x7f7d70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700036a0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7001f070 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c122160 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d70003a20 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.718+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c122bd0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.720+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c1334d0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.720+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d70003b80 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.720+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d70021070 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.730+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d70003e30 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.829+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4f20005590 con 0x7f4f4409d6f0 2023-10-03T10:16:13.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.829+0000 7f4f3a7fc700 1 -- 172.21.15.19:0/997095715 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f4001a430 con 0x7f4f4409d6f0 2023-10-03T10:16:13.829 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:13.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 msgr2=0x7f4f441a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 0x7f4f441a5380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4f40016000 tx=0x7f4f40004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 shutdown_connections 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f4409e440 0x7f4f441c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f4409d6f0 0x7f4f441a5380 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 --2- 172.21.15.19:0/997095715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f4409e000 0x7f4f441a58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.832+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 >> 172.21.15.19:0/997095715 conn(0x7f4f44066f50 msgr2=0x7f4f441bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.833+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 shutdown_connections 2023-10-03T10:16:13.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.833+0000 7f4f27fff700 1 -- 172.21.15.19:0/997095715 wait complete. 2023-10-03T10:16:13.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:13.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.872+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f73f0074ea0 con 0x7f73f009e000 2023-10-03T10:16:13.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.872+0000 7f73d7fff700 1 -- 172.21.15.19:0/555263975 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73e4021020 con 0x7f73f009e000 2023-10-03T10:16:13.872 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.874+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 msgr2=0x7f73f0122a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.874+0000 7f73f610f700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ebb0 tx=0x7f73e400ef70 comp rx=0 tx=0).stop 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 shutdown_connections 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73f009e410 0x7f73f0122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73f009d6f0 0x7f73f0122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 --2- 172.21.15.19:0/555263975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73f009e000 0x7f73f0122a70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 >> 172.21.15.19:0/555263975 conn(0x7f73f0066f50 msgr2=0x7f73f0130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 shutdown_connections 2023-10-03T10:16:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.875+0000 7f73f610f700 1 -- 172.21.15.19:0/555263975 wait complete. 2023-10-03T10:16:13.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.916+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61c8134360 con 0x7f61c8130870 2023-10-03T10:16:13.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.917+0000 7f61be7fc700 1 -- 172.21.15.19:0/3884771234 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61b802b070 con 0x7f61c8130870 2023-10-03T10:16:13.917 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 msgr2=0x7f61c809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 0x7f61c809c9c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f61c809fd90 tx=0x7f61b8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 shutdown_connections 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c8133a80 0x7f61c809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c812ff20 0x7f61c809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 --2- 172.21.15.19:0/3884771234 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c8130870 0x7f61c809c9c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 >> 172.21.15.19:0/3884771234 conn(0x7f61c80a4210 msgr2=0x7f61c80a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 shutdown_connections 2023-10-03T10:16:13.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.919+0000 7f61d0103700 1 -- 172.21.15.19:0/3884771234 wait complete. 2023-10-03T10:16:13.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.938+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d7c0747f0 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.939+0000 7f7d63fff700 1 -- 172.21.15.19:0/1197699302 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d7002b020 con 0x7f7d7c0a0a30 2023-10-03T10:16:13.938 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 msgr2=0x7f7d7c11f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7d700090b0 tx=0x7f7d70004750 comp rx=0 tx=0).stop 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 shutdown_connections 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d7c133930 0x7f7d7c1c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d7c09d630 0x7f7d7c11f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 --2- 172.21.15.19:0/1197699302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d7c0a0a30 0x7f7d7c11f7d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 >> 172.21.15.19:0/1197699302 conn(0x7f7d7c0a3050 msgr2=0x7f7d7c1bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:13.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 shutdown_connections 2023-10-03T10:16:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:13.941+0000 7f7d82044700 1 -- 172.21.15.19:0/1197699302 wait complete. 2023-10-03T10:16:13.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:14.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:14.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:14.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:14.955 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:15.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.009+0000 7fbb4538d700 1 Processor -- start 2023-10-03T10:16:15.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.009+0000 7fbb4538d700 1 -- start start 2023-10-03T10:16:15.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbb4006fb20 0x7fbb4006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb4009a390 con 0x7fbb4006fb20 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400716a0 con 0x7fbb40130540 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.010+0000 7fbb4538d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40071290 con 0x7fbb40130e50 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50798/0 (socket says 172.21.15.19:50798) 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2909736901 learned_addr learned my addr 172.21.15.19:0/2909736901 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3effd700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3f7fe700 1 --2- 172.21.15.19:0/2909736901 >> v2:172.21.15.19:3300/0 conn(0x7fbb4006fb20 0x7fbb4006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 msgr2=0x7fbb40130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2909736901 >> v2:172.21.15.19:3300/0 conn(0x7fbb4006fb20 msgr2=0x7fbb4006ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2909736901 >> v2:172.21.15.19:3300/0 conn(0x7fbb4006fb20 0x7fbb4006ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2909736901 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40130340 con 0x7fbb40130e50 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009920 tx=0x7fbb34009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adfa5428e3700e80 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.011+0000 7fbb3dffb700 1 -- 172.21.15.19:0/2909736901 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011830 con 0x7fbb40130e50 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb3dffb700 1 -- 172.21.15.19:0/2909736901 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34011990 con 0x7fbb40130e50 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb3dffb700 1 -- 172.21.15.19:0/2909736901 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34011d20 con 0x7fbb40130e50 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 -- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 msgr2=0x7fbb4006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbb34009920 tx=0x7fbb34009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 -- 172.21.15.19:0/2909736901 shutdown_connections 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2909736901 >> v2:172.21.15.19:3300/0 conn(0x7fbb4006fb20 0x7fbb4006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2909736901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4006f5e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.012+0000 7fbb4538d700 1 -- 172.21.15.19:0/2909736901 >> 172.21.15.19:0/2909736901 conn(0x7fbb400a2aa0 msgr2=0x7fbb400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.013+0000 7fbb4538d700 1 -- 172.21.15.19:0/2909736901 shutdown_connections 2023-10-03T10:16:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.013+0000 7fbb4538d700 1 -- 172.21.15.19:0/2909736901 wait complete. 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.014+0000 7fbb4538d700 1 Processor -- start 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.014+0000 7fbb4538d700 1 -- start start 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 0x7fbb40129840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40129d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4012a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4012c290 con 0x7fbb4006fb20 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400718e0 con 0x7fbb40130540 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb4538d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4012dc50 con 0x7fbb40130e50 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb3effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 0x7fbb40129840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb3effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 0x7fbb40129840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44938/0 (socket says 172.21.15.19:44938) 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4012a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb3effd700 1 -- 172.21.15.19:0/2459755922 learned_addr learned my addr 172.21.15.19:0/2459755922 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.015+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40129d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 msgr2=0x7fbb4012a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4012a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 msgr2=0x7fbb40129840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 0x7fbb40129840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 -- 172.21.15.19:0/2459755922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb34009550 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3f7fe700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4012a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb3e7fc700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40129d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbb34016000 tx=0x7fbb34004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004450 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb340045d0 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb340038e0 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.016+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4012cfb0 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.017+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4012d290 con 0x7fbb40130540 2023-10-03T10:16:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.017+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb34003a40 con 0x7fbb40130540 2023-10-03T10:16:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.018+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb34040500 con 0x7fbb40130540 2023-10-03T10:16:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.018+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4009dd40 con 0x7fbb40130540 2023-10-03T10:16:15.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.027+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb3401a420 con 0x7fbb40130540 2023-10-03T10:16:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.055+0000 7fa6db2cd700 1 Processor -- start 2023-10-03T10:16:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.055+0000 7fa6db2cd700 1 -- start start 2023-10-03T10:16:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6db2cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 0x7fa6d406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6db2cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d4134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6db2cd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6d4070ee0 con 0x7fa6d409eca0 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6db2cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4071480 con 0x7fa6d406ee80 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6db2cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4071b90 con 0x7fa6d406e570 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6d8868700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa6d409eca0 0x7fa6d4134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:53092/0 (socket says 172.21.15.19:53092) 2023-10-03T10:16:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6d8868700 1 -- 172.21.15.19:0/1560329211 learned_addr learned my addr 172.21.15.19:0/1560329211 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6d986a700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d4134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.056+0000 7fa6d9069700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 0x7fa6d406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6cbfff700 1 -- 172.21.15.19:0/1560329211 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580797293 0 0) 0x7fa6d4070ee0 con 0x7fa6d409eca0 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6cbfff700 1 -- 172.21.15.19:0/1560329211 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6c00035b0 con 0x7fa6d409eca0 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d9069700 1 -- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 msgr2=0x7fa6d4134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d9069700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d4134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d9069700 1 -- 172.21.15.19:0/1560329211 >> v1:172.21.15.19:6789/0 conn(0x7fa6d409eca0 legacy=0x7fa6d4134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d9069700 1 -- 172.21.15.19:0/1560329211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40711a0 con 0x7fa6d406e570 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d986a700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d4134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6d9069700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 0x7fa6d406e940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0fb10f262426473 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6cbfff700 1 -- 172.21.15.19:0/1560329211 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0011830 con 0x7fa6d406e570 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6cbfff700 1 -- 172.21.15.19:0/1560329211 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0011990 con 0x7fa6d406e570 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.057+0000 7fa6cbfff700 1 -- 172.21.15.19:0/1560329211 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0011d20 con 0x7fa6d406e570 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 -- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 msgr2=0x7fa6d406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 0x7fa6d406e940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009870 tx=0x7fa6d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 -- 172.21.15.19:0/1560329211 shutdown_connections 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d4134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/1560329211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d406e570 0x7fa6d406e940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 -- 172.21.15.19:0/1560329211 >> 172.21.15.19:0/1560329211 conn(0x7fa6d40a2aa0 msgr2=0x7fa6d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 -- 172.21.15.19:0/1560329211 shutdown_connections 2023-10-03T10:16:15.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.058+0000 7fa6db2cd700 1 -- 172.21.15.19:0/1560329211 wait complete. 2023-10-03T10:16:15.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 Processor -- start 2023-10-03T10:16:15.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 -- start start 2023-10-03T10:16:15.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 0x7fa6d4123370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d41238b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d4123df0 0x7fa6d41cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4133e90 con 0x7fa6d406e570 2023-10-03T10:16:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4126490 con 0x7fa6d406ee80 2023-10-03T10:16:15.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.060+0000 7fa6db2cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4124ea0 con 0x7fa6d4123df0 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d8868700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d41238b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 0x7fa6d4123370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d8868700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d41238b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57938/0 (socket says 172.21.15.19:57938) 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d8868700 1 -- 172.21.15.19:0/3595628621 learned_addr learned my addr 172.21.15.19:0/3595628621 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d986a700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d4123df0 0x7fa6d41cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 -- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d4123df0 msgr2=0x7fa6d41cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d4123df0 0x7fa6d41cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 -- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 msgr2=0x7fa6d41238b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d41238b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 -- 172.21.15.19:0/3595628621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009a70 con 0x7fa6d406e570 2023-10-03T10:16:15.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.061+0000 7fa6d9069700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 0x7fa6d4123370 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa6d406b610 tx=0x7fa6d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.062+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0004450 con 0x7fa6d406e570 2023-10-03T10:16:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.062+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d0030070 con 0x7fa6d406e570 2023-10-03T10:16:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.062+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d00094a0 con 0x7fa6d406e570 2023-10-03T10:16:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.062+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d00038e0 con 0x7fa6d406e570 2023-10-03T10:16:15.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.062+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d41358e0 con 0x7fa6d406e570 2023-10-03T10:16:15.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.063+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6d0003a40 con 0x7fa6d406e570 2023-10-03T10:16:15.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.063+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d4074ea0 con 0x7fa6d406e570 2023-10-03T10:16:15.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.063+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa6d0032070 con 0x7fa6d406e570 2023-10-03T10:16:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.072+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa6d00403a0 con 0x7fa6d406e570 2023-10-03T10:16:15.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.091+0000 7fe66b93a700 1 Processor -- start 2023-10-03T10:16:15.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 -- start start 2023-10-03T10:16:15.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe66412cf60 0x7fe66406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe664130260 0x7fe664136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66412d330 con 0x7fe66412cf60 2023-10-03T10:16:15.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66412cd90 con 0x7fe664130260 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe66b93a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6641306d0 con 0x7fe66412f8b0 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe668ed5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe668ed5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50832/0 (socket says 172.21.15.19:50832) 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe668ed5700 1 -- 172.21.15.19:0/2497094592 learned_addr learned my addr 172.21.15.19:0/2497094592 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.092+0000 7fe669ed7700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe664130260 0x7fe664136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe6696d6700 1 --2- 172.21.15.19:0/2497094592 >> v2:172.21.15.19:3300/0 conn(0x7fe66412cf60 0x7fe66406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 -- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe664130260 msgr2=0x7fe664136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe664130260 0x7fe664136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 -- 172.21.15.19:0/2497094592 >> v2:172.21.15.19:3300/0 conn(0x7fe66412cf60 msgr2=0x7fe66406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2497094592 >> v2:172.21.15.19:3300/0 conn(0x7fe66412cf60 0x7fe66406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 -- 172.21.15.19:0/2497094592 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe664071780 con 0x7fe66412f8b0 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe65400bbc0 tx=0x7fe65400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf3dfec4017dfe9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe65bfff700 1 -- 172.21.15.19:0/2497094592 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400dbe0 con 0x7fe66412f8b0 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe65bfff700 1 -- 172.21.15.19:0/2497094592 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400dd40 con 0x7fe66412f8b0 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.093+0000 7fe65bfff700 1 -- 172.21.15.19:0/2497094592 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654017630 con 0x7fe66412f8b0 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.094+0000 7fe66b93a700 1 -- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 msgr2=0x7fe66412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.094+0000 7fe66b93a700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe65400bbc0 tx=0x7fe65400bed0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 -- 172.21.15.19:0/2497094592 shutdown_connections 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe664130260 0x7fe664136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 --2- 172.21.15.19:0/2497094592 >> v2:172.21.15.19:3300/0 conn(0x7fe66412cf60 0x7fe66406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 --2- 172.21.15.19:0/2497094592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe66412f8b0 0x7fe66412fd20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 -- 172.21.15.19:0/2497094592 >> 172.21.15.19:0/2497094592 conn(0x7fe6640a2aa0 msgr2=0x7fe6640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 -- 172.21.15.19:0/2497094592 shutdown_connections 2023-10-03T10:16:15.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.095+0000 7fe66b93a700 1 -- 172.21.15.19:0/2497094592 wait complete. 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 Processor -- start 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 -- start start 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 0x7fe6641c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 0x7fe6641c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 0x7fe6641c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409ce90 con 0x7fe66412cf60 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409cc60 con 0x7fe66412f8b0 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.096+0000 7fe66b93a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe66409e5d0 con 0x7fe664130260 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe6696d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 0x7fe6641c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 0x7fe6641c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe6696d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 0x7fe6641c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44966/0 (socket says 172.21.15.19:44966) 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe6696d6700 1 -- 172.21.15.19:0/2541722603 learned_addr learned my addr 172.21.15.19:0/2541722603 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe669ed7700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 0x7fe6641c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 -- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 msgr2=0x7fe6641c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 0x7fe6641c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 -- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 msgr2=0x7fe6641c3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 0x7fe6641c3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 -- 172.21.15.19:0/2541722603 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65400b7f0 con 0x7fe66412f8b0 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe669ed7700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 0x7fe6641c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe668ed5700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 0x7fe6641c44f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe654018000 tx=0x7fe654004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654003ab0 con 0x7fe66412f8b0 2023-10-03T10:16:15.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654003c10 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.097+0000 7fe66b93a700 1 -- 172.21.15.19:0/2541722603 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66412da40 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.098+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe654017410 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.098+0000 7fe66b93a700 1 -- 172.21.15.19:0/2541722603 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6641190f0 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.099+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c0052e0 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.100+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe654015070 con 0x7fe66412f8b0 2023-10-03T10:16:15.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.100+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe654041850 con 0x7fe66412f8b0 2023-10-03T10:16:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.109+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe654028780 con 0x7fe66412f8b0 2023-10-03T10:16:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.135+0000 7fe820145700 1 Processor -- start 2023-10-03T10:16:15.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.136+0000 7fe820145700 1 -- start start 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 0x7fe818130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe81809e410 0x7fe818130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81809f520 con 0x7fe81809e410 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81809f130 con 0x7fe81809e000 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe820145700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe81809e930 con 0x7fe81809d6f0 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81d6e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 0x7fe818130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50846/0 (socket says 172.21.15.19:50846) 2023-10-03T10:16:15.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 -- 172.21.15.19:0/3209676567 learned_addr learned my addr 172.21.15.19:0/3209676567 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81e6e2700 1 --2- 172.21.15.19:0/3209676567 >> v2:172.21.15.19:3300/0 conn(0x7fe81809e410 0x7fe818130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 -- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 msgr2=0x7fe818130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 0x7fe818130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 -- 172.21.15.19:0/3209676567 >> v2:172.21.15.19:3300/0 conn(0x7fe81809e410 msgr2=0x7fe818130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 --2- 172.21.15.19:0/3209676567 >> v2:172.21.15.19:3300/0 conn(0x7fe81809e410 0x7fe818130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81dee1700 1 -- 172.21.15.19:0/3209676567 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81809b2d0 con 0x7fe81809d6f0 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.137+0000 7fe81d6e0700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 0x7fe818130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe81dee1700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe814009920 tx=0x7fe814009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0515c9419e740d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe81cedf700 1 -- 172.21.15.19:0/3209676567 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400f8a0 con 0x7fe81809d6f0 2023-10-03T10:16:15.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe81cedf700 1 -- 172.21.15.19:0/3209676567 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400fa00 con 0x7fe81809d6f0 2023-10-03T10:16:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe81cedf700 1 -- 172.21.15.19:0/3209676567 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81400fd90 con 0x7fe81809d6f0 2023-10-03T10:16:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe820145700 1 -- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 msgr2=0x7fe81809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.138+0000 7fe820145700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe814009920 tx=0x7fe814009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 -- 172.21.15.19:0/3209676567 shutdown_connections 2023-10-03T10:16:15.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 --2- 172.21.15.19:0/3209676567 >> v2:172.21.15.19:3300/0 conn(0x7fe81809e410 0x7fe818130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809d6f0 0x7fe81809dac0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 --2- 172.21.15.19:0/3209676567 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e000 0x7fe818130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 -- 172.21.15.19:0/3209676567 >> 172.21.15.19:0/3209676567 conn(0x7fe818066f50 msgr2=0x7fe81809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 -- 172.21.15.19:0/3209676567 shutdown_connections 2023-10-03T10:16:15.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.139+0000 7fe820145700 1 -- 172.21.15.19:0/3209676567 wait complete. 2023-10-03T10:16:15.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.140+0000 7fe820145700 1 Processor -- start 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.140+0000 7fe820145700 1 -- start start 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809e000 0x7fe818122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e410 0x7fe8181230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe818126da0 con 0x7fe81809d6f0 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8180a1ad0 con 0x7fe81809e410 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe820145700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe81809c700 con 0x7fe81809e000 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe81dee1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe81dee1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44984/0 (socket says 172.21.15.19:44984) 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe81dee1700 1 -- 172.21.15.19:0/2659067103 learned_addr learned my addr 172.21.15.19:0/2659067103 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:15.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe81e6e2700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e410 0x7fe8181230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.141+0000 7fe81d6e0700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809e000 0x7fe818122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 -- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809e000 msgr2=0x7fe818122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809e000 0x7fe818122b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 -- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e410 msgr2=0x7fe8181230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e410 0x7fe8181230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 -- 172.21.15.19:0/2659067103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080094a0 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe81dee1700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe814000c00 tx=0x7fe814004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140038a0 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe814009550 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814003a00 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814003d90 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.142+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe818124a50 con 0x7fe81809d6f0 2023-10-03T10:16:15.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.144+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe818074ea0 con 0x7fe81809d6f0 2023-10-03T10:16:15.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.144+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe81402a430 con 0x7fe81809d6f0 2023-10-03T10:16:15.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.144+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8140403b0 con 0x7fe81809d6f0 2023-10-03T10:16:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.153+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8140093b0 con 0x7fe81809d6f0 2023-10-03T10:16:15.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.281+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb400a0aa0 con 0x7fbb40130540 2023-10-03T10:16:15.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.281+0000 7fbb277fe700 1 -- 172.21.15.19:0/2459755922 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb34028030 con 0x7fbb40130540 2023-10-03T10:16:15.281 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:15.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 msgr2=0x7fbb40129d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40129d80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbb34016000 tx=0x7fbb34004750 comp rx=0 tx=0).stop 2023-10-03T10:16:15.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 shutdown_connections 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb40130e50 0x7fbb4012a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb4006fb20 0x7fbb40129840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 --2- 172.21.15.19:0/2459755922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb40130540 0x7fbb40129d80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 >> 172.21.15.19:0/2459755922 conn(0x7fbb400a2aa0 msgr2=0x7fbb4012f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.283+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 shutdown_connections 2023-10-03T10:16:15.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.284+0000 7fbb4538d700 1 -- 172.21.15.19:0/2459755922 wait complete. 2023-10-03T10:16:15.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.286+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa6d406f520 con 0x7fa6d406e570 2023-10-03T10:16:15.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.287+0000 7fa6c9ffb700 1 -- 172.21.15.19:0/3595628621 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa6d0015030 con 0x7fa6d406e570 2023-10-03T10:16:15.287 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:15.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 msgr2=0x7fa6d4123370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 0x7fa6d4123370 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa6d406b610 tx=0x7fa6d0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:15.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 shutdown_connections 2023-10-03T10:16:15.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa6d4123df0 0x7fa6d41cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6d406e570 0x7fa6d4123370 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 --2- 172.21.15.19:0/3595628621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa6d406ee80 0x7fa6d41238b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 >> 172.21.15.19:0/3595628621 conn(0x7fa6d40a2aa0 msgr2=0x7fa6d40a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 shutdown_connections 2023-10-03T10:16:15.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.289+0000 7fa6db2cd700 1 -- 172.21.15.19:0/3595628621 wait complete. 2023-10-03T10:16:15.300 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:15.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:15.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.325+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe63c005860 con 0x7fe66412f8b0 2023-10-03T10:16:15.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.325+0000 7fe659ffb700 1 -- 172.21.15.19:0/2541722603 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe65401f400 con 0x7fe66412f8b0 2023-10-03T10:16:15.325 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:15.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 msgr2=0x7fe6641c44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 0x7fe6641c44f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe654018000 tx=0x7fe654004750 comp rx=0 tx=0).stop 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 shutdown_connections 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe664130260 0x7fe6641c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe66412cf60 0x7fe6641c3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.327+0000 7fe64f7fe700 1 --2- 172.21.15.19:0/2541722603 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe66412f8b0 0x7fe6641c44f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.328+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 >> 172.21.15.19:0/2541722603 conn(0x7fe6640a2aa0 msgr2=0x7fe6641b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.328+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 shutdown_connections 2023-10-03T10:16:15.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.328+0000 7fe64f7fe700 1 -- 172.21.15.19:0/2541722603 wait complete. 2023-10-03T10:16:15.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:15.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.379+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe81806c360 con 0x7fe81809d6f0 2023-10-03T10:16:15.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.380+0000 7fe80e7fc700 1 -- 172.21.15.19:0/2659067103 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe814028af0 con 0x7fe81809d6f0 2023-10-03T10:16:15.380 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 msgr2=0x7fe818122630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe814000c00 tx=0x7fe814004750 comp rx=0 tx=0).stop 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 shutdown_connections 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe81809e410 0x7fe8181230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe81809d6f0 0x7fe818122630 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 --2- 172.21.15.19:0/2659067103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe81809e000 0x7fe818122b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 >> 172.21.15.19:0/2659067103 conn(0x7fe818066f50 msgr2=0x7fe81806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 shutdown_connections 2023-10-03T10:16:15.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:15.382+0000 7fe820145700 1 -- 172.21.15.19:0/2659067103 wait complete. 2023-10-03T10:16:15.395 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:16.301 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:16.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:16.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:16.396 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:16.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.457+0000 7fcb3c0c2700 1 Processor -- start 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.457+0000 7fcb3c0c2700 1 -- start start 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3c0c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409d6f0 0x7fcb3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3c0c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 0x7fcb34130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3c0c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb3409f130 con 0x7fcb3409e410 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3c0c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3409f520 con 0x7fcb3409e000 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3c0c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3409e930 con 0x7fcb3409d6f0 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3a65f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcb3409e410 0x7fcb34130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34348/0 (socket says 172.21.15.19:34348) 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3a65f700 1 -- 172.21.15.19:0/2721092948 learned_addr learned my addr 172.21.15.19:0/2721092948 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:16.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb39e5e700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409d6f0 0x7fcb3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3965d700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 0x7fcb34130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3965d700 1 -- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409d6f0 msgr2=0x7fcb3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3965d700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409d6f0 0x7fcb3409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb38e5c700 1 -- 172.21.15.19:0/2721092948 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3465139935 0 0) 0x7fcb3409f130 con 0x7fcb3409e410 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3965d700 1 -- 172.21.15.19:0/2721092948 >> v1:172.21.15.19:6789/0 conn(0x7fcb3409e410 legacy=0x7fcb34130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.458+0000 7fcb3965d700 1 -- 172.21.15.19:0/2721092948 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3409b2d0 con 0x7fcb3409e000 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.459+0000 7fcb3965d700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 0x7fcb34130660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a75d4ac92223b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.459+0000 7fcb38e5c700 1 -- 172.21.15.19:0/2721092948 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011830 con 0x7fcb3409e000 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.459+0000 7fcb38e5c700 1 -- 172.21.15.19:0/2721092948 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb24011990 con 0x7fcb3409e000 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.459+0000 7fcb38e5c700 1 -- 172.21.15.19:0/2721092948 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24011d20 con 0x7fcb3409e000 2023-10-03T10:16:16.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 msgr2=0x7fcb34130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 0x7fcb34130660 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcb24009870 tx=0x7fcb24009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2721092948 shutdown_connections 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409d6f0 0x7fcb3409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2721092948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409e000 0x7fcb34130660 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2721092948 >> 172.21.15.19:0/2721092948 conn(0x7fcb34066f50 msgr2=0x7fcb3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2721092948 shutdown_connections 2023-10-03T10:16:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.460+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2721092948 wait complete. 2023-10-03T10:16:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 Processor -- start 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 -- start start 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409e000 0x7fcb341205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 0x7fcb34120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34123ae0 con 0x7fcb3409e410 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34123270 con 0x7fcb3409d6f0 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.461+0000 7fcb3c0c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb34122400 con 0x7fcb3409e000 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41332/0 (socket says 172.21.15.19:41332) 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 -- 172.21.15.19:0/2544686847 learned_addr learned my addr 172.21.15.19:0/2544686847 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb3965d700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409e000 0x7fcb341205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb3a65f700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 0x7fcb34120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 -- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409e000 msgr2=0x7fcb341205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409e000 0x7fcb341205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 -- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 msgr2=0x7fcb34120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 0x7fcb34120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 -- 172.21.15.19:0/2544686847 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240094a0 con 0x7fcb3409d6f0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb3a65f700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 0x7fcb34120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb39e5e700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000e9b0 tx=0x7fcb3000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.462+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30009710 con 0x7fcb3409d6f0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.463+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000c850 con 0x7fcb3409d6f0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.463+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000cbc0 con 0x7fcb3409d6f0 2023-10-03T10:16:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.463+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3409c700 con 0x7fcb3409d6f0 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.463+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb340726b0 con 0x7fcb3409d6f0 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.464+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb3000cd20 con 0x7fcb3409d6f0 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.464+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb3001a360 con 0x7fcb3409d6f0 2023-10-03T10:16:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.464+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb34122eb0 con 0x7fcb3409d6f0 2023-10-03T10:16:16.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.473+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb300102b0 con 0x7fcb3409d6f0 2023-10-03T10:16:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.495+0000 7fec65f19700 1 Processor -- start 2023-10-03T10:16:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.495+0000 7efde42c5700 1 Processor -- start 2023-10-03T10:16:16.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.495+0000 7efde42c5700 1 -- start start 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.495+0000 7fec65f19700 1 -- start start 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 0x7fec6006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 0x7fec6006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec60070ee0 con 0x7fec60134610 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60071480 con 0x7fec6006e570 2023-10-03T10:16:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec65f19700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec6006f3c0 con 0x7fec6009eca0 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 0x7fec6006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58656/0 (socket says 172.21.15.19:58656) 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 0x7fec6006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5ffff700 1 -- 172.21.15.19:0/3922406932 learned_addr learned my addr 172.21.15.19:0/3922406932 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 0x7fec6006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41346/0 (socket says 172.21.15.19:41346) 2023-10-03T10:16:16.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7efde42c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7efde42c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7efde42c5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc1310d0 con 0x7efddc1305f0 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7efde42c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc1301c0 con 0x7efddc135e30 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.496+0000 7efde42c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efddc071ff0 con 0x7efddc133510 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 -- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 msgr2=0x7fec6006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 --2- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 0x7fec6006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 -- 172.21.15.19:0/3922406932 >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 msgr2=0x7fec60134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 --2- 172.21.15.19:0/3922406932 >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 -- 172.21.15.19:0/3922406932 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec60071b90 con 0x7fec6009eca0 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41348/0 (socket says 172.21.15.19:41348) 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 -- 172.21.15.19:0/900667518 learned_addr learned my addr 172.21.15.19:0/900667518 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5ffff700 1 --2- 172.21.15.19:0/3922406932 >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5effd700 1 --2- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 0x7fec6006ee80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec54009840 tx=0x7fec54009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caafe9931b631de3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 -- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 msgr2=0x7efddc1358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 --2- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 -- 172.21.15.19:0/900667518 >> v1:172.21.15.19:6789/0 conn(0x7efddc1305f0 legacy=0x7efddc1309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7efde2862700 1 -- 172.21.15.19:0/900667518 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc070e70 con 0x7efddc135e30 2023-10-03T10:16:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5e7fc700 1 -- 172.21.15.19:0/3922406932 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011830 con 0x7fec6009eca0 2023-10-03T10:16:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5e7fc700 1 -- 172.21.15.19:0/3922406932 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec54011990 con 0x7fec6009eca0 2023-10-03T10:16:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.497+0000 7fec5e7fc700 1 -- 172.21.15.19:0/3922406932 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec54011d20 con 0x7fec6009eca0 2023-10-03T10:16:16.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7efde2862700 1 --2- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e80 tx=0x7efdd400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af418b0ab31b517e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7efde105f700 1 -- 172.21.15.19:0/900667518 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd400e070 con 0x7efddc135e30 2023-10-03T10:16:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7efde105f700 1 -- 172.21.15.19:0/900667518 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd400b9c0 con 0x7efddc135e30 2023-10-03T10:16:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7efde105f700 1 -- 172.21.15.19:0/900667518 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd400bd70 con 0x7efddc135e30 2023-10-03T10:16:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 -- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 msgr2=0x7fec6006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 --2- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 0x7fec6006ee80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fec54009840 tx=0x7fec54009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 -- 172.21.15.19:0/3922406932 shutdown_connections 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 --2- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec6006e570 0x7fec6006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 --2- 172.21.15.19:0/3922406932 >> v2:172.21.15.19:3300/0 conn(0x7fec60134610 0x7fec60134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 --2- 172.21.15.19:0/3922406932 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec6009eca0 0x7fec6006ee80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 -- 172.21.15.19:0/3922406932 >> 172.21.15.19:0/3922406932 conn(0x7fec600a2aa0 msgr2=0x7fec600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.498+0000 7fec65f19700 1 -- 172.21.15.19:0/3922406932 shutdown_connections 2023-10-03T10:16:16.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7fec65f19700 1 -- 172.21.15.19:0/3922406932 wait complete. 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 -- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 msgr2=0x7efddc138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 --2- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e80 tx=0x7efdd400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 -- 172.21.15.19:0/900667518 shutdown_connections 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 --2- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc135e30 0x7efddc138210 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 --2- 172.21.15.19:0/900667518 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc1358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 -- 172.21.15.19:0/900667518 >> 172.21.15.19:0/900667518 conn(0x7efddc0a2aa0 msgr2=0x7efddc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 -- 172.21.15.19:0/900667518 shutdown_connections 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.499+0000 7efde42c5700 1 -- 172.21.15.19:0/900667518 wait complete. 2023-10-03T10:16:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 Processor -- start 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7fec65f19700 1 Processor -- start 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7fec65f19700 1 -- start start 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6006e570 0x7fec601276d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec60134610 0x7fec601260d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600a20c0 con 0x7fec6006e570 2023-10-03T10:16:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60126fa0 con 0x7fec60126610 2023-10-03T10:16:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec65f19700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec60127c10 con 0x7fec60134610 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 -- start start 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc1305f0 0x7efddc09a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc09aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc139350 con 0x7efddc135e30 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc071820 con 0x7efddc1305f0 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.500+0000 7efde42c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efddc138d70 con 0x7efddc133510 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2061700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc1305f0 0x7efddc09a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58662/0 (socket says 172.21.15.19:58662) 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 -- 172.21.15.19:0/3329708572 learned_addr learned my addr 172.21.15.19:0/3329708572 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 -- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 msgr2=0x7efddc09aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc09aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 -- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc1305f0 msgr2=0x7efddc09a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc1305f0 0x7efddc09a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 -- 172.21.15.19:0/3329708572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4009b30 con 0x7efddc135e30 2023-10-03T10:16:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec5ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41366/0 (socket says 172.21.15.19:41366) 2023-10-03T10:16:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec5ffff700 1 -- 172.21.15.19:0/1216824194 learned_addr learned my addr 172.21.15.19:0/1216824194 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7efde2862700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e50 tx=0x7efdd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.501+0000 7fec5f7fe700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6006e570 0x7fec601276d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004450 con 0x7efddc135e30 2023-10-03T10:16:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7fec5ffff700 1 -- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec60134610 msgr2=0x7fec601260d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7fec5ffff700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec60134610 0x7fec601260d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7fec5ffff700 1 -- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6006e570 msgr2=0x7fec601276d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7fec5ffff700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6006e570 0x7fec601276d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7fec5ffff700 1 -- 172.21.15.19:0/1216824194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58009b30 con 0x7fec60126610 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd40045b0 con 0x7efddc135e30 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004960 con 0x7efddc135e30 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc09c870 con 0x7efddc135e30 2023-10-03T10:16:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.502+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc09ce10 con 0x7efddc135e30 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec5ffff700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec5800efc0 tx=0x7fec5800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efdd4047460 con 0x7efddc135e30 2023-10-03T10:16:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58018070 con 0x7fec60126610 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efdd4063380 con 0x7efddc135e30 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc09ca30 con 0x7efddc135e30 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec5800f040 con 0x7fec60126610 2023-10-03T10:16:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec58003c20 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec540094a0 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.503+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6013e5b0 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.505+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6006f1b0 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.505+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec5800c930 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.508+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec580092e0 con 0x7fec60126610 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.512+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efdd404c070 con 0x7efddc135e30 2023-10-03T10:16:16.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.513+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec58074750 con 0x7fec60126610 2023-10-03T10:16:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.559+0000 7f2c89343700 1 Processor -- start 2023-10-03T10:16:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.559+0000 7f2c89343700 1 -- start start 2023-10-03T10:16:16.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c89343700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 0x7f2c84136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c89343700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c84136fe0 0x7f2c841393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c89343700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c84070940 con 0x7f2c8409e930 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c89343700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8406fd60 con 0x7f2c8409f410 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c89343700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8406fa80 con 0x7f2c84136fe0 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c82ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2c8409e930 0x7f2c8409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34358/0 (socket says 172.21.15.19:34358) 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c82ffd700 1 -- 172.21.15.19:0/114082123 learned_addr learned my addr 172.21.15.19:0/114082123 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c827fc700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 0x7f2c84136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c837fe700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c84136fe0 0x7f2c841393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c81ffb700 1 -- 172.21.15.19:0/114082123 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516688870 0 0) 0x7f2c84070940 con 0x7f2c8409e930 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c81ffb700 1 -- 172.21.15.19:0/114082123 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c6c0035b0 con 0x7f2c8409e930 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c827fc700 1 -- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c84136fe0 msgr2=0x7f2c841393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c827fc700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c84136fe0 0x7f2c841393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c827fc700 1 -- 172.21.15.19:0/114082123 >> v1:172.21.15.19:6789/0 conn(0x7f2c8409e930 legacy=0x7f2c8409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.560+0000 7f2c827fc700 1 -- 172.21.15.19:0/114082123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8409fb60 con 0x7f2c8409f410 2023-10-03T10:16:16.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.561+0000 7f2c827fc700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 0x7f2c84136aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009870 tx=0x7f2c78009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8851378876e73e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.561+0000 7f2c81ffb700 1 -- 172.21.15.19:0/114082123 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78011830 con 0x7f2c8409f410 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.561+0000 7f2c81ffb700 1 -- 172.21.15.19:0/114082123 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c78011990 con 0x7f2c8409f410 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.561+0000 7f2c81ffb700 1 -- 172.21.15.19:0/114082123 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78011d20 con 0x7f2c8409f410 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 -- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 msgr2=0x7f2c84136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 0x7f2c84136aa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2c78009870 tx=0x7f2c78009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 -- 172.21.15.19:0/114082123 shutdown_connections 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c84136fe0 0x7f2c841393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 --2- 172.21.15.19:0/114082123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c8409f410 0x7f2c84136aa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 -- 172.21.15.19:0/114082123 >> 172.21.15.19:0/114082123 conn(0x7f2c840a4210 msgr2=0x7f2c840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 -- 172.21.15.19:0/114082123 shutdown_connections 2023-10-03T10:16:16.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.562+0000 7f2c89343700 1 -- 172.21.15.19:0/114082123 wait complete. 2023-10-03T10:16:16.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.563+0000 7f2c89343700 1 Processor -- start 2023-10-03T10:16:16.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.563+0000 7f2c89343700 1 -- start start 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.563+0000 7f2c89343700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.563+0000 7f2c89343700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 0x7f2c841c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.563+0000 7f2c89343700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 0x7f2c8406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c89343700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84121ec0 con 0x7f2c8409e930 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c89343700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c841bc0c0 con 0x7f2c84136fe0 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c89343700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84132230 con 0x7f2c8409f410 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c82ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c82ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58678/0 (socket says 172.21.15.19:58678) 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c82ffd700 1 -- 172.21.15.19:0/1182196386 learned_addr learned my addr 172.21.15.19:0/1182196386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 0x7f2c841c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c837fe700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 0x7f2c8406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 -- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 msgr2=0x7f2c8406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 0x7f2c8406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 -- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 msgr2=0x7f2c841c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 -- 172.21.15.19:0/1182196386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780094a0 con 0x7f2c8409f410 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c837fe700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 0x7f2c8406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c82ffd700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.564+0000 7f2c827fc700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 0x7f2c841c89e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406f570 tx=0x7f2c78004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:16.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.565+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c78004450 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.565+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7801f070 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.565+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c84132600 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.565+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c780038e0 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.565+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8409df10 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.566+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c78003a40 con 0x7f2c8409f410 2023-10-03T10:16:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.566+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c84071d20 con 0x7f2c8409f410 2023-10-03T10:16:16.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.567+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c78021070 con 0x7f2c8409f410 2023-10-03T10:16:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.572+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c78010380 con 0x7f2c8409f410 2023-10-03T10:16:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.702+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb34123600 con 0x7fcb3409d6f0 2023-10-03T10:16:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.702+0000 7fcb2a7fc700 1 -- 172.21.15.19:0/2544686847 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb3001ae80 con 0x7fcb3409d6f0 2023-10-03T10:16:16.702 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 msgr2=0x7fcb341200a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000e9b0 tx=0x7fcb3000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 shutdown_connections 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb3409e410 0x7fcb34120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb3409d6f0 0x7fcb341200a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 --2- 172.21.15.19:0/2544686847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb3409e000 0x7fcb341205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 >> 172.21.15.19:0/2544686847 conn(0x7fcb34066f50 msgr2=0x7fcb3406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 shutdown_connections 2023-10-03T10:16:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.705+0000 7fcb3c0c2700 1 -- 172.21.15.19:0/2544686847 wait complete. 2023-10-03T10:16:16.719 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:16.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.729+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fec60074ea0 con 0x7fec60126610 2023-10-03T10:16:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.730+0000 7fec47fff700 1 -- 172.21.15.19:0/1216824194 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec58003d80 con 0x7fec60126610 2023-10-03T10:16:16.730 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 msgr2=0x7fec60126a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fec5800efc0 tx=0x7fec5800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 shutdown_connections 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec60126610 0x7fec60126a30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec6006e570 0x7fec601276d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 --2- 172.21.15.19:0/1216824194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec60134610 0x7fec601260d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 >> 172.21.15.19:0/1216824194 conn(0x7fec600a2aa0 msgr2=0x7fec600a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.733+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 shutdown_connections 2023-10-03T10:16:16.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.734+0000 7fec65f19700 1 -- 172.21.15.19:0/1216824194 wait complete. 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.739+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efddc074ea0 con 0x7efddc135e30 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.739+0000 7efdd2ffd700 1 -- 172.21.15.19:0/3329708572 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efdd4056090 con 0x7efddc135e30 2023-10-03T10:16:16.739 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 msgr2=0x7efddc09afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009e50 tx=0x7efdd4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 shutdown_connections 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc135e30 0x7efddc09afd0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efddc1305f0 0x7efddc09a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 --2- 172.21.15.19:0/3329708572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efddc133510 0x7efddc09aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 >> 172.21.15.19:0/3329708572 conn(0x7efddc0a2aa0 msgr2=0x7efddc12e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 shutdown_connections 2023-10-03T10:16:16.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.744+0000 7efde42c5700 1 -- 172.21.15.19:0/3329708572 wait complete. 2023-10-03T10:16:16.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:16.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.780+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2c84074ea0 con 0x7f2c8409f410 2023-10-03T10:16:16.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.781+0000 7f2c6b7fe700 1 -- 172.21.15.19:0/1182196386 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c7802b070 con 0x7f2c8409f410 2023-10-03T10:16:16.781 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 msgr2=0x7f2c841c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 0x7f2c841c89e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2c8406f570 tx=0x7f2c78004750 comp rx=0 tx=0).stop 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 shutdown_connections 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c84136fe0 0x7f2c8406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c8409e930 0x7f2c841c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 --2- 172.21.15.19:0/1182196386 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c8409f410 0x7f2c841c89e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:16.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 >> 172.21.15.19:0/1182196386 conn(0x7f2c840a4210 msgr2=0x7f2c84134a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:16.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 shutdown_connections 2023-10-03T10:16:16.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:16.783+0000 7f2c89343700 1 -- 172.21.15.19:0/1182196386 wait complete. 2023-10-03T10:16:16.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:17.720 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:17.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:17.759 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:17.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:17.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.875+0000 7f39ca1a0700 1 Processor -- start 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.875+0000 7f39ca1a0700 1 -- start start 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39ca1a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c413ac10 0x7f39c413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39ca1a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f39c413d530 0x7f39c413f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39ca1a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c409ebc0 con 0x7f39c41348a0 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39ca1a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c4095cb0 con 0x7f39c413d530 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39ca1a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c409e980 con 0x7f39c413ac10 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39c919e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f39c41348a0 0x7f39c4134c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34370/0 (socket says 172.21.15.19:34370) 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39c919e700 1 -- 172.21.15.19:0/1935412047 learned_addr learned my addr 172.21.15.19:0/1935412047 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39c999f700 1 --2- 172.21.15.19:0/1935412047 >> v2:172.21.15.19:3300/0 conn(0x7f39c413d530 0x7f39c413f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39c899d700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c413ac10 0x7f39c413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205713401 0 0) 0x7f39c409ebc0 con 0x7f39c41348a0 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.876+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b00035b0 con 0x7f39c41348a0 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2690635927 0 0) 0x7f39b00035b0 con 0x7f39c41348a0 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c413ac10 msgr2=0x7f39c413cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c413ac10 0x7f39c413cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 >> v2:172.21.15.19:3300/0 conn(0x7f39c413d530 msgr2=0x7f39c413f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 --2- 172.21.15.19:0/1935412047 >> v2:172.21.15.19:3300/0 conn(0x7f39c413d530 0x7f39c413f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4094ec0 con 0x7f39c41348a0 2023-10-03T10:16:17.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f39c00017f0 con 0x7f39c41348a0 2023-10-03T10:16:17.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39c999f700 1 --2- 172.21.15.19:0/1935412047 >> v2:172.21.15.19:3300/0 conn(0x7f39c413d530 0x7f39c413f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 >> v1:172.21.15.19:6789/0 conn(0x7f39c41348a0 legacy=0x7f39c4134c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39b0003a00 0x7f39b0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39b0004850 0x7f39b0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0005200 0x7f39b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4095cb0 con 0x7f39b0005200 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c409e980 con 0x7f39b0004850 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39b000c000 con 0x7f39b0003a00 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39c899d700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c413ac10 0x7f39c413cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39c919e700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39b0003a00 0x7f39b0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39c899d700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39b0004850 0x7f39b0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.877+0000 7f39c999f700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0005200 0x7f39b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 -- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39b0004850 msgr2=0x7f39b0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39b0004850 0x7f39b0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 -- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0005200 msgr2=0x7f39b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0005200 0x7f39b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 -- 172.21.15.19:0/1935412047 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b00035b0 con 0x7f39b0003a00 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39c919e700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39b0003a00 0x7f39b0003e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c190 tx=0x7f39b0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=438453763af6cdf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000cd30 con 0x7f39b0003a00 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000ce90 con 0x7f39b0003a00 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.878+0000 7f39bbfff700 1 -- 172.21.15.19:0/1935412047 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0007310 con 0x7f39b0003a00 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 -- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39b0003a00 msgr2=0x7f39b0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 --2- 172.21.15.19:0/1935412047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39b0003a00 0x7f39b0003e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c190 tx=0x7f39b0005880 comp rx=0 tx=0).stop 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39c999f700 1 -- 172.21.15.19:0/1935412047 reap_dead start 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 -- 172.21.15.19:0/1935412047 shutdown_connections 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 -- 172.21.15.19:0/1935412047 >> 172.21.15.19:0/1935412047 conn(0x7f39c40a2540 msgr2=0x7f39c40a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 -- 172.21.15.19:0/1935412047 shutdown_connections 2023-10-03T10:16:17.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.879+0000 7f39ca1a0700 1 -- 172.21.15.19:0/1935412047 wait complete. 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.881+0000 7f39ca1a0700 1 Processor -- start 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.881+0000 7f39ca1a0700 1 -- start start 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0003a00 0x7f39c4097e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 0x7f39c4133540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4097810 con 0x7f39b0003a00 2023-10-03T10:16:17.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c409c440 con 0x7f39c4096af0 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39ca1a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f39c413d300 con 0x7f39c4096180 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c899d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c919e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0003a00 0x7f39c4097e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c899d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50350/0 (socket says 172.21.15.19:50350) 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c899d700 1 -- 172.21.15.19:0/3956466216 learned_addr learned my addr 172.21.15.19:0/3956466216 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 0x7f39c4133540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 -- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 msgr2=0x7f39c40965b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 -- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0003a00 msgr2=0x7f39c4097e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0003a00 0x7f39c4097e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c999f700 1 -- 172.21.15.19:0/3956466216 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4094080 con 0x7f39c4096af0 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.882+0000 7f39c899d700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39c999f700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 0x7f39c4133540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39c409e6f0 tx=0x7f39bc009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00e070 con 0x7f39c4096af0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc003c30 con 0x7f39c4096af0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c40979e0 con 0x7f39c4096af0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc003dc0 con 0x7f39c4096af0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.883+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c4096f60 con 0x7f39c4096af0 2023-10-03T10:16:17.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.884+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f39bc0119b0 con 0x7f39c4096af0 2023-10-03T10:16:17.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.884+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f39bc03fc50 con 0x7f39c4096af0 2023-10-03T10:16:17.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.885+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c404f2a0 con 0x7f39c4096af0 2023-10-03T10:16:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.894+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f39bc01e360 con 0x7f39c4096af0 2023-10-03T10:16:17.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.912+0000 7f89ff99e700 1 Processor -- start 2023-10-03T10:16:17.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 -- start start 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 0x7f89f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f809e410 0x7f89f8134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f809b120 con 0x7f89f809e000 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f806b460 con 0x7f89f809e410 2023-10-03T10:16:17.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.914+0000 7f89ff99e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f809a7e0 con 0x7f89f809d6f0 2023-10-03T10:16:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fd73a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 0x7f89f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fd73a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 0x7f89f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50358/0 (socket says 172.21.15.19:50358) 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89f809e410 0x7f89f8134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fd73a700 1 -- 172.21.15.19:0/2175834735 learned_addr learned my addr 172.21.15.19:0/2175834735 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 -- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 msgr2=0x7f89f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 0x7f89f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 -- 172.21.15.19:0/2175834735 >> v1:172.21.15.19:6789/0 conn(0x7f89f809e000 legacy=0x7f89f81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 -- 172.21.15.19:0/2175834735 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f809a500 con 0x7f89f809e410 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f8134100 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f56231482daf967 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89effff700 1 -- 172.21.15.19:0/2175834735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f000e070 con 0x7f89f809e410 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89effff700 1 -- 172.21.15.19:0/2175834735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f000bb20 con 0x7f89f809e410 2023-10-03T10:16:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.915+0000 7f89effff700 1 -- 172.21.15.19:0/2175834735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0012430 con 0x7f89f809e410 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.916+0000 7f89ff99e700 1 -- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 msgr2=0x7f89f8134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.916+0000 7f89ff99e700 1 --2- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f8134100 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 -- 172.21.15.19:0/2175834735 shutdown_connections 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 --2- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f8134100 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 --2- 172.21.15.19:0/2175834735 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809d6f0 0x7f89f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 -- 172.21.15.19:0/2175834735 >> 172.21.15.19:0/2175834735 conn(0x7f89f8066f50 msgr2=0x7f89f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 -- 172.21.15.19:0/2175834735 shutdown_connections 2023-10-03T10:16:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.917+0000 7f89ff99e700 1 -- 172.21.15.19:0/2175834735 wait complete. 2023-10-03T10:16:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.918+0000 7f89ff99e700 1 Processor -- start 2023-10-03T10:16:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.918+0000 7f89ff99e700 1 -- start start 2023-10-03T10:16:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 Processor -- start 2023-10-03T10:16:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 -- start start 2023-10-03T10:16:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 0x7f89f81b9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809e000 0x7f89f81a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f81a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81aa330 con 0x7f89f809e410 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81a9970 con 0x7f89f809d6f0 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89ff99e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81a9100 con 0x7f89f809e000 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89fd73a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 0x7f89f81b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89fd73a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 0x7f89f81b9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41436/0 (socket says 172.21.15.19:41436) 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89fd73a700 1 -- 172.21.15.19:0/916474125 learned_addr learned my addr 172.21.15.19:0/916474125 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 0x7f149009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f149009dfe0 0x7f14901335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149009a570 con 0x7f1490133b00 2023-10-03T10:16:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149009b1c0 con 0x7f149009dfe0 2023-10-03T10:16:17.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f149489a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149009f240 con 0x7f149009d6d0 2023-10-03T10:16:17.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.919+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f81a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1490133b00 0x7f149013aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34394/0 (socket says 172.21.15.19:34394) 2023-10-03T10:16:17.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148ed9d700 1 -- 172.21.15.19:0/496160361 learned_addr learned my addr 172.21.15.19:0/496160361 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:17.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f89fdf3b700 1 -- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809e000 msgr2=0x7f89f81a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809e000 0x7f89f81a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f89fdf3b700 1 -- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 msgr2=0x7f89f81b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 0x7f89f81b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f89fdf3b700 1 -- 172.21.15.19:0/916474125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f0009a70 con 0x7f89f809e410 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148e59c700 1 --2- 172.21.15.19:0/496160361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 0x7f149009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537656689 0 0) 0x7f149009a570 con 0x7f1490133b00 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14780035b0 con 0x7f1490133b00 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148e59c700 1 -- 172.21.15.19:0/496160361 >> v2:172.21.15.19:3300/0 conn(0x7f149009dfe0 msgr2=0x7f14901335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148e59c700 1 --2- 172.21.15.19:0/496160361 >> v2:172.21.15.19:3300/0 conn(0x7f149009dfe0 0x7f14901335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148e59c700 1 -- 172.21.15.19:0/496160361 >> v1:172.21.15.19:6789/0 conn(0x7f1490133b00 legacy=0x7f149013aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771578128 0 0) 0x7f14780035b0 con 0x7f1490133b00 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.920+0000 7f148e59c700 1 -- 172.21.15.19:0/496160361 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149009a2d0 con 0x7f149009d6d0 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89fdf3b700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f81a6420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f148e59c700 1 --2- 172.21.15.19:0/496160361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 0x7f149009daa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1480009840 tx=0x7f1480009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bae7a0d28e43c64 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f001b810 con 0x7f89f809e410 2023-10-03T10:16:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880019f0 con 0x7f149009d6d0 2023-10-03T10:16:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0020070 con 0x7f89f809e410 2023-10-03T10:16:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89ff99e700 1 -- 172.21.15.19:0/916474125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f81a8cb0 con 0x7f89f809e410 2023-10-03T10:16:17.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480004030 con 0x7f149009d6d0 2023-10-03T10:16:17.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f148d59a700 1 -- 172.21.15.19:0/496160361 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800043c0 con 0x7f149009d6d0 2023-10-03T10:16:17.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89ff99e700 1 -- 172.21.15.19:0/916474125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f81a7a60 con 0x7f89f809e410 2023-10-03T10:16:17.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.921+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f001bbd0 con 0x7f89f809e410 2023-10-03T10:16:17.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.922+0000 7f149489a700 1 -- 172.21.15.19:0/496160361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 msgr2=0x7f149009daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.922+0000 7f149489a700 1 --2- 172.21.15.19:0/496160361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 0x7f149009daa0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1480009840 tx=0x7f1480009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:17.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8074ea0 con 0x7f89f809e410 2023-10-03T10:16:17.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 -- 172.21.15.19:0/496160361 shutdown_connections 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 --2- 172.21.15.19:0/496160361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f149009d6d0 0x7f149009daa0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 --2- 172.21.15.19:0/496160361 >> v2:172.21.15.19:3300/0 conn(0x7f149009dfe0 0x7f14901335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 -- 172.21.15.19:0/496160361 >> 172.21.15.19:0/496160361 conn(0x7f1490099c20 msgr2=0x7f14900a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89f001bd30 con 0x7f89f809e410 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 -- 172.21.15.19:0/496160361 shutdown_connections 2023-10-03T10:16:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f149489a700 1 -- 172.21.15.19:0/496160361 wait complete. 2023-10-03T10:16:17.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.923+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89f0022070 con 0x7f89f809e410 2023-10-03T10:16:17.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.925+0000 7f149489a700 1 Processor -- start 2023-10-03T10:16:17.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.925+0000 7f149489a700 1 -- start start 2023-10-03T10:16:17.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 0x7f149011cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f149009dfe0 0x7f149011d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490120770 con 0x7f149009dfe0 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149011e900 con 0x7f1490133b00 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f149489a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f149011fb20 con 0x7f149009d6d0 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41444/0 (socket says 172.21.15.19:41444) 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 -- 172.21.15.19:0/1884966191 learned_addr learned my addr 172.21.15.19:0/1884966191 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148e59c700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 0x7f149011cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 -- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 msgr2=0x7f149011cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 0x7f149011cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 -- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f149009dfe0 msgr2=0x7f149011d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f149009dfe0 0x7f149011d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148ed9d700 1 -- 172.21.15.19:0/1884966191 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14800094a0 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.926+0000 7f148e59c700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 0x7f149011cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f148ed9d700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f148800cca0 tx=0x7f148800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148800ac20 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800ada0 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488007310 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1490132690 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.927+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149011f660 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.928+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1488007470 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.928+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149004f2a0 con 0x7f1490133b00 2023-10-03T10:16:17.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.928+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f14880432f0 con 0x7f1490133b00 2023-10-03T10:16:17.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.929+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89f0025380 con 0x7f89f809e410 2023-10-03T10:16:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.938+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f148801b360 con 0x7f1490133b00 2023-10-03T10:16:17.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.964+0000 7fbbd2b99700 1 Processor -- start 2023-10-03T10:16:17.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.964+0000 7fbbd2b99700 1 -- start start 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd2b99700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd2b99700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd2b99700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbcc130260 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd2b99700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc09a350 con 0x7fbbcc06f680 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd2b99700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc071ff0 con 0x7fbbcc130670 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50378/0 (socket says 172.21.15.19:50378) 2023-10-03T10:16:17.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 -- 172.21.15.19:0/1334232032 learned_addr learned my addr 172.21.15.19:0/1334232032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbcbfff700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbcb7fe700 1 -- 172.21.15.19:0/1334232032 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381622871 0 0) 0x7fbbcc130260 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 -- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 msgr2=0x7fbbcc06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 -- 172.21.15.19:0/1334232032 >> v1:172.21.15.19:6789/0 conn(0x7fbbcc06ffd0 legacy=0x7fbbcc137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.965+0000 7fbbd0935700 1 -- 172.21.15.19:0/1334232032 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc070470 con 0x7fbbcc130670 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.966+0000 7fbbd0935700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006e60 tx=0x7fbbc0009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=425bee40b97f2acf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.966+0000 7fbbcb7fe700 1 -- 172.21.15.19:0/1334232032 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0004230 con 0x7fbbcc130670 2023-10-03T10:16:17.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.966+0000 7fbbcb7fe700 1 -- 172.21.15.19:0/1334232032 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0004390 con 0x7fbbcc130670 2023-10-03T10:16:17.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.966+0000 7fbbcb7fe700 1 -- 172.21.15.19:0/1334232032 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0010380 con 0x7fbbcc130670 2023-10-03T10:16:17.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 -- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 msgr2=0x7fbbcc130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0006e60 tx=0x7fbbc0009c90 comp rx=0 tx=0).stop 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 -- 172.21.15.19:0/1334232032 shutdown_connections 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc130670 0x7fbbcc130a40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/1334232032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 -- 172.21.15.19:0/1334232032 >> 172.21.15.19:0/1334232032 conn(0x7fbbcc0a2aa0 msgr2=0x7fbbcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 -- 172.21.15.19:0/1334232032 shutdown_connections 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.967+0000 7fbbd2b99700 1 -- 172.21.15.19:0/1334232032 wait complete. 2023-10-03T10:16:17.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.968+0000 7fbbd2b99700 1 Processor -- start 2023-10-03T10:16:17.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.968+0000 7fbbd2b99700 1 -- start start 2023-10-03T10:16:17.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 0x7fbbcc119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc11be40 con 0x7fbbcc130670 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc11ca00 con 0x7fbbcc06f680 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.969+0000 7fbbd2b99700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc11aee0 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbd1136700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 0x7fbbcc119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50394/0 (socket says 172.21.15.19:50394) 2023-10-03T10:16:17.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 -- 172.21.15.19:0/2385071243 learned_addr learned my addr 172.21.15.19:0/2385071243 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbd0935700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 -- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 msgr2=0x7fbbcc118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 -- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 msgr2=0x7fbbcc119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 0x7fbbcc119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 -- 172.21.15.19:0/2385071243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009550 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbd1136700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 0x7fbbcc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbcbfff700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800e810 tx=0x7fbbb800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.970+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb800c070 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.971+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb8013610 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.971+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbcc11c040 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.971+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8013980 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.971+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbcc12ea40 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.972+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbb8013ae0 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.972+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbbb803f3c0 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.972+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbcc11bb00 con 0x7fbbcc06ffd0 2023-10-03T10:16:17.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:17.982+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbcc11bb00 con 0x7fbbcc06ffd0 2023-10-03T10:16:18.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.109+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39c4098a00 con 0x7f39c4096af0 2023-10-03T10:16:18.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.110+0000 7f39b9ffb700 1 -- 172.21.15.19:0/3956466216 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f39bc02f090 con 0x7f39c4096af0 2023-10-03T10:16:18.110 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 msgr2=0x7f39c4133540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 0x7f39c4133540 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f39c409e6f0 tx=0x7f39bc009f90 comp rx=0 tx=0).stop 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 shutdown_connections 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f39c4096af0 0x7f39c4133540 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f39b0003a00 0x7f39c4097e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 --2- 172.21.15.19:0/3956466216 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f39c4096180 0x7f39c40965b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.113+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 >> 172.21.15.19:0/3956466216 conn(0x7f39c40a2540 msgr2=0x7f39c4138bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.114+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 shutdown_connections 2023-10-03T10:16:18.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.114+0000 7f39ca1a0700 1 -- 172.21.15.19:0/3956466216 wait complete. 2023-10-03T10:16:18.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.147+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89f806c360 con 0x7f89f809e410 2023-10-03T10:16:18.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.147+0000 7f89edffb700 1 -- 172.21.15.19:0/916474125 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89f0035020 con 0x7f89f809e410 2023-10-03T10:16:18.147 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 msgr2=0x7f89f81a6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f81a6420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009d90 tx=0x7f89f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 shutdown_connections 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89f809e410 0x7f89f81a6420 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89f809d6f0 0x7f89f81b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 --2- 172.21.15.19:0/916474125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89f809e000 0x7f89f81a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 >> 172.21.15.19:0/916474125 conn(0x7f89f8066f50 msgr2=0x7f89f81baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 shutdown_connections 2023-10-03T10:16:18.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.150+0000 7f89e37fe700 1 -- 172.21.15.19:0/916474125 wait complete. 2023-10-03T10:16:18.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.161+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f149006c230 con 0x7f1490133b00 2023-10-03T10:16:18.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.162+0000 7f147effd700 1 -- 172.21.15.19:0/1884966191 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1488019270 con 0x7f1490133b00 2023-10-03T10:16:18.161 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:18.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:18.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 msgr2=0x7f149011d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f148800cca0 tx=0x7f148800a060 comp rx=0 tx=0).stop 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 shutdown_connections 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1490133b00 0x7f149011d6d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f149009d6d0 0x7f149011cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 --2- 172.21.15.19:0/1884966191 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f149009dfe0 0x7f149011d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 >> 172.21.15.19:0/1884966191 conn(0x7f1490099c20 msgr2=0x7f1490131d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 shutdown_connections 2023-10-03T10:16:18.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.164+0000 7f149489a700 1 -- 172.21.15.19:0/1884966191 wait complete. 2023-10-03T10:16:18.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:18.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.192+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbbcc074ea0 con 0x7fbbcc06ffd0 2023-10-03T10:16:18.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.193+0000 7fbbc97fa700 1 -- 172.21.15.19:0/2385071243 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbb802b090 con 0x7fbbcc06ffd0 2023-10-03T10:16:18.192 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 msgr2=0x7fbbcc119210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800e810 tx=0x7fbbb800eb20 comp rx=0 tx=0).stop 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 shutdown_connections 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbcc130670 0x7fbbcc119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbcc06f680 0x7fbbcc118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 --2- 172.21.15.19:0/2385071243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbcc06ffd0 0x7fbbcc119210 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 >> 172.21.15.19:0/2385071243 conn(0x7fbbcc0a2aa0 msgr2=0x7fbbcc12d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 shutdown_connections 2023-10-03T10:16:18.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:18.195+0000 7fbbd2b99700 1 -- 172.21.15.19:0/2385071243 wait complete. 2023-10-03T10:16:18.208 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:19.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:19.165 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:19.178 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:19.209 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:19.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.289+0000 7fcdd2c80700 1 Processor -- start 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.289+0000 7fcdd2c80700 1 -- start start 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd2c80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd2c80700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcdcc06ee80 0x7fcdcc134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd2c80700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc070ee0 con 0x7fcdcc09eca0 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd2c80700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc071480 con 0x7fcdcc06ee80 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd2c80700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc071b90 con 0x7fcdcc06e570 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50400/0 (socket says 172.21.15.19:50400) 2023-10-03T10:16:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/3869874159 learned_addr learned my addr 172.21.15.19:0/3869874159 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd121d700 1 --2- 172.21.15.19:0/3869874159 >> v2:172.21.15.19:3300/0 conn(0x7fcdcc06ee80 0x7fcdcc134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/3869874159 >> v2:172.21.15.19:3300/0 conn(0x7fcdcc06ee80 msgr2=0x7fcdcc134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 --2- 172.21.15.19:0/3869874159 >> v2:172.21.15.19:3300/0 conn(0x7fcdcc06ee80 0x7fcdcc134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/3869874159 >> v1:172.21.15.19:6789/0 conn(0x7fcdcc09eca0 legacy=0x7fcdcc134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.290+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/3869874159 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0711a0 con 0x7fcdcc06e570 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.291+0000 7fcdd0a1c700 1 --2- 172.21.15.19:0/3869874159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00098f0 tx=0x7fcdc0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abd6bdd78f3ae43f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.291+0000 7fcdcb7fe700 1 -- 172.21.15.19:0/3869874159 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011830 con 0x7fcdcc06e570 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.291+0000 7fcdcb7fe700 1 -- 172.21.15.19:0/3869874159 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0011990 con 0x7fcdcc06e570 2023-10-03T10:16:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.291+0000 7fcdcb7fe700 1 -- 172.21.15.19:0/3869874159 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011d20 con 0x7fcdcc06e570 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 -- 172.21.15.19:0/3869874159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 msgr2=0x7fcdcc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/3869874159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00098f0 tx=0x7fcdc0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 -- 172.21.15.19:0/3869874159 shutdown_connections 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/3869874159 >> v2:172.21.15.19:3300/0 conn(0x7fcdcc06ee80 0x7fcdcc134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/3869874159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc06e940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 -- 172.21.15.19:0/3869874159 >> 172.21.15.19:0/3869874159 conn(0x7fcdcc0a2aa0 msgr2=0x7fcdcc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 -- 172.21.15.19:0/3869874159 shutdown_connections 2023-10-03T10:16:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.292+0000 7fcdd2c80700 1 -- 172.21.15.19:0/3869874159 wait complete. 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.293+0000 7fcdd2c80700 1 Processor -- start 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.293+0000 7fcdd2c80700 1 -- start start 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.293+0000 7fcdd2c80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.293+0000 7fcdd2c80700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcdcc06ee80 0x7fcdcc134cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd2c80700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdcc1389f0 0x7fcdcc138e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd2c80700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc09e920 con 0x7fcdcc1389f0 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd2c80700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc13b4e0 con 0x7fcdcc06ee80 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd2c80700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc135900 con 0x7fcdcc06e570 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50410/0 (socket says 172.21.15.19:50410) 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/1022612370 learned_addr learned my addr 172.21.15.19:0/1022612370 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd121d700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdcc1389f0 0x7fcdcc138e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcdcc06ee80 msgr2=0x7fcdcc134cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcdcc06ee80 0x7fcdcc134cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdcc1389f0 msgr2=0x7fcdcc138e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdcc1389f0 0x7fcdcc138e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 -- 172.21.15.19:0/1022612370 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009550 con 0x7fcdcc06e570 2023-10-03T10:16:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.294+0000 7fcdd0a1c700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000c00 tx=0x7fcdc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.295+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0004480 con 0x7fcdcc06e570 2023-10-03T10:16:19.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.295+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc001f070 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.295+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc09e220 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.295+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc139f10 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.295+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00038c0 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.296+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcdc0021030 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.296+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac0052e0 con 0x7fcdcc06e570 2023-10-03T10:16:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.296+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcdc0040a90 con 0x7fcdcc06e570 2023-10-03T10:16:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.305+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcdc00199a0 con 0x7fcdcc06e570 2023-10-03T10:16:19.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.329+0000 7f7304645700 1 Processor -- start 2023-10-03T10:16:19.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.329+0000 7f5707449700 1 Processor -- start 2023-10-03T10:16:19.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.329+0000 7f7304645700 1 -- start start 2023-10-03T10:16:19.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 -- start start 2023-10-03T10:16:19.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a09c0 0x7f57000a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 0x7f5700134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570009ea10 con 0x7f570009d5c0 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72fc09e000 0x7f72fc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e410 0x7f72fc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc06b460 con 0x7f72fc09e000 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc09b120 con 0x7f72fc09d6f0 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7304645700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc09a7e0 con 0x7f72fc09e410 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570009e210 con 0x7f57000a09c0 2023-10-03T10:16:19.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f5707449700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57000a26f0 con 0x7f57000a12d0 2023-10-03T10:16:19.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7301be0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72fc09e000 0x7f72fc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7301be0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72fc09e000 0x7f72fc1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58776/0 (socket says 172.21.15.19:58776) 2023-10-03T10:16:19.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.330+0000 7f7301be0700 1 -- 172.21.15.19:0/3132456830 learned_addr learned my addr 172.21.15.19:0/3132456830 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57049e4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f570009d5c0 0x7f5700133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34416/0 (socket says 172.21.15.19:34416) 2023-10-03T10:16:19.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57049e4700 1 -- 172.21.15.19:0/1879774324 learned_addr learned my addr 172.21.15.19:0/1879774324 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57059e6700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 0x7f5700134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7302be2700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e410 0x7f72fc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57059e6700 1 -- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a09c0 msgr2=0x7f57000a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57059e6700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a09c0 0x7f57000a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57059e6700 1 -- 172.21.15.19:0/1879774324 >> v1:172.21.15.19:6789/0 conn(0x7f570009d5c0 legacy=0x7f5700133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 -- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e410 msgr2=0x7f72fc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e410 0x7f72fc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 -- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 msgr2=0x7f72fc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 -- 172.21.15.19:0/3132456830 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc09a500 con 0x7f72fc09e000 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f56f7fff700 1 -- 172.21.15.19:0/1879774324 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896868041 0 0) 0x7f570009ea10 con 0x7f570009d5c0 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f57059e6700 1 -- 172.21.15.19:0/1879774324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570009db70 con 0x7f57000a12d0 2023-10-03T10:16:19.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f57059e6700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 0x7f5700134030 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009dc0 tx=0x7f56f800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35dbf9b2a25d3fa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.331+0000 7f7301be0700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e000 0x7f72fc1339f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad30618951e84d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f73013df700 1 -- 172.21.15.19:0/3132456830 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00b8a0 con 0x7f72fc09e000 2023-10-03T10:16:19.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f56f7fff700 1 -- 172.21.15.19:0/1879774324 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800e070 con 0x7f57000a12d0 2023-10-03T10:16:19.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f73013df700 1 -- 172.21.15.19:0/3132456830 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec00ba00 con 0x7f72fc09e000 2023-10-03T10:16:19.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f73013df700 1 -- 172.21.15.19:0/3132456830 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00bd90 con 0x7f72fc09e000 2023-10-03T10:16:19.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f56f7fff700 1 -- 172.21.15.19:0/1879774324 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f800bbd0 con 0x7f57000a12d0 2023-10-03T10:16:19.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.332+0000 7f56f7fff700 1 -- 172.21.15.19:0/1879774324 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8012430 con 0x7f57000a12d0 2023-10-03T10:16:19.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 -- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e000 msgr2=0x7f72fc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e000 0x7f72fc1339f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f72ec0098f0 tx=0x7f72ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 -- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 msgr2=0x7f5700134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 0x7f5700134030 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009dc0 tx=0x7f56f800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 -- 172.21.15.19:0/1879774324 shutdown_connections 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57000a12d0 0x7f5700134030 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 --2- 172.21.15.19:0/1879774324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a09c0 0x7f57000a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 -- 172.21.15.19:0/1879774324 >> 172.21.15.19:0/1879774324 conn(0x7f57000a2fe0 msgr2=0x7f57000a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 -- 172.21.15.19:0/3132456830 shutdown_connections 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e410 0x7f72fc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 --2- 172.21.15.19:0/3132456830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e000 0x7f72fc1339f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 -- 172.21.15.19:0/3132456830 >> 172.21.15.19:0/3132456830 conn(0x7f72fc066f50 msgr2=0x7f72fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 -- 172.21.15.19:0/3132456830 shutdown_connections 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f7304645700 1 -- 172.21.15.19:0/3132456830 wait complete. 2023-10-03T10:16:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.333+0000 7f5707449700 1 -- 172.21.15.19:0/1879774324 shutdown_connections 2023-10-03T10:16:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 Processor -- start 2023-10-03T10:16:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f5707449700 1 -- 172.21.15.19:0/1879774324 wait complete. 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 -- start start 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc122630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 0x7f72fc122b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 0x7f72fc1230b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc123b00 con 0x7f72fc09e410 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc1260b0 con 0x7f72fc09d6f0 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.335+0000 7f7304645700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc133090 con 0x7f72fc09e000 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7302be2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 0x7f72fc1230b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7302be2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 0x7f72fc1230b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58790/0 (socket says 172.21.15.19:58790) 2023-10-03T10:16:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7302be2700 1 -- 172.21.15.19:0/2682936903 learned_addr learned my addr 172.21.15.19:0/2682936903 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f5707449700 1 Processor -- start 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f5707449700 1 -- start start 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 0x7f72fc122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f73023e1700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc122630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 -- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 msgr2=0x7f72fc122630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc122630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 -- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 msgr2=0x7f72fc1230b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 0x7f72fc1230b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.336+0000 7f7301be0700 1 -- 172.21.15.19:0/2682936903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec009550 con 0x7f72fc09e000 2023-10-03T10:16:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 0x7f5700126e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 0x7f5700127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a12d0 0x7f57001278a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570012a6c0 con 0x7f57000a09c0 2023-10-03T10:16:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5700128210 con 0x7f57000a12d0 2023-10-03T10:16:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f5707449700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f570012ad60 con 0x7f570009d5c0 2023-10-03T10:16:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f7301be0700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 0x7f72fc122b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f72ec016000 tx=0x7f72ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57051e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 0x7f5700126e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 0x7f5700127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57051e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 0x7f5700126e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50444/0 (socket says 172.21.15.19:50444) 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57051e5700 1 -- 172.21.15.19:0/2590592963 learned_addr learned my addr 172.21.15.19:0/2590592963 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57059e6700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a12d0 0x7f57001278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 -- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 msgr2=0x7f5700126e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 0x7f5700126e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 -- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a12d0 msgr2=0x7f57001278a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a12d0 0x7f57001278a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 -- 172.21.15.19:0/2590592963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8009a70 con 0x7f57000a09c0 2023-10-03T10:16:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.337+0000 7f57049e4700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 0x7f5700127360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f57000a2b20 tx=0x7f56f000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.338+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec004450 con 0x7f72fc09e000 2023-10-03T10:16:19.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.338+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0045b0 con 0x7f72fc09e000 2023-10-03T10:16:19.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.338+0000 7f7304645700 1 -- 172.21.15.19:0/2682936903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0726e0 con 0x7f72fc09e000 2023-10-03T10:16:19.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.338+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0038c0 con 0x7f72fc09e000 2023-10-03T10:16:19.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.338+0000 7f7304645700 1 -- 172.21.15.19:0/2682936903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc09c760 con 0x7f72fc09e000 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.339+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72ec003a20 con 0x7f72fc09e000 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.339+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72ec040bc0 con 0x7f72fc09e000 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.339+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d80052e0 con 0x7f72fc09e000 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.340+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0004c80 con 0x7f57000a09c0 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.340+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0004e00 con 0x7f57000a09c0 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.340+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0007310 con 0x7f57000a09c0 2023-10-03T10:16:19.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.340+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570012a120 con 0x7f57000a09c0 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.341+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5700128a60 con 0x7f57000a09c0 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.341+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56f0007470 con 0x7f57000a09c0 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.342+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56f0040b90 con 0x7f57000a09c0 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.342+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5700071e20 con 0x7f57000a09c0 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.344+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72ec022390 con 0x7f72fc09e000 2023-10-03T10:16:19.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.347+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56f0044060 con 0x7f57000a09c0 2023-10-03T10:16:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.383+0000 7fd650729700 1 Processor -- start 2023-10-03T10:16:19.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.383+0000 7fd650729700 1 -- start start 2023-10-03T10:16:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd650729700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd64809f410 0x7fd648136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd650729700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd650729700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd648070940 con 0x7fd64809e930 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd650729700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64806fd60 con 0x7fd648136fe0 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd650729700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64806fa80 con 0x7fd64809f410 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41534/0 (socket says 172.21.15.19:41534) 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 -- 172.21.15.19:0/4083648823 learned_addr learned my addr 172.21.15.19:0/4083648823 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64dcc4700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd64809f410 0x7fd648136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 -- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd64809f410 msgr2=0x7fd648136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd64809f410 0x7fd648136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.384+0000 7fd64ecc6700 1 -- 172.21.15.19:0/4083648823 >> v1:172.21.15.19:6789/0 conn(0x7fd64809e930 legacy=0x7fd64809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:19.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.385+0000 7fd64ecc6700 1 -- 172.21.15.19:0/4083648823 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64809fb60 con 0x7fd648136fe0 2023-10-03T10:16:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.385+0000 7fd64ecc6700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd640009e80 tx=0x7fd64000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faf0203ae9eb5597 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.385+0000 7fd64d4c3700 1 -- 172.21.15.19:0/4083648823 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000e070 con 0x7fd648136fe0 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.385+0000 7fd64d4c3700 1 -- 172.21.15.19:0/4083648823 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd640003a20 con 0x7fd648136fe0 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.385+0000 7fd64d4c3700 1 -- 172.21.15.19:0/4083648823 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640003dd0 con 0x7fd648136fe0 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 -- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 msgr2=0x7fd6481393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd640009e80 tx=0x7fd64000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 -- 172.21.15.19:0/4083648823 shutdown_connections 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648136fe0 0x7fd6481393c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 --2- 172.21.15.19:0/4083648823 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd64809f410 0x7fd648136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 -- 172.21.15.19:0/4083648823 >> 172.21.15.19:0/4083648823 conn(0x7fd6480a4210 msgr2=0x7fd6480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 -- 172.21.15.19:0/4083648823 shutdown_connections 2023-10-03T10:16:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.386+0000 7fd650729700 1 -- 172.21.15.19:0/4083648823 wait complete. 2023-10-03T10:16:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.387+0000 7fd650729700 1 Processor -- start 2023-10-03T10:16:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.387+0000 7fd650729700 1 -- start start 2023-10-03T10:16:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 0x7fd6481272a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 0x7fd6481277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648136fe0 0x7fd648127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd648129f60 con 0x7fd64809f410 2023-10-03T10:16:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd648128700 con 0x7fd64809e930 2023-10-03T10:16:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd650729700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd648128da0 con 0x7fd648136fe0 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd64dcc4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 0x7fd6481277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd64dcc4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 0x7fd6481277e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58802/0 (socket says 172.21.15.19:58802) 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd64dcc4700 1 -- 172.21.15.19:0/2792165506 learned_addr learned my addr 172.21.15.19:0/2792165506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd64e4c5700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 0x7fd6481272a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.388+0000 7fd64ecc6700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648136fe0 0x7fd648127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 -- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648136fe0 msgr2=0x7fd648127d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648136fe0 0x7fd648127d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 -- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 msgr2=0x7fd6481277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 0x7fd6481277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 -- 172.21.15.19:0/2792165506 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009b30 con 0x7fd64809e930 2023-10-03T10:16:19.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd64e4c5700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 0x7fd6481272a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b3c0 tx=0x7fd64400b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011620 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6440117a0 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6480a2f40 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644011b50 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.389+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd648129380 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.390+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd644011cb0 con 0x7fd64809e930 2023-10-03T10:16:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.390+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd64403f2a0 con 0x7fd64809e930 2023-10-03T10:16:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.390+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64806bc90 con 0x7fd64809e930 2023-10-03T10:16:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.396+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd644015080 con 0x7fd64809e930 2023-10-03T10:16:19.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.516+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcdac005590 con 0x7fcdcc06e570 2023-10-03T10:16:19.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.517+0000 7fcdc97fa700 1 -- 172.21.15.19:0/1022612370 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcdc0015030 con 0x7fcdcc06e570 2023-10-03T10:16:19.517 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:19.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 msgr2=0x7fcdcc134780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0000c00 tx=0x7fcdc0004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 shutdown_connections 2023-10-03T10:16:19.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcdcc1389f0 0x7fcdcc138e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcdcc06e570 0x7fcdcc134780 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 --2- 172.21.15.19:0/1022612370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcdcc06ee80 0x7fcdcc134cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 >> 172.21.15.19:0/1022612370 conn(0x7fcdcc0a2aa0 msgr2=0x7fcdcc0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 shutdown_connections 2023-10-03T10:16:19.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.519+0000 7fcdd2c80700 1 -- 172.21.15.19:0/1022612370 wait complete. 2023-10-03T10:16:19.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:19.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.558+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57000747f0 con 0x7f57000a09c0 2023-10-03T10:16:19.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.558+0000 7f56f5ffb700 1 -- 172.21.15.19:0/2590592963 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56f000ce30 con 0x7f57000a09c0 2023-10-03T10:16:19.558 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:19.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 msgr2=0x7f5700127360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 0x7f5700127360 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f57000a2b20 tx=0x7f56f000c790 comp rx=0 tx=0).stop 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 shutdown_connections 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57000a12d0 0x7f57001278a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f570009d5c0 0x7f5700126e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 --2- 172.21.15.19:0/2590592963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57000a09c0 0x7f5700127360 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 >> 172.21.15.19:0/2590592963 conn(0x7f57000a2fe0 msgr2=0x7f570006da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 shutdown_connections 2023-10-03T10:16:19.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.560+0000 7f5707449700 1 -- 172.21.15.19:0/2590592963 wait complete. 2023-10-03T10:16:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.570+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72d8005590 con 0x7f72fc09e000 2023-10-03T10:16:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.571+0000 7f72f2ffd700 1 -- 172.21.15.19:0/2682936903 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72ec015020 con 0x7f72fc09e000 2023-10-03T10:16:19.570 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 msgr2=0x7f72fc122b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 0x7f72fc122b70 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f72ec016000 tx=0x7f72ec004750 comp rx=0 tx=0).stop 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 shutdown_connections 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72fc09e410 0x7f72fc1230b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72fc09d6f0 0x7f72fc122630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 --2- 172.21.15.19:0/2682936903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72fc09e000 0x7f72fc122b70 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 >> 172.21.15.19:0/2682936903 conn(0x7f72fc066f50 msgr2=0x7f72fc06efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 shutdown_connections 2023-10-03T10:16:19.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.573+0000 7f72f0ff9700 1 -- 172.21.15.19:0/2682936903 wait complete. 2023-10-03T10:16:19.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:19.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:19.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.605+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd648074ea0 con 0x7fd64809e930 2023-10-03T10:16:19.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.605+0000 7fd63effd700 1 -- 172.21.15.19:0/2792165506 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd6440202b0 con 0x7fd64809e930 2023-10-03T10:16:19.605 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:19.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 msgr2=0x7fd6481272a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 0x7fd6481272a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd64400b3c0 tx=0x7fd64400b6d0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 shutdown_connections 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648136fe0 0x7fd648127d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd64809e930 0x7fd6481272a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 --2- 172.21.15.19:0/2792165506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd64809f410 0x7fd6481277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 >> 172.21.15.19:0/2792165506 conn(0x7fd6480a4210 msgr2=0x7fd6481365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 shutdown_connections 2023-10-03T10:16:19.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:19.607+0000 7fd650729700 1 -- 172.21.15.19:0/2792165506 wait complete. 2023-10-03T10:16:19.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:20.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:20.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:20.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:20.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.696+0000 7fcd5abdc700 1 Processor -- start 2023-10-03T10:16:20.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.696+0000 7fcd5abdc700 1 -- start start 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd5abdc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd5409e1d0 0x7fcd54135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd5abdc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 0x7fcd54138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd5abdc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5409f130 con 0x7fcd5409d6f0 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd5abdc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5409f520 con 0x7fcd5409e1d0 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd5abdc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5409e930 con 0x7fcd54135e50 2023-10-03T10:16:20.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd53fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd5409e1d0 0x7fcd54135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd58978700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd5409d6f0 0x7fcd5409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34430/0 (socket says 172.21.15.19:34430) 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd58978700 1 -- 172.21.15.19:0/2391160015 learned_addr learned my addr 172.21.15.19:0/2391160015 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.697+0000 7fcd59179700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 0x7fcd54138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd537fe700 1 -- 172.21.15.19:0/2391160015 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693701549 0 0) 0x7fcd5409f130 con 0x7fcd5409d6f0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd537fe700 1 -- 172.21.15.19:0/2391160015 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd440035b0 con 0x7fcd5409d6f0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd53fff700 1 -- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 msgr2=0x7fcd54138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 0x7fcd54138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd53fff700 1 -- 172.21.15.19:0/2391160015 >> v1:172.21.15.19:6789/0 conn(0x7fcd5409d6f0 legacy=0x7fcd5409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd53fff700 1 -- 172.21.15.19:0/2391160015 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5409b2d0 con 0x7fcd5409e1d0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd59179700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 0x7fcd54138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd54135910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009840 tx=0x7fcd40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab357057d5f23e3f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd537fe700 1 -- 172.21.15.19:0/2391160015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40004230 con 0x7fcd5409e1d0 2023-10-03T10:16:20.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd537fe700 1 -- 172.21.15.19:0/2391160015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40004390 con 0x7fcd5409e1d0 2023-10-03T10:16:20.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.698+0000 7fcd537fe700 1 -- 172.21.15.19:0/2391160015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400036a0 con 0x7fcd5409e1d0 2023-10-03T10:16:20.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.699+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 msgr2=0x7fcd54135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.699+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd54135910 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009840 tx=0x7fcd40009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.699+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2391160015 shutdown_connections 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.699+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd54135e50 0x7fcd54138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.699+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2391160015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd54135910 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.700+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2391160015 >> 172.21.15.19:0/2391160015 conn(0x7fcd54066f50 msgr2=0x7fcd5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.700+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2391160015 shutdown_connections 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.700+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2391160015 wait complete. 2023-10-03T10:16:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.701+0000 7fcd5abdc700 1 Processor -- start 2023-10-03T10:16:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.701+0000 7fcd5abdc700 1 -- start start 2023-10-03T10:16:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 0x7fcd54120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd541206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54123130 con 0x7fcd5409e1d0 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd541321d0 con 0x7fcd54135e50 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd5abdc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5411fd90 con 0x7fcd5409d6f0 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.702+0000 7fcd59179700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd59179700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41548/0 (socket says 172.21.15.19:41548) 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd59179700 1 -- 172.21.15.19:0/2191128144 learned_addr learned my addr 172.21.15.19:0/2191128144 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd58978700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 0x7fcd54120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd541206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 -- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 msgr2=0x7fcd54120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 0x7fcd54120180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 -- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 msgr2=0x7fcd541c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 -- 172.21.15.19:0/2191128144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c009a70 con 0x7fcd5409e1d0 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd58978700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 0x7fcd54120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd59179700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.703+0000 7fcd53fff700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd541206c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcd40013000 tx=0x7fcd40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.704+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40003c30 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.704+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd40003d90 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.704+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40011870 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.704+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd400094a0 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.704+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd54072630 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.705+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd40018040 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.705+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5409c760 con 0x7fcd5409e1d0 2023-10-03T10:16:20.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.705+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd4003fd70 con 0x7fcd5409e1d0 2023-10-03T10:16:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.714+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd4001a400 con 0x7fcd5409e1d0 2023-10-03T10:16:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.741+0000 7f7cc8129700 1 Processor -- start 2023-10-03T10:16:20.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.741+0000 7f7cc8129700 1 -- start start 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc8129700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 0x7f7cc0136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc8129700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc8129700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc009ece0 con 0x7f7cc006a770 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc8129700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc006b640 con 0x7f7cc0136d80 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc8129700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc009e760 con 0x7f7cc006b250 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc66c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc66c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58820/0 (socket says 172.21.15.19:58820) 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc66c6700 1 -- 172.21.15.19:0/1374642736 learned_addr learned my addr 172.21.15.19:0/1374642736 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.742+0000 7f7cc56c4700 1 --2- 172.21.15.19:0/1374642736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 0x7f7cc0136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc56c4700 1 -- 172.21.15.19:0/1374642736 >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 msgr2=0x7f7cc0139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc56c4700 1 --2- 172.21.15.19:0/1374642736 >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc56c4700 1 -- 172.21.15.19:0/1374642736 >> v1:172.21.15.19:6789/0 conn(0x7f7cc006a770 legacy=0x7f7cc006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc56c4700 1 -- 172.21.15.19:0/1374642736 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc009e040 con 0x7f7cc006b250 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc66c6700 1 --2- 172.21.15.19:0/1374642736 >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc56c4700 1 --2- 172.21.15.19:0/1374642736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 0x7f7cc0136840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009840 tx=0x7f7cb0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb09333de5e4eaad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc4ec3700 1 -- 172.21.15.19:0/1374642736 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0011830 con 0x7f7cc006b250 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc4ec3700 1 -- 172.21.15.19:0/1374642736 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0011990 con 0x7f7cc006b250 2023-10-03T10:16:20.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.743+0000 7f7cc4ec3700 1 -- 172.21.15.19:0/1374642736 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0011d20 con 0x7f7cc006b250 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 -- 172.21.15.19:0/1374642736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 msgr2=0x7f7cc0136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 --2- 172.21.15.19:0/1374642736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 0x7f7cc0136840 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009840 tx=0x7f7cb0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 -- 172.21.15.19:0/1374642736 shutdown_connections 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 --2- 172.21.15.19:0/1374642736 >> v2:172.21.15.19:3300/0 conn(0x7f7cc0136d80 0x7f7cc0139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 --2- 172.21.15.19:0/1374642736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc006b250 0x7f7cc0136840 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 -- 172.21.15.19:0/1374642736 >> 172.21.15.19:0/1374642736 conn(0x7f7cc0066f50 msgr2=0x7f7cc009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 -- 172.21.15.19:0/1374642736 shutdown_connections 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.744+0000 7f7cc8129700 1 -- 172.21.15.19:0/1374642736 wait complete. 2023-10-03T10:16:20.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.745+0000 7f7cc8129700 1 Processor -- start 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.745+0000 7f7cc8129700 1 -- start start 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cc006a770 0x7f7cc011d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 0x7f7cc011d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc011cd20 con 0x7f7cc006b250 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc006e8e0 con 0x7f7cc006a770 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc8129700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0071e60 con 0x7f7cc0136d80 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50514/0 (socket says 172.21.15.19:50514) 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 -- 172.21.15.19:0/920593031 learned_addr learned my addr 172.21.15.19:0/920593031 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc56c4700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 0x7f7cc011d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 -- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cc006a770 msgr2=0x7f7cc011d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cc006a770 0x7f7cc011d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 -- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 msgr2=0x7f7cc011d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 0x7f7cc011d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc66c6700 1 -- 172.21.15.19:0/920593031 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009b30 con 0x7f7cc0136d80 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.746+0000 7f7cc56c4700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 0x7f7cc011d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cc66c6700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800efc0 tx=0x7f7cb800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb800cb30 con 0x7f7cc0136d80 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb800f040 con 0x7f7cc0136d80 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8014480 con 0x7f7cc0136d80 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb00094a0 con 0x7f7cc0136d80 2023-10-03T10:16:20.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.747+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc011da80 con 0x7f7cc0136d80 2023-10-03T10:16:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.748+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cb80145e0 con 0x7f7cc0136d80 2023-10-03T10:16:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.748+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7cb803fcf0 con 0x7f7cc0136d80 2023-10-03T10:16:20.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.748+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0074ea0 con 0x7f7cc0136d80 2023-10-03T10:16:20.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.754+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7cb801d410 con 0x7f7cc0136d80 2023-10-03T10:16:20.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.793+0000 7fb5cadb5700 1 Processor -- start 2023-10-03T10:16:20.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.793+0000 7fb5cadb5700 1 -- start start 2023-10-03T10:16:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5cadb5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb5c41337f0 0x7fb5c4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5cadb5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5cadb5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c406b990 con 0x7fb5c4133420 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5cadb5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c409b0e0 con 0x7fb5c41337f0 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5cadb5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4133c20 con 0x7fb5c4138dc0 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41570/0 (socket says 172.21.15.19:41570) 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 -- 172.21.15.19:0/1059719721 learned_addr learned my addr 172.21.15.19:0/1059719721 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 -- 172.21.15.19:0/1059719721 >> v2:172.21.15.19:3300/0 conn(0x7fb5c41337f0 msgr2=0x7fb5c4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 --2- 172.21.15.19:0/1059719721 >> v2:172.21.15.19:3300/0 conn(0x7fb5c41337f0 0x7fb5c4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 -- 172.21.15.19:0/1059719721 >> v1:172.21.15.19:6789/0 conn(0x7fb5c4133420 legacy=0x7fb5c4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.794+0000 7fb5c9352700 1 -- 172.21.15.19:0/1059719721 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40a0590 con 0x7fb5c4138dc0 2023-10-03T10:16:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.795+0000 7fb5c9352700 1 --2- 172.21.15.19:0/1059719721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009e50 tx=0x7fb5bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d983b0ab4397b41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.795+0000 7fb5c37fe700 1 -- 172.21.15.19:0/1059719721 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc00e070 con 0x7fb5c4138dc0 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.795+0000 7fb5c37fe700 1 -- 172.21.15.19:0/1059719721 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc003a20 con 0x7fb5c4138dc0 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.795+0000 7fb5c37fe700 1 -- 172.21.15.19:0/1059719721 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc003dd0 con 0x7fb5c4138dc0 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 -- 172.21.15.19:0/1059719721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 msgr2=0x7fb5c413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/1059719721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009e50 tx=0x7fb5bc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:20.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 -- 172.21.15.19:0/1059719721 shutdown_connections 2023-10-03T10:16:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/1059719721 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c413b1a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/1059719721 >> v2:172.21.15.19:3300/0 conn(0x7fb5c41337f0 0x7fb5c4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 -- 172.21.15.19:0/1059719721 >> 172.21.15.19:0/1059719721 conn(0x7fb5c40a4210 msgr2=0x7fb5c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 -- 172.21.15.19:0/1059719721 shutdown_connections 2023-10-03T10:16:20.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.796+0000 7fb5cadb5700 1 -- 172.21.15.19:0/1059719721 wait complete. 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 Processor -- start 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 -- start start 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4133420 0x7fb5c40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c4071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4072430 con 0x7fb5c4133420 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c409d9b0 con 0x7fb5c4138dc0 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.797+0000 7fb5cadb5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c41388a0 con 0x7fb5c41337f0 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c8b51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4133420 0x7fb5c40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50524/0 (socket says 172.21.15.19:50524) 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c9352700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c4071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 -- 172.21.15.19:0/2710963272 learned_addr learned my addr 172.21.15.19:0/2710963272 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 -- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 msgr2=0x7fb5c4071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c4071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 -- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4133420 msgr2=0x7fb5c40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4133420 0x7fb5c40709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 -- 172.21.15.19:0/2710963272 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009b30 con 0x7fb5c41337f0 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c9352700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.798+0000 7fb5c3fff700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000b560 tx=0x7fb5b000b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.799+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0011830 con 0x7fb5c41337f0 2023-10-03T10:16:20.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.799+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b00119b0 con 0x7fb5c41337f0 2023-10-03T10:16:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.799+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0011d60 con 0x7fb5c41337f0 2023-10-03T10:16:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.799+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c409cb60 con 0x7fb5c41337f0 2023-10-03T10:16:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.799+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c409dcf0 con 0x7fb5c41337f0 2023-10-03T10:16:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.800+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5b001a400 con 0x7fb5c41337f0 2023-10-03T10:16:20.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.800+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c409c8a0 con 0x7fb5c41337f0 2023-10-03T10:16:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.800+0000 7f2ac85fb700 1 Processor -- start 2023-10-03T10:16:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.800+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5b003f770 con 0x7fb5c41337f0 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.800+0000 7f2ac85fb700 1 -- start start 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac85fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac85fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac009e560 0x7f2ac013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac85fb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac006f720 con 0x7f2ac01341d0 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac85fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0070c80 con 0x7f2ac009e560 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac85fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac006fce0 con 0x7f2ac01338c0 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac6397700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac6397700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50526/0 (socket says 172.21.15.19:50526) 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.801+0000 7f2ac6397700 1 -- 172.21.15.19:0/223258135 learned_addr learned my addr 172.21.15.19:0/223258135 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6b98700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac009e560 0x7f2ac013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6397700 1 -- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac009e560 msgr2=0x7f2ac013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6397700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac009e560 0x7f2ac013b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6397700 1 -- 172.21.15.19:0/223258135 >> v1:172.21.15.19:6789/0 conn(0x7f2ac01341d0 legacy=0x7f2ac009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6397700 1 -- 172.21.15.19:0/223258135 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac01336a0 con 0x7f2ac01338c0 2023-10-03T10:16:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.802+0000 7f2ac6397700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009920 tx=0x7f2abc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c464186ffd96174 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.805+0000 7f2ac5395700 1 -- 172.21.15.19:0/223258135 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ba60 con 0x7f2ac01338c0 2023-10-03T10:16:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.805+0000 7f2ac5395700 1 -- 172.21.15.19:0/223258135 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00bbc0 con 0x7f2ac01338c0 2023-10-03T10:16:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.805+0000 7f2ac5395700 1 -- 172.21.15.19:0/223258135 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc009e70 con 0x7f2ac01338c0 2023-10-03T10:16:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5b000f8d0 con 0x7fb5c41337f0 2023-10-03T10:16:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 -- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 msgr2=0x7f2ac0133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2abc009920 tx=0x7f2abc009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 -- 172.21.15.19:0/223258135 shutdown_connections 2023-10-03T10:16:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac009e560 0x7f2ac013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/223258135 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac0133c90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 -- 172.21.15.19:0/223258135 >> 172.21.15.19:0/223258135 conn(0x7f2ac00a2aa0 msgr2=0x7f2ac00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 -- 172.21.15.19:0/223258135 shutdown_connections 2023-10-03T10:16:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.806+0000 7f2ac85fb700 1 -- 172.21.15.19:0/223258135 wait complete. 2023-10-03T10:16:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.808+0000 7f2ac85fb700 1 Processor -- start 2023-10-03T10:16:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.808+0000 7f2ac85fb700 1 -- start start 2023-10-03T10:16:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ac009e560 0x7f2ac011f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac01341d0 0x7f2ac0120370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0130f10 con 0x7f2ac009e560 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0130ce0 con 0x7f2ac01341d0 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac85fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01227c0 con 0x7f2ac01338c0 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50534/0 (socket says 172.21.15.19:50534) 2023-10-03T10:16:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 -- 172.21.15.19:0/1016369670 learned_addr learned my addr 172.21.15.19:0/1016369670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 -- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac01341d0 msgr2=0x7f2ac0120370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac01341d0 0x7f2ac0120370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 -- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ac009e560 msgr2=0x7f2ac011f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ac009e560 0x7f2ac011f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.809+0000 7f2ac5b96700 1 -- 172.21.15.19:0/1016369670 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc009550 con 0x7f2ac01338c0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ac5b96700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c4b0 tx=0x7f2ab000c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00052d0 con 0x7f2ac01338c0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab0005430 con 0x7f2ac01338c0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab00038c0 con 0x7f2ac01338c0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac0122ed0 con 0x7f2ac01338c0 2023-10-03T10:16:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.810+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac0122300 con 0x7f2ac01338c0 2023-10-03T10:16:20.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.812+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2ab0003a20 con 0x7f2ac01338c0 2023-10-03T10:16:20.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.812+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac0123370 con 0x7f2ac01338c0 2023-10-03T10:16:20.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.812+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2ab003ea80 con 0x7f2ac01338c0 2023-10-03T10:16:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.817+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2ab0011590 con 0x7f2ac01338c0 2023-10-03T10:16:20.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.964+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd5404ea50 con 0x7fcd5409e1d0 2023-10-03T10:16:20.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.964+0000 7fcd517fa700 1 -- 172.21.15.19:0/2191128144 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd40029120 con 0x7fcd5409e1d0 2023-10-03T10:16:20.964 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.966+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 msgr2=0x7fcd541206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.966+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd541206c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fcd40013000 tx=0x7fcd40004750 comp rx=0 tx=0).stop 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 shutdown_connections 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd54135e50 0x7fcd541c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd5409d6f0 0x7fcd54120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 --2- 172.21.15.19:0/2191128144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd5409e1d0 0x7fcd541206c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 >> 172.21.15.19:0/2191128144 conn(0x7fcd54066f50 msgr2=0x7fcd540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 shutdown_connections 2023-10-03T10:16:20.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.967+0000 7fcd5abdc700 1 -- 172.21.15.19:0/2191128144 wait complete. 2023-10-03T10:16:20.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.980+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cc011fda0 con 0x7f7cc0136d80 2023-10-03T10:16:20.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:20.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.981+0000 7f7cb67fc700 1 -- 172.21.15.19:0/920593031 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7cb802c090 con 0x7f7cc0136d80 2023-10-03T10:16:20.982 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:20.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 msgr2=0x7f7cc01c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:20.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800efc0 tx=0x7f7cb800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 shutdown_connections 2023-10-03T10:16:20.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cc0136d80 0x7f7cc01c6070 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cc006a770 0x7f7cc011d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 --2- 172.21.15.19:0/920593031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cc006b250 0x7f7cc011d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:20.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 >> 172.21.15.19:0/920593031 conn(0x7f7cc0066f50 msgr2=0x7f7cc0135d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:20.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 shutdown_connections 2023-10-03T10:16:20.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:20.983+0000 7f7cc8129700 1 -- 172.21.15.19:0/920593031 wait complete. 2023-10-03T10:16:20.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.013+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb5c409c690 con 0x7fb5c41337f0 2023-10-03T10:16:21.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.013+0000 7fb5c17fa700 1 -- 172.21.15.19:0/2710963272 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5c409c690 con 0x7fb5c41337f0 2023-10-03T10:16:21.013 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 msgr2=0x7fb5c4070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000b560 tx=0x7fb5b000b870 comp rx=0 tx=0).stop 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 shutdown_connections 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5c4138dc0 0x7fb5c4071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4133420 0x7fb5c40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 --2- 172.21.15.19:0/2710963272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5c41337f0 0x7fb5c4070ee0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 >> 172.21.15.19:0/2710963272 conn(0x7fb5c40a4210 msgr2=0x7fb5c40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 shutdown_connections 2023-10-03T10:16:21.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.016+0000 7fb5cadb5700 1 -- 172.21.15.19:0/2710963272 wait complete. 2023-10-03T10:16:21.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.025+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ac0122ed0 con 0x7f2ac01338c0 2023-10-03T10:16:21.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.025+0000 7f2ab6ffd700 1 -- 172.21.15.19:0/1016369670 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ac0122ed0 con 0x7f2ac01338c0 2023-10-03T10:16:21.025 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 msgr2=0x7f2ac011fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000c4b0 tx=0x7f2ab000c870 comp rx=0 tx=0).stop 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 shutdown_connections 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2ac01341d0 0x7f2ac0120370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ac009e560 0x7f2ac011f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 --2- 172.21.15.19:0/1016369670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2ac01338c0 0x7f2ac011fe30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:21.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 >> 172.21.15.19:0/1016369670 conn(0x7f2ac00a2aa0 msgr2=0x7f2ac009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:21.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 shutdown_connections 2023-10-03T10:16:21.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:21.028+0000 7f2ac85fb700 1 -- 172.21.15.19:0/1016369670 wait complete. 2023-10-03T10:16:21.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:21.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:21.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:21.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:22.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:22.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:22.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.150+0000 7fa279246700 1 Processor -- start 2023-10-03T10:16:22.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.150+0000 7fa279246700 1 -- start start 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa279246700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa279246700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa279246700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27409f130 con 0x7fa27409e410 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa279246700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27409f520 con 0x7fa27409d6f0 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa279246700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa27409e930 con 0x7fa27409e000 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50542/0 (socket says 172.21.15.19:50542) 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa272d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 -- 172.21.15.19:0/3362693587 learned_addr learned my addr 172.21.15.19:0/3362693587 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27359e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa27409e410 0x7fa274130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34468/0 (socket says 172.21.15.19:34468) 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 -- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 msgr2=0x7fa27409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 --2- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 -- 172.21.15.19:0/3362693587 >> v1:172.21.15.19:6789/0 conn(0x7fa27409e410 legacy=0x7fa274130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.151+0000 7fa27259c700 1 -- 172.21.15.19:0/3362693587 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27409b2d0 con 0x7fa27409e000 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.152+0000 7fa27259c700 1 --2- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa26800dd80 tx=0x7fa26800f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cdf32e3cf97d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.152+0000 7fa271d9b700 1 -- 172.21.15.19:0/3362693587 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268012070 con 0x7fa27409e000 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.152+0000 7fa271d9b700 1 -- 172.21.15.19:0/3362693587 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800fae0 con 0x7fa27409e000 2023-10-03T10:16:22.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.152+0000 7fa271d9b700 1 -- 172.21.15.19:0/3362693587 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800fe70 con 0x7fa27409e000 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 -- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 msgr2=0x7fa274130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 --2- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa26800dd80 tx=0x7fa26800f330 comp rx=0 tx=0).stop 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 -- 172.21.15.19:0/3362693587 shutdown_connections 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 --2- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 --2- 172.21.15.19:0/3362693587 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e000 0x7fa274130660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 -- 172.21.15.19:0/3362693587 >> 172.21.15.19:0/3362693587 conn(0x7fa274066f50 msgr2=0x7fa27409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 -- 172.21.15.19:0/3362693587 shutdown_connections 2023-10-03T10:16:22.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.153+0000 7fa279246700 1 -- 172.21.15.19:0/3362693587 wait complete. 2023-10-03T10:16:22.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 Processor -- start 2023-10-03T10:16:22.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 -- start start 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa27409e000 0x7fa27411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 0x7fa27411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27411f480 con 0x7fa27409e000 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa274130390 con 0x7fa27409d6f0 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.155+0000 7fa279246700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2741201e0 con 0x7fa27409e410 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa272d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 0x7fa27411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa272d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41606/0 (socket says 172.21.15.19:41606) 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa272d9d700 1 -- 172.21.15.19:0/3730386025 learned_addr learned my addr 172.21.15.19:0/3730386025 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27259c700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa27409e000 0x7fa27411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 -- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 msgr2=0x7fa27411dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 -- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa27409e000 msgr2=0x7fa27411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa27409e000 0x7fa27411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 -- 172.21.15.19:0/3730386025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26800da00 con 0x7fa27409e410 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa272d9d700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.156+0000 7fa27359e700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 0x7fa27411ea30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00cb40 tx=0x7fa26c00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.157+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00a9a0 con 0x7fa27409e410 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.157+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c00ab00 con 0x7fa27409e410 2023-10-03T10:16:22.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.157+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00ae70 con 0x7fa27409e410 2023-10-03T10:16:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.157+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2741217f0 con 0x7fa27409e410 2023-10-03T10:16:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.157+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27409c700 con 0x7fa27409e410 2023-10-03T10:16:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.158+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa26c007070 con 0x7fa27409e410 2023-10-03T10:16:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.158+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa26c03f2f0 con 0x7fa27409e410 2023-10-03T10:16:22.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.158+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa274074ea0 con 0x7fa27409e410 2023-10-03T10:16:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.168+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa26c017020 con 0x7fa27409e410 2023-10-03T10:16:22.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.185+0000 7f06dfdb2700 1 Processor -- start 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.185+0000 7f06dfdb2700 1 -- start start 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dfdb2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06d809e1d0 0x7f06d8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dfdb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dfdb2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d809f130 con 0x7f06d809d6f0 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dfdb2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d809f520 con 0x7f06d809e1d0 2023-10-03T10:16:22.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dfdb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06d809e930 con 0x7f06d8135e50 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06ddb4e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f06d809d6f0 0x7f06d809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34474/0 (socket says 172.21.15.19:34474) 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dd34d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06d809e1d0 0x7f06d8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06ddb4e700 1 -- 172.21.15.19:0/3361913448 learned_addr learned my addr 172.21.15.19:0/3361913448 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06de34f700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dd34d700 1 -- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 msgr2=0x7f06d8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dd34d700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dd34d700 1 -- 172.21.15.19:0/3361913448 >> v1:172.21.15.19:6789/0 conn(0x7f06d809d6f0 legacy=0x7f06d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.186+0000 7f06dd34d700 1 -- 172.21.15.19:0/3361913448 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d809b2d0 con 0x7f06d809e1d0 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.187+0000 7f06dd34d700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809e1d0 0x7f06d8135910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009840 tx=0x7f06c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223fe6ab99831681 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.187+0000 7f06dcb4c700 1 -- 172.21.15.19:0/3361913448 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8011830 con 0x7f06d809e1d0 2023-10-03T10:16:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.187+0000 7f06dcb4c700 1 -- 172.21.15.19:0/3361913448 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c8011990 con 0x7f06d809e1d0 2023-10-03T10:16:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.187+0000 7f06dcb4c700 1 -- 172.21.15.19:0/3361913448 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8011d20 con 0x7f06d809e1d0 2023-10-03T10:16:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809e1d0 msgr2=0x7f06d8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809e1d0 0x7f06d8135910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009840 tx=0x7f06c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3361913448 shutdown_connections 2023-10-03T10:16:22.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3361913448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809e1d0 0x7f06d8135910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3361913448 >> 172.21.15.19:0/3361913448 conn(0x7f06d8066f50 msgr2=0x7f06d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3361913448 shutdown_connections 2023-10-03T10:16:22.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.188+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3361913448 wait complete. 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 Processor -- start 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 -- start start 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06d809e1d0 0x7f06d8132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d81332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d81199b0 con 0x7f06d809d6f0 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8134a90 con 0x7f06d809e1d0 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.189+0000 7f06dfdb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06d8135b10 con 0x7f06d8135e50 2023-10-03T10:16:22.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58896/0 (socket says 172.21.15.19:58896) 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06de34f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d81332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 -- 172.21.15.19:0/3771403367 learned_addr learned my addr 172.21.15.19:0/3771403367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 -- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 msgr2=0x7f06d81332e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d81332e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 -- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06d809e1d0 msgr2=0x7f06d8132da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06d809e1d0 0x7f06d8132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 -- 172.21.15.19:0/3771403367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80094a0 con 0x7f06d809d6f0 2023-10-03T10:16:22.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06de34f700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d81332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.190+0000 7f06ddb4e700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c480 tx=0x7f06d400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.191+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4005d70 con 0x7f06d809d6f0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.191+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d809c700 con 0x7f06d809d6f0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.191+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40070d0 con 0x7f06d809d6f0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.191+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d4007440 con 0x7f06d809d6f0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.191+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d80a22b0 con 0x7f06d809d6f0 2023-10-03T10:16:22.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.192+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d8071700 con 0x7f06d809d6f0 2023-10-03T10:16:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.193+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f06d40075a0 con 0x7f06d809d6f0 2023-10-03T10:16:22.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.193+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f06d403ec40 con 0x7f06d809d6f0 2023-10-03T10:16:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.202+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06d4019b40 con 0x7f06d809d6f0 2023-10-03T10:16:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 Processor -- start 2023-10-03T10:16:22.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 -- start start 2023-10-03T10:16:22.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f68480a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6848138d80 0x7f684813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68480a2a70 con 0x7f68480a0a30 2023-10-03T10:16:22.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68480a01d0 con 0x7f6848138d80 2023-10-03T10:16:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f684d4ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f684809e2b0 con 0x7f684809d630 2023-10-03T10:16:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.224+0000 7f68467fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f68480a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68467fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f68480a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50582/0 (socket says 172.21.15.19:50582) 2023-10-03T10:16:22.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68467fc700 1 -- 172.21.15.19:0/1803508440 learned_addr learned my addr 172.21.15.19:0/1803508440 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68477fe700 1 --2- 172.21.15.19:0/1803508440 >> v2:172.21.15.19:3300/0 conn(0x7f6848138d80 0x7f684813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f6845ffb700 1 -- 172.21.15.19:0/1803508440 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413770797 0 0) 0x7f68480a2a70 con 0x7f68480a0a30 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f6845ffb700 1 -- 172.21.15.19:0/1803508440 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68300035b0 con 0x7f68480a0a30 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68477fe700 1 -- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 msgr2=0x7f68480a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68477fe700 1 --2- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f68480a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68477fe700 1 -- 172.21.15.19:0/1803508440 >> v1:172.21.15.19:6789/0 conn(0x7f68480a0a30 legacy=0x7f68480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.225+0000 7f68477fe700 1 -- 172.21.15.19:0/1803508440 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684809dc50 con 0x7f6848138d80 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.226+0000 7f68477fe700 1 --2- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6848138d80 0x7f684813b160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6840009d90 tx=0x7f684000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ffdb65893e2a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.226+0000 7f6845ffb700 1 -- 172.21.15.19:0/1803508440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684000e070 con 0x7f6848138d80 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.226+0000 7f6845ffb700 1 -- 172.21.15.19:0/1803508440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684000bb20 con 0x7f6848138d80 2023-10-03T10:16:22.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.226+0000 7f6845ffb700 1 -- 172.21.15.19:0/1803508440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840012430 con 0x7f6848138d80 2023-10-03T10:16:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 -- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6848138d80 msgr2=0x7f684813b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 --2- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6848138d80 0x7f684813b160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f6840009d90 tx=0x7f684000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 -- 172.21.15.19:0/1803508440 shutdown_connections 2023-10-03T10:16:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 --2- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6848138d80 0x7f684813b160 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 --2- 172.21.15.19:0/1803508440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f68480a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 -- 172.21.15.19:0/1803508440 >> 172.21.15.19:0/1803508440 conn(0x7f68480a3050 msgr2=0x7f68480a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 -- 172.21.15.19:0/1803508440 shutdown_connections 2023-10-03T10:16:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.227+0000 7f684d4ef700 1 -- 172.21.15.19:0/1803508440 wait complete. 2023-10-03T10:16:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.228+0000 7f684d4ef700 1 Processor -- start 2023-10-03T10:16:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.228+0000 7f684d4ef700 1 -- start start 2023-10-03T10:16:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 0x7f6848120ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6848138d80 0x7f6848120ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6848122130 con 0x7f68480a0a30 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6848123380 con 0x7f6848138d80 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f684d4ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6848123d60 con 0x7f684809d630 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f6846ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f6846ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50590/0 (socket says 172.21.15.19:50590) 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f6846ffd700 1 -- 172.21.15.19:0/663974557 learned_addr learned my addr 172.21.15.19:0/663974557 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f68467fc700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 0x7f6848120ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.229+0000 7f68477fe700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6848138d80 0x7f6848120ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 -- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 msgr2=0x7f6848120570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 -- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6848138d80 msgr2=0x7f6848120ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6848138d80 0x7f6848120ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 -- 172.21.15.19:0/663974557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6840009a70 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f6846ffd700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f68467fc700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 0x7f6848120ab0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e8e0 tx=0x7f683c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c013680 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683c0137e0 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68481237d0 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683c013b70 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.230+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68480a0410 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.231+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68480747f0 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.231+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f683c013cd0 con 0x7f68480a0a30 2023-10-03T10:16:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.232+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f683c0409f0 con 0x7f68480a0a30 2023-10-03T10:16:22.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.236+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f683c011d90 con 0x7f68480a0a30 2023-10-03T10:16:22.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.239+0000 7f6c860c8700 1 Processor -- start 2023-10-03T10:16:22.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.239+0000 7f6c860c8700 1 -- start start 2023-10-03T10:16:22.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c860c8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097fa0 0x7f6c80098370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c860c8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c860c8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c80096bc0 con 0x7f6c80131dc0 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c860c8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80097b50 con 0x7f6c80131450 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c860c8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80132230 con 0x7f6c80097fa0 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41630/0 (socket says 172.21.15.19:41630) 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c7ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6c80131dc0 0x7f6c80138780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34494/0 (socket says 172.21.15.19:34494) 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c7effd700 1 -- 172.21.15.19:0/960248812 learned_addr learned my addr 172.21.15.19:0/960248812 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.240+0000 7f6c7e7fc700 1 -- 172.21.15.19:0/960248812 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462701927 0 0) 0x7f6c80096bc0 con 0x7f6c80131dc0 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7e7fc700 1 -- 172.21.15.19:0/960248812 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c680035b0 con 0x7f6c80131dc0 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7effd700 1 -- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097fa0 msgr2=0x7f6c80098370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:22.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7effd700 1 --2- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097fa0 0x7f6c80098370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7effd700 1 -- 172.21.15.19:0/960248812 >> v1:172.21.15.19:6789/0 conn(0x7f6c80131dc0 legacy=0x7f6c80138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7effd700 1 -- 172.21.15.19:0/960248812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800968e0 con 0x7f6c80131450 2023-10-03T10:16:22.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7effd700 1 --2- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009920 tx=0x7f6c74009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66e638118d3edb5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7e7fc700 1 -- 172.21.15.19:0/960248812 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74011830 con 0x7f6c80131450 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7e7fc700 1 -- 172.21.15.19:0/960248812 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74011990 con 0x7f6c80131450 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.241+0000 7f6c7e7fc700 1 -- 172.21.15.19:0/960248812 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74011d20 con 0x7f6c80131450 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 -- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 msgr2=0x7f6c80131880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 --2- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c74009920 tx=0x7f6c74009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 -- 172.21.15.19:0/960248812 shutdown_connections 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 --2- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80097fa0 0x7f6c80098370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 --2- 172.21.15.19:0/960248812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80131450 0x7f6c80131880 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 -- 172.21.15.19:0/960248812 >> 172.21.15.19:0/960248812 conn(0x7f6c800a2360 msgr2=0x7f6c800a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 -- 172.21.15.19:0/960248812 shutdown_connections 2023-10-03T10:16:22.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.242+0000 7f6c860c8700 1 -- 172.21.15.19:0/960248812 wait complete. 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.244+0000 7f6c860c8700 1 Processor -- start 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.244+0000 7f6c860c8700 1 -- start start 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097fa0 0x7f6c80127240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 0x7f6c80127cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80098bb0 con 0x7f6c80131450 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80128840 con 0x7f6c80097fa0 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c860c8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8009da60 con 0x7f6c80131dc0 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58918/0 (socket says 172.21.15.19:58918) 2023-10-03T10:16:22.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 -- 172.21.15.19:0/3151318967 learned_addr learned my addr 172.21.15.19:0/3151318967 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:22.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 0x7f6c80127cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7f7fe700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097fa0 0x7f6c80127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 -- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 msgr2=0x7f6c80127cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 0x7f6c80127cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 -- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097fa0 msgr2=0x7f6c80127240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097fa0 0x7f6c80127240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.245+0000 7f6c7effd700 1 -- 172.21.15.19:0/3151318967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009550 con 0x7f6c80131450 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c7ffff700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 0x7f6c80127cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c7effd700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c00 tx=0x7f6c74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74004380 con 0x7f6c80131450 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7401f070 con 0x7f6c80131450 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c860c8700 1 -- 172.21.15.19:0/3151318967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c80129320 con 0x7f6c80131450 2023-10-03T10:16:22.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c740036a0 con 0x7f6c80131450 2023-10-03T10:16:22.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.246+0000 7f6c860c8700 1 -- 172.21.15.19:0/3151318967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80071960 con 0x7f6c80131450 2023-10-03T10:16:22.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.247+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c580052e0 con 0x7f6c80131450 2023-10-03T10:16:22.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.248+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c74021030 con 0x7f6c80131450 2023-10-03T10:16:22.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.248+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c74040a20 con 0x7f6c80131450 2023-10-03T10:16:22.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.253+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c740199a0 con 0x7f6c80131450 2023-10-03T10:16:22.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.421+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa274121320 con 0x7fa27409e410 2023-10-03T10:16:22.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.422+0000 7fa25b7fe700 1 -- 172.21.15.19:0/3730386025 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa26c0196d0 con 0x7fa27409e410 2023-10-03T10:16:22.422 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:22.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 msgr2=0x7fa27411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 0x7fa27411ea30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa26c00cb40 tx=0x7fa26c00ce50 comp rx=0 tx=0).stop 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 shutdown_connections 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa27409e410 0x7fa27411ea30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa27409d6f0 0x7fa27411dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 --2- 172.21.15.19:0/3730386025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa27409e000 0x7fa27411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 >> 172.21.15.19:0/3730386025 conn(0x7fa274066f50 msgr2=0x7fa2740a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.424+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 shutdown_connections 2023-10-03T10:16:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.425+0000 7fa279246700 1 -- 172.21.15.19:0/3730386025 wait complete. 2023-10-03T10:16:22.438 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:22.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.443+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6848123a00 con 0x7f68480a0a30 2023-10-03T10:16:22.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.443+0000 7f682f7fe700 1 -- 172.21.15.19:0/663974557 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f683c017030 con 0x7f68480a0a30 2023-10-03T10:16:22.443 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:22.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 msgr2=0x7f6848120ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 0x7f6848120ab0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f683c00e8e0 tx=0x7f683c00ebf0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 shutdown_connections 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6848138d80 0x7f6848120ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f684809d630 0x7f6848120570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 --2- 172.21.15.19:0/663974557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68480a0a30 0x7f6848120ab0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.445+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 >> 172.21.15.19:0/663974557 conn(0x7f68480a3050 msgr2=0x7f684809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.446+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 shutdown_connections 2023-10-03T10:16:22.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.446+0000 7f684d4ef700 1 -- 172.21.15.19:0/663974557 wait complete. 2023-10-03T10:16:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.453+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06d8074ea0 con 0x7f06d809d6f0 2023-10-03T10:16:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.453+0000 7f06ce7fc700 1 -- 172.21.15.19:0/3771403367 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06d4017070 con 0x7f06d809d6f0 2023-10-03T10:16:22.453 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 msgr2=0x7f06d8132860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f06d400c480 tx=0x7f06d400c790 comp rx=0 tx=0).stop 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 shutdown_connections 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06d8135e50 0x7f06d81332e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06d809d6f0 0x7f06d8132860 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 --2- 172.21.15.19:0/3771403367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06d809e1d0 0x7f06d8132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 >> 172.21.15.19:0/3771403367 conn(0x7f06d8066f50 msgr2=0x7f06d806e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 shutdown_connections 2023-10-03T10:16:22.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.456+0000 7f06dfdb2700 1 -- 172.21.15.19:0/3771403367 wait complete. 2023-10-03T10:16:22.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:22.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.462+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c58005590 con 0x7f6c80131450 2023-10-03T10:16:22.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.462+0000 7f6c67fff700 1 -- 172.21.15.19:0/3151318967 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c74015090 con 0x7f6c80131450 2023-10-03T10:16:22.462 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.464+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 msgr2=0x7f6c80127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.464+0000 7f6c65ffb700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c00 tx=0x7f6c74004750 comp rx=0 tx=0).stop 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 shutdown_connections 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c80131dc0 0x7f6c80127cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c80097fa0 0x7f6c80127240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 --2- 172.21.15.19:0/3151318967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c80131450 0x7f6c80127780 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 >> 172.21.15.19:0/3151318967 conn(0x7f6c800a2360 msgr2=0x7f6c8012f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 shutdown_connections 2023-10-03T10:16:22.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:22.465+0000 7f6c65ffb700 1 -- 172.21.15.19:0/3151318967 wait complete. 2023-10-03T10:16:22.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:22.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:23.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:23.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:23.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:23.479 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.612+0000 7f6e6f513700 1 Processor -- start 2023-10-03T10:16:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.612+0000 7f6e6f513700 1 -- start start 2023-10-03T10:16:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6f513700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e68071b40 0x7f6e68130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6f513700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68130d80 0x7f6e68133c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6f513700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e68099ef0 con 0x7f6e68130960 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6f513700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e68099500 con 0x7f6e68071b40 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6f513700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68099c10 con 0x7f6e68130d80 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6d2af700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e68071b40 0x7f6e68130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6caae700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6e68130960 0x7f6e68133570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34496/0 (socket says 172.21.15.19:34496) 2023-10-03T10:16:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6caae700 1 -- 172.21.15.19:0/2885054737 learned_addr learned my addr 172.21.15.19:0/2885054737 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6d2af700 1 -- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68130d80 msgr2=0x7f6e68133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6d2af700 1 --2- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68130d80 0x7f6e68133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.613+0000 7f6e6d2af700 1 -- 172.21.15.19:0/2885054737 >> v1:172.21.15.19:6789/0 conn(0x7f6e68130960 legacy=0x7f6e68133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.614+0000 7f6e6d2af700 1 -- 172.21.15.19:0/2885054737 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6809e370 con 0x7f6e68071b40 2023-10-03T10:16:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.614+0000 7f6e6d2af700 1 --2- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68071b40 0x7f6e68130420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009840 tx=0x7f6e64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a33cd20952d8cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.614+0000 7f6e5ffff700 1 -- 172.21.15.19:0/2885054737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011830 con 0x7f6e68071b40 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.615+0000 7f6e5ffff700 1 -- 172.21.15.19:0/2885054737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64011990 con 0x7f6e68071b40 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.615+0000 7f6e5ffff700 1 -- 172.21.15.19:0/2885054737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64011d20 con 0x7f6e68071b40 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.615+0000 7f6e6f513700 1 -- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68071b40 msgr2=0x7f6e68130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.615+0000 7f6e6f513700 1 --2- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68071b40 0x7f6e68130420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009840 tx=0x7f6e64009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.616+0000 7f6e6f513700 1 -- 172.21.15.19:0/2885054737 shutdown_connections 2023-10-03T10:16:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.616+0000 7f6e6f513700 1 --2- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68130d80 0x7f6e68133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.616+0000 7f6e6f513700 1 --2- 172.21.15.19:0/2885054737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68071b40 0x7f6e68130420 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.616+0000 7f6e6f513700 1 -- 172.21.15.19:0/2885054737 >> 172.21.15.19:0/2885054737 conn(0x7f6e6809e7e0 msgr2=0x7f6e6809ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.617+0000 7f6e6f513700 1 -- 172.21.15.19:0/2885054737 shutdown_connections 2023-10-03T10:16:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.617+0000 7f6e6f513700 1 -- 172.21.15.19:0/2885054737 wait complete. 2023-10-03T10:16:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 Processor -- start 2023-10-03T10:16:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 -- start start 2023-10-03T10:16:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e68130960 0x7f6e68126e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68127340 0x7f6e681277e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6812a1c0 con 0x7f6e68127340 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68129040 con 0x7f6e68071b40 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6f513700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68129300 con 0x7f6e68130960 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6d2af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6d2af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41644/0 (socket says 172.21.15.19:41644) 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.618+0000 7f6e6d2af700 1 -- 172.21.15.19:0/3340713845 learned_addr learned my addr 172.21.15.19:0/3340713845 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6dab0700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68127340 0x7f6e681277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 -- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e68130960 msgr2=0x7f6e68126e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e68130960 0x7f6e68126e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 -- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68127340 msgr2=0x7f6e681277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68127340 0x7f6e681277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 -- 172.21.15.19:0/3340713845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640094a0 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6d2af700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000c00 tx=0x7f6e64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640036a0 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6401f070 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6813a980 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.619+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64003a40 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.620+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e681c87b0 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.621+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e64003ba0 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.621+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e64021070 con 0x7f6e68071b40 2023-10-03T10:16:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.621+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680747f0 con 0x7f6e68071b40 2023-10-03T10:16:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.626+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e64015030 con 0x7f6e68071b40 2023-10-03T10:16:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.639+0000 7fb86dbbd700 1 Processor -- start 2023-10-03T10:16:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.639+0000 7fb86dbbd700 1 -- start start 2023-10-03T10:16:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb86dbbd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb868136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb86dbbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb8681393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb86dbbd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb868070940 con 0x7fb86809e930 2023-10-03T10:16:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb86dbbd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86806fd60 con 0x7fb86809f410 2023-10-03T10:16:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb86dbbd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86806fa80 con 0x7fb868136fe0 2023-10-03T10:16:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb8677fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb86809e930 0x7fb86809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34500/0 (socket says 172.21.15.19:34500) 2023-10-03T10:16:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb8677fe700 1 -- 172.21.15.19:0/301093504 learned_addr learned my addr 172.21.15.19:0/301093504 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb867fff700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb8681393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.640+0000 7fb866ffd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb868136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb8667fc700 1 -- 172.21.15.19:0/301093504 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069841105 0 0) 0x7fb868070940 con 0x7fb86809e930 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb8667fc700 1 -- 172.21.15.19:0/301093504 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8500035b0 con 0x7fb86809e930 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb866ffd700 1 -- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 msgr2=0x7fb8681393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb866ffd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb8681393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb866ffd700 1 -- 172.21.15.19:0/301093504 >> v1:172.21.15.19:6789/0 conn(0x7fb86809e930 legacy=0x7fb86809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb866ffd700 1 -- 172.21.15.19:0/301093504 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86809fb60 con 0x7fb86809f410 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb867fff700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb8681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb866ffd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb868136aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d53279e4751581d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb8667fc700 1 -- 172.21.15.19:0/301093504 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011830 con 0x7fb86809f410 2023-10-03T10:16:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb8667fc700 1 -- 172.21.15.19:0/301093504 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c011990 con 0x7fb86809f410 2023-10-03T10:16:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.641+0000 7fb8667fc700 1 -- 172.21.15.19:0/301093504 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c011d20 con 0x7fb86809f410 2023-10-03T10:16:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.642+0000 7fb86dbbd700 1 -- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 msgr2=0x7fb868136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.642+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb868136aa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009870 tx=0x7fb85c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 -- 172.21.15.19:0/301093504 shutdown_connections 2023-10-03T10:16:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb8681393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/301093504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb868136aa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 -- 172.21.15.19:0/301093504 >> 172.21.15.19:0/301093504 conn(0x7fb8680a4210 msgr2=0x7fb8680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 -- 172.21.15.19:0/301093504 shutdown_connections 2023-10-03T10:16:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.646+0000 7fb86dbbd700 1 -- 172.21.15.19:0/301093504 wait complete. 2023-10-03T10:16:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 Processor -- start 2023-10-03T10:16:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 -- start start 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86809e930 0x7fb86811b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb86811b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8680a32d0 con 0x7fb86809e930 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb868071d20 con 0x7fb86809f410 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.647+0000 7fb86dbbd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb86811e590 con 0x7fb868136fe0 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50638/0 (socket says 172.21.15.19:50638) 2023-10-03T10:16:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 -- 172.21.15.19:0/1266029409 learned_addr learned my addr 172.21.15.19:0/1266029409 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb8677fe700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86809e930 0x7fb86811b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb866ffd700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb86811b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 -- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 msgr2=0x7fb86811b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb86811b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 -- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86809e930 msgr2=0x7fb86811b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86809e930 0x7fb86811b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 -- 172.21.15.19:0/1266029409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb860009a70 con 0x7fb868136fe0 2023-10-03T10:16:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb867fff700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb86000efc0 tx=0x7fb86000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.648+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000cd40 con 0x7fb868136fe0 2023-10-03T10:16:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.649+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86000f040 con 0x7fb868136fe0 2023-10-03T10:16:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.649+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c0094a0 con 0x7fb868136fe0 2023-10-03T10:16:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.649+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000cea0 con 0x7fb868136fe0 2023-10-03T10:16:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.649+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86811d6e0 con 0x7fb868136fe0 2023-10-03T10:16:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.649+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb8600146a0 con 0x7fb868136fe0 2023-10-03T10:16:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.650+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb8600403c0 con 0x7fb868136fe0 2023-10-03T10:16:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.650+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb868074ea0 con 0x7fb868136fe0 2023-10-03T10:16:23.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.652+0000 7ff958d2d700 1 Processor -- start 2023-10-03T10:16:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 -- start start 2023-10-03T10:16:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff95412fc70 0x7ff954130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 0x7ff95412c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 0x7ff954136940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff954130580 con 0x7ff95412fc70 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95409be70 con 0x7ff95412c060 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff958d2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95409a6e0 con 0x7ff95412c970 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff951d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 0x7ff95412c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff951d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 0x7ff95412c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41656/0 (socket says 172.21.15.19:41656) 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff951d9b700 1 -- 172.21.15.19:0/3789933804 learned_addr learned my addr 172.21.15.19:0/3789933804 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.653+0000 7ff952d9d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 0x7ff954136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff95259c700 1 --2- 172.21.15.19:0/3789933804 >> v2:172.21.15.19:3300/0 conn(0x7ff95412fc70 0x7ff954130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 -- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 msgr2=0x7ff95412c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 0x7ff95412c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 -- 172.21.15.19:0/3789933804 >> v2:172.21.15.19:3300/0 conn(0x7ff95412fc70 msgr2=0x7ff954130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 --2- 172.21.15.19:0/3789933804 >> v2:172.21.15.19:3300/0 conn(0x7ff95412fc70 0x7ff954130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 -- 172.21.15.19:0/3789933804 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95409ac80 con 0x7ff95412c970 2023-10-03T10:16:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.654+0000 7ff952d9d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 0x7ff954136940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009d90 tx=0x7ff94c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21d7c0332fba5b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.657+0000 7fe4281a6700 1 Processor -- start 2023-10-03T10:16:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.657+0000 7fe4281a6700 1 -- start start 2023-10-03T10:16:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe4281a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe4281a6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe420131fe0 0x7fe42006e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe4281a6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe420131510 con 0x7fe42006ea90 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe4281a6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe420099e70 con 0x7fe420131fe0 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe4281a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe420066680 con 0x7fe4201316d0 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50658/0 (socket says 172.21.15.19:50658) 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 -- 172.21.15.19:0/135688509 learned_addr learned my addr 172.21.15.19:0/135688509 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425741700 1 --2- 172.21.15.19:0/135688509 >> v2:172.21.15.19:3300/0 conn(0x7fe420131fe0 0x7fe42006e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb860018020 con 0x7fb868136fe0 2023-10-03T10:16:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7ff95159a700 1 -- 172.21.15.19:0/3789933804 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c00e070 con 0x7ff95412c970 2023-10-03T10:16:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7ff95159a700 1 -- 172.21.15.19:0/3789933804 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c00bb20 con 0x7ff95412c970 2023-10-03T10:16:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7ff95159a700 1 -- 172.21.15.19:0/3789933804 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c012430 con 0x7ff95412c970 2023-10-03T10:16:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 -- 172.21.15.19:0/135688509 >> v2:172.21.15.19:3300/0 conn(0x7fe420131fe0 msgr2=0x7fe42006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 --2- 172.21.15.19:0/135688509 >> v2:172.21.15.19:3300/0 conn(0x7fe420131fe0 0x7fe42006e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 -- 172.21.15.19:0/135688509 >> v1:172.21.15.19:6789/0 conn(0x7fe42006ea90 legacy=0x7fe420138730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 -- 172.21.15.19:0/135688509 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42009ee00 con 0x7fe4201316d0 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.658+0000 7fe425f42700 1 --2- 172.21.15.19:0/135688509 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0098f0 tx=0x7fe41c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c7686fe415d33d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7fe424f40700 1 -- 172.21.15.19:0/135688509 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c004230 con 0x7fe4201316d0 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7fe424f40700 1 -- 172.21.15.19:0/135688509 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c004390 con 0x7fe4201316d0 2023-10-03T10:16:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7fe424f40700 1 -- 172.21.15.19:0/135688509 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c0036a0 con 0x7fe4201316d0 2023-10-03T10:16:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7ff958d2d700 1 -- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 msgr2=0x7ff954136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7ff958d2d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 0x7ff954136940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff94c009d90 tx=0x7ff94c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7fe4281a6700 1 -- 172.21.15.19:0/135688509 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 msgr2=0x7fe420131aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.659+0000 7fe4281a6700 1 --2- 172.21.15.19:0/135688509 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0098f0 tx=0x7fe41c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 -- 172.21.15.19:0/3789933804 shutdown_connections 2023-10-03T10:16:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 -- 172.21.15.19:0/135688509 shutdown_connections 2023-10-03T10:16:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 --2- 172.21.15.19:0/135688509 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4201316d0 0x7fe420131aa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c970 0x7ff954136940 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 --2- 172.21.15.19:0/3789933804 >> v2:172.21.15.19:3300/0 conn(0x7ff95412fc70 0x7ff954130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 --2- 172.21.15.19:0/3789933804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412c060 0x7ff95412c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 --2- 172.21.15.19:0/135688509 >> v2:172.21.15.19:3300/0 conn(0x7fe420131fe0 0x7fe42006e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 -- 172.21.15.19:0/135688509 >> 172.21.15.19:0/135688509 conn(0x7fe4200a2aa0 msgr2=0x7fe4200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 -- 172.21.15.19:0/3789933804 >> 172.21.15.19:0/3789933804 conn(0x7ff95409e7e0 msgr2=0x7ff95409ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 -- 172.21.15.19:0/3789933804 shutdown_connections 2023-10-03T10:16:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 -- 172.21.15.19:0/135688509 shutdown_connections 2023-10-03T10:16:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7ff958d2d700 1 -- 172.21.15.19:0/3789933804 wait complete. 2023-10-03T10:16:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.660+0000 7fe4281a6700 1 -- 172.21.15.19:0/135688509 wait complete. 2023-10-03T10:16:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 Processor -- start 2023-10-03T10:16:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 -- start start 2023-10-03T10:16:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 0x7fe42012ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 0x7fe42012d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 0x7fe42012d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42012bc20 con 0x7fe4201316d0 2023-10-03T10:16:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42012be00 con 0x7fe420131fe0 2023-10-03T10:16:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7fe4281a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe42009a0b0 con 0x7fe42006ea90 2023-10-03T10:16:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.661+0000 7ff958d2d700 1 Processor -- start 2023-10-03T10:16:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 0x7fe42012ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe426743700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 0x7fe42012d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe426743700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 0x7fe42012d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41658/0 (socket says 172.21.15.19:41658) 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe426743700 1 -- 172.21.15.19:0/3732840859 learned_addr learned my addr 172.21.15.19:0/3732840859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 0x7fe42012d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425f42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 0x7fe42012ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50670/0 (socket says 172.21.15.19:50670) 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 -- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 msgr2=0x7fe42012ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 0x7fe42012ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 -- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 msgr2=0x7fe42012d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 0x7fe42012d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 -- 172.21.15.19:0/3732840859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009550 con 0x7fe4201316d0 2023-10-03T10:16:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7fe425741700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 0x7fe42012d3f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe41000e900 tx=0x7fe41000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7ff958d2d700 1 -- start start 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7ff958d2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7ff958d2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff95412c970 0x7ff9540a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7ff958d2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412fc70 0x7ff9540a1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.662+0000 7ff958d2d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540a24d0 con 0x7ff95412c970 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff958d2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406f4d0 con 0x7ff95412fc70 2023-10-03T10:16:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff958d2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff95412b270 con 0x7ff95412c060 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50680/0 (socket says 172.21.15.19:50680) 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 -- 172.21.15.19:0/1053970802 learned_addr learned my addr 172.21.15.19:0/1053970802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff952d9d700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412fc70 0x7ff9540a1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 -- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412fc70 msgr2=0x7ff9540a1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412fc70 0x7ff9540a1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 -- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff95412c970 msgr2=0x7ff9540a1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff95412c970 0x7ff9540a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.663+0000 7ff95259c700 1 -- 172.21.15.19:0/1053970802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c009a70 con 0x7ff95412c060 2023-10-03T10:16:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000ee50 con 0x7fe4201316d0 2023-10-03T10:16:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff95259c700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b790 tx=0x7ff94400bb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000c850 con 0x7fe4201316d0 2023-10-03T10:16:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42013a870 con 0x7fe4201316d0 2023-10-03T10:16:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000cbc0 con 0x7fe4201316d0 2023-10-03T10:16:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42012c590 con 0x7fe4201316d0 2023-10-03T10:16:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944010040 con 0x7ff95412c060 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400dbc0 con 0x7ff95412c060 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944009760 con 0x7ff95412c060 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff954129e30 con 0x7ff95412c060 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.664+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95406d790 con 0x7ff95412c060 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.665+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe41000cd20 con 0x7fe4201316d0 2023-10-03T10:16:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.665+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe41003f770 con 0x7fe4201316d0 2023-10-03T10:16:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.666+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff944020460 con 0x7ff95412c060 2023-10-03T10:16:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.666+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff94403ff20 con 0x7ff95412c060 2023-10-03T10:16:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.666+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95406f070 con 0x7ff95412c060 2023-10-03T10:16:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.668+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420074ea0 con 0x7fe4201316d0 2023-10-03T10:16:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.672+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff944013700 con 0x7ff95412c060 2023-10-03T10:16:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.677+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe410021080 con 0x7fe4201316d0 2023-10-03T10:16:23.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.850+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6e6806b250 con 0x7f6e68071b40 2023-10-03T10:16:23.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.850+0000 7f6e5dffb700 1 -- 172.21.15.19:0/3340713845 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e64024380 con 0x7f6e68071b40 2023-10-03T10:16:23.850 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 msgr2=0x7f6e68129ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000c00 tx=0x7f6e64004750 comp rx=0 tx=0).stop 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 shutdown_connections 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e68127340 0x7f6e681277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e68071b40 0x7f6e68129ae0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 --2- 172.21.15.19:0/3340713845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e68130960 0x7f6e68126e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 >> 172.21.15.19:0/3340713845 conn(0x7f6e6809e7e0 msgr2=0x7f6e6809c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 shutdown_connections 2023-10-03T10:16:23.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.853+0000 7f6e6f513700 1 -- 172.21.15.19:0/3340713845 wait complete. 2023-10-03T10:16:23.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:23.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.871+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb86811e700 con 0x7fb868136fe0 2023-10-03T10:16:23.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.872+0000 7fb84ffff700 1 -- 172.21.15.19:0/1266029409 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb86002b090 con 0x7fb868136fe0 2023-10-03T10:16:23.872 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 msgr2=0x7fb86811bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb86000efc0 tx=0x7fb86000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 shutdown_connections 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb868136fe0 0x7fb86811bdb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb86809e930 0x7fb86811b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 --2- 172.21.15.19:0/1266029409 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb86809f410 0x7fb86811b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 >> 172.21.15.19:0/1266029409 conn(0x7fb8680a4210 msgr2=0x7fb86809d440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 shutdown_connections 2023-10-03T10:16:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.874+0000 7fb86dbbd700 1 -- 172.21.15.19:0/1266029409 wait complete. 2023-10-03T10:16:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.880+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff954099b30 con 0x7ff95412c060 2023-10-03T10:16:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.880+0000 7ff942ffd700 1 -- 172.21.15.19:0/1053970802 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff944015370 con 0x7ff95412c060 2023-10-03T10:16:23.880 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 msgr2=0x7ff9540a1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff94400b790 tx=0x7ff94400bb50 comp rx=0 tx=0).stop 2023-10-03T10:16:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 shutdown_connections 2023-10-03T10:16:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff95412fc70 0x7ff9540a1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff95412c060 0x7ff9540a1020 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 --2- 172.21.15.19:0/1053970802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff95412c970 0x7ff9540a1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 >> 172.21.15.19:0/1053970802 conn(0x7ff95409e7e0 msgr2=0x7ff95412e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 shutdown_connections 2023-10-03T10:16:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.883+0000 7ff958d2d700 1 -- 172.21.15.19:0/1053970802 wait complete. 2023-10-03T10:16:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.886+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe42006b9e0 con 0x7fe4201316d0 2023-10-03T10:16:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.887+0000 7fe4167fc700 1 -- 172.21.15.19:0/3732840859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4100232f0 con 0x7fe4201316d0 2023-10-03T10:16:23.886 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 msgr2=0x7fe42012d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 0x7fe42012d3f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe41000e900 tx=0x7fe41000ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 shutdown_connections 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe420131fe0 0x7fe42012d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe42006ea90 0x7fe42012ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 --2- 172.21.15.19:0/3732840859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4201316d0 0x7fe42012d3f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 >> 172.21.15.19:0/3732840859 conn(0x7fe4200a2aa0 msgr2=0x7fe42006f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 shutdown_connections 2023-10-03T10:16:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:23.889+0000 7fe4281a6700 1 -- 172.21.15.19:0/3732840859 wait complete. 2023-10-03T10:16:23.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:23.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:23.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:24.868 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:24.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:24.900 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:24.904 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:25.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.026+0000 7f3d366be700 1 Processor -- start 2023-10-03T10:16:25.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.026+0000 7f3d366be700 1 -- start start 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d366be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d366be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d30139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d366be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3009ece0 con 0x7f3d3006b080 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d366be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3009e760 con 0x7f3d30131d10 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d366be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3009e040 con 0x7f3d3006a770 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50696/0 (socket says 172.21.15.19:50696) 2023-10-03T10:16:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3d3006b080 0x7f3d30131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34514/0 (socket says 172.21.15.19:34514) 2023-10-03T10:16:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 -- 172.21.15.19:0/1265800903 learned_addr learned my addr 172.21.15.19:0/1265800903 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d34c5b700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d30139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 -- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 msgr2=0x7f3d30139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d30139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 -- 172.21.15.19:0/1265800903 >> v1:172.21.15.19:6789/0 conn(0x7f3d3006b080 legacy=0x7f3d30131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.027+0000 7f3d2ffff700 1 -- 172.21.15.19:0/1265800903 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3009f630 con 0x7f3d3006a770 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.028+0000 7f3d2ffff700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009920 tx=0x7f3d20009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e528345bd088e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.028+0000 7f3d2effd700 1 -- 172.21.15.19:0/1265800903 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20011830 con 0x7f3d3006a770 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.028+0000 7f3d2effd700 1 -- 172.21.15.19:0/1265800903 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d20011990 con 0x7f3d3006a770 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.028+0000 7f3d2effd700 1 -- 172.21.15.19:0/1265800903 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20011d20 con 0x7f3d3006a770 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 -- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 msgr2=0x7f3d3006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009920 tx=0x7f3d20009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 -- 172.21.15.19:0/1265800903 shutdown_connections 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d30139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 --2- 172.21.15.19:0/1265800903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d3006ab40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 -- 172.21.15.19:0/1265800903 >> 172.21.15.19:0/1265800903 conn(0x7f3d30066f50 msgr2=0x7f3d3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 -- 172.21.15.19:0/1265800903 shutdown_connections 2023-10-03T10:16:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.029+0000 7f3d366be700 1 -- 172.21.15.19:0/1265800903 wait complete. 2023-10-03T10:16:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.030+0000 7f3d366be700 1 Processor -- start 2023-10-03T10:16:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.030+0000 7f3d366be700 1 -- start start 2023-10-03T10:16:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 0x7f3d301c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d301c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30125c10 con 0x7f3d3006b080 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30131370 con 0x7f3d30131d10 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d366be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d30125ed0 con 0x7f3d3006a770 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d34c5b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d301c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50712/0 (socket says 172.21.15.19:50712) 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d34c5b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d301c8ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41674/0 (socket says 172.21.15.19:41674) 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 -- 172.21.15.19:0/3414554366 learned_addr learned my addr 172.21.15.19:0/3414554366 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2f7fe700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 0x7f3d301c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 -- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 msgr2=0x7f3d301c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d301c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 -- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 msgr2=0x7f3d301c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 0x7f3d301c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2ffff700 1 -- 172.21.15.19:0/3414554366 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d20009550 con 0x7f3d3006a770 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.031+0000 7f3d2f7fe700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 0x7f3d301c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d2ffff700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000c00 tx=0x7f3d20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d20004450 con 0x7f3d3006a770 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200045b0 con 0x7f3d3006a770 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200038c0 con 0x7f3d3006a770 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d30126940 con 0x7f3d3006a770 2023-10-03T10:16:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.032+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3009c1b0 con 0x7f3d3006a770 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.033+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d20003a20 con 0x7f3d3006a770 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.033+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d20021030 con 0x7f3d3006a770 2023-10-03T10:16:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.034+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3009c1b0 con 0x7f3d3006a770 2023-10-03T10:16:25.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.039+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d3009c1b0 con 0x7f3d3006a770 2023-10-03T10:16:25.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.073+0000 7fe236869700 1 Processor -- start 2023-10-03T10:16:25.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.073+0000 7fe236869700 1 -- start start 2023-10-03T10:16:25.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe236869700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 0x7fe23009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe236869700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe236869700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23009d2f0 con 0x7fe230133f30 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe236869700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23009a810 con 0x7fe23009e000 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe236869700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe23009a470 con 0x7fe23009d6f0 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe234e06700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe230133f30 0x7fe23013ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34516/0 (socket says 172.21.15.19:34516) 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe234e06700 1 -- 172.21.15.19:0/797137172 learned_addr learned my addr 172.21.15.19:0/797137172 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.074+0000 7fe22ffff700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 0x7fe23009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22f7fe700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22effd700 1 -- 172.21.15.19:0/797137172 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42516507 0 0) 0x7fe23009d2f0 con 0x7fe230133f30 2023-10-03T10:16:25.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22effd700 1 -- 172.21.15.19:0/797137172 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2180035b0 con 0x7fe230133f30 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22ffff700 1 -- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 msgr2=0x7fe2301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22ffff700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22ffff700 1 -- 172.21.15.19:0/797137172 >> v1:172.21.15.19:6789/0 conn(0x7fe230133f30 legacy=0x7fe23013ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22ffff700 1 -- 172.21.15.19:0/797137172 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23009ec40 con 0x7fe23009d6f0 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7f53279a6700 1 Processor -- start 2023-10-03T10:16:25.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7fe22ffff700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 0x7fe23009dac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe220009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f24c53a31b8d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7fe22effd700 1 -- 172.21.15.19:0/797137172 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220011830 con 0x7fe23009d6f0 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.075+0000 7f53279a6700 1 -- start start 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7fe22effd700 1 -- 172.21.15.19:0/797137172 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe220011990 con 0x7fe23009d6f0 2023-10-03T10:16:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7fe22effd700 1 -- 172.21.15.19:0/797137172 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe220011d00 con 0x7fe23009d6f0 2023-10-03T10:16:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f53279a6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f532009e930 0x7f532009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f53279a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532009f240 0x7f532013c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f53279a6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532006c970 con 0x7f532013c930 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f53279a6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532006be00 con 0x7f532009e930 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f53279a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f532006d940 con 0x7f532009f240 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f5325742700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f532009e930 0x7f532009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f5325742700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f532009e930 0x7f532009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58988/0 (socket says 172.21.15.19:58988) 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f5325742700 1 -- 172.21.15.19:0/3742605536 learned_addr learned my addr 172.21.15.19:0/3742605536 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.076+0000 7f5324f41700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532009f240 0x7f532013c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5325742700 1 -- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532009f240 msgr2=0x7f532013c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5325742700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532009f240 0x7f532013c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5325742700 1 -- 172.21.15.19:0/3742605536 >> v1:172.21.15.19:6789/0 conn(0x7f532013c930 legacy=0x7f532013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5325742700 1 -- 172.21.15.19:0/3742605536 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532009aa60 con 0x7f532009e930 2023-10-03T10:16:25.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5325742700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009e930 0x7f532009ed00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f53100098f0 tx=0x7f5310009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5825f06464fc4b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 -- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 msgr2=0x7fe23009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 0x7fe23009dac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe220009870 tx=0x7fe220009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5317fff700 1 -- 172.21.15.19:0/3742605536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310004230 con 0x7f532009e930 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5317fff700 1 -- 172.21.15.19:0/3742605536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310004390 con 0x7f532009e930 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7f5317fff700 1 -- 172.21.15.19:0/3742605536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100036a0 con 0x7f532009e930 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 -- 172.21.15.19:0/797137172 shutdown_connections 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe23009d6f0 0x7fe23009dac0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 --2- 172.21.15.19:0/797137172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 -- 172.21.15.19:0/797137172 >> 172.21.15.19:0/797137172 conn(0x7fe230066f50 msgr2=0x7fe23009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 -- 172.21.15.19:0/797137172 shutdown_connections 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.077+0000 7fe236869700 1 -- 172.21.15.19:0/797137172 wait complete. 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 -- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009e930 msgr2=0x7f532009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009e930 0x7f532009ed00 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f53100098f0 tx=0x7f5310009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:25.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 -- 172.21.15.19:0/3742605536 shutdown_connections 2023-10-03T10:16:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009e930 0x7f532009ed00 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 --2- 172.21.15.19:0/3742605536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532009f240 0x7f532013c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 -- 172.21.15.19:0/3742605536 >> 172.21.15.19:0/3742605536 conn(0x7f53200a4210 msgr2=0x7f53200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 -- 172.21.15.19:0/3742605536 shutdown_connections 2023-10-03T10:16:25.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7f53279a6700 1 -- 172.21.15.19:0/3742605536 wait complete. 2023-10-03T10:16:25.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.078+0000 7fe236869700 1 Processor -- start 2023-10-03T10:16:25.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.079+0000 7fe236869700 1 -- start start 2023-10-03T10:16:25.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 0x7fe2301c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe230126160 con 0x7fe23009d6f0 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe230126f20 con 0x7fe23009e000 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe236869700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2300a1d00 con 0x7fe230133f30 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50724/0 (socket says 172.21.15.19:50724) 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 -- 172.21.15.19:0/4138399210 learned_addr learned my addr 172.21.15.19:0/4138399210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe22ffff700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 0x7fe2301c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7f53279a6700 1 Processor -- start 2023-10-03T10:16:25.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7f53279a6700 1 -- start start 2023-10-03T10:16:25.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 -- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 msgr2=0x7fe2301c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 -- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 msgr2=0x7fe2301c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 0x7fe2301c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 -- 172.21.15.19:0/4138399210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2200094a0 con 0x7fe230133f30 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe22ffff700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 0x7fe2301c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.080+0000 7fe234e06700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe22800cb70 tx=0x7fe22800cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22800ab10 con 0x7fe230133f30 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009f240 0x7f53201285f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532013c930 0x7f53201ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5320128b30 con 0x7f532009f240 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532013bee0 con 0x7f532009e930 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f53279a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5320129180 con 0x7f532013c930 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22800ac70 con 0x7fe230133f30 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7f76dd64d700 1 Processor -- start 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7f76dd64d700 1 -- start start 2023-10-03T10:16:25.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7f76dd64d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76dd64d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f76d809f240 0x7f76d81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23009c640 con 0x7fe230133f30 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe228012400 con 0x7fe230133f30 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe230124430 con 0x7fe230133f30 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe230074ea0 con 0x7fe230133f30 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe22801b3b0 con 0x7fe230133f30 2023-10-03T10:16:25.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe22803f9e0 con 0x7fe230133f30 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f5325742700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f5325742700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41702/0 (socket says 172.21.15.19:41702) 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f5325742700 1 -- 172.21.15.19:0/1789610766 learned_addr learned my addr 172.21.15.19:0/1789610766 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.081+0000 7f5325f43700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532013c930 0x7f53201ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 -- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532013c930 msgr2=0x7f53201ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532013c930 0x7f53201ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 -- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009f240 msgr2=0x7f53201285f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009f240 0x7f53201285f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 -- 172.21.15.19:0/1789610766 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5310009550 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5325742700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5310009130 tx=0x7f5310004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5310003e20 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5310011630 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f53279a6700 1 -- 172.21.15.19:0/1789610766 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53200a95a0 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.082+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53100119c0 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.083+0000 7f53279a6700 1 -- 172.21.15.19:0/1789610766 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53201293e0 con 0x7f532009e930 2023-10-03T10:16:25.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f80052e0 con 0x7f532009e930 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76dd64d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76dd64d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d8070940 con 0x7f76d809f240 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76dd64d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d806fd60 con 0x7f76d809e930 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76dd64d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d806fa80 con 0x7f76d809f650 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41718/0 (socket says 172.21.15.19:41718) 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.084+0000 7f76d6ffd700 1 -- 172.21.15.19:0/3588177694 learned_addr learned my addr 172.21.15.19:0/3588177694 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d67fc700 1 --2- 172.21.15.19:0/3588177694 >> v2:172.21.15.19:3300/0 conn(0x7f76d809f240 0x7f76d81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 -- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 msgr2=0x7f76d8131d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 --2- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d8131d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 -- 172.21.15.19:0/3588177694 >> v2:172.21.15.19:3300/0 conn(0x7f76d809f240 msgr2=0x7f76d81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 --2- 172.21.15.19:0/3588177694 >> v2:172.21.15.19:3300/0 conn(0x7f76d809f240 0x7f76d81317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 -- 172.21.15.19:0/3588177694 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d809fb60 con 0x7f76d809e930 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f531001b440 con 0x7f532009e930 2023-10-03T10:16:25.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5310040ff0 con 0x7f532009e930 2023-10-03T10:16:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.085+0000 7f76d6ffd700 1 --2- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0098f0 tx=0x7f76cc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0d816af1214cdc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.086+0000 7f76d5ffb700 1 -- 172.21.15.19:0/3588177694 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00b8a0 con 0x7f76d809e930 2023-10-03T10:16:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.086+0000 7f76d5ffb700 1 -- 172.21.15.19:0/3588177694 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00ba00 con 0x7f76d809e930 2023-10-03T10:16:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.086+0000 7f76d5ffb700 1 -- 172.21.15.19:0/3588177694 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc00bd90 con 0x7f76d809e930 2023-10-03T10:16:25.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 -- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 msgr2=0x7f76d809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 --2- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0098f0 tx=0x7f76cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 -- 172.21.15.19:0/3588177694 shutdown_connections 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 --2- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d809e930 0x7f76d809ed00 secure :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0098f0 tx=0x7f76cc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 --2- 172.21.15.19:0/3588177694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 --2- 172.21.15.19:0/3588177694 >> v2:172.21.15.19:3300/0 conn(0x7f76d809f240 0x7f76d81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 -- 172.21.15.19:0/3588177694 >> 172.21.15.19:0/3588177694 conn(0x7f76d80a4210 msgr2=0x7f76d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 -- 172.21.15.19:0/3588177694 shutdown_connections 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.087+0000 7f76dd64d700 1 -- 172.21.15.19:0/3588177694 wait complete. 2023-10-03T10:16:25.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.088+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2280113a0 con 0x7fe230133f30 2023-10-03T10:16:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.089+0000 7f76dd64d700 1 Processor -- start 2023-10-03T10:16:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.089+0000 7f76dd64d700 1 -- start start 2023-10-03T10:16:25.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d809f240 0x7f76d81a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 0x7f76d81cec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d81a7410 con 0x7f76d809f240 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d81a8cd0 con 0x7f76d81a5c30 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76dd64d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76d81a80a0 con 0x7f76d809f650 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50744/0 (socket says 172.21.15.19:50744) 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76d67fc700 1 -- 172.21.15.19:0/2261651771 learned_addr learned my addr 172.21.15.19:0/2261651771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.090+0000 7f76d77fe700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 0x7f76d81cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 -- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 msgr2=0x7f76d81a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 -- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d809f240 msgr2=0x7f76d81a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d809f240 0x7f76d81a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 -- 172.21.15.19:0/2261651771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009550 con 0x7f76d81a5c30 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d67fc700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.091+0000 7f76d77fe700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 0x7f76d81cec30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b3c0 tx=0x7f76c800b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011830 con 0x7f76d81a5c30 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c8011990 con 0x7f76d81a5c30 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d80a0190 con 0x7f76d81a5c30 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c8011d20 con 0x7f76d81a5c30 2023-10-03T10:16:25.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d81a6610 con 0x7f76d81a5c30 2023-10-03T10:16:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.093+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5310072750 con 0x7f532009e930 2023-10-03T10:16:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.094+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76c801a400 con 0x7f76d81a5c30 2023-10-03T10:16:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.094+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76c803f660 con 0x7f76d81a5c30 2023-10-03T10:16:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.094+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d8074ea0 con 0x7f76d81a5c30 2023-10-03T10:16:25.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.099+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f76c800be40 con 0x7f76d81a5c30 2023-10-03T10:16:25.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.280+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d3009c1b0 con 0x7f3d3006a770 2023-10-03T10:16:25.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.280+0000 7f3d2cff9700 1 -- 172.21.15.19:0/3414554366 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d3009c1b0 con 0x7f3d3006a770 2023-10-03T10:16:25.280 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 msgr2=0x7f3d301c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3d20000c00 tx=0x7f3d20004750 comp rx=0 tx=0).stop 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 shutdown_connections 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d30131d10 0x7f3d301c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d3006a770 0x7f3d301c8120 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 --2- 172.21.15.19:0/3414554366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d3006b080 0x7f3d301c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.283+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 >> 172.21.15.19:0/3414554366 conn(0x7f3d30066f50 msgr2=0x7f3d300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.284+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 shutdown_connections 2023-10-03T10:16:25.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.284+0000 7f3d366be700 1 -- 172.21.15.19:0/3414554366 wait complete. 2023-10-03T10:16:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.297+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe2301337e0 con 0x7fe230133f30 2023-10-03T10:16:25.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.297+0000 7fe22cff9700 1 -- 172.21.15.19:0/4138399210 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe228017030 con 0x7fe230133f30 2023-10-03T10:16:25.297 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:25.298 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 msgr2=0x7fe230122820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fe22800cb70 tx=0x7fe22800cf30 comp rx=0 tx=0).stop 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 shutdown_connections 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe230133f30 0x7fe230122820 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe23009d6f0 0x7fe2301c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 --2- 172.21.15.19:0/4138399210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe23009e000 0x7fe2301c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 >> 172.21.15.19:0/4138399210 conn(0x7fe230066f50 msgr2=0x7fe230070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 shutdown_connections 2023-10-03T10:16:25.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.300+0000 7fe236869700 1 -- 172.21.15.19:0/4138399210 wait complete. 2023-10-03T10:16:25.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.307+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f76d81a6dc0 con 0x7f76d81a5c30 2023-10-03T10:16:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.307+0000 7f76bf7fe700 1 -- 172.21.15.19:0/2261651771 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f76c8028020 con 0x7f76d81a5c30 2023-10-03T10:16:25.307 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 msgr2=0x7f76d81cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 0x7f76d81cec30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f76c800b3c0 tx=0x7f76c800b6d0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 shutdown_connections 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f76d81a5c30 0x7f76d81cec30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f76d809f240 0x7f76d81a51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 --2- 172.21.15.19:0/2261651771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f76d809f650 0x7f76d81a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 >> 172.21.15.19:0/2261651771 conn(0x7f76d80a4210 msgr2=0x7f76d81b9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 shutdown_connections 2023-10-03T10:16:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.310+0000 7f76dd64d700 1 -- 172.21.15.19:0/2261651771 wait complete. 2023-10-03T10:16:25.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:25.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:25.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.329+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52f8005590 con 0x7f532009e930 2023-10-03T10:16:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.329+0000 7f5315ffb700 1 -- 172.21.15.19:0/1789610766 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f531000b7f0 con 0x7f532009e930 2023-10-03T10:16:25.329 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:25.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 msgr2=0x7f53201280b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5310009130 tx=0x7f5310004750 comp rx=0 tx=0).stop 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 shutdown_connections 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f532013c930 0x7f53201ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f532009e930 0x7f53201280b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 --2- 172.21.15.19:0/1789610766 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f532009f240 0x7f53201285f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 >> 172.21.15.19:0/1789610766 conn(0x7f53200a4210 msgr2=0x7f532009d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 shutdown_connections 2023-10-03T10:16:25.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:25.331+0000 7f530b7fe700 1 -- 172.21.15.19:0/1789610766 wait complete. 2023-10-03T10:16:25.345 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:26.299 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:26.316 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:26.324 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:26.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.458+0000 7fe12f77e700 1 Processor -- start 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.458+0000 7fe12f77e700 1 -- start start 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12f77e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 0x7fe12809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12f77e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 0x7fe12813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12f77e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12809a810 con 0x7fe12809dc30 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12f77e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12806ab40 con 0x7fe12806a770 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12f77e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809ebc0 con 0x7fe12813d1f0 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12cd19700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe12809dc30 0x7fe12809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57724/0 (socket says 172.21.15.19:57724) 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12cd19700 1 -- 172.21.15.19:0/1218082497 learned_addr learned my addr 172.21.15.19:0/1218082497 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12d51a700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 0x7fe12809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12dd1b700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 0x7fe12813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12d51a700 1 -- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 msgr2=0x7fe12813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12d51a700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 0x7fe12813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe12d51a700 1 -- 172.21.15.19:0/1218082497 >> v1:172.21.15.19:6789/0 conn(0x7fe12809dc30 legacy=0x7fe12809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.459+0000 7fe11ffff700 1 -- 172.21.15.19:0/1218082497 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494452406 0 0) 0x7fe12809a810 con 0x7fe12809dc30 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe12d51a700 1 -- 172.21.15.19:0/1218082497 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12809e920 con 0x7fe12806a770 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe12dd1b700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 0x7fe12813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe12d51a700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 0x7fe12809d6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe124009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f4a5560b52ec9cb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe11ffff700 1 -- 172.21.15.19:0/1218082497 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124011830 con 0x7fe12806a770 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe11ffff700 1 -- 172.21.15.19:0/1218082497 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe124011990 con 0x7fe12806a770 2023-10-03T10:16:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.460+0000 7fe11ffff700 1 -- 172.21.15.19:0/1218082497 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124011d20 con 0x7fe12806a770 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 -- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 msgr2=0x7fe12809d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 0x7fe12809d6f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe124009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 -- 172.21.15.19:0/1218082497 shutdown_connections 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12813d1f0 0x7fe12813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 --2- 172.21.15.19:0/1218082497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12806a770 0x7fe12809d6f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 -- 172.21.15.19:0/1218082497 >> 172.21.15.19:0/1218082497 conn(0x7fe128066f50 msgr2=0x7fe12809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 -- 172.21.15.19:0/1218082497 shutdown_connections 2023-10-03T10:16:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.461+0000 7fe12f77e700 1 -- 172.21.15.19:0/1218082497 wait complete. 2023-10-03T10:16:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.462+0000 7fe12f77e700 1 Processor -- start 2023-10-03T10:16:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.462+0000 7fe12f77e700 1 -- start start 2023-10-03T10:16:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12806a770 0x7fe1280714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12809dc30 0x7fe128134ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128135c40 con 0x7fe12813d1f0 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12809f1a0 con 0x7fe12809dc30 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12f77e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe12811ee70 con 0x7fe12806a770 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12dd1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12dd1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40872/0 (socket says 172.21.15.19:40872) 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12dd1b700 1 -- 172.21.15.19:0/583548111 learned_addr learned my addr 172.21.15.19:0/583548111 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.463+0000 7fe12d51a700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12806a770 0x7fe1280714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12cd19700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12809dc30 0x7fe128134ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 -- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12806a770 msgr2=0x7fe1280714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12806a770 0x7fe1280714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 -- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12809dc30 msgr2=0x7fe128134ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12809dc30 0x7fe128134ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 -- 172.21.15.19:0/583548111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe120009a70 con 0x7fe12813d1f0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12dd1b700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe12000efc0 tx=0x7fe12000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000ca90 con 0x7fe12813d1f0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12000f040 con 0x7fe12813d1f0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1240094a0 con 0x7fe12813d1f0 2023-10-03T10:16:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.464+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12000ce10 con 0x7fe12813d1f0 2023-10-03T10:16:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.465+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe128072110 con 0x7fe12813d1f0 2023-10-03T10:16:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.465+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe120014480 con 0x7fe12813d1f0 2023-10-03T10:16:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.465+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe12003fcc0 con 0x7fe12813d1f0 2023-10-03T10:16:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.466+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12811e7b0 con 0x7fe12813d1f0 2023-10-03T10:16:26.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.471+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe120012930 con 0x7fe12813d1f0 2023-10-03T10:16:26.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.495+0000 7fd7d3e2f700 1 Processor -- start 2023-10-03T10:16:26.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.495+0000 7fd7d3e2f700 1 -- start start 2023-10-03T10:16:26.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.495+0000 7f89b81fa700 1 Processor -- start 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d3e2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d3e2f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc134260 0x7fd7cc1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d3e2f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc06b990 con 0x7fd7cc133e30 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d3e2f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc0a0590 con 0x7fd7cc133420 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d3e2f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc09fb80 con 0x7fd7cc134260 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d13ca700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd7cc133e30 0x7fd7cc12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57730/0 (socket says 172.21.15.19:57730) 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d13ca700 1 -- 172.21.15.19:0/2029527956 learned_addr learned my addr 172.21.15.19:0/2029527956 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7fd7d1bcb700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.496+0000 7f89b81fa700 1 -- start start 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b81fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b81fa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b81fa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b009f130 con 0x7f89b009d6f0 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b81fa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b009f520 con 0x7f89b0135e50 2023-10-03T10:16:26.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b81fa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b009e930 con 0x7f89b009e1d0 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d0bc9700 1 -- 172.21.15.19:0/2029527956 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2064737282 0 0) 0x7fd7cc06b990 con 0x7fd7cc133e30 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d0bc9700 1 -- 172.21.15.19:0/2029527956 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b80035b0 con 0x7fd7cc133e30 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d1bcb700 1 -- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc134260 msgr2=0x7fd7cc1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d1bcb700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc134260 0x7fd7cc1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d1bcb700 1 -- 172.21.15.19:0/2029527956 >> v1:172.21.15.19:6789/0 conn(0x7fd7cc133e30 legacy=0x7fd7cc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d1bcb700 1 -- 172.21.15.19:0/2029527956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc0a0030 con 0x7fd7cc133420 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b5f96700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89b009d6f0 0x7f89b009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57732/0 (socket says 172.21.15.19:57732) 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b5f96700 1 -- 172.21.15.19:0/1450724546 learned_addr learned my addr 172.21.15.19:0/1450724546 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b6797700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b4f94700 1 -- 172.21.15.19:0/1450724546 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667114130 0 0) 0x7f89b009f130 con 0x7f89b009d6f0 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b4f94700 1 -- 172.21.15.19:0/1450724546 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f899c0035b0 con 0x7f89b009d6f0 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7fd7d1bcb700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc1337f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009870 tx=0x7fd7c8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed2e05699c16526b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b6797700 1 -- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 msgr2=0x7f89b0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b6797700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b6797700 1 -- 172.21.15.19:0/1450724546 >> v1:172.21.15.19:6789/0 conn(0x7f89b009d6f0 legacy=0x7f89b009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.497+0000 7f89b6797700 1 -- 172.21.15.19:0/1450724546 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b009b2d0 con 0x7f89b0135e50 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7f89b6797700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0138230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89a800bfd0 tx=0x7f89a800d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fc3d02ac233baf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7fd7d0bc9700 1 -- 172.21.15.19:0/2029527956 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011830 con 0x7fd7cc133420 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7fd7d0bc9700 1 -- 172.21.15.19:0/2029527956 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c8011990 con 0x7fd7cc133420 2023-10-03T10:16:26.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7fd7d0bc9700 1 -- 172.21.15.19:0/2029527956 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8011d20 con 0x7fd7cc133420 2023-10-03T10:16:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7f89b4f94700 1 -- 172.21.15.19:0/1450724546 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8010070 con 0x7f89b0135e50 2023-10-03T10:16:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7f89b4f94700 1 -- 172.21.15.19:0/1450724546 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a800b2e0 con 0x7f89b0135e50 2023-10-03T10:16:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.498+0000 7f89b4f94700 1 -- 172.21.15.19:0/1450724546 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800dc70 con 0x7f89b0135e50 2023-10-03T10:16:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 msgr2=0x7fd7cc1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc1337f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd7c8009870 tx=0x7fd7c8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/2029527956 shutdown_connections 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc134260 0x7fd7cc1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/2029527956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc1337f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/2029527956 >> 172.21.15.19:0/2029527956 conn(0x7fd7cc0a4210 msgr2=0x7fd7cc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 -- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 msgr2=0x7f89b0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0138230 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f89a800bfd0 tx=0x7f89a800d330 comp rx=0 tx=0).stop 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 -- 172.21.15.19:0/1450724546 shutdown_connections 2023-10-03T10:16:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0138230 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 --2- 172.21.15.19:0/1450724546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 -- 172.21.15.19:0/1450724546 >> 172.21.15.19:0/1450724546 conn(0x7f89b0066f50 msgr2=0x7f89b009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/2029527956 shutdown_connections 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/2029527956 wait complete. 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 Processor -- start 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 -- start start 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc134260 0x7fd7cc09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc12d370 con 0x7fd7cc134260 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc09e060 con 0x7fd7cc133420 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7fd7d3e2f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc131720 con 0x7fd7cc133e30 2023-10-03T10:16:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36002/0 (socket says 172.21.15.19:36002) 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 -- 172.21.15.19:0/1954521944 learned_addr learned my addr 172.21.15.19:0/1954521944 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d23cc700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc134260 0x7fd7cc09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d1bcb700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 -- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 msgr2=0x7fd7cc09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 -- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc134260 msgr2=0x7fd7cc09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc134260 0x7fd7cc09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 -- 172.21.15.19:0/1954521944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c80094a0 con 0x7fd7cc133e30 2023-10-03T10:16:26.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7fd7d13ca700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005910 tx=0x7fd7bc00c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 -- 172.21.15.19:0/1450724546 shutdown_connections 2023-10-03T10:16:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.499+0000 7f89b81fa700 1 -- 172.21.15.19:0/1450724546 wait complete. 2023-10-03T10:16:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7f89b81fa700 1 Processor -- start 2023-10-03T10:16:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.500+0000 7f89b81fa700 1 -- start start 2023-10-03T10:16:26.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89b009d6f0 0x7f89b012fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b012ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0079fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b01304a0 con 0x7f89b009d6f0 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b007cfa0 con 0x7f89b0135e50 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b81fa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0072570 con 0x7f89b009e1d0 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b6797700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0079fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b6797700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0079fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43550/0 (socket says 172.21.15.19:43550) 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b6797700 1 -- 172.21.15.19:0/2490441262 learned_addr learned my addr 172.21.15.19:0/2490441262 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b5f96700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89b009d6f0 0x7f89b012fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.501+0000 7f89b5795700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b012ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 -- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 msgr2=0x7f89b0079fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0079fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 -- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89b009d6f0 msgr2=0x7f89b012fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89b009d6f0 0x7f89b012fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 -- 172.21.15.19:0/2490441262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a800bc80 con 0x7f89b009e1d0 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.502+0000 7f89b5795700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b012ff60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b450 tx=0x7f89a000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011830 con 0x7f89b009e1d0 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a0011990 con 0x7f89b009e1d0 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011d40 con 0x7f89b009e1d0 2023-10-03T10:16:26.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b007d5e0 con 0x7f89b009e1d0 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc005d70 con 0x7fd7cc133e30 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc0070d0 con 0x7fd7cc133e30 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc11fd60 con 0x7fd7cc133e30 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b007b940 con 0x7f89b009e1d0 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc120a90 con 0x7fd7cc133e30 2023-10-03T10:16:26.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.503+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc007440 con 0x7fd7cc133e30 2023-10-03T10:16:26.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.504+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b009ca30 con 0x7f89b009e1d0 2023-10-03T10:16:26.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.504+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b40052e0 con 0x7fd7cc133e30 2023-10-03T10:16:26.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.504+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd7bc0075a0 con 0x7fd7cc133e30 2023-10-03T10:16:26.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.505+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a001a400 con 0x7f89b009e1d0 2023-10-03T10:16:26.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.505+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89a003fc70 con 0x7f89b009e1d0 2023-10-03T10:16:26.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.506+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd7bc012920 con 0x7fd7cc133e30 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 Processor -- start 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 -- start start 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 0x7f4bf809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4bf809f650 0x7f4bf8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf8070940 con 0x7f4bf809f650 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf806fd60 con 0x7f4bf809e930 2023-10-03T10:16:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.507+0000 7f4bfef36700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf806fa80 con 0x7f4bf809f240 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bfccd2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 0x7f4bf809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36024/0 (socket says 172.21.15.19:36024) 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 -- 172.21.15.19:0/3186663025 learned_addr learned my addr 172.21.15.19:0/3186663025 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bfd4d3700 1 --2- 172.21.15.19:0/3186663025 >> v2:172.21.15.19:3300/0 conn(0x7f4bf809f650 0x7f4bf8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 -- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 msgr2=0x7f4bf809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 0x7f4bf809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 -- 172.21.15.19:0/3186663025 >> v2:172.21.15.19:3300/0 conn(0x7f4bf809f650 msgr2=0x7f4bf8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 --2- 172.21.15.19:0/3186663025 >> v2:172.21.15.19:3300/0 conn(0x7f4bf809f650 0x7f4bf8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 -- 172.21.15.19:0/3186663025 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf809fb60 con 0x7f4bf809f240 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bfccd2700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 0x7f4bf809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.508+0000 7f4bf7fff700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4be40098f0 tx=0x7f4be4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e24333bfcaf4662 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.514+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a0009280 con 0x7f89b009e1d0 2023-10-03T10:16:26.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.523+0000 7f4bf77fe700 1 -- 172.21.15.19:0/3186663025 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4011830 con 0x7f4bf809f240 2023-10-03T10:16:26.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.523+0000 7f4bf77fe700 1 -- 172.21.15.19:0/3186663025 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be4011990 con 0x7f4bf809f240 2023-10-03T10:16:26.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.523+0000 7f4bf77fe700 1 -- 172.21.15.19:0/3186663025 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be4011d20 con 0x7f4bf809f240 2023-10-03T10:16:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.523+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7bc011dc0 con 0x7fd7cc133e30 2023-10-03T10:16:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.524+0000 7f4bfef36700 1 -- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 msgr2=0x7f4bf81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.524+0000 7f4bfef36700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4be40098f0 tx=0x7f4be4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 -- 172.21.15.19:0/3186663025 shutdown_connections 2023-10-03T10:16:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809e930 0x7f4bf809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 --2- 172.21.15.19:0/3186663025 >> v2:172.21.15.19:3300/0 conn(0x7f4bf809f650 0x7f4bf8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 --2- 172.21.15.19:0/3186663025 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf81317f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 -- 172.21.15.19:0/3186663025 >> 172.21.15.19:0/3186663025 conn(0x7f4bf80a4210 msgr2=0x7f4bf80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 -- 172.21.15.19:0/3186663025 shutdown_connections 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.525+0000 7f4bfef36700 1 -- 172.21.15.19:0/3186663025 wait complete. 2023-10-03T10:16:26.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 Processor -- start 2023-10-03T10:16:26.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 -- start start 2023-10-03T10:16:26.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 0x7f4bf8127ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf8128000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 0x7f4bf81cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.526+0000 7f4bfef36700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8128ec0 con 0x7f4bf809e930 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfef36700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8128cd0 con 0x7f4bf809f650 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfef36700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8131c50 con 0x7f4bf809f240 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfccd2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 0x7f4bf8127ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 0x7f4bf81cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfccd2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 0x7f4bf8127ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40912/0 (socket says 172.21.15.19:40912) 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bf7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf8128000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:26.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfccd2700 1 -- 172.21.15.19:0/2850187254 learned_addr learned my addr 172.21.15.19:0/2850187254 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 -- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 msgr2=0x7f4bf8128000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf8128000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 -- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 msgr2=0x7f4bf8127ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 0x7f4bf8127ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bfd4d3700 1 -- 172.21.15.19:0/2850187254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0094a0 con 0x7f4bf809f650 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.527+0000 7f4bf7fff700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf8128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bfd4d3700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 0x7f4bf81cc710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000ef90 tx=0x7f4bf000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf000cc90 con 0x7f4bf809f650 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be4009550 con 0x7f4bf809f650 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000f040 con 0x7f4bf809f650 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00146c0 con 0x7f4bf809f650 2023-10-03T10:16:26.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.528+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf80a0190 con 0x7f4bf809f650 2023-10-03T10:16:26.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.529+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8074ea0 con 0x7f4bf809f650 2023-10-03T10:16:26.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.530+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4bf0014820 con 0x7f4bf809f650 2023-10-03T10:16:26.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.530+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4bf00406b0 con 0x7f4bf809f650 2023-10-03T10:16:26.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.534+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4bf0014ad0 con 0x7f4bf809f650 2023-10-03T10:16:26.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.700+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe12811eaf0 con 0x7fe12813d1f0 2023-10-03T10:16:26.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.700+0000 7fe11dffb700 1 -- 172.21.15.19:0/583548111 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe12002a090 con 0x7fe12813d1f0 2023-10-03T10:16:26.700 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:26.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 msgr2=0x7fe1281350e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe12000efc0 tx=0x7fe12000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 shutdown_connections 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12813d1f0 0x7fe1281350e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12806a770 0x7fe1280714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.702+0000 7fe12f77e700 1 --2- 172.21.15.19:0/583548111 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12809dc30 0x7fe128134ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.703+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 >> 172.21.15.19:0/583548111 conn(0x7fe128066f50 msgr2=0x7fe12813efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.703+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 shutdown_connections 2023-10-03T10:16:26.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.703+0000 7fe12f77e700 1 -- 172.21.15.19:0/583548111 wait complete. 2023-10-03T10:16:26.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:26.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.727+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89b008ac60 con 0x7f89b009e1d0 2023-10-03T10:16:26.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.727+0000 7f89a67fc700 1 -- 172.21.15.19:0/2490441262 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a0028020 con 0x7f89b009e1d0 2023-10-03T10:16:26.727 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 msgr2=0x7f89b012ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b012ff60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b450 tx=0x7f89a000b760 comp rx=0 tx=0).stop 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 shutdown_connections 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89b0135e50 0x7f89b0079fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89b009d6f0 0x7f89b012fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 --2- 172.21.15.19:0/2490441262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89b009e1d0 0x7f89b012ff60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 >> 172.21.15.19:0/2490441262 conn(0x7f89b0066f50 msgr2=0x7f89b00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.729+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 shutdown_connections 2023-10-03T10:16:26.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.730+0000 7f89b81fa700 1 -- 172.21.15.19:0/2490441262 wait complete. 2023-10-03T10:16:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.732+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd7b4005150 con 0x7fd7cc133e30 2023-10-03T10:16:26.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.732+0000 7fd7c27fc700 1 -- 172.21.15.19:0/1954521944 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd7bc011360 con 0x7fd7cc133e30 2023-10-03T10:16:26.732 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 msgr2=0x7fd7cc09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc005910 tx=0x7fd7bc00c9e0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 shutdown_connections 2023-10-03T10:16:26.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd7cc134260 0x7fd7cc09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd7cc133420 0x7fd7cc09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 --2- 172.21.15.19:0/1954521944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd7cc133e30 0x7fd7cc09c9c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 >> 172.21.15.19:0/1954521944 conn(0x7fd7cc0a4210 msgr2=0x7fd7cc0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 shutdown_connections 2023-10-03T10:16:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.734+0000 7fd7d3e2f700 1 -- 172.21.15.19:0/1954521944 wait complete. 2023-10-03T10:16:26.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:26.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.754+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4bf812a2e0 con 0x7f4bf809f650 2023-10-03T10:16:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.755+0000 7f4bf57fa700 1 -- 172.21.15.19:0/2850187254 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4bf002a030 con 0x7f4bf809f650 2023-10-03T10:16:26.754 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 msgr2=0x7f4bf81cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 0x7f4bf81cc710 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000ef90 tx=0x7f4bf000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 shutdown_connections 2023-10-03T10:16:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4bf809f650 0x7f4bf81cc710 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf809e930 0x7f4bf8127ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 --2- 172.21.15.19:0/2850187254 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4bf809f240 0x7f4bf8128000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 >> 172.21.15.19:0/2850187254 conn(0x7f4bf80a4210 msgr2=0x7f4bf80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 shutdown_connections 2023-10-03T10:16:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:26.757+0000 7f4bfef36700 1 -- 172.21.15.19:0/2850187254 wait complete. 2023-10-03T10:16:26.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:27.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:27.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:27.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:27.771 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.886+0000 7f11a031b700 1 Processor -- start 2023-10-03T10:16:27.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.886+0000 7f11a031b700 1 -- start start 2023-10-03T10:16:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.887+0000 7f11a031b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f119809e1d0 0x7f1198138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.887+0000 7f11a031b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 0x7f119813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.887+0000 7f11a031b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119809b120 con 0x7f119809d6f0 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.887+0000 7f11a031b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119806b460 con 0x7f119809e1d0 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.887+0000 7f11a031b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f119809a7e0 con 0x7f1198139170 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f119809e1d0 0x7f1198138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119e8b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 0x7f119813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119e0b7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f119809d6f0 0x7f119809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57746/0 (socket says 172.21.15.19:57746) 2023-10-03T10:16:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119e0b7700 1 -- 172.21.15.19:0/3527995871 learned_addr learned my addr 172.21.15.19:0/3527995871 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 -- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 msgr2=0x7f119813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 0x7f119813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 -- 172.21.15.19:0/3527995871 >> v1:172.21.15.19:6789/0 conn(0x7f119809d6f0 legacy=0x7f119809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 -- 172.21.15.19:0/3527995871 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119809a500 con 0x7f119809e1d0 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119e8b8700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 0x7f119813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.888+0000 7f119d8b6700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f1198138c30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1188009870 tx=0x7f1188009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b8ff48f01ee05c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.889+0000 7f119d0b5700 1 -- 172.21.15.19:0/3527995871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011830 con 0x7f119809e1d0 2023-10-03T10:16:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.889+0000 7f119d0b5700 1 -- 172.21.15.19:0/3527995871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1188011990 con 0x7f119809e1d0 2023-10-03T10:16:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.889+0000 7f119d0b5700 1 -- 172.21.15.19:0/3527995871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188011d20 con 0x7f119809e1d0 2023-10-03T10:16:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 -- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 msgr2=0x7f1198138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f1198138c30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1188009870 tx=0x7f1188009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 -- 172.21.15.19:0/3527995871 shutdown_connections 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1198139170 0x7f119813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 --2- 172.21.15.19:0/3527995871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f1198138c30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 -- 172.21.15.19:0/3527995871 >> 172.21.15.19:0/3527995871 conn(0x7f1198066f50 msgr2=0x7f119809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 -- 172.21.15.19:0/3527995871 shutdown_connections 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.890+0000 7f11a031b700 1 -- 172.21.15.19:0/3527995871 wait complete. 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.891+0000 7f11a031b700 1 Processor -- start 2023-10-03T10:16:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 -- start start 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119809d6f0 0x7f1198121370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1198139170 0x7f11981c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198123f60 con 0x7f119809e1d0 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198120f90 con 0x7f1198139170 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.892+0000 7f11a031b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11981368b0 con 0x7f119809d6f0 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40930/0 (socket says 172.21.15.19:40930) 2023-10-03T10:16:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 -- 172.21.15.19:0/1069539930 learned_addr learned my addr 172.21.15.19:0/1069539930 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119e8b8700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1198139170 0x7f11981c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 -- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119809d6f0 msgr2=0x7f1198121370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119809d6f0 0x7f1198121370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 -- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1198139170 msgr2=0x7f11981c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1198139170 0x7f11981c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 -- 172.21.15.19:0/1069539930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009a70 con 0x7f119809e1d0 2023-10-03T10:16:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f119d8b6700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.893+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880036a0 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.894+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118801f070 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.894+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11880094a0 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.894+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188003a20 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.894+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11980a2020 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.895+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1188003b80 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.895+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119809c4b0 con 0x7f119809e1d0 2023-10-03T10:16:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.895+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1188021070 con 0x7f119809e1d0 2023-10-03T10:16:27.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.904+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f118802f3a0 con 0x7f119809e1d0 2023-10-03T10:16:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.920+0000 7efda59a3700 1 Processor -- start 2023-10-03T10:16:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.920+0000 7efda59a3700 1 -- start start 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efda59a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efda59a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 0x7efda01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efda59a3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda009b120 con 0x7efda009e410 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efda59a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda006b460 con 0x7efda009e000 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efda59a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efda009a7e0 con 0x7efda009d6f0 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 0x7efda01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36056/0 (socket says 172.21.15.19:36056) 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 0x7efda01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43596/0 (socket says 172.21.15.19:43596) 2023-10-03T10:16:27.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 -- 172.21.15.19:0/743340320 learned_addr learned my addr 172.21.15.19:0/743340320 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 -- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 msgr2=0x7efda01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 --2- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 0x7efda01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 -- 172.21.15.19:0/743340320 >> v1:172.21.15.19:6789/0 conn(0x7efda009e410 legacy=0x7efda0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.921+0000 7efd9effd700 1 -- 172.21.15.19:0/743340320 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda009a500 con 0x7efda009d6f0 2023-10-03T10:16:27.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.922+0000 7efd9effd700 1 --2- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd90009950 tx=0x7efd90009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c161287b1dcffb67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.922+0000 7efd9dffb700 1 -- 172.21.15.19:0/743340320 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90011830 con 0x7efda009d6f0 2023-10-03T10:16:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.922+0000 7efd9dffb700 1 -- 172.21.15.19:0/743340320 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd90011990 con 0x7efda009d6f0 2023-10-03T10:16:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.922+0000 7efd9dffb700 1 -- 172.21.15.19:0/743340320 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd90011d40 con 0x7efda009d6f0 2023-10-03T10:16:27.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 -- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 msgr2=0x7efda009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 --2- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efd90009950 tx=0x7efd90009c60 comp rx=0 tx=0).stop 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 -- 172.21.15.19:0/743340320 shutdown_connections 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 --2- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda009dac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 --2- 172.21.15.19:0/743340320 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e000 0x7efda01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 -- 172.21.15.19:0/743340320 >> 172.21.15.19:0/743340320 conn(0x7efda0066f50 msgr2=0x7efda009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 -- 172.21.15.19:0/743340320 shutdown_connections 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.923+0000 7efda59a3700 1 -- 172.21.15.19:0/743340320 wait complete. 2023-10-03T10:16:27.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.925+0000 7efda59a3700 1 Processor -- start 2023-10-03T10:16:27.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.925+0000 7efda59a3700 1 -- start start 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda01a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e410 0x7efda01a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda01a93c0 con 0x7efda009e000 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda009c710 con 0x7efda009e410 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efda59a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efda01a8d10 con 0x7efda009d6f0 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40934/0 (socket says 172.21.15.19:40934) 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 -- 172.21.15.19:0/1417509440 learned_addr learned my addr 172.21.15.19:0/1417509440 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9f7fe700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e410 0x7efda01a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9effd700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda01a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 -- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 msgr2=0x7efda01a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda01a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 -- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e410 msgr2=0x7efda01a6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e410 0x7efda01a6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 -- 172.21.15.19:0/1417509440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd90009550 con 0x7efda009e000 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9effd700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda01a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.926+0000 7efd9e7fc700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efd9400e980 tx=0x7efd9400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.927+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94009710 con 0x7efda009e000 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.927+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda01a7b60 con 0x7efda009e000 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.927+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9400eed0 con 0x7efda009e000 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.927+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9400ca70 con 0x7efda009e000 2023-10-03T10:16:27.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.927+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda01a9960 con 0x7efda009e000 2023-10-03T10:16:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.928+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd9400cbd0 con 0x7efda009e000 2023-10-03T10:16:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.928+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd800052e0 con 0x7efda009e000 2023-10-03T10:16:27.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.928+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd9403fb30 con 0x7efda009e000 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.929+0000 7efd3ae35700 1 Processor -- start 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.929+0000 7efd3ae35700 1 -- start start 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd3ae35700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 0x7efd34131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd3ae35700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd3409d9f0 0x7efd3406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd3ae35700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3409e130 con 0x7efd3406acb0 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd3ae35700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd341312b0 con 0x7efd3409d9f0 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd3ae35700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3409f6e0 con 0x7efd341316c0 2023-10-03T10:16:27.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd33fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd3409d9f0 0x7efd3406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd393d2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efd3406acb0 0x7efd34138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57760/0 (socket says 172.21.15.19:57760) 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd393d2700 1 -- 172.21.15.19:0/684458626 learned_addr learned my addr 172.21.15.19:0/684458626 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.930+0000 7efd38bd1700 1 --2- 172.21.15.19:0/684458626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 0x7efd34131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd38bd1700 1 -- 172.21.15.19:0/684458626 >> v2:172.21.15.19:3300/0 conn(0x7efd3409d9f0 msgr2=0x7efd3406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd38bd1700 1 --2- 172.21.15.19:0/684458626 >> v2:172.21.15.19:3300/0 conn(0x7efd3409d9f0 0x7efd3406a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd38bd1700 1 -- 172.21.15.19:0/684458626 >> v1:172.21.15.19:6789/0 conn(0x7efd3406acb0 legacy=0x7efd34138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd38bd1700 1 -- 172.21.15.19:0/684458626 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3409e760 con 0x7efd341316c0 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd38bd1700 1 --2- 172.21.15.19:0/684458626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 0x7efd34131a90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd28009840 tx=0x7efd28009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c3b82933d2eaff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd337fe700 1 -- 172.21.15.19:0/684458626 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28011830 con 0x7efd341316c0 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd337fe700 1 -- 172.21.15.19:0/684458626 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd28011990 con 0x7efd341316c0 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.931+0000 7efd337fe700 1 -- 172.21.15.19:0/684458626 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28011d20 con 0x7efd341316c0 2023-10-03T10:16:27.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.932+0000 7efd3ae35700 1 -- 172.21.15.19:0/684458626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 msgr2=0x7efd34131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.932+0000 7efd3ae35700 1 --2- 172.21.15.19:0/684458626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 0x7efd34131a90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7efd28009840 tx=0x7efd28009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.932+0000 7efd3ae35700 1 -- 172.21.15.19:0/684458626 shutdown_connections 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.932+0000 7efd3ae35700 1 --2- 172.21.15.19:0/684458626 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd341316c0 0x7efd34131a90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.932+0000 7efd3ae35700 1 --2- 172.21.15.19:0/684458626 >> v2:172.21.15.19:3300/0 conn(0x7efd3409d9f0 0x7efd3406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.933+0000 7efd3ae35700 1 -- 172.21.15.19:0/684458626 >> 172.21.15.19:0/684458626 conn(0x7efd34066f50 msgr2=0x7efd3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.933+0000 7efd3ae35700 1 -- 172.21.15.19:0/684458626 shutdown_connections 2023-10-03T10:16:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.933+0000 7efd3ae35700 1 -- 172.21.15.19:0/684458626 wait complete. 2023-10-03T10:16:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.934+0000 7efd3ae35700 1 Processor -- start 2023-10-03T10:16:27.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.934+0000 7efd3ae35700 1 -- start start 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 0x7efd34072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 0x7efd34127560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd341316c0 0x7efd34127aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3412b340 con 0x7efd3409d9f0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd341b9500 con 0x7efd3406acb0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd3ae35700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd341b7470 con 0x7efd341316c0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd38bd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 0x7efd34072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd38bd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 0x7efd34072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43620/0 (socket says 172.21.15.19:43620) 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd38bd1700 1 -- 172.21.15.19:0/2398071596 learned_addr learned my addr 172.21.15.19:0/2398071596 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.935+0000 7efd33fff700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 0x7efd34127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd393d2700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd341316c0 0x7efd34127aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 -- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd341316c0 msgr2=0x7efd34127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd341316c0 0x7efd34127aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 -- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 msgr2=0x7efd34072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 0x7efd34072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 -- 172.21.15.19:0/2398071596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd280094a0 con 0x7efd3409d9f0 2023-10-03T10:16:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd94021020 con 0x7efda009e000 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.936+0000 7efd33fff700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 0x7efd34127560 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7efd3406deb0 tx=0x7efd2000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.937+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000eea0 con 0x7efd3409d9f0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.937+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2000c820 con 0x7efd3409d9f0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.937+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2000cb90 con 0x7efd3409d9f0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.937+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3409ead0 con 0x7efd3409d9f0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.937+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd3412b900 con 0x7efd3409d9f0 2023-10-03T10:16:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.938+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd2000ccf0 con 0x7efd3409d9f0 2023-10-03T10:16:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.938+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd34074ea0 con 0x7efd3409d9f0 2023-10-03T10:16:27.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.938+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd2003f7f0 con 0x7efd3409d9f0 2023-10-03T10:16:27.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.944+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd20017080 con 0x7efd3409d9f0 2023-10-03T10:16:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 Processor -- start 2023-10-03T10:16:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 -- start start 2023-10-03T10:16:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc894139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89409b4f0 con 0x7fc894131810 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8941313c0 con 0x7fc894134630 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.961+0000 7fc89acc5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89406e8c0 con 0x7fc894136f50 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc893fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc894139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc893fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40964/0 (socket says 172.21.15.19:40964) 2023-10-03T10:16:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc893fff700 1 -- 172.21.15.19:0/3751790244 learned_addr learned my addr 172.21.15.19:0/3751790244 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 -- 172.21.15.19:0/3751790244 >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 msgr2=0x7fc894136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 --2- 172.21.15.19:0/3751790244 >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 -- 172.21.15.19:0/3751790244 >> v1:172.21.15.19:6789/0 conn(0x7fc894131810 legacy=0x7fc894131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 -- 172.21.15.19:0/3751790244 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894071d20 con 0x7fc894136f50 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc893fff700 1 --2- 172.21.15.19:0/3751790244 >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc899262700 1 --2- 172.21.15.19:0/3751790244 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc894139330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009d90 tx=0x7fc88c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6307bbd4155b751b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc8937fe700 1 -- 172.21.15.19:0/3751790244 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00e070 con 0x7fc894136f50 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc8937fe700 1 -- 172.21.15.19:0/3751790244 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00bae0 con 0x7fc894136f50 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.962+0000 7fc8937fe700 1 -- 172.21.15.19:0/3751790244 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c00be90 con 0x7fc894136f50 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 -- 172.21.15.19:0/3751790244 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 msgr2=0x7fc894139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3751790244 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc894139330 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009d90 tx=0x7fc88c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 -- 172.21.15.19:0/3751790244 shutdown_connections 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3751790244 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc894139330 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3751790244 >> v2:172.21.15.19:3300/0 conn(0x7fc894134630 0x7fc894136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 -- 172.21.15.19:0/3751790244 >> 172.21.15.19:0/3751790244 conn(0x7fc8940a2aa0 msgr2=0x7fc8940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:27.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 -- 172.21.15.19:0/3751790244 shutdown_connections 2023-10-03T10:16:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.963+0000 7fc89acc5700 1 -- 172.21.15.19:0/3751790244 wait complete. 2023-10-03T10:16:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.965+0000 7fc89acc5700 1 Processor -- start 2023-10-03T10:16:27.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.965+0000 7fc89acc5700 1 -- start start 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 0x7fc8941c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc8941c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89411d4a0 con 0x7fc894134630 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894133930 con 0x7fc894136f50 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc89acc5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940711d0 con 0x7fc894131810 2023-10-03T10:16:27.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36084/0 (socket says 172.21.15.19:36084) 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 -- 172.21.15.19:0/3194615222 learned_addr learned my addr 172.21.15.19:0/3194615222 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc893fff700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 0x7fc8941c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc899262700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc8941c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 -- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 msgr2=0x7fc8941c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc8941c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 -- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 msgr2=0x7fc8941c8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 0x7fc8941c8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.966+0000 7fc898a61700 1 -- 172.21.15.19:0/3194615222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880009550 con 0x7fc894131810 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc893fff700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 0x7fc8941c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc898a61700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc88800b470 tx=0x7fc88800b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888011830 con 0x7fc894131810 2023-10-03T10:16:27.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8880119b0 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88c009a70 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888011d60 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.967+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89411d840 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.968+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc894074ea0 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.969+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc88801a400 con 0x7fc894131810 2023-10-03T10:16:27.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.969+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc88803fc70 con 0x7fc894131810 2023-10-03T10:16:27.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:27.973+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc88801ae60 con 0x7fc894131810 2023-10-03T10:16:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.170+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f119809f420 con 0x7f119809e1d0 2023-10-03T10:16:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.171+0000 7f118effd700 1 -- 172.21.15.19:0/1069539930 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f118802b030 con 0x7f119809e1d0 2023-10-03T10:16:28.171 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 msgr2=0x7f11981218b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f1188000c00 tx=0x7f1188004750 comp rx=0 tx=0).stop 2023-10-03T10:16:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 shutdown_connections 2023-10-03T10:16:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1198139170 0x7f11981c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119809d6f0 0x7f1198121370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 --2- 172.21.15.19:0/1069539930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119809e1d0 0x7f11981218b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 >> 172.21.15.19:0/1069539930 conn(0x7f1198066f50 msgr2=0x7f1198136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 shutdown_connections 2023-10-03T10:16:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.173+0000 7f11a031b700 1 -- 172.21.15.19:0/1069539930 wait complete. 2023-10-03T10:16:28.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.178+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd341b9000 con 0x7efd3409d9f0 2023-10-03T10:16:28.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.178+0000 7efd317fa700 1 -- 172.21.15.19:0/2398071596 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd20021020 con 0x7efd3409d9f0 2023-10-03T10:16:28.178 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.180+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 msgr2=0x7efd34127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.180+0000 7efd3ae35700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 0x7efd34127560 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7efd3406deb0 tx=0x7efd2000ec60 comp rx=0 tx=0).stop 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 shutdown_connections 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd341316c0 0x7efd34127aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd3406acb0 0x7efd34072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 --2- 172.21.15.19:0/2398071596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd3409d9f0 0x7efd34127560 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 >> 172.21.15.19:0/2398071596 conn(0x7efd34066f50 msgr2=0x7efd340a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 shutdown_connections 2023-10-03T10:16:28.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.181+0000 7efd3ae35700 1 -- 172.21.15.19:0/2398071596 wait complete. 2023-10-03T10:16:28.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:28.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.196+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd80005590 con 0x7efda009e000 2023-10-03T10:16:28.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.196+0000 7efd87fff700 1 -- 172.21.15.19:0/1417509440 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd94017070 con 0x7efda009e000 2023-10-03T10:16:28.196 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 msgr2=0x7efda01a63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efd9400e980 tx=0x7efd9400ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 shutdown_connections 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efda009e410 0x7efda01a6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efda009d6f0 0x7efda01a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 --2- 172.21.15.19:0/1417509440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efda009e000 0x7efda01a63c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 >> 172.21.15.19:0/1417509440 conn(0x7efda0066f50 msgr2=0x7efda01baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 shutdown_connections 2023-10-03T10:16:28.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.199+0000 7efda59a3700 1 -- 172.21.15.19:0/1417509440 wait complete. 2023-10-03T10:16:28.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:28.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.218+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc89411e4a0 con 0x7fc894131810 2023-10-03T10:16:28.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.218+0000 7fc8917fa700 1 -- 172.21.15.19:0/3194615222 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc888028020 con 0x7fc894131810 2023-10-03T10:16:28.218 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.220+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 msgr2=0x7fc8941c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.220+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc88800b470 tx=0x7fc88800b780 comp rx=0 tx=0).stop 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 shutdown_connections 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc894136f50 0x7fc8941c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc894131810 0x7fc8941c81d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 --2- 172.21.15.19:0/3194615222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc894134630 0x7fc8941c8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 >> 172.21.15.19:0/3194615222 conn(0x7fc8940a2aa0 msgr2=0x7fc89412f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 shutdown_connections 2023-10-03T10:16:28.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:28.221+0000 7fc89acc5700 1 -- 172.21.15.19:0/3194615222 wait complete. 2023-10-03T10:16:28.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:29.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:29.201 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:29.213 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:29.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.345+0000 7f5cf47ea700 1 Processor -- start 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.345+0000 7f5cf47ea700 1 -- start start 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf47ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf47ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf47ea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec134980 con 0x7f5cec137f20 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf47ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec06c4b0 con 0x7f5cec134ec0 2023-10-03T10:16:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf47ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0a09c0 con 0x7f5cec06c0e0 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf2586700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf2586700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36092/0 (socket says 172.21.15.19:36092) 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.346+0000 7f5cf2586700 1 -- 172.21.15.19:0/3102390005 learned_addr learned my addr 172.21.15.19:0/3102390005 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1584700 1 -- 172.21.15.19:0/3102390005 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932101073 0 0) 0x7f5cec134980 con 0x7f5cec137f20 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1584700 1 -- 172.21.15.19:0/3102390005 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd80035b0 con 0x7f5cec137f20 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 -- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 msgr2=0x7f5cec09ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 -- 172.21.15.19:0/3102390005 >> v1:172.21.15.19:6789/0 conn(0x7f5cec137f20 legacy=0x7f5cec13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 -- 172.21.15.19:0/3102390005 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0a0600 con 0x7f5cec134ec0 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf2586700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec1379e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009870 tx=0x7f5cdc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=405c5b61dd78e63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.347+0000 7f5cf1584700 1 -- 172.21.15.19:0/3102390005 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc011830 con 0x7f5cec134ec0 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.348+0000 7f5cf1584700 1 -- 172.21.15.19:0/3102390005 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc011990 con 0x7f5cec134ec0 2023-10-03T10:16:29.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.348+0000 7f5cf1584700 1 -- 172.21.15.19:0/3102390005 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc011d20 con 0x7f5cec134ec0 2023-10-03T10:16:29.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 -- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 msgr2=0x7f5cec1379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec1379e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009870 tx=0x7f5cdc009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 -- 172.21.15.19:0/3102390005 shutdown_connections 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec06c0e0 0x7f5cec09ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/3102390005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec1379e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 -- 172.21.15.19:0/3102390005 >> 172.21.15.19:0/3102390005 conn(0x7f5cec0a4210 msgr2=0x7f5cec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 -- 172.21.15.19:0/3102390005 shutdown_connections 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.349+0000 7f5cf47ea700 1 -- 172.21.15.19:0/3102390005 wait complete. 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 Processor -- start 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 -- start start 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec11abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 0x7f5cec11b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec11dc10 con 0x7f5cec06c0e0 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec0a03f0 con 0x7f5cec134ec0 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.350+0000 7f5cf47ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec11bf30 con 0x7f5cec137f20 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2586700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2586700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40996/0 (socket says 172.21.15.19:40996) 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2586700 1 -- 172.21.15.19:0/1590585616 learned_addr learned my addr 172.21.15.19:0/1590585616 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2d87700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 0x7f5cec11b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec11abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 -- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 msgr2=0x7f5cec11b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 0x7f5cec11b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 -- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 msgr2=0x7f5cec11a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 -- 172.21.15.19:0/1590585616 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009550 con 0x7f5cec134ec0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2d87700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 0x7f5cec11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf2586700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.351+0000 7f5cf1d85700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec11abc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc016000 tx=0x7f5cdc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.352+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004450 con 0x7f5cec134ec0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.352+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc01f070 con 0x7f5cec134ec0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.352+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc0094a0 con 0x7f5cec134ec0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.352+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0038c0 con 0x7f5cec134ec0 2023-10-03T10:16:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.352+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec11cc90 con 0x7f5cec134ec0 2023-10-03T10:16:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.353+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec074ea0 con 0x7f5cec134ec0 2023-10-03T10:16:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.353+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5cdc003a20 con 0x7f5cec134ec0 2023-10-03T10:16:29.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.353+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5cdc021070 con 0x7f5cec134ec0 2023-10-03T10:16:29.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.358+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5cdc0045b0 con 0x7f5cec134ec0 2023-10-03T10:16:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 Processor -- start 2023-10-03T10:16:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 -- start start 2023-10-03T10:16:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe809f130 con 0x7fabe809e410 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe809f520 con 0x7fabe809e000 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.383+0000 7fabef0d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe809e930 con 0x7fabe809d6f0 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabe7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43670/0 (socket says 172.21.15.19:43670) 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 -- 172.21.15.19:0/2151944834 learned_addr learned my addr 172.21.15.19:0/2151944834 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabe7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41000/0 (socket says 172.21.15.19:41000) 2023-10-03T10:16:29.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 -- 172.21.15.19:0/2151944834 >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 msgr2=0x7fabe8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 --2- 172.21.15.19:0/2151944834 >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 -- 172.21.15.19:0/2151944834 >> v1:172.21.15.19:6789/0 conn(0x7fabe809e410 legacy=0x7fabe8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 -- 172.21.15.19:0/2151944834 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe809b2d0 con 0x7fabe809d6f0 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabe7fff700 1 --2- 172.21.15.19:0/2151944834 >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabece74700 1 --2- 172.21.15.19:0/2151944834 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0098f0 tx=0x7fabdc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=267368cb2bfcd66b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.384+0000 7fabe77fe700 1 -- 172.21.15.19:0/2151944834 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc004230 con 0x7fabe809d6f0 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabe77fe700 1 -- 172.21.15.19:0/2151944834 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabdc004390 con 0x7fabe809d6f0 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabe77fe700 1 -- 172.21.15.19:0/2151944834 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabdc0036a0 con 0x7fabe809d6f0 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 -- 172.21.15.19:0/2151944834 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 msgr2=0x7fabe809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 --2- 172.21.15.19:0/2151944834 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fabdc0098f0 tx=0x7fabdc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 -- 172.21.15.19:0/2151944834 shutdown_connections 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 --2- 172.21.15.19:0/2151944834 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809d6f0 0x7fabe809dac0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 --2- 172.21.15.19:0/2151944834 >> v2:172.21.15.19:3300/0 conn(0x7fabe809e000 0x7fabe8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 -- 172.21.15.19:0/2151944834 >> 172.21.15.19:0/2151944834 conn(0x7fabe8066f50 msgr2=0x7fabe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7f560ec43700 1 Processor -- start 2023-10-03T10:16:29.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 -- 172.21.15.19:0/2151944834 shutdown_connections 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7fabef0d8700 1 -- 172.21.15.19:0/2151944834 wait complete. 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.385+0000 7f560ec43700 1 -- start start 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560ec43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560809de00 0x7f560809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560ec43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f560813d1f0 0x7f560813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560ec43700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560809a810 con 0x7f560806a770 2023-10-03T10:16:29.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560ec43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560806ab40 con 0x7f560813d1f0 2023-10-03T10:16:29.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560ec43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560809ebc0 con 0x7f560809de00 2023-10-03T10:16:29.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560d1e0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f560813d1f0 0x7f560813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f5607fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560809de00 0x7f560809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7fabef0d8700 1 Processor -- start 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560d1e0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f560813d1f0 0x7f560813f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41010/0 (socket says 172.21.15.19:41010) 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560c9df700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f560806a770 0x7f560809d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57790/0 (socket says 172.21.15.19:57790) 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.386+0000 7f560d1e0700 1 -- 172.21.15.19:0/3880058588 learned_addr learned my addr 172.21.15.19:0/3880058588 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f56077fe700 1 -- 172.21.15.19:0/3880058588 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243533632 0 0) 0x7f560809a810 con 0x7f560806a770 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f56077fe700 1 -- 172.21.15.19:0/3880058588 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f80035b0 con 0x7f560806a770 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f560d1e0700 1 -- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560809de00 msgr2=0x7f560809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f560d1e0700 1 --2- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560809de00 0x7f560809e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f560d1e0700 1 -- 172.21.15.19:0/3880058588 >> v1:172.21.15.19:6789/0 conn(0x7f560806a770 legacy=0x7f560809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f560d1e0700 1 -- 172.21.15.19:0/3880058588 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560809e920 con 0x7f560813d1f0 2023-10-03T10:16:29.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7f560d1e0700 1 --2- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813f5d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5600009e50 tx=0x7f560000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab07adfc5e433d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 -- start start 2023-10-03T10:16:29.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 0x7fabe812dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fabe809e410 0x7fabe812e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8131d10 con 0x7fabe809d6f0 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe812f940 con 0x7fabe809e000 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.387+0000 7fabef0d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8131670 con 0x7fabe809e410 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43674/0 (socket says 172.21.15.19:43674) 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 -- 172.21.15.19:0/277662454 learned_addr learned my addr 172.21.15.19:0/277662454 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabece74700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 0x7fabe812dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabed675700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fabe809e410 0x7fabe812e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 -- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fabe809e410 msgr2=0x7fabe812e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fabe809e410 0x7fabe812e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 -- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 msgr2=0x7fabe812dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 0x7fabe812dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 -- 172.21.15.19:0/277662454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd40094a0 con 0x7fabe809e000 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7f56077fe700 1 -- 172.21.15.19:0/3880058588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000e070 con 0x7f560813d1f0 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7f56077fe700 1 -- 172.21.15.19:0/3880058588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560000b910 con 0x7f560813d1f0 2023-10-03T10:16:29.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7f56077fe700 1 -- 172.21.15.19:0/3880058588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000bcc0 con 0x7f560813d1f0 2023-10-03T10:16:29.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabece74700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 0x7fabe812dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:29.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.388+0000 7fabe7fff700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fabd400ebb0 tx=0x7fabd400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400c850 con 0x7fabe809e000 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd400c9b0 con 0x7fabe809e000 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd400cd40 con 0x7fabe809e000 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabdc009550 con 0x7fabe809e000 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe81306f0 con 0x7fabe809e000 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 -- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 msgr2=0x7f560813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 --2- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813f5d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5600009e50 tx=0x7f560000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:29.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 -- 172.21.15.19:0/3880058588 shutdown_connections 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 --2- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813f5d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 --2- 172.21.15.19:0/3880058588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560809de00 0x7f560809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 -- 172.21.15.19:0/3880058588 >> 172.21.15.19:0/3880058588 conn(0x7f5608066f50 msgr2=0x7f560809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 -- 172.21.15.19:0/3880058588 shutdown_connections 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.389+0000 7f560ec43700 1 -- 172.21.15.19:0/3880058588 wait complete. 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.390+0000 7fb4788ca700 1 Processor -- start 2023-10-03T10:16:29.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.390+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe8131b50 con 0x7fabe809e000 2023-10-03T10:16:29.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.390+0000 7f560ec43700 1 Processor -- start 2023-10-03T10:16:29.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabd4013470 con 0x7fabe809e000 2023-10-03T10:16:29.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.390+0000 7fb4788ca700 1 -- start start 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb4788ca700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a1510 0x7fb474138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb4788ca700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb474139250 0x7fb47413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb4788ca700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb47409edd0 con 0x7fb4740a0a30 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb4788ca700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740a18e0 con 0x7fb474139250 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb4788ca700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47409e1f0 con 0x7fb4740a1510 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb472d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb474139250 0x7fb47413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb472d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb474139250 0x7fb47413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41018/0 (socket says 172.21.15.19:41018) 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fb472d9d700 1 -- 172.21.15.19:0/899431175 learned_addr learned my addr 172.21.15.19:0/899431175 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb472d9d700 1 -- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a1510 msgr2=0x7fb474138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb472d9d700 1 --2- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a1510 0x7fb474138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb472d9d700 1 -- 172.21.15.19:0/899431175 >> v1:172.21.15.19:6789/0 conn(0x7fb4740a0a30 legacy=0x7fb4740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb472d9d700 1 -- 172.21.15.19:0/899431175 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47409dc50 con 0x7fb474139250 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 -- start start 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560806a770 0x7f56080713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f560809de00 0x7f560813b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608135af0 con 0x7f560813d1f0 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560813cb70 con 0x7f560809de00 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7f560ec43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f560811e060 con 0x7f560806a770 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41022/0 (socket says 172.21.15.19:41022) 2023-10-03T10:16:29.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 -- 172.21.15.19:0/2694082060 learned_addr learned my addr 172.21.15.19:0/2694082060 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb472d9d700 1 --2- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb474139250 0x7fb47413b630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009e80 tx=0x7fb46c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ca186038e67d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb47159a700 1 -- 172.21.15.19:0/899431175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00e070 con 0x7fb474139250 2023-10-03T10:16:29.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb47159a700 1 -- 172.21.15.19:0/899431175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46c003a20 con 0x7fb474139250 2023-10-03T10:16:29.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7fb47159a700 1 -- 172.21.15.19:0/899431175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c003dd0 con 0x7fb474139250 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 -- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560806a770 msgr2=0x7f56080713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560806a770 0x7f56080713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 -- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f560809de00 msgr2=0x7f560813b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f560809de00 0x7f560813b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.392+0000 7f560d1e0700 1 -- 172.21.15.19:0/2694082060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5600009b30 con 0x7f560813d1f0 2023-10-03T10:16:29.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.391+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabd403f750 con 0x7fabe809e000 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f560d1e0700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f560809eff0 tx=0x7f5600004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560000ce80 con 0x7f560813d1f0 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600004250 con 0x7f560813d1f0 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000045e0 con 0x7f560813d1f0 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560811ee20 con 0x7f560813d1f0 2023-10-03T10:16:29.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608071fc0 con 0x7f560813d1f0 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7fb4788ca700 1 -- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb474139250 msgr2=0x7fb47413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.393+0000 7fb4788ca700 1 --2- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb474139250 0x7fb47413b630 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb46c009e80 tx=0x7fb46c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 -- 172.21.15.19:0/899431175 shutdown_connections 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 --2- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb474139250 0x7fb47413b630 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 --2- 172.21.15.19:0/899431175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a1510 0x7fb474138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 -- 172.21.15.19:0/899431175 >> 172.21.15.19:0/899431175 conn(0x7fb4740a6550 msgr2=0x7fb4740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 -- 172.21.15.19:0/899431175 shutdown_connections 2023-10-03T10:16:29.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5600004740 con 0x7f560813d1f0 2023-10-03T10:16:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560811d890 con 0x7f560813d1f0 2023-10-03T10:16:29.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.395+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5600040fd0 con 0x7f560813d1f0 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.394+0000 7fb4788ca700 1 -- 172.21.15.19:0/899431175 wait complete. 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.395+0000 7fb4788ca700 1 Processor -- start 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.395+0000 7fb4788ca700 1 -- start start 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a0a30 0x7fb47406dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb474139250 0x7fb4741cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:29.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb474137800 con 0x7fb4740a1510 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb474070440 con 0x7fb4740a0a30 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb4788ca700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb47406f850 con 0x7fb474139250 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41026/0 (socket says 172.21.15.19:41026) 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 -- 172.21.15.19:0/428761871 learned_addr learned my addr 172.21.15.19:0/428761871 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb47259c700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a0a30 0x7fb47406dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 -- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb474139250 msgr2=0x7fb4741cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb474139250 0x7fb4741cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 -- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a0a30 msgr2=0x7fb47406dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.396+0000 7fb471d9b700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a0a30 0x7fb47406dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.397+0000 7fb471d9b700 1 -- 172.21.15.19:0/428761871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46c009b30 con 0x7fb4740a1510 2023-10-03T10:16:29.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.397+0000 7fb471d9b700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b530 tx=0x7fb46400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.400+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011830 con 0x7fb4740a1510 2023-10-03T10:16:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.401+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb464011990 con 0x7fb4740a1510 2023-10-03T10:16:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.401+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb464011d40 con 0x7fb4740a1510 2023-10-03T10:16:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.400+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabe8131b50 con 0x7fabe809e000 2023-10-03T10:16:29.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.401+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5600025410 con 0x7f560813d1f0 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.401+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4740a0220 con 0x7fb4740a1510 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.401+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4740707e0 con 0x7fb4740a1510 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.402+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb47404ea50 con 0x7fb4740a1510 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.402+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb46401a400 con 0x7fb4740a1510 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.403+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb46403fc00 con 0x7fb4740a1510 2023-10-03T10:16:29.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.407+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4640218f0 con 0x7fb4740a1510 2023-10-03T10:16:29.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.601+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5cec06b250 con 0x7f5cec134ec0 2023-10-03T10:16:29.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.601+0000 7f5ce2ffd700 1 -- 172.21.15.19:0/1590585616 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5cdc015020 con 0x7f5cec134ec0 2023-10-03T10:16:29.601 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 msgr2=0x7f5cec11abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec11abc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc016000 tx=0x7f5cdc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 shutdown_connections 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cec137f20 0x7f5cec11b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cec06c0e0 0x7f5cec11a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 --2- 172.21.15.19:0/1590585616 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cec134ec0 0x7f5cec11abc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 >> 172.21.15.19:0/1590585616 conn(0x7f5cec0a4210 msgr2=0x7f5cec1371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 shutdown_connections 2023-10-03T10:16:29.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.604+0000 7f5cf47ea700 1 -- 172.21.15.19:0/1590585616 wait complete. 2023-10-03T10:16:29.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.614+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fabe8131b50 con 0x7fabe809e000 2023-10-03T10:16:29.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.614+0000 7fabe57fa700 1 -- 172.21.15.19:0/277662454 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabe8131b50 con 0x7fabe809e000 2023-10-03T10:16:29.614 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 msgr2=0x7fabe812e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fabd400ebb0 tx=0x7fabd400eec0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 shutdown_connections 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fabe809e410 0x7fabe812e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fabe809d6f0 0x7fabe812dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 --2- 172.21.15.19:0/277662454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fabe809e000 0x7fabe812e2b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.617+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 >> 172.21.15.19:0/277662454 conn(0x7fabe8066f50 msgr2=0x7fabe806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.618+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 shutdown_connections 2023-10-03T10:16:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.618+0000 7fabef0d8700 1 -- 172.21.15.19:0/277662454 wait complete. 2023-10-03T10:16:29.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.623+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb474071300 con 0x7fb4740a1510 2023-10-03T10:16:29.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.623+0000 7fb462ffd700 1 -- 172.21.15.19:0/428761871 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb464028070 con 0x7fb4740a1510 2023-10-03T10:16:29.623 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 msgr2=0x7fb47406e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb46400b530 tx=0x7fb46400b840 comp rx=0 tx=0).stop 2023-10-03T10:16:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 shutdown_connections 2023-10-03T10:16:29.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb474139250 0x7fb4741cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4740a0a30 0x7fb47406dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 --2- 172.21.15.19:0/428761871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4740a1510 0x7fb47406e270 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 >> 172.21.15.19:0/428761871 conn(0x7fb4740a6550 msgr2=0x7fb474137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 shutdown_connections 2023-10-03T10:16:29.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.626+0000 7fb4788ca700 1 -- 172.21.15.19:0/428761871 wait complete. 2023-10-03T10:16:29.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:29.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:29.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.642+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5608074ea0 con 0x7f560813d1f0 2023-10-03T10:16:29.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.643+0000 7f56057fa700 1 -- 172.21.15.19:0/2694082060 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5600011390 con 0x7f560813d1f0 2023-10-03T10:16:29.643 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 msgr2=0x7f560813b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f560809eff0 tx=0x7f5600004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 shutdown_connections 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f560813d1f0 0x7f560813b8d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f560806a770 0x7f56080713c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 --2- 172.21.15.19:0/2694082060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f560809de00 0x7f560813b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.645+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 >> 172.21.15.19:0/2694082060 conn(0x7f5608066f50 msgr2=0x7f560813edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.646+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 shutdown_connections 2023-10-03T10:16:29.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:29.646+0000 7f560ec43700 1 -- 172.21.15.19:0/2694082060 wait complete. 2023-10-03T10:16:29.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:30.619 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:30.639 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:30.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:30.660 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.805+0000 7f4a02f7e700 1 Processor -- start 2023-10-03T10:16:30.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.805+0000 7f4a02f7e700 1 -- start start 2023-10-03T10:16:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a02f7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a02f7e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49fc138d80 0x7f49fc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a02f7e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0a2a70 con 0x7f49fc09d630 2023-10-03T10:16:30.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a02f7e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49fc0a01d0 con 0x7f49fc138d80 2023-10-03T10:16:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a02f7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc09e2b0 con 0x7f49fc0a0a30 2023-10-03T10:16:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a0151b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49fc138d80 0x7f49fc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a00d1a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a0151b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f49fc138d80 0x7f49fc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41030/0 (socket says 172.21.15.19:41030) 2023-10-03T10:16:30.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.806+0000 7f4a0151b700 1 -- 172.21.15.19:0/2375492446 learned_addr learned my addr 172.21.15.19:0/2375492446 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a0151b700 1 -- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 msgr2=0x7f49fc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a0151b700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a0151b700 1 -- 172.21.15.19:0/2375492446 >> v1:172.21.15.19:6789/0 conn(0x7f49fc09d630 legacy=0x7f49fc0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a0151b700 1 -- 172.21.15.19:0/2375492446 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc09dc50 con 0x7f49fc138d80 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a00d1a700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.807+0000 7f4a0151b700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc13b160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009e50 tx=0x7f49f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e58c819b411937c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.808+0000 7f49fb7fe700 1 -- 172.21.15.19:0/2375492446 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400e070 con 0x7f49fc138d80 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.808+0000 7f49fb7fe700 1 -- 172.21.15.19:0/2375492446 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f400b910 con 0x7f49fc138d80 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.808+0000 7f49fb7fe700 1 -- 172.21.15.19:0/2375492446 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f400bcc0 con 0x7f49fc138d80 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 -- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 msgr2=0x7f49fc13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc13b160 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f49f4009e50 tx=0x7f49f400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:30.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 -- 172.21.15.19:0/2375492446 shutdown_connections 2023-10-03T10:16:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc13b160 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/2375492446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 -- 172.21.15.19:0/2375492446 >> 172.21.15.19:0/2375492446 conn(0x7f49fc0a3050 msgr2=0x7f49fc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 -- 172.21.15.19:0/2375492446 shutdown_connections 2023-10-03T10:16:30.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.809+0000 7f4a02f7e700 1 -- 172.21.15.19:0/2375492446 wait complete. 2023-10-03T10:16:30.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.810+0000 7f4a02f7e700 1 Processor -- start 2023-10-03T10:16:30.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.810+0000 7f4a02f7e700 1 -- start start 2023-10-03T10:16:30.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc133e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1380a0 con 0x7f49fc138d80 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1370d0 con 0x7f49fc0a0a30 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a02f7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc1362a0 con 0x7f49fc09d630 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a00d1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a00d1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36150/0 (socket says 172.21.15.19:36150) 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a00d1a700 1 -- 172.21.15.19:0/1615537243 learned_addr learned my addr 172.21.15.19:0/1615537243 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.811+0000 7f4a0151b700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f49fbfff700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc133e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 -- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 msgr2=0x7f49fc133e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc133e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 -- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 msgr2=0x7f49fc1343b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc1343b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 -- 172.21.15.19:0/1615537243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00094a0 con 0x7f49fc09d630 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a0151b700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f49fbfff700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a00d1a700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49f000ebe0 tx=0x7f49f000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f0009800 con 0x7f49fc09d630 2023-10-03T10:16:30.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f000c910 con 0x7f49fc09d630 2023-10-03T10:16:30.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f000cc80 con 0x7f49fc09d630 2023-10-03T10:16:30.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f4009b30 con 0x7f49fc09d630 2023-10-03T10:16:30.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.812+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc0a0410 con 0x7f49fc09d630 2023-10-03T10:16:30.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.813+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49f0013470 con 0x7f49fc09d630 2023-10-03T10:16:30.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.814+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49f003fcc0 con 0x7f49fc09d630 2023-10-03T10:16:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 Processor -- start 2023-10-03T10:16:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 -- start start 2023-10-03T10:16:30.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc0747f0 con 0x7f49fc09d630 2023-10-03T10:16:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc884133510 0x7fc8841358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8841310d0 con 0x7fc8841305f0 2023-10-03T10:16:30.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8841301c0 con 0x7fc884133510 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.815+0000 7fc889ef8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc884071ff0 con 0x7fc884135e30 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43730/0 (socket says 172.21.15.19:43730) 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 -- 172.21.15.19:0/1524527958 learned_addr learned my addr 172.21.15.19:0/1524527958 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 -- 172.21.15.19:0/1524527958 >> v2:172.21.15.19:3300/0 conn(0x7fc884133510 msgr2=0x7fc8841358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 --2- 172.21.15.19:0/1524527958 >> v2:172.21.15.19:3300/0 conn(0x7fc884133510 0x7fc8841358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 -- 172.21.15.19:0/1524527958 >> v1:172.21.15.19:6789/0 conn(0x7fc8841305f0 legacy=0x7fc8841309c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 -- 172.21.15.19:0/1524527958 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc884070e70 con 0x7fc884135e30 2023-10-03T10:16:30.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7f342efed700 1 Processor -- start 2023-10-03T10:16:30.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc883fff700 1 --2- 172.21.15.19:0/1524527958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00d150 tx=0x7fc87c00d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8266a65a39061b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.816+0000 7fc8827fc700 1 -- 172.21.15.19:0/1524527958 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c010070 con 0x7fc884135e30 2023-10-03T10:16:30.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7fc8827fc700 1 -- 172.21.15.19:0/1524527958 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c00dd80 con 0x7fc884135e30 2023-10-03T10:16:30.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7fc8827fc700 1 -- 172.21.15.19:0/1524527958 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00b310 con 0x7fc884135e30 2023-10-03T10:16:30.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 -- start start 2023-10-03T10:16:30.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7fc889ef8700 1 -- 172.21.15.19:0/1524527958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 msgr2=0x7fc884138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7fc889ef8700 1 --2- 172.21.15.19:0/1524527958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00d150 tx=0x7fc87c00d460 comp rx=0 tx=0).stop 2023-10-03T10:16:30.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f342809e1d0 0x7f3428135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342809f130 con 0x7f342809d6f0 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342809f520 con 0x7f342809e1d0 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.817+0000 7f342efed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f342809e930 con 0x7f3428135e50 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36162/0 (socket says 172.21.15.19:36162) 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342cd89700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f342809d6f0 0x7f342809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57810/0 (socket says 172.21.15.19:57810) 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 -- 172.21.15.19:0/4244028869 learned_addr learned my addr 172.21.15.19:0/4244028869 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f3427fff700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f342809e1d0 0x7f3428135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 -- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f342809e1d0 msgr2=0x7f3428135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f342809e1d0 0x7f3428135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 -- 172.21.15.19:0/4244028869 >> v1:172.21.15.19:6789/0 conn(0x7f342809d6f0 legacy=0x7f342809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 -- 172.21.15.19:0/4244028869 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342809b2d0 con 0x7f3428135e50 2023-10-03T10:16:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 -- 172.21.15.19:0/1524527958 shutdown_connections 2023-10-03T10:16:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 --2- 172.21.15.19:0/1524527958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884135e30 0x7fc884138210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 --2- 172.21.15.19:0/1524527958 >> v2:172.21.15.19:3300/0 conn(0x7fc884133510 0x7fc8841358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 -- 172.21.15.19:0/1524527958 >> 172.21.15.19:0/1524527958 conn(0x7fc8840a2aa0 msgr2=0x7fc8840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f34277fe700 1 -- 172.21.15.19:0/4244028869 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735607347 0 0) 0x7f342809f130 con 0x7f342809d6f0 2023-10-03T10:16:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 -- 172.21.15.19:0/1524527958 shutdown_connections 2023-10-03T10:16:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7fc889ef8700 1 -- 172.21.15.19:0/1524527958 wait complete. 2023-10-03T10:16:30.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.818+0000 7f342d58a700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3420009f00 tx=0x7f342000d540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e819a4c236e2dbf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.819+0000 7fc889ef8700 1 Processor -- start 2023-10-03T10:16:30.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.819+0000 7fc889ef8700 1 -- start start 2023-10-03T10:16:30.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 0x7fc88411b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 0x7fc88411b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc884135e30 0x7fc88411bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88411a0d0 con 0x7fc884135e30 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc884071820 con 0x7fc884133510 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc889ef8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc884119e50 con 0x7fc8841305f0 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc8837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 0x7fc88411b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc8837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 0x7fc88411b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36176/0 (socket says 172.21.15.19:36176) 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc8837fe700 1 -- 172.21.15.19:0/309926477 learned_addr learned my addr 172.21.15.19:0/309926477 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc882ffd700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 0x7fc88411b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.820+0000 7fc883fff700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc884135e30 0x7fc88411bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 -- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 msgr2=0x7fc88411b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 0x7fc88411b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 -- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc884135e30 msgr2=0x7fc88411bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc884135e30 0x7fc88411bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 -- 172.21.15.19:0/309926477 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c00bd40 con 0x7fc884133510 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc882ffd700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 0x7fc88411b790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b480 tx=0x7fc87800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011830 con 0x7fc884133510 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc878011990 con 0x7fc884133510 2023-10-03T10:16:30.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88409e070 con 0x7fc884133510 2023-10-03T10:16:30.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7f34277fe700 1 -- 172.21.15.19:0/4244028869 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000dde0 con 0x7f3428135e50 2023-10-03T10:16:30.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878011d20 con 0x7fc884133510 2023-10-03T10:16:30.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7f34277fe700 1 -- 172.21.15.19:0/4244028869 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420011460 con 0x7f3428135e50 2023-10-03T10:16:30.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7f34277fe700 1 -- 172.21.15.19:0/4244028869 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420011810 con 0x7f3428135e50 2023-10-03T10:16:30.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88411a670 con 0x7fc884133510 2023-10-03T10:16:30.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.821+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49f0017080 con 0x7f49fc09d630 2023-10-03T10:16:30.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 -- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 msgr2=0x7f3428138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3420009f00 tx=0x7f342000d540 comp rx=0 tx=0).stop 2023-10-03T10:16:30.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 -- 172.21.15.19:0/4244028869 shutdown_connections 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3428135e50 0x7f3428138230 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 --2- 172.21.15.19:0/4244028869 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f342809e1d0 0x7f3428135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7f342efed700 1 -- 172.21.15.19:0/4244028869 >> 172.21.15.19:0/4244028869 conn(0x7f3428066f50 msgr2=0x7f342809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.823+0000 7f342efed700 1 -- 172.21.15.19:0/4244028869 shutdown_connections 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.823+0000 7f342efed700 1 -- 172.21.15.19:0/4244028869 wait complete. 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.824+0000 7f342efed700 1 Processor -- start 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.824+0000 7f342efed700 1 -- start start 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342809d6f0 0x7f3428133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f342809e1d0 0x7f3428133ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3428132bf0 con 0x7f342809d6f0 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428134bd0 con 0x7f3428135e50 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342efed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34280a3bd0 con 0x7f342809e1d0 2023-10-03T10:16:30.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342d58a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342d58a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43758/0 (socket says 172.21.15.19:43758) 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.825+0000 7f342d58a700 1 -- 172.21.15.19:0/3552171864 learned_addr learned my addr 172.21.15.19:0/3552171864 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc87801a400 con 0x7fc884133510 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc87803f560 con 0x7fc884133510 2023-10-03T10:16:30.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.822+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88409d9b0 con 0x7fc884133510 2023-10-03T10:16:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f3427fff700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f342809e1d0 0x7f3428133ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 -- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f342809e1d0 msgr2=0x7f3428133ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f342809e1d0 0x7f3428133ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 -- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342809d6f0 msgr2=0x7f3428133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342809d6f0 0x7f3428133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 -- 172.21.15.19:0/3552171864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009b30 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.826+0000 7f342d58a700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f342809ea70 tx=0x7f3420004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342001f070 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342809c700 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3428132ed0 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34200092e0 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420003c20 con 0x7f3428135e50 2023-10-03T10:16:30.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.828+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc878021af0 con 0x7fc884133510 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.829+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34080052e0 con 0x7f3428135e50 2023-10-03T10:16:30.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.830+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3420004030 con 0x7f3428135e50 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.830+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3420041290 con 0x7f3428135e50 2023-10-03T10:16:30.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.835+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3420022780 con 0x7f3428135e50 2023-10-03T10:16:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.844+0000 7ff59c0bd700 1 Processor -- start 2023-10-03T10:16:30.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 -- start start 2023-10-03T10:16:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 0x7ff5940a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 0x7ff59413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5940a2a70 con 0x7ff59409d630 2023-10-03T10:16:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940a01d0 con 0x7ff5940a0a30 2023-10-03T10:16:30.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.845+0000 7ff59c0bd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59409e2b0 con 0x7ff594138d80 2023-10-03T10:16:30.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 0x7ff59413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff599658700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff59409d630 0x7ff5940a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57820/0 (socket says 172.21.15.19:57820) 2023-10-03T10:16:30.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff599658700 1 -- 172.21.15.19:0/1868729936 learned_addr learned my addr 172.21.15.19:0/1868729936 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:30.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff599e59700 1 --2- 172.21.15.19:0/1868729936 >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 0x7ff5940a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 -- 172.21.15.19:0/1868729936 >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 msgr2=0x7ff5940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 --2- 172.21.15.19:0/1868729936 >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 0x7ff5940a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 -- 172.21.15.19:0/1868729936 >> v1:172.21.15.19:6789/0 conn(0x7ff59409d630 legacy=0x7ff5940a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff598e57700 1 -- 172.21.15.19:0/1868729936 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994295051 0 0) 0x7ff5940a2a70 con 0x7ff59409d630 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 -- 172.21.15.19:0/1868729936 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59409dc50 con 0x7ff594138d80 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff599e59700 1 --2- 172.21.15.19:0/1868729936 >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 0x7ff5940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.846+0000 7ff59a65a700 1 --2- 172.21.15.19:0/1868729936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 0x7ff59413b160 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009d90 tx=0x7ff58c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e3506ddddd7f6cf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.847+0000 7ff598e57700 1 -- 172.21.15.19:0/1868729936 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00e070 con 0x7ff594138d80 2023-10-03T10:16:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.847+0000 7ff598e57700 1 -- 172.21.15.19:0/1868729936 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00bbd0 con 0x7ff594138d80 2023-10-03T10:16:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.847+0000 7ff598e57700 1 -- 172.21.15.19:0/1868729936 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c012430 con 0x7ff594138d80 2023-10-03T10:16:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.847+0000 7ff59c0bd700 1 -- 172.21.15.19:0/1868729936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 msgr2=0x7ff59413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.847+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/1868729936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 0x7ff59413b160 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009d90 tx=0x7ff58c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:30.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 -- 172.21.15.19:0/1868729936 shutdown_connections 2023-10-03T10:16:30.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/1868729936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594138d80 0x7ff59413b160 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/1868729936 >> v2:172.21.15.19:3300/0 conn(0x7ff5940a0a30 0x7ff5940a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 -- 172.21.15.19:0/1868729936 >> 172.21.15.19:0/1868729936 conn(0x7ff5940a3050 msgr2=0x7ff5940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:30.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 -- 172.21.15.19:0/1868729936 shutdown_connections 2023-10-03T10:16:30.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.848+0000 7ff59c0bd700 1 -- 172.21.15.19:0/1868729936 wait complete. 2023-10-03T10:16:30.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 Processor -- start 2023-10-03T10:16:30.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 -- start start 2023-10-03T10:16:30.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 0x7ff59406f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594138d80 0x7ff5941d49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:30.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff594071090 con 0x7ff5940a0a30 2023-10-03T10:16:30.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5941304b0 con 0x7ff59409d630 2023-10-03T10:16:30.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.849+0000 7ff59c0bd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff59406f530 con 0x7ff594138d80 2023-10-03T10:16:30.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599e59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 0x7ff59406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41102/0 (socket says 172.21.15.19:41102) 2023-10-03T10:16:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599e59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 0x7ff59406f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43778/0 (socket says 172.21.15.19:43778) 2023-10-03T10:16:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 -- 172.21.15.19:0/2356963318 learned_addr learned my addr 172.21.15.19:0/2356963318 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:30.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 -- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594138d80 msgr2=0x7ff5941d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594138d80 0x7ff5941d49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 -- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 msgr2=0x7ff59406f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 0x7ff59406f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 -- 172.21.15.19:0/2356963318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009a70 con 0x7ff5940a0a30 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.850+0000 7ff599658700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff5840011e0 tx=0x7ff58400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:30.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.851+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584004c80 con 0x7ff5940a0a30 2023-10-03T10:16:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.851+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff594070400 con 0x7ff5940a0a30 2023-10-03T10:16:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.851+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5941311c0 con 0x7ff5940a0a30 2023-10-03T10:16:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.851+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584004de0 con 0x7ff5940a0a30 2023-10-03T10:16:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.851+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584007310 con 0x7ff5940a0a30 2023-10-03T10:16:30.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.852+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff584007470 con 0x7ff5940a0a30 2023-10-03T10:16:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.852+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff58403f500 con 0x7ff5940a0a30 2023-10-03T10:16:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.852+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57c0052e0 con 0x7ff5940a0a30 2023-10-03T10:16:30.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:30.862+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff5840123b0 con 0x7ff5940a0a30 2023-10-03T10:16:31.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.038+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc884074ea0 con 0x7fc884133510 2023-10-03T10:16:31.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.039+0000 7fc86bfff700 1 -- 172.21.15.19:0/309926477 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc878028070 con 0x7fc884133510 2023-10-03T10:16:31.039 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 msgr2=0x7fc88411b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 0x7fc88411b790 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fc87800b480 tx=0x7fc87800b790 comp rx=0 tx=0).stop 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 shutdown_connections 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc884135e30 0x7fc88411bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8841305f0 0x7fc88411b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 --2- 172.21.15.19:0/309926477 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc884133510 0x7fc88411b790 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.042+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 >> 172.21.15.19:0/309926477 conn(0x7fc8840a2aa0 msgr2=0x7fc884134380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.043+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 shutdown_connections 2023-10-03T10:16:31.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.043+0000 7fc889ef8700 1 -- 172.21.15.19:0/309926477 wait complete. 2023-10-03T10:16:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.044+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3408005590 con 0x7f3428135e50 2023-10-03T10:16:31.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.044+0000 7f34257fa700 1 -- 172.21.15.19:0/3552171864 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3420015030 con 0x7f3428135e50 2023-10-03T10:16:31.044 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:31.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.045+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f49fc072980 con 0x7f49fc09d630 2023-10-03T10:16:31.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.046+0000 7f49f97fa700 1 -- 172.21.15.19:0/1615537243 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49f0021020 con 0x7f49fc09d630 2023-10-03T10:16:31.046 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 msgr2=0x7f3428134530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f342809ea70 tx=0x7f3420004b40 comp rx=0 tx=0).stop 2023-10-03T10:16:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 shutdown_connections 2023-10-03T10:16:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3428135e50 0x7f3428134530 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f342809d6f0 0x7f3428133ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 --2- 172.21.15.19:0/3552171864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f342809e1d0 0x7f3428133ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 >> 172.21.15.19:0/3552171864 conn(0x7f3428066f50 msgr2=0x7f34280a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 shutdown_connections 2023-10-03T10:16:31.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.047+0000 7f342efed700 1 -- 172.21.15.19:0/3552171864 wait complete. 2023-10-03T10:16:31.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.049+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 msgr2=0x7f49fc133930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.049+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f49f000ebe0 tx=0x7f49f000eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 shutdown_connections 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49fc138d80 0x7f49fc1343b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49fc09d630 0x7f49fc133930 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 --2- 172.21.15.19:0/1615537243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49fc0a0a30 0x7f49fc133e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 >> 172.21.15.19:0/1615537243 conn(0x7f49fc0a3050 msgr2=0x7f49fc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 shutdown_connections 2023-10-03T10:16:31.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.050+0000 7f4a02f7e700 1 -- 172.21.15.19:0/1615537243 wait complete. 2023-10-03T10:16:31.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:31.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:31.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.076+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff57c005150 con 0x7ff5940a0a30 2023-10-03T10:16:31.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.076+0000 7ff58a7fc700 1 -- 172.21.15.19:0/2356963318 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff584011360 con 0x7ff5940a0a30 2023-10-03T10:16:31.077 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 msgr2=0x7ff59406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7ff5840011e0 tx=0x7ff58400ca30 comp rx=0 tx=0).stop 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 shutdown_connections 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594138d80 0x7ff5941d49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff59409d630 0x7ff59406f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 --2- 172.21.15.19:0/2356963318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5940a0a30 0x7ff59406fec0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 >> 172.21.15.19:0/2356963318 conn(0x7ff5940a3050 msgr2=0x7ff59412ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 shutdown_connections 2023-10-03T10:16:31.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:31.079+0000 7ff59c0bd700 1 -- 172.21.15.19:0/2356963318 wait complete. 2023-10-03T10:16:31.092 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:32.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:32.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:32.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:32.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:32.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 Processor -- start 2023-10-03T10:16:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 -- start start 2023-10-03T10:16:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 0x7fb9f813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f8070ee0 con 0x7fb9f806e570 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f8071980 con 0x7fb9f809eca0 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9fde79700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f8071480 con 0x7fb9f806f050 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9f6ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 0x7fb9f813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.217+0000 7fb9f7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f6ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 0x7fb9f813cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41104/0 (socket says 172.21.15.19:41104) 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43784/0 (socket says 172.21.15.19:43784) 2023-10-03T10:16:32.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f6ffd700 1 -- 172.21.15.19:0/1686733305 learned_addr learned my addr 172.21.15.19:0/1686733305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 -- 172.21.15.19:0/1686733305 >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 msgr2=0x7fb9f813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 --2- 172.21.15.19:0/1686733305 >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 0x7fb9f813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 -- 172.21.15.19:0/1686733305 >> v1:172.21.15.19:6789/0 conn(0x7fb9f806e570 legacy=0x7fb9f806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 -- 172.21.15.19:0/1686733305 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8071b90 con 0x7fb9f806f050 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f7fff700 1 --2- 172.21.15.19:0/1686733305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009d90 tx=0x7fb9f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75ea5603ffc2aa5a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f67fc700 1 -- 172.21.15.19:0/1686733305 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f000e070 con 0x7fb9f806f050 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f67fc700 1 -- 172.21.15.19:0/1686733305 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f000bb20 con 0x7fb9f806f050 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.218+0000 7fb9f67fc700 1 -- 172.21.15.19:0/1686733305 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0012430 con 0x7fb9f806f050 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 -- 172.21.15.19:0/1686733305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 msgr2=0x7fb9f813f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 --2- 172.21.15.19:0/1686733305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009d90 tx=0x7fb9f000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 -- 172.21.15.19:0/1686733305 shutdown_connections 2023-10-03T10:16:32.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 --2- 172.21.15.19:0/1686733305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813f3f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 --2- 172.21.15.19:0/1686733305 >> v2:172.21.15.19:3300/0 conn(0x7fb9f809eca0 0x7fb9f813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 -- 172.21.15.19:0/1686733305 >> 172.21.15.19:0/1686733305 conn(0x7fb9f80a2aa0 msgr2=0x7fb9f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 -- 172.21.15.19:0/1686733305 shutdown_connections 2023-10-03T10:16:32.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.219+0000 7fb9fde79700 1 -- 172.21.15.19:0/1686733305 wait complete. 2023-10-03T10:16:32.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.221+0000 7fb9fde79700 1 Processor -- start 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.221+0000 7fb9fde79700 1 -- start start 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f806e570 0x7fb9f813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f813d8b0 0x7fb9f812adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f812c010 con 0x7fb9f806e570 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f812de70 con 0x7fb9f806f050 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9fde79700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f80a2350 con 0x7fb9f813d8b0 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43788/0 (socket says 172.21.15.19:43788) 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 -- 172.21.15.19:0/2341644865 learned_addr learned my addr 172.21.15.19:0/2341644865 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f77fe700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f806e570 0x7fb9f813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f7fff700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f813d8b0 0x7fb9f812adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 -- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f813d8b0 msgr2=0x7fb9f812adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f813d8b0 0x7fb9f812adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 -- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f806e570 msgr2=0x7fb9f813ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f806e570 0x7fb9f813ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.222+0000 7fb9f6ffd700 1 -- 172.21.15.19:0/2341644865 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f0009a70 con 0x7fb9f806f050 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9f6ffd700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e940 tx=0x7fb9ec00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec013680 con 0x7fb9f806f050 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0137e0 con 0x7fb9f806f050 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec013b70 con 0x7fb9f806f050 2023-10-03T10:16:32.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f812d110 con 0x7fb9f806f050 2023-10-03T10:16:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.223+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f812c640 con 0x7fb9f806f050 2023-10-03T10:16:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.224+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9ec013cd0 con 0x7fb9f806f050 2023-10-03T10:16:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.224+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9ec03f690 con 0x7fb9f806f050 2023-10-03T10:16:32.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.224+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f813dcb0 con 0x7fb9f806f050 2023-10-03T10:16:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.225+0000 7fb118d18700 1 Processor -- start 2023-10-03T10:16:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.226+0000 7fb118d18700 1 -- start start 2023-10-03T10:16:32.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.226+0000 7fb118d18700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb11412cf60 0x7fb11406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb118d18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 0x7fb11412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb118d18700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11412cd90 con 0x7fb114130260 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb118d18700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11412d330 con 0x7fb11412cf60 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb118d18700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1141306d0 con 0x7fb11412f8b0 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb11412cf60 0x7fb11406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb112d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb114130260 0x7fb114136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57850/0 (socket says 172.21.15.19:57850) 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb112d9d700 1 -- 172.21.15.19:0/2875948030 learned_addr learned my addr 172.21.15.19:0/2875948030 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:32.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb111d9b700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 0x7fb11412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 -- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 msgr2=0x7fb11412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 0x7fb11412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11159a700 1 -- 172.21.15.19:0/2875948030 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884303869 0 0) 0x7fb11412cd90 con 0x7fb114130260 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 -- 172.21.15.19:0/2875948030 >> v1:172.21.15.19:6789/0 conn(0x7fb114130260 legacy=0x7fb114136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 -- 172.21.15.19:0/2875948030 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb114071780 con 0x7fb11412cf60 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb111d9b700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 0x7fb11412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.227+0000 7fb11259c700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb11412cf60 0x7fb11406f5d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb10400dd90 tx=0x7fb10400f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc2032ad7b4ad0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb11159a700 1 -- 172.21.15.19:0/2875948030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104012070 con 0x7fb11412cf60 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb11159a700 1 -- 172.21.15.19:0/2875948030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10400fbd0 con 0x7fb11412cf60 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb11159a700 1 -- 172.21.15.19:0/2875948030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb104016430 con 0x7fb11412cf60 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb118d18700 1 -- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb11412cf60 msgr2=0x7fb11406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb118d18700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb11412cf60 0x7fb11406f5d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb10400dd90 tx=0x7fb10400f330 comp rx=0 tx=0).stop 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.228+0000 7fb118d18700 1 -- 172.21.15.19:0/2875948030 shutdown_connections 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.229+0000 7fb118d18700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb11412cf60 0x7fb11406f5d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.229+0000 7fb118d18700 1 --2- 172.21.15.19:0/2875948030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412f8b0 0x7fb11412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.229+0000 7fb118d18700 1 -- 172.21.15.19:0/2875948030 >> 172.21.15.19:0/2875948030 conn(0x7fb1140a2aa0 msgr2=0x7fb1140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.229+0000 7fb118d18700 1 -- 172.21.15.19:0/2875948030 shutdown_connections 2023-10-03T10:16:32.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.229+0000 7fb118d18700 1 -- 172.21.15.19:0/2875948030 wait complete. 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 Processor -- start 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 -- start start 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 0x7fb11409b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 0x7fb11409be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 0x7fb1141c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11409e8f0 con 0x7fb114130260 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11409d8e0 con 0x7fb11412cf60 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.230+0000 7fb118d18700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb11409b490 con 0x7fb11412f8b0 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb11259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 0x7fb11409b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb11259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 0x7fb11409b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43800/0 (socket says 172.21.15.19:43800) 2023-10-03T10:16:32.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb11259c700 1 -- 172.21.15.19:0/1197233133 learned_addr learned my addr 172.21.15.19:0/1197233133 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 0x7fb11409be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb112d9d700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 0x7fb1141c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9ec00c970 con 0x7fb9f806f050 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 -- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 msgr2=0x7fb11409b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 0x7fb11409b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 -- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 msgr2=0x7fb1141c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 0x7fb1141c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 -- 172.21.15.19:0/1197233133 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10400da70 con 0x7fb11412f8b0 2023-10-03T10:16:32.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb112d9d700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 0x7fb1141c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.231+0000 7fb111d9b700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 0x7fb11409be50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb10800c820 tx=0x7fb10800cb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.232+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108011800 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.232+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb108011960 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.232+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb114067be0 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.232+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108011cf0 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.232+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11409cbc0 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.233+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb108018360 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.233+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb114074ea0 con 0x7fb11412f8b0 2023-10-03T10:16:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.233+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb10803f5b0 con 0x7fb11412f8b0 2023-10-03T10:16:32.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.242+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb108018610 con 0x7fb11412f8b0 2023-10-03T10:16:32.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.261+0000 7fa100cce700 1 Processor -- start 2023-10-03T10:16:32.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.261+0000 7fa100cce700 1 -- start start 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa100cce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa100cce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa0fc136d80 0x7fa0fc139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa100cce700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc09ece0 con 0x7fa0fc06a770 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa100cce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc06b640 con 0x7fa0fc136d80 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa100cce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc09e760 con 0x7fa0fc06b250 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa0f9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa0fa59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa0fc06a770 0x7fa0fc06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57862/0 (socket says 172.21.15.19:57862) 2023-10-03T10:16:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.262+0000 7fa0fa59c700 1 -- 172.21.15.19:0/3709287783 learned_addr learned my addr 172.21.15.19:0/3709287783 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0fad9d700 1 --2- 172.21.15.19:0/3709287783 >> v2:172.21.15.19:3300/0 conn(0x7fa0fc136d80 0x7fa0fc139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f9d9b700 1 -- 172.21.15.19:0/3709287783 >> v2:172.21.15.19:3300/0 conn(0x7fa0fc136d80 msgr2=0x7fa0fc139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f9d9b700 1 --2- 172.21.15.19:0/3709287783 >> v2:172.21.15.19:3300/0 conn(0x7fa0fc136d80 0x7fa0fc139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f9d9b700 1 -- 172.21.15.19:0/3709287783 >> v1:172.21.15.19:6789/0 conn(0x7fa0fc06a770 legacy=0x7fa0fc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f9d9b700 1 -- 172.21.15.19:0/3709287783 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc09e040 con 0x7fa0fc06b250 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f9d9b700 1 --2- 172.21.15.19:0/3709287783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc136840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009840 tx=0x7fa0f0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=735fbdb4d7c233e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f959a700 1 -- 172.21.15.19:0/3709287783 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011830 con 0x7fa0fc06b250 2023-10-03T10:16:32.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f959a700 1 -- 172.21.15.19:0/3709287783 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0011990 con 0x7fa0fc06b250 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.263+0000 7fa0f959a700 1 -- 172.21.15.19:0/3709287783 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0011d20 con 0x7fa0fc06b250 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 -- 172.21.15.19:0/3709287783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 msgr2=0x7fa0fc136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 --2- 172.21.15.19:0/3709287783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc136840 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0f0009840 tx=0x7fa0f0009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 -- 172.21.15.19:0/3709287783 shutdown_connections 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 --2- 172.21.15.19:0/3709287783 >> v2:172.21.15.19:3300/0 conn(0x7fa0fc136d80 0x7fa0fc139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 --2- 172.21.15.19:0/3709287783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc136840 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 -- 172.21.15.19:0/3709287783 >> 172.21.15.19:0/3709287783 conn(0x7fa0fc066f50 msgr2=0x7fa0fc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 -- 172.21.15.19:0/3709287783 shutdown_connections 2023-10-03T10:16:32.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.264+0000 7fa100cce700 1 -- 172.21.15.19:0/3709287783 wait complete. 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.265+0000 7fa100cce700 1 Processor -- start 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.265+0000 7fa100cce700 1 -- start start 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 0x7fa0fc11d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc11d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 0x7fa0fc1c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc11ce00 con 0x7fa0fc136d80 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc11fdd0 con 0x7fa0fc06b250 2023-10-03T10:16:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa100cce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc11fb90 con 0x7fa0fc06a770 2023-10-03T10:16:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa0fad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 0x7fa0fc1c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa0fa59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 0x7fa0fc11d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa0f9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc11d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa0fad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 0x7fa0fc1c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41166/0 (socket says 172.21.15.19:41166) 2023-10-03T10:16:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.266+0000 7fa0fad9d700 1 -- 172.21.15.19:0/2835863038 learned_addr learned my addr 172.21.15.19:0/2835863038 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 -- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 msgr2=0x7fa0fc11d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc11d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 -- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 msgr2=0x7fa0fc1c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 0x7fa0fc1c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 -- 172.21.15.19:0/2835863038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f00094a0 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0f9d9b700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc11d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0fa59c700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 0x7fa0fc11d120 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00c500 tx=0x7fa0ec00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec005d70 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec0070d0 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc120370 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec007440 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.267+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc120b00 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.268+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc074ea0 con 0x7fa0fc06a770 2023-10-03T10:16:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.269+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa0ec0075a0 con 0x7fa0fc06a770 2023-10-03T10:16:32.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.269+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa0ec03ef40 con 0x7fa0fc06a770 2023-10-03T10:16:32.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.269+0000 7fe750c40700 1 Processor -- start 2023-10-03T10:16:32.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.269+0000 7fe750c40700 1 -- start start 2023-10-03T10:16:32.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.270+0000 7fe750c40700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe74c130670 0x7fe74c130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.270+0000 7fe750c40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 0x7fe74c06fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.270+0000 7fe750c40700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c130260 con 0x7fe74c06ffd0 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.270+0000 7fe750c40700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c071ff0 con 0x7fe74c130670 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.270+0000 7fe750c40700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c09ecf0 con 0x7fe74c06f680 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe74c130670 0x7fe74c130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe74c130670 0x7fe74c130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41168/0 (socket says 172.21.15.19:41168) 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 -- 172.21.15.19:0/1372889489 learned_addr learned my addr 172.21.15.19:0/1372889489 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe749d9b700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 0x7fe74c06fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 -- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 msgr2=0x7fe74c06fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 0x7fe74c06fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 -- 172.21.15.19:0/1372889489 >> v1:172.21.15.19:6789/0 conn(0x7fe74c06ffd0 legacy=0x7fe74c137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 -- 172.21.15.19:0/1372889489 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c070e70 con 0x7fe74c130670 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74959a700 1 -- 172.21.15.19:0/1372889489 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255206199 0 0) 0x7fe74c130260 con 0x7fe74c06ffd0 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe749d9b700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 0x7fe74c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.271+0000 7fe74a59c700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c130670 0x7fe74c130a40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b9a0 tx=0x7fe73c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee2cf755dbc7d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe74959a700 1 -- 172.21.15.19:0/1372889489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00cc60 con 0x7fe74c130670 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe74959a700 1 -- 172.21.15.19:0/1372889489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00cdc0 con 0x7fe74c130670 2023-10-03T10:16:32.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe74959a700 1 -- 172.21.15.19:0/1372889489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00f680 con 0x7fe74c130670 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 -- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c130670 msgr2=0x7fe74c130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c130670 0x7fe74c130a40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b9a0 tx=0x7fe73c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 -- 172.21.15.19:0/1372889489 shutdown_connections 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c130670 0x7fe74c130a40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 --2- 172.21.15.19:0/1372889489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c06f680 0x7fe74c06fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.272+0000 7fe750c40700 1 -- 172.21.15.19:0/1372889489 >> 172.21.15.19:0/1372889489 conn(0x7fe74c0a2aa0 msgr2=0x7fe74c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.273+0000 7fe750c40700 1 -- 172.21.15.19:0/1372889489 shutdown_connections 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.273+0000 7fe750c40700 1 -- 172.21.15.19:0/1372889489 wait complete. 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 Processor -- start 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 -- start start 2023-10-03T10:16:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 0x7fe74c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 0x7fe74c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c11c910 con 0x7fe74c06ffd0 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c11bf50 con 0x7fe74c130670 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe750c40700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c11b320 con 0x7fe74c06f680 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.274+0000 7fe74a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36220/0 (socket says 172.21.15.19:36220) 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 -- 172.21.15.19:0/1972279494 learned_addr learned my addr 172.21.15.19:0/1972279494 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe749d9b700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 0x7fe74c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 -- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 msgr2=0x7fe74c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74ad9d700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 0x7fe74c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:32.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa0ec019b40 con 0x7fa0fc06a770 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 0x7fe74c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 -- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 msgr2=0x7fe74c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 0x7fe74c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 -- 172.21.15.19:0/1972279494 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c00b600 con 0x7fe74c06f680 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe749d9b700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 0x7fe74c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74a59c700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b340 tx=0x7fe73c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.275+0000 7fe74ad9d700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 0x7fe74c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.276+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c01c070 con 0x7fe74c06f680 2023-10-03T10:16:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.276+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c004050 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.276+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe74c12eb40 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.276+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c11a060 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.276+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0043e0 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.277+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7300052e0 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.277+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe73c0036a0 con 0x7fe74c06f680 2023-10-03T10:16:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.277+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe73c003e70 con 0x7fe74c06f680 2023-10-03T10:16:32.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.282+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe73c041e60 con 0x7fe74c06f680 2023-10-03T10:16:32.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.455+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb11409e750 con 0x7fb11412f8b0 2023-10-03T10:16:32.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.456+0000 7fb102ffd700 1 -- 172.21.15.19:0/1197233133 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb11409e750 con 0x7fb11412f8b0 2023-10-03T10:16:32.456 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 msgr2=0x7fb11409be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 0x7fb11409be50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb10800c820 tx=0x7fb10800cb30 comp rx=0 tx=0).stop 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 shutdown_connections 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb114130260 0x7fb1141c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb11412cf60 0x7fb11409b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 --2- 172.21.15.19:0/1197233133 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb11412f8b0 0x7fb11409be50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 >> 172.21.15.19:0/1197233133 conn(0x7fb1140a2aa0 msgr2=0x7fb1140a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 shutdown_connections 2023-10-03T10:16:32.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.458+0000 7fb118d18700 1 -- 172.21.15.19:0/1197233133 wait complete. 2023-10-03T10:16:32.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.463+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9f8070610 con 0x7fb9f806f050 2023-10-03T10:16:32.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.464+0000 7fb9dffff700 1 -- 172.21.15.19:0/2341644865 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9ec021020 con 0x7fb9f806f050 2023-10-03T10:16:32.464 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:32.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 msgr2=0x7fb9f813d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00e940 tx=0x7fb9ec00ec50 comp rx=0 tx=0).stop 2023-10-03T10:16:32.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 shutdown_connections 2023-10-03T10:16:32.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f813d8b0 0x7fb9f812adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f806e570 0x7fb9f813ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 --2- 172.21.15.19:0/2341644865 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f806f050 0x7fb9f813d370 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 >> 172.21.15.19:0/2341644865 conn(0x7fb9f80a2aa0 msgr2=0x7fb9f809cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 shutdown_connections 2023-10-03T10:16:32.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.468+0000 7fb9fde79700 1 -- 172.21.15.19:0/2341644865 wait complete. 2023-10-03T10:16:32.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:32.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:32.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.493+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe730005150 con 0x7fe74c06f680 2023-10-03T10:16:32.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.493+0000 7fe73affd700 1 -- 172.21.15.19:0/1972279494 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe73c026030 con 0x7fe74c06f680 2023-10-03T10:16:32.493 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 msgr2=0x7fe74c118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b340 tx=0x7fe73c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 shutdown_connections 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe74c130670 0x7fe74c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe74c06f680 0x7fe74c118cd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 --2- 172.21.15.19:0/1972279494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe74c06ffd0 0x7fe74c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 >> 172.21.15.19:0/1972279494 conn(0x7fe74c0a2aa0 msgr2=0x7fe74c12d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 shutdown_connections 2023-10-03T10:16:32.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.496+0000 7fe750c40700 1 -- 172.21.15.19:0/1972279494 wait complete. 2023-10-03T10:16:32.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.506+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0fc071510 con 0x7fa0fc06a770 2023-10-03T10:16:32.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.506+0000 7fa0eaffd700 1 -- 172.21.15.19:0/2835863038 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa0ec017030 con 0x7fa0fc06a770 2023-10-03T10:16:32.506 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.510+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 msgr2=0x7fa0fc11d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:32.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.510+0000 7fa100cce700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 0x7fa0fc11d120 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00c500 tx=0x7fa0ec00c810 comp rx=0 tx=0).stop 2023-10-03T10:16:32.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 shutdown_connections 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0fc136d80 0x7fa0fc1c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa0fc06a770 0x7fa0fc11d120 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 --2- 172.21.15.19:0/2835863038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa0fc06b250 0x7fa0fc11d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:32.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 >> 172.21.15.19:0/2835863038 conn(0x7fa0fc066f50 msgr2=0x7fa0fc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 shutdown_connections 2023-10-03T10:16:32.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:32.511+0000 7fa100cce700 1 -- 172.21.15.19:0/2835863038 wait complete. 2023-10-03T10:16:32.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:33.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:33.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:33.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:33.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:33.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.640+0000 7fbadc319700 1 Processor -- start 2023-10-03T10:16:33.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.640+0000 7fbadc319700 1 -- start start 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbadc319700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbad409e930 0x7fbad409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbadc319700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 0x7fbad4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbadc319700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad4070940 con 0x7fbad409f240 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbadc319700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad406fd60 con 0x7fbad409e930 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbadc319700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad406fa80 con 0x7fbad409f650 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbad98b4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbad409f240 0x7fbad41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57876/0 (socket says 172.21.15.19:57876) 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada0b5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbad409e930 0x7fbad409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada8b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 0x7fbad4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbad98b4700 1 -- 172.21.15.19:0/3586435600 learned_addr learned my addr 172.21.15.19:0/3586435600 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada8b6700 1 -- 172.21.15.19:0/3586435600 >> v2:172.21.15.19:3300/0 conn(0x7fbad409e930 msgr2=0x7fbad409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada8b6700 1 --2- 172.21.15.19:0/3586435600 >> v2:172.21.15.19:3300/0 conn(0x7fbad409e930 0x7fbad409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada8b6700 1 -- 172.21.15.19:0/3586435600 >> v1:172.21.15.19:6789/0 conn(0x7fbad409f240 legacy=0x7fbad41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbada8b6700 1 -- 172.21.15.19:0/3586435600 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad409fb60 con 0x7fbad409f650 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.641+0000 7fbad90b3700 1 -- 172.21.15.19:0/3586435600 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 456964020 0 0) 0x7fbad4070940 con 0x7fbad409f240 2023-10-03T10:16:33.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.642+0000 7fbada8b6700 1 --2- 172.21.15.19:0/3586435600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 0x7fbad4131f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbacc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b24124a6dc98d14f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.642+0000 7fbad90b3700 1 -- 172.21.15.19:0/3586435600 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00e070 con 0x7fbad409f650 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.642+0000 7fbad90b3700 1 -- 172.21.15.19:0/3586435600 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc00bb20 con 0x7fbad409f650 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.642+0000 7fbad90b3700 1 -- 172.21.15.19:0/3586435600 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012430 con 0x7fbad409f650 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 -- 172.21.15.19:0/3586435600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 msgr2=0x7fbad4131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 --2- 172.21.15.19:0/3586435600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 0x7fbad4131f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbacc009d90 tx=0x7fbacc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 -- 172.21.15.19:0/3586435600 shutdown_connections 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 --2- 172.21.15.19:0/3586435600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f650 0x7fbad4131f00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 --2- 172.21.15.19:0/3586435600 >> v2:172.21.15.19:3300/0 conn(0x7fbad409e930 0x7fbad409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 -- 172.21.15.19:0/3586435600 >> 172.21.15.19:0/3586435600 conn(0x7fbad40a4210 msgr2=0x7fbad40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 -- 172.21.15.19:0/3586435600 shutdown_connections 2023-10-03T10:16:33.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.643+0000 7fbadc319700 1 -- 172.21.15.19:0/3586435600 wait complete. 2023-10-03T10:16:33.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.644+0000 7fbadc319700 1 Processor -- start 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 -- start start 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbad409e930 0x7fbad41a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 0x7fbad41a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41a7250 con 0x7fbad409f650 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41a6730 con 0x7fbad409f240 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.645+0000 7fbadc319700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41a6f90 con 0x7fbad409e930 2023-10-03T10:16:33.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41188/0 (socket says 172.21.15.19:41188) 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 -- 172.21.15.19:0/3250611831 learned_addr learned my addr 172.21.15.19:0/3250611831 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada0b5700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbad409e930 0x7fbad41a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbad98b4700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 0x7fbad41a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 -- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbad409e930 msgr2=0x7fbad41a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbad409e930 0x7fbad41a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 -- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 msgr2=0x7fbad41a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 0x7fbad41a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 -- 172.21.15.19:0/3250611831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc009a70 con 0x7fbad409f650 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbad98b4700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 0x7fbad41a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.646+0000 7fbada8b6700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbad406fbc0 tx=0x7fbacc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012430 con 0x7fbad409f650 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc020070 con 0x7fbad409f650 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad40a0190 con 0x7fbad409f650 2023-10-03T10:16:33.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004280 con 0x7fbad409f650 2023-10-03T10:16:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad41a6290 con 0x7fbad409f650 2023-10-03T10:16:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.647+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbacc0043e0 con 0x7fbad409f650 2023-10-03T10:16:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.648+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbacc022070 con 0x7fbad409f650 2023-10-03T10:16:33.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.648+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad41a6ca0 con 0x7fbad409f650 2023-10-03T10:16:33.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.653+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbacc027480 con 0x7fbad409f650 2023-10-03T10:16:33.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.674+0000 7f8a7b32b700 1 Processor -- start 2023-10-03T10:16:33.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.675+0000 7f8a7b32b700 1 -- start start 2023-10-03T10:16:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.675+0000 7f8a7b32b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409d6f0 0x7f8a7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.675+0000 7f8a7b32b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a7409e000 0x7f8a741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a7b32b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a7b32b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7406b460 con 0x7f8a7409e000 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a7b32b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7409b120 con 0x7f8a7409d6f0 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a7b32b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7409a7e0 con 0x7f8a7409e410 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a7409e000 0x7f8a741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8a7409e000 0x7f8a741339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41192/0 (socket says 172.21.15.19:41192) 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 -- 172.21.15.19:0/246801903 learned_addr learned my addr 172.21.15.19:0/246801903 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a790c7700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409d6f0 0x7f8a7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 -- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 msgr2=0x7f8a74133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 -- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409d6f0 msgr2=0x7f8a7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409d6f0 0x7f8a7409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 -- 172.21.15.19:0/246801903 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7409a500 con 0x7f8a7409e000 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.676+0000 7f8a788c6700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409e000 0x7f8a741339f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a640098f0 tx=0x7f8a64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb2dd39e8eafb9b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.677+0000 7f8a6bfff700 1 -- 172.21.15.19:0/246801903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011830 con 0x7f8a7409e000 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.677+0000 7f8a6bfff700 1 -- 172.21.15.19:0/246801903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a64011990 con 0x7f8a7409e000 2023-10-03T10:16:33.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.677+0000 7f8a6bfff700 1 -- 172.21.15.19:0/246801903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011d20 con 0x7f8a7409e000 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 -- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409e000 msgr2=0x7f8a741339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409e000 0x7f8a741339f0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f8a640098f0 tx=0x7f8a64009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 -- 172.21.15.19:0/246801903 shutdown_connections 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409d6f0 0x7f8a7409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/246801903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409e000 0x7f8a741339f0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 -- 172.21.15.19:0/246801903 >> 172.21.15.19:0/246801903 conn(0x7f8a74066f50 msgr2=0x7f8a7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 -- 172.21.15.19:0/246801903 shutdown_connections 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.678+0000 7f8a7b32b700 1 -- 172.21.15.19:0/246801903 wait complete. 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 Processor -- start 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 -- start start 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 0x7f8a74122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74125c10 con 0x7f8a7409d6f0 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a74133290 con 0x7f8a7409e000 2023-10-03T10:16:33.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a7b32b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a741261b0 con 0x7f8a7409e410 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.679+0000 7f8a790c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a790c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41202/0 (socket says 172.21.15.19:41202) 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a790c7700 1 -- 172.21.15.19:0/3461299437 learned_addr learned my addr 172.21.15.19:0/3461299437 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 0x7f8a74122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a798c8700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 -- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 msgr2=0x7f8a74123190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74123190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 -- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 msgr2=0x7f8a74122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 -- 172.21.15.19:0/3461299437 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a64009550 con 0x7f8a7409e000 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a790c7700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a788c6700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 0x7f8a74122c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8a7406e510 tx=0x7f8a64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.680+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64004300 con 0x7f8a7409e000 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.681+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6401f070 con 0x7f8a7409e000 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.681+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a640036a0 con 0x7f8a7409e000 2023-10-03T10:16:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.681+0000 7f35edba5700 1 Processor -- start 2023-10-03T10:16:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.681+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a740721e0 con 0x7f8a7409e000 2023-10-03T10:16:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.681+0000 7f35edba5700 1 -- start start 2023-10-03T10:16:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a74125ed0 con 0x7f8a7409e000 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35edba5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e806f5d0 0x7f35e812cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35edba5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35e8066880 0x7f35e812ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35edba5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e812d2d0 con 0x7f35e8066410 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35edba5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e8071780 con 0x7f35e8066880 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35edba5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35e806f9a0 con 0x7f35e806f5d0 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35e8066880 0x7f35e812ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e6ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35e8066410 0x7f35e812f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57878/0 (socket says 172.21.15.19:57878) 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e6ffd700 1 -- 172.21.15.19:0/77098345 learned_addr learned my addr 172.21.15.19:0/77098345 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:33.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35e8066880 0x7f35e812ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41208/0 (socket says 172.21.15.19:41208) 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 -- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e806f5d0 msgr2=0x7f35e812cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 --2- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e806f5d0 0x7f35e812cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 -- 172.21.15.19:0/77098345 >> v1:172.21.15.19:6789/0 conn(0x7f35e8066410 legacy=0x7f35e812f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e67fc700 1 -- 172.21.15.19:0/77098345 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807554901 0 0) 0x7f35e812d2d0 con 0x7f35e8066410 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.682+0000 7f35e7fff700 1 -- 172.21.15.19:0/77098345 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8071a40 con 0x7f35e8066880 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.683+0000 7f35e7fff700 1 --2- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8066880 0x7f35e812ffc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd57488ae589c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.683+0000 7f35e67fc700 1 -- 172.21.15.19:0/77098345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000e070 con 0x7f35e8066880 2023-10-03T10:16:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.683+0000 7f35e67fc700 1 -- 172.21.15.19:0/77098345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e000bbd0 con 0x7f35e8066880 2023-10-03T10:16:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.683+0000 7f35e67fc700 1 -- 172.21.15.19:0/77098345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0012430 con 0x7f35e8066880 2023-10-03T10:16:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.683+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a74074ea0 con 0x7f8a7409e000 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 -- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8066880 msgr2=0x7f35e812ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 --2- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8066880 0x7f35e812ffc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009d90 tx=0x7f35e000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 -- 172.21.15.19:0/77098345 shutdown_connections 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 --2- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e8066880 0x7f35e812ffc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 --2- 172.21.15.19:0/77098345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e806f5d0 0x7f35e812cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 -- 172.21.15.19:0/77098345 >> 172.21.15.19:0/77098345 conn(0x7f35e80a2aa0 msgr2=0x7f35e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 -- 172.21.15.19:0/77098345 shutdown_connections 2023-10-03T10:16:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.684+0000 7f35edba5700 1 -- 172.21.15.19:0/77098345 wait complete. 2023-10-03T10:16:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.685+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8a64021030 con 0x7f8a7409e000 2023-10-03T10:16:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.685+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8a64040cd0 con 0x7f8a7409e000 2023-10-03T10:16:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.685+0000 7f35edba5700 1 Processor -- start 2023-10-03T10:16:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 -- start start 2023-10-03T10:16:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35e8066880 0x7f35e8099d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 0x7f35e809a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e809ebd0 con 0x7f35e806f5d0 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e809c850 con 0x7f35e8066880 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35edba5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35e809b8c0 con 0x7f35e8066410 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35e77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36270/0 (socket says 172.21.15.19:36270) 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.686+0000 7f35e77fe700 1 -- 172.21.15.19:0/2798639755 learned_addr learned my addr 172.21.15.19:0/2798639755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e7fff700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 0x7f35e809a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e77fe700 1 -- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35e8066880 msgr2=0x7f35e8099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e77fe700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35e8066880 0x7f35e8099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e77fe700 1 -- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 msgr2=0x7f35e809a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e77fe700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 0x7f35e809a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e77fe700 1 -- 172.21.15.19:0/2798639755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009a70 con 0x7f35e8066410 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.687+0000 7f35e7fff700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 0x7f35e809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:33.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.690+0000 7f35e77fe700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b560 tx=0x7f35d800b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.690+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8a640239c0 con 0x7f8a7409e000 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.693+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8011830 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.693+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d80119b0 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.693+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8011d60 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.693+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e809fef0 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.693+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e813db30 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.694+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e809c210 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.694+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35d801a400 con 0x7f35e8066410 2023-10-03T10:16:33.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.694+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f35d803f770 con 0x7f35e8066410 2023-10-03T10:16:33.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.704+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35d800f8d0 con 0x7f35e8066410 2023-10-03T10:16:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.713+0000 7fde89045700 1 Processor -- start 2023-10-03T10:16:33.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.713+0000 7fde89045700 1 -- start start 2023-10-03T10:16:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.713+0000 7fde89045700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.713+0000 7fde89045700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 0x7fde84130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.713+0000 7fde89045700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8409f130 con 0x7fde8409e410 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde89045700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde8409f520 con 0x7fde8409e000 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde89045700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8409e930 con 0x7fde8409d6f0 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43912/0 (socket says 172.21.15.19:43912) 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 -- 172.21.15.19:0/795505995 learned_addr learned my addr 172.21.15.19:0/795505995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde8259c700 1 --2- 172.21.15.19:0/795505995 >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 0x7fde84130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 -- 172.21.15.19:0/795505995 >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 msgr2=0x7fde84130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 --2- 172.21.15.19:0/795505995 >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 0x7fde84130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 -- 172.21.15.19:0/795505995 >> v1:172.21.15.19:6789/0 conn(0x7fde8409e410 legacy=0x7fde84130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde81d9b700 1 -- 172.21.15.19:0/795505995 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3734728422 0 0) 0x7fde8409f130 con 0x7fde8409e410 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 -- 172.21.15.19:0/795505995 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8409b2d0 con 0x7fde8409d6f0 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde8259c700 1 --2- 172.21.15.19:0/795505995 >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 0x7fde84130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.714+0000 7fde82d9d700 1 --2- 172.21.15.19:0/795505995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde74006ef0 tx=0x7fde7400dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e861afcca936371d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde81d9b700 1 -- 172.21.15.19:0/795505995 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74005c20 con 0x7fde8409d6f0 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde81d9b700 1 -- 172.21.15.19:0/795505995 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde74005d80 con 0x7fde8409d6f0 2023-10-03T10:16:33.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde81d9b700 1 -- 172.21.15.19:0/795505995 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74016a90 con 0x7fde8409d6f0 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde89045700 1 -- 172.21.15.19:0/795505995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 msgr2=0x7fde8409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde89045700 1 --2- 172.21.15.19:0/795505995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fde74006ef0 tx=0x7fde7400dcf0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde89045700 1 -- 172.21.15.19:0/795505995 shutdown_connections 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde89045700 1 --2- 172.21.15.19:0/795505995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8409dac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.715+0000 7fde89045700 1 --2- 172.21.15.19:0/795505995 >> v2:172.21.15.19:3300/0 conn(0x7fde8409e000 0x7fde84130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.716+0000 7fde89045700 1 -- 172.21.15.19:0/795505995 >> 172.21.15.19:0/795505995 conn(0x7fde84066f50 msgr2=0x7fde8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.716+0000 7fde89045700 1 -- 172.21.15.19:0/795505995 shutdown_connections 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.716+0000 7fde89045700 1 -- 172.21.15.19:0/795505995 wait complete. 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.717+0000 7fde89045700 1 Processor -- start 2023-10-03T10:16:33.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.717+0000 7fde89045700 1 -- start start 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde8409e000 0x7fde8411e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde8409e410 0x7fde8411ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde84120590 con 0x7fde8409e000 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8411f5f0 con 0x7fde8409d6f0 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde89045700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde8409c700 con 0x7fde8409e410 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde82d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde82d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43918/0 (socket says 172.21.15.19:43918) 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde82d9d700 1 -- 172.21.15.19:0/223343178 learned_addr learned my addr 172.21.15.19:0/223343178 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:33.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde8259c700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde8409e000 0x7fde8411e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.718+0000 7fde8359e700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde8409e410 0x7fde8411ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 -- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde8409e410 msgr2=0x7fde8411ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde8409e410 0x7fde8411ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 -- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde8409e000 msgr2=0x7fde8411e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde8409e000 0x7fde8411e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 -- 172.21.15.19:0/223343178 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74006b50 con 0x7fde8409d6f0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde82d9d700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde8409ea70 tx=0x7fde74004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74004460 con 0x7fde8409d6f0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400d2e0 con 0x7fde8409d6f0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde740038c0 con 0x7fde8409d6f0 2023-10-03T10:16:33.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde84120270 con 0x7fde8409d6f0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.719+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde84121c70 con 0x7fde8409d6f0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.721+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84121540 con 0x7fde8409d6f0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.721+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde74003a20 con 0x7fde8409d6f0 2023-10-03T10:16:33.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.721+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde74048dc0 con 0x7fde8409d6f0 2023-10-03T10:16:33.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.726+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde7401e3b0 con 0x7fde8409d6f0 2023-10-03T10:16:33.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.922+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbad4074ea0 con 0x7fbad409f650 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.922+0000 7fbacaffd700 1 -- 172.21.15.19:0/3250611831 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbacc011b80 con 0x7fbad409f650 2023-10-03T10:16:33.922 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:33.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 msgr2=0x7fbad41c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fbad406fbc0 tx=0x7fbacc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 shutdown_connections 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbad409f650 0x7fbad41c5cf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbad409e930 0x7fbad41a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 --2- 172.21.15.19:0/3250611831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbad409f240 0x7fbad41a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.925+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 >> 172.21.15.19:0/3250611831 conn(0x7fbad40a4210 msgr2=0x7fbad41b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.926+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 shutdown_connections 2023-10-03T10:16:33.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.926+0000 7fbadc319700 1 -- 172.21.15.19:0/3250611831 wait complete. 2023-10-03T10:16:33.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:33.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.948+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35e809c4d0 con 0x7f35e8066410 2023-10-03T10:16:33.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.949+0000 7f35cffff700 1 -- 172.21.15.19:0/2798639755 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35e809c4d0 con 0x7f35e8066410 2023-10-03T10:16:33.949 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 msgr2=0x7f35e809bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f35d800b560 tx=0x7f35d800b920 comp rx=0 tx=0).stop 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 shutdown_connections 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35e806f5d0 0x7f35e809a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35e8066410 0x7f35e809bc80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 --2- 172.21.15.19:0/2798639755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35e8066880 0x7f35e8099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.951+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 >> 172.21.15.19:0/2798639755 conn(0x7f35e80a2aa0 msgr2=0x7f35e812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.952+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 shutdown_connections 2023-10-03T10:16:33.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.952+0000 7f35edba5700 1 -- 172.21.15.19:0/2798639755 wait complete. 2023-10-03T10:16:33.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.955+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8a7406c360 con 0x7f8a7409e000 2023-10-03T10:16:33.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.956+0000 7f8a69ffb700 1 -- 172.21.15.19:0/3461299437 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8a64015030 con 0x7f8a7409e000 2023-10-03T10:16:33.956 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 msgr2=0x7f8a74122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 0x7f8a74122c50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8a7406e510 tx=0x7f8a64004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 shutdown_connections 2023-10-03T10:16:33.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8a7409e410 0x7f8a74123190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a7409d6f0 0x7f8a74122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 --2- 172.21.15.19:0/3461299437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8a7409e000 0x7f8a74122c50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 >> 172.21.15.19:0/3461299437 conn(0x7f8a74066f50 msgr2=0x7f8a74070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 shutdown_connections 2023-10-03T10:16:33.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.958+0000 7f8a7b32b700 1 -- 172.21.15.19:0/3461299437 wait complete. 2023-10-03T10:16:33.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:33.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.970+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fde8409a6e0 con 0x7fde8409d6f0 2023-10-03T10:16:33.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.971+0000 7fde6b7fe700 1 -- 172.21.15.19:0/223343178 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde7401a020 con 0x7fde8409d6f0 2023-10-03T10:16:33.971 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:33.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 msgr2=0x7fde8411e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fde8409ea70 tx=0x7fde74004750 comp rx=0 tx=0).stop 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 shutdown_connections 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde8409e410 0x7fde8411ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde8409d6f0 0x7fde8411e190 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 --2- 172.21.15.19:0/223343178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde8409e000 0x7fde8411e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 >> 172.21.15.19:0/223343178 conn(0x7fde84066f50 msgr2=0x7fde84070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 shutdown_connections 2023-10-03T10:16:33.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:33.973+0000 7fde89045700 1 -- 172.21.15.19:0/223343178 wait complete. 2023-10-03T10:16:33.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:34.941 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:34.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:34.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:34.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:35.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.100+0000 7f3daf0d9700 1 Processor -- start 2023-10-03T10:16:35.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.100+0000 7f3daf0d9700 1 -- start start 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3daf0d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 0x7f3da8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3daf0d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 0x7f3da8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3daf0d9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da81313c0 con 0x7f3da8099a40 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3daf0d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da806e8c0 con 0x7f3da809a580 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3daf0d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da8071d20 con 0x7f3da8131810 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3dad676700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 0x7f3da8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3da7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3da8099a40 0x7f3da8099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57898/0 (socket says 172.21.15.19:57898) 2023-10-03T10:16:35.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3da7fff700 1 -- 172.21.15.19:0/2860911519 learned_addr learned my addr 172.21.15.19:0/2860911519 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.101+0000 7f3dace75700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 0x7f3da8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3da77fe700 1 -- 172.21.15.19:0/2860911519 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 280563520 0 0) 0x7f3da81313c0 con 0x7f3da8099a40 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dad676700 1 -- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 msgr2=0x7f3da8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dad676700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 0x7f3da8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dad676700 1 -- 172.21.15.19:0/2860911519 >> v1:172.21.15.19:6789/0 conn(0x7f3da8099a40 legacy=0x7f3da8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dad676700 1 -- 172.21.15.19:0/2860911519 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80721a0 con 0x7f3da809a580 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dace75700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 0x7f3da8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3dad676700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 0x7f3da8139660 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009dc0 tx=0x7f3da000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1737ea285331965 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3da77fe700 1 -- 172.21.15.19:0/2860911519 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da000e070 con 0x7f3da809a580 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3da77fe700 1 -- 172.21.15.19:0/2860911519 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da000bb20 con 0x7f3da809a580 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.102+0000 7f3da77fe700 1 -- 172.21.15.19:0/2860911519 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0012430 con 0x7f3da809a580 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 msgr2=0x7f3da8139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 0x7f3da8139660 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009dc0 tx=0x7f3da000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2860911519 shutdown_connections 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da809a580 0x7f3da8139660 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2860911519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8131810 0x7f3da8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2860911519 >> 172.21.15.19:0/2860911519 conn(0x7f3da80a2aa0 msgr2=0x7f3da80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2860911519 shutdown_connections 2023-10-03T10:16:35.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.103+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2860911519 wait complete. 2023-10-03T10:16:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.105+0000 7f3daf0d9700 1 Processor -- start 2023-10-03T10:16:35.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.105+0000 7f3daf0d9700 1 -- start start 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 0x7f3da811b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da8131810 0x7f3da811bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da811ed80 con 0x7f3da809a580 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da806eb00 con 0x7f3da8131810 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3daf0d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3da811d260 con 0x7f3da8099a40 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 0x7f3da811b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3da7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41246/0 (socket says 172.21.15.19:41246) 2023-10-03T10:16:35.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3da7fff700 1 -- 172.21.15.19:0/2138446542 learned_addr learned my addr 172.21.15.19:0/2138446542 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dad676700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da8131810 0x7f3da811bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 -- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da8131810 msgr2=0x7f3da811bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da8131810 0x7f3da811bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 -- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 msgr2=0x7f3da811ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3dace75700 1 -- 172.21.15.19:0/2138446542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c00f610 con 0x7f3da8099a40 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.106+0000 7f3da7fff700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3dace75700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 0x7f3da811b540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d40 tx=0x7f3d9c0133b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c004230 con 0x7f3da8099a40 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9c015040 con 0x7f3da8099a40 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da0009a70 con 0x7f3da8099a40 2023-10-03T10:16:35.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0045b0 con 0x7f3da8099a40 2023-10-03T10:16:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.107+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da811e3a0 con 0x7f3da8099a40 2023-10-03T10:16:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.108+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d9c013910 con 0x7f3da8099a40 2023-10-03T10:16:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.108+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d9c0434a0 con 0x7f3da8099a40 2023-10-03T10:16:35.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.108+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da8074ea0 con 0x7f3da8099a40 2023-10-03T10:16:35.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.118+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d9c0036a0 con 0x7f3da8099a40 2023-10-03T10:16:35.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 Processor -- start 2023-10-03T10:16:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 -- start start 2023-10-03T10:16:35.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcaf8099a40 0x7fcaf8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 0x7fcaf8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.136+0000 7fcaff6fe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf81313c0 con 0x7fcaf8099a40 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcaff6fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf806e8c0 con 0x7fcaf809a3b0 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcaff6fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf809a820 con 0x7fcaf8131810 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcaf8099a40 0x7fcaf8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcaf8099a40 0x7fcaf8099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41252/0 (socket says 172.21.15.19:41252) 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 -- 172.21.15.19:0/1523538333 learned_addr learned my addr 172.21.15.19:0/1523538333 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafdc9b700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 0x7fcaf8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafd49a700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 -- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 msgr2=0x7fcaf8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 -- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 msgr2=0x7fcaf8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 0x7fcaf8138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 -- 172.21.15.19:0/1523538333 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8071d20 con 0x7fcaf8099a40 2023-10-03T10:16:35.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafdc9b700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 0x7fcaf8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.137+0000 7fcafcc99700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf8099a40 0x7fcaf8099e70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009950 tx=0x7fcae8009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61a8483757d049e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.138+0000 7fcaeffff700 1 -- 172.21.15.19:0/1523538333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8004030 con 0x7fcaf8099a40 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.138+0000 7fcaeffff700 1 -- 172.21.15.19:0/1523538333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae8004190 con 0x7fcaf8099a40 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.138+0000 7fcaeffff700 1 -- 172.21.15.19:0/1523538333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae8004520 con 0x7fcaf8099a40 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 -- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf8099a40 msgr2=0x7fcaf8099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf8099a40 0x7fcaf8099e70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009950 tx=0x7fcae8009c60 comp rx=0 tx=0).stop 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 -- 172.21.15.19:0/1523538333 shutdown_connections 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf809a3b0 0x7fcaf8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/1523538333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf8099a40 0x7fcaf8099e70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 -- 172.21.15.19:0/1523538333 >> 172.21.15.19:0/1523538333 conn(0x7fcaf80a2aa0 msgr2=0x7fcaf80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 -- 172.21.15.19:0/1523538333 shutdown_connections 2023-10-03T10:16:35.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.139+0000 7fcaff6fe700 1 -- 172.21.15.19:0/1523538333 wait complete. 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.140+0000 7fcaff6fe700 1 Processor -- start 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.140+0000 7fcaff6fe700 1 -- start start 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf8099a40 0x7fcaf811b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf809a3b0 0x7fcaf811bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf80a1cf0 con 0x7fcaf809a3b0 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf811cc80 con 0x7fcaf8099a40 2023-10-03T10:16:35.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcaff6fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf811d3c0 con 0x7fcaf8131810 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36318/0 (socket says 172.21.15.19:36318) 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 -- 172.21.15.19:0/3160533676 learned_addr learned my addr 172.21.15.19:0/3160533676 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafcc99700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf809a3b0 0x7fcaf811bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafd49a700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf8099a40 0x7fcaf811b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fad31978700 1 Processor -- start 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 -- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf8099a40 msgr2=0x7fcaf811b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf8099a40 0x7fcaf811b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 -- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf809a3b0 msgr2=0x7fcaf811bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf809a3b0 0x7fcaf811bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.141+0000 7fcafdc9b700 1 -- 172.21.15.19:0/3160533676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0009a70 con 0x7fcaf8131810 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcafdc9b700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000ca90 con 0x7fcaf8131810 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 -- start start 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2c06a770 0x7fad2c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c09dc30 0x7fad2c09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c13c1e0 0x7fad2c13e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad2c06ab40 con 0x7fad2c06a770 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c09ebc0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fad31978700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c09a810 con 0x7fad2c09dc30 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2c06a770 0x7fad2c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fad2c06a770 0x7fad2c09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41280/0 (socket says 172.21.15.19:41280) 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 -- 172.21.15.19:0/2110689338 learned_addr learned my addr 172.21.15.19:0/2110689338 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2b7fe700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c13c1e0 0x7fad2c13e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 -- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c09dc30 msgr2=0x7fad2c09e080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c09dc30 0x7fad2c09e080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 -- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c13c1e0 msgr2=0x7fad2c13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c13c1e0 0x7fad2c13e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 -- 172.21.15.19:0/2110689338 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c09e920 con 0x7fad2c06a770 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf000f040 con 0x7fcaf8131810 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae8009550 con 0x7fcaf8131810 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000ce10 con 0x7fcaf8131810 2023-10-03T10:16:35.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.142+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf806eb00 con 0x7fcaf8131810 2023-10-03T10:16:35.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaf0014480 con 0x7fcaf8131810 2023-10-03T10:16:35.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcaf003fe70 con 0x7fcaf8131810 2023-10-03T10:16:35.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fad2affd700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c06a770 0x7fad2c09d6f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fad24009e80 tx=0x7fad2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a712608832b837e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.143+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf8074ea0 con 0x7fcaf8131810 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.144+0000 7fad29ffb700 1 -- 172.21.15.19:0/2110689338 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400e070 con 0x7fad2c06a770 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.144+0000 7fad29ffb700 1 -- 172.21.15.19:0/2110689338 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400b980 con 0x7fad2c06a770 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.144+0000 7fad29ffb700 1 -- 172.21.15.19:0/2110689338 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400bd30 con 0x7fad2c06a770 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 -- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c06a770 msgr2=0x7fad2c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c06a770 0x7fad2c09d6f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fad24009e80 tx=0x7fad2400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 -- 172.21.15.19:0/2110689338 shutdown_connections 2023-10-03T10:16:35.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c13c1e0 0x7fad2c13e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c06a770 0x7fad2c09d6f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 --2- 172.21.15.19:0/2110689338 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c09dc30 0x7fad2c09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.145+0000 7fad31978700 1 -- 172.21.15.19:0/2110689338 >> 172.21.15.19:0/2110689338 conn(0x7fad2c066f50 msgr2=0x7fad2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.146+0000 7fad31978700 1 -- 172.21.15.19:0/2110689338 shutdown_connections 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.146+0000 7fad31978700 1 -- 172.21.15.19:0/2110689338 wait complete. 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.147+0000 7fad31978700 1 Processor -- start 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.147+0000 7fad31978700 1 -- start start 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c06a770 0x7fad2c11d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c072480 con 0x7fad2c09dc30 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c072290 con 0x7fad2c06a770 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad31978700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c09f1a0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad2b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad2a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad2b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36324/0 (socket says 172.21.15.19:36324) 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad2a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41294/0 (socket says 172.21.15.19:41294) 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.148+0000 7fad2b7fe700 1 -- 172.21.15.19:0/2203952647 learned_addr learned my addr 172.21.15.19:0/2203952647 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 -- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c06a770 msgr2=0x7fad2c11d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c06a770 0x7fad2c11d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 -- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 msgr2=0x7fad2c11dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 -- 172.21.15.19:0/2203952647 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad24009b30 con 0x7fad2c13c1e0 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2a7fc700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.149+0000 7fad2b7fe700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fad2000e840 tx=0x7fad2000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.152+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000c070 con 0x7fad2c13c1e0 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.153+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20013610 con 0x7fad2c13c1e0 2023-10-03T10:16:35.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.153+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c11f2f0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.153+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200139c0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.153+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c13bf30 con 0x7fad2c13c1e0 2023-10-03T10:16:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.154+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaf0012700 con 0x7fcaf8131810 2023-10-03T10:16:35.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.154+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad20013b20 con 0x7fad2c13c1e0 2023-10-03T10:16:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.154+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2c11f880 con 0x7fad2c13c1e0 2023-10-03T10:16:35.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.154+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad2003f2c0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.163+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad20023b60 con 0x7fad2c13c1e0 2023-10-03T10:16:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.192+0000 7ff6ca0e8700 1 Processor -- start 2023-10-03T10:16:35.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 -- start start 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6c409d630 0x7ff6c40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c4138d80 0x7ff6c413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40a2a70 con 0x7ff6c40a0a30 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40a01d0 con 0x7ff6c409d630 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6ca0e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c409e2b0 con 0x7ff6c4138d80 2023-10-03T10:16:35.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6c2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6c409d630 0x7ff6c40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6c37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff6c40a0a30 0x7ff6c40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57910/0 (socket says 172.21.15.19:57910) 2023-10-03T10:16:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.193+0000 7ff6c37fe700 1 -- 172.21.15.19:0/470268657 learned_addr learned my addr 172.21.15.19:0/470268657 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c2ffd700 1 -- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c4138d80 msgr2=0x7ff6c413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c2ffd700 1 --2- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c4138d80 0x7ff6c413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c2ffd700 1 -- 172.21.15.19:0/470268657 >> v1:172.21.15.19:6789/0 conn(0x7ff6c40a0a30 legacy=0x7ff6c40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c2ffd700 1 -- 172.21.15.19:0/470268657 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c409dc50 con 0x7ff6c409d630 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c2ffd700 1 --2- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c409d630 0x7ff6c40a1510 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009840 tx=0x7ff6b8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a9e2a85a181a2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c27fc700 1 -- 172.21.15.19:0/470268657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8004230 con 0x7ff6c409d630 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c27fc700 1 -- 172.21.15.19:0/470268657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8004390 con 0x7ff6c409d630 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.194+0000 7ff6c27fc700 1 -- 172.21.15.19:0/470268657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b80036a0 con 0x7ff6c409d630 2023-10-03T10:16:35.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c409d630 msgr2=0x7ff6c40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c409d630 0x7ff6c40a1510 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8009840 tx=0x7ff6b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/470268657 shutdown_connections 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c4138d80 0x7ff6c413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/470268657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c409d630 0x7ff6c40a1510 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/470268657 >> 172.21.15.19:0/470268657 conn(0x7ff6c40a3050 msgr2=0x7ff6c40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/470268657 shutdown_connections 2023-10-03T10:16:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.195+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/470268657 wait complete. 2023-10-03T10:16:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.196+0000 7ff6ca0e8700 1 Processor -- start 2023-10-03T10:16:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.196+0000 7ff6ca0e8700 1 -- start start 2023-10-03T10:16:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 0x7ff6c411d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c40a0a30 0x7ff6c411d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 0x7ff6c411dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c411f880 con 0x7ff6c4138d80 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4120310 con 0x7ff6c40a0a30 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6ca0e8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c411e8a0 con 0x7ff6c409d630 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 0x7ff6c411dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 0x7ff6c411dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41322/0 (socket says 172.21.15.19:41322) 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c3fff700 1 -- 172.21.15.19:0/1940785348 learned_addr learned my addr 172.21.15.19:0/1940785348 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c2ffd700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c40a0a30 0x7ff6c411d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 0x7ff6c411d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 -- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c40a0a30 msgr2=0x7ff6c411d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c40a0a30 0x7ff6c411d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 -- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 msgr2=0x7ff6c411dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 0x7ff6c411dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.197+0000 7ff6c37fe700 1 -- 172.21.15.19:0/1940785348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b80094a0 con 0x7ff6c409d630 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6c37fe700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 0x7ff6c411d440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4002020 tx=0x7ff6b400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400ac90 con 0x7ff6c409d630 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400adf0 con 0x7ff6c409d630 2023-10-03T10:16:35.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40a4f50 con 0x7ff6c409d630 2023-10-03T10:16:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40072d0 con 0x7ff6c409d630 2023-10-03T10:16:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.198+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41216f0 con 0x7ff6c409d630 2023-10-03T10:16:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.199+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff6b4007430 con 0x7ff6c409d630 2023-10-03T10:16:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.199+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff6b403f770 con 0x7ff6c409d630 2023-10-03T10:16:35.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.199+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c40747f0 con 0x7ff6c409d630 2023-10-03T10:16:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.204+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff6b4018030 con 0x7ff6c409d630 2023-10-03T10:16:35.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.356+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3da806b9e0 con 0x7f3da8099a40 2023-10-03T10:16:35.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.357+0000 7f3da57fa700 1 -- 172.21.15.19:0/2138446542 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d9c023360 con 0x7f3da8099a40 2023-10-03T10:16:35.357 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:35.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 msgr2=0x7f3da811b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 0x7f3da811b540 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009d40 tx=0x7f3d9c0133b0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 shutdown_connections 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3da8131810 0x7f3da811bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3da8099a40 0x7f3da811b540 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 --2- 172.21.15.19:0/2138446542 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3da809a580 0x7f3da811ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 >> 172.21.15.19:0/2138446542 conn(0x7f3da80a2aa0 msgr2=0x7f3da809d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 shutdown_connections 2023-10-03T10:16:35.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.359+0000 7f3daf0d9700 1 -- 172.21.15.19:0/2138446542 wait complete. 2023-10-03T10:16:35.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.373+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fad2c074ea0 con 0x7fad2c13c1e0 2023-10-03T10:16:35.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:35.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.374+0000 7fad13fff700 1 -- 172.21.15.19:0/2203952647 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad20023770 con 0x7fad2c13c1e0 2023-10-03T10:16:35.374 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:35.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 msgr2=0x7fad2c11e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fad2000e840 tx=0x7fad2000eb50 comp rx=0 tx=0).stop 2023-10-03T10:16:35.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 shutdown_connections 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad2c13c1e0 0x7fad2c11e270 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad2c06a770 0x7fad2c11d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 --2- 172.21.15.19:0/2203952647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad2c09dc30 0x7fad2c11dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 >> 172.21.15.19:0/2203952647 conn(0x7fad2c066f50 msgr2=0x7fad2c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 shutdown_connections 2023-10-03T10:16:35.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.377+0000 7fad31978700 1 -- 172.21.15.19:0/2203952647 wait complete. 2023-10-03T10:16:35.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.401+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcaf811e120 con 0x7fcaf8131810 2023-10-03T10:16:35.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.401+0000 7fcaedffb700 1 -- 172.21.15.19:0/3160533676 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaf002b090 con 0x7fcaf8131810 2023-10-03T10:16:35.401 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 msgr2=0x7fcaf811c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000efc0 tx=0x7fcaf000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 shutdown_connections 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcaf8131810 0x7fcaf811c310 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcaf8099a40 0x7fcaf811b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 --2- 172.21.15.19:0/3160533676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcaf809a3b0 0x7fcaf811bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 >> 172.21.15.19:0/3160533676 conn(0x7fcaf80a2aa0 msgr2=0x7fcaf80a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 shutdown_connections 2023-10-03T10:16:35.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.404+0000 7fcaff6fe700 1 -- 172.21.15.19:0/3160533676 wait complete. 2023-10-03T10:16:35.417 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:35.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.434+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff6c4120920 con 0x7ff6c409d630 2023-10-03T10:16:35.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.435+0000 7ff6abfff700 1 -- 172.21.15.19:0/1940785348 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff6b4012400 con 0x7ff6c409d630 2023-10-03T10:16:35.434 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 msgr2=0x7ff6c411d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 0x7ff6c411d440 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4002020 tx=0x7ff6b400a340 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 shutdown_connections 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6c4138d80 0x7ff6c411dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6c409d630 0x7ff6c411d440 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 --2- 172.21.15.19:0/1940785348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6c40a0a30 0x7ff6c411d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 >> 172.21.15.19:0/1940785348 conn(0x7ff6c40a3050 msgr2=0x7ff6c409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 shutdown_connections 2023-10-03T10:16:35.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:35.437+0000 7ff6ca0e8700 1 -- 172.21.15.19:0/1940785348 wait complete. 2023-10-03T10:16:35.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:36.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:36.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:36.418 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:36.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:36.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.536+0000 7fd830323700 1 Processor -- start 2023-10-03T10:16:36.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.536+0000 7fd830323700 1 -- start start 2023-10-03T10:16:36.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.536+0000 7fd830323700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809d6f0 0x7fd82809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.536+0000 7fd830323700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd830323700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd82809e410 0x7fd828133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd830323700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82806b460 con 0x7fd82809e410 2023-10-03T10:16:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd830323700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82809b120 con 0x7fd82809d6f0 2023-10-03T10:16:36.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd830323700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd82809a7e0 con 0x7fd82809e000 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82e8c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd82809e410 0x7fd828133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47596/0 (socket says 172.21.15.19:47596) 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 -- 172.21.15.19:0/3484727548 learned_addr learned my addr 172.21.15.19:0/3484727548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82e0bf700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809d6f0 0x7fd82809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 -- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809d6f0 msgr2=0x7fd82809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809d6f0 0x7fd82809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 -- 172.21.15.19:0/3484727548 >> v2:172.21.15.19:3300/0 conn(0x7fd82809e410 msgr2=0x7fd828133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 --2- 172.21.15.19:0/3484727548 >> v2:172.21.15.19:3300/0 conn(0x7fd82809e410 0x7fd828133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 -- 172.21.15.19:0/3484727548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82809a500 con 0x7fd82809e000 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.537+0000 7fd82d8be700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd818009920 tx=0x7fd818009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56324a3426836e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.538+0000 7fd82d0bd700 1 -- 172.21.15.19:0/3484727548 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818011830 con 0x7fd82809e000 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.538+0000 7fd82d0bd700 1 -- 172.21.15.19:0/3484727548 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd818011990 con 0x7fd82809e000 2023-10-03T10:16:36.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.538+0000 7fd82d0bd700 1 -- 172.21.15.19:0/3484727548 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818011d20 con 0x7fd82809e000 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.538+0000 7fd830323700 1 -- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 msgr2=0x7fd8281339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.538+0000 7fd830323700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd818009920 tx=0x7fd818009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 -- 172.21.15.19:0/3484727548 shutdown_connections 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809d6f0 0x7fd82809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 --2- 172.21.15.19:0/3484727548 >> v2:172.21.15.19:3300/0 conn(0x7fd82809e410 0x7fd828133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 --2- 172.21.15.19:0/3484727548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281339f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 -- 172.21.15.19:0/3484727548 >> 172.21.15.19:0/3484727548 conn(0x7fd828066f50 msgr2=0x7fd82809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 -- 172.21.15.19:0/3484727548 shutdown_connections 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.539+0000 7fd830323700 1 -- 172.21.15.19:0/3484727548 wait complete. 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 Processor -- start 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 -- start start 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 0x7fd8281a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809e410 0x7fd8281a69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281a8810 con 0x7fd82809d6f0 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281a99c0 con 0x7fd82809e410 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd830323700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280a2200 con 0x7fd82809e000 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd82e0bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 0x7fd8281a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd82e0bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 0x7fd8281a5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48046/0 (socket says 172.21.15.19:48046) 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.540+0000 7fd82e0bf700 1 -- 172.21.15.19:0/718050433 learned_addr learned my addr 172.21.15.19:0/718050433 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82e8c0700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809e410 0x7fd8281a69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 -- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809e410 msgr2=0x7fd8281a69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809e410 0x7fd8281a69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 -- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 msgr2=0x7fd8281a5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 0x7fd8281a5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 -- 172.21.15.19:0/718050433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd818009550 con 0x7fd82809e000 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd82d8be700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281a6460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd82809e9b0 tx=0x7fd818004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd818004240 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81801f070 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8180036a0 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.541+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82809c710 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.542+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8281a96e0 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.543+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd818021030 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.543+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8281a8270 con 0x7fd82809e000 2023-10-03T10:16:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.543+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8180408f0 con 0x7fd82809e000 2023-10-03T10:16:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.552+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8180199a0 con 0x7fd82809e000 2023-10-03T10:16:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.571+0000 7f09635e7700 1 Processor -- start 2023-10-03T10:16:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 -- start start 2023-10-03T10:16:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 0x7f095c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f095c06f050 0x7f095c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095c070ee0 con 0x7f095c06e570 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095c071980 con 0x7f095c06f050 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.572+0000 7f09635e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c071480 con 0x7f095c09eca0 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0961383700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f095c06e570 0x7f095c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36782/0 (socket says 172.21.15.19:36782) 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0961383700 1 -- 172.21.15.19:0/1150106473 learned_addr learned my addr 172.21.15.19:0/1150106473 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0961b84700 1 --2- 172.21.15.19:0/1150106473 >> v2:172.21.15.19:3300/0 conn(0x7f095c06f050 0x7f095c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 --2- 172.21.15.19:0/1150106473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 0x7f095c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 -- 172.21.15.19:0/1150106473 >> v2:172.21.15.19:3300/0 conn(0x7f095c06f050 msgr2=0x7f095c13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 --2- 172.21.15.19:0/1150106473 >> v2:172.21.15.19:3300/0 conn(0x7f095c06f050 0x7f095c13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 -- 172.21.15.19:0/1150106473 >> v1:172.21.15.19:6789/0 conn(0x7f095c06e570 legacy=0x7f095c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0953fff700 1 -- 172.21.15.19:0/1150106473 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82946323 0 0) 0x7f095c070ee0 con 0x7f095c06e570 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 -- 172.21.15.19:0/1150106473 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c071b90 con 0x7f095c09eca0 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0960b82700 1 --2- 172.21.15.19:0/1150106473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 0x7f095c13cea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f094c009840 tx=0x7f094c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5eb9490a322b1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.573+0000 7f0953fff700 1 -- 172.21.15.19:0/1150106473 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c011830 con 0x7f095c09eca0 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f0953fff700 1 -- 172.21.15.19:0/1150106473 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c011990 con 0x7f095c09eca0 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f0953fff700 1 -- 172.21.15.19:0/1150106473 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c011d20 con 0x7f095c09eca0 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 -- 172.21.15.19:0/1150106473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 msgr2=0x7f095c13cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 --2- 172.21.15.19:0/1150106473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 0x7f095c13cea0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f094c009840 tx=0x7f094c009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 -- 172.21.15.19:0/1150106473 shutdown_connections 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 --2- 172.21.15.19:0/1150106473 >> v2:172.21.15.19:3300/0 conn(0x7f095c06f050 0x7f095c13f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 --2- 172.21.15.19:0/1150106473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c09eca0 0x7f095c13cea0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 -- 172.21.15.19:0/1150106473 >> 172.21.15.19:0/1150106473 conn(0x7f095c0a2aa0 msgr2=0x7f095c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.574+0000 7f09635e7700 1 -- 172.21.15.19:0/1150106473 shutdown_connections 2023-10-03T10:16:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.575+0000 7f09635e7700 1 -- 172.21.15.19:0/1150106473 wait complete. 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.576+0000 7f09635e7700 1 Processor -- start 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.576+0000 7f09635e7700 1 -- start start 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f095c06e570 0x7f095c11aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f095c06f050 0x7f095c1370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095c11a6d0 con 0x7f095c06f050 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095c119370 con 0x7f095c1375f0 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f09635e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f095c13ec60 con 0x7f095c06e570 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48606/0 (socket says 172.21.15.19:48606) 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 -- 172.21.15.19:0/3293606544 learned_addr learned my addr 172.21.15.19:0/3293606544 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0960b82700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f095c06f050 0x7f095c1370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 -- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f095c06e570 msgr2=0x7f095c11aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f095c06e570 0x7f095c11aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 -- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f095c06f050 msgr2=0x7f095c1370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f095c06f050 0x7f095c1370b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 -- 172.21.15.19:0/3293606544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0094a0 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.577+0000 7f0961b84700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0954009dd0 tx=0x7f095400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.578+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954009c40 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.578+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095400f040 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.578+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954014480 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.578+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095c11a9b0 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.578+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095c11a410 con 0x7f095c1375f0 2023-10-03T10:16:36.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.579+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095c13e8c0 con 0x7f095c1375f0 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.580+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f09540145e0 con 0x7f095c1375f0 2023-10-03T10:16:36.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.580+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09540406e0 con 0x7f095c1375f0 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 Processor -- start 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 -- start start 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe214133ed0 0x7fe21413ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21409dc70 con 0x7fe21409f440 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2140a25d0 con 0x7fe214133ed0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.581+0000 7fe219602700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140a2780 con 0x7fe21409eb30 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48618/0 (socket says 172.21.15.19:48618) 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 -- 172.21.15.19:0/2135409286 learned_addr learned my addr 172.21.15.19:0/2135409286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe2137fe700 1 --2- 172.21.15.19:0/2135409286 >> v2:172.21.15.19:3300/0 conn(0x7fe214133ed0 0x7fe21413ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 -- 172.21.15.19:0/2135409286 >> v2:172.21.15.19:3300/0 conn(0x7fe214133ed0 msgr2=0x7fe21413ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2135409286 >> v2:172.21.15.19:3300/0 conn(0x7fe214133ed0 0x7fe21413ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 -- 172.21.15.19:0/2135409286 >> v1:172.21.15.19:6789/0 conn(0x7fe21409f440 legacy=0x7fe2141337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 -- 172.21.15.19:0/2135409286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2140a1dc0 con 0x7fe21409eb30 2023-10-03T10:16:36.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.582+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2135409286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe2040098f0 tx=0x7fe204009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b27cac696711cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.588+0000 7fe211ffb700 1 -- 172.21.15.19:0/2135409286 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204011830 con 0x7fe21409eb30 2023-10-03T10:16:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe211ffb700 1 -- 172.21.15.19:0/2135409286 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204011990 con 0x7fe21409eb30 2023-10-03T10:16:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe211ffb700 1 -- 172.21.15.19:0/2135409286 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204011d20 con 0x7fe21409eb30 2023-10-03T10:16:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0954012930 con 0x7f095c1375f0 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 -- 172.21.15.19:0/2135409286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 msgr2=0x7fe21409ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 --2- 172.21.15.19:0/2135409286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe2040098f0 tx=0x7fe204009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 -- 172.21.15.19:0/2135409286 shutdown_connections 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 --2- 172.21.15.19:0/2135409286 >> v2:172.21.15.19:3300/0 conn(0x7fe214133ed0 0x7fe21413ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 --2- 172.21.15.19:0/2135409286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409eb30 0x7fe21409ef00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.589+0000 7fe219602700 1 -- 172.21.15.19:0/2135409286 >> 172.21.15.19:0/2135409286 conn(0x7fe2140a6400 msgr2=0x7fe2140a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.590+0000 7fe219602700 1 -- 172.21.15.19:0/2135409286 shutdown_connections 2023-10-03T10:16:36.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.590+0000 7fe219602700 1 -- 172.21.15.19:0/2135409286 wait complete. 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 Processor -- start 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 -- start start 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 0x7fe2141c0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 0x7fe2141c1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2141223b0 0x7fe2141c3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214120870 con 0x7fe214133ed0 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140a4830 con 0x7fe21409f440 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.591+0000 7fe219602700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe21409cec0 con 0x7fe2141223b0 2023-10-03T10:16:36.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe2127fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 0x7fe2141c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe2127fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 0x7fe2141c1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48064/0 (socket says 172.21.15.19:48064) 2023-10-03T10:16:36.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe2127fc700 1 -- 172.21.15.19:0/2646163770 learned_addr learned my addr 172.21.15.19:0/2646163770 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 0x7fe2141c0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 -- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2141223b0 msgr2=0x7fe2141c3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2141223b0 0x7fe2141c3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 -- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 msgr2=0x7fe2141c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 0x7fe2141c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.592+0000 7fe212ffd700 1 -- 172.21.15.19:0/2646163770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009550 con 0x7fe21409f440 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe212ffd700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 0x7fe2141c0df0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe204016000 tx=0x7fe204004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040045d0 con 0x7fe21409f440 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2040036a0 con 0x7fe21409f440 2023-10-03T10:16:36.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe219602700 1 -- 172.21.15.19:0/2646163770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe214133d30 con 0x7fe21409f440 2023-10-03T10:16:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204003a10 con 0x7fe21409f440 2023-10-03T10:16:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.593+0000 7fe219602700 1 -- 172.21.15.19:0/2646163770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21411ffa0 con 0x7fe21409f440 2023-10-03T10:16:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.594+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe204021070 con 0x7fe21409f440 2023-10-03T10:16:36.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.595+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2040408e0 con 0x7fe21409f440 2023-10-03T10:16:36.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.596+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe214133d30 con 0x7fe21409f440 2023-10-03T10:16:36.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.605+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe214133d30 con 0x7fe21409f440 2023-10-03T10:16:36.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.617+0000 7fb5f5a7c700 1 Processor -- start 2023-10-03T10:16:36.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.617+0000 7fb5f5a7c700 1 -- start start 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.617+0000 7fb5f5a7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f006a770 0x7fb5f009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5f5a7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5f5a7c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f009a810 con 0x7fb5f013c1e0 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5f5a7c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f006ab40 con 0x7fb5f009dc30 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5f5a7c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f009ebc0 con 0x7fb5f006a770 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5effff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb5f013c1e0 0x7fb5f013e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36812/0 (socket says 172.21.15.19:36812) 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5effff700 1 -- 172.21.15.19:0/2606891502 learned_addr learned my addr 172.21.15.19:0/2606891502 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5ef7fe700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f006a770 0x7fb5f009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f006a770 msgr2=0x7fb5f009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f006a770 0x7fb5f009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2606891502 >> v1:172.21.15.19:6789/0 conn(0x7fb5f013c1e0 legacy=0x7fb5f013e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2606891502 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f009e920 con 0x7fb5f009dc30 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.618+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f009e080 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009870 tx=0x7fb5e4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12864b099337e1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5ee7fc700 1 -- 172.21.15.19:0/2606891502 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4011830 con 0x7fb5f009dc30 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5ee7fc700 1 -- 172.21.15.19:0/2606891502 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4011990 con 0x7fb5f009dc30 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5ee7fc700 1 -- 172.21.15.19:0/2606891502 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4011d20 con 0x7fb5f009dc30 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 msgr2=0x7fb5f009e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f009e080 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009870 tx=0x7fb5e4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2606891502 shutdown_connections 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f006a770 0x7fb5f009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2606891502 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f009e080 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2606891502 >> 172.21.15.19:0/2606891502 conn(0x7fb5f0066f50 msgr2=0x7fb5f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.619+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2606891502 shutdown_connections 2023-10-03T10:16:36.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.620+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2606891502 wait complete. 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.620+0000 7fb5f5a7c700 1 Processor -- start 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 -- start start 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5f006a770 0x7fb5f013e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f013a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 0x7fb5f013ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f013ee90 con 0x7fb5f006a770 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f011d9a0 con 0x7fb5f009dc30 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5f5a7c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f011e020 con 0x7fb5f013c1e0 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 0x7fb5f013ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5effff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 0x7fb5f013ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47634/0 (socket says 172.21.15.19:47634) 2023-10-03T10:16:36.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5effff700 1 -- 172.21.15.19:0/2199946139 learned_addr learned my addr 172.21.15.19:0/2199946139 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.621+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f013a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5ef7fe700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5f006a770 0x7fb5f013e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 msgr2=0x7fb5f013ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 0x7fb5f013ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5f006a770 msgr2=0x7fb5f013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5f006a770 0x7fb5f013e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 -- 172.21.15.19:0/2199946139 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e40094a0 con 0x7fb5f009dc30 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5eeffd700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f013a5d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb5f011d860 tx=0x7fb5e4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4004510 con 0x7fb5f009dc30 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e401f070 con 0x7fb5f009dc30 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e40038c0 con 0x7fb5f009dc30 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f009f1a0 con 0x7fb5f009dc30 2023-10-03T10:16:36.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.622+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f013fc90 con 0x7fb5f009dc30 2023-10-03T10:16:36.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.623+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb5e4003a20 con 0x7fb5f009dc30 2023-10-03T10:16:36.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.624+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb5e4021070 con 0x7fb5f009dc30 2023-10-03T10:16:36.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.624+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f0074ea0 con 0x7fb5f009dc30 2023-10-03T10:16:36.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.629+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb5e4040e60 con 0x7fb5f009dc30 2023-10-03T10:16:36.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.778+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd828074ea0 con 0x7fd82809e000 2023-10-03T10:16:36.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.779+0000 7fd81effd700 1 -- 172.21.15.19:0/718050433 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd818015070 con 0x7fd82809e000 2023-10-03T10:16:36.795 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 msgr2=0x7fd8281a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281a6460 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd82809e9b0 tx=0x7fd818004750 comp rx=0 tx=0).stop 2023-10-03T10:16:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 shutdown_connections 2023-10-03T10:16:36.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd82809e410 0x7fd8281a69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd82809d6f0 0x7fd8281a5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 --2- 172.21.15.19:0/718050433 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd82809e000 0x7fd8281a6460 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 >> 172.21.15.19:0/718050433 conn(0x7fd828066f50 msgr2=0x7fd8281baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 shutdown_connections 2023-10-03T10:16:36.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.781+0000 7fd830323700 1 -- 172.21.15.19:0/718050433 wait complete. 2023-10-03T10:16:36.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:36.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.800+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f095c074ea0 con 0x7f095c1375f0 2023-10-03T10:16:36.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.801+0000 7f0951ffb700 1 -- 172.21.15.19:0/3293606544 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0954012340 con 0x7f095c1375f0 2023-10-03T10:16:36.801 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 msgr2=0x7f095c137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0954009dd0 tx=0x7f095400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 shutdown_connections 2023-10-03T10:16:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f095c1375f0 0x7f095c137a50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f095c06e570 0x7f095c11aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 --2- 172.21.15.19:0/3293606544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f095c06f050 0x7f095c1370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 >> 172.21.15.19:0/3293606544 conn(0x7f095c0a2aa0 msgr2=0x7f095c09c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 shutdown_connections 2023-10-03T10:16:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.803+0000 7f09635e7700 1 -- 172.21.15.19:0/3293606544 wait complete. 2023-10-03T10:16:36.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:36.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.821+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe214133d30 con 0x7fe21409f440 2023-10-03T10:16:36.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.822+0000 7fe1fb7fe700 1 -- 172.21.15.19:0/2646163770 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe214133d30 con 0x7fe21409f440 2023-10-03T10:16:36.822 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 msgr2=0x7fe2141c0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 0x7fe2141c0df0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe204016000 tx=0x7fe204004750 comp rx=0 tx=0).stop 2023-10-03T10:16:36.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 shutdown_connections 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2141223b0 0x7fe2141c3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f440 0x7fe2141c0df0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 --2- 172.21.15.19:0/2646163770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe214133ed0 0x7fe2141c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 >> 172.21.15.19:0/2646163770 conn(0x7fe2140a6400 msgr2=0x7fe2140a08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 shutdown_connections 2023-10-03T10:16:36.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.824+0000 7fe1f97fa700 1 -- 172.21.15.19:0/2646163770 wait complete. 2023-10-03T10:16:36.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.838+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5f006c360 con 0x7fb5f009dc30 2023-10-03T10:16:36.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.838+0000 7fb5d7fff700 1 -- 172.21.15.19:0/2199946139 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb5e402b020 con 0x7fb5f009dc30 2023-10-03T10:16:36.838 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:36.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:36.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 msgr2=0x7fb5f013a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:36.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f013a5d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb5f011d860 tx=0x7fb5e4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:36.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 shutdown_connections 2023-10-03T10:16:36.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5f013c1e0 0x7fb5f013ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5f006a770 0x7fb5f013e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 --2- 172.21.15.19:0/2199946139 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb5f009dc30 0x7fb5f013a5d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 >> 172.21.15.19:0/2199946139 conn(0x7fb5f0066f50 msgr2=0x7fb5f00a15e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 shutdown_connections 2023-10-03T10:16:36.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:36.840+0000 7fb5f5a7c700 1 -- 172.21.15.19:0/2199946139 wait complete. 2023-10-03T10:16:36.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:37.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:37.817 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:37.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:37.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.968+0000 7f8db4803700 1 Processor -- start 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.968+0000 7f8db4803700 1 -- start start 2023-10-03T10:16:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8db4803700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 0x7f8db0135750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8db4803700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 0x7f8db0137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8db4803700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db009ab20 con 0x7f8db0099780 2023-10-03T10:16:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8db4803700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db009b890 con 0x7f8db009a260 2023-10-03T10:16:37.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8db4803700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db009bb50 con 0x7f8db009a630 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8daf59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 0x7f8db0137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8daed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8db0099780 0x7f8db0099b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36818/0 (socket says 172.21.15.19:36818) 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8daed9d700 1 -- 172.21.15.19:0/4234830725 learned_addr learned my addr 172.21.15.19:0/4234830725 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.969+0000 7f8dae59c700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 0x7f8db0135750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dae59c700 1 -- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 msgr2=0x7f8db0137ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dae59c700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 0x7f8db0137ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dae59c700 1 -- 172.21.15.19:0/4234830725 >> v1:172.21.15.19:6789/0 conn(0x7f8db0099780 legacy=0x7f8db0099b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dae59c700 1 -- 172.21.15.19:0/4234830725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db0099210 con 0x7f8db009a260 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8daf59e700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 0x7f8db0137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dae59c700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 0x7f8db0135750 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78551ad3d55600f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dadd9b700 1 -- 172.21.15.19:0/4234830725 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4011830 con 0x7f8db009a260 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dadd9b700 1 -- 172.21.15.19:0/4234830725 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da4011990 con 0x7f8db009a260 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.970+0000 7f8dadd9b700 1 -- 172.21.15.19:0/4234830725 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4011d20 con 0x7f8db009a260 2023-10-03T10:16:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 -- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 msgr2=0x7f8db0135750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 0x7f8db0135750 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8da4009870 tx=0x7f8da4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 -- 172.21.15.19:0/4234830725 shutdown_connections 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a630 0x7f8db0137ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 --2- 172.21.15.19:0/4234830725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db009a260 0x7f8db0135750 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 -- 172.21.15.19:0/4234830725 >> 172.21.15.19:0/4234830725 conn(0x7f8db00a2540 msgr2=0x7f8db00a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 -- 172.21.15.19:0/4234830725 shutdown_connections 2023-10-03T10:16:37.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.971+0000 7f8db4803700 1 -- 172.21.15.19:0/4234830725 wait complete. 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.972+0000 7f8db4803700 1 Processor -- start 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.972+0000 7f8db4803700 1 -- start start 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db0099780 0x7f8db0132da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 0x7f8db01332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 0x7f8db0133820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0136530 con 0x7f8db009a630 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0137310 con 0x7f8db0099780 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8db4803700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db0134820 con 0x7f8db009a260 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8daf59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 0x7f8db0133820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8daf59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 0x7f8db0133820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48074/0 (socket says 172.21.15.19:48074) 2023-10-03T10:16:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8daf59e700 1 -- 172.21.15.19:0/2299893410 learned_addr learned my addr 172.21.15.19:0/2299893410 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8dae59c700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 0x7f8db01332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.973+0000 7f8daed9d700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db0099780 0x7f8db0132da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 -- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db0099780 msgr2=0x7f8db0132da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db0099780 0x7f8db0132da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 -- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 msgr2=0x7f8db0133820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 0x7f8db0133820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 -- 172.21.15.19:0/2299893410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da8009a70 con 0x7f8db009a260 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8dae59c700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 0x7f8db01332e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8da4016000 tx=0x7f8da4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4004450 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da40094a0 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da401f070 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40038e0 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.974+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db0135010 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.975+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8da4003a40 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.976+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8da4021070 con 0x7f8db009a260 2023-10-03T10:16:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.976+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db004f2a0 con 0x7f8db009a260 2023-10-03T10:16:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.981+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8da402b020 con 0x7f8db009a260 2023-10-03T10:16:37.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 Processor -- start 2023-10-03T10:16:37.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 -- start start 2023-10-03T10:16:37.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c409d6f0 0x7f03c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c409f130 con 0x7f03c409e410 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c409f520 con 0x7f03c409d6f0 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.996+0000 7f03c9aaa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c409e930 con 0x7f03c409e000 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c409d6f0 0x7f03c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03c409e410 0x7f03c4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36820/0 (socket says 172.21.15.19:36820) 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c3fff700 1 -- 172.21.15.19:0/3505607168 learned_addr learned my addr 172.21.15.19:0/3505607168 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c409d6f0 0x7f03c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48078/0 (socket says 172.21.15.19:48078) 2023-10-03T10:16:37.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c2ffd700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:37.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 -- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 msgr2=0x7f03c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:37.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 -- 172.21.15.19:0/3505607168 >> v1:172.21.15.19:6789/0 conn(0x7f03c409e410 legacy=0x7f03c4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 -- 172.21.15.19:0/3505607168 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c409b2d0 con 0x7f03c409d6f0 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c27fc700 1 -- 172.21.15.19:0/3505607168 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976185214 0 0) 0x7f03c409f130 con 0x7f03c409e410 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c37fe700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409d6f0 0x7f03c409dac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f03b400bae0 tx=0x7f03b400bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47db5bd10565cdb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.997+0000 7f03c27fc700 1 -- 172.21.15.19:0/3505607168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b400dc70 con 0x7f03c409d6f0 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c27fc700 1 -- 172.21.15.19:0/3505607168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b400ddd0 con 0x7f03c409d6f0 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c27fc700 1 -- 172.21.15.19:0/3505607168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b4010690 con 0x7f03c409d6f0 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 -- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409d6f0 msgr2=0x7f03c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409d6f0 0x7f03c409dac0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f03b400bae0 tx=0x7f03b400bdf0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 -- 172.21.15.19:0/3505607168 shutdown_connections 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409d6f0 0x7f03c409dac0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:37.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/3505607168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 -- 172.21.15.19:0/3505607168 >> 172.21.15.19:0/3505607168 conn(0x7f03c4066f50 msgr2=0x7f03c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 -- 172.21.15.19:0/3505607168 shutdown_connections 2023-10-03T10:16:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:37.998+0000 7f03c9aaa700 1 -- 172.21.15.19:0/3505607168 wait complete. 2023-10-03T10:16:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.000+0000 7f03c9aaa700 1 Processor -- start 2023-10-03T10:16:38.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.000+0000 7f03c9aaa700 1 -- start start 2023-10-03T10:16:38.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.000+0000 7f93db366700 1 Processor -- start 2023-10-03T10:16:38.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f93db366700 1 -- start start 2023-10-03T10:16:38.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c411e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c4121840 con 0x7f03c409e410 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c41303e0 con 0x7f03c409d6f0 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c9aaa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c40a2070 con 0x7f03c409e000 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48084/0 (socket says 172.21.15.19:48084) 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48678/0 (socket says 172.21.15.19:48678) 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f03c3fff700 1 -- 172.21.15.19:0/2956270498 learned_addr learned my addr 172.21.15.19:0/2956270498 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:38.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f93db366700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93d41338a0 0x7f93d4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f93db366700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.001+0000 7f93db366700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d406ef30 con 0x7f93d409de50 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93db366700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d406fef0 con 0x7f93d41338a0 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93db366700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d41334b0 con 0x7f93d409e930 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c2ffd700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c411e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 -- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 msgr2=0x7f03c411e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c411e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 -- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 msgr2=0x7f03c411e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 -- 172.21.15.19:0/2956270498 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b400b740 con 0x7f03c409e410 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93d8901700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f93d409de50 0x7f93d409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36826/0 (socket says 172.21.15.19:36826) 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93d8901700 1 -- 172.21.15.19:0/3953052452 learned_addr learned my addr 172.21.15.19:0/3953052452 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93d9903700 1 --2- 172.21.15.19:0/3953052452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93d9102700 1 --2- 172.21.15.19:0/3953052452 >> v2:172.21.15.19:3300/0 conn(0x7f93d41338a0 0x7f93d4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c37fe700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c3fff700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f03bc002230 tx=0x7f03bc00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93cbfff700 1 -- 172.21.15.19:0/3953052452 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967336200 0 0) 0x7f93d406ef30 con 0x7f93d409de50 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f93cbfff700 1 -- 172.21.15.19:0/3953052452 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c00035b0 con 0x7f93d409de50 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc00ab70 con 0x7f03c409e410 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc00acd0 con 0x7f03c409e410 2023-10-03T10:16:38.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c4121b20 con 0x7f03c409e410 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc007310 con 0x7f03c409e410 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.002+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c409c750 con 0x7f03c409e410 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93d9903700 1 -- 172.21.15.19:0/3953052452 >> v2:172.21.15.19:3300/0 conn(0x7f93d41338a0 msgr2=0x7f93d4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93d9903700 1 --2- 172.21.15.19:0/3953052452 >> v2:172.21.15.19:3300/0 conn(0x7f93d41338a0 0x7f93d4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93d9903700 1 -- 172.21.15.19:0/3953052452 >> v1:172.21.15.19:6789/0 conn(0x7f93d409de50 legacy=0x7f93d409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93d9903700 1 -- 172.21.15.19:0/3953052452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d406fc30 con 0x7f93d409e930 2023-10-03T10:16:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93d9903700 1 --2- 172.21.15.19:0/3953052452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d413b740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009d90 tx=0x7f93cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd55937685351327 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93cbfff700 1 -- 172.21.15.19:0/3953052452 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc00e070 con 0x7f93d409e930 2023-10-03T10:16:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93cbfff700 1 -- 172.21.15.19:0/3953052452 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc00bb20 con 0x7f93d409e930 2023-10-03T10:16:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.003+0000 7f93cbfff700 1 -- 172.21.15.19:0/3953052452 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc012430 con 0x7f93d409e930 2023-10-03T10:16:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c41213d0 con 0x7f03c409e410 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 -- 172.21.15.19:0/3953052452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 msgr2=0x7f93d413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 --2- 172.21.15.19:0/3953052452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d413b740 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009d90 tx=0x7f93cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 -- 172.21.15.19:0/3953052452 shutdown_connections 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 --2- 172.21.15.19:0/3953052452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d413b740 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 --2- 172.21.15.19:0/3953052452 >> v2:172.21.15.19:3300/0 conn(0x7f93d41338a0 0x7f93d4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 -- 172.21.15.19:0/3953052452 >> 172.21.15.19:0/3953052452 conn(0x7f93d40a2aa0 msgr2=0x7f93d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 -- 172.21.15.19:0/3953052452 shutdown_connections 2023-10-03T10:16:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.004+0000 7f93db366700 1 -- 172.21.15.19:0/3953052452 wait complete. 2023-10-03T10:16:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.005+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03bc007470 con 0x7f03c409e410 2023-10-03T10:16:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.005+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03bc03f750 con 0x7f03c409e410 2023-10-03T10:16:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.006+0000 7f93db366700 1 Processor -- start 2023-10-03T10:16:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.006+0000 7f93db366700 1 -- start start 2023-10-03T10:16:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93d41338a0 0x7f93d411c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d411e560 con 0x7f93d409de50 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d411efb0 con 0x7f93d41338a0 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93db366700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93d411f1b0 con 0x7f93d409e930 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d8901700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48108/0 (socket says 172.21.15.19:48108) 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 -- 172.21.15.19:0/3489456571 learned_addr learned my addr 172.21.15.19:0/3489456571 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d8901700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47692/0 (socket says 172.21.15.19:47692) 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 -- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 msgr2=0x7f93d411bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 -- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93d41338a0 msgr2=0x7f93d411c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93d41338a0 0x7f93d411c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d9102700 1 -- 172.21.15.19:0/3489456571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc009a70 con 0x7f93d409de50 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.007+0000 7f93d8901700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.008+0000 7f93d9102700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e9b0 tx=0x7f93d000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.009+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0009710 con 0x7f93d409de50 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.009+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d000c850 con 0x7f93d409de50 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.009+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d000cbc0 con 0x7f93d409de50 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.009+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d411e100 con 0x7f93d409de50 2023-10-03T10:16:38.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.009+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03bc00ae40 con 0x7f03c409e410 2023-10-03T10:16:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.010+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d406f640 con 0x7f93d409de50 2023-10-03T10:16:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.011+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d4074ea0 con 0x7f93d409de50 2023-10-03T10:16:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.015+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93d000cd20 con 0x7f93d409de50 2023-10-03T10:16:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.015+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93d003fe40 con 0x7f93d409de50 2023-10-03T10:16:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.023+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93d0013470 con 0x7f93d409de50 2023-10-03T10:16:38.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 Processor -- start 2023-10-03T10:16:38.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 -- start start 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffae809e930 0x7ffae809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809f240 0x7ffae81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffae8070940 con 0x7ffae809e930 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae806fd60 con 0x7ffae809f650 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.048+0000 7ffaeee51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffae806fa80 con 0x7ffae809f240 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffae809e930 0x7ffae809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffae809e930 0x7ffae809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48116/0 (socket says 172.21.15.19:48116) 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 -- 172.21.15.19:0/2460601416 learned_addr learned my addr 172.21.15.19:0/2460601416 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:38.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaed3ee700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 -- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809f240 msgr2=0x7ffae81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809f240 0x7ffae81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 -- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 msgr2=0x7ffae8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 -- 172.21.15.19:0/2460601416 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffae809fb60 con 0x7ffae809e930 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.049+0000 7ffaecbed700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809e930 0x7ffae809ed00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098f0 tx=0x7ffadc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a996e8613e9d7da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.050+0000 7ffae77fe700 1 -- 172.21.15.19:0/2460601416 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc011830 con 0x7ffae809e930 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.050+0000 7ffae77fe700 1 -- 172.21.15.19:0/2460601416 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffadc011990 con 0x7ffae809e930 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.050+0000 7ffae77fe700 1 -- 172.21.15.19:0/2460601416 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc011d20 con 0x7ffae809e930 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.050+0000 7ffaeee51700 1 -- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809e930 msgr2=0x7ffae809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.050+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809e930 0x7ffae809ed00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ffadc0098f0 tx=0x7ffadc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 -- 172.21.15.19:0/2460601416 shutdown_connections 2023-10-03T10:16:38.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809e930 0x7ffae809ed00 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2460601416 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809f240 0x7ffae81317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 -- 172.21.15.19:0/2460601416 >> 172.21.15.19:0/2460601416 conn(0x7ffae80a4210 msgr2=0x7ffae80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 -- 172.21.15.19:0/2460601416 shutdown_connections 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.051+0000 7ffaeee51700 1 -- 172.21.15.19:0/2460601416 wait complete. 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.052+0000 7ffaeee51700 1 Processor -- start 2023-10-03T10:16:38.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.052+0000 7ffaeee51700 1 -- start start 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809e930 0x7ffae81b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 0x7ffae81a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae81a4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81a80c0 con 0x7ffae809f240 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81a7700 con 0x7ffae809f650 2023-10-03T10:16:38.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaeee51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81a6e90 con 0x7ffae809e930 2023-10-03T10:16:38.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaed3ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae81a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 0x7ffae81a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaed3ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae81a4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48692/0 (socket says 172.21.15.19:48692) 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaed3ee700 1 -- 172.21.15.19:0/2521536154 learned_addr learned my addr 172.21.15.19:0/2521536154 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.053+0000 7ffaecbed700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809e930 0x7ffae81b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 -- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809e930 msgr2=0x7ffae81b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809e930 0x7ffae81b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 -- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 msgr2=0x7ffae81a4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae81a4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 -- 172.21.15.19:0/2521536154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009550 con 0x7ffae809f240 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae7fff700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 0x7ffae81a3be0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffad400b480 tx=0x7ffad400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4011830 con 0x7ffae809f240 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad4011990 con 0x7ffae809f240 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4011d40 con 0x7ffae809f240 2023-10-03T10:16:38.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae80a0190 con 0x7ffae809f240 2023-10-03T10:16:38.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.054+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81a6aa0 con 0x7ffae809f240 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.056+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffae81a70c0 con 0x7ffae809f240 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.057+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffad401a400 con 0x7ffae809f240 2023-10-03T10:16:38.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.057+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffad403f7d0 con 0x7ffae809f240 2023-10-03T10:16:38.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.065+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffad4022990 con 0x7ffae809f240 2023-10-03T10:16:38.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.196+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8db00983b0 con 0x7f8db009a260 2023-10-03T10:16:38.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.197+0000 7f8d977fe700 1 -- 172.21.15.19:0/2299893410 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8da4034070 con 0x7f8db009a260 2023-10-03T10:16:38.199 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 msgr2=0x7f8db01332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 0x7f8db01332e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8da4016000 tx=0x7f8da4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 shutdown_connections 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db009a630 0x7f8db0133820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db0099780 0x7f8db0132da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 --2- 172.21.15.19:0/2299893410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db009a260 0x7f8db01332e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 >> 172.21.15.19:0/2299893410 conn(0x7f8db00a2540 msgr2=0x7f8db009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 shutdown_connections 2023-10-03T10:16:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.200+0000 7f8db4803700 1 -- 172.21.15.19:0/2299893410 wait complete. 2023-10-03T10:16:38.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:38.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.245+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f93d411ee10 con 0x7f93d409de50 2023-10-03T10:16:38.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.245+0000 7f93c9ffb700 1 -- 172.21.15.19:0/3489456571 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93d411ee10 con 0x7f93d409de50 2023-10-03T10:16:38.245 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 msgr2=0x7f93d411b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f93d000e9b0 tx=0x7f93d000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 shutdown_connections 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93d41338a0 0x7f93d411c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93d409de50 0x7f93d411b690 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 --2- 172.21.15.19:0/3489456571 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93d409e930 0x7f93d411bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 >> 172.21.15.19:0/3489456571 conn(0x7f93d40a2aa0 msgr2=0x7f93d4130510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 shutdown_connections 2023-10-03T10:16:38.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.248+0000 7f93db366700 1 -- 172.21.15.19:0/3489456571 wait complete. 2023-10-03T10:16:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.249+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f03c411ac20 con 0x7f03c409e410 2023-10-03T10:16:38.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.249+0000 7f03abfff700 1 -- 172.21.15.19:0/2956270498 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03bc018030 con 0x7f03c409e410 2023-10-03T10:16:38.249 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 msgr2=0x7f03c411ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f03bc002230 tx=0x7f03bc00cf50 comp rx=0 tx=0).stop 2023-10-03T10:16:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 shutdown_connections 2023-10-03T10:16:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c409e410 0x7f03c411ea80 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c409d6f0 0x7f03c411e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 --2- 172.21.15.19:0/2956270498 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c409e000 0x7f03c411e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.251+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 >> 172.21.15.19:0/2956270498 conn(0x7f03c4066f50 msgr2=0x7f03c4130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.254+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 shutdown_connections 2023-10-03T10:16:38.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.254+0000 7f03c9aaa700 1 -- 172.21.15.19:0/2956270498 wait complete. 2023-10-03T10:16:38.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:38.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:38.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.286+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffae81a6aa0 con 0x7ffae809f240 2023-10-03T10:16:38.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.286+0000 7ffae57fa700 1 -- 172.21.15.19:0/2521536154 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffae81a6aa0 con 0x7ffae809f240 2023-10-03T10:16:38.286 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 msgr2=0x7ffae81a3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 0x7ffae81a3be0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7ffad400b480 tx=0x7ffad400b790 comp rx=0 tx=0).stop 2023-10-03T10:16:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 shutdown_connections 2023-10-03T10:16:38.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffae809f650 0x7ffae81a4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffae809e930 0x7ffae81b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 --2- 172.21.15.19:0/2521536154 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffae809f240 0x7ffae81a3be0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 >> 172.21.15.19:0/2521536154 conn(0x7ffae80a4210 msgr2=0x7ffae81b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 shutdown_connections 2023-10-03T10:16:38.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:38.288+0000 7ffaeee51700 1 -- 172.21.15.19:0/2521536154 wait complete. 2023-10-03T10:16:38.301 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:39.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:39.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:39.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:39.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:39.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.384+0000 7fa2a5da5700 1 Processor -- start 2023-10-03T10:16:39.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.384+0000 7fa2a5da5700 1 -- start start 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa2a5da5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2a009e1d0 0x7fa2a0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa2a5da5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a0139170 0x7fa2a013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa2a5da5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a009b120 con 0x7fa2a009d6f0 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa2a5da5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a006b460 con 0x7fa2a009e1d0 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa2a5da5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a009a7e0 con 0x7fa2a0139170 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa2a009d6f0 0x7fa2a009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36828/0 (socket says 172.21.15.19:36828) 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29f7fe700 1 -- 172.21.15.19:0/82701229 learned_addr learned my addr 172.21.15.19:0/82701229 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29effd700 1 --2- 172.21.15.19:0/82701229 >> v2:172.21.15.19:3300/0 conn(0x7fa2a009e1d0 0x7fa2a0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29ffff700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a0139170 0x7fa2a013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29effd700 1 -- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a0139170 msgr2=0x7fa2a013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29effd700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a0139170 0x7fa2a013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29effd700 1 -- 172.21.15.19:0/82701229 >> v1:172.21.15.19:6789/0 conn(0x7fa2a009d6f0 legacy=0x7fa2a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29e7fc700 1 -- 172.21.15.19:0/82701229 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074216632 0 0) 0x7fa2a009b120 con 0x7fa2a009d6f0 2023-10-03T10:16:39.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.385+0000 7fa29effd700 1 -- 172.21.15.19:0/82701229 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a009a500 con 0x7fa2a009e1d0 2023-10-03T10:16:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.386+0000 7fa29effd700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a009e1d0 0x7fa2a0138c30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa294009870 tx=0x7fa294009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a7a13d5ff8821f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.386+0000 7fa29e7fc700 1 -- 172.21.15.19:0/82701229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011830 con 0x7fa2a009e1d0 2023-10-03T10:16:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.386+0000 7fa29e7fc700 1 -- 172.21.15.19:0/82701229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa294011990 con 0x7fa2a009e1d0 2023-10-03T10:16:39.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.386+0000 7fa29e7fc700 1 -- 172.21.15.19:0/82701229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa294011d20 con 0x7fa2a009e1d0 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 -- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a009e1d0 msgr2=0x7fa2a0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a009e1d0 0x7fa2a0138c30 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa294009870 tx=0x7fa294009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 -- 172.21.15.19:0/82701229 shutdown_connections 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a0139170 0x7fa2a013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/82701229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a009e1d0 0x7fa2a0138c30 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 -- 172.21.15.19:0/82701229 >> 172.21.15.19:0/82701229 conn(0x7fa2a0066f50 msgr2=0x7fa2a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 -- 172.21.15.19:0/82701229 shutdown_connections 2023-10-03T10:16:39.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.387+0000 7fa2a5da5700 1 -- 172.21.15.19:0/82701229 wait complete. 2023-10-03T10:16:39.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.389+0000 7fa2a5da5700 1 Processor -- start 2023-10-03T10:16:39.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.389+0000 7fa2a5da5700 1 -- start start 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 0x7fa2a0121960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 0x7fa2a0121ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a00a3a20 con 0x7fa2a0139170 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a01251a0 con 0x7fa2a009d6f0 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa2a5da5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0137850 con 0x7fa2a009e1d0 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 0x7fa2a0121ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 0x7fa2a0121ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47726/0 (socket says 172.21.15.19:47726) 2023-10-03T10:16:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48152/0 (socket says 172.21.15.19:48152) 2023-10-03T10:16:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29effd700 1 -- 172.21.15.19:0/13837570 learned_addr learned my addr 172.21.15.19:0/13837570 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29f7fe700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 0x7fa2a0121960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 -- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 msgr2=0x7fa2a0121ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 0x7fa2a0121ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 -- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 msgr2=0x7fa2a0121960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 0x7fa2a0121960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29ffff700 1 -- 172.21.15.19:0/13837570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2940094a0 con 0x7fa2a0139170 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.390+0000 7fa29f7fe700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 0x7fa2a0121960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.391+0000 7fa29ffff700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa29800ef90 tx=0x7fa29800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.391+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa29800cc90 con 0x7fa2a0139170 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.391+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800f040 con 0x7fa2a0139170 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.391+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a0123680 con 0x7fa2a0139170 2023-10-03T10:16:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.391+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a0123ad0 con 0x7fa2a0139170 2023-10-03T10:16:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.392+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980146c0 con 0x7fa2a0139170 2023-10-03T10:16:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.393+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa298014820 con 0x7fa2a0139170 2023-10-03T10:16:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.393+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa29801c570 con 0x7fa2a0139170 2023-10-03T10:16:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.393+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a0124dc0 con 0x7fa2a0139170 2023-10-03T10:16:39.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.398+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa298018070 con 0x7fa2a0139170 2023-10-03T10:16:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.424+0000 7efed6169700 1 Processor -- start 2023-10-03T10:16:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.424+0000 7efed6169700 1 -- start start 2023-10-03T10:16:39.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 0x7efed009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efed009e410 0x7efed0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed006b460 con 0x7efed009e410 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed009b120 con 0x7efed009e000 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.425+0000 7efed6169700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed009a7e0 con 0x7efed009d6f0 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efeceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 0x7efed009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efeceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48708/0 (socket says 172.21.15.19:48708) 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efeceffd700 1 -- 172.21.15.19:0/2592139537 learned_addr learned my addr 172.21.15.19:0/2592139537 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecffff700 1 --2- 172.21.15.19:0/2592139537 >> v2:172.21.15.19:3300/0 conn(0x7efed009e410 0x7efed0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 -- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 msgr2=0x7efed01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 -- 172.21.15.19:0/2592139537 >> v2:172.21.15.19:3300/0 conn(0x7efed009e410 msgr2=0x7efed0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 --2- 172.21.15.19:0/2592139537 >> v2:172.21.15.19:3300/0 conn(0x7efed009e410 0x7efed0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 -- 172.21.15.19:0/2592139537 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed009a500 con 0x7efed009d6f0 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efeceffd700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efecf7fe700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 0x7efed009dac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efec0009870 tx=0x7efec0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fc2e6268a2d9a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.426+0000 7efece7fc700 1 -- 172.21.15.19:0/2592139537 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0011830 con 0x7efed009d6f0 2023-10-03T10:16:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efece7fc700 1 -- 172.21.15.19:0/2592139537 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0011990 con 0x7efed009d6f0 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efece7fc700 1 -- 172.21.15.19:0/2592139537 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0011d20 con 0x7efed009d6f0 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 -- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 msgr2=0x7efed009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 0x7efed009dac0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efec0009870 tx=0x7efec0009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 -- 172.21.15.19:0/2592139537 shutdown_connections 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 --2- 172.21.15.19:0/2592139537 >> v2:172.21.15.19:3300/0 conn(0x7efed009e410 0x7efed0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009d6f0 0x7efed009dac0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 --2- 172.21.15.19:0/2592139537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009e000 0x7efed01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 -- 172.21.15.19:0/2592139537 >> 172.21.15.19:0/2592139537 conn(0x7efed0066f50 msgr2=0x7efed009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 -- 172.21.15.19:0/2592139537 shutdown_connections 2023-10-03T10:16:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.427+0000 7efed6169700 1 -- 172.21.15.19:0/2592139537 wait complete. 2023-10-03T10:16:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.429+0000 7efed6169700 1 Processor -- start 2023-10-03T10:16:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.429+0000 7efed6169700 1 -- start start 2023-10-03T10:16:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009d6f0 0x7efed01a52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009e410 0x7efed01c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed01a8190 con 0x7efed009e000 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed01a8370 con 0x7efed009d6f0 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efed6169700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efed01b91e0 con 0x7efed009e410 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efeceffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efeceffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48170/0 (socket says 172.21.15.19:48170) 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efecf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009d6f0 0x7efed01a52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efeceffd700 1 -- 172.21.15.19:0/3640606313 learned_addr learned my addr 172.21.15.19:0/3640606313 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.430+0000 7efecffff700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009e410 0x7efed01c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 -- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009e410 msgr2=0x7efed01c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009e410 0x7efed01c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 -- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009d6f0 msgr2=0x7efed01a52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009d6f0 0x7efed01a52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 -- 172.21.15.19:0/3640606313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009550 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeceffd700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efec400ec10 tx=0x7efec400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400c850 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400c9b0 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec00094a0 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400cd60 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.431+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed00a3000 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.432+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efec4013470 con 0x7efed009e000 2023-10-03T10:16:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.433+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efec403f8e0 con 0x7efed009e000 2023-10-03T10:16:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.433+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed009c710 con 0x7efed009e000 2023-10-03T10:16:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.438+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efec40232f0 con 0x7efed009e000 2023-10-03T10:16:39.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 Processor -- start 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 -- start start 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b412f8b0 0x7f65b412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b412cd90 con 0x7f65b4130260 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b412d330 con 0x7f65b412f8b0 2023-10-03T10:16:39.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b920d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b41306e0 con 0x7f65b412cf60 2023-10-03T10:16:39.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f65b412f8b0 0x7f65b412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48716/0 (socket says 172.21.15.19:48716) 2023-10-03T10:16:39.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b2d9d700 1 -- 172.21.15.19:0/3374430600 learned_addr learned my addr 172.21.15.19:0/3374430600 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.460+0000 7f65b359e700 1 --1- 172.21.15.19:0/3374430600 >> v1:172.21.15.19:6789/0 conn(0x7f65b4130260 0x7f65b4136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36844/0 (socket says 172.21.15.19:36844) 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b2d9d700 1 -- 172.21.15.19:0/3374430600 >> v2:172.21.15.19:3300/0 conn(0x7f65b412f8b0 msgr2=0x7f65b412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b2d9d700 1 --2- 172.21.15.19:0/3374430600 >> v2:172.21.15.19:3300/0 conn(0x7f65b412f8b0 0x7f65b412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b2d9d700 1 -- 172.21.15.19:0/3374430600 >> v1:172.21.15.19:6789/0 conn(0x7f65b4130260 legacy=0x7f65b4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b2d9d700 1 -- 172.21.15.19:0/3374430600 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b4071780 con 0x7f65b412cf60 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b2d9d700 1 --2- 172.21.15.19:0/3374430600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f65a400aa90 tx=0x7f65a400ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61f5a729858e3b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b1d9b700 1 -- 172.21.15.19:0/3374430600 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a400cb70 con 0x7f65b412cf60 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b1d9b700 1 -- 172.21.15.19:0/3374430600 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a400ccd0 con 0x7f65b412cf60 2023-10-03T10:16:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.461+0000 7f65b1d9b700 1 -- 172.21.15.19:0/3374430600 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4018620 con 0x7f65b412cf60 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 -- 172.21.15.19:0/3374430600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 msgr2=0x7f65b406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 --2- 172.21.15.19:0/3374430600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f65a400aa90 tx=0x7f65a400ada0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 -- 172.21.15.19:0/3374430600 shutdown_connections 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 --2- 172.21.15.19:0/3374430600 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b412cf60 0x7f65b406f5d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 --2- 172.21.15.19:0/3374430600 >> v2:172.21.15.19:3300/0 conn(0x7f65b412f8b0 0x7f65b412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 -- 172.21.15.19:0/3374430600 >> 172.21.15.19:0/3374430600 conn(0x7f65b40a2aa0 msgr2=0x7f65b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 -- 172.21.15.19:0/3374430600 shutdown_connections 2023-10-03T10:16:39.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.462+0000 7f65b920d700 1 -- 172.21.15.19:0/3374430600 wait complete. 2023-10-03T10:16:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.464+0000 7f65b920d700 1 Processor -- start 2023-10-03T10:16:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.464+0000 7f65b920d700 1 -- start start 2023-10-03T10:16:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b412cf60 0x7f65b409bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 0x7f65b409c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b409e910 con 0x7f65b412f8b0 2023-10-03T10:16:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b409d230 con 0x7f65b4130260 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b920d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65b409eaf0 con 0x7f65b412cf60 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48724/0 (socket says 172.21.15.19:48724) 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 -- 172.21.15.19:0/1011386041 learned_addr learned my addr 172.21.15.19:0/1011386041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b259c700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 0x7f65b409c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 -- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b412cf60 msgr2=0x7f65b409bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b412cf60 0x7f65b409bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 -- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 msgr2=0x7f65b409c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 0x7f65b409c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b359e700 1 -- 172.21.15.19:0/1011386041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a400a6f0 con 0x7f65b4130260 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.465+0000 7f65b259c700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 0x7f65b409c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f65b359e700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00cbd0 tx=0x7f65ac00cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00ab00 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac00ac60 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac007070 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4129890 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.466+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b409d3d0 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.467+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65ac0071d0 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.467+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65ac03f580 con 0x7f65b4130260 2023-10-03T10:16:39.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.467+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65b4074ea0 con 0x7f65b4130260 2023-10-03T10:16:39.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.472+0000 7f840a702700 1 Processor -- start 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.472+0000 7f840a702700 1 -- start start 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f840a702700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f840a702700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f840409e000 0x7f8404130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f840a702700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840409f130 con 0x7f840409e410 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f840a702700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840409f520 con 0x7f840409e000 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f840a702700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840409e930 con 0x7f840409d6f0 2023-10-03T10:16:39.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65ac017020 con 0x7f65b4130260 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f8403fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f84037fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f840409e000 0x7f8404130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f8403fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48738/0 (socket says 172.21.15.19:48738) 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f8403fff700 1 -- 172.21.15.19:0/855482393 learned_addr learned my addr 172.21.15.19:0/855482393 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.473+0000 7f8403fff700 1 -- 172.21.15.19:0/855482393 >> v2:172.21.15.19:3300/0 conn(0x7f840409e000 msgr2=0x7f8404130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:39.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8403fff700 1 --2- 172.21.15.19:0/855482393 >> v2:172.21.15.19:3300/0 conn(0x7f840409e000 0x7f8404130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8403fff700 1 -- 172.21.15.19:0/855482393 >> v1:172.21.15.19:6789/0 conn(0x7f840409e410 legacy=0x7f8404130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8403fff700 1 -- 172.21.15.19:0/855482393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840409b2d0 con 0x7f840409d6f0 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8403fff700 1 --2- 172.21.15.19:0/855482393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83f40098f0 tx=0x7f83f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baf4a0acb8f1c5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8402ffd700 1 -- 172.21.15.19:0/855482393 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4011830 con 0x7f840409d6f0 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8402ffd700 1 -- 172.21.15.19:0/855482393 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4011990 con 0x7f840409d6f0 2023-10-03T10:16:39.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.474+0000 7f8402ffd700 1 -- 172.21.15.19:0/855482393 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4011d20 con 0x7f840409d6f0 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 -- 172.21.15.19:0/855482393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 msgr2=0x7f840409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 --2- 172.21.15.19:0/855482393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f83f40098f0 tx=0x7f83f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 -- 172.21.15.19:0/855482393 shutdown_connections 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 --2- 172.21.15.19:0/855482393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409d6f0 0x7f840409dac0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 --2- 172.21.15.19:0/855482393 >> v2:172.21.15.19:3300/0 conn(0x7f840409e000 0x7f8404130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 -- 172.21.15.19:0/855482393 >> 172.21.15.19:0/855482393 conn(0x7f8404066f50 msgr2=0x7f840409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 -- 172.21.15.19:0/855482393 shutdown_connections 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.475+0000 7f840a702700 1 -- 172.21.15.19:0/855482393 wait complete. 2023-10-03T10:16:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.476+0000 7f840a702700 1 Processor -- start 2023-10-03T10:16:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.476+0000 7f840a702700 1 -- start start 2023-10-03T10:16:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 0x7f840411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f840409e410 0x7f840411ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840411f450 con 0x7f840409d6f0 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8404130360 con 0x7f840409e000 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f840a702700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84041201b0 con 0x7f840409e410 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f8403fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f8403fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48216/0 (socket says 172.21.15.19:48216) 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f8403fff700 1 -- 172.21.15.19:0/1896839021 learned_addr learned my addr 172.21.15.19:0/1896839021 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f84037fe700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 0x7f840411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.477+0000 7f8408c9f700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f840409e410 0x7f840411ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 -- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f840409e410 msgr2=0x7f840411ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f840409e410 0x7f840411ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 -- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 msgr2=0x7f840411df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 -- 172.21.15.19:0/1896839021 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4009550 con 0x7f840409e000 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f8403fff700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f84037fe700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 0x7f840411e4c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83f8012be0 tx=0x7f83f8012ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8010920 con 0x7f840409e000 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8013040 con 0x7f840409e000 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8404120de0 con 0x7f840409e000 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8010c80 con 0x7f840409e000 2023-10-03T10:16:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.478+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84040a1e00 con 0x7f840409e000 2023-10-03T10:16:39.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.479+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f83f8018480 con 0x7f840409e000 2023-10-03T10:16:39.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.479+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83f8043620 con 0x7f840409e000 2023-10-03T10:16:39.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.479+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840409c700 con 0x7f840409e000 2023-10-03T10:16:39.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.484+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f83f8016930 con 0x7f840409e000 2023-10-03T10:16:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.638+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2a009f420 con 0x7fa2a0139170 2023-10-03T10:16:39.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.639+0000 7fa287fff700 1 -- 172.21.15.19:0/13837570 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa298018030 con 0x7fa2a0139170 2023-10-03T10:16:39.639 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 msgr2=0x7fa2a01223e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa29800ef90 tx=0x7fa29800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 shutdown_connections 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2a0139170 0x7fa2a01223e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2a009d6f0 0x7fa2a0121960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 --2- 172.21.15.19:0/13837570 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa2a009e1d0 0x7fa2a0121ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 >> 172.21.15.19:0/13837570 conn(0x7fa2a0066f50 msgr2=0x7fa2a0070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 shutdown_connections 2023-10-03T10:16:39.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.641+0000 7fa2a5da5700 1 -- 172.21.15.19:0/13837570 wait complete. 2023-10-03T10:16:39.655 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.666+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efed0074ea0 con 0x7efed009e000 2023-10-03T10:16:39.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.667+0000 7efeb7fff700 1 -- 172.21.15.19:0/3640606313 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efec402a090 con 0x7efed009e000 2023-10-03T10:16:39.667 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 msgr2=0x7efed01a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7efec400ec10 tx=0x7efec400ef20 comp rx=0 tx=0).stop 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 shutdown_connections 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efed009e410 0x7efed01c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efed009d6f0 0x7efed01a52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 --2- 172.21.15.19:0/3640606313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efed009e000 0x7efed01a57f0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 >> 172.21.15.19:0/3640606313 conn(0x7efed0066f50 msgr2=0x7efed006f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 shutdown_connections 2023-10-03T10:16:39.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.669+0000 7efed6169700 1 -- 172.21.15.19:0/3640606313 wait complete. 2023-10-03T10:16:39.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.697+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8404074ea0 con 0x7f840409e000 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.697+0000 7f8400ff9700 1 -- 172.21.15.19:0/1896839021 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f83f8016340 con 0x7f840409e000 2023-10-03T10:16:39.697 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 msgr2=0x7f840411e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 0x7f840411e4c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83f8012be0 tx=0x7f83f8012ef0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 shutdown_connections 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f840409e410 0x7f840411ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f840409d6f0 0x7f840411df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.699+0000 7f840a702700 1 --2- 172.21.15.19:0/1896839021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f840409e000 0x7f840411e4c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.700+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 >> 172.21.15.19:0/1896839021 conn(0x7f8404066f50 msgr2=0x7f8404071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.700+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 shutdown_connections 2023-10-03T10:16:39.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.700+0000 7f840a702700 1 -- 172.21.15.19:0/1896839021 wait complete. 2023-10-03T10:16:39.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.714+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65b409e770 con 0x7f65b4130260 2023-10-03T10:16:39.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.715+0000 7f659b7fe700 1 -- 172.21.15.19:0/1011386041 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65b409e770 con 0x7f65b4130260 2023-10-03T10:16:39.715 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 msgr2=0x7f65b41c3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00cbd0 tx=0x7f65ac00cee0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 shutdown_connections 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65b4130260 0x7f65b41c3fb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65b412cf60 0x7f65b409bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 --2- 172.21.15.19:0/1011386041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65b412f8b0 0x7f65b409c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 >> 172.21.15.19:0/1011386041 conn(0x7f65b40a2aa0 msgr2=0x7f65b406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 shutdown_connections 2023-10-03T10:16:39.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:39.717+0000 7f65b920d700 1 -- 172.21.15.19:0/1011386041 wait complete. 2023-10-03T10:16:39.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:40.656 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:40.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:40.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:40.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.821+0000 7fbcb07c0700 1 Processor -- start 2023-10-03T10:16:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.821+0000 7fbcb07c0700 1 -- start start 2023-10-03T10:16:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.822+0000 7fbcb07c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbca809d630 0x7fbca80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.822+0000 7fbcb07c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.822+0000 7fbcb07c0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca80a2a70 con 0x7fbca80a0a30 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.822+0000 7fbcb07c0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca80a01d0 con 0x7fbca809d630 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcb07c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbca809e2b0 con 0x7fbca8138d80 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcaed5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcaed5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47774/0 (socket says 172.21.15.19:47774) 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcaed5d700 1 -- 172.21.15.19:0/4112044210 learned_addr learned my addr 172.21.15.19:0/4112044210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcadd5b700 1 --2- 172.21.15.19:0/4112044210 >> v2:172.21.15.19:3300/0 conn(0x7fbca809d630 0x7fbca80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcadd5b700 1 -- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 msgr2=0x7fbca813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcadd5b700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcadd5b700 1 -- 172.21.15.19:0/4112044210 >> v1:172.21.15.19:6789/0 conn(0x7fbca80a0a30 legacy=0x7fbca80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcadd5b700 1 -- 172.21.15.19:0/4112044210 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca809dc50 con 0x7fbca809d630 2023-10-03T10:16:40.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcad55a700 1 -- 172.21.15.19:0/4112044210 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687813617 0 0) 0x7fbca80a2a70 con 0x7fbca80a0a30 2023-10-03T10:16:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.823+0000 7fbcaed5d700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.824+0000 7fbcadd5b700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca80a1510 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009840 tx=0x7fbc98009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d7f1605af1e98b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.824+0000 7fbcad55a700 1 -- 172.21.15.19:0/4112044210 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011830 con 0x7fbca809d630 2023-10-03T10:16:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.824+0000 7fbcad55a700 1 -- 172.21.15.19:0/4112044210 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98011990 con 0x7fbca809d630 2023-10-03T10:16:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.824+0000 7fbcad55a700 1 -- 172.21.15.19:0/4112044210 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011d20 con 0x7fbca809d630 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 -- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 msgr2=0x7fbca80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca80a1510 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009840 tx=0x7fbc98009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 -- 172.21.15.19:0/4112044210 shutdown_connections 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca8138d80 0x7fbca813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/4112044210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca80a1510 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 -- 172.21.15.19:0/4112044210 >> 172.21.15.19:0/4112044210 conn(0x7fbca80a3050 msgr2=0x7fbca80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 -- 172.21.15.19:0/4112044210 shutdown_connections 2023-10-03T10:16:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.825+0000 7fbcb07c0700 1 -- 172.21.15.19:0/4112044210 wait complete. 2023-10-03T10:16:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 Processor -- start 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 -- start start 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca80a0a30 0x7fbca8133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbca8138d80 0x7fbca8134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8136190 con 0x7fbca809d630 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8136eb0 con 0x7fbca8138d80 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.827+0000 7fbcb07c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80a4ba0 con 0x7fbca80a0a30 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcaed5d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbca8138d80 0x7fbca8134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48244/0 (socket says 172.21.15.19:48244) 2023-10-03T10:16:40.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 -- 172.21.15.19:0/38582163 learned_addr learned my addr 172.21.15.19:0/38582163 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcadd5b700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca80a0a30 0x7fbca8133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 -- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca80a0a30 msgr2=0x7fbca8133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca80a0a30 0x7fbca8133c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 -- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbca8138d80 msgr2=0x7fbca8134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbca8138d80 0x7fbca8134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 -- 172.21.15.19:0/38582163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca0009b30 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbcae55c700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c520 tx=0x7fbca400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.828+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40054e0 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.829+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca4003680 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.829+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca40039f0 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.829+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc980094a0 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.829+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca8136540 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.830+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbca4003b50 con 0x7fbca809d630 2023-10-03T10:16:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.830+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbca403ea10 con 0x7fbca809d630 2023-10-03T10:16:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.830+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca81379e0 con 0x7fbca809d630 2023-10-03T10:16:40.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.835+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbca401b3b0 con 0x7fbca809d630 2023-10-03T10:16:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.868+0000 7fc40d528700 1 Processor -- start 2023-10-03T10:16:40.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.868+0000 7fc40d528700 1 -- start start 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc40d528700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 0x7fc408138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc40d528700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc408139170 0x7fc40813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc40d528700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc40809b120 con 0x7fc40809d6f0 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc40d528700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40806b460 con 0x7fc408139170 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc40d528700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc40809a7e0 con 0x7fc40809e1d0 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc4067fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 0x7fc408138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc4067fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 0x7fc408138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47784/0 (socket says 172.21.15.19:47784) 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc4067fc700 1 -- 172.21.15.19:0/1525760409 learned_addr learned my addr 172.21.15.19:0/1525760409 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc406ffd700 1 --1- 172.21.15.19:0/1525760409 >> v1:172.21.15.19:6789/0 conn(0x7fc40809d6f0 0x7fc40809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36876/0 (socket says 172.21.15.19:36876) 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.869+0000 7fc4077fe700 1 --2- 172.21.15.19:0/1525760409 >> v2:172.21.15.19:3300/0 conn(0x7fc408139170 0x7fc40813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc4077fe700 1 -- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 msgr2=0x7fc408138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc4077fe700 1 --2- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 0x7fc408138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc4077fe700 1 -- 172.21.15.19:0/1525760409 >> v1:172.21.15.19:6789/0 conn(0x7fc40809d6f0 legacy=0x7fc40809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc4077fe700 1 -- 172.21.15.19:0/1525760409 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40809a500 con 0x7fc408139170 2023-10-03T10:16:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc4077fe700 1 --2- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408139170 0x7fc40813b550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf091e8b634707f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc405ffb700 1 -- 172.21.15.19:0/1525760409 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40000e070 con 0x7fc408139170 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc405ffb700 1 -- 172.21.15.19:0/1525760409 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40000bb20 con 0x7fc408139170 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.870+0000 7fc405ffb700 1 -- 172.21.15.19:0/1525760409 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400012430 con 0x7fc408139170 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 -- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408139170 msgr2=0x7fc40813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 --2- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408139170 0x7fc40813b550 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc400009d90 tx=0x7fc40000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 -- 172.21.15.19:0/1525760409 shutdown_connections 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 --2- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408139170 0x7fc40813b550 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 --2- 172.21.15.19:0/1525760409 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809e1d0 0x7fc408138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 -- 172.21.15.19:0/1525760409 >> 172.21.15.19:0/1525760409 conn(0x7fc408066f50 msgr2=0x7fc40809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 -- 172.21.15.19:0/1525760409 shutdown_connections 2023-10-03T10:16:40.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.871+0000 7fc40d528700 1 -- 172.21.15.19:0/1525760409 wait complete. 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.872+0000 7fc40d528700 1 Processor -- start 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.872+0000 7fc40d528700 1 -- start start 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc40809e1d0 0x7fc40811f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc408139170 0x7fc4081c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc408122510 con 0x7fc40809d6f0 2023-10-03T10:16:40.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc408121ee0 con 0x7fc40809e1d0 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc40d528700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080a3b10 con 0x7fc408139170 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48254/0 (socket says 172.21.15.19:48254) 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 -- 172.21.15.19:0/2514688630 learned_addr learned my addr 172.21.15.19:0/2514688630 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc4067fc700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc40809e1d0 0x7fc40811f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc4077fe700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc408139170 0x7fc4081c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 -- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc408139170 msgr2=0x7fc4081c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc408139170 0x7fc4081c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 -- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc40809e1d0 msgr2=0x7fc40811f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc40809e1d0 0x7fc40811f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.873+0000 7fc406ffd700 1 -- 172.21.15.19:0/2514688630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc400009a70 con 0x7fc40809d6f0 2023-10-03T10:16:40.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc406ffd700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c520 tx=0x7fc3f800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8005cb0 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f8005e10 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40809c710 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f80072d0 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.874+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40811fdc0 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.875+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3f8007430 con 0x7fc40809d6f0 2023-10-03T10:16:40.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.875+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3f803eae0 con 0x7fc40809d6f0 2023-10-03T10:16:40.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.875+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408074ea0 con 0x7fc40809d6f0 2023-10-03T10:16:40.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.880+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3f8017080 con 0x7fc40809d6f0 2023-10-03T10:16:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.891+0000 7fb922092700 1 Processor -- start 2023-10-03T10:16:40.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.891+0000 7fb922092700 1 -- start start 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb922092700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 0x7fb91c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb922092700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb922092700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c09f130 con 0x7fb91c09d6f0 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb922092700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c09f520 con 0x7fb91c09e1d0 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb922092700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c09e930 con 0x7fb91c135e50 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47800/0 (socket says 172.21.15.19:47800) 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 -- 172.21.15.19:0/2367822873 learned_addr learned my addr 172.21.15.19:0/2367822873 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91b7fe700 1 --1- 172.21.15.19:0/2367822873 >> v1:172.21.15.19:6789/0 conn(0x7fb91c09d6f0 0x7fb91c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36880/0 (socket says 172.21.15.19:36880) 2023-10-03T10:16:40.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91affd700 1 --2- 172.21.15.19:0/2367822873 >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 0x7fb91c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 -- 172.21.15.19:0/2367822873 >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 msgr2=0x7fb91c135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 --2- 172.21.15.19:0/2367822873 >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 0x7fb91c135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 -- 172.21.15.19:0/2367822873 >> v1:172.21.15.19:6789/0 conn(0x7fb91c09d6f0 legacy=0x7fb91c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.892+0000 7fb91bfff700 1 -- 172.21.15.19:0/2367822873 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c09b2d0 con 0x7fb91c135e50 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.893+0000 7fb91affd700 1 --2- 172.21.15.19:0/2367822873 >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 0x7fb91c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.893+0000 7fb91bfff700 1 --2- 172.21.15.19:0/2367822873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb914009eb0 tx=0x7fb91400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15dbd43dcf596d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.893+0000 7fb91a7fc700 1 -- 172.21.15.19:0/2367822873 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914003c20 con 0x7fb91c135e50 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.893+0000 7fb91a7fc700 1 -- 172.21.15.19:0/2367822873 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914003d80 con 0x7fb91c135e50 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.893+0000 7fb91a7fc700 1 -- 172.21.15.19:0/2367822873 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400bad0 con 0x7fb91c135e50 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 -- 172.21.15.19:0/2367822873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 msgr2=0x7fb91c138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 --2- 172.21.15.19:0/2367822873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb914009eb0 tx=0x7fb91400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 -- 172.21.15.19:0/2367822873 shutdown_connections 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 --2- 172.21.15.19:0/2367822873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c135e50 0x7fb91c138230 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 --2- 172.21.15.19:0/2367822873 >> v2:172.21.15.19:3300/0 conn(0x7fb91c09e1d0 0x7fb91c135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 -- 172.21.15.19:0/2367822873 >> 172.21.15.19:0/2367822873 conn(0x7fb91c066f50 msgr2=0x7fb91c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 -- 172.21.15.19:0/2367822873 shutdown_connections 2023-10-03T10:16:40.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.894+0000 7fb922092700 1 -- 172.21.15.19:0/2367822873 wait complete. 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 Processor -- start 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 -- start start 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 0x7fb91c1c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 0x7fb91c1c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 0x7fb91c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c11b1e0 con 0x7fb91c09d6f0 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c11aff0 con 0x7fb91c135e50 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.895+0000 7fb922092700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c11d010 con 0x7fb91c09e1d0 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 0x7fb91c1c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 0x7fb91c1c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 0x7fb91c1c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47806/0 (socket says 172.21.15.19:47806) 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 0x7fb91c1c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48280/0 (socket says 172.21.15.19:48280) 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91affd700 1 -- 172.21.15.19:0/735993331 learned_addr learned my addr 172.21.15.19:0/735993331 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 0x7fb91c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 -- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 msgr2=0x7fb91c1c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 0x7fb91c1c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 -- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 msgr2=0x7fb91c1c4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 0x7fb91c1c4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 -- 172.21.15.19:0/735993331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9100094a0 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.896+0000 7fb91bfff700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 0x7fb91c119480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb914016000 tx=0x7fb914004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.897+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914004440 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.897+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9140045e0 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.897+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9140094d0 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.897+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb914009b30 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.897+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c09c700 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.898+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb914011460 con 0x7fb91c135e50 2023-10-03T10:16:40.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.898+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c074ea0 con 0x7fb91c135e50 2023-10-03T10:16:40.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.898+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb914023560 con 0x7fb91c135e50 2023-10-03T10:16:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.902+0000 7fcbd2ffd700 1 Processor -- start 2023-10-03T10:16:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.902+0000 7fcbd2ffd700 1 -- start start 2023-10-03T10:16:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc09daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd2ffd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbcc09b940 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd2ffd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc09a920 con 0x7fcbcc09d6d0 2023-10-03T10:16:40.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd2ffd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc09ab10 con 0x7fcbcc130d10 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47820/0 (socket says 172.21.15.19:47820) 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 -- 172.21.15.19:0/1827212676 learned_addr learned my addr 172.21.15.19:0/1827212676 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd0d99700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc09daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbcb7fe700 1 -- 172.21.15.19:0/1827212676 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421518047 0 0) 0x7fcbcc09b940 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 -- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 msgr2=0x7fcbcc09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc09daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 -- 172.21.15.19:0/1827212676 >> v1:172.21.15.19:6789/0 conn(0x7fcbcc09dfe0 legacy=0x7fcbcc130600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.903+0000 7fcbd159a700 1 -- 172.21.15.19:0/1827212676 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc09c520 con 0x7fcbcc130d10 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.904+0000 7fcbd159a700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009e80 tx=0x7fcbc400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb2b143085cc6ae1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.904+0000 7fcbcb7fe700 1 -- 172.21.15.19:0/1827212676 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400e070 con 0x7fcbcc130d10 2023-10-03T10:16:40.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.904+0000 7fcbcb7fe700 1 -- 172.21.15.19:0/1827212676 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400b910 con 0x7fcbcc130d10 2023-10-03T10:16:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.904+0000 7fcbcb7fe700 1 -- 172.21.15.19:0/1827212676 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc400bcc0 con 0x7fcbcc130d10 2023-10-03T10:16:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 msgr2=0x7fcbcc1388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009e80 tx=0x7fcbc400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1827212676 shutdown_connections 2023-10-03T10:16:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc1388d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1827212676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc09daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1827212676 >> 172.21.15.19:0/1827212676 conn(0x7fcbcc099c20 msgr2=0x7fcbcc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1827212676 shutdown_connections 2023-10-03T10:16:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.905+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1827212676 wait complete. 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.906+0000 7fcbd2ffd700 1 Processor -- start 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.906+0000 7fcbd2ffd700 1 -- start start 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 0x7fcbcc120960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc122630 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc123ef0 con 0x7fcbcc09d6d0 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd2ffd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc130620 con 0x7fcbcc130d10 2023-10-03T10:16:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd159a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd159a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47832/0 (socket says 172.21.15.19:47832) 2023-10-03T10:16:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd159a700 1 -- 172.21.15.19:0/1075916991 learned_addr learned my addr 172.21.15.19:0/1075916991 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbcbfff700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 0x7fcbcc120960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbd0d99700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbcbfff700 1 -- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 msgr2=0x7fcbcc120ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbcbfff700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbcbfff700 1 -- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 msgr2=0x7fcbcc120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.907+0000 7fcbcbfff700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc120420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbcbfff700 1 -- 172.21.15.19:0/1075916991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009b30 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbd159a700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbd0d99700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbcbfff700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 0x7fcbcc120960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c430 tx=0x7fcbb800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb914029070 con 0x7fb91c135e50 2023-10-03T10:16:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80052e0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8005460 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbcc121fe0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80038c0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.908+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbcc1227d0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.914+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbcc04f2a0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.914+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbb8003a20 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.914+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbb803e9a0 con 0x7fcbcc09dfe0 2023-10-03T10:16:40.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:40.919+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbb8019b40 con 0x7fcbcc09dfe0 2023-10-03T10:16:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.095+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbca80747f0 con 0x7fbca809d630 2023-10-03T10:16:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.096+0000 7fbc9effd700 1 -- 172.21.15.19:0/38582163 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbca4017020 con 0x7fbca809d630 2023-10-03T10:16:41.096 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.096+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc408071e90 con 0x7fc40809d6f0 2023-10-03T10:16:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.097+0000 7fc3ef7fe700 1 -- 172.21.15.19:0/2514688630 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3f8012400 con 0x7fc40809d6f0 2023-10-03T10:16:41.097 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.098+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 msgr2=0x7fbca8133700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.098+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbca400c520 tx=0x7fbca400c830 comp rx=0 tx=0).stop 2023-10-03T10:16:41.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 shutdown_connections 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbca8138d80 0x7fbca8134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbca809d630 0x7fbca8133700 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fbcb07c0700 1 --2- 172.21.15.19:0/38582163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbca80a0a30 0x7fbca8133c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 >> 172.21.15.19:0/38582163 conn(0x7fbca80a3050 msgr2=0x7fbca809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 msgr2=0x7fc40811f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.099+0000 7fc40d528700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800c520 tx=0x7fc3f800c830 comp rx=0 tx=0).stop 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 shutdown_connections 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 shutdown_connections 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc408139170 0x7fc4081c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809d6f0 0x7fc40811f340 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 --2- 172.21.15.19:0/2514688630 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc40809e1d0 0x7fc40811f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fbcb07c0700 1 -- 172.21.15.19:0/38582163 wait complete. 2023-10-03T10:16:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 >> 172.21.15.19:0/2514688630 conn(0x7fc408066f50 msgr2=0x7fc408136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 shutdown_connections 2023-10-03T10:16:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.100+0000 7fc40d528700 1 -- 172.21.15.19:0/2514688630 wait complete. 2023-10-03T10:16:41.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:41.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:41.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.128+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcbcc09b5c0 con 0x7fcbcc09dfe0 2023-10-03T10:16:41.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.128+0000 7fcbc97fa700 1 -- 172.21.15.19:0/1075916991 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbb8017030 con 0x7fcbcc09dfe0 2023-10-03T10:16:41.128 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 msgr2=0x7fcbcc120960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 0x7fcbcc120960 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800c430 tx=0x7fcbb800c740 comp rx=0 tx=0).stop 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 shutdown_connections 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbcc130d10 0x7fcbcc120ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbcc09d6d0 0x7fcbcc120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 --2- 172.21.15.19:0/1075916991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbcc09dfe0 0x7fcbcc120960 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 >> 172.21.15.19:0/1075916991 conn(0x7fcbcc099c20 msgr2=0x7fcbcc0a1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 shutdown_connections 2023-10-03T10:16:41.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.131+0000 7fcbd2ffd700 1 -- 172.21.15.19:0/1075916991 wait complete. 2023-10-03T10:16:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.139+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb91c06c360 con 0x7fb91c135e50 2023-10-03T10:16:41.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.140+0000 7fb903fff700 1 -- 172.21.15.19:0/735993331 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb91403be60 con 0x7fb91c135e50 2023-10-03T10:16:41.139 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 msgr2=0x7fb91c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 0x7fb91c119480 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb914016000 tx=0x7fb914004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 shutdown_connections 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb91c135e50 0x7fb91c119480 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb91c09d6f0 0x7fb91c1c4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 --2- 172.21.15.19:0/735993331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb91c09e1d0 0x7fb91c1c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 >> 172.21.15.19:0/735993331 conn(0x7fb91c066f50 msgr2=0x7fb91c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:41.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 shutdown_connections 2023-10-03T10:16:41.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:41.142+0000 7fb922092700 1 -- 172.21.15.19:0/735993331 wait complete. 2023-10-03T10:16:41.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:41.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:42.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:42.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:42.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:42.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:42.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 Processor -- start 2023-10-03T10:16:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 -- start start 2023-10-03T10:16:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7f0be32c2700 1 Processor -- start 2023-10-03T10:16:42.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7f0be32c2700 1 -- start start 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9dc1338a0 0x7fe9dc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc06ef30 con 0x7fe9dc09e760 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc06fef0 con 0x7fe9dc1338a0 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.274+0000 7fe9e1d79700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1334b0 con 0x7fe9dc09de50 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47840/0 (socket says 172.21.15.19:47840) 2023-10-03T10:16:42.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 -- 172.21.15.19:0/3345134631 learned_addr learned my addr 172.21.15.19:0/3345134631 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be32c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 0x7f0bdc138a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be32c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be32c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc09a570 con 0x7f0bdc09d6d0 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be32c2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc09e5a0 con 0x7f0bdc09e1b0 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be32c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc09b1c0 con 0x7f0bdc138f50 2023-10-03T10:16:42.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9db7fe700 1 --2- 172.21.15.19:0/3345134631 >> v2:172.21.15.19:3300/0 conn(0x7fe9dc1338a0 0x7fe9dc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be185f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be185f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47846/0 (socket says 172.21.15.19:47846) 2023-10-03T10:16:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7f0be185f700 1 -- 172.21.15.19:0/626812859 learned_addr learned my addr 172.21.15.19:0/626812859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 -- 172.21.15.19:0/3345134631 >> v2:172.21.15.19:3300/0 conn(0x7fe9dc1338a0 msgr2=0x7fe9dc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 --2- 172.21.15.19:0/3345134631 >> v2:172.21.15.19:3300/0 conn(0x7fe9dc1338a0 0x7fe9dc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 -- 172.21.15.19:0/3345134631 >> v1:172.21.15.19:6789/0 conn(0x7fe9dc09e760 legacy=0x7fe9dc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 -- 172.21.15.19:0/3345134631 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc06fc30 con 0x7fe9dc09de50 2023-10-03T10:16:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.275+0000 7fe9daffd700 1 --2- 172.21.15.19:0/3345134631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00098f0 tx=0x7fe9d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb9f914f83b31f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be085d700 1 --2- 172.21.15.19:0/626812859 >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 0x7f0bdc138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be185f700 1 -- 172.21.15.19:0/626812859 >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 msgr2=0x7f0bdc138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be185f700 1 --2- 172.21.15.19:0/626812859 >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 0x7f0bdc138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be185f700 1 -- 172.21.15.19:0/626812859 >> v1:172.21.15.19:6789/0 conn(0x7f0bdc09d6d0 legacy=0x7f0bdc09daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be185f700 1 -- 172.21.15.19:0/626812859 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc09f240 con 0x7f0bdc138f50 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be085d700 1 --2- 172.21.15.19:0/626812859 >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 0x7f0bdc138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:42.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7fe9da7fc700 1 -- 172.21.15.19:0/3345134631 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0004230 con 0x7fe9dc09de50 2023-10-03T10:16:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7fe9da7fc700 1 -- 172.21.15.19:0/3345134631 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0004390 con 0x7fe9dc09de50 2023-10-03T10:16:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7fe9da7fc700 1 -- 172.21.15.19:0/3345134631 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00036a0 con 0x7fe9dc09de50 2023-10-03T10:16:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0be185f700 1 --2- 172.21.15.19:0/626812859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4376f159dde3dc2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0bd3fff700 1 -- 172.21.15.19:0/626812859 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400e070 con 0x7f0bdc138f50 2023-10-03T10:16:42.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0bd3fff700 1 -- 172.21.15.19:0/626812859 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400b9c0 con 0x7f0bdc138f50 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.276+0000 7f0bd3fff700 1 -- 172.21.15.19:0/626812859 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400bd70 con 0x7f0bdc138f50 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3345134631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 msgr2=0x7fe9dc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3345134631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00098f0 tx=0x7fe9d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3345134631 shutdown_connections 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3345134631 >> v2:172.21.15.19:3300/0 conn(0x7fe9dc1338a0 0x7fe9dc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3345134631 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc09e220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3345134631 >> 172.21.15.19:0/3345134631 conn(0x7fe9dc0a2aa0 msgr2=0x7fe9dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3345134631 shutdown_connections 2023-10-03T10:16:42.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3345134631 wait complete. 2023-10-03T10:16:42.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 -- 172.21.15.19:0/626812859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 msgr2=0x7f0bdc13b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 --2- 172.21.15.19:0/626812859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009e50 tx=0x7f0bd400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 -- 172.21.15.19:0/626812859 shutdown_connections 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 --2- 172.21.15.19:0/626812859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc138f50 0x7f0bdc13b330 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 --2- 172.21.15.19:0/626812859 >> v2:172.21.15.19:3300/0 conn(0x7f0bdc09e1b0 0x7f0bdc138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.277+0000 7f0be32c2700 1 -- 172.21.15.19:0/626812859 >> 172.21.15.19:0/626812859 conn(0x7f0bdc099c20 msgr2=0x7f0bdc0a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.278+0000 7f0be32c2700 1 -- 172.21.15.19:0/626812859 shutdown_connections 2023-10-03T10:16:42.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.278+0000 7f0be32c2700 1 -- 172.21.15.19:0/626812859 wait complete. 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.278+0000 7fe9e1d79700 1 Processor -- start 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.278+0000 7fe9e1d79700 1 -- start start 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9dc09e760 0x7fe9dc11f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 0x7fe9dc11f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc06f640 con 0x7fe9dc1338a0 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1207d0 con 0x7fe9dc09e760 2023-10-03T10:16:42.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9e1d79700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc1222f0 con 0x7fe9dc09de50 2023-10-03T10:16:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7f0be32c2700 1 Processor -- start 2023-10-03T10:16:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9db7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47856/0 (socket says 172.21.15.19:47856) 2023-10-03T10:16:42.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9db7fe700 1 -- 172.21.15.19:0/3479132453 learned_addr learned my addr 172.21.15.19:0/3479132453 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7fe9dbfff700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 0x7fe9dc11f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 -- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9dc09e760 msgr2=0x7fe9dc11f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9dc09e760 0x7fe9dc11f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 -- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 msgr2=0x7fe9dc11f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 0x7fe9dc11f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 -- 172.21.15.19:0/3479132453 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0009550 con 0x7fe9dc09de50 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9dbfff700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 0x7fe9dc11f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9db7fe700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e840 tx=0x7fe9cc00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.279+0000 7f0be32c2700 1 -- start start 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc09d6d0 0x7f0bdc1c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bdc09e1b0 0x7f0bdc1c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc11bec0 con 0x7f0bdc138f50 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc11b770 con 0x7f0bdc09e1b0 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be32c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc11c0b0 con 0x7f0bdc09d6d0 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be185f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be185f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48332/0 (socket says 172.21.15.19:48332) 2023-10-03T10:16:42.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be185f700 1 -- 172.21.15.19:0/1652433457 learned_addr learned my addr 172.21.15.19:0/1652433457 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc013610 con 0x7fe9dc09de50 2023-10-03T10:16:42.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc013770 con 0x7fe9dc09de50 2023-10-03T10:16:42.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc013b20 con 0x7fe9dc09de50 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be085d700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bdc09e1b0 0x7f0bdc1c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.280+0000 7f0be185f700 1 -- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc09d6d0 msgr2=0x7f0bdc1c8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be185f700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc09d6d0 0x7f0bdc1c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be185f700 1 -- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bdc09e1b0 msgr2=0x7f0bdc1c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be185f700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bdc09e1b0 0x7f0bdc1c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be185f700 1 -- 172.21.15.19:0/1652433457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009b30 con 0x7f0bdc138f50 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be185f700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc09b300 tx=0x7f0bd4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40048b0 con 0x7f0bdc138f50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd40092e0 con 0x7f0bdc138f50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc09c900 con 0x7f0bdc138f50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401c680 con 0x7f0bdc138f50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc0a1020 con 0x7fe9dc09de50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc122d60 con 0x7fe9dc09de50 2023-10-03T10:16:42.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.281+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc11daf0 con 0x7f0bdc138f50 2023-10-03T10:16:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9cc013c80 con 0x7fe9dc09de50 2023-10-03T10:16:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0bd401c7e0 con 0x7f0bdc138f50 2023-10-03T10:16:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc121f90 con 0x7fe9dc09de50 2023-10-03T10:16:42.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9cc03f350 con 0x7fe9dc09de50 2023-10-03T10:16:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc11d770 con 0x7f0bdc138f50 2023-10-03T10:16:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.283+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0bd40413b0 con 0x7f0bdc138f50 2023-10-03T10:16:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.288+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9cc012370 con 0x7fe9dc09de50 2023-10-03T10:16:42.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.292+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0bdc11d770 con 0x7f0bdc138f50 2023-10-03T10:16:42.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.318+0000 7f9d0942f700 1 Processor -- start 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.318+0000 7f9d0942f700 1 -- start start 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d0942f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 0x7f9d0409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d0942f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 0x7f9d0409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d0942f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0409a810 con 0x7f9d0413c1e0 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d0942f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0406ab40 con 0x7f9d0406a770 2023-10-03T10:16:42.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d0942f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0409ebc0 con 0x7f9d0409dc30 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d037fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d0413c1e0 0x7f9d0413e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36910/0 (socket says 172.21.15.19:36910) 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d037fe700 1 -- 172.21.15.19:0/1882833559 learned_addr learned my addr 172.21.15.19:0/1882833559 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d027fc700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 0x7f9d0409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.319+0000 7f9d02ffd700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 0x7f9d0409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d01ffb700 1 -- 172.21.15.19:0/1882833559 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188864472 0 0) 0x7f9d0409a810 con 0x7f9d0413c1e0 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d01ffb700 1 -- 172.21.15.19:0/1882833559 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cec0035b0 con 0x7f9d0413c1e0 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d02ffd700 1 -- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 msgr2=0x7f9d0409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d02ffd700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 0x7f9d0409e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d02ffd700 1 -- 172.21.15.19:0/1882833559 >> v1:172.21.15.19:6789/0 conn(0x7f9d0413c1e0 legacy=0x7f9d0413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d02ffd700 1 -- 172.21.15.19:0/1882833559 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0409e920 con 0x7f9d0406a770 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d027fc700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 0x7f9d0409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:42.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d02ffd700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 0x7f9d0409d6f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009870 tx=0x7f9cf4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d2babb2e78a83c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d01ffb700 1 -- 172.21.15.19:0/1882833559 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011830 con 0x7f9d0406a770 2023-10-03T10:16:42.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d01ffb700 1 -- 172.21.15.19:0/1882833559 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf4011990 con 0x7f9d0406a770 2023-10-03T10:16:42.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.320+0000 7f9d01ffb700 1 -- 172.21.15.19:0/1882833559 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4011d20 con 0x7f9d0406a770 2023-10-03T10:16:42.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 -- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 msgr2=0x7f9d0409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 0x7f9d0409d6f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009870 tx=0x7f9cf4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 -- 172.21.15.19:0/1882833559 shutdown_connections 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0406a770 0x7f9d0409d6f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1882833559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0409dc30 0x7f9d0409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 -- 172.21.15.19:0/1882833559 >> 172.21.15.19:0/1882833559 conn(0x7f9d04066f50 msgr2=0x7f9d0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 -- 172.21.15.19:0/1882833559 shutdown_connections 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.321+0000 7f9d0942f700 1 -- 172.21.15.19:0/1882833559 wait complete. 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.323+0000 7f9d0942f700 1 Processor -- start 2023-10-03T10:16:42.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.323+0000 7f9d0942f700 1 -- start start 2023-10-03T10:16:42.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0406a770 0x7f9d0413e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0413c1e0 0x7f9d0413a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0411db30 con 0x7f9d0406a770 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0413f530 con 0x7f9d0409dc30 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d0942f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d04134ae0 con 0x7f9d0413c1e0 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48812/0 (socket says 172.21.15.19:48812) 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 -- 172.21.15.19:0/1403887956 learned_addr learned my addr 172.21.15.19:0/1403887956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d037fe700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0413c1e0 0x7f9d0413a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 -- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0413c1e0 msgr2=0x7f9d0413a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0413c1e0 0x7f9d0413a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 -- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0406a770 msgr2=0x7f9d0413e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0406a770 0x7f9d0413e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.324+0000 7f9d027fc700 1 -- 172.21.15.19:0/1403887956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf80094a0 con 0x7f9d0409dc30 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9d027fc700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800ebe0 tx=0x7f9cf800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800c910 con 0x7f9d0409dc30 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf40094a0 con 0x7f9d0409dc30 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0413feb0 con 0x7f9d0409dc30 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800ca70 con 0x7f9d0409dc30 2023-10-03T10:16:42.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.325+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf800ce00 con 0x7f9d0409dc30 2023-10-03T10:16:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.326+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cf8013470 con 0x7f9d0409dc30 2023-10-03T10:16:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.326+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cf803f900 con 0x7f9d0409dc30 2023-10-03T10:16:42.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.326+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce40052e0 con 0x7f9d0409dc30 2023-10-03T10:16:42.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.331+0000 7f4dbfc21700 1 Processor -- start 2023-10-03T10:16:42.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 -- start start 2023-10-03T10:16:42.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cf8021020 con 0x7f9d0409dc30 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4db809e930 0x7f4db813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db806ef30 con 0x7f4db809de50 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db806fef0 con 0x7f4db809e930 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.332+0000 7f4dbfc21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81334b0 con 0x7f4db81338a0 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48814/0 (socket says 172.21.15.19:48814) 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 -- 172.21.15.19:0/1111012698 learned_addr learned my addr 172.21.15.19:0/1111012698 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbe1be700 1 --2- 172.21.15.19:0/1111012698 >> v2:172.21.15.19:3300/0 conn(0x7f4db809e930 0x7f4db813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 -- 172.21.15.19:0/1111012698 >> v2:172.21.15.19:3300/0 conn(0x7f4db809e930 msgr2=0x7f4db813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 --2- 172.21.15.19:0/1111012698 >> v2:172.21.15.19:3300/0 conn(0x7f4db809e930 0x7f4db813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 -- 172.21.15.19:0/1111012698 >> v1:172.21.15.19:6789/0 conn(0x7f4db809de50 legacy=0x7f4db809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 -- 172.21.15.19:0/1111012698 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db806fc30 con 0x7f4db81338a0 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbd9bd700 1 --2- 172.21.15.19:0/1111012698 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d64e57da0bc09e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbc9bb700 1 -- 172.21.15.19:0/1111012698 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400b8a0 con 0x7f4db81338a0 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbc9bb700 1 -- 172.21.15.19:0/1111012698 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400ba00 con 0x7f4db81338a0 2023-10-03T10:16:42.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.333+0000 7f4dbc9bb700 1 -- 172.21.15.19:0/1111012698 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400bd90 con 0x7f4db81338a0 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1111012698 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 msgr2=0x7f4db8133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1111012698 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4db40098f0 tx=0x7f4db4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1111012698 shutdown_connections 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1111012698 >> v2:172.21.15.19:3300/0 conn(0x7f4db809e930 0x7f4db813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1111012698 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db81338a0 0x7f4db8133c70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.334+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1111012698 >> 172.21.15.19:0/1111012698 conn(0x7f4db80a2aa0 msgr2=0x7f4db80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.335+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1111012698 shutdown_connections 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.335+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1111012698 wait complete. 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 Processor -- start 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 -- start start 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4db809de50 0x7f4db811ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4db81338a0 0x7f4db811f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81224d0 con 0x7f4db809de50 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81209b0 con 0x7f4db809e930 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbfc21700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80a10d0 con 0x7f4db81338a0 2023-10-03T10:16:42.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbd1bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbd1bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48828/0 (socket says 172.21.15.19:48828) 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.336+0000 7f4dbd1bc700 1 -- 172.21.15.19:0/1670240175 learned_addr learned my addr 172.21.15.19:0/1670240175 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbe1be700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4db81338a0 0x7f4db811f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd9bd700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4db809de50 0x7f4db811ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 -- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4db81338a0 msgr2=0x7f4db811f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4db81338a0 0x7f4db811f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 -- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4db809de50 msgr2=0x7f4db811ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4db809de50 0x7f4db811ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 -- 172.21.15.19:0/1670240175 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db4009550 con 0x7f4db809e930 2023-10-03T10:16:42.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbd1bc700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c420 tx=0x7f4da800c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:42.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80052d0 con 0x7f4db809e930 2023-10-03T10:16:42.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8005430 con 0x7f4db809e930 2023-10-03T10:16:42.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db806f640 con 0x7f4db809e930 2023-10-03T10:16:42.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.337+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da80038a0 con 0x7f4db809e930 2023-10-03T10:16:42.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.338+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db8122f40 con 0x7f4db809e930 2023-10-03T10:16:42.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.338+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4da8003a00 con 0x7f4db809e930 2023-10-03T10:16:42.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.339+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4da803e990 con 0x7f4db809e930 2023-10-03T10:16:42.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.340+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db80a0580 con 0x7f4db809e930 2023-10-03T10:16:42.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.349+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4da8003cb0 con 0x7f4db809e930 2023-10-03T10:16:42.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.495+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe9dc074ea0 con 0x7fe9dc09de50 2023-10-03T10:16:42.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.496+0000 7fe9c3fff700 1 -- 172.21.15.19:0/3479132453 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9cc010310 con 0x7fe9dc09de50 2023-10-03T10:16:42.496 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:42.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 msgr2=0x7fe9dc11eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00e840 tx=0x7fe9cc00eb50 comp rx=0 tx=0).stop 2023-10-03T10:16:42.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 shutdown_connections 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9dc1338a0 0x7fe9dc11f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9dc09de50 0x7fe9dc11eb00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 --2- 172.21.15.19:0/3479132453 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9dc09e760 0x7fe9dc11f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.499+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 >> 172.21.15.19:0/3479132453 conn(0x7fe9dc0a2aa0 msgr2=0x7fe9dc09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.500+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 shutdown_connections 2023-10-03T10:16:42.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.500+0000 7fe9e1d79700 1 -- 172.21.15.19:0/3479132453 wait complete. 2023-10-03T10:16:42.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.515+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0bdc11d770 con 0x7f0bdc138f50 2023-10-03T10:16:42.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.515+0000 7f0bd1ffb700 1 -- 172.21.15.19:0/1652433457 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0bdc11d770 con 0x7f0bdc138f50 2023-10-03T10:16:42.515 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:42.518 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 msgr2=0x7f0bdc11a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc09b300 tx=0x7f0bd4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 shutdown_connections 2023-10-03T10:16:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0bdc138f50 0x7f0bdc11a2b0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0bdc09d6d0 0x7f0bdc1c8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 --2- 172.21.15.19:0/1652433457 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0bdc09e1b0 0x7f0bdc1c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 >> 172.21.15.19:0/1652433457 conn(0x7f0bdc099c20 msgr2=0x7f0bdc0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 shutdown_connections 2023-10-03T10:16:42.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.519+0000 7f0be32c2700 1 -- 172.21.15.19:0/1652433457 wait complete. 2023-10-03T10:16:42.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.556+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9ce4005590 con 0x7f9d0409dc30 2023-10-03T10:16:42.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.556+0000 7f9ceb7fe700 1 -- 172.21.15.19:0/1403887956 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cf80232f0 con 0x7f9d0409dc30 2023-10-03T10:16:42.556 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:42.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 msgr2=0x7f9d0413a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800ebe0 tx=0x7f9cf800eef0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 shutdown_connections 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0413c1e0 0x7f9d0413a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0406a770 0x7f9d0413e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 --2- 172.21.15.19:0/1403887956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0409dc30 0x7f9d0413a380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.558+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 >> 172.21.15.19:0/1403887956 conn(0x7f9d04066f50 msgr2=0x7f9d04072060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.559+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 shutdown_connections 2023-10-03T10:16:42.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.559+0000 7f9d0942f700 1 -- 172.21.15.19:0/1403887956 wait complete. 2023-10-03T10:16:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.568+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4db8074ea0 con 0x7f4db809e930 2023-10-03T10:16:42.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.568+0000 7f4dae7fc700 1 -- 172.21.15.19:0/1670240175 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4da8017020 con 0x7f4db809e930 2023-10-03T10:16:42.568 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 msgr2=0x7f4db811f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c420 tx=0x7f4da800c730 comp rx=0 tx=0).stop 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 shutdown_connections 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4db81338a0 0x7f4db811f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4db809de50 0x7f4db811ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 --2- 172.21.15.19:0/1670240175 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4db809e930 0x7f4db811f1d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 >> 172.21.15.19:0/1670240175 conn(0x7f4db80a2aa0 msgr2=0x7f4db809ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 shutdown_connections 2023-10-03T10:16:42.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:42.571+0000 7f4dbfc21700 1 -- 172.21.15.19:0/1670240175 wait complete. 2023-10-03T10:16:42.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:42.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:43.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:43.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:43.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:43.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:43.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.681+0000 7f7a35fe5700 1 Processor -- start 2023-10-03T10:16:43.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.681+0000 7f7a35fe5700 1 -- start start 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3006b460 con 0x7f7a3009e000 2023-10-03T10:16:43.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3009b120 con 0x7f7a3009e410 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.682+0000 7f7a35fe5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3009a7e0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48352/0 (socket says 172.21.15.19:48352) 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48830/0 (socket says 172.21.15.19:48830) 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2effd700 1 -- 172.21.15.19:0/4234298890 learned_addr learned my addr 172.21.15.19:0/4234298890 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47910/0 (socket says 172.21.15.19:47910) 2023-10-03T10:16:43.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 msgr2=0x7f7a30133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/4234298890 >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 msgr2=0x7f7a301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/4234298890 >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/4234298890 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3009a500 con 0x7f7a3009d6f0 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2ffff700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2effd700 1 --2- 172.21.15.19:0/4234298890 >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:43.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.683+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a20009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14f2c992cb54d4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.684+0000 7f7a2e7fc700 1 -- 172.21.15.19:0/4234298890 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011830 con 0x7f7a3009d6f0 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.684+0000 7f7a2e7fc700 1 -- 172.21.15.19:0/4234298890 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20011990 con 0x7f7a3009d6f0 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.684+0000 7f7a2e7fc700 1 -- 172.21.15.19:0/4234298890 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20011d20 con 0x7f7a3009d6f0 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 -- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 msgr2=0x7f7a3009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a20009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 -- 172.21.15.19:0/4234298890 shutdown_connections 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009e410 0x7f7a30133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/4234298890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009d6f0 0x7f7a3009dac0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/4234298890 >> v2:172.21.15.19:3300/0 conn(0x7f7a3009e000 0x7f7a301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 -- 172.21.15.19:0/4234298890 >> 172.21.15.19:0/4234298890 conn(0x7f7a30066f50 msgr2=0x7f7a3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 -- 172.21.15.19:0/4234298890 shutdown_connections 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.685+0000 7f7a35fe5700 1 -- 172.21.15.19:0/4234298890 wait complete. 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.686+0000 7f7a35fe5700 1 Processor -- start 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 -- start start 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a3009e000 0x7f7a301a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009e410 0x7f7a301a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301aa280 con 0x7f7a3009e000 2023-10-03T10:16:43.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a79b0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.687+0000 7f7a35fe5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301a7fd0 con 0x7f7a3009e410 2023-10-03T10:16:43.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48834/0 (socket says 172.21.15.19:48834) 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/1534251930 learned_addr learned my addr 172.21.15.19:0/1534251930 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2ffff700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009e410 0x7f7a301a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2effd700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a3009e000 0x7f7a301a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009e410 msgr2=0x7f7a301a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009e410 0x7f7a301a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a3009e000 msgr2=0x7f7a301a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a3009e000 0x7f7a301a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 -- 172.21.15.19:0/1534251930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a24009550 con 0x7f7a3009d6f0 2023-10-03T10:16:43.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a2f7fe700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009840 tx=0x7f7a20004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20004450 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2001f070 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.688+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a28009a70 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.689+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a200038c0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.689+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a200094a0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.690+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a30074ea0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.690+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a20003a20 con 0x7f7a3009d6f0 2023-10-03T10:16:43.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.690+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a20021070 con 0x7f7a3009d6f0 2023-10-03T10:16:43.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.695+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a200045b0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.722+0000 7f80735da700 1 Processor -- start 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.722+0000 7f80735da700 1 -- start start 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.722+0000 7f80735da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.722+0000 7f80735da700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 0x7f806c138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f80735da700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806c0716a0 con 0x7f806c130e50 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f80735da700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806c09a390 con 0x7f806c06fcf0 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f80735da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f806c071290 con 0x7f806c130540 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47922/0 (socket says 172.21.15.19:47922) 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 -- 172.21.15.19:0/2911375608 learned_addr learned my addr 172.21.15.19:0/2911375608 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071b77700 1 --2- 172.21.15.19:0/2911375608 >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 0x7f806c138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 -- 172.21.15.19:0/2911375608 >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 msgr2=0x7f806c138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 --2- 172.21.15.19:0/2911375608 >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 0x7f806c138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 -- 172.21.15.19:0/2911375608 >> v1:172.21.15.19:6789/0 conn(0x7f806c130e50 legacy=0x7f806c06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 -- 172.21.15.19:0/2911375608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c130340 con 0x7f806c130540 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071b77700 1 --2- 172.21.15.19:0/2911375608 >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 0x7f806c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.723+0000 7f8071376700 1 --2- 172.21.15.19:0/2911375608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f806800dd40 tx=0x7f806800f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879341e68b4c56bd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f8063fff700 1 -- 172.21.15.19:0/2911375608 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068012070 con 0x7f806c130540 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f8063fff700 1 -- 172.21.15.19:0/2911375608 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800de90 con 0x7f806c130540 2023-10-03T10:16:43.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f8063fff700 1 -- 172.21.15.19:0/2911375608 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800fba0 con 0x7f806c130540 2023-10-03T10:16:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 -- 172.21.15.19:0/2911375608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 msgr2=0x7f806c130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 --2- 172.21.15.19:0/2911375608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f806800dd40 tx=0x7f806800f330 comp rx=0 tx=0).stop 2023-10-03T10:16:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 -- 172.21.15.19:0/2911375608 shutdown_connections 2023-10-03T10:16:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 --2- 172.21.15.19:0/2911375608 >> v2:172.21.15.19:3300/0 conn(0x7f806c06fcf0 0x7f806c138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 --2- 172.21.15.19:0/2911375608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130540 0x7f806c130910 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.724+0000 7f80735da700 1 -- 172.21.15.19:0/2911375608 >> 172.21.15.19:0/2911375608 conn(0x7f806c0a2aa0 msgr2=0x7f806c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.725+0000 7f80735da700 1 -- 172.21.15.19:0/2911375608 shutdown_connections 2023-10-03T10:16:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.725+0000 7f80735da700 1 -- 172.21.15.19:0/2911375608 wait complete. 2023-10-03T10:16:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.726+0000 7f80735da700 1 Processor -- start 2023-10-03T10:16:43.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.726+0000 7f80735da700 1 -- start start 2023-10-03T10:16:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f806c130540 0x7f806c09c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130e50 0x7f806c09c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806c09db60 con 0x7f806c06fcf0 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806c119340 con 0x7f806c130540 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f80735da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f806c119a80 con 0x7f806c130e50 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f8071376700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f8071376700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48376/0 (socket says 172.21.15.19:48376) 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f8071376700 1 -- 172.21.15.19:0/311455578 learned_addr learned my addr 172.21.15.19:0/311455578 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f8070b75700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f806c130540 0x7f806c09c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.727+0000 7f8071b77700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130e50 0x7f806c09c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 -- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130e50 msgr2=0x7f806c09c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130e50 0x7f806c09c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 -- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f806c130540 msgr2=0x7f806c09c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f806c130540 0x7f806c09c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 -- 172.21.15.19:0/311455578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806800d9f0 con 0x7f806c06fcf0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8071376700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8068000c00 tx=0x7f8068004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800fb90 con 0x7f806c06fcf0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680036a0 con 0x7f806c06fcf0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806c118e80 con 0x7f806c06fcf0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068003a30 con 0x7f806c06fcf0 2023-10-03T10:16:43.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.728+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f806c11a020 con 0x7f806c06fcf0 2023-10-03T10:16:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.729+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806c119c40 con 0x7f806c06fcf0 2023-10-03T10:16:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.730+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8068003b90 con 0x7f806c06fcf0 2023-10-03T10:16:43.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.730+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80680450d0 con 0x7f806c06fcf0 2023-10-03T10:16:43.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.735+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8068003e40 con 0x7f806c06fcf0 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.764+0000 7f21746df700 1 Processor -- start 2023-10-03T10:16:43.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.765+0000 7f21746df700 1 -- start start 2023-10-03T10:16:43.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f21746df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f21746df700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f216c136fe0 0x7f216c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f21746df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c070940 con 0x7f216c09e930 2023-10-03T10:16:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f21746df700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c06fd60 con 0x7f216c136fe0 2023-10-03T10:16:43.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f21746df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f216c06fa80 con 0x7f216c09f410 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47938/0 (socket says 172.21.15.19:47938) 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 -- 172.21.15.19:0/2007859692 learned_addr learned my addr 172.21.15.19:0/2007859692 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2172c7c700 1 --2- 172.21.15.19:0/2007859692 >> v2:172.21.15.19:3300/0 conn(0x7f216c136fe0 0x7f216c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 -- 172.21.15.19:0/2007859692 >> v2:172.21.15.19:3300/0 conn(0x7f216c136fe0 msgr2=0x7f216c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 --2- 172.21.15.19:0/2007859692 >> v2:172.21.15.19:3300/0 conn(0x7f216c136fe0 0x7f216c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 -- 172.21.15.19:0/2007859692 >> v1:172.21.15.19:6789/0 conn(0x7f216c09e930 legacy=0x7f216c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.766+0000 7f2171c7a700 1 -- 172.21.15.19:0/2007859692 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c09fb60 con 0x7f216c09f410 2023-10-03T10:16:43.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.767+0000 7f2171c7a700 1 --2- 172.21.15.19:0/2007859692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098f0 tx=0x7f215c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa145edb9696af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.767+0000 7f2171479700 1 -- 172.21.15.19:0/2007859692 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011830 con 0x7f216c09f410 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.767+0000 7f2171479700 1 -- 172.21.15.19:0/2007859692 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c011990 con 0x7f216c09f410 2023-10-03T10:16:43.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.767+0000 7f2171479700 1 -- 172.21.15.19:0/2007859692 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c011d20 con 0x7f216c09f410 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 -- 172.21.15.19:0/2007859692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 msgr2=0x7f216c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 --2- 172.21.15.19:0/2007859692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f215c0098f0 tx=0x7f215c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 -- 172.21.15.19:0/2007859692 shutdown_connections 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 --2- 172.21.15.19:0/2007859692 >> v2:172.21.15.19:3300/0 conn(0x7f216c136fe0 0x7f216c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 --2- 172.21.15.19:0/2007859692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c136aa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 -- 172.21.15.19:0/2007859692 >> 172.21.15.19:0/2007859692 conn(0x7f216c0a4210 msgr2=0x7f216c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 -- 172.21.15.19:0/2007859692 shutdown_connections 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.768+0000 7f21746df700 1 -- 172.21.15.19:0/2007859692 wait complete. 2023-10-03T10:16:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.769+0000 7f21746df700 1 Processor -- start 2023-10-03T10:16:43.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.769+0000 7f21746df700 1 -- start start 2023-10-03T10:16:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.769+0000 7f21746df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f216c09e930 0x7f216c11c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.769+0000 7f21746df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.769+0000 7f21746df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f216c136fe0 0x7f216c11d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f21746df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1202a0 con 0x7f216c136fe0 2023-10-03T10:16:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f21746df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c132500 con 0x7f216c09e930 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f21746df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0a2f00 con 0x7f216c09f410 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f217247b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f216c09e930 0x7f216c11c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47952/0 (socket says 172.21.15.19:47952) 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 -- 172.21.15.19:0/1049514581 learned_addr learned my addr 172.21.15.19:0/1049514581 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2172c7c700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f216c136fe0 0x7f216c11d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 -- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f216c09e930 msgr2=0x7f216c11c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f216c09e930 0x7f216c11c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 -- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f216c136fe0 msgr2=0x7f216c11d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f216c136fe0 0x7f216c11d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 -- 172.21.15.19:0/1049514581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c009550 con 0x7f216c09f410 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.770+0000 7f2171c7a700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c00 tx=0x7f215c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.771+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c0036a0 con 0x7f216c09f410 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.771+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c11e2c0 con 0x7f216c09f410 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.771+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215c003800 con 0x7f216c09f410 2023-10-03T10:16:43.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.771+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215c003bb0 con 0x7f216c09f410 2023-10-03T10:16:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.771+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c11f8a0 con 0x7f216c09f410 2023-10-03T10:16:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.772+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f215c021070 con 0x7f216c09f410 2023-10-03T10:16:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.772+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c074ea0 con 0x7f216c09f410 2023-10-03T10:16:43.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.772+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f215c0409f0 con 0x7f216c09f410 2023-10-03T10:16:43.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.782+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f215c024470 con 0x7f216c09f410 2023-10-03T10:16:43.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.783+0000 7f386156f700 1 Processor -- start 2023-10-03T10:16:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 -- start start 2023-10-03T10:16:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f385c13d1f0 0x7f385c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c09a810 con 0x7f385c09dc30 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385c06ab40 con 0x7f385c13d1f0 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f386156f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c09ebc0 con 0x7f385c06a770 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f385affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f385affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48856/0 (socket says 172.21.15.19:48856) 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f385affd700 1 -- 172.21.15.19:0/1454761157 learned_addr learned my addr 172.21.15.19:0/1454761157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.784+0000 7f385b7fe700 1 --2- 172.21.15.19:0/1454761157 >> v2:172.21.15.19:3300/0 conn(0x7f385c13d1f0 0x7f385c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f385affd700 1 -- 172.21.15.19:0/1454761157 >> v2:172.21.15.19:3300/0 conn(0x7f385c13d1f0 msgr2=0x7f385c13f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f385affd700 1 --2- 172.21.15.19:0/1454761157 >> v2:172.21.15.19:3300/0 conn(0x7f385c13d1f0 0x7f385c13f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f385affd700 1 -- 172.21.15.19:0/1454761157 >> v1:172.21.15.19:6789/0 conn(0x7f385c09dc30 legacy=0x7f385c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f385affd700 1 -- 172.21.15.19:0/1454761157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c09e920 con 0x7f385c06a770 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f385affd700 1 --2- 172.21.15.19:0/1454761157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f384c009920 tx=0x7f384c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a534e7bed3e42f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f3859ffb700 1 -- 172.21.15.19:0/1454761157 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c011830 con 0x7f385c06a770 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f3859ffb700 1 -- 172.21.15.19:0/1454761157 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384c011990 con 0x7f385c06a770 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.785+0000 7f3859ffb700 1 -- 172.21.15.19:0/1454761157 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c011d20 con 0x7f385c06a770 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 -- 172.21.15.19:0/1454761157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 msgr2=0x7f385c09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 --2- 172.21.15.19:0/1454761157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f384c009920 tx=0x7f384c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:43.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 -- 172.21.15.19:0/1454761157 shutdown_connections 2023-10-03T10:16:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 --2- 172.21.15.19:0/1454761157 >> v2:172.21.15.19:3300/0 conn(0x7f385c13d1f0 0x7f385c13f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 --2- 172.21.15.19:0/1454761157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c09d6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 -- 172.21.15.19:0/1454761157 >> 172.21.15.19:0/1454761157 conn(0x7f385c066f50 msgr2=0x7f385c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 -- 172.21.15.19:0/1454761157 shutdown_connections 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.786+0000 7f386156f700 1 -- 172.21.15.19:0/1454761157 wait complete. 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.788+0000 7f386156f700 1 Processor -- start 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.788+0000 7f386156f700 1 -- start start 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f385c13d1f0 0x7f385c13be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c11eb10 con 0x7f385c09dc30 2023-10-03T10:16:43.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c0724d0 con 0x7f385c06a770 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f386156f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f385c13f670 con 0x7f385c13d1f0 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48410/0 (socket says 172.21.15.19:48410) 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 -- 172.21.15.19:0/4238655358 learned_addr learned my addr 172.21.15.19:0/4238655358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385affd700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 -- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f385c13d1f0 msgr2=0x7f385c13be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f385c13d1f0 0x7f385c13be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 -- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 msgr2=0x7f385c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.789+0000 7f385a7fc700 1 -- 172.21.15.19:0/4238655358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009550 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f385a7fc700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f385000c430 tx=0x7f385000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500052d0 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850005430 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f386156f700 1 -- 172.21.15.19:0/4238655358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c09f1a0 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38500038c0 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.790+0000 7f386156f700 1 -- 172.21.15.19:0/4238655358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c11f2a0 con 0x7f385c09dc30 2023-10-03T10:16:43.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.792+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3850003a20 con 0x7f385c09dc30 2023-10-03T10:16:43.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.792+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c11f0d0 con 0x7f385c09dc30 2023-10-03T10:16:43.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.793+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f385003eb30 con 0x7f385c09dc30 2023-10-03T10:16:43.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.802+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3850018260 con 0x7f385c09dc30 2023-10-03T10:16:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.942+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a3009c6d0 con 0x7f7a3009d6f0 2023-10-03T10:16:43.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.943+0000 7f7a17fff700 1 -- 172.21.15.19:0/1534251930 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a20015020 con 0x7f7a3009d6f0 2023-10-03T10:16:43.943 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 msgr2=0x7f7a301a5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009840 tx=0x7f7a20004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 shutdown_connections 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a3009e410 0x7f7a301a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a3009d6f0 0x7f7a301a5e30 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 --2- 172.21.15.19:0/1534251930 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a3009e000 0x7f7a301a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 >> 172.21.15.19:0/1534251930 conn(0x7f7a30066f50 msgr2=0x7f7a301badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 shutdown_connections 2023-10-03T10:16:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.945+0000 7f7a35fe5700 1 -- 172.21.15.19:0/1534251930 wait complete. 2023-10-03T10:16:43.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.949+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f806c074ea0 con 0x7f806c06fcf0 2023-10-03T10:16:43.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.950+0000 7f8061ffb700 1 -- 172.21.15.19:0/311455578 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8068028bb0 con 0x7f806c06fcf0 2023-10-03T10:16:43.950 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:43.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 msgr2=0x7f806c09bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8068000c00 tx=0x7f8068004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 shutdown_connections 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f806c130e50 0x7f806c09c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f806c06fcf0 0x7f806c09bdd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 --2- 172.21.15.19:0/311455578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f806c130540 0x7f806c09c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 >> 172.21.15.19:0/311455578 conn(0x7f806c0a2aa0 msgr2=0x7f806c12b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 shutdown_connections 2023-10-03T10:16:43.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.952+0000 7f80735da700 1 -- 172.21.15.19:0/311455578 wait complete. 2023-10-03T10:16:43.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:43.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:43.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.992+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f216c06b250 con 0x7f216c09f410 2023-10-03T10:16:43.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.992+0000 7f2162ffd700 1 -- 172.21.15.19:0/1049514581 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f215c015020 con 0x7f216c09f410 2023-10-03T10:16:43.992 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 msgr2=0x7f216c11cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c00 tx=0x7f215c004750 comp rx=0 tx=0).stop 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 shutdown_connections 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f216c136fe0 0x7f216c11d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f216c09e930 0x7f216c11c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 --2- 172.21.15.19:0/1049514581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f216c09f410 0x7f216c11cb90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.994+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 >> 172.21.15.19:0/1049514581 conn(0x7f216c0a4210 msgr2=0x7f216c134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.995+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 shutdown_connections 2023-10-03T10:16:43.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:43.995+0000 7f21746df700 1 -- 172.21.15.19:0/1049514581 wait complete. 2023-10-03T10:16:44.008 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:44.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.009+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f385c074ea0 con 0x7f385c09dc30 2023-10-03T10:16:44.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.009+0000 7f38437fe700 1 -- 172.21.15.19:0/4238655358 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3850017020 con 0x7f385c09dc30 2023-10-03T10:16:44.009 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 msgr2=0x7f385c13b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f385000c430 tx=0x7f385000c740 comp rx=0 tx=0).stop 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 shutdown_connections 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f385c13d1f0 0x7f385c13be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f385c06a770 0x7f385c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 --2- 172.21.15.19:0/4238655358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f385c09dc30 0x7f385c13b910 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 >> 172.21.15.19:0/4238655358 conn(0x7f385c066f50 msgr2=0x7f385c09b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 shutdown_connections 2023-10-03T10:16:44.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:44.012+0000 7f38397fa700 1 -- 172.21.15.19:0/4238655358 wait complete. 2023-10-03T10:16:44.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:44.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:44.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:45.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:45.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.117+0000 7f73c603a700 1 Processor -- start 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.117+0000 7f73c603a700 1 -- start start 2023-10-03T10:16:45.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73c603a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73c603a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73c603a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c009f130 con 0x7f73c009d6f0 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73c603a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c009f520 con 0x7f73c009e1d0 2023-10-03T10:16:45.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73c603a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73c009e930 con 0x7f73c0135e50 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73bf7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f73c009d6f0 0x7f73c009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36950/0 (socket says 172.21.15.19:36950) 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73bf7fe700 1 -- 172.21.15.19:0/2200891868 learned_addr learned my addr 172.21.15.19:0/2200891868 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73beffd700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73bffff700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73be7fc700 1 -- 172.21.15.19:0/2200891868 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774423416 0 0) 0x7f73c009f130 con 0x7f73c009d6f0 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73be7fc700 1 -- 172.21.15.19:0/2200891868 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a80035b0 con 0x7f73c009d6f0 2023-10-03T10:16:45.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73beffd700 1 -- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 msgr2=0x7f73c0138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73beffd700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73beffd700 1 -- 172.21.15.19:0/2200891868 >> v1:172.21.15.19:6789/0 conn(0x7f73c009d6f0 legacy=0x7f73c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.118+0000 7f73beffd700 1 -- 172.21.15.19:0/2200891868 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c009b2d0 con 0x7f73c009e1d0 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.119+0000 7f73bffff700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.119+0000 7f73beffd700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c0135910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b920 tx=0x7f73b400bc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6cbc6759d784728 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.119+0000 7f73be7fc700 1 -- 172.21.15.19:0/2200891868 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400ca30 con 0x7f73c009e1d0 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.119+0000 7f73be7fc700 1 -- 172.21.15.19:0/2200891868 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b400cb90 con 0x7f73c009e1d0 2023-10-03T10:16:45.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.119+0000 7f73be7fc700 1 -- 172.21.15.19:0/2200891868 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b400f460 con 0x7f73c009e1d0 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 -- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 msgr2=0x7f73c0135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c0135910 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f73b400b920 tx=0x7f73b400bc30 comp rx=0 tx=0).stop 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 -- 172.21.15.19:0/2200891868 shutdown_connections 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 --2- 172.21.15.19:0/2200891868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c0135910 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 -- 172.21.15.19:0/2200891868 >> 172.21.15.19:0/2200891868 conn(0x7f73c0066f50 msgr2=0x7f73c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 -- 172.21.15.19:0/2200891868 shutdown_connections 2023-10-03T10:16:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.120+0000 7f73c603a700 1 -- 172.21.15.19:0/2200891868 wait complete. 2023-10-03T10:16:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.121+0000 7f73c603a700 1 Processor -- start 2023-10-03T10:16:45.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.121+0000 7f73c603a700 1 -- start start 2023-10-03T10:16:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c01199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c01301b0 con 0x7f73c009d6f0 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c011ce10 con 0x7f73c009e1d0 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73c603a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73c012fd30 con 0x7f73c0135e50 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48418/0 (socket says 172.21.15.19:48418) 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bf7fe700 1 -- 172.21.15.19:0/3275681148 learned_addr learned my addr 172.21.15.19:0/3275681148 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73beffd700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c01199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bffff700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bf7fe700 1 -- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 msgr2=0x7f73c0119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.122+0000 7f73bf7fe700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73bf7fe700 1 -- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 msgr2=0x7f73c01199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73bf7fe700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c01199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73bf7fe700 1 -- 172.21.15.19:0/3275681148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b800f050 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73bf7fe700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c4d0 tx=0x7f73b000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0005d70 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00070d0 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b400b550 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0007460 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.123+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c011c8c0 con 0x7f73c009d6f0 2023-10-03T10:16:45.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.124+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73b00075c0 con 0x7f73c009d6f0 2023-10-03T10:16:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.124+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c0074ea0 con 0x7f73c009d6f0 2023-10-03T10:16:45.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.125+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73b003eb50 con 0x7f73c009d6f0 2023-10-03T10:16:45.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.130+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73b000f260 con 0x7f73c009d6f0 2023-10-03T10:16:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.158+0000 7fe7d024d700 1 Processor -- start 2023-10-03T10:16:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.158+0000 7fe7d024d700 1 -- start start 2023-10-03T10:16:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7d024d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7d024d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7d024d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c809f130 con 0x7fe7c809e410 2023-10-03T10:16:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7d024d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c809f520 con 0x7fe7c809e000 2023-10-03T10:16:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7d024d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c809e930 con 0x7fe7c809d6f0 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7cd7e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7cdfe9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7cd7e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48882/0 (socket says 172.21.15.19:48882) 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7cdfe9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47996/0 (socket says 172.21.15.19:47996) 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.159+0000 7fe7cd7e8700 1 -- 172.21.15.19:0/1654170627 learned_addr learned my addr 172.21.15.19:0/1654170627 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 msgr2=0x7fe7c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7cdfe9700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/1654170627 >> v1:172.21.15.19:6789/0 conn(0x7fe7c809e410 legacy=0x7fe7c8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7feadb7b4700 1 Processor -- start 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7ccfe7700 1 -- 172.21.15.19:0/1654170627 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425857864 0 0) 0x7fe7c809f130 con 0x7fe7c809e410 2023-10-03T10:16:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/1654170627 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c809b2d0 con 0x7fe7c809d6f0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7fe7cdfe9700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098a0 tx=0x7fe7c4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6321ab7b627d307b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fe7cd7e8700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fe7ccfe7700 1 -- 172.21.15.19:0/1654170627 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4011830 con 0x7fe7c809d6f0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fe7ccfe7700 1 -- 172.21.15.19:0/1654170627 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4011990 con 0x7fe7c809d6f0 2023-10-03T10:16:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fe7ccfe7700 1 -- 172.21.15.19:0/1654170627 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4011d20 con 0x7fe7c809d6f0 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.160+0000 7feadb7b4700 1 -- start start 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7feadb7b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fead409b3a0 0x7fead409cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7feadb7b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead413fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7feadb7b4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead4099c70 con 0x7fead409d3e0 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7feadb7b4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead409b770 con 0x7fead409b3a0 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7feadb7b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead4098ea0 con 0x7fead409d7d0 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fead9550700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fead409b3a0 0x7fead409cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fead9550700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fead409b3a0 0x7fead409cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48426/0 (socket says 172.21.15.19:48426) 2023-10-03T10:16:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fead9550700 1 -- 172.21.15.19:0/956689580 learned_addr learned my addr 172.21.15.19:0/956689580 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.161+0000 7fead9d51700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead413fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9550700 1 -- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 msgr2=0x7fead413fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9550700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead413fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9550700 1 -- 172.21.15.19:0/956689580 >> v1:172.21.15.19:6789/0 conn(0x7fead409d3e0 legacy=0x7fead413c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9550700 1 -- 172.21.15.19:0/956689580 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4099780 con 0x7fead409b3a0 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9d51700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead413fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fead9550700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409b3a0 0x7fead409cea0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5534866301f4df9d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 -- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 msgr2=0x7fe7c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40098a0 tx=0x7fe7c4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 -- 172.21.15.19:0/1654170627 shutdown_connections 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c809dac0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 --2- 172.21.15.19:0/1654170627 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e000 0x7fe7c8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 -- 172.21.15.19:0/1654170627 >> 172.21.15.19:0/1654170627 conn(0x7fe7c8066f50 msgr2=0x7fe7c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7feacbfff700 1 -- 172.21.15.19:0/956689580 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead0005e30 con 0x7fead409b3a0 2023-10-03T10:16:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7feacbfff700 1 -- 172.21.15.19:0/956689580 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fead0006030 con 0x7fead409b3a0 2023-10-03T10:16:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7feacbfff700 1 -- 172.21.15.19:0/956689580 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fead00063c0 con 0x7fead409b3a0 2023-10-03T10:16:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 -- 172.21.15.19:0/1654170627 shutdown_connections 2023-10-03T10:16:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.162+0000 7fe7d024d700 1 -- 172.21.15.19:0/1654170627 wait complete. 2023-10-03T10:16:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 -- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409b3a0 msgr2=0x7fead409cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409b3a0 0x7fead409cea0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fead0006fd0 tx=0x7fead0009bd0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 -- 172.21.15.19:0/956689580 shutdown_connections 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead413fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 --2- 172.21.15.19:0/956689580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409b3a0 0x7fead409cea0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7feadb7b4700 1 -- 172.21.15.19:0/956689580 >> 172.21.15.19:0/956689580 conn(0x7fead40a2260 msgr2=0x7fead40a2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7fe7d024d700 1 Processor -- start 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.163+0000 7fe7d024d700 1 -- start start 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e410 0x7fe7c8119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c811c2c0 con 0x7fe7c809e000 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c811a5f0 con 0x7fe7c809e410 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7feadb7b4700 1 -- 172.21.15.19:0/956689580 shutdown_connections 2023-10-03T10:16:45.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7feadb7b4700 1 -- 172.21.15.19:0/956689580 wait complete. 2023-10-03T10:16:45.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7d024d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c811b840 con 0x7fe7c809d6f0 2023-10-03T10:16:45.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7cd7e8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7cdfe9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7cd7e8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48436/0 (socket says 172.21.15.19:48436) 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7cdfe9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48002/0 (socket says 172.21.15.19:48002) 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7cd7e8700 1 -- 172.21.15.19:0/2771666690 learned_addr learned my addr 172.21.15.19:0/2771666690 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.164+0000 7fe7ce7ea700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e410 0x7fe7c8119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e410 msgr2=0x7fe7c8119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e410 0x7fe7c8119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 msgr2=0x7fe7c81199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 -- 172.21.15.19:0/2771666690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b8009550 con 0x7fe7c809d6f0 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cd7e8700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7cdfe9700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4016000 tx=0x7fe7c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c40036a0 con 0x7fe7c809d6f0 2023-10-03T10:16:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c40094a0 con 0x7fe7c809d6f0 2023-10-03T10:16:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c809c700 con 0x7fe7c809d6f0 2023-10-03T10:16:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.165+0000 7feadb7b4700 1 Processor -- start 2023-10-03T10:16:45.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 -- start start 2023-10-03T10:16:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c401e070 con 0x7fe7c809d6f0 2023-10-03T10:16:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4003a00 con 0x7fe7c809d6f0 2023-10-03T10:16:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7c4003b60 con 0x7fe7c809d6f0 2023-10-03T10:16:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b00052e0 con 0x7fe7c809d6f0 2023-10-03T10:16:45.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe7c40404a0 con 0x7fe7c809d6f0 2023-10-03T10:16:45.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fead409b3a0 0x7fead408a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead40906a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40925b0 con 0x7fead409d3e0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead4091e60 con 0x7fead409d7d0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.166+0000 7feadb7b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fead406df00 con 0x7fead409b3a0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48448/0 (socket says 172.21.15.19:48448) 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 -- 172.21.15.19:0/1627913959 learned_addr learned my addr 172.21.15.19:0/1627913959 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 -- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fead409b3a0 msgr2=0x7fead408a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fead409b3a0 0x7fead408a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 -- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 msgr2=0x7fead40906a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead40906a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 -- 172.21.15.19:0/1627913959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0009500 con 0x7fead409d3e0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.167+0000 7fead8d4f700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7feac400c450 tx=0x7feac400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.168+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac40054e0 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.168+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4003680 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.168+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4003a30 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.168+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead4098c70 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.168+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4099ed0 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.169+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4093530 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.170+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feac4003b90 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.171+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feac403f0d0 con 0x7fead409d3e0 2023-10-03T10:16:45.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.174+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7c4003e10 con 0x7fe7c809d6f0 2023-10-03T10:16:45.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.175+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feac4003e40 con 0x7fead409d3e0 2023-10-03T10:16:45.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.207+0000 7f22cb433700 1 Processor -- start 2023-10-03T10:16:45.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.207+0000 7f22cb433700 1 -- start start 2023-10-03T10:16:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22cb433700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 0x7f22c4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22cb433700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c4136fe0 0x7f22c41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22cb433700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c4070940 con 0x7f22c409e930 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22cb433700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c406fd60 con 0x7f22c4136fe0 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22cb433700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c406fa80 con 0x7f22c409f410 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22c91cf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22c409e930 0x7f22c409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36978/0 (socket says 172.21.15.19:36978) 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22c91cf700 1 -- 172.21.15.19:0/3806684090 learned_addr learned my addr 172.21.15.19:0/3806684090 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.208+0000 7f22c89ce700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 0x7f22c4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c99d0700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c4136fe0 0x7f22c41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22bbfff700 1 -- 172.21.15.19:0/3806684090 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528066540 0 0) 0x7f22c4070940 con 0x7f22c409e930 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22bbfff700 1 -- 172.21.15.19:0/3806684090 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b00035b0 con 0x7f22c409e930 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c89ce700 1 -- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c4136fe0 msgr2=0x7f22c41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c89ce700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c4136fe0 0x7f22c41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c89ce700 1 -- 172.21.15.19:0/3806684090 >> v1:172.21.15.19:6789/0 conn(0x7f22c409e930 legacy=0x7f22c409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c89ce700 1 -- 172.21.15.19:0/3806684090 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c409fb60 con 0x7f22c409f410 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.209+0000 7f22c89ce700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 0x7f22c4136aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b51a5088d0e61d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22bbfff700 1 -- 172.21.15.19:0/3806684090 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011830 con 0x7f22c409f410 2023-10-03T10:16:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22bbfff700 1 -- 172.21.15.19:0/3806684090 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b4011990 con 0x7f22c409f410 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22bbfff700 1 -- 172.21.15.19:0/3806684090 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4011d20 con 0x7f22c409f410 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 -- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 msgr2=0x7f22c4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 0x7f22c4136aa0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f22b4009870 tx=0x7f22b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 -- 172.21.15.19:0/3806684090 shutdown_connections 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c4136fe0 0x7f22c41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 --2- 172.21.15.19:0/3806684090 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409f410 0x7f22c4136aa0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 -- 172.21.15.19:0/3806684090 >> 172.21.15.19:0/3806684090 conn(0x7f22c40a4210 msgr2=0x7f22c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 -- 172.21.15.19:0/3806684090 shutdown_connections 2023-10-03T10:16:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.210+0000 7f22cb433700 1 -- 172.21.15.19:0/3806684090 wait complete. 2023-10-03T10:16:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.211+0000 7f22cb433700 1 Processor -- start 2023-10-03T10:16:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.211+0000 7f22cb433700 1 -- start start 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 0x7f22c411c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c409f410 0x7f22c411cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4131ed0 con 0x7f22c4136fe0 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c41200c0 con 0x7f22c409f410 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22cb433700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22c4071d20 con 0x7f22c409e930 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22c99d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22c99d0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48464/0 (socket says 172.21.15.19:48464) 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22c99d0700 1 -- 172.21.15.19:0/589085451 learned_addr learned my addr 172.21.15.19:0/589085451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22c91cf700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 0x7f22c411c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.212+0000 7f22c89ce700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c409f410 0x7f22c411cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 -- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c409f410 msgr2=0x7f22c411cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c409f410 0x7f22c411cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 -- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 msgr2=0x7f22c411d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 -- 172.21.15.19:0/589085451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40094a0 con 0x7f22c409e930 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c99d0700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22c91cf700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 0x7f22c411c620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001b70 tx=0x7f22c0012ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0005c30 con 0x7f22c409e930 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c0005d90 con 0x7f22c409e930 2023-10-03T10:16:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4132490 con 0x7f22c409e930 2023-10-03T10:16:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0012360 con 0x7f22c409e930 2023-10-03T10:16:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.213+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c4120850 con 0x7f22c409e930 2023-10-03T10:16:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.214+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22c00124c0 con 0x7f22c409e930 2023-10-03T10:16:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.214+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c411fd40 con 0x7f22c409e930 2023-10-03T10:16:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.215+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22c003ea50 con 0x7f22c409e930 2023-10-03T10:16:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.220+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22c0014620 con 0x7f22c409e930 2023-10-03T10:16:45.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.345+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f73c011c520 con 0x7f73c009d6f0 2023-10-03T10:16:45.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.345+0000 7f73a7fff700 1 -- 172.21.15.19:0/3275681148 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73b0017070 con 0x7f73c009d6f0 2023-10-03T10:16:45.345 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:45.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 msgr2=0x7f73c0119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c4d0 tx=0x7f73b000c7e0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 shutdown_connections 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73c0135e50 0x7f73c0119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73c009d6f0 0x7f73c0119480 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 --2- 172.21.15.19:0/3275681148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73c009e1d0 0x7f73c01199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.347+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 >> 172.21.15.19:0/3275681148 conn(0x7f73c0066f50 msgr2=0x7f73c0132940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.348+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 shutdown_connections 2023-10-03T10:16:45.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.348+0000 7f73c603a700 1 -- 172.21.15.19:0/3275681148 wait complete. 2023-10-03T10:16:45.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.383+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7b0005590 con 0x7fe7c809d6f0 2023-10-03T10:16:45.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.384+0000 7fe7be7fc700 1 -- 172.21.15.19:0/2771666690 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe7c4015070 con 0x7fe7c809d6f0 2023-10-03T10:16:45.384 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 msgr2=0x7fe7c8119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4016000 tx=0x7fe7c4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 shutdown_connections 2023-10-03T10:16:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7c809e410 0x7fe7c8119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7c809d6f0 0x7fe7c8119480 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 --2- 172.21.15.19:0/2771666690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7c809e000 0x7fe7c81199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 >> 172.21.15.19:0/2771666690 conn(0x7fe7c8066f50 msgr2=0x7fe7c8070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 shutdown_connections 2023-10-03T10:16:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.386+0000 7fe7d024d700 1 -- 172.21.15.19:0/2771666690 wait complete. 2023-10-03T10:16:45.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.388+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fead4074ea0 con 0x7fead409d3e0 2023-10-03T10:16:45.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.388+0000 7feac9ffb700 1 -- 172.21.15.19:0/1627913959 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feac4017030 con 0x7fead409d3e0 2023-10-03T10:16:45.388 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 msgr2=0x7fead4090160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7feac400c450 tx=0x7feac400c810 comp rx=0 tx=0).stop 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 shutdown_connections 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fead409d7d0 0x7fead40906a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fead409b3a0 0x7fead408a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 --2- 172.21.15.19:0/1627913959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fead409d3e0 0x7fead4090160 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 >> 172.21.15.19:0/1627913959 conn(0x7fead40a2260 msgr2=0x7fead4071300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 shutdown_connections 2023-10-03T10:16:45.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.391+0000 7feadb7b4700 1 -- 172.21.15.19:0/1627913959 wait complete. 2023-10-03T10:16:45.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:45.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:45.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.427+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22c4074ea0 con 0x7f22c409e930 2023-10-03T10:16:45.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.427+0000 7f22b9ffb700 1 -- 172.21.15.19:0/589085451 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22c001a300 con 0x7f22c409e930 2023-10-03T10:16:45.427 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 msgr2=0x7f22c411c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 0x7f22c411c620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f22c0001b70 tx=0x7f22c0012ef0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 shutdown_connections 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22c4136fe0 0x7f22c411d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22c409e930 0x7f22c411c620 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 --2- 172.21.15.19:0/589085451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22c409f410 0x7f22c411cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 >> 172.21.15.19:0/589085451 conn(0x7f22c40a4210 msgr2=0x7f22c4134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 shutdown_connections 2023-10-03T10:16:45.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:45.430+0000 7f22cb433700 1 -- 172.21.15.19:0/589085451 wait complete. 2023-10-03T10:16:45.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:46.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:46.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:46.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:46.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:46.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.520+0000 7f93557ba700 1 Processor -- start 2023-10-03T10:16:46.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.520+0000 7f93557ba700 1 -- start start 2023-10-03T10:16:46.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f93557ba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9350133420 0x7f93501337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f93557ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f93557ba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935006b990 con 0x7f9350134260 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f93557ba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93500a0590 con 0x7f9350133420 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f93557ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f935009fb80 con 0x7f9350133e30 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41418/0 (socket says 172.21.15.19:41418) 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 -- 172.21.15.19:0/3537845067 learned_addr learned my addr 172.21.15.19:0/3537845067 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934effd700 1 --2- 172.21.15.19:0/3537845067 >> v2:172.21.15.19:3300/0 conn(0x7f9350133420 0x7f93501337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 -- 172.21.15.19:0/3537845067 >> v2:172.21.15.19:3300/0 conn(0x7f9350133420 msgr2=0x7f93501337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 --2- 172.21.15.19:0/3537845067 >> v2:172.21.15.19:3300/0 conn(0x7f9350133420 0x7f93501337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 -- 172.21.15.19:0/3537845067 >> v1:172.21.15.19:6789/0 conn(0x7f9350134260 legacy=0x7f93501304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.521+0000 7f934e7fc700 1 -- 172.21.15.19:0/3537845067 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93500a0030 con 0x7f9350133e30 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f934e7fc700 1 --2- 172.21.15.19:0/3537845067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93380098f0 tx=0x7f9338009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f82e537a721fa19e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f934dffb700 1 -- 172.21.15.19:0/3537845067 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338004230 con 0x7f9350133e30 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f934dffb700 1 -- 172.21.15.19:0/3537845067 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338004390 con 0x7f9350133e30 2023-10-03T10:16:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f934dffb700 1 -- 172.21.15.19:0/3537845067 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93380036a0 con 0x7f9350133e30 2023-10-03T10:16:46.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f93557ba700 1 -- 172.21.15.19:0/3537845067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 msgr2=0x7f935012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.522+0000 7f93557ba700 1 --2- 172.21.15.19:0/3537845067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f93380098f0 tx=0x7f9338009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:46.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 -- 172.21.15.19:0/3537845067 shutdown_connections 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 --2- 172.21.15.19:0/3537845067 >> v2:172.21.15.19:3300/0 conn(0x7f9350133420 0x7f93501337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 --2- 172.21.15.19:0/3537845067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133e30 0x7f935012ff90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 -- 172.21.15.19:0/3537845067 >> 172.21.15.19:0/3537845067 conn(0x7f93500a4210 msgr2=0x7f93500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 -- 172.21.15.19:0/3537845067 shutdown_connections 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.523+0000 7f93557ba700 1 -- 172.21.15.19:0/3537845067 wait complete. 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 Processor -- start 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 -- start start 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9350133e30 0x7f935009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 0x7f935009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935012d790 con 0x7f9350134260 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93501203b0 con 0x7f9350133e30 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.524+0000 7f93557ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93501317b0 con 0x7f9350133420 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 0x7f935009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41432/0 (socket says 172.21.15.19:41432) 2023-10-03T10:16:46.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934effd700 1 -- 172.21.15.19:0/1602779065 learned_addr learned my addr 172.21.15.19:0/1602779065 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 -- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 msgr2=0x7f935009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 -- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9350133e30 msgr2=0x7f935009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9350133e30 0x7f935009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 -- 172.21.15.19:0/1602779065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338009550 con 0x7f9350134260 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934effd700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f934f7fe700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 0x7f935009cf00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f934800cae0 tx=0x7f934800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.525+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800aaa0 con 0x7f9350134260 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.526+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935011fd30 con 0x7f9350134260 2023-10-03T10:16:46.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.526+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935011f990 con 0x7f9350134260 2023-10-03T10:16:46.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.526+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800ac00 con 0x7f9350134260 2023-10-03T10:16:46.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.526+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348012420 con 0x7f9350134260 2023-10-03T10:16:46.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.527+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9348012580 con 0x7f9350134260 2023-10-03T10:16:46.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.527+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f934803fd40 con 0x7f9350134260 2023-10-03T10:16:46.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.527+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93340052e0 con 0x7f9350134260 2023-10-03T10:16:46.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.536+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93480226c0 con 0x7f9350134260 2023-10-03T10:16:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.557+0000 7f265762d700 1 Processor -- start 2023-10-03T10:16:46.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 -- start start 2023-10-03T10:16:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 Processor -- start 2023-10-03T10:16:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 -- start start 2023-10-03T10:16:46.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2650135c20 0x7f2650138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f265006fa40 con 0x7f265012cf60 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f265012cd90 con 0x7f2650135c20 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7f265762d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2650071780 con 0x7f265006f5d0 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60210/0 (socket says 172.21.15.19:60210) 2023-10-03T10:16:46.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 -- 172.21.15.19:0/3775027256 learned_addr learned my addr 172.21.15.19:0/3775027256 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409d6f0 0x7fe54409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 0x7fe5441339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe54409b120 con 0x7fe54409e410 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54406b460 con 0x7fe54409d6f0 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.558+0000 7fe549833700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe54409a7e0 con 0x7fe54409e000 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe542ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409d6f0 0x7fe54409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 0x7fe5441339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5437fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe54409e410 0x7fe544133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45152/0 (socket says 172.21.15.19:45152) 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5437fe700 1 -- 172.21.15.19:0/4160653847 learned_addr learned my addr 172.21.15.19:0/4160653847 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:46.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 -- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409d6f0 msgr2=0x7fe54409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 --2- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409d6f0 0x7fe54409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 -- 172.21.15.19:0/4160653847 >> v1:172.21.15.19:6789/0 conn(0x7fe54409e410 legacy=0x7fe544133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 -- 172.21.15.19:0/4160653847 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54409a500 con 0x7fe54409e000 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe541ffb700 1 -- 172.21.15.19:0/4160653847 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641484467 0 0) 0x7fe54409b120 con 0x7fe54409e410 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 -- 172.21.15.19:0/3775027256 >> v2:172.21.15.19:3300/0 conn(0x7f2650135c20 msgr2=0x7f2650138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 --2- 172.21.15.19:0/3775027256 >> v2:172.21.15.19:3300/0 conn(0x7f2650135c20 0x7f2650138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 -- 172.21.15.19:0/3775027256 >> v1:172.21.15.19:6789/0 conn(0x7f265012cf60 legacy=0x7f265012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 -- 172.21.15.19:0/3775027256 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2650071a40 con 0x7f265006f5d0 2023-10-03T10:16:46.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7fe5427fc700 1 --2- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 0x7fe5441339f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe5380098a0 tx=0x7fe538009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c073382e98a7d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.559+0000 7f2654bc8700 1 --2- 172.21.15.19:0/3775027256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f264000bb90 tx=0x7f264000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6dcb77d4db61222 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7fe541ffb700 1 -- 172.21.15.19:0/4160653847 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538011830 con 0x7fe54409e000 2023-10-03T10:16:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7fe541ffb700 1 -- 172.21.15.19:0/4160653847 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe538011990 con 0x7fe54409e000 2023-10-03T10:16:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7fe541ffb700 1 -- 172.21.15.19:0/4160653847 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538011d40 con 0x7fe54409e000 2023-10-03T10:16:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7f2647fff700 1 -- 172.21.15.19:0/3775027256 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000dc40 con 0x7f265006f5d0 2023-10-03T10:16:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7f2647fff700 1 -- 172.21.15.19:0/3775027256 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264000dda0 con 0x7f265006f5d0 2023-10-03T10:16:46.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7f2647fff700 1 -- 172.21.15.19:0/3775027256 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2640017640 con 0x7f265006f5d0 2023-10-03T10:16:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7fe549833700 1 -- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 msgr2=0x7fe5441339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7fe549833700 1 --2- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 0x7fe5441339f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe5380098a0 tx=0x7fe538009bb0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.560+0000 7f265762d700 1 -- 172.21.15.19:0/3775027256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 msgr2=0x7f265012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 --2- 172.21.15.19:0/3775027256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f264000bb90 tx=0x7f264000bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 -- 172.21.15.19:0/3775027256 shutdown_connections 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 --2- 172.21.15.19:0/3775027256 >> v2:172.21.15.19:3300/0 conn(0x7f2650135c20 0x7f2650138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 --2- 172.21.15.19:0/3775027256 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f265012ffc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 -- 172.21.15.19:0/3775027256 >> 172.21.15.19:0/3775027256 conn(0x7f26500a2aa0 msgr2=0x7f26500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 -- 172.21.15.19:0/4160653847 shutdown_connections 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 --2- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409d6f0 0x7fe54409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 --2- 172.21.15.19:0/4160653847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409e000 0x7fe5441339f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 -- 172.21.15.19:0/4160653847 >> 172.21.15.19:0/4160653847 conn(0x7fe544066f50 msgr2=0x7fe54409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 -- 172.21.15.19:0/4160653847 shutdown_connections 2023-10-03T10:16:46.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 -- 172.21.15.19:0/3775027256 shutdown_connections 2023-10-03T10:16:46.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7f265762d700 1 -- 172.21.15.19:0/3775027256 wait complete. 2023-10-03T10:16:46.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.561+0000 7fe549833700 1 -- 172.21.15.19:0/4160653847 wait complete. 2023-10-03T10:16:46.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.562+0000 7f265762d700 1 Processor -- start 2023-10-03T10:16:46.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.562+0000 7fe549833700 1 Processor -- start 2023-10-03T10:16:46.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.562+0000 7f265762d700 1 -- start start 2023-10-03T10:16:46.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 -- start start 2023-10-03T10:16:46.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f2650132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f265012cf60 0x7f2650132650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 0x7f2650132b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265009ecd0 con 0x7f2650135c20 2023-10-03T10:16:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26501331c0 con 0x7f265006f5d0 2023-10-03T10:16:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f265762d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f265012c080 con 0x7f265012cf60 2023-10-03T10:16:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 0x7fe5441223a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 0x7fe5441228e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f26553c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f2650132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f26553c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f2650132110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60224/0 (socket says 172.21.15.19:60224) 2023-10-03T10:16:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7f26553c9700 1 -- 172.21.15.19:0/1189065001 learned_addr learned my addr 172.21.15.19:0/1189065001 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 0x7f2650132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409e410 0x7fe544122e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe544125ec0 con 0x7fe54409e000 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5441259b0 con 0x7fe54409e410 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe549833700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe544124e40 con 0x7fe54409d6f0 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe542ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 0x7fe5441223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe542ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 0x7fe5441223a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41450/0 (socket says 172.21.15.19:41450) 2023-10-03T10:16:46.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.563+0000 7fe542ffd700 1 -- 172.21.15.19:0/2776225935 learned_addr learned my addr 172.21.15.19:0/2776225935 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 0x7fe5441228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5437fe700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409e410 0x7fe544122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2654bc8700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f265012cf60 0x7f2650132650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 -- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 msgr2=0x7fe5441223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 0x7fe5441223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 -- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409e410 msgr2=0x7fe544122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409e410 0x7fe544122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 -- 172.21.15.19:0/2776225935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380094a0 con 0x7fe54409e000 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 -- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f265012cf60 msgr2=0x7f2650132650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f265012cf60 0x7f2650132650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 -- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 msgr2=0x7f2650132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f2650132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7f2655bca700 1 -- 172.21.15.19:0/1189065001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264000b7f0 con 0x7f2650135c20 2023-10-03T10:16:46.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.564+0000 7fe5427fc700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 0x7fe5441228e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe538016000 tx=0x7fe538004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe538004590 con 0x7fe54409e000 2023-10-03T10:16:46.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f2655bca700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 0x7f2650132b90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f265009f150 tx=0x7f2648009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264800cb30 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264800ccb0 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2650129fa0 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2648014680 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2650134a90 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.566+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f264801d3b0 con 0x7f2650135c20 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53801f070 con 0x7fe54409e000 2023-10-03T10:16:46.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.565+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5380038e0 con 0x7fe54409e000 2023-10-03T10:16:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.566+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2648006e40 con 0x7f2650135c20 2023-10-03T10:16:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.566+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54409c710 con 0x7fe54409e000 2023-10-03T10:16:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.566+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5440a2b90 con 0x7fe54409e000 2023-10-03T10:16:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.567+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe538003a40 con 0x7fe54409e000 2023-10-03T10:16:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.567+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26501357a0 con 0x7f2650135c20 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.567+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe538021070 con 0x7fe54409e000 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.567+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe544074ea0 con 0x7fe54409e000 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.572+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2648019080 con 0x7f2650135c20 2023-10-03T10:16:46.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.577+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe538015070 con 0x7fe54409e000 2023-10-03T10:16:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.606+0000 7fa95b3d7700 1 Processor -- start 2023-10-03T10:16:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.606+0000 7fa95b3d7700 1 -- start start 2023-10-03T10:16:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa95b3d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 0x7fa95409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa95b3d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa95409e410 0x7fa954134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa95b3d7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95409b120 con 0x7fa95409e000 2023-10-03T10:16:46.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa95b3d7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95406b460 con 0x7fa95409e410 2023-10-03T10:16:46.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa95b3d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95409a7e0 con 0x7fa95409d6f0 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959173700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 0x7fa95409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959173700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 0x7fa95409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60246/0 (socket says 172.21.15.19:60246) 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959974700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa95409e410 0x7fa954134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959173700 1 -- 172.21.15.19:0/2527715213 learned_addr learned my addr 172.21.15.19:0/2527715213 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959974700 1 -- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 msgr2=0x7fa95409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959974700 1 --2- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 0x7fa95409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959974700 1 -- 172.21.15.19:0/2527715213 >> v1:172.21.15.19:6789/0 conn(0x7fa95409e000 legacy=0x7fa9541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa94bfff700 1 -- 172.21.15.19:0/2527715213 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520942815 0 0) 0x7fa95409b120 con 0x7fa95409e000 2023-10-03T10:16:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.607+0000 7fa959974700 1 -- 172.21.15.19:0/2527715213 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95409a500 con 0x7fa95409e410 2023-10-03T10:16:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.608+0000 7fa959974700 1 --2- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa954134100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009d90 tx=0x7fa94c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c6b5e77289837f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.608+0000 7fa94bfff700 1 -- 172.21.15.19:0/2527715213 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c00e070 con 0x7fa95409e410 2023-10-03T10:16:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.608+0000 7fa94bfff700 1 -- 172.21.15.19:0/2527715213 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c00bb20 con 0x7fa95409e410 2023-10-03T10:16:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.608+0000 7fa94bfff700 1 -- 172.21.15.19:0/2527715213 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c012430 con 0x7fa95409e410 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 -- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 msgr2=0x7fa954134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa954134100 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009d90 tx=0x7fa94c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 -- 172.21.15.19:0/2527715213 shutdown_connections 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa954134100 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/2527715213 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409d6f0 0x7fa95409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 -- 172.21.15.19:0/2527715213 >> 172.21.15.19:0/2527715213 conn(0x7fa954066f50 msgr2=0x7fa95409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 -- 172.21.15.19:0/2527715213 shutdown_connections 2023-10-03T10:16:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.609+0000 7fa95b3d7700 1 -- 172.21.15.19:0/2527715213 wait complete. 2023-10-03T10:16:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.610+0000 7fa95b3d7700 1 Processor -- start 2023-10-03T10:16:46.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.610+0000 7fa95b3d7700 1 -- start start 2023-10-03T10:16:46.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa95409d6f0 0x7fa9541a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 0x7fa9541a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9541a8120 con 0x7fa95409e410 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9541a8300 con 0x7fa95409e000 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa95b3d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9541b9170 con 0x7fa95409d6f0 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa958972700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 0x7fa9541a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57528/0 (socket says 172.21.15.19:57528) 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa958972700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 0x7fa9541a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60258/0 (socket says 172.21.15.19:60258) 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 -- 172.21.15.19:0/3011889012 learned_addr learned my addr 172.21.15.19:0/3011889012 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 -- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa95409d6f0 msgr2=0x7fa9541a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa95409d6f0 0x7fa9541a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 -- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 msgr2=0x7fa9541a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 0x7fa9541a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 -- 172.21.15.19:0/3011889012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009a70 con 0x7fa95409e410 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.611+0000 7fa959974700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00b680 tx=0x7fa94c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.612+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c01b810 con 0x7fa95409e410 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.612+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c020070 con 0x7fa95409e410 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.612+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9541a4ca0 con 0x7fa95409e410 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.612+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c01bb90 con 0x7fa95409e410 2023-10-03T10:16:46.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.612+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa95409c710 con 0x7fa95409e410 2023-10-03T10:16:46.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.613+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954074ea0 con 0x7fa95409e410 2023-10-03T10:16:46.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.614+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa94c01bcf0 con 0x7fa95409e410 2023-10-03T10:16:46.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.614+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa94c022070 con 0x7fa95409e410 2023-10-03T10:16:46.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.619+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa94c0267f0 con 0x7fa95409e410 2023-10-03T10:16:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.751+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9334005590 con 0x7f9350134260 2023-10-03T10:16:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.751+0000 7f93477fe700 1 -- 172.21.15.19:0/1602779065 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9348011380 con 0x7f9350134260 2023-10-03T10:16:46.751 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.753+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 msgr2=0x7f935009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.753+0000 7f93557ba700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 0x7f935009cf00 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f934800cae0 tx=0x7f934800cdf0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 shutdown_connections 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9350134260 0x7f935009cf00 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9350133420 0x7f935009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 --2- 172.21.15.19:0/1602779065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9350133e30 0x7f935009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 >> 172.21.15.19:0/1602779065 conn(0x7f93500a4210 msgr2=0x7f93500a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 shutdown_connections 2023-10-03T10:16:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.754+0000 7f93557ba700 1 -- 172.21.15.19:0/1602779065 wait complete. 2023-10-03T10:16:46.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:46.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.786+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f265012a960 con 0x7f2650135c20 2023-10-03T10:16:46.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.786+0000 7f2645ffb700 1 -- 172.21.15.19:0/1189065001 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f264801bc50 con 0x7f2650135c20 2023-10-03T10:16:46.786 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.789+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 msgr2=0x7f2650132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.789+0000 7f265762d700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 0x7f2650132b90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f265009f150 tx=0x7f2648009ed0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 shutdown_connections 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2650135c20 0x7f2650132b90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f265006f5d0 0x7f2650132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 --2- 172.21.15.19:0/1189065001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f265012cf60 0x7f2650132650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 >> 172.21.15.19:0/1189065001 conn(0x7f26500a2aa0 msgr2=0x7f265006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe54406c360 con 0x7fe54409e000 2023-10-03T10:16:46.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 shutdown_connections 2023-10-03T10:16:46.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7f265762d700 1 -- 172.21.15.19:0/1189065001 wait complete. 2023-10-03T10:16:46.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.790+0000 7fe52bfff700 1 -- 172.21.15.19:0/2776225935 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe538006cc0 con 0x7fe54409e000 2023-10-03T10:16:46.791 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 msgr2=0x7fe5441228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 0x7fe5441228e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fe538016000 tx=0x7fe538004750 comp rx=0 tx=0).stop 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 shutdown_connections 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe54409e410 0x7fe544122e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe54409d6f0 0x7fe5441223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 --2- 172.21.15.19:0/2776225935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe54409e000 0x7fe5441228e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 >> 172.21.15.19:0/2776225935 conn(0x7fe544066f50 msgr2=0x7fe544133f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.792+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 shutdown_connections 2023-10-03T10:16:46.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.793+0000 7fe549833700 1 -- 172.21.15.19:0/2776225935 wait complete. 2023-10-03T10:16:46.805 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:46.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:46.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.830+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9541a63f0 con 0x7fa95409e410 2023-10-03T10:16:46.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.830+0000 7fa949ffb700 1 -- 172.21.15.19:0/3011889012 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa94c034020 con 0x7fa95409e410 2023-10-03T10:16:46.830 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:46.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 msgr2=0x7fa9541c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:46.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00b680 tx=0x7fa94c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 shutdown_connections 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa95409e410 0x7fa9541c8040 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa95409d6f0 0x7fa9541a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 --2- 172.21.15.19:0/3011889012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa95409e000 0x7fa9541a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 >> 172.21.15.19:0/3011889012 conn(0x7fa954066f50 msgr2=0x7fa95406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 shutdown_connections 2023-10-03T10:16:46.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:46.832+0000 7fa95b3d7700 1 -- 172.21.15.19:0/3011889012 wait complete. 2023-10-03T10:16:46.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:47.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:47.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:47.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:47.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:47.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.932+0000 7f62bfc67700 1 Processor -- start 2023-10-03T10:16:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 -- start start 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8099a40 0x7f62b8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 0x7f62b8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b809b580 con 0x7f62b809a3b0 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b81313c0 con 0x7f62b8099a40 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.933+0000 7f62bfc67700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b806e8c0 con 0x7f62b8131810 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41482/0 (socket says 172.21.15.19:41482) 2023-10-03T10:16:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 -- 172.21.15.19:0/4078020933 learned_addr learned my addr 172.21.15.19:0/4078020933 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bd202700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8099a40 0x7f62b8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62be204700 1 --2- 172.21.15.19:0/4078020933 >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 0x7f62b8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 -- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8099a40 msgr2=0x7f62b8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8099a40 0x7f62b8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 -- 172.21.15.19:0/4078020933 >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 msgr2=0x7f62b8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 --2- 172.21.15.19:0/4078020933 >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 0x7f62b8138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62bda03700 1 -- 172.21.15.19:0/4078020933 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b809a820 con 0x7f62b8131810 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.934+0000 7f62be204700 1 --2- 172.21.15.19:0/4078020933 >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 0x7f62b8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.935+0000 7f62bda03700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9de79b8929c6b45 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.935+0000 7f62bca01700 1 -- 172.21.15.19:0/4078020933 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011830 con 0x7f62b8131810 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.935+0000 7f62bca01700 1 -- 172.21.15.19:0/4078020933 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4011990 con 0x7f62b8131810 2023-10-03T10:16:47.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.935+0000 7f62bca01700 1 -- 172.21.15.19:0/4078020933 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011d20 con 0x7f62b8131810 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 -- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 msgr2=0x7f62b8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f62b40098f0 tx=0x7f62b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 -- 172.21.15.19:0/4078020933 shutdown_connections 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 --2- 172.21.15.19:0/4078020933 >> v2:172.21.15.19:3300/0 conn(0x7f62b809a3b0 0x7f62b8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b8131810 0x7f62b8131be0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 --2- 172.21.15.19:0/4078020933 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8099a40 0x7f62b8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 -- 172.21.15.19:0/4078020933 >> 172.21.15.19:0/4078020933 conn(0x7f62b80a2aa0 msgr2=0x7f62b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.936+0000 7f62bfc67700 1 -- 172.21.15.19:0/4078020933 shutdown_connections 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.937+0000 7f62bfc67700 1 -- 172.21.15.19:0/4078020933 wait complete. 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.938+0000 7f62bfc67700 1 Processor -- start 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.938+0000 7f62bfc67700 1 -- start start 2023-10-03T10:16:47.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b8099a40 0x7f62b806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131810 0x7f62b8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b811e2a0 con 0x7f62b8099a40 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8130870 con 0x7f62b8131810 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bfc67700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80709e0 con 0x7f62b809a3b0 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bd202700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bd202700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41492/0 (socket says 172.21.15.19:41492) 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bd202700 1 -- 172.21.15.19:0/1424802101 learned_addr learned my addr 172.21.15.19:0/1424802101 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62be204700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131810 0x7f62b8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.939+0000 7f62bda03700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b8099a40 0x7f62b806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 -- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131810 msgr2=0x7f62b8070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131810 0x7f62b8070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 -- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b8099a40 msgr2=0x7f62b806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b8099a40 0x7f62b806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 -- 172.21.15.19:0/1424802101 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4009550 con 0x7f62b809a3b0 2023-10-03T10:16:47.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bd202700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e980 tx=0x7f62a800ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8009710 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a800eed0 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b811ea90 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a800ca70 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.940+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b806eb00 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.941+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62a800cbd0 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.941+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62a803fc40 con 0x7f62b809a3b0 2023-10-03T10:16:47.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.942+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b811e6d0 con 0x7f62b809a3b0 2023-10-03T10:16:47.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.947+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62a8017070 con 0x7f62b809a3b0 2023-10-03T10:16:47.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.962+0000 7ff9d42e2700 1 Processor -- start 2023-10-03T10:16:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.962+0000 7ff9d42e2700 1 -- start start 2023-10-03T10:16:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d42e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d42e2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9cc09e410 0x7ff9cc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d42e2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9cc09b120 con 0x7ff9cc09e000 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d42e2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9cc06b460 con 0x7ff9cc09e410 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d42e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc09a7e0 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41496/0 (socket says 172.21.15.19:41496) 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 -- 172.21.15.19:0/3616239584 learned_addr learned my addr 172.21.15.19:0/3616239584 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 -- 172.21.15.19:0/3616239584 >> v2:172.21.15.19:3300/0 conn(0x7ff9cc09e410 msgr2=0x7ff9cc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 --2- 172.21.15.19:0/3616239584 >> v2:172.21.15.19:3300/0 conn(0x7ff9cc09e410 0x7ff9cc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 -- 172.21.15.19:0/3616239584 >> v1:172.21.15.19:6789/0 conn(0x7ff9cc09e000 legacy=0x7ff9cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 -- 172.21.15.19:0/3616239584 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc09a500 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.963+0000 7ff9d207e700 1 --2- 172.21.15.19:0/3616239584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009920 tx=0x7ff9c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660750d93c7e1aa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.964+0000 7ff9d107c700 1 -- 172.21.15.19:0/3616239584 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8004230 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.964+0000 7ff9d107c700 1 -- 172.21.15.19:0/3616239584 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8004390 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.964+0000 7ff9d107c700 1 -- 172.21.15.19:0/3616239584 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8009e70 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.964+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3616239584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 msgr2=0x7ff9cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.964+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3616239584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009920 tx=0x7ff9c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3616239584 shutdown_connections 2023-10-03T10:16:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3616239584 >> v2:172.21.15.19:3300/0 conn(0x7ff9cc09e410 0x7ff9cc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3616239584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09d6f0 0x7ff9cc09dac0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3616239584 >> 172.21.15.19:0/3616239584 conn(0x7ff9cc066f50 msgr2=0x7ff9cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3616239584 shutdown_connections 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.965+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3616239584 wait complete. 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 Processor -- start 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 -- start start 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9cc09d6f0 0x7ff9cc1a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 0x7ff9cc1a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1a7bd0 con 0x7ff9cc09e000 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1a8e20 con 0x7ff9cc09d6f0 2023-10-03T10:16:47.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d42e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1a81b0 con 0x7ff9cc09e410 2023-10-03T10:16:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d187d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d187d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57570/0 (socket says 172.21.15.19:57570) 2023-10-03T10:16:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.966+0000 7ff9d187d700 1 -- 172.21.15.19:0/3631597539 learned_addr learned my addr 172.21.15.19:0/3631597539 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 -- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 msgr2=0x7ff9cc1a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d287f700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 0x7ff9cc1a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 0x7ff9cc1a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 -- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9cc09d6f0 msgr2=0x7ff9cc1a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9cc09d6f0 0x7ff9cc1a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 -- 172.21.15.19:0/3631597539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c8009550 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d287f700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 0x7ff9cc1a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d187d700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c4d0 tx=0x7ff9bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc0054e0 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc003680 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1a9800 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.967+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc003a10 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.968+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc09c710 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.968+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9bc003b70 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.968+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff9bc03eb60 con 0x7ff9cc09e000 2023-10-03T10:16:47.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.969+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc074ea0 con 0x7ff9cc09e000 2023-10-03T10:16:47.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.977+0000 7f326352a700 1 Processor -- start 2023-10-03T10:16:47.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.977+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9bc012400 con 0x7ff9cc09e000 2023-10-03T10:16:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.978+0000 7f326352a700 1 -- start start 2023-10-03T10:16:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.978+0000 7f326352a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.978+0000 7f326352a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 0x7f325c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f326352a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c09b120 con 0x7f325c09e410 2023-10-03T10:16:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f326352a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c06b460 con 0x7f325c09d6f0 2023-10-03T10:16:47.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f326352a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c09a7e0 con 0x7f325c09e000 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60296/0 (socket says 172.21.15.19:60296) 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 -- 172.21.15.19:0/2993284363 learned_addr learned my addr 172.21.15.19:0/2993284363 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f3260ac5700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 0x7f325c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 -- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 msgr2=0x7f325c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 0x7f325c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 -- 172.21.15.19:0/2993284363 >> v1:172.21.15.19:6789/0 conn(0x7f325c09e410 legacy=0x7f325c133f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 -- 172.21.15.19:0/2993284363 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c09a500 con 0x7f325c09d6f0 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f3260ac5700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 0x7f325c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.979+0000 7f32612c6700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3258009920 tx=0x7f3258009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8075e4bff6246d2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.980+0000 7f3253fff700 1 -- 172.21.15.19:0/2993284363 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258004230 con 0x7f325c09d6f0 2023-10-03T10:16:47.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.980+0000 7f3253fff700 1 -- 172.21.15.19:0/2993284363 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258004390 con 0x7f325c09d6f0 2023-10-03T10:16:47.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.980+0000 7f3253fff700 1 -- 172.21.15.19:0/2993284363 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580036a0 con 0x7f325c09d6f0 2023-10-03T10:16:47.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.981+0000 7f326352a700 1 -- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 msgr2=0x7f325c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.981+0000 7f326352a700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3258009920 tx=0x7f3258009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 -- 172.21.15.19:0/2993284363 shutdown_connections 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09d6f0 0x7f325c09dac0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 --2- 172.21.15.19:0/2993284363 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09e000 0x7f325c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 -- 172.21.15.19:0/2993284363 >> 172.21.15.19:0/2993284363 conn(0x7f325c066f50 msgr2=0x7f325c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 -- 172.21.15.19:0/2993284363 shutdown_connections 2023-10-03T10:16:47.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.982+0000 7f326352a700 1 -- 172.21.15.19:0/2993284363 wait complete. 2023-10-03T10:16:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.983+0000 7f326352a700 1 Processor -- start 2023-10-03T10:16:47.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.983+0000 7f326352a700 1 -- start start 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 0x7f325c1224b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 0x7f325c1229f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f325c09e410 0x7f325c122f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c125c80 con 0x7f325c09e410 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c124f60 con 0x7f325c09e000 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f326352a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f325c0a2d90 con 0x7f325c09d6f0 2023-10-03T10:16:47.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f3260ac5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 0x7f325c1229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f32612c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 0x7f325c1224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:47.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f32612c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 0x7f325c1224b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41528/0 (socket says 172.21.15.19:41528) 2023-10-03T10:16:47.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.984+0000 7f32612c6700 1 -- 172.21.15.19:0/730743411 learned_addr learned my addr 172.21.15.19:0/730743411 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:47.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 -- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 msgr2=0x7f325c1224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 0x7f325c1224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 -- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f325c09e410 msgr2=0x7f325c122f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f325c09e410 0x7f325c122f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 -- 172.21.15.19:0/730743411 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c0094a0 con 0x7f325c09e000 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3260ac5700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 0x7f325c1229f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e9b0 tx=0x7f324c00ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00c850 con 0x7f325c09e000 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3258009550 con 0x7f325c09e000 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c00c9b0 con 0x7f325c09e000 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.985+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00cd40 con 0x7f325c09e000 2023-10-03T10:16:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.986+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c124840 con 0x7f325c09e000 2023-10-03T10:16:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.987+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f324c013470 con 0x7f325c09e000 2023-10-03T10:16:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.987+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c074ea0 con 0x7f325c09e000 2023-10-03T10:16:47.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.987+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f324c012dc0 con 0x7f325c09e000 2023-10-03T10:16:47.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:47.997+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f324c017020 con 0x7f325c09e000 2023-10-03T10:16:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.019+0000 7f40c3dba700 1 Processor -- start 2023-10-03T10:16:48.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.020+0000 7f40c3dba700 1 -- start start 2023-10-03T10:16:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.020+0000 7f40c3dba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40bc09e1d0 0x7f40bc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c3dba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc135e50 0x7f40bc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c3dba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc09f130 con 0x7f40bc09d6f0 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c3dba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc09f520 con 0x7f40bc09e1d0 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c3dba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc09e930 con 0x7f40bc135e50 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40bc09e1d0 0x7f40bc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40bc09e1d0 0x7f40bc135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57574/0 (socket says 172.21.15.19:57574) 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 -- 172.21.15.19:0/2079224792 learned_addr learned my addr 172.21.15.19:0/2079224792 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:48.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1b56700 1 --1- 172.21.15.19:0/2079224792 >> v1:172.21.15.19:6789/0 conn(0x7f40bc09d6f0 0x7f40bc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45180/0 (socket says 172.21.15.19:45180) 2023-10-03T10:16:48.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 -- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc135e50 msgr2=0x7f40bc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:48.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 --2- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc135e50 0x7f40bc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 -- 172.21.15.19:0/2079224792 >> v1:172.21.15.19:6789/0 conn(0x7f40bc09d6f0 legacy=0x7f40bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 -- 172.21.15.19:0/2079224792 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc09b2d0 con 0x7f40bc09e1d0 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c1355700 1 --2- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc09e1d0 0x7f40bc135910 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00bb90 tx=0x7f40ac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d14f01b7f056e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.021+0000 7f40c0b54700 1 -- 172.21.15.19:0/2079224792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00dd50 con 0x7f40bc09e1d0 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c0b54700 1 -- 172.21.15.19:0/2079224792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac010470 con 0x7f40bc09e1d0 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c0b54700 1 -- 172.21.15.19:0/2079224792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac010800 con 0x7f40bc09e1d0 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 -- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc09e1d0 msgr2=0x7f40bc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 --2- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc09e1d0 0x7f40bc135910 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00bb90 tx=0x7f40ac00bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 -- 172.21.15.19:0/2079224792 shutdown_connections 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 --2- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc135e50 0x7f40bc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 --2- 172.21.15.19:0/2079224792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc09e1d0 0x7f40bc135910 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 -- 172.21.15.19:0/2079224792 >> 172.21.15.19:0/2079224792 conn(0x7f40bc066f50 msgr2=0x7f40bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.022+0000 7f40c3dba700 1 -- 172.21.15.19:0/2079224792 shutdown_connections 2023-10-03T10:16:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.023+0000 7f40c3dba700 1 -- 172.21.15.19:0/2079224792 wait complete. 2023-10-03T10:16:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.024+0000 7f40c3dba700 1 Processor -- start 2023-10-03T10:16:48.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.024+0000 7f40c3dba700 1 -- start start 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc09e1d0 0x7f40bc119c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc135e50 0x7f40bc11a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc11cf80 con 0x7f40bc135e50 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc126440 con 0x7f40bc09d6f0 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c3dba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc09c700 con 0x7f40bc09e1d0 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60310/0 (socket says 172.21.15.19:60310) 2023-10-03T10:16:48.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 -- 172.21.15.19:0/733213227 learned_addr learned my addr 172.21.15.19:0/733213227 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c2357700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc135e50 0x7f40bc11a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 -- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc09e1d0 msgr2=0x7f40bc119c80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc09e1d0 0x7f40bc119c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 -- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc135e50 msgr2=0x7f40bc11a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc135e50 0x7f40bc11a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.025+0000 7f40c1b56700 1 -- 172.21.15.19:0/733213227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac00b7f0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40c1b56700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c530 tx=0x7f40b800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8005cb0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8005e10 con 0x7f40bc09d6f0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80072d0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc0a1ef0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.026+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc11d260 con 0x7f40bc09d6f0 2023-10-03T10:16:48.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.027+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc11bdd0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.027+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40b8007430 con 0x7f40bc09d6f0 2023-10-03T10:16:48.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.028+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40b803ea60 con 0x7f40bc09d6f0 2023-10-03T10:16:48.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.032+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40b8012400 con 0x7f40bc09d6f0 2023-10-03T10:16:48.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.192+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff9cc06c360 con 0x7ff9cc09e000 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.192+0000 7ff9c2ffd700 1 -- 172.21.15.19:0/3631597539 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9bc017020 con 0x7ff9cc09e000 2023-10-03T10:16:48.192 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.194+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 msgr2=0x7ff9cc1a6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.194+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c4d0 tx=0x7ff9bc00c890 comp rx=0 tx=0).stop 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 shutdown_connections 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9cc09e410 0x7ff9cc1a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9cc09d6f0 0x7ff9cc1a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 --2- 172.21.15.19:0/3631597539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9cc09e000 0x7ff9cc1a6500 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 >> 172.21.15.19:0/3631597539 conn(0x7ff9cc066f50 msgr2=0x7ff9cc1baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 shutdown_connections 2023-10-03T10:16:48.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7ff9d42e2700 1 -- 172.21.15.19:0/3631597539 wait complete. 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62b8071d20 con 0x7f62b809a3b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.195+0000 7f62ae7fc700 1 -- 172.21.15.19:0/1424802101 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62a801b3b0 con 0x7f62b809a3b0 2023-10-03T10:16:48.196 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 msgr2=0x7f62b806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e980 tx=0x7f62a800ec90 comp rx=0 tx=0).stop 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 shutdown_connections 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131810 0x7f62b8070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b8099a40 0x7f62b806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 --2- 172.21.15.19:0/1424802101 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b809a3b0 0x7f62b806fb50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 >> 172.21.15.19:0/1424802101 conn(0x7f62b80a2aa0 msgr2=0x7f62b812e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 shutdown_connections 2023-10-03T10:16:48.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.199+0000 7f62bfc67700 1 -- 172.21.15.19:0/1424802101 wait complete. 2023-10-03T10:16:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.207+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f325c06c360 con 0x7f325c09e000 2023-10-03T10:16:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.207+0000 7f3251ffb700 1 -- 172.21.15.19:0/730743411 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f324c017020 con 0x7f325c09e000 2023-10-03T10:16:48.210 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:48.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 msgr2=0x7f325c1229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 0x7f325c1229f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f324c00e9b0 tx=0x7f324c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 shutdown_connections 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f325c09e410 0x7f325c122f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f325c09d6f0 0x7f325c1224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 --2- 172.21.15.19:0/730743411 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f325c09e000 0x7f325c1229f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 >> 172.21.15.19:0/730743411 conn(0x7f325c066f50 msgr2=0x7f325c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 shutdown_connections 2023-10-03T10:16:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.210+0000 7f326352a700 1 -- 172.21.15.19:0/730743411 wait complete. 2023-10-03T10:16:48.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:48.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:48.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:48.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.269+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f40bc074ea0 con 0x7f40bc09d6f0 2023-10-03T10:16:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.269+0000 7f40b27fc700 1 -- 172.21.15.19:0/733213227 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40b8017020 con 0x7f40bc09d6f0 2023-10-03T10:16:48.269 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 msgr2=0x7f40bc119740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c530 tx=0x7f40b800c840 comp rx=0 tx=0).stop 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 shutdown_connections 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40bc135e50 0x7f40bc11a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40bc09d6f0 0x7f40bc119740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 --2- 172.21.15.19:0/733213227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40bc09e1d0 0x7f40bc119c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 >> 172.21.15.19:0/733213227 conn(0x7f40bc066f50 msgr2=0x7f40bc132bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 shutdown_connections 2023-10-03T10:16:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:48.271+0000 7f40c3dba700 1 -- 172.21.15.19:0/733213227 wait complete. 2023-10-03T10:16:48.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:49.212 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:49.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:49.225 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:49.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 Processor -- start 2023-10-03T10:16:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 -- start start 2023-10-03T10:16:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 0x7f54cc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 0x7f54cc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54cc09f130 con 0x7f54cc09d6f0 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54cc09f520 con 0x7f54cc09e1d0 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54d1ad2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc09e930 con 0x7f54cc135e50 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 0x7f54cc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54cbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 0x7f54cc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54caffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 0x7f54cc135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57584/0 (socket says 172.21.15.19:57584) 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54caffd700 1 -- 172.21.15.19:0/3843920615 learned_addr learned my addr 172.21.15.19:0/3843920615 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.376+0000 7f54cb7fe700 1 --1- 172.21.15.19:0/3843920615 >> v1:172.21.15.19:6789/0 conn(0x7f54cc09d6f0 0x7f54cc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45186/0 (socket says 172.21.15.19:45186) 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54cbfff700 1 -- 172.21.15.19:0/3843920615 >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 msgr2=0x7f54cc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54cbfff700 1 --2- 172.21.15.19:0/3843920615 >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 0x7f54cc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54cbfff700 1 -- 172.21.15.19:0/3843920615 >> v1:172.21.15.19:6789/0 conn(0x7f54cc09d6f0 legacy=0x7f54cc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54cbfff700 1 -- 172.21.15.19:0/3843920615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc09b2d0 con 0x7f54cc135e50 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54cbfff700 1 --2- 172.21.15.19:0/3843920615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 0x7f54cc138230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009d90 tx=0x7f54c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2da96fcbe730671b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54ca7fc700 1 -- 172.21.15.19:0/3843920615 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c400bd20 con 0x7f54cc135e50 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54ca7fc700 1 -- 172.21.15.19:0/3843920615 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c400be80 con 0x7f54cc135e50 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.377+0000 7f54ca7fc700 1 -- 172.21.15.19:0/3843920615 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40116a0 con 0x7f54cc135e50 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3843920615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 msgr2=0x7f54cc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3843920615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 0x7f54cc138230 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54c4009d90 tx=0x7f54c400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3843920615 shutdown_connections 2023-10-03T10:16:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3843920615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc135e50 0x7f54cc138230 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3843920615 >> v2:172.21.15.19:3300/0 conn(0x7f54cc09e1d0 0x7f54cc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3843920615 >> 172.21.15.19:0/3843920615 conn(0x7f54cc066f50 msgr2=0x7f54cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3843920615 shutdown_connections 2023-10-03T10:16:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.378+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3843920615 wait complete. 2023-10-03T10:16:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.379+0000 7f54d1ad2700 1 Processor -- start 2023-10-03T10:16:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 -- start start 2023-10-03T10:16:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54cc09d6f0 0x7f54cc11fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc09e1d0 0x7f54cc120170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc124110 con 0x7f54cc09d6f0 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc123750 con 0x7f54cc135e50 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54d1ad2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54cc123240 con 0x7f54cc09e1d0 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60318/0 (socket says 172.21.15.19:60318) 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54cbfff700 1 -- 172.21.15.19:0/3173007439 learned_addr learned my addr 172.21.15.19:0/3173007439 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.380+0000 7f54cb7fe700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54cc09d6f0 0x7f54cc11fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54caffd700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc09e1d0 0x7f54cc120170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 -- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc09e1d0 msgr2=0x7f54cc120170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc09e1d0 0x7f54cc120170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 -- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54cc09d6f0 msgr2=0x7f54cc11fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54cc09d6f0 0x7f54cc11fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 -- 172.21.15.19:0/3173007439 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c4009a70 con 0x7f54cc135e50 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54cbfff700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54cc09ea70 tx=0x7f54c4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4003ea0 con 0x7f54cc135e50 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4004800 con 0x7f54cc135e50 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4004970 con 0x7f54cc135e50 2023-10-03T10:16:49.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.381+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54cc1226d0 con 0x7f54cc135e50 2023-10-03T10:16:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.382+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54cc0a1f00 con 0x7f54cc135e50 2023-10-03T10:16:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.382+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f54c40116a0 con 0x7f54cc135e50 2023-10-03T10:16:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.383+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f54c4041050 con 0x7f54cc135e50 2023-10-03T10:16:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.383+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54cc074ea0 con 0x7f54cc135e50 2023-10-03T10:16:49.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.388+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f54c4011950 con 0x7f54cc135e50 2023-10-03T10:16:49.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 Processor -- start 2023-10-03T10:16:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f35578e4700 1 Processor -- start 2023-10-03T10:16:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 -- start start 2023-10-03T10:16:49.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f35578e4700 1 -- start start 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23640a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23640a1340 0x7f2364133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2364133fa0 0x7f2364134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236409edd0 con 0x7f2364133fa0 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236409e1f0 con 0x7f23640a1340 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.404+0000 7f236af42700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f236409dc50 con 0x7f23640a0a30 2023-10-03T10:16:49.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f35578e4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f355009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f35578e4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f355009e000 0x7f35501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f35578e4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355009b120 con 0x7f355009e410 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f35578e4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355006b460 con 0x7f355009e000 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f35578e4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f355009a7e0 con 0x7f355009d6f0 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f2368cde700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23640a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f2368cde700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23640a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41568/0 (socket says 172.21.15.19:41568) 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f2368cde700 1 -- 172.21.15.19:0/2959828462 learned_addr learned my addr 172.21.15.19:0/2959828462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 --2- 172.21.15.19:0/2959828462 >> v2:172.21.15.19:3300/0 conn(0x7f2364133fa0 0x7f2364134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f2363fff700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23640a1340 0x7f2364133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f3555e81700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f355009e410 0x7f3550133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45198/0 (socket says 172.21.15.19:45198) 2023-10-03T10:16:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f3555e81700 1 -- 172.21.15.19:0/922831168 learned_addr learned my addr 172.21.15.19:0/922831168 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f3555680700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f355009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 -- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 msgr2=0x7f23640a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23640a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 -- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23640a1340 msgr2=0x7f2364133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23640a1340 0x7f2364133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f23694df700 1 -- 172.21.15.19:0/2959828462 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640a1fe0 con 0x7f2364133fa0 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121955467 0 0) 0x7f355009b120 con 0x7f355009e410 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.405+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f353c0035b0 con 0x7f355009e410 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3935298658 0 0) 0x7f353c0035b0 con 0x7f355009e410 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3554e7f700 1 --2- 172.21.15.19:0/922831168 >> v2:172.21.15.19:3300/0 conn(0x7f355009e000 0x7f35501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 msgr2=0x7f355009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f355009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 >> v2:172.21.15.19:3300/0 conn(0x7f355009e000 msgr2=0x7f35501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 --2- 172.21.15.19:0/922831168 >> v2:172.21.15.19:3300/0 conn(0x7f355009e000 0x7f35501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355009a500 con 0x7f355009e410 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f35480019f0 con 0x7f355009e410 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 >> v1:172.21.15.19:6789/0 conn(0x7f355009e410 legacy=0x7f3550133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353c003a30 0x7f353c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f353c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f353c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355006b460 con 0x7f353c003a30 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355009a7e0 con 0x7f353c004d90 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f353c00baf0 con 0x7f355009d6f0 2023-10-03T10:16:49.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f23694df700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2364133fa0 0x7f2364134410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f235c009d90 tx=0x7f235c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06bf71ebeae14b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3554e7f700 1 --2- 172.21.15.19:0/922831168 >> v2:172.21.15.19:3300/0 conn(0x7f355009e000 0x7f35501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555680700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353c003a30 0x7f353c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f23637fe700 1 -- 172.21.15.19:0/2959828462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c00e070 con 0x7f2364133fa0 2023-10-03T10:16:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f23637fe700 1 -- 172.21.15.19:0/2959828462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c00bb20 con 0x7f2364133fa0 2023-10-03T10:16:49.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f23637fe700 1 -- 172.21.15.19:0/2959828462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c012430 con 0x7f2364133fa0 2023-10-03T10:16:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f353c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3554e7f700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f353c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 -- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 msgr2=0x7f353c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f353c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 -- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353c003a30 msgr2=0x7f353c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353c003a30 0x7f353c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555e81700 1 -- 172.21.15.19:0/922831168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355009a500 con 0x7f353c004d90 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.406+0000 7f3555680700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f353c003a30 0x7f353c003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f3555e81700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f353c005200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f354800a860 tx=0x7f353c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8974b548f4831aa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012600 con 0x7f353c004d90 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3548012760 con 0x7f353c004d90 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f3547fff700 1 -- 172.21.15.19:0/922831168 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548012b10 con 0x7f353c004d90 2023-10-03T10:16:49.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 -- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2364133fa0 msgr2=0x7f2364134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2364133fa0 0x7f2364134410 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f235c009d90 tx=0x7f235c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f3554e7f700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f355009d6f0 0x7f353c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:49.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 -- 172.21.15.19:0/2959828462 shutdown_connections 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2364133fa0 0x7f2364134410 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23640a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 --2- 172.21.15.19:0/2959828462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23640a1340 0x7f2364133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 -- 172.21.15.19:0/2959828462 >> 172.21.15.19:0/2959828462 conn(0x7f23640a6550 msgr2=0x7f23640a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 -- 172.21.15.19:0/2959828462 shutdown_connections 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.407+0000 7f236af42700 1 -- 172.21.15.19:0/2959828462 wait complete. 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 -- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 msgr2=0x7f353c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 --2- 172.21.15.19:0/922831168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f353c005200 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f354800a860 tx=0x7f353c005880 comp rx=0 tx=0).stop 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f3555e81700 1 -- 172.21.15.19:0/922831168 reap_dead start 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 -- 172.21.15.19:0/922831168 shutdown_connections 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 -- 172.21.15.19:0/922831168 >> 172.21.15.19:0/922831168 conn(0x7f3550066f50 msgr2=0x7f355009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 -- 172.21.15.19:0/922831168 shutdown_connections 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f236af42700 1 Processor -- start 2023-10-03T10:16:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 -- start start 2023-10-03T10:16:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.408+0000 7f35578e4700 1 -- 172.21.15.19:0/922831168 wait complete. 2023-10-03T10:16:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f35578e4700 1 Processor -- start 2023-10-03T10:16:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23641c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23640a1340 0x7f23641c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23640a3680 con 0x7f23640a1340 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2364121420 con 0x7f2364133fa0 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f236af42700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23641c4cb0 con 0x7f23640a0a30 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f23694df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f23694df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60340/0 (socket says 172.21.15.19:60340) 2023-10-03T10:16:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f23694df700 1 -- 172.21.15.19:0/836174059 learned_addr learned my addr 172.21.15.19:0/836174059 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f35578e4700 1 -- start start 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f35578e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.409+0000 7f35578e4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 0x7f35501b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f35578e4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35501c8a10 0x7f35501c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f35578e4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35501b7dc0 con 0x7f35501b4f90 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f35578e4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35500a1e90 con 0x7f353c004d90 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f35578e4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f355009c710 con 0x7f35501c8a10 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3555680700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3555680700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60348/0 (socket says 172.21.15.19:60348) 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3555680700 1 -- 172.21.15.19:0/3161537499 learned_addr learned my addr 172.21.15.19:0/3161537499 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 0x7f35501b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 -- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35501c8a10 msgr2=0x7f35501c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35501c8a10 0x7f35501c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 -- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 msgr2=0x7f35501b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 -- 172.21.15.19:0/3161537499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35501b8fe0 con 0x7f35501b4f90 2023-10-03T10:16:49.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f23694df700 1 -- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 msgr2=0x7f23641c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f23694df700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23641c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f23694df700 1 -- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23640a1340 msgr2=0x7f23641c4770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:49.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f23694df700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23640a1340 0x7f23641c4770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f23694df700 1 -- 172.21.15.19:0/836174059 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c009a70 con 0x7f2364133fa0 2023-10-03T10:16:49.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3555680700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.410+0000 7f3554e7f700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 0x7f35501b5380 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f354000d7b0 tx=0x7f354000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f23694df700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f236409ef10 tx=0x7f235c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540012870 con 0x7f35501b4f90 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354000c040 con 0x7f35501b4f90 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540012bf0 con 0x7f35501b4f90 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35501b83d0 con 0x7f35501b4f90 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c004920 con 0x7f2364133fa0 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235c020070 con 0x7f2364133fa0 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f236af42700 1 -- 172.21.15.19:0/836174059 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2364120720 con 0x7f2364133fa0 2023-10-03T10:16:49.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235c0276c0 con 0x7f2364133fa0 2023-10-03T10:16:49.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f236af42700 1 -- 172.21.15.19:0/836174059 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f236411fb00 con 0x7f2364133fa0 2023-10-03T10:16:49.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.411+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35501b63e0 con 0x7f35501b4f90 2023-10-03T10:16:49.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.412+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3540012d50 con 0x7f35501b4f90 2023-10-03T10:16:49.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.412+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3550074ea0 con 0x7f35501b4f90 2023-10-03T10:16:49.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.413+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f354000f8f0 con 0x7f35501b4f90 2023-10-03T10:16:49.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.413+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c0052e0 con 0x7f2364133fa0 2023-10-03T10:16:49.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.413+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f235c027820 con 0x7f2364133fa0 2023-10-03T10:16:49.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.413+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f235c022070 con 0x7f2364133fa0 2023-10-03T10:16:49.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.418+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3540044060 con 0x7f35501b4f90 2023-10-03T10:16:49.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.418+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f235c02fd60 con 0x7f2364133fa0 2023-10-03T10:16:49.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.476+0000 7f52b6b01700 1 Processor -- start 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.476+0000 7f52b6b01700 1 -- start start 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b6b01700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b6b01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 0x7f52b013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b6b01700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b0134980 con 0x7f52b006c0e0 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b6b01700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b006c4b0 con 0x7f52b013d240 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b6b01700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b009b0e0 con 0x7f52b009ac90 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52affff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52affff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41618/0 (socket says 172.21.15.19:41618) 2023-10-03T10:16:49.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b489d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f52b006c0e0 0x7f52b0134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45206/0 (socket says 172.21.15.19:45206) 2023-10-03T10:16:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52affff700 1 -- 172.21.15.19:0/1351696365 learned_addr learned my addr 172.21.15.19:0/1351696365 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.477+0000 7f52b509e700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 0x7f52b013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52af7fe700 1 -- 172.21.15.19:0/1351696365 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165595169 0 0) 0x7f52b0134980 con 0x7f52b006c0e0 2023-10-03T10:16:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52af7fe700 1 -- 172.21.15.19:0/1351696365 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a00035b0 con 0x7f52b006c0e0 2023-10-03T10:16:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52b509e700 1 -- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 msgr2=0x7f52b013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:49.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52b509e700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52b509e700 1 -- 172.21.15.19:0/1351696365 >> v1:172.21.15.19:6789/0 conn(0x7f52b006c0e0 legacy=0x7f52b0134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52b509e700 1 -- 172.21.15.19:0/1351696365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b00a0600 con 0x7f52b013d240 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52affff700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52b509e700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 0x7f52b013f620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009dc0 tx=0x7f52a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b08baa7a80afe7b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52af7fe700 1 -- 172.21.15.19:0/1351696365 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800e070 con 0x7f52b013d240 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52af7fe700 1 -- 172.21.15.19:0/1351696365 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a800bb20 con 0x7f52b013d240 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.478+0000 7f52af7fe700 1 -- 172.21.15.19:0/1351696365 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8012430 con 0x7f52b013d240 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 -- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 msgr2=0x7f52b013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 0x7f52b013f620 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009dc0 tx=0x7f52a800b330 comp rx=0 tx=0).stop 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 -- 172.21.15.19:0/1351696365 shutdown_connections 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b013d240 0x7f52b013f620 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1351696365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b013cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.479+0000 7f52b6b01700 1 -- 172.21.15.19:0/1351696365 >> 172.21.15.19:0/1351696365 conn(0x7f52b00a4210 msgr2=0x7f52b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.480+0000 7f52b6b01700 1 -- 172.21.15.19:0/1351696365 shutdown_connections 2023-10-03T10:16:49.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.480+0000 7f52b6b01700 1 -- 172.21.15.19:0/1351696365 wait complete. 2023-10-03T10:16:49.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.481+0000 7f52b6b01700 1 Processor -- start 2023-10-03T10:16:49.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.481+0000 7f52b6b01700 1 -- start start 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 0x7f52b0135b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b0136080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b013d240 0x7f52b01365c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b0136f10 con 0x7f52b013d240 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b011ad30 con 0x7f52b006c0e0 2023-10-03T10:16:49.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b6b01700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52b0137580 con 0x7f52b009ac90 2023-10-03T10:16:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b489d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 0x7f52b0135b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52affff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b0136080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b489d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 0x7f52b0135b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60370/0 (socket says 172.21.15.19:60370) 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b489d700 1 -- 172.21.15.19:0/1781610445 learned_addr learned my addr 172.21.15.19:0/1781610445 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.482+0000 7f52b509e700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b013d240 0x7f52b01365c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 -- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 msgr2=0x7f52b0135b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 0x7f52b0135b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 -- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b013d240 msgr2=0x7f52b01365c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b013d240 0x7f52b01365c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 -- 172.21.15.19:0/1781610445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c009550 con 0x7f52b009ac90 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52affff700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b0136080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9a0 tx=0x7f529c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c004030 con 0x7f52b009ac90 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529c004190 con 0x7f52b009ac90 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a8009a70 con 0x7f52b009ac90 2023-10-03T10:16:49.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529c004520 con 0x7f52b009ac90 2023-10-03T10:16:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.483+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b011b760 con 0x7f52b009ac90 2023-10-03T10:16:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.485+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b013cdb0 con 0x7f52b009ac90 2023-10-03T10:16:49.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.485+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f529c0036a0 con 0x7f52b009ac90 2023-10-03T10:16:49.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.487+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f529c003950 con 0x7f52b009ac90 2023-10-03T10:16:49.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.495+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f529c019d60 con 0x7f52b009ac90 2023-10-03T10:16:49.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.627+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f233c005590 con 0x7f2364133fa0 2023-10-03T10:16:49.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.627+0000 7f23617fa700 1 -- 172.21.15.19:0/836174059 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f235c02fb80 con 0x7f2364133fa0 2023-10-03T10:16:49.629 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:49.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.628+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f54cc072560 con 0x7f54cc135e50 2023-10-03T10:16:49.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.628+0000 7f54b3fff700 1 -- 172.21.15.19:0/3173007439 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f54c4020360 con 0x7f54cc135e50 2023-10-03T10:16:49.629 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 msgr2=0x7f23641c07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f236409ef10 tx=0x7f235c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 shutdown_connections 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2364133fa0 0x7f23641c07f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23640a0a30 0x7f23641c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 --2- 172.21.15.19:0/836174059 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23640a1340 0x7f23641c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 >> 172.21.15.19:0/836174059 conn(0x7f23640a6550 msgr2=0x7f236409c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 shutdown_connections 2023-10-03T10:16:49.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.630+0000 7f234effd700 1 -- 172.21.15.19:0/836174059 wait complete. 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 msgr2=0x7f54cc1206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f54cc09ea70 tx=0x7f54c4004b40 comp rx=0 tx=0).stop 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 shutdown_connections 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f54cc135e50 0x7f54cc1206b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f54cc09d6f0 0x7f54cc11fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 --2- 172.21.15.19:0/3173007439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f54cc09e1d0 0x7f54cc120170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 >> 172.21.15.19:0/3173007439 conn(0x7f54cc066f50 msgr2=0x7f54cc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 shutdown_connections 2023-10-03T10:16:49.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.631+0000 7f54d1ad2700 1 -- 172.21.15.19:0/3173007439 wait complete. 2023-10-03T10:16:49.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:49.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:49.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.657+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f355006c360 con 0x7f35501b4f90 2023-10-03T10:16:49.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.658+0000 7f3545ffb700 1 -- 172.21.15.19:0/3161537499 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f354000fb00 con 0x7f35501b4f90 2023-10-03T10:16:49.659 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 msgr2=0x7f35501b5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 0x7f35501b5380 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f354000d7b0 tx=0x7f354000db70 comp rx=0 tx=0).stop 2023-10-03T10:16:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 shutdown_connections 2023-10-03T10:16:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35501c8a10 0x7f35501c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f353c004d90 0x7f35501b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 --2- 172.21.15.19:0/3161537499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35501b4f90 0x7f35501b5380 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 >> 172.21.15.19:0/3161537499 conn(0x7f3550066f50 msgr2=0x7f35500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 shutdown_connections 2023-10-03T10:16:49.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.660+0000 7f35578e4700 1 -- 172.21.15.19:0/3161537499 wait complete. 2023-10-03T10:16:49.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:49.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.728+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f52b0074ea0 con 0x7f52b009ac90 2023-10-03T10:16:49.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.729+0000 7f52ad7fa700 1 -- 172.21.15.19:0/1781610445 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f529c019300 con 0x7f52b009ac90 2023-10-03T10:16:49.730 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 msgr2=0x7f52b0136080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b0136080 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f529c00e9a0 tx=0x7f529c00ecb0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 shutdown_connections 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52b013d240 0x7f52b01365c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52b006c0e0 0x7f52b0135b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 --2- 172.21.15.19:0/1781610445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52b009ac90 0x7f52b0136080 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:49.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 >> 172.21.15.19:0/1781610445 conn(0x7f52b00a4210 msgr2=0x7f52b0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 shutdown_connections 2023-10-03T10:16:49.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:49.731+0000 7f52b6b01700 1 -- 172.21.15.19:0/1781610445 wait complete. 2023-10-03T10:16:49.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:50.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:50.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:50.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:50.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.808+0000 7feac8bfa700 1 Processor -- start 2023-10-03T10:16:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.808+0000 7feac8bfa700 1 -- start start 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feac41341d0 0x7feac409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac409e390 0x7feac409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feac4070c80 con 0x7feac41341d0 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac409ed20 con 0x7feac41338c0 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac8bfa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac406f720 con 0x7feac409e390 2023-10-03T10:16:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60378/0 (socket says 172.21.15.19:60378) 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 -- 172.21.15.19:0/3998767468 learned_addr learned my addr 172.21.15.19:0/3998767468 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 -- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac409e390 msgr2=0x7feac409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 --2- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac409e390 0x7feac409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 -- 172.21.15.19:0/3998767468 >> v2:172.21.15.19:3300/0 conn(0x7feac41341d0 msgr2=0x7feac409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 --2- 172.21.15.19:0/3998767468 >> v2:172.21.15.19:3300/0 conn(0x7feac41341d0 0x7feac409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.809+0000 7feac259c700 1 -- 172.21.15.19:0/3998767468 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac406fce0 con 0x7feac41338c0 2023-10-03T10:16:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7feac259c700 1 --2- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feab4009920 tx=0x7feab4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=552c5afad1621b85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 Processor -- start 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 -- start start 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb964133570 0x7fb964135950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb964135e90 0x7fb964138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96409c280 con 0x7fb9640954c0 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96409aaf0 con 0x7fb964135e90 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.810+0000 7fb96afe3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb96409b960 con 0x7fb964133570 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb964135e90 0x7fb964138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb964135e90 0x7fb964138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57644/0 (socket says 172.21.15.19:57644) 2023-10-03T10:16:50.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 -- 172.21.15.19:0/742940793 learned_addr learned my addr 172.21.15.19:0/742940793 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7feac159a700 1 -- 172.21.15.19:0/3998767468 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab400ba20 con 0x7feac41338c0 2023-10-03T10:16:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7feac159a700 1 -- 172.21.15.19:0/3998767468 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab400bb80 con 0x7feac41338c0 2023-10-03T10:16:50.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7feac159a700 1 -- 172.21.15.19:0/3998767468 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4009e70 con 0x7feac41338c0 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 -- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb964133570 msgr2=0x7fb964135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 --2- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb964133570 0x7fb964135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 -- 172.21.15.19:0/742940793 >> v1:172.21.15.19:6789/0 conn(0x7fb9640954c0 legacy=0x7fb964095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 -- 172.21.15.19:0/742940793 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96409a7b0 con 0x7fb964135e90 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb969580700 1 --2- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964135e90 0x7fb964138270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ad35131e3c610d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb9637fe700 1 -- 172.21.15.19:0/742940793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c00e070 con 0x7fb964135e90 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb9637fe700 1 -- 172.21.15.19:0/742940793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c003a20 con 0x7fb964135e90 2023-10-03T10:16:50.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.811+0000 7fb9637fe700 1 -- 172.21.15.19:0/742940793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c003dd0 con 0x7fb964135e90 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 -- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 msgr2=0x7feac4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 --2- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7feab4009920 tx=0x7feab4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 -- 172.21.15.19:0/3998767468 shutdown_connections 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 --2- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac41338c0 0x7feac4133c90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 --2- 172.21.15.19:0/3998767468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac409e390 0x7feac409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 --2- 172.21.15.19:0/3998767468 >> v2:172.21.15.19:3300/0 conn(0x7feac41341d0 0x7feac409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 -- 172.21.15.19:0/3998767468 >> 172.21.15.19:0/3998767468 conn(0x7feac40a2aa0 msgr2=0x7feac40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 -- 172.21.15.19:0/3998767468 shutdown_connections 2023-10-03T10:16:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7feac8bfa700 1 -- 172.21.15.19:0/3998767468 wait complete. 2023-10-03T10:16:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 -- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964135e90 msgr2=0x7fb964138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 --2- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964135e90 0x7fb964138270 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 -- 172.21.15.19:0/742940793 shutdown_connections 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 --2- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964135e90 0x7fb964138270 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 --2- 172.21.15.19:0/742940793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb964133570 0x7fb964135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 -- 172.21.15.19:0/742940793 >> 172.21.15.19:0/742940793 conn(0x7fb9640a2360 msgr2=0x7fb9640a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 -- 172.21.15.19:0/742940793 shutdown_connections 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.812+0000 7fb96afe3700 1 -- 172.21.15.19:0/742940793 wait complete. 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.813+0000 7feac8bfa700 1 Processor -- start 2023-10-03T10:16:50.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.813+0000 7feac8bfa700 1 -- start start 2023-10-03T10:16:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.813+0000 7fb96afe3700 1 Processor -- start 2023-10-03T10:16:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac41338c0 0x7feac411f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac41341d0 0x7feac411f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac41200f0 con 0x7feac41341d0 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feac4122770 con 0x7feac409e390 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac8bfa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feac412f750 con 0x7feac41338c0 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60392/0 (socket says 172.21.15.19:60392) 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 -- 172.21.15.19:0/1614735837 learned_addr learned my addr 172.21.15.19:0/1614735837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 -- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac41338c0 msgr2=0x7feac411f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac41338c0 0x7feac411f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 -- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac41341d0 msgr2=0x7feac411f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac41341d0 0x7feac411f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7feac259c700 1 -- 172.21.15.19:0/1614735837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009550 con 0x7feac409e390 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 -- start start 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9640954c0 0x7fb964071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964133570 0x7fb964071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9641316d0 con 0x7fb964133570 2023-10-03T10:16:50.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96409b000 con 0x7fb964135e90 2023-10-03T10:16:50.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.814+0000 7fb96afe3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb964094be0 con 0x7fb9640954c0 2023-10-03T10:16:50.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7feac259c700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feac412ffb0 tx=0x7feab4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60396/0 (socket says 172.21.15.19:60396) 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 -- 172.21.15.19:0/3721517341 learned_addr learned my addr 172.21.15.19:0/3721517341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 -- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9640954c0 msgr2=0x7fb964071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9640954c0 0x7fb964071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 -- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964133570 msgr2=0x7fb964071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964133570 0x7fb964071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 -- 172.21.15.19:0/3721517341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c009b30 con 0x7fb964135e90 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.815+0000 7fb969580700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb95c015040 tx=0x7fb95c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0044c0 con 0x7fb964135e90 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb964094e80 con 0x7fb964135e90 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb964130c60 con 0x7fb964135e90 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c004620 con 0x7fb964135e90 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab4004480 con 0x7feac409e390 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab401f070 con 0x7feac409e390 2023-10-03T10:16:50.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab40038e0 con 0x7feac409e390 2023-10-03T10:16:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.816+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c025450 con 0x7fb964135e90 2023-10-03T10:16:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.817+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac4120900 con 0x7feac409e390 2023-10-03T10:16:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.817+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac406f960 con 0x7feac409e390 2023-10-03T10:16:50.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.817+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9440052e0 con 0x7fb964135e90 2023-10-03T10:16:50.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.818+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feab4021030 con 0x7feac409e390 2023-10-03T10:16:50.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.818+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feac406e580 con 0x7feac409e390 2023-10-03T10:16:50.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.818+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feab4040c70 con 0x7feac409e390 2023-10-03T10:16:50.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.818+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb95c0255b0 con 0x7fb964135e90 2023-10-03T10:16:50.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.818+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb95c040ef0 con 0x7fb964135e90 2023-10-03T10:16:50.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.823+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb95c01b7b0 con 0x7fb964135e90 2023-10-03T10:16:50.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.828+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feab40239c0 con 0x7feac409e390 2023-10-03T10:16:50.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.851+0000 7f06aed95700 1 Processor -- start 2023-10-03T10:16:50.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.851+0000 7f06aed95700 1 -- start start 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06aed95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809e930 0x7f06a809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06aed95700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06a809f240 0x7f06a81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06aed95700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a8070940 con 0x7f06a809f650 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06aed95700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a806fd60 con 0x7f06a809f240 2023-10-03T10:16:50.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06aed95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a806fa80 con 0x7f06a809e930 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06a7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06a809f240 0x7f06a81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06a7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f06a809f240 0x7f06a81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57672/0 (socket says 172.21.15.19:57672) 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06a7fff700 1 -- 172.21.15.19:0/1433054854 learned_addr learned my addr 172.21.15.19:0/1433054854 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.852+0000 7f06acb31700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809e930 0x7f06a809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a7fff700 1 -- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809e930 msgr2=0x7f06a809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a7fff700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809e930 0x7f06a809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a7fff700 1 -- 172.21.15.19:0/1433054854 >> v1:172.21.15.19:6789/0 conn(0x7f06a809f650 legacy=0x7f06a8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a7fff700 1 -- 172.21.15.19:0/1433054854 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a809fb60 con 0x7f06a809f240 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a7fff700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81317f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f06940098f0 tx=0x7f0694009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61386f1ffb58f7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a77fe700 1 -- 172.21.15.19:0/1433054854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400b8a0 con 0x7f06a809f240 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a77fe700 1 -- 172.21.15.19:0/1433054854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400ba00 con 0x7f06a809f240 2023-10-03T10:16:50.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.853+0000 7f06a77fe700 1 -- 172.21.15.19:0/1433054854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400bd90 con 0x7f06a809f240 2023-10-03T10:16:50.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 -- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 msgr2=0x7f06a81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81317f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f06940098f0 tx=0x7f0694009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 -- 172.21.15.19:0/1433054854 shutdown_connections 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809e930 0x7f06a809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 --2- 172.21.15.19:0/1433054854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81317f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 -- 172.21.15.19:0/1433054854 >> 172.21.15.19:0/1433054854 conn(0x7f06a80a4210 msgr2=0x7f06a80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 -- 172.21.15.19:0/1433054854 shutdown_connections 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.854+0000 7f06aed95700 1 -- 172.21.15.19:0/1433054854 wait complete. 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.855+0000 7f06aed95700 1 Processor -- start 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.855+0000 7f06aed95700 1 -- start start 2023-10-03T10:16:50.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06a809e930 0x7f06a81a4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809f650 0x7f06a81a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a81a6590 con 0x7f06a809f240 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80a33d0 con 0x7f06a809e930 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06aed95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8071d20 con 0x7f06a809f650 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57682/0 (socket says 172.21.15.19:57682) 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 -- 172.21.15.19:0/2509583015 learned_addr learned my addr 172.21.15.19:0/2509583015 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06ad332700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809f650 0x7f06a81a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 -- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809f650 msgr2=0x7f06a81a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809f650 0x7f06a81a5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 -- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06a809e930 msgr2=0x7f06a81a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06a809e930 0x7f06a81a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.856+0000 7f06a7fff700 1 -- 172.21.15.19:0/2509583015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009550 con 0x7f06a809f240 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.857+0000 7f06a7fff700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0694000c00 tx=0x7f0694004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.857+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694004380 con 0x7f06a809f240 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.857+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069401f070 con 0x7f06a809f240 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.857+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a80a0190 con 0x7f06a809f240 2023-10-03T10:16:50.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.857+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940036a0 con 0x7f06a809f240 2023-10-03T10:16:50.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.858+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a81a6d10 con 0x7f06a809f240 2023-10-03T10:16:50.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.858+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0694021030 con 0x7f06a809f240 2023-10-03T10:16:50.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.858+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0694044070 con 0x7f06a809f240 2023-10-03T10:16:50.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.859+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a8074ea0 con 0x7f06a809f240 2023-10-03T10:16:50.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.864+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0694015070 con 0x7f06a809f240 2023-10-03T10:16:50.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 Processor -- start 2023-10-03T10:16:50.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 -- start start 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe4070ee0 con 0x7f3fe406e570 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4071980 con 0x7f3fe406f050 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.895+0000 7f3fe8cdb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4071480 con 0x7f3fe409eca0 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41676/0 (socket says 172.21.15.19:41676) 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 -- 172.21.15.19:0/3557683481 learned_addr learned my addr 172.21.15.19:0/3557683481 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe2d9d700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 -- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 msgr2=0x7f3fe413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 -- 172.21.15.19:0/3557683481 >> v1:172.21.15.19:6789/0 conn(0x7f3fe406e570 legacy=0x7f3fe406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe159a700 1 -- 172.21.15.19:0/3557683481 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305830102 0 0) 0x7f3fe4070ee0 con 0x7f3fe406e570 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 -- 172.21.15.19:0/3557683481 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4071b90 con 0x7f3fe409eca0 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe1d9b700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009920 tx=0x7f3fd8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6fd4f73e4f4759 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.896+0000 7f3fe159a700 1 -- 172.21.15.19:0/3557683481 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011830 con 0x7f3fe409eca0 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe159a700 1 -- 172.21.15.19:0/3557683481 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8011990 con 0x7f3fe409eca0 2023-10-03T10:16:50.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe159a700 1 -- 172.21.15.19:0/3557683481 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011d20 con 0x7f3fe409eca0 2023-10-03T10:16:50.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 msgr2=0x7f3fe413cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009920 tx=0x7f3fd8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3557683481 shutdown_connections 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3557683481 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe409eca0 0x7f3fe413cea0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3557683481 >> 172.21.15.19:0/3557683481 conn(0x7f3fe40a2aa0 msgr2=0x7f3fe40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.897+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3557683481 shutdown_connections 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.898+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3557683481 wait complete. 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 Processor -- start 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 -- start start 2023-10-03T10:16:50.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4138380 0x7f3fe413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe413e730 con 0x7f3fe4138380 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe412d560 con 0x7f3fe406f050 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe8cdb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe4070610 con 0x7f3fe406e570 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41680/0 (socket says 172.21.15.19:41680) 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe259c700 1 -- 172.21.15.19:0/3424962710 learned_addr learned my addr 172.21.15.19:0/3424962710 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:50.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.899+0000 7f3fe2d9d700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4138380 0x7f3fe413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe1d9b700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 -- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 msgr2=0x7f3fe413cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 -- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4138380 msgr2=0x7f3fe413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4138380 0x7f3fe413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 -- 172.21.15.19:0/3424962710 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8009550 con 0x7f3fe406e570 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe259c700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001eb0 tx=0x7f3fd400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40054e0 con 0x7f3fe406e570 2023-10-03T10:16:50.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd4003680 con 0x7f3fe406e570 2023-10-03T10:16:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd40039f0 con 0x7f3fe406e570 2023-10-03T10:16:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe412ceb0 con 0x7f3fe406e570 2023-10-03T10:16:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.900+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe412c9f0 con 0x7f3fe406e570 2023-10-03T10:16:50.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.902+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3fd4003b50 con 0x7f3fe406e570 2023-10-03T10:16:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.902+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4074ea0 con 0x7f3fe406e570 2023-10-03T10:16:50.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.902+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3fd403ea60 con 0x7f3fe406e570 2023-10-03T10:16:50.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:50.907+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3fd401b3b0 con 0x7f3fe406e570 2023-10-03T10:16:51.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.036+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb944005150 con 0x7fb964135e90 2023-10-03T10:16:51.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.036+0000 7fb9617fa700 1 -- 172.21.15.19:0/3721517341 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb95c017020 con 0x7fb964135e90 2023-10-03T10:16:51.037 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:51.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.038+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feac4074ea0 con 0x7feac409e390 2023-10-03T10:16:51.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.039+0000 7feab2ffd700 1 -- 172.21.15.19:0/1614735837 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feab40233d0 con 0x7feac409e390 2023-10-03T10:16:51.040 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:51.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.040+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 msgr2=0x7fb964071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.040+0000 7fb96afe3700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb95c015040 tx=0x7fb95c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 shutdown_connections 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb964135e90 0x7fb964071ab0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9640954c0 0x7fb964071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 --2- 172.21.15.19:0/3721517341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb964133570 0x7fb964071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 >> 172.21.15.19:0/3721517341 conn(0x7fb9640a2360 msgr2=0x7fb964133940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 shutdown_connections 2023-10-03T10:16:51.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.041+0000 7fb96afe3700 1 -- 172.21.15.19:0/3721517341 wait complete. 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 msgr2=0x7feac411ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7feac412ffb0 tx=0x7feab4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 shutdown_connections 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feac41341d0 0x7feac411f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feac409e390 0x7feac411ece0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 --2- 172.21.15.19:0/1614735837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feac41338c0 0x7feac411f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 >> 172.21.15.19:0/1614735837 conn(0x7feac40a2aa0 msgr2=0x7feac409ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 shutdown_connections 2023-10-03T10:16:51.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.042+0000 7feac8bfa700 1 -- 172.21.15.19:0/1614735837 wait complete. 2023-10-03T10:16:51.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:51.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.075+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f06a806b250 con 0x7f06a809f240 2023-10-03T10:16:51.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.076+0000 7f06a57fa700 1 -- 172.21.15.19:0/2509583015 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0694015020 con 0x7f06a809f240 2023-10-03T10:16:51.077 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 msgr2=0x7f06a81a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0694000c00 tx=0x7f0694004750 comp rx=0 tx=0).stop 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 shutdown_connections 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f06a809f650 0x7f06a81a5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f06a809e930 0x7f06a81a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 --2- 172.21.15.19:0/2509583015 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f06a809f240 0x7f06a81a4ec0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 >> 172.21.15.19:0/2509583015 conn(0x7f06a80a4210 msgr2=0x7f06a806c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 shutdown_connections 2023-10-03T10:16:51.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.078+0000 7f06aed95700 1 -- 172.21.15.19:0/2509583015 wait complete. 2023-10-03T10:16:51.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.118+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3fe412da60 con 0x7f3fe406e570 2023-10-03T10:16:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.119+0000 7f3fd2ffd700 1 -- 172.21.15.19:0/3424962710 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3fd4017030 con 0x7f3fe406e570 2023-10-03T10:16:51.120 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 msgr2=0x7f3fe413ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4001eb0 tx=0x7f3fd400c800 comp rx=0 tx=0).stop 2023-10-03T10:16:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 shutdown_connections 2023-10-03T10:16:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3fe4138380 0x7f3fe413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3fe406e570 0x7f3fe413ca90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 --2- 172.21.15.19:0/3424962710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3fe406f050 0x7f3fe413cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:51.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 >> 172.21.15.19:0/3424962710 conn(0x7f3fe40a2aa0 msgr2=0x7f3fe409ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:51.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 shutdown_connections 2023-10-03T10:16:51.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:51.121+0000 7f3fe8cdb700 1 -- 172.21.15.19:0/3424962710 wait complete. 2023-10-03T10:16:51.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:52.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:52.064 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:52.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:52.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:52.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 Processor -- start 2023-10-03T10:16:52.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 -- start start 2023-10-03T10:16:52.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 0x7fe58c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c070ee0 con 0x7fe58c09eca0 2023-10-03T10:16:52.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c071480 con 0x7fe58c06ee80 2023-10-03T10:16:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.217+0000 7fe5917ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c071b90 con 0x7fe58c06e570 2023-10-03T10:16:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60422/0 (socket says 172.21.15.19:60422) 2023-10-03T10:16:52.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 -- 172.21.15.19:0/2814737461 learned_addr learned my addr 172.21.15.19:0/2814737461 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58b7fe700 1 --2- 172.21.15.19:0/2814737461 >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 0x7fe58c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 -- 172.21.15.19:0/2814737461 >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 msgr2=0x7fe58c134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 --2- 172.21.15.19:0/2814737461 >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 0x7fe58c134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 -- 172.21.15.19:0/2814737461 >> v1:172.21.15.19:6789/0 conn(0x7fe58c09eca0 legacy=0x7fe58c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 -- 172.21.15.19:0/2814737461 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c0711a0 con 0x7fe58c06e570 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe589ffb700 1 -- 172.21.15.19:0/2814737461 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404199215 0 0) 0x7fe58c070ee0 con 0x7fe58c09eca0 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58b7fe700 1 --2- 172.21.15.19:0/2814737461 >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 0x7fe58c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7f475ec13700 1 Processor -- start 2023-10-03T10:16:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.218+0000 7fe58affd700 1 --2- 172.21.15.19:0/2814737461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098f0 tx=0x7fe57c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a92379920b80c31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 -- start start 2023-10-03T10:16:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7fe589ffb700 1 -- 172.21.15.19:0/2814737461 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011830 con 0x7fe58c06e570 2023-10-03T10:16:52.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7fe589ffb700 1 -- 172.21.15.19:0/2814737461 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c011990 con 0x7fe58c06e570 2023-10-03T10:16:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f4758138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4758139170 0x7f475813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475809b120 con 0x7f475809d6f0 2023-10-03T10:16:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475806b460 con 0x7f4758139170 2023-10-03T10:16:52.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f475ec13700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475809a7e0 con 0x7f475809e1d0 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f4757fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f4758138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f4757fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f4758138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41696/0 (socket says 172.21.15.19:41696) 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7f4757fff700 1 -- 172.21.15.19:0/3061907391 learned_addr learned my addr 172.21.15.19:0/3061907391 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 --2- 172.21.15.19:0/3061907391 >> v2:172.21.15.19:3300/0 conn(0x7f4758139170 0x7f475813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.219+0000 7fe589ffb700 1 -- 172.21.15.19:0/2814737461 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011d20 con 0x7fe58c06e570 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 -- 172.21.15.19:0/2814737461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 msgr2=0x7fe58c06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 --2- 172.21.15.19:0/2814737461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098f0 tx=0x7fe57c009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 -- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 msgr2=0x7f4758138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 --2- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f4758138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 -- 172.21.15.19:0/3061907391 >> v1:172.21.15.19:6789/0 conn(0x7f475809d6f0 legacy=0x7f475809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 -- 172.21.15.19:0/3061907391 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475809a500 con 0x7f4758139170 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 -- 172.21.15.19:0/2814737461 shutdown_connections 2023-10-03T10:16:52.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 --2- 172.21.15.19:0/2814737461 >> v2:172.21.15.19:3300/0 conn(0x7fe58c06ee80 0x7fe58c134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 --2- 172.21.15.19:0/2814737461 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06e570 0x7fe58c06e940 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 -- 172.21.15.19:0/2814737461 >> 172.21.15.19:0/2814737461 conn(0x7fe58c0a2aa0 msgr2=0x7fe58c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 -- 172.21.15.19:0/2814737461 shutdown_connections 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7fe5917ea700 1 -- 172.21.15.19:0/2814737461 wait complete. 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.220+0000 7f475d1b0700 1 --2- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475813b550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4750009d90 tx=0x7f475000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242daad8d3a0d47d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.221+0000 7f47577fe700 1 -- 172.21.15.19:0/3061907391 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475000e070 con 0x7f4758139170 2023-10-03T10:16:52.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.221+0000 7f47577fe700 1 -- 172.21.15.19:0/3061907391 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750003a20 con 0x7f4758139170 2023-10-03T10:16:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.221+0000 7f47577fe700 1 -- 172.21.15.19:0/3061907391 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750003dd0 con 0x7f4758139170 2023-10-03T10:16:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 Processor -- start 2023-10-03T10:16:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 -- start start 2023-10-03T10:16:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 0x7fe58c134c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe58c133410 0x7fe58c133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c09e900 con 0x7fe58c06e570 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c135650 con 0x7fe58c06ee80 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe5917ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c070610 con 0x7fe58c133410 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7f475ec13700 1 -- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 msgr2=0x7f475813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7f475ec13700 1 --2- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475813b550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4750009d90 tx=0x7f475000b330 comp rx=0 tx=0).stop 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe58affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe58affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57718/0 (socket says 172.21.15.19:57718) 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe58a7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 0x7fe58c134c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7fe58affd700 1 -- 172.21.15.19:0/3344236670 learned_addr learned my addr 172.21.15.19:0/3344236670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7f475ec13700 1 -- 172.21.15.19:0/3061907391 shutdown_connections 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7f475ec13700 1 --2- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475813b550 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.222+0000 7f475ec13700 1 --2- 172.21.15.19:0/3061907391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f4758138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7f475ec13700 1 -- 172.21.15.19:0/3061907391 >> 172.21.15.19:0/3061907391 conn(0x7f4758066f50 msgr2=0x7f475809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58b7fe700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe58c133410 0x7fe58c133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7f475ec13700 1 -- 172.21.15.19:0/3061907391 shutdown_connections 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 -- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe58c133410 msgr2=0x7fe58c133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe58c133410 0x7fe58c133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 -- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 msgr2=0x7fe58c134750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 -- 172.21.15.19:0/3344236670 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584009a70 con 0x7fe58c06ee80 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58affd700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7f475ec13700 1 -- 172.21.15.19:0/3061907391 wait complete. 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.223+0000 7fe58a7fc700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 0x7fe58c134c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe58c070e10 tx=0x7fe58000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800054e0 con 0x7fe58c06ee80 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c009550 con 0x7fe58c06ee80 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58000ce60 con 0x7fe58c06ee80 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5800038c0 con 0x7fe58c06ee80 2023-10-03T10:16:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c13a440 con 0x7fe58c06ee80 2023-10-03T10:16:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.224+0000 7f475ec13700 1 Processor -- start 2023-10-03T10:16:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.225+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe580003a20 con 0x7fe58c06ee80 2023-10-03T10:16:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.225+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe58003e9b0 con 0x7fe58c06ee80 2023-10-03T10:16:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.225+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c0052e0 con 0x7fe58c06ee80 2023-10-03T10:16:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.225+0000 7f475ec13700 1 -- start start 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 0x7f475811c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f475811c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475811cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475811fa30 con 0x7f4758139170 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475811f520 con 0x7f475809d6f0 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f475ec13700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f475811e3b0 con 0x7f475809e1d0 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.226+0000 7f4757fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f475811c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475c9af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 0x7f475811c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f4757fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f475811c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41714/0 (socket says 172.21.15.19:41714) 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f4757fff700 1 -- 172.21.15.19:0/277957556 learned_addr learned my addr 172.21.15.19:0/277957556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475c9af700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 0x7f475811c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60432/0 (socket says 172.21.15.19:60432) 2023-10-03T10:16:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475811cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 -- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 msgr2=0x7f475811c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f475811c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 -- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 msgr2=0x7f475811c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 0x7f475811c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 -- 172.21.15.19:0/277957556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750009a70 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f475d1b0700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475811cbc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4750015000 tx=0x7f4750004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.227+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750009410 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.228+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750004540 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.228+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500048f0 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.228+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758072250 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.228+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475809c710 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.229+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4750012430 con 0x7f4758139170 2023-10-03T10:16:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.229+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47500412b0 con 0x7f4758139170 2023-10-03T10:16:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.229+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758071ec0 con 0x7f4758139170 2023-10-03T10:16:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.234+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe580017020 con 0x7fe58c06ee80 2023-10-03T10:16:52.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.238+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f475002d940 con 0x7f4758139170 2023-10-03T10:16:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.268+0000 7fe83433d700 1 Processor -- start 2023-10-03T10:16:52.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.268+0000 7fe83433d700 1 -- start start 2023-10-03T10:16:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe83433d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 0x7fe82c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe83433d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe83433d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe82c09edd0 con 0x7fe82c0a0a30 2023-10-03T10:16:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe83433d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c0a18e0 con 0x7fe82c139250 2023-10-03T10:16:52.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe83433d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c09e1f0 con 0x7fe82c0a1510 2023-10-03T10:16:52.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe8320d9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe82c0a0a30 0x7fe82c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45274/0 (socket says 172.21.15.19:45274) 2023-10-03T10:16:52.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe8320d9700 1 -- 172.21.15.19:0/509453507 learned_addr learned my addr 172.21.15.19:0/509453507 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:52.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe8318d8700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 0x7fe82c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.269+0000 7fe8328da700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8310d7700 1 -- 172.21.15.19:0/509453507 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781991084 0 0) 0x7fe82c09edd0 con 0x7fe82c0a0a30 2023-10-03T10:16:52.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8310d7700 1 -- 172.21.15.19:0/509453507 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8180035b0 con 0x7fe82c0a0a30 2023-10-03T10:16:52.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8318d8700 1 -- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 msgr2=0x7fe82c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8318d8700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8318d8700 1 -- 172.21.15.19:0/509453507 >> v1:172.21.15.19:6789/0 conn(0x7fe82c0a0a30 legacy=0x7fe82c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8318d8700 1 -- 172.21.15.19:0/509453507 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c09dc50 con 0x7fe82c0a1510 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8318d8700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 0x7fe82c138d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b1a5bb832c976b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8310d7700 1 -- 172.21.15.19:0/509453507 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c011830 con 0x7fe82c0a1510 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8310d7700 1 -- 172.21.15.19:0/509453507 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c011990 con 0x7fe82c0a1510 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.270+0000 7fe8310d7700 1 -- 172.21.15.19:0/509453507 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c011d20 con 0x7fe82c0a1510 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 -- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 msgr2=0x7fe82c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 0x7fe82c138d10 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009870 tx=0x7fe81c009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 -- 172.21.15.19:0/509453507 shutdown_connections 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 --2- 172.21.15.19:0/509453507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a1510 0x7fe82c138d10 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 -- 172.21.15.19:0/509453507 >> 172.21.15.19:0/509453507 conn(0x7fe82c0a6550 msgr2=0x7fe82c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 -- 172.21.15.19:0/509453507 shutdown_connections 2023-10-03T10:16:52.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.271+0000 7fe83433d700 1 -- 172.21.15.19:0/509453507 wait complete. 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 Processor -- start 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 -- start start 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 0x7fe82c122740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 0x7fe82c122c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c1231c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c125ff0 con 0x7fe82c0a1510 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c125980 con 0x7fe82c139250 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.273+0000 7fe83433d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe82c1261f0 con 0x7fe82c0a0a30 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8320d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 0x7fe82c122740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8318d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 0x7fe82c122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8320d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 0x7fe82c122740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41736/0 (socket says 172.21.15.19:41736) 2023-10-03T10:16:52.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8318d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 0x7fe82c122c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57726/0 (socket says 172.21.15.19:57726) 2023-10-03T10:16:52.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8320d9700 1 -- 172.21.15.19:0/1024898235 learned_addr learned my addr 172.21.15.19:0/1024898235 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c1231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 -- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 msgr2=0x7fe82c122740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 0x7fe82c122740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 -- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 msgr2=0x7fe82c122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 0x7fe82c122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.274+0000 7fe8328da700 1 -- 172.21.15.19:0/1024898235 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0094a0 con 0x7fe82c139250 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe8328da700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c1231c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe82400efc0 tx=0x7fe82400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82400cc90 con 0x7fe82c139250 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c0a0220 con 0x7fe82c139250 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82400f040 con 0x7fe82c139250 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8240146c0 con 0x7fe82c139250 2023-10-03T10:16:52.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.275+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82c124ad0 con 0x7fe82c139250 2023-10-03T10:16:52.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.276+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe824014820 con 0x7fe82c139250 2023-10-03T10:16:52.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.276+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe824040310 con 0x7fe82c139250 2023-10-03T10:16:52.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.276+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe82c074ea0 con 0x7fe82c139250 2023-10-03T10:16:52.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.286+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe824009e60 con 0x7fe82c139250 2023-10-03T10:16:52.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.302+0000 7fe258b2a700 1 Processor -- start 2023-10-03T10:16:52.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.302+0000 7fe258b2a700 1 -- start start 2023-10-03T10:16:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe258b2a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe25409d6f0 0x7fe25409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe258b2a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe258b2a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe25409b120 con 0x7fe25409e410 2023-10-03T10:16:52.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe258b2a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25406b460 con 0x7fe25409d6f0 2023-10-03T10:16:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe258b2a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe25409a7e0 con 0x7fe25409e000 2023-10-03T10:16:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe251d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe251d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41738/0 (socket says 172.21.15.19:41738) 2023-10-03T10:16:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe251d9b700 1 -- 172.21.15.19:0/591648517 learned_addr learned my addr 172.21.15.19:0/591648517 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.303+0000 7fe25259c700 1 --2- 172.21.15.19:0/591648517 >> v2:172.21.15.19:3300/0 conn(0x7fe25409d6f0 0x7fe25409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe251d9b700 1 -- 172.21.15.19:0/591648517 >> v2:172.21.15.19:3300/0 conn(0x7fe25409d6f0 msgr2=0x7fe25409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe251d9b700 1 --2- 172.21.15.19:0/591648517 >> v2:172.21.15.19:3300/0 conn(0x7fe25409d6f0 0x7fe25409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe251d9b700 1 -- 172.21.15.19:0/591648517 >> v1:172.21.15.19:6789/0 conn(0x7fe25409e410 legacy=0x7fe254133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe251d9b700 1 -- 172.21.15.19:0/591648517 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25409a500 con 0x7fe25409e000 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe251d9b700 1 --2- 172.21.15.19:0/591648517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe248009920 tx=0x7fe248009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52513e675e6c5b74 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe25159a700 1 -- 172.21.15.19:0/591648517 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248011830 con 0x7fe25409e000 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe25159a700 1 -- 172.21.15.19:0/591648517 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe248011990 con 0x7fe25409e000 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.304+0000 7fe25159a700 1 -- 172.21.15.19:0/591648517 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248011d20 con 0x7fe25409e000 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 -- 172.21.15.19:0/591648517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 msgr2=0x7fe2541339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 --2- 172.21.15.19:0/591648517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe248009920 tx=0x7fe248009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 -- 172.21.15.19:0/591648517 shutdown_connections 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 --2- 172.21.15.19:0/591648517 >> v2:172.21.15.19:3300/0 conn(0x7fe25409d6f0 0x7fe25409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 --2- 172.21.15.19:0/591648517 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409e000 0x7fe2541339f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 -- 172.21.15.19:0/591648517 >> 172.21.15.19:0/591648517 conn(0x7fe254066f50 msgr2=0x7fe25409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 -- 172.21.15.19:0/591648517 shutdown_connections 2023-10-03T10:16:52.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.305+0000 7fe258b2a700 1 -- 172.21.15.19:0/591648517 wait complete. 2023-10-03T10:16:52.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.307+0000 7fe258b2a700 1 Processor -- start 2023-10-03T10:16:52.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.307+0000 7fe258b2a700 1 -- start start 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.307+0000 7fe258b2a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 0x7fe2541a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.307+0000 7fe258b2a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe25409e000 0x7fe2541a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.307+0000 7fe258b2a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe258b2a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541a8e70 con 0x7fe25409e410 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe258b2a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541a98c0 con 0x7fe25409e000 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe258b2a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2541a7450 con 0x7fe25409d6f0 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57742/0 (socket says 172.21.15.19:57742) 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 -- 172.21.15.19:0/3298474729 learned_addr learned my addr 172.21.15.19:0/3298474729 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe25259c700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 0x7fe2541a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe251d9b700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe25409e000 0x7fe2541a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 -- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 msgr2=0x7fe2541a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 0x7fe2541a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 -- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe25409e000 msgr2=0x7fe2541a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe25409e000 0x7fe2541a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 -- 172.21.15.19:0/3298474729 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009550 con 0x7fe25409e410 2023-10-03T10:16:52.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe25259c700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 0x7fe2541a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:52.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.308+0000 7fe252d9d700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cc50 tx=0x7fe24c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:52.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.309+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c003c00 con 0x7fe25409e410 2023-10-03T10:16:52.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.309+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c003d60 con 0x7fe25409e410 2023-10-03T10:16:52.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.309+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2541a89b0 con 0x7fe25409e410 2023-10-03T10:16:52.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.309+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00aab0 con 0x7fe25409e410 2023-10-03T10:16:52.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.309+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2540a3180 con 0x7fe25409e410 2023-10-03T10:16:52.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.310+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25409c770 con 0x7fe25409e410 2023-10-03T10:16:52.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.310+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe24c00ac10 con 0x7fe25409e410 2023-10-03T10:16:52.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.310+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe24c0405a0 con 0x7fe25409e410 2023-10-03T10:16:52.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.315+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe24c0198f0 con 0x7fe25409e410 2023-10-03T10:16:52.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.449+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47581252c0 con 0x7f4758139170 2023-10-03T10:16:52.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.449+0000 7f47557fa700 1 -- 172.21.15.19:0/277957556 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f475002d350 con 0x7f4758139170 2023-10-03T10:16:52.450 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.452+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 msgr2=0x7f475811cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.452+0000 7f475ec13700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475811cbc0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f4750015000 tx=0x7f4750004ad0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 shutdown_connections 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4758139170 0x7f475811cbc0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f475809d6f0 0x7f475811c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 --2- 172.21.15.19:0/277957556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f475809e1d0 0x7f475811c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 >> 172.21.15.19:0/277957556 conn(0x7f4758066f50 msgr2=0x7f475806f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 shutdown_connections 2023-10-03T10:16:52.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.453+0000 7f475ec13700 1 -- 172.21.15.19:0/277957556 wait complete. 2023-10-03T10:16:52.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:52.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.494+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe56c005590 con 0x7fe58c06ee80 2023-10-03T10:16:52.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.494+0000 7fe5737fe700 1 -- 172.21.15.19:0/3344236670 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe58001c440 con 0x7fe58c06ee80 2023-10-03T10:16:52.495 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.497+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 msgr2=0x7fe58c134c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.497+0000 7fe5917ea700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 0x7fe58c134c90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe58c070e10 tx=0x7fe58000c800 comp rx=0 tx=0).stop 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 shutdown_connections 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe58c133410 0x7fe58c133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe58c06e570 0x7fe58c134750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 --2- 172.21.15.19:0/3344236670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe58c06ee80 0x7fe58c134c90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 >> 172.21.15.19:0/3344236670 conn(0x7fe58c0a2aa0 msgr2=0x7fe58c0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 shutdown_connections 2023-10-03T10:16:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.498+0000 7fe5917ea700 1 -- 172.21.15.19:0/3344236670 wait complete. 2023-10-03T10:16:52.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.518+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe82c0a28e0 con 0x7fe82c139250 2023-10-03T10:16:52.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.518+0000 7fe822ffd700 1 -- 172.21.15.19:0/1024898235 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe824007330 con 0x7fe82c139250 2023-10-03T10:16:52.519 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.520+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 msgr2=0x7fe82c1231c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.520+0000 7fe83433d700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c1231c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe82400efc0 tx=0x7fe82400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 shutdown_connections 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe82c139250 0x7fe82c1231c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe82c0a0a30 0x7fe82c122740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 --2- 172.21.15.19:0/1024898235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe82c0a1510 0x7fe82c122c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 >> 172.21.15.19:0/1024898235 conn(0x7fe82c0a6550 msgr2=0x7fe82c09ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 shutdown_connections 2023-10-03T10:16:52.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.521+0000 7fe83433d700 1 -- 172.21.15.19:0/1024898235 wait complete. 2023-10-03T10:16:52.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.527+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe254074ea0 con 0x7fe25409e410 2023-10-03T10:16:52.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.527+0000 7fe242ffd700 1 -- 172.21.15.19:0/3298474729 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe24c011380 con 0x7fe25409e410 2023-10-03T10:16:52.528 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:52.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 msgr2=0x7fe2541a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cc50 tx=0x7fe24c00cf60 comp rx=0 tx=0).stop 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 shutdown_connections 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe25409e410 0x7fe2541a6ab0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe25409d6f0 0x7fe2541a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 --2- 172.21.15.19:0/3298474729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe25409e000 0x7fe2541a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.529+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 >> 172.21.15.19:0/3298474729 conn(0x7fe254066f50 msgr2=0x7fe2540a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.530+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 shutdown_connections 2023-10-03T10:16:52.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:52.530+0000 7fe258b2a700 1 -- 172.21.15.19:0/3298474729 wait complete. 2023-10-03T10:16:52.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:52.544 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:53.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:53.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:53.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:53.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:53.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.645+0000 7f7c9eedb700 1 Processor -- start 2023-10-03T10:16:53.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.645+0000 7f7c9eedb700 1 -- start start 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9806b460 con 0x7f7c9809e410 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9809b120 con 0x7f7c9809e000 2023-10-03T10:16:53.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9eedb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9809a7e0 con 0x7f7c9809d6f0 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9cc77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9d478700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9cc77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41750/0 (socket says 172.21.15.19:41750) 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9d478700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57746/0 (socket says 172.21.15.19:57746) 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c9cc77700 1 -- 172.21.15.19:0/1900644319 learned_addr learned my addr 172.21.15.19:0/1900644319 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.646+0000 7f7c97fff700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 -- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 msgr2=0x7f7c981339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 -- 172.21.15.19:0/1900644319 >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 msgr2=0x7f7c98133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 --2- 172.21.15.19:0/1900644319 >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 -- 172.21.15.19:0/1900644319 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9809a500 con 0x7f7c9809d6f0 2023-10-03T10:16:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c97fff700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9d478700 1 --2- 172.21.15.19:0/1900644319 >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c9cc77700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009920 tx=0x7f7c8c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd6b7acac0f5fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c977fe700 1 -- 172.21.15.19:0/1900644319 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011830 con 0x7f7c9809d6f0 2023-10-03T10:16:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c977fe700 1 -- 172.21.15.19:0/1900644319 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c011990 con 0x7f7c9809d6f0 2023-10-03T10:16:53.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.647+0000 7f7c977fe700 1 -- 172.21.15.19:0/1900644319 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c011d20 con 0x7f7c9809d6f0 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 -- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 msgr2=0x7f7c9809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009920 tx=0x7f7c8c009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 -- 172.21.15.19:0/1900644319 shutdown_connections 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/1900644319 >> v2:172.21.15.19:3300/0 conn(0x7f7c9809e410 0x7f7c98133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c9809dac0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/1900644319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 -- 172.21.15.19:0/1900644319 >> 172.21.15.19:0/1900644319 conn(0x7f7c98066f50 msgr2=0x7f7c9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 -- 172.21.15.19:0/1900644319 shutdown_connections 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.648+0000 7f7c9eedb700 1 -- 172.21.15.19:0/1900644319 wait complete. 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.649+0000 7f7c9eedb700 1 Processor -- start 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 -- start start 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c981a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981a6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 0x7f7c981a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c981a9170 con 0x7f7c9809e410 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c981a7a90 con 0x7f7c9809e000 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9eedb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c981a9620 con 0x7f7c9809d6f0 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9cc77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c981a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9d478700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 0x7f7c981a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9cc77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c981a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41764/0 (socket says 172.21.15.19:41764) 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.650+0000 7f7c9cc77700 1 -- 172.21.15.19:0/3226642682 learned_addr learned my addr 172.21.15.19:0/3226642682 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 -- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 msgr2=0x7f7c981a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c981a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c97fff700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981a6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 -- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 msgr2=0x7f7c981a6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981a6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 -- 172.21.15.19:0/3226642682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c840094a0 con 0x7f7c9809e410 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c97fff700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9d478700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 0x7f7c981a68b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000ef90 tx=0x7f7c9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9000cd40 con 0x7f7c9809e410 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9000f040 con 0x7f7c9809e410 2023-10-03T10:16:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c90009a70 con 0x7f7c9809e410 2023-10-03T10:16:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c900146c0 con 0x7f7c9809e410 2023-10-03T10:16:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.651+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8c009550 con 0x7f7c9809e410 2023-10-03T10:16:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.652+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c90014820 con 0x7f7c9809e410 2023-10-03T10:16:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.652+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c90040360 con 0x7f7c9809e410 2023-10-03T10:16:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.654+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c98074ea0 con 0x7f7c9809e410 2023-10-03T10:16:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.664+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c90018020 con 0x7f7c9809e410 2023-10-03T10:16:53.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.679+0000 7f28dc6f9700 1 Processor -- start 2023-10-03T10:16:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.679+0000 7f28dc6f9700 1 -- start start 2023-10-03T10:16:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28dc6f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28dc6f9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 0x7f28d4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28dc6f9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d409f130 con 0x7f28d409e410 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28dc6f9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d409f520 con 0x7f28d409e000 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28dc6f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28d409e930 con 0x7f28d409d6f0 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41774/0 (socket says 172.21.15.19:41774) 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 -- 172.21.15.19:0/643578181 learned_addr learned my addr 172.21.15.19:0/643578181 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28d9c94700 1 --2- 172.21.15.19:0/643578181 >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 0x7f28d4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 -- 172.21.15.19:0/643578181 >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 msgr2=0x7f28d4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 --2- 172.21.15.19:0/643578181 >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 0x7f28d4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 -- 172.21.15.19:0/643578181 >> v1:172.21.15.19:6789/0 conn(0x7f28d409e410 legacy=0x7f28d4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28da495700 1 -- 172.21.15.19:0/643578181 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d409b2d0 con 0x7f28d409d6f0 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.680+0000 7f28d9c94700 1 --2- 172.21.15.19:0/643578181 >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 0x7f28d4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:53.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.681+0000 7f28da495700 1 --2- 172.21.15.19:0/643578181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f28d000bb90 tx=0x7f28d000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0df4e52e5a4e634 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.681+0000 7f28d9493700 1 -- 172.21.15.19:0/643578181 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d000dd50 con 0x7f28d409d6f0 2023-10-03T10:16:53.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.681+0000 7f28d9493700 1 -- 172.21.15.19:0/643578181 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0010470 con 0x7f28d409d6f0 2023-10-03T10:16:53.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.681+0000 7f28d9493700 1 -- 172.21.15.19:0/643578181 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0010800 con 0x7f28d409d6f0 2023-10-03T10:16:53.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 -- 172.21.15.19:0/643578181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 msgr2=0x7f28d409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/643578181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f28d000bb90 tx=0x7f28d000bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 -- 172.21.15.19:0/643578181 shutdown_connections 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/643578181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409d6f0 0x7f28d409dac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/643578181 >> v2:172.21.15.19:3300/0 conn(0x7f28d409e000 0x7f28d4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.682+0000 7f28dc6f9700 1 -- 172.21.15.19:0/643578181 >> 172.21.15.19:0/643578181 conn(0x7f28d4066f50 msgr2=0x7f28d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.684+0000 7f28dc6f9700 1 -- 172.21.15.19:0/643578181 shutdown_connections 2023-10-03T10:16:53.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.684+0000 7f28dc6f9700 1 -- 172.21.15.19:0/643578181 wait complete. 2023-10-03T10:16:53.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 Processor -- start 2023-10-03T10:16:53.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 -- start start 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28d409e000 0x7f28d41b7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41b9720 con 0x7f28d409d6f0 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40a1d00 con 0x7f28d409e000 2023-10-03T10:16:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dc6f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41bbba0 con 0x7f28d409e410 2023-10-03T10:16:53.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28da495700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dac96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28da495700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57764/0 (socket says 172.21.15.19:57764) 2023-10-03T10:16:53.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28da495700 1 -- 172.21.15.19:0/477700523 learned_addr learned my addr 172.21.15.19:0/477700523 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.685+0000 7f28dac96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41780/0 (socket says 172.21.15.19:41780) 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28d9c94700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28d409e000 0x7f28d41b7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 -- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28d409e000 msgr2=0x7f28d41b7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28d409e000 0x7f28d41b7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 -- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 msgr2=0x7f28d41b7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 -- 172.21.15.19:0/477700523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d000b7f0 con 0x7f28d409e410 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28da495700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dac96700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00cb90 tx=0x7f28cc00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc003c00 con 0x7f28d409e410 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28cc003d60 con 0x7f28d409e410 2023-10-03T10:16:53.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.686+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d41b9150 con 0x7f28d409e410 2023-10-03T10:16:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.687+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d41bb750 con 0x7f28d409e410 2023-10-03T10:16:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.687+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc00aa60 con 0x7f28d409e410 2023-10-03T10:16:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.689+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28cc00abc0 con 0x7f28d409e410 2023-10-03T10:16:53.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.689+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28cc03f5f0 con 0x7f28d409e410 2023-10-03T10:16:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.689+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc0052e0 con 0x7f28d409e410 2023-10-03T10:16:53.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.698+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28cc0198f0 con 0x7f28d409e410 2023-10-03T10:16:53.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.716+0000 7fd8e8e49700 1 Processor -- start 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.716+0000 7fd8e8e49700 1 -- start start 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e8e49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e8e49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 0x7fd8e413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e8e49700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e40a2a70 con 0x7fd8e40a0a30 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e8e49700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e40a01d0 con 0x7fd8e409d630 2023-10-03T10:16:53.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e8e49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e409e2b0 con 0x7fd8e4138d80 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57774/0 (socket says 172.21.15.19:57774) 2023-10-03T10:16:53.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e1d9b700 1 -- 172.21.15.19:0/554496358 learned_addr learned my addr 172.21.15.19:0/554496358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e259c700 1 --1- 172.21.15.19:0/554496358 >> v1:172.21.15.19:6789/0 conn(0x7fd8e40a0a30 0x7fd8e40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45314/0 (socket says 172.21.15.19:45314) 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.717+0000 7fd8e2d9d700 1 --2- 172.21.15.19:0/554496358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 0x7fd8e413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e2d9d700 1 -- 172.21.15.19:0/554496358 >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 msgr2=0x7fd8e40a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e2d9d700 1 --2- 172.21.15.19:0/554496358 >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e2d9d700 1 -- 172.21.15.19:0/554496358 >> v1:172.21.15.19:6789/0 conn(0x7fd8e40a0a30 legacy=0x7fd8e40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e2d9d700 1 -- 172.21.15.19:0/554496358 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e409dc50 con 0x7fd8e4138d80 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e159a700 1 -- 172.21.15.19:0/554496358 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126786993 0 0) 0x7fd8e40a2a70 con 0x7fd8e40a0a30 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e1d9b700 1 --2- 172.21.15.19:0/554496358 >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e2d9d700 1 --2- 172.21.15.19:0/554496358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 0x7fd8e413b160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009d90 tx=0x7fd8dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284b9cd3d71c3c44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e159a700 1 -- 172.21.15.19:0/554496358 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc00e070 con 0x7fd8e4138d80 2023-10-03T10:16:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e159a700 1 -- 172.21.15.19:0/554496358 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8dc00bb20 con 0x7fd8e4138d80 2023-10-03T10:16:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.718+0000 7fd8e159a700 1 -- 172.21.15.19:0/554496358 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8dc012430 con 0x7fd8e4138d80 2023-10-03T10:16:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.719+0000 7fd8e8e49700 1 -- 172.21.15.19:0/554496358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 msgr2=0x7fd8e413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.719+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/554496358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 0x7fd8e413b160 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd8dc009d90 tx=0x7fd8dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 -- 172.21.15.19:0/554496358 shutdown_connections 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/554496358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e4138d80 0x7fd8e413b160 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/554496358 >> v2:172.21.15.19:3300/0 conn(0x7fd8e409d630 0x7fd8e40a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 -- 172.21.15.19:0/554496358 >> 172.21.15.19:0/554496358 conn(0x7fd8e40a3050 msgr2=0x7fd8e40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 -- 172.21.15.19:0/554496358 shutdown_connections 2023-10-03T10:16:53.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.722+0000 7fd8e8e49700 1 -- 172.21.15.19:0/554496358 wait complete. 2023-10-03T10:16:53.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.723+0000 7fd8e8e49700 1 Processor -- start 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.723+0000 7fd8e8e49700 1 -- start start 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 0x7fd8e411c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 0x7fd8e411d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e411ee10 con 0x7fd8e4138d80 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e412efe0 con 0x7fd8e40a0a30 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e8e49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40a0410 con 0x7fd8e409d630 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60526/0 (socket says 172.21.15.19:60526) 2023-10-03T10:16:53.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e1d9b700 1 -- 172.21.15.19:0/3621751077 learned_addr learned my addr 172.21.15.19:0/3621751077 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e259c700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 0x7fd8e411c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e2d9d700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 0x7fd8e411d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.724+0000 7fd8e259c700 1 -- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 msgr2=0x7fd8e411cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e259c700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e259c700 1 -- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 msgr2=0x7fd8e411d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e259c700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 0x7fd8e411d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e259c700 1 -- 172.21.15.19:0/3621751077 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009550 con 0x7fd8e409d630 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e1d9b700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e2d9d700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 0x7fd8e411d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e259c700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 0x7fd8e411c7c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c4a0 tx=0x7fd8d400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4004c80 con 0x7fd8e409d630 2023-10-03T10:16:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d4004de0 con 0x7fd8e409d630 2023-10-03T10:16:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc009a70 con 0x7fd8e409d630 2023-10-03T10:16:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e412f1b0 con 0x7fd8e409d630 2023-10-03T10:16:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.727+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e40747f0 con 0x7fd8e409d630 2023-10-03T10:16:53.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.725+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d4007310 con 0x7fd8e409d630 2023-10-03T10:16:53.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.727+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8d4007470 con 0x7fd8e409d630 2023-10-03T10:16:53.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.727+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8d4040dd0 con 0x7fd8e409d630 2023-10-03T10:16:53.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.736+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8d4044060 con 0x7fd8e409d630 2023-10-03T10:16:53.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 Processor -- start 2023-10-03T10:16:53.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 -- start start 2023-10-03T10:16:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f930c09d6f0 0x7f930c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930c09b120 con 0x7f930c09e410 2023-10-03T10:16:53.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f930c06b460 con 0x7f930c09d6f0 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9312ebf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f930c09a7e0 con 0x7f930c09e000 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f930bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f930bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41796/0 (socket says 172.21.15.19:41796) 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f930bfff700 1 -- 172.21.15.19:0/3961741439 learned_addr learned my addr 172.21.15.19:0/3961741439 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.743+0000 7f9310c5b700 1 --2- 172.21.15.19:0/3961741439 >> v2:172.21.15.19:3300/0 conn(0x7f930c09d6f0 0x7f930c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930bfff700 1 -- 172.21.15.19:0/3961741439 >> v2:172.21.15.19:3300/0 conn(0x7f930c09d6f0 msgr2=0x7f930c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930bfff700 1 --2- 172.21.15.19:0/3961741439 >> v2:172.21.15.19:3300/0 conn(0x7f930c09d6f0 0x7f930c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930bfff700 1 -- 172.21.15.19:0/3961741439 >> v1:172.21.15.19:6789/0 conn(0x7f930c09e410 legacy=0x7f930c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:53.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930bfff700 1 -- 172.21.15.19:0/3961741439 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c09a500 con 0x7f930c09e000 2023-10-03T10:16:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930bfff700 1 --2- 172.21.15.19:0/3961741439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009920 tx=0x7f92f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff0e35737f7965a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930b7fe700 1 -- 172.21.15.19:0/3961741439 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8004230 con 0x7f930c09e000 2023-10-03T10:16:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930b7fe700 1 -- 172.21.15.19:0/3961741439 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f8004390 con 0x7f930c09e000 2023-10-03T10:16:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.744+0000 7f930b7fe700 1 -- 172.21.15.19:0/3961741439 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8009e70 con 0x7f930c09e000 2023-10-03T10:16:53.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 -- 172.21.15.19:0/3961741439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 msgr2=0x7f930c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 --2- 172.21.15.19:0/3961741439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009920 tx=0x7f92f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 -- 172.21.15.19:0/3961741439 shutdown_connections 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 --2- 172.21.15.19:0/3961741439 >> v2:172.21.15.19:3300/0 conn(0x7f930c09d6f0 0x7f930c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 --2- 172.21.15.19:0/3961741439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09e000 0x7f930c1339f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 -- 172.21.15.19:0/3961741439 >> 172.21.15.19:0/3961741439 conn(0x7f930c066f50 msgr2=0x7f930c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 -- 172.21.15.19:0/3961741439 shutdown_connections 2023-10-03T10:16:53.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.745+0000 7f9312ebf700 1 -- 172.21.15.19:0/3961741439 wait complete. 2023-10-03T10:16:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.746+0000 7f9312ebf700 1 Processor -- start 2023-10-03T10:16:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.746+0000 7f9312ebf700 1 -- start start 2023-10-03T10:16:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f930c09e000 0x7f930c1a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f930c09e410 0x7f930c1a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930c1a9190 con 0x7f930c09e000 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930c09c710 con 0x7f930c09e410 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9312ebf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f930c0a32a0 con 0x7f930c09d6f0 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9310c5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9310c5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41802/0 (socket says 172.21.15.19:41802) 2023-10-03T10:16:53.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9310c5b700 1 -- 172.21.15.19:0/289759426 learned_addr learned my addr 172.21.15.19:0/289759426 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f930bfff700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f930c09e000 0x7f930c1a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f931145c700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f930c09e410 0x7f930c1a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.747+0000 7f9310c5b700 1 -- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f930c09e410 msgr2=0x7f930c1a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9310c5b700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f930c09e410 0x7f930c1a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9310c5b700 1 -- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f930c09e000 msgr2=0x7f930c1a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9310c5b700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f930c09e000 0x7f930c1a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9310c5b700 1 -- 172.21.15.19:0/289759426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f8009550 con 0x7f930c09d6f0 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9310c5b700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f930000d800 tx=0x7f930000db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93000125f0 con 0x7f930c09d6f0 2023-10-03T10:16:53.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9300012750 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300012b00 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c1a7af0 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.748+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c1a9f00 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.749+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9300012c60 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.749+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93000509c0 con 0x7f930c09d6f0 2023-10-03T10:16:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.750+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930c1a95a0 con 0x7f930c09d6f0 2023-10-03T10:16:53.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.754+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9300025440 con 0x7f930c09d6f0 2023-10-03T10:16:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.884+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7c981a8c40 con 0x7f7c9809e410 2023-10-03T10:16:53.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.885+0000 7f7c957fa700 1 -- 172.21.15.19:0/3226642682 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c9002b090 con 0x7f7c9809e410 2023-10-03T10:16:53.886 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 msgr2=0x7f7c981a68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 0x7f7c981a68b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7c9000ef90 tx=0x7f7c9000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 shutdown_connections 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c9809e410 0x7f7c981a68b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c9809d6f0 0x7f7c981a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 --2- 172.21.15.19:0/3226642682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c9809e000 0x7f7c981a6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.887+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 >> 172.21.15.19:0/3226642682 conn(0x7f7c98066f50 msgr2=0x7f7c981bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.888+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 shutdown_connections 2023-10-03T10:16:53.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.888+0000 7f7c9eedb700 1 -- 172.21.15.19:0/3226642682 wait complete. 2023-10-03T10:16:53.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:53.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.920+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f28bc005590 con 0x7f28d409e410 2023-10-03T10:16:53.922 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:53.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.921+0000 7f28caffd700 1 -- 172.21.15.19:0/477700523 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28cc011380 con 0x7f28d409e410 2023-10-03T10:16:53.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 msgr2=0x7f28d41b80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00cb90 tx=0x7f28cc00cea0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 shutdown_connections 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28d409e410 0x7f28d41b80b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28d409d6f0 0x7f28d41b7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 --2- 172.21.15.19:0/477700523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28d409e000 0x7f28d41b7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 >> 172.21.15.19:0/477700523 conn(0x7f28d4066f50 msgr2=0x7f28d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.923+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 shutdown_connections 2023-10-03T10:16:53.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.924+0000 7f28dc6f9700 1 -- 172.21.15.19:0/477700523 wait complete. 2023-10-03T10:16:53.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:53.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.971+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd8e4072980 con 0x7fd8e409d630 2023-10-03T10:16:53.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.972+0000 7fd8d2ffd700 1 -- 172.21.15.19:0/3621751077 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd8d4044030 con 0x7fd8e409d630 2023-10-03T10:16:53.973 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 msgr2=0x7fd8e411c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 0x7fd8e411c7c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400c4a0 tx=0x7fd8d400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 shutdown_connections 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8e4138d80 0x7fd8e411d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd8e409d630 0x7fd8e411c7c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 --2- 172.21.15.19:0/3621751077 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd8e40a0a30 0x7fd8e411cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 >> 172.21.15.19:0/3621751077 conn(0x7fd8e40a3050 msgr2=0x7fd8e4099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 shutdown_connections 2023-10-03T10:16:53.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.974+0000 7fd8e8e49700 1 -- 172.21.15.19:0/3621751077 wait complete. 2023-10-03T10:16:53.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:53.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.990+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f930c074ea0 con 0x7f930c09d6f0 2023-10-03T10:16:53.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.990+0000 7f93097fa700 1 -- 172.21.15.19:0/289759426 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9300011340 con 0x7f930c09d6f0 2023-10-03T10:16:53.991 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.992+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 msgr2=0x7f930c1a5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.992+0000 7f9312ebf700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f930000d800 tx=0x7f930000db10 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 shutdown_connections 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f930c09e410 0x7f930c1a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f930c09d6f0 0x7f930c1a5ee0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 --2- 172.21.15.19:0/289759426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f930c09e000 0x7f930c1a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 >> 172.21.15.19:0/289759426 conn(0x7f930c066f50 msgr2=0x7f930c1badd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 shutdown_connections 2023-10-03T10:16:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:53.993+0000 7f9312ebf700 1 -- 172.21.15.19:0/289759426 wait complete. 2023-10-03T10:16:54.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:54.904 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:54.939 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:54.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:55.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:55.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.059+0000 7f4e39116700 1 Processor -- start 2023-10-03T10:16:55.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.059+0000 7f4e39116700 1 -- start start 2023-10-03T10:16:55.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e39116700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e39116700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e34135e50 0x7f4e34138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e39116700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3409f130 con 0x7f4e3409d6f0 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e39116700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3409f520 con 0x7f4e34135e50 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e39116700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3409e930 con 0x7f4e3409e1d0 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e3259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e3259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60544/0 (socket says 172.21.15.19:60544) 2023-10-03T10:16:55.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e3259c700 1 -- 172.21.15.19:0/1347416757 learned_addr learned my addr 172.21.15.19:0/1347416757 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.060+0000 7f4e3359e700 1 --2- 172.21.15.19:0/1347416757 >> v2:172.21.15.19:3300/0 conn(0x7f4e34135e50 0x7f4e34138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e3259c700 1 -- 172.21.15.19:0/1347416757 >> v2:172.21.15.19:3300/0 conn(0x7f4e34135e50 msgr2=0x7f4e34138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e3259c700 1 --2- 172.21.15.19:0/1347416757 >> v2:172.21.15.19:3300/0 conn(0x7f4e34135e50 0x7f4e34138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e3259c700 1 -- 172.21.15.19:0/1347416757 >> v1:172.21.15.19:6789/0 conn(0x7f4e3409d6f0 legacy=0x7f4e3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e3259c700 1 -- 172.21.15.19:0/1347416757 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3409b2d0 con 0x7f4e3409e1d0 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e3259c700 1 --2- 172.21.15.19:0/1347416757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009920 tx=0x7f4e28009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d03e69162208dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e31d9b700 1 -- 172.21.15.19:0/1347416757 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011830 con 0x7f4e3409e1d0 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e31d9b700 1 -- 172.21.15.19:0/1347416757 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28011990 con 0x7f4e3409e1d0 2023-10-03T10:16:55.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.061+0000 7f4e31d9b700 1 -- 172.21.15.19:0/1347416757 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28011d20 con 0x7f4e3409e1d0 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 -- 172.21.15.19:0/1347416757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 msgr2=0x7f4e34135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 --2- 172.21.15.19:0/1347416757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009920 tx=0x7f4e28009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 -- 172.21.15.19:0/1347416757 shutdown_connections 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 --2- 172.21.15.19:0/1347416757 >> v2:172.21.15.19:3300/0 conn(0x7f4e34135e50 0x7f4e34138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 --2- 172.21.15.19:0/1347416757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e3409e1d0 0x7f4e34135910 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 -- 172.21.15.19:0/1347416757 >> 172.21.15.19:0/1347416757 conn(0x7f4e34066f50 msgr2=0x7f4e3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 -- 172.21.15.19:0/1347416757 shutdown_connections 2023-10-03T10:16:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.062+0000 7f4e39116700 1 -- 172.21.15.19:0/1347416757 wait complete. 2023-10-03T10:16:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.064+0000 7f4e39116700 1 Processor -- start 2023-10-03T10:16:55.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.064+0000 7f4e39116700 1 -- start start 2023-10-03T10:16:55.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e3409e1d0 0x7f4e34132ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 0x7f4e34133410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34134bf0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34119590 con 0x7f4e34135e50 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e39116700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34135c40 con 0x7f4e3409e1d0 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57812/0 (socket says 172.21.15.19:57812) 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 -- 172.21.15.19:0/3204718305 learned_addr learned my addr 172.21.15.19:0/3204718305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e3259c700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e3409e1d0 0x7f4e34132ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e3359e700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 0x7f4e34133410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 -- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e3409e1d0 msgr2=0x7f4e34132ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e3409e1d0 0x7f4e34132ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 -- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 msgr2=0x7f4e34133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 0x7f4e34133410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e32d9d700 1 -- 172.21.15.19:0/3204718305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e28009550 con 0x7f4e3409d6f0 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.065+0000 7f4e3359e700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 0x7f4e34133410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e32d9d700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c450 tx=0x7f4e2400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e240050d0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e24005250 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34119bd0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e24003680 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.066+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e34119850 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.068+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4e240037e0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.068+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4e2403e9a0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.068+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e34074ea0 con 0x7f4e3409d6f0 2023-10-03T10:16:55.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.077+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4e24017020 con 0x7f4e3409d6f0 2023-10-03T10:16:55.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.108+0000 7f850a5b1700 1 Processor -- start 2023-10-03T10:16:55.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.108+0000 7f850a5b1700 1 -- start start 2023-10-03T10:16:55.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409e410 0x7f8504133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850406b460 con 0x7f850409d6f0 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850409b120 con 0x7f850409e000 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f850a5b1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f850409a7e0 con 0x7f850409e410 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f8503fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f8503fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57816/0 (socket says 172.21.15.19:57816) 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f8503fff700 1 -- 172.21.15.19:0/3338066324 learned_addr learned my addr 172.21.15.19:0/3338066324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.109+0000 7f85037fe700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 -- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409e410 msgr2=0x7f8504133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409e410 0x7f8504133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 -- 172.21.15.19:0/3338066324 >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 msgr2=0x7f850409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 --2- 172.21.15.19:0/3338066324 >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 -- 172.21.15.19:0/3338066324 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850409a500 con 0x7f850409e000 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f85037fe700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 0x7f85041339f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009870 tx=0x7f84f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172eb4eb9a17354 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f8502ffd700 1 -- 172.21.15.19:0/3338066324 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8011830 con 0x7f850409e000 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f8502ffd700 1 -- 172.21.15.19:0/3338066324 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8011990 con 0x7f850409e000 2023-10-03T10:16:55.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.110+0000 7f8502ffd700 1 -- 172.21.15.19:0/3338066324 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8011d20 con 0x7f850409e000 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 -- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 msgr2=0x7f85041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 0x7f85041339f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009870 tx=0x7f84f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 -- 172.21.15.19:0/3338066324 shutdown_connections 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409e410 0x7f8504133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 --2- 172.21.15.19:0/3338066324 >> v2:172.21.15.19:3300/0 conn(0x7f850409d6f0 0x7f850409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 --2- 172.21.15.19:0/3338066324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e000 0x7f85041339f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 -- 172.21.15.19:0/3338066324 >> 172.21.15.19:0/3338066324 conn(0x7f8504066f50 msgr2=0x7f850409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 -- 172.21.15.19:0/3338066324 shutdown_connections 2023-10-03T10:16:55.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.111+0000 7f850a5b1700 1 -- 172.21.15.19:0/3338066324 wait complete. 2023-10-03T10:16:55.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.113+0000 7f850a5b1700 1 Processor -- start 2023-10-03T10:16:55.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.113+0000 7f850a5b1700 1 -- start start 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409d6f0 0x7f85041a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e410 0x7f85041a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85040a2090 con 0x7f850409e000 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85041a8420 con 0x7f850409e410 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f850a5b1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85041a86e0 con 0x7f850409d6f0 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f85037fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f85037fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57832/0 (socket says 172.21.15.19:57832) 2023-10-03T10:16:55.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f85037fe700 1 -- 172.21.15.19:0/2443349507 learned_addr learned my addr 172.21.15.19:0/2443349507 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.114+0000 7f8508b4e700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e410 0x7f85041a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 -- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409d6f0 msgr2=0x7f85041a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409d6f0 0x7f85041a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 -- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e410 msgr2=0x7f85041a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e410 0x7f85041a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 -- 172.21.15.19:0/2443349507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f80094a0 con 0x7f850409e000 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f85037fe700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009840 tx=0x7f84f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8004590 con 0x7f850409e000 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f850409c710 con 0x7f850409e000 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85041a89c0 con 0x7f850409e000 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f801f070 con 0x7f850409e000 2023-10-03T10:16:55.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.115+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f80038a0 con 0x7f850409e000 2023-10-03T10:16:55.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.116+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84f8003a00 con 0x7f850409e000 2023-10-03T10:16:55.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.117+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e40052e0 con 0x7f850409e000 2023-10-03T10:16:55.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.117+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84f8021070 con 0x7f850409e000 2023-10-03T10:16:55.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.126+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84f8010380 con 0x7f850409e000 2023-10-03T10:16:55.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.159+0000 7f7f14da4700 1 Processor -- start 2023-10-03T10:16:55.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.159+0000 7f7f14da4700 1 -- start start 2023-10-03T10:16:55.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f1009d6f0 0x7f7f1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e000 0x7f7f101339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e410 0x7f7f10133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1006b460 con 0x7f7f1009d6f0 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1009b120 con 0x7f7f1009e000 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.160+0000 7f7f14da4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1009a7e0 con 0x7f7f1009e410 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f1009d6f0 0x7f7f1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7f1009d6f0 0x7f7f1009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57842/0 (socket says 172.21.15.19:57842) 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 -- 172.21.15.19:0/1789011801 learned_addr learned my addr 172.21.15.19:0/1789011801 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0ed9d700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e410 0x7f7f10133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0dd9b700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e000 0x7f7f101339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 -- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e410 msgr2=0x7f7f10133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e410 0x7f7f10133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 -- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e000 msgr2=0x7f7f101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e000 0x7f7f101339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.161+0000 7f7f0e59c700 1 -- 172.21.15.19:0/1789011801 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1009a500 con 0x7f7f1009d6f0 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.162+0000 7f7f0e59c700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f1009dac0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098f0 tx=0x7f7f00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45b0ce059ebb2a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.162+0000 7f7f0d59a700 1 -- 172.21.15.19:0/1789011801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011830 con 0x7f7f1009d6f0 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.162+0000 7f7f0d59a700 1 -- 172.21.15.19:0/1789011801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00011990 con 0x7f7f1009d6f0 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.162+0000 7f7f0d59a700 1 -- 172.21.15.19:0/1789011801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00011d20 con 0x7f7f1009d6f0 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 -- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 msgr2=0x7f7f1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f1009dac0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f7f000098f0 tx=0x7f7f00009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 -- 172.21.15.19:0/1789011801 shutdown_connections 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e410 0x7f7f10133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f1009dac0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1789011801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e000 0x7f7f101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 -- 172.21.15.19:0/1789011801 >> 172.21.15.19:0/1789011801 conn(0x7f7f10066f50 msgr2=0x7f7f1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 -- 172.21.15.19:0/1789011801 shutdown_connections 2023-10-03T10:16:55.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.163+0000 7f7f14da4700 1 -- 172.21.15.19:0/1789011801 wait complete. 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.164+0000 7f7f14da4700 1 Processor -- start 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.164+0000 7f7f14da4700 1 -- start start 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e000 0x7f7f101a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 0x7f7f101a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101a9840 con 0x7f7f1009d6f0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101a8c10 con 0x7f7f1009e410 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f14da4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7f101a7180 con 0x7f7f1009e000 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57852/0 (socket says 172.21.15.19:57852) 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 0x7f7f101a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0e59c700 1 -- 172.21.15.19:0/1264582393 learned_addr learned my addr 172.21.15.19:0/1264582393 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0dd9b700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e000 0x7f7f101a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 -- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e000 msgr2=0x7f7f101a6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e000 0x7f7f101a6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 -- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 msgr2=0x7f7f101a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0ed9d700 1 -- 172.21.15.19:0/1264582393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00009550 con 0x7f7f1009e410 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.165+0000 7f7f0e59c700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:55.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7f0ed9d700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 0x7f7f101a67a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009d90 tx=0x7f7f0800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08009c00 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0800f040 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1009c710 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08014480 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.166+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f101a7f10 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.167+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7f080145e0 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.167+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f10074ea0 con 0x7f7f1009e410 2023-10-03T10:16:55.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.167+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7f08040250 con 0x7f7f1009e410 2023-10-03T10:16:55.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.177+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7f08018030 con 0x7f7f1009e410 2023-10-03T10:16:55.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 Processor -- start 2023-10-03T10:16:55.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 -- start start 2023-10-03T10:16:55.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc06b460 con 0x7f00dc09e000 2023-10-03T10:16:55.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09b120 con 0x7f00dc09e410 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e3189700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09a7e0 con 0x7f00dc09d6f0 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e0f25700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.186+0000 7f00e1726700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60594/0 (socket says 172.21.15.19:60594) 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e0f25700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41872/0 (socket says 172.21.15.19:41872) 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 -- 172.21.15.19:0/3437540832 learned_addr learned my addr 172.21.15.19:0/3437540832 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 -- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 msgr2=0x7f00dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 -- 172.21.15.19:0/3437540832 >> v2:172.21.15.19:3300/0 conn(0x7f00dc09e000 msgr2=0x7f00dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 --2- 172.21.15.19:0/3437540832 >> v2:172.21.15.19:3300/0 conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 -- 172.21.15.19:0/3437540832 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc09a500 con 0x7f00dc09e410 2023-10-03T10:16:55.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e0f25700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:55.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00e1726700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e80 tx=0x7f00d400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5530c64a95c6ddb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00db7fe700 1 -- 172.21.15.19:0/3437540832 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400e070 con 0x7f00dc09e410 2023-10-03T10:16:55.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00db7fe700 1 -- 172.21.15.19:0/3437540832 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d400b8d0 con 0x7f00dc09e410 2023-10-03T10:16:55.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.187+0000 7f00db7fe700 1 -- 172.21.15.19:0/3437540832 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d400bc80 con 0x7f00dc09e410 2023-10-03T10:16:55.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 -- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 msgr2=0x7f00dc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e80 tx=0x7f00d400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:55.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 -- 172.21.15.19:0/3437540832 shutdown_connections 2023-10-03T10:16:55.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc133f30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 --2- 172.21.15.19:0/3437540832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09d6f0 0x7f00dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 --2- 172.21.15.19:0/3437540832 >> v2:172.21.15.19:3300/0 conn(0x7f00dc09e000 0x7f00dc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 -- 172.21.15.19:0/3437540832 >> 172.21.15.19:0/3437540832 conn(0x7f00dc066f50 msgr2=0x7f00dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 -- 172.21.15.19:0/3437540832 shutdown_connections 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.188+0000 7f00e3189700 1 -- 172.21.15.19:0/3437540832 wait complete. 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.189+0000 7f00e3189700 1 Processor -- start 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.189+0000 7f00e3189700 1 -- start start 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00dc09d6f0 0x7f00dc1a5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc1a6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1a9160 con 0x7f00dc09d6f0 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1aa2b0 con 0x7f00dc09e410 2023-10-03T10:16:55.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e3189700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc1a8c30 con 0x7f00dc09e000 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41882/0 (socket says 172.21.15.19:41882) 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 -- 172.21.15.19:0/1406873717 learned_addr learned my addr 172.21.15.19:0/1406873717 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e1726700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc1a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00e0f25700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00dc09d6f0 0x7f00dc1a5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 -- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 msgr2=0x7f00dc1a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc1a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 -- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00dc09d6f0 msgr2=0x7f00dc1a5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.190+0000 7f00dbfff700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00dc09d6f0 0x7f00dc1a5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.191+0000 7f00dbfff700 1 -- 172.21.15.19:0/1406873717 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00094a0 con 0x7f00dc09e000 2023-10-03T10:16:55.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.191+0000 7f00dbfff700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b530 tx=0x7f00c800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:55.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.192+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011830 con 0x7f00dc09e000 2023-10-03T10:16:55.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.192+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c80119b0 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.192+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4009b30 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.192+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8011d60 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.192+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc1a9660 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.193+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00c801a400 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.193+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc074ea0 con 0x7f00dc09e000 2023-10-03T10:16:55.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.193+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00c803f390 con 0x7f00dc09e000 2023-10-03T10:16:55.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.198+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00c8021cd0 con 0x7f00dc09e000 2023-10-03T10:16:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.304+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4e3406c360 con 0x7f4e3409d6f0 2023-10-03T10:16:55.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.304+0000 7f4e1b7fe700 1 -- 172.21.15.19:0/3204718305 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e24011590 con 0x7f4e3409d6f0 2023-10-03T10:16:55.305 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 msgr2=0x7f4e34132990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f4e2400c450 tx=0x7f4e2400c760 comp rx=0 tx=0).stop 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 shutdown_connections 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e34135e50 0x7f4e34133410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e3409d6f0 0x7f4e34132990 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 --2- 172.21.15.19:0/3204718305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e3409e1d0 0x7f4e34132ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 >> 172.21.15.19:0/3204718305 conn(0x7f4e34066f50 msgr2=0x7f4e3406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 shutdown_connections 2023-10-03T10:16:55.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.307+0000 7f4e39116700 1 -- 172.21.15.19:0/3204718305 wait complete. 2023-10-03T10:16:55.323 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:55.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.350+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84e4005590 con 0x7f850409e000 2023-10-03T10:16:55.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.350+0000 7f8500ff9700 1 -- 172.21.15.19:0/2443349507 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84f8015030 con 0x7f850409e000 2023-10-03T10:16:55.351 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 msgr2=0x7f85041a54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009840 tx=0x7f84f8004750 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 shutdown_connections 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f850409e410 0x7f85041a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f850409d6f0 0x7f85041a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 --2- 172.21.15.19:0/2443349507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f850409e000 0x7f85041a54b0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 >> 172.21.15.19:0/2443349507 conn(0x7f8504066f50 msgr2=0x7f850406f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 shutdown_connections 2023-10-03T10:16:55.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.353+0000 7f850a5b1700 1 -- 172.21.15.19:0/2443349507 wait complete. 2023-10-03T10:16:55.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:55.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.386+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f1006c360 con 0x7f7f1009e410 2023-10-03T10:16:55.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.386+0000 7f7efeffd700 1 -- 172.21.15.19:0/1264582393 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7f0802b090 con 0x7f7f1009e410 2023-10-03T10:16:55.387 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:55.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 msgr2=0x7f7f101a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 0x7f7f101a67a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009d90 tx=0x7f7f0800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 shutdown_connections 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7f1009e410 0x7f7f101a67a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f1009d6f0 0x7f7f101a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 --2- 172.21.15.19:0/1264582393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7f1009e000 0x7f7f101a6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 >> 172.21.15.19:0/1264582393 conn(0x7f7f10066f50 msgr2=0x7f7f100a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 shutdown_connections 2023-10-03T10:16:55.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.388+0000 7f7f14da4700 1 -- 172.21.15.19:0/1264582393 wait complete. 2023-10-03T10:16:55.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.407+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00dc1a9660 con 0x7f00dc09e000 2023-10-03T10:16:55.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.408+0000 7f00d97fa700 1 -- 172.21.15.19:0/1406873717 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00dc1a9660 con 0x7f00dc09e000 2023-10-03T10:16:55.409 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:55.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 msgr2=0x7f00dc1a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:55.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f00c800b530 tx=0x7f00c800b840 comp rx=0 tx=0).stop 2023-10-03T10:16:55.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 shutdown_connections 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00dc09e410 0x7f00dc1a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00dc09d6f0 0x7f00dc1a5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 --2- 172.21.15.19:0/1406873717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00dc09e000 0x7f00dc1a6310 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 >> 172.21.15.19:0/1406873717 conn(0x7f00dc066f50 msgr2=0x7f00dc1bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 shutdown_connections 2023-10-03T10:16:55.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:55.410+0000 7f00e3189700 1 -- 172.21.15.19:0/1406873717 wait complete. 2023-10-03T10:16:55.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:56.323 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:56.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:56.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:56.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:56.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.475+0000 7f2f39934700 1 Processor -- start 2023-10-03T10:16:56.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 -- start start 2023-10-03T10:16:56.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f341338a0 0x7f2f34133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f3409de50 0x7f2f3409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3406ef30 con 0x7f2f3409e760 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3406fef0 con 0x7f2f3409de50 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.476+0000 7f2f39934700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341334b0 con 0x7f2f341338a0 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f3409de50 0x7f2f3409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f32ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f341338a0 0x7f2f34133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f3409de50 0x7f2f3409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41204/0 (socket says 172.21.15.19:41204) 2023-10-03T10:16:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 -- 172.21.15.19:0/733616159 learned_addr learned my addr 172.21.15.19:0/733616159 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 -- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f341338a0 msgr2=0x7f2f34133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 --2- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f341338a0 0x7f2f34133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 -- 172.21.15.19:0/733616159 >> v1:172.21.15.19:6789/0 conn(0x7f2f3409e760 legacy=0x7f2f3413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 -- 172.21.15.19:0/733616159 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3406fc30 con 0x7f2f3409de50 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.477+0000 7f2f327fc700 1 --2- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f3409de50 0x7f2f3409e220 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098f0 tx=0x7f2f28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9864a4df8f3e55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f31ffb700 1 -- 172.21.15.19:0/733616159 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28011830 con 0x7f2f3409de50 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f31ffb700 1 -- 172.21.15.19:0/733616159 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f28011990 con 0x7f2f3409de50 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f31ffb700 1 -- 172.21.15.19:0/733616159 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28011d20 con 0x7f2f3409de50 2023-10-03T10:16:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 -- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f3409de50 msgr2=0x7f2f3409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 --2- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f3409de50 0x7f2f3409e220 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2f280098f0 tx=0x7f2f28009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 -- 172.21.15.19:0/733616159 shutdown_connections 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 --2- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f341338a0 0x7f2f34133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 --2- 172.21.15.19:0/733616159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f3409de50 0x7f2f3409e220 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.478+0000 7f2f39934700 1 -- 172.21.15.19:0/733616159 >> 172.21.15.19:0/733616159 conn(0x7f2f340a2aa0 msgr2=0x7f2f340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.479+0000 7f2f39934700 1 -- 172.21.15.19:0/733616159 shutdown_connections 2023-10-03T10:16:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.479+0000 7f2f39934700 1 -- 172.21.15.19:0/733616159 wait complete. 2023-10-03T10:16:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.480+0000 7f2f39934700 1 Processor -- start 2023-10-03T10:16:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.480+0000 7f2f39934700 1 -- start start 2023-10-03T10:16:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 0x7f2f3411eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f3409e760 0x7f2f3411eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341222f0 con 0x7f2f341338a0 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f341207d0 con 0x7f2f3409e760 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f39934700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f340a1110 con 0x7f2f3409de50 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f337fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41210/0 (socket says 172.21.15.19:41210) 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f337fe700 1 -- 172.21.15.19:0/2981200864 learned_addr learned my addr 172.21.15.19:0/2981200864 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 0x7f2f3411eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 -- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f3409e760 msgr2=0x7f2f3411eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f3409e760 0x7f2f3411eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 -- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 msgr2=0x7f2f3411f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f32ffd700 1 -- 172.21.15.19:0/2981200864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f28009550 con 0x7f2f3409de50 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.481+0000 7f2f337fe700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f32ffd700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 0x7f2f3411eab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400e900 tx=0x7f2f2400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400ee50 con 0x7f2f3409de50 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2400c850 con 0x7f2f3409de50 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3406f640 con 0x7f2f3409de50 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400cbc0 con 0x7f2f3409de50 2023-10-03T10:16:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.482+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f34122d60 con 0x7f2f3409de50 2023-10-03T10:16:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.483+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f2400cd20 con 0x7f2f3409de50 2023-10-03T10:16:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.483+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f2403f6e0 con 0x7f2f3409de50 2023-10-03T10:16:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.483+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3412fa00 con 0x7f2f3409de50 2023-10-03T10:16:56.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.493+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f240232f0 con 0x7f2f3409de50 2023-10-03T10:16:56.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 Processor -- start 2023-10-03T10:16:56.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 -- start start 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb40009d6f0 0x7fb40009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb400133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40006b460 con 0x7fb40009d6f0 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009b120 con 0x7fb40009e000 2023-10-03T10:16:56.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.520+0000 7fb407b26700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009a7e0 con 0x7fb40009e410 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb40009d6f0 0x7fb40009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb40009d6f0 0x7fb40009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41222/0 (socket says 172.21.15.19:41222) 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 -- 172.21.15.19:0/3170881913 learned_addr learned my addr 172.21.15.19:0/3170881913 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4050c1700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4060c3700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb400133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 -- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 msgr2=0x7fb400133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb400133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 -- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 msgr2=0x7fb4001339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 -- 172.21.15.19:0/3170881913 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009a500 con 0x7fb40009d6f0 2023-10-03T10:16:56.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4050c1700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.521+0000 7fb4058c2700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb40009dac0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0098f0 tx=0x7fb3fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7770799094b9d807 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb4048c0700 1 -- 172.21.15.19:0/3170881913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc011830 con 0x7fb40009d6f0 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb4048c0700 1 -- 172.21.15.19:0/3170881913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc011990 con 0x7fb40009d6f0 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb4048c0700 1 -- 172.21.15.19:0/3170881913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc011d20 con 0x7fb40009d6f0 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 -- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 msgr2=0x7fb40009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb40009dac0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0098f0 tx=0x7fb3fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 -- 172.21.15.19:0/3170881913 shutdown_connections 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb400133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb40009dac0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 --2- 172.21.15.19:0/3170881913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.522+0000 7fb407b26700 1 -- 172.21.15.19:0/3170881913 >> 172.21.15.19:0/3170881913 conn(0x7fb400066f50 msgr2=0x7fb40009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.523+0000 7fb407b26700 1 -- 172.21.15.19:0/3170881913 shutdown_connections 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.523+0000 7fb407b26700 1 -- 172.21.15.19:0/3170881913 wait complete. 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 Processor -- start 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 -- start start 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb4001a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4000a1f20 con 0x7fb40009d6f0 2023-10-03T10:16:56.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001a80a0 con 0x7fb40009e000 2023-10-03T10:16:56.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb407b26700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001b91f0 con 0x7fb40009e410 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb4060c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb4060c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41828/0 (socket says 172.21.15.19:41828) 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.524+0000 7fb4060c3700 1 -- 172.21.15.19:0/2058825006 learned_addr learned my addr 172.21.15.19:0/2058825006 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4050c1700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4058c2700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb4001a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 -- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 msgr2=0x7fb4001a5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001a5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 -- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 msgr2=0x7fb4001a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb4001a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 -- 172.21.15.19:0/2058825006 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f00094a0 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb4060c3700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8007e70 tx=0x7fb3f800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8017e90 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800e920 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3fc009550 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800ecb0 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.525+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4001a6c60 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.527+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f801f3f0 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.527+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4001a6530 con 0x7fb40009e410 2023-10-03T10:16:56.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.527+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3f8047f40 con 0x7fb40009e410 2023-10-03T10:16:56.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.536+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f801d300 con 0x7fb40009e410 2023-10-03T10:16:56.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.560+0000 7fcbebbef700 1 Processor -- start 2023-10-03T10:16:56.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.560+0000 7fcbebbef700 1 -- start start 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbebbef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 0x7fcbe4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbebbef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcbe4099a40 0x7fcbe4099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbebbef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe409a850 con 0x7fcbe409a3b0 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbebbef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe409b580 con 0x7fcbe4099a40 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbebbef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe41313c0 con 0x7fcbe4131810 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbea18c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcbe409a3b0 0x7fcbe4138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43504/0 (socket says 172.21.15.19:43504) 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe998b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 0x7fcbe4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbea18c700 1 -- 172.21.15.19:0/3167594618 learned_addr learned my addr 172.21.15.19:0/3167594618 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:56.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3167594618 >> v2:172.21.15.19:3300/0 conn(0x7fcbe4099a40 0x7fcbe4099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe8989700 1 -- 172.21.15.19:0/3167594618 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410738367 0 0) 0x7fcbe409a850 con 0x7fcbe409a3b0 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe8989700 1 -- 172.21.15.19:0/3167594618 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd00035b0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe918a700 1 -- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 msgr2=0x7fcbe4131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 0x7fcbe4131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe918a700 1 -- 172.21.15.19:0/3167594618 >> v1:172.21.15.19:6789/0 conn(0x7fcbe409a3b0 legacy=0x7fcbe4138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.561+0000 7fcbe918a700 1 -- 172.21.15.19:0/3167594618 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe406e8c0 con 0x7fcbe4099a40 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.562+0000 7fcbe998b700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 0x7fcbe4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.562+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4099a40 0x7fcbe4099e70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36213fb6a96f2ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.562+0000 7fcbe8989700 1 -- 172.21.15.19:0/3167594618 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4011830 con 0x7fcbe4099a40 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.562+0000 7fcbe8989700 1 -- 172.21.15.19:0/3167594618 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd4011990 con 0x7fcbe4099a40 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.562+0000 7fcbe8989700 1 -- 172.21.15.19:0/3167594618 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4011d20 con 0x7fcbe4099a40 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 -- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4099a40 msgr2=0x7fcbe4099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4099a40 0x7fcbe4099e70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4009870 tx=0x7fcbd4009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 -- 172.21.15.19:0/3167594618 shutdown_connections 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe4131810 0x7fcbe4131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3167594618 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4099a40 0x7fcbe4099e70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 -- 172.21.15.19:0/3167594618 >> 172.21.15.19:0/3167594618 conn(0x7fcbe40a2aa0 msgr2=0x7fcbe40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 -- 172.21.15.19:0/3167594618 shutdown_connections 2023-10-03T10:16:56.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.563+0000 7fcbebbef700 1 -- 172.21.15.19:0/3167594618 wait complete. 2023-10-03T10:16:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 Processor -- start 2023-10-03T10:16:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 -- start start 2023-10-03T10:16:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbe4099a40 0x7fcbe41195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4131810 0x7fcbe411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe411d0e0 con 0x7fcbe4131810 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe411b7f0 con 0x7fcbe4099a40 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.564+0000 7fcbebbef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe411da80 con 0x7fcbe409a3b0 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41834/0 (socket says 172.21.15.19:41834) 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 -- 172.21.15.19:0/3495901390 learned_addr learned my addr 172.21.15.19:0/3495901390 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbea18c700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4131810 0x7fcbe411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 -- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbe4099a40 msgr2=0x7fcbe41195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbe4099a40 0x7fcbe41195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 -- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4131810 msgr2=0x7fcbe411a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4131810 0x7fcbe411a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 -- 172.21.15.19:0/3495901390 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00094a0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbe918a700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c00 tx=0x7fcbd4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.565+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd40036a0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.566+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd401f070 con 0x7fcbe409a3b0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.566+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd4003a60 con 0x7fcbe409a3b0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.566+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd40094a0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.566+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40a17b0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.567+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe411b230 con 0x7fcbe409a3b0 2023-10-03T10:16:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.568+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcbd4003bc0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.570+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcbd4021070 con 0x7fcbe409a3b0 2023-10-03T10:16:56.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.573+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcbd405e750 con 0x7fcbe409a3b0 2023-10-03T10:16:56.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.637+0000 7f71dfb0d700 1 Processor -- start 2023-10-03T10:16:56.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.637+0000 7f71dfb0d700 1 -- start start 2023-10-03T10:16:56.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 0x7f71d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e410 0x7f71d8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d809f520 con 0x7f71d809e000 2023-10-03T10:16:56.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809f130 con 0x7f71d809e410 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dfb0d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809e930 con 0x7f71d809d6f0 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dd8a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dd8a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41844/0 (socket says 172.21.15.19:41844) 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71de0aa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e410 0x7f71d8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dd8a9700 1 -- 172.21.15.19:0/1588457826 learned_addr learned my addr 172.21.15.19:0/1588457826 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.638+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/1588457826 >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 0x7f71d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 -- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e410 msgr2=0x7f71d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 --2- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e410 0x7f71d8130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 -- 172.21.15.19:0/1588457826 >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 msgr2=0x7f71d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 --2- 172.21.15.19:0/1588457826 >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 0x7f71d8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 -- 172.21.15.19:0/1588457826 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d809b2d0 con 0x7f71d809d6f0 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/1588457826 >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 0x7f71d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dd8a9700 1 --2- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009920 tx=0x7f71d4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38a70041d5a28b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dc8a7700 1 -- 172.21.15.19:0/1588457826 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011830 con 0x7f71d809d6f0 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dc8a7700 1 -- 172.21.15.19:0/1588457826 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d4011990 con 0x7f71d809d6f0 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.639+0000 7f71dc8a7700 1 -- 172.21.15.19:0/1588457826 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d4011d20 con 0x7f71d809d6f0 2023-10-03T10:16:56.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 -- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 msgr2=0x7f71d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009920 tx=0x7f71d4009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 -- 172.21.15.19:0/1588457826 shutdown_connections 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e410 0x7f71d8130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/1588457826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809d6f0 0x7f71d809dac0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/1588457826 >> v2:172.21.15.19:3300/0 conn(0x7f71d809e000 0x7f71d8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 -- 172.21.15.19:0/1588457826 >> 172.21.15.19:0/1588457826 conn(0x7f71d8066f50 msgr2=0x7f71d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 -- 172.21.15.19:0/1588457826 shutdown_connections 2023-10-03T10:16:56.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.640+0000 7f71dfb0d700 1 -- 172.21.15.19:0/1588457826 wait complete. 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.641+0000 7f71dfb0d700 1 Processor -- start 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.641+0000 7f71dfb0d700 1 -- start start 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 0x7f71d81222f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 0x7f71d8122830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8130250 con 0x7f71d809d6f0 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d809c700 con 0x7f71d809e000 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dfb0d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d8125a90 con 0x7f71d809e410 2023-10-03T10:16:56.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71de0aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71de0aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41846/0 (socket says 172.21.15.19:41846) 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71de0aa700 1 -- 172.21.15.19:0/526174001 learned_addr learned my addr 172.21.15.19:0/526174001 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 0x7f71d8122830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd8a9700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 0x7f71d81222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 -- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 msgr2=0x7f71d8122d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 -- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 msgr2=0x7f71d81222f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 0x7f71d81222f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd0a8700 1 -- 172.21.15.19:0/526174001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c80094a0 con 0x7f71d809e000 2023-10-03T10:16:56.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71de0aa700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.642+0000 7f71dd8a9700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 0x7f71d81222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71dd0a8700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 0x7f71d8122830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71c800e9b0 tx=0x7f71c800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8004240 con 0x7f71d809e000 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d4009550 con 0x7f71d809e000 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d8124610 con 0x7f71d809e000 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c80043a0 con 0x7f71d809e000 2023-10-03T10:16:56.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.643+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c80036a0 con 0x7f71d809e000 2023-10-03T10:16:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.644+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c00052e0 con 0x7f71d809e000 2023-10-03T10:16:56.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.644+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71c8003800 con 0x7f71d809e000 2023-10-03T10:16:56.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.649+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71c8003de0 con 0x7f71d809e000 2023-10-03T10:16:56.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.654+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71c800c5e0 con 0x7f71d809e000 2023-10-03T10:16:56.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.715+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f34074ea0 con 0x7f2f3409de50 2023-10-03T10:16:56.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.716+0000 7f2f1bfff700 1 -- 172.21.15.19:0/2981200864 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f24017020 con 0x7f2f3409de50 2023-10-03T10:16:56.716 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 msgr2=0x7f2f3411eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 0x7f2f3411eab0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400e900 tx=0x7f2f2400ec10 comp rx=0 tx=0).stop 2023-10-03T10:16:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 shutdown_connections 2023-10-03T10:16:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f341338a0 0x7f2f3411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f3409de50 0x7f2f3411eab0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 --2- 172.21.15.19:0/2981200864 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f3409e760 0x7f2f3411eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 >> 172.21.15.19:0/2981200864 conn(0x7f2f340a2aa0 msgr2=0x7f2f3409edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 shutdown_connections 2023-10-03T10:16:56.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.719+0000 7f2f39934700 1 -- 172.21.15.19:0/2981200864 wait complete. 2023-10-03T10:16:56.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.789+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbe4071db0 con 0x7fcbe409a3b0 2023-10-03T10:16:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.789+0000 7fcbda7fc700 1 -- 172.21.15.19:0/3495901390 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbd4034090 con 0x7fcbe409a3b0 2023-10-03T10:16:56.790 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.790+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb400074ea0 con 0x7fb40009e410 2023-10-03T10:16:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.791+0000 7fb3f67fc700 1 -- 172.21.15.19:0/2058825006 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f8026310 con 0x7fb40009e410 2023-10-03T10:16:56.792 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:56.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.791+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 msgr2=0x7fcbe4119b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.791+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcbd4000c00 tx=0x7fcbd4004750 comp rx=0 tx=0).stop 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.792+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 shutdown_connections 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.792+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcbe4131810 0x7fcbe411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.792+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcbe4099a40 0x7fcbe41195c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.792+0000 7fcbebbef700 1 --2- 172.21.15.19:0/3495901390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcbe409a3b0 0x7fcbe4119b00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.792+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 >> 172.21.15.19:0/3495901390 conn(0x7fcbe40a2aa0 msgr2=0x7fcbe412e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 shutdown_connections 2023-10-03T10:16:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fcbebbef700 1 -- 172.21.15.19:0/3495901390 wait complete. 2023-10-03T10:16:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 msgr2=0x7fb4001c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8007e70 tx=0x7fb3f800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 shutdown_connections 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009e410 0x7fb4001c8040 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb40009d6f0 0x7fb4001a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 --2- 172.21.15.19:0/2058825006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb40009e000 0x7fb4001a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 >> 172.21.15.19:0/2058825006 conn(0x7fb400066f50 msgr2=0x7fb4001bbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 shutdown_connections 2023-10-03T10:16:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.793+0000 7fb407b26700 1 -- 172.21.15.19:0/2058825006 wait complete. 2023-10-03T10:16:56.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:56.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:56.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.882+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71c0005590 con 0x7f71d809e000 2023-10-03T10:16:56.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.883+0000 7f71ce7fc700 1 -- 172.21.15.19:0/526174001 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71c8017030 con 0x7f71d809e000 2023-10-03T10:16:56.884 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 msgr2=0x7f71d8122830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 0x7f71d8122830 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f71c800e9b0 tx=0x7f71c800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 shutdown_connections 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71d809e410 0x7f71d8122d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71d809d6f0 0x7f71d81222f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 --2- 172.21.15.19:0/526174001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71d809e000 0x7f71d8122830 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:56.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 >> 172.21.15.19:0/526174001 conn(0x7f71d8066f50 msgr2=0x7f71d806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:56.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 shutdown_connections 2023-10-03T10:16:56.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:56.885+0000 7f71dfb0d700 1 -- 172.21.15.19:0/526174001 wait complete. 2023-10-03T10:16:56.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:57.740 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:57.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:57.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:57.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 Processor -- start 2023-10-03T10:16:57.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 -- start start 2023-10-03T10:16:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f078c136f50 0x7f078c139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c09b4f0 con 0x7f078c131810 2023-10-03T10:16:57.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c1313c0 con 0x7f078c136f50 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f0791c95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078c06e8c0 con 0x7f078c134630 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f078bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f078c136f50 0x7f078c139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f078bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f078c136f50 0x7f078c139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41276/0 (socket says 172.21.15.19:41276) 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.892+0000 7f078bfff700 1 -- 172.21.15.19:0/3146983003 learned_addr learned my addr 172.21.15.19:0/3146983003 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078affd700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078bfff700 1 -- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 msgr2=0x7f078c136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078bfff700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078bfff700 1 -- 172.21.15.19:0/3146983003 >> v1:172.21.15.19:6789/0 conn(0x7f078c131810 legacy=0x7f078c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078bfff700 1 -- 172.21.15.19:0/3146983003 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c071d20 con 0x7f078c136f50 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078a7fc700 1 -- 172.21.15.19:0/3146983003 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286608603 0 0) 0x7f078c09b4f0 con 0x7f078c131810 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078bfff700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c136f50 0x7f078c139330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0784009e50 tx=0x7f078400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94eb9fa81ed182dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078a7fc700 1 -- 172.21.15.19:0/3146983003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400e070 con 0x7f078c136f50 2023-10-03T10:16:57.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078a7fc700 1 -- 172.21.15.19:0/3146983003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078400b910 con 0x7f078c136f50 2023-10-03T10:16:57.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.893+0000 7f078a7fc700 1 -- 172.21.15.19:0/3146983003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078400bcc0 con 0x7f078c136f50 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 -- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c136f50 msgr2=0x7f078c139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c136f50 0x7f078c139330 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f0784009e50 tx=0x7f078400b330 comp rx=0 tx=0).stop 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 -- 172.21.15.19:0/3146983003 shutdown_connections 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c136f50 0x7f078c139330 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 --2- 172.21.15.19:0/3146983003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 -- 172.21.15.19:0/3146983003 >> 172.21.15.19:0/3146983003 conn(0x7f078c0a2aa0 msgr2=0x7f078c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 -- 172.21.15.19:0/3146983003 shutdown_connections 2023-10-03T10:16:57.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.894+0000 7f0791c95700 1 -- 172.21.15.19:0/3146983003 wait complete. 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.895+0000 7f0791c95700 1 Processor -- start 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.895+0000 7f0791c95700 1 -- start start 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f078c136f50 0x7f078c119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c11bd10 con 0x7f078c131810 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f078c12eb00 con 0x7f078c136f50 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f0791c95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f078c11b010 con 0x7f078c134630 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41292/0 (socket says 172.21.15.19:41292) 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 -- 172.21.15.19:0/2065861193 learned_addr learned my addr 172.21.15.19:0/2065861193 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:57.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078bfff700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f078c136f50 0x7f078c119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078affd700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 -- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 msgr2=0x7f078c119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 -- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f078c136f50 msgr2=0x7f078c119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f078c136f50 0x7f078c119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.896+0000 7f078b7fe700 1 -- 172.21.15.19:0/2065861193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784009b30 con 0x7f078c131810 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f078b7fe700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c480 tx=0x7f077c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c0054e0 con 0x7f078c131810 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077c003680 con 0x7f078c131810 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c11c6a0 con 0x7f078c131810 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077c003a30 con 0x7f078c131810 2023-10-03T10:16:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.897+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c06eb00 con 0x7f078c131810 2023-10-03T10:16:57.901 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:57.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.898+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f077c003b90 con 0x7f078c131810 2023-10-03T10:16:57.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.898+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f077c03ebe0 con 0x7f078c131810 2023-10-03T10:16:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.898+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c074ea0 con 0x7f078c131810 2023-10-03T10:16:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.903+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f077c017030 con 0x7f078c131810 2023-10-03T10:16:57.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.964+0000 7f10f0c3a700 1 Processor -- start 2023-10-03T10:16:57.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.964+0000 7f10f0c3a700 1 -- start start 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10ec09d6f0 0x7f10ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 0x7f10ec133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec06b460 con 0x7f10ec09d6f0 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec09b120 con 0x7f10ec09e410 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10f0c3a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec09a7e0 con 0x7f10ec09e000 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10ead9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 0x7f10ec133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41870/0 (socket says 172.21.15.19:41870) 2023-10-03T10:16:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 -- 172.21.15.19:0/113812028 learned_addr learned my addr 172.21.15.19:0/113812028 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 -- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 msgr2=0x7f10ec133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 0x7f10ec133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 -- 172.21.15.19:0/113812028 >> v2:172.21.15.19:3300/0 conn(0x7f10ec09d6f0 msgr2=0x7f10ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.965+0000 7f10e9d9b700 1 --2- 172.21.15.19:0/113812028 >> v2:172.21.15.19:3300/0 conn(0x7f10ec09d6f0 0x7f10ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10e9d9b700 1 -- 172.21.15.19:0/113812028 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec09a500 con 0x7f10ec09e000 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10ead9d700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 0x7f10ec133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10e9d9b700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009920 tx=0x7f10e0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8337399d30aa6c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10e959a700 1 -- 172.21.15.19:0/113812028 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011830 con 0x7f10ec09e000 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10e959a700 1 -- 172.21.15.19:0/113812028 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0011990 con 0x7f10ec09e000 2023-10-03T10:16:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.966+0000 7f10e959a700 1 -- 172.21.15.19:0/113812028 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011d20 con 0x7f10ec09e000 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 -- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 msgr2=0x7f10ec1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10e0009920 tx=0x7f10e0009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 -- 172.21.15.19:0/113812028 shutdown_connections 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e410 0x7f10ec133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/113812028 >> v2:172.21.15.19:3300/0 conn(0x7f10ec09d6f0 0x7f10ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/113812028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09e000 0x7f10ec1339f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 -- 172.21.15.19:0/113812028 >> 172.21.15.19:0/113812028 conn(0x7f10ec066f50 msgr2=0x7f10ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:57.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 -- 172.21.15.19:0/113812028 shutdown_connections 2023-10-03T10:16:57.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.967+0000 7f10f0c3a700 1 -- 172.21.15.19:0/113812028 wait complete. 2023-10-03T10:16:57.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.969+0000 7f10f0c3a700 1 Processor -- start 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.969+0000 7f10f0c3a700 1 -- start start 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.969+0000 7f10f0c3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10f0c3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e000 0x7f10ec1a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10f0c3a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ec09e410 0x7f10ec1a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10f0c3a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1a6b20 con 0x7f10ec09e410 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10f0c3a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1a86b0 con 0x7f10ec09e000 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10f0c3a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0a21f0 con 0x7f10ec09d6f0 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41874/0 (socket says 172.21.15.19:41874) 2023-10-03T10:16:57.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 -- 172.21.15.19:0/2713863037 learned_addr learned my addr 172.21.15.19:0/2713863037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:57.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 -- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e000 msgr2=0x7f10ec1a53b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e000 0x7f10ec1a53b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 -- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ec09e410 msgr2=0x7f10ec1a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ec09e410 0x7f10ec1a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 -- 172.21.15.19:0/2713863037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e4009a70 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10ea59c700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00b530 tx=0x7f10dc00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.970+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc011830 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.971+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0119b0 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.971+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e0009550 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.971+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc011d60 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.971+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec1a7cd0 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.972+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10dc01a400 con 0x7f10ec09d6f0 2023-10-03T10:16:57.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.972+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec074ea0 con 0x7f10ec09d6f0 2023-10-03T10:16:57.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.972+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10dc03f7e0 con 0x7f10ec09d6f0 2023-10-03T10:16:57.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:57.981+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f10dc00f8d0 con 0x7f10ec09d6f0 2023-10-03T10:16:58.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.001+0000 7fad9ccb2700 1 Processor -- start 2023-10-03T10:16:58.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.001+0000 7fad9ccb2700 1 -- start start 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9ccb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 0x7fad9809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9ccb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad981317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9ccb2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad98070940 con 0x7fad9809f650 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9ccb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad9806fd60 con 0x7fad9809f240 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9ccb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad9806fa80 con 0x7fad9809e930 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad95d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad981317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad96d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fad9809f650 0x7fad98131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43514/0 (socket says 172.21.15.19:43514) 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad96d9d700 1 -- 172.21.15.19:0/3864018846 learned_addr learned my addr 172.21.15.19:0/3864018846 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:58.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9659c700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 0x7fad9809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9559a700 1 -- 172.21.15.19:0/3864018846 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1810502958 0 0) 0x7fad98070940 con 0x7fad9809f650 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.002+0000 7fad9559a700 1 -- 172.21.15.19:0/3864018846 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad800035b0 con 0x7fad9809f650 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9659c700 1 -- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 msgr2=0x7fad981317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9659c700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad981317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9659c700 1 -- 172.21.15.19:0/3864018846 >> v1:172.21.15.19:6789/0 conn(0x7fad9809f650 legacy=0x7fad98131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9659c700 1 -- 172.21.15.19:0/3864018846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9809fb60 con 0x7fad9809e930 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad95d9b700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad981317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9659c700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 0x7fad9809ed00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad88009870 tx=0x7fad88009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e74de0feb6a90476 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9559a700 1 -- 172.21.15.19:0/3864018846 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011830 con 0x7fad9809e930 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9559a700 1 -- 172.21.15.19:0/3864018846 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad88011990 con 0x7fad9809e930 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.003+0000 7fad9559a700 1 -- 172.21.15.19:0/3864018846 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88011d20 con 0x7fad9809e930 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 -- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 msgr2=0x7fad9809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 0x7fad9809ed00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fad88009870 tx=0x7fad88009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 -- 172.21.15.19:0/3864018846 shutdown_connections 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809e930 0x7fad9809ed00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/3864018846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad981317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 -- 172.21.15.19:0/3864018846 >> 172.21.15.19:0/3864018846 conn(0x7fad980a4210 msgr2=0x7fad980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 -- 172.21.15.19:0/3864018846 shutdown_connections 2023-10-03T10:16:58.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.004+0000 7fad9ccb2700 1 -- 172.21.15.19:0/3864018846 wait complete. 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.005+0000 7fad9ccb2700 1 Processor -- start 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.005+0000 7fad9ccb2700 1 -- start start 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad9809e930 0x7fad9806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad9806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad981a9740 con 0x7fad9809e930 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad981a89c0 con 0x7fad9809f240 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9ccb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad981a91b0 con 0x7fad9809f650 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41888/0 (socket says 172.21.15.19:41888) 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 -- 172.21.15.19:0/2264882075 learned_addr learned my addr 172.21.15.19:0/2264882075 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad95d9b700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad9806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad9659c700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad9809e930 0x7fad9806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 -- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 msgr2=0x7fad9806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad9806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 -- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad9809e930 msgr2=0x7fad9806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad9809e930 0x7fad9806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.006+0000 7fad96d9d700 1 -- 172.21.15.19:0/2264882075 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0094a0 con 0x7fad9809f650 2023-10-03T10:16:58.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad96d9d700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fad9000cbb0 tx=0x7fad9000cec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000aaa0 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000ac00 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad90012400 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad880094a0 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.007+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad980a0190 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.008+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad90012560 con 0x7fad9809f650 2023-10-03T10:16:58.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.008+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad981a0b30 con 0x7fad9809f650 2023-10-03T10:16:58.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.008+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad9003f380 con 0x7fad9809f650 2023-10-03T10:16:58.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.013+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad90017070 con 0x7fad9809f650 2023-10-03T10:16:58.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.084+0000 7fac0ccc9700 1 Processor -- start 2023-10-03T10:16:58.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.084+0000 7fac0ccc9700 1 -- start start 2023-10-03T10:16:58.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac0ccc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac080a0a30 0x7fac080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac0ccc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac0ccc9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac080a2a70 con 0x7fac08133930 2023-10-03T10:16:58.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac0ccc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac080a01d0 con 0x7fac080a0a30 2023-10-03T10:16:58.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac0ccc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac0809e2b0 con 0x7fac0809d630 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac05d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac05d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41890/0 (socket says 172.21.15.19:41890) 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.085+0000 7fac05d9b700 1 -- 172.21.15.19:0/3073234595 learned_addr learned my addr 172.21.15.19:0/3073234595 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac0659c700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac080a0a30 0x7fac080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac05d9b700 1 -- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac080a0a30 msgr2=0x7fac080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac0559a700 1 -- 172.21.15.19:0/3073234595 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983907230 0 0) 0x7fac080a2a70 con 0x7fac08133930 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac05d9b700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac080a0a30 0x7fac080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac05d9b700 1 -- 172.21.15.19:0/3073234595 >> v1:172.21.15.19:6789/0 conn(0x7fac08133930 legacy=0x7fac08133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac05d9b700 1 -- 172.21.15.19:0/3073234595 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0809dc50 con 0x7fac0809d630 2023-10-03T10:16:58.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac05d9b700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009920 tx=0x7fabfc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc85d82e9c53ab38 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac0559a700 1 -- 172.21.15.19:0/3073234595 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc00ba60 con 0x7fac0809d630 2023-10-03T10:16:58.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac0559a700 1 -- 172.21.15.19:0/3073234595 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc00bbc0 con 0x7fac0809d630 2023-10-03T10:16:58.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.086+0000 7fac0559a700 1 -- 172.21.15.19:0/3073234595 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc009e70 con 0x7fac0809d630 2023-10-03T10:16:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 -- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 msgr2=0x7fac080a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009920 tx=0x7fabfc009c30 comp rx=0 tx=0).stop 2023-10-03T10:16:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 -- 172.21.15.19:0/3073234595 shutdown_connections 2023-10-03T10:16:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac080a0a30 0x7fac080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 --2- 172.21.15.19:0/3073234595 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac0809d630 0x7fac080a1340 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 -- 172.21.15.19:0/3073234595 >> 172.21.15.19:0/3073234595 conn(0x7fac080a3050 msgr2=0x7fac080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 -- 172.21.15.19:0/3073234595 shutdown_connections 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.087+0000 7fac0ccc9700 1 -- 172.21.15.19:0/3073234595 wait complete. 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.089+0000 7fac0ccc9700 1 Processor -- start 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.089+0000 7fac0ccc9700 1 -- start start 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac0809d630 0x7fac081c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 0x7fac081c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac08120c50 con 0x7fac080a0a30 2023-10-03T10:16:58.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac08133710 con 0x7fac0809d630 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac0ccc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fac081bcf00 con 0x7fac08133930 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac06d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac06d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41892/0 (socket says 172.21.15.19:41892) 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac06d9d700 1 -- 172.21.15.19:0/2199536309 learned_addr learned my addr 172.21.15.19:0/2199536309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 0x7fac081c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 -- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 msgr2=0x7fac0811e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 -- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac0809d630 msgr2=0x7fac081c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac0809d630 0x7fac081c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.090+0000 7fac05d9b700 1 -- 172.21.15.19:0/2199536309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc009550 con 0x7fac080a0a30 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fac06d9d700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fac05d9b700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 0x7fac081c8880 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabfc016000 tx=0x7fabfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc004510 con 0x7fac080a0a30 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabfc0036a0 con 0x7fac080a0a30 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fac0ccc9700 1 -- 172.21.15.19:0/2199536309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac080a5d70 con 0x7fac080a0a30 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabfc003a50 con 0x7fac080a0a30 2023-10-03T10:16:58.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.091+0000 7fac0ccc9700 1 -- 172.21.15.19:0/2199536309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac08121fe0 con 0x7fac080a0a30 2023-10-03T10:16:58.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.092+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fabfc021070 con 0x7fac080a0a30 2023-10-03T10:16:58.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.092+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe00052e0 con 0x7fac080a0a30 2023-10-03T10:16:58.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.093+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fabfc040ad0 con 0x7fac080a0a30 2023-10-03T10:16:58.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.101+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fabfc0193b0 con 0x7fac080a0a30 2023-10-03T10:16:58.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.125+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f078c11c420 con 0x7f078c131810 2023-10-03T10:16:58.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.125+0000 7f0773fff700 1 -- 172.21.15.19:0/2065861193 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f077c003e40 con 0x7f078c131810 2023-10-03T10:16:58.126 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 msgr2=0x7f078c118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f077c00c480 tx=0x7f077c00c790 comp rx=0 tx=0).stop 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 shutdown_connections 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f078c136f50 0x7f078c119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f078c131810 0x7f078c118cd0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 --2- 172.21.15.19:0/2065861193 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f078c134630 0x7f078c119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 >> 172.21.15.19:0/2065861193 conn(0x7f078c0a2aa0 msgr2=0x7f078c0a09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 shutdown_connections 2023-10-03T10:16:58.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.129+0000 7f0791c95700 1 -- 172.21.15.19:0/2065861193 wait complete. 2023-10-03T10:16:58.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.232+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad981a8d60 con 0x7fad9809f650 2023-10-03T10:16:58.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.233+0000 7fad86ffd700 1 -- 172.21.15.19:0/2264882075 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad9001b3b0 con 0x7fad9809f650 2023-10-03T10:16:58.234 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:58.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 msgr2=0x7fad9806c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fad9000cbb0 tx=0x7fad9000cec0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 shutdown_connections 2023-10-03T10:16:58.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad9809f650 0x7fad9806c300 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad9809e930 0x7fad9806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 --2- 172.21.15.19:0/2264882075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad9809f240 0x7fad9806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 >> 172.21.15.19:0/2264882075 conn(0x7fad980a4210 msgr2=0x7fad981b8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 shutdown_connections 2023-10-03T10:16:58.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.235+0000 7fad9ccb2700 1 -- 172.21.15.19:0/2264882075 wait complete. 2023-10-03T10:16:58.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.243+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10ec1a8320 con 0x7f10ec09d6f0 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.243+0000 7f10daffd700 1 -- 172.21.15.19:0/2713863037 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10dc015030 con 0x7f10ec09d6f0 2023-10-03T10:16:58.244 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:58.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 msgr2=0x7f10ec1a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00b530 tx=0x7f10dc00b8f0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 shutdown_connections 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ec09e410 0x7f10ec1a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10ec09d6f0 0x7f10ec1a4e70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 --2- 172.21.15.19:0/2713863037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10ec09e000 0x7f10ec1a53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 >> 172.21.15.19:0/2713863037 conn(0x7f10ec066f50 msgr2=0x7f10ec1bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 shutdown_connections 2023-10-03T10:16:58.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.247+0000 7f10f0c3a700 1 -- 172.21.15.19:0/2713863037 wait complete. 2023-10-03T10:16:58.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:58.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:16:58.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.320+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fabe0005590 con 0x7fac080a0a30 2023-10-03T10:16:58.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.320+0000 7fabf6ffd700 1 -- 172.21.15.19:0/2199536309 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabfc015020 con 0x7fac080a0a30 2023-10-03T10:16:58.321 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 msgr2=0x7fac081c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 0x7fac081c8880 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fabfc016000 tx=0x7fabfc004750 comp rx=0 tx=0).stop 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 shutdown_connections 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fac08133930 0x7fac0811e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fac0809d630 0x7fac081c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 --2- 172.21.15.19:0/2199536309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac080a0a30 0x7fac081c8880 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:58.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 >> 172.21.15.19:0/2199536309 conn(0x7fac080a3050 msgr2=0x7fac0809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 shutdown_connections 2023-10-03T10:16:58.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:58.323+0000 7fabf4ff9700 1 -- 172.21.15.19:0/2199536309 wait complete. 2023-10-03T10:16:58.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:59.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:16:59.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:16:59.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.300+0000 7fa567829700 1 Processor -- start 2023-10-03T10:16:59.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.300+0000 7fa567829700 1 -- start start 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 0x7fa56009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa56009e000 0x7fa560130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56009f520 con 0x7fa56009e000 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009f130 con 0x7fa56009d6f0 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa567829700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009e930 con 0x7fa56009e410 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa56009e000 0x7fa560130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa56009e000 0x7fa560130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41332/0 (socket says 172.21.15.19:41332) 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 -- 172.21.15.19:0/548127132 learned_addr learned my addr 172.21.15.19:0/548127132 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa5655c5700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 0x7fa56009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa565dc6700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 -- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 msgr2=0x7fa560130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 -- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 msgr2=0x7fa56009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 0x7fa56009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa564dc4700 1 -- 172.21.15.19:0/548127132 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56009b2d0 con 0x7fa56009e000 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa565dc6700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.301+0000 7fa5655c5700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 0x7fa56009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.302+0000 7fa564dc4700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009e000 0x7fa560130660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa55000bbc0 tx=0x7fa55000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7e3f3d74dd91e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.302+0000 7fa557fff700 1 -- 172.21.15.19:0/548127132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55000dcf0 con 0x7fa56009e000 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.302+0000 7fa557fff700 1 -- 172.21.15.19:0/548127132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55000de50 con 0x7fa56009e000 2023-10-03T10:16:59.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.302+0000 7fa557fff700 1 -- 172.21.15.19:0/548127132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550010690 con 0x7fa56009e000 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 -- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009e000 msgr2=0x7fa560130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009e000 0x7fa560130660 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa55000bbc0 tx=0x7fa55000bed0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 -- 172.21.15.19:0/548127132 shutdown_connections 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009d6f0 0x7fa56009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 --2- 172.21.15.19:0/548127132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009e000 0x7fa560130660 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 -- 172.21.15.19:0/548127132 >> 172.21.15.19:0/548127132 conn(0x7fa560066f50 msgr2=0x7fa56009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 -- 172.21.15.19:0/548127132 shutdown_connections 2023-10-03T10:16:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.303+0000 7fa567829700 1 -- 172.21.15.19:0/548127132 wait complete. 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 Processor -- start 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 -- start start 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 0x7fa560122530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56009c770 con 0x7fa56009d6f0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601242c0 con 0x7fa56009e000 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.304+0000 7fa567829700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600a1b60 con 0x7fa56009e410 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55818/0 (socket says 172.21.15.19:55818) 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 -- 172.21.15.19:0/2646504444 learned_addr learned my addr 172.21.15.19:0/2646504444 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa5655c5700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 0x7fa560122530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 -- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 msgr2=0x7fa560122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 -- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 msgr2=0x7fa560122530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 0x7fa560122530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 -- 172.21.15.19:0/2646504444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0094a0 con 0x7fa56009e000 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa5655c5700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 0x7fa560122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa564dc4700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa550004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550003bf0 con 0x7fa56009e000 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.305+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa550003d50 con 0x7fa56009e000 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.306+0000 7fa567829700 1 -- 172.21.15.19:0/2646504444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55000b7f0 con 0x7fa56009e000 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.306+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa550010690 con 0x7fa56009e000 2023-10-03T10:16:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.306+0000 7fa567829700 1 -- 172.21.15.19:0/2646504444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560124930 con 0x7fa56009e000 2023-10-03T10:16:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.307+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5380052e0 con 0x7fa56009e000 2023-10-03T10:16:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.308+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa550019400 con 0x7fa56009e000 2023-10-03T10:16:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.308+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa550040fc0 con 0x7fa56009e000 2023-10-03T10:16:59.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.313+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa55000e720 con 0x7fa56009e000 2023-10-03T10:16:59.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:16:59.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 Processor -- start 2023-10-03T10:16:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 -- start start 2023-10-03T10:16:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f145006e570 0x7f145006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 0x7f145006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1450070ee0 con 0x7f1450134610 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1450071480 con 0x7f145006e570 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.396+0000 7f1455e69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145006f3c0 con 0x7f145009eca0 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 0x7f145006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f145006e570 0x7f145006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1450134610 0x7f1450134ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43528/0 (socket says 172.21.15.19:43528) 2023-10-03T10:16:59.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144ffff700 1 -- 172.21.15.19:0/3370774430 learned_addr learned my addr 172.21.15.19:0/3370774430 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144e7fc700 1 -- 172.21.15.19:0/3370774430 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1457729794 0 0) 0x7f1450070ee0 con 0x7f1450134610 2023-10-03T10:16:59.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 -- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f145006e570 msgr2=0x7f145006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 --2- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f145006e570 0x7f145006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 -- 172.21.15.19:0/3370774430 >> v1:172.21.15.19:6789/0 conn(0x7f1450134610 legacy=0x7f1450134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 -- 172.21.15.19:0/3370774430 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1450071b90 con 0x7f145009eca0 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.397+0000 7f144effd700 1 --2- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 0x7f145006ee80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1444009870 tx=0x7f1444009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=222c58909224319f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f144e7fc700 1 -- 172.21.15.19:0/3370774430 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444011830 con 0x7f145009eca0 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f144e7fc700 1 -- 172.21.15.19:0/3370774430 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444011990 con 0x7f145009eca0 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f144e7fc700 1 -- 172.21.15.19:0/3370774430 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444011d20 con 0x7f145009eca0 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 -- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 msgr2=0x7f145006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 --2- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 0x7f145006ee80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1444009870 tx=0x7f1444009b80 comp rx=0 tx=0).stop 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 -- 172.21.15.19:0/3370774430 shutdown_connections 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 --2- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f145006e570 0x7f145006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 --2- 172.21.15.19:0/3370774430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f145009eca0 0x7f145006ee80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.398+0000 7f1455e69700 1 -- 172.21.15.19:0/3370774430 >> 172.21.15.19:0/3370774430 conn(0x7f14500a2aa0 msgr2=0x7f14500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.399+0000 7f1455e69700 1 -- 172.21.15.19:0/3370774430 shutdown_connections 2023-10-03T10:16:59.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.399+0000 7f1455e69700 1 -- 172.21.15.19:0/3370774430 wait complete. 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 Processor -- start 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 -- start start 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1450134610 0x7f1450133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 0x7f14501335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1450070610 con 0x7f145006e570 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1450134330 con 0x7f1450134610 2023-10-03T10:16:59.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.400+0000 7f1455e69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f145013dcd0 con 0x7f14501406e0 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 0x7f14501335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41354/0 (socket says 172.21.15.19:41354) 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 -- 172.21.15.19:0/4209311722 learned_addr learned my addr 172.21.15.19:0/4209311722 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144effd700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1450134610 0x7f1450133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 -- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 msgr2=0x7f14501335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 0x7f14501335c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 -- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1450134610 msgr2=0x7f1450133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1450134610 0x7f1450133080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 -- 172.21.15.19:0/4209311722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440094a0 con 0x7f145006e570 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144ffff700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 0x7f14501335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f144f7fe700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f144000e8a0 tx=0x7f144000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440009590 con 0x7f145006e570 2023-10-03T10:16:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.401+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440013680 con 0x7f145006e570 2023-10-03T10:16:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.402+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145013d010 con 0x7f145006e570 2023-10-03T10:16:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.402+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400139f0 con 0x7f145006e570 2023-10-03T10:16:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.402+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145013d9f0 con 0x7f145006e570 2023-10-03T10:16:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.403+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1440013b50 con 0x7f145006e570 2023-10-03T10:16:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.403+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1450074ea0 con 0x7f145006e570 2023-10-03T10:16:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.403+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f144003f890 con 0x7f145006e570 2023-10-03T10:16:59.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.412+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1440021080 con 0x7f145006e570 2023-10-03T10:16:59.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.448+0000 7f2098d9e700 1 Processor -- start 2023-10-03T10:16:59.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.448+0000 7f2098d9e700 1 -- start start 2023-10-03T10:16:59.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.449+0000 7f2098d9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 0x7f20940a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.449+0000 7f2098d9e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 0x7f209413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.449+0000 7f2098d9e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20940a2a70 con 0x7f20940a0a30 2023-10-03T10:16:59.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.449+0000 7f2098d9e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20940a01d0 con 0x7f2094138d80 2023-10-03T10:16:59.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.449+0000 7f2098d9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209409e2b0 con 0x7f209409d630 2023-10-03T10:16:59.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 0x7f20940a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f20940a0a30 0x7f20940a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43540/0 (socket says 172.21.15.19:43540) 2023-10-03T10:16:59.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209259c700 1 -- 172.21.15.19:0/2999833460 learned_addr learned my addr 172.21.15.19:0/2999833460 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:16:59.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2092d9d700 1 --2- 172.21.15.19:0/2999833460 >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 0x7f209413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 -- 172.21.15.19:0/2999833460 >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 msgr2=0x7f209413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 --2- 172.21.15.19:0/2999833460 >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 0x7f209413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 -- 172.21.15.19:0/2999833460 >> v1:172.21.15.19:6789/0 conn(0x7f20940a0a30 legacy=0x7f20940a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209159a700 1 -- 172.21.15.19:0/2999833460 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910437391 0 0) 0x7f20940a2a70 con 0x7f20940a0a30 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 -- 172.21.15.19:0/2999833460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209409dc50 con 0x7f209409d630 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2092d9d700 1 --2- 172.21.15.19:0/2999833460 >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 0x7f209413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f2091d9b700 1 --2- 172.21.15.19:0/2999833460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 0x7f20940a1510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2088009840 tx=0x7f2088009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddb38b3cf629ea88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209159a700 1 -- 172.21.15.19:0/2999833460 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011830 con 0x7f209409d630 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209159a700 1 -- 172.21.15.19:0/2999833460 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088011990 con 0x7f209409d630 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.450+0000 7f209159a700 1 -- 172.21.15.19:0/2999833460 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088011d20 con 0x7f209409d630 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 -- 172.21.15.19:0/2999833460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 msgr2=0x7f20940a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 --2- 172.21.15.19:0/2999833460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 0x7f20940a1510 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2088009840 tx=0x7f2088009b50 comp rx=0 tx=0).stop 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 -- 172.21.15.19:0/2999833460 shutdown_connections 2023-10-03T10:16:59.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 --2- 172.21.15.19:0/2999833460 >> v2:172.21.15.19:3300/0 conn(0x7f2094138d80 0x7f209413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 --2- 172.21.15.19:0/2999833460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f209409d630 0x7f20940a1510 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 -- 172.21.15.19:0/2999833460 >> 172.21.15.19:0/2999833460 conn(0x7f20940a3050 msgr2=0x7f20940a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 -- 172.21.15.19:0/2999833460 shutdown_connections 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.451+0000 7f2098d9e700 1 -- 172.21.15.19:0/2999833460 wait complete. 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.453+0000 7f2098d9e700 1 Processor -- start 2023-10-03T10:16:59.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.453+0000 7f2098d9e700 1 -- start start 2023-10-03T10:16:59.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f209409d630 0x7f20941cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2094138d80 0x7f209406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2094071550 con 0x7f2094138d80 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f209413aca0 con 0x7f20940a0a30 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2098d9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20940a0410 con 0x7f209409d630 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2091d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2091d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55846/0 (socket says 172.21.15.19:55846) 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2091d9b700 1 -- 172.21.15.19:0/3116897240 learned_addr learned my addr 172.21.15.19:0/3116897240 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f2092d9d700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2094138d80 0x7f209406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.454+0000 7f209259c700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f209409d630 0x7f20941cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 -- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f209409d630 msgr2=0x7f20941cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f209409d630 0x7f20941cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 -- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2094138d80 msgr2=0x7f209406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2094138d80 0x7f209406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 -- 172.21.15.19:0/3116897240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c009a70 con 0x7f20940a0a30 2023-10-03T10:16:59.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.455+0000 7f2091d9b700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2088009fd0 tx=0x7f2088004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.456+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20880038a0 con 0x7f20940a0a30 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.456+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208801f070 con 0x7f20940a0a30 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.456+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088003c00 con 0x7f20940a0a30 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.456+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20880094a0 con 0x7f20940a0a30 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.456+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20941336e0 con 0x7f20940a0a30 2023-10-03T10:16:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.457+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20940747f0 con 0x7f20940a0a30 2023-10-03T10:16:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.458+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f208801a430 con 0x7f20940a0a30 2023-10-03T10:16:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.458+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2088021070 con 0x7f20940a0a30 2023-10-03T10:16:59.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.468+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2088010380 con 0x7f20940a0a30 2023-10-03T10:16:59.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.498+0000 7f0babfdb700 1 Processor -- start 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 -- start start 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 0x7f0ba4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba409f130 con 0x7f0ba409e410 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba409f520 con 0x7f0ba409e000 2023-10-03T10:16:59.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.499+0000 7f0babfdb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba409e930 con 0x7f0ba409d6f0 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41930/0 (socket says 172.21.15.19:41930) 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 -- 172.21.15.19:0/2293535414 learned_addr learned my addr 172.21.15.19:0/2293535414 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9576700 1 --2- 172.21.15.19:0/2293535414 >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 0x7f0ba4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 -- 172.21.15.19:0/2293535414 >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 msgr2=0x7f0ba4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 --2- 172.21.15.19:0/2293535414 >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 0x7f0ba4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 -- 172.21.15.19:0/2293535414 >> v1:172.21.15.19:6789/0 conn(0x7f0ba409e410 legacy=0x7f0ba4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 -- 172.21.15.19:0/2293535414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba409b2d0 con 0x7f0ba409d6f0 2023-10-03T10:16:59.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9576700 1 --2- 172.21.15.19:0/2293535414 >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 0x7f0ba4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:59.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.500+0000 7f0ba9d77700 1 --2- 172.21.15.19:0/2293535414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000bb90 tx=0x7f0ba000bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac463a2fbc5097a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.501+0000 7f0ba8d75700 1 -- 172.21.15.19:0/2293535414 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba000dd50 con 0x7f0ba409d6f0 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.501+0000 7f0ba8d75700 1 -- 172.21.15.19:0/2293535414 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0010470 con 0x7f0ba409d6f0 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.501+0000 7f0ba8d75700 1 -- 172.21.15.19:0/2293535414 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0010800 con 0x7f0ba409d6f0 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 -- 172.21.15.19:0/2293535414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 msgr2=0x7f0ba409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2293535414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0ba000bb90 tx=0x7f0ba000bea0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 -- 172.21.15.19:0/2293535414 shutdown_connections 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2293535414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba409dac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2293535414 >> v2:172.21.15.19:3300/0 conn(0x7f0ba409e000 0x7f0ba4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 -- 172.21.15.19:0/2293535414 >> 172.21.15.19:0/2293535414 conn(0x7f0ba4066f50 msgr2=0x7f0ba409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 -- 172.21.15.19:0/2293535414 shutdown_connections 2023-10-03T10:16:59.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.502+0000 7f0babfdb700 1 -- 172.21.15.19:0/2293535414 wait complete. 2023-10-03T10:16:59.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.503+0000 7f0babfdb700 1 Processor -- start 2023-10-03T10:16:59.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.503+0000 7f0babfdb700 1 -- start start 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.503+0000 7f0babfdb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba411dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.503+0000 7f0babfdb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 0x7f0ba411e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.503+0000 7f0babfdb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0babfdb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba411fd10 con 0x7f0ba409e410 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0babfdb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba411fb20 con 0x7f0ba409e000 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0babfdb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40a1d90 con 0x7f0ba409d6f0 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41380/0 (socket says 172.21.15.19:41380) 2023-10-03T10:16:59.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 -- 172.21.15.19:0/2564896401 learned_addr learned my addr 172.21.15.19:0/2564896401 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:16:59.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0ba9d77700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba411dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 -- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 msgr2=0x7f0ba411dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba411dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0baa578700 1 -- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 msgr2=0x7f0ba411e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.504+0000 7f0ba9576700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 0x7f0ba411e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.505+0000 7f0baa578700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 0x7f0ba411e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.505+0000 7f0baa578700 1 -- 172.21.15.19:0/2564896401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba000b7f0 con 0x7f0ba409e410 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.505+0000 7f0ba9576700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 0x7f0ba411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.505+0000 7f0baa578700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00cbf0 tx=0x7f0b9c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.506+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c003c00 con 0x7f0ba409e410 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.506+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9c003d60 con 0x7f0ba409e410 2023-10-03T10:16:59.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.506+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c00ac20 con 0x7f0ba409e410 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.506+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba409c700 con 0x7f0ba409e410 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.506+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba4120310 con 0x7f0ba409e410 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.507+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba4074ea0 con 0x7f0ba409e410 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.507+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b9c0050d0 con 0x7f0ba409e410 2023-10-03T10:16:59.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.507+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b9c03f780 con 0x7f0ba409e410 2023-10-03T10:16:59.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.516+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b9c00ad80 con 0x7f0ba409e410 2023-10-03T10:16:59.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.539+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa538005860 con 0x7fa56009e000 2023-10-03T10:16:59.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.539+0000 7fa555ffb700 1 -- 172.21.15.19:0/2646504444 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa55000e360 con 0x7fa56009e000 2023-10-03T10:16:59.540 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 msgr2=0x7fa560122a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa550004750 comp rx=0 tx=0).stop 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 shutdown_connections 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa56009e410 0x7fa560122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa56009d6f0 0x7fa560122530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 --2- 172.21.15.19:0/2646504444 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa56009e000 0x7fa560122a70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 >> 172.21.15.19:0/2646504444 conn(0x7fa560066f50 msgr2=0x7fa56006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 shutdown_connections 2023-10-03T10:16:59.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.542+0000 7fa54b7fe700 1 -- 172.21.15.19:0/2646504444 wait complete. 2023-10-03T10:16:59.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:16:59.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.686+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1450071100 con 0x7f145006e570 2023-10-03T10:16:59.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.687+0000 7f1437fff700 1 -- 172.21.15.19:0/4209311722 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1440017020 con 0x7f145006e570 2023-10-03T10:16:59.688 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:16:59.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 msgr2=0x7f14501401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f144000e8a0 tx=0x7f144000ebb0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 shutdown_connections 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14501406e0 0x7f14501335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f145006e570 0x7f14501401a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 --2- 172.21.15.19:0/4209311722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1450134610 0x7f1450133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.689+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 >> 172.21.15.19:0/4209311722 conn(0x7f14500a2aa0 msgr2=0x7f1450137ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.690+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 shutdown_connections 2023-10-03T10:16:59.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.690+0000 7f1455e69700 1 -- 172.21.15.19:0/4209311722 wait complete. 2023-10-03T10:16:59.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:16:59.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.722+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0ba406c360 con 0x7f0ba409e410 2023-10-03T10:16:59.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.722+0000 7f0b9a7fc700 1 -- 172.21.15.19:0/2564896401 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b9c019300 con 0x7f0ba409e410 2023-10-03T10:16:59.724 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:16:59.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.723+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2094071120 con 0x7f20940a0a30 2023-10-03T10:16:59.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.723+0000 7f2082ffd700 1 -- 172.21.15.19:0/3116897240 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f208802eb90 con 0x7f20940a0a30 2023-10-03T10:16:59.724 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 msgr2=0x7f0ba411ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00cbf0 tx=0x7f0b9c00a060 comp rx=0 tx=0).stop 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 shutdown_connections 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ba409e410 0x7f0ba411ea30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ba409d6f0 0x7f0ba411dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 --2- 172.21.15.19:0/2564896401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ba409e000 0x7f0ba411e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 >> 172.21.15.19:0/2564896401 conn(0x7f0ba4066f50 msgr2=0x7f0ba40710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 shutdown_connections 2023-10-03T10:16:59.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.725+0000 7f0babfdb700 1 -- 172.21.15.19:0/2564896401 wait complete. 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 msgr2=0x7f20941ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2088009fd0 tx=0x7f2088004750 comp rx=0 tx=0).stop 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 shutdown_connections 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2094138d80 0x7f209406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f209409d630 0x7f20941cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 --2- 172.21.15.19:0/3116897240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20940a0a30 0x7f20941ccdf0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 >> 172.21.15.19:0/3116897240 conn(0x7f20940a3050 msgr2=0x7f20940a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 shutdown_connections 2023-10-03T10:16:59.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:16:59.726+0000 7f2098d9e700 1 -- 172.21.15.19:0/3116897240 wait complete. 2023-10-03T10:16:59.741 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:16:59.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:00.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 Processor -- start 2023-10-03T10:17:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 -- start start 2023-10-03T10:17:00.705 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 0x7f779809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 0x7f77981317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7798070940 con 0x7f779809f650 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779806fd60 con 0x7f779809e930 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779f8f6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779806fa80 con 0x7f779809f240 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779de93700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f779809f650 0x7f7798131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43556/0 (socket says 172.21.15.19:43556) 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.704+0000 7f779d692700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 0x7f779809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779de93700 1 -- 172.21.15.19:0/1027240963 learned_addr learned my addr 172.21.15.19:0/1027240963 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 0x7f77981317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f778ffff700 1 -- 172.21.15.19:0/1027240963 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330171451 0 0) 0x7f7798070940 con 0x7f779809f650 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f778ffff700 1 -- 172.21.15.19:0/1027240963 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77840035b0 con 0x7f779809f650 2023-10-03T10:17:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 -- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 msgr2=0x7f779809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 0x7f779809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 -- 172.21.15.19:0/1027240963 >> v1:172.21.15.19:6789/0 conn(0x7f779809f650 legacy=0x7f7798131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 -- 172.21.15.19:0/1027240963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779809fb60 con 0x7f779809f240 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779d692700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 0x7f779809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f779ce91700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 0x7f77981317f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f7788009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f294e7af519d9232 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f778ffff700 1 -- 172.21.15.19:0/1027240963 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788011830 con 0x7f779809f240 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f778ffff700 1 -- 172.21.15.19:0/1027240963 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788011990 con 0x7f779809f240 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.705+0000 7f778ffff700 1 -- 172.21.15.19:0/1027240963 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788011d20 con 0x7f779809f240 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 -- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 msgr2=0x7f77981317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 0x7f77981317f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7788009870 tx=0x7f7788009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 -- 172.21.15.19:0/1027240963 shutdown_connections 2023-10-03T10:17:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809e930 0x7f779809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 --2- 172.21.15.19:0/1027240963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809f240 0x7f77981317f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 -- 172.21.15.19:0/1027240963 >> 172.21.15.19:0/1027240963 conn(0x7f77980a4210 msgr2=0x7f77980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 -- 172.21.15.19:0/1027240963 shutdown_connections 2023-10-03T10:17:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.706+0000 7f779f8f6700 1 -- 172.21.15.19:0/1027240963 wait complete. 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.707+0000 7f779f8f6700 1 Processor -- start 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.707+0000 7f779f8f6700 1 -- start start 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809e930 0x7f77981a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809f650 0x7f77981a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981a5de0 con 0x7f779809f240 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77981a76a0 con 0x7f779809f650 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779f8f6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77981a6a70 con 0x7f779809e930 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779ce91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779de93700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809f650 0x7f77981a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779ce91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41382/0 (socket says 172.21.15.19:41382) 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779ce91700 1 -- 172.21.15.19:0/2665191918 learned_addr learned my addr 172.21.15.19:0/2665191918 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.708+0000 7f779d692700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809e930 0x7f77981a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 -- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809e930 msgr2=0x7f77981a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809e930 0x7f77981a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 -- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809f650 msgr2=0x7f77981a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809f650 0x7f77981a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 -- 172.21.15.19:0/2665191918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77940094a0 con 0x7f779809f240 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779ce91700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f77880090b0 tx=0x7f7788004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788011dc0 con 0x7f779809f240 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788004040 con 0x7f779809f240 2023-10-03T10:17:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77880094a0 con 0x7f779809f240 2023-10-03T10:17:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.709+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77880043f0 con 0x7f779809f240 2023-10-03T10:17:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.710+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980a0190 con 0x7f779809f240 2023-10-03T10:17:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.711+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77981a7060 con 0x7f779809f240 2023-10-03T10:17:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.711+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f778802a070 con 0x7f779809f240 2023-10-03T10:17:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.711+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7788048af0 con 0x7f779809f240 2023-10-03T10:17:00.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.717+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77981a7060 con 0x7f779809f240 2023-10-03T10:17:00.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:00.742 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.852+0000 7ff4831f7700 1 Processor -- start 2023-10-03T10:17:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 -- start start 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff47c09d6f0 0x7ff47c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e440 0x7ff47c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c09b120 con 0x7ff47c09e000 2023-10-03T10:17:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c06b460 con 0x7ff47c09d6f0 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff4831f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c09a7e0 con 0x7ff47c09e440 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff47bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff47c09e000 0x7ff47c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43572/0 (socket says 172.21.15.19:43572) 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff47bfff700 1 -- 172.21.15.19:0/1163045324 learned_addr learned my addr 172.21.15.19:0/1163045324 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.853+0000 7ff480f93700 1 --2- 172.21.15.19:0/1163045324 >> v2:172.21.15.19:3300/0 conn(0x7ff47c09d6f0 0x7ff47c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff481794700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e440 0x7ff47c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff480f93700 1 -- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e440 msgr2=0x7ff47c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff480f93700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e440 0x7ff47c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff480f93700 1 -- 172.21.15.19:0/1163045324 >> v1:172.21.15.19:6789/0 conn(0x7ff47c09e000 legacy=0x7ff47c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff480f93700 1 -- 172.21.15.19:0/1163045324 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c09a500 con 0x7ff47c09d6f0 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff47b7fe700 1 -- 172.21.15.19:0/1163045324 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137822593 0 0) 0x7ff47c09b120 con 0x7ff47c09e000 2023-10-03T10:17:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff480f93700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09d6f0 0x7ff47c09dac0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff470009870 tx=0x7ff470009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4200766f50fa552 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff47b7fe700 1 -- 172.21.15.19:0/1163045324 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470011830 con 0x7ff47c09d6f0 2023-10-03T10:17:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff47b7fe700 1 -- 172.21.15.19:0/1163045324 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470011990 con 0x7ff47c09d6f0 2023-10-03T10:17:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.854+0000 7ff47b7fe700 1 -- 172.21.15.19:0/1163045324 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470011d20 con 0x7ff47c09d6f0 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 -- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09d6f0 msgr2=0x7ff47c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09d6f0 0x7ff47c09dac0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff470009870 tx=0x7ff470009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 -- 172.21.15.19:0/1163045324 shutdown_connections 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e440 0x7ff47c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 --2- 172.21.15.19:0/1163045324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09d6f0 0x7ff47c09dac0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 -- 172.21.15.19:0/1163045324 >> 172.21.15.19:0/1163045324 conn(0x7ff47c066f50 msgr2=0x7ff47c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 -- 172.21.15.19:0/1163045324 shutdown_connections 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.855+0000 7ff4831f7700 1 -- 172.21.15.19:0/1163045324 wait complete. 2023-10-03T10:17:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.857+0000 7ff4831f7700 1 Processor -- start 2023-10-03T10:17:00.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.857+0000 7ff4831f7700 1 -- start start 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff47c09d6f0 0x7ff47c1a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 0x7ff47c1a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1a8570 con 0x7ff47c09e440 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c09c780 con 0x7ff47c09e000 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff4831f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1b93e0 con 0x7ff47c09d6f0 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41396/0 (socket says 172.21.15.19:41396) 2023-10-03T10:17:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 -- 172.21.15.19:0/504261112 learned_addr learned my addr 172.21.15.19:0/504261112 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff47bfff700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 0x7ff47c1a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 -- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff47c09d6f0 msgr2=0x7ff47c1a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff47c09d6f0 0x7ff47c1a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 -- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 msgr2=0x7ff47c1a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 0x7ff47c1a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff481794700 1 -- 172.21.15.19:0/504261112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4700094a0 con 0x7ff47c09e440 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.858+0000 7ff47bfff700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 0x7ff47c1a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff481794700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff474007e40 tx=0x7ff47400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47400ede0 con 0x7ff47c09e440 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff474014420 con 0x7ff47c09e440 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4740147d0 con 0x7ff47c09e440 2023-10-03T10:17:00.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c1a5f20 con 0x7ff47c09e440 2023-10-03T10:17:00.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.859+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c1a6650 con 0x7ff47c09e440 2023-10-03T10:17:00.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.860+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c1a83b0 con 0x7ff47c09e440 2023-10-03T10:17:00.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.860+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff474014930 con 0x7ff47c09e440 2023-10-03T10:17:00.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.861+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff47403fc20 con 0x7ff47c09e440 2023-10-03T10:17:00.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.865+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4740122e0 con 0x7ff47c09e440 2023-10-03T10:17:00.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.886+0000 7fb3859c0700 1 Processor -- start 2023-10-03T10:17:00.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 -- start start 2023-10-03T10:17:00.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb38009d6f0 0x7fb38009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 0x7fb380130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb38009f130 con 0x7fb38009e410 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb38009f520 con 0x7fb38009d6f0 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.887+0000 7fb3859c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb38009e930 con 0x7fb38009e000 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 0x7fb380130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb38009d6f0 0x7fb38009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 0x7fb380130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41974/0 (socket says 172.21.15.19:41974) 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37e7fc700 1 -- 172.21.15.19:0/2992741248 learned_addr learned my addr 172.21.15.19:0/2992741248 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fa05f2be700 1 Processor -- start 2023-10-03T10:17:00.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 -- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 msgr2=0x7fb380130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 --2- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 0x7fb380130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 -- 172.21.15.19:0/2992741248 >> v1:172.21.15.19:6789/0 conn(0x7fb38009e410 legacy=0x7fb380130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 -- 172.21.15.19:0/2992741248 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38009b2d0 con 0x7fb38009d6f0 2023-10-03T10:17:00.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fa05f2be700 1 -- start start 2023-10-03T10:17:00.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.888+0000 7fb37effd700 1 --2- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009d6f0 0x7fb38009dac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb370009840 tx=0x7fb370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ca7893a63db396 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fb37dffb700 1 -- 172.21.15.19:0/2992741248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000f8a0 con 0x7fb38009d6f0 2023-10-03T10:17:00.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fb37dffb700 1 -- 172.21.15.19:0/2992741248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000fa00 con 0x7fb38009d6f0 2023-10-03T10:17:00.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fb37dffb700 1 -- 172.21.15.19:0/2992741248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000fd90 con 0x7fb38009d6f0 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05f2be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d6f0 0x7fa05809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05f2be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05f2be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05809f130 con 0x7fa05809e410 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05f2be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05809f520 con 0x7fa05809d6f0 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05f2be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa05809e930 con 0x7fa05809e000 2023-10-03T10:17:00.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41986/0 (socket says 172.21.15.19:41986) 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 -- 172.21.15.19:0/290655716 learned_addr learned my addr 172.21.15.19:0/290655716 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 -- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d6f0 msgr2=0x7fa05809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 --2- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d6f0 0x7fa05809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 -- 172.21.15.19:0/290655716 >> v1:172.21.15.19:6789/0 conn(0x7fa05809e410 legacy=0x7fa058130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.889+0000 7fa05c859700 1 -- 172.21.15.19:0/290655716 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05809b2d0 con 0x7fa05809e000 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 -- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009d6f0 msgr2=0x7fb38009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 --2- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009d6f0 0x7fb38009dac0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fb370009840 tx=0x7fb370009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:00.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fa05c859700 1 --2- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa05400bbf0 tx=0x7fa05400bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86fe42caa1af440c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 -- 172.21.15.19:0/2992741248 shutdown_connections 2023-10-03T10:17:00.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 --2- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009d6f0 0x7fb38009dac0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 --2- 172.21.15.19:0/2992741248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009e000 0x7fb380130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 -- 172.21.15.19:0/2992741248 >> 172.21.15.19:0/2992741248 conn(0x7fb380066f50 msgr2=0x7fb38009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 -- 172.21.15.19:0/2992741248 shutdown_connections 2023-10-03T10:17:00.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fb3859c0700 1 -- 172.21.15.19:0/2992741248 wait complete. 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fa04ffff700 1 -- 172.21.15.19:0/290655716 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05400dd60 con 0x7fa05809e000 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fa04ffff700 1 -- 172.21.15.19:0/290655716 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa054004030 con 0x7fa05809e000 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.890+0000 7fa04ffff700 1 -- 172.21.15.19:0/290655716 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0540043c0 con 0x7fa05809e000 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 -- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 msgr2=0x7fa058130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 --2- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa05400bbf0 tx=0x7fa05400bf00 comp rx=0 tx=0).stop 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 -- 172.21.15.19:0/290655716 shutdown_connections 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 --2- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d6f0 0x7fa05809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 --2- 172.21.15.19:0/290655716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e000 0x7fa058130660 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 -- 172.21.15.19:0/290655716 >> 172.21.15.19:0/290655716 conn(0x7fa058066f50 msgr2=0x7fa05809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 -- 172.21.15.19:0/290655716 shutdown_connections 2023-10-03T10:17:00.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fb3859c0700 1 Processor -- start 2023-10-03T10:17:00.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fa05f2be700 1 -- 172.21.15.19:0/290655716 wait complete. 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.891+0000 7fb3859c0700 1 -- start start 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb38009e000 0x7fb38011e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009e410 0x7fb38011ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38011f520 con 0x7fb38009e410 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3801303a0 con 0x7fb38009e000 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb3859c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb380120e20 con 0x7fb38009d6f0 2023-10-03T10:17:00.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fa05f2be700 1 Processor -- start 2023-10-03T10:17:00.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41992/0 (socket says 172.21.15.19:41992) 2023-10-03T10:17:00.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 -- 172.21.15.19:0/827538446 learned_addr learned my addr 172.21.15.19:0/827538446 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37e7fc700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb38009e000 0x7fb38011e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37f7fe700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009e410 0x7fb38011ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fa05f2be700 1 -- start start 2023-10-03T10:17:00.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 -- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb38009e000 msgr2=0x7fb38011e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb38009e000 0x7fb38011e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 -- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009e410 msgr2=0x7fb38011ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009e410 0x7fb38011ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.892+0000 7fb37effd700 1 -- 172.21.15.19:0/827538446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3700094a0 con 0x7fb38009d6f0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb37effd700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb3700090b0 tx=0x7fb370004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37001e070 con 0x7fb38009d6f0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3700045a0 con 0x7fb38009d6f0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb380121800 con 0x7fb38009d6f0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3700038c0 con 0x7fb38009d6f0 2023-10-03T10:17:00.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3800a1e20 con 0x7fb38009d6f0 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d6f0 0x7fa05811e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e000 0x7fa05811e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058120610 con 0x7fa05809e000 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa058121c50 con 0x7fa05809e410 2023-10-03T10:17:00.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05f2be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581202f0 con 0x7fa05809d6f0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05d85b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05d85b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55928/0 (socket says 172.21.15.19:55928) 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05d85b700 1 -- 172.21.15.19:0/242963921 learned_addr learned my addr 172.21.15.19:0/242963921 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.893+0000 7fa05d05a700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d6f0 0x7fa05811e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 -- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d6f0 msgr2=0x7fa05811e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d6f0 0x7fa05811e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 -- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e000 msgr2=0x7fa05811e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e000 0x7fa05811e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 -- 172.21.15.19:0/242963921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05400b7f0 con 0x7fa05809e410 2023-10-03T10:17:00.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fa05d85b700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c7a0 tx=0x7fa05000cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.894+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3600052e0 con 0x7fb38009d6f0 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050003e10 con 0x7fa05809e410 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050005070 con 0x7fa05809e410 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0580a1ce0 con 0x7fa05809e410 2023-10-03T10:17:00.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb370022070 con 0x7fb38009d6f0 2023-10-03T10:17:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050005420 con 0x7fa05809e410 2023-10-03T10:17:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb370041fc0 con 0x7fb38009d6f0 2023-10-03T10:17:00.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.895+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0581213e0 con 0x7fa05809e410 2023-10-03T10:17:00.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.896+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058074ea0 con 0x7fa05809e410 2023-10-03T10:17:00.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.896+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa050005580 con 0x7fa05809e410 2023-10-03T10:17:00.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.897+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa050040db0 con 0x7fa05809e410 2023-10-03T10:17:00.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.901+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb370003a20 con 0x7fb38009d6f0 2023-10-03T10:17:00.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.901+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa050044060 con 0x7fa05809e410 2023-10-03T10:17:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.965+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77981a7060 con 0x7f779809f240 2023-10-03T10:17:00.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.966+0000 7f778dffb700 1 -- 172.21.15.19:0/2665191918 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77981a7060 con 0x7f779809f240 2023-10-03T10:17:00.967 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 msgr2=0x7f77981a4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f77880090b0 tx=0x7f7788004750 comp rx=0 tx=0).stop 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 shutdown_connections 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f779809f650 0x7f77981a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f779809e930 0x7f77981a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 --2- 172.21.15.19:0/2665191918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f779809f240 0x7f77981a4160 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.968+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 >> 172.21.15.19:0/2665191918 conn(0x7f77980a4210 msgr2=0x7f77981b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.969+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 shutdown_connections 2023-10-03T10:17:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:00.969+0000 7f779f8f6700 1 -- 172.21.15.19:0/2665191918 wait complete. 2023-10-03T10:17:00.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.106+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff47c1a6650 con 0x7ff47c09e440 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.106+0000 7ff4797fa700 1 -- 172.21.15.19:0/504261112 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff47c1a6650 con 0x7ff47c09e440 2023-10-03T10:17:01.107 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 msgr2=0x7ff47c1c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff474007e40 tx=0x7ff47400e3c0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 shutdown_connections 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff47c09e440 0x7ff47c1c7fd0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff47c09d6f0 0x7ff47c1a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 --2- 172.21.15.19:0/504261112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff47c09e000 0x7ff47c1a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 >> 172.21.15.19:0/504261112 conn(0x7ff47c066f50 msgr2=0x7ff47c1bb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 shutdown_connections 2023-10-03T10:17:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.109+0000 7ff4831f7700 1 -- 172.21.15.19:0/504261112 wait complete. 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.110+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa05806c360 con 0x7fa05809e410 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.110+0000 7fa04dffb700 1 -- 172.21.15.19:0/242963921 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa050017020 con 0x7fa05809e410 2023-10-03T10:17:01.111 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 msgr2=0x7fa05811ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c7a0 tx=0x7fa05000cab0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 shutdown_connections 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e410 0x7fa05811ebb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d6f0 0x7fa05811e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 --2- 172.21.15.19:0/242963921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e000 0x7fa05811e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.113+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 >> 172.21.15.19:0/242963921 conn(0x7fa058066f50 msgr2=0x7fa05806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.116+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 shutdown_connections 2023-10-03T10:17:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.116+0000 7fa05f2be700 1 -- 172.21.15.19:0/242963921 wait complete. 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.121+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb360005590 con 0x7fb38009d6f0 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.121+0000 7fb367fff700 1 -- 172.21.15.19:0/827538446 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb370029020 con 0x7fb38009d6f0 2023-10-03T10:17:01.122 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 msgr2=0x7fb38011e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb3700090b0 tx=0x7fb370004750 comp rx=0 tx=0).stop 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 shutdown_connections 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb38009e410 0x7fb38011ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb38009d6f0 0x7fb38011e050 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 --2- 172.21.15.19:0/827538446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb38009e000 0x7fb38011e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 >> 172.21.15.19:0/827538446 conn(0x7fb380066f50 msgr2=0x7fb380071cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 shutdown_connections 2023-10-03T10:17:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:01.124+0000 7fb3859c0700 1 -- 172.21.15.19:0/827538446 wait complete. 2023-10-03T10:17:01.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:01.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:01.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:01.990 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:02.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:02.133 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.134+0000 7efff47d9700 1 Processor -- start 2023-10-03T10:17:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.134+0000 7efff47d9700 1 -- start start 2023-10-03T10:17:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff47d9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effec09d6f0 0x7effec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff47d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 0x7effec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff47d9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec09b120 con 0x7effec09e000 2023-10-03T10:17:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff47d9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec06b460 con 0x7effec09d6f0 2023-10-03T10:17:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff47d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec09a7e0 con 0x7effec09e440 2023-10-03T10:17:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2d76700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 0x7effec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2575700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effec09d6f0 0x7effec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2d76700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 0x7effec134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55940/0 (socket says 172.21.15.19:55940) 2023-10-03T10:17:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2d76700 1 -- 172.21.15.19:0/756227909 learned_addr learned my addr 172.21.15.19:0/756227909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff1d74700 1 --1- 172.21.15.19:0/756227909 >> v1:172.21.15.19:6789/0 conn(0x7effec09e000 0x7effec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43588/0 (socket says 172.21.15.19:43588) 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2575700 1 -- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 msgr2=0x7effec134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2575700 1 --2- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 0x7effec134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2575700 1 -- 172.21.15.19:0/756227909 >> v1:172.21.15.19:6789/0 conn(0x7effec09e000 legacy=0x7effec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.135+0000 7efff2575700 1 -- 172.21.15.19:0/756227909 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec09a500 con 0x7effec09d6f0 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.136+0000 7efff2575700 1 --2- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec09dac0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7effe8009870 tx=0x7effe8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f88d39cc1d7fb63 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.136+0000 7efff1573700 1 -- 172.21.15.19:0/756227909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011830 con 0x7effec09d6f0 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.136+0000 7efff1573700 1 -- 172.21.15.19:0/756227909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe8011990 con 0x7effec09d6f0 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.136+0000 7efff1573700 1 -- 172.21.15.19:0/756227909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011d20 con 0x7effec09d6f0 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 -- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 msgr2=0x7effec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 --2- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec09dac0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7effe8009870 tx=0x7effe8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 -- 172.21.15.19:0/756227909 shutdown_connections 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 --2- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e440 0x7effec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 --2- 172.21.15.19:0/756227909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec09dac0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 -- 172.21.15.19:0/756227909 >> 172.21.15.19:0/756227909 conn(0x7effec066f50 msgr2=0x7effec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 -- 172.21.15.19:0/756227909 shutdown_connections 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.137+0000 7efff47d9700 1 -- 172.21.15.19:0/756227909 wait complete. 2023-10-03T10:17:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.138+0000 7efff47d9700 1 Processor -- start 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.138+0000 7efff47d9700 1 -- start start 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec1a5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effec09e440 0x7effec1a68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec1a8030 con 0x7effec09d6f0 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec1a90f0 con 0x7effec09e000 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff47d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effec09c710 con 0x7effec09e440 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff2d76700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effec09e440 0x7effec1a68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55950/0 (socket says 172.21.15.19:55950) 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 -- 172.21.15.19:0/2789987854 learned_addr learned my addr 172.21.15.19:0/2789987854 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff2575700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec1a5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 -- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effec09e440 msgr2=0x7effec1a68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effec09e440 0x7effec1a68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 -- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 msgr2=0x7effec1a5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec1a5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff1d74700 1 -- 172.21.15.19:0/2789987854 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe80094a0 con 0x7effec09e000 2023-10-03T10:17:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.139+0000 7efff2575700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec1a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:02.143 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7efff1d74700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c520 tx=0x7effdc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc005cb0 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc005e10 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec0a20b0 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc0072d0 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.140+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec1a8ca0 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.141+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec074ea0 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.141+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7effdc007430 con 0x7effec09e000 2023-10-03T10:17:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.141+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7effdc03eab0 con 0x7effec09e000 2023-10-03T10:17:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.146+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7effdc0076e0 con 0x7effec09e000 2023-10-03T10:17:02.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.279+0000 7fc6e7fd7700 1 Processor -- start 2023-10-03T10:17:02.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.279+0000 7fc6e7fd7700 1 -- start start 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e7fd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e7fd7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6e009f240 0x7fc6e01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e7fd7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e0070940 con 0x7fc6e009f650 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e7fd7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e006fd60 con 0x7fc6e009f240 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e7fd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e006fa80 con 0x7fc6e009e930 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42016/0 (socket says 172.21.15.19:42016) 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 -- 172.21.15.19:0/2364966879 learned_addr learned my addr 172.21.15.19:0/2364966879 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5572700 1 --2- 172.21.15.19:0/2364966879 >> v2:172.21.15.19:3300/0 conn(0x7fc6e009f240 0x7fc6e01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 -- 172.21.15.19:0/2364966879 >> v2:172.21.15.19:3300/0 conn(0x7fc6e009f240 msgr2=0x7fc6e01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 --2- 172.21.15.19:0/2364966879 >> v2:172.21.15.19:3300/0 conn(0x7fc6e009f240 0x7fc6e01317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 -- 172.21.15.19:0/2364966879 >> v1:172.21.15.19:6789/0 conn(0x7fc6e009f650 legacy=0x7fc6e0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 -- 172.21.15.19:0/2364966879 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e009fb60 con 0x7fc6e009e930 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.280+0000 7fc6e5d73700 1 --2- 172.21.15.19:0/2364966879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0098f0 tx=0x7fc6dc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bba2cdaa8fe85a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e4d71700 1 -- 172.21.15.19:0/2364966879 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc011830 con 0x7fc6e009e930 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e4d71700 1 -- 172.21.15.19:0/2364966879 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc011990 con 0x7fc6e009e930 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e4d71700 1 -- 172.21.15.19:0/2364966879 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc011d20 con 0x7fc6e009e930 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/2364966879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 msgr2=0x7fc6e009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/2364966879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc0098f0 tx=0x7fc6dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/2364966879 shutdown_connections 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/2364966879 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009e930 0x7fc6e009ed00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/2364966879 >> v2:172.21.15.19:3300/0 conn(0x7fc6e009f240 0x7fc6e01317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.281+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/2364966879 >> 172.21.15.19:0/2364966879 conn(0x7fc6e00a4210 msgr2=0x7fc6e00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.282+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/2364966879 shutdown_connections 2023-10-03T10:17:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.282+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/2364966879 wait complete. 2023-10-03T10:17:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.283+0000 7fc6e7fd7700 1 Processor -- start 2023-10-03T10:17:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.283+0000 7fc6e7fd7700 1 -- start start 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e009e930 0x7fc6e006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e009f650 0x7fc6e006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01a9a50 con 0x7fc6e009f650 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01a89f0 con 0x7fc6e009e930 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e7fd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01a91e0 con 0x7fc6e009f240 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42024/0 (socket says 172.21.15.19:42024) 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 -- 172.21.15.19:0/3501634022 learned_addr learned my addr 172.21.15.19:0/3501634022 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e6574700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e009f650 0x7fc6e006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 -- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e009e930 msgr2=0x7fc6e006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e009e930 0x7fc6e006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 -- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e009f650 msgr2=0x7fc6e006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e009f650 0x7fc6e006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.284+0000 7fc6e5572700 1 -- 172.21.15.19:0/3501634022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc009550 con 0x7fc6e009f240 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6e5572700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000e980 tx=0x7fc6d000ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d0009710 con 0x7fc6e009f240 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d000eed0 con 0x7fc6e009f240 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e00a0190 con 0x7fc6e009f240 2023-10-03T10:17:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d000ca70 con 0x7fc6e009f240 2023-10-03T10:17:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.285+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e01b7300 con 0x7fc6e009f240 2023-10-03T10:17:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.286+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e0074ea0 con 0x7fc6e009f240 2023-10-03T10:17:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.286+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6d000cbd0 con 0x7fc6e009f240 2023-10-03T10:17:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.287+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6d003faf0 con 0x7fc6e009f240 2023-10-03T10:17:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.290+0000 7f9fdcb0e700 1 Processor -- start 2023-10-03T10:17:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.290+0000 7f9fdcb0e700 1 -- start start 2023-10-03T10:17:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.291+0000 7f9fdcb0e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fd8131810 0x7f9fd8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.291+0000 7f9fdcb0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.291+0000 7f9fdcb0e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd81313c0 con 0x7f9fd8099a40 2023-10-03T10:17:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.291+0000 7f9fdcb0e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd806e8c0 con 0x7f9fd8131810 2023-10-03T10:17:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.291+0000 7f9fdcb0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8071d20 con 0x7f9fd809a580 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fd8131810 0x7f9fd8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9fd8099a40 0x7f9fd8099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43598/0 (socket says 172.21.15.19:43598) 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd5d9b700 1 -- 172.21.15.19:0/4067956439 learned_addr learned my addr 172.21.15.19:0/4067956439 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd6d9d700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 -- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 msgr2=0x7f9fd8139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd8139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 -- 172.21.15.19:0/4067956439 >> v1:172.21.15.19:6789/0 conn(0x7f9fd8099a40 legacy=0x7f9fd8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 -- 172.21.15.19:0/4067956439 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80721a0 con 0x7f9fd8131810 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd659c700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8131be0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009840 tx=0x7f9fc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3b13e8784521f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.294+0000 7f9fd559a700 1 -- 172.21.15.19:0/4067956439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8004230 con 0x7f9fd8131810 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.295+0000 7f9fd559a700 1 -- 172.21.15.19:0/4067956439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8004390 con 0x7f9fd8131810 2023-10-03T10:17:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.295+0000 7f9fd559a700 1 -- 172.21.15.19:0/4067956439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc80036a0 con 0x7f9fd8131810 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 msgr2=0x7f9fd8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8131be0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009840 tx=0x7f9fc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/4067956439 shutdown_connections 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd8139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/4067956439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8131be0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/4067956439 >> 172.21.15.19:0/4067956439 conn(0x7f9fd80a2aa0 msgr2=0x7f9fd80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6d001b3b0 con 0x7fc6e009f240 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/4067956439 shutdown_connections 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.296+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/4067956439 wait complete. 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.297+0000 7f9fdcb0e700 1 Processor -- start 2023-10-03T10:17:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.297+0000 7f9fdcb0e700 1 -- start start 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8120ee0 con 0x7f9fd8131810 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd81213a0 con 0x7f9fd8099a40 2023-10-03T10:17:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fdcb0e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8120340 con 0x7f9fd809a580 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55966/0 (socket says 172.21.15.19:55966) 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 -- 172.21.15.19:0/1071892987 learned_addr learned my addr 172.21.15.19:0/1071892987 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd6d9d700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 -- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 msgr2=0x7f9fd806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 -- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 msgr2=0x7f9fd8070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.298+0000 7f9fd659c700 1 -- 172.21.15.19:0/1071892987 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc80094a0 con 0x7f9fd8099a40 2023-10-03T10:17:02.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fd659c700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80090b0 tx=0x7f9fc8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8003d80 con 0x7f9fd8099a40 2023-10-03T10:17:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc801f070 con 0x7f9fd8099a40 2023-10-03T10:17:02.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd80a1d50 con 0x7f9fd8099a40 2023-10-03T10:17:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8011870 con 0x7f9fd8099a40 2023-10-03T10:17:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.299+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd812ec50 con 0x7f9fd8099a40 2023-10-03T10:17:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.300+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fc8021030 con 0x7f9fd8099a40 2023-10-03T10:17:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.300+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd8074ea0 con 0x7f9fd8099a40 2023-10-03T10:17:02.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.300+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9fc80409e0 con 0x7f9fd8099a40 2023-10-03T10:17:02.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.308+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fc8006bd0 con 0x7f9fd8099a40 2023-10-03T10:17:02.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.316+0000 7fc213240700 1 Processor -- start 2023-10-03T10:17:02.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 -- start start 2023-10-03T10:17:02.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc20c131810 0x7fc20c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c09a580 0x7fc20c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc20c1313c0 con 0x7fc20c099a40 2023-10-03T10:17:02.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc20c06e8c0 con 0x7fc20c131810 2023-10-03T10:17:02.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc213240700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c071d20 con 0x7fc20c09a580 2023-10-03T10:17:02.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc20bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc20c099a40 0x7fc20c099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43604/0 (socket says 172.21.15.19:43604) 2023-10-03T10:17:02.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.317+0000 7fc20bfff700 1 -- 172.21.15.19:0/965434230 learned_addr learned my addr 172.21.15.19:0/965434230 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:02.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 --2- 172.21.15.19:0/965434230 >> v2:172.21.15.19:3300/0 conn(0x7fc20c131810 0x7fc20c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc2117dd700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c09a580 0x7fc20c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc20b7fe700 1 -- 172.21.15.19:0/965434230 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930038305 0 0) 0x7fc20c1313c0 con 0x7fc20c099a40 2023-10-03T10:17:02.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc20b7fe700 1 -- 172.21.15.19:0/965434230 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1fc0035b0 con 0x7fc20c099a40 2023-10-03T10:17:02.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 -- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c09a580 msgr2=0x7fc20c139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c09a580 0x7fc20c139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 -- 172.21.15.19:0/965434230 >> v1:172.21.15.19:6789/0 conn(0x7fc20c099a40 legacy=0x7fc20c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 -- 172.21.15.19:0/965434230 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c0721a0 con 0x7fc20c131810 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.318+0000 7fc210fdc700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c131810 0x7fc20c131be0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc200009840 tx=0x7fc200009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3a062439eb8731 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc20b7fe700 1 -- 172.21.15.19:0/965434230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200011830 con 0x7fc20c131810 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc20b7fe700 1 -- 172.21.15.19:0/965434230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc200011990 con 0x7fc20c131810 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc20b7fe700 1 -- 172.21.15.19:0/965434230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc200011d20 con 0x7fc20c131810 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 -- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c131810 msgr2=0x7fc20c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c131810 0x7fc20c131be0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc200009840 tx=0x7fc200009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 -- 172.21.15.19:0/965434230 shutdown_connections 2023-10-03T10:17:02.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c09a580 0x7fc20c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 --2- 172.21.15.19:0/965434230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c131810 0x7fc20c131be0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 -- 172.21.15.19:0/965434230 >> 172.21.15.19:0/965434230 conn(0x7fc20c0a2aa0 msgr2=0x7fc20c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.319+0000 7fc213240700 1 -- 172.21.15.19:0/965434230 shutdown_connections 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.320+0000 7fc213240700 1 -- 172.21.15.19:0/965434230 wait complete. 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.321+0000 7fc213240700 1 Processor -- start 2023-10-03T10:17:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.321+0000 7fc213240700 1 -- start start 2023-10-03T10:17:02.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc20c099a40 0x7fc20c11b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 0x7fc20c11baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c11ee30 con 0x7fc20c09a580 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c11f030 con 0x7fc20c131810 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc213240700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc20c06eb00 con 0x7fc20c099a40 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc2117dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc20bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 0x7fc20c11baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc2117dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55988/0 (socket says 172.21.15.19:55988) 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc2117dd700 1 -- 172.21.15.19:0/3948769964 learned_addr learned my addr 172.21.15.19:0/3948769964 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:02.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.322+0000 7fc210fdc700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc20c099a40 0x7fc20c11b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 -- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc20c099a40 msgr2=0x7fc20c11b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc20c099a40 0x7fc20c11b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 -- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 msgr2=0x7fc20c11c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 -- 172.21.15.19:0/3948769964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000094a0 con 0x7fc20c09a580 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc2117dd700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc20bfff700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 0x7fc20c11baf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc1f801d470 tx=0x7fc1f801d780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f8005b70 con 0x7fc20c09a580 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f8005cd0 con 0x7fc20c09a580 2023-10-03T10:17:02.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.323+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f80072d0 con 0x7fc20c09a580 2023-10-03T10:17:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.324+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc20c11d1c0 con 0x7fc20c09a580 2023-10-03T10:17:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.324+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc20c11e370 con 0x7fc20c09a580 2023-10-03T10:17:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.325+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc1f8007430 con 0x7fc20c09a580 2023-10-03T10:17:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.325+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc1f804f7c0 con 0x7fc20c09a580 2023-10-03T10:17:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.325+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc20c074ea0 con 0x7fc20c09a580 2023-10-03T10:17:02.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.331+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc1f8028080 con 0x7fc20c09a580 2023-10-03T10:17:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.416+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7effec09f420 con 0x7effec09e000 2023-10-03T10:17:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.416+0000 7effe2ffd700 1 -- 172.21.15.19:0/2789987854 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7effdc017020 con 0x7effec09e000 2023-10-03T10:17:02.417 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:02.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.418+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 msgr2=0x7effec1a6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.418+0000 7efff47d9700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c520 tx=0x7effdc00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 shutdown_connections 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effec09e440 0x7effec1a68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effec09d6f0 0x7effec1a5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 --2- 172.21.15.19:0/2789987854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effec09e000 0x7effec1a6380 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 >> 172.21.15.19:0/2789987854 conn(0x7effec066f50 msgr2=0x7effec1bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 shutdown_connections 2023-10-03T10:17:02.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.419+0000 7efff47d9700 1 -- 172.21.15.19:0/2789987854 wait complete. 2023-10-03T10:17:02.434 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:02.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.505+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc6e006b250 con 0x7fc6e009f240 2023-10-03T10:17:02.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.506+0000 7fc6d67fc700 1 -- 172.21.15.19:0/3501634022 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6d003fe60 con 0x7fc6e009f240 2023-10-03T10:17:02.507 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 msgr2=0x7fc6e006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc6d000e980 tx=0x7fc6d000ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 shutdown_connections 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e009f650 0x7fc6e006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e009e930 0x7fc6e006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 --2- 172.21.15.19:0/3501634022 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e009f240 0x7fc6e006bdf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 >> 172.21.15.19:0/3501634022 conn(0x7fc6e00a4210 msgr2=0x7fc6e01b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 shutdown_connections 2023-10-03T10:17:02.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.508+0000 7fc6e7fd7700 1 -- 172.21.15.19:0/3501634022 wait complete. 2023-10-03T10:17:02.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:02.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.538+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fd8074ea0 con 0x7f9fd8099a40 2023-10-03T10:17:02.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.539+0000 7f9fc6ffd700 1 -- 172.21.15.19:0/1071892987 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fc80193c0 con 0x7f9fd8099a40 2023-10-03T10:17:02.539 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:02.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 msgr2=0x7f9fd806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9fc80090b0 tx=0x7f9fc8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:02.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 shutdown_connections 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fd8131810 0x7f9fd8070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fd8099a40 0x7f9fd806f610 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 --2- 172.21.15.19:0/1071892987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fd809a580 0x7f9fd806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 >> 172.21.15.19:0/1071892987 conn(0x7f9fd80a2aa0 msgr2=0x7f9fd81b8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 shutdown_connections 2023-10-03T10:17:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.541+0000 7f9fdcb0e700 1 -- 172.21.15.19:0/1071892987 wait complete. 2023-10-03T10:17:02.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.560+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc20c06b9e0 con 0x7fc20c09a580 2023-10-03T10:17:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.561+0000 7fc2097fa700 1 -- 172.21.15.19:0/3948769964 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc1f80076e0 con 0x7fc20c09a580 2023-10-03T10:17:02.562 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:02.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 msgr2=0x7fc20c11baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:02.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 0x7fc20c11baf0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc1f801d470 tx=0x7fc1f801d780 comp rx=0 tx=0).stop 2023-10-03T10:17:02.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 shutdown_connections 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc20c131810 0x7fc20c11c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc20c099a40 0x7fc20c11b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 --2- 172.21.15.19:0/3948769964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc20c09a580 0x7fc20c11baf0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 >> 172.21.15.19:0/3948769964 conn(0x7fc20c0a2aa0 msgr2=0x7fc20c0a10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 shutdown_connections 2023-10-03T10:17:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:02.563+0000 7fc213240700 1 -- 172.21.15.19:0/3948769964 wait complete. 2023-10-03T10:17:02.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:03.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:03.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:03.556 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:03.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 Processor -- start 2023-10-03T10:17:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 -- start start 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f153806ef30 con 0x7f153809de50 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153806fef0 con 0x7f153809e930 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.581+0000 7f153fee3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f15381334b0 con 0x7f15381338a0 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42056/0 (socket says 172.21.15.19:42056) 2023-10-03T10:17:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 -- 172.21.15.19:0/2150229987 learned_addr learned my addr 172.21.15.19:0/2150229987 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153e480700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 -- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 msgr2=0x7f153813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 -- 172.21.15.19:0/2150229987 >> v1:172.21.15.19:6789/0 conn(0x7f153809de50 legacy=0x7f153809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.582+0000 7f153dc7f700 1 -- 172.21.15.19:0/2150229987 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153806fc30 con 0x7f15381338a0 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.583+0000 7f153dc7f700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1534009920 tx=0x7f1534009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37273af28481dd78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.583+0000 7f153cc7d700 1 -- 172.21.15.19:0/2150229987 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011830 con 0x7f15381338a0 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.583+0000 7f153cc7d700 1 -- 172.21.15.19:0/2150229987 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1534011990 con 0x7f15381338a0 2023-10-03T10:17:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.583+0000 7f153cc7d700 1 -- 172.21.15.19:0/2150229987 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534011d20 con 0x7f15381338a0 2023-10-03T10:17:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 -- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 msgr2=0x7f1538133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1534009920 tx=0x7f1534009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:03.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 -- 172.21.15.19:0/2150229987 shutdown_connections 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 --2- 172.21.15.19:0/2150229987 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f1538133c70 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 -- 172.21.15.19:0/2150229987 >> 172.21.15.19:0/2150229987 conn(0x7f15380a2aa0 msgr2=0x7f15380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 -- 172.21.15.19:0/2150229987 shutdown_connections 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.584+0000 7f153fee3700 1 -- 172.21.15.19:0/2150229987 wait complete. 2023-10-03T10:17:03.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 Processor -- start 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 -- start start 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153811dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f153811e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1538120f20 con 0x7f153809de50 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380a0f20 con 0x7f153809e930 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.586+0000 7f153fee3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f153811f400 con 0x7f15381338a0 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41510/0 (socket says 172.21.15.19:41510) 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 -- 172.21.15.19:0/3359746521 learned_addr learned my addr 172.21.15.19:0/3359746521 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153d47e700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153811dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 -- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 msgr2=0x7f153811e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f153811e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 -- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 msgr2=0x7f153811dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153811dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 -- 172.21.15.19:0/3359746521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1534009550 con 0x7f153809de50 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153d47e700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153811dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.587+0000 7f153dc7f700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f1534004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.588+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534004510 con 0x7f153809de50 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.588+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f153806f640 con 0x7f153809de50 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.588+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1538121990 con 0x7f153809de50 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.588+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15340036a0 con 0x7f153809de50 2023-10-03T10:17:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.588+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1534003a50 con 0x7f153809de50 2023-10-03T10:17:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.589+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1534003bb0 con 0x7f153809de50 2023-10-03T10:17:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.589+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f153811a470 con 0x7f153809de50 2023-10-03T10:17:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.589+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1534040b70 con 0x7f153809de50 2023-10-03T10:17:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.595+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1534003e60 con 0x7f153809de50 2023-10-03T10:17:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.674+0000 7f148ac51700 1 Processor -- start 2023-10-03T10:17:03.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.674+0000 7f148ac51700 1 -- start start 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14841338a0 0x7f1484133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409de50 0x7f148409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f148409e760 0x7f148413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148406fef0 con 0x7f14841338a0 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148406ef30 con 0x7f148409de50 2023-10-03T10:17:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f148ac51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f14841334b0 con 0x7f148409e760 2023-10-03T10:17:03.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f14889ed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14841338a0 0x7f1484133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f14889ed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f14841338a0 0x7f1484133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41526/0 (socket says 172.21.15.19:41526) 2023-10-03T10:17:03.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f14889ed700 1 -- 172.21.15.19:0/485356449 learned_addr learned my addr 172.21.15.19:0/485356449 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.675+0000 7f1483fff700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409de50 0x7f148409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 -- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f148409e760 msgr2=0x7f148413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f148409e760 0x7f148413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 -- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409de50 msgr2=0x7f148409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409de50 0x7f148409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 -- 172.21.15.19:0/485356449 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148406fc30 con 0x7f14841338a0 2023-10-03T10:17:03.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14889ed700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14841338a0 0x7f1484133c70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f14780098f0 tx=0x7f1478009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa77c7bfb2137ce server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14837fe700 1 -- 172.21.15.19:0/485356449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478011830 con 0x7f14841338a0 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14837fe700 1 -- 172.21.15.19:0/485356449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1478011990 con 0x7f14841338a0 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.676+0000 7f14837fe700 1 -- 172.21.15.19:0/485356449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1478011d20 con 0x7f14841338a0 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 -- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14841338a0 msgr2=0x7f1484133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14841338a0 0x7f1484133c70 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f14780098f0 tx=0x7f1478009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 -- 172.21.15.19:0/485356449 shutdown_connections 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f148409e760 0x7f148413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14841338a0 0x7f1484133c70 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 --2- 172.21.15.19:0/485356449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409de50 0x7f148409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 -- 172.21.15.19:0/485356449 >> 172.21.15.19:0/485356449 conn(0x7f14840a2aa0 msgr2=0x7f14840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 -- 172.21.15.19:0/485356449 shutdown_connections 2023-10-03T10:17:03.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.677+0000 7f148ac51700 1 -- 172.21.15.19:0/485356449 wait complete. 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.678+0000 7f148ac51700 1 Processor -- start 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.678+0000 7f148ac51700 1 -- start start 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 0x7f148411b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14841338a0 0x7f148411c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148411f0a0 con 0x7f148409de50 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148411da00 con 0x7f148409e760 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f148ac51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f148412ebb0 con 0x7f14841338a0 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56024/0 (socket says 172.21.15.19:56024) 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 -- 172.21.15.19:0/1009379581 learned_addr learned my addr 172.21.15.19:0/1009379581 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f14891ee700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14841338a0 0x7f148411c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f14889ed700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 0x7f148411b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 -- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14841338a0 msgr2=0x7f148411c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14841338a0 0x7f148411c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 -- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 msgr2=0x7f148411b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 0x7f148411b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f1483fff700 1 -- 172.21.15.19:0/1009379581 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478009550 con 0x7f148409e760 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.679+0000 7f14889ed700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 0x7f148411b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f1483fff700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f147000e870 tx=0x7f147000eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470009590 con 0x7f148409e760 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470013680 con 0x7f148409e760 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14840a0fb0 con 0x7f148409e760 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148411ea70 con 0x7f148409e760 2023-10-03T10:17:03.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.680+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700139f0 con 0x7f148409e760 2023-10-03T10:17:03.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.681+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14640052e0 con 0x7f148409e760 2023-10-03T10:17:03.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.682+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1470013b50 con 0x7f148409e760 2023-10-03T10:17:03.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.682+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f147003fda0 con 0x7f148409e760 2023-10-03T10:17:03.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.687+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f147000c7d0 con 0x7f148409e760 2023-10-03T10:17:03.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.715+0000 7f1107d0b700 1 Processor -- start 2023-10-03T10:17:03.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.715+0000 7f1107d0b700 1 -- start start 2023-10-03T10:17:03.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.715+0000 7f1107d0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 0x7f110009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.715+0000 7f1107d0b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.715+0000 7f1107d0b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110009a810 con 0x7f110006a770 2023-10-03T10:17:03.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f1107d0b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110006ab40 con 0x7f110013d1f0 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f1107d0b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f110009ebc0 con 0x7f110009de00 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f1105aa7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f110006a770 0x7f110009d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43622/0 (socket says 172.21.15.19:43622) 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f1105aa7700 1 -- 172.21.15.19:0/565893121 learned_addr learned my addr 172.21.15.19:0/565893121 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11062a8700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11052a6700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 0x7f110009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f1104aa5700 1 -- 172.21.15.19:0/565893121 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643621860 0 0) 0x7f110009a810 con 0x7f110006a770 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11052a6700 1 -- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 msgr2=0x7f110013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11052a6700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11052a6700 1 -- 172.21.15.19:0/565893121 >> v1:172.21.15.19:6789/0 conn(0x7f110006a770 legacy=0x7f110009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11052a6700 1 -- 172.21.15.19:0/565893121 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110009e920 con 0x7f110009de00 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.716+0000 7f11062a8700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.717+0000 7f11052a6700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 0x7f110009e250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009870 tx=0x7f10f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb5e1ceeb2062c01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.717+0000 7f1104aa5700 1 -- 172.21.15.19:0/565893121 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0011830 con 0x7f110009de00 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.717+0000 7f1104aa5700 1 -- 172.21.15.19:0/565893121 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0011990 con 0x7f110009de00 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.717+0000 7f1104aa5700 1 -- 172.21.15.19:0/565893121 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f0011d20 con 0x7f110009de00 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 -- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 msgr2=0x7f110009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 0x7f110009e250 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10f0009870 tx=0x7f10f0009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 -- 172.21.15.19:0/565893121 shutdown_connections 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 --2- 172.21.15.19:0/565893121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110009de00 0x7f110009e250 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 -- 172.21.15.19:0/565893121 >> 172.21.15.19:0/565893121 conn(0x7f1100066f50 msgr2=0x7f110009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 -- 172.21.15.19:0/565893121 shutdown_connections 2023-10-03T10:17:03.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.718+0000 7f1107d0b700 1 -- 172.21.15.19:0/565893121 wait complete. 2023-10-03T10:17:03.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.719+0000 7f1107d0b700 1 Processor -- start 2023-10-03T10:17:03.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.719+0000 7f1107d0b700 1 -- start start 2023-10-03T10:17:03.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f110009de00 0x7f110013b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110011ec60 con 0x7f110009de00 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1100135c30 con 0x7f110013d1f0 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1107d0b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f110009f1a0 con 0x7f110006a770 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1105aa7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1105aa7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42108/0 (socket says 172.21.15.19:42108) 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f1105aa7700 1 -- 172.21.15.19:0/3194437741 learned_addr learned my addr 172.21.15.19:0/3194437741 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f11062a8700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.720+0000 7f11052a6700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f110009de00 0x7f110013b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 -- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 msgr2=0x7f110013baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 -- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f110009de00 msgr2=0x7f110013b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f110009de00 0x7f110013b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 -- 172.21.15.19:0/3194437741 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8009a70 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f11062a8700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1105aa7700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c520 tx=0x7f10fc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc004c80 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc004e00 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f00094a0 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc007310 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.721+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110011ee60 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.722+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f10fc007470 con 0x7f110006a770 2023-10-03T10:17:03.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.723+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10fc03f1f0 con 0x7f110006a770 2023-10-03T10:17:03.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.723+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110011cc70 con 0x7f110006a770 2023-10-03T10:17:03.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.732+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f110011cc70 con 0x7f110006a770 2023-10-03T10:17:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.745+0000 7f0911403700 1 Processor -- start 2023-10-03T10:17:03.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.745+0000 7f0911403700 1 -- start start 2023-10-03T10:17:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.746+0000 7f0911403700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.746+0000 7f0911403700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f090c133280 0x7f090c13ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.746+0000 7f0911403700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c09f440 con 0x7f090c06a770 2023-10-03T10:17:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.746+0000 7f0911403700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c06ab40 con 0x7f090c133280 2023-10-03T10:17:03.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.746+0000 7f0911403700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c09a2c0 con 0x7f090c133f40 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56048/0 (socket says 172.21.15.19:56048) 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 -- 172.21.15.19:0/1830488084 learned_addr learned my addr 172.21.15.19:0/1830488084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090b7fe700 1 --2- 172.21.15.19:0/1830488084 >> v2:172.21.15.19:3300/0 conn(0x7f090c133280 0x7f090c13ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 -- 172.21.15.19:0/1830488084 >> v2:172.21.15.19:3300/0 conn(0x7f090c133280 msgr2=0x7f090c13ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 --2- 172.21.15.19:0/1830488084 >> v2:172.21.15.19:3300/0 conn(0x7f090c133280 0x7f090c13ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 -- 172.21.15.19:0/1830488084 >> v1:172.21.15.19:6789/0 conn(0x7f090c06a770 legacy=0x7f090c133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 -- 172.21.15.19:0/1830488084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c06b250 con 0x7f090c133f40 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f090a7fc700 1 --2- 172.21.15.19:0/1830488084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f09000098f0 tx=0x7f0900009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0e9767f1b46ac2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f0909ffb700 1 -- 172.21.15.19:0/1830488084 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900011830 con 0x7f090c133f40 2023-10-03T10:17:03.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f0909ffb700 1 -- 172.21.15.19:0/1830488084 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900011990 con 0x7f090c133f40 2023-10-03T10:17:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.747+0000 7f0909ffb700 1 -- 172.21.15.19:0/1830488084 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900011d20 con 0x7f090c133f40 2023-10-03T10:17:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 -- 172.21.15.19:0/1830488084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 msgr2=0x7f090c1385e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 --2- 172.21.15.19:0/1830488084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f09000098f0 tx=0x7f0900009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:03.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 -- 172.21.15.19:0/1830488084 shutdown_connections 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 --2- 172.21.15.19:0/1830488084 >> v2:172.21.15.19:3300/0 conn(0x7f090c133280 0x7f090c13ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 --2- 172.21.15.19:0/1830488084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133f40 0x7f090c1385e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.748+0000 7f0911403700 1 -- 172.21.15.19:0/1830488084 >> 172.21.15.19:0/1830488084 conn(0x7f090c0a2cc0 msgr2=0x7f090c0a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.749+0000 7f0911403700 1 -- 172.21.15.19:0/1830488084 shutdown_connections 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.749+0000 7f0911403700 1 -- 172.21.15.19:0/1830488084 wait complete. 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.750+0000 7f0911403700 1 Processor -- start 2023-10-03T10:17:03.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.750+0000 7f0911403700 1 -- start start 2023-10-03T10:17:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 0x7f090c070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133280 0x7f090c070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 0x7f090c071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c135ca0 con 0x7f090c133f40 2023-10-03T10:17:03.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c135e80 con 0x7f090c133280 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f0911403700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f090c12d900 con 0x7f090c06a770 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f090affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 0x7f090c070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f090affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 0x7f090c070680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42110/0 (socket says 172.21.15.19:42110) 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f090affd700 1 -- 172.21.15.19:0/2616006779 learned_addr learned my addr 172.21.15.19:0/2616006779 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f090a7fc700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133280 0x7f090c070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.751+0000 7f090b7fe700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 0x7f090c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 -- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 msgr2=0x7f090c070680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 0x7f090c070680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 -- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133280 msgr2=0x7f090c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133280 0x7f090c070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 -- 172.21.15.19:0/2616006779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900009550 con 0x7f090c133f40 2023-10-03T10:17:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.752+0000 7f090b7fe700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 0x7f090c071100 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f090400efc0 tx=0x7f090400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.753+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090400cd40 con 0x7f090c133f40 2023-10-03T10:17:03.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.753+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090400f040 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.753+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090c1355f0 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.753+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c072320 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.753+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040146c0 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.754+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0904014820 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.754+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec0052e0 con 0x7f090c133f40 2023-10-03T10:17:03.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.754+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f09040401f0 con 0x7f090c133f40 2023-10-03T10:17:03.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.764+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0904007920 con 0x7f090c133f40 2023-10-03T10:17:03.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.823+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1538120a90 con 0x7f153809de50 2023-10-03T10:17:03.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.823+0000 7f152e7fc700 1 -- 172.21.15.19:0/3359746521 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1534015070 con 0x7f153809de50 2023-10-03T10:17:03.824 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.825+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 msgr2=0x7f153811d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.825+0000 7f153fee3700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f1534004750 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 shutdown_connections 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f15381338a0 0x7f153811e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f153809de50 0x7f153811d7f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 --2- 172.21.15.19:0/3359746521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f153809e930 0x7f153811dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 >> 172.21.15.19:0/3359746521 conn(0x7f15380a2aa0 msgr2=0x7f153809f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 shutdown_connections 2023-10-03T10:17:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.826+0000 7f153fee3700 1 -- 172.21.15.19:0/3359746521 wait complete. 2023-10-03T10:17:03.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.903+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1464005860 con 0x7f148409e760 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.903+0000 7f14817fa700 1 -- 172.21.15.19:0/1009379581 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1470021070 con 0x7f148409e760 2023-10-03T10:17:03.904 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 msgr2=0x7f148411bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f147000e870 tx=0x7f147000eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 shutdown_connections 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f14841338a0 0x7f148411c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f148409de50 0x7f148411b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 --2- 172.21.15.19:0/1009379581 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f148409e760 0x7f148411bd90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 >> 172.21.15.19:0/1009379581 conn(0x7f14840a2aa0 msgr2=0x7f14841306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 shutdown_connections 2023-10-03T10:17:03.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.906+0000 7f148ac51700 1 -- 172.21.15.19:0/1009379581 wait complete. 2023-10-03T10:17:03.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:03.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.952+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f110011cc70 con 0x7f110006a770 2023-10-03T10:17:03.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.952+0000 7f10f67fc700 1 -- 172.21.15.19:0/3194437741 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f110011cc70 con 0x7f110006a770 2023-10-03T10:17:03.953 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:03.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 msgr2=0x7f110011c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00c520 tx=0x7f10fc00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 shutdown_connections 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f110013d1f0 0x7f110013baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f110006a770 0x7f110011c010 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 --2- 172.21.15.19:0/3194437741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f110009de00 0x7f110013b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.954+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 >> 172.21.15.19:0/3194437741 conn(0x7f1100066f50 msgr2=0x7f11000a2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.955+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 shutdown_connections 2023-10-03T10:17:03.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.955+0000 7f1107d0b700 1 -- 172.21.15.19:0/3194437741 wait complete. 2023-10-03T10:17:03.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.975+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08ec005590 con 0x7f090c133f40 2023-10-03T10:17:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.975+0000 7f08f37fe700 1 -- 172.21.15.19:0/2616006779 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0904018020 con 0x7f090c133f40 2023-10-03T10:17:03.976 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.977+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 msgr2=0x7f090c071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.977+0000 7f0911403700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 0x7f090c071100 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f090400efc0 tx=0x7f090400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 shutdown_connections 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f090c133f40 0x7f090c071100 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f090c06a770 0x7f090c070680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 --2- 172.21.15.19:0/2616006779 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f090c133280 0x7f090c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 >> 172.21.15.19:0/2616006779 conn(0x7f090c0a2cc0 msgr2=0x7f090c09b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 shutdown_connections 2023-10-03T10:17:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:03.978+0000 7f0911403700 1 -- 172.21.15.19:0/2616006779 wait complete. 2023-10-03T10:17:03.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:04.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:04.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:04.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.991+0000 7f66c73a2700 1 Processor -- start 2023-10-03T10:17:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.991+0000 7f66c73a2700 1 -- start start 2023-10-03T10:17:04.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c73a2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 0x7f66c0136720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c73a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c73a2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c009d8a0 con 0x7f66c009bc50 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c73a2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c006b490 con 0x7f66c009c730 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c73a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c009e5e0 con 0x7f66c0136c60 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c6ba1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c6ba1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56054/0 (socket says 172.21.15.19:56054) 2023-10-03T10:17:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c6ba1700 1 -- 172.21.15.19:0/4066470622 learned_addr learned my addr 172.21.15.19:0/4066470622 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.992+0000 7f66c5b9f700 1 --2- 172.21.15.19:0/4066470622 >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 0x7f66c0136720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c6ba1700 1 -- 172.21.15.19:0/4066470622 >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 msgr2=0x7f66c0136720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c6ba1700 1 --2- 172.21.15.19:0/4066470622 >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 0x7f66c0136720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c6ba1700 1 -- 172.21.15.19:0/4066470622 >> v1:172.21.15.19:6789/0 conn(0x7f66c009bc50 legacy=0x7f66c009c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c6ba1700 1 -- 172.21.15.19:0/4066470622 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c009e8a0 con 0x7f66c0136c60 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c539e700 1 -- 172.21.15.19:0/4066470622 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940891602 0 0) 0x7f66c009d8a0 con 0x7f66c009bc50 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c5b9f700 1 --2- 172.21.15.19:0/4066470622 >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 0x7f66c0136720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c6ba1700 1 --2- 172.21.15.19:0/4066470622 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009e50 tx=0x7f66b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a163d6f43dddb144 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c539e700 1 -- 172.21.15.19:0/4066470622 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800e070 con 0x7f66c0136c60 2023-10-03T10:17:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c539e700 1 -- 172.21.15.19:0/4066470622 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800b910 con 0x7f66c0136c60 2023-10-03T10:17:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.993+0000 7f66c539e700 1 -- 172.21.15.19:0/4066470622 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800bcc0 con 0x7f66c0136c60 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 -- 172.21.15.19:0/4066470622 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 msgr2=0x7f66c0139040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 --2- 172.21.15.19:0/4066470622 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f66b8009e50 tx=0x7f66b800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 -- 172.21.15.19:0/4066470622 shutdown_connections 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 --2- 172.21.15.19:0/4066470622 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c0136c60 0x7f66c0139040 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 --2- 172.21.15.19:0/4066470622 >> v2:172.21.15.19:3300/0 conn(0x7f66c009c730 0x7f66c0136720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 -- 172.21.15.19:0/4066470622 >> 172.21.15.19:0/4066470622 conn(0x7f66c00a2e20 msgr2=0x7f66c00a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 -- 172.21.15.19:0/4066470622 shutdown_connections 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.994+0000 7f66c73a2700 1 -- 172.21.15.19:0/4066470622 wait complete. 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.995+0000 7f66c73a2700 1 Processor -- start 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.995+0000 7f66c73a2700 1 -- start start 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 0x7f66c011f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c009c730 0x7f66c011f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0122760 con 0x7f66c009bc50 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c01350b0 con 0x7f66c009c730 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c73a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66c0071ad0 con 0x7f66c0136c60 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:42124/0 (socket says 172.21.15.19:42124) 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c63a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 0x7f66c011f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 -- 172.21.15.19:0/1048196638 learned_addr learned my addr 172.21.15.19:0/1048196638 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 -- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c009c730 msgr2=0x7f66c011f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c009c730 0x7f66c011f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 -- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 msgr2=0x7f66c011f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 0x7f66c011f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c6ba1700 1 -- 172.21.15.19:0/1048196638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b0009430 con 0x7f66c0136c60 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.996+0000 7f66c63a0700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 0x7f66c011f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66c6ba1700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b8004920 con 0x7f66c0136c60 2023-10-03T10:17:05.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b80092e0 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b801c660 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b8009b30 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.997+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c0122d00 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.998+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f66b801c7c0 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.998+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f66b8040ee0 con 0x7f66c0136c60 2023-10-03T10:17:05.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:04.999+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c01228a0 con 0x7f66c0136c60 2023-10-03T10:17:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.006+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f66b80123f0 con 0x7f66c0136c60 2023-10-03T10:17:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.067+0000 7fab8d4a8700 1 Processor -- start 2023-10-03T10:17:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 -- start start 2023-10-03T10:17:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab881338a0 0x7fab88133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 0x7fab8813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8806fef0 con 0x7fab881338a0 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8806ef30 con 0x7fab8809e760 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab8d4a8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab881334b0 con 0x7fab8809de50 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab86ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab881338a0 0x7fab88133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab86ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fab881338a0 0x7fab88133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41588/0 (socket says 172.21.15.19:41588) 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab86ffd700 1 -- 172.21.15.19:0/2643552340 learned_addr learned my addr 172.21.15.19:0/2643552340 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.068+0000 7fab877fe700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 0x7fab8813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab867fc700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 -- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 msgr2=0x7fab8809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 -- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 msgr2=0x7fab8813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 0x7fab8813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 -- 172.21.15.19:0/2643552340 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8806fc30 con 0x7fab881338a0 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab877fe700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 0x7fab8813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab86ffd700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab881338a0 0x7fab88133c70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fab780098f0 tx=0x7fab78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393911d83ea1b014 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab85ffb700 1 -- 172.21.15.19:0/2643552340 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011830 con 0x7fab881338a0 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab85ffb700 1 -- 172.21.15.19:0/2643552340 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78011990 con 0x7fab881338a0 2023-10-03T10:17:05.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.069+0000 7fab85ffb700 1 -- 172.21.15.19:0/2643552340 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78011d20 con 0x7fab881338a0 2023-10-03T10:17:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab881338a0 msgr2=0x7fab88133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab881338a0 0x7fab88133c70 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fab780098f0 tx=0x7fab78009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2643552340 shutdown_connections 2023-10-03T10:17:05.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab8809e760 0x7fab8813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab881338a0 0x7fab88133c70 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2643552340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2643552340 >> 172.21.15.19:0/2643552340 conn(0x7fab880a2aa0 msgr2=0x7fab880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2643552340 shutdown_connections 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.070+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2643552340 wait complete. 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.071+0000 7fab8d4a8700 1 Processor -- start 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.071+0000 7fab8d4a8700 1 -- start start 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8811b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab881338a0 0x7fab8811c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8811cb50 con 0x7fab8809e760 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8811d260 con 0x7fab881338a0 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab8d4a8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fab8811e4b0 con 0x7fab8809de50 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab867fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41596/0 (socket says 172.21.15.19:41596) 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab867fc700 1 -- 172.21.15.19:0/2825866795 learned_addr learned my addr 172.21.15.19:0/2825866795 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab877fe700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab881338a0 0x7fab8811c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.072+0000 7fab867fc700 1 -- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 msgr2=0x7fab8811b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab867fc700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8811b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab867fc700 1 -- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab881338a0 msgr2=0x7fab8811c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab867fc700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab881338a0 0x7fab8811c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab867fc700 1 -- 172.21.15.19:0/2825866795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80009a70 con 0x7fab8809e760 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab867fc700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d830 tx=0x7fab7c00dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c0125f0 con 0x7fab8809e760 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7c012750 con 0x7fab8809e760 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78009550 con 0x7fab8809e760 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7c012b00 con 0x7fab8809e760 2023-10-03T10:17:05.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.073+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab880a0f90 con 0x7fab8809e760 2023-10-03T10:17:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.074+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fab7c012c60 con 0x7fab8809e760 2023-10-03T10:17:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.074+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8806f640 con 0x7fab8809e760 2023-10-03T10:17:05.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.074+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fab7c03f950 con 0x7fab8809e760 2023-10-03T10:17:05.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.084+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fab7c011750 con 0x7fab8809e760 2023-10-03T10:17:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.129+0000 7f5842ae1700 1 Processor -- start 2023-10-03T10:17:05.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.129+0000 7f5842ae1700 1 -- start start 2023-10-03T10:17:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f5842ae1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 0x7f583c138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f5842ae1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c1393e0 0x7f583c13b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f5842ae1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c09f960 con 0x7f583c09e850 2023-10-03T10:17:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f5842ae1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09f720 con 0x7f583c09f330 2023-10-03T10:17:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f5842ae1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c09ae60 con 0x7f583c1393e0 2023-10-03T10:17:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.130+0000 7f583bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 0x7f583c138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f584087d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f583c09e850 0x7f583c09ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43646/0 (socket says 172.21.15.19:43646) 2023-10-03T10:17:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f584087d700 1 -- 172.21.15.19:0/1152806503 learned_addr learned my addr 172.21.15.19:0/1152806503 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f584107e700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c1393e0 0x7f583c13b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583bfff700 1 -- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c1393e0 msgr2=0x7f583c13b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583bfff700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c1393e0 0x7f583c13b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583bfff700 1 -- 172.21.15.19:0/1152806503 >> v1:172.21.15.19:6789/0 conn(0x7f583c09e850 legacy=0x7f583c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583bfff700 1 -- 172.21.15.19:0/1152806503 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c06cb10 con 0x7f583c09f330 2023-10-03T10:17:05.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583bfff700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 0x7f583c138ea0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f5828009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e62a0c240c9746 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583b7fe700 1 -- 172.21.15.19:0/1152806503 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828011830 con 0x7f583c09f330 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583b7fe700 1 -- 172.21.15.19:0/1152806503 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828011990 con 0x7f583c09f330 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.131+0000 7f583b7fe700 1 -- 172.21.15.19:0/1152806503 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828011d20 con 0x7f583c09f330 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 -- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 msgr2=0x7f583c138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 0x7f583c138ea0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5828009870 tx=0x7f5828009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 -- 172.21.15.19:0/1152806503 shutdown_connections 2023-10-03T10:17:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c1393e0 0x7f583c13b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 --2- 172.21.15.19:0/1152806503 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c09f330 0x7f583c138ea0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 -- 172.21.15.19:0/1152806503 >> 172.21.15.19:0/1152806503 conn(0x7f583c0a3f70 msgr2=0x7f583c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 -- 172.21.15.19:0/1152806503 shutdown_connections 2023-10-03T10:17:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.132+0000 7f5842ae1700 1 -- 172.21.15.19:0/1152806503 wait complete. 2023-10-03T10:17:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.133+0000 7f5842ae1700 1 Processor -- start 2023-10-03T10:17:05.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.133+0000 7f5842ae1700 1 -- start start 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c09e850 0x7f583c1c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f583c09f330 0x7f583c1c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c120780 con 0x7f583c09f330 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c121ca0 con 0x7f583c1393e0 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f5842ae1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1348e0 con 0x7f583c09e850 2023-10-03T10:17:05.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56106/0 (socket says 172.21.15.19:56106) 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 -- 172.21.15.19:0/799377637 learned_addr learned my addr 172.21.15.19:0/799377637 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584087d700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c09e850 0x7f583c1c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 -- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c09e850 msgr2=0x7f583c1c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c09e850 0x7f583c1c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 -- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f583c09f330 msgr2=0x7f583c1c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f583c09f330 0x7f583c1c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.134+0000 7f584107e700 1 -- 172.21.15.19:0/799377637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280094a0 con 0x7f583c1393e0 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f584107e700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f583400efc0 tx=0x7f583400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009ea0 con 0x7f583c1393e0 2023-10-03T10:17:05.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400f040 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c121f70 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c1c9310 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.135+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834014480 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.136+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f58340145e0 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.137+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f581c0052e0 con 0x7f583c1393e0 2023-10-03T10:17:05.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.137+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f583403fff0 con 0x7f583c1393e0 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.137+0000 7f673a66e700 1 Processor -- start 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.137+0000 7f673a66e700 1 -- start start 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673409de50 0x7f673409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 0x7f673413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673406fef0 con 0x7f673409e760 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673406ef30 con 0x7f67341338a0 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f673a66e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67341334b0 con 0x7f673409de50 2023-10-03T10:17:05.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f6733fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f6738c0b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 0x7f673413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f6733fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56110/0 (socket says 172.21.15.19:56110) 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f6733fff700 1 -- 172.21.15.19:0/537969276 learned_addr learned my addr 172.21.15.19:0/537969276 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.138+0000 7f67337fe700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673409de50 0x7f673409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 -- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673409de50 msgr2=0x7f673409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673409de50 0x7f673409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 -- 172.21.15.19:0/537969276 >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 msgr2=0x7f673413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 --2- 172.21.15.19:0/537969276 >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 0x7f673413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 -- 172.21.15.19:0/537969276 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673406fc30 con 0x7f67341338a0 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6738c0b700 1 --2- 172.21.15.19:0/537969276 >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 0x7f673413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:05.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.139+0000 7f6733fff700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6724009920 tx=0x7f6724009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aec490b31af63b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.142+0000 7f6732ffd700 1 -- 172.21.15.19:0/537969276 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724011830 con 0x7f67341338a0 2023-10-03T10:17:05.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.142+0000 7f6732ffd700 1 -- 172.21.15.19:0/537969276 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724011990 con 0x7f67341338a0 2023-10-03T10:17:05.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.143+0000 7f6732ffd700 1 -- 172.21.15.19:0/537969276 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724011d20 con 0x7f67341338a0 2023-10-03T10:17:05.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.143+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f583401a8b0 con 0x7f583c1393e0 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.143+0000 7f673a66e700 1 -- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 msgr2=0x7f6734133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.143+0000 7f673a66e700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6724009920 tx=0x7f6724009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.144+0000 7f673a66e700 1 -- 172.21.15.19:0/537969276 shutdown_connections 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.144+0000 7f673a66e700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f67341338a0 0x7f6734133c70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.144+0000 7f673a66e700 1 --2- 172.21.15.19:0/537969276 >> v2:172.21.15.19:3300/0 conn(0x7f673409e760 0x7f673413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.144+0000 7f673a66e700 1 --2- 172.21.15.19:0/537969276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f673409de50 0x7f673409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.144+0000 7f673a66e700 1 -- 172.21.15.19:0/537969276 >> 172.21.15.19:0/537969276 conn(0x7f67340a2aa0 msgr2=0x7f67340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.145+0000 7f673a66e700 1 -- 172.21.15.19:0/537969276 shutdown_connections 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.145+0000 7f673a66e700 1 -- 172.21.15.19:0/537969276 wait complete. 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.146+0000 7f673a66e700 1 Processor -- start 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.146+0000 7f673a66e700 1 -- start start 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673409e760 0x7f673411efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f67341338a0 0x7f673411f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6734121fe0 con 0x7f673409e760 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6734122580 con 0x7f673409de50 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f673a66e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f673406f640 con 0x7f67341338a0 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56116/0 (socket says 172.21.15.19:56116) 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 -- 172.21.15.19:0/1694211967 learned_addr learned my addr 172.21.15.19:0/1694211967 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 -- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f67341338a0 msgr2=0x7f673411f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f67341338a0 0x7f673411f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 -- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673409e760 msgr2=0x7f673411efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673409e760 0x7f673411efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.147+0000 7f6733fff700 1 -- 172.21.15.19:0/1694211967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6724009550 con 0x7f673409de50 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f6733fff700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f67240098f0 tx=0x7f6724004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240036a0 con 0x7f673409de50 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724003800 con 0x7f673409de50 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6734120ed0 con 0x7f673409de50 2023-10-03T10:17:05.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724003bb0 con 0x7f673409de50 2023-10-03T10:17:05.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.148+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673412f580 con 0x7f673409de50 2023-10-03T10:17:05.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.149+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6724003d10 con 0x7f673409de50 2023-10-03T10:17:05.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.149+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6724040520 con 0x7f673409de50 2023-10-03T10:17:05.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.149+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6734074ea0 con 0x7f673409de50 2023-10-03T10:17:05.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.154+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f672402a310 con 0x7f673409de50 2023-10-03T10:17:05.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.290+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f66c009dd60 con 0x7f66c0136c60 2023-10-03T10:17:05.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.290+0000 7f66b6ffd700 1 -- 172.21.15.19:0/1048196638 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66b8033090 con 0x7f66c0136c60 2023-10-03T10:17:05.291 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 msgr2=0x7f66c011fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f66b800b680 tx=0x7f66b8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 shutdown_connections 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f66c0136c60 0x7f66c011fc60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66c009bc50 0x7f66c011f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 --2- 172.21.15.19:0/1048196638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f66c009c730 0x7f66c011f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 >> 172.21.15.19:0/1048196638 conn(0x7f66c00a2e20 msgr2=0x7f66c00a19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 shutdown_connections 2023-10-03T10:17:05.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.294+0000 7f66c73a2700 1 -- 172.21.15.19:0/1048196638 wait complete. 2023-10-03T10:17:05.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.343+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fab88074ea0 con 0x7fab8809e760 2023-10-03T10:17:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.343+0000 7fab6f7fe700 1 -- 172.21.15.19:0/2825866795 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fab7c013390 con 0x7fab8809e760 2023-10-03T10:17:05.344 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 msgr2=0x7fab8811bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00d830 tx=0x7fab7c00dbf0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 shutdown_connections 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fab881338a0 0x7fab8811c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fab8809de50 0x7fab8811b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 --2- 172.21.15.19:0/2825866795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fab8809e760 0x7fab8811bbe0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 >> 172.21.15.19:0/2825866795 conn(0x7fab880a2aa0 msgr2=0x7fab88130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 shutdown_connections 2023-10-03T10:17:05.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.346+0000 7fab8d4a8700 1 -- 172.21.15.19:0/2825866795 wait complete. 2023-10-03T10:17:05.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.388+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f581c005590 con 0x7f583c1393e0 2023-10-03T10:17:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.388+0000 7f58397fa700 1 -- 172.21.15.19:0/799377637 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5834018030 con 0x7f583c1393e0 2023-10-03T10:17:05.389 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.390+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 msgr2=0x7f583c11ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.390+0000 7f5842ae1700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f583400efc0 tx=0x7f583400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 shutdown_connections 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f583c1393e0 0x7f583c11ea30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f583c09e850 0x7f583c1c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 --2- 172.21.15.19:0/799377637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f583c09f330 0x7f583c1c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 >> 172.21.15.19:0/799377637 conn(0x7f583c0a3f70 msgr2=0x7f583c136e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 shutdown_connections 2023-10-03T10:17:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.391+0000 7f5842ae1700 1 -- 172.21.15.19:0/799377637 wait complete. 2023-10-03T10:17:05.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.400+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6734122d70 con 0x7f673409de50 2023-10-03T10:17:05.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.400+0000 7f6730ff9700 1 -- 172.21.15.19:0/1694211967 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6724028020 con 0x7f673409de50 2023-10-03T10:17:05.401 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.403+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 msgr2=0x7f673411ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.403+0000 7f673a66e700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f67240098f0 tx=0x7f6724004750 comp rx=0 tx=0).stop 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 shutdown_connections 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f67341338a0 0x7f673411f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f673409de50 0x7f673411ea60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 --2- 172.21.15.19:0/1694211967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f673409e760 0x7f673411efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 >> 172.21.15.19:0/1694211967 conn(0x7f67340a2aa0 msgr2=0x7f673409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 shutdown_connections 2023-10-03T10:17:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:05.404+0000 7f673a66e700 1 -- 172.21.15.19:0/1694211967 wait complete. 2023-10-03T10:17:05.406 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:05.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:06.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:06.361 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:06.407 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:06.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:06.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.468+0000 7fe566f32700 1 Processor -- start 2023-10-03T10:17:06.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.468+0000 7fe566f32700 1 -- start start 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe566f32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe566f32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 0x7fe560139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe566f32700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56009b4f0 con 0x7fe560131810 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe566f32700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5601313c0 con 0x7fe560136f50 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe566f32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe56006e8c0 con 0x7fe560134630 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe55ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe55ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49456/0 (socket says 172.21.15.19:49456) 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe55ffff700 1 -- 172.21.15.19:0/4109777832 learned_addr learned my addr 172.21.15.19:0/4109777832 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe5654cf700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 0x7fe560139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe5654cf700 1 -- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 msgr2=0x7fe560136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe5654cf700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe5654cf700 1 -- 172.21.15.19:0/4109777832 >> v1:172.21.15.19:6789/0 conn(0x7fe560131810 legacy=0x7fe560131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.469+0000 7fe5654cf700 1 -- 172.21.15.19:0/4109777832 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe560071d20 con 0x7fe560136f50 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.470+0000 7fe5654cf700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 0x7fe560139330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe558009dc0 tx=0x7fe55800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8bf0719a7dd2636 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.470+0000 7fe55f7fe700 1 -- 172.21.15.19:0/4109777832 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800e070 con 0x7fe560136f50 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.470+0000 7fe55f7fe700 1 -- 172.21.15.19:0/4109777832 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800bae0 con 0x7fe560136f50 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.470+0000 7fe55f7fe700 1 -- 172.21.15.19:0/4109777832 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800be90 con 0x7fe560136f50 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 -- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 msgr2=0x7fe560139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 0x7fe560139330 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe558009dc0 tx=0x7fe55800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:06.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 -- 172.21.15.19:0/4109777832 shutdown_connections 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560136f50 0x7fe560139330 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 --2- 172.21.15.19:0/4109777832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 -- 172.21.15.19:0/4109777832 >> 172.21.15.19:0/4109777832 conn(0x7fe5600a2aa0 msgr2=0x7fe5600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.471+0000 7fe566f32700 1 -- 172.21.15.19:0/4109777832 shutdown_connections 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.472+0000 7fe566f32700 1 -- 172.21.15.19:0/4109777832 wait complete. 2023-10-03T10:17:06.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.473+0000 7fe566f32700 1 Processor -- start 2023-10-03T10:17:06.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.473+0000 7fe566f32700 1 -- start start 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 0x7fe560119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56011a830 con 0x7fe560136f50 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56011c3c0 con 0x7fe560131810 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe566f32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe560130d20 con 0x7fe560134630 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49840/0 (socket says 172.21.15.19:49840) 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 -- 172.21.15.19:0/3503725168 learned_addr learned my addr 172.21.15.19:0/3503725168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe5654cf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 0x7fe560119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 -- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 msgr2=0x7fe560119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 -- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 msgr2=0x7fe560119750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 0x7fe560119750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe564cce700 1 -- 172.21.15.19:0/3503725168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558009a70 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.474+0000 7fe5654cf700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 0x7fe560119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe564cce700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c4d0 tx=0x7fe55400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554011790 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540118f0 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56011ce90 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554011ca0 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.475+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56011c6a0 con 0x7fe560131810 2023-10-03T10:17:06.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.476+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe55401c460 con 0x7fe560131810 2023-10-03T10:17:06.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.476+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe55403f430 con 0x7fe560131810 2023-10-03T10:17:06.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.477+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56012ea70 con 0x7fe560131810 2023-10-03T10:17:06.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.482+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5540108d0 con 0x7fe560131810 2023-10-03T10:17:06.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.527+0000 7f3c8edab700 1 Processor -- start 2023-10-03T10:17:06.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.527+0000 7f3c8edab700 1 -- start start 2023-10-03T10:17:06.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8edab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c8809d6f0 0x7f3c8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8edab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e410 0x7f3c88130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8edab700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8809f130 con 0x7f3c8809e000 2023-10-03T10:17:06.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8edab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8809f520 con 0x7f3c8809d6f0 2023-10-03T10:17:06.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8edab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8809e930 con 0x7f3c8809e410 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8cb47700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c8809d6f0 0x7f3c8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8cb47700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3c8809d6f0 0x7f3c8809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34018/0 (socket says 172.21.15.19:34018) 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8cb47700 1 -- 172.21.15.19:0/7693328 learned_addr learned my addr 172.21.15.19:0/7693328 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.528+0000 7f3c8d348700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e410 0x7f3c88130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c8cb47700 1 -- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e410 msgr2=0x7f3c88130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c8cb47700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e410 0x7f3c88130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c8cb47700 1 -- 172.21.15.19:0/7693328 >> v1:172.21.15.19:6789/0 conn(0x7f3c8809e000 legacy=0x7f3c88130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c8cb47700 1 -- 172.21.15.19:0/7693328 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8809b2d0 con 0x7f3c8809d6f0 2023-10-03T10:17:06.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c8cb47700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8809dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00bb90 tx=0x7f3c7c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f183acc2b17b4197 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c877fe700 1 -- 172.21.15.19:0/7693328 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00dd30 con 0x7f3c8809d6f0 2023-10-03T10:17:06.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c877fe700 1 -- 172.21.15.19:0/7693328 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c00de90 con 0x7f3c8809d6f0 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.529+0000 7f3c877fe700 1 -- 172.21.15.19:0/7693328 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c010690 con 0x7f3c8809d6f0 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 -- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 msgr2=0x7f3c8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8809dac0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00bb90 tx=0x7f3c7c00bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 -- 172.21.15.19:0/7693328 shutdown_connections 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e410 0x7f3c88130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 --2- 172.21.15.19:0/7693328 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8809dac0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 -- 172.21.15.19:0/7693328 >> 172.21.15.19:0/7693328 conn(0x7f3c88066f50 msgr2=0x7f3c8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 -- 172.21.15.19:0/7693328 shutdown_connections 2023-10-03T10:17:06.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.530+0000 7f3c8edab700 1 -- 172.21.15.19:0/7693328 wait complete. 2023-10-03T10:17:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.532+0000 7f3c8edab700 1 Processor -- start 2023-10-03T10:17:06.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.532+0000 7f3c8edab700 1 -- start start 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8811dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 0x7f3c8811ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8811f480 con 0x7f3c8809d6f0 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88130390 con 0x7f3c8809e410 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8edab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88120e10 con 0x7f3c8809e000 2023-10-03T10:17:06.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8cb47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8811dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49478/0 (socket says 172.21.15.19:49478) 2023-10-03T10:17:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c87fff700 1 -- 172.21.15.19:0/1775081527 learned_addr learned my addr 172.21.15.19:0/1775081527 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.533+0000 7f3c8d348700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 0x7f3c8811ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 -- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 msgr2=0x7f3c8811ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 0x7f3c8811ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 -- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 msgr2=0x7f3c8811dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8811dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 -- 172.21.15.19:0/1775081527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7c00b7f0 con 0x7f3c8809e000 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c8d348700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 0x7f3c8811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c8cb47700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8811dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c87fff700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c510 tx=0x7f3c7400c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c740052d0 con 0x7f3c8809e000 2023-10-03T10:17:06.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c74005430 con 0x7f3c8809e000 2023-10-03T10:17:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c740038c0 con 0x7f3c8809e000 2023-10-03T10:17:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c881217f0 con 0x7f3c8809e000 2023-10-03T10:17:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.534+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c880a1d90 con 0x7f3c8809e000 2023-10-03T10:17:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.536+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3c74003a20 con 0x7f3c8809e000 2023-10-03T10:17:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.536+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8809c700 con 0x7f3c8809e000 2023-10-03T10:17:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.536+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3c7403e9e0 con 0x7f3c8809e000 2023-10-03T10:17:06.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.545+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3c74011590 con 0x7f3c8809e000 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.560+0000 7fbccd9a7700 1 Processor -- start 2023-10-03T10:17:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 -- start start 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc80704b0 con 0x7fbcc8130e50 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc809a390 con 0x7fbcc806fb20 2023-10-03T10:17:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbccd9a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80716a0 con 0x7fbcc8130540 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbcc77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbcc67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbcc77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49854/0 (socket says 172.21.15.19:49854) 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbcc77fe700 1 -- 172.21.15.19:0/1127330405 learned_addr learned my addr 172.21.15.19:0/1127330405 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.561+0000 7fbcc67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34026/0 (socket says 172.21.15.19:34026) 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc6ffd700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 -- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 msgr2=0x7fbcc8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 -- 172.21.15.19:0/1127330405 >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 msgr2=0x7fbcc806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 --2- 172.21.15.19:0/1127330405 >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 -- 172.21.15.19:0/1127330405 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc8071290 con 0x7fbcc806fb20 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc67fc700 1 --2- 172.21.15.19:0/1127330405 >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc77fe700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009e50 tx=0x7fbcc000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b79a14a6ee7115 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc5ffb700 1 -- 172.21.15.19:0/1127330405 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000e070 con 0x7fbcc806fb20 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc5ffb700 1 -- 172.21.15.19:0/1127330405 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc000b910 con 0x7fbcc806fb20 2023-10-03T10:17:06.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.562+0000 7fbcc5ffb700 1 -- 172.21.15.19:0/1127330405 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000bcc0 con 0x7fbcc806fb20 2023-10-03T10:17:06.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 -- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 msgr2=0x7fbcc806ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009e50 tx=0x7fbcc000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:06.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 -- 172.21.15.19:0/1127330405 shutdown_connections 2023-10-03T10:17:06.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc806ff70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/1127330405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/1127330405 >> v2:172.21.15.19:3300/0 conn(0x7fbcc8130e50 0x7fbcc806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.563+0000 7fbccd9a7700 1 -- 172.21.15.19:0/1127330405 >> 172.21.15.19:0/1127330405 conn(0x7fbcc80a2aa0 msgr2=0x7fbcc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.564+0000 7fbccd9a7700 1 -- 172.21.15.19:0/1127330405 shutdown_connections 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.564+0000 7fbccd9a7700 1 -- 172.21.15.19:0/1127330405 wait complete. 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.565+0000 7fbccd9a7700 1 Processor -- start 2023-10-03T10:17:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.565+0000 7fbccd9a7700 1 -- start start 2023-10-03T10:17:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc81c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc81c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc8130e50 0x7fbcc81c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc812cd40 con 0x7fbcc8130e50 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc80a09c0 con 0x7fbcc806fb20 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbccd9a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc81c5860 con 0x7fbcc8130540 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc81c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbcc6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc81c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49856/0 (socket says 172.21.15.19:49856) 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbcc67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc81c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbcc6ffd700 1 -- 172.21.15.19:0/241067264 learned_addr learned my addr 172.21.15.19:0/241067264 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.566+0000 7fbcc77fe700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc8130e50 0x7fbcc81c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 -- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 msgr2=0x7fbcc81c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc81c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 -- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc8130e50 msgr2=0x7fbcc81c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc8130e50 0x7fbcc81c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 -- 172.21.15.19:0/241067264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc0094a0 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcc67fc700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc81c5320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00e9b0 tx=0x7fbcbc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00ee50 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00c850 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc0009b30 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00cbe0 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.567+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc812d2e0 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.568+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcbc00cd40 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.569+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcbc03f9d0 con 0x7fbcc8130540 2023-10-03T10:17:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.569+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc8074ea0 con 0x7fbcc8130540 2023-10-03T10:17:06.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.574+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcbc01b3b0 con 0x7fbcc8130540 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.603+0000 7fd64dd60700 1 Processor -- start 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.603+0000 7fd64dd60700 1 -- start start 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.603+0000 7fd64dd60700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 0x7fd6481337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.603+0000 7fd64dd60700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd64dd60700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 0x7fd6481304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd64dd60700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64806b990 con 0x7fd648133420 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd64dd60700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6480a0590 con 0x7fd648133e30 2023-10-03T10:17:06.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd64dd60700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd64809fb80 con 0x7fd648134260 2023-10-03T10:17:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd646ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd646ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49860/0 (socket says 172.21.15.19:49860) 2023-10-03T10:17:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd646ffd700 1 -- 172.21.15.19:0/496560840 learned_addr learned my addr 172.21.15.19:0/496560840 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd6477fe700 1 --2- 172.21.15.19:0/496560840 >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 0x7fd6481337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 0x7fd6481304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 -- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 msgr2=0x7fd64812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 -- 172.21.15.19:0/496560840 >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 msgr2=0x7fd6481337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:06.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 --2- 172.21.15.19:0/496560840 >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 0x7fd6481337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd647fff700 1 -- 172.21.15.19:0/496560840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480a0030 con 0x7fd648134260 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd6477fe700 1 --2- 172.21.15.19:0/496560840 >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 0x7fd6481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.604+0000 7fd646ffd700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd647fff700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 0x7fd6481304d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd640009d90 tx=0x7fd64000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd134c4f07a45190 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd6467fc700 1 -- 172.21.15.19:0/496560840 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64000e070 con 0x7fd648134260 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd6467fc700 1 -- 172.21.15.19:0/496560840 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64000bb20 con 0x7fd648134260 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd6467fc700 1 -- 172.21.15.19:0/496560840 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640012430 con 0x7fd648134260 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd64dd60700 1 -- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 msgr2=0x7fd6481304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.605+0000 7fd64dd60700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 0x7fd6481304d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fd640009d90 tx=0x7fd64000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 -- 172.21.15.19:0/496560840 shutdown_connections 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648134260 0x7fd6481304d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 --2- 172.21.15.19:0/496560840 >> v2:172.21.15.19:3300/0 conn(0x7fd648133420 0x7fd6481337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 --2- 172.21.15.19:0/496560840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648133e30 0x7fd64812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 -- 172.21.15.19:0/496560840 >> 172.21.15.19:0/496560840 conn(0x7fd6480a4210 msgr2=0x7fd6480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 -- 172.21.15.19:0/496560840 shutdown_connections 2023-10-03T10:17:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.606+0000 7fd64dd60700 1 -- 172.21.15.19:0/496560840 wait complete. 2023-10-03T10:17:06.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 Processor -- start 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 -- start start 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648133e30 0x7fd64809cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 0x7fd64809d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64811ea90 con 0x7fd648133420 2023-10-03T10:17:06.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481209d0 con 0x7fd648134260 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.607+0000 7fd64dd60700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd648120c90 con 0x7fd648133e30 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34048/0 (socket says 172.21.15.19:34048) 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 -- 172.21.15.19:0/1973885005 learned_addr learned my addr 172.21.15.19:0/1973885005 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd646ffd700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648133e30 0x7fd64809cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd647fff700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 0x7fd64809d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 -- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648133e30 msgr2=0x7fd64809cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648133e30 0x7fd64809cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 -- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 msgr2=0x7fd64809d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 0x7fd64809d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 -- 172.21.15.19:0/1973885005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6380094a0 con 0x7fd648133420 2023-10-03T10:17:06.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd647fff700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 0x7fd64809d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd6477fe700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd63800ebe0 tx=0x7fd63800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638009800 con 0x7fd648133420 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800c910 con 0x7fd648133420 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.608+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c009550 con 0x7fd648133420 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.609+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800cc80 con 0x7fd648133420 2023-10-03T10:17:06.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.609+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd640009a70 con 0x7fd648133420 2023-10-03T10:17:06.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.610+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd638013470 con 0x7fd648133420 2023-10-03T10:17:06.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.610+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd63803f810 con 0x7fd648133420 2023-10-03T10:17:06.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.610+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64806d400 con 0x7fd648133420 2023-10-03T10:17:06.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.619+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd638017020 con 0x7fd648133420 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.709+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe560074ea0 con 0x7fe560131810 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.710+0000 7fe55d7fa700 1 -- 172.21.15.19:0/3503725168 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5540102e0 con 0x7fe560131810 2023-10-03T10:17:06.710 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:06.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 msgr2=0x7fe560118cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe55400c4d0 tx=0x7fe55400c7e0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 shutdown_connections 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe560136f50 0x7fe560119750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe560131810 0x7fe560118cd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 --2- 172.21.15.19:0/3503725168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe560134630 0x7fe560119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.713+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 >> 172.21.15.19:0/3503725168 conn(0x7fe5600a2aa0 msgr2=0x7fe56009f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.714+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 shutdown_connections 2023-10-03T10:17:06.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.714+0000 7fe566f32700 1 -- 172.21.15.19:0/3503725168 wait complete. 2023-10-03T10:17:06.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:06.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.759+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3c88074ea0 con 0x7f3c8809e000 2023-10-03T10:17:06.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.759+0000 7f3c857fa700 1 -- 172.21.15.19:0/1775081527 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3c74017030 con 0x7f3c8809e000 2023-10-03T10:17:06.760 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 msgr2=0x7f3c8811e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3c7400c510 tx=0x7f3c7400c820 comp rx=0 tx=0).stop 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 shutdown_connections 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3c8809e410 0x7f3c8811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3c8809d6f0 0x7f3c8811dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 --2- 172.21.15.19:0/1775081527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3c8809e000 0x7f3c8811e4f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 >> 172.21.15.19:0/1775081527 conn(0x7f3c88066f50 msgr2=0x7f3c8806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 shutdown_connections 2023-10-03T10:17:06.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.762+0000 7f3c8edab700 1 -- 172.21.15.19:0/1775081527 wait complete. 2023-10-03T10:17:06.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:06.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.784+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbcc806b9e0 con 0x7fbcc8130540 2023-10-03T10:17:06.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.785+0000 7fbcaffff700 1 -- 172.21.15.19:0/241067264 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcbc017020 con 0x7fbcc8130540 2023-10-03T10:17:06.786 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 msgr2=0x7fbcc81c5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc81c5320 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00e9b0 tx=0x7fbcbc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 shutdown_connections 2023-10-03T10:17:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcc8130e50 0x7fbcc81c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcc806fb20 0x7fbcc81c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 --2- 172.21.15.19:0/241067264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcc8130540 0x7fbcc81c5320 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 >> 172.21.15.19:0/241067264 conn(0x7fbcc80a2aa0 msgr2=0x7fbcc812f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 shutdown_connections 2023-10-03T10:17:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.787+0000 7fbccd9a7700 1 -- 172.21.15.19:0/241067264 wait complete. 2023-10-03T10:17:06.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.830+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd64811fdb0 con 0x7fd648133420 2023-10-03T10:17:06.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.830+0000 7fd62ffff700 1 -- 172.21.15.19:0/1973885005 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd638013720 con 0x7fd648133420 2023-10-03T10:17:06.831 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:06.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.832+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 msgr2=0x7fd64809c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.832+0000 7fd64dd60700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd63800ebe0 tx=0x7fd63800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 shutdown_connections 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd648134260 0x7fd64809d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd648133420 0x7fd64809c6e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 --2- 172.21.15.19:0/1973885005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd648133e30 0x7fd64809cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 >> 172.21.15.19:0/1973885005 conn(0x7fd6480a4210 msgr2=0x7fd6481302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 shutdown_connections 2023-10-03T10:17:06.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:06.833+0000 7fd64dd60700 1 -- 172.21.15.19:0/1973885005 wait complete. 2023-10-03T10:17:06.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:07.730 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:07.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:07.802 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:07.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.878+0000 7f46db7b9700 1 Processor -- start 2023-10-03T10:17:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 -- start start 2023-10-03T10:17:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 0x7f46d4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d406ef30 con 0x7f46d409e760 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d406fef0 con 0x7f46d41338a0 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.879+0000 7f46db7b9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d41334b0 con 0x7f46d409de50 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49526/0 (socket says 172.21.15.19:49526) 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 -- 172.21.15.19:0/38514425 learned_addr learned my addr 172.21.15.19:0/38514425 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d9555700 1 --2- 172.21.15.19:0/38514425 >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 0x7f46d4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 -- 172.21.15.19:0/38514425 >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 msgr2=0x7f46d4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 --2- 172.21.15.19:0/38514425 >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 0x7f46d4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 -- 172.21.15.19:0/38514425 >> v1:172.21.15.19:6789/0 conn(0x7f46d409e760 legacy=0x7f46d413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 -- 172.21.15.19:0/38514425 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d406fc30 con 0x7f46d409de50 2023-10-03T10:17:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d9555700 1 --2- 172.21.15.19:0/38514425 >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 0x7f46d4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46d8d54700 1 --2- 172.21.15.19:0/38514425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f46c40098f0 tx=0x7f46c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79971e537a35439a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.880+0000 7f46cbfff700 1 -- 172.21.15.19:0/38514425 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4004230 con 0x7f46d409de50 2023-10-03T10:17:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46cbfff700 1 -- 172.21.15.19:0/38514425 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4004390 con 0x7f46d409de50 2023-10-03T10:17:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46cbfff700 1 -- 172.21.15.19:0/38514425 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c40036a0 con 0x7f46d409de50 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 -- 172.21.15.19:0/38514425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 msgr2=0x7f46d409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 --2- 172.21.15.19:0/38514425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f46c40098f0 tx=0x7f46c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 -- 172.21.15.19:0/38514425 shutdown_connections 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 --2- 172.21.15.19:0/38514425 >> v2:172.21.15.19:3300/0 conn(0x7f46d41338a0 0x7f46d4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 --2- 172.21.15.19:0/38514425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d409e220 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.881+0000 7f46db7b9700 1 -- 172.21.15.19:0/38514425 >> 172.21.15.19:0/38514425 conn(0x7f46d40a2aa0 msgr2=0x7f46d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.882+0000 7f46db7b9700 1 -- 172.21.15.19:0/38514425 shutdown_connections 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.882+0000 7f46db7b9700 1 -- 172.21.15.19:0/38514425 wait complete. 2023-10-03T10:17:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.883+0000 7f46db7b9700 1 Processor -- start 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.883+0000 7f46db7b9700 1 -- start start 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d411ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d41338a0 0x7f46d411f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4120ea0 con 0x7f46d409e760 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d411feb0 con 0x7f46d41338a0 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46db7b9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d4120720 con 0x7f46d409de50 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34074/0 (socket says 172.21.15.19:34074) 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 -- 172.21.15.19:0/2147635696 learned_addr learned my addr 172.21.15.19:0/2147635696 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d9555700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d411ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 -- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 msgr2=0x7f46d411ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d411ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 -- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d41338a0 msgr2=0x7f46d411f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d41338a0 0x7f46d411f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.884+0000 7f46d8d54700 1 -- 172.21.15.19:0/2147635696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4009550 con 0x7f46d409e760 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46d8d54700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009130 tx=0x7f46c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400b660 con 0x7f46d409e760 2023-10-03T10:17:07.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c400b7c0 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c400bb70 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d4122240 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.885+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d4122cb0 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.886+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d4074ea0 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.887+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46c400bcd0 con 0x7f46d409e760 2023-10-03T10:17:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.887+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46c4040f30 con 0x7f46d409e760 2023-10-03T10:17:07.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.892+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46c4010b70 con 0x7f46d409e760 2023-10-03T10:17:07.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.933+0000 7fe9f1705700 1 Processor -- start 2023-10-03T10:17:07.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.933+0000 7fe9f1705700 1 -- start start 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9f1705700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9ec134630 0x7fe9ec136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9f1705700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 0x7fe9ec139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9f1705700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec09b4f0 con 0x7fe9ec131810 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9f1705700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec1313c0 con 0x7fe9ec134630 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9f1705700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec06e8c0 con 0x7fe9ec136f50 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9ea7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9ec134630 0x7fe9ec136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9ea7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe9ec134630 0x7fe9ec136a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34078/0 (socket says 172.21.15.19:34078) 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9eaffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe9ec131810 0x7fe9ec131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36364/0 (socket says 172.21.15.19:36364) 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9ea7fc700 1 -- 172.21.15.19:0/458054561 learned_addr learned my addr 172.21.15.19:0/458054561 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.934+0000 7fe9eb7fe700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 0x7fe9ec139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9ea7fc700 1 -- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 msgr2=0x7fe9ec139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9ea7fc700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 0x7fe9ec139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9ea7fc700 1 -- 172.21.15.19:0/458054561 >> v1:172.21.15.19:6789/0 conn(0x7fe9ec131810 legacy=0x7fe9ec131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9ea7fc700 1 -- 172.21.15.19:0/458054561 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec071d20 con 0x7fe9ec134630 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9eb7fe700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 0x7fe9ec139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9ea7fc700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec136a10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00098f0 tx=0x7fe9e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2261ee7a133c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9e9ffb700 1 -- 172.21.15.19:0/458054561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0011830 con 0x7fe9ec134630 2023-10-03T10:17:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9e9ffb700 1 -- 172.21.15.19:0/458054561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0011990 con 0x7fe9ec134630 2023-10-03T10:17:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.935+0000 7fe9e9ffb700 1 -- 172.21.15.19:0/458054561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0011d20 con 0x7fe9ec134630 2023-10-03T10:17:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 -- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 msgr2=0x7fe9ec136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec136a10 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00098f0 tx=0x7fe9e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 -- 172.21.15.19:0/458054561 shutdown_connections 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec136f50 0x7fe9ec139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 --2- 172.21.15.19:0/458054561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec136a10 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 -- 172.21.15.19:0/458054561 >> 172.21.15.19:0/458054561 conn(0x7fe9ec0a2aa0 msgr2=0x7fe9ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.936+0000 7fe9f1705700 1 -- 172.21.15.19:0/458054561 shutdown_connections 2023-10-03T10:17:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.937+0000 7fe9f1705700 1 -- 172.21.15.19:0/458054561 wait complete. 2023-10-03T10:17:07.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.938+0000 7fe9f1705700 1 Processor -- start 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.938+0000 7fe9f1705700 1 -- start start 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 0x7fe9ec1c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec1c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9ec136f50 0x7fe9ec1c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec0713a0 con 0x7fe9ec134630 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec09a800 con 0x7fe9ec131810 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9f1705700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec06eb00 con 0x7fe9ec136f50 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9ea7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec1c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9ea7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec1c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34090/0 (socket says 172.21.15.19:34090) 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9ea7fc700 1 -- 172.21.15.19:0/2691030692 learned_addr learned my addr 172.21.15.19:0/2691030692 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9eaffd700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 0x7fe9ec1c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.939+0000 7fe9eb7fe700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9ec136f50 0x7fe9ec1c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 -- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9ec136f50 msgr2=0x7fe9ec1c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9ec136f50 0x7fe9ec1c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 -- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 msgr2=0x7fe9ec1c88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec1c88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 -- 172.21.15.19:0/2691030692 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009a70 con 0x7fe9ec131810 2023-10-03T10:17:07.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9eaffd700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 0x7fe9ec1c8370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c3c0 tx=0x7fe9dc00c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc004a70 con 0x7fe9ec131810 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc004bd0 con 0x7fe9ec131810 2023-10-03T10:17:07.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc0070d0 con 0x7fe9ec131810 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e0009550 con 0x7fe9ec131810 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.940+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec11d3d0 con 0x7fe9ec131810 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.942+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec074ea0 con 0x7fe9ec131810 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.943+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe9dc007230 con 0x7fe9ec131810 2023-10-03T10:17:07.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.943+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe9dc03ed70 con 0x7fe9ec131810 2023-10-03T10:17:07.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.952+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe9dc0074e0 con 0x7fe9ec131810 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.988+0000 7fc2a6b48700 1 Processor -- start 2023-10-03T10:17:07.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.988+0000 7fc2a6b48700 1 -- start start 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.988+0000 7fc2a6b48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130540 0x7fc2a0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.988+0000 7fc2a6b48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc2a6b48700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00716a0 con 0x7fc2a006fb20 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc2a6b48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a009a390 con 0x7fc2a0130540 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc2a6b48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a0071290 con 0x7fc2a0130e50 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc2a48e4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130540 0x7fc2a0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49548/0 (socket says 172.21.15.19:49548) 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 -- 172.21.15.19:0/2790886023 learned_addr learned my addr 172.21.15.19:0/2790886023 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 -- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130540 msgr2=0x7fc2a0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29f7fe700 1 -- 172.21.15.19:0/2790886023 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246957233 0 0) 0x7fc2a00716a0 con 0x7fc2a006fb20 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 --2- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130540 0x7fc2a0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 -- 172.21.15.19:0/2790886023 >> v1:172.21.15.19:6789/0 conn(0x7fc2a006fb20 legacy=0x7fc2a0137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 -- 172.21.15.19:0/2790886023 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0130340 con 0x7fc2a0130e50 2023-10-03T10:17:07.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.989+0000 7fc29ffff700 1 --2- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00bbf0 tx=0x7fc28c00bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c614532fa877881 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.990+0000 7fc29f7fe700 1 -- 172.21.15.19:0/2790886023 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00dcf0 con 0x7fc2a0130e50 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.990+0000 7fc29f7fe700 1 -- 172.21.15.19:0/2790886023 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c00de50 con 0x7fc2a0130e50 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.990+0000 7fc29f7fe700 1 -- 172.21.15.19:0/2790886023 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c010690 con 0x7fc2a0130e50 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 -- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 msgr2=0x7fc2a006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00bbf0 tx=0x7fc28c00bf00 comp rx=0 tx=0).stop 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 -- 172.21.15.19:0/2790886023 shutdown_connections 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130540 0x7fc2a0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/2790886023 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a0130e50 0x7fc2a006f5e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 -- 172.21.15.19:0/2790886023 >> 172.21.15.19:0/2790886023 conn(0x7fc2a00a2aa0 msgr2=0x7fc2a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 -- 172.21.15.19:0/2790886023 shutdown_connections 2023-10-03T10:17:07.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.991+0000 7fc2a6b48700 1 -- 172.21.15.19:0/2790886023 wait complete. 2023-10-03T10:17:07.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.992+0000 7fc2a6b48700 1 Processor -- start 2023-10-03T10:17:07.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.992+0000 7fc2a6b48700 1 -- start start 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.992+0000 7fc2a6b48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a006fb20 0x7fc2a0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.992+0000 7fc2a6b48700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.992+0000 7fc2a6b48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 0x7fc2a0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a6b48700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a011a0b0 con 0x7fc2a0130540 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a6b48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a011b2e0 con 0x7fc2a0130e50 2023-10-03T10:17:07.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a6b48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a011a680 con 0x7fc2a006fb20 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34100/0 (socket says 172.21.15.19:34100) 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc29ffff700 1 -- 172.21.15.19:0/134167684 learned_addr learned my addr 172.21.15.19:0/134167684 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 0x7fc2a0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a48e4700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a006fb20 0x7fc2a0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 -- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a006fb20 msgr2=0x7fc2a0118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a006fb20 0x7fc2a0118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 -- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 msgr2=0x7fc2a0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 -- 172.21.15.19:0/134167684 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c00b7f0 con 0x7fc2a0130e50 2023-10-03T10:17:07.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc29ffff700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.993+0000 7fc2a50e5700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 0x7fc2a0119750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c730 tx=0x7fc29800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.994+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298003e30 con 0x7fc2a0130e50 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.994+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc298005070 con 0x7fc2a0130e50 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.994+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a011b730 con 0x7fc2a0130e50 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.994+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298005420 con 0x7fc2a0130e50 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.994+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a00718e0 con 0x7fc2a0130e50 2023-10-03T10:17:07.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.995+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a0074ea0 con 0x7fc2a0130e50 2023-10-03T10:17:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.995+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc298005580 con 0x7fc2a0130e50 2023-10-03T10:17:07.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:07.996+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc29803f1d0 con 0x7fc2a0130e50 2023-10-03T10:17:08.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.001+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc298010710 con 0x7fc2a0130e50 2023-10-03T10:17:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.027+0000 7f1ba43cc700 1 Processor -- start 2023-10-03T10:17:08.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.027+0000 7f1ba43cc700 1 -- start start 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b9c09e760 0x7f1b9c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9c06fef0 con 0x7f1b9c09e760 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c06ef30 con 0x7f1b9c1338a0 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba43cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c1334b0 con 0x7f1b9c09de50 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba2168700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba2168700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49928/0 (socket says 172.21.15.19:49928) 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba2168700 1 -- 172.21.15.19:0/3209821992 learned_addr learned my addr 172.21.15.19:0/3209821992 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.028+0000 7f1ba1967700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 -- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 msgr2=0x7f1b9c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 -- 172.21.15.19:0/3209821992 >> v2:172.21.15.19:3300/0 conn(0x7f1b9c09e760 msgr2=0x7f1b9c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 --2- 172.21.15.19:0/3209821992 >> v2:172.21.15.19:3300/0 conn(0x7f1b9c09e760 0x7f1b9c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 -- 172.21.15.19:0/3209821992 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c06fc30 con 0x7f1b9c1338a0 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba1967700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba2168700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009920 tx=0x7f1b98009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89a21660ba50321d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba1166700 1 -- 172.21.15.19:0/3209821992 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011830 con 0x7f1b9c1338a0 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba1166700 1 -- 172.21.15.19:0/3209821992 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98011990 con 0x7f1b9c1338a0 2023-10-03T10:17:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.029+0000 7f1ba1166700 1 -- 172.21.15.19:0/3209821992 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011d20 con 0x7f1b9c1338a0 2023-10-03T10:17:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 -- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 msgr2=0x7f1b9c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009920 tx=0x7f1b98009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 -- 172.21.15.19:0/3209821992 shutdown_connections 2023-10-03T10:17:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c133c70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/3209821992 >> v2:172.21.15.19:3300/0 conn(0x7f1b9c09e760 0x7f1b9c13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/3209821992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 -- 172.21.15.19:0/3209821992 >> 172.21.15.19:0/3209821992 conn(0x7f1b9c0a2aa0 msgr2=0x7f1b9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 -- 172.21.15.19:0/3209821992 shutdown_connections 2023-10-03T10:17:08.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.030+0000 7f1ba43cc700 1 -- 172.21.15.19:0/3209821992 wait complete. 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.032+0000 7f1ba43cc700 1 Processor -- start 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.032+0000 7f1ba43cc700 1 -- start start 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c11d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c11e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c11f340 con 0x7f1b9c09e760 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c06f640 con 0x7f1b9c1338a0 2023-10-03T10:17:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba43cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c120f70 con 0x7f1b9c09de50 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34130/0 (socket says 172.21.15.19:34130) 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 -- 172.21.15.19:0/2729789678 learned_addr learned my addr 172.21.15.19:0/2729789678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba2168700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c11d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba2969700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c11e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 -- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 msgr2=0x7f1b9c11d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c11d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 -- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 msgr2=0x7f1b9c11e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c11e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 -- 172.21.15.19:0/2729789678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c0094a0 con 0x7f1b9c09e760 2023-10-03T10:17:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.033+0000 7f1ba1967700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ebb0 tx=0x7f1b8c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.034+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00c850 con 0x7f1b9c09e760 2023-10-03T10:17:08.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.034+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b98009550 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.034+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c00c9b0 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.034+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c00cd40 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.034+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c120590 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.035+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c11a470 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.035+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b8c013470 con 0x7f1b9c09e760 2023-10-03T10:17:08.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.035+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b8c03f760 con 0x7f1b9c09e760 2023-10-03T10:17:08.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.044+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b8c0232f0 con 0x7f1b9c09e760 2023-10-03T10:17:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.115+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46d406b9e0 con 0x7f46d409e760 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.116+0000 7f46c9ffb700 1 -- 172.21.15.19:0/2147635696 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46c4029090 con 0x7f46d409e760 2023-10-03T10:17:08.117 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:08.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 msgr2=0x7f46d411ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009130 tx=0x7f46c4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 shutdown_connections 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d41338a0 0x7f46d411f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d409de50 0x7f46d411ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 --2- 172.21.15.19:0/2147635696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d409e760 0x7f46d411ef90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.119+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 >> 172.21.15.19:0/2147635696 conn(0x7f46d40a2aa0 msgr2=0x7f46d409ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.120+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 shutdown_connections 2023-10-03T10:17:08.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.120+0000 7f46db7b9700 1 -- 172.21.15.19:0/2147635696 wait complete. 2023-10-03T10:17:08.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:08.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.199+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe9ec12eb00 con 0x7fe9ec131810 2023-10-03T10:17:08.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.200+0000 7fe9d37fe700 1 -- 172.21.15.19:0/2691030692 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe9dc01ab00 con 0x7fe9ec131810 2023-10-03T10:17:08.201 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:08.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 msgr2=0x7fe9ec1c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 0x7fe9ec1c8370 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c3c0 tx=0x7fe9dc00c6d0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 shutdown_connections 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe9ec136f50 0x7fe9ec1c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe9ec131810 0x7fe9ec1c8370 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 --2- 172.21.15.19:0/2691030692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe9ec134630 0x7fe9ec1c88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 >> 172.21.15.19:0/2691030692 conn(0x7fe9ec0a2aa0 msgr2=0x7fe9ec12f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 shutdown_connections 2023-10-03T10:17:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.203+0000 7fe9f1705700 1 -- 172.21.15.19:0/2691030692 wait complete. 2023-10-03T10:17:08.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:08.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.226+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2a011bd80 con 0x7fc2a0130e50 2023-10-03T10:17:08.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.226+0000 7fc29d7fa700 1 -- 172.21.15.19:0/134167684 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc29801a360 con 0x7fc2a0130e50 2023-10-03T10:17:08.227 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 msgr2=0x7fc2a0119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 0x7fc2a0119750 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc29800c730 tx=0x7fc29800ca40 comp rx=0 tx=0).stop 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 shutdown_connections 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a0130e50 0x7fc2a0119750 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a006fb20 0x7fc2a0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 --2- 172.21.15.19:0/134167684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0130540 0x7fc2a0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 >> 172.21.15.19:0/134167684 conn(0x7fc2a00a2aa0 msgr2=0x7fc2a012d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 shutdown_connections 2023-10-03T10:17:08.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.229+0000 7fc2a6b48700 1 -- 172.21.15.19:0/134167684 wait complete. 2023-10-03T10:17:08.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:08.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.270+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b9c074ea0 con 0x7f1b9c09e760 2023-10-03T10:17:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.270+0000 7f1b92ffd700 1 -- 172.21.15.19:0/2729789678 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b8c021020 con 0x7f1b9c09e760 2023-10-03T10:17:08.271 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 msgr2=0x7f1b9c11dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00ebb0 tx=0x7f1b8c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 shutdown_connections 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c1338a0 0x7f1b9c11e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09de50 0x7f1b9c11d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 --2- 172.21.15.19:0/2729789678 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c09e760 0x7f1b9c11dcb0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 >> 172.21.15.19:0/2729789678 conn(0x7f1b9c0a2aa0 msgr2=0x7f1b9c1bac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.272+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 shutdown_connections 2023-10-03T10:17:08.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:08.273+0000 7f1ba43cc700 1 -- 172.21.15.19:0/2729789678 wait complete. 2023-10-03T10:17:08.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:09.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:09.219 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:09.244 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:09.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:09.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.287+0000 7f74e2cc7700 1 Processor -- start 2023-10-03T10:17:09.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.287+0000 7f74e2cc7700 1 -- start start 2023-10-03T10:17:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc12f8b0 0x7f74dc12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 0x7f74dc136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74dc12d330 con 0x7f74dc130260 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc12cd90 con 0x7f74dc12cf60 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e2cc7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1306d0 con 0x7f74dc12f8b0 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49950/0 (socket says 172.21.15.19:49950) 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 -- 172.21.15.19:0/257585464 learned_addr learned my addr 172.21.15.19:0/257585464 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e1264700 1 --2- 172.21.15.19:0/257585464 >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 0x7f74dc136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74dbfff700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc12f8b0 0x7f74dc12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 -- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc12f8b0 msgr2=0x7f74dc12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc12f8b0 0x7f74dc12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 -- 172.21.15.19:0/257585464 >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 msgr2=0x7f74dc136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 --2- 172.21.15.19:0/257585464 >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 0x7f74dc136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.288+0000 7f74e0a63700 1 -- 172.21.15.19:0/257585464 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc071780 con 0x7f74dc12cf60 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.289+0000 7f74e0a63700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74d000bb90 tx=0x7f74d000bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ebb5f1e83d6ddf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.289+0000 7f74e1264700 1 --2- 172.21.15.19:0/257585464 >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 0x7f74dc136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.289+0000 7f74db7fe700 1 -- 172.21.15.19:0/257585464 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000dc20 con 0x7f74dc12cf60 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.289+0000 7f74db7fe700 1 -- 172.21.15.19:0/257585464 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d000dd80 con 0x7f74dc12cf60 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.289+0000 7f74db7fe700 1 -- 172.21.15.19:0/257585464 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0017660 con 0x7f74dc12cf60 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 -- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 msgr2=0x7f74dc06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f74d000bb90 tx=0x7f74d000bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 -- 172.21.15.19:0/257585464 shutdown_connections 2023-10-03T10:17:09.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12cf60 0x7f74dc06f5d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/257585464 >> v2:172.21.15.19:3300/0 conn(0x7f74dc130260 0x7f74dc136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/257585464 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc12f8b0 0x7f74dc12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 -- 172.21.15.19:0/257585464 >> 172.21.15.19:0/257585464 conn(0x7f74dc0a2aa0 msgr2=0x7f74dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 -- 172.21.15.19:0/257585464 shutdown_connections 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.290+0000 7f74e2cc7700 1 -- 172.21.15.19:0/257585464 wait complete. 2023-10-03T10:17:09.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.291+0000 7f74e2cc7700 1 Processor -- start 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.291+0000 7f74e2cc7700 1 -- start start 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 0x7f74dc1c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc130260 0x7f74dc1c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc09d710 con 0x7f74dc12cf60 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc12f4f0 con 0x7f74dc12f8b0 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e2cc7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc129fa0 con 0x7f74dc130260 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e0a63700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e0a63700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34148/0 (socket says 172.21.15.19:34148) 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e0a63700 1 -- 172.21.15.19:0/15604670 learned_addr learned my addr 172.21.15.19:0/15604670 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74dbfff700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 0x7f74dc1c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.292+0000 7f74e1264700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc130260 0x7f74dc1c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 -- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc130260 msgr2=0x7f74dc1c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc130260 0x7f74dc1c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 -- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 msgr2=0x7f74dc1c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 0x7f74dc1c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 -- 172.21.15.19:0/15604670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4009a70 con 0x7f74dc12cf60 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74dbfff700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 0x7f74dc1c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e0a63700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f74d000bee0 tx=0x7f74d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0009040 con 0x7f74dc12cf60 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d00038c0 con 0x7f74dc12cf60 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d000b7f0 con 0x7f74dc12cf60 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0003c70 con 0x7f74dc12cf60 2023-10-03T10:17:09.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.293+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc09d8a0 con 0x7f74dc12cf60 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.294+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f74d0015070 con 0x7f74dc12cf60 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.294+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74d003fc80 con 0x7f74dc12cf60 2023-10-03T10:17:09.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.294+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74dc09e9a0 con 0x7f74dc12cf60 2023-10-03T10:17:09.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.301+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f74dc09e9a0 con 0x7f74dc12cf60 2023-10-03T10:17:09.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 Processor -- start 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 -- start start 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 0x7ffbe806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbe8134610 0x7ffbe8134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe8070ee0 con 0x7ffbe8134610 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8071480 con 0x7ffbe809eca0 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.365+0000 7ffbed474700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe806f3c0 con 0x7ffbe806e570 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 0x7ffbe806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 0x7ffbe806ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49972/0 (socket says 172.21.15.19:49972) 2023-10-03T10:17:09.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe67fc700 1 -- 172.21.15.19:0/2428858227 learned_addr learned my addr 172.21.15.19:0/2428858227 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe77fe700 1 --2- 172.21.15.19:0/2428858227 >> v2:172.21.15.19:3300/0 conn(0x7ffbe8134610 0x7ffbe8134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 msgr2=0x7ffbe806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 0x7ffbe806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/2428858227 >> v2:172.21.15.19:3300/0 conn(0x7ffbe8134610 msgr2=0x7ffbe8134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/2428858227 >> v2:172.21.15.19:3300/0 conn(0x7ffbe8134610 0x7ffbe8134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/2428858227 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe8071b90 con 0x7ffbe806e570 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.366+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe806e940 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009840 tx=0x7ffbd8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61f98f2706660304 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.367+0000 7ffbe5ffb700 1 -- 172.21.15.19:0/2428858227 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8011830 con 0x7ffbe806e570 2023-10-03T10:17:09.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.367+0000 7ffbe5ffb700 1 -- 172.21.15.19:0/2428858227 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8011990 con 0x7ffbe806e570 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.367+0000 7ffbe5ffb700 1 -- 172.21.15.19:0/2428858227 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8011d20 con 0x7ffbe806e570 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.367+0000 7ffbed474700 1 -- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 msgr2=0x7ffbe806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.367+0000 7ffbed474700 1 --2- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe806e940 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffbd8009840 tx=0x7ffbd8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 -- 172.21.15.19:0/2428858227 shutdown_connections 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 --2- 172.21.15.19:0/2428858227 >> v2:172.21.15.19:3300/0 conn(0x7ffbe8134610 0x7ffbe8134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 --2- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe806e940 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 --2- 172.21.15.19:0/2428858227 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe809eca0 0x7ffbe806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 -- 172.21.15.19:0/2428858227 >> 172.21.15.19:0/2428858227 conn(0x7ffbe80a2aa0 msgr2=0x7ffbe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 -- 172.21.15.19:0/2428858227 shutdown_connections 2023-10-03T10:17:09.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.368+0000 7ffbed474700 1 -- 172.21.15.19:0/2428858227 wait complete. 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.369+0000 7ffbed474700 1 Processor -- start 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.369+0000 7ffbed474700 1 -- start start 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.369+0000 7ffbed474700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.369+0000 7ffbed474700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe8134610 0x7ffbe8127790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbed474700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbe8125ea0 0x7ffbe8126310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbed474700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe80a1de0 con 0x7ffbe8125ea0 2023-10-03T10:17:09.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbed474700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe8070610 con 0x7ffbe8134610 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbed474700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe813d160 con 0x7ffbe806e570 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49604/0 (socket says 172.21.15.19:49604) 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/3532095677 learned_addr learned my addr 172.21.15.19:0/3532095677 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe67fc700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe8134610 0x7ffbe8127790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe77fe700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbe8125ea0 0x7ffbe8126310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe8134610 msgr2=0x7ffbe8127790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe8134610 0x7ffbe8127790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbe8125ea0 msgr2=0x7ffbe8126310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbe8125ea0 0x7ffbe8126310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 -- 172.21.15.19:0/3532095677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd80094a0 con 0x7ffbe806e570 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.370+0000 7ffbe6ffd700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80090b0 tx=0x7ffbd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.371+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004450 con 0x7ffbe806e570 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.371+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd801f070 con 0x7ffbe806e570 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.371+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe813de90 con 0x7ffbe806e570 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.371+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80038e0 con 0x7ffbe806e570 2023-10-03T10:17:09.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.371+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe813bcc0 con 0x7ffbe806e570 2023-10-03T10:17:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.372+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbd8003a40 con 0x7ffbe806e570 2023-10-03T10:17:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.372+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe8074ea0 con 0x7ffbe806e570 2023-10-03T10:17:09.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.372+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffbd8021070 con 0x7ffbe806e570 2023-10-03T10:17:09.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.381+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbd801a7b0 con 0x7ffbe806e570 2023-10-03T10:17:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.411+0000 7fc2f1f1b700 1 Processor -- start 2023-10-03T10:17:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 -- start start 2023-10-03T10:17:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09f650 0x7fc2ec131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ec070940 con 0x7fc2ec09f240 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ec06fd60 con 0x7fc2ec09f650 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2f1f1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec06fa80 con 0x7fc2ec09e930 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2eaffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc2ec09f240 0x7fc2ec1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36378/0 (socket says 172.21.15.19:36378) 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2eaffd700 1 -- 172.21.15.19:0/3588364732 learned_addr learned my addr 172.21.15.19:0/3588364732 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49618/0 (socket says 172.21.15.19:49618) 2023-10-03T10:17:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.412+0000 7fc2ebfff700 1 --2- 172.21.15.19:0/3588364732 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09f650 0x7fc2ec131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/3588364732 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09f650 msgr2=0x7fc2ec131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2eb7fe700 1 --2- 172.21.15.19:0/3588364732 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09f650 0x7fc2ec131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/3588364732 >> v1:172.21.15.19:6789/0 conn(0x7fc2ec09f240 legacy=0x7fc2ec1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/3588364732 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec09fb60 con 0x7fc2ec09e930 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2ea7fc700 1 -- 172.21.15.19:0/3588364732 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816735591 0 0) 0x7fc2ec070940 con 0x7fc2ec09f240 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2eb7fe700 1 --2- 172.21.15.19:0/3588364732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009840 tx=0x7fc2dc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e221dd47b2094742 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2ea7fc700 1 -- 172.21.15.19:0/3588364732 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011830 con 0x7fc2ec09e930 2023-10-03T10:17:09.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2ea7fc700 1 -- 172.21.15.19:0/3588364732 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc011990 con 0x7fc2ec09e930 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.413+0000 7fc2ea7fc700 1 -- 172.21.15.19:0/3588364732 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc011d20 con 0x7fc2ec09e930 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/3588364732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 msgr2=0x7fc2ec09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 --2- 172.21.15.19:0/3588364732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009840 tx=0x7fc2dc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/3588364732 shutdown_connections 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 --2- 172.21.15.19:0/3588364732 >> v2:172.21.15.19:3300/0 conn(0x7fc2ec09f650 0x7fc2ec131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 --2- 172.21.15.19:0/3588364732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09e930 0x7fc2ec09ed00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/3588364732 >> 172.21.15.19:0/3588364732 conn(0x7fc2ec0a4210 msgr2=0x7fc2ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/3588364732 shutdown_connections 2023-10-03T10:17:09.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.414+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/3588364732 wait complete. 2023-10-03T10:17:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.416+0000 7fc2f1f1b700 1 Processor -- start 2023-10-03T10:17:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.416+0000 7fc2f1f1b700 1 -- start start 2023-10-03T10:17:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09f240 0x7fc2ec1c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09f650 0x7fc2ec1c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a43d0 con 0x7fc2ec09e930 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a41e0 con 0x7fc2ec09f650 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2f1f1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec1a5e80 con 0x7fc2ec09f240 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34200/0 (socket says 172.21.15.19:34200) 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/4219683863 learned_addr learned my addr 172.21.15.19:0/4219683863 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eaffd700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09f240 0x7fc2ec1c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2ebfff700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09f650 0x7fc2ec1c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09f240 msgr2=0x7fc2ec1c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09f240 0x7fc2ec1c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09f650 msgr2=0x7fc2ec1c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09f650 0x7fc2ec1c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 -- 172.21.15.19:0/4219683863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc0094a0 con 0x7fc2ec09e930 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.417+0000 7fc2eb7fe700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0090b0 tx=0x7fc2dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.418+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc004400 con 0x7fc2ec09e930 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.418+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc01f070 con 0x7fc2ec09e930 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.418+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0038a0 con 0x7fc2ec09e930 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.418+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/4219683863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0a0190 con 0x7fc2ec09e930 2023-10-03T10:17:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.418+0000 7fc2f1f1b700 1 -- 172.21.15.19:0/4219683863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec1a49d0 con 0x7fc2ec09e930 2023-10-03T10:17:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.419+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2dc021030 con 0x7fc2ec09e930 2023-10-03T10:17:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.419+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2dc0408b0 con 0x7fc2ec09e930 2023-10-03T10:17:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.420+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec074ea0 con 0x7fc2ec09e930 2023-10-03T10:17:09.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.429+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2dc004560 con 0x7fc2ec09e930 2023-10-03T10:17:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.437+0000 7f6a3129c700 1 Processor -- start 2023-10-03T10:17:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.437+0000 7f6a3129c700 1 -- start start 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09d6f0 0x7f6a2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a2c09e000 0x7f6a2c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c09f520 con 0x7f6a2c09e000 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c09f130 con 0x7f6a2c09e410 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a3129c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c09e930 con 0x7f6a2c09d6f0 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a2c09e000 0x7f6a2c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a2c09e000 0x7f6a2c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34204/0 (socket says 172.21.15.19:34204) 2023-10-03T10:17:09.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/620590510 learned_addr learned my addr 172.21.15.19:0/620590510 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09d6f0 msgr2=0x7f6a2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09d6f0 0x7f6a2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 msgr2=0x7f6a2c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2b7fe700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/620590510 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c09b2d0 con 0x7f6a2c09e000 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.438+0000 7f6a2b7fe700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.439+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09e000 0x7f6a2c130660 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009920 tx=0x7f6a20009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e4df04e64956ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.439+0000 7f6a29ffb700 1 -- 172.21.15.19:0/620590510 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2000ba20 con 0x7f6a2c09e000 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.439+0000 7f6a29ffb700 1 -- 172.21.15.19:0/620590510 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2000bb80 con 0x7f6a2c09e000 2023-10-03T10:17:09.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.439+0000 7f6a29ffb700 1 -- 172.21.15.19:0/620590510 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20009e70 con 0x7f6a2c09e000 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 -- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09e000 msgr2=0x7f6a2c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09e000 0x7f6a2c130660 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f6a20009920 tx=0x7f6a20009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:09.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 -- 172.21.15.19:0/620590510 shutdown_connections 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09d6f0 0x7f6a2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 --2- 172.21.15.19:0/620590510 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09e000 0x7f6a2c130660 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 -- 172.21.15.19:0/620590510 >> 172.21.15.19:0/620590510 conn(0x7f6a2c066f50 msgr2=0x7f6a2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 -- 172.21.15.19:0/620590510 shutdown_connections 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.440+0000 7f6a3129c700 1 -- 172.21.15.19:0/620590510 wait complete. 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.441+0000 7f6a3129c700 1 Processor -- start 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.441+0000 7f6a3129c700 1 -- start start 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.441+0000 7f6a3129c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09d6f0 0x7f6a2c122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.441+0000 7f6a3129c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.441+0000 7f6a3129c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a3129c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c130430 con 0x7f6a2c09d6f0 2023-10-03T10:17:09.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a3129c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c125c70 con 0x7f6a2c09e410 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a3129c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c09c700 con 0x7f6a2c09e000 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49634/0 (socket says 172.21.15.19:49634) 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/3706767361 learned_addr learned my addr 172.21.15.19:0/3706767361 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2affd700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09d6f0 0x7f6a2c122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2b7fe700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 msgr2=0x7f6a2c122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09d6f0 msgr2=0x7f6a2c122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09d6f0 0x7f6a2c122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 -- 172.21.15.19:0/3706767361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20009550 con 0x7f6a2c09e000 2023-10-03T10:17:09.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a2a7fc700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c09d470 tx=0x7f6a20004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a20004400 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2001f070 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200038e0 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.442+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c124150 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.443+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c1266e0 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.444+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c09ca30 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.444+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a20021030 con 0x7f6a2c09e000 2023-10-03T10:17:09.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.445+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a20040fa0 con 0x7f6a2c09e000 2023-10-03T10:17:09.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.453+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a20023980 con 0x7f6a2c09e000 2023-10-03T10:17:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.526+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f74dc09e9a0 con 0x7f74dc12cf60 2023-10-03T10:17:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.526+0000 7f74d97fa700 1 -- 172.21.15.19:0/15604670 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f74dc09e9a0 con 0x7f74dc12cf60 2023-10-03T10:17:09.527 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.529+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 msgr2=0x7f74dc1c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.529+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f74d000bee0 tx=0x7f74d0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 shutdown_connections 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f74dc130260 0x7f74dc1c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74dc12cf60 0x7f74dc1c3db0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 --2- 172.21.15.19:0/15604670 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74dc12f8b0 0x7f74dc1c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 >> 172.21.15.19:0/15604670 conn(0x7f74dc0a2aa0 msgr2=0x7f74dc06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 shutdown_connections 2023-10-03T10:17:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.530+0000 7f74e2cc7700 1 -- 172.21.15.19:0/15604670 wait complete. 2023-10-03T10:17:09.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.596+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffbe8071100 con 0x7ffbe806e570 2023-10-03T10:17:09.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.597+0000 7ffbcf7fe700 1 -- 172.21.15.19:0/3532095677 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbd8010b70 con 0x7ffbe806e570 2023-10-03T10:17:09.597 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 msgr2=0x7ffbe8127250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ffbd80090b0 tx=0x7ffbd8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 shutdown_connections 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbe8125ea0 0x7ffbe8126310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbe806e570 0x7ffbe8127250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 --2- 172.21.15.19:0/3532095677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbe8134610 0x7ffbe8127790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.600+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 >> 172.21.15.19:0/3532095677 conn(0x7ffbe80a2aa0 msgr2=0x7ffbe8099a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.601+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 shutdown_connections 2023-10-03T10:17:09.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.601+0000 7ffbed474700 1 -- 172.21.15.19:0/3532095677 wait complete. 2023-10-03T10:17:09.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.655+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc2ec1a4e50 con 0x7fc2ec09e930 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.655+0000 7fc2d3fff700 1 -- 172.21.15.19:0/4219683863 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2dc015020 con 0x7fc2ec09e930 2023-10-03T10:17:09.656 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 msgr2=0x7fc2ec1c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0090b0 tx=0x7fc2dc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 shutdown_connections 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2ec09f650 0x7fc2ec1c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2ec09e930 0x7fc2ec1c5e20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 --2- 172.21.15.19:0/4219683863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2ec09f240 0x7fc2ec1c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.657+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 >> 172.21.15.19:0/4219683863 conn(0x7fc2ec0a4210 msgr2=0x7fc2ec1b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.658+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 shutdown_connections 2023-10-03T10:17:09.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.658+0000 7fc2d1ffb700 1 -- 172.21.15.19:0/4219683863 wait complete. 2023-10-03T10:17:09.672 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.676+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6a2c074ea0 con 0x7f6a2c09e000 2023-10-03T10:17:09.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.676+0000 7f6a137fe700 1 -- 172.21.15.19:0/3706767361 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a20015030 con 0x7f6a2c09e000 2023-10-03T10:17:09.677 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.678+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 msgr2=0x7f6a2c1229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.678+0000 7f6a3129c700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c09d470 tx=0x7f6a20004750 comp rx=0 tx=0).stop 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.678+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 shutdown_connections 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a2c09e410 0x7f6a2c122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a2c09d6f0 0x7f6a2c122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 --2- 172.21.15.19:0/3706767361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a2c09e000 0x7f6a2c1229b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 >> 172.21.15.19:0/3706767361 conn(0x7f6a2c066f50 msgr2=0x7f6a2c130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 shutdown_connections 2023-10-03T10:17:09.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:09.679+0000 7f6a3129c700 1 -- 172.21.15.19:0/3706767361 wait complete. 2023-10-03T10:17:09.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:10.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:10.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:10.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:10.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.700+0000 7f2cd02e6700 1 Processor -- start 2023-10-03T10:17:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.700+0000 7f2cd02e6700 1 -- start start 2023-10-03T10:17:10.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cd02e6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2cc8131810 0x7f2cc8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cd02e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cd02e6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc81313c0 con 0x7f2cc8099a40 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cd02e6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc806e8c0 con 0x7f2cc8131810 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cd02e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc8071d20 con 0x7f2cc809a580 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cce082700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2cc8131810 0x7f2cc8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cce082700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2cc8131810 0x7f2cc8131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34230/0 (socket says 172.21.15.19:34230) 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cce082700 1 -- 172.21.15.19:0/1581799968 learned_addr learned my addr 172.21.15.19:0/1581799968 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.701+0000 7f2cce883700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2cce082700 1 -- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 msgr2=0x7f2cc8139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2cce082700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc8139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2cce082700 1 -- 172.21.15.19:0/1581799968 >> v1:172.21.15.19:6789/0 conn(0x7f2cc8099a40 legacy=0x7f2cc8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2ccd080700 1 -- 172.21.15.19:0/1581799968 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003418793 0 0) 0x7f2cc81313c0 con 0x7f2cc8099a40 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2cce082700 1 -- 172.21.15.19:0/1581799968 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc80721a0 con 0x7f2cc8131810 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2cce082700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc8131be0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098f0 tx=0x7f2cc4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811dafb0037e28dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.702+0000 7f2ccd080700 1 -- 172.21.15.19:0/1581799968 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4011830 con 0x7f2cc8131810 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.703+0000 7f2ccd080700 1 -- 172.21.15.19:0/1581799968 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4011990 con 0x7f2cc8131810 2023-10-03T10:17:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.703+0000 7f2ccd080700 1 -- 172.21.15.19:0/1581799968 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4011d20 con 0x7f2cc8131810 2023-10-03T10:17:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 -- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 msgr2=0x7f2cc8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc8131be0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40098f0 tx=0x7f2cc4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 -- 172.21.15.19:0/1581799968 shutdown_connections 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc8139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/1581799968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc8131be0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 -- 172.21.15.19:0/1581799968 >> 172.21.15.19:0/1581799968 conn(0x7f2cc80a2aa0 msgr2=0x7f2cc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 -- 172.21.15.19:0/1581799968 shutdown_connections 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.704+0000 7f2cd02e6700 1 -- 172.21.15.19:0/1581799968 wait complete. 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.705+0000 7f2cd02e6700 1 Processor -- start 2023-10-03T10:17:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.705+0000 7f2cd02e6700 1 -- start start 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc811bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc811c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc811d230 con 0x7f2cc8131810 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc806eb00 con 0x7f2cc809a580 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cd02e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc811ee60 con 0x7f2cc8099a40 2023-10-03T10:17:10.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cce082700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cce082700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49648/0 (socket says 172.21.15.19:49648) 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cce082700 1 -- 172.21.15.19:0/3203435645 learned_addr learned my addr 172.21.15.19:0/3203435645 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.706+0000 7f2cce883700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc811c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 -- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 msgr2=0x7f2cc811bbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc811bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 -- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 msgr2=0x7f2cc811c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc811c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 -- 172.21.15.19:0/3203435645 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009550 con 0x7f2cc8099a40 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce883700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc811c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:10.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.707+0000 7f2cce082700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009c40 tx=0x7f2cc4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.708+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40036a0 con 0x7f2cc8099a40 2023-10-03T10:17:10.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.708+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4003800 con 0x7f2cc8099a40 2023-10-03T10:17:10.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.708+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4003bb0 con 0x7f2cc8099a40 2023-10-03T10:17:10.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.708+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc80a1a80 con 0x7f2cc8099a40 2023-10-03T10:17:10.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.708+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc811e8d0 con 0x7f2cc8099a40 2023-10-03T10:17:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.709+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc8074ea0 con 0x7f2cc8099a40 2023-10-03T10:17:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.709+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2cc4021070 con 0x7f2cc8099a40 2023-10-03T10:17:10.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.709+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2cc4040f00 con 0x7f2cc8099a40 2023-10-03T10:17:10.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.715+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2cc400b3e0 con 0x7f2cc8099a40 2023-10-03T10:17:10.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.767+0000 7fc2e51cf700 1 Processor -- start 2023-10-03T10:17:10.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.767+0000 7fc2e51cf700 1 -- start start 2023-10-03T10:17:10.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2e006a770 0x7fc2e006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e0131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e0131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e009ece0 con 0x7fc2e006a770 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e009e760 con 0x7fc2e0131b40 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2e51cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e009e040 con 0x7fc2e006b080 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2ded9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2e006a770 0x7fc2e006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2ded9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2e006a770 0x7fc2e006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34252/0 (socket says 172.21.15.19:34252) 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2ded9d700 1 -- 172.21.15.19:0/2887559032 learned_addr learned my addr 172.21.15.19:0/2887559032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.768+0000 7fc2de59c700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e0131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2df59e700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e0131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 -- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 msgr2=0x7fc2e0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e0131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 -- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 msgr2=0x7fc2e0131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e0131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 -- 172.21.15.19:0/2887559032 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e009f630 con 0x7fc2e006a770 2023-10-03T10:17:10.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ded9d700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e006ab40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00098f0 tx=0x7fc2d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad75d2b56f08b09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ddd9b700 1 -- 172.21.15.19:0/2887559032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011830 con 0x7fc2e006a770 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ddd9b700 1 -- 172.21.15.19:0/2887559032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d0011990 con 0x7fc2e006a770 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.769+0000 7fc2ddd9b700 1 -- 172.21.15.19:0/2887559032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0011d20 con 0x7fc2e006a770 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 -- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 msgr2=0x7fc2e006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e006ab40 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00098f0 tx=0x7fc2d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 -- 172.21.15.19:0/2887559032 shutdown_connections 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e0131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e006ab40 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/2887559032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e0131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 -- 172.21.15.19:0/2887559032 >> 172.21.15.19:0/2887559032 conn(0x7fc2e0066f50 msgr2=0x7fc2e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 -- 172.21.15.19:0/2887559032 shutdown_connections 2023-10-03T10:17:10.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.770+0000 7fc2e51cf700 1 -- 172.21.15.19:0/2887559032 wait complete. 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 Processor -- start 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 -- start start 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e01c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e011e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0130cb0 con 0x7fc2e006a770 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0121b80 con 0x7fc2e0131b40 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2e51cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01200d0 con 0x7fc2e006b080 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2de59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2de59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49674/0 (socket says 172.21.15.19:49674) 2023-10-03T10:17:10.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2de59c700 1 -- 172.21.15.19:0/314808474 learned_addr learned my addr 172.21.15.19:0/314808474 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.772+0000 7fc2ded9d700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e01c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2df59e700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e011e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 -- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 msgr2=0x7fc2e011e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e011e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 -- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 msgr2=0x7fc2e01c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e01c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 -- 172.21.15.19:0/314808474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d0009550 con 0x7fc2e006b080 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2de59c700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e9b0 tx=0x7fc2d400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4009710 con 0x7fc2e006b080 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400ee50 con 0x7fc2e006b080 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e01c4ba0 con 0x7fc2e006b080 2023-10-03T10:17:10.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400ca50 con 0x7fc2e006b080 2023-10-03T10:17:10.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.773+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e01218c0 con 0x7fc2e006b080 2023-10-03T10:17:10.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.775+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2d400cbb0 con 0x7fc2e006b080 2023-10-03T10:17:10.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.775+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0074ea0 con 0x7fc2e006b080 2023-10-03T10:17:10.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.775+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2d403fa60 con 0x7fc2e006b080 2023-10-03T10:17:10.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.780+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2d401b3b0 con 0x7fc2e006b080 2023-10-03T10:17:10.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.819+0000 7fe7a60e5700 1 Processor -- start 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.819+0000 7fe7a60e5700 1 -- start start 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe7a60e5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe7a006f5d0 0x7fe7a012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe7a60e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe7a60e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a006fa40 con 0x7fe7a012cf60 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe7a60e5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a012cd90 con 0x7fe7a006f5d0 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe7a60e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0071780 con 0x7fe7a0135c20 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe7a012cf60 0x7fe7a012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36402/0 (socket says 172.21.15.19:36402) 2023-10-03T10:17:10.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79f7fe700 1 -- 172.21.15.19:0/2089211710 learned_addr learned my addr 172.21.15.19:0/2089211710 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:10.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79effd700 1 --2- 172.21.15.19:0/2089211710 >> v2:172.21.15.19:3300/0 conn(0x7fe7a006f5d0 0x7fe7a012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79ffff700 1 -- 172.21.15.19:0/2089211710 >> v2:172.21.15.19:3300/0 conn(0x7fe7a006f5d0 msgr2=0x7fe7a012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79ffff700 1 --2- 172.21.15.19:0/2089211710 >> v2:172.21.15.19:3300/0 conn(0x7fe7a006f5d0 0x7fe7a012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79ffff700 1 -- 172.21.15.19:0/2089211710 >> v1:172.21.15.19:6789/0 conn(0x7fe7a012cf60 legacy=0x7fe7a012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.820+0000 7fe79ffff700 1 -- 172.21.15.19:0/2089211710 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a0071a40 con 0x7fe7a0135c20 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe79ffff700 1 --2- 172.21.15.19:0/2089211710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a0138000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe798009d90 tx=0x7fe79800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b824051fa90ba553 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe79e7fc700 1 -- 172.21.15.19:0/2089211710 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79800e070 con 0x7fe7a0135c20 2023-10-03T10:17:10.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe79e7fc700 1 -- 172.21.15.19:0/2089211710 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79800bb20 con 0x7fe7a0135c20 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe79e7fc700 1 -- 172.21.15.19:0/2089211710 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798012430 con 0x7fe7a0135c20 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe7a60e5700 1 -- 172.21.15.19:0/2089211710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 msgr2=0x7fe7a0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.821+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/2089211710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a0138000 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe798009d90 tx=0x7fe79800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 -- 172.21.15.19:0/2089211710 shutdown_connections 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/2089211710 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a0138000 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/2089211710 >> v2:172.21.15.19:3300/0 conn(0x7fe7a006f5d0 0x7fe7a012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 -- 172.21.15.19:0/2089211710 >> 172.21.15.19:0/2089211710 conn(0x7fe7a00a2aa0 msgr2=0x7fe7a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 -- 172.21.15.19:0/2089211710 shutdown_connections 2023-10-03T10:17:10.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.822+0000 7fe7a60e5700 1 -- 172.21.15.19:0/2089211710 wait complete. 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.823+0000 7fe7a60e5700 1 Processor -- start 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.823+0000 7fe7a60e5700 1 -- start start 2023-10-03T10:17:10.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 0x7fe7a0127100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 0x7fe7a0127640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a01c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0131470 con 0x7fe7a006f5d0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a009c4f0 con 0x7fe7a0135c20 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe7a60e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a009c790 con 0x7fe7a012cf60 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 0x7fe7a0127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 0x7fe7a0127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 0x7fe7a0127640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49688/0 (socket says 172.21.15.19:49688) 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a01c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79effd700 1 -- 172.21.15.19:0/1089960321 learned_addr learned my addr 172.21.15.19:0/1089960321 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.824+0000 7fe79f7fe700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 0x7fe7a0127100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34296/0 (socket says 172.21.15.19:34296) 2023-10-03T10:17:10.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 -- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 msgr2=0x7fe7a0127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 0x7fe7a0127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 -- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 msgr2=0x7fe7a0127100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 0x7fe7a0127100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 -- 172.21.15.19:0/1089960321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009a70 con 0x7fe7a0135c20 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe79ffff700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a01c3f70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe798016000 tx=0x7fe798004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798012430 con 0x7fe7a0135c20 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798020070 con 0x7fe7a0135c20 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.825+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798004280 con 0x7fe7a0135c20 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.826+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a0135790 con 0x7fe7a0135c20 2023-10-03T10:17:10.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.826+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a0127b80 con 0x7fe7a0135c20 2023-10-03T10:17:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.827+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe7980043e0 con 0x7fe7a0135c20 2023-10-03T10:17:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.827+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a0074ea0 con 0x7fe7a0135c20 2023-10-03T10:17:10.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.828+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe798022070 con 0x7fe7a0135c20 2023-10-03T10:17:10.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.837+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7980269d0 con 0x7fe7a0135c20 2023-10-03T10:17:10.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.858+0000 7fdde0359700 1 Processor -- start 2023-10-03T10:17:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.858+0000 7fdde0359700 1 -- start start 2023-10-03T10:17:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdde0359700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdde0359700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddd813d1f0 0x7fddd813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdde0359700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd809a810 con 0x7fddd809dc30 2023-10-03T10:17:10.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdde0359700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd806ab40 con 0x7fddd813d1f0 2023-10-03T10:17:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdde0359700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd809ebc0 con 0x7fddd806a770 2023-10-03T10:17:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fddde0f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fddde8f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fddd813d1f0 0x7fddd813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdddd8f4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fddd809dc30 0x7fddd809e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36416/0 (socket says 172.21.15.19:36416) 2023-10-03T10:17:10.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.859+0000 7fdddd8f4700 1 -- 172.21.15.19:0/3603149449 learned_addr learned my addr 172.21.15.19:0/3603149449 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fddde8f6700 1 -- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 msgr2=0x7fddd809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:10.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fddde8f6700 1 --2- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fddde8f6700 1 -- 172.21.15.19:0/3603149449 >> v1:172.21.15.19:6789/0 conn(0x7fddd809dc30 legacy=0x7fddd809e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fdddd0f3700 1 -- 172.21.15.19:0/3603149449 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731115617 0 0) 0x7fddd809a810 con 0x7fddd809dc30 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fddde8f6700 1 -- 172.21.15.19:0/3603149449 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd809e920 con 0x7fddd813d1f0 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fddde8f6700 1 --2- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd813d1f0 0x7fddd813f5d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009dc0 tx=0x7fddd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5c79894eede49c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fdddd0f3700 1 -- 172.21.15.19:0/3603149449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000e070 con 0x7fddd813d1f0 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fdddd0f3700 1 -- 172.21.15.19:0/3603149449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000bae0 con 0x7fddd813d1f0 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.860+0000 7fdddd0f3700 1 -- 172.21.15.19:0/3603149449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000be90 con 0x7fddd813d1f0 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.861+0000 7fdde0359700 1 -- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd813d1f0 msgr2=0x7fddd813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.861+0000 7fdde0359700 1 --2- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd813d1f0 0x7fddd813f5d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009dc0 tx=0x7fddd000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:10.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.861+0000 7fdde0359700 1 -- 172.21.15.19:0/3603149449 shutdown_connections 2023-10-03T10:17:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.861+0000 7fdde0359700 1 --2- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd813d1f0 0x7fddd813f5d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.861+0000 7fdde0359700 1 --2- 172.21.15.19:0/3603149449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.862+0000 7fdde0359700 1 -- 172.21.15.19:0/3603149449 >> 172.21.15.19:0/3603149449 conn(0x7fddd8066f50 msgr2=0x7fddd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.862+0000 7fdde0359700 1 -- 172.21.15.19:0/3603149449 shutdown_connections 2023-10-03T10:17:10.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.862+0000 7fdde0359700 1 -- 172.21.15.19:0/3603149449 wait complete. 2023-10-03T10:17:10.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.863+0000 7fdde0359700 1 Processor -- start 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.863+0000 7fdde0359700 1 -- start start 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd809dc30 0x7fddd8129950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 0x7fddd8129e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd812f640 con 0x7fddd809dc30 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd8140530 con 0x7fddd813d1f0 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdde0359700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fddd811c6f0 con 0x7fddd806a770 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49702/0 (socket says 172.21.15.19:49702) 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 -- 172.21.15.19:0/1709055030 learned_addr learned my addr 172.21.15.19:0/1709055030 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:10.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fdddd8f4700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd809dc30 0x7fddd8129950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde8f6700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 0x7fddd8129e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 -- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 msgr2=0x7fddd8129e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 0x7fddd8129e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 -- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd809dc30 msgr2=0x7fddd8129950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd809dc30 0x7fddd8129950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde0f5700 1 -- 172.21.15.19:0/1709055030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009a70 con 0x7fddd806a770 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.864+0000 7fddde8f6700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 0x7fddd8129e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fddde0f5700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e870 tx=0x7fddd400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4009590 con 0x7fddd806a770 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4013680 con 0x7fddd806a770 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd812edc0 con 0x7fddd806a770 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd40139f0 con 0x7fddd806a770 2023-10-03T10:17:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.865+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd8130370 con 0x7fddd806a770 2023-10-03T10:17:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.866+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fddd4013b50 con 0x7fddd806a770 2023-10-03T10:17:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.866+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd812f7b0 con 0x7fddd806a770 2023-10-03T10:17:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.866+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fddd403fa00 con 0x7fddd806a770 2023-10-03T10:17:10.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.871+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fddd401abb0 con 0x7fddd806a770 2023-10-03T10:17:10.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.938+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cc806b9e0 con 0x7f2cc8099a40 2023-10-03T10:17:10.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.938+0000 7f2cbeffd700 1 -- 172.21.15.19:0/3203435645 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2cc4015020 con 0x7f2cc8099a40 2023-10-03T10:17:10.939 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 msgr2=0x7f2cc811b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009c40 tx=0x7f2cc4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 shutdown_connections 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2cc8131810 0x7f2cc811c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2cc8099a40 0x7f2cc811b6a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 --2- 172.21.15.19:0/3203435645 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2cc809a580 0x7f2cc811bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 >> 172.21.15.19:0/3203435645 conn(0x7f2cc80a2aa0 msgr2=0x7f2cc80710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 shutdown_connections 2023-10-03T10:17:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.942+0000 7f2cd02e6700 1 -- 172.21.15.19:0/3203435645 wait complete. 2023-10-03T10:17:10.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.999+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc2e006c360 con 0x7fc2e006b080 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:10.999+0000 7fc2c77fe700 1 -- 172.21.15.19:0/314808474 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2d4021020 con 0x7fc2e006b080 2023-10-03T10:17:11.000 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 msgr2=0x7fc2e01c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e9b0 tx=0x7fc2d400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 shutdown_connections 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2e0131b40 0x7fc2e011e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2e006a770 0x7fc2e01c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 --2- 172.21.15.19:0/314808474 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2e006b080 0x7fc2e01c4660 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 >> 172.21.15.19:0/314808474 conn(0x7fc2e0066f50 msgr2=0x7fc2e00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 shutdown_connections 2023-10-03T10:17:11.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.002+0000 7fc2e51cf700 1 -- 172.21.15.19:0/314808474 wait complete. 2023-10-03T10:17:11.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.066+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7a01316b0 con 0x7fe7a0135c20 2023-10-03T10:17:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.067+0000 7fe787fff700 1 -- 172.21.15.19:0/1089960321 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe79802c030 con 0x7fe7a0135c20 2023-10-03T10:17:11.068 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 msgr2=0x7fe7a01c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a01c3f70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe798016000 tx=0x7fe798004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 shutdown_connections 2023-10-03T10:17:11.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe7a0135c20 0x7fe7a01c3f70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe7a006f5d0 0x7fe7a0127100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 --2- 172.21.15.19:0/1089960321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe7a012cf60 0x7fe7a0127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 >> 172.21.15.19:0/1089960321 conn(0x7fe7a00a2aa0 msgr2=0x7fe7a012a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 shutdown_connections 2023-10-03T10:17:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.069+0000 7fe7a60e5700 1 -- 172.21.15.19:0/1089960321 wait complete. 2023-10-03T10:17:11.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.080+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddd8074ea0 con 0x7fddd806a770 2023-10-03T10:17:11.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.080+0000 7fddceffd700 1 -- 172.21.15.19:0/1709055030 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fddd4017070 con 0x7fddd806a770 2023-10-03T10:17:11.081 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:11.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.082+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 msgr2=0x7fddd811ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.082+0000 7fdde0359700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e870 tx=0x7fddd400eb80 comp rx=0 tx=0).stop 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 shutdown_connections 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fddd813d1f0 0x7fddd8129e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fddd806a770 0x7fddd811ba70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 --2- 172.21.15.19:0/1709055030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fddd809dc30 0x7fddd8129950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 >> 172.21.15.19:0/1709055030 conn(0x7fddd8066f50 msgr2=0x7fddd80a3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 shutdown_connections 2023-10-03T10:17:11.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:11.083+0000 7fdde0359700 1 -- 172.21.15.19:0/1709055030 wait complete. 2023-10-03T10:17:11.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:11.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:11.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:12.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:12.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:12.097 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.117+0000 7ff598e23700 1 Processor -- start 2023-10-03T10:17:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.117+0000 7ff598e23700 1 -- start start 2023-10-03T10:17:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff598e23700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff594133420 0x7ff5941337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff598e23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 0x7ff5941306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff598e23700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59406b990 con 0x7ff594133e30 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff598e23700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5940a0590 con 0x7ff594133420 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff598e23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59409fb80 con 0x7ff594134260 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff59259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff594133420 0x7ff5941337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff591d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff594133e30 0x7ff59412ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36432/0 (socket says 172.21.15.19:36432) 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.118+0000 7ff591d9b700 1 -- 172.21.15.19:0/3563830744 learned_addr learned my addr 172.21.15.19:0/3563830744 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 --2- 172.21.15.19:0/3563830744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 0x7ff5941306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 -- 172.21.15.19:0/3563830744 >> v2:172.21.15.19:3300/0 conn(0x7ff594133420 msgr2=0x7ff5941337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 --2- 172.21.15.19:0/3563830744 >> v2:172.21.15.19:3300/0 conn(0x7ff594133420 0x7ff5941337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 -- 172.21.15.19:0/3563830744 >> v1:172.21.15.19:6789/0 conn(0x7ff594133e30 legacy=0x7ff59412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 -- 172.21.15.19:0/3563830744 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5940a0030 con 0x7ff594134260 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff59159a700 1 -- 172.21.15.19:0/3563830744 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933607334 0 0) 0x7ff59406b990 con 0x7ff594133e30 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff592d9d700 1 --2- 172.21.15.19:0/3563830744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 0x7ff5941306a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009d90 tx=0x7ff58c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32741ea0813db2f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff59159a700 1 -- 172.21.15.19:0/3563830744 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00e070 con 0x7ff594134260 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff59159a700 1 -- 172.21.15.19:0/3563830744 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c00bb20 con 0x7ff594134260 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.119+0000 7ff59159a700 1 -- 172.21.15.19:0/3563830744 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c012430 con 0x7ff594134260 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.120+0000 7ff598e23700 1 -- 172.21.15.19:0/3563830744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 msgr2=0x7ff5941306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.120+0000 7ff598e23700 1 --2- 172.21.15.19:0/3563830744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 0x7ff5941306a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009d90 tx=0x7ff58c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 -- 172.21.15.19:0/3563830744 shutdown_connections 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 --2- 172.21.15.19:0/3563830744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594134260 0x7ff5941306a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 --2- 172.21.15.19:0/3563830744 >> v2:172.21.15.19:3300/0 conn(0x7ff594133420 0x7ff5941337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 -- 172.21.15.19:0/3563830744 >> 172.21.15.19:0/3563830744 conn(0x7ff5940a4210 msgr2=0x7ff5940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 -- 172.21.15.19:0/3563830744 shutdown_connections 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.121+0000 7ff598e23700 1 -- 172.21.15.19:0/3563830744 wait complete. 2023-10-03T10:17:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.122+0000 7ff598e23700 1 Processor -- start 2023-10-03T10:17:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.122+0000 7ff598e23700 1 -- start start 2023-10-03T10:17:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 0x7ff59409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594133e30 0x7ff59409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 0x7ff59409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59411fd50 con 0x7ff594133420 2023-10-03T10:17:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59412dbf0 con 0x7ff594133e30 2023-10-03T10:17:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff598e23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff594120e40 con 0x7ff594134260 2023-10-03T10:17:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff59259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 0x7ff59409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff59259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 0x7ff59409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34314/0 (socket says 172.21.15.19:34314) 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff59259c700 1 -- 172.21.15.19:0/648258774 learned_addr learned my addr 172.21.15.19:0/648258774 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.123+0000 7ff592d9d700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 0x7ff59409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff591d9b700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594133e30 0x7ff59409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 -- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594133e30 msgr2=0x7ff59409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594133e30 0x7ff59409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 -- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 msgr2=0x7ff59409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 0x7ff59409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 -- 172.21.15.19:0/648258774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58c009a70 con 0x7ff594134260 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.124+0000 7ff592d9d700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 0x7ff59409cf00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff58c016000 tx=0x7ff58c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.125+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c012430 con 0x7ff594134260 2023-10-03T10:17:12.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.125+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58c004040 con 0x7ff594134260 2023-10-03T10:17:12.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.125+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59409df00 con 0x7ff594134260 2023-10-03T10:17:12.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.125+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58c0043f0 con 0x7ff594134260 2023-10-03T10:17:12.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.125+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59411f9b0 con 0x7ff594134260 2023-10-03T10:17:12.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.126+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff58c004550 con 0x7ff594134260 2023-10-03T10:17:12.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.126+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff58c0418d0 con 0x7ff594134260 2023-10-03T10:17:12.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.130+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5940a3e20 con 0x7ff594134260 2023-10-03T10:17:12.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.139+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff58c011390 con 0x7ff594134260 2023-10-03T10:17:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.170+0000 7f7743e22700 1 Processor -- start 2023-10-03T10:17:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.170+0000 7f7743e22700 1 -- start start 2023-10-03T10:17:12.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7743e22700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7743e22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7743e22700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c09ece0 con 0x7f773c06b080 2023-10-03T10:17:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7743e22700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c09e760 con 0x7f773c06a770 2023-10-03T10:17:12.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7743e22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c09e040 con 0x7f773c131d10 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f77413bd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f773c06b080 0x7f773c131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36436/0 (socket says 172.21.15.19:36436) 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f77413bd700 1 -- 172.21.15.19:0/3274438918 learned_addr learned my addr 172.21.15.19:0/3274438918 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f77423bf700 1 --2- 172.21.15.19:0/3274438918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7741bbe700 1 --2- 172.21.15.19:0/3274438918 >> v2:172.21.15.19:3300/0 conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7740bbc700 1 -- 172.21.15.19:0/3274438918 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890641887 0 0) 0x7f773c09ece0 con 0x7f773c06b080 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.171+0000 7f7740bbc700 1 -- 172.21.15.19:0/3274438918 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77280035b0 con 0x7f773c06b080 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f77423bf700 1 -- 172.21.15.19:0/3274438918 >> v2:172.21.15.19:3300/0 conn(0x7f773c06a770 msgr2=0x7f773c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f77423bf700 1 --2- 172.21.15.19:0/3274438918 >> v2:172.21.15.19:3300/0 conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f77423bf700 1 -- 172.21.15.19:0/3274438918 >> v1:172.21.15.19:6789/0 conn(0x7f773c06b080 legacy=0x7f773c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f77423bf700 1 -- 172.21.15.19:0/3274438918 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c09f630 con 0x7f773c131d10 2023-10-03T10:17:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f77423bf700 1 --2- 172.21.15.19:0/3274438918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 0x7f773c139860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7734009d90 tx=0x7f773400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40eeb5bf6c028f69 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f7740bbc700 1 -- 172.21.15.19:0/3274438918 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400e070 con 0x7f773c131d10 2023-10-03T10:17:12.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f7740bbc700 1 -- 172.21.15.19:0/3274438918 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400bb20 con 0x7f773c131d10 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.172+0000 7f7740bbc700 1 -- 172.21.15.19:0/3274438918 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734012430 con 0x7f773c131d10 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 -- 172.21.15.19:0/3274438918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 msgr2=0x7f773c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 --2- 172.21.15.19:0/3274438918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 0x7f773c139860 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7734009d90 tx=0x7f773400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 -- 172.21.15.19:0/3274438918 shutdown_connections 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 --2- 172.21.15.19:0/3274438918 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c131d10 0x7f773c139860 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 --2- 172.21.15.19:0/3274438918 >> v2:172.21.15.19:3300/0 conn(0x7f773c06a770 0x7f773c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 -- 172.21.15.19:0/3274438918 >> 172.21.15.19:0/3274438918 conn(0x7f773c066f50 msgr2=0x7f773c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 -- 172.21.15.19:0/3274438918 shutdown_connections 2023-10-03T10:17:12.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.173+0000 7f7743e22700 1 -- 172.21.15.19:0/3274438918 wait complete. 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.174+0000 7f7743e22700 1 Processor -- start 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.174+0000 7f7743e22700 1 -- start start 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 0x7f773c11e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 0x7f773c11e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 0x7f773c11eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c121880 con 0x7f773c131d10 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c11f410 con 0x7f773c06b080 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7743e22700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0a2330 con 0x7f773c06a770 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77413bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 0x7f773c11e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77413bd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 0x7f773c11e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50110/0 (socket says 172.21.15.19:50110) 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77413bd700 1 -- 172.21.15.19:0/2431242146 learned_addr learned my addr 172.21.15.19:0/2431242146 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 0x7f773c11eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7741bbe700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 0x7f773c11e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 -- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 msgr2=0x7f773c11e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 0x7f773c11e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 -- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 msgr2=0x7f773c11e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 0x7f773c11e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f77423bf700 1 -- 172.21.15.19:0/2431242146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734009a70 con 0x7f773c131d10 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.175+0000 7f7741bbe700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 0x7f773c11e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f77423bf700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 0x7f773c11eac0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7734016000 tx=0x7f7734004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734012430 con 0x7f773c131d10 2023-10-03T10:17:12.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7734020070 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c071e60 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c1222f0 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.176+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7734004280 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.177+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77240052e0 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.178+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77340043e0 con 0x7f773c131d10 2023-10-03T10:17:12.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.178+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7734022070 con 0x7f773c131d10 2023-10-03T10:17:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.187+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77340048d0 con 0x7f773c131d10 2023-10-03T10:17:12.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.248+0000 7f1b2b8f4700 1 Processor -- start 2023-10-03T10:17:12.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.248+0000 7f1b2b8f4700 1 -- start start 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b2b8f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 0x7f1b2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b2b8f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 0x7f1b24134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b2b8f4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2409b120 con 0x7f1b2409e000 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b2b8f4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2406b460 con 0x7f1b2409e410 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b2b8f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2409a7e0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29e91700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 0x7f1b24134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29690700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 0x7f1b2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b28e8f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b2409e000 0x7f1b241339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36446/0 (socket says 172.21.15.19:36446) 2023-10-03T10:17:12.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b28e8f700 1 -- 172.21.15.19:0/2002061962 learned_addr learned my addr 172.21.15.19:0/2002061962 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29690700 1 -- 172.21.15.19:0/2002061962 >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 msgr2=0x7f1b24134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29690700 1 --2- 172.21.15.19:0/2002061962 >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 0x7f1b24134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29690700 1 -- 172.21.15.19:0/2002061962 >> v1:172.21.15.19:6789/0 conn(0x7f1b2409e000 legacy=0x7f1b241339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29690700 1 -- 172.21.15.19:0/2002061962 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2409a500 con 0x7f1b2409d6f0 2023-10-03T10:17:12.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b29e91700 1 --2- 172.21.15.19:0/2002061962 >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 0x7f1b24134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.249+0000 7f1b1bfff700 1 -- 172.21.15.19:0/2002061962 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606507702 0 0) 0x7f1b2409b120 con 0x7f1b2409e000 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.250+0000 7f1b29690700 1 --2- 172.21.15.19:0/2002061962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 0x7f1b2409dac0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009870 tx=0x7f1b20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ae14cb90f76f4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.250+0000 7f1b1bfff700 1 -- 172.21.15.19:0/2002061962 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011830 con 0x7f1b2409d6f0 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.250+0000 7f1b1bfff700 1 -- 172.21.15.19:0/2002061962 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20011990 con 0x7f1b2409d6f0 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.250+0000 7f1b1bfff700 1 -- 172.21.15.19:0/2002061962 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011d20 con 0x7f1b2409d6f0 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/2002061962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 msgr2=0x7f1b2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/2002061962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 0x7f1b2409dac0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009870 tx=0x7f1b20009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/2002061962 shutdown_connections 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/2002061962 >> v2:172.21.15.19:3300/0 conn(0x7f1b2409e410 0x7f1b24134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/2002061962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409d6f0 0x7f1b2409dac0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/2002061962 >> 172.21.15.19:0/2002061962 conn(0x7f1b24066f50 msgr2=0x7f1b2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/2002061962 shutdown_connections 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.251+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/2002061962 wait complete. 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 Processor -- start 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 -- start start 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 0x7f1b241a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409e410 0x7f1b241a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241a58e0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2409c780 con 0x7f1b2409e410 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.252+0000 7f1b2b8f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b241a7190 con 0x7f1b2409e000 2023-10-03T10:17:12.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34352/0 (socket says 172.21.15.19:34352) 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 -- 172.21.15.19:0/1777734592 learned_addr learned my addr 172.21.15.19:0/1777734592 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b28e8f700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 0x7f1b241a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29e91700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409e410 0x7f1b241a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 -- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 msgr2=0x7f1b241a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 0x7f1b241a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 -- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409e410 msgr2=0x7f1b241a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409e410 0x7f1b241a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 -- 172.21.15.19:0/1777734592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c009a70 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b28e8f700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 0x7f1b241a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b29690700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1b20000c00 tx=0x7f1b20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200036a0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2001f070 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b200094a0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.253+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20003a00 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.254+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b241a6eb0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.255+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b20003b60 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.255+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b241a5ad0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.255+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b20021070 con 0x7f1b2409d6f0 2023-10-03T10:17:12.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.260+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b20010380 con 0x7f1b2409d6f0 2023-10-03T10:17:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.273+0000 7f41a081b700 1 Processor -- start 2023-10-03T10:17:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.273+0000 7f41a081b700 1 -- start start 2023-10-03T10:17:12.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.274+0000 7f41a081b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 0x7f419c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.274+0000 7f41a081b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 0x7f419c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.274+0000 7f41a081b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c070940 con 0x7f419c09f650 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.274+0000 7f41a081b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c06fd60 con 0x7f419c09f240 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.274+0000 7f41a081b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419c06fa80 con 0x7f419c09e930 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 0x7f419c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f419c09f650 0x7f419c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36460/0 (socket says 172.21.15.19:36460) 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 0x7f419c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419ad9d700 1 -- 172.21.15.19:0/3089569394 learned_addr learned my addr 172.21.15.19:0/3089569394 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419959a700 1 -- 172.21.15.19:0/3089569394 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574051539 0 0) 0x7f419c070940 con 0x7f419c09f650 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419959a700 1 -- 172.21.15.19:0/3089569394 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41840035b0 con 0x7f419c09f650 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 -- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 msgr2=0x7f419c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 0x7f419c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 -- 172.21.15.19:0/3089569394 >> v1:172.21.15.19:6789/0 conn(0x7f419c09f650 legacy=0x7f419c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 -- 172.21.15.19:0/3089569394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c09fb60 con 0x7f419c09f240 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f419a59c700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 0x7f419c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.275+0000 7f4199d9b700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 0x7f419c1317f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4190009870 tx=0x7f4190009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7525fbba4cfa994 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.276+0000 7f419959a700 1 -- 172.21.15.19:0/3089569394 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011830 con 0x7f419c09f240 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.276+0000 7f419959a700 1 -- 172.21.15.19:0/3089569394 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190011990 con 0x7f419c09f240 2023-10-03T10:17:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.276+0000 7f419959a700 1 -- 172.21.15.19:0/3089569394 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011d20 con 0x7f419c09f240 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 -- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 msgr2=0x7f419c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 0x7f419c1317f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4190009870 tx=0x7f4190009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 -- 172.21.15.19:0/3089569394 shutdown_connections 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09e930 0x7f419c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 --2- 172.21.15.19:0/3089569394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f240 0x7f419c1317f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 -- 172.21.15.19:0/3089569394 >> 172.21.15.19:0/3089569394 conn(0x7f419c0a4210 msgr2=0x7f419c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 -- 172.21.15.19:0/3089569394 shutdown_connections 2023-10-03T10:17:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.277+0000 7f41a081b700 1 -- 172.21.15.19:0/3089569394 wait complete. 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 Processor -- start 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 -- start start 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419c09e930 0x7f419c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 0x7f419c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 0x7f419c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c1b7230 con 0x7f419c09e930 2023-10-03T10:17:12.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c1a93e0 con 0x7f419c09f650 2023-10-03T10:17:12.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.279+0000 7f41a081b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419c1a8900 con 0x7f419c09f240 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f4199d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 0x7f419c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f4199d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 0x7f419c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49748/0 (socket says 172.21.15.19:49748) 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f4199d9b700 1 -- 172.21.15.19:0/135728979 learned_addr learned my addr 172.21.15.19:0/135728979 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419a59c700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419c09e930 0x7f419c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 0x7f419c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 -- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 msgr2=0x7f419c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 0x7f419c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 -- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419c09e930 msgr2=0x7f419c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419c09e930 0x7f419c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 -- 172.21.15.19:0/135728979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0094a0 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.280+0000 7f419ad9d700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 0x7f419c06c330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f419400ca80 tx=0x7f419400cd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.281+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400a9a0 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.281+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400ab00 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.281+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41900094a0 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.281+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400ae70 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.281+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c0a0190 con 0x7f419c09f650 2023-10-03T10:17:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.282+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f419401b3b0 con 0x7f419c09f650 2023-10-03T10:17:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.282+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f419403f230 con 0x7f419c09f650 2023-10-03T10:17:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.282+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c1a0b30 con 0x7f419c09f650 2023-10-03T10:17:12.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.292+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f41940192c0 con 0x7f419c09f650 2023-10-03T10:17:12.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.371+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff594074ea0 con 0x7ff594134260 2023-10-03T10:17:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.372+0000 7ff582ffd700 1 -- 172.21.15.19:0/648258774 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff58c01ab80 con 0x7ff594134260 2023-10-03T10:17:12.373 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.374+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 msgr2=0x7ff59409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.374+0000 7ff598e23700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 0x7ff59409cf00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff58c016000 tx=0x7ff58c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 shutdown_connections 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff594134260 0x7ff59409cf00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff594133420 0x7ff59409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 --2- 172.21.15.19:0/648258774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff594133e30 0x7ff59409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 >> 172.21.15.19:0/648258774 conn(0x7ff5940a4210 msgr2=0x7ff5940a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 shutdown_connections 2023-10-03T10:17:12.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.375+0000 7ff598e23700 1 -- 172.21.15.19:0/648258774 wait complete. 2023-10-03T10:17:12.390 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.473+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b24074ea0 con 0x7f1b2409d6f0 2023-10-03T10:17:12.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.473+0000 7f1b19ffb700 1 -- 172.21.15.19:0/1777734592 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b20033020 con 0x7f1b2409d6f0 2023-10-03T10:17:12.474 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 msgr2=0x7f1b241a36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f1b20000c00 tx=0x7f1b20004750 comp rx=0 tx=0).stop 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 shutdown_connections 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b2409e410 0x7f1b241a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b2409d6f0 0x7f1b241a36c0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 --2- 172.21.15.19:0/1777734592 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b2409e000 0x7f1b241a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 >> 172.21.15.19:0/1777734592 conn(0x7f1b24066f50 msgr2=0x7f1b240a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 shutdown_connections 2023-10-03T10:17:12.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.476+0000 7f1b2b8f4700 1 -- 172.21.15.19:0/1777734592 wait complete. 2023-10-03T10:17:12.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.485+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7724005590 con 0x7f773c131d10 2023-10-03T10:17:12.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.485+0000 7f77327fc700 1 -- 172.21.15.19:0/2431242146 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f773401ab70 con 0x7f773c131d10 2023-10-03T10:17:12.486 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.487+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 msgr2=0x7f773c11eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.487+0000 7f7743e22700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 0x7f773c11eac0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7734016000 tx=0x7f7734004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 shutdown_connections 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f773c131d10 0x7f773c11eac0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f773c06a770 0x7f773c11e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 --2- 172.21.15.19:0/2431242146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f773c06b080 0x7f773c11e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 >> 172.21.15.19:0/2431242146 conn(0x7f773c066f50 msgr2=0x7f773c071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 shutdown_connections 2023-10-03T10:17:12.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.488+0000 7f7743e22700 1 -- 172.21.15.19:0/2431242146 wait complete. 2023-10-03T10:17:12.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:12.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:12.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.577+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f419c1a9110 con 0x7f419c09f650 2023-10-03T10:17:12.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.578+0000 7f418affd700 1 -- 172.21.15.19:0/135728979 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4194017030 con 0x7f419c09f650 2023-10-03T10:17:12.579 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:12.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 msgr2=0x7f419c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:12.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 0x7f419c06c330 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f419400ca80 tx=0x7f419400cd90 comp rx=0 tx=0).stop 2023-10-03T10:17:12.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 shutdown_connections 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419c09f650 0x7f419c06c330 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419c09e930 0x7f419c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 --2- 172.21.15.19:0/135728979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419c09f240 0x7f419c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 >> 172.21.15.19:0/135728979 conn(0x7f419c0a4210 msgr2=0x7f419c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 shutdown_connections 2023-10-03T10:17:12.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:12.580+0000 7f41a081b700 1 -- 172.21.15.19:0/135728979 wait complete. 2023-10-03T10:17:12.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:13.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:13.491 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:13.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.540+0000 7f591a87f700 1 Processor -- start 2023-10-03T10:17:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.540+0000 7f591a87f700 1 -- start start 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f591a87f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f591a87f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f591409e410 0x7f5914130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f591a87f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591409f130 con 0x7f591409e000 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f591a87f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591409f520 con 0x7f591409e410 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f591a87f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591409e930 con 0x7f591409d6f0 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50152/0 (socket says 172.21.15.19:50152) 2023-10-03T10:17:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 -- 172.21.15.19:0/2506618729 learned_addr learned my addr 172.21.15.19:0/2506618729 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5918e1c700 1 --2- 172.21.15.19:0/2506618729 >> v2:172.21.15.19:3300/0 conn(0x7f591409e410 0x7f5914130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 -- 172.21.15.19:0/2506618729 >> v2:172.21.15.19:3300/0 conn(0x7f591409e410 msgr2=0x7f5914130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 --2- 172.21.15.19:0/2506618729 >> v2:172.21.15.19:3300/0 conn(0x7f591409e410 0x7f5914130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.541+0000 7f5913fff700 1 -- 172.21.15.19:0/2506618729 >> v1:172.21.15.19:6789/0 conn(0x7f591409e000 legacy=0x7f5914130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.542+0000 7f5913fff700 1 -- 172.21.15.19:0/2506618729 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591409b2d0 con 0x7f591409d6f0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.542+0000 7f5913fff700 1 --2- 172.21.15.19:0/2506618729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59040098f0 tx=0x7f5904009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b22e43a32e25316 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.542+0000 7f5912ffd700 1 -- 172.21.15.19:0/2506618729 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904011830 con 0x7f591409d6f0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.542+0000 7f5912ffd700 1 -- 172.21.15.19:0/2506618729 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5904011990 con 0x7f591409d6f0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.542+0000 7f5912ffd700 1 -- 172.21.15.19:0/2506618729 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904011d20 con 0x7f591409d6f0 2023-10-03T10:17:13.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 -- 172.21.15.19:0/2506618729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 msgr2=0x7f591409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 --2- 172.21.15.19:0/2506618729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f59040098f0 tx=0x7f5904009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 -- 172.21.15.19:0/2506618729 shutdown_connections 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 --2- 172.21.15.19:0/2506618729 >> v2:172.21.15.19:3300/0 conn(0x7f591409e410 0x7f5914130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 --2- 172.21.15.19:0/2506618729 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409d6f0 0x7f591409dac0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 -- 172.21.15.19:0/2506618729 >> 172.21.15.19:0/2506618729 conn(0x7f5914066f50 msgr2=0x7f591409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 -- 172.21.15.19:0/2506618729 shutdown_connections 2023-10-03T10:17:13.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.543+0000 7f591a87f700 1 -- 172.21.15.19:0/2506618729 wait complete. 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.544+0000 7f591a87f700 1 Processor -- start 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.544+0000 7f591a87f700 1 -- start start 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 0x7f591411e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 0x7f591411e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 0x7f591411eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591411f510 con 0x7f591409e410 2023-10-03T10:17:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5914121b10 con 0x7f591409e000 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f591a87f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59141303d0 con 0x7f591409d6f0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5913fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 0x7f591411e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5913fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 0x7f591411e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49758/0 (socket says 172.21.15.19:49758) 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5913fff700 1 -- 172.21.15.19:0/218454961 learned_addr learned my addr 172.21.15.19:0/218454961 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 0x7f591411eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f59137fe700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 0x7f591411e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 -- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 msgr2=0x7f591411e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 0x7f591411e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 -- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 msgr2=0x7f591411e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 0x7f591411e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f5918e1c700 1 -- 172.21.15.19:0/218454961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009550 con 0x7f591409e410 2023-10-03T10:17:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.545+0000 7f59137fe700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 0x7f591411e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f5918e1c700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 0x7f591411eac0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f590c00efc0 tx=0x7f590c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c00cc90 con 0x7f591409e410 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c00f040 con 0x7f591409e410 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59141201e0 con 0x7f591409e410 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c009e60 con 0x7f591409e410 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.546+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591409c750 con 0x7f591409e410 2023-10-03T10:17:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.547+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f590c014480 con 0x7f591409e410 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.547+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f590c03fde0 con 0x7f591409e410 2023-10-03T10:17:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.547+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5914121360 con 0x7f591409e410 2023-10-03T10:17:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.552+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f590c018020 con 0x7f591409e410 2023-10-03T10:17:13.595 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:13.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 Processor -- start 2023-10-03T10:17:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 -- start start 2023-10-03T10:17:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 0x7fdcd406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcd4130430 0x7fdcd4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd412cd90 con 0x7fdcd412f8b0 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd412d330 con 0x7fdcd4130430 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.635+0000 7fdcdc7ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd4071780 con 0x7fdcd412cf60 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcd9d48700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdcd412f8b0 0x7fdcd412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36478/0 (socket says 172.21.15.19:36478) 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcd9d48700 1 -- 172.21.15.19:0/704054743 learned_addr learned my addr 172.21.15.19:0/704054743 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcdad4a700 1 --2- 172.21.15.19:0/704054743 >> v2:172.21.15.19:3300/0 conn(0x7fdcd4130430 0x7fdcd4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 --2- 172.21.15.19:0/704054743 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 0x7fdcd406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 -- 172.21.15.19:0/704054743 >> v2:172.21.15.19:3300/0 conn(0x7fdcd4130430 msgr2=0x7fdcd4137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 --2- 172.21.15.19:0/704054743 >> v2:172.21.15.19:3300/0 conn(0x7fdcd4130430 0x7fdcd4137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 -- 172.21.15.19:0/704054743 >> v1:172.21.15.19:6789/0 conn(0x7fdcd412f8b0 legacy=0x7fdcd412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 -- 172.21.15.19:0/704054743 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4071a40 con 0x7fdcd412cf60 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcd9547700 1 -- 172.21.15.19:0/704054743 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675703287 0 0) 0x7fdcd412cd90 con 0x7fdcd412f8b0 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.636+0000 7fdcda549700 1 --2- 172.21.15.19:0/704054743 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 0x7fdcd406f5d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009840 tx=0x7fdcd0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcaaf83b4675a68a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcd9547700 1 -- 172.21.15.19:0/704054743 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011830 con 0x7fdcd412cf60 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcd9547700 1 -- 172.21.15.19:0/704054743 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd0011990 con 0x7fdcd412cf60 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcd9547700 1 -- 172.21.15.19:0/704054743 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0011d20 con 0x7fdcd412cf60 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/704054743 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 msgr2=0x7fdcd406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/704054743 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 0x7fdcd406f5d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009840 tx=0x7fdcd0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/704054743 shutdown_connections 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/704054743 >> v2:172.21.15.19:3300/0 conn(0x7fdcd4130430 0x7fdcd4137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/704054743 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412cf60 0x7fdcd406f5d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.637+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/704054743 >> 172.21.15.19:0/704054743 conn(0x7fdcd40a2aa0 msgr2=0x7fdcd40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.638+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/704054743 shutdown_connections 2023-10-03T10:17:13.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.638+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/704054743 wait complete. 2023-10-03T10:17:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 Processor -- start 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 -- start start 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 0x7fdcd409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 0x7fdcd41c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd409c5f0 con 0x7fdcd412cf60 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd409ea40 con 0x7fdcd412f8b0 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdc7ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd409cd10 con 0x7fdcd4130430 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcd9d48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcdad4a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 0x7fdcd41c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcd9d48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50178/0 (socket says 172.21.15.19:50178) 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.639+0000 7fdcd9d48700 1 -- 172.21.15.19:0/2945065725 learned_addr learned my addr 172.21.15.19:0/2945065725 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcda549700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 0x7fdcd409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 -- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 msgr2=0x7fdcd41c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 0x7fdcd41c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 -- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 msgr2=0x7fdcd409b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 0x7fdcd409b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 -- 172.21.15.19:0/2945065725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00094a0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcdad4a700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 0x7fdcd41c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcda549700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 0x7fdcd409b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcd9d48700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4001eb0 tx=0x7fdcc400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4004c80 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4004de0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.640+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd412d9d0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.641+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4007310 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.641+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd411d6d0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.642+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd4074ea0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.642+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdcc4007470 con 0x7fdcd412f8b0 2023-10-03T10:17:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.642+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdcc403f360 con 0x7fdcd412f8b0 2023-10-03T10:17:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.651+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcc401bd10 con 0x7fdcd412f8b0 2023-10-03T10:17:13.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.692+0000 7f367d125700 1 Processor -- start 2023-10-03T10:17:13.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.692+0000 7f367d125700 1 -- start start 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367d125700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 0x7f3678133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367d125700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f367809e930 0x7f367813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367d125700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367806ef30 con 0x7f367809de50 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367d125700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367806fef0 con 0x7f367809e930 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367d125700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36781334b0 con 0x7f36781338a0 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 0x7f3678133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f367809de50 0x7f367809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36488/0 (socket says 172.21.15.19:36488) 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367659c700 1 -- 172.21.15.19:0/1287543489 learned_addr learned my addr 172.21.15.19:0/1287543489 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:13.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f367759e700 1 --2- 172.21.15.19:0/1287543489 >> v2:172.21.15.19:3300/0 conn(0x7f367809e930 0x7f367813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 -- 172.21.15.19:0/1287543489 >> v2:172.21.15.19:3300/0 conn(0x7f367809e930 msgr2=0x7f367813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 --2- 172.21.15.19:0/1287543489 >> v2:172.21.15.19:3300/0 conn(0x7f367809e930 0x7f367813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 -- 172.21.15.19:0/1287543489 >> v1:172.21.15.19:6789/0 conn(0x7f367809de50 legacy=0x7f367809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 -- 172.21.15.19:0/1287543489 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367806fc30 con 0x7f36781338a0 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.693+0000 7f3676d9d700 1 --2- 172.21.15.19:0/1287543489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 0x7f3678133c70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3668009840 tx=0x7f3668009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db96b47117e9af0b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.694+0000 7f3675d9b700 1 -- 172.21.15.19:0/1287543489 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011830 con 0x7f36781338a0 2023-10-03T10:17:13.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.694+0000 7f3675d9b700 1 -- 172.21.15.19:0/1287543489 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3668011990 con 0x7f36781338a0 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.694+0000 7f3675d9b700 1 -- 172.21.15.19:0/1287543489 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668011d20 con 0x7f36781338a0 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 -- 172.21.15.19:0/1287543489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 msgr2=0x7f3678133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 --2- 172.21.15.19:0/1287543489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 0x7f3678133c70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f3668009840 tx=0x7f3668009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 -- 172.21.15.19:0/1287543489 shutdown_connections 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 --2- 172.21.15.19:0/1287543489 >> v2:172.21.15.19:3300/0 conn(0x7f367809e930 0x7f367813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 --2- 172.21.15.19:0/1287543489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36781338a0 0x7f3678133c70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 -- 172.21.15.19:0/1287543489 >> 172.21.15.19:0/1287543489 conn(0x7f36780a2aa0 msgr2=0x7f36780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 -- 172.21.15.19:0/1287543489 shutdown_connections 2023-10-03T10:17:13.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.695+0000 7f367d125700 1 -- 172.21.15.19:0/1287543489 wait complete. 2023-10-03T10:17:13.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.697+0000 7f367d125700 1 Processor -- start 2023-10-03T10:17:13.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.697+0000 7f367d125700 1 -- start start 2023-10-03T10:17:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 0x7f367811d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36781338a0 0x7f367811e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3678120fa0 con 0x7f367809de50 2023-10-03T10:17:13.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36781200e0 con 0x7f367809e930 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367d125700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36780a0fe0 con 0x7f36781338a0 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50196/0 (socket says 172.21.15.19:50196) 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367659c700 1 -- 172.21.15.19:0/574425491 learned_addr learned my addr 172.21.15.19:0/574425491 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 0x7f367811d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367759e700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36781338a0 0x7f367811e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 -- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36781338a0 msgr2=0x7f367811e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36781338a0 0x7f367811e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 -- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 msgr2=0x7f367811dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f3676d9d700 1 -- 172.21.15.19:0/574425491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36680094a0 con 0x7f367809de50 2023-10-03T10:17:13.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.698+0000 7f367659c700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f3676d9d700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 0x7f367811d790 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3668016000 tx=0x7f3668004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36680036a0 con 0x7f367809de50 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366801f070 con 0x7f367809de50 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3668003a40 con 0x7f367809de50 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f367d125700 1 -- 172.21.15.19:0/574425491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367806f640 con 0x7f367809de50 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.699+0000 7f367d125700 1 -- 172.21.15.19:0/574425491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36781205a0 con 0x7f367809de50 2023-10-03T10:17:13.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.700+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36500052e0 con 0x7f367809de50 2023-10-03T10:17:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.701+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3668003ba0 con 0x7f367809de50 2023-10-03T10:17:13.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.701+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3668021070 con 0x7f367809de50 2023-10-03T10:17:13.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.706+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3668010380 con 0x7f367809de50 2023-10-03T10:17:13.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.755+0000 7fb8868e7700 1 Processor -- start 2023-10-03T10:17:13.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.755+0000 7fb8868e7700 1 -- start start 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb8868e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb880133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb8868e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb8868e7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb88006ef30 con 0x7fb88009de50 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb8868e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88006fef0 con 0x7fb8801338a0 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb8868e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8801334b0 con 0x7fb88009e930 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49786/0 (socket says 172.21.15.19:49786) 2023-10-03T10:17:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb87f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb88009de50 0x7fb88009e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36496/0 (socket says 172.21.15.19:36496) 2023-10-03T10:17:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 -- 172.21.15.19:0/2710128994 learned_addr learned my addr 172.21.15.19:0/2710128994 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb87ffff700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb880133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 -- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 msgr2=0x7fb880133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb87effd700 1 -- 172.21.15.19:0/2710128994 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421033449 0 0) 0x7fb88006ef30 con 0x7fb88009de50 2023-10-03T10:17:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb880133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.756+0000 7fb884e84700 1 -- 172.21.15.19:0/2710128994 >> v1:172.21.15.19:6789/0 conn(0x7fb88009de50 legacy=0x7fb88009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.757+0000 7fb884e84700 1 -- 172.21.15.19:0/2710128994 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88006fc30 con 0x7fb88009e930 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.757+0000 7fb884e84700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb878009e80 tx=0x7fb87800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc70ff3ceb6305b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.757+0000 7fb87effd700 1 -- 172.21.15.19:0/2710128994 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800e070 con 0x7fb88009e930 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.757+0000 7fb87effd700 1 -- 172.21.15.19:0/2710128994 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb87800b9c0 con 0x7fb88009e930 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.757+0000 7fb87effd700 1 -- 172.21.15.19:0/2710128994 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800bd70 con 0x7fb88009e930 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 -- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 msgr2=0x7fb88013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb878009e80 tx=0x7fb87800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 -- 172.21.15.19:0/2710128994 shutdown_connections 2023-10-03T10:17:13.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88013b740 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 --2- 172.21.15.19:0/2710128994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb880133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 -- 172.21.15.19:0/2710128994 >> 172.21.15.19:0/2710128994 conn(0x7fb8800a2aa0 msgr2=0x7fb8800a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 -- 172.21.15.19:0/2710128994 shutdown_connections 2023-10-03T10:17:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.758+0000 7fb8868e7700 1 -- 172.21.15.19:0/2710128994 wait complete. 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.760+0000 7fb8868e7700 1 Processor -- start 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.760+0000 7fb8868e7700 1 -- start start 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88011dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb88011e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb880120de0 con 0x7fb88009de50 2023-10-03T10:17:13.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88011f2c0 con 0x7fb8801338a0 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb8868e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8800a0d00 con 0x7fb88009e930 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34420/0 (socket says 172.21.15.19:34420) 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 -- 172.21.15.19:0/3032749462 learned_addr learned my addr 172.21.15.19:0/3032749462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87f7fe700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88011dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb884e84700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb88011e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 -- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 msgr2=0x7fb88011dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88011dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 -- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 msgr2=0x7fb88011e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb88011e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.761+0000 7fb87ffff700 1 -- 172.21.15.19:0/3032749462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878009b30 con 0x7fb88009de50 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb87ffff700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb87000e810 tx=0x7fb87000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87000c070 con 0x7fb88009de50 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb870013610 con 0x7fb88009de50 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88006f640 con 0x7fb88009de50 2023-10-03T10:17:13.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8700139c0 con 0x7fb88009de50 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.762+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8801210c0 con 0x7fb88009de50 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.763+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88011a470 con 0x7fb88009de50 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.763+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb870013b20 con 0x7fb88009de50 2023-10-03T10:17:13.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.764+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb87003f830 con 0x7fb88009de50 2023-10-03T10:17:13.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.772+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb87000f040 con 0x7fb88009de50 2023-10-03T10:17:13.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.779+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5914074ea0 con 0x7f591409e410 2023-10-03T10:17:13.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.779+0000 7f5910ff9700 1 -- 172.21.15.19:0/218454961 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f590c0118b0 con 0x7f591409e410 2023-10-03T10:17:13.780 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 msgr2=0x7f591411eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 0x7f591411eac0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f590c00efc0 tx=0x7f590c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 shutdown_connections 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f591409e410 0x7f591411eac0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f591409d6f0 0x7f591411e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 --2- 172.21.15.19:0/218454961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f591409e000 0x7f591411e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 >> 172.21.15.19:0/218454961 conn(0x7f5914066f50 msgr2=0x7f59140a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 shutdown_connections 2023-10-03T10:17:13.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.782+0000 7f591a87f700 1 -- 172.21.15.19:0/218454961 wait complete. 2023-10-03T10:17:13.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.875+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdcd40713a0 con 0x7fdcd412f8b0 2023-10-03T10:17:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.875+0000 7fdccaffd700 1 -- 172.21.15.19:0/2945065725 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcc4011360 con 0x7fdcd412f8b0 2023-10-03T10:17:13.876 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:13.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 msgr2=0x7fdcd409b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4001eb0 tx=0x7fdcc400c800 comp rx=0 tx=0).stop 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 shutdown_connections 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcd4130430 0x7fdcd41c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcd412cf60 0x7fdcd409b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 --2- 172.21.15.19:0/2945065725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcd412f8b0 0x7fdcd409b8b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.877+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 >> 172.21.15.19:0/2945065725 conn(0x7fdcd40a2aa0 msgr2=0x7fdcd41b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.878+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 shutdown_connections 2023-10-03T10:17:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.878+0000 7fdcdc7ad700 1 -- 172.21.15.19:0/2945065725 wait complete. 2023-10-03T10:17:13.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.934+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3650005860 con 0x7f367809de50 2023-10-03T10:17:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.934+0000 7f365f7fe700 1 -- 172.21.15.19:0/574425491 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3668015030 con 0x7f367809de50 2023-10-03T10:17:13.935 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 msgr2=0x7f367811d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 0x7f367811d790 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f3668016000 tx=0x7f3668004750 comp rx=0 tx=0).stop 2023-10-03T10:17:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 shutdown_connections 2023-10-03T10:17:13.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36781338a0 0x7f367811e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f367809de50 0x7f367811d790 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 --2- 172.21.15.19:0/574425491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f367809e930 0x7f367811dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 >> 172.21.15.19:0/574425491 conn(0x7f36780a2aa0 msgr2=0x7f36781b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 shutdown_connections 2023-10-03T10:17:13.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.937+0000 7f365d7fa700 1 -- 172.21.15.19:0/574425491 wait complete. 2023-10-03T10:17:13.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:13.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.978+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb880074ea0 con 0x7fb88009de50 2023-10-03T10:17:13.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.978+0000 7fb87cff9700 1 -- 172.21.15.19:0/3032749462 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb8700127e0 con 0x7fb88009de50 2023-10-03T10:17:13.979 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.980+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 msgr2=0x7fb88011d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.980+0000 7fb8868e7700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fb87000e810 tx=0x7fb87000eb20 comp rx=0 tx=0).stop 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.980+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 shutdown_connections 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.980+0000 7fb8868e7700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb8801338a0 0x7fb88011e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.981+0000 7fb8868e7700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb88009de50 0x7fb88011d6d0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.981+0000 7fb8868e7700 1 --2- 172.21.15.19:0/3032749462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb88009e930 0x7fb88011dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.981+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 >> 172.21.15.19:0/3032749462 conn(0x7fb8800a2aa0 msgr2=0x7fb8801badc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.981+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 shutdown_connections 2023-10-03T10:17:13.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:13.981+0000 7fb8868e7700 1 -- 172.21.15.19:0/3032749462 wait complete. 2023-10-03T10:17:13.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:14.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:14.892 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:14.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.944+0000 7ffb66dd5700 1 Processor -- start 2023-10-03T10:17:14.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.944+0000 7ffb66dd5700 1 -- start start 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb66dd5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb66dd5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb60139250 0x7ffb6013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb66dd5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6009edd0 con 0x7ffb600a0a30 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb66dd5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb600a18e0 con 0x7ffb60139250 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb66dd5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6009e1f0 con 0x7ffb600a1510 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb64b71700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb600a0a30 0x7ffb600a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36508/0 (socket says 172.21.15.19:36508) 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb64b71700 1 -- 172.21.15.19:0/2583273859 learned_addr learned my addr 172.21.15.19:0/2583273859 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb65372700 1 --2- 172.21.15.19:0/2583273859 >> v2:172.21.15.19:3300/0 conn(0x7ffb60139250 0x7ffb6013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb5ffff700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb5f7fe700 1 -- 172.21.15.19:0/2583273859 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954523618 0 0) 0x7ffb6009edd0 con 0x7ffb600a0a30 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb5f7fe700 1 -- 172.21.15.19:0/2583273859 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb480035b0 con 0x7ffb600a0a30 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb65372700 1 -- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 msgr2=0x7ffb60138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb65372700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb65372700 1 -- 172.21.15.19:0/2583273859 >> v1:172.21.15.19:6789/0 conn(0x7ffb600a0a30 legacy=0x7ffb600a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.945+0000 7ffb65372700 1 -- 172.21.15.19:0/2583273859 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6009dc50 con 0x7ffb60139250 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.946+0000 7ffb65372700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb60139250 0x7ffb6013b630 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb50009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5545fa9b75796184 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.946+0000 7ffb5f7fe700 1 -- 172.21.15.19:0/2583273859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50011830 con 0x7ffb60139250 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.946+0000 7ffb5f7fe700 1 -- 172.21.15.19:0/2583273859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50011990 con 0x7ffb60139250 2023-10-03T10:17:14.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.946+0000 7ffb5f7fe700 1 -- 172.21.15.19:0/2583273859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50011d20 con 0x7ffb60139250 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb60139250 msgr2=0x7ffb6013b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb60139250 0x7ffb6013b630 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009870 tx=0x7ffb50009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2583273859 shutdown_connections 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb60139250 0x7ffb6013b630 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2583273859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2583273859 >> 172.21.15.19:0/2583273859 conn(0x7ffb600a6550 msgr2=0x7ffb600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2583273859 shutdown_connections 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.947+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2583273859 wait complete. 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 Processor -- start 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 -- start start 2023-10-03T10:17:14.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 0x7ffb601226b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60139250 0x7ffb60123130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb60125ef0 con 0x7ffb600a0a30 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb601259d0 con 0x7ffb600a1510 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb66dd5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb600a5560 con 0x7ffb60139250 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb5ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50236/0 (socket says 172.21.15.19:50236) 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb5ffff700 1 -- 172.21.15.19:0/2606233410 learned_addr learned my addr 172.21.15.19:0/2606233410 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.948+0000 7ffb64b71700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 0x7ffb601226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb65372700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60139250 0x7ffb60123130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 -- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60139250 msgr2=0x7ffb60123130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60139250 0x7ffb60123130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 -- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 msgr2=0x7ffb60122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 -- 172.21.15.19:0/2606233410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500094a0 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb5ffff700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb64b71700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 0x7ffb601226b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800cbc0 tx=0x7ffb5800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800a9e0 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5800ab40 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb600a0220 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb58012400 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.949+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb60126960 con 0x7ffb600a0a30 2023-10-03T10:17:14.953 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.951+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb60074ea0 con 0x7ffb600a0a30 2023-10-03T10:17:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.951+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb5801b3b0 con 0x7ffb600a0a30 2023-10-03T10:17:14.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.951+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb5803f780 con 0x7ffb600a0a30 2023-10-03T10:17:14.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:14.956+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb580192c0 con 0x7ffb600a0a30 2023-10-03T10:17:14.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:15.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.048+0000 7f741a245700 1 Processor -- start 2023-10-03T10:17:15.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.048+0000 7f741a245700 1 -- start start 2023-10-03T10:17:15.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.049+0000 7f741a245700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 0x7f7414131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.049+0000 7f741a245700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 0x7f7414139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.049+0000 7f741a245700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741409e130 con 0x7f741409d9f0 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.049+0000 7f741a245700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74141312b0 con 0x7f74141316c0 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.049+0000 7f741a245700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f741409f6e0 con 0x7f741406ae80 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 0x7f7414131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f7412ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f741409d9f0 0x7f741406a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36518/0 (socket says 172.21.15.19:36518) 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f7412ffd700 1 -- 172.21.15.19:0/3963374284 learned_addr learned my addr 172.21.15.19:0/3963374284 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:15.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f7413fff700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 0x7f7414139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 -- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 msgr2=0x7f7414139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 0x7f7414139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 -- 172.21.15.19:0/3963374284 >> v1:172.21.15.19:6789/0 conn(0x7f741409d9f0 legacy=0x7f741406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 -- 172.21.15.19:0/3963374284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741409e760 con 0x7f74141316c0 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f7413fff700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 0x7f7414139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.050+0000 7f74137fe700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 0x7f7414131a90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7404009870 tx=0x7f7404009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c81e7ca772b67fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.051+0000 7f74127fc700 1 -- 172.21.15.19:0/3963374284 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404011830 con 0x7f74141316c0 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.051+0000 7f74127fc700 1 -- 172.21.15.19:0/3963374284 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7404011990 con 0x7f74141316c0 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.051+0000 7f74127fc700 1 -- 172.21.15.19:0/3963374284 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404011d20 con 0x7f74141316c0 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 -- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 msgr2=0x7f7414131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 0x7f7414131a90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7404009870 tx=0x7f7404009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:15.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 -- 172.21.15.19:0/3963374284 shutdown_connections 2023-10-03T10:17:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741406ae80 0x7f7414139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 --2- 172.21.15.19:0/3963374284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f74141316c0 0x7f7414131a90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 -- 172.21.15.19:0/3963374284 >> 172.21.15.19:0/3963374284 conn(0x7f7414066f50 msgr2=0x7f741409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 -- 172.21.15.19:0/3963374284 shutdown_connections 2023-10-03T10:17:15.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.052+0000 7f741a245700 1 -- 172.21.15.19:0/3963374284 wait complete. 2023-10-03T10:17:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.053+0000 7f741a245700 1 Processor -- start 2023-10-03T10:17:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.053+0000 7f741a245700 1 -- start start 2023-10-03T10:17:15.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 0x7f74141c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74141316c0 0x7f74140709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140a3760 con 0x7f74141316c0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741412b900 con 0x7f741406ae80 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f741a245700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74141281b0 con 0x7f741409d9f0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50256/0 (socket says 172.21.15.19:50256) 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 -- 172.21.15.19:0/2856407697 learned_addr learned my addr 172.21.15.19:0/2856407697 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f7412ffd700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 0x7f74141c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f7413fff700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74141316c0 0x7f74140709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 -- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 msgr2=0x7f74141c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 0x7f74141c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 -- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74141316c0 msgr2=0x7f74140709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74141316c0 0x7f74140709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f74137fe700 1 -- 172.21.15.19:0/2856407697 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f740c009a70 con 0x7f741406ae80 2023-10-03T10:17:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.054+0000 7f7412ffd700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 0x7f74141c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:15.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f74137fe700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7404009bc0 tx=0x7f7404004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040044d0 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74040036a0 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74040094a0 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404003a30 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.055+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7414072520 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.056+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7404003b90 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.056+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f74040408d0 con 0x7f741406ae80 2023-10-03T10:17:15.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.056+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741409bb60 con 0x7f741406ae80 2023-10-03T10:17:15.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.066+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7404015080 con 0x7f741406ae80 2023-10-03T10:17:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.103+0000 7f6321098700 1 Processor -- start 2023-10-03T10:17:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.103+0000 7f6321098700 1 -- start start 2023-10-03T10:17:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.103+0000 7f6321098700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f631c12cf60 0x7f631c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.103+0000 7f6321098700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f6321098700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c12cd90 con 0x7f631c12f8b0 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f6321098700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c12d330 con 0x7f631c12cf60 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f6321098700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c071780 con 0x7f631c130430 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50260/0 (socket says 172.21.15.19:50260) 2023-10-03T10:17:15.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 -- 172.21.15.19:0/3963770787 learned_addr learned my addr 172.21.15.19:0/3963770787 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631ad9d700 1 --2- 172.21.15.19:0/3963770787 >> v2:172.21.15.19:3300/0 conn(0x7f631c12cf60 0x7f631c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f6319d9b700 1 -- 172.21.15.19:0/3963770787 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287751884 0 0) 0x7f631c12cd90 con 0x7f631c12f8b0 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 -- 172.21.15.19:0/3963770787 >> v2:172.21.15.19:3300/0 conn(0x7f631c12cf60 msgr2=0x7f631c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 --2- 172.21.15.19:0/3963770787 >> v2:172.21.15.19:3300/0 conn(0x7f631c12cf60 0x7f631c06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 -- 172.21.15.19:0/3963770787 >> v1:172.21.15.19:6789/0 conn(0x7f631c12f8b0 legacy=0x7f631c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 -- 172.21.15.19:0/3963770787 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c071a40 con 0x7f631c130430 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.104+0000 7f631b59e700 1 --2- 172.21.15.19:0/3963770787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6314009e50 tx=0x7f631400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb962aff116bb851 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.105+0000 7f6319d9b700 1 -- 172.21.15.19:0/3963770787 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400bbc0 con 0x7f631c130430 2023-10-03T10:17:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.105+0000 7f6319d9b700 1 -- 172.21.15.19:0/3963770787 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631400bd20 con 0x7f631c130430 2023-10-03T10:17:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.105+0000 7f6319d9b700 1 -- 172.21.15.19:0/3963770787 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314010710 con 0x7f631c130430 2023-10-03T10:17:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 -- 172.21.15.19:0/3963770787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 msgr2=0x7f631c137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 --2- 172.21.15.19:0/3963770787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6314009e50 tx=0x7f631400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 -- 172.21.15.19:0/3963770787 shutdown_connections 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 --2- 172.21.15.19:0/3963770787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c130430 0x7f631c137c30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 --2- 172.21.15.19:0/3963770787 >> v2:172.21.15.19:3300/0 conn(0x7f631c12cf60 0x7f631c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 -- 172.21.15.19:0/3963770787 >> 172.21.15.19:0/3963770787 conn(0x7f631c0a2aa0 msgr2=0x7f631c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 -- 172.21.15.19:0/3963770787 shutdown_connections 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.106+0000 7f6321098700 1 -- 172.21.15.19:0/3963770787 wait complete. 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.108+0000 7f6321098700 1 Processor -- start 2023-10-03T10:17:15.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.108+0000 7f6321098700 1 -- start start 2023-10-03T10:17:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631c12cf60 0x7f631c1c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c130430 0x7f631c1c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c129d00 con 0x7f631c130430 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c09eb60 con 0x7f631c12f8b0 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f6321098700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f631c12a010 con 0x7f631c12cf60 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631c12cf60 0x7f631c1c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50270/0 (socket says 172.21.15.19:50270) 2023-10-03T10:17:15.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 -- 172.21.15.19:0/2680979080 learned_addr learned my addr 172.21.15.19:0/2680979080 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631b59e700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c130430 0x7f631c1c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 -- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631c12cf60 msgr2=0x7f631c1c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631c12cf60 0x7f631c1c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 -- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c130430 msgr2=0x7f631c1c49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c130430 0x7f631c1c49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 -- 172.21.15.19:0/2680979080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6314009b30 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.109+0000 7f631a59c700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f63100011e0 tx=0x7f631000ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.110+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100054e0 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.110+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310003680 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.110+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c09e8a0 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.110+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310003a30 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.110+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c119390 con 0x7f631c12f8b0 2023-10-03T10:17:15.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.111+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c06fbd0 con 0x7f631c12f8b0 2023-10-03T10:17:15.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.112+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6310003b90 con 0x7f631c12f8b0 2023-10-03T10:17:15.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.112+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f631003ebb0 con 0x7f631c12f8b0 2023-10-03T10:17:15.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.117+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6310003e40 con 0x7f631c12f8b0 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.151+0000 7f3345fb4700 1 Processor -- start 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.151+0000 7f3345fb4700 1 -- start start 2023-10-03T10:17:15.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.151+0000 7f3345fb4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33400a0a30 0x7f33400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3345fb4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3345fb4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400a2a70 con 0x7f3340133930 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3345fb4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400a01d0 con 0x7f33400a0a30 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3345fb4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f334009e2b0 con 0x7f334009d630 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49832/0 (socket says 172.21.15.19:49832) 2023-10-03T10:17:15.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 -- 172.21.15.19:0/3178581358 learned_addr learned my addr 172.21.15.19:0/3178581358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 -- 172.21.15.19:0/3178581358 >> v2:172.21.15.19:3300/0 conn(0x7f33400a0a30 msgr2=0x7f33400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 --2- 172.21.15.19:0/3178581358 >> v2:172.21.15.19:3300/0 conn(0x7f33400a0a30 0x7f33400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 -- 172.21.15.19:0/3178581358 >> v1:172.21.15.19:6789/0 conn(0x7f3340133930 legacy=0x7f3340133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 -- 172.21.15.19:0/3178581358 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334009dc50 con 0x7f334009d630 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f3336ffd700 1 --2- 172.21.15.19:0/3178581358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33280098f0 tx=0x7f3328009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d18ed8d4ac48350 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.152+0000 7f333effd700 1 -- 172.21.15.19:0/3178581358 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328004230 con 0x7f334009d630 2023-10-03T10:17:15.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.153+0000 7f333effd700 1 -- 172.21.15.19:0/3178581358 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3328004390 con 0x7f334009d630 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.153+0000 7f333effd700 1 -- 172.21.15.19:0/3178581358 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33280036a0 con 0x7f334009d630 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.153+0000 7f3345fb4700 1 -- 172.21.15.19:0/3178581358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 msgr2=0x7f33400a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.153+0000 7f3345fb4700 1 --2- 172.21.15.19:0/3178581358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33280098f0 tx=0x7f3328009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 -- 172.21.15.19:0/3178581358 shutdown_connections 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 --2- 172.21.15.19:0/3178581358 >> v2:172.21.15.19:3300/0 conn(0x7f33400a0a30 0x7f33400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 --2- 172.21.15.19:0/3178581358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f334009d630 0x7f33400a1340 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 -- 172.21.15.19:0/3178581358 >> 172.21.15.19:0/3178581358 conn(0x7f33400a3050 msgr2=0x7f33400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 -- 172.21.15.19:0/3178581358 shutdown_connections 2023-10-03T10:17:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.154+0000 7f3345fb4700 1 -- 172.21.15.19:0/3178581358 wait complete. 2023-10-03T10:17:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.155+0000 7f3345fb4700 1 Processor -- start 2023-10-03T10:17:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.155+0000 7f3345fb4700 1 -- start start 2023-10-03T10:17:15.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334009d630 0x7f3340121280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3340133930 0x7f3340121d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3340122e00 con 0x7f334009d630 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3340124ad0 con 0x7f33400a0a30 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3345fb4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3340123c90 con 0x7f3340133930 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3336ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3336ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50286/0 (socket says 172.21.15.19:50286) 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f3336ffd700 1 -- 172.21.15.19:0/1338968119 learned_addr learned my addr 172.21.15.19:0/1338968119 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f333f7fe700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334009d630 0x7f3340121280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.156+0000 7f333ffff700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3340133930 0x7f3340121d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 -- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3340133930 msgr2=0x7f3340121d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3340133930 0x7f3340121d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 -- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334009d630 msgr2=0x7f3340121280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334009d630 0x7f3340121280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 -- 172.21.15.19:0/1338968119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009550 con 0x7f33400a0a30 2023-10-03T10:17:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3336ffd700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f332800b0e0 tx=0x7f3328004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328003d60 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340124770 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400a0410 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332801f070 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.157+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332800b880 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.158+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3328021030 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.158+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3328040df0 con 0x7f33400a0a30 2023-10-03T10:17:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.158+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33240052e0 con 0x7f33400a0a30 2023-10-03T10:17:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.163+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f332802d440 con 0x7f33400a0a30 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.240+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb600a1d10 con 0x7ffb600a0a30 2023-10-03T10:17:15.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.241+0000 7ffb5d7fa700 1 -- 172.21.15.19:0/2606233410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb58017020 con 0x7ffb600a0a30 2023-10-03T10:17:15.242 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:15.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 msgr2=0x7ffb601226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 0x7ffb601226b0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800cbc0 tx=0x7ffb5800ced0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 shutdown_connections 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb60139250 0x7ffb60123130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb600a0a30 0x7ffb601226b0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 --2- 172.21.15.19:0/2606233410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb600a1510 0x7ffb60122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.244+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 >> 172.21.15.19:0/2606233410 conn(0x7ffb600a6550 msgr2=0x7ffb6011c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.245+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 shutdown_connections 2023-10-03T10:17:15.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.245+0000 7ffb66dd5700 1 -- 172.21.15.19:0/2606233410 wait complete. 2023-10-03T10:17:15.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:15.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.290+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7414074ea0 con 0x7f741406ae80 2023-10-03T10:17:15.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.291+0000 7f73fbfff700 1 -- 172.21.15.19:0/2856407697 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f740402e970 con 0x7f741406ae80 2023-10-03T10:17:15.292 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:15.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 msgr2=0x7f74141c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7404009bc0 tx=0x7f7404004750 comp rx=0 tx=0).stop 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 shutdown_connections 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74141316c0 0x7f74140709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f741406ae80 0x7f74141c85a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 --2- 172.21.15.19:0/2856407697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f741409d9f0 0x7f74141c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 >> 172.21.15.19:0/2856407697 conn(0x7f7414066f50 msgr2=0x7f74140a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.293+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 shutdown_connections 2023-10-03T10:17:15.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.294+0000 7f741a245700 1 -- 172.21.15.19:0/2856407697 wait complete. 2023-10-03T10:17:15.308 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:15.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.373+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f631c12dba0 con 0x7f631c12f8b0 2023-10-03T10:17:15.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.373+0000 7f63037fe700 1 -- 172.21.15.19:0/2680979080 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6310017030 con 0x7f631c12f8b0 2023-10-03T10:17:15.374 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 msgr2=0x7f631c1c44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f63100011e0 tx=0x7f631000ca30 comp rx=0 tx=0).stop 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 shutdown_connections 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f631c130430 0x7f631c1c49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f631c12cf60 0x7f631c1c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 --2- 172.21.15.19:0/2680979080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f631c12f8b0 0x7f631c1c44b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 >> 172.21.15.19:0/2680979080 conn(0x7f631c0a2aa0 msgr2=0x7f631c12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 shutdown_connections 2023-10-03T10:17:15.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.376+0000 7f6321098700 1 -- 172.21.15.19:0/2680979080 wait complete. 2023-10-03T10:17:15.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.382+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3324005590 con 0x7f33400a0a30 2023-10-03T10:17:15.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.382+0000 7f333cff9700 1 -- 172.21.15.19:0/1338968119 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3328023bc0 con 0x7f33400a0a30 2023-10-03T10:17:15.383 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.384+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 msgr2=0x7f33401217c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.384+0000 7f3345fb4700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f332800b0e0 tx=0x7f3328004750 comp rx=0 tx=0).stop 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 shutdown_connections 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3340133930 0x7f3340121d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f334009d630 0x7f3340121280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 --2- 172.21.15.19:0/1338968119 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33400a0a30 0x7f33401217c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:15.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 >> 172.21.15.19:0/1338968119 conn(0x7f33400a3050 msgr2=0x7f334009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:15.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 shutdown_connections 2023-10-03T10:17:15.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:15.385+0000 7f3345fb4700 1 -- 172.21.15.19:0/1338968119 wait complete. 2023-10-03T10:17:15.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:15.399 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:16.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:16.309 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:16.391 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:16.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 Processor -- start 2023-10-03T10:17:16.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 -- start start 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 0x7f35c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35c009e410 0x7f35c0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c009f520 con 0x7f35c009e410 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c009f130 con 0x7f35c009d6f0 2023-10-03T10:17:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.417+0000 7f35c60d5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c009e930 con 0x7f35c009e000 2023-10-03T10:17:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 0x7f35c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35bffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35c009e410 0x7f35c0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35bf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 0x7f35c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60102/0 (socket says 172.21.15.19:60102) 2023-10-03T10:17:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60222/0 (socket says 172.21.15.19:60222) 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35bf7fe700 1 -- 172.21.15.19:0/1692967856 learned_addr learned my addr 172.21.15.19:0/1692967856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 -- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 msgr2=0x7f35c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 --2- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 0x7f35c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 -- 172.21.15.19:0/1692967856 >> v2:172.21.15.19:3300/0 conn(0x7f35c009e410 msgr2=0x7f35c0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 --2- 172.21.15.19:0/1692967856 >> v2:172.21.15.19:3300/0 conn(0x7f35c009e410 0x7f35c0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 -- 172.21.15.19:0/1692967856 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c009b2d0 con 0x7f35c009e000 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.418+0000 7f35beffd700 1 --2- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee096b5e20ade979 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.419+0000 7f35be7fc700 1 -- 172.21.15.19:0/1692967856 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011830 con 0x7f35c009e000 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.419+0000 7f35be7fc700 1 -- 172.21.15.19:0/1692967856 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4011990 con 0x7f35c009e000 2023-10-03T10:17:16.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.419+0000 7f35be7fc700 1 -- 172.21.15.19:0/1692967856 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4011d20 con 0x7f35c009e000 2023-10-03T10:17:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 -- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 msgr2=0x7f35c0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 --2- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009870 tx=0x7f35b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 -- 172.21.15.19:0/1692967856 shutdown_connections 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 --2- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009d6f0 0x7f35c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 --2- 172.21.15.19:0/1692967856 >> v2:172.21.15.19:3300/0 conn(0x7f35c009e410 0x7f35c0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 --2- 172.21.15.19:0/1692967856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009e000 0x7f35c0130660 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 -- 172.21.15.19:0/1692967856 >> 172.21.15.19:0/1692967856 conn(0x7f35c0066f50 msgr2=0x7f35c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 -- 172.21.15.19:0/1692967856 shutdown_connections 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.420+0000 7f35c60d5700 1 -- 172.21.15.19:0/1692967856 wait complete. 2023-10-03T10:17:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.422+0000 7f35c60d5700 1 Processor -- start 2023-10-03T10:17:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.422+0000 7f35c60d5700 1 -- start start 2023-10-03T10:17:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009d6f0 0x7f35c011e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 0x7f35c011e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0121350 con 0x7f35c009e410 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c011fc80 con 0x7f35c009e000 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35c60d5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35c0130140 con 0x7f35c009d6f0 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43068/0 (socket says 172.21.15.19:43068) 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35bffff700 1 -- 172.21.15.19:0/3169353937 learned_addr learned my addr 172.21.15.19:0/3169353937 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.423+0000 7f35bf7fe700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009d6f0 0x7f35c011e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 -- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009d6f0 msgr2=0x7f35c011e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009d6f0 0x7f35c011e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 -- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 msgr2=0x7f35c011e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35beffd700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 0x7f35c011e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 0x7f35c011e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 -- 172.21.15.19:0/3169353937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40094a0 con 0x7f35c009e410 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35beffd700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 0x7f35c011e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35bffff700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f35b800efc0 tx=0x7f35b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8009ea0 con 0x7f35c009e410 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b800f040 con 0x7f35c009e410 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b8014480 con 0x7f35c009e410 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c00a16b0 con 0x7f35c009e410 2023-10-03T10:17:16.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.424+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c0121920 con 0x7f35c009e410 2023-10-03T10:17:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.426+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c0121540 con 0x7f35c009e410 2023-10-03T10:17:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.427+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35b80145e0 con 0x7f35c009e410 2023-10-03T10:17:16.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.427+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f35b8040a90 con 0x7f35c009e410 2023-10-03T10:17:16.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.432+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35b8012930 con 0x7f35c009e410 2023-10-03T10:17:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.460+0000 7f52a536d700 1 Processor -- start 2023-10-03T10:17:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.460+0000 7f52a536d700 1 -- start start 2023-10-03T10:17:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f52a536d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f52a01337f0 0x7f52a0138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f52a536d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a013b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f52a536d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a006b990 con 0x7f52a0133420 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f52a536d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a009b0e0 con 0x7f52a01337f0 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f52a536d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a0133c20 con 0x7f52a0138dc0 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f52a01337f0 0x7f52a0138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f52a01337f0 0x7f52a0138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43070/0 (socket says 172.21.15.19:43070) 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 -- 172.21.15.19:0/2644108250 learned_addr learned my addr 172.21.15.19:0/2644108250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529f7fe700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a013b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 -- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 msgr2=0x7f52a013b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a013b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 -- 172.21.15.19:0/2644108250 >> v1:172.21.15.19:6789/0 conn(0x7f52a0133420 legacy=0x7f52a0133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529e7fc700 1 -- 172.21.15.19:0/2644108250 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00a0590 con 0x7f52a01337f0 2023-10-03T10:17:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.461+0000 7f529dffb700 1 -- 172.21.15.19:0/2644108250 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297595209 0 0) 0x7f52a006b990 con 0x7f52a0133420 2023-10-03T10:17:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.462+0000 7f529e7fc700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a0138880 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52940098f0 tx=0x7f5294009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc5f83cff445b2b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.462+0000 7f529dffb700 1 -- 172.21.15.19:0/2644108250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294011830 con 0x7f52a01337f0 2023-10-03T10:17:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.462+0000 7f529dffb700 1 -- 172.21.15.19:0/2644108250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5294011990 con 0x7f52a01337f0 2023-10-03T10:17:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.462+0000 7f529dffb700 1 -- 172.21.15.19:0/2644108250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5294011d20 con 0x7f52a01337f0 2023-10-03T10:17:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 -- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 msgr2=0x7f52a0138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a0138880 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52940098f0 tx=0x7f5294009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 -- 172.21.15.19:0/2644108250 shutdown_connections 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a013b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 --2- 172.21.15.19:0/2644108250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a0138880 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 -- 172.21.15.19:0/2644108250 >> 172.21.15.19:0/2644108250 conn(0x7f52a00a4210 msgr2=0x7f52a00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 -- 172.21.15.19:0/2644108250 shutdown_connections 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.463+0000 7f52a536d700 1 -- 172.21.15.19:0/2644108250 wait complete. 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.464+0000 7f52a536d700 1 Processor -- start 2023-10-03T10:17:16.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.464+0000 7f52a536d700 1 -- start start 2023-10-03T10:17:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52a0133420 0x7f52a009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a012f420 con 0x7f52a01337f0 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a012f060 con 0x7f52a0133420 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f52a536d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f52a012f600 con 0x7f52a0138dc0 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f529f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f529f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60236/0 (socket says 172.21.15.19:60236) 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.465+0000 7f529f7fe700 1 -- 172.21.15.19:0/1392825307 learned_addr learned my addr 172.21.15.19:0/1392825307 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529e7fc700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529effd700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52a0133420 0x7f52a009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 -- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52a0133420 msgr2=0x7f52a009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52a0133420 0x7f52a009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 -- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 msgr2=0x7f52a009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 -- 172.21.15.19:0/1392825307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009550 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f529f7fe700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5298009e30 tx=0x7f529800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298009ca0 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529800f040 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a009df60 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5298014480 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.466+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a012e360 con 0x7f52a0138dc0 2023-10-03T10:17:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.468+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f52980145e0 con 0x7f52a0138dc0 2023-10-03T10:17:16.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.468+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a0074ea0 con 0x7f52a0138dc0 2023-10-03T10:17:16.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.468+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52980402e0 con 0x7f52a0138dc0 2023-10-03T10:17:16.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.473+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5298007900 con 0x7f52a0138dc0 2023-10-03T10:17:16.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 Processor -- start 2023-10-03T10:17:16.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 -- start start 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 0x7f616406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6164134610 0x7f6164134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6164070ee0 con 0x7f6164134610 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6164071480 con 0x7f616406e570 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.538+0000 7f616b46e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f616406f3c0 con 0x7f616409eca0 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f616920a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f616920a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60128/0 (socket says 172.21.15.19:60128) 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f616920a700 1 -- 172.21.15.19:0/3602378046 learned_addr learned my addr 172.21.15.19:0/3602378046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 0x7f616406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6169a0b700 1 --2- 172.21.15.19:0/3602378046 >> v2:172.21.15.19:3300/0 conn(0x7f6164134610 0x7f6164134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 -- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 msgr2=0x7f616406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 -- 172.21.15.19:0/3602378046 >> v2:172.21.15.19:3300/0 conn(0x7f6164134610 msgr2=0x7f6164134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 --2- 172.21.15.19:0/3602378046 >> v2:172.21.15.19:3300/0 conn(0x7f6164134610 0x7f6164134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f6168a09700 1 -- 172.21.15.19:0/3602378046 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164071b90 con 0x7f616409eca0 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.539+0000 7f616920a700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f6168a09700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 0x7f616406ee80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6154009840 tx=0x7f6154009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54091b2ef38c4562 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f615bfff700 1 -- 172.21.15.19:0/3602378046 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011830 con 0x7f616409eca0 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f615bfff700 1 -- 172.21.15.19:0/3602378046 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154011990 con 0x7f616409eca0 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f615bfff700 1 -- 172.21.15.19:0/3602378046 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154011d20 con 0x7f616409eca0 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f616b46e700 1 -- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 msgr2=0x7f616406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.540+0000 7f616b46e700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 0x7f616406ee80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6154009840 tx=0x7f6154009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 -- 172.21.15.19:0/3602378046 shutdown_connections 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f616406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 --2- 172.21.15.19:0/3602378046 >> v2:172.21.15.19:3300/0 conn(0x7f6164134610 0x7f6164134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 --2- 172.21.15.19:0/3602378046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f616409eca0 0x7f616406ee80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 -- 172.21.15.19:0/3602378046 >> 172.21.15.19:0/3602378046 conn(0x7f61640a2aa0 msgr2=0x7f61640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 -- 172.21.15.19:0/3602378046 shutdown_connections 2023-10-03T10:17:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.541+0000 7f616b46e700 1 -- 172.21.15.19:0/3602378046 wait complete. 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.542+0000 7f616b46e700 1 Processor -- start 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.542+0000 7f616b46e700 1 -- start start 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 0x7f6164139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6164127950 0x7f616413a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616413e4c0 con 0x7f6164127950 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61640a2050 con 0x7f616406e570 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616b46e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6164070610 con 0x7f6164134610 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616920a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616920a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60140/0 (socket says 172.21.15.19:60140) 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616920a700 1 -- 172.21.15.19:0/3629590316 learned_addr learned my addr 172.21.15.19:0/3629590316 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f6169a0b700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6164127950 0x7f616413a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f6168a09700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 0x7f6164139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.543+0000 7f616920a700 1 -- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 msgr2=0x7f6164139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616920a700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 0x7f6164139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616920a700 1 -- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6164127950 msgr2=0x7f616413a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616920a700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6164127950 0x7f616413a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616920a700 1 -- 172.21.15.19:0/3629590316 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6160009550 con 0x7f616406e570 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f6168a09700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 0x7f6164139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616920a700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f616000ec10 tx=0x7f616000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000c850 con 0x7f616406e570 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f616000c9b0 con 0x7f616406e570 2023-10-03T10:17:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616000cd20 con 0x7f616406e570 2023-10-03T10:17:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61540094a0 con 0x7f616406e570 2023-10-03T10:17:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.544+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616413c5a0 con 0x7f616406e570 2023-10-03T10:17:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.546+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6160013470 con 0x7f616406e570 2023-10-03T10:17:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.546+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616409d1f0 con 0x7f616406e570 2023-10-03T10:17:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.546+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f616003f860 con 0x7f616406e570 2023-10-03T10:17:16.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.551+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6160013720 con 0x7f616406e570 2023-10-03T10:17:16.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 Processor -- start 2023-10-03T10:17:16.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 -- start start 2023-10-03T10:17:16.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f231812f640 0x7f231812fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f231812ff50 0x7f2318095070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f231809b180 con 0x7f23180955b0 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f231809eb40 con 0x7f231812ff50 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.567+0000 7f231f0ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f231809c580 con 0x7f231812f640 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f231d657700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f23180955b0 0x7f2318136b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40118/0 (socket says 172.21.15.19:40118) 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f231d657700 1 -- 172.21.15.19:0/3576687448 learned_addr learned my addr 172.21.15.19:0/3576687448 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:16.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 --2- 172.21.15.19:0/3576687448 >> v2:172.21.15.19:3300/0 conn(0x7f231812ff50 0x7f2318095070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f231ce56700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f231812f640 0x7f231812fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 -- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f231812f640 msgr2=0x7f231812fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f231812f640 0x7f231812fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 -- 172.21.15.19:0/3576687448 >> v1:172.21.15.19:6789/0 conn(0x7f23180955b0 legacy=0x7f2318136b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 -- 172.21.15.19:0/3576687448 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231809aca0 con 0x7f231812ff50 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f2317fff700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318095070 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2304009840 tx=0x7f2304009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea94016d0b86f343 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.568+0000 7f23177fe700 1 -- 172.21.15.19:0/3576687448 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400f940 con 0x7f231812ff50 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f23177fe700 1 -- 172.21.15.19:0/3576687448 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230400faa0 con 0x7f231812ff50 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f23177fe700 1 -- 172.21.15.19:0/3576687448 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400fe30 con 0x7f231812ff50 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 -- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 msgr2=0x7f2318095070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318095070 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2304009840 tx=0x7f2304009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 -- 172.21.15.19:0/3576687448 shutdown_connections 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f231812f640 0x7f231812fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 --2- 172.21.15.19:0/3576687448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318095070 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 -- 172.21.15.19:0/3576687448 >> 172.21.15.19:0/3576687448 conn(0x7f23180a2360 msgr2=0x7f23180a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 -- 172.21.15.19:0/3576687448 shutdown_connections 2023-10-03T10:17:16.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.569+0000 7f231f0ba700 1 -- 172.21.15.19:0/3576687448 wait complete. 2023-10-03T10:17:16.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.570+0000 7f231f0ba700 1 Processor -- start 2023-10-03T10:17:16.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.570+0000 7f231f0ba700 1 -- start start 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 0x7f23180714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f231812f640 0x7f2318071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318072950 con 0x7f231812ff50 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180a1e70 con 0x7f231812f640 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231f0ba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f231812ccf0 con 0x7f23180955b0 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231d657700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231d657700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318071f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43108/0 (socket says 172.21.15.19:43108) 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231ce56700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 0x7f23180714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.571+0000 7f231d657700 1 -- 172.21.15.19:0/532004497 learned_addr learned my addr 172.21.15.19:0/532004497 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f2317fff700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f231812f640 0x7f2318071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:16.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 -- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f231812f640 msgr2=0x7f2318071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f231812f640 0x7f2318071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 -- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 msgr2=0x7f2318071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 -- 172.21.15.19:0/532004497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23040094a0 con 0x7f23180955b0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f231ce56700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 0x7f23180714f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e900 tx=0x7f230c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c013680 con 0x7f23180955b0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.572+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230c0137e0 con 0x7f23180955b0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.573+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231812c050 con 0x7f23180955b0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.573+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230c013b50 con 0x7f23180955b0 2023-10-03T10:17:16.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.573+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231812c290 con 0x7f23180955b0 2023-10-03T10:17:16.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.574+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2318074ea0 con 0x7f23180955b0 2023-10-03T10:17:16.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.574+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f230c013cb0 con 0x7f23180955b0 2023-10-03T10:17:16.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.574+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f230c03f930 con 0x7f23180955b0 2023-10-03T10:17:16.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.583+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f230c01b7c0 con 0x7f23180955b0 2023-10-03T10:17:16.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.649+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35c0074ea0 con 0x7f35c009e410 2023-10-03T10:17:16.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.649+0000 7f35a7fff700 1 -- 172.21.15.19:0/3169353937 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35b8012340 con 0x7f35c009e410 2023-10-03T10:17:16.650 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 msgr2=0x7f35c011ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f35b800efc0 tx=0x7f35b800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 shutdown_connections 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35c009e410 0x7f35c011ec30 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35c009d6f0 0x7f35c011e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 --2- 172.21.15.19:0/3169353937 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35c009e000 0x7f35c011e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 >> 172.21.15.19:0/3169353937 conn(0x7f35c0066f50 msgr2=0x7f35c006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 shutdown_connections 2023-10-03T10:17:16.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.652+0000 7f35c60d5700 1 -- 172.21.15.19:0/3169353937 wait complete. 2023-10-03T10:17:16.667 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:16.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.690+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52a012df20 con 0x7f52a0138dc0 2023-10-03T10:17:16.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.690+0000 7f52877fe700 1 -- 172.21.15.19:0/1392825307 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5298018020 con 0x7f52a0138dc0 2023-10-03T10:17:16.691 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 msgr2=0x7f52a009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5298009e30 tx=0x7f529800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 shutdown_connections 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f52a0138dc0 0x7f52a009cf00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f52a0133420 0x7f52a009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 --2- 172.21.15.19:0/1392825307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01337f0 0x7f52a009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.692+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 >> 172.21.15.19:0/1392825307 conn(0x7f52a00a4210 msgr2=0x7f52a00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.693+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 shutdown_connections 2023-10-03T10:17:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.693+0000 7f52a536d700 1 -- 172.21.15.19:0/1392825307 wait complete. 2023-10-03T10:17:16.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.768+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6164074ea0 con 0x7f616406e570 2023-10-03T10:17:16.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.768+0000 7f6159ffb700 1 -- 172.21.15.19:0/3629590316 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6160021020 con 0x7f616406e570 2023-10-03T10:17:16.769 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 msgr2=0x7f6164127410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f616000ec10 tx=0x7f616000ef20 comp rx=0 tx=0).stop 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 shutdown_connections 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6164127950 0x7f616413a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f616406e570 0x7f6164127410 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 --2- 172.21.15.19:0/3629590316 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6164134610 0x7f6164139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 >> 172.21.15.19:0/3629590316 conn(0x7f61640a2aa0 msgr2=0x7f6164137a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 shutdown_connections 2023-10-03T10:17:16.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.771+0000 7f616b46e700 1 -- 172.21.15.19:0/3629590316 wait complete. 2023-10-03T10:17:16.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.792+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f231808b060 con 0x7f23180955b0 2023-10-03T10:17:16.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.792+0000 7f23157fa700 1 -- 172.21.15.19:0/532004497 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f230c017030 con 0x7f23180955b0 2023-10-03T10:17:16.793 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.794+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 msgr2=0x7f23180714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.794+0000 7f231f0ba700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 0x7f23180714f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f230c00e900 tx=0x7f230c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 shutdown_connections 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f231812ff50 0x7f2318071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23180955b0 0x7f23180714f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 --2- 172.21.15.19:0/532004497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f231812f640 0x7f2318071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 >> 172.21.15.19:0/532004497 conn(0x7f23180a2360 msgr2=0x7f231812d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:16.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 shutdown_connections 2023-10-03T10:17:16.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:16.795+0000 7f231f0ba700 1 -- 172.21.15.19:0/532004497 wait complete. 2023-10-03T10:17:16.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:17.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:17.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:17.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:17.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.819+0000 7fcd2e73a700 1 Processor -- start 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.819+0000 7fcd2e73a700 1 -- start start 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 0x7fcd2806ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2809a390 con 0x7fcd2806fb20 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280716a0 con 0x7fcd28130e50 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2e73a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28071290 con 0x7fcd28130540 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd277fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60276/0 (socket says 172.21.15.19:60276) 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd277fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60160/0 (socket says 172.21.15.19:60160) 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 -- 172.21.15.19:0/3734618306 learned_addr learned my addr 172.21.15.19:0/3734618306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd2ccd7700 1 --2- 172.21.15.19:0/3734618306 >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 0x7fcd2806ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 -- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 msgr2=0x7fcd2806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 -- 172.21.15.19:0/3734618306 >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 msgr2=0x7fcd2806ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 --2- 172.21.15.19:0/3734618306 >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 0x7fcd2806ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd27fff700 1 -- 172.21.15.19:0/3734618306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28130340 con 0x7fcd28130540 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.821+0000 7fcd2ccd7700 1 --2- 172.21.15.19:0/3734618306 >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 0x7fcd2806ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.820+0000 7fcd277fe700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.821+0000 7fcd27fff700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009920 tx=0x7fcd18009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de96cfa483dca7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/3734618306 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800f8a0 con 0x7fcd28130540 2023-10-03T10:17:17.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/3734618306 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1800fa00 con 0x7fcd28130540 2023-10-03T10:17:17.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.821+0000 7fcd26ffd700 1 -- 172.21.15.19:0/3734618306 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1800fd90 con 0x7fcd28130540 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 -- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 msgr2=0x7fcd28130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009920 tx=0x7fcd18009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 -- 172.21.15.19:0/3734618306 shutdown_connections 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/3734618306 >> v2:172.21.15.19:3300/0 conn(0x7fcd2806fb20 0x7fcd2806ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd28130910 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/3734618306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2806f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 -- 172.21.15.19:0/3734618306 >> 172.21.15.19:0/3734618306 conn(0x7fcd280a2aa0 msgr2=0x7fcd280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 -- 172.21.15.19:0/3734618306 shutdown_connections 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.822+0000 7fcd2e73a700 1 -- 172.21.15.19:0/3734618306 wait complete. 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.823+0000 7fcd2e73a700 1 Processor -- start 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 -- start start 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd2811e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2811e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28121050 con 0x7fcd2806fb20 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd281216f0 con 0x7fcd28130e50 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.824+0000 7fcd2e73a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2811eec0 con 0x7fcd28130540 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43124/0 (socket says 172.21.15.19:43124) 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 -- 172.21.15.19:0/2391831266 learned_addr learned my addr 172.21.15.19:0/2391831266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd277fe700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd2811e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 -- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 msgr2=0x7fcd2811e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd2811e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 -- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 msgr2=0x7fcd2811e550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2811e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 -- 172.21.15.19:0/2391831266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd20009a70 con 0x7fcd2806fb20 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.825+0000 7fcd27fff700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.826+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180038a0 con 0x7fcd2806fb20 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.826+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18003a20 con 0x7fcd2806fb20 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.826+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c0094a0 con 0x7fcd2806fb20 2023-10-03T10:17:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.826+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18003dd0 con 0x7fcd2806fb20 2023-10-03T10:17:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.826+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd18009550 con 0x7fcd2806fb20 2023-10-03T10:17:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.827+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd28074ea0 con 0x7fcd2806fb20 2023-10-03T10:17:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.827+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd18019400 con 0x7fcd2806fb20 2023-10-03T10:17:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.828+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd18040af0 con 0x7fcd2806fb20 2023-10-03T10:17:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.833+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd18020750 con 0x7fcd2806fb20 2023-10-03T10:17:17.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.863+0000 7ff6a4a22700 1 Processor -- start 2023-10-03T10:17:17.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.863+0000 7ff6a4a22700 1 -- start start 2023-10-03T10:17:17.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.863+0000 7ff6a4a22700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff6a006f5d0 0x7ff6a012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.863+0000 7ff6a4a22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff6a4a22700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a006fa40 con 0x7ff6a012cf60 2023-10-03T10:17:17.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff6a4a22700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a012cd90 con 0x7ff6a006f5d0 2023-10-03T10:17:17.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff6a4a22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0071780 con 0x7ff6a0135c20 2023-10-03T10:17:17.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff69ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60176/0 (socket says 172.21.15.19:60176) 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff69ed9d700 1 -- 172.21.15.19:0/1276702961 learned_addr learned my addr 172.21.15.19:0/1276702961 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.864+0000 7ff69dd9b700 1 --2- 172.21.15.19:0/1276702961 >> v2:172.21.15.19:3300/0 conn(0x7ff6a006f5d0 0x7ff6a012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69ed9d700 1 -- 172.21.15.19:0/1276702961 >> v2:172.21.15.19:3300/0 conn(0x7ff6a006f5d0 msgr2=0x7ff6a012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69ed9d700 1 --2- 172.21.15.19:0/1276702961 >> v2:172.21.15.19:3300/0 conn(0x7ff6a006f5d0 0x7ff6a012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69ed9d700 1 -- 172.21.15.19:0/1276702961 >> v1:172.21.15.19:6789/0 conn(0x7ff6a012cf60 legacy=0x7ff6a012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69ed9d700 1 -- 172.21.15.19:0/1276702961 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0071a40 con 0x7ff6a0135c20 2023-10-03T10:17:17.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69ed9d700 1 --2- 172.21.15.19:0/1276702961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bf60 tx=0x7ff69800bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2626bdc0da4d0593 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69d59a700 1 -- 172.21.15.19:0/1276702961 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69800da00 con 0x7ff6a0135c20 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69d59a700 1 -- 172.21.15.19:0/1276702961 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69800db60 con 0x7ff6a0135c20 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.865+0000 7ff69d59a700 1 -- 172.21.15.19:0/1276702961 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980124d0 con 0x7ff6a0135c20 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 -- 172.21.15.19:0/1276702961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 msgr2=0x7ff6a0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/1276702961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bf60 tx=0x7ff69800bf90 comp rx=0 tx=0).stop 2023-10-03T10:17:17.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 -- 172.21.15.19:0/1276702961 shutdown_connections 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/1276702961 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a0135c20 0x7ff6a0138000 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/1276702961 >> v2:172.21.15.19:3300/0 conn(0x7ff6a006f5d0 0x7ff6a012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 -- 172.21.15.19:0/1276702961 >> 172.21.15.19:0/1276702961 conn(0x7ff6a00a2aa0 msgr2=0x7ff6a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 -- 172.21.15.19:0/1276702961 shutdown_connections 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.866+0000 7ff6a4a22700 1 -- 172.21.15.19:0/1276702961 wait complete. 2023-10-03T10:17:17.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 Processor -- start 2023-10-03T10:17:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 -- start start 2023-10-03T10:17:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 0x7ff6a009a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 0x7ff6a009a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6a0135c20 0x7ff6a01d5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a009c5a0 con 0x7ff6a006f5d0 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a0099df0 con 0x7ff6a012cf60 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.868+0000 7ff6a4a22700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a00a1620 con 0x7ff6a0135c20 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 0x7ff6a009a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 0x7ff6a009a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43134/0 (socket says 172.21.15.19:43134) 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69e59c700 1 -- 172.21.15.19:0/3993628341 learned_addr learned my addr 172.21.15.19:0/3993628341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 0x7ff6a009a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69ed9d700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6a0135c20 0x7ff6a01d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 -- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6a0135c20 msgr2=0x7ff6a01d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6a0135c20 0x7ff6a01d5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 -- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 msgr2=0x7ff6a009a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 0x7ff6a009a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 -- 172.21.15.19:0/3993628341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff69800bd40 con 0x7ff6a012cf60 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.869+0000 7ff69dd9b700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 0x7ff6a009a710 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff69400e930 tx=0x7ff69400ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.870+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694013680 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.870+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940137e0 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.870+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694013b50 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.870+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a009c7d0 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.870+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a009b810 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.871+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff694013cb0 con 0x7ff6a012cf60 2023-10-03T10:17:17.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.871+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a0074ea0 con 0x7ff6a012cf60 2023-10-03T10:17:17.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.871+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff69403f6a0 con 0x7ff6a012cf60 2023-10-03T10:17:17.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.876+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff69401bc30 con 0x7ff6a012cf60 2023-10-03T10:17:17.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.943+0000 7fd2db33f700 1 Processor -- start 2023-10-03T10:17:17.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.943+0000 7fd2db33f700 1 -- start start 2023-10-03T10:17:17.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2db33f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2db33f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d413b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2db33f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d406f720 con 0x7fd2d41341d0 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2db33f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4070c80 con 0x7fd2d41338c0 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2db33f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d406fce0 con 0x7fd2d409e560 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60184/0 (socket says 172.21.15.19:60184) 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 -- 172.21.15.19:0/4022394739 learned_addr learned my addr 172.21.15.19:0/4022394739 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d98dc700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d413b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 -- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 msgr2=0x7fd2d413b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d413b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 -- 172.21.15.19:0/4022394739 >> v1:172.21.15.19:6789/0 conn(0x7fd2d41341d0 legacy=0x7fd2d409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.944+0000 7fd2d90db700 1 -- 172.21.15.19:0/4022394739 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d41336a0 con 0x7fd2d41338c0 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.945+0000 7fd2d90db700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009920 tx=0x7fd2d0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=494cde1f85e6fae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.945+0000 7fd2cbfff700 1 -- 172.21.15.19:0/4022394739 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0004230 con 0x7fd2d41338c0 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.945+0000 7fd2cbfff700 1 -- 172.21.15.19:0/4022394739 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0004390 con 0x7fd2d41338c0 2023-10-03T10:17:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.945+0000 7fd2cbfff700 1 -- 172.21.15.19:0/4022394739 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00036a0 con 0x7fd2d41338c0 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 -- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 msgr2=0x7fd2d4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0009920 tx=0x7fd2d0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 -- 172.21.15.19:0/4022394739 shutdown_connections 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d413b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 --2- 172.21.15.19:0/4022394739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41338c0 0x7fd2d4133c90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 -- 172.21.15.19:0/4022394739 >> 172.21.15.19:0/4022394739 conn(0x7fd2d40a2aa0 msgr2=0x7fd2d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 -- 172.21.15.19:0/4022394739 shutdown_connections 2023-10-03T10:17:17.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.946+0000 7fd2db33f700 1 -- 172.21.15.19:0/4022394739 wait complete. 2023-10-03T10:17:17.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.947+0000 7fd2db33f700 1 Processor -- start 2023-10-03T10:17:17.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.947+0000 7fd2db33f700 1 -- start start 2023-10-03T10:17:17.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d41338c0 0x7fd2d411fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41341d0 0x7fd2d41203d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4123190 con 0x7fd2d41338c0 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4122470 con 0x7fd2d41341d0 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2db33f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d4132140 con 0x7fd2d409e560 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60322/0 (socket says 172.21.15.19:60322) 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 -- 172.21.15.19:0/1041672590 learned_addr learned my addr 172.21.15.19:0/1041672590 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d98dc700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41341d0 0x7fd2d41203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d88da700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d41338c0 0x7fd2d411fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 -- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41341d0 msgr2=0x7fd2d41203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41341d0 0x7fd2d41203d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 -- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d41338c0 msgr2=0x7fd2d411fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d41338c0 0x7fd2d411fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.948+0000 7fd2d90db700 1 -- 172.21.15.19:0/1041672590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009550 con 0x7fd2d409e560 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2d90db700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000c00 tx=0x7fd2d0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0003c70 con 0x7fd2d409e560 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d0003df0 con 0x7fd2d409e560 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0011870 con 0x7fd2d409e560 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d406f960 con 0x7fd2d409e560 2023-10-03T10:17:17.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.949+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d4123470 con 0x7fd2d409e560 2023-10-03T10:17:17.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.950+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd2d0021070 con 0x7fd2d409e560 2023-10-03T10:17:17.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.950+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd2d0040ce0 con 0x7fd2d409e560 2023-10-03T10:17:17.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.951+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d4074ea0 con 0x7fd2d409e560 2023-10-03T10:17:17.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.960+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2d002d990 con 0x7fd2d409e560 2023-10-03T10:17:17.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 Processor -- start 2023-10-03T10:17:17.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 -- start start 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f929009fa10 0x7f929009f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f92901316a0 0x7f9290131b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929009b610 con 0x7f92901316a0 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929009f630 con 0x7f929009e7e0 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.969+0000 7f92951d4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f929009bbb0 con 0x7f929009fa10 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60194/0 (socket says 172.21.15.19:60194) 2023-10-03T10:17:17.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 -- 172.21.15.19:0/1272476408 learned_addr learned my addr 172.21.15.19:0/1272476408 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928e59c700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f929009fa10 0x7f929009f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928f59e700 1 --2- 172.21.15.19:0/1272476408 >> v2:172.21.15.19:3300/0 conn(0x7f92901316a0 0x7f9290131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 -- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f929009fa10 msgr2=0x7f929009f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f929009fa10 0x7f929009f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 -- 172.21.15.19:0/1272476408 >> v2:172.21.15.19:3300/0 conn(0x7f92901316a0 msgr2=0x7f9290131b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 --2- 172.21.15.19:0/1272476408 >> v2:172.21.15.19:3300/0 conn(0x7f92901316a0 0x7f9290131b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 -- 172.21.15.19:0/1272476408 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92900a0010 con 0x7f929009e7e0 2023-10-03T10:17:17.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928ed9d700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92800098f0 tx=0x7f9280009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ed7a92be5f5f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.970+0000 7f928dd9b700 1 -- 172.21.15.19:0/1272476408 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011830 con 0x7f929009e7e0 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f928dd9b700 1 -- 172.21.15.19:0/1272476408 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9280011990 con 0x7f929009e7e0 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f928dd9b700 1 -- 172.21.15.19:0/1272476408 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9280011d20 con 0x7f929009e7e0 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 -- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 msgr2=0x7f929009ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f92800098f0 tx=0x7f9280009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:17.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 -- 172.21.15.19:0/1272476408 shutdown_connections 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929009ebb0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 --2- 172.21.15.19:0/1272476408 >> v2:172.21.15.19:3300/0 conn(0x7f92901316a0 0x7f9290131b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 --2- 172.21.15.19:0/1272476408 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f929009fa10 0x7f929009f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 -- 172.21.15.19:0/1272476408 >> 172.21.15.19:0/1272476408 conn(0x7f92900a4300 msgr2=0x7f92900a4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 -- 172.21.15.19:0/1272476408 shutdown_connections 2023-10-03T10:17:17.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.971+0000 7f92951d4700 1 -- 172.21.15.19:0/1272476408 wait complete. 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 Processor -- start 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 -- start start 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929011bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92901316a0 0x7f929011c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901201e0 con 0x7f929009fa10 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92900a0330 con 0x7f929009e7e0 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.973+0000 7f92951d4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f929011d9d0 con 0x7f92901316a0 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43158/0 (socket says 172.21.15.19:43158) 2023-10-03T10:17:17.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 -- 172.21.15.19:0/3594767475 learned_addr learned my addr 172.21.15.19:0/3594767475 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928ed9d700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929011bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928f59e700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92901316a0 0x7f929011c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 -- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92901316a0 msgr2=0x7f929011c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92901316a0 0x7f929011c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 -- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 msgr2=0x7f929011bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929011bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 -- 172.21.15.19:0/3594767475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280009550 con 0x7f929009fa10 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928ed9d700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929011bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f928e59c700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f928400e980 tx=0x7f928400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284009710 con 0x7f929009fa10 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928400c690 con 0x7f929009fa10 2023-10-03T10:17:17.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.974+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929011f560 con 0x7f929009fa10 2023-10-03T10:17:17.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.975+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928400ca20 con 0x7f929009fa10 2023-10-03T10:17:17.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.975+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929011eb80 con 0x7f929009fa10 2023-10-03T10:17:17.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.976+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f928400cb80 con 0x7f929009fa10 2023-10-03T10:17:17.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.976+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9290070f50 con 0x7f929009fa10 2023-10-03T10:17:17.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.976+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f928403f700 con 0x7f929009fa10 2023-10-03T10:17:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:17.985+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92840232f0 con 0x7f929009fa10 2023-10-03T10:17:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.072+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcd281214a0 con 0x7fcd2806fb20 2023-10-03T10:17:18.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.072+0000 7fcd24ff9700 1 -- 172.21.15.19:0/2391831266 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd18040e60 con 0x7fcd2806fb20 2023-10-03T10:17:18.073 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:18.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 msgr2=0x7fcd2811dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fcd18000c00 tx=0x7fcd18004750 comp rx=0 tx=0).stop 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 shutdown_connections 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd28130e50 0x7fcd2811e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd2806fb20 0x7fcd2811dad0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 --2- 172.21.15.19:0/2391831266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd28130540 0x7fcd2811e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.074+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 >> 172.21.15.19:0/2391831266 conn(0x7fcd280a2aa0 msgr2=0x7fcd2812bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.075+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 shutdown_connections 2023-10-03T10:17:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.075+0000 7fcd2e73a700 1 -- 172.21.15.19:0/2391831266 wait complete. 2023-10-03T10:17:18.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:18.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.142+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff6a0135a00 con 0x7ff6a012cf60 2023-10-03T10:17:18.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.142+0000 7ff68effd700 1 -- 172.21.15.19:0/3993628341 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff694017070 con 0x7ff6a012cf60 2023-10-03T10:17:18.143 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 msgr2=0x7ff6a009a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 0x7ff6a009a710 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff69400e930 tx=0x7ff69400ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 shutdown_connections 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6a0135c20 0x7ff6a01d5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff6a006f5d0 0x7ff6a009a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 --2- 172.21.15.19:0/3993628341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff6a012cf60 0x7ff6a009a710 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 >> 172.21.15.19:0/3993628341 conn(0x7ff6a00a2aa0 msgr2=0x7ff6a012a640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.144+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 shutdown_connections 2023-10-03T10:17:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.145+0000 7ff6a4a22700 1 -- 172.21.15.19:0/3993628341 wait complete. 2023-10-03T10:17:18.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.191+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f929004f2a0 con 0x7f929009fa10 2023-10-03T10:17:18.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.192+0000 7f92777fe700 1 -- 172.21.15.19:0/3594767475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9284021070 con 0x7f929009fa10 2023-10-03T10:17:18.193 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 msgr2=0x7f929011c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f928400e980 tx=0x7f928400ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 shutdown_connections 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92901316a0 0x7f929011c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f929009e7e0 0x7f929011bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 --2- 172.21.15.19:0/3594767475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f929009fa10 0x7f929011c260 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 >> 172.21.15.19:0/3594767475 conn(0x7f92900a4300 msgr2=0x7f9290130cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 shutdown_connections 2023-10-03T10:17:18.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.194+0000 7f92951d4700 1 -- 172.21.15.19:0/3594767475 wait complete. 2023-10-03T10:17:18.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.198+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd2d406b9e0 con 0x7fd2d409e560 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.198+0000 7fd2c9ffb700 1 -- 172.21.15.19:0/1041672590 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd2d002d3a0 con 0x7fd2d409e560 2023-10-03T10:17:18.199 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.200+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 msgr2=0x7fd2d411f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.200+0000 7fd2db33f700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0000c00 tx=0x7fd2d0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.201+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 shutdown_connections 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.201+0000 7fd2db33f700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd2d41341d0 0x7fd2d41203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.201+0000 7fd2db33f700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd2d409e560 0x7fd2d411f950 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.201+0000 7fd2db33f700 1 --2- 172.21.15.19:0/1041672590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd2d41338c0 0x7fd2d411fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.201+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 >> 172.21.15.19:0/1041672590 conn(0x7fd2d40a2aa0 msgr2=0x7fd2d40a0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.202+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 shutdown_connections 2023-10-03T10:17:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:18.202+0000 7fd2db33f700 1 -- 172.21.15.19:0/1041672590 wait complete. 2023-10-03T10:17:18.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:18.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:19.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:19.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:19.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:19.217 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.238+0000 7ff52d20c700 1 Processor -- start 2023-10-03T10:17:19.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 -- start start 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 0x7ff52809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52809f520 con 0x7ff52809d6f0 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52809f130 con 0x7ff52809e410 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52d20c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff52809e930 con 0x7ff52809e000 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60340/0 (socket says 172.21.15.19:60340) 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff52659c700 1 -- 172.21.15.19:0/814101084 learned_addr learned my addr 172.21.15.19:0/814101084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.239+0000 7ff526d9d700 1 --2- 172.21.15.19:0/814101084 >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 0x7ff52809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 -- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 msgr2=0x7ff528130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 --2- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 -- 172.21.15.19:0/814101084 >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 msgr2=0x7ff52809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 --2- 172.21.15.19:0/814101084 >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 0x7ff52809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 -- 172.21.15.19:0/814101084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52809b2d0 con 0x7ff52809e000 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff526d9d700 1 --2- 172.21.15.19:0/814101084 >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 0x7ff52809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff52659c700 1 --2- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009920 tx=0x7ff51c009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0912bda736a9107 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff525d9b700 1 -- 172.21.15.19:0/814101084 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011830 con 0x7ff52809e000 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff525d9b700 1 -- 172.21.15.19:0/814101084 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c011990 con 0x7ff52809e000 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.240+0000 7ff525d9b700 1 -- 172.21.15.19:0/814101084 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011d20 con 0x7ff52809e000 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.241+0000 7ff52d20c700 1 -- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 msgr2=0x7ff528130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.241+0000 7ff52d20c700 1 --2- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009920 tx=0x7ff51c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 -- 172.21.15.19:0/814101084 shutdown_connections 2023-10-03T10:17:19.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 --2- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 --2- 172.21.15.19:0/814101084 >> v2:172.21.15.19:3300/0 conn(0x7ff52809d6f0 0x7ff52809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 --2- 172.21.15.19:0/814101084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809e000 0x7ff528130660 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 -- 172.21.15.19:0/814101084 >> 172.21.15.19:0/814101084 conn(0x7ff528066f50 msgr2=0x7ff52809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 -- 172.21.15.19:0/814101084 shutdown_connections 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.242+0000 7ff52d20c700 1 -- 172.21.15.19:0/814101084 wait complete. 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.243+0000 7ff52d20c700 1 Processor -- start 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.243+0000 7ff52d20c700 1 -- start start 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 0x7ff528133230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52809e000 0x7ff528133770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5280a3890 con 0x7ff52809e000 2023-10-03T10:17:19.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff528135710 con 0x7ff52809e410 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52d20c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff528136d50 con 0x7ff52809d6f0 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60236/0 (socket says 172.21.15.19:60236) 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 -- 172.21.15.19:0/781544829 learned_addr learned my addr 172.21.15.19:0/781544829 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff526d9d700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 0x7ff528133230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 -- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 msgr2=0x7ff528133230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 0x7ff528133230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 -- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52809e000 msgr2=0x7ff528133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52809e000 0x7ff528133770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff52759e700 1 -- 172.21.15.19:0/781544829 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180094a0 con 0x7ff52809e410 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.244+0000 7ff526d9d700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 0x7ff528133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:19.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff52759e700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff520009dd0 tx=0x7ff52000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000cd40 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000f040 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c009550 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52812d240 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.245+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200146c0 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.246+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff520014820 con 0x7ff52809e410 2023-10-03T10:17:19.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.246+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5080052e0 con 0x7ff52809e410 2023-10-03T10:17:19.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.246+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff52003ffd0 con 0x7ff52809e410 2023-10-03T10:17:19.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.252+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff520071750 con 0x7ff52809e410 2023-10-03T10:17:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.310+0000 7fd1032e7700 1 Processor -- start 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.310+0000 7fd1032e7700 1 -- start start 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd1032e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 0x7fd0fc06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd1032e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc06ee80 0x7fd0fc134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd1032e7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc070ee0 con 0x7fd0fc09eca0 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd1032e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc071480 con 0x7fd0fc06e570 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd1032e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc071b90 con 0x7fd0fc06ee80 2023-10-03T10:17:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd100882700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd0fc09eca0 0x7fd0fc134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40142/0 (socket says 172.21.15.19:40142) 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd100882700 1 -- 172.21.15.19:0/3215654543 learned_addr learned my addr 172.21.15.19:0/3215654543 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101083700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 0x7fd0fc06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101884700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc06ee80 0x7fd0fc134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101083700 1 -- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc06ee80 msgr2=0x7fd0fc134d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101083700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc06ee80 0x7fd0fc134d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd0f3fff700 1 -- 172.21.15.19:0/3215654543 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 690828253 0 0) 0x7fd0fc070ee0 con 0x7fd0fc09eca0 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101083700 1 -- 172.21.15.19:0/3215654543 >> v1:172.21.15.19:6789/0 conn(0x7fd0fc09eca0 legacy=0x7fd0fc134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.311+0000 7fd101083700 1 -- 172.21.15.19:0/3215654543 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0711a0 con 0x7fd0fc06e570 2023-10-03T10:17:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.312+0000 7fd101083700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 0x7fd0fc06e940 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009870 tx=0x7fd0f8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c329085969254d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.312+0000 7fd0f3fff700 1 -- 172.21.15.19:0/3215654543 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8011830 con 0x7fd0fc06e570 2023-10-03T10:17:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.312+0000 7fd0f3fff700 1 -- 172.21.15.19:0/3215654543 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f8011990 con 0x7fd0fc06e570 2023-10-03T10:17:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.312+0000 7fd0f3fff700 1 -- 172.21.15.19:0/3215654543 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8011d20 con 0x7fd0fc06e570 2023-10-03T10:17:19.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 -- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 msgr2=0x7fd0fc06e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 0x7fd0fc06e940 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0f8009870 tx=0x7fd0f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:19.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 -- 172.21.15.19:0/3215654543 shutdown_connections 2023-10-03T10:17:19.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc06ee80 0x7fd0fc134d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 --2- 172.21.15.19:0/3215654543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06e570 0x7fd0fc06e940 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 -- 172.21.15.19:0/3215654543 >> 172.21.15.19:0/3215654543 conn(0x7fd0fc0a2aa0 msgr2=0x7fd0fc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 -- 172.21.15.19:0/3215654543 shutdown_connections 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.313+0000 7fd1032e7700 1 -- 172.21.15.19:0/3215654543 wait complete. 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 Processor -- start 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 -- start start 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc06e570 0x7fd0fc134980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc1338e0 0x7fd0fc133d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc139fb0 con 0x7fd0fc06e570 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc09e820 con 0x7fd0fc06ee80 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.314+0000 7fd1032e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc13b040 con 0x7fd0fc1338e0 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60246/0 (socket says 172.21.15.19:60246) 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 -- 172.21.15.19:0/461564180 learned_addr learned my addr 172.21.15.19:0/461564180 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd101884700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc1338e0 0x7fd0fc133d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd101083700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc06e570 0x7fd0fc134980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 -- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc1338e0 msgr2=0x7fd0fc133d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc1338e0 0x7fd0fc133d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 -- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc06e570 msgr2=0x7fd0fc134980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc06e570 0x7fd0fc134980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 -- 172.21.15.19:0/461564180 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80094a0 con 0x7fd0fc06ee80 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.315+0000 7fd100882700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c550 tx=0x7fd0ec00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.316+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec004c80 con 0x7fd0fc06ee80 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.316+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec004e20 con 0x7fd0fc06ee80 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.316+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec007310 con 0x7fd0fc06ee80 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.316+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc13b300 con 0x7fd0fc06ee80 2023-10-03T10:17:19.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.316+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc09e0e0 con 0x7fd0fc06ee80 2023-10-03T10:17:19.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.317+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0ec007470 con 0x7fd0fc06ee80 2023-10-03T10:17:19.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.317+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc074ea0 con 0x7fd0fc06ee80 2023-10-03T10:17:19.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.317+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0ec040bf0 con 0x7fd0fc06ee80 2023-10-03T10:17:19.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.322+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0ec044060 con 0x7fd0fc06ee80 2023-10-03T10:17:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.366+0000 7f109acfd700 1 Processor -- start 2023-10-03T10:17:19.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.366+0000 7f109acfd700 1 -- start start 2023-10-03T10:17:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.366+0000 7f109acfd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f109409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.366+0000 7f109acfd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 0x7f1094134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.366+0000 7f109acfd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109409b120 con 0x7f109409e000 2023-10-03T10:17:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109acfd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109406b460 con 0x7f109409d6f0 2023-10-03T10:17:19.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109acfd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f109409a7e0 con 0x7f109409e410 2023-10-03T10:17:19.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 0x7f1094134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f1093fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f109409e000 0x7f10941339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40144/0 (socket says 172.21.15.19:40144) 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f1093fff700 1 -- 172.21.15.19:0/4255743094 learned_addr learned my addr 172.21.15.19:0/4255743094 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f1098a99700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f109409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 -- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 msgr2=0x7f109409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f109409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 -- 172.21.15.19:0/4255743094 >> v1:172.21.15.19:6789/0 conn(0x7f109409e000 legacy=0x7f10941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f10937fe700 1 -- 172.21.15.19:0/4255743094 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202776091 0 0) 0x7f109409b120 con 0x7f109409e000 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 -- 172.21.15.19:0/4255743094 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109409a500 con 0x7f109409e410 2023-10-03T10:17:19.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f1098a99700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f109409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.367+0000 7f109929a700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 0x7f1094134100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f108c009df0 tx=0x7f108c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64e7fe81e31dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.368+0000 7f10937fe700 1 -- 172.21.15.19:0/4255743094 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00e070 con 0x7f109409e410 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.368+0000 7f10937fe700 1 -- 172.21.15.19:0/4255743094 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108c00bae0 con 0x7f109409e410 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.368+0000 7f10937fe700 1 -- 172.21.15.19:0/4255743094 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108c00be90 con 0x7f109409e410 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.368+0000 7f109acfd700 1 -- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 msgr2=0x7f1094134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.368+0000 7f109acfd700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 0x7f1094134100 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f108c009df0 tx=0x7f108c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 -- 172.21.15.19:0/4255743094 shutdown_connections 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e410 0x7f1094134100 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 --2- 172.21.15.19:0/4255743094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f109409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 -- 172.21.15.19:0/4255743094 >> 172.21.15.19:0/4255743094 conn(0x7f1094066f50 msgr2=0x7f109409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 -- 172.21.15.19:0/4255743094 shutdown_connections 2023-10-03T10:17:19.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.369+0000 7f109acfd700 1 -- 172.21.15.19:0/4255743094 wait complete. 2023-10-03T10:17:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 Processor -- start 2023-10-03T10:17:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 -- start start 2023-10-03T10:17:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f1094122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 0x7f1094122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 0x7f1094122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10941237f0 con 0x7f109409e410 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1094124e00 con 0x7f109409d6f0 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.370+0000 7f109acfd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1094125e40 con 0x7f109409e000 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f109929a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 0x7f1094122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f109929a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 0x7f1094122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43176/0 (socket says 172.21.15.19:43176) 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f109929a700 1 -- 172.21.15.19:0/2866437623 learned_addr learned my addr 172.21.15.19:0/2866437623 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1098a99700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f1094122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 0x7f1094122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 -- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 msgr2=0x7f1094122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f1094122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 -- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 msgr2=0x7f1094122da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 0x7f1094122da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 -- 172.21.15.19:0/2866437623 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10880094a0 con 0x7f109409e000 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1098a99700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f1094122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.371+0000 7f1093fff700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 0x7f1094122860 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f109406e510 tx=0x7f108000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.372+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080004c80 con 0x7f109409e000 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.372+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080004de0 con 0x7f109409e000 2023-10-03T10:17:19.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.372+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080007310 con 0x7f109409e000 2023-10-03T10:17:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.372+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c009a70 con 0x7f109409e000 2023-10-03T10:17:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.372+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10940a2020 con 0x7f109409e000 2023-10-03T10:17:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.373+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1080007470 con 0x7f109409e000 2023-10-03T10:17:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.373+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f108003f300 con 0x7f109409e000 2023-10-03T10:17:19.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.373+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f109411f030 con 0x7f109409e000 2023-10-03T10:17:19.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.378+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1080007720 con 0x7f109409e000 2023-10-03T10:17:19.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.386+0000 7f0a559b3700 1 Processor -- start 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.386+0000 7f0a559b3700 1 -- start start 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a5006e570 0x7f0a5006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a5009eca0 0x7f0a5006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a50070ee0 con 0x7f0a5009eca0 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50071480 con 0x7f0a50134610 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a559b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5006f3c0 con 0x7f0a5006e570 2023-10-03T10:17:19.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60282/0 (socket says 172.21.15.19:60282) 2023-10-03T10:17:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/1702628447 learned_addr learned my addr 172.21.15.19:0/1702628447 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4effd700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a5006e570 0x7f0a5006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4e7fc700 1 --2- 172.21.15.19:0/1702628447 >> v2:172.21.15.19:3300/0 conn(0x7f0a5009eca0 0x7f0a5006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a5006e570 msgr2=0x7f0a5006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a5006e570 0x7f0a5006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/1702628447 >> v2:172.21.15.19:3300/0 conn(0x7f0a5009eca0 msgr2=0x7f0a5006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/1702628447 >> v2:172.21.15.19:3300/0 conn(0x7f0a5009eca0 0x7f0a5006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.387+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/1702628447 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50071b90 con 0x7f0a50134610 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.388+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=393933d0d010bf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.388+0000 7f0a4dffb700 1 -- 172.21.15.19:0/1702628447 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800e070 con 0x7f0a50134610 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.388+0000 7f0a4dffb700 1 -- 172.21.15.19:0/1702628447 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4800b910 con 0x7f0a50134610 2023-10-03T10:17:19.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.388+0000 7f0a4dffb700 1 -- 172.21.15.19:0/1702628447 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800bcc0 con 0x7f0a50134610 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 -- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 msgr2=0x7f0a50134a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009e50 tx=0x7f0a4800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 -- 172.21.15.19:0/1702628447 shutdown_connections 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a50134610 0x7f0a50134a40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 --2- 172.21.15.19:0/1702628447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a5006e570 0x7f0a5006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 --2- 172.21.15.19:0/1702628447 >> v2:172.21.15.19:3300/0 conn(0x7f0a5009eca0 0x7f0a5006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 -- 172.21.15.19:0/1702628447 >> 172.21.15.19:0/1702628447 conn(0x7f0a500a2aa0 msgr2=0x7f0a500a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 -- 172.21.15.19:0/1702628447 shutdown_connections 2023-10-03T10:17:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.389+0000 7f0a559b3700 1 -- 172.21.15.19:0/1702628447 wait complete. 2023-10-03T10:17:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 Processor -- start 2023-10-03T10:17:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 -- start start 2023-10-03T10:17:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a5006e570 0x7f0a50127100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50134610 0x7f0a50127640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5013c750 con 0x7f0a50134610 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50070610 con 0x7f0a5006e570 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.390+0000 7f0a559b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5013e650 con 0x7f0a501d4c40 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60392/0 (socket says 172.21.15.19:60392) 2023-10-03T10:17:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/3640821324 learned_addr learned my addr 172.21.15.19:0/3640821324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4e7fc700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50134610 0x7f0a50127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4effd700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a5006e570 0x7f0a50127100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a5006e570 msgr2=0x7f0a50127100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a5006e570 0x7f0a50127100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50134610 msgr2=0x7f0a50127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50134610 0x7f0a50127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 -- 172.21.15.19:0/3640821324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48009b30 con 0x7f0a501d4c40 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.391+0000 7f0a4f7fe700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800b680 tx=0x7f0a48004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.392+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48004450 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.392+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480045f0 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.392+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5013d3c0 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.392+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800ce80 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.392+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a50127b80 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.393+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5013d9b0 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.393+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a4801c410 con 0x7f0a501d4c40 2023-10-03T10:17:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.393+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a480413f0 con 0x7f0a501d4c40 2023-10-03T10:17:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.402+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a4801a7d0 con 0x7f0a501d4c40 2023-10-03T10:17:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.482+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff508005590 con 0x7ff52809e410 2023-10-03T10:17:19.483 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.482+0000 7ff50f7fe700 1 -- 172.21.15.19:0/781544829 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff520018020 con 0x7ff52809e410 2023-10-03T10:17:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 msgr2=0x7ff528133cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff520009dd0 tx=0x7ff52000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 shutdown_connections 2023-10-03T10:17:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff52809e410 0x7ff528133cb0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff52809d6f0 0x7ff528133230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 --2- 172.21.15.19:0/781544829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff52809e000 0x7ff528133770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.486+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 >> 172.21.15.19:0/781544829 conn(0x7ff528066f50 msgr2=0x7ff528070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.487+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 shutdown_connections 2023-10-03T10:17:19.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.487+0000 7ff52d20c700 1 -- 172.21.15.19:0/781544829 wait complete. 2023-10-03T10:17:19.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:19.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.536+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd0fc06b9e0 con 0x7fd0fc06ee80 2023-10-03T10:17:19.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.536+0000 7fd0f1ffb700 1 -- 172.21.15.19:0/461564180 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0ec044070 con 0x7fd0fc06ee80 2023-10-03T10:17:19.537 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 msgr2=0x7fd0fc1333a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c550 tx=0x7fd0ec00c860 comp rx=0 tx=0).stop 2023-10-03T10:17:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 shutdown_connections 2023-10-03T10:17:19.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0fc1338e0 0x7fd0fc133d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0fc06e570 0x7fd0fc134980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 --2- 172.21.15.19:0/461564180 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0fc06ee80 0x7fd0fc1333a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 >> 172.21.15.19:0/461564180 conn(0x7fd0fc0a2aa0 msgr2=0x7fd0fc0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 shutdown_connections 2023-10-03T10:17:19.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.538+0000 7fd1032e7700 1 -- 172.21.15.19:0/461564180 wait complete. 2023-10-03T10:17:19.553 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.588+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1094074ea0 con 0x7f109409e000 2023-10-03T10:17:19.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.589+0000 7f10917fa700 1 -- 172.21.15.19:0/2866437623 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f108001b7b0 con 0x7f109409e000 2023-10-03T10:17:19.590 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 msgr2=0x7f1094122860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 0x7f1094122860 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f109406e510 tx=0x7f108000c750 comp rx=0 tx=0).stop 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 shutdown_connections 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f109409e410 0x7f1094122da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f109409d6f0 0x7f1094122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 --2- 172.21.15.19:0/2866437623 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f109409e000 0x7f1094122860 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 >> 172.21.15.19:0/2866437623 conn(0x7f1094066f50 msgr2=0x7f1094133de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 shutdown_connections 2023-10-03T10:17:19.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.591+0000 7f109acfd700 1 -- 172.21.15.19:0/2866437623 wait complete. 2023-10-03T10:17:19.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:19.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.615+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a50074ea0 con 0x7f0a501d4c40 2023-10-03T10:17:19.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.615+0000 7f0a37fff700 1 -- 172.21.15.19:0/3640821324 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a48011390 con 0x7f0a501d4c40 2023-10-03T10:17:19.616 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 msgr2=0x7f0a501d50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0a4800b680 tx=0x7f0a48004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 shutdown_connections 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a501d4c40 0x7f0a501d50c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a5006e570 0x7f0a50127100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 --2- 172.21.15.19:0/3640821324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a50134610 0x7f0a50127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 >> 172.21.15.19:0/3640821324 conn(0x7f0a500a2aa0 msgr2=0x7f0a50137a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 shutdown_connections 2023-10-03T10:17:19.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:19.618+0000 7f0a559b3700 1 -- 172.21.15.19:0/3640821324 wait complete. 2023-10-03T10:17:19.632 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:20.503 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:20.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:20.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:20.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.653+0000 7f4c3bcd2700 1 Processor -- start 2023-10-03T10:17:20.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 -- start start 2023-10-03T10:17:20.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c3409d6f0 0x7f4c3409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c34134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c3409b120 con 0x7f4c3409e000 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3406b460 con 0x7f4c3409d6f0 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.654+0000 7f4c3bcd2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3409a7e0 con 0x7f4c3409e440 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c3409d6f0 0x7f4c3409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4c3409d6f0 0x7f4c3409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43218/0 (socket says 172.21.15.19:43218) 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 -- 172.21.15.19:0/4164831148 learned_addr learned my addr 172.21.15.19:0/4164831148 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c3a26f700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c34134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 -- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 msgr2=0x7f4c34134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c34134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 -- 172.21.15.19:0/4164831148 >> v1:172.21.15.19:6789/0 conn(0x7f4c3409e000 legacy=0x7f4c341339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 -- 172.21.15.19:0/4164831148 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3409a500 con 0x7f4c3409d6f0 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.655+0000 7f4c39a6e700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c3409dac0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009920 tx=0x7f4c30009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13176c008145d0a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.656+0000 7f4c38a6c700 1 -- 172.21.15.19:0/4164831148 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30011830 con 0x7f4c3409d6f0 2023-10-03T10:17:20.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.656+0000 7f4c38a6c700 1 -- 172.21.15.19:0/4164831148 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c30011990 con 0x7f4c3409d6f0 2023-10-03T10:17:20.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.656+0000 7f4c38a6c700 1 -- 172.21.15.19:0/4164831148 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30011d20 con 0x7f4c3409d6f0 2023-10-03T10:17:20.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 msgr2=0x7f4c3409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c3409dac0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f4c30009920 tx=0x7f4c30009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/4164831148 shutdown_connections 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c34134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/4164831148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c3409dac0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/4164831148 >> 172.21.15.19:0/4164831148 conn(0x7f4c34066f50 msgr2=0x7f4c3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/4164831148 shutdown_connections 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.657+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/4164831148 wait complete. 2023-10-03T10:17:20.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.658+0000 7f4c3bcd2700 1 Processor -- start 2023-10-03T10:17:20.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 -- start start 2023-10-03T10:17:20.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c341cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c3409e000 0x7f4c341cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3411cdd0 con 0x7f4c3409d6f0 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341ae6b0 con 0x7f4c3409e440 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.659+0000 7f4c3bcd2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3411b350 con 0x7f4c3409e000 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60326/0 (socket says 172.21.15.19:60326) 2023-10-03T10:17:20.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 -- 172.21.15.19:0/2540930275 learned_addr learned my addr 172.21.15.19:0/2540930275 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c39a6e700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c341cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 -- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c3409e000 msgr2=0x7f4c341cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c3409e000 0x7f4c341cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 -- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 msgr2=0x7f4c341cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c341cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 -- 172.21.15.19:0/2540930275 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009550 con 0x7f4c3409e440 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c39a6e700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c341cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.660+0000 7f4c3a26f700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009dd0 tx=0x7f4c2c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.661+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00cce0 con 0x7f4c3409e440 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.661+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00f040 con 0x7f4c3409e440 2023-10-03T10:17:20.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.661+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3411d030 con 0x7f4c3409e440 2023-10-03T10:17:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.661+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3411ca30 con 0x7f4c3409e440 2023-10-03T10:17:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.661+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c014480 con 0x7f4c3409e440 2023-10-03T10:17:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.662+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c2c0145e0 con 0x7f4c3409e440 2023-10-03T10:17:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.662+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c2c0400e0 con 0x7f4c3409e440 2023-10-03T10:17:20.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.662+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c0052e0 con 0x7f4c3409e440 2023-10-03T10:17:20.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.668+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c2c018070 con 0x7f4c3409e440 2023-10-03T10:17:20.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 Processor -- start 2023-10-03T10:17:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 -- start start 2023-10-03T10:17:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5cac135c20 0x7f5cac138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac06fa40 con 0x7f5cac12cf60 2023-10-03T10:17:20.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac12cd90 con 0x7f5cac135c20 2023-10-03T10:17:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5cb1cf4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac071780 con 0x7f5cac06f5d0 2023-10-03T10:17:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.700+0000 7f5caaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60412/0 (socket says 172.21.15.19:60412) 2023-10-03T10:17:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 -- 172.21.15.19:0/2821737347 learned_addr learned my addr 172.21.15.19:0/2821737347 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5cabfff700 1 --2- 172.21.15.19:0/2821737347 >> v2:172.21.15.19:3300/0 conn(0x7f5cac135c20 0x7f5cac138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 -- 172.21.15.19:0/2821737347 >> v2:172.21.15.19:3300/0 conn(0x7f5cac135c20 msgr2=0x7f5cac138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 --2- 172.21.15.19:0/2821737347 >> v2:172.21.15.19:3300/0 conn(0x7f5cac135c20 0x7f5cac138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 -- 172.21.15.19:0/2821737347 >> v1:172.21.15.19:6789/0 conn(0x7f5cac12cf60 legacy=0x7f5cac12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 -- 172.21.15.19:0/2821737347 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac071a40 con 0x7f5cac06f5d0 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caaffd700 1 --2- 172.21.15.19:0/2821737347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098f0 tx=0x7f5ca0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ebcec6c0f983e0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caa7fc700 1 -- 172.21.15.19:0/2821737347 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0010830 con 0x7f5cac06f5d0 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caa7fc700 1 -- 172.21.15.19:0/2821737347 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca0010990 con 0x7f5cac06f5d0 2023-10-03T10:17:20.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.701+0000 7f5caa7fc700 1 -- 172.21.15.19:0/2821737347 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca0010d20 con 0x7f5cac06f5d0 2023-10-03T10:17:20.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.702+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2821737347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 msgr2=0x7f5cac12ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.702+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2821737347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5ca00098f0 tx=0x7f5ca0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:20.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2821737347 shutdown_connections 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2821737347 >> v2:172.21.15.19:3300/0 conn(0x7f5cac135c20 0x7f5cac138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2821737347 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac12ffc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2821737347 >> 172.21.15.19:0/2821737347 conn(0x7f5cac0a2aa0 msgr2=0x7f5cac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2821737347 shutdown_connections 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.703+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2821737347 wait complete. 2023-10-03T10:17:20.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 Processor -- start 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 -- start start 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac1c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac135c20 0x7f5cac1c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0a15e0 con 0x7f5cac135c20 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac134380 con 0x7f5cac12cf60 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.704+0000 7f5cb1cf4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1351c0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5caaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac1c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5caaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60336/0 (socket says 172.21.15.19:60336) 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5caaffd700 1 -- 172.21.15.19:0/2865951928 learned_addr learned my addr 172.21.15.19:0/2865951928 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cabfff700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac135c20 0x7f5cac1c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 -- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 msgr2=0x7f5cac1c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 -- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac135c20 msgr2=0x7f5cac1c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac135c20 0x7f5cac1c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 -- 172.21.15.19:0/2865951928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0009550 con 0x7f5cac06f5d0 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5caaffd700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.705+0000 7f5cab7fe700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac1c5020 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000f60 tx=0x7f5c9c00c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.706+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0052d0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.706+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c005430 con 0x7f5cac06f5d0 2023-10-03T10:17:20.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.706+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac129fa0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.706+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac09eba0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.707+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0038c0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.708+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c9c003a60 con 0x7f5cac06f5d0 2023-10-03T10:17:20.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.708+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c0052e0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.708+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c9c03ead0 con 0x7f5cac06f5d0 2023-10-03T10:17:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.713+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c9c011590 con 0x7f5cac06f5d0 2023-10-03T10:17:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.759+0000 7fa947215700 1 Processor -- start 2023-10-03T10:17:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.759+0000 7fa947215700 1 -- start start 2023-10-03T10:17:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa947215700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009d6f0 0x7fa94009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa947215700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa94009e000 0x7fa9401339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa947215700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa94009b120 con 0x7fa94009e410 2023-10-03T10:17:20.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa947215700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa94006b460 con 0x7fa94009e000 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa947215700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa94009a7e0 con 0x7fa94009d6f0 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa9457b2700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa94009e410 0x7fa940133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40176/0 (socket says 172.21.15.19:40176) 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa9457b2700 1 -- 172.21.15.19:0/1442469633 learned_addr learned my addr 172.21.15.19:0/1442469633 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1442469633 >> v2:172.21.15.19:3300/0 conn(0x7fa94009e000 0x7fa9401339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa944fb1700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009d6f0 0x7fa94009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.760+0000 7fa93ffff700 1 -- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009d6f0 msgr2=0x7fa94009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009d6f0 0x7fa94009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93ffff700 1 -- 172.21.15.19:0/1442469633 >> v1:172.21.15.19:6789/0 conn(0x7fa94009e410 legacy=0x7fa940133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93ffff700 1 -- 172.21.15.19:0/1442469633 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94009a500 con 0x7fa94009e000 2023-10-03T10:17:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009e000 0x7fa9401339f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009840 tx=0x7fa92c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d670b94bab7fe7a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93f7fe700 1 -- 172.21.15.19:0/1442469633 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c011830 con 0x7fa94009e000 2023-10-03T10:17:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93f7fe700 1 -- 172.21.15.19:0/1442469633 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c011990 con 0x7fa94009e000 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.761+0000 7fa93f7fe700 1 -- 172.21.15.19:0/1442469633 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c011d20 con 0x7fa94009e000 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 -- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009e000 msgr2=0x7fa9401339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009e000 0x7fa9401339f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009840 tx=0x7fa92c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 -- 172.21.15.19:0/1442469633 shutdown_connections 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009d6f0 0x7fa94009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 --2- 172.21.15.19:0/1442469633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009e000 0x7fa9401339f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 -- 172.21.15.19:0/1442469633 >> 172.21.15.19:0/1442469633 conn(0x7fa940066f50 msgr2=0x7fa94009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 -- 172.21.15.19:0/1442469633 shutdown_connections 2023-10-03T10:17:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.762+0000 7fa947215700 1 -- 172.21.15.19:0/1442469633 wait complete. 2023-10-03T10:17:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.763+0000 7fa947215700 1 Processor -- start 2023-10-03T10:17:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.764+0000 7fa947215700 1 -- start start 2023-10-03T10:17:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.764+0000 7fa947215700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009d6f0 0x7fa9401a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.764+0000 7fa947215700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.764+0000 7fa947215700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 0x7fa9401a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.764+0000 7fa947215700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401a8800 con 0x7fa94009d6f0 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa947215700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9401a6510 con 0x7fa94009e000 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa947215700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400a2fd0 con 0x7fa94009e410 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60342/0 (socket says 172.21.15.19:60342) 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 -- 172.21.15.19:0/1773937233 learned_addr learned my addr 172.21.15.19:0/1773937233 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa9457b2700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 0x7fa9401a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa944fb1700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009d6f0 0x7fa9401a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 -- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 msgr2=0x7fa9401a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 0x7fa9401a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 -- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009d6f0 msgr2=0x7fa9401a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009d6f0 0x7fa9401a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa93ffff700 1 -- 172.21.15.19:0/1773937233 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c0094a0 con 0x7fa94009e000 2023-10-03T10:17:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.765+0000 7fa9457b2700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 0x7fa9401a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa93ffff700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa92c013000 tx=0x7fa92c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c0036a0 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c01f070 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9401a6ce0 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c003a20 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.766+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9401a7e20 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.767+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa92c003b80 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.767+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa92c021070 con 0x7fa94009e000 2023-10-03T10:17:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.767+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa940074ea0 con 0x7fa94009e000 2023-10-03T10:17:20.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.772+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa92c01a950 con 0x7fa94009e000 2023-10-03T10:17:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.801+0000 7f0d8a20c700 1 Processor -- start 2023-10-03T10:17:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.801+0000 7f0d8a20c700 1 -- start start 2023-10-03T10:17:20.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d8a20c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 0x7f0d8406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d8a20c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d84130430 0x7f0d84137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d8a20c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8412cd90 con 0x7f0d8412f8b0 2023-10-03T10:17:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d8a20c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8412d330 con 0x7f0d84130430 2023-10-03T10:17:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d8a20c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84071780 con 0x7f0d8412cf60 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d82ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0d8412f8b0 0x7f0d8412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40186/0 (socket says 172.21.15.19:40186) 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d82ffd700 1 -- 172.21.15.19:0/3161856720 learned_addr learned my addr 172.21.15.19:0/3161856720 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d83fff700 1 --2- 172.21.15.19:0/3161856720 >> v2:172.21.15.19:3300/0 conn(0x7f0d84130430 0x7f0d84137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d837fe700 1 --2- 172.21.15.19:0/3161856720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 0x7f0d8406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d837fe700 1 -- 172.21.15.19:0/3161856720 >> v2:172.21.15.19:3300/0 conn(0x7f0d84130430 msgr2=0x7f0d84137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d837fe700 1 --2- 172.21.15.19:0/3161856720 >> v2:172.21.15.19:3300/0 conn(0x7f0d84130430 0x7f0d84137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d837fe700 1 -- 172.21.15.19:0/3161856720 >> v1:172.21.15.19:6789/0 conn(0x7f0d8412f8b0 legacy=0x7f0d8412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d827fc700 1 -- 172.21.15.19:0/3161856720 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167948451 0 0) 0x7f0d8412cd90 con 0x7f0d8412f8b0 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.802+0000 7f0d837fe700 1 -- 172.21.15.19:0/3161856720 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84071a40 con 0x7f0d8412cf60 2023-10-03T10:17:20.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.803+0000 7f0d837fe700 1 --2- 172.21.15.19:0/3161856720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 0x7f0d8406f5d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400a9e0 tx=0x7f0d7400acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c17d569e91917c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.803+0000 7f0d827fc700 1 -- 172.21.15.19:0/3161856720 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7400cb70 con 0x7f0d8412cf60 2023-10-03T10:17:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.803+0000 7f0d827fc700 1 -- 172.21.15.19:0/3161856720 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7400ccd0 con 0x7f0d8412cf60 2023-10-03T10:17:20.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.803+0000 7f0d827fc700 1 -- 172.21.15.19:0/3161856720 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74018620 con 0x7f0d8412cf60 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 -- 172.21.15.19:0/3161856720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 msgr2=0x7f0d8406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/3161856720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 0x7f0d8406f5d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400a9e0 tx=0x7f0d7400acf0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 -- 172.21.15.19:0/3161856720 shutdown_connections 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/3161856720 >> v2:172.21.15.19:3300/0 conn(0x7f0d84130430 0x7f0d84137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/3161856720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d8412cf60 0x7f0d8406f5d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 -- 172.21.15.19:0/3161856720 >> 172.21.15.19:0/3161856720 conn(0x7f0d840a2aa0 msgr2=0x7f0d840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 -- 172.21.15.19:0/3161856720 shutdown_connections 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.804+0000 7f0d8a20c700 1 -- 172.21.15.19:0/3161856720 wait complete. 2023-10-03T10:17:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.805+0000 7f0d8a20c700 1 Processor -- start 2023-10-03T10:17:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 -- start start 2023-10-03T10:17:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d8412f8b0 0x7f0d8409b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d84130430 0x7f0d841c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8409ce70 con 0x7f0d8412cf60 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8409de20 con 0x7f0d84130430 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d8a20c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8409e680 con 0x7f0d8412f8b0 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d837fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d837fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43288/0 (socket says 172.21.15.19:43288) 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d837fe700 1 -- 172.21.15.19:0/2445812763 learned_addr learned my addr 172.21.15.19:0/2445812763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.806+0000 7f0d82ffd700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d8412f8b0 0x7f0d8409b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d83fff700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d84130430 0x7f0d841c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 -- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d8412f8b0 msgr2=0x7f0d8409b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d8412f8b0 0x7f0d8409b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 -- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d84130430 msgr2=0x7f0d841c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d84130430 0x7f0d841c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 -- 172.21.15.19:0/2445812763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7400a640 con 0x7f0d8412cf60 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d837fe700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0d8412d470 tx=0x7f0d740047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74003ab0 con 0x7f0d8412cf60 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8409d980 con 0x7f0d8412cf60 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d74003c30 con 0x7f0d8412cf60 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.807+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74021480 con 0x7f0d8412cf60 2023-10-03T10:17:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.808+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8409bdf0 con 0x7f0d8412cf60 2023-10-03T10:17:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.808+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d84074ea0 con 0x7f0d8412cf60 2023-10-03T10:17:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.809+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d7402b440 con 0x7f0d8412cf60 2023-10-03T10:17:20.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.809+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d74040f60 con 0x7f0d8412cf60 2023-10-03T10:17:20.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.818+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d7406c750 con 0x7f0d8412cf60 2023-10-03T10:17:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.885+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4c1c005590 con 0x7f4c3409e440 2023-10-03T10:17:20.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.885+0000 7f4c2a7fc700 1 -- 172.21.15.19:0/2540930275 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c2c01a680 con 0x7f4c3409e440 2023-10-03T10:17:20.886 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 msgr2=0x7f4c341194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009dd0 tx=0x7f4c2c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 shutdown_connections 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c3409e440 0x7f4c341194b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c3409d6f0 0x7f4c341cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 --2- 172.21.15.19:0/2540930275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c3409e000 0x7f4c341cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 >> 172.21.15.19:0/2540930275 conn(0x7f4c34066f50 msgr2=0x7f4c341baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 shutdown_connections 2023-10-03T10:17:20.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.888+0000 7f4c3bcd2700 1 -- 172.21.15.19:0/2540930275 wait complete. 2023-10-03T10:17:20.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:20.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.928+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c8c005590 con 0x7f5cac06f5d0 2023-10-03T10:17:20.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.928+0000 7f5c93fff700 1 -- 172.21.15.19:0/2865951928 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c9c017070 con 0x7f5cac06f5d0 2023-10-03T10:17:20.929 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.930+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 msgr2=0x7f5cac1c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.930+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac1c5020 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c000f60 tx=0x7f5c9c00c730 comp rx=0 tx=0).stop 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 shutdown_connections 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5cac135c20 0x7f5cac1c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5cac06f5d0 0x7f5cac1c5020 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 --2- 172.21.15.19:0/2865951928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5cac12cf60 0x7f5cac1c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 >> 172.21.15.19:0/2865951928 conn(0x7f5cac0a2aa0 msgr2=0x7f5cac12a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 shutdown_connections 2023-10-03T10:17:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.931+0000 7f5cb1cf4700 1 -- 172.21.15.19:0/2865951928 wait complete. 2023-10-03T10:17:20.946 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:20.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.988+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa94006c360 con 0x7fa94009e000 2023-10-03T10:17:20.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.989+0000 7fa93d7fa700 1 -- 172.21.15.19:0/1773937233 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa92c00bbd0 con 0x7fa94009e000 2023-10-03T10:17:20.990 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 msgr2=0x7fa9401a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa92c013000 tx=0x7fa92c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:20.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 shutdown_connections 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa94009e410 0x7fa9401a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa94009d6f0 0x7fa9401a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 --2- 172.21.15.19:0/1773937233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa94009e000 0x7fa9401a5660 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 >> 172.21.15.19:0/1773937233 conn(0x7fa940066f50 msgr2=0x7fa9401bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 shutdown_connections 2023-10-03T10:17:20.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:20.991+0000 7fa947215700 1 -- 172.21.15.19:0/1773937233 wait complete. 2023-10-03T10:17:21.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:21.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.028+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d840713a0 con 0x7f0d8412cf60 2023-10-03T10:17:21.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.028+0000 7f0d6bfff700 1 -- 172.21.15.19:0/2445812763 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d74026070 con 0x7f0d8412cf60 2023-10-03T10:17:21.029 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 msgr2=0x7f0d8409b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0d8412d470 tx=0x7f0d740047c0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 shutdown_connections 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d84130430 0x7f0d841c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d8412cf60 0x7f0d8409b370 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 --2- 172.21.15.19:0/2445812763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d8412f8b0 0x7f0d8409b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 >> 172.21.15.19:0/2445812763 conn(0x7f0d840a2aa0 msgr2=0x7f0d840a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 shutdown_connections 2023-10-03T10:17:21.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:21.031+0000 7f0d8a20c700 1 -- 172.21.15.19:0/2445812763 wait complete. 2023-10-03T10:17:21.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:21.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:21.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:22.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:22.046 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:22.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 Processor -- start 2023-10-03T10:17:22.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 -- start start 2023-10-03T10:17:22.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec10130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec10130e50 0x7fec1006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec1006fb20 0x7fec1006ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100704b0 con 0x7fec10130e50 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1009a390 con 0x7fec10130540 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.055+0000 7fec152d1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec100716a0 con 0x7fec1006fb20 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec10130e50 0x7fec1006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec10130e50 0x7fec1006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43302/0 (socket says 172.21.15.19:43302) 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 -- 172.21.15.19:0/1312269635 learned_addr learned my addr 172.21.15.19:0/1312269635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 -- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec1006fb20 msgr2=0x7fec1006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec1006fb20 0x7fec1006ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 -- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 msgr2=0x7fec10130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec10130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 -- 172.21.15.19:0/1312269635 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec10071290 con 0x7fec10130e50 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.056+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec10130e50 0x7fec1006f5e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fec0400bbc0 tx=0x7fec0400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e5120bea74bd40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.057+0000 7fec0dffb700 1 -- 172.21.15.19:0/1312269635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400dd50 con 0x7fec10130e50 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.057+0000 7fec0dffb700 1 -- 172.21.15.19:0/1312269635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04010470 con 0x7fec10130e50 2023-10-03T10:17:22.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.057+0000 7fec0dffb700 1 -- 172.21.15.19:0/1312269635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04010800 con 0x7fec10130e50 2023-10-03T10:17:22.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.057+0000 7fec152d1700 1 -- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec10130e50 msgr2=0x7fec1006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.057+0000 7fec152d1700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec10130e50 0x7fec1006f5e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fec0400bbc0 tx=0x7fec0400bed0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 -- 172.21.15.19:0/1312269635 shutdown_connections 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec10130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec1006fb20 0x7fec1006ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 --2- 172.21.15.19:0/1312269635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec10130e50 0x7fec1006f5e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 -- 172.21.15.19:0/1312269635 >> 172.21.15.19:0/1312269635 conn(0x7fec100a2aa0 msgr2=0x7fec100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 -- 172.21.15.19:0/1312269635 shutdown_connections 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.058+0000 7fec152d1700 1 -- 172.21.15.19:0/1312269635 wait complete. 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.059+0000 7fec152d1700 1 Processor -- start 2023-10-03T10:17:22.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.059+0000 7fec152d1700 1 -- start start 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec1009c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec10130e50 0x7fec1009cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec10071970 con 0x7fec1006fb20 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1011e280 con 0x7fec10130540 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec152d1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec1011d500 con 0x7fec10130e50 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43304/0 (socket says 172.21.15.19:43304) 2023-10-03T10:17:22.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0effd700 1 -- 172.21.15.19:0/3399266989 learned_addr learned my addr 172.21.15.19:0/3399266989 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec1009c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0f7fe700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec10130e50 0x7fec1009cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 -- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec10130e50 msgr2=0x7fec1009cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec10130e50 0x7fec1009cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 -- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 msgr2=0x7fec1009c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0e7fc700 1 -- 172.21.15.19:0/3399266989 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0400b7f0 con 0x7fec10130540 2023-10-03T10:17:22.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.060+0000 7fec0effd700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7fec0e7fc700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec1009c570 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec1006b6c0 tx=0x7fec04004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04003bb0 con 0x7fec10130540 2023-10-03T10:17:22.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04003d10 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04010820 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1009dd50 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.061+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1009e430 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.063+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10074ea0 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.063+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec04019400 con 0x7fec10130540 2023-10-03T10:17:22.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.064+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec04041080 con 0x7fec10130540 2023-10-03T10:17:22.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.069+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec040196b0 con 0x7fec10130540 2023-10-03T10:17:22.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.104+0000 7f132620e700 1 Processor -- start 2023-10-03T10:17:22.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.104+0000 7f132620e700 1 -- start start 2023-10-03T10:17:22.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f132620e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f132620e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f1320130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f132620e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132009f130 con 0x7f132009e000 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f132620e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132009f520 con 0x7f132009d6f0 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f132620e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132009e930 con 0x7f132009e410 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.105+0000 7f131f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60394/0 (socket says 172.21.15.19:60394) 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131f7fe700 1 -- 172.21.15.19:0/3273352549 learned_addr learned my addr 172.21.15.19:0/3273352549 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131effd700 1 --1- 172.21.15.19:0/3273352549 >> v1:172.21.15.19:6789/0 conn(0x7f132009e000 0x7f1320130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40200/0 (socket says 172.21.15.19:40200) 2023-10-03T10:17:22.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f1320130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 -- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 msgr2=0x7f132009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 -- 172.21.15.19:0/3273352549 >> v1:172.21.15.19:6789/0 conn(0x7f132009e000 legacy=0x7f1320130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 -- 172.21.15.19:0/3273352549 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132009b2d0 con 0x7f132009e410 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131f7fe700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.106+0000 7f131ffff700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f1320130d70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1318009dc0 tx=0x7f131800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eda6bf1105fcb3d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f131e7fc700 1 -- 172.21.15.19:0/3273352549 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131800e070 con 0x7f132009e410 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f131e7fc700 1 -- 172.21.15.19:0/3273352549 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1318003a20 con 0x7f132009e410 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f131e7fc700 1 -- 172.21.15.19:0/3273352549 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1318003dd0 con 0x7f132009e410 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 -- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 msgr2=0x7f1320130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f1320130d70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1318009dc0 tx=0x7f131800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 -- 172.21.15.19:0/3273352549 shutdown_connections 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f1320130d70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 --2- 172.21.15.19:0/3273352549 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.108+0000 7f132620e700 1 -- 172.21.15.19:0/3273352549 >> 172.21.15.19:0/3273352549 conn(0x7f1320066f50 msgr2=0x7f132009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.109+0000 7f132620e700 1 -- 172.21.15.19:0/3273352549 shutdown_connections 2023-10-03T10:17:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.109+0000 7f132620e700 1 -- 172.21.15.19:0/3273352549 wait complete. 2023-10-03T10:17:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.110+0000 7f132620e700 1 Processor -- start 2023-10-03T10:17:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.110+0000 7f132620e700 1 -- start start 2023-10-03T10:17:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132009e000 0x7f132011e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f132011eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132009c700 con 0x7f132009e000 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1320121ba0 con 0x7f132009d6f0 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f132620e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1320120920 con 0x7f132009e410 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f131f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f131f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60398/0 (socket says 172.21.15.19:60398) 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.111+0000 7f131f7fe700 1 -- 172.21.15.19:0/859499648 learned_addr learned my addr 172.21.15.19:0/859499648 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131effd700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132009e000 0x7f132011e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131ffff700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f132011eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 -- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 msgr2=0x7f132011eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f132011eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 -- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132009e000 msgr2=0x7f132011e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132009e000 0x7f132011e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 -- 172.21.15.19:0/859499648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131000b7f0 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f131f7fe700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f131000ecf0 tx=0x7f131000d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310004230 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310004390 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131000ee90 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.112+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1318009a70 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.113+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1320121500 con 0x7f132009d6f0 2023-10-03T10:17:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.114+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1320120370 con 0x7f132009d6f0 2023-10-03T10:17:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.115+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13100036a0 con 0x7f132009d6f0 2023-10-03T10:17:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.115+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1310014070 con 0x7f132009d6f0 2023-10-03T10:17:22.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.124+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1310021760 con 0x7f132009d6f0 2023-10-03T10:17:22.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 Processor -- start 2023-10-03T10:17:22.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 -- start start 2023-10-03T10:17:22.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 0x7f19c806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f19c806acb0 0x7f19c806b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c809e130 con 0x7f19c806acb0 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c81312b0 con 0x7f19c809d9f0 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.162+0000 7f19cd41a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c809f6e0 con 0x7f19c81316c0 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60478/0 (socket says 172.21.15.19:60478) 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 0x7f19c806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c6ffd700 1 -- 172.21.15.19:0/2255423818 learned_addr learned my addr 172.21.15.19:0/2255423818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c77fe700 1 --2- 172.21.15.19:0/2255423818 >> v2:172.21.15.19:3300/0 conn(0x7f19c806acb0 0x7f19c806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 -- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 msgr2=0x7f19c8131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 -- 172.21.15.19:0/2255423818 >> v2:172.21.15.19:3300/0 conn(0x7f19c806acb0 msgr2=0x7f19c806b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 --2- 172.21.15.19:0/2255423818 >> v2:172.21.15.19:3300/0 conn(0x7f19c806acb0 0x7f19c806b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 -- 172.21.15.19:0/2255423818 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c809e760 con 0x7f19c809d9f0 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c6ffd700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.163+0000 7f19c67fc700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 0x7f19c806a770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009840 tx=0x7f19bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5499ec6bb87af899 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.164+0000 7f19c5ffb700 1 -- 172.21.15.19:0/2255423818 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011830 con 0x7f19c809d9f0 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.164+0000 7f19c5ffb700 1 -- 172.21.15.19:0/2255423818 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc011990 con 0x7f19c809d9f0 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.164+0000 7f19c5ffb700 1 -- 172.21.15.19:0/2255423818 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011d20 con 0x7f19c809d9f0 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 -- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 msgr2=0x7f19c806a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 0x7f19c806a770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009840 tx=0x7f19bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 -- 172.21.15.19:0/2255423818 shutdown_connections 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2255423818 >> v2:172.21.15.19:3300/0 conn(0x7f19c806acb0 0x7f19c806b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c81316c0 0x7f19c8131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2255423818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c809d9f0 0x7f19c806a770 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 -- 172.21.15.19:0/2255423818 >> 172.21.15.19:0/2255423818 conn(0x7f19c8066f50 msgr2=0x7f19c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 -- 172.21.15.19:0/2255423818 shutdown_connections 2023-10-03T10:17:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.165+0000 7f19cd41a700 1 -- 172.21.15.19:0/2255423818 wait complete. 2023-10-03T10:17:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.166+0000 7f19cd41a700 1 Processor -- start 2023-10-03T10:17:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.166+0000 7f19cd41a700 1 -- start start 2023-10-03T10:17:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c809d9f0 0x7f19c8070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 0x7f19c8071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c811a960 con 0x7f19c806acb0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c811bb80 con 0x7f19c81316c0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19cd41a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19c811a6a0 con 0x7f19c809d9f0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43332/0 (socket says 172.21.15.19:43332) 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 -- 172.21.15.19:0/2545179039 learned_addr learned my addr 172.21.15.19:0/2545179039 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c77fe700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 0x7f19c8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c67fc700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c809d9f0 0x7f19c8070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 -- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c809d9f0 msgr2=0x7f19c8070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c809d9f0 0x7f19c8070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 -- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 msgr2=0x7f19c8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 0x7f19c8071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c6ffd700 1 -- 172.21.15.19:0/2545179039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8009550 con 0x7f19c806acb0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.167+0000 7f19c77fe700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 0x7f19c8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19c6ffd700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19b800ebe0 tx=0x7f19b800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800c850 con 0x7f19c806acb0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b800c9b0 con 0x7f19c806acb0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800cd20 con 0x7f19c806acb0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0094a0 con 0x7f19c806acb0 2023-10-03T10:17:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.168+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c8128410 con 0x7f19c806acb0 2023-10-03T10:17:22.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.169+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f19b8013470 con 0x7f19c806acb0 2023-10-03T10:17:22.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.169+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8074ea0 con 0x7f19c806acb0 2023-10-03T10:17:22.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.169+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f19b803f8b0 con 0x7f19c806acb0 2023-10-03T10:17:22.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.174+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f19b80232f0 con 0x7f19c806acb0 2023-10-03T10:17:22.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.198+0000 7ff42b7fe700 1 Processor -- start 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.198+0000 7ff42b7fe700 1 -- start start 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff42412cf60 0x7ff42406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff424130430 0x7ff424137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42b7fe700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42412cd90 con 0x7ff42412f8b0 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42b7fe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42412d330 con 0x7ff42412cf60 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42b7fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff424071780 con 0x7ff424130430 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff428d99700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff42412f8b0 0x7ff42412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40214/0 (socket says 172.21.15.19:40214) 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff428d99700 1 -- 172.21.15.19:0/923075943 learned_addr learned my addr 172.21.15.19:0/923075943 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42959a700 1 --2- 172.21.15.19:0/923075943 >> v2:172.21.15.19:3300/0 conn(0x7ff42412cf60 0x7ff42406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff429d9b700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff424130430 0x7ff424137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42959a700 1 -- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff424130430 msgr2=0x7ff424137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42959a700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff424130430 0x7ff424137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42959a700 1 -- 172.21.15.19:0/923075943 >> v1:172.21.15.19:6789/0 conn(0x7ff42412f8b0 legacy=0x7ff42412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff41bfff700 1 -- 172.21.15.19:0/923075943 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422191145 0 0) 0x7ff42412cd90 con 0x7ff42412f8b0 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.199+0000 7ff42959a700 1 -- 172.21.15.19:0/923075943 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff424071a40 con 0x7ff42412cf60 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff42959a700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42406f5d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff420009840 tx=0x7ff420009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcbb5ce6eeca20d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff41bfff700 1 -- 172.21.15.19:0/923075943 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000f940 con 0x7ff42412cf60 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff41bfff700 1 -- 172.21.15.19:0/923075943 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42000faa0 con 0x7ff42412cf60 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff41bfff700 1 -- 172.21.15.19:0/923075943 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42000fe30 con 0x7ff42412cf60 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff42b7fe700 1 -- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 msgr2=0x7ff42406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.200+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42406f5d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff420009840 tx=0x7ff420009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 -- 172.21.15.19:0/923075943 shutdown_connections 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff424130430 0x7ff424137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/923075943 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42406f5d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 -- 172.21.15.19:0/923075943 >> 172.21.15.19:0/923075943 conn(0x7ff4240a2aa0 msgr2=0x7ff4240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 -- 172.21.15.19:0/923075943 shutdown_connections 2023-10-03T10:17:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.201+0000 7ff42b7fe700 1 -- 172.21.15.19:0/923075943 wait complete. 2023-10-03T10:17:22.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 Processor -- start 2023-10-03T10:17:22.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 -- start start 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff424130430 0x7ff4241c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42409e9b0 con 0x7ff42412cf60 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff424067c90 con 0x7ff424130430 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff42b7fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff42409b6b0 con 0x7ff42412f8b0 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.202+0000 7ff428d99700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60500/0 (socket says 172.21.15.19:60500) 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 -- 172.21.15.19:0/3742043126 learned_addr learned my addr 172.21.15.19:0/3742043126 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff429d9b700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff424130430 0x7ff4241c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff42959a700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 -- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff424130430 msgr2=0x7ff4241c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff424130430 0x7ff4241c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 -- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 msgr2=0x7ff42409bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42409bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 -- 172.21.15.19:0/3742043126 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200094a0 con 0x7ff42412f8b0 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff42959a700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42409bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff428d99700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c520 tx=0x7ff41400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414004c80 con 0x7ff42412f8b0 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414004de0 con 0x7ff42412f8b0 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414007310 con 0x7ff42412f8b0 2023-10-03T10:17:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.203+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42409b3e0 con 0x7ff42412f8b0 2023-10-03T10:17:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.204+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42411d500 con 0x7ff42412f8b0 2023-10-03T10:17:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.205+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff424074ea0 con 0x7ff42412f8b0 2023-10-03T10:17:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.205+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff414007470 con 0x7ff42412f8b0 2023-10-03T10:17:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.205+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff41403f4c0 con 0x7ff42412f8b0 2023-10-03T10:17:22.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.214+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4140106d0 con 0x7ff42412f8b0 2023-10-03T10:17:22.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.300+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fec1006b9e0 con 0x7fec10130540 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.300+0000 7febf77fe700 1 -- 172.21.15.19:0/3399266989 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec0400e360 con 0x7fec10130540 2023-10-03T10:17:22.301 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 msgr2=0x7fec1009c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec1009c570 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fec1006b6c0 tx=0x7fec04004750 comp rx=0 tx=0).stop 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 shutdown_connections 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec10130e50 0x7fec1009cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec1006fb20 0x7fec1009c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 --2- 172.21.15.19:0/3399266989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec10130540 0x7fec1009c570 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 >> 172.21.15.19:0/3399266989 conn(0x7fec100a2aa0 msgr2=0x7fec1012b650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 shutdown_connections 2023-10-03T10:17:22.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.303+0000 7fec152d1700 1 -- 172.21.15.19:0/3399266989 wait complete. 2023-10-03T10:17:22.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.338+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1320074ea0 con 0x7f132009d6f0 2023-10-03T10:17:22.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.339+0000 7f1307fff700 1 -- 172.21.15.19:0/859499648 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f131001d030 con 0x7f132009d6f0 2023-10-03T10:17:22.340 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 msgr2=0x7f132011e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f131000ecf0 tx=0x7f131000d630 comp rx=0 tx=0).stop 2023-10-03T10:17:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 shutdown_connections 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132009e410 0x7f132011eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132009d6f0 0x7f132011e0c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 --2- 172.21.15.19:0/859499648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132009e000 0x7f132011e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 >> 172.21.15.19:0/859499648 conn(0x7f1320066f50 msgr2=0x7f1320071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 shutdown_connections 2023-10-03T10:17:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.341+0000 7f132620e700 1 -- 172.21.15.19:0/859499648 wait complete. 2023-10-03T10:17:22.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:22.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.384+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f19c809e980 con 0x7f19c806acb0 2023-10-03T10:17:22.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.384+0000 7f19af7fe700 1 -- 172.21.15.19:0/2545179039 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f19b8021020 con 0x7f19c806acb0 2023-10-03T10:17:22.385 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.386+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 msgr2=0x7f19c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.386+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19b800ebe0 tx=0x7f19b800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.386+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 shutdown_connections 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.386+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f19c81316c0 0x7f19c8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.386+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19c806acb0 0x7f19c80709e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.387+0000 7f19cd41a700 1 --2- 172.21.15.19:0/2545179039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f19c809d9f0 0x7f19c8070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.387+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 >> 172.21.15.19:0/2545179039 conn(0x7f19c8066f50 msgr2=0x7f19c80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.387+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 shutdown_connections 2023-10-03T10:17:22.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.387+0000 7f19cd41a700 1 -- 172.21.15.19:0/2545179039 wait complete. 2023-10-03T10:17:22.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.425+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff424129fa0 con 0x7ff42412f8b0 2023-10-03T10:17:22.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.425+0000 7ff419ffb700 1 -- 172.21.15.19:0/3742043126 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff414011360 con 0x7ff42412f8b0 2023-10-03T10:17:22.425 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:22.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 msgr2=0x7ff42409c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:22.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c520 tx=0x7ff41400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:22.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 shutdown_connections 2023-10-03T10:17:22.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff424130430 0x7ff4241c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff42412cf60 0x7ff42409bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 --2- 172.21.15.19:0/3742043126 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff42412f8b0 0x7ff42409c040 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:22.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 >> 172.21.15.19:0/3742043126 conn(0x7ff4240a2aa0 msgr2=0x7ff4240a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:22.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 shutdown_connections 2023-10-03T10:17:22.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:22.427+0000 7ff42b7fe700 1 -- 172.21.15.19:0/3742043126 wait complete. 2023-10-03T10:17:22.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:23.319 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:23.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:23.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:23.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:23.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.470+0000 7f7dabfaa700 1 Processor -- start 2023-10-03T10:17:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.470+0000 7f7dabfaa700 1 -- start start 2023-10-03T10:17:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7dabfaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7dabfaa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7da409f240 0x7f7da41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7dabfaa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da4070940 con 0x7f7da409f650 2023-10-03T10:17:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7dabfaa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da406fd60 con 0x7f7da409f240 2023-10-03T10:17:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7dabfaa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da406fa80 con 0x7f7da409e930 2023-10-03T10:17:23.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7da9d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7da9d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60506/0 (socket says 172.21.15.19:60506) 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.471+0000 7f7da9d46700 1 -- 172.21.15.19:0/4060453192 learned_addr learned my addr 172.21.15.19:0/4060453192 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da9d46700 1 -- 172.21.15.19:0/4060453192 >> v2:172.21.15.19:3300/0 conn(0x7f7da409f240 msgr2=0x7f7da41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da9d46700 1 --2- 172.21.15.19:0/4060453192 >> v2:172.21.15.19:3300/0 conn(0x7f7da409f240 0x7f7da41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da9d46700 1 -- 172.21.15.19:0/4060453192 >> v1:172.21.15.19:6789/0 conn(0x7f7da409f650 legacy=0x7f7da4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da9d46700 1 -- 172.21.15.19:0/4060453192 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da409fb60 con 0x7f7da409e930 2023-10-03T10:17:23.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da9d46700 1 --2- 172.21.15.19:0/4060453192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098f0 tx=0x7f7da0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f2c2b54fd245ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da8d44700 1 -- 172.21.15.19:0/4060453192 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0004230 con 0x7f7da409e930 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da8d44700 1 -- 172.21.15.19:0/4060453192 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da0004390 con 0x7f7da409e930 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.472+0000 7f7da8d44700 1 -- 172.21.15.19:0/4060453192 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00036a0 con 0x7f7da409e930 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 -- 172.21.15.19:0/4060453192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 msgr2=0x7f7da409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/4060453192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7da00098f0 tx=0x7f7da0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:23.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 -- 172.21.15.19:0/4060453192 shutdown_connections 2023-10-03T10:17:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/4060453192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da409ed00 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/4060453192 >> v2:172.21.15.19:3300/0 conn(0x7f7da409f240 0x7f7da41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 -- 172.21.15.19:0/4060453192 >> 172.21.15.19:0/4060453192 conn(0x7f7da40a4210 msgr2=0x7f7da40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 -- 172.21.15.19:0/4060453192 shutdown_connections 2023-10-03T10:17:23.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.473+0000 7f7dabfaa700 1 -- 172.21.15.19:0/4060453192 wait complete. 2023-10-03T10:17:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.474+0000 7f7dabfaa700 1 Processor -- start 2023-10-03T10:17:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.474+0000 7f7dabfaa700 1 -- start start 2023-10-03T10:17:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da41a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da409f240 0x7f7da41a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41aa490 con 0x7f7da409f650 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41a7bc0 con 0x7f7da409f240 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7dabfaa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da41a81e0 con 0x7f7da409e930 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43372/0 (socket says 172.21.15.19:43372) 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 -- 172.21.15.19:0/2859905451 learned_addr learned my addr 172.21.15.19:0/2859905451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7da9545700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da409f240 0x7f7da41a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7da9d46700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da41a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 -- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 msgr2=0x7f7da41a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da41a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 -- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da409f240 msgr2=0x7f7da41a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da409f240 0x7f7da41a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.475+0000 7f7daa547700 1 -- 172.21.15.19:0/2859905451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009550 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7daa547700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00c7d0 tx=0x7f7d9c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c003e10 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c005070 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40a0190 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c005420 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.476+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da40a36e0 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.477+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d9c005580 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.477+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d9c0118c0 con 0x7f7da409f650 2023-10-03T10:17:23.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.478+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da4071d80 con 0x7f7da409f650 2023-10-03T10:17:23.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.487+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d9c005830 con 0x7f7da409f650 2023-10-03T10:17:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.525+0000 7fe59019e700 1 Processor -- start 2023-10-03T10:17:23.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.526+0000 7fe59019e700 1 -- start start 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.526+0000 7fe59019e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.526+0000 7fe59019e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 0x7fe58812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.526+0000 7fe59019e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe588134260 0x7fe5881304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.526+0000 7fe59019e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58806b990 con 0x7fe588134260 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe59019e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880a0590 con 0x7fe588133e30 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe59019e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe58809fb80 con 0x7fe588133420 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60528/0 (socket says 172.21.15.19:60528) 2023-10-03T10:17:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 -- 172.21.15.19:0/3057645235 learned_addr learned my addr 172.21.15.19:0/3057645235 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58d739700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 0x7fe58812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58e73b700 1 --2- 172.21.15.19:0/3057645235 >> v2:172.21.15.19:3300/0 conn(0x7fe588134260 0x7fe5881304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 -- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 msgr2=0x7fe58812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 0x7fe58812ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 -- 172.21.15.19:0/3057645235 >> v2:172.21.15.19:3300/0 conn(0x7fe588134260 msgr2=0x7fe5881304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 --2- 172.21.15.19:0/3057645235 >> v2:172.21.15.19:3300/0 conn(0x7fe588134260 0x7fe5881304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 -- 172.21.15.19:0/3057645235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5880a0030 con 0x7fe588133420 2023-10-03T10:17:23.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58d739700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 0x7fe58812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.527+0000 7fe58df3a700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7149261eada85cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe58cf38700 1 -- 172.21.15.19:0/3057645235 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584011830 con 0x7fe588133420 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe58cf38700 1 -- 172.21.15.19:0/3057645235 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584011990 con 0x7fe588133420 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe58cf38700 1 -- 172.21.15.19:0/3057645235 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584011d20 con 0x7fe588133420 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 -- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 msgr2=0x7fe5881337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe5840098f0 tx=0x7fe584009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 -- 172.21.15.19:0/3057645235 shutdown_connections 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 --2- 172.21.15.19:0/3057645235 >> v2:172.21.15.19:3300/0 conn(0x7fe588134260 0x7fe5881304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133420 0x7fe5881337f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 --2- 172.21.15.19:0/3057645235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588133e30 0x7fe58812ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.528+0000 7fe59019e700 1 -- 172.21.15.19:0/3057645235 >> 172.21.15.19:0/3057645235 conn(0x7fe5880a4210 msgr2=0x7fe5880a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.529+0000 7fe59019e700 1 -- 172.21.15.19:0/3057645235 shutdown_connections 2023-10-03T10:17:23.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.529+0000 7fe59019e700 1 -- 172.21.15.19:0/3057645235 wait complete. 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 Processor -- start 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 -- start start 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 0x7fe58809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588134260 0x7fe58809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58811fd30 con 0x7fe588133420 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58811ff80 con 0x7fe588134260 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe59019e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe58809deb0 con 0x7fe588133e30 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe58d739700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe58d739700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60544/0 (socket says 172.21.15.19:60544) 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe58e73b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588134260 0x7fe58809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.530+0000 7fe58d739700 1 -- 172.21.15.19:0/2945936497 learned_addr learned my addr 172.21.15.19:0/2945936497 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58df3a700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 0x7fe58809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 -- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588134260 msgr2=0x7fe58809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588134260 0x7fe58809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 -- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 msgr2=0x7fe58809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 0x7fe58809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 -- 172.21.15.19:0/2945936497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5780094a0 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58df3a700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 0x7fe58809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe58d739700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe57800ebe0 tx=0x7fe57800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800c910 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57800ca70 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57800ce00 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe584009550 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.531+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58812d6f0 con 0x7fe588133e30 2023-10-03T10:17:23.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.533+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58809e420 con 0x7fe588133e30 2023-10-03T10:17:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.534+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe578013470 con 0x7fe588133e30 2023-10-03T10:17:23.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.534+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe57803fec0 con 0x7fe588133e30 2023-10-03T10:17:23.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.542+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe578013720 con 0x7fe588133e30 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.567+0000 7f90bb8e6700 1 Processor -- start 2023-10-03T10:17:23.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 -- start start 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b4130540 0x7f90b4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90b4130e50 0x7f90b406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b40716a0 con 0x7f90b406fb20 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b409a390 con 0x7f90b4130e50 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90bb8e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4071290 con 0x7f90b4130540 2023-10-03T10:17:23.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90b9e83700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f90b406fb20 0x7f90b4137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40234/0 (socket says 172.21.15.19:40234) 2023-10-03T10:17:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90b9e83700 1 -- 172.21.15.19:0/67000739 learned_addr learned my addr 172.21.15.19:0/67000739 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.568+0000 7f90b8e81700 1 --2- 172.21.15.19:0/67000739 >> v2:172.21.15.19:3300/0 conn(0x7f90b4130e50 0x7f90b406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b9682700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b4130540 0x7f90b4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90abfff700 1 -- 172.21.15.19:0/67000739 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753417419 0 0) 0x7f90b40716a0 con 0x7f90b406fb20 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90abfff700 1 -- 172.21.15.19:0/67000739 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a00035b0 con 0x7f90b406fb20 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b8e81700 1 -- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b4130540 msgr2=0x7f90b4130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b8e81700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b4130540 0x7f90b4130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b8e81700 1 -- 172.21.15.19:0/67000739 >> v1:172.21.15.19:6789/0 conn(0x7f90b406fb20 legacy=0x7f90b4137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b8e81700 1 -- 172.21.15.19:0/67000739 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4130340 con 0x7f90b4130e50 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90b8e81700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b406f5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009840 tx=0x7f90a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831e5d6870958a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90abfff700 1 -- 172.21.15.19:0/67000739 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4011830 con 0x7f90b4130e50 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90abfff700 1 -- 172.21.15.19:0/67000739 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a4011990 con 0x7f90b4130e50 2023-10-03T10:17:23.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.569+0000 7f90abfff700 1 -- 172.21.15.19:0/67000739 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4011d20 con 0x7f90b4130e50 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.570+0000 7f90bb8e6700 1 -- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 msgr2=0x7f90b406f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.570+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b406f5e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009840 tx=0x7f90a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 -- 172.21.15.19:0/67000739 shutdown_connections 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b4130540 0x7f90b4130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/67000739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b406f5e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 -- 172.21.15.19:0/67000739 >> 172.21.15.19:0/67000739 conn(0x7f90b40a2aa0 msgr2=0x7f90b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 -- 172.21.15.19:0/67000739 shutdown_connections 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.571+0000 7f90bb8e6700 1 -- 172.21.15.19:0/67000739 wait complete. 2023-10-03T10:17:23.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.572+0000 7f90bb8e6700 1 Processor -- start 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.572+0000 7f90bb8e6700 1 -- start start 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b406fb20 0x7f90b41cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90b4130540 0x7f90b41ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b4127160 con 0x7f90b4130e50 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b412c810 con 0x7f90b4130540 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90bb8e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90b40a0810 con 0x7f90b406fb20 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90b9e83700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90b9e83700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43410/0 (socket says 172.21.15.19:43410) 2023-10-03T10:17:23.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90b9e83700 1 -- 172.21.15.19:0/2531781063 learned_addr learned my addr 172.21.15.19:0/2531781063 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90b8e81700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90b4130540 0x7f90b41ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.573+0000 7f90b9682700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b406fb20 0x7f90b41cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 -- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b406fb20 msgr2=0x7f90b41cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b406fb20 0x7f90b41cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 -- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90b4130540 msgr2=0x7f90b41ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90b4130540 0x7f90b41ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 -- 172.21.15.19:0/2531781063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40094a0 con 0x7f90b4130e50 2023-10-03T10:17:23.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90b9e83700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00cb40 tx=0x7f90ac00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00a9e0 con 0x7f90b4130e50 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00ab40 con 0x7f90b4130e50 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac012400 con 0x7f90b4130e50 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.574+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b411daf0 con 0x7f90b4130e50 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.575+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b41cd090 con 0x7f90b4130e50 2023-10-03T10:17:23.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.577+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b4074ea0 con 0x7f90b4130e50 2023-10-03T10:17:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.577+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90ac012560 con 0x7f90b4130e50 2023-10-03T10:17:23.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.577+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90ac042030 con 0x7f90b4130e50 2023-10-03T10:17:23.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.582+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90ac0108f0 con 0x7f90b4130e50 2023-10-03T10:17:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.618+0000 7f3e52699700 1 Processor -- start 2023-10-03T10:17:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.618+0000 7f3e52699700 1 -- start start 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.618+0000 7f3e52699700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3e4c09e1d0 0x7f3e4c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e52699700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e52699700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c09b120 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e52699700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c06b460 con 0x7f3e4c09e1d0 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e52699700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09a7e0 con 0x7f3e4c139170 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60584/0 (socket says 172.21.15.19:60584) 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 -- 172.21.15.19:0/3527936276 learned_addr learned my addr 172.21.15.19:0/3527936276 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e4b7fe700 1 --2- 172.21.15.19:0/3527936276 >> v2:172.21.15.19:3300/0 conn(0x7f3e4c09e1d0 0x7f3e4c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 -- 172.21.15.19:0/3527936276 >> v2:172.21.15.19:3300/0 conn(0x7f3e4c09e1d0 msgr2=0x7f3e4c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 --2- 172.21.15.19:0/3527936276 >> v2:172.21.15.19:3300/0 conn(0x7f3e4c09e1d0 0x7f3e4c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 -- 172.21.15.19:0/3527936276 >> v1:172.21.15.19:6789/0 conn(0x7f3e4c09d6f0 legacy=0x7f3e4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 -- 172.21.15.19:0/3527936276 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c09a500 con 0x7f3e4c139170 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.619+0000 7f3e50c36700 1 --2- 172.21.15.19:0/3527936276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e80 tx=0x7f3e4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3297cec24eb251d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.620+0000 7f3e4affd700 1 -- 172.21.15.19:0/3527936276 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400e070 con 0x7f3e4c139170 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.620+0000 7f3e4affd700 1 -- 172.21.15.19:0/3527936276 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400b980 con 0x7f3e4c139170 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.620+0000 7f3e4affd700 1 -- 172.21.15.19:0/3527936276 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400bd30 con 0x7f3e4c139170 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 -- 172.21.15.19:0/3527936276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 msgr2=0x7f3e4c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 --2- 172.21.15.19:0/3527936276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009e80 tx=0x7f3e4400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 -- 172.21.15.19:0/3527936276 shutdown_connections 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 --2- 172.21.15.19:0/3527936276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c139170 0x7f3e4c13b550 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 --2- 172.21.15.19:0/3527936276 >> v2:172.21.15.19:3300/0 conn(0x7f3e4c09e1d0 0x7f3e4c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 -- 172.21.15.19:0/3527936276 >> 172.21.15.19:0/3527936276 conn(0x7f3e4c066f50 msgr2=0x7f3e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 -- 172.21.15.19:0/3527936276 shutdown_connections 2023-10-03T10:17:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.621+0000 7f3e52699700 1 -- 172.21.15.19:0/3527936276 wait complete. 2023-10-03T10:17:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.622+0000 7f3e52699700 1 Processor -- start 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.622+0000 7f3e52699700 1 -- start start 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c09e1d0 0x7f3e4c11ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e4c139170 0x7f3e4c11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c121e90 con 0x7f3e4c09e1d0 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c09c710 con 0x7f3e4c139170 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e52699700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c120550 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60588/0 (socket says 172.21.15.19:60588) 2023-10-03T10:17:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 -- 172.21.15.19:0/2670846255 learned_addr learned my addr 172.21.15.19:0/2670846255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4b7fe700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c09e1d0 0x7f3e4c11ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e50c36700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e4c139170 0x7f3e4c11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 -- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e4c139170 msgr2=0x7f3e4c11f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e4c139170 0x7f3e4c11f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 -- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c09e1d0 msgr2=0x7f3e4c11ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.623+0000 7f3e4bfff700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c09e1d0 0x7f3e4c11ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e4bfff700 1 -- 172.21.15.19:0/2670846255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e44009b30 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e4bfff700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c510 tx=0x7f3e3c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0052d0 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c005430 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0038c0 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0a1a10 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.624+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c121b40 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.625+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e3c003a20 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.625+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c120c90 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.626+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e3c03ea90 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.635+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e3c018260 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.710+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7da4074ea0 con 0x7f7da409f650 2023-10-03T10:17:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.711+0000 7f7d9a7fc700 1 -- 172.21.15.19:0/2859905451 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d9c017070 con 0x7f7da409f650 2023-10-03T10:17:23.712 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 msgr2=0x7f7da41a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00c7d0 tx=0x7f7d9c00cae0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 shutdown_connections 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da409f650 0x7f7da41a6a30 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da409e930 0x7f7da41a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 --2- 172.21.15.19:0/2859905451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da409f240 0x7f7da41a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 >> 172.21.15.19:0/2859905451 conn(0x7f7da40a4210 msgr2=0x7f7da41bb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 shutdown_connections 2023-10-03T10:17:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.714+0000 7f7dabfaa700 1 -- 172.21.15.19:0/2859905451 wait complete. 2023-10-03T10:17:23.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.793+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe58809e420 con 0x7fe588133e30 2023-10-03T10:17:23.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.793+0000 7fe57e7fc700 1 -- 172.21.15.19:0/2945936497 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe58809e420 con 0x7fe588133e30 2023-10-03T10:17:23.794 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 msgr2=0x7fe58809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe57800ebe0 tx=0x7fe57800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 shutdown_connections 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe588134260 0x7fe58809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe588133420 0x7fe58809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 --2- 172.21.15.19:0/2945936497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe588133e30 0x7fe58809c9c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 >> 172.21.15.19:0/2945936497 conn(0x7fe5880a4210 msgr2=0x7fe5880a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 shutdown_connections 2023-10-03T10:17:23.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.796+0000 7fe59019e700 1 -- 172.21.15.19:0/2945936497 wait complete. 2023-10-03T10:17:23.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.807+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f90b406b9e0 con 0x7f90b4130e50 2023-10-03T10:17:23.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.808+0000 7f90a9ffb700 1 -- 172.21.15.19:0/2531781063 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90ac017020 con 0x7f90b4130e50 2023-10-03T10:17:23.809 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:23.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 msgr2=0x7f90b411a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f90ac00cb40 tx=0x7f90ac00ce50 comp rx=0 tx=0).stop 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 shutdown_connections 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90b4130e50 0x7f90b411a570 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90b406fb20 0x7f90b41cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 --2- 172.21.15.19:0/2531781063 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90b4130540 0x7f90b41ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 >> 172.21.15.19:0/2531781063 conn(0x7f90b40a2aa0 msgr2=0x7f90b412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 shutdown_connections 2023-10-03T10:17:23.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.810+0000 7f90bb8e6700 1 -- 172.21.15.19:0/2531781063 wait complete. 2023-10-03T10:17:23.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:23.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.863+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3e4c09f420 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.864+0000 7f3e48ff9700 1 -- 172.21.15.19:0/2670846255 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e3c017030 con 0x7f3e4c09d6f0 2023-10-03T10:17:23.865 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:23.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 msgr2=0x7f3e4c11e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:23.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00c510 tx=0x7f3e3c00c820 comp rx=0 tx=0).stop 2023-10-03T10:17:23.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 shutdown_connections 2023-10-03T10:17:23.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e4c139170 0x7f3e4c11f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e4c09d6f0 0x7f3e4c11e8c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 --2- 172.21.15.19:0/2670846255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e4c09e1d0 0x7f3e4c11ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 >> 172.21.15.19:0/2670846255 conn(0x7f3e4c066f50 msgr2=0x7f3e4c09b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 shutdown_connections 2023-10-03T10:17:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:23.866+0000 7f3e52699700 1 -- 172.21.15.19:0/2670846255 wait complete. 2023-10-03T10:17:23.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:24.738 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:24.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:24.826 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:24.881 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:24.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 Processor -- start 2023-10-03T10:17:24.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 -- start start 2023-10-03T10:17:24.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d0070940 con 0x7fb4d009f240 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d006fd60 con 0x7fb4d009e930 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.888+0000 7fb4d5942700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d006fa80 con 0x7fb4d009f650 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4cf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60466/0 (socket says 172.21.15.19:60466) 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 -- 172.21.15.19:0/497396219 learned_addr learned my addr 172.21.15.19:0/497396219 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:24.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4cf7fe700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60600/0 (socket says 172.21.15.19:60600) 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4cdffb700 1 -- 172.21.15.19:0/497396219 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977864691 0 0) 0x7fb4d0070940 con 0x7fb4d009f240 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4cdffb700 1 -- 172.21.15.19:0/497396219 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b80035b0 con 0x7fb4d009f240 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 -- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 msgr2=0x7fb4d0131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 -- 172.21.15.19:0/497396219 >> v1:172.21.15.19:6789/0 conn(0x7fb4d009f240 legacy=0x7fb4d01317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4ceffd700 1 -- 172.21.15.19:0/497396219 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d009fb60 con 0x7fb4d009e930 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.889+0000 7fb4cf7fe700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:24.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.890+0000 7fb4ceffd700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009920 tx=0x7fb4c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69f7a08ad8bd3e1f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.890+0000 7fb4cdffb700 1 -- 172.21.15.19:0/497396219 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0011830 con 0x7fb4d009e930 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.890+0000 7fb4cdffb700 1 -- 172.21.15.19:0/497396219 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c0011990 con 0x7fb4d009e930 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.890+0000 7fb4cdffb700 1 -- 172.21.15.19:0/497396219 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0011d00 con 0x7fb4d009e930 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 -- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 msgr2=0x7fb4d009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4c0009920 tx=0x7fb4c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 -- 172.21.15.19:0/497396219 shutdown_connections 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009f650 0x7fb4d0131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 --2- 172.21.15.19:0/497396219 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009e930 0x7fb4d009ed00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 -- 172.21.15.19:0/497396219 >> 172.21.15.19:0/497396219 conn(0x7fb4d00a4210 msgr2=0x7fb4d00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 -- 172.21.15.19:0/497396219 shutdown_connections 2023-10-03T10:17:24.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.891+0000 7fb4d5942700 1 -- 172.21.15.19:0/497396219 wait complete. 2023-10-03T10:17:24.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.892+0000 7fb4d5942700 1 Processor -- start 2023-10-03T10:17:24.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 -- start start 2023-10-03T10:17:24.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009f240 0x7fb4d006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d009f650 0x7fb4d006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d01a95e0 con 0x7fb4d009f650 2023-10-03T10:17:24.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d006d4c0 con 0x7fb4d009f240 2023-10-03T10:17:24.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.893+0000 7fb4d5942700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d01a9280 con 0x7fb4d009e930 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60602/0 (socket says 172.21.15.19:60602) 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 -- 172.21.15.19:0/2790193066 learned_addr learned my addr 172.21.15.19:0/2790193066 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4cf7fe700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d009f650 0x7fb4d006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ce7fc700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009f240 0x7fb4d006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 -- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009f240 msgr2=0x7fb4d006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009f240 0x7fb4d006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 -- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d009f650 msgr2=0x7fb4d006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d009f650 0x7fb4d006c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 -- 172.21.15.19:0/2790193066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8009a70 con 0x7fb4d009e930 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4ceffd700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00a0b00 tx=0x7fb4c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.894+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0004240 con 0x7fb4d009e930 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.895+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c001f070 con 0x7fb4d009e930 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.895+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c00045a0 con 0x7fb4d009e930 2023-10-03T10:17:24.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.895+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c0009550 con 0x7fb4d009e930 2023-10-03T10:17:24.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.895+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d00a0190 con 0x7fb4d009e930 2023-10-03T10:17:24.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.896+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4c0021030 con 0x7fb4d009e930 2023-10-03T10:17:24.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.896+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4c0040760 con 0x7fb4d009e930 2023-10-03T10:17:24.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.896+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d01a0b30 con 0x7fb4d009e930 2023-10-03T10:17:24.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.901+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4c0015080 con 0x7fb4d009e930 2023-10-03T10:17:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.961+0000 7f1fb435c700 1 Processor -- start 2023-10-03T10:17:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.961+0000 7f1fb435c700 1 -- start start 2023-10-03T10:17:24.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1fac09e000 0x7f1fac1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09e410 0x7f1fac133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac06b460 con 0x7f1fac09e000 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09b120 con 0x7f1fac09d6f0 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb435c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac09a7e0 con 0x7f1fac09e410 2023-10-03T10:17:24.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60472/0 (socket says 172.21.15.19:60472) 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 -- 172.21.15.19:0/3020267157 learned_addr learned my addr 172.21.15.19:0/3020267157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb18f7700 1 --2- 172.21.15.19:0/3020267157 >> v2:172.21.15.19:3300/0 conn(0x7f1fac09e000 0x7f1fac1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb28f9700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09e410 0x7f1fac133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 -- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09e410 msgr2=0x7f1fac133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09e410 0x7f1fac133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 -- 172.21.15.19:0/3020267157 >> v2:172.21.15.19:3300/0 conn(0x7f1fac09e000 msgr2=0x7f1fac1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 --2- 172.21.15.19:0/3020267157 >> v2:172.21.15.19:3300/0 conn(0x7f1fac09e000 0x7f1fac1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.962+0000 7f1fb20f8700 1 -- 172.21.15.19:0/3020267157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac09a500 con 0x7f1fac09d6f0 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb20f8700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8013de0 tx=0x7f1fa8009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=471e2190f9e6c70 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb10f6700 1 -- 172.21.15.19:0/3020267157 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80128e0 con 0x7f1fac09d6f0 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb10f6700 1 -- 172.21.15.19:0/3020267157 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8012a40 con 0x7f1fac09d6f0 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb10f6700 1 -- 172.21.15.19:0/3020267157 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8012dd0 con 0x7f1fac09d6f0 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb435c700 1 -- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 msgr2=0x7f1fac09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.963+0000 7f1fb435c700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8013de0 tx=0x7f1fa8009710 comp rx=0 tx=0).stop 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 -- 172.21.15.19:0/3020267157 shutdown_connections 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09d6f0 0x7f1fac09dac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 --2- 172.21.15.19:0/3020267157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09e410 0x7f1fac133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 --2- 172.21.15.19:0/3020267157 >> v2:172.21.15.19:3300/0 conn(0x7f1fac09e000 0x7f1fac1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 -- 172.21.15.19:0/3020267157 >> 172.21.15.19:0/3020267157 conn(0x7f1fac066f50 msgr2=0x7f1fac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:24.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 -- 172.21.15.19:0/3020267157 shutdown_connections 2023-10-03T10:17:24.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.964+0000 7f1fb435c700 1 -- 172.21.15.19:0/3020267157 wait complete. 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 Processor -- start 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 -- start start 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09d6f0 0x7f1fac11ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09e410 0x7f1fac11b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac11e680 con 0x7f1fac09e000 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac11dc30 con 0x7f1fac09e410 2023-10-03T10:17:24.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb435c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac11e880 con 0x7f1fac09d6f0 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb18f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.965+0000 7f1fb18f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43472/0 (socket says 172.21.15.19:43472) 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 -- 172.21.15.19:0/2031481250 learned_addr learned my addr 172.21.15.19:0/2031481250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb28f9700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09e410 0x7f1fac11b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 -- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09d6f0 msgr2=0x7f1fac11ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09d6f0 0x7f1fac11ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 -- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09e410 msgr2=0x7f1fac11b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09e410 0x7f1fac11b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 -- 172.21.15.19:0/2031481250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8013a10 con 0x7f1fac09e000 2023-10-03T10:17:24.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb18f7700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00e980 tx=0x7f1f9c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00eed0 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00c850 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00cbc0 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fac11d770 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.966+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac09c710 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.967+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac074ea0 con 0x7f1fac09e000 2023-10-03T10:17:24.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.968+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f9c00cd20 con 0x7f1fac09e000 2023-10-03T10:17:24.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.969+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f9c0400a0 con 0x7f1fac09e000 2023-10-03T10:17:24.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:24.977+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f9c024350 con 0x7f1fac09e000 2023-10-03T10:17:25.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.026+0000 7fbbf2701700 1 Processor -- start 2023-10-03T10:17:25.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.026+0000 7fbbf2701700 1 -- start start 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf2701700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbec09e930 0x7fbbec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf2701700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf2701700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec070940 con 0x7fbbec09f650 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf2701700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec06fd60 con 0x7fbbec09e930 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf2701700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec06fa80 con 0x7fbbec09f240 2023-10-03T10:17:25.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf0c9e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbbec09f650 0x7fbbec131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40258/0 (socket says 172.21.15.19:40258) 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbf0c9e700 1 -- 172.21.15.19:0/1591902396 learned_addr learned my addr 172.21.15.19:0/1591902396 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 --2- 172.21.15.19:0/1591902396 >> v2:172.21.15.19:3300/0 conn(0x7fbbec09e930 0x7fbbec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 -- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 msgr2=0x7fbbec1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 --2- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 -- 172.21.15.19:0/1591902396 >> v1:172.21.15.19:6789/0 conn(0x7fbbec09f650 legacy=0x7fbbec131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 -- 172.21.15.19:0/1591902396 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec09fb60 con 0x7fbbec09e930 2023-10-03T10:17:25.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.027+0000 7fbbebfff700 1 --2- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09e930 0x7fbbec09ed00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009840 tx=0x7fbbdc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949f991f217f83f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbeaffd700 1 -- 172.21.15.19:0/1591902396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011830 con 0x7fbbec09e930 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbeaffd700 1 -- 172.21.15.19:0/1591902396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc011990 con 0x7fbbec09e930 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbeaffd700 1 -- 172.21.15.19:0/1591902396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011d20 con 0x7fbbec09e930 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 -- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09e930 msgr2=0x7fbbec09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 --2- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09e930 0x7fbbec09ed00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009840 tx=0x7fbbdc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 -- 172.21.15.19:0/1591902396 shutdown_connections 2023-10-03T10:17:25.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 --2- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09e930 0x7fbbec09ed00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 --2- 172.21.15.19:0/1591902396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.028+0000 7fbbf2701700 1 -- 172.21.15.19:0/1591902396 >> 172.21.15.19:0/1591902396 conn(0x7fbbec0a4210 msgr2=0x7fbbec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.029+0000 7fbbf2701700 1 -- 172.21.15.19:0/1591902396 shutdown_connections 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.029+0000 7fbbf2701700 1 -- 172.21.15.19:0/1591902396 wait complete. 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.030+0000 7fbbf2701700 1 Processor -- start 2023-10-03T10:17:25.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.030+0000 7fbbf2701700 1 -- start start 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbec09e930 0x7fbbec1a3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09f650 0x7fbbec1a4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec1a70a0 con 0x7fbbec09f650 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec071d20 con 0x7fbbec09f240 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf2701700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0a3460 con 0x7fbbec09e930 2023-10-03T10:17:25.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbeb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbeb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60500/0 (socket says 172.21.15.19:60500) 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbeb7fe700 1 -- 172.21.15.19:0/899925902 learned_addr learned my addr 172.21.15.19:0/899925902 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.031+0000 7fbbf0c9e700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09f650 0x7fbbec1a4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 -- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbec09e930 msgr2=0x7fbbec1a3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbec09e930 0x7fbbec1a3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 -- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09f650 msgr2=0x7fbbec1a4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09f650 0x7fbbec1a4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 -- 172.21.15.19:0/899925902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094a0 con 0x7fbbec09f240 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbeb7fe700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b530 tx=0x7fbbe000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011830 con 0x7fbbec09f240 2023-10-03T10:17:25.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0011990 con 0x7fbbec09f240 2023-10-03T10:17:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0011d20 con 0x7fbbec09f240 2023-10-03T10:17:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec0a0190 con 0x7fbbec09f240 2023-10-03T10:17:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.032+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec1a6c50 con 0x7fbbec09f240 2023-10-03T10:17:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.033+0000 7f839e626700 1 Processor -- start 2023-10-03T10:17:25.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 -- start start 2023-10-03T10:17:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec1a74b0 con 0x7fbbec09f240 2023-10-03T10:17:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8398138dd0 0x7f839813b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbe001a400 con 0x7fbbec09f240 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8398099ef0 con 0x7f8398071b40 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8398099500 con 0x7f8398138dd0 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f839e626700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398099c10 con 0x7f8398130b30 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f83977fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f83977fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60504/0 (socket says 172.21.15.19:60504) 2023-10-03T10:17:25.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.034+0000 7f83977fe700 1 -- 172.21.15.19:0/2817904530 learned_addr learned my addr 172.21.15.19:0/2817904530 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbbe003f6b0 con 0x7fbbec09f240 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7f83977fe700 1 -- 172.21.15.19:0/2817904530 >> v2:172.21.15.19:3300/0 conn(0x7f8398138dd0 msgr2=0x7f839813b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7f83977fe700 1 --2- 172.21.15.19:0/2817904530 >> v2:172.21.15.19:3300/0 conn(0x7f8398138dd0 0x7f839813b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7f83977fe700 1 -- 172.21.15.19:0/2817904530 >> v1:172.21.15.19:6789/0 conn(0x7f8398071b40 legacy=0x7f8398130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7f83977fe700 1 -- 172.21.15.19:0/2817904530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398130f20 con 0x7f8398130b30 2023-10-03T10:17:25.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.035+0000 7f83977fe700 1 --2- 172.21.15.19:0/2817904530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f838c009920 tx=0x7f838c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25799b240fc3dc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.044+0000 7f8396ffd700 1 -- 172.21.15.19:0/2817904530 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c004230 con 0x7f8398130b30 2023-10-03T10:17:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.044+0000 7f8396ffd700 1 -- 172.21.15.19:0/2817904530 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c004390 con 0x7f8398130b30 2023-10-03T10:17:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.044+0000 7f8396ffd700 1 -- 172.21.15.19:0/2817904530 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c009e70 con 0x7f8398130b30 2023-10-03T10:17:25.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.044+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbe000f8d0 con 0x7fbbec09f240 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 -- 172.21.15.19:0/2817904530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 msgr2=0x7f8398138890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 --2- 172.21.15.19:0/2817904530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f838c009920 tx=0x7f838c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 -- 172.21.15.19:0/2817904530 shutdown_connections 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 --2- 172.21.15.19:0/2817904530 >> v2:172.21.15.19:3300/0 conn(0x7f8398138dd0 0x7f839813b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 --2- 172.21.15.19:0/2817904530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398130b30 0x7f8398138890 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 -- 172.21.15.19:0/2817904530 >> 172.21.15.19:0/2817904530 conn(0x7f839809e7e0 msgr2=0x7f839809ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 -- 172.21.15.19:0/2817904530 shutdown_connections 2023-10-03T10:17:25.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.045+0000 7f839e626700 1 -- 172.21.15.19:0/2817904530 wait complete. 2023-10-03T10:17:25.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.046+0000 7f839e626700 1 Processor -- start 2023-10-03T10:17:25.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.046+0000 7f839e626700 1 -- start start 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398071b40 0x7f83981372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8398130b30 0x7f83981377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398136210 con 0x7f8398130b30 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398138ad0 con 0x7f8398071b40 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839e626700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f839809c150 con 0x7f8398138dd0 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:60630/0 (socket says 172.21.15.19:60630) 2023-10-03T10:17:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 -- 172.21.15.19:0/83059755 learned_addr learned my addr 172.21.15.19:0/83059755 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f8397fff700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398071b40 0x7f83981372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 -- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398071b40 msgr2=0x7f83981372b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398071b40 0x7f83981372b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 -- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8398130b30 msgr2=0x7f83981377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8398130b30 0x7f83981377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.047+0000 7f839cbc3700 1 -- 172.21.15.19:0/83059755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c009550 con 0x7f8398138dd0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f839cbc3700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f839000b9e0 tx=0x7f839000bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839000c9b0 con 0x7f8398138dd0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839000cb10 con 0x7f8398138dd0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8390014440 con 0x7f8398138dd0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398134850 con 0x7f8398138dd0 2023-10-03T10:17:25.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.048+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83981369a0 con 0x7f8398138dd0 2023-10-03T10:17:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.049+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f839001d3b0 con 0x7f8398138dd0 2023-10-03T10:17:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.049+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83980747f0 con 0x7f8398138dd0 2023-10-03T10:17:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.049+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8390006e40 con 0x7f8398138dd0 2023-10-03T10:17:25.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.054+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f839001c360 con 0x7f8398138dd0 2023-10-03T10:17:25.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.136+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4d00a3260 con 0x7fb4d009e930 2023-10-03T10:17:25.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.136+0000 7fb4b7fff700 1 -- 172.21.15.19:0/2790193066 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4c001a450 con 0x7fb4d009e930 2023-10-03T10:17:25.136 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 msgr2=0x7fb4d006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00a0b00 tx=0x7fb4c0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 shutdown_connections 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4d009f650 0x7fb4d006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4d009e930 0x7fb4d006b8b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 --2- 172.21.15.19:0/2790193066 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4d009f240 0x7fb4d006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 >> 172.21.15.19:0/2790193066 conn(0x7fb4d00a4210 msgr2=0x7fb4d01b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 shutdown_connections 2023-10-03T10:17:25.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.139+0000 7fb4d5942700 1 -- 172.21.15.19:0/2790193066 wait complete. 2023-10-03T10:17:25.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:25.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.241+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1fac06c360 con 0x7f1fac09e000 2023-10-03T10:17:25.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.241+0000 7f1fa2ffd700 1 -- 172.21.15.19:0/2031481250 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f9c021020 con 0x7f1fac09e000 2023-10-03T10:17:25.241 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.243+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 msgr2=0x7f1fac11b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.243+0000 7f1fb435c700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00e980 tx=0x7f1f9c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 shutdown_connections 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1fac09e410 0x7f1fac11b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1fac09d6f0 0x7f1fac11ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 --2- 172.21.15.19:0/2031481250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1fac09e000 0x7f1fac11b2a0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 >> 172.21.15.19:0/2031481250 conn(0x7f1fac066f50 msgr2=0x7f1fac133cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 shutdown_connections 2023-10-03T10:17:25.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.244+0000 7f1fb435c700 1 -- 172.21.15.19:0/2031481250 wait complete. 2023-10-03T10:17:25.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.261+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f839806b250 con 0x7f8398138dd0 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.261+0000 7f8394ff9700 1 -- 172.21.15.19:0/83059755 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8390019020 con 0x7f8398138dd0 2023-10-03T10:17:25.261 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 msgr2=0x7f83981cc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f839000b9e0 tx=0x7f839000bda0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 shutdown_connections 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398138dd0 0x7f83981cc810 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398071b40 0x7f83981372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 --2- 172.21.15.19:0/83059755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8398130b30 0x7f83981377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 >> 172.21.15.19:0/83059755 conn(0x7f839809e7e0 msgr2=0x7f839813a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 shutdown_connections 2023-10-03T10:17:25.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.264+0000 7f839e626700 1 -- 172.21.15.19:0/83059755 wait complete. 2023-10-03T10:17:25.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.279+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbbec09ffe0 con 0x7fbbec09f240 2023-10-03T10:17:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.279+0000 7fbbe8ff9700 1 -- 172.21.15.19:0/899925902 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbe0015020 con 0x7fbbec09f240 2023-10-03T10:17:25.279 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 msgr2=0x7fbbec1a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000b530 tx=0x7fbbe000b840 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 shutdown_connections 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbec09f650 0x7fbbec1a4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbec09e930 0x7fbbec1a3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 --2- 172.21.15.19:0/899925902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbec09f240 0x7fbbec1a4410 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 >> 172.21.15.19:0/899925902 conn(0x7fbbec0a4210 msgr2=0x7fbbec1b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 shutdown_connections 2023-10-03T10:17:25.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:25.282+0000 7fbbf2701700 1 -- 172.21.15.19:0/899925902 wait complete. 2023-10-03T10:17:25.295 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:26.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:26.258 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:26.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:26.296 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:26.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.305+0000 7f35a7d97700 1 Processor -- start 2023-10-03T10:17:26.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.305+0000 7f35a7d97700 1 -- start start 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f35a009e410 0x7f35a0130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a009f520 con 0x7f35a009e410 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a009f130 con 0x7f35a009e000 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a7d97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a009e930 con 0x7f35a009d6f0 2023-10-03T10:17:26.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a5332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a5b33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a5332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60532/0 (socket says 172.21.15.19:60532) 2023-10-03T10:17:26.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.306+0000 7f35a5332700 1 -- 172.21.15.19:0/2909418887 learned_addr learned my addr 172.21.15.19:0/2909418887 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:26.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a6334700 1 --2- 172.21.15.19:0/2909418887 >> v2:172.21.15.19:3300/0 conn(0x7f35a009e410 0x7f35a0130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 -- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 msgr2=0x7f35a0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 --2- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 -- 172.21.15.19:0/2909418887 >> v2:172.21.15.19:3300/0 conn(0x7f35a009e410 msgr2=0x7f35a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 --2- 172.21.15.19:0/2909418887 >> v2:172.21.15.19:3300/0 conn(0x7f35a009e410 0x7f35a0130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 -- 172.21.15.19:0/2909418887 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a009b2d0 con 0x7f35a009d6f0 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a5b33700 1 --2- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a009dac0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f359c00bb10 tx=0x7f359c00be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b22a4d5925d1aaab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a4b31700 1 -- 172.21.15.19:0/2909418887 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00dc30 con 0x7f35a009d6f0 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a4b31700 1 -- 172.21.15.19:0/2909418887 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c00dd90 con 0x7f35a009d6f0 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.307+0000 7f35a4b31700 1 -- 172.21.15.19:0/2909418887 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c010690 con 0x7f35a009d6f0 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 -- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 msgr2=0x7f35a009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a009dac0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f359c00bb10 tx=0x7f359c00be20 comp rx=0 tx=0).stop 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 -- 172.21.15.19:0/2909418887 shutdown_connections 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2909418887 >> v2:172.21.15.19:3300/0 conn(0x7f35a009e410 0x7f35a0130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a009dac0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2909418887 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.308+0000 7f35a7d97700 1 -- 172.21.15.19:0/2909418887 >> 172.21.15.19:0/2909418887 conn(0x7f35a0066f50 msgr2=0x7f35a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.309+0000 7f35a7d97700 1 -- 172.21.15.19:0/2909418887 shutdown_connections 2023-10-03T10:17:26.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.309+0000 7f35a7d97700 1 -- 172.21.15.19:0/2909418887 wait complete. 2023-10-03T10:17:26.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.311+0000 7f35a7d97700 1 Processor -- start 2023-10-03T10:17:26.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.311+0000 7f35a7d97700 1 -- start start 2023-10-03T10:17:26.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a011e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35a009e410 0x7f35a011ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a011f760 con 0x7f35a009e410 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0120490 con 0x7f35a009e000 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a7d97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01301c0 con 0x7f35a009d6f0 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:60540/0 (socket says 172.21.15.19:60540) 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 -- 172.21.15.19:0/2673904919 learned_addr learned my addr 172.21.15.19:0/2673904919 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a6334700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35a009e410 0x7f35a011ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 -- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 msgr2=0x7f35a011e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a011e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 -- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35a009e410 msgr2=0x7f35a011ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35a009e410 0x7f35a011ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 -- 172.21.15.19:0/2673904919 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c00b740 con 0x7f35a009e000 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.312+0000 7f35a5332700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f359000b140 tx=0x7f359000b450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.313+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590019070 con 0x7f35a009e000 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.313+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359000bd90 con 0x7f35a009e000 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.313+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0121d80 con 0x7f35a009e000 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.313+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0121aa0 con 0x7f35a009e000 2023-10-03T10:17:26.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.314+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359001d610 con 0x7f35a009e000 2023-10-03T10:17:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.314+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35880052e0 con 0x7f35a009e000 2023-10-03T10:17:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.315+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f359001d770 con 0x7f35a009e000 2023-10-03T10:17:26.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.315+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3590047320 con 0x7f35a009e000 2023-10-03T10:17:26.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.321+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f359001dcb0 con 0x7f35a009e000 2023-10-03T10:17:26.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.415+0000 7f5a0aef9700 1 Processor -- start 2023-10-03T10:17:26.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.415+0000 7f5a0aef9700 1 -- start start 2023-10-03T10:17:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a0aef9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5a040a0a30 0x7f5a040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a0aef9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a0409d630 0x7f5a040a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a0aef9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a040a2a70 con 0x7f5a04133930 2023-10-03T10:17:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a0aef9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a040a01d0 con 0x7f5a040a0a30 2023-10-03T10:17:26.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a0aef9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0409e2b0 con 0x7f5a0409d630 2023-10-03T10:17:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a09496700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5a04133930 0x7f5a04133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34374/0 (socket says 172.21.15.19:34374) 2023-10-03T10:17:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a03fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a0409d630 0x7f5a040a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a09496700 1 -- 172.21.15.19:0/526138521 learned_addr learned my addr 172.21.15.19:0/526138521 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.416+0000 7f5a08c95700 1 --2- 172.21.15.19:0/526138521 >> v2:172.21.15.19:3300/0 conn(0x7f5a040a0a30 0x7f5a040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a037fe700 1 -- 172.21.15.19:0/526138521 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507685497 0 0) 0x7f5a040a2a70 con 0x7f5a04133930 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a08c95700 1 -- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a0409d630 msgr2=0x7f5a040a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a08c95700 1 --2- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a0409d630 0x7f5a040a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a08c95700 1 -- 172.21.15.19:0/526138521 >> v1:172.21.15.19:6789/0 conn(0x7f5a04133930 legacy=0x7f5a04133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a08c95700 1 -- 172.21.15.19:0/526138521 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0409dc50 con 0x7f5a040a0a30 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a08c95700 1 --2- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a040a0a30 0x7f5a040a0e00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009840 tx=0x7f59f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255e7b27265537e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a037fe700 1 -- 172.21.15.19:0/526138521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8011830 con 0x7f5a040a0a30 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a037fe700 1 -- 172.21.15.19:0/526138521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f8011990 con 0x7f5a040a0a30 2023-10-03T10:17:26.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.417+0000 7f5a037fe700 1 -- 172.21.15.19:0/526138521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8011d20 con 0x7f5a040a0a30 2023-10-03T10:17:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 -- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a040a0a30 msgr2=0x7f5a040a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a040a0a30 0x7f5a040a0e00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f59f8009840 tx=0x7f59f8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 -- 172.21.15.19:0/526138521 shutdown_connections 2023-10-03T10:17:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a040a0a30 0x7f5a040a0e00 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/526138521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a0409d630 0x7f5a040a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 -- 172.21.15.19:0/526138521 >> 172.21.15.19:0/526138521 conn(0x7f5a040a3050 msgr2=0x7f5a040a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.418+0000 7f5a0aef9700 1 -- 172.21.15.19:0/526138521 shutdown_connections 2023-10-03T10:17:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.419+0000 7f5a0aef9700 1 -- 172.21.15.19:0/526138521 wait complete. 2023-10-03T10:17:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.420+0000 7f5a0aef9700 1 Processor -- start 2023-10-03T10:17:26.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.420+0000 7f5a0aef9700 1 -- start start 2023-10-03T10:17:26.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a040a0a30 0x7f5a04132880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 0x7f5a04132dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04121240 con 0x7f5a0409d630 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a041204d0 con 0x7f5a04133930 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a0aef9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a04121e40 con 0x7f5a040a0a30 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a08c95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a08c95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40300/0 (socket says 172.21.15.19:40300) 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a08c95700 1 -- 172.21.15.19:0/3986919514 learned_addr learned my addr 172.21.15.19:0/3986919514 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a09496700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 0x7f5a04132dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.421+0000 7f5a03fff700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a040a0a30 0x7f5a04132880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 -- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a040a0a30 msgr2=0x7f5a04132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a040a0a30 0x7f5a04132880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 -- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 msgr2=0x7f5a04132dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 0x7f5a04132dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 -- 172.21.15.19:0/3986919514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80094a0 con 0x7f5a0409d630 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a09496700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 0x7f5a04132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:26.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a08c95700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f59f80090b0 tx=0x7f59f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f8004480 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f801f070 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f80038c0 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a040a4250 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.422+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a04133370 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.424+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a040747f0 con 0x7f5a0409d630 2023-10-03T10:17:26.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.424+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f59f8021030 con 0x7f5a0409d630 2023-10-03T10:17:26.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.424+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f59f80408c0 con 0x7f5a0409d630 2023-10-03T10:17:26.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.433+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f59f80199a0 con 0x7f5a0409d630 2023-10-03T10:17:26.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.450+0000 7f56af11b700 1 Processor -- start 2023-10-03T10:17:26.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.450+0000 7f56af11b700 1 -- start start 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56af11b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56a809d6f0 0x7f56a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56af11b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 0x7f56a8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56af11b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a809f130 con 0x7f56a809e000 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56af11b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a809f520 con 0x7f56a809d6f0 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56af11b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a809e930 con 0x7f56a809e410 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56a7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56a809e000 0x7f56a8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34382/0 (socket says 172.21.15.19:34382) 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56a7fff700 1 -- 172.21.15.19:0/1369878445 learned_addr learned my addr 172.21.15.19:0/1369878445 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:26.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56ad6b8700 1 --2- 172.21.15.19:0/1369878445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 0x7f56a8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56a77fe700 1 -- 172.21.15.19:0/1369878445 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324694375 0 0) 0x7f56a809f130 con 0x7f56a809e000 2023-10-03T10:17:26.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56aceb7700 1 --2- 172.21.15.19:0/1369878445 >> v2:172.21.15.19:3300/0 conn(0x7f56a809d6f0 0x7f56a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56a77fe700 1 -- 172.21.15.19:0/1369878445 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56980035b0 con 0x7f56a809e000 2023-10-03T10:17:26.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.451+0000 7f56ad6b8700 1 -- 172.21.15.19:0/1369878445 >> v2:172.21.15.19:3300/0 conn(0x7f56a809d6f0 msgr2=0x7f56a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56ad6b8700 1 --2- 172.21.15.19:0/1369878445 >> v2:172.21.15.19:3300/0 conn(0x7f56a809d6f0 0x7f56a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56ad6b8700 1 -- 172.21.15.19:0/1369878445 >> v1:172.21.15.19:6789/0 conn(0x7f56a809e000 legacy=0x7f56a8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56ad6b8700 1 -- 172.21.15.19:0/1369878445 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a809b2d0 con 0x7f56a809e410 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56ad6b8700 1 --2- 172.21.15.19:0/1369878445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 0x7f56a8130d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f56a000bfa0 tx=0x7f56a000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93ed6a8ec02a5d9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56a77fe700 1 -- 172.21.15.19:0/1369878445 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0010070 con 0x7f56a809e410 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56a77fe700 1 -- 172.21.15.19:0/1369878445 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a000b2e0 con 0x7f56a809e410 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.452+0000 7f56a77fe700 1 -- 172.21.15.19:0/1369878445 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a000dc40 con 0x7f56a809e410 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 -- 172.21.15.19:0/1369878445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 msgr2=0x7f56a8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 --2- 172.21.15.19:0/1369878445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 0x7f56a8130d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f56a000bfa0 tx=0x7f56a000d330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 -- 172.21.15.19:0/1369878445 shutdown_connections 2023-10-03T10:17:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 --2- 172.21.15.19:0/1369878445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809e410 0x7f56a8130d70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 --2- 172.21.15.19:0/1369878445 >> v2:172.21.15.19:3300/0 conn(0x7f56a809d6f0 0x7f56a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 -- 172.21.15.19:0/1369878445 >> 172.21.15.19:0/1369878445 conn(0x7f56a8066f50 msgr2=0x7f56a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 -- 172.21.15.19:0/1369878445 shutdown_connections 2023-10-03T10:17:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.453+0000 7f56af11b700 1 -- 172.21.15.19:0/1369878445 wait complete. 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.455+0000 7f56af11b700 1 Processor -- start 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.455+0000 7f56af11b700 1 -- start start 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 0x7f56a81220c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 0x7f56a8122600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 0x7f56a8122b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a80a3c70 con 0x7f56a809e000 2023-10-03T10:17:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a8125be0 con 0x7f56a809d6f0 2023-10-03T10:17:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56af11b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56a809c700 con 0x7f56a809e410 2023-10-03T10:17:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56ad6b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 0x7f56a8122b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56ad6b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 0x7f56a8122b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35656/0 (socket says 172.21.15.19:35656) 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56ad6b8700 1 -- 172.21.15.19:0/1733350257 learned_addr learned my addr 172.21.15.19:0/1733350257 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 0x7f56a81220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56a7fff700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 0x7f56a8122600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 -- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 msgr2=0x7f56a8122b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 0x7f56a8122b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 -- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 msgr2=0x7f56a8122600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 0x7f56a8122600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56aceb7700 1 -- 172.21.15.19:0/1733350257 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a000bc80 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.456+0000 7f56a7fff700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 0x7f56a8122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56aceb7700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 0x7f56a81220c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f569c00e7e0 tx=0x7f569c00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00c070 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c013610 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0139a0 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a8124f20 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.457+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a81244c0 con 0x7f56a809d6f0 2023-10-03T10:17:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 Processor -- start 2023-10-03T10:17:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a811ac20 con 0x7f56a809d6f0 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 -- start start 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09eca0 0x7fc91c13cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc91c06f050 0x7fc91c13f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c070ee0 con 0x7fc91c06e570 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c071980 con 0x7fc91c06f050 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc921c89700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c071480 con 0x7fc91c09eca0 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc91b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc91c06e570 0x7fc91c06e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34390/0 (socket says 172.21.15.19:34390) 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.458+0000 7fc91b7fe700 1 -- 172.21.15.19:0/4270028109 learned_addr learned my addr 172.21.15.19:0/4270028109 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91bfff700 1 --2- 172.21.15.19:0/4270028109 >> v2:172.21.15.19:3300/0 conn(0x7fc91c06f050 0x7fc91c13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91affd700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09eca0 0x7fc91c13cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91bfff700 1 -- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09eca0 msgr2=0x7fc91c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91bfff700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09eca0 0x7fc91c13cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91bfff700 1 -- 172.21.15.19:0/4270028109 >> v1:172.21.15.19:6789/0 conn(0x7fc91c06e570 legacy=0x7fc91c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.459+0000 7fc91bfff700 1 -- 172.21.15.19:0/4270028109 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c071b90 con 0x7fc91c06f050 2023-10-03T10:17:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f569c013b00 con 0x7f56a809d6f0 2023-10-03T10:17:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7fc91bfff700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c06f050 0x7fc91c13f3f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bbb5bb1a4165e9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f569c03fa10 con 0x7f56a809d6f0 2023-10-03T10:17:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7fc91a7fc700 1 -- 172.21.15.19:0/4270028109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400e070 con 0x7fc91c06f050 2023-10-03T10:17:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7fc91a7fc700 1 -- 172.21.15.19:0/4270028109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400bbd0 con 0x7fc91c06f050 2023-10-03T10:17:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.460+0000 7fc91a7fc700 1 -- 172.21.15.19:0/4270028109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914012430 con 0x7fc91c06f050 2023-10-03T10:17:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 -- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c06f050 msgr2=0x7fc91c13f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c06f050 0x7fc91c13f3f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 -- 172.21.15.19:0/4270028109 shutdown_connections 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c06f050 0x7fc91c13f3f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 --2- 172.21.15.19:0/4270028109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09eca0 0x7fc91c13cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 -- 172.21.15.19:0/4270028109 >> 172.21.15.19:0/4270028109 conn(0x7fc91c0a2aa0 msgr2=0x7fc91c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 -- 172.21.15.19:0/4270028109 shutdown_connections 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.461+0000 7fc921c89700 1 -- 172.21.15.19:0/4270028109 wait complete. 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 Processor -- start 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 -- start start 2023-10-03T10:17:26.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 0x7fc91c137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c138380 0x7fc91c137ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c131780 con 0x7fc91c138380 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c11a6d0 con 0x7fc91c06f050 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.462+0000 7fc921c89700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1190c0 con 0x7fc91c06e570 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51744/0 (socket says 172.21.15.19:51744) 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 -- 172.21.15.19:0/129648252 learned_addr learned my addr 172.21.15.19:0/129648252 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 0x7fc91c137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:26.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 -- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 msgr2=0x7fc91c137040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 0x7fc91c137040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 -- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c138380 msgr2=0x7fc91c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c138380 0x7fc91c137ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 -- 172.21.15.19:0/129648252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914009a70 con 0x7fc91c06f050 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 0x7fc91c137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.463+0000 7fc91affd700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc91000e810 tx=0x7fc91000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.465+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910013610 con 0x7fc91c06f050 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.465+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910013770 con 0x7fc91c06f050 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.465+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c070610 con 0x7fc91c06f050 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.465+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910013ae0 con 0x7fc91c06f050 2023-10-03T10:17:26.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.465+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c11a410 con 0x7fc91c06f050 2023-10-03T10:17:26.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.466+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f569c024940 con 0x7f56a809d6f0 2023-10-03T10:17:26.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.467+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc910013c40 con 0x7fc91c06f050 2023-10-03T10:17:26.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.467+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc91003f340 con 0x7fc91c06f050 2023-10-03T10:17:26.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.467+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c074ea0 con 0x7fc91c06f050 2023-10-03T10:17:26.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.476+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc910012370 con 0x7fc91c06f050 2023-10-03T10:17:26.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.551+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3588005590 con 0x7f35a009e000 2023-10-03T10:17:26.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.552+0000 7f35967fc700 1 -- 172.21.15.19:0/2673904919 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3590022020 con 0x7f35a009e000 2023-10-03T10:17:26.552 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:26.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 msgr2=0x7f35a011e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f359000b140 tx=0x7f359000b450 comp rx=0 tx=0).stop 2023-10-03T10:17:26.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 shutdown_connections 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35a009e410 0x7f35a011ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35a009d6f0 0x7f35a011e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 --2- 172.21.15.19:0/2673904919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35a009e000 0x7f35a011e7f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 >> 172.21.15.19:0/2673904919 conn(0x7f35a0066f50 msgr2=0x7f35a006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.554+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 shutdown_connections 2023-10-03T10:17:26.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.555+0000 7f35a7d97700 1 -- 172.21.15.19:0/2673904919 wait complete. 2023-10-03T10:17:26.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.649+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5a04072980 con 0x7f5a0409d630 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.649+0000 7f5a017fa700 1 -- 172.21.15.19:0/3986919514 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f59f8015070 con 0x7f5a0409d630 2023-10-03T10:17:26.649 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 msgr2=0x7f5a04132340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f59f80090b0 tx=0x7f59f8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 shutdown_connections 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a04133930 0x7f5a04132dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a0409d630 0x7f5a04132340 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 --2- 172.21.15.19:0/3986919514 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a040a0a30 0x7f5a04132880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 >> 172.21.15.19:0/3986919514 conn(0x7f5a040a3050 msgr2=0x7f5a041bb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 shutdown_connections 2023-10-03T10:17:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.652+0000 7f5a0aef9700 1 -- 172.21.15.19:0/3986919514 wait complete. 2023-10-03T10:17:26.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.681+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56a8125550 con 0x7f56a809d6f0 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.682+0000 7f56a57fa700 1 -- 172.21.15.19:0/1733350257 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f569c02a030 con 0x7f56a809d6f0 2023-10-03T10:17:26.681 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 msgr2=0x7f56a81220c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 0x7f56a81220c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f569c00e7e0 tx=0x7f569c00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 shutdown_connections 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56a809e410 0x7f56a8122b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56a809d6f0 0x7f56a81220c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 --2- 172.21.15.19:0/1733350257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56a809e000 0x7f56a8122600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 >> 172.21.15.19:0/1733350257 conn(0x7f56a8066f50 msgr2=0x7f56a8130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 shutdown_connections 2023-10-03T10:17:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.684+0000 7f56af11b700 1 -- 172.21.15.19:0/1733350257 wait complete. 2023-10-03T10:17:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.685+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc91c1192f0 con 0x7fc91c06f050 2023-10-03T10:17:26.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.686+0000 7fc903fff700 1 -- 172.21.15.19:0/129648252 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc910010310 con 0x7fc91c06f050 2023-10-03T10:17:26.686 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 msgr2=0x7fc91c137580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc91000e810 tx=0x7fc91000eb20 comp rx=0 tx=0).stop 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 shutdown_connections 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c138380 0x7fc91c137ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c06e570 0x7fc91c137040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 --2- 172.21.15.19:0/129648252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c06f050 0x7fc91c137580 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:26.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 >> 172.21.15.19:0/129648252 conn(0x7fc91c0a2aa0 msgr2=0x7fc91c09cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:26.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 shutdown_connections 2023-10-03T10:17:26.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:26.688+0000 7fc921c89700 1 -- 172.21.15.19:0/129648252 wait complete. 2023-10-03T10:17:26.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:26.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:27.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:27.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:27.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:27.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.721+0000 7fedb7667700 1 Processor -- start 2023-10-03T10:17:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.721+0000 7fedb7667700 1 -- start start 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb7667700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fedb009d6f0 0x7fedb009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb7667700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e410 0x7fedb0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb7667700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb009f130 con 0x7fedb009e000 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb7667700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb009f520 con 0x7fedb009d6f0 2023-10-03T10:17:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb7667700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb009e930 con 0x7fedb009e410 2023-10-03T10:17:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb5403700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fedb009d6f0 0x7fedb009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb5403700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fedb009d6f0 0x7fedb009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40330/0 (socket says 172.21.15.19:40330) 2023-10-03T10:17:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb5403700 1 -- 172.21.15.19:0/3832440120 learned_addr learned my addr 172.21.15.19:0/3832440120 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.722+0000 7fedb4c02700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fedb009e000 0x7fedb0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34402/0 (socket says 172.21.15.19:34402) 2023-10-03T10:17:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7fedb5c04700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e410 0x7fedb0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7feda7fff700 1 -- 172.21.15.19:0/3832440120 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275532248 0 0) 0x7fedb009f130 con 0x7fedb009e000 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7feda7fff700 1 -- 172.21.15.19:0/3832440120 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed9c0035b0 con 0x7fedb009e000 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7fedb5403700 1 -- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e410 msgr2=0x7fedb0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7fedb5403700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e410 0x7fedb0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7fedb5403700 1 -- 172.21.15.19:0/3832440120 >> v1:172.21.15.19:6789/0 conn(0x7fedb009e000 legacy=0x7fedb0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.723+0000 7fedb5403700 1 -- 172.21.15.19:0/3832440120 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb009b2d0 con 0x7fedb009d6f0 2023-10-03T10:17:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.724+0000 7fedb5403700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb009dac0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098f0 tx=0x7fedac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9857a596631448d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.724+0000 7feda7fff700 1 -- 172.21.15.19:0/3832440120 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011830 con 0x7fedb009d6f0 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.724+0000 7feda7fff700 1 -- 172.21.15.19:0/3832440120 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac011990 con 0x7fedb009d6f0 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.724+0000 7feda7fff700 1 -- 172.21.15.19:0/3832440120 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac011d20 con 0x7fedb009d6f0 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 -- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 msgr2=0x7fedb009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb009dac0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fedac0098f0 tx=0x7fedac009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 -- 172.21.15.19:0/3832440120 shutdown_connections 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e410 0x7fedb0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 --2- 172.21.15.19:0/3832440120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb009dac0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.725+0000 7fedb7667700 1 -- 172.21.15.19:0/3832440120 >> 172.21.15.19:0/3832440120 conn(0x7fedb0066f50 msgr2=0x7fedb009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.726+0000 7fedb7667700 1 -- 172.21.15.19:0/3832440120 shutdown_connections 2023-10-03T10:17:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.726+0000 7fedb7667700 1 -- 172.21.15.19:0/3832440120 wait complete. 2023-10-03T10:17:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 Processor -- start 2023-10-03T10:17:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 -- start start 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb011de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e000 0x7fedb011e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb011fa10 con 0x7fedb009d6f0 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb0120c60 con 0x7fedb009e000 2023-10-03T10:17:27.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb7667700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedb011fff0 con 0x7fedb009e410 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb5c04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb5c04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35692/0 (socket says 172.21.15.19:35692) 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb5c04700 1 -- 172.21.15.19:0/3529068367 learned_addr learned my addr 172.21.15.19:0/3529068367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.727+0000 7fedb5403700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb011de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb4c02700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e000 0x7fedb011e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 -- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 msgr2=0x7fedb011e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 -- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e000 msgr2=0x7fedb011e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e000 0x7fedb011e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 -- 172.21.15.19:0/3529068367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009550 con 0x7fedb009d6f0 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5c04700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb5403700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb011de50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fedac016000 tx=0x7fedac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac004450 con 0x7fedb009d6f0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac01f070 con 0x7fedb009d6f0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb0121640 con 0x7fedb009d6f0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.728+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0045f0 con 0x7fedb009d6f0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.729+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb009c700 con 0x7fedb009d6f0 2023-10-03T10:17:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.730+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb011ac20 con 0x7fedb009d6f0 2023-10-03T10:17:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.731+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fedac0038e0 con 0x7fedb009d6f0 2023-10-03T10:17:27.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.731+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fedac021070 con 0x7fedb009d6f0 2023-10-03T10:17:27.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.736+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fedac02f760 con 0x7fedb009d6f0 2023-10-03T10:17:27.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.844+0000 7fd71e16f700 1 Processor -- start 2023-10-03T10:17:27.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.844+0000 7fd71e16f700 1 -- start start 2023-10-03T10:17:27.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 0x7fd71809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 0x7fd7181339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e410 0x7fd718133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71806b460 con 0x7fd71809d6f0 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71809b120 con 0x7fd71809e410 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd71e16f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd71809a7e0 con 0x7fd71809e000 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd7177fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 0x7fd71809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 0x7fd7181339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd7177fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 0x7fd71809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40346/0 (socket says 172.21.15.19:40346) 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd7177fe700 1 -- 172.21.15.19:0/2121037682 learned_addr learned my addr 172.21.15.19:0/2121037682 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 -- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e410 msgr2=0x7fd718133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 --2- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e410 0x7fd718133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 -- 172.21.15.19:0/2121037682 >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 msgr2=0x7fd71809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 --2- 172.21.15.19:0/2121037682 >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 0x7fd71809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 -- 172.21.15.19:0/2121037682 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71809a500 con 0x7fd71809e000 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.845+0000 7fd716ffd700 1 --2- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 0x7fd7181339f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009870 tx=0x7fd70c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570f086c5ba954c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd7167fc700 1 -- 172.21.15.19:0/2121037682 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011830 con 0x7fd71809e000 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd7167fc700 1 -- 172.21.15.19:0/2121037682 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c011990 con 0x7fd71809e000 2023-10-03T10:17:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd7167fc700 1 -- 172.21.15.19:0/2121037682 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c011d20 con 0x7fd71809e000 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 -- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 msgr2=0x7fd7181339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 --2- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 0x7fd7181339f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd70c009870 tx=0x7fd70c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 -- 172.21.15.19:0/2121037682 shutdown_connections 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 --2- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e410 0x7fd718133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 --2- 172.21.15.19:0/2121037682 >> v2:172.21.15.19:3300/0 conn(0x7fd71809d6f0 0x7fd71809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.846+0000 7fd71e16f700 1 --2- 172.21.15.19:0/2121037682 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809e000 0x7fd7181339f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.847+0000 7fd71e16f700 1 -- 172.21.15.19:0/2121037682 >> 172.21.15.19:0/2121037682 conn(0x7fd718066f50 msgr2=0x7fd71809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.847+0000 7fd71e16f700 1 -- 172.21.15.19:0/2121037682 shutdown_connections 2023-10-03T10:17:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.847+0000 7fd71e16f700 1 -- 172.21.15.19:0/2121037682 wait complete. 2023-10-03T10:17:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.848+0000 7fd71e16f700 1 Processor -- start 2023-10-03T10:17:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.848+0000 7fd71e16f700 1 -- start start 2023-10-03T10:17:27.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 0x7fd7181a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 0x7fd7181a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181a9b20 con 0x7fd71809e410 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181a8230 con 0x7fd71809e000 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd71e16f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7181a92b0 con 0x7fd71809d6f0 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd717fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd7177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 0x7fd7181a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd717fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40348/0 (socket says 172.21.15.19:40348) 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd717fff700 1 -- 172.21.15.19:0/1731256593 learned_addr learned my addr 172.21.15.19:0/1731256593 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.849+0000 7fd716ffd700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 0x7fd7181a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 -- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 msgr2=0x7fd7181a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 0x7fd7181a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 -- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 msgr2=0x7fd7181a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 0x7fd7181a65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 -- 172.21.15.19:0/1731256593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0094a0 con 0x7fd71809e410 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd7177fe700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 0x7fd7181a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd716ffd700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 0x7fd7181a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd717fff700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd71000b970 tx=0x7fd71000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000d860 con 0x7fd71809e410 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000d9e0 con 0x7fd71809e410 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71809c710 con 0x7fd71809e410 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000dd90 con 0x7fd71809e410 2023-10-03T10:17:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.850+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7181b93f0 con 0x7fd71809e410 2023-10-03T10:17:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.852+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd71000e430 con 0x7fd71809e410 2023-10-03T10:17:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.852+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd710006e40 con 0x7fd71809e410 2023-10-03T10:17:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.854+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f80052e0 con 0x7fd71809e410 2023-10-03T10:17:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.858+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd7100203a0 con 0x7fd71809e410 2023-10-03T10:17:27.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.860+0000 7f7ec7cd1700 1 Processor -- start 2023-10-03T10:17:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.860+0000 7f7ec7cd1700 1 -- start start 2023-10-03T10:17:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7fc07c39a700 1 Processor -- start 2023-10-03T10:17:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec7cd1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ec009d6f0 0x7f7ec009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7fc07c39a700 1 -- start start 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec7cd1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009e410 0x7f7ec0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec7cd1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec009f130 con 0x7f7ec009e000 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec7cd1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec009f520 con 0x7f7ec009d6f0 2023-10-03T10:17:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec7cd1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec009e930 con 0x7f7ec009e410 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec5a6d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ec009d6f0 0x7f7ec009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec5a6d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ec009d6f0 0x7f7ec009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40364/0 (socket says 172.21.15.19:40364) 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.861+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/321436381 learned_addr learned my addr 172.21.15.19:0/321436381 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009e410 msgr2=0x7f7ec0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec5a6d700 1 --2- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009e410 0x7f7ec0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/321436381 >> v1:172.21.15.19:6789/0 conn(0x7f7ec009e000 legacy=0x7f7ec0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/321436381 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec009b2d0 con 0x7f7ec009d6f0 2023-10-03T10:17:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec5a6d700 1 --2- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009d6f0 0x7f7ec009dac0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00bb90 tx=0x7f7ebc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffad682fa4748646 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07c39a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc074136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07c39a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc074136fe0 0x7fc0741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07c39a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc074070940 con 0x7fc07409e930 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07c39a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406fd60 con 0x7fc074136fe0 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07c39a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406fa80 con 0x7fc07409f410 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07a136700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc07409e930 0x7fc07409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34414/0 (socket says 172.21.15.19:34414) 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7fc07a136700 1 -- 172.21.15.19:0/1722857969 learned_addr learned my addr 172.21.15.19:0/1722857969 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec4a6b700 1 -- 172.21.15.19:0/321436381 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc00dd10 con 0x7f7ec009d6f0 2023-10-03T10:17:27.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec4a6b700 1 -- 172.21.15.19:0/321436381 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc00de70 con 0x7f7ec009d6f0 2023-10-03T10:17:27.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.862+0000 7f7ec4a6b700 1 -- 172.21.15.19:0/321436381 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc004230 con 0x7f7ec009d6f0 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1881522173 0 0) 0x7fc074070940 con 0x7fc07409e930 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0600035b0 con 0x7fc07409e930 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317254634 0 0) 0x7fc0600035b0 con 0x7fc07409e930 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 msgr2=0x7fc074136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc074136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc074136fe0 msgr2=0x7fc0741393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc074136fe0 0x7fc0741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07409fb60 con 0x7fc07409e930 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7fc070001670 con 0x7fc07409e930 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 >> v1:172.21.15.19:6789/0 conn(0x7fc07409e930 legacy=0x7fc07409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc060003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 0x7fc060004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc060004d90 0x7fc060005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406fd60 con 0x7fc060004110 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07406fa80 con 0x7fc060004d90 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc06000bd40 con 0x7fc07409f410 2023-10-03T10:17:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7fc07a136700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc060003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009d6f0 msgr2=0x7f7ec009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.863+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009d6f0 0x7f7ec009dac0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f7ebc00bb90 tx=0x7f7ebc00bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 -- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc060004d90 msgr2=0x7fc060005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc060004d90 0x7fc060005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 -- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 msgr2=0x7fc060004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc079935700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 0x7fc060004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 0x7fc060004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 -- 172.21.15.19:0/1722857969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0600035b0 con 0x7fc07409f410 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc079935700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 0x7fc060004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/321436381 shutdown_connections 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009e410 0x7f7ec0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/321436381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009d6f0 0x7f7ec009dac0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/321436381 >> 172.21.15.19:0/321436381 conn(0x7f7ec0066f50 msgr2=0x7f7ec009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc07a136700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc060003a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c240 tx=0x7fc060005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36ea4718c21b13db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/321436381 shutdown_connections 2023-10-03T10:17:27.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/321436381 wait complete. 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07000cd80 con 0x7fc07409f410 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070005960 con 0x7fc07409f410 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.864+0000 7fc079134700 1 -- 172.21.15.19:0/1722857969 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070005d10 con 0x7fc07409f410 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 -- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 msgr2=0x7fc060003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc060003a00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c240 tx=0x7fc060005880 comp rx=0 tx=0).stop 2023-10-03T10:17:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7f7ec7cd1700 1 Processor -- start 2023-10-03T10:17:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 -- 172.21.15.19:0/1722857969 shutdown_connections 2023-10-03T10:17:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc060004d90 0x7fc060005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004110 0x7fc060004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 --2- 172.21.15.19:0/1722857969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc07409f410 0x7fc060003a00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.865+0000 7fc07c39a700 1 -- 172.21.15.19:0/1722857969 >> 172.21.15.19:0/1722857969 conn(0x7fc0740a4210 msgr2=0x7fc0740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:27.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7fc07c39a700 1 -- 172.21.15.19:0/1722857969 shutdown_connections 2023-10-03T10:17:27.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 -- start start 2023-10-03T10:17:27.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009e000 0x7f7ec011e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ec009e410 0x7f7ec011ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0120330 con 0x7f7ec009e000 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00a1e20 con 0x7f7ec009e410 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.867+0000 7f7ec7cd1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec009c700 con 0x7f7ec009d6f0 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7fc07c39a700 1 -- 172.21.15.19:0/1722857969 wait complete. 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35746/0 (socket says 172.21.15.19:35746) 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/3692597731 learned_addr learned my addr 172.21.15.19:0/3692597731 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ec009e410 msgr2=0x7f7ec011ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ec009e410 0x7f7ec011ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009e000 msgr2=0x7f7ec011e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009e000 0x7f7ec011e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 -- 172.21.15.19:0/3692597731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ebc00b7f0 con 0x7f7ec009d6f0 2023-10-03T10:17:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7ec5a6d700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00a3e80 tx=0x7f7ebc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc003d20 con 0x7f7ec009d6f0 2023-10-03T10:17:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc003e80 con 0x7f7ec009d6f0 2023-10-03T10:17:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.868+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc010670 con 0x7f7ec009d6f0 2023-10-03T10:17:27.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.869+0000 7fc07c39a700 1 Processor -- start 2023-10-03T10:17:27.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.869+0000 7fc07c39a700 1 -- start start 2023-10-03T10:17:27.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.869+0000 7fc07c39a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc060004110 0x7fc07411b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc07409e930 0x7fc07411c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074136d40 con 0x7fc060004d90 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07411e730 con 0x7fc07409e930 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc07411cd80 con 0x7fc060004110 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40372/0 (socket says 172.21.15.19:40372) 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 -- 172.21.15.19:0/2687178345 learned_addr learned my addr 172.21.15.19:0/2687178345 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07a136700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc060004110 0x7fc07411b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 -- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc060004110 msgr2=0x7fc07411b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc060004110 0x7fc07411b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 -- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc07409e930 msgr2=0x7fc07411c3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc07409e930 0x7fc07411c3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 -- 172.21.15.19:0/2687178345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07411dd40 con 0x7fc060004d90 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc079935700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c7f0 tx=0x7fc06400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064004440 con 0x7fc060004d90 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064003680 con 0x7fc060004d90 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064003a30 con 0x7fc060004d90 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07411f110 con 0x7fc060004d90 2023-10-03T10:17:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.870+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec0121420 con 0x7f7ec009d6f0 2023-10-03T10:17:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.871+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc074071d20 con 0x7fc060004d90 2023-10-03T10:17:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.871+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec0122420 con 0x7f7ec009d6f0 2023-10-03T10:17:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.872+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ebc0193f0 con 0x7f7ec009d6f0 2023-10-03T10:17:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.872+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec0074ea0 con 0x7f7ec009d6f0 2023-10-03T10:17:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.872+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ebc042f70 con 0x7f7ec009d6f0 2023-10-03T10:17:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.872+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07409a3e0 con 0x7fc060004d90 2023-10-03T10:17:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.873+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc064003b90 con 0x7fc060004d90 2023-10-03T10:17:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.873+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc06403ffc0 con 0x7fc060004d90 2023-10-03T10:17:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.877+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc064010350 con 0x7fc060004d90 2023-10-03T10:17:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:27.883+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ebc00f3d0 con 0x7f7ec009d6f0 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.018+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fedb0074ea0 con 0x7fedb009d6f0 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.018+0000 7feda5ffb700 1 -- 172.21.15.19:0/3529068367 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fedac02b020 con 0x7fedb009d6f0 2023-10-03T10:17:28.018 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 msgr2=0x7fedb011de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb011de50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fedac016000 tx=0x7fedac004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 shutdown_connections 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedb009e410 0x7fedb011e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedb009d6f0 0x7fedb011de50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 --2- 172.21.15.19:0/3529068367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedb009e000 0x7fedb011e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 >> 172.21.15.19:0/3529068367 conn(0x7fedb0066f50 msgr2=0x7fedb0130b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 shutdown_connections 2023-10-03T10:17:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.021+0000 7fedb7667700 1 -- 172.21.15.19:0/3529068367 wait complete. 2023-10-03T10:17:28.035 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.110+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc074074ea0 con 0x7fc060004d90 2023-10-03T10:17:28.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.110+0000 7fc06affd700 1 -- 172.21.15.19:0/2687178345 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc064028070 con 0x7fc060004d90 2023-10-03T10:17:28.110 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 msgr2=0x7fc07411be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c7f0 tx=0x7fc06400cbb0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 shutdown_connections 2023-10-03T10:17:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc07409e930 0x7fc07411c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc060004110 0x7fc07411b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 --2- 172.21.15.19:0/2687178345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc060004d90 0x7fc07411be60 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 >> 172.21.15.19:0/2687178345 conn(0x7fc0740a4210 msgr2=0x7fc0740a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 shutdown_connections 2023-10-03T10:17:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.112+0000 7fc07c39a700 1 -- 172.21.15.19:0/2687178345 wait complete. 2023-10-03T10:17:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.117+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd6f8005590 con 0x7fd71809e410 2023-10-03T10:17:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.117+0000 7fd6fffff700 1 -- 172.21.15.19:0/1731256593 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd71001c030 con 0x7fd71809e410 2023-10-03T10:17:28.117 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 msgr2=0x7fd7181a6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd71000b970 tx=0x7fd71000bc80 comp rx=0 tx=0).stop 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 shutdown_connections 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd71809e410 0x7fd7181a6b20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd71809d6f0 0x7fd7181a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 --2- 172.21.15.19:0/1731256593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd71809e000 0x7fd7181a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.119+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 >> 172.21.15.19:0/1731256593 conn(0x7fd718066f50 msgr2=0x7fd7181badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.120+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 shutdown_connections 2023-10-03T10:17:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.120+0000 7fd71e16f700 1 -- 172.21.15.19:0/1731256593 wait complete. 2023-10-03T10:17:28.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.133+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7ec0120fd0 con 0x7f7ec009d6f0 2023-10-03T10:17:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.133+0000 7f7eb67fc700 1 -- 172.21.15.19:0/3692597731 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ebc029030 con 0x7f7ec009d6f0 2023-10-03T10:17:28.133 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:28.134 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.135+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 msgr2=0x7f7ec011e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.135+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7ec00a3e80 tx=0x7f7ebc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 shutdown_connections 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ec009e410 0x7f7ec011ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ec009d6f0 0x7f7ec011e1c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 --2- 172.21.15.19:0/3692597731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ec009e000 0x7f7ec011e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 >> 172.21.15.19:0/3692597731 conn(0x7f7ec0066f50 msgr2=0x7f7ec006f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 shutdown_connections 2023-10-03T10:17:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:28.136+0000 7f7ec7cd1700 1 -- 172.21.15.19:0/3692597731 wait complete. 2023-10-03T10:17:28.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:29.036 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:29.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:29.135 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:29.149 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:29.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.185+0000 7fb4c646e700 1 Processor -- start 2023-10-03T10:17:29.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.185+0000 7fb4c646e700 1 -- start start 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4c009d6f0 0x7fb4c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c006b460 con 0x7fb4c009d6f0 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c009b120 con 0x7fb4c009e000 2023-10-03T10:17:29.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c646e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c009a7e0 con 0x7fb4c009e410 2023-10-03T10:17:29.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c4a0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4bffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4c009d6f0 0x7fb4c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c4a0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35770/0 (socket says 172.21.15.19:35770) 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4c4a0b700 1 -- 172.21.15.19:0/2606389435 learned_addr learned my addr 172.21.15.19:0/2606389435 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.186+0000 7fb4b7fff700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 -- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 msgr2=0x7fb4c01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 -- 172.21.15.19:0/2606389435 >> v2:172.21.15.19:3300/0 conn(0x7fb4c009d6f0 msgr2=0x7fb4c009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 --2- 172.21.15.19:0/2606389435 >> v2:172.21.15.19:3300/0 conn(0x7fb4c009d6f0 0x7fb4c009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 -- 172.21.15.19:0/2606389435 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c009a500 con 0x7fb4c009e410 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.187+0000 7fb4c4a0b700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009e80 tx=0x7fb4b800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f173211bb89574 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.188+0000 7fb4bf7fe700 1 -- 172.21.15.19:0/2606389435 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800e070 con 0x7fb4c009e410 2023-10-03T10:17:29.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.188+0000 7fb4bf7fe700 1 -- 172.21.15.19:0/2606389435 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b800b8d0 con 0x7fb4c009e410 2023-10-03T10:17:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.188+0000 7fb4bf7fe700 1 -- 172.21.15.19:0/2606389435 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b800bc80 con 0x7fb4c009e410 2023-10-03T10:17:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 -- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 msgr2=0x7fb4c0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb4b8009e80 tx=0x7fb4b800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 -- 172.21.15.19:0/2606389435 shutdown_connections 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009e410 0x7fb4c0133f30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 --2- 172.21.15.19:0/2606389435 >> v2:172.21.15.19:3300/0 conn(0x7fb4c009d6f0 0x7fb4c009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 --2- 172.21.15.19:0/2606389435 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 -- 172.21.15.19:0/2606389435 >> 172.21.15.19:0/2606389435 conn(0x7fb4c0066f50 msgr2=0x7fb4c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 -- 172.21.15.19:0/2606389435 shutdown_connections 2023-10-03T10:17:29.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.189+0000 7fb4c646e700 1 -- 172.21.15.19:0/2606389435 wait complete. 2023-10-03T10:17:29.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.190+0000 7fb4c646e700 1 Processor -- start 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.190+0000 7fb4c646e700 1 -- start start 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 0x7fb4c01c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 0x7fb4c01c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c01b51a0 con 0x7fb4c009e410 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c01a2cd0 con 0x7fb4c009e000 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c646e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c009c780 con 0x7fb4c009d6f0 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c4a0b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 0x7fb4c01c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c4a0b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 0x7fb4c01c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40390/0 (socket says 172.21.15.19:40390) 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4c4a0b700 1 -- 172.21.15.19:0/1523039350 learned_addr learned my addr 172.21.15.19:0/1523039350 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4b7fff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4bffff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 0x7fb4c01c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4b7fff700 1 -- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 msgr2=0x7fb4c01c0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.191+0000 7fb4b7fff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 0x7fb4c01c0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.192+0000 7fb4b7fff700 1 -- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 msgr2=0x7fb4c01c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.192+0000 7fb4b7fff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 0x7fb4c01c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.192+0000 7fb4b7fff700 1 -- 172.21.15.19:0/1523039350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b8009b30 con 0x7fb4c009e000 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.192+0000 7fb4bffff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 0x7fb4c01c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:29.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.192+0000 7fb4b7fff700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01c1190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800e7e0 tx=0x7fb4a800eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.193+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a800c070 con 0x7fb4c009e000 2023-10-03T10:17:29.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.193+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a8013610 con 0x7fb4c009e000 2023-10-03T10:17:29.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.193+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c01a4da0 con 0x7fb4c009e000 2023-10-03T10:17:29.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.193+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8013980 con 0x7fb4c009e000 2023-10-03T10:17:29.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.193+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c01a40a0 con 0x7fb4c009e000 2023-10-03T10:17:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.194+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0074ea0 con 0x7fb4c009e000 2023-10-03T10:17:29.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.194+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4a8013ae0 con 0x7fb4c009e000 2023-10-03T10:17:29.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.194+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4a803f0b0 con 0x7fb4c009e000 2023-10-03T10:17:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.204+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4a80238f0 con 0x7fb4c009e000 2023-10-03T10:17:29.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.289+0000 7feb48368700 1 Processor -- start 2023-10-03T10:17:29.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.289+0000 7feb48368700 1 -- start start 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb48368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb48368700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb4009e000 0x7feb40130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb48368700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4009f130 con 0x7feb4009e410 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb48368700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4009f520 con 0x7feb4009e000 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb48368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb4009e930 con 0x7feb4009d6f0 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb45903700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feb4009e000 0x7feb40130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb46905700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feb4009e410 0x7feb40130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34430/0 (socket says 172.21.15.19:34430) 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb46905700 1 -- 172.21.15.19:0/3030943857 learned_addr learned my addr 172.21.15.19:0/3030943857 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.290+0000 7feb46104700 1 --2- 172.21.15.19:0/3030943857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb45102700 1 -- 172.21.15.19:0/3030943857 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023232751 0 0) 0x7feb4009f130 con 0x7feb4009e410 2023-10-03T10:17:29.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb46104700 1 -- 172.21.15.19:0/3030943857 >> v2:172.21.15.19:3300/0 conn(0x7feb4009e000 msgr2=0x7feb40130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb46104700 1 --2- 172.21.15.19:0/3030943857 >> v2:172.21.15.19:3300/0 conn(0x7feb4009e000 0x7feb40130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb46104700 1 -- 172.21.15.19:0/3030943857 >> v1:172.21.15.19:6789/0 conn(0x7feb4009e410 legacy=0x7feb40130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb46104700 1 -- 172.21.15.19:0/3030943857 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4009b2d0 con 0x7feb4009d6f0 2023-10-03T10:17:29.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb46104700 1 --2- 172.21.15.19:0/3030943857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4009dac0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009840 tx=0x7feb3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dbd600e80e79d09 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb45102700 1 -- 172.21.15.19:0/3030943857 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011830 con 0x7feb4009d6f0 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb45102700 1 -- 172.21.15.19:0/3030943857 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3c011990 con 0x7feb4009d6f0 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.291+0000 7feb45102700 1 -- 172.21.15.19:0/3030943857 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3c011d20 con 0x7feb4009d6f0 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 -- 172.21.15.19:0/3030943857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 msgr2=0x7feb4009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 --2- 172.21.15.19:0/3030943857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4009dac0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009840 tx=0x7feb3c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 -- 172.21.15.19:0/3030943857 shutdown_connections 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 --2- 172.21.15.19:0/3030943857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4009dac0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 --2- 172.21.15.19:0/3030943857 >> v2:172.21.15.19:3300/0 conn(0x7feb4009e000 0x7feb40130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 -- 172.21.15.19:0/3030943857 >> 172.21.15.19:0/3030943857 conn(0x7feb40066f50 msgr2=0x7feb4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 -- 172.21.15.19:0/3030943857 shutdown_connections 2023-10-03T10:17:29.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.292+0000 7feb48368700 1 -- 172.21.15.19:0/3030943857 wait complete. 2023-10-03T10:17:29.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.294+0000 7feb48368700 1 Processor -- start 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.294+0000 7feb48368700 1 -- start start 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4011de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 0x7feb4011e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 0x7feb4011e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4011fa60 con 0x7feb4009e410 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb40120cb0 con 0x7feb4009e000 2023-10-03T10:17:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb48368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feb40120040 con 0x7feb4009d6f0 2023-10-03T10:17:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb45903700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 0x7feb4011e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 0x7feb4011e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb45903700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 0x7feb4011e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51822/0 (socket says 172.21.15.19:51822) 2023-10-03T10:17:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb45903700 1 -- 172.21.15.19:0/2769098314 learned_addr learned my addr 172.21.15.19:0/2769098314 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46104700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4011de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 -- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 msgr2=0x7feb4011de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4011de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 -- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 msgr2=0x7feb4011e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 0x7feb4011e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46905700 1 -- 172.21.15.19:0/2769098314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c0094a0 con 0x7feb4009e410 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.295+0000 7feb46104700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4011de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb46905700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 0x7feb4011e8d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7feb3800cbe0 tx=0x7feb3800cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800aa60 con 0x7feb4009e410 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3800abc0 con 0x7feb4009e410 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb40121690 con 0x7feb4009e410 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380070d0 con 0x7feb4009e410 2023-10-03T10:17:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.296+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4009c700 con 0x7feb4009e410 2023-10-03T10:17:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.297+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feb38007230 con 0x7feb4009e410 2023-10-03T10:17:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.297+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feb3803f330 con 0x7feb4009e410 2023-10-03T10:17:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.297+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4011ac20 con 0x7feb4009e410 2023-10-03T10:17:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.303+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feb3801a6d0 con 0x7feb4009e410 2023-10-03T10:17:29.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.323+0000 7fbc660dc700 1 Processor -- start 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 -- start start 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 0x7fbc601379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 0x7fbc601383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6006c4b0 con 0x7fbc60134ec0 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600a09c0 con 0x7fbc6006c0e0 2023-10-03T10:17:29.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc660dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60134980 con 0x7fbc60137f20 2023-10-03T10:17:29.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51830/0 (socket says 172.21.15.19:51830) 2023-10-03T10:17:29.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.324+0000 7fbc5f7fe700 1 -- 172.21.15.19:0/3078574085 learned_addr learned my addr 172.21.15.19:0/3078574085 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5ffff700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 0x7fbc601383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 -- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 msgr2=0x7fbc601383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5effd700 1 --2- 172.21.15.19:0/3078574085 >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 0x7fbc601379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 0x7fbc601383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 -- 172.21.15.19:0/3078574085 >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 msgr2=0x7fbc601379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 --2- 172.21.15.19:0/3078574085 >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 0x7fbc601379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 -- 172.21.15.19:0/3078574085 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600a0600 con 0x7fbc6006c0e0 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5ffff700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 0x7fbc601383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5effd700 1 --2- 172.21.15.19:0/3078574085 >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 0x7fbc601379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5f7fe700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098f0 tx=0x7fbc50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc43e9f96c5fc10c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5e7fc700 1 -- 172.21.15.19:0/3078574085 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000b8a0 con 0x7fbc6006c0e0 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5e7fc700 1 -- 172.21.15.19:0/3078574085 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5000ba00 con 0x7fbc6006c0e0 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.325+0000 7fbc5e7fc700 1 -- 172.21.15.19:0/3078574085 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5000bd90 con 0x7fbc6006c0e0 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 -- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 msgr2=0x7fbc6009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc500098f0 tx=0x7fbc50009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 -- 172.21.15.19:0/3078574085 shutdown_connections 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc6006c0e0 0x7fbc6009ac90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 --2- 172.21.15.19:0/3078574085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60137f20 0x7fbc601383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 --2- 172.21.15.19:0/3078574085 >> v2:172.21.15.19:3300/0 conn(0x7fbc60134ec0 0x7fbc601379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 -- 172.21.15.19:0/3078574085 >> 172.21.15.19:0/3078574085 conn(0x7fbc600a4210 msgr2=0x7fbc600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 -- 172.21.15.19:0/3078574085 shutdown_connections 2023-10-03T10:17:29.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.326+0000 7fbc660dc700 1 -- 172.21.15.19:0/3078574085 wait complete. 2023-10-03T10:17:29.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 Processor -- start 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 -- start start 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc6006c0e0 0x7fbc601341d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc60137f20 0x7fbc6011ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.328+0000 7fbc660dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6011c480 con 0x7fbc6006c0e0 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc660dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6011dce0 con 0x7fbc60137f20 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc660dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6009b220 con 0x7fbc60134ec0 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35820/0 (socket says 172.21.15.19:35820) 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 -- 172.21.15.19:0/791588574 learned_addr learned my addr 172.21.15.19:0/791588574 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 -- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc60137f20 msgr2=0x7fbc6011ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc60137f20 0x7fbc6011ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 -- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc6006c0e0 msgr2=0x7fbc601341d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc6006c0e0 0x7fbc601341d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 -- 172.21.15.19:0/791588574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009550 con 0x7fbc60134ec0 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc5effd700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c740 tx=0x7fbc5400cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.329+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54004220 con 0x7fbc60134ec0 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.330+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54004380 con 0x7fbc60134ec0 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.330+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540036a0 con 0x7fbc60134ec0 2023-10-03T10:17:29.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.330+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600a03f0 con 0x7fbc60134ec0 2023-10-03T10:17:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.330+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6011e2f0 con 0x7fbc60134ec0 2023-10-03T10:17:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.331+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbc54003800 con 0x7fbc60134ec0 2023-10-03T10:17:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.331+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc60074ea0 con 0x7fbc60134ec0 2023-10-03T10:17:29.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.331+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbc5403fa70 con 0x7fbc60134ec0 2023-10-03T10:17:29.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.335+0000 7fd3d2f65700 1 Processor -- start 2023-10-03T10:17:29.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.335+0000 7fd3d2f65700 1 -- start start 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d2f65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3cc1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d2f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc135e30 0x7fd3cc138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d2f65700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3cc130260 con 0x7fd3cc130670 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d2f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc09a350 con 0x7fd3cc135e30 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d2f65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc071ff0 con 0x7fd3cc133510 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d0d01700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd3cc130670 0x7fd3cc130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34442/0 (socket says 172.21.15.19:34442) 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d0d01700 1 -- 172.21.15.19:0/4225564967 learned_addr learned my addr 172.21.15.19:0/4225564967 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:29.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.336+0000 7fd3d1502700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc135e30 0x7fd3cc138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980440555 0 0) 0x7fd3cc130260 con 0x7fd3cc130670 2023-10-03T10:17:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3bc0035b0 con 0x7fd3cc130670 2023-10-03T10:17:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cbfff700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3cc1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878918211 0 0) 0x7fd3bc0035b0 con 0x7fd3cc130670 2023-10-03T10:17:29.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 msgr2=0x7fd3cc1358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3cc1358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc135e30 msgr2=0x7fd3cc138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc135e30 0x7fd3cc138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc09ecf0 con 0x7fd3cc130670 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7fd3c0001670 con 0x7fd3cc130670 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cbfff700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3cc1358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 >> v1:172.21.15.19:6789/0 conn(0x7fd3cc130670 legacy=0x7fd3cc130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3bc003a00 0x7fd3bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc004390 0x7fd3bc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3bc0050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc09a350 con 0x7fd3bc004390 2023-10-03T10:17:29.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc071ff0 con 0x7fd3bc003a00 2023-10-03T10:17:29.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc009a50 con 0x7fd3cc133510 2023-10-03T10:17:29.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbc54007320 con 0x7fbc60134ec0 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3d0d01700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3bc003a00 0x7fd3bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.337+0000 7fd3cbfff700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc004390 0x7fd3bc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3bc0050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 -- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3bc003a00 msgr2=0x7fd3bc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3bc003a00 0x7fd3bc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 -- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc004390 msgr2=0x7fd3bc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:29.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc004390 0x7fd3bc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 -- 172.21.15.19:0/4225564967 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc09ecf0 con 0x7fd3cc133510 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.338+0000 7fd3d1502700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3bc0050f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc099b60 tx=0x7fd3bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6b36c55406ad75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.339+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400eb20 con 0x7fd3cc133510 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.339+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c400f040 con 0x7fd3cc133510 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.339+0000 7fd3cb7fe700 1 -- 172.21.15.19:0/4225564967 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c400eea0 con 0x7fd3cc133510 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 -- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 msgr2=0x7fd3bc0050f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3bc0050f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc099b60 tx=0x7fd3bc005880 comp rx=0 tx=0).stop 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 -- 172.21.15.19:0/4225564967 shutdown_connections 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3cc133510 0x7fd3bc0050f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc004390 0x7fd3bc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/4225564967 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3bc003a00 0x7fd3bc003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 -- 172.21.15.19:0/4225564967 >> 172.21.15.19:0/4225564967 conn(0x7fd3cc0a2aa0 msgr2=0x7fd3cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 -- 172.21.15.19:0/4225564967 shutdown_connections 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.340+0000 7fd3d2f65700 1 -- 172.21.15.19:0/4225564967 wait complete. 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.342+0000 7fd3d2f65700 1 Processor -- start 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.342+0000 7fd3d2f65700 1 -- start start 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3bc004390 0x7fd3cc09c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 0x7fd3cc09ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc119d10 con 0x7fd3bc003a00 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc09d860 con 0x7fd3cc130670 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d2f65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3cc0718b0 con 0x7fd3bc004390 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40430/0 (socket says 172.21.15.19:40430) 2023-10-03T10:17:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 -- 172.21.15.19:0/2269552407 learned_addr learned my addr 172.21.15.19:0/2269552407 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3cbfff700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3bc004390 0x7fd3cc09c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 -- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3bc004390 msgr2=0x7fd3cc09c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3bc004390 0x7fd3cc09c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 -- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 msgr2=0x7fd3cc09ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d1502700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 0x7fd3cc09ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 0x7fd3cc09ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 -- 172.21.15.19:0/2269552407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc12fcd0 con 0x7fd3bc003a00 2023-10-03T10:17:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d1502700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 0x7fd3cc09ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.343+0000 7fd3d0d01700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0007360 tx=0x7fd3c0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.344+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0004ea0 con 0x7fd3bc003a00 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.344+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000f8d0 con 0x7fd3bc003a00 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.344+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000fc60 con 0x7fd3bc003a00 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.344+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc11a620 con 0x7fd3bc003a00 2023-10-03T10:17:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.344+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3cc119040 con 0x7fd3bc003a00 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.345+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3cc119f00 con 0x7fd3bc003a00 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.346+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3c001d360 con 0x7fd3bc003a00 2023-10-03T10:17:29.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.346+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3c003f3a0 con 0x7fd3bc003a00 2023-10-03T10:17:29.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.355+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3c001b270 con 0x7fd3bc003a00 2023-10-03T10:17:29.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.434+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb4c006c360 con 0x7fb4c009e000 2023-10-03T10:17:29.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.434+0000 7fb4bd7fa700 1 -- 172.21.15.19:0/1523039350 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4a8023300 con 0x7fb4c009e000 2023-10-03T10:17:29.434 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 msgr2=0x7fb4c01c1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01c1190 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800e7e0 tx=0x7fb4a800eaf0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 shutdown_connections 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c009e410 0x7fb4c01c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c009d6f0 0x7fb4c01c0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 --2- 172.21.15.19:0/1523039350 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c009e000 0x7fb4c01c1190 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 >> 172.21.15.19:0/1523039350 conn(0x7fb4c0066f50 msgr2=0x7fb4c01b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 shutdown_connections 2023-10-03T10:17:29.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.438+0000 7fb4c646e700 1 -- 172.21.15.19:0/1523039350 wait complete. 2023-10-03T10:17:29.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:29.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.558+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7feb40074ea0 con 0x7feb4009e410 2023-10-03T10:17:29.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.558+0000 7feb36ffd700 1 -- 172.21.15.19:0/2769098314 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb38018030 con 0x7feb4009e410 2023-10-03T10:17:29.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.558+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbc600a1740 con 0x7fbc60134ec0 2023-10-03T10:17:29.558 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.558+0000 7fbc47fff700 1 -- 172.21.15.19:0/791588574 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc54010b40 con 0x7fbc60134ec0 2023-10-03T10:17:29.559 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.560+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 msgr2=0x7feb4011e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 0x7feb4011e8d0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7feb3800cbe0 tx=0x7feb3800cef0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 shutdown_connections 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb4009e410 0x7feb4011e8d0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feb4009d6f0 0x7feb4011de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 --2- 172.21.15.19:0/2769098314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feb4009e000 0x7feb4011e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 >> 172.21.15.19:0/2769098314 conn(0x7feb40066f50 msgr2=0x7feb40130ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 shutdown_connections 2023-10-03T10:17:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7feb48368700 1 -- 172.21.15.19:0/2769098314 wait complete. 2023-10-03T10:17:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 msgr2=0x7fbc6011a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c740 tx=0x7fbc5400cb00 comp rx=0 tx=0).stop 2023-10-03T10:17:29.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 shutdown_connections 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbc60137f20 0x7fbc6011ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc6006c0e0 0x7fbc601341d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 --2- 172.21.15.19:0/791588574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbc60134ec0 0x7fbc6011a8e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 >> 172.21.15.19:0/791588574 conn(0x7fbc600a4210 msgr2=0x7fbc60099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 shutdown_connections 2023-10-03T10:17:29.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.561+0000 7fbc660dc700 1 -- 172.21.15.19:0/791588574 wait complete. 2023-10-03T10:17:29.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:29.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:29.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.599+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd3cc074ea0 con 0x7fd3bc003a00 2023-10-03T10:17:29.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.599+0000 7fd3c97fa700 1 -- 172.21.15.19:0/2269552407 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3c001a030 con 0x7fd3bc003a00 2023-10-03T10:17:29.599 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 msgr2=0x7fd3cc09c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0007360 tx=0x7fd3c0007720 comp rx=0 tx=0).stop 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 shutdown_connections 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3cc130670 0x7fd3cc09ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3bc003a00 0x7fd3cc09c3a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 --2- 172.21.15.19:0/2269552407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3bc004390 0x7fd3cc09c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:29.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 >> 172.21.15.19:0/2269552407 conn(0x7fd3cc0a2aa0 msgr2=0x7fd3cc130a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:29.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 shutdown_connections 2023-10-03T10:17:29.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:29.602+0000 7fd3d2f65700 1 -- 172.21.15.19:0/2269552407 wait complete. 2023-10-03T10:17:29.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:30.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:30.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:30.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.608+0000 7f2306b11700 1 Processor -- start 2023-10-03T10:17:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.608+0000 7f2306b11700 1 -- start start 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 0x7f2300133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f230009de50 0x7f230009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 0x7f230013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230006fef0 con 0x7f230009de50 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230006ef30 con 0x7f230009e760 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f2306b11700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23001334b0 con 0x7f23001338a0 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f23048ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 0x7f2300133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f23050ae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 0x7f230013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f23048ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 0x7f2300133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35876/0 (socket says 172.21.15.19:35876) 2023-10-03T10:17:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f23048ad700 1 -- 172.21.15.19:0/2998659905 learned_addr learned my addr 172.21.15.19:0/2998659905 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.609+0000 7f22fffff700 1 --2- 172.21.15.19:0/2998659905 >> v2:172.21.15.19:3300/0 conn(0x7f230009de50 0x7f230009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 -- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 msgr2=0x7f2300133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 --2- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 0x7f2300133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 -- 172.21.15.19:0/2998659905 >> v2:172.21.15.19:3300/0 conn(0x7f230009de50 msgr2=0x7f230009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 --2- 172.21.15.19:0/2998659905 >> v2:172.21.15.19:3300/0 conn(0x7f230009de50 0x7f230009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 -- 172.21.15.19:0/2998659905 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230006fc30 con 0x7f230009e760 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f23050ae700 1 --2- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 0x7f230013a730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009d90 tx=0x7f22f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa6bdddc75c3ba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f22ff7fe700 1 -- 172.21.15.19:0/2998659905 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f800e070 con 0x7f230009e760 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f22ff7fe700 1 -- 172.21.15.19:0/2998659905 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f800bb20 con 0x7f230009e760 2023-10-03T10:17:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.610+0000 7f22ff7fe700 1 -- 172.21.15.19:0/2998659905 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8012430 con 0x7f230009e760 2023-10-03T10:17:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 -- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 msgr2=0x7f230013a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 --2- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 0x7f230013a730 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f22f8009d90 tx=0x7f22f800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 -- 172.21.15.19:0/2998659905 shutdown_connections 2023-10-03T10:17:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 --2- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009e760 0x7f230013a730 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 --2- 172.21.15.19:0/2998659905 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23001338a0 0x7f2300133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 --2- 172.21.15.19:0/2998659905 >> v2:172.21.15.19:3300/0 conn(0x7f230009de50 0x7f230009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 -- 172.21.15.19:0/2998659905 >> 172.21.15.19:0/2998659905 conn(0x7f23000a2aa0 msgr2=0x7f23000a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 -- 172.21.15.19:0/2998659905 shutdown_connections 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.611+0000 7f2306b11700 1 -- 172.21.15.19:0/2998659905 wait complete. 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.612+0000 7f2306b11700 1 Processor -- start 2023-10-03T10:17:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.613+0000 7f2306b11700 1 -- start start 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.613+0000 7f2306b11700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009de50 0x7f23001214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f2306b11700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f230009e760 0x7f2300121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f2306b11700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f2306b11700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2300124140 con 0x7f23001338a0 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f2306b11700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2300123440 con 0x7f230009de50 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f2306b11700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23000a0f00 con 0x7f230009e760 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f22fffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f230009e760 0x7f2300121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40440/0 (socket says 172.21.15.19:40440) 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 -- 172.21.15.19:0/3015145989 learned_addr learned my addr 172.21.15.19:0/3015145989 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23048ad700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009de50 0x7f23001214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 -- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f230009e760 msgr2=0x7f2300121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f230009e760 0x7f2300121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 -- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009de50 msgr2=0x7f23001214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009de50 0x7f23001214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 -- 172.21.15.19:0/3015145989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8009a70 con 0x7f23001338a0 2023-10-03T10:17:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.614+0000 7f23050ae700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f22f8014040 tx=0x7f22f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.615+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80044d0 con 0x7f23001338a0 2023-10-03T10:17:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.615+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f8020070 con 0x7f23001338a0 2023-10-03T10:17:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.615+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230006f640 con 0x7f23001338a0 2023-10-03T10:17:30.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.615+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8004890 con 0x7f23001338a0 2023-10-03T10:17:30.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.615+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2300124a40 con 0x7f23001338a0 2023-10-03T10:17:30.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.616+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22f8012430 con 0x7f23001338a0 2023-10-03T10:17:30.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.616+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22f8022070 con 0x7f23001338a0 2023-10-03T10:17:30.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.616+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2300074ea0 con 0x7f23001338a0 2023-10-03T10:17:30.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.622+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22f8025970 con 0x7f23001338a0 2023-10-03T10:17:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.726+0000 7fc7cc43b700 1 Processor -- start 2023-10-03T10:17:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.726+0000 7f3a25b38700 1 Processor -- start 2023-10-03T10:17:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.726+0000 7fc7cc43b700 1 -- start start 2023-10-03T10:17:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 -- start start 2023-10-03T10:17:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 0x7f3a2009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 0x7f3a20130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7cc43b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a2009f130 con 0x7f3a2009e410 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2009f520 con 0x7f3a2009e000 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a25b38700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2009e930 con 0x7f3a2009d6f0 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7cc43b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 0x7fc7c4130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7cc43b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c409f130 con 0x7fc7c409e000 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7cc43b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c409f520 con 0x7fc7c409d6f0 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7cc43b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c409e930 con 0x7fc7c409e410 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7ca1d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7ca1d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51896/0 (socket says 172.21.15.19:51896) 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7fc7ca1d7700 1 -- 172.21.15.19:0/3915872220 learned_addr learned my addr 172.21.15.19:0/3915872220 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a1ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a2009e410 0x7f3a20130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34450/0 (socket says 172.21.15.19:34450) 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a1ffff700 1 -- 172.21.15.19:0/655140801 learned_addr learned my addr 172.21.15.19:0/655140801 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:30.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.727+0000 7f3a1effd700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 0x7f3a20130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca9d8700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 0x7fc7c4130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1f7fe700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 0x7f3a2009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1effd700 1 -- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 msgr2=0x7f3a2009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca1d7700 1 -- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 msgr2=0x7fc7c4130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca1d7700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 0x7fc7c4130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca1d7700 1 -- 172.21.15.19:0/3915872220 >> v1:172.21.15.19:6789/0 conn(0x7fc7c409e000 legacy=0x7fc7c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca1d7700 1 -- 172.21.15.19:0/3915872220 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c409b2d0 con 0x7fc7c409d6f0 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca9d8700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 0x7fc7c4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1effd700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 0x7f3a2009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1effd700 1 -- 172.21.15.19:0/655140801 >> v1:172.21.15.19:6789/0 conn(0x7f3a2009e410 legacy=0x7f3a20130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1effd700 1 -- 172.21.15.19:0/655140801 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2009b2d0 con 0x7f3a2009e000 2023-10-03T10:17:30.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1f7fe700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 0x7f3a2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:30.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7ca1d7700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009920 tx=0x7fc7c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c03ebdd5ad4a75e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7f3a1effd700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 0x7f3a20130660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009870 tx=0x7f3a14009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0bcfcc1cbfb188f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.728+0000 7fc7c91d5700 1 -- 172.21.15.19:0/3915872220 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c000ba60 con 0x7fc7c409d6f0 2023-10-03T10:17:30.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7c91d5700 1 -- 172.21.15.19:0/3915872220 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c000bbc0 con 0x7fc7c409d6f0 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7c91d5700 1 -- 172.21.15.19:0/3915872220 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c0009e70 con 0x7fc7c409d6f0 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7f3a1e7fc700 1 -- 172.21.15.19:0/655140801 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14011830 con 0x7f3a2009e000 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7f3a1e7fc700 1 -- 172.21.15.19:0/655140801 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a14011990 con 0x7f3a2009e000 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7f3a1e7fc700 1 -- 172.21.15.19:0/655140801 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a14011d20 con 0x7f3a2009e000 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 -- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 msgr2=0x7fc7c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009920 tx=0x7fc7c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7f3a25b38700 1 -- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 msgr2=0x7f3a20130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7f3a25b38700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 0x7f3a20130660 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3a14009870 tx=0x7f3a14009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 -- 172.21.15.19:0/3915872220 shutdown_connections 2023-10-03T10:17:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409e410 0x7fc7c4130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/3915872220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409d6f0 0x7fc7c409dac0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 -- 172.21.15.19:0/655140801 shutdown_connections 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009d6f0 0x7f3a2009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 --2- 172.21.15.19:0/655140801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e000 0x7f3a20130660 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 -- 172.21.15.19:0/655140801 >> 172.21.15.19:0/655140801 conn(0x7f3a20066f50 msgr2=0x7f3a2009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 -- 172.21.15.19:0/655140801 shutdown_connections 2023-10-03T10:17:30.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.730+0000 7f3a25b38700 1 -- 172.21.15.19:0/655140801 wait complete. 2023-10-03T10:17:30.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.729+0000 7fc7cc43b700 1 -- 172.21.15.19:0/3915872220 >> 172.21.15.19:0/3915872220 conn(0x7fc7c4066f50 msgr2=0x7fc7c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.731+0000 7fc7cc43b700 1 -- 172.21.15.19:0/3915872220 shutdown_connections 2023-10-03T10:17:30.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.731+0000 7f3a25b38700 1 Processor -- start 2023-10-03T10:17:30.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.731+0000 7fc7cc43b700 1 -- 172.21.15.19:0/3915872220 wait complete. 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.731+0000 7f3a25b38700 1 -- start start 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a2009d6f0 0x7f3a2012fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 0x7f3a20130750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a2013b7e0 con 0x7f3a2009d6f0 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20132500 con 0x7f3a2009e410 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a25b38700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20131880 con 0x7f3a2009e000 2023-10-03T10:17:30.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7fc7cc43b700 1 Processor -- start 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a1effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a1effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35904/0 (socket says 172.21.15.19:35904) 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a1effd700 1 -- 172.21.15.19:0/3245935507 learned_addr learned my addr 172.21.15.19:0/3245935507 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a1ffff700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 0x7f3a20130750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7f3a1f7fe700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a2009d6f0 0x7f3a2012fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.732+0000 7fc7cc43b700 1 -- start start 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 -- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 msgr2=0x7f3a20130210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 -- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a2009d6f0 msgr2=0x7f3a2012fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a2009d6f0 0x7f3a2012fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 -- 172.21.15.19:0/3245935507 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140094a0 con 0x7f3a2009e410 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1effd700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:30.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a1ffff700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 0x7f3a20130750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800caa0 tx=0x7f3a1800cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 0x7fc7c411e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7c409e410 0x7fc7c411eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c411f580 con 0x7fc7c409e410 2023-10-03T10:17:30.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c4130490 con 0x7fc7c409e000 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7cc43b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c41202e0 con 0x7fc7c409d6f0 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7c99d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7ca1d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 0x7fc7c411e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7c99d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51916/0 (socket says 172.21.15.19:51916) 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7c99d6700 1 -- 172.21.15.19:0/908036531 learned_addr learned my addr 172.21.15.19:0/908036531 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800a9a0 con 0x7f3a2009e410 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1800ab00 con 0x7f3a2009e410 2023-10-03T10:17:30.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1800ae70 con 0x7f3a2009e410 2023-10-03T10:17:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.733+0000 7fc7ca9d8700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7c409e410 0x7fc7c411eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a20072570 con 0x7f3a2009e410 2023-10-03T10:17:30.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a2013a6d0 con 0x7f3a2009e410 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 -- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 msgr2=0x7fc7c411e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 0x7fc7c411e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 -- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7c409e410 msgr2=0x7fc7c411eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7c409e410 0x7fc7c411eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 -- 172.21.15.19:0/908036531 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0009550 con 0x7fc7c409e000 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7ca1d7700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 0x7fc7c411e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.734+0000 7fc7c99d6700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400c4b0 tx=0x7fc7b400c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40052d0 con 0x7fc7c409e000 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b4005430 con 0x7fc7c409e000 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b40038c0 con 0x7fc7c409e000 2023-10-03T10:17:30.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c41218f0 con 0x7fc7c409e000 2023-10-03T10:17:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a20131250 con 0x7f3a2009e410 2023-10-03T10:17:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.735+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c409c700 con 0x7fc7c409e000 2023-10-03T10:17:30.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.736+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4074ea0 con 0x7fc7c409e000 2023-10-03T10:17:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.739+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a18012400 con 0x7f3a2009e410 2023-10-03T10:17:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.739+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a180128f0 con 0x7f3a2009e410 2023-10-03T10:17:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.744+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a1801b3b0 con 0x7f3a2009e410 2023-10-03T10:17:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.745+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7b4003a20 con 0x7fc7c409e000 2023-10-03T10:17:30.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.745+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7b403f130 con 0x7fc7c409e000 2023-10-03T10:17:30.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.753+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7b4003cd0 con 0x7fc7c409e000 2023-10-03T10:17:30.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.762+0000 7fb894d51700 1 Processor -- start 2023-10-03T10:17:30.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.762+0000 7fb894d51700 1 -- start start 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb89006c0e0 0x7fb89009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 0x7fb8901379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 0x7fb890138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89006c4b0 con 0x7fb89006c0e0 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8901388b0 con 0x7fb890134ec0 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb894d51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900a09c0 con 0x7fb890137f20 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 0x7fb8901379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb89006c0e0 0x7fb89009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 0x7fb8901379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51924/0 (socket says 172.21.15.19:51924) 2023-10-03T10:17:30.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88dd9b700 1 -- 172.21.15.19:0/2747840576 learned_addr learned my addr 172.21.15.19:0/2747840576 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88ed9d700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 0x7fb890138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88e59c700 1 -- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 msgr2=0x7fb890138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88e59c700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 0x7fb890138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.763+0000 7fb88e59c700 1 -- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 msgr2=0x7fb8901379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:30.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88e59c700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 0x7fb8901379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88e59c700 1 -- 172.21.15.19:0/2747840576 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb890134980 con 0x7fb89006c0e0 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88ed9d700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 0x7fb890138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88e59c700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb89006c0e0 0x7fb89009ac90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb880009840 tx=0x7fb880009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b943b64133f5f8f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88d59a700 1 -- 172.21.15.19:0/2747840576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880011830 con 0x7fb89006c0e0 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88d59a700 1 -- 172.21.15.19:0/2747840576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880011990 con 0x7fb89006c0e0 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.764+0000 7fb88d59a700 1 -- 172.21.15.19:0/2747840576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880011d20 con 0x7fb89006c0e0 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 -- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb89006c0e0 msgr2=0x7fb89009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb89006c0e0 0x7fb89009ac90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb880009840 tx=0x7fb880009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 -- 172.21.15.19:0/2747840576 shutdown_connections 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb890137f20 0x7fb890138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb89006c0e0 0x7fb89009ac90 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 --2- 172.21.15.19:0/2747840576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890134ec0 0x7fb8901379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 -- 172.21.15.19:0/2747840576 >> 172.21.15.19:0/2747840576 conn(0x7fb8900a4210 msgr2=0x7fb8900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 -- 172.21.15.19:0/2747840576 shutdown_connections 2023-10-03T10:17:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.765+0000 7fb894d51700 1 -- 172.21.15.19:0/2747840576 wait complete. 2023-10-03T10:17:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.767+0000 7fb894d51700 1 Processor -- start 2023-10-03T10:17:30.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.767+0000 7fb894d51700 1 -- start start 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 0x7fb8901ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890137f20 0x7fb89011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890134400 con 0x7fb890134ec0 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900a03f0 con 0x7fb890137f20 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb894d51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb89011e6a0 con 0x7fb89006c0e0 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb88dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40482/0 (socket says 172.21.15.19:40482) 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb88e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 0x7fb8901ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb88dd9b700 1 -- 172.21.15.19:0/3654591596 learned_addr learned my addr 172.21.15.19:0/3654591596 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.768+0000 7fb88ed9d700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890137f20 0x7fb89011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 -- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890137f20 msgr2=0x7fb89011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890137f20 0x7fb89011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 -- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 msgr2=0x7fb8901cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 -- 172.21.15.19:0/3654591596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8800094a0 con 0x7fb89006c0e0 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88dd9b700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb88e59c700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 0x7fb8901ccd50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb880016000 tx=0x7fb880004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880004510 con 0x7fb89006c0e0 2023-10-03T10:17:30.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88001e070 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb890134140 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800038e0 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.769+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb89011cca0 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.770+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb880003a40 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.770+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb880040440 con 0x7fb89006c0e0 2023-10-03T10:17:30.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.771+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb890074ea0 con 0x7fb89006c0e0 2023-10-03T10:17:30.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.780+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb88001a420 con 0x7fb89006c0e0 2023-10-03T10:17:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.851+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2300123600 con 0x7f23001338a0 2023-10-03T10:17:30.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.852+0000 7f22fd7fa700 1 -- 172.21.15.19:0/3015145989 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22f8025380 con 0x7f23001338a0 2023-10-03T10:17:30.852 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 msgr2=0x7f2300121f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f22f8014040 tx=0x7f22f8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 shutdown_connections 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23001338a0 0x7f2300121f60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f230009de50 0x7f23001214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 --2- 172.21.15.19:0/3015145989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f230009e760 0x7f2300121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 >> 172.21.15.19:0/3015145989 conn(0x7f23000a2aa0 msgr2=0x7f23001b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 shutdown_connections 2023-10-03T10:17:30.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.855+0000 7f2306b11700 1 -- 172.21.15.19:0/3015145989 wait complete. 2023-10-03T10:17:30.870 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:30.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.962+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3a20074ea0 con 0x7f3a2009e410 2023-10-03T10:17:30.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.963+0000 7f3a07fff700 1 -- 172.21.15.19:0/3245935507 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a18017070 con 0x7f3a2009e410 2023-10-03T10:17:30.963 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:30.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 msgr2=0x7f3a20130750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 0x7f3a20130750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800caa0 tx=0x7f3a1800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 shutdown_connections 2023-10-03T10:17:30.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a2009e410 0x7f3a20130750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a2009d6f0 0x7f3a2012fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 --2- 172.21.15.19:0/3245935507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a2009e000 0x7f3a20130210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 >> 172.21.15.19:0/3245935507 conn(0x7f3a20066f50 msgr2=0x7f3a200a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 shutdown_connections 2023-10-03T10:17:30.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.965+0000 7f3a25b38700 1 -- 172.21.15.19:0/3245935507 wait complete. 2023-10-03T10:17:30.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:30.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.990+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc7c406c360 con 0x7fc7c409e000 2023-10-03T10:17:30.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.990+0000 7fc7baffd700 1 -- 172.21.15.19:0/908036531 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7b4017020 con 0x7fc7c409e000 2023-10-03T10:17:30.990 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 msgr2=0x7fc7c411e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc7b400c4b0 tx=0x7fc7b400c870 comp rx=0 tx=0).stop 2023-10-03T10:17:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 shutdown_connections 2023-10-03T10:17:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7c409e410 0x7fc7c411eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc7c409d6f0 0x7fc7c411e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 --2- 172.21.15.19:0/908036531 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc7c409e000 0x7fc7c411e5f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:30.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 >> 172.21.15.19:0/908036531 conn(0x7fc7c4066f50 msgr2=0x7fc7c406f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:30.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 shutdown_connections 2023-10-03T10:17:30.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:30.994+0000 7fc7cc43b700 1 -- 172.21.15.19:0/908036531 wait complete. 2023-10-03T10:17:31.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:31.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.022+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb89006b250 con 0x7fb89006c0e0 2023-10-03T10:17:31.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.023+0000 7fb87effd700 1 -- 172.21.15.19:0/3654591596 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb880015020 con 0x7fb89006c0e0 2023-10-03T10:17:31.022 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 msgr2=0x7fb8901ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 0x7fb8901ccd50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb880016000 tx=0x7fb880004750 comp rx=0 tx=0).stop 2023-10-03T10:17:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 shutdown_connections 2023-10-03T10:17:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb890137f20 0x7fb89011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb89006c0e0 0x7fb8901ccd50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 --2- 172.21.15.19:0/3654591596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb890134ec0 0x7fb8901cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 >> 172.21.15.19:0/3654591596 conn(0x7fb8900a4210 msgr2=0x7fb890099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 shutdown_connections 2023-10-03T10:17:31.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:31.025+0000 7fb894d51700 1 -- 172.21.15.19:0/3654591596 wait complete. 2023-10-03T10:17:31.038 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:31.871 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:31.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:32.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:32.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 Processor -- start 2023-10-03T10:17:32.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 -- start start 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 0x7f0358131c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f035806ae80 0x7f0358139590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035809dba0 con 0x7f035809e230 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0358132140 con 0x7f035806ae80 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035ebfc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03581313e0 con 0x7f0358131830 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f035d199700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f035806ae80 0x7f0358139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f0357fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f035809e230 0x7f035806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34466/0 (socket says 172.21.15.19:34466) 2023-10-03T10:17:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.020+0000 7f0357fff700 1 -- 172.21.15.19:0/799666051 learned_addr learned my addr 172.21.15.19:0/799666051 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035c998700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 0x7f0358131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035d199700 1 -- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 msgr2=0x7f0358131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035d199700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 0x7f0358131c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035d199700 1 -- 172.21.15.19:0/799666051 >> v1:172.21.15.19:6789/0 conn(0x7f035809e230 legacy=0x7f035806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035d199700 1 -- 172.21.15.19:0/799666051 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035809d6d0 con 0x7f035806ae80 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f03577fe700 1 -- 172.21.15.19:0/799666051 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512974610 0 0) 0x7f035809dba0 con 0x7f035809e230 2023-10-03T10:17:32.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035c998700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 0x7f0358131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f035d199700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035806ae80 0x7f0358139590 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998fe2f784beab1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f03577fe700 1 -- 172.21.15.19:0/799666051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000e070 con 0x7f035806ae80 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f03577fe700 1 -- 172.21.15.19:0/799666051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000bb20 con 0x7f035806ae80 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.021+0000 7f03577fe700 1 -- 172.21.15.19:0/799666051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350012430 con 0x7f035806ae80 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 -- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035806ae80 msgr2=0x7f0358139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035806ae80 0x7f0358139590 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 -- 172.21.15.19:0/799666051 shutdown_connections 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035806ae80 0x7f0358139590 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 --2- 172.21.15.19:0/799666051 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0358131830 0x7f0358131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 -- 172.21.15.19:0/799666051 >> 172.21.15.19:0/799666051 conn(0x7f0358099c20 msgr2=0x7f03580a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 -- 172.21.15.19:0/799666051 shutdown_connections 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.022+0000 7f035ebfc700 1 -- 172.21.15.19:0/799666051 wait complete. 2023-10-03T10:17:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.023+0000 7f035ebfc700 1 Processor -- start 2023-10-03T10:17:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.023+0000 7f035ebfc700 1 -- start start 2023-10-03T10:17:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 0x7f035809a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 0x7f035809ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035809bfb0 con 0x7f035809e230 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035811fcc0 con 0x7f0358131830 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035ebfc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0358130300 con 0x7f035806ae80 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035c998700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f0357fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 0x7f035809a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035c998700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35942/0 (socket says 172.21.15.19:35942) 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035c998700 1 -- 172.21.15.19:0/3394426351 learned_addr learned my addr 172.21.15.19:0/3394426351 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.024+0000 7f035d199700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 0x7f035809ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 -- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 msgr2=0x7f035809a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 -- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 msgr2=0x7f035809ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 0x7f035809ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 -- 172.21.15.19:0/3394426351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480094a0 con 0x7f035809e230 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f035d199700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 0x7f035809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f035c998700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f0357fff700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 0x7f035809a840 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f035812b870 tx=0x7f034c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c004c80 con 0x7f035809e230 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c004de0 con 0x7f035809e230 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.025+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c007310 con 0x7f035809e230 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.026+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0350009a70 con 0x7f035809e230 2023-10-03T10:17:32.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.026+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035811e880 con 0x7f035809e230 2023-10-03T10:17:32.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.027+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f034c007470 con 0x7f035809e230 2023-10-03T10:17:32.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.027+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035811fb00 con 0x7f035809e230 2023-10-03T10:17:32.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.027+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f034c03f1f0 con 0x7f035809e230 2023-10-03T10:17:32.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.033+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f034c007720 con 0x7f035809e230 2023-10-03T10:17:32.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:32.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.125+0000 7f4d02a8e700 1 Processor -- start 2023-10-03T10:17:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 -- start start 2023-10-03T10:17:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc09e1d0 0x7f4cfc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc09f130 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc09f520 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.126+0000 7f4d02a8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc09e930 con 0x7f4cfc135e50 2023-10-03T10:17:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc09e1d0 0x7f4cfc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4cfc09e1d0 0x7f4cfc135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40506/0 (socket says 172.21.15.19:40506) 2023-10-03T10:17:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 -- 172.21.15.19:0/2207224393 learned_addr learned my addr 172.21.15.19:0/2207224393 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4d0102b700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 -- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 msgr2=0x7f4cfc138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 -- 172.21.15.19:0/2207224393 >> v1:172.21.15.19:6789/0 conn(0x7f4cfc09d6f0 legacy=0x7f4cfc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 -- 172.21.15.19:0/2207224393 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc09b2d0 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfb7fe700 1 -- 172.21.15.19:0/2207224393 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126063948 0 0) 0x7f4cfc09f130 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4d0102b700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.127+0000 7f4cfbfff700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09e1d0 0x7f4cfc135910 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098f0 tx=0x7f4ce8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fd1f9ac4582b68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4cfb7fe700 1 -- 172.21.15.19:0/2207224393 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8011830 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4cfb7fe700 1 -- 172.21.15.19:0/2207224393 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8011990 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4cfb7fe700 1 -- 172.21.15.19:0/2207224393 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8011d20 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 -- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09e1d0 msgr2=0x7f4cfc135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09e1d0 0x7f4cfc135910 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098f0 tx=0x7f4ce8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 -- 172.21.15.19:0/2207224393 shutdown_connections 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/2207224393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09e1d0 0x7f4cfc135910 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.128+0000 7f4d02a8e700 1 -- 172.21.15.19:0/2207224393 >> 172.21.15.19:0/2207224393 conn(0x7f4cfc066f50 msgr2=0x7f4cfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.129+0000 7f4d02a8e700 1 -- 172.21.15.19:0/2207224393 shutdown_connections 2023-10-03T10:17:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.129+0000 7f4d02a8e700 1 -- 172.21.15.19:0/2207224393 wait complete. 2023-10-03T10:17:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 Processor -- start 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 -- start start 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc11c540 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc12fd20 con 0x7f4cfc135e50 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d02a8e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc11af10 con 0x7f4cfc09e1d0 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4d0082a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.130+0000 7f4cfbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cfbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35948/0 (socket says 172.21.15.19:35948) 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40514/0 (socket says 172.21.15.19:40514) 2023-10-03T10:17:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cfbfff700 1 -- 172.21.15.19:0/205878638 learned_addr learned my addr 172.21.15.19:0/205878638 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0102b700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 -- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 msgr2=0x7f4cfc1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 -- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 msgr2=0x7f4cfc119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 -- 172.21.15.19:0/205878638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4009a70 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cfbfff700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d0082a700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0001b40 tx=0x7f4cf0014f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf0005480 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cf000a700 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce8009550 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cf000aab0 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.131+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc09c700 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.132+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc11c7c0 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.133+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cf000ac10 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.134+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cf00475f0 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.138+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cf0003680 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.165+0000 7f258bf07700 1 Processor -- start 2023-10-03T10:17:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.165+0000 7f258bf07700 1 -- start start 2023-10-03T10:17:32.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f258bf07700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258409e930 0x7f258409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f258bf07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f240 0x7f25841317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f258bf07700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2584070940 con 0x7f258409f650 2023-10-03T10:17:32.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f258bf07700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258406fd60 con 0x7f258409e930 2023-10-03T10:17:32.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f258bf07700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258406fa80 con 0x7f258409f240 2023-10-03T10:17:32.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f2589ca3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258409e930 0x7f258409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f2589ca3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258409e930 0x7f258409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40520/0 (socket says 172.21.15.19:40520) 2023-10-03T10:17:32.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f2589ca3700 1 -- 172.21.15.19:0/2453905118 learned_addr learned my addr 172.21.15.19:0/2453905118 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.166+0000 7f25894a2700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f240 0x7f25841317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2589ca3700 1 -- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f240 msgr2=0x7f25841317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2589ca3700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f240 0x7f25841317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2589ca3700 1 -- 172.21.15.19:0/2453905118 >> v1:172.21.15.19:6789/0 conn(0x7f258409f650 legacy=0x7f2584131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2589ca3700 1 -- 172.21.15.19:0/2453905118 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258409fb60 con 0x7f258409e930 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2589ca3700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409e930 0x7f258409ed00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f25800098f0 tx=0x7f2580009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f273b8574ff197 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2588ca1700 1 -- 172.21.15.19:0/2453905118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580011830 con 0x7f258409e930 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2588ca1700 1 -- 172.21.15.19:0/2453905118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580011990 con 0x7f258409e930 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.167+0000 7f2588ca1700 1 -- 172.21.15.19:0/2453905118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580011d20 con 0x7f258409e930 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 -- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409e930 msgr2=0x7f258409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409e930 0x7f258409ed00 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f25800098f0 tx=0x7f2580009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 -- 172.21.15.19:0/2453905118 shutdown_connections 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409e930 0x7f258409ed00 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 --2- 172.21.15.19:0/2453905118 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f240 0x7f25841317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 -- 172.21.15.19:0/2453905118 >> 172.21.15.19:0/2453905118 conn(0x7f25840a4210 msgr2=0x7f25840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 -- 172.21.15.19:0/2453905118 shutdown_connections 2023-10-03T10:17:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.168+0000 7f258bf07700 1 -- 172.21.15.19:0/2453905118 wait complete. 2023-10-03T10:17:32.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.169+0000 7f258bf07700 1 Processor -- start 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.169+0000 7f258bf07700 1 -- start start 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 0x7f258406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f650 0x7f258406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841a89c0 con 0x7f258409f240 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25841a9a00 con 0x7f258409f650 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258bf07700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25841a94f0 con 0x7f258409e930 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f2589ca3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f2589ca3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35962/0 (socket says 172.21.15.19:35962) 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f2589ca3700 1 -- 172.21.15.19:0/2170617395 learned_addr learned my addr 172.21.15.19:0/2170617395 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f25894a2700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 0x7f258406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.170+0000 7f258a4a4700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f650 0x7f258406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 -- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 msgr2=0x7f258406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 -- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f650 msgr2=0x7f258406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f650 0x7f258406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 -- 172.21.15.19:0/2170617395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2580009550 con 0x7f258409f240 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f2589ca3700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f25894a2700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 0x7f258406bdf0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f257400e930 tx=0x7f257400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574013680 con 0x7f258409f240 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740137e0 con 0x7f258409f240 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25840a0190 con 0x7f258409f240 2023-10-03T10:17:32.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574013b50 con 0x7f258409f240 2023-10-03T10:17:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.171+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25840a3670 con 0x7f258409f240 2023-10-03T10:17:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.172+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2574013cb0 con 0x7f258409f240 2023-10-03T10:17:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.173+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f257403f6a0 con 0x7f258409f240 2023-10-03T10:17:32.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.173+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c0052e0 con 0x7f258409f240 2023-10-03T10:17:32.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.178+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f257401be10 con 0x7f258409f240 2023-10-03T10:17:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 Processor -- start 2023-10-03T10:17:32.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 -- start start 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 0x7f3d18131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d181313c0 con 0x7f3d18131810 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1806e8c0 con 0x7f3d1809a3b0 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1d0ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d18071d20 con 0x7f3d18099a40 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35976/0 (socket says 172.21.15.19:35976) 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d1659c700 1 -- 172.21.15.19:0/1333703667 learned_addr learned my addr 172.21.15.19:0/1333703667 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.233+0000 7f3d16d9d700 1 --2- 172.21.15.19:0/1333703667 >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 0x7f3d18131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1759e700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 -- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 msgr2=0x7f3d18138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 -- 172.21.15.19:0/1333703667 >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 msgr2=0x7f3d18131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1333703667 >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 0x7f3d18131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 -- 172.21.15.19:0/1333703667 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180721a0 con 0x7f3d18099a40 2023-10-03T10:17:32.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d16d9d700 1 --2- 172.21.15.19:0/1333703667 >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 0x7f3d18131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0098f0 tx=0x7f3d0c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a8f433a3cd4734 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d15d9b700 1 -- 172.21.15.19:0/1333703667 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c011830 con 0x7f3d18099a40 2023-10-03T10:17:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d15d9b700 1 -- 172.21.15.19:0/1333703667 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c011990 con 0x7f3d18099a40 2023-10-03T10:17:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.234+0000 7f3d15d9b700 1 -- 172.21.15.19:0/1333703667 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c011d20 con 0x7f3d18099a40 2023-10-03T10:17:32.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 msgr2=0x7f3d18099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0098f0 tx=0x7f3d0c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1333703667 shutdown_connections 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1333703667 >> v2:172.21.15.19:3300/0 conn(0x7f3d18131810 0x7f3d18131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1333703667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18099e70 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1333703667 >> 172.21.15.19:0/1333703667 conn(0x7f3d180a2aa0 msgr2=0x7f3d180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1333703667 shutdown_connections 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.235+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1333703667 wait complete. 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 Processor -- start 2023-10-03T10:17:32.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 -- start start 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18119800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d18131810 0x7f3d1811a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1811b900 con 0x7f3d18131810 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180a1b40 con 0x7f3d1809a3b0 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1d0ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1806eb00 con 0x7f3d18099a40 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51996/0 (socket says 172.21.15.19:51996) 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.237+0000 7f3d1659c700 1 -- 172.21.15.19:0/1464911292 learned_addr learned my addr 172.21.15.19:0/1464911292 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:32.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1759e700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d18131810 0x7f3d1811a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 -- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 msgr2=0x7f3d18119800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18119800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 -- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d18131810 msgr2=0x7f3d1811a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d18131810 0x7f3d1811a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 -- 172.21.15.19:0/1464911292 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009550 con 0x7f3d1809a3b0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3d1659c700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c000c00 tx=0x7f3d0c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c004400 con 0x7f3d1809a3b0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c01f070 con 0x7f3d1809a3b0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.238+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0038e0 con 0x7f3d1809a3b0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.239+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1811c9f0 con 0x7f3d1809a3b0 2023-10-03T10:17:32.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.239+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1811d760 con 0x7f3d1809a3b0 2023-10-03T10:17:32.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.240+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d0c021030 con 0x7f3d1809a3b0 2023-10-03T10:17:32.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.240+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d0c040b80 con 0x7f3d1809a3b0 2023-10-03T10:17:32.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.241+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1811cbe0 con 0x7f3d1809a3b0 2023-10-03T10:17:32.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.246+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d0c015080 con 0x7f3d1809a3b0 2023-10-03T10:17:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.319+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f035804f2a0 con 0x7f035809e230 2023-10-03T10:17:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.320+0000 7f03557fa700 1 -- 172.21.15.19:0/3394426351 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f034c01b340 con 0x7f035809e230 2023-10-03T10:17:32.320 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:32.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 msgr2=0x7f035809a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 0x7f035809a840 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f035812b870 tx=0x7f034c00c750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 shutdown_connections 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0358131830 0x7f035809ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f035806ae80 0x7f035809a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 --2- 172.21.15.19:0/3394426351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f035809e230 0x7f035809a840 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 >> 172.21.15.19:0/3394426351 conn(0x7f0358099c20 msgr2=0x7f035812d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 shutdown_connections 2023-10-03T10:17:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.322+0000 7f035ebfc700 1 -- 172.21.15.19:0/3394426351 wait complete. 2023-10-03T10:17:32.337 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:32.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.350+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4cfc11c7c0 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.350+0000 7f4cf97fa700 1 -- 172.21.15.19:0/205878638 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cfc11c7c0 con 0x7f4cfc09d6f0 2023-10-03T10:17:32.350 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:32.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 msgr2=0x7f4cfc119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0001b40 tx=0x7f4cf0014f70 comp rx=0 tx=0).stop 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 shutdown_connections 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cfc135e50 0x7f4cfc119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cfc09d6f0 0x7f4cfc119480 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 --2- 172.21.15.19:0/205878638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cfc09e1d0 0x7f4cfc1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 >> 172.21.15.19:0/205878638 conn(0x7f4cfc066f50 msgr2=0x7f4cfc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 shutdown_connections 2023-10-03T10:17:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.352+0000 7f4d02a8e700 1 -- 172.21.15.19:0/205878638 wait complete. 2023-10-03T10:17:32.366 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.389+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f256c005590 con 0x7f258409f240 2023-10-03T10:17:32.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.389+0000 7f257a7fc700 1 -- 172.21.15.19:0/2170617395 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f257401b3b0 con 0x7f258409f240 2023-10-03T10:17:32.389 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 msgr2=0x7f258406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 0x7f258406bdf0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f257400e930 tx=0x7f257400ec40 comp rx=0 tx=0).stop 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 shutdown_connections 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258409f650 0x7f258406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258409e930 0x7f258406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 --2- 172.21.15.19:0/2170617395 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258409f240 0x7f258406bdf0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 >> 172.21.15.19:0/2170617395 conn(0x7f25840a4210 msgr2=0x7f25841b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 shutdown_connections 2023-10-03T10:17:32.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.392+0000 7f258bf07700 1 -- 172.21.15.19:0/2170617395 wait complete. 2023-10-03T10:17:32.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:32.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.453+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3d1811c5a0 con 0x7f3d1809a3b0 2023-10-03T10:17:32.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.454+0000 7f3cff7fe700 1 -- 172.21.15.19:0/1464911292 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d0c004560 con 0x7f3d1809a3b0 2023-10-03T10:17:32.454 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 msgr2=0x7f3d18119d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c000c00 tx=0x7f3d0c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 shutdown_connections 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d18131810 0x7f3d1811a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d18099a40 0x7f3d18119800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 --2- 172.21.15.19:0/1464911292 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d1809a3b0 0x7f3d18119d40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:32.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 >> 172.21.15.19:0/1464911292 conn(0x7f3d180a2aa0 msgr2=0x7f3d1812e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:32.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 shutdown_connections 2023-10-03T10:17:32.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:32.456+0000 7f3d1d0ee700 1 -- 172.21.15.19:0/1464911292 wait complete. 2023-10-03T10:17:32.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:33.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:33.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:33.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:33.470 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:33.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 Processor -- start 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 -- start start 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2e406a770 0x7ff2e406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e409ece0 con 0x7ff2e4131b40 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e409e760 con 0x7ff2e406a770 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.490+0000 7ff2e988e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e409e040 con 0x7ff2e406b080 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2e406a770 0x7ff2e406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35992/0 (socket says 172.21.15.19:35992) 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff2e4131b40 0x7ff2e4138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34494/0 (socket says 172.21.15.19:34494) 2023-10-03T10:17:33.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 -- 172.21.15.19:0/661152777 learned_addr learned my addr 172.21.15.19:0/661152777 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 -- 172.21.15.19:0/661152777 >> v2:172.21.15.19:3300/0 conn(0x7ff2e406a770 msgr2=0x7ff2e406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 --2- 172.21.15.19:0/661152777 >> v2:172.21.15.19:3300/0 conn(0x7ff2e406a770 0x7ff2e406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 -- 172.21.15.19:0/661152777 >> v1:172.21.15.19:6789/0 conn(0x7ff2e4131b40 legacy=0x7ff2e4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 -- 172.21.15.19:0/661152777 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e409f630 con 0x7ff2e406b080 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.491+0000 7ff2e27fc700 1 --2- 172.21.15.19:0/661152777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098f0 tx=0x7ff2d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d773e4e215a33cd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e1ffb700 1 -- 172.21.15.19:0/661152777 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011830 con 0x7ff2e406b080 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e1ffb700 1 -- 172.21.15.19:0/661152777 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8011990 con 0x7ff2e406b080 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e1ffb700 1 -- 172.21.15.19:0/661152777 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011d20 con 0x7ff2e406b080 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 -- 172.21.15.19:0/661152777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 msgr2=0x7ff2e4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 --2- 172.21.15.19:0/661152777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098f0 tx=0x7ff2d8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 -- 172.21.15.19:0/661152777 shutdown_connections 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 --2- 172.21.15.19:0/661152777 >> v2:172.21.15.19:3300/0 conn(0x7ff2e406a770 0x7ff2e406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 --2- 172.21.15.19:0/661152777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e406b080 0x7ff2e4131600 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.492+0000 7ff2e988e700 1 -- 172.21.15.19:0/661152777 >> 172.21.15.19:0/661152777 conn(0x7ff2e4066f50 msgr2=0x7ff2e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.493+0000 7ff2e988e700 1 -- 172.21.15.19:0/661152777 shutdown_connections 2023-10-03T10:17:33.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.493+0000 7ff2e988e700 1 -- 172.21.15.19:0/661152777 wait complete. 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 Processor -- start 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 -- start start 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2e406b080 0x7ff2e4127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 0x7ff2e4127b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4131670 con 0x7ff2e406a770 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4071e60 con 0x7ff2e406b080 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.494+0000 7ff2e988e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e412a4e0 con 0x7ff2e4131b40 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 0x7ff2e4127b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40544/0 (socket says 172.21.15.19:40544) 2023-10-03T10:17:33.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e2ffd700 1 -- 172.21.15.19:0/3347964596 learned_addr learned my addr 172.21.15.19:0/3347964596 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 -- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2e406b080 msgr2=0x7ff2e4127630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2e406b080 0x7ff2e4127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 -- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 msgr2=0x7ff2e41270f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 -- 172.21.15.19:0/3347964596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8009550 con 0x7ff2e4131b40 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e2ffd700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2e37fe700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 0x7ff2e4127b70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cb10 tx=0x7ff2dc00ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc00aaa0 con 0x7ff2e4131b40 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc00ac00 con 0x7ff2e4131b40 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.495+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc007070 con 0x7ff2e4131b40 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.496+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e41291f0 con 0x7ff2e4131b40 2023-10-03T10:17:33.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.496+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e412a8e0 con 0x7ff2e4131b40 2023-10-03T10:17:33.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.497+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e411ac20 con 0x7ff2e4131b40 2023-10-03T10:17:33.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.498+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2dc0071d0 con 0x7ff2e4131b40 2023-10-03T10:17:33.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.498+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2dc03fdb0 con 0x7ff2e4131b40 2023-10-03T10:17:33.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.503+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2dc01b3b0 con 0x7ff2e4131b40 2023-10-03T10:17:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 Processor -- start 2023-10-03T10:17:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 -- start start 2023-10-03T10:17:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f89a412cf60 0x7f89a406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a4137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a412cd90 con 0x7f89a412f8b0 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a412d330 con 0x7f89a412cf60 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.538+0000 7f89ac19c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4071780 con 0x7f89a4130430 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9737700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f89a412f8b0 0x7f89a412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34496/0 (socket says 172.21.15.19:34496) 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9737700 1 -- 172.21.15.19:0/940562085 learned_addr learned my addr 172.21.15.19:0/940562085 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9f38700 1 --2- 172.21.15.19:0/940562085 >> v2:172.21.15.19:3300/0 conn(0x7f89a412cf60 0x7f89a406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89aa739700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a4137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9f38700 1 -- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 msgr2=0x7f89a4137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9f38700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a4137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9f38700 1 -- 172.21.15.19:0/940562085 >> v1:172.21.15.19:6789/0 conn(0x7f89a412f8b0 legacy=0x7f89a412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a9f38700 1 -- 172.21.15.19:0/940562085 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4071a40 con 0x7f89a412cf60 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.539+0000 7f89a8f36700 1 -- 172.21.15.19:0/940562085 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464520790 0 0) 0x7f89a412cd90 con 0x7f89a412f8b0 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.540+0000 7f89a9f38700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412cf60 0x7f89a406f5d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006b00 tx=0x7f89a000ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752c0d10696cf8b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.540+0000 7f89a8f36700 1 -- 172.21.15.19:0/940562085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0004230 con 0x7f89a412cf60 2023-10-03T10:17:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.540+0000 7f89a8f36700 1 -- 172.21.15.19:0/940562085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a000d040 con 0x7f89a412cf60 2023-10-03T10:17:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.540+0000 7f89a8f36700 1 -- 172.21.15.19:0/940562085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00036a0 con 0x7f89a412cf60 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 -- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412cf60 msgr2=0x7f89a406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412cf60 0x7f89a406f5d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006b00 tx=0x7f89a000ab40 comp rx=0 tx=0).stop 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 -- 172.21.15.19:0/940562085 shutdown_connections 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a4137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 --2- 172.21.15.19:0/940562085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412cf60 0x7f89a406f5d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 -- 172.21.15.19:0/940562085 >> 172.21.15.19:0/940562085 conn(0x7f89a40a2aa0 msgr2=0x7f89a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 -- 172.21.15.19:0/940562085 shutdown_connections 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.541+0000 7f89ac19c700 1 -- 172.21.15.19:0/940562085 wait complete. 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.542+0000 7f89ac19c700 1 Processor -- start 2023-10-03T10:17:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.542+0000 7f89ac19c700 1 -- start start 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 0x7f89a409c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a41c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a409e9b0 con 0x7f89a412f8b0 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4067c90 con 0x7f89a412cf60 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89ac19c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f89a409b6b0 con 0x7f89a4130430 2023-10-03T10:17:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52008/0 (socket says 172.21.15.19:52008) 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 -- 172.21.15.19:0/3131005482 learned_addr learned my addr 172.21.15.19:0/3131005482 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89aa739700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a41c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9737700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 0x7f89a409c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 -- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 msgr2=0x7f89a41c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a41c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 -- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 msgr2=0x7f89a409c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 0x7f89a409c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9f38700 1 -- 172.21.15.19:0/3131005482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a000a4c0 con 0x7f89a412cf60 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89aa739700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a41c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.543+0000 7f89a9737700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 0x7f89a409c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f89a9f38700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f89a412d470 tx=0x7f89a0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0011620 con 0x7f89a412cf60 2023-10-03T10:17:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a001f070 con 0x7f89a412cf60 2023-10-03T10:17:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a409b3e0 con 0x7f89a412cf60 2023-10-03T10:17:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00119e0 con 0x7f89a412cf60 2023-10-03T10:17:33.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.544+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a411d500 con 0x7f89a412cf60 2023-10-03T10:17:33.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.545+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89a0021030 con 0x7f89a412cf60 2023-10-03T10:17:33.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.545+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a4129fa0 con 0x7f89a412cf60 2023-10-03T10:17:33.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.545+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89a0040b90 con 0x7f89a412cf60 2023-10-03T10:17:33.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.555+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f89a0011b40 con 0x7f89a412cf60 2023-10-03T10:17:33.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.579+0000 7fc6f48d9700 1 Processor -- start 2023-10-03T10:17:33.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.579+0000 7fc6f48d9700 1 -- start start 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6f48d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6f48d9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6f00a1340 0x7fc6f0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6f48d9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f009edd0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6f48d9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f009e1f0 con 0x7fc6f00a1340 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6f48d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f009dc50 con 0x7fc6f00a0a30 2023-10-03T10:17:33.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36014/0 (socket says 172.21.15.19:36014) 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 -- 172.21.15.19:0/340373305 learned_addr learned my addr 172.21.15.19:0/340373305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6edd9b700 1 --2- 172.21.15.19:0/340373305 >> v2:172.21.15.19:3300/0 conn(0x7fc6f00a1340 0x7fc6f0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 -- 172.21.15.19:0/340373305 >> v2:172.21.15.19:3300/0 conn(0x7fc6f00a1340 msgr2=0x7fc6f0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 --2- 172.21.15.19:0/340373305 >> v2:172.21.15.19:3300/0 conn(0x7fc6f00a1340 0x7fc6f0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 -- 172.21.15.19:0/340373305 >> v1:172.21.15.19:6789/0 conn(0x7fc6f0133fa0 legacy=0x7fc6f013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.580+0000 7fc6ee59c700 1 -- 172.21.15.19:0/340373305 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00a1fe0 con 0x7fc6f00a0a30 2023-10-03T10:17:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.581+0000 7fc6ee59c700 1 --2- 172.21.15.19:0/340373305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009e50 tx=0x7fc6e000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2728ddeb3b8a20c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.581+0000 7fc6ed59a700 1 -- 172.21.15.19:0/340373305 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000e070 con 0x7fc6f00a0a30 2023-10-03T10:17:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.581+0000 7fc6ed59a700 1 -- 172.21.15.19:0/340373305 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e000b910 con 0x7fc6f00a0a30 2023-10-03T10:17:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.581+0000 7fc6ed59a700 1 -- 172.21.15.19:0/340373305 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e000bcc0 con 0x7fc6f00a0a30 2023-10-03T10:17:33.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 -- 172.21.15.19:0/340373305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 msgr2=0x7fc6f00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/340373305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009e50 tx=0x7fc6e000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 -- 172.21.15.19:0/340373305 shutdown_connections 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/340373305 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f00a0a30 0x7fc6f00a0e00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/340373305 >> v2:172.21.15.19:3300/0 conn(0x7fc6f00a1340 0x7fc6f0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 -- 172.21.15.19:0/340373305 >> 172.21.15.19:0/340373305 conn(0x7fc6f00a6550 msgr2=0x7fc6f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 -- 172.21.15.19:0/340373305 shutdown_connections 2023-10-03T10:17:33.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.582+0000 7fc6f48d9700 1 -- 172.21.15.19:0/340373305 wait complete. 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.583+0000 7fc6f48d9700 1 Processor -- start 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.583+0000 7fc6f48d9700 1 -- start start 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f00a0a30 0x7fc6f011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6f00a1340 0x7fc6f011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00a0290 con 0x7fc6f00a0a30 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01209e0 con 0x7fc6f00a1340 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6f48d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0122010 con 0x7fc6f0133fa0 2023-10-03T10:17:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36028/0 (socket says 172.21.15.19:36028) 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 -- 172.21.15.19:0/141792575 learned_addr learned my addr 172.21.15.19:0/141792575 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6ee59c700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f00a0a30 0x7fc6f011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 -- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6f00a1340 msgr2=0x7fc6f011eda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6f00a1340 0x7fc6f011eda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 -- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f00a0a30 msgr2=0x7fc6f011e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f00a0a30 0x7fc6f011e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.584+0000 7fc6eed9d700 1 -- 172.21.15.19:0/141792575 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009b30 con 0x7fc6f0133fa0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6eed9d700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c500 tx=0x7fc6e800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80052d0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8005430 con 0x7fc6f0133fa0 2023-10-03T10:17:33.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f0120560 con 0x7fc6f0133fa0 2023-10-03T10:17:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80038c0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.585+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f00a38a0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.586+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6e8003a20 con 0x7fc6f0133fa0 2023-10-03T10:17:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.586+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f0074ea0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.586+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6e803eab0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.592+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6e8018260 con 0x7fc6f0133fa0 2023-10-03T10:17:33.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.624+0000 7f7d0b7ab700 1 Processor -- start 2023-10-03T10:17:33.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.624+0000 7f7d0b7ab700 1 -- start start 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d0409e410 0x7f7d04130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0409f520 con 0x7f7d0409e410 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0409f130 con 0x7f7d0409d6f0 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d0b7ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0409e930 con 0x7f7d0409e000 2023-10-03T10:17:33.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d08d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d09547700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d08d46700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36034/0 (socket says 172.21.15.19:36034) 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d08d46700 1 -- 172.21.15.19:0/999427973 learned_addr learned my addr 172.21.15.19:0/999427973 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d09547700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52024/0 (socket says 172.21.15.19:52024) 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.625+0000 7f7d09d48700 1 --2- 172.21.15.19:0/999427973 >> v2:172.21.15.19:3300/0 conn(0x7f7d0409e410 0x7f7d04130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 -- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 msgr2=0x7f7d04130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 -- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 msgr2=0x7f7d0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 -- 172.21.15.19:0/999427973 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0409b2d0 con 0x7f7d0409e410 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d08d46700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:33.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7d09d48700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d04130ba0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d90 tx=0x7f7cfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43030a25ed44e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7cfbfff700 1 -- 172.21.15.19:0/999427973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00e070 con 0x7f7d0409e410 2023-10-03T10:17:33.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7cfbfff700 1 -- 172.21.15.19:0/999427973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00bb20 con 0x7f7d0409e410 2023-10-03T10:17:33.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.626+0000 7f7cfbfff700 1 -- 172.21.15.19:0/999427973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc012430 con 0x7f7d0409e410 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 msgr2=0x7f7d04130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d04130ba0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009d90 tx=0x7f7cfc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/999427973 shutdown_connections 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409d6f0 0x7f7d0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d04130ba0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/999427973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409e000 0x7f7d04130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/999427973 >> 172.21.15.19:0/999427973 conn(0x7f7d04066f50 msgr2=0x7f7d0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/999427973 shutdown_connections 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.627+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/999427973 wait complete. 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.629+0000 7f7d0b7ab700 1 Processor -- start 2023-10-03T10:17:33.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.629+0000 7f7d0b7ab700 1 -- start start 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 0x7f7d041c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409e000 0x7f7d041c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04119dd0 con 0x7f7d0409e410 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d041382e0 con 0x7f7d0409e000 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d0b7ab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d040a2000 con 0x7f7d0409d6f0 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09547700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 0x7f7d041c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40608/0 (socket says 172.21.15.19:40608) 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09547700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 0x7f7d041c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36040/0 (socket says 172.21.15.19:36040) 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 -- 172.21.15.19:0/1608349449 learned_addr learned my addr 172.21.15.19:0/1608349449 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d08d46700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409e000 0x7f7d041c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 -- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 msgr2=0x7f7d041c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 0x7f7d041c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 -- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409e000 msgr2=0x7f7d041c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409e000 0x7f7d041c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.630+0000 7f7d09d48700 1 -- 172.21.15.19:0/1608349449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4009550 con 0x7f7d0409e410 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7d09d48700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00b680 tx=0x7f7cfc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0048b0 con 0x7f7d0409e410 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc020070 con 0x7f7d0409e410 2023-10-03T10:17:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc009a70 con 0x7f7d0409e410 2023-10-03T10:17:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0276c0 con 0x7f7d0409e410 2023-10-03T10:17:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.631+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d04119fd0 con 0x7f7d0409e410 2023-10-03T10:17:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.632+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7cfc012430 con 0x7f7d0409e410 2023-10-03T10:17:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.632+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7cfc022070 con 0x7f7d0409e410 2023-10-03T10:17:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.632+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d041310c0 con 0x7f7d0409e410 2023-10-03T10:17:33.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.637+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d041310c0 con 0x7f7d0409e410 2023-10-03T10:17:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.756+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2e412a340 con 0x7ff2e4131b40 2023-10-03T10:17:33.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.756+0000 7ff2cbfff700 1 -- 172.21.15.19:0/3347964596 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2e412a340 con 0x7ff2e4131b40 2023-10-03T10:17:33.756 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:33.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.758+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 msgr2=0x7ff2e4127b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 0x7ff2e4127b70 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00cb10 tx=0x7ff2dc00ce20 comp rx=0 tx=0).stop 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 shutdown_connections 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2e4131b40 0x7ff2e4127b70 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2e406a770 0x7ff2e41270f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 --2- 172.21.15.19:0/3347964596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2e406b080 0x7ff2e4127630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 >> 172.21.15.19:0/3347964596 conn(0x7ff2e4066f50 msgr2=0x7ff2e4070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 shutdown_connections 2023-10-03T10:17:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.759+0000 7ff2e988e700 1 -- 172.21.15.19:0/3347964596 wait complete. 2023-10-03T10:17:33.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.791+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89a4074ea0 con 0x7f89a412cf60 2023-10-03T10:17:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.791+0000 7f899a7fc700 1 -- 172.21.15.19:0/3131005482 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f89a0019bb0 con 0x7f89a412cf60 2023-10-03T10:17:33.791 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:33.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 msgr2=0x7f89a409bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f89a412d470 tx=0x7f89a0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:33.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 shutdown_connections 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f89a4130430 0x7f89a41c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f89a412cf60 0x7f89a409bb00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 --2- 172.21.15.19:0/3131005482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f89a412f8b0 0x7f89a409c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 >> 172.21.15.19:0/3131005482 conn(0x7f89a40a2aa0 msgr2=0x7f89a40a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 shutdown_connections 2023-10-03T10:17:33.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.793+0000 7f89ac19c700 1 -- 172.21.15.19:0/3131005482 wait complete. 2023-10-03T10:17:33.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:33.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.815+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6f00a28e0 con 0x7fc6f0133fa0 2023-10-03T10:17:33.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.815+0000 7fc6deffd700 1 -- 172.21.15.19:0/141792575 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6e8017030 con 0x7fc6f0133fa0 2023-10-03T10:17:33.815 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 msgr2=0x7fc6f011f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c500 tx=0x7fc6e800c810 comp rx=0 tx=0).stop 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 shutdown_connections 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6f0133fa0 0x7fc6f011f2e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f00a0a30 0x7fc6f011e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 --2- 172.21.15.19:0/141792575 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6f00a1340 0x7fc6f011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 >> 172.21.15.19:0/141792575 conn(0x7fc6f00a6550 msgr2=0x7fc6f009a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 shutdown_connections 2023-10-03T10:17:33.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.818+0000 7fc6f48d9700 1 -- 172.21.15.19:0/141792575 wait complete. 2023-10-03T10:17:33.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:33.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.845+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7d041310c0 con 0x7f7d0409e410 2023-10-03T10:17:33.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.845+0000 7f7cf9ffb700 1 -- 172.21.15.19:0/1608349449 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d041310c0 con 0x7f7d0409e410 2023-10-03T10:17:33.845 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.847+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 msgr2=0x7f7d041c8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.847+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00b680 tx=0x7f7cfc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 shutdown_connections 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d0409e410 0x7f7d041c8b80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d0409d6f0 0x7f7d041c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 --2- 172.21.15.19:0/1608349449 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d0409e000 0x7f7d041c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:33.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 >> 172.21.15.19:0/1608349449 conn(0x7f7d04066f50 msgr2=0x7f7d0406ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:33.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 shutdown_connections 2023-10-03T10:17:33.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:33.848+0000 7f7d0b7ab700 1 -- 172.21.15.19:0/1608349449 wait complete. 2023-10-03T10:17:33.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:34.774 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:34.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:34.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:34.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:34.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 Processor -- start 2023-10-03T10:17:34.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 -- start start 2023-10-03T10:17:34.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f54136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f54139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5409ece0 con 0x7f6f5406a770 2023-10-03T10:17:34.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5406b640 con 0x7f6f54136d80 2023-10-03T10:17:34.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.929+0000 7f6f5ad69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5409e760 con 0x7f6f5406b250 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f58b05700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6f5406a770 0x7f6f5406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34512/0 (socket says 172.21.15.19:34512) 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f54136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f58b05700 1 -- 172.21.15.19:0/4181348293 learned_addr learned my addr 172.21.15.19:0/4181348293 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f59306700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f54139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 -- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 msgr2=0x7f6f54139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f54139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 -- 172.21.15.19:0/4181348293 >> v1:172.21.15.19:6789/0 conn(0x7f6f5406a770 legacy=0x7f6f5406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 -- 172.21.15.19:0/4181348293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5409e040 con 0x7f6f5406b250 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.930+0000 7f6f53fff700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f54136840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f40009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd1c0a54839324a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.931+0000 7f6f537fe700 1 -- 172.21.15.19:0/4181348293 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011830 con 0x7f6f5406b250 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.931+0000 7f6f537fe700 1 -- 172.21.15.19:0/4181348293 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40011990 con 0x7f6f5406b250 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.931+0000 7f6f537fe700 1 -- 172.21.15.19:0/4181348293 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40011d20 con 0x7f6f5406b250 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 -- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 msgr2=0x7f6f54136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f54136840 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009870 tx=0x7f6f40009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 -- 172.21.15.19:0/4181348293 shutdown_connections 2023-10-03T10:17:34.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f54139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/4181348293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f54136840 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 -- 172.21.15.19:0/4181348293 >> 172.21.15.19:0/4181348293 conn(0x7f6f54066f50 msgr2=0x7f6f5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 -- 172.21.15.19:0/4181348293 shutdown_connections 2023-10-03T10:17:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.932+0000 7f6f5ad69700 1 -- 172.21.15.19:0/4181348293 wait complete. 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.933+0000 7f6f5ad69700 1 Processor -- start 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.933+0000 7f6f5ad69700 1 -- start start 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f541c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f541c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5411e560 con 0x7f6f5406a770 2023-10-03T10:17:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f541203a0 con 0x7f6f54136d80 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f5ad69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5411d100 con 0x7f6f5406b250 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.934+0000 7f6f58b05700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40614/0 (socket says 172.21.15.19:40614) 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 -- 172.21.15.19:0/256615512 learned_addr learned my addr 172.21.15.19:0/256615512 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f53fff700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f541c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f59306700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f541c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 -- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 msgr2=0x7f6f541c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f541c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 -- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 msgr2=0x7f6f541c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f541c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 -- 172.21.15.19:0/256615512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400094a0 con 0x7f6f5406a770 2023-10-03T10:17:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f58b05700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800c480 tx=0x7f6f4800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.935+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48005d70 con 0x7f6f5406a770 2023-10-03T10:17:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.936+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800ce90 con 0x7f6f5406a770 2023-10-03T10:17:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.936+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5411fd20 con 0x7f6f5406a770 2023-10-03T10:17:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.936+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480072d0 con 0x7f6f5406a770 2023-10-03T10:17:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.936+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f54120090 con 0x7f6f5406a770 2023-10-03T10:17:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.937+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f54074ea0 con 0x7f6f5406a770 2023-10-03T10:17:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.937+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f48007430 con 0x7f6f5406a770 2023-10-03T10:17:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.937+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f4803e8e0 con 0x7f6f5406a770 2023-10-03T10:17:34.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.946+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f4801b3b0 con 0x7f6f5406a770 2023-10-03T10:17:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.976+0000 7f99698d7700 1 Processor -- start 2023-10-03T10:17:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.976+0000 7f99698d7700 1 -- start start 2023-10-03T10:17:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99698d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409d6f0 0x7f996409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99698d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f996409e410 0x7f9964134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99698d7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996409b120 con 0x7f996409e000 2023-10-03T10:17:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99698d7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f996406b460 con 0x7f996409e410 2023-10-03T10:17:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99698d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996409a7e0 con 0x7f996409d6f0 2023-10-03T10:17:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99627fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f996409e000 0x7f99641339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34520/0 (socket says 172.21.15.19:34520) 2023-10-03T10:17:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99627fc700 1 -- 172.21.15.19:0/605083810 learned_addr learned my addr 172.21.15.19:0/605083810 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f99637fe700 1 --2- 172.21.15.19:0/605083810 >> v2:172.21.15.19:3300/0 conn(0x7f996409e410 0x7f9964134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.977+0000 7f9962ffd700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409d6f0 0x7f996409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f9961ffb700 1 -- 172.21.15.19:0/605083810 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655193297 0 0) 0x7f996409b120 con 0x7f996409e000 2023-10-03T10:17:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f9961ffb700 1 -- 172.21.15.19:0/605083810 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f994c0035b0 con 0x7f996409e000 2023-10-03T10:17:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f99637fe700 1 -- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409d6f0 msgr2=0x7f996409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f99637fe700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409d6f0 0x7f996409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f99637fe700 1 -- 172.21.15.19:0/605083810 >> v1:172.21.15.19:6789/0 conn(0x7f996409e000 legacy=0x7f99641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f99637fe700 1 -- 172.21.15.19:0/605083810 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996409a500 con 0x7f996409e410 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f99637fe700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e410 0x7f9964134100 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfc56b70b51ba6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f9961ffb700 1 -- 172.21.15.19:0/605083810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00e070 con 0x7f996409e410 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f9961ffb700 1 -- 172.21.15.19:0/605083810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c00bb20 con 0x7f996409e410 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.978+0000 7f9961ffb700 1 -- 172.21.15.19:0/605083810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00be90 con 0x7f996409e410 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 -- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e410 msgr2=0x7f9964134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e410 0x7f9964134100 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f995c009d90 tx=0x7f995c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 -- 172.21.15.19:0/605083810 shutdown_connections 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e410 0x7f9964134100 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 --2- 172.21.15.19:0/605083810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409d6f0 0x7f996409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 -- 172.21.15.19:0/605083810 >> 172.21.15.19:0/605083810 conn(0x7f9964066f50 msgr2=0x7f996409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 -- 172.21.15.19:0/605083810 shutdown_connections 2023-10-03T10:17:34.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.979+0000 7f99698d7700 1 -- 172.21.15.19:0/605083810 wait complete. 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.980+0000 7f99698d7700 1 Processor -- start 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.980+0000 7f99698d7700 1 -- start start 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 0x7f99641c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409e410 0x7f99641c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99641b92d0 con 0x7f996409e000 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99641a64b0 con 0x7f996409e410 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99698d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f996409c710 con 0x7f996409d6f0 2023-10-03T10:17:34.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99627fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f9962ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 0x7f99641c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99627fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40632/0 (socket says 172.21.15.19:40632) 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99627fc700 1 -- 172.21.15.19:0/1500742375 learned_addr learned my addr 172.21.15.19:0/1500742375 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.981+0000 7f99637fe700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409e410 0x7f99641c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 -- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 msgr2=0x7f99641c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 0x7f99641c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 -- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409e410 msgr2=0x7f99641c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409e410 0x7f99641c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 -- 172.21.15.19:0/1500742375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c009a70 con 0x7f996409e000 2023-10-03T10:17:34.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f9962ffd700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 0x7f99641c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99627fc700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9958005910 tx=0x7f995800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958005d70 con 0x7f996409e000 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580070d0 con 0x7f996409e000 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99641a7ca0 con 0x7f996409e000 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958007440 con 0x7f996409e000 2023-10-03T10:17:34.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.982+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99641a6fa0 con 0x7f996409e000 2023-10-03T10:17:34.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.984+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99580075a0 con 0x7f996409e000 2023-10-03T10:17:34.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.984+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9964074ea0 con 0x7f996409e000 2023-10-03T10:17:34.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.984+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f995803ea60 con 0x7f996409e000 2023-10-03T10:17:34.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:34.994+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9958011bc0 con 0x7f996409e000 2023-10-03T10:17:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.014+0000 7fd99ea2c700 1 Processor -- start 2023-10-03T10:17:35.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.014+0000 7fd99ea2c700 1 -- start start 2023-10-03T10:17:35.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99ea2c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99ea2c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd9980a0090 0x7fd99809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99ea2c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd99809ba70 con 0x7fd998131970 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99ea2c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd99809d4a0 con 0x7fd9980a0090 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99ea2c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99809e8f0 con 0x7fd99809c650 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99cfc9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd998131970 0x7fd998131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34532/0 (socket says 172.21.15.19:34532) 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd997fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.015+0000 7fd99cfc9700 1 -- 172.21.15.19:0/2993634428 learned_addr learned my addr 172.21.15.19:0/2993634428 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd9977fe700 1 --2- 172.21.15.19:0/2993634428 >> v2:172.21.15.19:3300/0 conn(0x7fd9980a0090 0x7fd99809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd997fff700 1 -- 172.21.15.19:0/2993634428 >> v2:172.21.15.19:3300/0 conn(0x7fd9980a0090 msgr2=0x7fd99809cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd997fff700 1 --2- 172.21.15.19:0/2993634428 >> v2:172.21.15.19:3300/0 conn(0x7fd9980a0090 0x7fd99809cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd997fff700 1 -- 172.21.15.19:0/2993634428 >> v1:172.21.15.19:6789/0 conn(0x7fd998131970 legacy=0x7fd998131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd997fff700 1 -- 172.21.15.19:0/2993634428 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980a0760 con 0x7fd99809c650 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd997fff700 1 --2- 172.21.15.19:0/2993634428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99809ca20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd988009840 tx=0x7fd988009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8893f5c331bc2c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd996ffd700 1 -- 172.21.15.19:0/2993634428 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011830 con 0x7fd99809c650 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd996ffd700 1 -- 172.21.15.19:0/2993634428 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd988011990 con 0x7fd99809c650 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.016+0000 7fd996ffd700 1 -- 172.21.15.19:0/2993634428 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd988011d20 con 0x7fd99809c650 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2993634428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 msgr2=0x7fd99809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2993634428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99809ca20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd988009840 tx=0x7fd988009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2993634428 shutdown_connections 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2993634428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99809ca20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2993634428 >> v2:172.21.15.19:3300/0 conn(0x7fd9980a0090 0x7fd99809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2993634428 >> 172.21.15.19:0/2993634428 conn(0x7fd9980a3f70 msgr2=0x7fd9980a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2993634428 shutdown_connections 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.017+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2993634428 wait complete. 2023-10-03T10:17:35.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.018+0000 7fd99ea2c700 1 Processor -- start 2023-10-03T10:17:35.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 -- start start 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9980a0090 0x7fd99811c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd998131970 0x7fd99811cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99811d510 con 0x7fd9980a0090 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99811fb60 con 0x7fd998131970 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99ea2c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd99811e270 con 0x7fd99809c650 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd997fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd997fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36080/0 (socket says 172.21.15.19:36080) 2023-10-03T10:17:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd997fff700 1 -- 172.21.15.19:0/2606716036 learned_addr learned my addr 172.21.15.19:0/2606716036 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd99cfc9700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd998131970 0x7fd99811cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.019+0000 7fd9977fe700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9980a0090 0x7fd99811c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 -- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd998131970 msgr2=0x7fd99811cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd998131970 0x7fd99811cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 -- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9980a0090 msgr2=0x7fd99811c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9980a0090 0x7fd99811c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 -- 172.21.15.19:0/2606716036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9880094a0 con 0x7fd99809c650 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd997fff700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9880090b0 tx=0x7fd988004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98801d7c0 con 0x7fd99809c650 2023-10-03T10:17:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98801d920 con 0x7fd99809c650 2023-10-03T10:17:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd99811ef30 con 0x7fd99809c650 2023-10-03T10:17:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98801dcd0 con 0x7fd99809c650 2023-10-03T10:17:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.020+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd99809d980 con 0x7fd99809c650 2023-10-03T10:17:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.022+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd99812f490 con 0x7fd99809c650 2023-10-03T10:17:35.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.022+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd9880036a0 con 0x7fd99809c650 2023-10-03T10:17:35.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.025+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd98800b760 con 0x7fd99809c650 2023-10-03T10:17:35.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.027+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd98801de30 con 0x7fd99809c650 2023-10-03T10:17:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.032+0000 7fce3f066700 1 Processor -- start 2023-10-03T10:17:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.032+0000 7fce3f066700 1 -- start start 2023-10-03T10:17:35.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3f066700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3f066700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3809e410 0x7fce38130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3f066700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3809f130 con 0x7fce3809e000 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3f066700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3809f520 con 0x7fce3809e410 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3f066700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3809e930 con 0x7fce3809d6f0 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3d603700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3809e410 0x7fce38130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3d603700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce3809e410 0x7fce38130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40654/0 (socket says 172.21.15.19:40654) 2023-10-03T10:17:35.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3d603700 1 -- 172.21.15.19:0/2670681257 learned_addr learned my addr 172.21.15.19:0/2670681257 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:35.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.033+0000 7fce3ce02700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce3d603700 1 -- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 msgr2=0x7fce3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:35.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce3d603700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce3d603700 1 -- 172.21.15.19:0/2670681257 >> v1:172.21.15.19:6789/0 conn(0x7fce3809e000 legacy=0x7fce38130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce3d603700 1 -- 172.21.15.19:0/2670681257 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3809b2d0 con 0x7fce3809e410 2023-10-03T10:17:35.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce3d603700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e410 0x7fce38130d70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fce30009e50 tx=0x7fce3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a7839afac5ba43 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce377fe700 1 -- 172.21.15.19:0/2670681257 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000e070 con 0x7fce3809e410 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce377fe700 1 -- 172.21.15.19:0/2670681257 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000b910 con 0x7fce3809e410 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.034+0000 7fce377fe700 1 -- 172.21.15.19:0/2670681257 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000bcc0 con 0x7fce3809e410 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 -- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e410 msgr2=0x7fce38130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e410 0x7fce38130d70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fce30009e50 tx=0x7fce3000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 -- 172.21.15.19:0/2670681257 shutdown_connections 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e410 0x7fce38130d70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 --2- 172.21.15.19:0/2670681257 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 -- 172.21.15.19:0/2670681257 >> 172.21.15.19:0/2670681257 conn(0x7fce38066f50 msgr2=0x7fce3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 -- 172.21.15.19:0/2670681257 shutdown_connections 2023-10-03T10:17:35.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.035+0000 7fce3f066700 1 -- 172.21.15.19:0/2670681257 wait complete. 2023-10-03T10:17:35.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.036+0000 7fce3f066700 1 Processor -- start 2023-10-03T10:17:35.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.036+0000 7fce3f066700 1 -- start start 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce38119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 0x7fce381199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 0x7fce38119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3811c380 con 0x7fce3809e000 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3811a6d0 con 0x7fce3809e410 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3f066700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3811b900 con 0x7fce3809d6f0 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 0x7fce381199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce3ce02700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce38119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.037+0000 7fce37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 0x7fce381199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40668/0 (socket says 172.21.15.19:40668) 2023-10-03T10:17:35.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce37fff700 1 -- 172.21.15.19:0/305134688 learned_addr learned my addr 172.21.15.19:0/305134688 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 0x7fce38119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 -- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 msgr2=0x7fce38119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce38119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 -- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 msgr2=0x7fce381199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 0x7fce381199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 -- 172.21.15.19:0/305134688 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce30009b30 con 0x7fce3809e410 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce3d603700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 0x7fce38119f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fce380a3e50 tx=0x7fce30004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30004780 con 0x7fce3809e410 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce300092e0 con 0x7fce3809e410 2023-10-03T10:17:35.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.038+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3001c680 con 0x7fce3809e410 2023-10-03T10:17:35.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.039+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3811af10 con 0x7fce3809e410 2023-10-03T10:17:35.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.039+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3809c700 con 0x7fce3809e410 2023-10-03T10:17:35.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.040+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce38074ea0 con 0x7fce3809e410 2023-10-03T10:17:35.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.041+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce3001c7e0 con 0x7fce3809e410 2023-10-03T10:17:35.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.041+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce300417d0 con 0x7fce3809e410 2023-10-03T10:17:35.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.045+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce30011960 con 0x7fce3809e410 2023-10-03T10:17:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.166+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f54132460 con 0x7f6f5406a770 2023-10-03T10:17:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.166+0000 7f6f517fa700 1 -- 172.21.15.19:0/256615512 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f48017030 con 0x7f6f5406a770 2023-10-03T10:17:35.166 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:35.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.168+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 msgr2=0x7f6f5411d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.168+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800c480 tx=0x7f6f4800c790 comp rx=0 tx=0).stop 2023-10-03T10:17:35.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 shutdown_connections 2023-10-03T10:17:35.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6f54136d80 0x7f6f541c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6f5406a770 0x7f6f5411d4b0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 --2- 172.21.15.19:0/256615512 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6f5406b250 0x7f6f541c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 >> 172.21.15.19:0/256615512 conn(0x7f6f54066f50 msgr2=0x7f6f5406f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 shutdown_connections 2023-10-03T10:17:35.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.169+0000 7f6f5ad69700 1 -- 172.21.15.19:0/256615512 wait complete. 2023-10-03T10:17:35.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:35.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.239+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9980747f0 con 0x7fd99809c650 2023-10-03T10:17:35.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.239+0000 7fd994ff9700 1 -- 172.21.15.19:0/2606716036 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd98802e2c0 con 0x7fd99809c650 2023-10-03T10:17:35.239 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 msgr2=0x7fd99811c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd9880090b0 tx=0x7fd988004750 comp rx=0 tx=0).stop 2023-10-03T10:17:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 shutdown_connections 2023-10-03T10:17:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd998131970 0x7fd99811cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd99809c650 0x7fd99811c040 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 --2- 172.21.15.19:0/2606716036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd9980a0090 0x7fd99811c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 >> 172.21.15.19:0/2606716036 conn(0x7fd9980a3f70 msgr2=0x7fd9980a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 shutdown_connections 2023-10-03T10:17:35.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.242+0000 7fd99ea2c700 1 -- 172.21.15.19:0/2606716036 wait complete. 2023-10-03T10:17:35.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:35.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.257+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f996406c360 con 0x7f996409e000 2023-10-03T10:17:35.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.257+0000 7f994bfff700 1 -- 172.21.15.19:0/1500742375 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9958017020 con 0x7f996409e000 2023-10-03T10:17:35.258 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:35.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 msgr2=0x7f99641c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f9958005910 tx=0x7f995800c9e0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 shutdown_connections 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f996409e410 0x7f99641c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f996409d6f0 0x7f99641c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 --2- 172.21.15.19:0/1500742375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f996409e000 0x7f99641c8510 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 >> 172.21.15.19:0/1500742375 conn(0x7f9964066f50 msgr2=0x7f99640a3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 shutdown_connections 2023-10-03T10:17:35.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.260+0000 7f99698d7700 1 -- 172.21.15.19:0/1500742375 wait complete. 2023-10-03T10:17:35.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:35.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.291+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fce3806c360 con 0x7fce3809e410 2023-10-03T10:17:35.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.291+0000 7fce357fa700 1 -- 172.21.15.19:0/305134688 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce30020020 con 0x7fce3809e410 2023-10-03T10:17:35.291 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 msgr2=0x7fce38119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 0x7fce38119f00 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fce380a3e50 tx=0x7fce30004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 shutdown_connections 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3809e410 0x7fce38119f00 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3809d6f0 0x7fce38119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 --2- 172.21.15.19:0/305134688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3809e000 0x7fce381199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:35.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 >> 172.21.15.19:0/305134688 conn(0x7fce38066f50 msgr2=0x7fce3813ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:35.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 shutdown_connections 2023-10-03T10:17:35.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:35.294+0000 7fce3f066700 1 -- 172.21.15.19:0/305134688 wait complete. 2023-10-03T10:17:35.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:36.184 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:36.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:36.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:36.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:36.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 Processor -- start 2023-10-03T10:17:36.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 -- start start 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96c409d6f0 0x7f96c409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 0x7f96c41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c406b460 con 0x7f96c409d6f0 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409b120 con 0x7f96c409e410 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.334+0000 7f96c905e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c409a7e0 con 0x7f96c409e000 2023-10-03T10:17:36.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96c409d6f0 0x7f96c409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f96c409d6f0 0x7f96c409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54836/0 (socket says 172.21.15.19:54836) 2023-10-03T10:17:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 -- 172.21.15.19:0/1401424508 learned_addr learned my addr 172.21.15.19:0/1401424508 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c259c700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 0x7f96c41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c359e700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 -- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 msgr2=0x7f96c41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 0x7f96c41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 -- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 msgr2=0x7f96c4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 -- 172.21.15.19:0/1401424508 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c409a500 con 0x7f96c409d6f0 2023-10-03T10:17:36.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c259c700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 0x7f96c41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.335+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409d6f0 0x7f96c409dac0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f96b40098f0 tx=0x7f96b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc501fcbefae2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c1d9b700 1 -- 172.21.15.19:0/1401424508 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011830 con 0x7f96c409d6f0 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c1d9b700 1 -- 172.21.15.19:0/1401424508 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4011990 con 0x7f96c409d6f0 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c1d9b700 1 -- 172.21.15.19:0/1401424508 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011d20 con 0x7f96c409d6f0 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 -- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409d6f0 msgr2=0x7f96c409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409d6f0 0x7f96c409dac0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f96b40098f0 tx=0x7f96b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 -- 172.21.15.19:0/1401424508 shutdown_connections 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409d6f0 0x7f96c409dac0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 --2- 172.21.15.19:0/1401424508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409e000 0x7f96c41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 -- 172.21.15.19:0/1401424508 >> 172.21.15.19:0/1401424508 conn(0x7f96c4066f50 msgr2=0x7f96c409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 -- 172.21.15.19:0/1401424508 shutdown_connections 2023-10-03T10:17:36.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.336+0000 7f96c905e700 1 -- 172.21.15.19:0/1401424508 wait complete. 2023-10-03T10:17:36.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 Processor -- start 2023-10-03T10:17:36.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 -- start start 2023-10-03T10:17:36.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409e000 0x7f96c41c5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c41c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41a95a0 con 0x7f96c409e000 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41a9780 con 0x7f96c409e410 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.338+0000 7f96c905e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41c5aa0 con 0x7f96c409d6f0 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41342/0 (socket says 172.21.15.19:41342) 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 -- 172.21.15.19:0/2884720582 learned_addr learned my addr 172.21.15.19:0/2884720582 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c259c700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409e000 0x7f96c41c5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 -- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 msgr2=0x7f96c41c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c41c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 -- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409e000 msgr2=0x7f96c41c5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409e000 0x7f96c41c5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 -- 172.21.15.19:0/2884720582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80094a0 con 0x7f96c409d6f0 2023-10-03T10:17:36.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.339+0000 7f96c2d9d700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f96b4022e00 tx=0x7f96b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.340+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4004040 con 0x7f96c409d6f0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.340+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b40041a0 con 0x7f96c409d6f0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.340+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b4009550 con 0x7f96c409d6f0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.340+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4004510 con 0x7f96c409d6f0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.340+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c41a8ac0 con 0x7f96c409d6f0 2023-10-03T10:17:36.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.341+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c41a78d0 con 0x7f96c409d6f0 2023-10-03T10:17:36.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.342+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f96b40036a0 con 0x7f96c409d6f0 2023-10-03T10:17:36.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.342+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f96b4049350 con 0x7f96c409d6f0 2023-10-03T10:17:36.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.346+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f96b4034950 con 0x7f96c409d6f0 2023-10-03T10:17:36.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.404+0000 7fb9c2283700 1 Processor -- start 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 -- start start 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 0x7fb9bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc09b120 con 0x7fb9bc09e000 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc06b460 con 0x7fb9bc09e410 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c2283700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc09a7e0 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9bb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb9bc09e000 0x7fb9bc1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54358/0 (socket says 172.21.15.19:54358) 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9bb7fe700 1 -- 172.21.15.19:0/207902507 learned_addr learned my addr 172.21.15.19:0/207902507 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:36.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9bbfff700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 0x7fb9bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.405+0000 7fb9c0820700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9baffd700 1 -- 172.21.15.19:0/207902507 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329969898 0 0) 0x7fb9bc09b120 con 0x7fb9bc09e000 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9baffd700 1 -- 172.21.15.19:0/207902507 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a40035b0 con 0x7fb9bc09e000 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9bbfff700 1 -- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 msgr2=0x7fb9bc134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9bbfff700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9bbfff700 1 -- 172.21.15.19:0/207902507 >> v1:172.21.15.19:6789/0 conn(0x7fb9bc09e000 legacy=0x7fb9bc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9bbfff700 1 -- 172.21.15.19:0/207902507 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc09a500 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9bbfff700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 0x7fb9bc09dac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098a0 tx=0x7fb9ac009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5429cdf6b87c4b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.406+0000 7fb9baffd700 1 -- 172.21.15.19:0/207902507 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011830 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9baffd700 1 -- 172.21.15.19:0/207902507 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac011990 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9baffd700 1 -- 172.21.15.19:0/207902507 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac011d00 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 -- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 msgr2=0x7fb9bc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 0x7fb9bc09dac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0098a0 tx=0x7fb9ac009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 -- 172.21.15.19:0/207902507 shutdown_connections 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 --2- 172.21.15.19:0/207902507 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09d6f0 0x7fb9bc09dac0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 -- 172.21.15.19:0/207902507 >> 172.21.15.19:0/207902507 conn(0x7fb9bc066f50 msgr2=0x7fb9bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.407+0000 7fb9c2283700 1 -- 172.21.15.19:0/207902507 shutdown_connections 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.408+0000 7fb9c2283700 1 -- 172.21.15.19:0/207902507 wait complete. 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 Processor -- start 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 -- start start 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 0x7fb9bc1c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09e000 0x7fb9bc1c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1a65a0 con 0x7fb9bc09d6f0 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1a63b0 con 0x7fb9bc09e410 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c2283700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc1a82c0 con 0x7fb9bc09e000 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c0820700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9bbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 0x7fb9bc1c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.409+0000 7fb9c0820700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43760/0 (socket says 172.21.15.19:43760) 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 -- 172.21.15.19:0/2739500890 learned_addr learned my addr 172.21.15.19:0/2739500890 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9bb7fe700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09e000 0x7fb9bc1c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 -- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09e000 msgr2=0x7fb9bc1c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09e000 0x7fb9bc1c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 -- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 msgr2=0x7fb9bc1c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 0x7fb9bc1c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 -- 172.21.15.19:0/2739500890 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac0094a0 con 0x7fb9bc09e410 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9bbfff700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 0x7fb9bc1c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c0820700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400efc0 tx=0x7fb9b400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4009ea0 con 0x7fb9bc09e410 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc0a1d00 con 0x7fb9bc09e410 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b400f040 con 0x7fb9bc09e410 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.410+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b4014480 con 0x7fb9bc09e410 2023-10-03T10:17:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.411+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc09c760 con 0x7fb9bc09e410 2023-10-03T10:17:36.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.412+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc074ea0 con 0x7fb9bc09e410 2023-10-03T10:17:36.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.412+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9b40145e0 con 0x7fb9bc09e410 2023-10-03T10:17:36.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.412+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9b40402d0 con 0x7fb9bc09e410 2023-10-03T10:17:36.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.417+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9b4007920 con 0x7fb9bc09e410 2023-10-03T10:17:36.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 Processor -- start 2023-10-03T10:17:36.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 -- start start 2023-10-03T10:17:36.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533409f130 con 0x7f533409e000 2023-10-03T10:17:36.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533409f520 con 0x7f533409e410 2023-10-03T10:17:36.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.445+0000 7f5339082700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f533409e930 con 0x7f533409d6f0 2023-10-03T10:17:36.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f5332d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f533409e000 0x7f5334130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54374/0 (socket says 172.21.15.19:54374) 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533259c700 1 -- 172.21.15.19:0/270042110 learned_addr learned my addr 172.21.15.19:0/270042110 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 --2- 172.21.15.19:0/270042110 >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 -- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 msgr2=0x7f533409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 --2- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 -- 172.21.15.19:0/270042110 >> v1:172.21.15.19:6789/0 conn(0x7f533409e000 legacy=0x7f5334130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 -- 172.21.15.19:0/270042110 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533409b2d0 con 0x7f533409e410 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f533359e700 1 --2- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f5334130d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f532c009d90 tx=0x7f532c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df8ad628a9c386d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.446+0000 7f5331d9b700 1 -- 172.21.15.19:0/270042110 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00bd20 con 0x7f533409e410 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5331d9b700 1 -- 172.21.15.19:0/270042110 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00be80 con 0x7f533409e410 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5331d9b700 1 -- 172.21.15.19:0/270042110 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0116a0 con 0x7f533409e410 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 -- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 msgr2=0x7f5334130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 --2- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f5334130d70 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f532c009d90 tx=0x7f532c00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 -- 172.21.15.19:0/270042110 shutdown_connections 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 --2- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f5334130d70 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 --2- 172.21.15.19:0/270042110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 -- 172.21.15.19:0/270042110 >> 172.21.15.19:0/270042110 conn(0x7f5334066f50 msgr2=0x7f533409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 -- 172.21.15.19:0/270042110 shutdown_connections 2023-10-03T10:17:36.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.447+0000 7f5339082700 1 -- 172.21.15.19:0/270042110 wait complete. 2023-10-03T10:17:36.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 Processor -- start 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 -- start start 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 0x7f533411e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f533411eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533409c700 con 0x7f533409e410 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341202a0 con 0x7f533409d6f0 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5339082700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53340a1d00 con 0x7f533409e000 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5332d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5332d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43774/0 (socket says 172.21.15.19:43774) 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.449+0000 7f5332d9d700 1 -- 172.21.15.19:0/2999789585 learned_addr learned my addr 172.21.15.19:0/2999789585 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:36.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f533359e700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f533411eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f533259c700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 0x7f533411e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 -- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 msgr2=0x7f533411e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 0x7f533411e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 -- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 msgr2=0x7f533411eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f533411eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 -- 172.21.15.19:0/2999789585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009a70 con 0x7f533409d6f0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f533259c700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 0x7f533411e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5332d9d700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f532400e9b0 tx=0x7f532400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324009710 con 0x7f533409d6f0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400c850 con 0x7f533409d6f0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5334121390 con 0x7f533409d6f0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400cbc0 con 0x7f533409d6f0 2023-10-03T10:17:36.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.450+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5334122390 con 0x7f533409d6f0 2023-10-03T10:17:36.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.452+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533411ac20 con 0x7f533409d6f0 2023-10-03T10:17:36.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.452+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f532400cd20 con 0x7f533409d6f0 2023-10-03T10:17:36.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.452+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f532403ff90 con 0x7f533409d6f0 2023-10-03T10:17:36.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.461+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5324011350 con 0x7f533409d6f0 2023-10-03T10:17:36.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.483+0000 7f45723de700 1 Processor -- start 2023-10-03T10:17:36.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.483+0000 7f45723de700 1 -- start start 2023-10-03T10:17:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f45723de700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f456c09d6f0 0x7f456c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f45723de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f45723de700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f456c09f130 con 0x7f456c09e000 2023-10-03T10:17:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f45723de700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f456c09f520 con 0x7f456c09d6f0 2023-10-03T10:17:36.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f45723de700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c09e930 con 0x7f456c09e410 2023-10-03T10:17:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f456b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f456c09e000 0x7f456c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54386/0 (socket says 172.21.15.19:54386) 2023-10-03T10:17:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f457097b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f456bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f456c09d6f0 0x7f456c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.484+0000 7f456b7fe700 1 -- 172.21.15.19:0/294566493 learned_addr learned my addr 172.21.15.19:0/294566493 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456bfff700 1 -- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 msgr2=0x7f456c130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456bfff700 1 --2- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456bfff700 1 -- 172.21.15.19:0/294566493 >> v1:172.21.15.19:6789/0 conn(0x7f456c09e000 legacy=0x7f456c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456bfff700 1 -- 172.21.15.19:0/294566493 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f456c09b2d0 con 0x7f456c09d6f0 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456bfff700 1 --2- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c09dac0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f455c009840 tx=0x7f455c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afe6dd21fbee41a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456affd700 1 -- 172.21.15.19:0/294566493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c011830 con 0x7f456c09d6f0 2023-10-03T10:17:36.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456affd700 1 -- 172.21.15.19:0/294566493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c011990 con 0x7f456c09d6f0 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.485+0000 7f456affd700 1 -- 172.21.15.19:0/294566493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c011d20 con 0x7f456c09d6f0 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 -- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 msgr2=0x7f456c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 --2- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c09dac0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f455c009840 tx=0x7f455c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 -- 172.21.15.19:0/294566493 shutdown_connections 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 --2- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 --2- 172.21.15.19:0/294566493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c09dac0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 -- 172.21.15.19:0/294566493 >> 172.21.15.19:0/294566493 conn(0x7f456c066f50 msgr2=0x7f456c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 -- 172.21.15.19:0/294566493 shutdown_connections 2023-10-03T10:17:36.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.486+0000 7f45723de700 1 -- 172.21.15.19:0/294566493 wait complete. 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.487+0000 7f45723de700 1 Processor -- start 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 -- start start 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f456c09e000 0x7f456c136d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c1372b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:36.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456c1381f0 con 0x7f456c09d6f0 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456c139b60 con 0x7f456c09e410 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f45723de700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f456c0a1cd0 con 0x7f456c09e000 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f456bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f456c09e000 0x7f456c136d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f456bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54908/0 (socket says 172.21.15.19:54908) 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f456bfff700 1 -- 172.21.15.19:0/2304463404 learned_addr learned my addr 172.21.15.19:0/2304463404 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.488+0000 7f457097b700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c1372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 -- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f456c09e000 msgr2=0x7f456c136d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f456c09e000 0x7f456c136d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 -- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 msgr2=0x7f456c1372b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c1372b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 -- 172.21.15.19:0/2304463404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c0094a0 con 0x7f456c09d6f0 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f457097b700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c1372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f456bfff700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f455c009fd0 tx=0x7f455c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c0036a0 con 0x7f456c09d6f0 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c01f070 con 0x7f456c09d6f0 2023-10-03T10:17:36.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f456c13b330 con 0x7f456c09d6f0 2023-10-03T10:17:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c003a60 con 0x7f456c09d6f0 2023-10-03T10:17:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.489+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f456c13a890 con 0x7f456c09d6f0 2023-10-03T10:17:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.490+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f455c003bc0 con 0x7f456c09d6f0 2023-10-03T10:17:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.491+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f456c074ea0 con 0x7f456c09d6f0 2023-10-03T10:17:36.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.491+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f455c021070 con 0x7f456c09d6f0 2023-10-03T10:17:36.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.500+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f455c0253e0 con 0x7f456c09d6f0 2023-10-03T10:17:36.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.568+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f96c4074ea0 con 0x7f96c409d6f0 2023-10-03T10:17:36.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.569+0000 7f96ab7fe700 1 -- 172.21.15.19:0/2884720582 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f96b4015090 con 0x7f96c409d6f0 2023-10-03T10:17:36.569 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 msgr2=0x7f96c41c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f96b4022e00 tx=0x7f96b4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 shutdown_connections 2023-10-03T10:17:36.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f96c409e410 0x7f96c41c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f96c409d6f0 0x7f96c41c5020 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 --2- 172.21.15.19:0/2884720582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96c409e000 0x7f96c41c5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 >> 172.21.15.19:0/2884720582 conn(0x7f96c4066f50 msgr2=0x7f96c41bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 shutdown_connections 2023-10-03T10:17:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.571+0000 7f96c905e700 1 -- 172.21.15.19:0/2884720582 wait complete. 2023-10-03T10:17:36.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:36.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.646+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb9bc06c360 con 0x7fb9bc09e410 2023-10-03T10:17:36.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.646+0000 7fb9b8ff9700 1 -- 172.21.15.19:0/2739500890 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9b4018020 con 0x7fb9bc09e410 2023-10-03T10:17:36.646 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:36.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 msgr2=0x7fb9bc1c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400efc0 tx=0x7fb9b400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 shutdown_connections 2023-10-03T10:17:36.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9bc09e410 0x7fb9bc1c8a50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9bc09d6f0 0x7fb9bc1c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 --2- 172.21.15.19:0/2739500890 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9bc09e000 0x7fb9bc1c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 >> 172.21.15.19:0/2739500890 conn(0x7fb9bc066f50 msgr2=0x7fb9bc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 shutdown_connections 2023-10-03T10:17:36.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.650+0000 7fb9c2283700 1 -- 172.21.15.19:0/2739500890 wait complete. 2023-10-03T10:17:36.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:36.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.683+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5334120f40 con 0x7f533409d6f0 2023-10-03T10:17:36.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.683+0000 7f531b7fe700 1 -- 172.21.15.19:0/2999789585 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f532402a090 con 0x7f533409d6f0 2023-10-03T10:17:36.683 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:36.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 msgr2=0x7f533411e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f532400e9b0 tx=0x7f532400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 shutdown_connections 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e410 0x7f533411eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409d6f0 0x7f533411e0e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 --2- 172.21.15.19:0/2999789585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409e000 0x7f533411e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 >> 172.21.15.19:0/2999789585 conn(0x7f5334066f50 msgr2=0x7f5334130a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 shutdown_connections 2023-10-03T10:17:36.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.685+0000 7f5339082700 1 -- 172.21.15.19:0/2999789585 wait complete. 2023-10-03T10:17:36.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:36.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.710+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f456c06c360 con 0x7f456c09d6f0 2023-10-03T10:17:36.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.711+0000 7f4568ff9700 1 -- 172.21.15.19:0/2304463404 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f455c015020 con 0x7f456c09d6f0 2023-10-03T10:17:36.711 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:36.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 msgr2=0x7f456c136830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:36.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f455c009fd0 tx=0x7f455c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:36.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 shutdown_connections 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f456c09e410 0x7f456c1372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f456c09d6f0 0x7f456c136830 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 --2- 172.21.15.19:0/2304463404 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f456c09e000 0x7f456c136d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 >> 172.21.15.19:0/2304463404 conn(0x7f456c066f50 msgr2=0x7f456c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 shutdown_connections 2023-10-03T10:17:36.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:36.713+0000 7f45723de700 1 -- 172.21.15.19:0/2304463404 wait complete. 2023-10-03T10:17:36.726 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:37.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:37.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:37.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:37.727 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.746+0000 7f73ec4a5700 1 Processor -- start 2023-10-03T10:17:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.746+0000 7f73ec4a5700 1 -- start start 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e41316c0 0x7f73e4131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e409d9f0 0x7f73e406a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 0x7f73e406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e409e130 con 0x7f73e41316c0 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e41312b0 con 0x7f73e409d9f0 2023-10-03T10:17:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ec4a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73e409f6e0 con 0x7f73e406acb0 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e41316c0 0x7f73e4131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f73e41316c0 0x7f73e4131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54920/0 (socket says 172.21.15.19:54920) 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 -- 172.21.15.19:0/3637896003 learned_addr learned my addr 172.21.15.19:0/3637896003 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73eaa42700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 0x7f73e406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 -- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 msgr2=0x7f73e406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 0x7f73e406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 -- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e409d9f0 msgr2=0x7f73e406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e409d9f0 0x7f73e406a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73ea241700 1 -- 172.21.15.19:0/3637896003 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e409e760 con 0x7f73e41316c0 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.747+0000 7f73eaa42700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 0x7f73e406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.748+0000 7f73ea241700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e41316c0 0x7f73e4131a90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4f369bd5d967ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.748+0000 7f73e923f700 1 -- 172.21.15.19:0/3637896003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000b8a0 con 0x7f73e41316c0 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.748+0000 7f73e923f700 1 -- 172.21.15.19:0/3637896003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000ba00 con 0x7f73e41316c0 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.748+0000 7f73e923f700 1 -- 172.21.15.19:0/3637896003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e000bd90 con 0x7f73e41316c0 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 -- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e41316c0 msgr2=0x7f73e4131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e41316c0 0x7f73e4131a90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f73e00098f0 tx=0x7f73e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 -- 172.21.15.19:0/3637896003 shutdown_connections 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e406acb0 0x7f73e406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e41316c0 0x7f73e4131a90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/3637896003 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e409d9f0 0x7f73e406a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 -- 172.21.15.19:0/3637896003 >> 172.21.15.19:0/3637896003 conn(0x7f73e4066f50 msgr2=0x7f73e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 -- 172.21.15.19:0/3637896003 shutdown_connections 2023-10-03T10:17:37.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.749+0000 7f73ec4a5700 1 -- 172.21.15.19:0/3637896003 wait complete. 2023-10-03T10:17:37.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.750+0000 7f73ec4a5700 1 Processor -- start 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.750+0000 7f73ec4a5700 1 -- start start 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e409d9f0 0x7f73e41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e41316c0 0x7f73e4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4072070 con 0x7f73e406acb0 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e411bbe0 con 0x7f73e41316c0 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ec4a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f73e412b900 con 0x7f73e409d9f0 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ea241700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ea241700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54936/0 (socket says 172.21.15.19:54936) 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73ea241700 1 -- 172.21.15.19:0/364216047 learned_addr learned my addr 172.21.15.19:0/364216047 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.751+0000 7f73eaa42700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e41316c0 0x7f73e4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73e9a40700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e409d9f0 0x7f73e41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 -- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e409d9f0 msgr2=0x7f73e41199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e409d9f0 0x7f73e41199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 -- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e41316c0 msgr2=0x7f73e4119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e41316c0 0x7f73e4119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 -- 172.21.15.19:0/364216047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0009550 con 0x7f73e406acb0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ea241700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c00 tx=0x7f73e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00044d0 con 0x7f73e406acb0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e001f070 con 0x7f73e406acb0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e00038e0 con 0x7f73e406acb0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e411af40 con 0x7f73e406acb0 2023-10-03T10:17:37.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.752+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e411a860 con 0x7f73e406acb0 2023-10-03T10:17:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.754+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f73e0003a40 con 0x7f73e406acb0 2023-10-03T10:17:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.754+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f73e0021070 con 0x7f73e406acb0 2023-10-03T10:17:37.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.754+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4074ea0 con 0x7f73e406acb0 2023-10-03T10:17:37.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.763+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f73e001a430 con 0x7f73e406acb0 2023-10-03T10:17:37.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.845+0000 7f77d2e2b700 1 Processor -- start 2023-10-03T10:17:37.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.845+0000 7f77d2e2b700 1 -- start start 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09e000 0x7f77cc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 0x7f77cc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77cc06b460 con 0x7f77cc09e410 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc09b120 con 0x7f77cc09d6f0 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d2e2b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc09a7e0 con 0x7f77cc09e000 2023-10-03T10:17:37.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d0bc7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d0bc7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43818/0 (socket says 172.21.15.19:43818) 2023-10-03T10:17:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d0bc7700 1 -- 172.21.15.19:0/1429404250 learned_addr learned my addr 172.21.15.19:0/1429404250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77d13c8700 1 --2- 172.21.15.19:0/1429404250 >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 0x7f77cc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.846+0000 7f77cbfff700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09e000 0x7f77cc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 -- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09e000 msgr2=0x7f77cc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09e000 0x7f77cc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 -- 172.21.15.19:0/1429404250 >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 msgr2=0x7f77cc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/1429404250 >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 0x7f77cc133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 -- 172.21.15.19:0/1429404250 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77cc09a500 con 0x7f77cc09d6f0 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d13c8700 1 --2- 172.21.15.19:0/1429404250 >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 0x7f77cc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009920 tx=0x7f77c0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89f8fe234c07b82f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77cb7fe700 1 -- 172.21.15.19:0/1429404250 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0011830 con 0x7f77cc09d6f0 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77cb7fe700 1 -- 172.21.15.19:0/1429404250 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0011990 con 0x7f77cc09d6f0 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.847+0000 7f77cb7fe700 1 -- 172.21.15.19:0/1429404250 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0011d20 con 0x7f77cc09d6f0 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 -- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 msgr2=0x7f77cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009920 tx=0x7f77c0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 -- 172.21.15.19:0/1429404250 shutdown_connections 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09d6f0 0x7f77cc09dac0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/1429404250 >> v2:172.21.15.19:3300/0 conn(0x7f77cc09e410 0x7f77cc133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/1429404250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09e000 0x7f77cc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 -- 172.21.15.19:0/1429404250 >> 172.21.15.19:0/1429404250 conn(0x7f77cc066f50 msgr2=0x7f77cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 -- 172.21.15.19:0/1429404250 shutdown_connections 2023-10-03T10:17:37.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.848+0000 7f77d2e2b700 1 -- 172.21.15.19:0/1429404250 wait complete. 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.849+0000 7f77d2e2b700 1 Processor -- start 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 -- start start 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 0x7f77cc1a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09e410 0x7f77cc1a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc1a7ac0 con 0x7f77cc09e000 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc1a80e0 con 0x7f77cc09e410 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.850+0000 7f77d2e2b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77cc1a8d10 con 0x7f77cc09d6f0 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41412/0 (socket says 172.21.15.19:41412) 2023-10-03T10:17:37.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 -- 172.21.15.19:0/2340845894 learned_addr learned my addr 172.21.15.19:0/2340845894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d13c8700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09e410 0x7f77cc1a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77cbfff700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 0x7f77cc1a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 -- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09e410 msgr2=0x7f77cc1a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09e410 0x7f77cc1a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 -- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 msgr2=0x7f77cc1a6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 0x7f77cc1a6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77d0bc7700 1 -- 172.21.15.19:0/2340845894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c4009a70 con 0x7f77cc09d6f0 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.851+0000 7f77cbfff700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 0x7f77cc1a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77d0bc7700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f77c0000c00 tx=0x7f77c0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0004240 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c001f070 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c0009550 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c00036a0 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.852+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77cc0a2140 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.853+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77c0021030 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.853+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77cc09c710 con 0x7f77cc09d6f0 2023-10-03T10:17:37.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.853+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77c0040820 con 0x7f77cc09d6f0 2023-10-03T10:17:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.863+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77c00199a0 con 0x7f77cc09d6f0 2023-10-03T10:17:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.863+0000 7f03c87b2700 1 Processor -- start 2023-10-03T10:17:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.863+0000 7f03c87b2700 1 -- start start 2023-10-03T10:17:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.863+0000 7f03c87b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c009d6f0 0x7f03c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c87b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c87b2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c009f130 con 0x7f03c009e000 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c87b2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c009f520 con 0x7f03c009d6f0 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c87b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c009e930 con 0x7f03c009e410 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c5d4d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f03c009e000 0x7f03c0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54394/0 (socket says 172.21.15.19:54394) 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c5d4d700 1 -- 172.21.15.19:0/447357931 learned_addr learned my addr 172.21.15.19:0/447357931 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c654e700 1 --2- 172.21.15.19:0/447357931 >> v2:172.21.15.19:3300/0 conn(0x7f03c009d6f0 0x7f03c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c6d4f700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c654e700 1 -- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 msgr2=0x7f03c0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c654e700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c654e700 1 -- 172.21.15.19:0/447357931 >> v1:172.21.15.19:6789/0 conn(0x7f03c009e000 legacy=0x7f03c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.864+0000 7f03c654e700 1 -- 172.21.15.19:0/447357931 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c009b2d0 con 0x7f03c009d6f0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.865+0000 7f03c654e700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c009dac0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009840 tx=0x7f03bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdd48d60a406458 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.865+0000 7f03c554c700 1 -- 172.21.15.19:0/447357931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011830 con 0x7f03c009d6f0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.865+0000 7f03c554c700 1 -- 172.21.15.19:0/447357931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc011990 con 0x7f03c009d6f0 2023-10-03T10:17:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.865+0000 7f03c554c700 1 -- 172.21.15.19:0/447357931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc011d20 con 0x7f03c009d6f0 2023-10-03T10:17:37.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 -- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 msgr2=0x7f03c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c009dac0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009840 tx=0x7f03bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:37.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 -- 172.21.15.19:0/447357931 shutdown_connections 2023-10-03T10:17:37.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 --2- 172.21.15.19:0/447357931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c009dac0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 -- 172.21.15.19:0/447357931 >> 172.21.15.19:0/447357931 conn(0x7f03c0066f50 msgr2=0x7f03c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 -- 172.21.15.19:0/447357931 shutdown_connections 2023-10-03T10:17:37.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.866+0000 7f03c87b2700 1 -- 172.21.15.19:0/447357931 wait complete. 2023-10-03T10:17:37.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.867+0000 7f03c87b2700 1 Processor -- start 2023-10-03T10:17:37.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.867+0000 7f03c87b2700 1 -- start start 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 0x7f03c012e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c01cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c012dfd0 con 0x7f03c009d6f0 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c011f3c0 con 0x7f03c009e000 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c87b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c006e840 con 0x7f03c009e410 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c654e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c654e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54972/0 (socket says 172.21.15.19:54972) 2023-10-03T10:17:37.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c5d4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 0x7f03c012e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c654e700 1 -- 172.21.15.19:0/645364342 learned_addr learned my addr 172.21.15.19:0/645364342 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.868+0000 7f03c6d4f700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c01cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 -- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 msgr2=0x7f03c01cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c01cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 -- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 msgr2=0x7f03c012e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 0x7f03c012e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 -- 172.21.15.19:0/645364342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03bc0094a0 con 0x7f03c009d6f0 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c5d4d700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 0x7f03c012e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03c654e700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009fd0 tx=0x7f03bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.869+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0036a0 con 0x7f03c009d6f0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.870+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc01f070 con 0x7f03c009d6f0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.870+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003a60 con 0x7f03c009d6f0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.870+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c009c700 con 0x7f03c009d6f0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.870+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c006a9e0 con 0x7f03c009d6f0 2023-10-03T10:17:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.871+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c011f200 con 0x7f03c009d6f0 2023-10-03T10:17:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.871+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03bc003bc0 con 0x7f03c009d6f0 2023-10-03T10:17:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.871+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03bc021070 con 0x7f03c009d6f0 2023-10-03T10:17:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.880+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03bc019d80 con 0x7f03c009d6f0 2023-10-03T10:17:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.891+0000 7f8ed16cf700 1 Processor -- start 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.891+0000 7f8ed16cf700 1 -- start start 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ed16cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ed16cf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8ecc136fe0 0x7f8ecc1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ed16cf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc070940 con 0x7f8ecc09e930 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ed16cf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc06fd60 con 0x7f8ecc136fe0 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ed16cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc06fa80 con 0x7f8ecc09f410 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8eca7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8eca7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41440/0 (socket says 172.21.15.19:41440) 2023-10-03T10:17:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8eca7fc700 1 -- 172.21.15.19:0/1249824145 learned_addr learned my addr 172.21.15.19:0/1249824145 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8ecb7fe700 1 --2- 172.21.15.19:0/1249824145 >> v2:172.21.15.19:3300/0 conn(0x7f8ecc136fe0 0x7f8ecc1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8eca7fc700 1 -- 172.21.15.19:0/1249824145 >> v2:172.21.15.19:3300/0 conn(0x7f8ecc136fe0 msgr2=0x7f8ecc1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.892+0000 7f8eca7fc700 1 --2- 172.21.15.19:0/1249824145 >> v2:172.21.15.19:3300/0 conn(0x7f8ecc136fe0 0x7f8ecc1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8eca7fc700 1 -- 172.21.15.19:0/1249824145 >> v1:172.21.15.19:6789/0 conn(0x7f8ecc09e930 legacy=0x7f8ecc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8eca7fc700 1 -- 172.21.15.19:0/1249824145 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc09fb60 con 0x7f8ecc09f410 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8eca7fc700 1 --2- 172.21.15.19:0/1249824145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00098f0 tx=0x7f8ec0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3380d37dcfaf3bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8ec9ffb700 1 -- 172.21.15.19:0/1249824145 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0011830 con 0x7f8ecc09f410 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8ec9ffb700 1 -- 172.21.15.19:0/1249824145 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0011990 con 0x7f8ecc09f410 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.893+0000 7f8ec9ffb700 1 -- 172.21.15.19:0/1249824145 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0011d00 con 0x7f8ecc09f410 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 -- 172.21.15.19:0/1249824145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 msgr2=0x7f8ecc136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/1249824145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00098f0 tx=0x7f8ec0009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 -- 172.21.15.19:0/1249824145 shutdown_connections 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/1249824145 >> v2:172.21.15.19:3300/0 conn(0x7f8ecc136fe0 0x7f8ecc1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/1249824145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09f410 0x7f8ecc136aa0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 -- 172.21.15.19:0/1249824145 >> 172.21.15.19:0/1249824145 conn(0x7f8ecc0a4210 msgr2=0x7f8ecc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 -- 172.21.15.19:0/1249824145 shutdown_connections 2023-10-03T10:17:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.894+0000 7f8ed16cf700 1 -- 172.21.15.19:0/1249824145 wait complete. 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.895+0000 7f8ed16cf700 1 Processor -- start 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.895+0000 7f8ed16cf700 1 -- start start 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 0x7f8ecc11cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ecc136fe0 0x7f8ecc11d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc11ff20 con 0x7f8ecc136fe0 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0a2f00 con 0x7f8ecc09f410 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ed16cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc11e2b0 con 0x7f8ecc09e930 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ecaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ecaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41456/0 (socket says 172.21.15.19:41456) 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 0x7f8ecc11cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ecaffd700 1 -- 172.21.15.19:0/2128516746 learned_addr learned my addr 172.21.15.19:0/2128516746 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ecb7fe700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ecc136fe0 0x7f8ecc11d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 -- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 msgr2=0x7f8ecc11c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 -- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ecc136fe0 msgr2=0x7f8ecc11d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ecc136fe0 0x7f8ecc11d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8eca7fc700 1 -- 172.21.15.19:0/2128516746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009550 con 0x7f8ecc09f410 2023-10-03T10:17:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.896+0000 7f8ecaffd700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8eca7fc700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 0x7f8ecc11cc90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc06f570 tx=0x7f8ec0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0004450 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec00045b0 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc071d20 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc11f890 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.897+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec00038c0 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.898+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac0052e0 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.899+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ec0003a20 con 0x7f8ecc09f410 2023-10-03T10:17:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.899+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ec0040a60 con 0x7f8ecc09f410 2023-10-03T10:17:37.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:37.908+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ec001a420 con 0x7f8ecc09f410 2023-10-03T10:17:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.018+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f73e411ba40 con 0x7f73e406acb0 2023-10-03T10:17:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.018+0000 7f73daffd700 1 -- 172.21.15.19:0/364216047 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73e411ba40 con 0x7f73e406acb0 2023-10-03T10:17:38.018 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 msgr2=0x7f73e4119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f73e0000c00 tx=0x7f73e0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 shutdown_connections 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f73e41316c0 0x7f73e4119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f73e406acb0 0x7f73e4119480 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 --2- 172.21.15.19:0/364216047 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f73e409d9f0 0x7f73e41199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 >> 172.21.15.19:0/364216047 conn(0x7f73e4066f50 msgr2=0x7f73e409be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 shutdown_connections 2023-10-03T10:17:38.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.022+0000 7f73ec4a5700 1 -- 172.21.15.19:0/364216047 wait complete. 2023-10-03T10:17:38.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:38.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.077+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77cc074ea0 con 0x7f77cc09d6f0 2023-10-03T10:17:38.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.077+0000 7f77c97fa700 1 -- 172.21.15.19:0/2340845894 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77c0015030 con 0x7f77cc09d6f0 2023-10-03T10:17:38.077 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.080+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 msgr2=0x7f77cc1a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.080+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f77c0000c00 tx=0x7f77c0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 shutdown_connections 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77cc09e410 0x7f77cc1a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77cc09d6f0 0x7f77cc1a5f40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 --2- 172.21.15.19:0/2340845894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77cc09e000 0x7f77cc1a6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 >> 172.21.15.19:0/2340845894 conn(0x7f77cc066f50 msgr2=0x7f77cc1bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 shutdown_connections 2023-10-03T10:17:38.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.081+0000 7f77d2e2b700 1 -- 172.21.15.19:0/2340845894 wait complete. 2023-10-03T10:17:38.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.090+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f03c0074ea0 con 0x7f03c009d6f0 2023-10-03T10:17:38.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.091+0000 7f03b6ffd700 1 -- 172.21.15.19:0/645364342 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03bc02b070 con 0x7f03c009d6f0 2023-10-03T10:17:38.090 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:38.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 msgr2=0x7f03c012e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f03bc009fd0 tx=0x7f03bc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 shutdown_connections 2023-10-03T10:17:38.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c009e410 0x7f03c01cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c009d6f0 0x7f03c012e370 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 --2- 172.21.15.19:0/645364342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c009e000 0x7f03c012e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 >> 172.21.15.19:0/645364342 conn(0x7f03c0066f50 msgr2=0x7f03c00700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 shutdown_connections 2023-10-03T10:17:38.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.093+0000 7f03c87b2700 1 -- 172.21.15.19:0/645364342 wait complete. 2023-10-03T10:17:38.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:38.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:38.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.127+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8eac005860 con 0x7f8ecc09f410 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.127+0000 7f8eb37fe700 1 -- 172.21.15.19:0/2128516746 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ec0028070 con 0x7f8ecc09f410 2023-10-03T10:17:38.127 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 msgr2=0x7f8ecc11cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 0x7f8ecc11cc90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc06f570 tx=0x7f8ec0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 shutdown_connections 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8ecc136fe0 0x7f8ecc11d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8ecc09e930 0x7f8ecc11c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 --2- 172.21.15.19:0/2128516746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8ecc09f410 0x7f8ecc11cc90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 >> 172.21.15.19:0/2128516746 conn(0x7f8ecc0a4210 msgr2=0x7f8ecc134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 shutdown_connections 2023-10-03T10:17:38.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:38.130+0000 7f8ed16cf700 1 -- 172.21.15.19:0/2128516746 wait complete. 2023-10-03T10:17:38.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:39.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:39.096 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:39.108 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:39.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.193+0000 7f1f2f5a5700 1 Processor -- start 2023-10-03T10:17:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 -- start start 2023-10-03T10:17:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 0x7f1f2809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 0x7f1f28130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2809f130 con 0x7f1f2809e000 2023-10-03T10:17:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2809f520 con 0x7f1f2809e410 2023-10-03T10:17:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2f5a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2809e930 con 0x7f1f2809d6f0 2023-10-03T10:17:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2cb40700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1f2809e000 0x7f1f28130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54414/0 (socket says 172.21.15.19:54414) 2023-10-03T10:17:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2cb40700 1 -- 172.21.15.19:0/113166012 learned_addr learned my addr 172.21.15.19:0/113166012 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.194+0000 7f1f2db42700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 0x7f1f28130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2d341700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 0x7f1f2809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2db42700 1 -- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 msgr2=0x7f1f2809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2db42700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 0x7f1f2809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2db42700 1 -- 172.21.15.19:0/113166012 >> v1:172.21.15.19:6789/0 conn(0x7f1f2809e000 legacy=0x7f1f28130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2db42700 1 -- 172.21.15.19:0/113166012 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2809b2d0 con 0x7f1f2809e410 2023-10-03T10:17:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f1ffff700 1 -- 172.21.15.19:0/113166012 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955492157 0 0) 0x7f1f2809f130 con 0x7f1f2809e000 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2d341700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 0x7f1f2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f2db42700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 0x7f1f28130d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009dc0 tx=0x7f1f2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c1679cc9ef6195 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f1ffff700 1 -- 172.21.15.19:0/113166012 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000bdd0 con 0x7f1f2809e410 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f1ffff700 1 -- 172.21.15.19:0/113166012 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f200104d0 con 0x7f1f2809e410 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.195+0000 7f1f1ffff700 1 -- 172.21.15.19:0/113166012 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20010880 con 0x7f1f2809e410 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 msgr2=0x7f1f28130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 0x7f1f28130d70 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009dc0 tx=0x7f1f2000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/113166012 shutdown_connections 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e410 0x7f1f28130d70 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/113166012 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809d6f0 0x7f1f2809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/113166012 >> 172.21.15.19:0/113166012 conn(0x7f1f28066f50 msgr2=0x7f1f2809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/113166012 shutdown_connections 2023-10-03T10:17:39.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.196+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/113166012 wait complete. 2023-10-03T10:17:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.197+0000 7f1f2f5a5700 1 Processor -- start 2023-10-03T10:17:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 -- start start 2023-10-03T10:17:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f2809d6f0 0x7f1f281300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 0x7f1f2811e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281221b0 con 0x7f1f2809d6f0 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281217f0 con 0x7f1f2809e000 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2f5a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28120f80 con 0x7f1f2809e410 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2cb40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2cb40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43862/0 (socket says 172.21.15.19:43862) 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2cb40700 1 -- 172.21.15.19:0/2439364919 learned_addr learned my addr 172.21.15.19:0/2439364919 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.198+0000 7f1f2db42700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 0x7f1f2811e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 -- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 msgr2=0x7f1f2811dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 -- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f2809d6f0 msgr2=0x7f1f281300b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f2809d6f0 0x7f1f281300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 -- 172.21.15.19:0/2439364919 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009a70 con 0x7f1f2809e410 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2cb40700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2db42700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 0x7f1f2811e2a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f280a3e50 tx=0x7f1f20004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20010a50 con 0x7f1f2809e410 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20010bb0 con 0x7f1f2809e410 2023-10-03T10:17:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28120b30 con 0x7f1f2809e410 2023-10-03T10:17:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.199+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20004040 con 0x7f1f2809e410 2023-10-03T10:17:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.200+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f280a3bf0 con 0x7f1f2809e410 2023-10-03T10:17:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.201+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1f2001f030 con 0x7f1f2809e410 2023-10-03T10:17:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.201+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2811ac20 con 0x7f1f2809e410 2023-10-03T10:17:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.201+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1f20045570 con 0x7f1f2809e410 2023-10-03T10:17:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.210+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1f200041a0 con 0x7f1f2809e410 2023-10-03T10:17:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.246+0000 7f9d78d95700 1 Processor -- start 2023-10-03T10:17:39.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.246+0000 7f9d78d95700 1 -- start start 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d78d95700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d74130540 0x7f9d74130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d78d95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d78d95700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d740716a0 con 0x7f9d7406fb20 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d78d95700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7409a390 con 0x7f9d74130540 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d78d95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d74071290 con 0x7f9d74130e50 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41474/0 (socket says 172.21.15.19:41474) 2023-10-03T10:17:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d7259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d74130540 0x7f9d74130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d71d9b700 1 -- 172.21.15.19:0/1752087934 learned_addr learned my addr 172.21.15.19:0/1752087934 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d7259c700 1 -- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 msgr2=0x7f9d7406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d7259c700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d7259c700 1 -- 172.21.15.19:0/1752087934 >> v1:172.21.15.19:6789/0 conn(0x7f9d7406fb20 legacy=0x7f9d74137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d7259c700 1 -- 172.21.15.19:0/1752087934 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d74130340 con 0x7f9d74130540 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.247+0000 7f9d71d9b700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.248+0000 7f9d7259c700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d74130910 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009840 tx=0x7f9d64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5d4fdf9cd8bc418 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.248+0000 7f9d7159a700 1 -- 172.21.15.19:0/1752087934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011830 con 0x7f9d74130540 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.248+0000 7f9d7159a700 1 -- 172.21.15.19:0/1752087934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d64011990 con 0x7f9d74130540 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.248+0000 7f9d7159a700 1 -- 172.21.15.19:0/1752087934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011d20 con 0x7f9d74130540 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 -- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 msgr2=0x7f9d74130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d74130910 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009840 tx=0x7f9d64009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 -- 172.21.15.19:0/1752087934 shutdown_connections 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d74130910 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 --2- 172.21.15.19:0/1752087934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d7406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 -- 172.21.15.19:0/1752087934 >> 172.21.15.19:0/1752087934 conn(0x7f9d740a2aa0 msgr2=0x7f9d740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 -- 172.21.15.19:0/1752087934 shutdown_connections 2023-10-03T10:17:39.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.249+0000 7f9d78d95700 1 -- 172.21.15.19:0/1752087934 wait complete. 2023-10-03T10:17:39.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.250+0000 7f9d78d95700 1 Processor -- start 2023-10-03T10:17:39.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.250+0000 7f9d78d95700 1 -- start start 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d7406fb20 0x7f9d741c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7413bc20 con 0x7f9d74130540 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740718e0 con 0x7f9d7406fb20 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d78d95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7413b050 con 0x7f9d74130e50 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d71d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d71d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55016/0 (socket says 172.21.15.19:55016) 2023-10-03T10:17:39.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41476/0 (socket says 172.21.15.19:41476) 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d71d9b700 1 -- 172.21.15.19:0/704475341 learned_addr learned my addr 172.21.15.19:0/704475341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 -- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d7406fb20 msgr2=0x7f9d741c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d7406fb20 0x7f9d741c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 -- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 msgr2=0x7f9d741c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d72d9d700 1 -- 172.21.15.19:0/704475341 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68009550 con 0x7f9d74130e50 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.251+0000 7f9d71d9b700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.252+0000 7f9d72d9d700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00cb90 tx=0x7f9d6c00cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.252+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c003c00 con 0x7f9d74130e50 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.252+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c003d60 con 0x7f9d74130e50 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.252+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c00aaa0 con 0x7f9d74130e50 2023-10-03T10:17:39.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.253+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d640094a0 con 0x7f9d74130e50 2023-10-03T10:17:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.253+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d74131d40 con 0x7f9d74130e50 2023-10-03T10:17:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.254+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d6c00ac00 con 0x7f9d74130e50 2023-10-03T10:17:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.254+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74074ea0 con 0x7f9d74130e50 2023-10-03T10:17:39.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.254+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d6c03f5f0 con 0x7f9d74130e50 2023-10-03T10:17:39.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.263+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d6c0198f0 con 0x7f9d74130e50 2023-10-03T10:17:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.299+0000 7fadfda6a700 1 Processor -- start 2023-10-03T10:17:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.299+0000 7fadfda6a700 1 -- start start 2023-10-03T10:17:39.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadfda6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadfda6a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fadf8139030 0x7fadf813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadfda6a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf806ef30 con 0x7fadf81338a0 2023-10-03T10:17:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadfda6a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf806fef0 con 0x7fadf8139030 2023-10-03T10:17:39.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadfda6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf81334b0 con 0x7fadf8136710 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fadf8139030 0x7fadf813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fadf81338a0 0x7fadf8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54440/0 (socket says 172.21.15.19:54440) 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf77fe700 1 -- 172.21.15.19:0/55323347 learned_addr learned my addr 172.21.15.19:0/55323347 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf6ffd700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf7fff700 1 -- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 msgr2=0x7fadf8138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf7fff700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf8138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf7fff700 1 -- 172.21.15.19:0/55323347 >> v1:172.21.15.19:6789/0 conn(0x7fadf81338a0 legacy=0x7fadf8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf7fff700 1 -- 172.21.15.19:0/55323347 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf806fc30 con 0x7fadf8139030 2023-10-03T10:17:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.300+0000 7fadf67fc700 1 -- 172.21.15.19:0/55323347 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309839797 0 0) 0x7fadf806ef30 con 0x7fadf81338a0 2023-10-03T10:17:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadf7fff700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf813b410 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7178e4d2aa0b98fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadf67fc700 1 -- 172.21.15.19:0/55323347 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000e070 con 0x7fadf8139030 2023-10-03T10:17:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadf67fc700 1 -- 172.21.15.19:0/55323347 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000bb20 con 0x7fadf8139030 2023-10-03T10:17:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadf67fc700 1 -- 172.21.15.19:0/55323347 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012430 con 0x7fadf8139030 2023-10-03T10:17:39.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 -- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 msgr2=0x7fadf813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf813b410 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fadf0009d90 tx=0x7fadf000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 -- 172.21.15.19:0/55323347 shutdown_connections 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf813b410 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 --2- 172.21.15.19:0/55323347 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.301+0000 7fadfda6a700 1 -- 172.21.15.19:0/55323347 >> 172.21.15.19:0/55323347 conn(0x7fadf80a2aa0 msgr2=0x7fadf80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.302+0000 7fadfda6a700 1 -- 172.21.15.19:0/55323347 shutdown_connections 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.302+0000 7fadfda6a700 1 -- 172.21.15.19:0/55323347 wait complete. 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.302+0000 7fadfda6a700 1 Processor -- start 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 -- start start 2023-10-03T10:17:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 0x7fadf811adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf811b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf811c9d0 con 0x7fadf8139030 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf806f640 con 0x7fadf8136710 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadfda6a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fadf811eb20 con 0x7fadf81338a0 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.303+0000 7fadf7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55032/0 (socket says 172.21.15.19:55032) 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 -- 172.21.15.19:0/3557985311 learned_addr learned my addr 172.21.15.19:0/3557985311 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf77fe700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 0x7fadf811adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf6ffd700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf811b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 -- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 msgr2=0x7fadf811adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 0x7fadf811adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 -- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 msgr2=0x7fadf811b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf811b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 -- 172.21.15.19:0/3557985311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf0009a70 con 0x7fadf8139030 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf77fe700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 0x7fadf811adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7fadf7fff700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fadf0013000 tx=0x7fadf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.304+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0012430 con 0x7fadf8139030 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.305+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf0020070 con 0x7fadf8139030 2023-10-03T10:17:39.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.305+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf0004280 con 0x7fadf8139030 2023-10-03T10:17:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.305+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf811d230 con 0x7fadf8139030 2023-10-03T10:17:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.305+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf811e0d0 con 0x7fadf8139030 2023-10-03T10:17:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.306+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fadf00043e0 con 0x7fadf8139030 2023-10-03T10:17:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.306+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf811e2a0 con 0x7fadf8139030 2023-10-03T10:17:39.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.306+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fadf0022070 con 0x7fadf8139030 2023-10-03T10:17:39.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.315+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fadf811e2a0 con 0x7fadf8139030 2023-10-03T10:17:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.337+0000 7f85a5cf5700 1 Processor -- start 2023-10-03T10:17:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.337+0000 7f85a5cf5700 1 -- start start 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f85a5cf5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f85a5cf5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85a0136f50 0x7f85a0139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f85a5cf5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a0071a00 con 0x7f85a0131630 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f85a5cf5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a0131430 con 0x7f85a0136f50 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f85a5cf5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85a009a510 con 0x7f85a0134630 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f859ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f85a0136f50 0x7f85a0139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f859f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f85a0131630 0x7f85a0131a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54450/0 (socket says 172.21.15.19:54450) 2023-10-03T10:17:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f859f7fe700 1 -- 172.21.15.19:0/32577828 learned_addr learned my addr 172.21.15.19:0/32577828 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:39.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.338+0000 7f859effd700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859ffff700 1 -- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 msgr2=0x7f85a0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859ffff700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859ffff700 1 -- 172.21.15.19:0/32577828 >> v1:172.21.15.19:6789/0 conn(0x7f85a0131630 legacy=0x7f85a0131a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859e7fc700 1 -- 172.21.15.19:0/32577828 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883041498 0 0) 0x7f85a0071a00 con 0x7f85a0131630 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859ffff700 1 -- 172.21.15.19:0/32577828 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00721c0 con 0x7f85a0136f50 2023-10-03T10:17:39.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859effd700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859ffff700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0136f50 0x7f85a0139330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8598009d90 tx=0x7f859800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68482aa912b28310 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859e7fc700 1 -- 172.21.15.19:0/32577828 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800e070 con 0x7f85a0136f50 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859e7fc700 1 -- 172.21.15.19:0/32577828 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800bbd0 con 0x7f85a0136f50 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.339+0000 7f859e7fc700 1 -- 172.21.15.19:0/32577828 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598012430 con 0x7f85a0136f50 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 -- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0136f50 msgr2=0x7f85a0139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0136f50 0x7f85a0139330 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f8598009d90 tx=0x7f859800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 -- 172.21.15.19:0/32577828 shutdown_connections 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0136f50 0x7f85a0139330 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/32577828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 -- 172.21.15.19:0/32577828 >> 172.21.15.19:0/32577828 conn(0x7f85a00a2aa0 msgr2=0x7f85a00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 -- 172.21.15.19:0/32577828 shutdown_connections 2023-10-03T10:17:39.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.340+0000 7f85a5cf5700 1 -- 172.21.15.19:0/32577828 wait complete. 2023-10-03T10:17:39.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.341+0000 7f85a5cf5700 1 Processor -- start 2023-10-03T10:17:39.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 -- start start 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 0x7f85a0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a0099f20 con 0x7f85a0131630 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a01337e0 con 0x7f85a0136f50 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f85a5cf5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85a011bc50 con 0x7f85a0134630 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f859f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f859f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55048/0 (socket says 172.21.15.19:55048) 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f859f7fe700 1 -- 172.21.15.19:0/3530205132 learned_addr learned my addr 172.21.15.19:0/3530205132 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:39.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.342+0000 7f859ffff700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 0x7f85a0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859effd700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 -- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 msgr2=0x7f85a0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 -- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 msgr2=0x7f85a0118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 -- 172.21.15.19:0/3530205132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598009a70 con 0x7f85a0136f50 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859f7fe700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f859ffff700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 0x7f85a0119750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8598016000 tx=0x7f8598004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598012430 con 0x7f85a0136f50 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859801fdd0 con 0x7f85a0136f50 2023-10-03T10:17:39.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598012820 con 0x7f85a0136f50 2023-10-03T10:17:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a011c1e0 con 0x7f85a0136f50 2023-10-03T10:17:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.343+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a011cc50 con 0x7f85a0136f50 2023-10-03T10:17:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.345+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a0074ea0 con 0x7f85a0136f50 2023-10-03T10:17:39.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.345+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8598027070 con 0x7f85a0136f50 2023-10-03T10:17:39.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.345+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8598044e50 con 0x7f85a0136f50 2023-10-03T10:17:39.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.354+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8598012980 con 0x7f85a0136f50 2023-10-03T10:17:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.436+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1f28121390 con 0x7f1f2809e410 2023-10-03T10:17:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.437+0000 7f1f1dffb700 1 -- 172.21.15.19:0/2439364919 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1f2001d090 con 0x7f1f2809e410 2023-10-03T10:17:39.437 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 msgr2=0x7f1f2811e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 0x7f1f2811e2a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f1f280a3e50 tx=0x7f1f20004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 shutdown_connections 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1f2809e410 0x7f1f2811e2a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f2809d6f0 0x7f1f281300b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 --2- 172.21.15.19:0/2439364919 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1f2809e000 0x7f1f2811dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 >> 172.21.15.19:0/2439364919 conn(0x7f1f28066f50 msgr2=0x7f1f28130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 shutdown_connections 2023-10-03T10:17:39.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.439+0000 7f1f2f5a5700 1 -- 172.21.15.19:0/2439364919 wait complete. 2023-10-03T10:17:39.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.476+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9d7406b9e0 con 0x7f9d74130e50 2023-10-03T10:17:39.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.477+0000 7f9d62ffd700 1 -- 172.21.15.19:0/704475341 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d6c019300 con 0x7f9d74130e50 2023-10-03T10:17:39.477 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 msgr2=0x7f9d74139c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00cb90 tx=0x7f9d6c00cea0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 shutdown_connections 2023-10-03T10:17:39.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d74130e50 0x7f9d74139c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d7406fb20 0x7f9d741c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 --2- 172.21.15.19:0/704475341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d74130540 0x7f9d741c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 >> 172.21.15.19:0/704475341 conn(0x7f9d740a2aa0 msgr2=0x7f9d74126e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 shutdown_connections 2023-10-03T10:17:39.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.479+0000 7f9d78d95700 1 -- 172.21.15.19:0/704475341 wait complete. 2023-10-03T10:17:39.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.524+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fadf811e0d0 con 0x7fadf8139030 2023-10-03T10:17:39.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.525+0000 7faddffff700 1 -- 172.21.15.19:0/3557985311 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fadf811e0d0 con 0x7fadf8139030 2023-10-03T10:17:39.525 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:39.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 msgr2=0x7fadf811b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fadf0013000 tx=0x7fadf0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 shutdown_connections 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fadf8139030 0x7fadf811b840 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fadf81338a0 0x7fadf811adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 --2- 172.21.15.19:0/3557985311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fadf8136710 0x7fadf811b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 >> 172.21.15.19:0/3557985311 conn(0x7fadf80a2aa0 msgr2=0x7fadf80a0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 shutdown_connections 2023-10-03T10:17:39.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.527+0000 7fadfda6a700 1 -- 172.21.15.19:0/3557985311 wait complete. 2023-10-03T10:17:39.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:39.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.561+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f85a006b9e0 con 0x7f85a0136f50 2023-10-03T10:17:39.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.562+0000 7f8587fff700 1 -- 172.21.15.19:0/3530205132 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8598046090 con 0x7f85a0136f50 2023-10-03T10:17:39.562 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 msgr2=0x7f85a0119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 0x7f85a0119750 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8598016000 tx=0x7f8598004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 shutdown_connections 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f85a0136f50 0x7f85a0119750 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f85a0131630 0x7f85a0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 --2- 172.21.15.19:0/3530205132 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f85a0134630 0x7f85a0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 >> 172.21.15.19:0/3530205132 conn(0x7f85a00a2aa0 msgr2=0x7f85a00a0930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 shutdown_connections 2023-10-03T10:17:39.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:39.564+0000 7f85a5cf5700 1 -- 172.21.15.19:0/3530205132 wait complete. 2023-10-03T10:17:39.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:40.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:40.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:40.542 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:40.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:40.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.619+0000 7f0fe5373700 1 Processor -- start 2023-10-03T10:17:40.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.619+0000 7f0fe5373700 1 -- start start 2023-10-03T10:17:40.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 0x7f0fe006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fe009a350 con 0x7f0fe006f680 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0130260 con 0x7f0fe0130670 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.620+0000 7f0fe5373700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe0071ff0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fde7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 0x7f0fe006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43918/0 (socket says 172.21.15.19:43918) 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41494/0 (socket says 172.21.15.19:41494) 2023-10-03T10:17:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fde7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 0x7f0fe006fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55056/0 (socket says 172.21.15.19:55056) 2023-10-03T10:17:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 -- 172.21.15.19:0/4077629717 learned_addr learned my addr 172.21.15.19:0/4077629717 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 -- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 msgr2=0x7f0fe0137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 -- 172.21.15.19:0/4077629717 >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 msgr2=0x7f0fe006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 --2- 172.21.15.19:0/4077629717 >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 0x7f0fe006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 -- 172.21.15.19:0/4077629717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0070470 con 0x7f0fe0130670 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdf7fe700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fdeffd700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009920 tx=0x7f0fd0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14402258ac598f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.621+0000 7f0fddffb700 1 -- 172.21.15.19:0/4077629717 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0011830 con 0x7f0fe0130670 2023-10-03T10:17:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fddffb700 1 -- 172.21.15.19:0/4077629717 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0011990 con 0x7f0fe0130670 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fddffb700 1 -- 172.21.15.19:0/4077629717 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd0011d20 con 0x7f0fe0130670 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 -- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 msgr2=0x7f0fe0130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0fd0009920 tx=0x7f0fd0009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 -- 172.21.15.19:0/4077629717 shutdown_connections 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe0130a40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 --2- 172.21.15.19:0/4077629717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe0137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 --2- 172.21.15.19:0/4077629717 >> v2:172.21.15.19:3300/0 conn(0x7f0fe006f680 0x7f0fe006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 -- 172.21.15.19:0/4077629717 >> 172.21.15.19:0/4077629717 conn(0x7f0fe00a2aa0 msgr2=0x7f0fe00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.622+0000 7f0fe5373700 1 -- 172.21.15.19:0/4077629717 shutdown_connections 2023-10-03T10:17:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.623+0000 7f0fe5373700 1 -- 172.21.15.19:0/4077629717 wait complete. 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.624+0000 7f0fe5373700 1 Processor -- start 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.624+0000 7f0fe5373700 1 -- start start 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 0x7f0fe011ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe011f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe011f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe012cea0 con 0x7f0fe006f680 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe01221a0 con 0x7f0fe0130670 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fe5373700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe012c9e0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe011f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fdf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe011f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43922/0 (socket says 172.21.15.19:43922) 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fdf7fe700 1 -- 172.21.15.19:0/1657314761 learned_addr learned my addr 172.21.15.19:0/1657314761 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fdeffd700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 0x7f0fe011ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.625+0000 7f0fde7fc700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe011f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 -- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 msgr2=0x7f0fe011f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe011f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 -- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 msgr2=0x7f0fe011ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 0x7f0fe011ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 -- 172.21.15.19:0/1657314761 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd8009a70 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fdeffd700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 0x7f0fe011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fde7fc700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe011f450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400e8d0 tx=0x7f0fd400ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4013680 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd40137e0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4013b50 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd0009550 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.626+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fe0071820 con 0x7f0fe006ffd0 2023-10-03T10:17:40.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.628+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0074ea0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.628+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0fd4013cb0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.628+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0fd403f630 con 0x7f0fe006ffd0 2023-10-03T10:17:40.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.637+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0fd401bde0 con 0x7f0fe006ffd0 2023-10-03T10:17:40.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.650+0000 7f7651ad4700 1 Processor -- start 2023-10-03T10:17:40.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.650+0000 7f7651ad4700 1 -- start start 2023-10-03T10:17:40.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f7651ad4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 0x7f764c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f7651ad4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 0x7f764c13b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f7651ad4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c06f720 con 0x7f764c1341d0 2023-10-03T10:17:40.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f7651ad4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c070c80 con 0x7f764c09e560 2023-10-03T10:17:40.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f7651ad4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764c06fce0 con 0x7f764c1338c0 2023-10-03T10:17:40.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f764affd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f764c1341d0 0x7f764c09de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54456/0 (socket says 172.21.15.19:54456) 2023-10-03T10:17:40.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f764affd700 1 -- 172.21.15.19:0/881444102 learned_addr learned my addr 172.21.15.19:0/881444102 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:40.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f764bfff700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 0x7f764c13b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.651+0000 7f764b7fe700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 0x7f764c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764a7fc700 1 -- 172.21.15.19:0/881444102 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830195277 0 0) 0x7f764c06f720 con 0x7f764c1341d0 2023-10-03T10:17:40.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764a7fc700 1 -- 172.21.15.19:0/881444102 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76340035b0 con 0x7f764c1341d0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764b7fe700 1 -- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 msgr2=0x7f764c13b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764b7fe700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 0x7f764c13b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764b7fe700 1 -- 172.21.15.19:0/881444102 >> v1:172.21.15.19:6789/0 conn(0x7f764c1341d0 legacy=0x7f764c09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764b7fe700 1 -- 172.21.15.19:0/881444102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c1336a0 con 0x7f764c1338c0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764bfff700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 0x7f764c13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764b7fe700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 0x7f764c133c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f763c009870 tx=0x7f763c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e44082d50026a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764a7fc700 1 -- 172.21.15.19:0/881444102 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c011830 con 0x7f764c1338c0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764a7fc700 1 -- 172.21.15.19:0/881444102 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c011990 con 0x7f764c1338c0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.652+0000 7f764a7fc700 1 -- 172.21.15.19:0/881444102 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c011d20 con 0x7f764c1338c0 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 -- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 msgr2=0x7f764c133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 0x7f764c133c90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f763c009870 tx=0x7f763c009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:40.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 -- 172.21.15.19:0/881444102 shutdown_connections 2023-10-03T10:17:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c09e560 0x7f764c13b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 --2- 172.21.15.19:0/881444102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c1338c0 0x7f764c133c90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 -- 172.21.15.19:0/881444102 >> 172.21.15.19:0/881444102 conn(0x7f764c0a2aa0 msgr2=0x7f764c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 -- 172.21.15.19:0/881444102 shutdown_connections 2023-10-03T10:17:40.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.653+0000 7f7651ad4700 1 -- 172.21.15.19:0/881444102 wait complete. 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.654+0000 7f7651ad4700 1 Processor -- start 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 -- start start 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 0x7f764c11fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1341d0 0x7f764c120390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c1230c0 con 0x7f764c1341d0 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c06f960 con 0x7f764c1338c0 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f7651ad4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f764c121cf0 con 0x7f764c09e560 2023-10-03T10:17:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f764b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41512/0 (socket says 172.21.15.19:41512) 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f764b7fe700 1 -- 172.21.15.19:0/2432172369 learned_addr learned my addr 172.21.15.19:0/2432172369 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f764bfff700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1341d0 0x7f764c120390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.655+0000 7f764affd700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 0x7f764c11fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 -- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 msgr2=0x7f764c11fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 0x7f764c11fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 -- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1341d0 msgr2=0x7f764c120390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1341d0 0x7f764c120390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 -- 172.21.15.19:0/2432172369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7644009a70 con 0x7f764c09e560 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764affd700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 0x7f764c11fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:40.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f764b7fe700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f763c0090b0 tx=0x7f763c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0044d0 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c01f070 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c0094a0 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0038e0 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.656+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c1222b0 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.657+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f763c003a40 con 0x7f764c09e560 2023-10-03T10:17:40.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.657+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f763c021070 con 0x7f764c09e560 2023-10-03T10:17:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.657+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c122f20 con 0x7f764c09e560 2023-10-03T10:17:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.662+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f764c122f20 con 0x7f764c09e560 2023-10-03T10:17:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.720+0000 7f65457ee700 1 Processor -- start 2023-10-03T10:17:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.720+0000 7f65457ee700 1 -- start start 2023-10-03T10:17:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f65457ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6540130540 0x7f6540130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f65457ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f654006fcf0 0x7f6540138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f65457ee700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400716a0 con 0x7f6540130e50 2023-10-03T10:17:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f65457ee700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654009a390 con 0x7f6540130540 2023-10-03T10:17:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f65457ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6540071290 con 0x7f654006fcf0 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f653effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6540130540 0x7f6540130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f653effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6540130540 0x7f6540130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55084/0 (socket says 172.21.15.19:55084) 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f653effd700 1 -- 172.21.15.19:0/2916915808 learned_addr learned my addr 172.21.15.19:0/2916915808 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.721+0000 7f653e7fc700 1 --1- 172.21.15.19:0/2916915808 >> v1:172.21.15.19:6789/0 conn(0x7f6540130e50 0x7f654006f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54458/0 (socket says 172.21.15.19:54458) 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653f7fe700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f654006fcf0 0x7f6540138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653effd700 1 -- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f654006fcf0 msgr2=0x7f6540138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653effd700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f654006fcf0 0x7f6540138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653effd700 1 -- 172.21.15.19:0/2916915808 >> v1:172.21.15.19:6789/0 conn(0x7f6540130e50 legacy=0x7f654006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653effd700 1 -- 172.21.15.19:0/2916915808 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540130340 con 0x7f6540130540 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653effd700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6540130540 0x7f6540130910 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f653000bb90 tx=0x7f653000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee420aff2abb713d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653dffb700 1 -- 172.21.15.19:0/2916915808 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000dd30 con 0x7f6540130540 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653dffb700 1 -- 172.21.15.19:0/2916915808 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653000de90 con 0x7f6540130540 2023-10-03T10:17:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.722+0000 7f653dffb700 1 -- 172.21.15.19:0/2916915808 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530010690 con 0x7f6540130540 2023-10-03T10:17:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.723+0000 7f65457ee700 1 -- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6540130540 msgr2=0x7f6540130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.723+0000 7f65457ee700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6540130540 0x7f6540130910 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f653000bb90 tx=0x7f653000bea0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 -- 172.21.15.19:0/2916915808 shutdown_connections 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f654006fcf0 0x7f6540138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 --2- 172.21.15.19:0/2916915808 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6540130540 0x7f6540130910 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 -- 172.21.15.19:0/2916915808 >> 172.21.15.19:0/2916915808 conn(0x7f65400a2aa0 msgr2=0x7f65400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 -- 172.21.15.19:0/2916915808 shutdown_connections 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.724+0000 7f65457ee700 1 -- 172.21.15.19:0/2916915808 wait complete. 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.725+0000 7f65457ee700 1 Processor -- start 2023-10-03T10:17:40.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.725+0000 7f65457ee700 1 -- start start 2023-10-03T10:17:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6540130540 0x7f654009b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6540130e50 0x7f654009ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654009dd40 con 0x7f654006fcf0 2023-10-03T10:17:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6540119a10 con 0x7f6540130540 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f65457ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6540119050 con 0x7f6540130e50 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f653effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f653effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55098/0 (socket says 172.21.15.19:55098) 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f653effd700 1 -- 172.21.15.19:0/1305599488 learned_addr learned my addr 172.21.15.19:0/1305599488 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f653e7fc700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6540130540 0x7f654009b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.726+0000 7f653f7fe700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6540130e50 0x7f654009ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 -- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6540130e50 msgr2=0x7f654009ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6540130e50 0x7f654009ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 -- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6540130540 msgr2=0x7f654009b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6540130540 0x7f654009b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 -- 172.21.15.19:0/1305599488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653000b7f0 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f653effd700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f653000d5d0 tx=0x7f65300047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530003b70 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530003cf0 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300106b0 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400718e0 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.727+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654009e460 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.729+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6530024440 con 0x7f654006fcf0 2023-10-03T10:17:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.729+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654009e190 con 0x7f654006fcf0 2023-10-03T10:17:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.729+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6530040e90 con 0x7f654006fcf0 2023-10-03T10:17:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.731+0000 7f7effb43700 1 Processor -- start 2023-10-03T10:17:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.731+0000 7f7effb43700 1 -- start start 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7effb43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7ef809f410 0x7f7ef8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7effb43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7effb43700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef8070940 con 0x7f7ef809e930 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7effb43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef806fd60 con 0x7f7ef809f410 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7effb43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef806fa80 con 0x7f7ef8136fe0 2023-10-03T10:17:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7efe0e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7efe0e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43958/0 (socket says 172.21.15.19:43958) 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2005687075 learned_addr learned my addr 172.21.15.19:0/2005687075 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.732+0000 7f7efd0de700 1 --2- 172.21.15.19:0/2005687075 >> v2:172.21.15.19:3300/0 conn(0x7f7ef809f410 0x7f7ef8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2005687075 >> v2:172.21.15.19:3300/0 conn(0x7f7ef809f410 msgr2=0x7f7ef8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efe0e0700 1 --2- 172.21.15.19:0/2005687075 >> v2:172.21.15.19:3300/0 conn(0x7f7ef809f410 0x7f7ef8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2005687075 >> v1:172.21.15.19:6789/0 conn(0x7f7ef809e930 legacy=0x7f7ef809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2005687075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef809fb60 con 0x7f7ef8136fe0 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efe0e0700 1 --2- 172.21.15.19:0/2005687075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009e50 tx=0x7f7ef000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beeea4c8cf514e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efc8dd700 1 -- 172.21.15.19:0/2005687075 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000e070 con 0x7f7ef8136fe0 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efc8dd700 1 -- 172.21.15.19:0/2005687075 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000b910 con 0x7f7ef8136fe0 2023-10-03T10:17:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.733+0000 7f7efc8dd700 1 -- 172.21.15.19:0/2005687075 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000bcc0 con 0x7f7ef8136fe0 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 -- 172.21.15.19:0/2005687075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 msgr2=0x7f7ef81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 --2- 172.21.15.19:0/2005687075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009e50 tx=0x7f7ef000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 -- 172.21.15.19:0/2005687075 shutdown_connections 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 --2- 172.21.15.19:0/2005687075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef8136fe0 0x7f7ef81393c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 --2- 172.21.15.19:0/2005687075 >> v2:172.21.15.19:3300/0 conn(0x7f7ef809f410 0x7f7ef8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.734+0000 7f7effb43700 1 -- 172.21.15.19:0/2005687075 >> 172.21.15.19:0/2005687075 conn(0x7f7ef80a4210 msgr2=0x7f7ef80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.735+0000 7f7effb43700 1 -- 172.21.15.19:0/2005687075 shutdown_connections 2023-10-03T10:17:40.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.735+0000 7f7effb43700 1 -- 172.21.15.19:0/2005687075 wait complete. 2023-10-03T10:17:40.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.735+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6530003e60 con 0x7f654006fcf0 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 Processor -- start 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 -- start start 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ef809e930 0x7f7ef811c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef809f410 0x7f7ef811ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8071db0 con 0x7f7ef809e930 2023-10-03T10:17:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef809df70 con 0x7f7ef809f410 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.736+0000 7f7effb43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef811f820 con 0x7f7ef8136fe0 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41544/0 (socket says 172.21.15.19:41544) 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2086786215 learned_addr learned my addr 172.21.15.19:0/2086786215 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efd8df700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ef809e930 0x7f7ef811c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef809f410 msgr2=0x7f7ef811ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef809f410 0x7f7ef811ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ef809e930 msgr2=0x7f7ef811c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ef809e930 0x7f7ef811c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 -- 172.21.15.19:0/2086786215 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009b30 con 0x7f7ef8136fe0 2023-10-03T10:17:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.737+0000 7f7efe0e0700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000b680 tx=0x7f7ef0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.739+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0004450 con 0x7f7ef8136fe0 2023-10-03T10:17:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.739+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef00045b0 con 0x7f7ef8136fe0 2023-10-03T10:17:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.739+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef811e9c0 con 0x7f7ef8136fe0 2023-10-03T10:17:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.739+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0004960 con 0x7f7ef8136fe0 2023-10-03T10:17:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.739+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8120800 con 0x7f7ef8136fe0 2023-10-03T10:17:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.740+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ef0025460 con 0x7f7ef8136fe0 2023-10-03T10:17:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.740+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ef0041410 con 0x7f7ef8136fe0 2023-10-03T10:17:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.740+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef811fa30 con 0x7f7ef8136fe0 2023-10-03T10:17:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.745+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ef002a070 con 0x7f7ef8136fe0 2023-10-03T10:17:40.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.905+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fe0072210 con 0x7f0fe006ffd0 2023-10-03T10:17:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.906+0000 7f0fc77fe700 1 -- 172.21.15.19:0/1657314761 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0fd4021070 con 0x7f0fe006ffd0 2023-10-03T10:17:40.906 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 msgr2=0x7f0fe011f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe011f450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0fd400e8d0 tx=0x7f0fd400ebe0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 shutdown_connections 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0fe0130670 0x7f0fe011f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0fe006f680 0x7f0fe011ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 --2- 172.21.15.19:0/1657314761 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0fe006ffd0 0x7f0fe011f450 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 >> 172.21.15.19:0/1657314761 conn(0x7f0fe00a2aa0 msgr2=0x7f0fe00a0700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 shutdown_connections 2023-10-03T10:17:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.908+0000 7f0fe5373700 1 -- 172.21.15.19:0/1657314761 wait complete. 2023-10-03T10:17:40.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.918+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f764c122f20 con 0x7f764c09e560 2023-10-03T10:17:40.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.918+0000 7f7633fff700 1 -- 172.21.15.19:0/2432172369 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f764c122f20 con 0x7f764c09e560 2023-10-03T10:17:40.918 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 msgr2=0x7f764c11f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f763c0090b0 tx=0x7f763c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 shutdown_connections 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f764c1341d0 0x7f764c120390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f764c09e560 0x7f764c11f910 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 --2- 172.21.15.19:0/2432172369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f764c1338c0 0x7f764c11fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 >> 172.21.15.19:0/2432172369 conn(0x7f764c0a2aa0 msgr2=0x7f764c09f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 shutdown_connections 2023-10-03T10:17:40.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.921+0000 7f7651ad4700 1 -- 172.21.15.19:0/2432172369 wait complete. 2023-10-03T10:17:40.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:40.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:40.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.970+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6540074ea0 con 0x7f654006fcf0 2023-10-03T10:17:40.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.970+0000 7f65277fe700 1 -- 172.21.15.19:0/1305599488 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f653000f3d0 con 0x7f654006fcf0 2023-10-03T10:17:40.970 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 msgr2=0x7f654009af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f653000d5d0 tx=0x7f65300047c0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 shutdown_connections 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6540130e50 0x7f654009ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f654006fcf0 0x7f654009af80 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 --2- 172.21.15.19:0/1305599488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6540130540 0x7f654009b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 >> 172.21.15.19:0/1305599488 conn(0x7f65400a2aa0 msgr2=0x7f654012d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 shutdown_connections 2023-10-03T10:17:40.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.972+0000 7f65457ee700 1 -- 172.21.15.19:0/1305599488 wait complete. 2023-10-03T10:17:40.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:40.999+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ef8074ea0 con 0x7f7ef8136fe0 2023-10-03T10:17:40.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.000+0000 7f7eee7fc700 1 -- 172.21.15.19:0/2086786215 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ef00117a0 con 0x7f7ef8136fe0 2023-10-03T10:17:40.999 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 msgr2=0x7f7ef811cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000b680 tx=0x7f7ef0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 shutdown_connections 2023-10-03T10:17:41.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ef8136fe0 0x7f7ef811cfd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ef809e930 0x7f7ef811c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 --2- 172.21.15.19:0/2086786215 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ef809f410 0x7f7ef811ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 >> 172.21.15.19:0/2086786215 conn(0x7f7ef80a4210 msgr2=0x7f7ef8134ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 shutdown_connections 2023-10-03T10:17:41.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:41.002+0000 7f7effb43700 1 -- 172.21.15.19:0/2086786215 wait complete. 2023-10-03T10:17:41.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:41.924 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:41.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:41.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:42.016 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 Processor -- start 2023-10-03T10:17:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 -- start start 2023-10-03T10:17:42.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db806fef0 con 0x7f8db81338a0 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db806ef30 con 0x7f8db809de50 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.076+0000 7f8dbfde6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81334b0 con 0x7f8db809e760 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbdb82700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbdb82700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55116/0 (socket says 172.21.15.19:55116) 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbdb82700 1 -- 172.21.15.19:0/546154856 learned_addr learned my addr 172.21.15.19:0/546154856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 -- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 msgr2=0x7f8db813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 -- 172.21.15.19:0/546154856 >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 msgr2=0x7f8db8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 --2- 172.21.15.19:0/546154856 >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 -- 172.21.15.19:0/546154856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db806fc30 con 0x7f8db809de50 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbdb82700 1 --2- 172.21.15.19:0/546154856 >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.077+0000 7f8dbd381700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db809e220 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009840 tx=0x7f8da8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9d215dc97ede937 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbcb80700 1 -- 172.21.15.19:0/546154856 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8011830 con 0x7f8db809de50 2023-10-03T10:17:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbcb80700 1 -- 172.21.15.19:0/546154856 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da8011990 con 0x7f8db809de50 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbcb80700 1 -- 172.21.15.19:0/546154856 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da8011d20 con 0x7f8db809de50 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbfde6700 1 -- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 msgr2=0x7f8db809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db809e220 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8da8009840 tx=0x7f8da8009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.078+0000 7f8dbfde6700 1 -- 172.21.15.19:0/546154856 shutdown_connections 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/546154856 >> v2:172.21.15.19:3300/0 conn(0x7f8db81338a0 0x7f8db8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/546154856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db809e220 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 -- 172.21.15.19:0/546154856 >> 172.21.15.19:0/546154856 conn(0x7f8db80a2aa0 msgr2=0x7f8db80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 -- 172.21.15.19:0/546154856 shutdown_connections 2023-10-03T10:17:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.079+0000 7f8dbfde6700 1 -- 172.21.15.19:0/546154856 wait complete. 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.080+0000 7f8dbfde6700 1 Processor -- start 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 -- start start 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db811eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db811f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 0x7f8db811f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db811ff70 con 0x7f8db81338a0 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db8122030 con 0x7f8db809de50 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.081+0000 7f8dbfde6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8db812f640 con 0x7f8db809e760 2023-10-03T10:17:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbdb82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db811eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbdb82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db811eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43986/0 (socket says 172.21.15.19:43986) 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbdb82700 1 -- 172.21.15.19:0/339807872 learned_addr learned my addr 172.21.15.19:0/339807872 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 0x7f8db811f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbd381700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db811f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 -- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 msgr2=0x7f8db811f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db811f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 -- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 msgr2=0x7f8db811eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db811eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 -- 172.21.15.19:0/339807872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009550 con 0x7f8db81338a0 2023-10-03T10:17:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.082+0000 7f8dbe383700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 0x7f8db811f5b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8db000be50 tx=0x7f8db0009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.083+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000cb90 con 0x7f8db81338a0 2023-10-03T10:17:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.083+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000cd10 con 0x7f8db81338a0 2023-10-03T10:17:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.083+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da80094a0 con 0x7f8db81338a0 2023-10-03T10:17:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.083+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0014680 con 0x7f8db81338a0 2023-10-03T10:17:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.083+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db81207d0 con 0x7f8db81338a0 2023-10-03T10:17:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.084+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db8074ea0 con 0x7f8db81338a0 2023-10-03T10:17:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.084+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8db001d3b0 con 0x7f8db81338a0 2023-10-03T10:17:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.084+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8db0006e40 con 0x7f8db81338a0 2023-10-03T10:17:42.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.093+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8db001c360 con 0x7f8db81338a0 2023-10-03T10:17:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.116+0000 7f86d4b86700 1 Processor -- start 2023-10-03T10:17:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.116+0000 7f86d4b86700 1 -- start start 2023-10-03T10:17:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86d4b86700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 0x7f86d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86d4b86700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009e000 0x7f86d01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86d4b86700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d009b120 con 0x7f86d009e410 2023-10-03T10:17:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86d4b86700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d006b460 con 0x7f86d009e000 2023-10-03T10:17:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86d4b86700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86d009a7e0 con 0x7f86d009d6f0 2023-10-03T10:17:42.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86cdd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009e000 0x7f86d01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86ced9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f86d009e410 0x7f86d0133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54472/0 (socket says 172.21.15.19:54472) 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86ced9d700 1 -- 172.21.15.19:0/897995225 learned_addr learned my addr 172.21.15.19:0/897995225 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.117+0000 7f86ce59c700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 0x7f86d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86ce59c700 1 -- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009e000 msgr2=0x7f86d01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86cd59a700 1 -- 172.21.15.19:0/897995225 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530296977 0 0) 0x7f86d009b120 con 0x7f86d009e410 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86ce59c700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009e000 0x7f86d01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86ce59c700 1 -- 172.21.15.19:0/897995225 >> v1:172.21.15.19:6789/0 conn(0x7f86d009e410 legacy=0x7f86d0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86ce59c700 1 -- 172.21.15.19:0/897995225 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d009a500 con 0x7f86d009d6f0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86ce59c700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 0x7f86d009dac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86c00098a0 tx=0x7f86c0009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=814c8a960b0d2188 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86cd59a700 1 -- 172.21.15.19:0/897995225 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0011830 con 0x7f86d009d6f0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86cd59a700 1 -- 172.21.15.19:0/897995225 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c0011990 con 0x7f86d009d6f0 2023-10-03T10:17:42.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.118+0000 7f86cd59a700 1 -- 172.21.15.19:0/897995225 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0011d20 con 0x7f86d009d6f0 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.119+0000 7f86d4b86700 1 -- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 msgr2=0x7f86d009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.119+0000 7f86d4b86700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 0x7f86d009dac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f86c00098a0 tx=0x7f86c0009bb0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.119+0000 7f86d4b86700 1 -- 172.21.15.19:0/897995225 shutdown_connections 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.119+0000 7f86d4b86700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009d6f0 0x7f86d009dac0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.119+0000 7f86d4b86700 1 --2- 172.21.15.19:0/897995225 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009e000 0x7f86d01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.120+0000 7f86d4b86700 1 -- 172.21.15.19:0/897995225 >> 172.21.15.19:0/897995225 conn(0x7f86d0066f50 msgr2=0x7f86d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.120+0000 7f86d4b86700 1 -- 172.21.15.19:0/897995225 shutdown_connections 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.120+0000 7f86d4b86700 1 -- 172.21.15.19:0/897995225 wait complete. 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 Processor -- start 2023-10-03T10:17:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 -- start start 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009e000 0x7f86d01c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86d009e410 0x7f86d01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01a72e0 con 0x7f86d009e410 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01c5ad0 con 0x7f86d009d6f0 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.121+0000 7f86d4b86700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86d01a9820 con 0x7f86d009e000 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44010/0 (socket says 172.21.15.19:44010) 2023-10-03T10:17:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 -- 172.21.15.19:0/4255553516 learned_addr learned my addr 172.21.15.19:0/4255553516 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ced9d700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86d009e410 0x7f86d01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86cdd9b700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009e000 0x7f86d01c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 -- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009e000 msgr2=0x7f86d01c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009e000 0x7f86d01c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 -- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86d009e410 msgr2=0x7f86d01c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86d009e410 0x7f86d01c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 -- 172.21.15.19:0/4255553516 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00094a0 con 0x7f86d009d6f0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.122+0000 7f86ce59c700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f86c00097c0 tx=0x7f86c0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.123+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0004450 con 0x7f86d009d6f0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.123+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c001f070 con 0x7f86d009d6f0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.123+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00a3040 con 0x7f86d009d6f0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.123+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00038e0 con 0x7f86d009d6f0 2023-10-03T10:17:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.123+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d01a7910 con 0x7f86d009d6f0 2023-10-03T10:17:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.124+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d0074ea0 con 0x7f86d009d6f0 2023-10-03T10:17:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.125+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86c0003a40 con 0x7f86d009d6f0 2023-10-03T10:17:42.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.125+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86c0021070 con 0x7f86d009d6f0 2023-10-03T10:17:42.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.134+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86c00045b0 con 0x7f86d009d6f0 2023-10-03T10:17:42.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.171+0000 7f4ba5f4d700 1 Processor -- start 2023-10-03T10:17:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.171+0000 7f4ba5f4d700 1 -- start start 2023-10-03T10:17:42.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.171+0000 7f4ba5f4d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ba00a1510 0x7f4ba013d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.171+0000 7f4ba5f4d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4ba5f4d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba009d920 con 0x7f4ba00a0a30 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4ba5f4d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba009d020 con 0x7f4ba00a1510 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4ba5f4d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a2010 con 0x7f4ba013d650 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41586/0 (socket says 172.21.15.19:41586) 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 -- 172.21.15.19:0/2912106159 learned_addr learned my addr 172.21.15.19:0/2912106159 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9effd700 1 --2- 172.21.15.19:0/2912106159 >> v2:172.21.15.19:3300/0 conn(0x7f4ba00a1510 0x7f4ba013d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 -- 172.21.15.19:0/2912106159 >> v2:172.21.15.19:3300/0 conn(0x7f4ba00a1510 msgr2=0x7f4ba013d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 --2- 172.21.15.19:0/2912106159 >> v2:172.21.15.19:3300/0 conn(0x7f4ba00a1510 0x7f4ba013d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 -- 172.21.15.19:0/2912106159 >> v1:172.21.15.19:6789/0 conn(0x7f4ba00a0a30 legacy=0x7f4ba00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 -- 172.21.15.19:0/2912106159 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba009dbe0 con 0x7f4ba013d650 2023-10-03T10:17:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.172+0000 7f4b9ffff700 1 --2- 172.21.15.19:0/2912106159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009e50 tx=0x7f4b9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f917019ec690dbb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4b9e7fc700 1 -- 172.21.15.19:0/2912106159 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800e070 con 0x7f4ba013d650 2023-10-03T10:17:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4b9e7fc700 1 -- 172.21.15.19:0/2912106159 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9800b9c0 con 0x7f4ba013d650 2023-10-03T10:17:42.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4b9e7fc700 1 -- 172.21.15.19:0/2912106159 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800bd70 con 0x7f4ba013d650 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/2912106159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 msgr2=0x7f4ba013fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/2912106159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009e50 tx=0x7f4b9800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/2912106159 shutdown_connections 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/2912106159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba013fa30 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/2912106159 >> v2:172.21.15.19:3300/0 conn(0x7f4ba00a1510 0x7f4ba013d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.173+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/2912106159 >> 172.21.15.19:0/2912106159 conn(0x7f4ba00a6550 msgr2=0x7f4ba00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.174+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/2912106159 shutdown_connections 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.174+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/2912106159 wait complete. 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 Processor -- start 2023-10-03T10:17:42.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 -- start start 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 0x7f4ba0125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a1510 0x7f4ba01263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009ff90 con 0x7f4ba00a1510 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a49a0 con 0x7f4ba00a0a30 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4ba5f4d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0127ab0 con 0x7f4ba013d650 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.175+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41602/0 (socket says 172.21.15.19:41602) 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 -- 172.21.15.19:0/4254771640 learned_addr learned my addr 172.21.15.19:0/4254771640 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9effd700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a1510 0x7f4ba01263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9f7fe700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 0x7f4ba0125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 -- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 msgr2=0x7f4ba0125ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 0x7f4ba0125ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 -- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a1510 msgr2=0x7f4ba01263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a1510 0x7f4ba01263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 -- 172.21.15.19:0/4254771640 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98009b30 con 0x7f4ba013d650 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9f7fe700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 0x7f4ba0125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b9ffff700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4b98012000 tx=0x7f4b98004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980048b0 con 0x7f4ba013d650 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b980099b0 con 0x7f4ba013d650 2023-10-03T10:17:42.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba0129780 con 0x7f4ba013d650 2023-10-03T10:17:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9801c680 con 0x7f4ba013d650 2023-10-03T10:17:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.176+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba01282a0 con 0x7f4ba013d650 2023-10-03T10:17:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.178+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9801c7e0 con 0x7f4ba013d650 2023-10-03T10:17:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.178+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b98040e40 con 0x7f4ba013d650 2023-10-03T10:17:42.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.178+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba0071e20 con 0x7f4ba013d650 2023-10-03T10:17:42.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.183+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b98023930 con 0x7f4ba013d650 2023-10-03T10:17:42.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.224+0000 7f7a9667b700 1 Processor -- start 2023-10-03T10:17:42.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.224+0000 7f7a9667b700 1 -- start start 2023-10-03T10:17:42.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a9667b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7a9009f410 0x7f7a90136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a9667b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a9667b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a90070940 con 0x7f7a9009e930 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a9667b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a9006fd60 con 0x7f7a9009f410 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a9667b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9006fa80 con 0x7f7a90136fe0 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44022/0 (socket says 172.21.15.19:44022) 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 -- 172.21.15.19:0/3317043207 learned_addr learned my addr 172.21.15.19:0/3317043207 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a8f7fe700 1 --2- 172.21.15.19:0/3317043207 >> v2:172.21.15.19:3300/0 conn(0x7f7a9009f410 0x7f7a90136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 -- 172.21.15.19:0/3317043207 >> v2:172.21.15.19:3300/0 conn(0x7f7a9009f410 msgr2=0x7f7a90136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 --2- 172.21.15.19:0/3317043207 >> v2:172.21.15.19:3300/0 conn(0x7f7a9009f410 0x7f7a90136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 -- 172.21.15.19:0/3317043207 >> v1:172.21.15.19:6789/0 conn(0x7f7a9009e930 legacy=0x7f7a9009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 -- 172.21.15.19:0/3317043207 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9009fb60 con 0x7f7a90136fe0 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.225+0000 7f7a94c18700 1 --2- 172.21.15.19:0/3317043207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009e50 tx=0x7f7a8800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d681a387d82b49d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a8effd700 1 -- 172.21.15.19:0/3317043207 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88003c20 con 0x7f7a90136fe0 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a8effd700 1 -- 172.21.15.19:0/3317043207 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a88003d80 con 0x7f7a90136fe0 2023-10-03T10:17:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a8effd700 1 -- 172.21.15.19:0/3317043207 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800bb10 con 0x7f7a90136fe0 2023-10-03T10:17:42.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 -- 172.21.15.19:0/3317043207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 msgr2=0x7f7a901393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 --2- 172.21.15.19:0/3317043207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7a88009e50 tx=0x7f7a8800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:42.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 -- 172.21.15.19:0/3317043207 shutdown_connections 2023-10-03T10:17:42.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 --2- 172.21.15.19:0/3317043207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a901393c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 --2- 172.21.15.19:0/3317043207 >> v2:172.21.15.19:3300/0 conn(0x7f7a9009f410 0x7f7a90136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.226+0000 7f7a9667b700 1 -- 172.21.15.19:0/3317043207 >> 172.21.15.19:0/3317043207 conn(0x7f7a900a4210 msgr2=0x7f7a900a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.227+0000 7f7a9667b700 1 -- 172.21.15.19:0/3317043207 shutdown_connections 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.227+0000 7f7a9667b700 1 -- 172.21.15.19:0/3317043207 wait complete. 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.227+0000 7f7a9667b700 1 Processor -- start 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 -- start start 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 0x7f7a9011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a9009f410 0x7f7a9011abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a9011b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9011cd10 con 0x7f7a9009f410 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9011c500 con 0x7f7a90136fe0 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a9667b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9006d6b0 con 0x7f7a9009e930 2023-10-03T10:17:42.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 0x7f7a9011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a8ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 0x7f7a9011a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41614/0 (socket says 172.21.15.19:41614) 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.228+0000 7f7a8ffff700 1 -- 172.21.15.19:0/1870123341 learned_addr learned my addr 172.21.15.19:0/1870123341 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a9011b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 -- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 msgr2=0x7f7a9011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 0x7f7a9011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 -- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a9009f410 msgr2=0x7f7a9011abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a9009f410 0x7f7a9011abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 -- 172.21.15.19:0/1870123341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a88009b30 con 0x7f7a90136fe0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a94c18700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a9011b100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7a88018000 tx=0x7f7a88004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004230 con 0x7f7a90136fe0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a880043b0 con 0x7f7a90136fe0 2023-10-03T10:17:42.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.229+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a88004760 con 0x7f7a90136fe0 2023-10-03T10:17:42.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.230+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9011de90 con 0x7f7a90136fe0 2023-10-03T10:17:42.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.230+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9011dbb0 con 0x7f7a90136fe0 2023-10-03T10:17:42.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.231+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a880104d0 con 0x7f7a90136fe0 2023-10-03T10:17:42.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.231+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9011d850 con 0x7f7a90136fe0 2023-10-03T10:17:42.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.231+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a88044e70 con 0x7f7a90136fe0 2023-10-03T10:17:42.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.240+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a9011d850 con 0x7f7a90136fe0 2023-10-03T10:17:42.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.314+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8db806b9e0 con 0x7f8db81338a0 2023-10-03T10:17:42.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.314+0000 7f8dae7fc700 1 -- 172.21.15.19:0/339807872 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8db0019030 con 0x7f8db81338a0 2023-10-03T10:17:42.314 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 msgr2=0x7f8db811f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 0x7f8db811f5b0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8db000be50 tx=0x7f8db0009ed0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 shutdown_connections 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8db81338a0 0x7f8db811f5b0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8db809de50 0x7f8db811eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 --2- 172.21.15.19:0/339807872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8db809e760 0x7f8db811f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.317+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 >> 172.21.15.19:0/339807872 conn(0x7f8db80a2aa0 msgr2=0x7f8db809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.318+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 shutdown_connections 2023-10-03T10:17:42.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.318+0000 7f8dbfde6700 1 -- 172.21.15.19:0/339807872 wait complete. 2023-10-03T10:17:42.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:42.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.351+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86d006c360 con 0x7f86d009d6f0 2023-10-03T10:17:42.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.351+0000 7f86beffd700 1 -- 172.21.15.19:0/4255553516 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86c0015020 con 0x7f86d009d6f0 2023-10-03T10:17:42.351 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 msgr2=0x7f86d01c5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f86c00097c0 tx=0x7f86c0004750 comp rx=0 tx=0).stop 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 shutdown_connections 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86d009e410 0x7f86d01c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86d009d6f0 0x7f86d01c5050 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 --2- 172.21.15.19:0/4255553516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86d009e000 0x7f86d01c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 >> 172.21.15.19:0/4255553516 conn(0x7f86d0066f50 msgr2=0x7f86d01bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 shutdown_connections 2023-10-03T10:17:42.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.354+0000 7f86d4b86700 1 -- 172.21.15.19:0/4255553516 wait complete. 2023-10-03T10:17:42.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.407+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ba0074ea0 con 0x7f4ba013d650 2023-10-03T10:17:42.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.408+0000 7f4b87fff700 1 -- 172.21.15.19:0/4254771640 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b98034090 con 0x7f4ba013d650 2023-10-03T10:17:42.408 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 msgr2=0x7f4ba0126920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4b98012000 tx=0x7f4b98004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 shutdown_connections 2023-10-03T10:17:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba013d650 0x7f4ba0126920 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba00a0a30 0x7f4ba0125ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 --2- 172.21.15.19:0/4254771640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a1510 0x7f4ba01263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 >> 172.21.15.19:0/4254771640 conn(0x7f4ba00a6550 msgr2=0x7f4ba00a2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 shutdown_connections 2023-10-03T10:17:42.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.410+0000 7f4ba5f4d700 1 -- 172.21.15.19:0/4254771640 wait complete. 2023-10-03T10:17:42.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.449+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7a9011d850 con 0x7f7a90136fe0 2023-10-03T10:17:42.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.450+0000 7f7a8cff9700 1 -- 172.21.15.19:0/1870123341 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a9011d850 con 0x7f7a90136fe0 2023-10-03T10:17:42.450 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 msgr2=0x7f7a9011b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a9011b100 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7a88018000 tx=0x7f7a88004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 shutdown_connections 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a90136fe0 0x7f7a9011b100 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a9009e930 0x7f7a9011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 --2- 172.21.15.19:0/1870123341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a9009f410 0x7f7a9011abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 >> 172.21.15.19:0/1870123341 conn(0x7f7a900a4210 msgr2=0x7f7a900a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 shutdown_connections 2023-10-03T10:17:42.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:42.452+0000 7f7a9667b700 1 -- 172.21.15.19:0/1870123341 wait complete. 2023-10-03T10:17:42.465 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:43.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:43.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:43.424 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:43.465 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.481+0000 7ff51d3f5700 1 Processor -- start 2023-10-03T10:17:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.481+0000 7ff51d3f5700 1 -- start start 2023-10-03T10:17:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5181338a0 0x7ff518133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff51809de50 0x7ff51809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809e760 0x7ff51813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51806fef0 con 0x7ff51809de50 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51806ef30 con 0x7ff5181338a0 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff51d3f5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181334b0 con 0x7ff51809e760 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff5167fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff51809de50 0x7ff51809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff5167fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff51809de50 0x7ff51809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55162/0 (socket says 172.21.15.19:55162) 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff5167fc700 1 -- 172.21.15.19:0/3515137649 learned_addr learned my addr 172.21.15.19:0/3515137649 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff5177fe700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809e760 0x7ff51813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.482+0000 7ff516ffd700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5181338a0 0x7ff518133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 -- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809e760 msgr2=0x7ff51813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809e760 0x7ff51813a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 -- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5181338a0 msgr2=0x7ff518133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5181338a0 0x7ff518133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 -- 172.21.15.19:0/3515137649 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51806fc30 con 0x7ff51809de50 2023-10-03T10:17:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff5167fc700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff51809de50 0x7ff51809e220 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098f0 tx=0x7ff50c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62b07d20d7476ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff515ffb700 1 -- 172.21.15.19:0/3515137649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011830 con 0x7ff51809de50 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff515ffb700 1 -- 172.21.15.19:0/3515137649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c011990 con 0x7ff51809de50 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.483+0000 7ff515ffb700 1 -- 172.21.15.19:0/3515137649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011d20 con 0x7ff51809de50 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 -- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff51809de50 msgr2=0x7ff51809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff51809de50 0x7ff51809e220 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098f0 tx=0x7ff50c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 -- 172.21.15.19:0/3515137649 shutdown_connections 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5181338a0 0x7ff518133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809e760 0x7ff51813a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/3515137649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff51809de50 0x7ff51809e220 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 -- 172.21.15.19:0/3515137649 >> 172.21.15.19:0/3515137649 conn(0x7ff5180a2aa0 msgr2=0x7ff5180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 -- 172.21.15.19:0/3515137649 shutdown_connections 2023-10-03T10:17:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.484+0000 7ff51d3f5700 1 -- 172.21.15.19:0/3515137649 wait complete. 2023-10-03T10:17:43.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.486+0000 7ff51d3f5700 1 Processor -- start 2023-10-03T10:17:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.486+0000 7ff51d3f5700 1 -- start start 2023-10-03T10:17:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff51809e760 0x7ff51811bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5181338a0 0x7ff51811c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51811f300 con 0x7ff5181338a0 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51811da10 con 0x7ff51809e760 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff51d3f5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff51811e6d0 con 0x7ff51809de50 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff516ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff516ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41632/0 (socket says 172.21.15.19:41632) 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff516ffd700 1 -- 172.21.15.19:0/1070427797 learned_addr learned my addr 172.21.15.19:0/1070427797 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff5177fe700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5181338a0 0x7ff51811c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.487+0000 7ff5167fc700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff51809e760 0x7ff51811bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 -- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff51809e760 msgr2=0x7ff51811bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff51809e760 0x7ff51811bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 -- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5181338a0 msgr2=0x7ff51811c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5181338a0 0x7ff51811c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 -- 172.21.15.19:0/1070427797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50c009550 con 0x7ff51809de50 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff516ffd700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b3f0 tx=0x7ff50800b700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508019070 con 0x7ff51809de50 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800be70 con 0x7ff51809de50 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51811ea90 con 0x7ff51809de50 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508014af0 con 0x7ff51809de50 2023-10-03T10:17:43.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.488+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51806f690 con 0x7ff51809de50 2023-10-03T10:17:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.489+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff50801d610 con 0x7ff51809de50 2023-10-03T10:17:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.490+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff518071da0 con 0x7ff51809de50 2023-10-03T10:17:43.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.490+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5080472a0 con 0x7ff51809de50 2023-10-03T10:17:43.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.495+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff50801b720 con 0x7ff51809de50 2023-10-03T10:17:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.524+0000 7f1197435700 1 Processor -- start 2023-10-03T10:17:43.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 -- start start 2023-10-03T10:17:43.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f119006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f119009eca0 0x7f119006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1190134610 0x7f1190134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1190070ee0 con 0x7f1190134610 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1190071480 con 0x7f119009eca0 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f1197435700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f119006f3c0 con 0x7f119006e570 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.525+0000 7f11959d2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1190134610 0x7f1190134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1190134610 0x7f1190134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55174/0 (socket says 172.21.15.19:55174) 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 -- 172.21.15.19:0/1843645535 learned_addr learned my addr 172.21.15.19:0/1843645535 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11949d0700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f119009eca0 0x7f119006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11951d1700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f119006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 -- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 msgr2=0x7f119006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f119006e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 -- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f119009eca0 msgr2=0x7f119006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f119009eca0 0x7f119006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 -- 172.21.15.19:0/1843645535 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190071b90 con 0x7f1190134610 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f11959d2700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1190134610 0x7f1190134ab0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1188009e50 tx=0x7f118800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49173133ff1569c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.526+0000 7f1187fff700 1 -- 172.21.15.19:0/1843645535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800e070 con 0x7f1190134610 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1187fff700 1 -- 172.21.15.19:0/1843645535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800b910 con 0x7f1190134610 2023-10-03T10:17:43.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1187fff700 1 -- 172.21.15.19:0/1843645535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800bcc0 con 0x7f1190134610 2023-10-03T10:17:43.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 -- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1190134610 msgr2=0x7f1190134ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1190134610 0x7f1190134ab0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f1188009e50 tx=0x7f118800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:43.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 -- 172.21.15.19:0/1843645535 shutdown_connections 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1190134610 0x7f1190134ab0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f119006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 --2- 172.21.15.19:0/1843645535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f119009eca0 0x7f119006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.527+0000 7f1197435700 1 -- 172.21.15.19:0/1843645535 >> 172.21.15.19:0/1843645535 conn(0x7f11900a2aa0 msgr2=0x7f11900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.528+0000 7f1197435700 1 -- 172.21.15.19:0/1843645535 shutdown_connections 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.528+0000 7f1197435700 1 -- 172.21.15.19:0/1843645535 wait complete. 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 Processor -- start 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 -- start start 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f1190127640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 0x7f11901264f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190070610 con 0x7f119013de10 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119013d630 con 0x7f1190134610 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f1197435700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f119013e600 con 0x7f119006e570 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f11949d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f11959d2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 0x7f11901264f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f11949d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44068/0 (socket says 172.21.15.19:44068) 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f11959d2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 0x7f11901264f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55186/0 (socket says 172.21.15.19:55186) 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.529+0000 7f11949d0700 1 -- 172.21.15.19:0/1999427938 learned_addr learned my addr 172.21.15.19:0/1999427938 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11951d1700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f1190127640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 -- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 msgr2=0x7f1190127640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f1190127640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 -- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 msgr2=0x7f11901264f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 0x7f11901264f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 -- 172.21.15.19:0/1999427938 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009b30 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f11949d0700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f118000e9b0 tx=0x7f118000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800096b0 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118000ee50 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119013bfb0 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.530+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000c9f0 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.531+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190127b80 con 0x7f1190134610 2023-10-03T10:17:43.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.532+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119013d770 con 0x7f1190134610 2023-10-03T10:17:43.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.535+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f118000cb50 con 0x7f1190134610 2023-10-03T10:17:43.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.536+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f118003fd10 con 0x7f1190134610 2023-10-03T10:17:43.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.544+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f118000ce00 con 0x7f1190134610 2023-10-03T10:17:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.588+0000 7fb7fb2cf700 1 Processor -- start 2023-10-03T10:17:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.588+0000 7fb7fb2cf700 1 -- start start 2023-10-03T10:17:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7fb2cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f4138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7fb2cf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7f4138dc0 0x7fb7f413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7fb2cf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f406b990 con 0x7fb7f4133420 2023-10-03T10:17:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7fb2cf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f409b0e0 con 0x7fb7f4138dc0 2023-10-03T10:17:43.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7fb2cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4133c20 con 0x7fb7f41337f0 2023-10-03T10:17:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7f906b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb7f4133420 0x7fb7f4133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54514/0 (socket says 172.21.15.19:54514) 2023-10-03T10:17:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7f906b700 1 -- 172.21.15.19:0/3734853940 learned_addr learned my addr 172.21.15.19:0/3734853940 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7f986c700 1 --2- 172.21.15.19:0/3734853940 >> v2:172.21.15.19:3300/0 conn(0x7fb7f4138dc0 0x7fb7f413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.589+0000 7fb7f886a700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f4138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7f986c700 1 -- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 msgr2=0x7fb7f4138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7f986c700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f4138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7f986c700 1 -- 172.21.15.19:0/3734853940 >> v1:172.21.15.19:6789/0 conn(0x7fb7f4133420 legacy=0x7fb7f4133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7f986c700 1 -- 172.21.15.19:0/3734853940 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40a0590 con 0x7fb7f4138dc0 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7f986c700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4138dc0 0x7fb7f413b1a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc156b64d4288850 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7ebfff700 1 -- 172.21.15.19:0/3734853940 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00e070 con 0x7fb7f4138dc0 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7ebfff700 1 -- 172.21.15.19:0/3734853940 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00bb20 con 0x7fb7f4138dc0 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.590+0000 7fb7ebfff700 1 -- 172.21.15.19:0/3734853940 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec012430 con 0x7fb7f4138dc0 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4138dc0 msgr2=0x7fb7f413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4138dc0 0x7fb7f413b1a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/3734853940 shutdown_connections 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4138dc0 0x7fb7f413b1a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/3734853940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f4138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/3734853940 >> 172.21.15.19:0/3734853940 conn(0x7fb7f40a4210 msgr2=0x7fb7f40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/3734853940 shutdown_connections 2023-10-03T10:17:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.591+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/3734853940 wait complete. 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 Processor -- start 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 -- start start 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4133420 0x7fb7f409c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7f4138dc0 0x7fb7f409d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4130460 con 0x7fb7f4133420 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f409e1f0 con 0x7fb7f41337f0 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.593+0000 7fb7fb2cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f412f250 con 0x7fb7f4138dc0 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44076/0 (socket says 172.21.15.19:44076) 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 -- 172.21.15.19:0/1374919370 learned_addr learned my addr 172.21.15.19:0/1374919370 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f906b700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4133420 0x7fb7f409c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 -- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7f4138dc0 msgr2=0x7fb7f409d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7f4138dc0 0x7fb7f409d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 -- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4133420 msgr2=0x7fb7f409c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4133420 0x7fb7f409c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 -- 172.21.15.19:0/1374919370 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009a70 con 0x7fb7f41337f0 2023-10-03T10:17:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7f886a700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400e9b0 tx=0x7fb7e400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4009710 con 0x7fb7f41337f0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400c850 con 0x7fb7f41337f0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f4130a20 con 0x7fb7f41337f0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.594+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400cbc0 con 0x7fb7f41337f0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.595+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f412f5c0 con 0x7fb7f41337f0 2023-10-03T10:17:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.596+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f4074ea0 con 0x7fb7f41337f0 2023-10-03T10:17:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.597+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7e400cd20 con 0x7fb7f41337f0 2023-10-03T10:17:43.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.597+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7e403f990 con 0x7fb7f41337f0 2023-10-03T10:17:43.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.605+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7e401be10 con 0x7fb7f41337f0 2023-10-03T10:17:43.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.640+0000 7fb9db04f700 1 Processor -- start 2023-10-03T10:17:43.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.640+0000 7fb9db04f700 1 -- start start 2023-10-03T10:17:43.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9db04f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9d409d630 0x7fb9d40a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9db04f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d4138d80 0x7fb9d413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9db04f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d40a2a70 con 0x7fb9d40a0a30 2023-10-03T10:17:43.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9db04f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d40a01d0 con 0x7fb9d409d630 2023-10-03T10:17:43.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9db04f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d409e2b0 con 0x7fb9d4138d80 2023-10-03T10:17:43.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9d3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9d409d630 0x7fb9d40a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9d8deb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb9d40a0a30 0x7fb9d40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54526/0 (socket says 172.21.15.19:54526) 2023-10-03T10:17:43.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.641+0000 7fb9d8deb700 1 -- 172.21.15.19:0/960440862 learned_addr learned my addr 172.21.15.19:0/960440862 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d95ec700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d4138d80 0x7fb9d413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d3fff700 1 -- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d4138d80 msgr2=0x7fb9d413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d3fff700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d4138d80 0x7fb9d413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d3fff700 1 -- 172.21.15.19:0/960440862 >> v1:172.21.15.19:6789/0 conn(0x7fb9d40a0a30 legacy=0x7fb9d40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d3fff700 1 -- 172.21.15.19:0/960440862 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d409dc50 con 0x7fb9d409d630 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d37fe700 1 -- 172.21.15.19:0/960440862 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929496648 0 0) 0x7fb9d40a2a70 con 0x7fb9d40a0a30 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d3fff700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d409d630 0x7fb9d40a1510 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009840 tx=0x7fb9c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c1eb72a38aa5c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d37fe700 1 -- 172.21.15.19:0/960440862 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0011830 con 0x7fb9d409d630 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d37fe700 1 -- 172.21.15.19:0/960440862 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0011990 con 0x7fb9d409d630 2023-10-03T10:17:43.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.642+0000 7fb9d37fe700 1 -- 172.21.15.19:0/960440862 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0011d20 con 0x7fb9d409d630 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.643+0000 7fb9db04f700 1 -- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d409d630 msgr2=0x7fb9d40a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.643+0000 7fb9db04f700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d409d630 0x7fb9d40a1510 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009840 tx=0x7fb9c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.643+0000 7fb9db04f700 1 -- 172.21.15.19:0/960440862 shutdown_connections 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.643+0000 7fb9db04f700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d4138d80 0x7fb9d413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.643+0000 7fb9db04f700 1 --2- 172.21.15.19:0/960440862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d409d630 0x7fb9d40a1510 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.644+0000 7fb9db04f700 1 -- 172.21.15.19:0/960440862 >> 172.21.15.19:0/960440862 conn(0x7fb9d40a3050 msgr2=0x7fb9d40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.644+0000 7fb9db04f700 1 -- 172.21.15.19:0/960440862 shutdown_connections 2023-10-03T10:17:43.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.644+0000 7fb9db04f700 1 -- 172.21.15.19:0/960440862 wait complete. 2023-10-03T10:17:43.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.645+0000 7fb9db04f700 1 Processor -- start 2023-10-03T10:17:43.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.645+0000 7fb9db04f700 1 -- start start 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 0x7fb9d412dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 0x7fb9d412dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d409bca0 con 0x7fb9d4138d80 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d4099e80 con 0x7fb9d409d630 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9db04f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d412cbf0 con 0x7fb9d40a0a30 2023-10-03T10:17:43.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9d95ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9d8deb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 0x7fb9d412dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9d95ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55228/0 (socket says 172.21.15.19:55228) 2023-10-03T10:17:43.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.646+0000 7fb9d95ec700 1 -- 172.21.15.19:0/2486606240 learned_addr learned my addr 172.21.15.19:0/2486606240 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 -- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 msgr2=0x7fb9d412dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d3fff700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 0x7fb9d412dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 0x7fb9d412dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 -- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 msgr2=0x7fb9d412dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 0x7fb9d412dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 -- 172.21.15.19:0/2486606240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00094a0 con 0x7fb9d4138d80 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d3fff700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 0x7fb9d412dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d8deb700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 0x7fb9d412dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d95ec700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007e30 tx=0x7fb9cc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00ede0 con 0x7fb9d4138d80 2023-10-03T10:17:43.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc014420 con 0x7fb9d4138d80 2023-10-03T10:17:43.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.647+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d412c990 con 0x7fb9d4138d80 2023-10-03T10:17:43.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.648+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d412f5f0 con 0x7fb9d4138d80 2023-10-03T10:17:43.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.648+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0147d0 con 0x7fb9d4138d80 2023-10-03T10:17:43.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.649+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b40052e0 con 0x7fb9d4138d80 2023-10-03T10:17:43.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.650+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9cc014930 con 0x7fb9d4138d80 2023-10-03T10:17:43.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.650+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9cc03fea0 con 0x7fb9d4138d80 2023-10-03T10:17:43.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.660+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9cc01bce0 con 0x7fb9d4138d80 2023-10-03T10:17:43.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.714+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff518074ea0 con 0x7ff51809de50 2023-10-03T10:17:43.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.715+0000 7ff4ff7fe700 1 -- 172.21.15.19:0/1070427797 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff508022030 con 0x7ff51809de50 2023-10-03T10:17:43.715 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:43.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 msgr2=0x7ff51811b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b3f0 tx=0x7ff50800b700 comp rx=0 tx=0).stop 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 shutdown_connections 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5181338a0 0x7ff51811c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff51809de50 0x7ff51811b7e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 --2- 172.21.15.19:0/1070427797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff51809e760 0x7ff51811bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 >> 172.21.15.19:0/1070427797 conn(0x7ff5180a2aa0 msgr2=0x7ff518130630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.718+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 shutdown_connections 2023-10-03T10:17:43.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.719+0000 7ff51d3f5700 1 -- 172.21.15.19:0/1070427797 wait complete. 2023-10-03T10:17:43.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.775+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f119013d770 con 0x7f1190134610 2023-10-03T10:17:43.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.775+0000 7f1185ffb700 1 -- 172.21.15.19:0/1999427938 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f119013d770 con 0x7f1190134610 2023-10-03T10:17:43.775 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 msgr2=0x7f1190125fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f118000e9b0 tx=0x7f118000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 shutdown_connections 2023-10-03T10:17:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f119013de10 0x7f11901264f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f119006e570 0x7f1190127640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 --2- 172.21.15.19:0/1999427938 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1190134610 0x7f1190125fb0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 >> 172.21.15.19:0/1999427938 conn(0x7f11900a2aa0 msgr2=0x7f1190137bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 shutdown_connections 2023-10-03T10:17:43.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.778+0000 7f1197435700 1 -- 172.21.15.19:0/1999427938 wait complete. 2023-10-03T10:17:43.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:43.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.837+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7f413b6c0 con 0x7fb7f41337f0 2023-10-03T10:17:43.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.837+0000 7fb7e9ffb700 1 -- 172.21.15.19:0/1374919370 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7f413b6c0 con 0x7fb7f41337f0 2023-10-03T10:17:43.837 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 msgr2=0x7fb7f409ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400e9b0 tx=0x7fb7e400ed70 comp rx=0 tx=0).stop 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 shutdown_connections 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7f4138dc0 0x7fb7f409d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7f4133420 0x7fb7f409c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 --2- 172.21.15.19:0/1374919370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7f41337f0 0x7fb7f409ce00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 >> 172.21.15.19:0/1374919370 conn(0x7fb7f40a4210 msgr2=0x7fb7f40a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 shutdown_connections 2023-10-03T10:17:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.840+0000 7fb7fb2cf700 1 -- 172.21.15.19:0/1374919370 wait complete. 2023-10-03T10:17:43.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:43.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.870+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9b4005590 con 0x7fb9d4138d80 2023-10-03T10:17:43.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.870+0000 7fb9d17fa700 1 -- 172.21.15.19:0/2486606240 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9cc01bb00 con 0x7fb9d4138d80 2023-10-03T10:17:43.870 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 msgr2=0x7fb9d412e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc007e30 tx=0x7fb9cc00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 shutdown_connections 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9d4138d80 0x7fb9d412e530 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9d409d630 0x7fb9d412dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 --2- 172.21.15.19:0/2486606240 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9d40a0a30 0x7fb9d412dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 >> 172.21.15.19:0/2486606240 conn(0x7fb9d40a3050 msgr2=0x7fb9d41392d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 shutdown_connections 2023-10-03T10:17:43.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:43.872+0000 7fb9db04f700 1 -- 172.21.15.19:0/2486606240 wait complete. 2023-10-03T10:17:43.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:44.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:44.793 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:44.854 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:44.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:44.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.891+0000 7fdbbf4f7700 1 Processor -- start 2023-10-03T10:17:44.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.891+0000 7fdbbf4f7700 1 -- start start 2023-10-03T10:17:44.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbf4f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbf4f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbf4f7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb81313c0 con 0x7fdbb809a3b0 2023-10-03T10:17:44.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbf4f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb809b580 con 0x7fdbb8131810 2023-10-03T10:17:44.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbf4f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb806e8c0 con 0x7fdbb8099a40 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbca92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbda94700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdbb809a3b0 0x7fdbb8138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54532/0 (socket says 172.21.15.19:54532) 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbda94700 1 -- 172.21.15.19:0/3653513943 learned_addr learned my addr 172.21.15.19:0/3653513943 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.892+0000 7fdbbd293700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbaffff700 1 -- 172.21.15.19:0/3653513943 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651816188 0 0) 0x7fdbb81313c0 con 0x7fdbb809a3b0 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbd293700 1 -- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 msgr2=0x7fdbb8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbd293700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbd293700 1 -- 172.21.15.19:0/3653513943 >> v1:172.21.15.19:6789/0 conn(0x7fdbb809a3b0 legacy=0x7fdbb8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbd293700 1 -- 172.21.15.19:0/3653513943 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb809a820 con 0x7fdbb8131810 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbca92700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbbd293700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8131be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009870 tx=0x7fdbb4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bfee8c088ce41f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbaffff700 1 -- 172.21.15.19:0/3653513943 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4011830 con 0x7fdbb8131810 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbaffff700 1 -- 172.21.15.19:0/3653513943 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4011990 con 0x7fdbb8131810 2023-10-03T10:17:44.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.893+0000 7fdbaffff700 1 -- 172.21.15.19:0/3653513943 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4011d20 con 0x7fdbb8131810 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 msgr2=0x7fdbb8131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8131be0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4009870 tx=0x7fdbb4009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/3653513943 shutdown_connections 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8131be0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/3653513943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/3653513943 >> 172.21.15.19:0/3653513943 conn(0x7fdbb80a2aa0 msgr2=0x7fdbb80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/3653513943 shutdown_connections 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.894+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/3653513943 wait complete. 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.895+0000 7fdbbf4f7700 1 Processor -- start 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.895+0000 7fdbbf4f7700 1 -- start start 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8119540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8119fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb811d980 con 0x7fdbb809a3b0 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb806eb00 con 0x7fdbb8131810 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbf4f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb811beb0 con 0x7fdbb8099a40 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55242/0 (socket says 172.21.15.19:55242) 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 -- 172.21.15.19:0/274625663 learned_addr learned my addr 172.21.15.19:0/274625663 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:44.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbda94700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8119fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 -- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 msgr2=0x7fdbb8119540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8119540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 -- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 msgr2=0x7fdbb8119fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8119fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbca92700 1 -- 172.21.15.19:0/274625663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80094a0 con 0x7fdbb809a3b0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.896+0000 7fdbbda94700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.897+0000 7fdbbca92700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdba800ebe0 tx=0x7fdba800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.897+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800c910 con 0x7fdbb809a3b0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.897+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba800ca70 con 0x7fdbb809a3b0 2023-10-03T10:17:44.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.897+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba800ce00 con 0x7fdbb809a3b0 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.898+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb40094a0 con 0x7fdbb809a3b0 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.898+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb8130720 con 0x7fdbb809a3b0 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.899+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb8074ea0 con 0x7fdbb809a3b0 2023-10-03T10:17:44.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.899+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdba8013470 con 0x7fdbb809a3b0 2023-10-03T10:17:44.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.900+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdba803f970 con 0x7fdbb809a3b0 2023-10-03T10:17:44.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.909+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdba8011d20 con 0x7fdbb809a3b0 2023-10-03T10:17:44.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.954+0000 7f6fa60ad700 1 Processor -- start 2023-10-03T10:17:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.954+0000 7f6fa60ad700 1 -- start start 2023-10-03T10:17:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.955+0000 7f6fa60ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009e1d0 0x7f6fa0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.955+0000 7f6fa60ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.955+0000 7f6fa60ad700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa009b120 con 0x7f6fa009d6f0 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.955+0000 7f6fa60ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa006b460 con 0x7f6fa0139170 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.955+0000 7f6fa60ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa009a7e0 con 0x7f6fa009e1d0 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6fa009d6f0 0x7f6fa009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54542/0 (socket says 172.21.15.19:54542) 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9f7fe700 1 -- 172.21.15.19:0/1375778676 learned_addr learned my addr 172.21.15.19:0/1375778676 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9effd700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009e1d0 0x7f6fa0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 -- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009e1d0 msgr2=0x7f6fa0138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009e1d0 0x7f6fa0138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 -- 172.21.15.19:0/1375778676 >> v1:172.21.15.19:6789/0 conn(0x7f6fa009d6f0 legacy=0x7f6fa009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 -- 172.21.15.19:0/1375778676 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa009a500 con 0x7f6fa0139170 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.956+0000 7f6f9ffff700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa013b550 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009dc0 tx=0x7f6f9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c41ba07cd33438b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.957+0000 7f6f9e7fc700 1 -- 172.21.15.19:0/1375778676 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800e070 con 0x7f6fa0139170 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.957+0000 7f6f9e7fc700 1 -- 172.21.15.19:0/1375778676 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f98003a20 con 0x7f6fa0139170 2023-10-03T10:17:44.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.957+0000 7f6f9e7fc700 1 -- 172.21.15.19:0/1375778676 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f98003dd0 con 0x7f6fa0139170 2023-10-03T10:17:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 -- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 msgr2=0x7f6fa013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa013b550 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009dc0 tx=0x7f6f9800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:44.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 -- 172.21.15.19:0/1375778676 shutdown_connections 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa013b550 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/1375778676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009e1d0 0x7f6fa0138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 -- 172.21.15.19:0/1375778676 >> 172.21.15.19:0/1375778676 conn(0x7f6fa0066f50 msgr2=0x7f6fa009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 -- 172.21.15.19:0/1375778676 shutdown_connections 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.958+0000 7f6fa60ad700 1 -- 172.21.15.19:0/1375778676 wait complete. 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.959+0000 7f6fa60ad700 1 Processor -- start 2023-10-03T10:17:44.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.959+0000 7f6fa60ad700 1 -- start start 2023-10-03T10:17:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fa009e1d0 0x7f6fa01c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa011e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0120550 con 0x7f6fa009e1d0 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0120360 con 0x7f6fa0139170 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6fa60ad700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa0122270 con 0x7f6fa009d6f0 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6f9f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41686/0 (socket says 172.21.15.19:41686) 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6f9f7fe700 1 -- 172.21.15.19:0/2131229153 learned_addr learned my addr 172.21.15.19:0/2131229153 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6f9effd700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fa009e1d0 0x7f6fa01c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.960+0000 7f6f9ffff700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa011e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 -- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 msgr2=0x7f6fa011e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa011e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 -- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fa009e1d0 msgr2=0x7f6fa01c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fa009e1d0 0x7f6fa01c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 -- 172.21.15.19:0/2131229153 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009a70 con 0x7f6fa009d6f0 2023-10-03T10:17:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9ffff700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa011e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:44.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f9f7fe700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c780 tx=0x7f6f9000ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90004c80 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90004de0 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90007310 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa0134620 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.961+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa0072050 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.962+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6f90007470 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.962+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6f9003e920 con 0x7f6fa009d6f0 2023-10-03T10:17:44.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.963+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa0074ea0 con 0x7f6fa009d6f0 2023-10-03T10:17:44.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:44.968+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6f90018020 con 0x7f6fa009d6f0 2023-10-03T10:17:45.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 Processor -- start 2023-10-03T10:17:45.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 -- start start 2023-10-03T10:17:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2244133960 0x7f2244133d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f224409e990 0x7f224413b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2244133550 con 0x7f224409de50 2023-10-03T10:17:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224406fab0 con 0x7f224409e990 2023-10-03T10:17:45.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.007+0000 7f2249656700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2244071e20 con 0x7f2244133960 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f224409e990 0x7f224413b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f224409e990 0x7f224413b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55264/0 (socket says 172.21.15.19:55264) 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 -- 172.21.15.19:0/3776634590 learned_addr learned my addr 172.21.15.19:0/3776634590 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 -- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2244133960 msgr2=0x7f2244133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 --2- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2244133960 0x7f2244133d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 -- 172.21.15.19:0/3776634590 >> v1:172.21.15.19:6789/0 conn(0x7f224409de50 legacy=0x7f224409e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 -- 172.21.15.19:0/3776634590 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224406f1e0 con 0x7f224409e990 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f22437fe700 1 --2- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f224413b7f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f223c0098f0 tx=0x7f223c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41fe541438c43ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.008+0000 7f2241ffb700 1 -- 172.21.15.19:0/3776634590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c004230 con 0x7f224409e990 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2241ffb700 1 -- 172.21.15.19:0/3776634590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c004390 con 0x7f224409e990 2023-10-03T10:17:45.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2241ffb700 1 -- 172.21.15.19:0/3776634590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c0036a0 con 0x7f224409e990 2023-10-03T10:17:45.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 -- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 msgr2=0x7f224413b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 --2- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f224413b7f0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f223c0098f0 tx=0x7f223c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 -- 172.21.15.19:0/3776634590 shutdown_connections 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 --2- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f224413b7f0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 --2- 172.21.15.19:0/3776634590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2244133960 0x7f2244133d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 -- 172.21.15.19:0/3776634590 >> 172.21.15.19:0/3776634590 conn(0x7f22440a2610 msgr2=0x7f22440a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 -- 172.21.15.19:0/3776634590 shutdown_connections 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.009+0000 7f2249656700 1 -- 172.21.15.19:0/3776634590 wait complete. 2023-10-03T10:17:45.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 Processor -- start 2023-10-03T10:17:45.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 -- start start 2023-10-03T10:17:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 0x7f224411fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f2244120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 0x7f2244120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22441233b0 con 0x7f224409e990 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2244123620 con 0x7f224409de50 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2249656700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2244120fb0 con 0x7f2244133960 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 0x7f224411fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2242ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 0x7f224411fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44120/0 (socket says 172.21.15.19:44120) 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f2242ffd700 1 -- 172.21.15.19:0/1885917293 learned_addr learned my addr 172.21.15.19:0/1885917293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:45.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f22437fe700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 0x7f2244120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.011+0000 7f22427fc700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f2244120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 -- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 msgr2=0x7f224411fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 0x7f224411fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 -- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 msgr2=0x7f2244120120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f2244120120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 -- 172.21.15.19:0/1885917293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009550 con 0x7f2244133960 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22427fc700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f2244120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f22437fe700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 0x7f2244120660 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f223c015000 tx=0x7f223c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c003e60 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00b660 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2244121710 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c00ba10 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.012+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224406ec70 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.014+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224406f480 con 0x7f2244133960 2023-10-03T10:17:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.014+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f223c00bb70 con 0x7f2244133960 2023-10-03T10:17:45.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.018+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f223c010d50 con 0x7f2244133960 2023-10-03T10:17:45.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.019+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f223c00be20 con 0x7f2244133960 2023-10-03T10:17:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.060+0000 7f2e9e0da700 1 Processor -- start 2023-10-03T10:17:45.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.060+0000 7f2e9e0da700 1 -- start start 2023-10-03T10:17:45.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e9e0da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e9e0da700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e980a1340 0x7f2e98133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e9e0da700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9809edd0 con 0x7f2e98133fa0 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e9e0da700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9809e1f0 con 0x7f2e980a1340 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e9e0da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9809dc50 con 0x7f2e980a0a30 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41704/0 (socket says 172.21.15.19:41704) 2023-10-03T10:17:45.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 -- 172.21.15.19:0/2848282003 learned_addr learned my addr 172.21.15.19:0/2848282003 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 -- 172.21.15.19:0/2848282003 >> v2:172.21.15.19:3300/0 conn(0x7f2e980a1340 msgr2=0x7f2e98133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 --2- 172.21.15.19:0/2848282003 >> v2:172.21.15.19:3300/0 conn(0x7f2e980a1340 0x7f2e98133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 -- 172.21.15.19:0/2848282003 >> v1:172.21.15.19:6789/0 conn(0x7f2e98133fa0 legacy=0x7f2e9813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 -- 172.21.15.19:0/2848282003 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980a1fe0 con 0x7f2e980a0a30 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.061+0000 7f2e977fe700 1 --2- 172.21.15.19:0/2848282003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098f0 tx=0x7f2e88009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82db53b98f4071e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e967fc700 1 -- 172.21.15.19:0/2848282003 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88004230 con 0x7f2e980a0a30 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e967fc700 1 -- 172.21.15.19:0/2848282003 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e88004390 con 0x7f2e980a0a30 2023-10-03T10:17:45.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e967fc700 1 -- 172.21.15.19:0/2848282003 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880036a0 con 0x7f2e980a0a30 2023-10-03T10:17:45.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 -- 172.21.15.19:0/2848282003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 msgr2=0x7f2e980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/2848282003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098f0 tx=0x7f2e88009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 -- 172.21.15.19:0/2848282003 shutdown_connections 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/2848282003 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e980a0e00 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/2848282003 >> v2:172.21.15.19:3300/0 conn(0x7f2e980a1340 0x7f2e98133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.062+0000 7f2e9e0da700 1 -- 172.21.15.19:0/2848282003 >> 172.21.15.19:0/2848282003 conn(0x7f2e980a6550 msgr2=0x7f2e980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.063+0000 7f2e9e0da700 1 -- 172.21.15.19:0/2848282003 shutdown_connections 2023-10-03T10:17:45.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.063+0000 7f2e9e0da700 1 -- 172.21.15.19:0/2848282003 wait complete. 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 Processor -- start 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 -- start start 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e980a1340 0x7f2e981c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e98133fa0 0x7f2e9811e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98120460 con 0x7f2e980a1340 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98120a40 con 0x7f2e98133fa0 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e9e0da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98133190 con 0x7f2e980a0a30 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41708/0 (socket says 172.21.15.19:41708) 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.064+0000 7f2e977fe700 1 -- 172.21.15.19:0/1406797 learned_addr learned my addr 172.21.15.19:0/1406797 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:45.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e96ffd700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e980a1340 0x7f2e981c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e97fff700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e98133fa0 0x7f2e9811e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 -- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e98133fa0 msgr2=0x7f2e9811e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e98133fa0 0x7f2e9811e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 -- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e980a1340 msgr2=0x7f2e981c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e980a1340 0x7f2e981c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 -- 172.21.15.19:0/1406797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88009550 con 0x7f2e980a0a30 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e977fe700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b0e0 tx=0x7f2e88004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003cd0 con 0x7f2e980a0a30 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8801f070 con 0x7f2e980a0a30 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.065+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e98122360 con 0x7f2e980a0a30 2023-10-03T10:17:45.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.066+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800b8a0 con 0x7f2e980a0a30 2023-10-03T10:17:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.066+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e980a0220 con 0x7f2e980a0a30 2023-10-03T10:17:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.067+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e88021030 con 0x7f2e980a0a30 2023-10-03T10:17:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.067+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e980a1d40 con 0x7f2e980a0a30 2023-10-03T10:17:45.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.067+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e88040c10 con 0x7f2e980a0a30 2023-10-03T10:17:45.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.072+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e880239c0 con 0x7f2e980a0a30 2023-10-03T10:17:45.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.144+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdbb806b9e0 con 0x7fdbb809a3b0 2023-10-03T10:17:45.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.144+0000 7fdbadffb700 1 -- 172.21.15.19:0/274625663 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdba8017070 con 0x7fdbb809a3b0 2023-10-03T10:17:45.144 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 msgr2=0x7fdbb8119a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fdba800ebe0 tx=0x7fdba800eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 shutdown_connections 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbb8131810 0x7fdbb8119fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbb8099a40 0x7fdbb8119540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 --2- 172.21.15.19:0/274625663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbb809a3b0 0x7fdbb8119a80 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 >> 172.21.15.19:0/274625663 conn(0x7fdbb80a2aa0 msgr2=0x7fdbb812e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 shutdown_connections 2023-10-03T10:17:45.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.148+0000 7fdbbf4f7700 1 -- 172.21.15.19:0/274625663 wait complete. 2023-10-03T10:17:45.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.222+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6fa006c360 con 0x7f6fa009d6f0 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.222+0000 7f6f87fff700 1 -- 172.21.15.19:0/2131229153 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6f90007720 con 0x7f6fa009d6f0 2023-10-03T10:17:45.222 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:45.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 msgr2=0x7f6fa01c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c780 tx=0x7f6f9000ca90 comp rx=0 tx=0).stop 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 shutdown_connections 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6fa0139170 0x7f6fa011e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6fa009d6f0 0x7f6fa01c8560 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.224+0000 7f6fa60ad700 1 --2- 172.21.15.19:0/2131229153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6fa009e1d0 0x7f6fa01c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.225+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 >> 172.21.15.19:0/2131229153 conn(0x7f6fa0066f50 msgr2=0x7f6fa0136b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.225+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 shutdown_connections 2023-10-03T10:17:45.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.225+0000 7f6fa60ad700 1 -- 172.21.15.19:0/2131229153 wait complete. 2023-10-03T10:17:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.232+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22440747f0 con 0x7f2244133960 2023-10-03T10:17:45.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.232+0000 7f222b7fe700 1 -- 172.21.15.19:0/1885917293 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f223c010b70 con 0x7f2244133960 2023-10-03T10:17:45.232 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 msgr2=0x7f2244120660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 0x7f2244120660 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f223c015000 tx=0x7f223c004750 comp rx=0 tx=0).stop 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 shutdown_connections 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2244133960 0x7f2244120660 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f224409de50 0x7f224411fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 --2- 172.21.15.19:0/1885917293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f224409e990 0x7f2244120120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 >> 172.21.15.19:0/1885917293 conn(0x7f22440a2610 msgr2=0x7f22440a05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 shutdown_connections 2023-10-03T10:17:45.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.236+0000 7f2249656700 1 -- 172.21.15.19:0/1885917293 wait complete. 2023-10-03T10:17:45.239 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:45.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.293+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2e980a1d40 con 0x7f2e980a0a30 2023-10-03T10:17:45.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.294+0000 7f2e7ffff700 1 -- 172.21.15.19:0/1406797 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e880233d0 con 0x7f2e980a0a30 2023-10-03T10:17:45.294 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 msgr2=0x7f2e981c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800b0e0 tx=0x7f2e88004750 comp rx=0 tx=0).stop 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 shutdown_connections 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e98133fa0 0x7f2e9811e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e980a0a30 0x7f2e981c8840 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 --2- 172.21.15.19:0/1406797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e980a1340 0x7f2e981c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 >> 172.21.15.19:0/1406797 conn(0x7f2e980a6550 msgr2=0x7f2e981b9130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 shutdown_connections 2023-10-03T10:17:45.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:45.296+0000 7f2e9e0da700 1 -- 172.21.15.19:0/1406797 wait complete. 2023-10-03T10:17:45.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:46.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:46.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:46.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:46.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:46.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 Processor -- start 2023-10-03T10:17:46.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 -- start start 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 0x7efe80131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe80070940 con 0x7efe8009f240 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8006fd60 con 0x7efe8009f650 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.311+0000 7efe852d2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006fa80 con 0x7efe8009e930 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 0x7efe80131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44132/0 (socket says 172.21.15.19:44132) 2023-10-03T10:17:46.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 -- 172.21.15.19:0/1594207428 learned_addr learned my addr 172.21.15.19:0/1594207428 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 -- 172.21.15.19:0/1594207428 >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 msgr2=0x7efe80131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 --2- 172.21.15.19:0/1594207428 >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 0x7efe80131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 -- 172.21.15.19:0/1594207428 >> v1:172.21.15.19:6789/0 conn(0x7efe8009f240 legacy=0x7efe801317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 -- 172.21.15.19:0/1594207428 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8009fb60 con 0x7efe8009e930 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7f7fe700 1 --2- 172.21.15.19:0/1594207428 >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 0x7efe80131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.312+0000 7efe7effd700 1 --2- 172.21.15.19:0/1594207428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efe700098f0 tx=0x7efe70009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ef76b206f58f716 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.313+0000 7efe7dffb700 1 -- 172.21.15.19:0/1594207428 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011830 con 0x7efe8009e930 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.313+0000 7efe7dffb700 1 -- 172.21.15.19:0/1594207428 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70011990 con 0x7efe8009e930 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.313+0000 7efe7dffb700 1 -- 172.21.15.19:0/1594207428 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70011d20 con 0x7efe8009e930 2023-10-03T10:17:46.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 -- 172.21.15.19:0/1594207428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 msgr2=0x7efe8009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 --2- 172.21.15.19:0/1594207428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7efe700098f0 tx=0x7efe70009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 -- 172.21.15.19:0/1594207428 shutdown_connections 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 --2- 172.21.15.19:0/1594207428 >> v2:172.21.15.19:3300/0 conn(0x7efe8009f650 0x7efe80131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 --2- 172.21.15.19:0/1594207428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe8009ed00 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 -- 172.21.15.19:0/1594207428 >> 172.21.15.19:0/1594207428 conn(0x7efe800a4210 msgr2=0x7efe800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 -- 172.21.15.19:0/1594207428 shutdown_connections 2023-10-03T10:17:46.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.314+0000 7efe852d2700 1 -- 172.21.15.19:0/1594207428 wait complete. 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.315+0000 7efe852d2700 1 Processor -- start 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.315+0000 7efe852d2700 1 -- start start 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe8009f240 0x7efe801a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe8009f650 0x7efe801a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe801a5120 con 0x7efe8009f650 2023-10-03T10:17:46.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe801a5880 con 0x7efe8009e930 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe852d2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe801a5ea0 con 0x7efe8009f240 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44136/0 (socket says 172.21.15.19:44136) 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 -- 172.21.15.19:0/2126906430 learned_addr learned my addr 172.21.15.19:0/2126906430 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 -- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe8009f240 msgr2=0x7efe801a41b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe8009f240 0x7efe801a41b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 -- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe8009f650 msgr2=0x7efe801a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe8009f650 0x7efe801a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 -- 172.21.15.19:0/2126906430 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78009a70 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.316+0000 7efe7effd700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe70004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.317+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700044f0 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.317+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7001f070 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.317+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700038a0 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.318+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe70009550 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.318+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800a0190 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.318+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe70021030 con 0x7efe8009e930 2023-10-03T10:17:46.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.319+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe70040a00 con 0x7efe8009e930 2023-10-03T10:17:46.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.319+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe801a0b30 con 0x7efe8009e930 2023-10-03T10:17:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.328+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe70015080 con 0x7efe8009e930 2023-10-03T10:17:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 Processor -- start 2023-10-03T10:17:46.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 -- start start 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 0x7f612009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 0x7f61201339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612006b460 con 0x7f612009d6f0 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612009b120 con 0x7f612009e410 2023-10-03T10:17:46.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6126483700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f612009a7e0 con 0x7f612009e000 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6124a20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6124a20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49048/0 (socket says 172.21.15.19:49048) 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f6124a20700 1 -- 172.21.15.19:0/1853922944 learned_addr learned my addr 172.21.15.19:0/1853922944 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.388+0000 7f611f7fe700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 0x7f61201339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611ffff700 1 --2- 172.21.15.19:0/1853922944 >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 0x7f612009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 -- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 msgr2=0x7f6120133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 -- 172.21.15.19:0/1853922944 >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 msgr2=0x7f612009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 --2- 172.21.15.19:0/1853922944 >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 0x7f612009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 -- 172.21.15.19:0/1853922944 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612009a500 con 0x7f612009e000 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f6124a20700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611ffff700 1 --2- 172.21.15.19:0/1853922944 >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 0x7f612009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611f7fe700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 0x7f61201339f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6114009870 tx=0x7f6114009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e39b58284910259 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.389+0000 7f611effd700 1 -- 172.21.15.19:0/1853922944 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114011830 con 0x7f612009e000 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.390+0000 7f611effd700 1 -- 172.21.15.19:0/1853922944 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6114011990 con 0x7f612009e000 2023-10-03T10:17:46.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.390+0000 7f611effd700 1 -- 172.21.15.19:0/1853922944 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114011d00 con 0x7f612009e000 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 -- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 msgr2=0x7f61201339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 0x7f61201339f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f6114009870 tx=0x7f6114009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 -- 172.21.15.19:0/1853922944 shutdown_connections 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f6120133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 --2- 172.21.15.19:0/1853922944 >> v2:172.21.15.19:3300/0 conn(0x7f612009d6f0 0x7f612009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 --2- 172.21.15.19:0/1853922944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009e000 0x7f61201339f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 -- 172.21.15.19:0/1853922944 >> 172.21.15.19:0/1853922944 conn(0x7f6120066f50 msgr2=0x7f612009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 -- 172.21.15.19:0/1853922944 shutdown_connections 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.391+0000 7f6126483700 1 -- 172.21.15.19:0/1853922944 wait complete. 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.392+0000 7f6126483700 1 Processor -- start 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 -- start start 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009d6f0 0x7f61201a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f61201c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61201a5cf0 con 0x7f612009e000 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61201a8450 con 0x7f612009e410 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.393+0000 7f6126483700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61200a1de0 con 0x7f612009d6f0 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48626/0 (socket says 172.21.15.19:48626) 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 -- 172.21.15.19:0/197149115 learned_addr learned my addr 172.21.15.19:0/197149115 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f6124a20700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f61201c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611ffff700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009d6f0 0x7f61201a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 -- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009d6f0 msgr2=0x7f61201a5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009d6f0 0x7f61201a5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 -- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 msgr2=0x7f61201c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f61201c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 -- 172.21.15.19:0/197149115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6118009b30 con 0x7f612009e000 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.394+0000 7f611f7fe700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6114009840 tx=0x7f6114004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.395+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114004450 con 0x7f612009e000 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.395+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61140094a0 con 0x7f612009e000 2023-10-03T10:17:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.395+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611401f070 con 0x7f612009e000 2023-10-03T10:17:46.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.395+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61140038e0 con 0x7f612009e000 2023-10-03T10:17:46.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.395+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61201b9150 con 0x7f612009e000 2023-10-03T10:17:46.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.396+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612009c710 con 0x7f612009e000 2023-10-03T10:17:46.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.396+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6114003a40 con 0x7f612009e000 2023-10-03T10:17:46.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.397+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6114021070 con 0x7f612009e000 2023-10-03T10:17:46.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.405+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6114006bd0 con 0x7f612009e000 2023-10-03T10:17:46.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.436+0000 7f22ba648700 1 Processor -- start 2023-10-03T10:17:46.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.436+0000 7f22ba648700 1 -- start start 2023-10-03T10:17:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.436+0000 7f22ba648700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22b4130540 0x7f22b4130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.436+0000 7f22ba648700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 0x7f22b4138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22ba648700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40716a0 con 0x7f22b4130e50 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22ba648700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b409a390 con 0x7f22b4130540 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22ba648700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b4071290 con 0x7f22b406fcf0 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22b4130e50 0x7f22b406f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49258/0 (socket says 172.21.15.19:49258) 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b37fe700 1 -- 172.21.15.19:0/4102679445 learned_addr learned my addr 172.21.15.19:0/4102679445 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 --2- 172.21.15.19:0/4102679445 >> v2:172.21.15.19:3300/0 conn(0x7f22b4130540 0x7f22b4130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b8be5700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 0x7f22b4138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 -- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 msgr2=0x7f22b4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 0x7f22b4138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 -- 172.21.15.19:0/4102679445 >> v1:172.21.15.19:6789/0 conn(0x7f22b4130e50 legacy=0x7f22b406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 -- 172.21.15.19:0/4102679445 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b4130340 con 0x7f22b4130540 2023-10-03T10:17:46.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b8be5700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 0x7f22b4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.437+0000 7f22b3fff700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b4130540 0x7f22b4130910 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009840 tx=0x7f22a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a00e5e0f9e6ff8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22b2ffd700 1 -- 172.21.15.19:0/4102679445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011830 con 0x7f22b4130540 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22b2ffd700 1 -- 172.21.15.19:0/4102679445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a4011990 con 0x7f22b4130540 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22b2ffd700 1 -- 172.21.15.19:0/4102679445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4011d20 con 0x7f22b4130540 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 -- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b4130540 msgr2=0x7f22b4130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b4130540 0x7f22b4130910 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009840 tx=0x7f22a4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 -- 172.21.15.19:0/4102679445 shutdown_connections 2023-10-03T10:17:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b406fcf0 0x7f22b4138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 --2- 172.21.15.19:0/4102679445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b4130540 0x7f22b4130910 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.438+0000 7f22ba648700 1 -- 172.21.15.19:0/4102679445 >> 172.21.15.19:0/4102679445 conn(0x7f22b40a2aa0 msgr2=0x7f22b40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.439+0000 7f22ba648700 1 -- 172.21.15.19:0/4102679445 shutdown_connections 2023-10-03T10:17:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.439+0000 7f22ba648700 1 -- 172.21.15.19:0/4102679445 wait complete. 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.440+0000 7f22ba648700 1 Processor -- start 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.440+0000 7f22ba648700 1 -- start start 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 0x7f22b41c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 0x7f22b41c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b412ba40 con 0x7f22b406fcf0 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40718e0 con 0x7f22b4130e50 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22ba648700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22b412aae0 con 0x7f22b4130540 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b8be5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 0x7f22b41c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48648/0 (socket says 172.21.15.19:48648) 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b8be5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 0x7f22b41c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49060/0 (socket says 172.21.15.19:49060) 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 -- 172.21.15.19:0/3463736186 learned_addr learned my addr 172.21.15.19:0/3463736186 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b37fe700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 0x7f22b41c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 -- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 msgr2=0x7f22b41c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 0x7f22b41c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 -- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 msgr2=0x7f22b41c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 0x7f22b41c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.441+0000 7f22b3fff700 1 -- 172.21.15.19:0/3463736186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac009a70 con 0x7f22b406fcf0 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22b3fff700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009fd0 tx=0x7f22a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22b37fe700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 0x7f22b41c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a40036a0 con 0x7f22b406fcf0 2023-10-03T10:17:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a40094a0 con 0x7f22b406fcf0 2023-10-03T10:17:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b41c8ee0 con 0x7f22b406fcf0 2023-10-03T10:17:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a401f070 con 0x7f22b406fcf0 2023-10-03T10:17:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.442+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4003a00 con 0x7f22b406fcf0 2023-10-03T10:17:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.443+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22940052e0 con 0x7f22b406fcf0 2023-10-03T10:17:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.443+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22a4003b60 con 0x7f22b406fcf0 2023-10-03T10:17:46.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.444+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22a4021070 con 0x7f22b406fcf0 2023-10-03T10:17:46.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.448+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22a4045070 con 0x7f22b406fcf0 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.467+0000 7f069ec32700 1 Processor -- start 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.467+0000 7f069ec32700 1 -- start start 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069ec32700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f069806b250 0x7f0698136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069ec32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 0x7f0698139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069ec32700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069809ece0 con 0x7f069806a770 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069ec32700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069809e760 con 0x7f069806b250 2023-10-03T10:17:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069ec32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069809e040 con 0x7f0698136d80 2023-10-03T10:17:46.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069d1cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 0x7f0698139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f0697fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f069806b250 0x7f0698136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069c9ce700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f069806a770 0x7f069806ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49262/0 (socket says 172.21.15.19:49262) 2023-10-03T10:17:46.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069d1cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 0x7f0698139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58360/0 (socket says 172.21.15.19:58360) 2023-10-03T10:17:46.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.468+0000 7f069c9ce700 1 -- 172.21.15.19:0/738553838 learned_addr learned my addr 172.21.15.19:0/738553838 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f0697fff700 1 -- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 msgr2=0x7f0698139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f0697fff700 1 --2- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 0x7f0698139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f0697fff700 1 -- 172.21.15.19:0/738553838 >> v1:172.21.15.19:6789/0 conn(0x7f069806a770 legacy=0x7f069806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f0697fff700 1 -- 172.21.15.19:0/738553838 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069809f630 con 0x7f069806b250 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f0697fff700 1 --2- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f0698136840 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0684009840 tx=0x7f0684009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38547401ffc74ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f06977fe700 1 -- 172.21.15.19:0/738553838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f069806b250 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f06977fe700 1 -- 172.21.15.19:0/738553838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684011990 con 0x7f069806b250 2023-10-03T10:17:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.469+0000 7f06977fe700 1 -- 172.21.15.19:0/738553838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011d20 con 0x7f069806b250 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 -- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 msgr2=0x7f0698136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 --2- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f0698136840 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f0684009840 tx=0x7f0684009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 -- 172.21.15.19:0/738553838 shutdown_connections 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 --2- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0698136d80 0x7f0698139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 --2- 172.21.15.19:0/738553838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f0698136840 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 -- 172.21.15.19:0/738553838 >> 172.21.15.19:0/738553838 conn(0x7f0698066f50 msgr2=0x7f069809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 -- 172.21.15.19:0/738553838 shutdown_connections 2023-10-03T10:17:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.470+0000 7f069ec32700 1 -- 172.21.15.19:0/738553838 wait complete. 2023-10-03T10:17:46.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.471+0000 7f069ec32700 1 Processor -- start 2023-10-03T10:17:46.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.471+0000 7f069ec32700 1 -- start start 2023-10-03T10:17:46.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f069809b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 0x7f06981c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0698071e60 con 0x7f069806b250 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0698121d00 con 0x7f0698136d80 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069ec32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f069809b7f0 con 0x7f069806a770 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069c9ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f0697fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f069809b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069c9ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58376/0 (socket says 172.21.15.19:58376) 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069c9ce700 1 -- 172.21.15.19:0/336101883 learned_addr learned my addr 172.21.15.19:0/336101883 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.472+0000 7f069d1cf700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 0x7f06981c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 -- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 msgr2=0x7f06981c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 0x7f06981c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 -- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 msgr2=0x7f069809b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f069809b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 -- 172.21.15.19:0/336101883 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840094a0 con 0x7f069806a770 2023-10-03T10:17:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069d1cf700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 0x7f06981c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f0697fff700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f069809b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069c9ce700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c520 tx=0x7f068c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c005d70 con 0x7f069806a770 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0070d0 con 0x7f069806a770 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c007440 con 0x7f069806a770 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069809c060 con 0x7f069806a770 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.473+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06981227a0 con 0x7f069806a770 2023-10-03T10:17:46.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.474+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f068c0075a0 con 0x7f069806a770 2023-10-03T10:17:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.474+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0698074ea0 con 0x7f069806a770 2023-10-03T10:17:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.475+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f068c03ebc0 con 0x7f069806a770 2023-10-03T10:17:46.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.484+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f068c019b40 con 0x7f069806a770 2023-10-03T10:17:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.636+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe800a3570 con 0x7efe8009e930 2023-10-03T10:17:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.636+0000 7efe677fe700 1 -- 172.21.15.19:0/2126906430 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe70003a00 con 0x7efe8009e930 2023-10-03T10:17:46.637 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 msgr2=0x7efe801a3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe70004750 comp rx=0 tx=0).stop 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 shutdown_connections 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe8009f650 0x7efe801a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe8009e930 0x7efe801a3c70 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 --2- 172.21.15.19:0/2126906430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe8009f240 0x7efe801a41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 >> 172.21.15.19:0/2126906430 conn(0x7efe800a4210 msgr2=0x7efe801b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 shutdown_connections 2023-10-03T10:17:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.639+0000 7efe852d2700 1 -- 172.21.15.19:0/2126906430 wait complete. 2023-10-03T10:17:46.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.662+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2294005590 con 0x7f22b406fcf0 2023-10-03T10:17:46.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.663+0000 7f22b0ff9700 1 -- 172.21.15.19:0/3463736186 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22a4015030 con 0x7f22b406fcf0 2023-10-03T10:17:46.663 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 msgr2=0x7f22b41c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009fd0 tx=0x7f22a4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 shutdown_connections 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22b4130e50 0x7f22b41c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22b406fcf0 0x7f22b41c81a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 --2- 172.21.15.19:0/3463736186 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22b4130540 0x7f22b41c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 >> 172.21.15.19:0/3463736186 conn(0x7f22b40a2aa0 msgr2=0x7f22b4124e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 shutdown_connections 2023-10-03T10:17:46.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.665+0000 7f22ba648700 1 -- 172.21.15.19:0/3463736186 wait complete. 2023-10-03T10:17:46.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:46.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.691+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f069806c360 con 0x7f069806a770 2023-10-03T10:17:46.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.693+0000 7f06957fa700 1 -- 172.21.15.19:0/336101883 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f068c017070 con 0x7f069806a770 2023-10-03T10:17:46.693 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 msgr2=0x7f069809ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f068c00c520 tx=0x7f068c00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 shutdown_connections 2023-10-03T10:17:46.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0698136d80 0x7f06981c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f069806a770 0x7f069809ad70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 --2- 172.21.15.19:0/336101883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f069806b250 0x7f069809b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 >> 172.21.15.19:0/336101883 conn(0x7f0698066f50 msgr2=0x7f0698135da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 shutdown_connections 2023-10-03T10:17:46.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.696+0000 7f069ec32700 1 -- 172.21.15.19:0/336101883 wait complete. 2023-10-03T10:17:46.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.720+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6120074ea0 con 0x7f612009e000 2023-10-03T10:17:46.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.720+0000 7f611cff9700 1 -- 172.21.15.19:0/197149115 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6114015020 con 0x7f612009e000 2023-10-03T10:17:46.720 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 msgr2=0x7f61201a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f6114009840 tx=0x7f6114004750 comp rx=0 tx=0).stop 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 shutdown_connections 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f612009e410 0x7f61201c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f612009d6f0 0x7f61201a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 --2- 172.21.15.19:0/197149115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f612009e000 0x7f61201a57b0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 >> 172.21.15.19:0/197149115 conn(0x7f6120066f50 msgr2=0x7f612009fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:46.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 shutdown_connections 2023-10-03T10:17:46.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:46.723+0000 7f6126483700 1 -- 172.21.15.19:0/197149115 wait complete. 2023-10-03T10:17:46.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:47.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:47.680 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:47.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:47.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:47.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 Processor -- start 2023-10-03T10:17:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 -- start start 2023-10-03T10:17:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 0x7f35dc131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc099a40 0x7f35dc099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc1313c0 con 0x7f35dc09a3b0 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc09b580 con 0x7f35dc131810 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.810+0000 7f35e2822700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc06e8c0 con 0x7f35dc099a40 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35e0dbf700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f35dc09a3b0 0x7f35dc138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49278/0 (socket says 172.21.15.19:49278) 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35e0dbf700 1 -- 172.21.15.19:0/3973922719 learned_addr learned my addr 172.21.15.19:0/3973922719 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:47.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 0x7f35dc131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35db7fe700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc099a40 0x7f35dc099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35daffd700 1 -- 172.21.15.19:0/3973922719 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309447374 0 0) 0x7f35dc1313c0 con 0x7f35dc09a3b0 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35dbfff700 1 -- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc099a40 msgr2=0x7f35dc099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc099a40 0x7f35dc099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35dbfff700 1 -- 172.21.15.19:0/3973922719 >> v1:172.21.15.19:6789/0 conn(0x7f35dc09a3b0 legacy=0x7f35dc138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.811+0000 7f35dbfff700 1 -- 172.21.15.19:0/3973922719 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc09a820 con 0x7f35dc131810 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.812+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 0x7f35dc131be0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009870 tx=0x7f35cc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53d9326de1983a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.812+0000 7f35daffd700 1 -- 172.21.15.19:0/3973922719 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011830 con 0x7f35dc131810 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.812+0000 7f35daffd700 1 -- 172.21.15.19:0/3973922719 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011990 con 0x7f35dc131810 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.812+0000 7f35daffd700 1 -- 172.21.15.19:0/3973922719 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011d20 con 0x7f35dc131810 2023-10-03T10:17:47.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 -- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 msgr2=0x7f35dc131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 0x7f35dc131be0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009870 tx=0x7f35cc009b80 comp rx=0 tx=0).stop 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 -- 172.21.15.19:0/3973922719 shutdown_connections 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc131810 0x7f35dc131be0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 --2- 172.21.15.19:0/3973922719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc099a40 0x7f35dc099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 -- 172.21.15.19:0/3973922719 >> 172.21.15.19:0/3973922719 conn(0x7f35dc0a2aa0 msgr2=0x7f35dc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 -- 172.21.15.19:0/3973922719 shutdown_connections 2023-10-03T10:17:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.813+0000 7f35e2822700 1 -- 172.21.15.19:0/3973922719 wait complete. 2023-10-03T10:17:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.814+0000 7f35e2822700 1 Processor -- start 2023-10-03T10:17:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 -- start start 2023-10-03T10:17:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc09a3b0 0x7f35dc119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35dc131810 0x7f35dc11a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc11ce90 con 0x7f35dc131810 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc11da50 con 0x7f35dc099a40 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35e2822700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc11d090 con 0x7f35dc09a3b0 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35dbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49092/0 (socket says 172.21.15.19:49092) 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.815+0000 7f35dbfff700 1 -- 172.21.15.19:0/3472152070 learned_addr learned my addr 172.21.15.19:0/3472152070 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35db7fe700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc09a3b0 0x7f35dc119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35e0dbf700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35dc131810 0x7f35dc11a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 -- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc09a3b0 msgr2=0x7f35dc119b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc09a3b0 0x7f35dc119b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 -- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35dc131810 msgr2=0x7f35dc11a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35dc131810 0x7f35dc11a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 -- 172.21.15.19:0/3472152070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0094a0 con 0x7f35dc099a40 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35dbfff700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009840 tx=0x7f35cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc004510 con 0x7f35dc099a40 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.816+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc024070 con 0x7f35dc099a40 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.817+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc11bf80 con 0x7f35dc099a40 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.817+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0038c0 con 0x7f35dc099a40 2023-10-03T10:17:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.817+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc130690 con 0x7f35dc099a40 2023-10-03T10:17:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.818+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f35cc003a20 con 0x7f35dc099a40 2023-10-03T10:17:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.818+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f35cc026070 con 0x7f35dc099a40 2023-10-03T10:17:47.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.818+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc06eb00 con 0x7f35dc099a40 2023-10-03T10:17:47.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.827+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f35cc015070 con 0x7f35dc099a40 2023-10-03T10:17:47.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.859+0000 7f1806030700 1 Processor -- start 2023-10-03T10:17:47.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.859+0000 7f1806030700 1 -- start start 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f1806030700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f180006a770 0x7f180006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f1806030700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1800131d10 0x7f1800139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f1806030700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180009ece0 con 0x7f180006b080 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f1806030700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180009e760 con 0x7f1800131d10 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f1806030700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180009e040 con 0x7f180006a770 2023-10-03T10:17:47.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f17feffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f180006b080 0x7f1800131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49290/0 (socket says 172.21.15.19:49290) 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f17feffd700 1 -- 172.21.15.19:0/2213864840 learned_addr learned my addr 172.21.15.19:0/2213864840 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f17fffff700 1 --2- 172.21.15.19:0/2213864840 >> v2:172.21.15.19:3300/0 conn(0x7f1800131d10 0x7f1800139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.860+0000 7f17ff7fe700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f180006a770 0x7f180006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fffff700 1 -- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f180006a770 msgr2=0x7f180006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fffff700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f180006a770 0x7f180006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fffff700 1 -- 172.21.15.19:0/2213864840 >> v1:172.21.15.19:6789/0 conn(0x7f180006b080 legacy=0x7f1800131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fffff700 1 -- 172.21.15.19:0/2213864840 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180009f630 con 0x7f1800131d10 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fffff700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1800131d10 0x7f1800139860 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009d90 tx=0x7f17f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b41cd0d2d10551 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fe7fc700 1 -- 172.21.15.19:0/2213864840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800e070 con 0x7f1800131d10 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fe7fc700 1 -- 172.21.15.19:0/2213864840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f800bb20 con 0x7f1800131d10 2023-10-03T10:17:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.861+0000 7f17fe7fc700 1 -- 172.21.15.19:0/2213864840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8012430 con 0x7f1800131d10 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 -- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1800131d10 msgr2=0x7f1800139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1800131d10 0x7f1800139860 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009d90 tx=0x7f17f800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 -- 172.21.15.19:0/2213864840 shutdown_connections 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1800131d10 0x7f1800139860 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 --2- 172.21.15.19:0/2213864840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f180006a770 0x7f180006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 -- 172.21.15.19:0/2213864840 >> 172.21.15.19:0/2213864840 conn(0x7f1800066f50 msgr2=0x7f180009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 -- 172.21.15.19:0/2213864840 shutdown_connections 2023-10-03T10:17:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.862+0000 7f1806030700 1 -- 172.21.15.19:0/2213864840 wait complete. 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.863+0000 7f1806030700 1 Processor -- start 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.863+0000 7f1806030700 1 -- start start 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f180006b080 0x7f180011c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 0x7f180011ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180011f990 con 0x7f180006a770 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180011e880 con 0x7f1800131d10 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f1806030700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f180011e130 con 0x7f180006b080 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48686/0 (socket says 172.21.15.19:48686) 2023-10-03T10:17:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 -- 172.21.15.19:0/1600303855 learned_addr learned my addr 172.21.15.19:0/1600303855 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17fffff700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 0x7f180011ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 -- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f180006b080 msgr2=0x7f180011c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f180006b080 0x7f180011c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 -- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 msgr2=0x7f180011ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 0x7f180011ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17ff7fe700 1 -- 172.21.15.19:0/1600303855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8009a70 con 0x7f180006a770 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.864+0000 7f17fffff700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 0x7f180011ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f17ff7fe700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0009710 con 0x7f180006a770 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0013860 con 0x7f180006a770 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1800071e60 con 0x7f180006a770 2023-10-03T10:17:47.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0013bd0 con 0x7f180006a770 2023-10-03T10:17:47.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.865+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18001313e0 con 0x7f180006a770 2023-10-03T10:17:47.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.866+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17f0013d30 con 0x7f180006a770 2023-10-03T10:17:47.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.866+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f17f0043620 con 0x7f180006a770 2023-10-03T10:17:47.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.866+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1800074ea0 con 0x7f180006a770 2023-10-03T10:17:47.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.871+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17f0020080 con 0x7f180006a770 2023-10-03T10:17:47.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.889+0000 7f95923df700 1 Processor -- start 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.889+0000 7f95923df700 1 -- start start 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f95923df700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f958c09ac90 0x7f958c13cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f95923df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c13d240 0x7f958c13f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f95923df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958c134980 con 0x7f958c06c0e0 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f95923df700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958c06c4b0 con 0x7f958c09ac90 2023-10-03T10:17:47.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f95923df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c09b0e0 con 0x7f958c13d240 2023-10-03T10:17:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f958b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f958c09ac90 0x7f958c13cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f958bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f958c06c0e0 0x7f958c134ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49292/0 (socket says 172.21.15.19:49292) 2023-10-03T10:17:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.890+0000 7f958bfff700 1 -- 172.21.15.19:0/2358502615 learned_addr learned my addr 172.21.15.19:0/2358502615 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958b7fe700 1 -- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c13d240 msgr2=0x7f958c13f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958b7fe700 1 --2- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c13d240 0x7f958c13f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958b7fe700 1 -- 172.21.15.19:0/2358502615 >> v1:172.21.15.19:6789/0 conn(0x7f958c06c0e0 legacy=0x7f958c134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958affd700 1 -- 172.21.15.19:0/2358502615 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839803375 0 0) 0x7f958c134980 con 0x7f958c06c0e0 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958b7fe700 1 -- 172.21.15.19:0/2358502615 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0a0600 con 0x7f958c09ac90 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958b7fe700 1 --2- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c09ac90 0x7f958c13cd00 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9580009840 tx=0x7f9580009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cd546c2d906dc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958affd700 1 -- 172.21.15.19:0/2358502615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580011830 con 0x7f958c09ac90 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958affd700 1 -- 172.21.15.19:0/2358502615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9580011990 con 0x7f958c09ac90 2023-10-03T10:17:47.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.891+0000 7f958affd700 1 -- 172.21.15.19:0/2358502615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9580011d20 con 0x7f958c09ac90 2023-10-03T10:17:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 -- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c09ac90 msgr2=0x7f958c13cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 --2- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c09ac90 0x7f958c13cd00 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f9580009840 tx=0x7f9580009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 -- 172.21.15.19:0/2358502615 shutdown_connections 2023-10-03T10:17:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 --2- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c13d240 0x7f958c13f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 --2- 172.21.15.19:0/2358502615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c09ac90 0x7f958c13cd00 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 -- 172.21.15.19:0/2358502615 >> 172.21.15.19:0/2358502615 conn(0x7f958c0a4210 msgr2=0x7f958c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 -- 172.21.15.19:0/2358502615 shutdown_connections 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.892+0000 7f95923df700 1 -- 172.21.15.19:0/2358502615 wait complete. 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.893+0000 7f95923df700 1 Processor -- start 2023-10-03T10:17:47.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 -- start start 2023-10-03T10:17:47.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 0x7f958c09b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c09ac90 0x7f958c09b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 0x7f958c09beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958c138f90 con 0x7f958c13d240 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958c09e0b0 con 0x7f958c06c0e0 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.894+0000 7f95923df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f958c138780 con 0x7f958c09ac90 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f958bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 0x7f958c09b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f958bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 0x7f958c09b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49126/0 (socket says 172.21.15.19:49126) 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f958bfff700 1 -- 172.21.15.19:0/1559994189 learned_addr learned my addr 172.21.15.19:0/1559994189 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 0x7f958c09beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f958b7fe700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c09ac90 0x7f958c09b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 -- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c09ac90 msgr2=0x7f958c09b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c09ac90 0x7f958c09b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 -- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 msgr2=0x7f958c09b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 0x7f958c09b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 -- 172.21.15.19:0/1559994189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95800094a0 con 0x7f958c13d240 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f959097c700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 0x7f958c09beb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f958400bdf0 tx=0x7f9584009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958400cb30 con 0x7f958c13d240 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958400cc90 con 0x7f958c13d240 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.895+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958c09c750 con 0x7f958c13d240 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.896+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584014440 con 0x7f958c13d240 2023-10-03T10:17:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.896+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958c134320 con 0x7f958c13d240 2023-10-03T10:17:47.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.897+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f958c074ea0 con 0x7f958c13d240 2023-10-03T10:17:47.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.898+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f958401d3b0 con 0x7f958c13d240 2023-10-03T10:17:47.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.898+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9584006e40 con 0x7f958c13d240 2023-10-03T10:17:47.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.899+0000 7fefc4eca700 1 Processor -- start 2023-10-03T10:17:47.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.899+0000 7fefc4eca700 1 -- start start 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefc4eca700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fefc0130670 0x7fefc0130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefc4eca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefc4eca700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc0130260 con 0x7fefc006f680 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefc4eca700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc009a350 con 0x7fefc0130670 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefc4eca700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0071ff0 con 0x7fefc00701a0 2023-10-03T10:17:47.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefbed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefbed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58430/0 (socket says 172.21.15.19:58430) 2023-10-03T10:17:47.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.900+0000 7fefbed9d700 1 -- 172.21.15.19:0/289210924 learned_addr learned my addr 172.21.15.19:0/289210924 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:47.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbe59c700 1 --2- 172.21.15.19:0/289210924 >> v2:172.21.15.19:3300/0 conn(0x7fefc0130670 0x7fefc0130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbed9d700 1 -- 172.21.15.19:0/289210924 >> v2:172.21.15.19:3300/0 conn(0x7fefc0130670 msgr2=0x7fefc0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:47.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbed9d700 1 --2- 172.21.15.19:0/289210924 >> v2:172.21.15.19:3300/0 conn(0x7fefc0130670 0x7fefc0130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbed9d700 1 -- 172.21.15.19:0/289210924 >> v1:172.21.15.19:6789/0 conn(0x7fefc006f680 legacy=0x7fefc006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbed9d700 1 -- 172.21.15.19:0/289210924 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc009ecf0 con 0x7fefc00701a0 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbed9d700 1 --2- 172.21.15.19:0/289210924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e50 tx=0x7fefb800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe3f02493c661cad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbd59a700 1 -- 172.21.15.19:0/289210924 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb800e070 con 0x7fefc00701a0 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbd59a700 1 -- 172.21.15.19:0/289210924 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb800b910 con 0x7fefc00701a0 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.901+0000 7fefbd59a700 1 -- 172.21.15.19:0/289210924 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb800bcc0 con 0x7fefc00701a0 2023-10-03T10:17:47.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 -- 172.21.15.19:0/289210924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 msgr2=0x7fefc0138540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 --2- 172.21.15.19:0/289210924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009e50 tx=0x7fefb800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 -- 172.21.15.19:0/289210924 shutdown_connections 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 --2- 172.21.15.19:0/289210924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc00701a0 0x7fefc0138540 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 --2- 172.21.15.19:0/289210924 >> v2:172.21.15.19:3300/0 conn(0x7fefc0130670 0x7fefc0130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.902+0000 7fefc4eca700 1 -- 172.21.15.19:0/289210924 >> 172.21.15.19:0/289210924 conn(0x7fefc00a2aa0 msgr2=0x7fefc00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.903+0000 7fefc4eca700 1 -- 172.21.15.19:0/289210924 shutdown_connections 2023-10-03T10:17:47.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.903+0000 7fefc4eca700 1 -- 172.21.15.19:0/289210924 wait complete. 2023-10-03T10:17:47.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.904+0000 7fefc4eca700 1 Processor -- start 2023-10-03T10:17:47.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.904+0000 7fefc4eca700 1 -- start start 2023-10-03T10:17:47.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f95840076c0 con 0x7f958c13d240 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc006f680 0x7fefc009b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0119bc0 con 0x7fefc0130670 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc0119200 con 0x7fefc00701a0 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefc4eca700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fefc013ba70 con 0x7fefc006f680 2023-10-03T10:17:47.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbdd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:47.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48716/0 (socket says 172.21.15.19:48716) 2023-10-03T10:17:47.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbed9d700 1 -- 172.21.15.19:0/1836721390 learned_addr learned my addr 172.21.15.19:0/1836721390 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:47.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbdd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49130/0 (socket says 172.21.15.19:49130) 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbed9d700 1 -- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc006f680 msgr2=0x7fefc009b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.905+0000 7fefbed9d700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc006f680 0x7fefc009b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefbed9d700 1 -- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 msgr2=0x7fefc009b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefbed9d700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefbed9d700 1 -- 172.21.15.19:0/1836721390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009b30 con 0x7fefc0130670 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefbdd9b700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefbed9d700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fefc0072130 tx=0x7fefb8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80048b0 con 0x7fefc0130670 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc0071820 con 0x7fefc0130670 2023-10-03T10:17:47.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb80099b0 con 0x7fefc0130670 2023-10-03T10:17:47.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb801c680 con 0x7fefc0130670 2023-10-03T10:17:47.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.906+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc009d330 con 0x7fefc0130670 2023-10-03T10:17:47.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.907+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefb801c7e0 con 0x7fefc0130670 2023-10-03T10:17:47.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.907+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefb80413e0 con 0x7fefc0130670 2023-10-03T10:17:47.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.911+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc0074ea0 con 0x7fefc0130670 2023-10-03T10:17:47.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:47.919+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefb80257d0 con 0x7fefc0130670 2023-10-03T10:17:48.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.056+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f35dc074ea0 con 0x7f35dc099a40 2023-10-03T10:17:48.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.057+0000 7f35d8ff9700 1 -- 172.21.15.19:0/3472152070 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f35cc030030 con 0x7f35dc099a40 2023-10-03T10:17:48.057 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:48.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 msgr2=0x7f35dc1195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009840 tx=0x7f35cc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:48.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 shutdown_connections 2023-10-03T10:17:48.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f35dc131810 0x7f35dc11a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f35dc099a40 0x7f35dc1195f0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 --2- 172.21.15.19:0/3472152070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f35dc09a3b0 0x7f35dc119b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.059+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 >> 172.21.15.19:0/3472152070 conn(0x7f35dc0a2aa0 msgr2=0x7f35dc12e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.060+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 shutdown_connections 2023-10-03T10:17:48.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.062+0000 7f35e2822700 1 -- 172.21.15.19:0/3472152070 wait complete. 2023-10-03T10:17:48.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.086+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f180006c360 con 0x7f180006a770 2023-10-03T10:17:48.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.087+0000 7f17e7fff700 1 -- 172.21.15.19:0/1600303855 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f17f001a790 con 0x7f180006a770 2023-10-03T10:17:48.087 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 msgr2=0x7f180011c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 shutdown_connections 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1800131d10 0x7f180011ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f180006a770 0x7f180011c410 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 --2- 172.21.15.19:0/1600303855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f180006b080 0x7f180011c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 >> 172.21.15.19:0/1600303855 conn(0x7f1800066f50 msgr2=0x7f18000a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 shutdown_connections 2023-10-03T10:17:48.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.089+0000 7f1806030700 1 -- 172.21.15.19:0/1600303855 wait complete. 2023-10-03T10:17:48.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.135+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f958c09c990 con 0x7f958c13d240 2023-10-03T10:17:48.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.135+0000 7f9588ff9700 1 -- 172.21.15.19:0/1559994189 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9584019070 con 0x7f958c13d240 2023-10-03T10:17:48.135 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:48.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 msgr2=0x7f958c09beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 0x7f958c09beb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f958400bdf0 tx=0x7f9584009ed0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 shutdown_connections 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f958c13d240 0x7f958c09beb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f958c06c0e0 0x7f958c09b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 --2- 172.21.15.19:0/1559994189 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f958c09ac90 0x7f958c09b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.137+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 >> 172.21.15.19:0/1559994189 conn(0x7f958c0a4210 msgr2=0x7f958c0a0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.138+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 shutdown_connections 2023-10-03T10:17:48.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.138+0000 7f95923df700 1 -- 172.21.15.19:0/1559994189 wait complete. 2023-10-03T10:17:48.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.150+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fefc0072210 con 0x7fefc0130670 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.150+0000 7fefaeffd700 1 -- 172.21.15.19:0/1836721390 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefb802db40 con 0x7fefc0130670 2023-10-03T10:17:48.150 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:48.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:48.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 msgr2=0x7fefc009ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fefc0072130 tx=0x7fefb8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 shutdown_connections 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fefc0130670 0x7fefc009ba80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fefc006f680 0x7fefc009b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 --2- 172.21.15.19:0/1836721390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fefc00701a0 0x7fefc009b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.152+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 >> 172.21.15.19:0/1836721390 conn(0x7fefc00a2aa0 msgr2=0x7fefc0139b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.153+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 shutdown_connections 2023-10-03T10:17:48.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:48.153+0000 7fefc4eca700 1 -- 172.21.15.19:0/1836721390 wait complete. 2023-10-03T10:17:48.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:49.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:49.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:49.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:49.167 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:49.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.226+0000 7f8b67c7b700 1 Processor -- start 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 -- start start 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6006fa40 con 0x7f8b6012cf60 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6012cd90 con 0x7f8b60135c20 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b67c7b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60071780 con 0x7f8b6006f5d0 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b66218700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.227+0000 7f8b65216700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49140/0 (socket says 172.21.15.19:49140) 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b66218700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48730/0 (socket says 172.21.15.19:48730) 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 -- 172.21.15.19:0/349073314 learned_addr learned my addr 172.21.15.19:0/349073314 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65a17700 1 --1- 172.21.15.19:0/349073314 >> v1:172.21.15.19:6789/0 conn(0x7f8b6012cf60 0x7f8b6012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49314/0 (socket says 172.21.15.19:49314) 2023-10-03T10:17:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 -- 172.21.15.19:0/349073314 >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 msgr2=0x7f8b60138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 --2- 172.21.15.19:0/349073314 >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 -- 172.21.15.19:0/349073314 >> v1:172.21.15.19:6789/0 conn(0x7f8b6012cf60 legacy=0x7f8b6012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 -- 172.21.15.19:0/349073314 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60071a40 con 0x7f8b6006f5d0 2023-10-03T10:17:49.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b66218700 1 --2- 172.21.15.19:0/349073314 >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b65216700 1 --2- 172.21.15.19:0/349073314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000aa90 tx=0x7f8b5000ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d9340d4c6d6272 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b64a15700 1 -- 172.21.15.19:0/349073314 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5000cb30 con 0x7f8b6006f5d0 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b64a15700 1 -- 172.21.15.19:0/349073314 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5000cc90 con 0x7f8b6006f5d0 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.228+0000 7f8b64a15700 1 -- 172.21.15.19:0/349073314 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50004030 con 0x7f8b6006f5d0 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.229+0000 7f8b67c7b700 1 -- 172.21.15.19:0/349073314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 msgr2=0x7f8b6012ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.229+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/349073314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000aa90 tx=0x7f8b5000ada0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 -- 172.21.15.19:0/349073314 shutdown_connections 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/349073314 >> v2:172.21.15.19:3300/0 conn(0x7f8b60135c20 0x7f8b60138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/349073314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b6012ffc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 -- 172.21.15.19:0/349073314 >> 172.21.15.19:0/349073314 conn(0x7f8b600a2aa0 msgr2=0x7f8b600a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 -- 172.21.15.19:0/349073314 shutdown_connections 2023-10-03T10:17:49.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.231+0000 7f8b67c7b700 1 -- 172.21.15.19:0/349073314 wait complete. 2023-10-03T10:17:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.232+0000 7f8b67c7b700 1 Processor -- start 2023-10-03T10:17:49.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.232+0000 7f8b67c7b700 1 -- start start 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b60133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b60135c20 0x7f8b601c4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60134bf0 con 0x7f8b6012cf60 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60134a00 con 0x7f8b6006f5d0 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b67c7b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60135050 con 0x7f8b60135c20 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b65216700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b65216700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48736/0 (socket says 172.21.15.19:48736) 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.233+0000 7f8b65216700 1 -- 172.21.15.19:0/775297586 learned_addr learned my addr 172.21.15.19:0/775297586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 -- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b60135c20 msgr2=0x7f8b601c4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b60135c20 0x7f8b601c4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 -- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 msgr2=0x7f8b60133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b60133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 -- 172.21.15.19:0/775297586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b58009a70 con 0x7f8b6012cf60 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b65216700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8b600718c0 tx=0x7f8b50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5001d070 con 0x7f8b6012cf60 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5000a6f0 con 0x7f8b6012cf60 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6009aaa0 con 0x7f8b6012cf60 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b500038b0 con 0x7f8b6012cf60 2023-10-03T10:17:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.234+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50003c20 con 0x7f8b6012cf60 2023-10-03T10:17:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.235+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b480052e0 con 0x7f8b6012cf60 2023-10-03T10:17:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.236+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b50021410 con 0x7f8b6012cf60 2023-10-03T10:17:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.236+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b50040950 con 0x7f8b6012cf60 2023-10-03T10:17:49.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.242+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b50017c20 con 0x7f8b6012cf60 2023-10-03T10:17:49.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.272+0000 7ff968b81700 1 Processor -- start 2023-10-03T10:17:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 -- start start 2023-10-03T10:17:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff96412cf60 0x7ff96406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff964130260 0x7ff964136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96412d330 con 0x7ff96412cf60 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96412cd90 con 0x7ff96412f8b0 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.273+0000 7ff968b81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641306d0 con 0x7ff964130260 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49166/0 (socket says 172.21.15.19:49166) 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff962d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff964130260 0x7ff964136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 -- 172.21.15.19:0/2393583896 learned_addr learned my addr 172.21.15.19:0/2393583896 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 -- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff964130260 msgr2=0x7ff964136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 --2- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff964130260 0x7ff964136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 -- 172.21.15.19:0/2393583896 >> v2:172.21.15.19:3300/0 conn(0x7ff96412cf60 msgr2=0x7ff96406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 --2- 172.21.15.19:0/2393583896 >> v2:172.21.15.19:3300/0 conn(0x7ff96412cf60 0x7ff96406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 -- 172.21.15.19:0/2393583896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964071780 con 0x7ff96412f8b0 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff961d9b700 1 --2- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff95800aa90 tx=0x7ff95800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e554335860b8762 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.274+0000 7ff96159a700 1 -- 172.21.15.19:0/2393583896 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cb70 con 0x7ff96412f8b0 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.275+0000 7ff96159a700 1 -- 172.21.15.19:0/2393583896 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800ccd0 con 0x7ff96412f8b0 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.275+0000 7ff96159a700 1 -- 172.21.15.19:0/2393583896 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958018620 con 0x7ff96412f8b0 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 -- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 msgr2=0x7ff96412fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 --2- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff95800aa90 tx=0x7ff95800ada0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 -- 172.21.15.19:0/2393583896 shutdown_connections 2023-10-03T10:17:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 --2- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff964130260 0x7ff964136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 --2- 172.21.15.19:0/2393583896 >> v2:172.21.15.19:3300/0 conn(0x7ff96412cf60 0x7ff96406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 --2- 172.21.15.19:0/2393583896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96412f8b0 0x7ff96412fd20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 -- 172.21.15.19:0/2393583896 >> 172.21.15.19:0/2393583896 conn(0x7ff9640a2aa0 msgr2=0x7ff9640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 -- 172.21.15.19:0/2393583896 shutdown_connections 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.276+0000 7ff968b81700 1 -- 172.21.15.19:0/2393583896 wait complete. 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 Processor -- start 2023-10-03T10:17:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 -- start start 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 0x7ff96409c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff964130260 0x7ff9641c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff964129a00 con 0x7ff96412cf60 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96409b840 con 0x7ff964130260 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff968b81700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff96409e610 con 0x7ff96412f8b0 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.278+0000 7ff96259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48750/0 (socket says 172.21.15.19:48750) 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 -- 172.21.15.19:0/2967542546 learned_addr learned my addr 172.21.15.19:0/2967542546 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff961d9b700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 0x7ff96409c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 -- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 msgr2=0x7ff96409c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 0x7ff96409c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 -- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff964130260 msgr2=0x7ff9641c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff964130260 0x7ff9641c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 -- 172.21.15.19:0/2967542546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95800a6f0 con 0x7ff96412cf60 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff961d9b700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 0x7ff96409c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff96259c700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b530 tx=0x7ff95400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.279+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954011830 con 0x7ff96412cf60 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.280+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540119b0 con 0x7ff96412cf60 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.280+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff964129fa0 con 0x7ff96412cf60 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.280+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954011d60 con 0x7ff96412cf60 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.280+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96409e8d0 con 0x7ff96412cf60 2023-10-03T10:17:49.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.281+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9641191b0 con 0x7ff96412cf60 2023-10-03T10:17:49.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.287+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff95401a400 con 0x7ff96412cf60 2023-10-03T10:17:49.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.287+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff95403fd80 con 0x7ff96412cf60 2023-10-03T10:17:49.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.290+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff95401a6b0 con 0x7ff96412cf60 2023-10-03T10:17:49.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.314+0000 7f870426a700 1 Processor -- start 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.314+0000 7f870426a700 1 -- start start 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f870426a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f870426a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 0x7f86fc1379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f870426a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc134980 con 0x7f86fc137f20 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f870426a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc06c4b0 con 0x7f86fc134ec0 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f870426a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0a09c0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8702006700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8701805700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 0x7f86fc1379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8702006700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49196/0 (socket says 172.21.15.19:49196) 2023-10-03T10:17:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8701805700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 0x7f86fc1379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48766/0 (socket says 172.21.15.19:48766) 2023-10-03T10:17:49.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8702006700 1 -- 172.21.15.19:0/870583936 learned_addr learned my addr 172.21.15.19:0/870583936 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8701004700 1 -- 172.21.15.19:0/870583936 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053737900 0 0) 0x7f86fc134980 con 0x7f86fc137f20 2023-10-03T10:17:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.315+0000 7f8702006700 1 -- 172.21.15.19:0/870583936 >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 msgr2=0x7f86fc1379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8702006700 1 --2- 172.21.15.19:0/870583936 >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 0x7f86fc1379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8702006700 1 -- 172.21.15.19:0/870583936 >> v1:172.21.15.19:6789/0 conn(0x7f86fc137f20 legacy=0x7f86fc13ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8702006700 1 -- 172.21.15.19:0/870583936 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0a0600 con 0x7f86fc06c0e0 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8702006700 1 --2- 172.21.15.19:0/870583936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86f80098f0 tx=0x7f86f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b4cefcca2f5510b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8701004700 1 -- 172.21.15.19:0/870583936 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011830 con 0x7f86fc06c0e0 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8701004700 1 -- 172.21.15.19:0/870583936 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f8011990 con 0x7f86fc06c0e0 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.316+0000 7f8701004700 1 -- 172.21.15.19:0/870583936 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8011d20 con 0x7f86fc06c0e0 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 -- 172.21.15.19:0/870583936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 msgr2=0x7f86fc09ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 --2- 172.21.15.19:0/870583936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f86f80098f0 tx=0x7f86f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 -- 172.21.15.19:0/870583936 shutdown_connections 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 --2- 172.21.15.19:0/870583936 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc06c0e0 0x7f86fc09ac90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 --2- 172.21.15.19:0/870583936 >> v2:172.21.15.19:3300/0 conn(0x7f86fc134ec0 0x7f86fc1379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 -- 172.21.15.19:0/870583936 >> 172.21.15.19:0/870583936 conn(0x7f86fc0a4210 msgr2=0x7f86fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 -- 172.21.15.19:0/870583936 shutdown_connections 2023-10-03T10:17:49.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.317+0000 7f870426a700 1 -- 172.21.15.19:0/870583936 wait complete. 2023-10-03T10:17:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.319+0000 7f870426a700 1 Processor -- start 2023-10-03T10:17:49.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.319+0000 7f870426a700 1 -- start start 2023-10-03T10:17:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc134ec0 0x7f86fc11b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86fc137f20 0x7f86fc11b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc11de90 con 0x7f86fc06c0e0 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc137ab0 con 0x7f86fc134ec0 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f870426a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0a03f0 con 0x7f86fc137f20 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48772/0 (socket says 172.21.15.19:48772) 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 -- 172.21.15.19:0/1462594372 learned_addr learned my addr 172.21.15.19:0/1462594372 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702807700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86fc137f20 0x7f86fc11b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8701805700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc134ec0 0x7f86fc11b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 -- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86fc137f20 msgr2=0x7f86fc11b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86fc137f20 0x7f86fc11b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 -- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc134ec0 msgr2=0x7f86fc11b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc134ec0 0x7f86fc11b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.320+0000 7f8702006700 1 -- 172.21.15.19:0/1462594372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f8009550 con 0x7f86fc06c0e0 2023-10-03T10:17:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f8702006700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f8004240 con 0x7f86fc06c0e0 2023-10-03T10:17:49.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f801f070 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc11c5e0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc11e430 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.321+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f80036a0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.322+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86f8021030 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.322+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f86f80405f0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.323+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc074ea0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.332+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f86f8015080 con 0x7f86fc06c0e0 2023-10-03T10:17:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.363+0000 7f1a869f4700 1 Processor -- start 2023-10-03T10:17:49.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.363+0000 7f1a869f4700 1 -- start start 2023-10-03T10:17:49.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8009e930 0x7f1a8009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009f240 0x7f1a801317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 0x7f1a80131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a80070940 con 0x7f1a8009e930 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8006fd60 con 0x7f1a8009f240 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.364+0000 7f1a869f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a8006fa80 con 0x7f1a8009f650 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8009e930 0x7f1a8009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1a8009e930 0x7f1a8009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48784/0 (socket says 172.21.15.19:48784) 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 -- 172.21.15.19:0/776497563 learned_addr learned my addr 172.21.15.19:0/776497563 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7f7fe700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009f240 0x7f1a801317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a84f91700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 0x7f1a80131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 -- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 msgr2=0x7f1a80131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 0x7f1a80131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 -- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009f240 msgr2=0x7f1a801317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:49.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009f240 0x7f1a801317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 -- 172.21.15.19:0/776497563 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8009fb60 con 0x7f1a8009e930 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a84f91700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 0x7f1a80131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7ffff700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009e930 0x7f1a8009ed00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098f0 tx=0x7f1a70009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b3a61a7deff949 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7effd700 1 -- 172.21.15.19:0/776497563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011830 con 0x7f1a8009e930 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7effd700 1 -- 172.21.15.19:0/776497563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70011990 con 0x7f1a8009e930 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.365+0000 7f1a7effd700 1 -- 172.21.15.19:0/776497563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70011d20 con 0x7f1a8009e930 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 -- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009e930 msgr2=0x7f1a8009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009e930 0x7f1a8009ed00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f1a700098f0 tx=0x7f1a70009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 -- 172.21.15.19:0/776497563 shutdown_connections 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f650 0x7f1a80131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009e930 0x7f1a8009ed00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 --2- 172.21.15.19:0/776497563 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009f240 0x7f1a801317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 -- 172.21.15.19:0/776497563 >> 172.21.15.19:0/776497563 conn(0x7f1a800a4210 msgr2=0x7f1a800a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.366+0000 7f1a869f4700 1 -- 172.21.15.19:0/776497563 shutdown_connections 2023-10-03T10:17:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.367+0000 7f1a869f4700 1 -- 172.21.15.19:0/776497563 wait complete. 2023-10-03T10:17:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.368+0000 7f1a869f4700 1 Processor -- start 2023-10-03T10:17:49.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.368+0000 7f1a869f4700 1 -- start start 2023-10-03T10:17:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 0x7f1a801a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f240 0x7f1a801a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 0x7f1a801a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:49.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a80f0 con 0x7f1a8009f650 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a58c0 con 0x7f1a8009e930 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a869f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a801a7450 con 0x7f1a8009f240 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 0x7f1a801a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a84f91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 0x7f1a801a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a7ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 0x7f1a801a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49210/0 (socket says 172.21.15.19:49210) 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a7ffff700 1 -- 172.21.15.19:0/1065681259 learned_addr learned my addr 172.21.15.19:0/1065681259 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.369+0000 7f1a7f7fe700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f240 0x7f1a801a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 -- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f240 msgr2=0x7f1a801a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f240 0x7f1a801a4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 -- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 msgr2=0x7f1a801a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 0x7f1a801a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 -- 172.21.15.19:0/1065681259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a70009550 con 0x7f1a8009f650 2023-10-03T10:17:49.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a84f91700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 0x7f1a801a4690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007e60 tx=0x7f1a7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7800dd20 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7800f040 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a800a0190 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a78003c60 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.370+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801a6a70 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.371+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1a78004030 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.372+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a801a0b30 con 0x7f1a8009f650 2023-10-03T10:17:49.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.372+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1a7803f700 con 0x7f1a8009f650 2023-10-03T10:17:49.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.377+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1a7801d360 con 0x7f1a8009f650 2023-10-03T10:17:49.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.457+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b48005590 con 0x7f8b6012cf60 2023-10-03T10:17:49.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.457+0000 7f8b567fc700 1 -- 172.21.15.19:0/775297586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b50026070 con 0x7f8b6012cf60 2023-10-03T10:17:49.457 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 msgr2=0x7f8b60133ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8b600718c0 tx=0x7f8b50004750 comp rx=0 tx=0).stop 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 shutdown_connections 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b60135c20 0x7f8b601c4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b6006f5d0 0x7f8b60133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 --2- 172.21.15.19:0/775297586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b6012cf60 0x7f8b60133ec0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 >> 172.21.15.19:0/775297586 conn(0x7f8b600a2aa0 msgr2=0x7f8b6006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 shutdown_connections 2023-10-03T10:17:49.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.460+0000 7f8b67c7b700 1 -- 172.21.15.19:0/775297586 wait complete. 2023-10-03T10:17:49.474 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:49.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.544+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff964074ea0 con 0x7ff96412cf60 2023-10-03T10:17:49.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.544+0000 7ff952ffd700 1 -- 172.21.15.19:0/2967542546 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff954028090 con 0x7ff96412cf60 2023-10-03T10:17:49.544 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:49.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.546+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 msgr2=0x7ff96409bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.546+0000 7ff968b81700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff95400b530 tx=0x7ff95400b8f0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.546+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 shutdown_connections 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.546+0000 7ff968b81700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff964130260 0x7ff9641c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.546+0000 7ff968b81700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96412cf60 0x7ff96409bbd0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.547+0000 7ff968b81700 1 --2- 172.21.15.19:0/2967542546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96412f8b0 0x7ff96409c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.547+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 >> 172.21.15.19:0/2967542546 conn(0x7ff9640a2aa0 msgr2=0x7ff96406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.547+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 shutdown_connections 2023-10-03T10:17:49.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.547+0000 7ff968b81700 1 -- 172.21.15.19:0/2967542546 wait complete. 2023-10-03T10:17:49.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.577+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86fc06b250 con 0x7f86fc06c0e0 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.577+0000 7f86f2ffd700 1 -- 172.21.15.19:0/1462594372 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f86f80199a0 con 0x7f86fc06c0e0 2023-10-03T10:17:49.577 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 msgr2=0x7f86fc11aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8004750 comp rx=0 tx=0).stop 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 shutdown_connections 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86fc137f20 0x7f86fc11b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86fc06c0e0 0x7f86fc11aac0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 --2- 172.21.15.19:0/1462594372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f86fc134ec0 0x7f86fc11b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 >> 172.21.15.19:0/1462594372 conn(0x7f86fc0a4210 msgr2=0x7f86fc06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 shutdown_connections 2023-10-03T10:17:49.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.580+0000 7f870426a700 1 -- 172.21.15.19:0/1462594372 wait complete. 2023-10-03T10:17:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.585+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1a80074ea0 con 0x7f1a8009f650 2023-10-03T10:17:49.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.585+0000 7f1a7cff9700 1 -- 172.21.15.19:0/1065681259 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1a7801a070 con 0x7f1a8009f650 2023-10-03T10:17:49.585 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 msgr2=0x7f1a801a4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 0x7f1a801a4690 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f1a78007e60 tx=0x7f1a7800d3b0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 shutdown_connections 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a8009f650 0x7f1a801a4690 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1a8009e930 0x7f1a801a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 --2- 172.21.15.19:0/1065681259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1a8009f240 0x7f1a801a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 >> 172.21.15.19:0/1065681259 conn(0x7f1a800a4210 msgr2=0x7f1a801b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 shutdown_connections 2023-10-03T10:17:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:49.588+0000 7f1a869f4700 1 -- 172.21.15.19:0/1065681259 wait complete. 2023-10-03T10:17:49.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:49.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:50.475 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:50.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:50.596 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:50.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.628+0000 7f6c80c1e700 1 Processor -- start 2023-10-03T10:17:50.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.628+0000 7f6c80c1e700 1 -- start start 2023-10-03T10:17:50.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c80c1e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6c7c1338c0 0x7f6c7c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c80c1e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c80c1e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c06f720 con 0x7f6c7c09e390 2023-10-03T10:17:50.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c80c1e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c070c80 con 0x7f6c7c1338c0 2023-10-03T10:17:50.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c80c1e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c06fce0 con 0x7f6c7c1341d0 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c79d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c79d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49226/0 (socket says 172.21.15.19:49226) 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c79d9b700 1 -- 172.21.15.19:0/2876816835 learned_addr learned my addr 172.21.15.19:0/2876816835 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c7ad9d700 1 --1- 172.21.15.19:0/2876816835 >> v1:172.21.15.19:6789/0 conn(0x7f6c7c09e390 0x7f6c7c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49332/0 (socket says 172.21.15.19:49332) 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c7a59c700 1 --2- 172.21.15.19:0/2876816835 >> v2:172.21.15.19:3300/0 conn(0x7f6c7c1338c0 0x7f6c7c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.629+0000 7f6c79d9b700 1 -- 172.21.15.19:0/2876816835 >> v2:172.21.15.19:3300/0 conn(0x7f6c7c1338c0 msgr2=0x7f6c7c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c79d9b700 1 --2- 172.21.15.19:0/2876816835 >> v2:172.21.15.19:3300/0 conn(0x7f6c7c1338c0 0x7f6c7c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c79d9b700 1 -- 172.21.15.19:0/2876816835 >> v1:172.21.15.19:6789/0 conn(0x7f6c7c09e390 legacy=0x7f6c7c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c79d9b700 1 -- 172.21.15.19:0/2876816835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c1336a0 con 0x7f6c7c1341d0 2023-10-03T10:17:50.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c7959a700 1 -- 172.21.15.19:0/2876816835 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695186705 0 0) 0x7f6c7c06f720 con 0x7f6c7c09e390 2023-10-03T10:17:50.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c79d9b700 1 --2- 172.21.15.19:0/2876816835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c700098f0 tx=0x7f6c70009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecfb214702a2b8be server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c7959a700 1 -- 172.21.15.19:0/2876816835 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70011830 con 0x7f6c7c1341d0 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c7959a700 1 -- 172.21.15.19:0/2876816835 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c70011990 con 0x7f6c7c1341d0 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.630+0000 7f6c7959a700 1 -- 172.21.15.19:0/2876816835 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70011d20 con 0x7f6c7c1341d0 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 -- 172.21.15.19:0/2876816835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 msgr2=0x7f6c7c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/2876816835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c700098f0 tx=0x7f6c70009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 -- 172.21.15.19:0/2876816835 shutdown_connections 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/2876816835 >> v2:172.21.15.19:3300/0 conn(0x7f6c7c1338c0 0x7f6c7c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/2876816835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c09de50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 -- 172.21.15.19:0/2876816835 >> 172.21.15.19:0/2876816835 conn(0x7f6c7c0a2aa0 msgr2=0x7f6c7c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 -- 172.21.15.19:0/2876816835 shutdown_connections 2023-10-03T10:17:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.631+0000 7f6c80c1e700 1 -- 172.21.15.19:0/2876816835 wait complete. 2023-10-03T10:17:50.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.633+0000 7f6c80c1e700 1 Processor -- start 2023-10-03T10:17:50.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.633+0000 7f6c80c1e700 1 -- start start 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c7c1338c0 0x7f6c7c11acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c11b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c11bc40 con 0x7f6c7c09e390 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c12db60 con 0x7f6c7c1341d0 2023-10-03T10:17:50.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c80c1e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c11d5d0 con 0x7f6c7c1338c0 2023-10-03T10:17:50.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48812/0 (socket says 172.21.15.19:48812) 2023-10-03T10:17:50.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 -- 172.21.15.19:0/417926521 learned_addr learned my addr 172.21.15.19:0/417926521 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7ad9d700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c11b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 -- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c7c1338c0 msgr2=0x7f6c7c11acb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c7c1338c0 0x7f6c7c11acb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 -- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 msgr2=0x7f6c7c11b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c11b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.634+0000 7f6c7a59c700 1 -- 172.21.15.19:0/417926521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70009550 con 0x7f6c7c09e390 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.635+0000 7f6c7a59c700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00e9e0 tx=0x7f6c6c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.635+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c009710 con 0x7f6c7c09e390 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.635+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c00c850 con 0x7f6c7c09e390 2023-10-03T10:17:50.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.635+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00cbc0 con 0x7f6c7c09e390 2023-10-03T10:17:50.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.636+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c11dfb0 con 0x7f6c7c09e390 2023-10-03T10:17:50.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.636+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c11c9a0 con 0x7f6c7c09e390 2023-10-03T10:17:50.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.637+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6c6c00cd20 con 0x7f6c7c09e390 2023-10-03T10:17:50.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.637+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6c6c03f840 con 0x7f6c7c09e390 2023-10-03T10:17:50.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.637+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c06f960 con 0x7f6c7c09e390 2023-10-03T10:17:50.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.646+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6c6c01be10 con 0x7f6c7c09e390 2023-10-03T10:17:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 Processor -- start 2023-10-03T10:17:50.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 -- start start 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f05101304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051006b990 con 0x7f0510133e30 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100a0590 con 0x7f0510133420 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.712+0000 7f0515adf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f051009fb80 con 0x7f0510134260 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49244/0 (socket says 172.21.15.19:49244) 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48824/0 (socket says 172.21.15.19:48824) 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 -- 172.21.15.19:0/1272387999 learned_addr learned my addr 172.21.15.19:0/1272387999 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050ffff700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f05101304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 -- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 msgr2=0x7f05101304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f05101304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 -- 172.21.15.19:0/1272387999 >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 msgr2=0x7f051012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 --2- 172.21.15.19:0/1272387999 >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 -- 172.21.15.19:0/1272387999 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100a0030 con 0x7f0510133420 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050effd700 1 --2- 172.21.15.19:0/1272387999 >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050f7fe700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f05000098f0 tx=0x7f0500009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794b9b7ac06ca738 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.713+0000 7f050e7fc700 1 -- 172.21.15.19:0/1272387999 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011830 con 0x7f0510133420 2023-10-03T10:17:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f050e7fc700 1 -- 172.21.15.19:0/1272387999 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0500011990 con 0x7f0510133420 2023-10-03T10:17:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f050e7fc700 1 -- 172.21.15.19:0/1272387999 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500011d20 con 0x7f0510133420 2023-10-03T10:17:50.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 -- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 msgr2=0x7f05101337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f05000098f0 tx=0x7f0500009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 -- 172.21.15.19:0/1272387999 shutdown_connections 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f05101337f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 --2- 172.21.15.19:0/1272387999 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f05101304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 --2- 172.21.15.19:0/1272387999 >> v2:172.21.15.19:3300/0 conn(0x7f0510133e30 0x7f051012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 -- 172.21.15.19:0/1272387999 >> 172.21.15.19:0/1272387999 conn(0x7f05100a4210 msgr2=0x7f05100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 -- 172.21.15.19:0/1272387999 shutdown_connections 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.714+0000 7f0515adf700 1 -- 172.21.15.19:0/1272387999 wait complete. 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.715+0000 7f0515adf700 1 Processor -- start 2023-10-03T10:17:50.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 -- start start 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0510133e30 0x7f051009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f051009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051011ff60 con 0x7f0510133e30 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051012dc30 con 0x7f0510133420 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f0515adf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f051009e050 con 0x7f0510134260 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f050f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49246/0 (socket says 172.21.15.19:49246) 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f050f7fe700 1 -- 172.21.15.19:0/2975199866 learned_addr learned my addr 172.21.15.19:0/2975199866 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f050effd700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0510133e30 0x7f051009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.716+0000 7f050ffff700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f051009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 -- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 msgr2=0x7f051009d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f051009d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 -- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0510133e30 msgr2=0x7f051009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0510133e30 0x7f051009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 -- 172.21.15.19:0/2975199866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040094a0 con 0x7f0510133420 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f050f7fe700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0500000c00 tx=0x7f0500004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0500004450 con 0x7f0510133420 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05000045b0 con 0x7f0510133420 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0500009550 con 0x7f0510133420 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05000038e0 con 0x7f0510133420 2023-10-03T10:17:50.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.717+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051009e480 con 0x7f0510133420 2023-10-03T10:17:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.718+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05101202c0 con 0x7f0510133420 2023-10-03T10:17:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.718+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0500021070 con 0x7f0510133420 2023-10-03T10:17:50.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.719+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f05000483b0 con 0x7f0510133420 2023-10-03T10:17:50.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.724+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05101202c0 con 0x7f0510133420 2023-10-03T10:17:50.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.759+0000 7fdc20178700 1 Processor -- start 2023-10-03T10:17:50.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.760+0000 7fdc20178700 1 -- start start 2023-10-03T10:17:50.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc20178700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc18133420 0x7fdc181337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc20178700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc181306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc20178700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1806b990 con 0x7fdc18133e30 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc20178700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180a0590 con 0x7fdc18133420 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc20178700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809fb80 con 0x7fdc18134260 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc18133420 0x7fdc181337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1e715700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc181306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc18133420 0x7fdc181337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48852/0 (socket says 172.21.15.19:48852) 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1e715700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc181306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49258/0 (socket says 172.21.15.19:49258) 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 -- 172.21.15.19:0/1638595000 learned_addr learned my addr 172.21.15.19:0/1638595000 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 -- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 msgr2=0x7fdc181306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 --2- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc181306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 -- 172.21.15.19:0/1638595000 >> v1:172.21.15.19:6789/0 conn(0x7fdc18133e30 legacy=0x7fdc1812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.761+0000 7fdc1df14700 1 -- 172.21.15.19:0/1638595000 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180a0030 con 0x7fdc18133420 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.762+0000 7fdc1df14700 1 --2- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133420 0x7fdc181337f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fdc140098f0 tx=0x7fdc14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711fdf6c028d5a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.762+0000 7fdc1cf12700 1 -- 172.21.15.19:0/1638595000 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14011830 con 0x7fdc18133420 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.762+0000 7fdc1cf12700 1 -- 172.21.15.19:0/1638595000 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc14011990 con 0x7fdc18133420 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.762+0000 7fdc1cf12700 1 -- 172.21.15.19:0/1638595000 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14011d20 con 0x7fdc18133420 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 -- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133420 msgr2=0x7fdc181337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 --2- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133420 0x7fdc181337f0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fdc140098f0 tx=0x7fdc14009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 -- 172.21.15.19:0/1638595000 shutdown_connections 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 --2- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc181306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 --2- 172.21.15.19:0/1638595000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133420 0x7fdc181337f0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 -- 172.21.15.19:0/1638595000 >> 172.21.15.19:0/1638595000 conn(0x7fdc180a4210 msgr2=0x7fdc180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 -- 172.21.15.19:0/1638595000 shutdown_connections 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.763+0000 7fdc20178700 1 -- 172.21.15.19:0/1638595000 wait complete. 2023-10-03T10:17:50.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.764+0000 7fdc20178700 1 Processor -- start 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.764+0000 7fdc20178700 1 -- start start 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 0x7fdc1809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc1809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809d850 con 0x7fdc18133e30 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1809e0a0 con 0x7fdc18134260 2023-10-03T10:17:50.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc20178700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1812d870 con 0x7fdc18133420 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc1df14700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc1df14700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58544/0 (socket says 172.21.15.19:58544) 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc1df14700 1 -- 172.21.15.19:0/2838670479 learned_addr learned my addr 172.21.15.19:0/2838670479 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.765+0000 7fdc1e715700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc1809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1d713700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 0x7fdc1809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 -- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 msgr2=0x7fdc1809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc1809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 -- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 msgr2=0x7fdc1809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 0x7fdc1809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 -- 172.21.15.19:0/2838670479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14009550 con 0x7fdc18133420 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1d713700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 0x7fdc1809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1df14700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc14000c00 tx=0x7fdc14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc1e715700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc1809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14004480 con 0x7fdc18133420 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1401f070 con 0x7fdc18133420 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1811fe30 con 0x7fdc18133420 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc140038a0 con 0x7fdc18133420 2023-10-03T10:17:50.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.766+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1812d3b0 con 0x7fdc18133420 2023-10-03T10:17:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.767+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc18131400 con 0x7fdc18133420 2023-10-03T10:17:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.768+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc14021030 con 0x7fdc18133420 2023-10-03T10:17:50.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.768+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc14040e60 con 0x7fdc18133420 2023-10-03T10:17:50.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.775+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc140199a0 con 0x7fdc18133420 2023-10-03T10:17:50.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.801+0000 7fef1c2fd700 1 Processor -- start 2023-10-03T10:17:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.801+0000 7fef1c2fd700 1 -- start start 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1c2fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef140a1510 0x7fef14138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1c2fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef1413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1c2fd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1409edd0 con 0x7fef140a0a30 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1c2fd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef140a18e0 con 0x7fef140a1510 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1c2fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef1409e1f0 con 0x7fef14139250 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19898700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef140a1510 0x7fef14138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1a099700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fef140a0a30 0x7fef140a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49356/0 (socket says 172.21.15.19:49356) 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1a099700 1 -- 172.21.15.19:0/719161748 learned_addr learned my addr 172.21.15.19:0/719161748 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef1a89a700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef1413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19898700 1 -- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 msgr2=0x7fef1413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:50.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19898700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef1413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19898700 1 -- 172.21.15.19:0/719161748 >> v1:172.21.15.19:6789/0 conn(0x7fef140a0a30 legacy=0x7fef140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19898700 1 -- 172.21.15.19:0/719161748 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1409dc50 con 0x7fef140a1510 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.802+0000 7fef19097700 1 -- 172.21.15.19:0/719161748 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076737424 0 0) 0x7fef1409edd0 con 0x7fef140a0a30 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.803+0000 7fef1a89a700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef1413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.803+0000 7fef19898700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14138d10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fef04009840 tx=0x7fef04009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548d7807d55227a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.803+0000 7fef19097700 1 -- 172.21.15.19:0/719161748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04011830 con 0x7fef140a1510 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.803+0000 7fef19097700 1 -- 172.21.15.19:0/719161748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04011990 con 0x7fef140a1510 2023-10-03T10:17:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.803+0000 7fef19097700 1 -- 172.21.15.19:0/719161748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04011d20 con 0x7fef140a1510 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 -- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 msgr2=0x7fef14138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14138d10 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fef04009840 tx=0x7fef04009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 -- 172.21.15.19:0/719161748 shutdown_connections 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef1413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/719161748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14138d10 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 -- 172.21.15.19:0/719161748 >> 172.21.15.19:0/719161748 conn(0x7fef140a6550 msgr2=0x7fef140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 -- 172.21.15.19:0/719161748 shutdown_connections 2023-10-03T10:17:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.804+0000 7fef1c2fd700 1 -- 172.21.15.19:0/719161748 wait complete. 2023-10-03T10:17:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.805+0000 7fef1c2fd700 1 Processor -- start 2023-10-03T10:17:50.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.805+0000 7fef1c2fd700 1 -- start start 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef140a0a30 0x7fef141228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef14123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef141389e0 con 0x7fef140a1510 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef140a0220 con 0x7fef140a0a30 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1c2fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef14126060 con 0x7fef14139250 2023-10-03T10:17:50.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef19898700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef19898700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48886/0 (socket says 172.21.15.19:48886) 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef19898700 1 -- 172.21.15.19:0/3762026440 learned_addr learned my addr 172.21.15.19:0/3762026440 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1a89a700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef14123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.806+0000 7fef1a099700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef140a0a30 0x7fef141228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 -- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 msgr2=0x7fef14123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef14123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 -- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef140a0a30 msgr2=0x7fef141228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef140a0a30 0x7fef141228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 -- 172.21.15.19:0/3762026440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c009a70 con 0x7fef140a1510 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef1a89a700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef14123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef19898700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fef04009fd0 tx=0x7fef04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef040038a0 con 0x7fef140a1510 2023-10-03T10:17:50.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0401f070 con 0x7fef140a1510 2023-10-03T10:17:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04003c00 con 0x7fef140a1510 2023-10-03T10:17:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef040094a0 con 0x7fef140a1510 2023-10-03T10:17:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.807+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef14124bb0 con 0x7fef140a1510 2023-10-03T10:17:50.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.808+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef0401a430 con 0x7fef140a1510 2023-10-03T10:17:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.808+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef04021070 con 0x7fef140a1510 2023-10-03T10:17:50.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.809+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef14074ea0 con 0x7fef140a1510 2023-10-03T10:17:50.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.818+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef04015080 con 0x7fef140a1510 2023-10-03T10:17:50.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.912+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6c7c074ea0 con 0x7f6c7c09e390 2023-10-03T10:17:50.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.912+0000 7f6c6affd700 1 -- 172.21.15.19:0/417926521 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c6c02a090 con 0x7f6c7c09e390 2023-10-03T10:17:50.912 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:50.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.914+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 msgr2=0x7f6c7c11a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.914+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00e9e0 tx=0x7f6c6c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 shutdown_connections 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6c7c1341d0 0x7f6c7c11b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c7c09e390 0x7f6c7c11a770 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 --2- 172.21.15.19:0/417926521 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6c7c1338c0 0x7f6c7c11acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 >> 172.21.15.19:0/417926521 conn(0x7f6c7c0a2aa0 msgr2=0x7f6c7c12f500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 shutdown_connections 2023-10-03T10:17:50.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.915+0000 7f6c80c1e700 1 -- 172.21.15.19:0/417926521 wait complete. 2023-10-03T10:17:50.933 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:50.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.950+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f05101202c0 con 0x7f0510133420 2023-10-03T10:17:50.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.950+0000 7f04f7fff700 1 -- 172.21.15.19:0/2975199866 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0500029020 con 0x7f0510133420 2023-10-03T10:17:50.950 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.952+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 msgr2=0x7f051009c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.952+0000 7f0515adf700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0500000c00 tx=0x7f0500004750 comp rx=0 tx=0).stop 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 shutdown_connections 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0510134260 0x7f051009d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0510133420 0x7f051009c6e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 --2- 172.21.15.19:0/2975199866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0510133e30 0x7f051009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 >> 172.21.15.19:0/2975199866 conn(0x7f05100a4210 msgr2=0x7f05100a2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 shutdown_connections 2023-10-03T10:17:50.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.953+0000 7f0515adf700 1 -- 172.21.15.19:0/2975199866 wait complete. 2023-10-03T10:17:50.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.996+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc18074ea0 con 0x7fdc18133420 2023-10-03T10:17:50.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.996+0000 7fdc0e7fc700 1 -- 172.21.15.19:0/2838670479 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc14015030 con 0x7fdc18133420 2023-10-03T10:17:50.996 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 msgr2=0x7fdc1809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdc14000c00 tx=0x7fdc14004750 comp rx=0 tx=0).stop 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 shutdown_connections 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc18134260 0x7fdc1809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc18133420 0x7fdc1809c480 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:50.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 --2- 172.21.15.19:0/2838670479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc18133e30 0x7fdc1809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 >> 172.21.15.19:0/2838670479 conn(0x7fdc180a4210 msgr2=0x7fdc180a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 shutdown_connections 2023-10-03T10:17:51.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:50.999+0000 7fdc20178700 1 -- 172.21.15.19:0/2838670479 wait complete. 2023-10-03T10:17:51.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.028+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef140a28e0 con 0x7fef140a1510 2023-10-03T10:17:51.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.029+0000 7fef0affd700 1 -- 172.21.15.19:0/3762026440 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef04035090 con 0x7fef140a1510 2023-10-03T10:17:51.029 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 msgr2=0x7fef14122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:51.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fef04009fd0 tx=0x7fef04004750 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 shutdown_connections 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef14139250 0x7fef14123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef140a0a30 0x7fef141228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 --2- 172.21.15.19:0/3762026440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef140a1510 0x7fef14122e00 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 >> 172.21.15.19:0/3762026440 conn(0x7fef140a6550 msgr2=0x7fef140a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 shutdown_connections 2023-10-03T10:17:51.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:51.031+0000 7fef1c2fd700 1 -- 172.21.15.19:0/3762026440 wait complete. 2023-10-03T10:17:51.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:51.934 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:51.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:52.013 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:52.045 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:52.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.084+0000 7f892b251700 1 Processor -- start 2023-10-03T10:17:52.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.084+0000 7f892b251700 1 -- start start 2023-10-03T10:17:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f892b251700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f892b251700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 0x7f8924137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f892b251700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f892412cd90 con 0x7f892412f8b0 2023-10-03T10:17:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f892b251700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892412d330 con 0x7f8924130430 2023-10-03T10:17:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f892b251700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8924071780 con 0x7f892412cf60 2023-10-03T10:17:52.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f8923fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f892412f8b0 0x7f892412fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49368/0 (socket says 172.21.15.19:49368) 2023-10-03T10:17:52.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f8923fff700 1 -- 172.21.15.19:0/3551432701 learned_addr learned my addr 172.21.15.19:0/3551432701 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:52.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f89297ee700 1 --2- 172.21.15.19:0/3551432701 >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 0x7f8924137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.085+0000 7f8928fed700 1 --2- 172.21.15.19:0/3551432701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f8928fed700 1 -- 172.21.15.19:0/3551432701 >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 msgr2=0x7f8924137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f8928fed700 1 --2- 172.21.15.19:0/3551432701 >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 0x7f8924137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f8928fed700 1 -- 172.21.15.19:0/3551432701 >> v1:172.21.15.19:6789/0 conn(0x7f892412f8b0 legacy=0x7f892412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f89237fe700 1 -- 172.21.15.19:0/3551432701 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619585008 0 0) 0x7f892412cd90 con 0x7f892412f8b0 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f8928fed700 1 -- 172.21.15.19:0/3551432701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8924071a40 con 0x7f892412cf60 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f89297ee700 1 --2- 172.21.15.19:0/3551432701 >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 0x7f8924137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f8928fed700 1 --2- 172.21.15.19:0/3551432701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892406f5d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f891800bae0 tx=0x7f891800bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa5d4cac1d63574 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f89237fe700 1 -- 172.21.15.19:0/3551432701 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891800dc70 con 0x7f892412cf60 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f89237fe700 1 -- 172.21.15.19:0/3551432701 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891800ddd0 con 0x7f892412cf60 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.086+0000 7f89237fe700 1 -- 172.21.15.19:0/3551432701 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918010690 con 0x7f892412cf60 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 -- 172.21.15.19:0/3551432701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 msgr2=0x7f892406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 --2- 172.21.15.19:0/3551432701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892406f5d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f891800bae0 tx=0x7f891800bdf0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 -- 172.21.15.19:0/3551432701 shutdown_connections 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 --2- 172.21.15.19:0/3551432701 >> v2:172.21.15.19:3300/0 conn(0x7f8924130430 0x7f8924137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 --2- 172.21.15.19:0/3551432701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892406f5d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 -- 172.21.15.19:0/3551432701 >> 172.21.15.19:0/3551432701 conn(0x7f89240a2aa0 msgr2=0x7f89240a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.087+0000 7f892b251700 1 -- 172.21.15.19:0/3551432701 shutdown_connections 2023-10-03T10:17:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.088+0000 7f892b251700 1 -- 172.21.15.19:0/3551432701 wait complete. 2023-10-03T10:17:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.089+0000 7f892b251700 1 Processor -- start 2023-10-03T10:17:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.089+0000 7f892b251700 1 -- start start 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f892412f8b0 0x7f892409b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 0x7f892409bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892409e7e0 con 0x7f8924130430 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892409cea0 con 0x7f892412cf60 2023-10-03T10:17:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f892b251700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f892409e0c0 con 0x7f892412f8b0 2023-10-03T10:17:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f8928fed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f8928fed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49294/0 (socket says 172.21.15.19:49294) 2023-10-03T10:17:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f8928fed700 1 -- 172.21.15.19:0/2155740401 learned_addr learned my addr 172.21.15.19:0/2155740401 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.090+0000 7f89297ee700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 0x7f892409bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 -- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f892412f8b0 msgr2=0x7f892409b7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f892412f8b0 0x7f892409b7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 -- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 msgr2=0x7f892409bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 0x7f892409bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 -- 172.21.15.19:0/2155740401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c00a980 con 0x7f892412cf60 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f89297ee700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 0x7f892409bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f8928fed700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f891800b2c0 tx=0x7f8918004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891801d070 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918010680 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891800b740 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918010a40 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.091+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892409ea30 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.092+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f89180036a0 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.093+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8924074ea0 con 0x7f892412cf60 2023-10-03T10:17:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.093+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f89180409c0 con 0x7f892412cf60 2023-10-03T10:17:52.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.098+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8918021790 con 0x7f892412cf60 2023-10-03T10:17:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.134+0000 7fe5363f3700 1 Processor -- start 2023-10-03T10:17:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.134+0000 7fe5363f3700 1 -- start start 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe5363f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009d6f0 0x7fe53009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe5363f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe5363f3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53009f130 con 0x7fe53009e000 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe5363f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53009f520 con 0x7fe53009e410 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe5363f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe53009e930 con 0x7fe53009d6f0 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe534990700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009d6f0 0x7fe53009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe534990700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49306/0 (socket says 172.21.15.19:49306) 2023-10-03T10:17:52.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.135+0000 7fe534990700 1 -- 172.21.15.19:0/1479449946 learned_addr learned my addr 172.21.15.19:0/1479449946 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:52.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe534990700 1 -- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009d6f0 msgr2=0x7fe53009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe534990700 1 --2- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009d6f0 0x7fe53009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe534990700 1 -- 172.21.15.19:0/1479449946 >> v1:172.21.15.19:6789/0 conn(0x7fe53009e000 legacy=0x7fe530130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe52effd700 1 -- 172.21.15.19:0/1479449946 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214855884 0 0) 0x7fe53009f130 con 0x7fe53009e000 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe534990700 1 -- 172.21.15.19:0/1479449946 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53009b2d0 con 0x7fe53009e410 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe534990700 1 --2- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe52800bf60 tx=0x7fe52800bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06a71c69700ccbd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe52effd700 1 -- 172.21.15.19:0/1479449946 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800b4e0 con 0x7fe53009e410 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe52effd700 1 -- 172.21.15.19:0/1479449946 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52800da30 con 0x7fe53009e410 2023-10-03T10:17:52.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.136+0000 7fe52effd700 1 -- 172.21.15.19:0/1479449946 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800dde0 con 0x7fe53009e410 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 -- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 msgr2=0x7fe530130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 --2- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe52800bf60 tx=0x7fe52800bf90 comp rx=0 tx=0).stop 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 -- 172.21.15.19:0/1479449946 shutdown_connections 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 --2- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009e410 0x7fe530130d70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 --2- 172.21.15.19:0/1479449946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009d6f0 0x7fe53009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 -- 172.21.15.19:0/1479449946 >> 172.21.15.19:0/1479449946 conn(0x7fe530066f50 msgr2=0x7fe53009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 -- 172.21.15.19:0/1479449946 shutdown_connections 2023-10-03T10:17:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.137+0000 7fe5363f3700 1 -- 172.21.15.19:0/1479449946 wait complete. 2023-10-03T10:17:52.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.139+0000 7fe5363f3700 1 Processor -- start 2023-10-03T10:17:52.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.139+0000 7fe5363f3700 1 -- start start 2023-10-03T10:17:52.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 0x7fe5301300b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 0x7fe53011dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 0x7fe53011e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301221b0 con 0x7fe53009e410 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5301217f0 con 0x7fe53009d6f0 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe5363f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe530120f80 con 0x7fe53009e000 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 0x7fe5301300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe52ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 0x7fe5301300b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49314/0 (socket says 172.21.15.19:49314) 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe52ffff700 1 -- 172.21.15.19:0/3404024825 learned_addr learned my addr 172.21.15.19:0/3404024825 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe52f7fe700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 0x7fe53011dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 0x7fe53011e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 -- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 msgr2=0x7fe53011dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 0x7fe53011dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 -- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 msgr2=0x7fe5301300b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 0x7fe5301300b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.140+0000 7fe534990700 1 -- 172.21.15.19:0/3404024825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52800bd40 con 0x7fe53009e410 2023-10-03T10:17:52.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe52f7fe700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 0x7fe53011dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe534990700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 0x7fe53011e2a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe528019000 tx=0x7fe528004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52800b4e0 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe528025850 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe530120b30 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe528025be0 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.141+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5300a3bf0 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.142+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe528025d40 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.142+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5301211b0 con 0x7fe53009e410 2023-10-03T10:17:52.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.143+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe5280494d0 con 0x7fe53009e410 2023-10-03T10:17:52.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.148+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe5301211b0 con 0x7fe53009e410 2023-10-03T10:17:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 Processor -- start 2023-10-03T10:17:52.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 -- start start 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06a770 0x7f244c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f244c09ece0 con 0x7f244c06b080 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c09e760 con 0x7f244c131d10 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f245215e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244c09e040 con 0x7f244c06a770 2023-10-03T10:17:52.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f244affd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f244c06b080 0x7f244c131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49384/0 (socket says 172.21.15.19:49384) 2023-10-03T10:17:52.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.180+0000 7f244affd700 1 -- 172.21.15.19:0/1075602953 learned_addr learned my addr 172.21.15.19:0/1075602953 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244b7fe700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06a770 0x7f244c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244a7fc700 1 -- 172.21.15.19:0/1075602953 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159705582 0 0) 0x7f244c09ece0 con 0x7f244c06b080 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244a7fc700 1 -- 172.21.15.19:0/1075602953 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24340035b0 con 0x7f244c06b080 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 -- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06a770 msgr2=0x7f244c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06a770 0x7f244c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 -- 172.21.15.19:0/1075602953 >> v1:172.21.15.19:6789/0 conn(0x7f244c06b080 legacy=0x7f244c131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 -- 172.21.15.19:0/1075602953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c09f630 con 0x7f244c131d10 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.181+0000 7f244bfff700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c139860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2444009dc0 tx=0x7f244400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4078753246cbbf2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f244a7fc700 1 -- 172.21.15.19:0/1075602953 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244400e070 con 0x7f244c131d10 2023-10-03T10:17:52.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f244a7fc700 1 -- 172.21.15.19:0/1075602953 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244400bb20 con 0x7f244c131d10 2023-10-03T10:17:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f244a7fc700 1 -- 172.21.15.19:0/1075602953 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444012430 con 0x7f244c131d10 2023-10-03T10:17:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 -- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 msgr2=0x7f244c139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c139860 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2444009dc0 tx=0x7f244400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 -- 172.21.15.19:0/1075602953 shutdown_connections 2023-10-03T10:17:52.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c139860 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 --2- 172.21.15.19:0/1075602953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06a770 0x7f244c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.182+0000 7f245215e700 1 -- 172.21.15.19:0/1075602953 >> 172.21.15.19:0/1075602953 conn(0x7f244c066f50 msgr2=0x7f244c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.183+0000 7f245215e700 1 -- 172.21.15.19:0/1075602953 shutdown_connections 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.183+0000 7f245215e700 1 -- 172.21.15.19:0/1075602953 wait complete. 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.184+0000 7f245215e700 1 Processor -- start 2023-10-03T10:17:52.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.184+0000 7f245215e700 1 -- start start 2023-10-03T10:17:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06b080 0x7f244c09b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c1c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c125bb0 con 0x7f244c06a770 2023-10-03T10:17:52.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244c131600 con 0x7f244c131d10 2023-10-03T10:17:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f245215e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f244c071e60 con 0x7f244c06b080 2023-10-03T10:17:52.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f244b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f244b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48910/0 (socket says 172.21.15.19:48910) 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f244b7fe700 1 -- 172.21.15.19:0/2361993348 learned_addr learned my addr 172.21.15.19:0/2361993348 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f244bfff700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c1c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.185+0000 7f244affd700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06b080 0x7f244c09b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 -- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06b080 msgr2=0x7f244c09b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06b080 0x7f244c09b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 -- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 msgr2=0x7f244c09ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 -- 172.21.15.19:0/2361993348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2444009a70 con 0x7f244c131d10 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244b7fe700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f244bfff700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c1c7fa0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2444016000 tx=0x7f2444004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444004800 con 0x7f244c131d10 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444020070 con 0x7f244c131d10 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c09c020 con 0x7f244c131d10 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.186+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24440276c0 con 0x7f244c131d10 2023-10-03T10:17:52.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.187+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c09b7c0 con 0x7f244c131d10 2023-10-03T10:17:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.188+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c074ea0 con 0x7f244c131d10 2023-10-03T10:17:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.188+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2444012430 con 0x7f244c131d10 2023-10-03T10:17:52.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.188+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2444022070 con 0x7f244c131d10 2023-10-03T10:17:52.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.197+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2444003e30 con 0x7f244c131d10 2023-10-03T10:17:52.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.227+0000 7f3a48498700 1 Processor -- start 2023-10-03T10:17:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.227+0000 7f3a48498700 1 -- start start 2023-10-03T10:17:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a48498700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a4009e240 0x7f3a40138c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a48498700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a401391a0 0x7f3a4013b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a48498700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4006b0a0 con 0x7f3a4009d760 2023-10-03T10:17:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a48498700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4006b6d0 con 0x7f3a4009e240 2023-10-03T10:17:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a48498700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4009b1c0 con 0x7f3a401391a0 2023-10-03T10:17:52.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45a33700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3a4009e240 0x7f3a40138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a46234700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3a4009d760 0x7f3a4009db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49392/0 (socket says 172.21.15.19:49392) 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a46234700 1 -- 172.21.15.19:0/613360068 learned_addr learned my addr 172.21.15.19:0/613360068 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a46a35700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a401391a0 0x7f3a4013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45a33700 1 -- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a401391a0 msgr2=0x7f3a4013b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45a33700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a401391a0 0x7f3a4013b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45a33700 1 -- 172.21.15.19:0/613360068 >> v1:172.21.15.19:6789/0 conn(0x7f3a4009d760 legacy=0x7f3a4009db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45232700 1 -- 172.21.15.19:0/613360068 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366408841 0 0) 0x7f3a4006b0a0 con 0x7f3a4009d760 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.228+0000 7f3a45a33700 1 -- 172.21.15.19:0/613360068 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4006b490 con 0x7f3a4009e240 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a45a33700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a4009e240 0x7f3a40138c60 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a30009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b52a4186fe635c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a45232700 1 -- 172.21.15.19:0/613360068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30005e30 con 0x7f3a4009e240 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a45232700 1 -- 172.21.15.19:0/613360068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a30006030 con 0x7f3a4009e240 2023-10-03T10:17:52.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a45232700 1 -- 172.21.15.19:0/613360068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a300063c0 con 0x7f3a4009e240 2023-10-03T10:17:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a48498700 1 -- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a4009e240 msgr2=0x7f3a40138c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.229+0000 7f3a48498700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a4009e240 0x7f3a40138c60 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009820 tx=0x7f3a30009b30 comp rx=0 tx=0).stop 2023-10-03T10:17:52.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 -- 172.21.15.19:0/613360068 shutdown_connections 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a401391a0 0x7f3a4013b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 --2- 172.21.15.19:0/613360068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a4009e240 0x7f3a40138c60 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 -- 172.21.15.19:0/613360068 >> 172.21.15.19:0/613360068 conn(0x7f3a40066f50 msgr2=0x7f3a400a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 -- 172.21.15.19:0/613360068 shutdown_connections 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.230+0000 7f3a48498700 1 -- 172.21.15.19:0/613360068 wait complete. 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 Processor -- start 2023-10-03T10:17:52.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 -- start start 2023-10-03T10:17:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a4009d760 0x7f3a4011e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.232 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 0x7f3a4011ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a400a22b0 con 0x7f3a401391a0 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a401205f0 con 0x7f3a4009e240 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a48498700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a40120a90 con 0x7f3a4009d760 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a46a35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a46a35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48926/0 (socket says 172.21.15.19:48926) 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a46a35700 1 -- 172.21.15.19:0/4251670390 learned_addr learned my addr 172.21.15.19:0/4251670390 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.231+0000 7f3a46234700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a4009d760 0x7f3a4011e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a45a33700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 0x7f3a4011ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 -- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a4009d760 msgr2=0x7f3a4011e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a4009d760 0x7f3a4011e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 -- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 msgr2=0x7f3a4011ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 0x7f3a4011ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 -- 172.21.15.19:0/4251670390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30009430 con 0x7f3a401391a0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a45a33700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 0x7f3a4011ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a46a35700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800efc0 tx=0x7f3a3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cd40 con 0x7f3a401391a0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800f040 con 0x7f3a401391a0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a40121e50 con 0x7f3a401391a0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a40120cd0 con 0x7f3a401391a0 2023-10-03T10:17:52.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.232+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a380146c0 con 0x7f3a401391a0 2023-10-03T10:17:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.234+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3a38014820 con 0x7f3a401391a0 2023-10-03T10:17:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.234+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a280052e0 con 0x7f3a401391a0 2023-10-03T10:17:52.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.234+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3a380402f0 con 0x7f3a401391a0 2023-10-03T10:17:52.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.243+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3a38007900 con 0x7f3a401391a0 2023-10-03T10:17:52.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.319+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f892412ede0 con 0x7f892412cf60 2023-10-03T10:17:52.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.319+0000 7f89217fa700 1 -- 172.21.15.19:0/2155740401 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8918007040 con 0x7f892412cf60 2023-10-03T10:17:52.319 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:52.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.321+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 msgr2=0x7f892409b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.321+0000 7f892b251700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f891800b2c0 tx=0x7f8918004750 comp rx=0 tx=0).stop 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 shutdown_connections 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8924130430 0x7f892409bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f892412cf60 0x7f892409b290 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 --2- 172.21.15.19:0/2155740401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f892412f8b0 0x7f892409b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 >> 172.21.15.19:0/2155740401 conn(0x7f89240a2aa0 msgr2=0x7f892412a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 shutdown_connections 2023-10-03T10:17:52.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.322+0000 7f892b251700 1 -- 172.21.15.19:0/2155740401 wait complete. 2023-10-03T10:17:52.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:52.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.385+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5301211b0 con 0x7fe53009e410 2023-10-03T10:17:52.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.386+0000 7fe52cff9700 1 -- 172.21.15.19:0/3404024825 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5301211b0 con 0x7fe53009e410 2023-10-03T10:17:52.386 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 msgr2=0x7fe53011e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 0x7fe53011e2a0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fe528019000 tx=0x7fe528004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 shutdown_connections 2023-10-03T10:17:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe53009e410 0x7fe53011e2a0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe53009d6f0 0x7fe5301300b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 --2- 172.21.15.19:0/3404024825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe53009e000 0x7fe53011dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 >> 172.21.15.19:0/3404024825 conn(0x7fe530066f50 msgr2=0x7fe530130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 shutdown_connections 2023-10-03T10:17:52.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.388+0000 7fe5363f3700 1 -- 172.21.15.19:0/3404024825 wait complete. 2023-10-03T10:17:52.402 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:52.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.408+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f244c06c360 con 0x7f244c131d10 2023-10-03T10:17:52.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.408+0000 7f2433fff700 1 -- 172.21.15.19:0/2361993348 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f244401ab70 con 0x7f244c131d10 2023-10-03T10:17:52.408 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 msgr2=0x7f244c1c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c1c7fa0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2444016000 tx=0x7f2444004ad0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 shutdown_connections 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f244c131d10 0x7f244c1c7fa0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f244c06a770 0x7f244c09ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 --2- 172.21.15.19:0/2361993348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f244c06b080 0x7f244c09b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 >> 172.21.15.19:0/2361993348 conn(0x7f244c066f50 msgr2=0x7f244c06ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 shutdown_connections 2023-10-03T10:17:52.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.411+0000 7f245215e700 1 -- 172.21.15.19:0/2361993348 wait complete. 2023-10-03T10:17:52.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.452+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a28005150 con 0x7f3a401391a0 2023-10-03T10:17:52.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.453+0000 7f3a36ffd700 1 -- 172.21.15.19:0/4251670390 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3a38009ca0 con 0x7f3a401391a0 2023-10-03T10:17:52.452 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 msgr2=0x7f3a4011f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800efc0 tx=0x7f3a3800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 shutdown_connections 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a401391a0 0x7f3a4011f3a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3a4009d760 0x7f3a4011e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 --2- 172.21.15.19:0/4251670390 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3a4009e240 0x7f3a4011ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:52.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 >> 172.21.15.19:0/4251670390 conn(0x7f3a40066f50 msgr2=0x7f3a40138130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:52.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 shutdown_connections 2023-10-03T10:17:52.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:52.455+0000 7f3a48498700 1 -- 172.21.15.19:0/4251670390 wait complete. 2023-10-03T10:17:52.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:53.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:53.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:53.425 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:53.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.493+0000 7fdae1d30700 1 Processor -- start 2023-10-03T10:17:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.493+0000 7fdae1d30700 1 -- start start 2023-10-03T10:17:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdae1d30700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 0x7fdadc138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdae1d30700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdadc138dc0 0x7fdadc13b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdae1d30700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc06b990 con 0x7fdadc133420 2023-10-03T10:17:53.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdae1d30700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc09b0e0 con 0x7fdadc138dc0 2023-10-03T10:17:53.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdae1d30700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc133c20 con 0x7fdadc1337f0 2023-10-03T10:17:53.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdadb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdadc133420 0x7fdadc133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49394/0 (socket says 172.21.15.19:49394) 2023-10-03T10:17:53.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdadb7fe700 1 -- 172.21.15.19:0/4074173940 learned_addr learned my addr 172.21.15.19:0/4074173940 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:53.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.494+0000 7fdadbfff700 1 --2- 172.21.15.19:0/4074173940 >> v2:172.21.15.19:3300/0 conn(0x7fdadc138dc0 0x7fdadc13b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadaffd700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 0x7fdadc138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadbfff700 1 -- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 msgr2=0x7fdadc138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadbfff700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 0x7fdadc138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadbfff700 1 -- 172.21.15.19:0/4074173940 >> v1:172.21.15.19:6789/0 conn(0x7fdadc133420 legacy=0x7fdadc133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadbfff700 1 -- 172.21.15.19:0/4074173940 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0a0590 con 0x7fdadc138dc0 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadaffd700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 0x7fdadc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:53.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdadbfff700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc13b1a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59de930edf98921e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdada7fc700 1 -- 172.21.15.19:0/4074173940 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400e070 con 0x7fdadc138dc0 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdada7fc700 1 -- 172.21.15.19:0/4074173940 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400bbd0 con 0x7fdadc138dc0 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.495+0000 7fdada7fc700 1 -- 172.21.15.19:0/4074173940 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4012430 con 0x7fdadc138dc0 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 -- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 msgr2=0x7fdadc13b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc13b1a0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009d90 tx=0x7fdad400b330 comp rx=0 tx=0).stop 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 -- 172.21.15.19:0/4074173940 shutdown_connections 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc13b1a0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 --2- 172.21.15.19:0/4074173940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc1337f0 0x7fdadc138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 -- 172.21.15.19:0/4074173940 >> 172.21.15.19:0/4074173940 conn(0x7fdadc0a4210 msgr2=0x7fdadc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 -- 172.21.15.19:0/4074173940 shutdown_connections 2023-10-03T10:17:53.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.496+0000 7fdae1d30700 1 -- 172.21.15.19:0/4074173940 wait complete. 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.498+0000 7fdae1d30700 1 Processor -- start 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.498+0000 7fdae1d30700 1 -- start start 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdadc1337f0 0x7fdadc12f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc12fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc09dc90 con 0x7fdadc138dc0 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc09ca70 con 0x7fdadc133420 2023-10-03T10:17:53.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdae1d30700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1388a0 con 0x7fdadc1337f0 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49362/0 (socket says 172.21.15.19:49362) 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 -- 172.21.15.19:0/45273726 learned_addr learned my addr 172.21.15.19:0/45273726 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadaffd700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdadc1337f0 0x7fdadc12f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 -- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdadc1337f0 msgr2=0x7fdadc12f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdadc1337f0 0x7fdadc12f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 -- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 msgr2=0x7fdadc12fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc12fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.499+0000 7fdadb7fe700 1 -- 172.21.15.19:0/45273726 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4009a70 con 0x7fdadc133420 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdadb7fe700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c520 tx=0x7fdacc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc005d70 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc0070d0 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc007440 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc09c710 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.500+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc09d510 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.501+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc09f130 con 0x7fdadc133420 2023-10-03T10:17:53.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.502+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdacc0075a0 con 0x7fdadc133420 2023-10-03T10:17:53.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.502+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdacc03eb80 con 0x7fdadc133420 2023-10-03T10:17:53.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.509+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdacc011d70 con 0x7fdadc133420 2023-10-03T10:17:53.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.572+0000 7fd19e7ef700 1 Processor -- start 2023-10-03T10:17:53.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.572+0000 7fd19e7ef700 1 -- start start 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19e7ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809d6f0 0x7fd19809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19e7ef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd19809e000 0x7fd198130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19e7ef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19809f130 con 0x7fd19809e410 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19e7ef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19809f520 con 0x7fd19809e000 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19e7ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd19809e930 con 0x7fd19809d6f0 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd1977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd19809e000 0x7fd198130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809d6f0 0x7fd19809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd1977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd19809e000 0x7fd198130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48948/0 (socket says 172.21.15.19:48948) 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd19cd8c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd19809e410 0x7fd198130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49400/0 (socket says 172.21.15.19:49400) 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.573+0000 7fd1977fe700 1 -- 172.21.15.19:0/18346125 learned_addr learned my addr 172.21.15.19:0/18346125 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd1977fe700 1 -- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809d6f0 msgr2=0x7fd19809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd1977fe700 1 --2- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809d6f0 0x7fd19809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd1977fe700 1 -- 172.21.15.19:0/18346125 >> v1:172.21.15.19:6789/0 conn(0x7fd19809e410 legacy=0x7fd198130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd1977fe700 1 -- 172.21.15.19:0/18346125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19809b2d0 con 0x7fd19809e000 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd1977fe700 1 --2- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809e000 0x7fd198130660 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edac62e56a73ccc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd196ffd700 1 -- 172.21.15.19:0/18346125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c010a90 con 0x7fd19809e000 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd196ffd700 1 -- 172.21.15.19:0/18346125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c010bf0 con 0x7fd19809e000 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.574+0000 7fd196ffd700 1 -- 172.21.15.19:0/18346125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c018440 con 0x7fd19809e000 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 -- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809e000 msgr2=0x7fd198130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809e000 0x7fd198130660 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098f0 tx=0x7fd18c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:53.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 -- 172.21.15.19:0/18346125 shutdown_connections 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809d6f0 0x7fd19809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/18346125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809e000 0x7fd198130660 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 -- 172.21.15.19:0/18346125 >> 172.21.15.19:0/18346125 conn(0x7fd198066f50 msgr2=0x7fd19809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 -- 172.21.15.19:0/18346125 shutdown_connections 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.575+0000 7fd19e7ef700 1 -- 172.21.15.19:0/18346125 wait complete. 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.577+0000 7fd19e7ef700 1 Processor -- start 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.577+0000 7fd19e7ef700 1 -- start start 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809e000 0x7fd19811e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd19809e410 0x7fd19811ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1981201d0 con 0x7fd19809d6f0 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd198120680 con 0x7fd19809e410 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd19e7ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd198121cc0 con 0x7fd19809e000 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48960/0 (socket says 172.21.15.19:48960) 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 -- 172.21.15.19:0/1719492524 learned_addr learned my addr 172.21.15.19:0/1719492524 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd1977fe700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809e000 0x7fd19811e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 -- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809e000 msgr2=0x7fd19811e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809e000 0x7fd19811e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 -- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd19809e410 msgr2=0x7fd19811ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd19809e410 0x7fd19811ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 -- 172.21.15.19:0/1719492524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009550 con 0x7fd19809d6f0 2023-10-03T10:17:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.578+0000 7fd197fff700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fd18800ed70 tx=0x7fd18800d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.579+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800de40 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.579+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188010440 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.579+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19811fdb0 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.579+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1880107b0 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.579+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1981223c0 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.580+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd188010910 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.580+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd18803fe10 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.580+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1980a2b50 con 0x7fd19809d6f0 2023-10-03T10:17:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.590+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd188010da0 con 0x7fd19809d6f0 2023-10-03T10:17:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.610+0000 7f3e7f4af700 1 Processor -- start 2023-10-03T10:17:53.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 -- start start 2023-10-03T10:17:53.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7809b120 con 0x7f3e7809d6f0 2023-10-03T10:17:53.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7806b460 con 0x7f3e7809e1d0 2023-10-03T10:17:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.611+0000 7f3e7f4af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7809a7e0 con 0x7f3e78139170 2023-10-03T10:17:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49386/0 (socket says 172.21.15.19:49386) 2023-10-03T10:17:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 -- 172.21.15.19:0/30484695 learned_addr learned my addr 172.21.15.19:0/30484695 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7da4c700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 -- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 msgr2=0x7f3e7813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 -- 172.21.15.19:0/30484695 >> v1:172.21.15.19:6789/0 conn(0x7f3e7809d6f0 legacy=0x7f3e7809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 -- 172.21.15.19:0/30484695 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7809a500 con 0x7f3e7809e1d0 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.612+0000 7f3e7ca4a700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009920 tx=0x7f3e68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10ac232367bda584 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e6ffff700 1 -- 172.21.15.19:0/30484695 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011830 con 0x7f3e7809e1d0 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e6ffff700 1 -- 172.21.15.19:0/30484695 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68011990 con 0x7f3e7809e1d0 2023-10-03T10:17:53.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e6ffff700 1 -- 172.21.15.19:0/30484695 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68011d20 con 0x7f3e7809e1d0 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 -- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 msgr2=0x7f3e78138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009920 tx=0x7f3e68009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 -- 172.21.15.19:0/30484695 shutdown_connections 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/30484695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809e1d0 0x7f3e78138c30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.613+0000 7f3e7f4af700 1 -- 172.21.15.19:0/30484695 >> 172.21.15.19:0/30484695 conn(0x7f3e78066f50 msgr2=0x7f3e7809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.614+0000 7f3e7f4af700 1 -- 172.21.15.19:0/30484695 shutdown_connections 2023-10-03T10:17:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.614+0000 7f3e7f4af700 1 -- 172.21.15.19:0/30484695 wait complete. 2023-10-03T10:17:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.615+0000 7f3e7f4af700 1 Processor -- start 2023-10-03T10:17:53.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.615+0000 7f3e7f4af700 1 -- start start 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e7809e1d0 0x7f3e781c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7811e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e781be2f0 con 0x7f3e7809e1d0 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e781c9150 con 0x7f3e7809d6f0 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7f4af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78121d60 con 0x7f3e78139170 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49392/0 (socket says 172.21.15.19:49392) 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 -- 172.21.15.19:0/2119661750 learned_addr learned my addr 172.21.15.19:0/2119661750 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7da4c700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7811e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 -- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 msgr2=0x7f3e7811e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7811e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 -- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e7809e1d0 msgr2=0x7f3e781c8c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e7809e1d0 0x7f3e781c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7d24b700 1 -- 172.21.15.19:0/2119661750 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68009550 con 0x7f3e7809d6f0 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.616+0000 7f3e7da4c700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e7d24b700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400c4e0 tx=0x7f3e7400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740052d0 con 0x7f3e7809d6f0 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e74005430 con 0x7f3e7809d6f0 2023-10-03T10:17:53.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7809c770 con 0x7f3e7809d6f0 2023-10-03T10:17:53.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e740038c0 con 0x7f3e7809d6f0 2023-10-03T10:17:53.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.617+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e78122300 con 0x7f3e7809d6f0 2023-10-03T10:17:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.619+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78074ea0 con 0x7f3e7809d6f0 2023-10-03T10:17:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.619+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3e74003a20 con 0x7f3e7809d6f0 2023-10-03T10:17:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.620+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3e7403f020 con 0x7f3e7809d6f0 2023-10-03T10:17:53.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.628+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3e7400e280 con 0x7f3e7809d6f0 2023-10-03T10:17:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.650+0000 7fcb083e7700 1 Processor -- start 2023-10-03T10:17:53.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 -- start start 2023-10-03T10:17:53.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb0009d6f0 0x7fcb0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 0x7fcb00130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0009f130 con 0x7fcb0009e410 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0009f520 con 0x7fcb0009d6f0 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.651+0000 7fcb083e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0009e930 con 0x7fcb0009e000 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb0009d6f0 0x7fcb0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06984700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcb0009e410 0x7fcb00130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49414/0 (socket says 172.21.15.19:49414) 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06984700 1 -- 172.21.15.19:0/2074802319 learned_addr learned my addr 172.21.15.19:0/2074802319 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb05982700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 0x7fcb00130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb05181700 1 -- 172.21.15.19:0/2074802319 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122157983 0 0) 0x7fcb0009f130 con 0x7fcb0009e410 2023-10-03T10:17:53.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb05181700 1 -- 172.21.15.19:0/2074802319 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaec0035b0 con 0x7fcb0009e410 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 -- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 msgr2=0x7fcb00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 0x7fcb00130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 -- 172.21.15.19:0/2074802319 >> v1:172.21.15.19:6789/0 conn(0x7fcb0009e410 legacy=0x7fcb00130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 -- 172.21.15.19:0/2074802319 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0009b2d0 con 0x7fcb0009d6f0 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb05982700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 0x7fcb00130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.652+0000 7fcb06183700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009d6f0 0x7fcb0009dac0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009840 tx=0x7fcafc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb333406706fbe4d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb05181700 1 -- 172.21.15.19:0/2074802319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00f8a0 con 0x7fcb0009d6f0 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb05181700 1 -- 172.21.15.19:0/2074802319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00fa00 con 0x7fcb0009d6f0 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb05181700 1 -- 172.21.15.19:0/2074802319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00fd90 con 0x7fcb0009d6f0 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 -- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009d6f0 msgr2=0x7fcb0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009d6f0 0x7fcb0009dac0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009840 tx=0x7fcafc009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 -- 172.21.15.19:0/2074802319 shutdown_connections 2023-10-03T10:17:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009d6f0 0x7fcb0009dac0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 --2- 172.21.15.19:0/2074802319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e000 0x7fcb00130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.653+0000 7fcb083e7700 1 -- 172.21.15.19:0/2074802319 >> 172.21.15.19:0/2074802319 conn(0x7fcb00066f50 msgr2=0x7fcb0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.654+0000 7fcb083e7700 1 -- 172.21.15.19:0/2074802319 shutdown_connections 2023-10-03T10:17:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.654+0000 7fcb083e7700 1 -- 172.21.15.19:0/2074802319 wait complete. 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.654+0000 7fcb083e7700 1 Processor -- start 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 -- start start 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 0x7fcb0012ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e410 0x7fcb0012d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0007d930 con 0x7fcb0009e000 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0007db10 con 0x7fcb0009d6f0 2023-10-03T10:17:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb083e7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb000a3bc0 con 0x7fcb0009e410 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb05982700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb06183700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 0x7fcb0012ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb05982700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48986/0 (socket says 172.21.15.19:48986) 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb05982700 1 -- 172.21.15.19:0/489167712 learned_addr learned my addr 172.21.15.19:0/489167712 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb06183700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 0x7fcb0012ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49402/0 (socket says 172.21.15.19:49402) 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.655+0000 7fcb06984700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e410 0x7fcb0012d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 -- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e410 msgr2=0x7fcb0012d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e410 0x7fcb0012d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 -- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 msgr2=0x7fcb0012ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 0x7fcb0012ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 -- 172.21.15.19:0/489167712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf00094a0 con 0x7fcb0009e000 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb05982700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000ebe0 tx=0x7fcaf000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000c850 con 0x7fcb0009e000 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf000c9b0 con 0x7fcb0009e000 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc0094a0 con 0x7fcb0009e000 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf000cd40 con 0x7fcb0009e000 2023-10-03T10:17:53.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.656+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0007bc00 con 0x7fcb0009e000 2023-10-03T10:17:53.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.658+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcaf0013470 con 0x7fcb0009e000 2023-10-03T10:17:53.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.658+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb00074ea0 con 0x7fcb0009e000 2023-10-03T10:17:53.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.658+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcaf003fb40 con 0x7fcb0009e000 2023-10-03T10:17:53.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.662+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcaf0013720 con 0x7fcb0009e000 2023-10-03T10:17:53.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.758+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdadc074ea0 con 0x7fdadc133420 2023-10-03T10:17:53.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.758+0000 7fdac3fff700 1 -- 172.21.15.19:0/45273726 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdacc017020 con 0x7fdadc133420 2023-10-03T10:17:53.758 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:53.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.761+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 msgr2=0x7fdadc12f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.761+0000 7fdae1d30700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00c520 tx=0x7fdacc00c830 comp rx=0 tx=0).stop 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 shutdown_connections 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdadc138dc0 0x7fdadc12fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdadc133420 0x7fdadc12f130 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 --2- 172.21.15.19:0/45273726 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdadc1337f0 0x7fdadc12f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 >> 172.21.15.19:0/45273726 conn(0x7fdadc0a4210 msgr2=0x7fdadc0a0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 shutdown_connections 2023-10-03T10:17:53.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.762+0000 7fdae1d30700 1 -- 172.21.15.19:0/45273726 wait complete. 2023-10-03T10:17:53.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:53.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.803+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd198074ea0 con 0x7fd19809d6f0 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.803+0000 7fd194ff9700 1 -- 172.21.15.19:0/1719492524 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd188017360 con 0x7fd19809d6f0 2023-10-03T10:17:53.803 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 msgr2=0x7fd19811e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fd18800ed70 tx=0x7fd18800d630 comp rx=0 tx=0).stop 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 shutdown_connections 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd19809e410 0x7fd19811ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd19809d6f0 0x7fd19811e1a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 --2- 172.21.15.19:0/1719492524 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd19809e000 0x7fd19811e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 >> 172.21.15.19:0/1719492524 conn(0x7fd198066f50 msgr2=0x7fd19806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 shutdown_connections 2023-10-03T10:17:53.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.806+0000 7fd19e7ef700 1 -- 172.21.15.19:0/1719492524 wait complete. 2023-10-03T10:17:53.819 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:53.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.847+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3e78121f60 con 0x7f3e7809d6f0 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.847+0000 7f3e6dffb700 1 -- 172.21.15.19:0/2119661750 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3e78121f60 con 0x7f3e7809d6f0 2023-10-03T10:17:53.847 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:53.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 msgr2=0x7f3e781c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3e7400c4e0 tx=0x7f3e7400c8a0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 shutdown_connections 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3e78139170 0x7f3e7811e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3e7809d6f0 0x7f3e781c86d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 --2- 172.21.15.19:0/2119661750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e7809e1d0 0x7f3e781c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.849+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 >> 172.21.15.19:0/2119661750 conn(0x7f3e78066f50 msgr2=0x7f3e78136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.850+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 shutdown_connections 2023-10-03T10:17:53.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.850+0000 7f3e7f4af700 1 -- 172.21.15.19:0/2119661750 wait complete. 2023-10-03T10:17:53.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:53.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.871+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcb0006c360 con 0x7fcb0009e000 2023-10-03T10:17:53.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.872+0000 7fcaf6ffd700 1 -- 172.21.15.19:0/489167712 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcaf0021020 con 0x7fcb0009e000 2023-10-03T10:17:53.871 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 msgr2=0x7fcb0012d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000ebe0 tx=0x7fcaf000eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 shutdown_connections 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb0009e410 0x7fcb0012d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb0009d6f0 0x7fcb0012ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 --2- 172.21.15.19:0/489167712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb0009e000 0x7fcb0012d350 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 >> 172.21.15.19:0/489167712 conn(0x7fcb00066f50 msgr2=0x7fcb0009fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 shutdown_connections 2023-10-03T10:17:53.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:53.874+0000 7fcb083e7700 1 -- 172.21.15.19:0/489167712 wait complete. 2023-10-03T10:17:53.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:54.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:54.820 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:54.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:54.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.944+0000 7fcb7958b700 1 Processor -- start 2023-10-03T10:17:54.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 -- start start 2023-10-03T10:17:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb7409d6f0 0x7fcb7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 0x7fcb74130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e410 0x7fcb74130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7409f520 con 0x7fcb7409d6f0 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7409f130 con 0x7fcb7409e410 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb7958b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7409e930 con 0x7fcb7409e000 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb72ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb7409d6f0 0x7fcb7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb72ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb7409d6f0 0x7fcb7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48998/0 (socket says 172.21.15.19:48998) 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb72ffd700 1 -- 172.21.15.19:0/4187286897 learned_addr learned my addr 172.21.15.19:0/4187286897 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.945+0000 7fcb737fe700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e410 0x7fcb74130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 -- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 msgr2=0x7fcb74130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb727fc700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 0x7fcb74130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 0x7fcb74130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 -- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e410 msgr2=0x7fcb74130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e410 0x7fcb74130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 -- 172.21.15.19:0/4187286897 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7409b2d0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb727fc700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 0x7fcb74130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409d6f0 0x7fcb7409dac0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009920 tx=0x7fcb64009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4159f287eb5774d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb71ffb700 1 -- 172.21.15.19:0/4187286897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64010a90 con 0x7fcb7409d6f0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb71ffb700 1 -- 172.21.15.19:0/4187286897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64010bf0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.946+0000 7fcb71ffb700 1 -- 172.21.15.19:0/4187286897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64018440 con 0x7fcb7409d6f0 2023-10-03T10:17:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 -- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409d6f0 msgr2=0x7fcb7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409d6f0 0x7fcb7409dac0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009920 tx=0x7fcb64009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 -- 172.21.15.19:0/4187286897 shutdown_connections 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e410 0x7fcb74130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409d6f0 0x7fcb7409dac0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 --2- 172.21.15.19:0/4187286897 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409e000 0x7fcb74130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 -- 172.21.15.19:0/4187286897 >> 172.21.15.19:0/4187286897 conn(0x7fcb74066f50 msgr2=0x7fcb7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 -- 172.21.15.19:0/4187286897 shutdown_connections 2023-10-03T10:17:54.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.947+0000 7fcb7958b700 1 -- 172.21.15.19:0/4187286897 wait complete. 2023-10-03T10:17:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.948+0000 7fcb7958b700 1 Processor -- start 2023-10-03T10:17:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 -- start start 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e000 0x7fcb7411e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 0x7fcb7411ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb741202e0 con 0x7fcb7409e410 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a1a80 con 0x7fcb7409e000 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb7958b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7409c700 con 0x7fcb7409d6f0 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb72ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58702/0 (socket says 172.21.15.19:58702) 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb72ffd700 1 -- 172.21.15.19:0/1809445184 learned_addr learned my addr 172.21.15.19:0/1809445184 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb737fe700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 0x7fcb7411ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.949+0000 7fcb727fc700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e000 0x7fcb7411e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 -- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e000 msgr2=0x7fcb7411e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e000 0x7fcb7411e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 -- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 msgr2=0x7fcb7411ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 0x7fcb7411ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 -- 172.21.15.19:0/1809445184 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009550 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb737fe700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 0x7fcb7411ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64003ab0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64003c10 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb741213d0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64023450 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.950+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb741223d0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.951+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb6401f070 con 0x7fcb7409d6f0 2023-10-03T10:17:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.952+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb741215c0 con 0x7fcb7409d6f0 2023-10-03T10:17:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.952+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb64045070 con 0x7fcb7409d6f0 2023-10-03T10:17:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.961+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb64076750 con 0x7fcb7409d6f0 2023-10-03T10:17:54.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.977+0000 7f839e048700 1 Processor -- start 2023-10-03T10:17:54.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 -- start start 2023-10-03T10:17:54.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f839809e1d0 0x7f8398138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398139170 0x7f839813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f839809b120 con 0x7f839809d6f0 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806b460 con 0x7f839809e1d0 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f839e048700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839809a7e0 con 0x7f8398139170 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f8396ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f839809e1d0 0x7f8398138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f8396ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f839809e1d0 0x7f8398138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49016/0 (socket says 172.21.15.19:49016) 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f8396ffd700 1 -- 172.21.15.19:0/2088330314 learned_addr learned my addr 172.21.15.19:0/2088330314 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:54.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.978+0000 7f8397fff700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398139170 0x7f839813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f8396ffd700 1 -- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398139170 msgr2=0x7f839813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f8396ffd700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398139170 0x7f839813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f8396ffd700 1 -- 172.21.15.19:0/2088330314 >> v1:172.21.15.19:6789/0 conn(0x7f839809d6f0 legacy=0x7f839809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f8396ffd700 1 -- 172.21.15.19:0/2088330314 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839809a500 con 0x7f839809e1d0 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f8396ffd700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809e1d0 0x7f8398138c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f838c009920 tx=0x7f838c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faf4c1bfca00ee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f83967fc700 1 -- 172.21.15.19:0/2088330314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c004230 con 0x7f839809e1d0 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f83967fc700 1 -- 172.21.15.19:0/2088330314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c004390 con 0x7f839809e1d0 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.979+0000 7f83967fc700 1 -- 172.21.15.19:0/2088330314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c0036a0 con 0x7f839809e1d0 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 -- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809e1d0 msgr2=0x7f8398138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809e1d0 0x7f8398138c30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f838c009920 tx=0x7f838c009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 -- 172.21.15.19:0/2088330314 shutdown_connections 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8398139170 0x7f839813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 --2- 172.21.15.19:0/2088330314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809e1d0 0x7f8398138c30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 -- 172.21.15.19:0/2088330314 >> 172.21.15.19:0/2088330314 conn(0x7f8398066f50 msgr2=0x7f839809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:54.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 -- 172.21.15.19:0/2088330314 shutdown_connections 2023-10-03T10:17:54.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.980+0000 7f839e048700 1 -- 172.21.15.19:0/2088330314 wait complete. 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.981+0000 7f839e048700 1 Processor -- start 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.982+0000 7f839e048700 1 -- start start 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 0x7f83981c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398139170 0x7f83981c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980a2b90 con 0x7f839809d6f0 2023-10-03T10:17:54.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839809c710 con 0x7f839809e1d0 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f839e048700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83981207c0 con 0x7f8398139170 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49028/0 (socket says 172.21.15.19:49028) 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 -- 172.21.15.19:0/2632799882 learned_addr learned my addr 172.21.15.19:0/2632799882 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f8396ffd700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 0x7f83981c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 -- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398139170 msgr2=0x7f83981c8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398139170 0x7f83981c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 -- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 msgr2=0x7f83981c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 0x7f83981c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 -- 172.21.15.19:0/2632799882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c009550 con 0x7f839809d6f0 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f8396ffd700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 0x7f83981c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:54.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.983+0000 7f83977fe700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.984+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011790 con 0x7f839809d6f0 2023-10-03T10:17:54.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.984+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83880118f0 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.984+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388011ca0 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.984+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398122020 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.984+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83981225c0 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.985+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398074ea0 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.985+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838801c460 con 0x7f839809d6f0 2023-10-03T10:17:54.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.986+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f838803fe80 con 0x7f839809d6f0 2023-10-03T10:17:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:54.994+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f838801a930 con 0x7f839809d6f0 2023-10-03T10:17:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.026+0000 7fce38f7b700 1 Processor -- start 2023-10-03T10:17:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.026+0000 7fce38f7b700 1 -- start start 2023-10-03T10:17:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce38f7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce38f7b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce34135e50 0x7fce34138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce38f7b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3409f130 con 0x7fce3409d6f0 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce38f7b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3409f520 con 0x7fce34135e50 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce38f7b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce3409e930 con 0x7fce3409e1d0 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce31d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce31d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58722/0 (socket says 172.21.15.19:58722) 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce31d9b700 1 -- 172.21.15.19:0/3690943027 learned_addr learned my addr 172.21.15.19:0/3690943027 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce3259c700 1 --1- 172.21.15.19:0/3690943027 >> v1:172.21.15.19:6789/0 conn(0x7fce3409d6f0 0x7fce3409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:49430/0 (socket says 172.21.15.19:49430) 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.027+0000 7fce32d9d700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce34135e50 0x7fce34138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce31d9b700 1 -- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce34135e50 msgr2=0x7fce34138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce31d9b700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce34135e50 0x7fce34138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce31d9b700 1 -- 172.21.15.19:0/3690943027 >> v1:172.21.15.19:6789/0 conn(0x7fce3409d6f0 legacy=0x7fce3409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce3159a700 1 -- 172.21.15.19:0/3690943027 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183839252 0 0) 0x7fce3409f130 con 0x7fce3409d6f0 2023-10-03T10:17:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce31d9b700 1 -- 172.21.15.19:0/3690943027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3409b2d0 con 0x7fce3409e1d0 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce31d9b700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fce28009920 tx=0x7fce28009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee3158169a5ac077 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce3159a700 1 -- 172.21.15.19:0/3690943027 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28012b80 con 0x7fce3409e1d0 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce3159a700 1 -- 172.21.15.19:0/3690943027 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28012ce0 con 0x7fce3409e1d0 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.028+0000 7fce3159a700 1 -- 172.21.15.19:0/3690943027 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2801b620 con 0x7fce3409e1d0 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 -- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 msgr2=0x7fce34135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fce28009920 tx=0x7fce28009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 -- 172.21.15.19:0/3690943027 shutdown_connections 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce34135e50 0x7fce34138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3690943027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce3409e1d0 0x7fce34135910 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 -- 172.21.15.19:0/3690943027 >> 172.21.15.19:0/3690943027 conn(0x7fce34066f50 msgr2=0x7fce3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.029+0000 7fce38f7b700 1 -- 172.21.15.19:0/3690943027 shutdown_connections 2023-10-03T10:17:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.030+0000 7fce38f7b700 1 -- 172.21.15.19:0/3690943027 wait complete. 2023-10-03T10:17:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.031+0000 7fce38f7b700 1 Processor -- start 2023-10-03T10:17:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.031+0000 7fce38f7b700 1 -- start start 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3409d6f0 0x7fce34119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 0x7fce34119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3411b7e0 con 0x7fce3409e1d0 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3411ce20 con 0x7fce3409d6f0 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce38f7b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce34130170 con 0x7fce34135e50 2023-10-03T10:17:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce31d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce32d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 0x7fce34119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce31d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49040/0 (socket says 172.21.15.19:49040) 2023-10-03T10:17:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce31d9b700 1 -- 172.21.15.19:0/3834904137 learned_addr learned my addr 172.21.15.19:0/3834904137 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.032+0000 7fce3259c700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3409d6f0 0x7fce34119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 -- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 msgr2=0x7fce34119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 0x7fce34119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 -- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3409d6f0 msgr2=0x7fce34119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3409d6f0 0x7fce34119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 -- 172.21.15.19:0/3834904137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce28009550 con 0x7fce3409e1d0 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce32d9d700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 0x7fce34119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce31d9b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fce28009c70 tx=0x7fce28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28020070 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce280038b0 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.033+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3411af50 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.034+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28003c20 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.034+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce34072600 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.035+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce2801b400 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.035+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34074ea0 con 0x7fce3409e1d0 2023-10-03T10:17:55.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.035+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce28044370 con 0x7fce3409e1d0 2023-10-03T10:17:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.040+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce2802a070 con 0x7fce3409e1d0 2023-10-03T10:17:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.068+0000 7ffb8e217700 1 Processor -- start 2023-10-03T10:17:55.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.068+0000 7ffb8e217700 1 -- start start 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb8e217700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 0x7ffb88133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb8e217700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb8e217700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8806ef30 con 0x7ffb8809e760 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb8e217700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8806fef0 con 0x7ffb881338a0 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb8e217700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881334b0 con 0x7ffb8809de50 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58740/0 (socket says 172.21.15.19:58740) 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 -- 172.21.15.19:0/2783920178 learned_addr learned my addr 172.21.15.19:0/2783920178 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:55.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb877fe700 1 --2- 172.21.15.19:0/2783920178 >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 0x7ffb88133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 -- 172.21.15.19:0/2783920178 >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 msgr2=0x7ffb88133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 --2- 172.21.15.19:0/2783920178 >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 0x7ffb88133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 -- 172.21.15.19:0/2783920178 >> v1:172.21.15.19:6789/0 conn(0x7ffb8809e760 legacy=0x7ffb8813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb86ffd700 1 -- 172.21.15.19:0/2783920178 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8806fc30 con 0x7ffb8809de50 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.069+0000 7ffb877fe700 1 --2- 172.21.15.19:0/2783920178 >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 0x7ffb88133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.070+0000 7ffb86ffd700 1 --2- 172.21.15.19:0/2783920178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0098f0 tx=0x7ffb7c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35238abe0c460eba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.070+0000 7ffb867fc700 1 -- 172.21.15.19:0/2783920178 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00b8a0 con 0x7ffb8809de50 2023-10-03T10:17:55.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.070+0000 7ffb867fc700 1 -- 172.21.15.19:0/2783920178 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c00ba00 con 0x7ffb8809de50 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.070+0000 7ffb867fc700 1 -- 172.21.15.19:0/2783920178 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c00bd90 con 0x7ffb8809de50 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 -- 172.21.15.19:0/2783920178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 msgr2=0x7ffb8809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2783920178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0098f0 tx=0x7ffb7c009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 -- 172.21.15.19:0/2783920178 shutdown_connections 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2783920178 >> v2:172.21.15.19:3300/0 conn(0x7ffb881338a0 0x7ffb88133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2783920178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8809e220 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 -- 172.21.15.19:0/2783920178 >> 172.21.15.19:0/2783920178 conn(0x7ffb880a2aa0 msgr2=0x7ffb880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 -- 172.21.15.19:0/2783920178 shutdown_connections 2023-10-03T10:17:55.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.071+0000 7ffb8e217700 1 -- 172.21.15.19:0/2783920178 wait complete. 2023-10-03T10:17:55.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.072+0000 7ffb8e217700 1 Processor -- start 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.072+0000 7ffb8e217700 1 -- start start 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.072+0000 7ffb8e217700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8811ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.072+0000 7ffb8e217700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb8809e760 0x7ffb8811ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb8e217700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb8e217700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881224e0 con 0x7ffb8809e760 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb8e217700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb88120e60 con 0x7ffb881338a0 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb8e217700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880a0fa0 con 0x7ffb8809de50 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb877fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8811ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49476/0 (socket says 172.21.15.19:49476) 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb877fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8811ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58746/0 (socket says 172.21.15.19:58746) 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 -- 172.21.15.19:0/2186356704 learned_addr learned my addr 172.21.15.19:0/2186356704 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb86ffd700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb8809e760 0x7ffb8811ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 -- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 msgr2=0x7ffb8811ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8811ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 -- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb8809e760 msgr2=0x7ffb8811ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb8809e760 0x7ffb8811ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 -- 172.21.15.19:0/2186356704 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009550 con 0x7ffb881338a0 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.073+0000 7ffb87fff700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000cc80 tx=0x7ffb8000cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.074+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000aa60 con 0x7ffb881338a0 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.074+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8000abc0 con 0x7ffb881338a0 2023-10-03T10:17:55.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.074+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8806f640 con 0x7ffb881338a0 2023-10-03T10:17:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.074+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80012420 con 0x7ffb881338a0 2023-10-03T10:17:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.074+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8812f910 con 0x7ffb881338a0 2023-10-03T10:17:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.075+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb88074ea0 con 0x7ffb881338a0 2023-10-03T10:17:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.075+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb80005080 con 0x7ffb881338a0 2023-10-03T10:17:55.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.075+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb8003f6f0 con 0x7ffb881338a0 2023-10-03T10:17:55.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.084+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb80010b10 con 0x7ffb881338a0 2023-10-03T10:17:55.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.179+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb74120f80 con 0x7fcb7409d6f0 2023-10-03T10:17:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.180+0000 7fcb5b7fe700 1 -- 172.21.15.19:0/1809445184 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6401d020 con 0x7fcb7409d6f0 2023-10-03T10:17:55.181 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 msgr2=0x7fcb7411e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb64000c00 tx=0x7fcb64004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 shutdown_connections 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb7409e410 0x7fcb7411ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb7409d6f0 0x7fcb7411e170 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 --2- 172.21.15.19:0/1809445184 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb7409e000 0x7fcb7411e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 >> 172.21.15.19:0/1809445184 conn(0x7fcb74066f50 msgr2=0x7fcb7406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 shutdown_connections 2023-10-03T10:17:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.182+0000 7fcb7958b700 1 -- 172.21.15.19:0/1809445184 wait complete. 2023-10-03T10:17:55.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:55.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.221+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f839809f420 con 0x7f839809d6f0 2023-10-03T10:17:55.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.221+0000 7f837ffff700 1 -- 172.21.15.19:0/2632799882 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f838801a360 con 0x7f839809d6f0 2023-10-03T10:17:55.221 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 msgr2=0x7f83981c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f838800c4d0 tx=0x7f838800c7e0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 shutdown_connections 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8398139170 0x7f83981c8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f839809d6f0 0x7f83981c8460 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 --2- 172.21.15.19:0/2632799882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f839809e1d0 0x7f83981c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.223+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 >> 172.21.15.19:0/2632799882 conn(0x7f8398066f50 msgr2=0x7f83980a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.224+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 shutdown_connections 2023-10-03T10:17:55.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.224+0000 7f839e048700 1 -- 172.21.15.19:0/2632799882 wait complete. 2023-10-03T10:17:55.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.250+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fce3411c9a0 con 0x7fce3409e1d0 2023-10-03T10:17:55.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.251+0000 7fce22ffd700 1 -- 172.21.15.19:0/3834904137 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce2802a070 con 0x7fce3409e1d0 2023-10-03T10:17:55.251 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 msgr2=0x7fce341199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fce28009c70 tx=0x7fce28004750 comp rx=0 tx=0).stop 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 shutdown_connections 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce34135e50 0x7fce34119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce3409d6f0 0x7fce34119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 --2- 172.21.15.19:0/3834904137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce3409e1d0 0x7fce341199c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 >> 172.21.15.19:0/3834904137 conn(0x7fce34066f50 msgr2=0x7fce341328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 shutdown_connections 2023-10-03T10:17:55.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.253+0000 7fce38f7b700 1 -- 172.21.15.19:0/3834904137 wait complete. 2023-10-03T10:17:55.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.290+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb8806b9e0 con 0x7ffb881338a0 2023-10-03T10:17:55.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.290+0000 7ffb6ffff700 1 -- 172.21.15.19:0/2186356704 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb80010750 con 0x7ffb881338a0 2023-10-03T10:17:55.290 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.292+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 msgr2=0x7ffb8811f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ffb8000cc80 tx=0x7ffb8000cf90 comp rx=0 tx=0).stop 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 shutdown_connections 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb881338a0 0x7ffb8811f4c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb8809de50 0x7ffb8811ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 --2- 172.21.15.19:0/2186356704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb8809e760 0x7ffb8811ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 >> 172.21.15.19:0/2186356704 conn(0x7ffb880a2aa0 msgr2=0x7ffb8809ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 shutdown_connections 2023-10-03T10:17:55.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:55.293+0000 7ffb8e217700 1 -- 172.21.15.19:0/2186356704 wait complete. 2023-10-03T10:17:55.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:56.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:56.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:56.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:56.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:56.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.348+0000 7fedf92a6700 1 Processor -- start 2023-10-03T10:17:56.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 -- start start 2023-10-03T10:17:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406b250 0x7fedf4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 0x7fedf4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf409ece0 con 0x7fedf406a770 2023-10-03T10:17:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf406b640 con 0x7fedf4136d80 2023-10-03T10:17:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf92a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf409e760 con 0x7fedf406b250 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fedf406a770 0x7fedf406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58450/0 (socket says 172.21.15.19:58450) 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf2ffd700 1 -- 172.21.15.19:0/1795086882 learned_addr learned my addr 172.21.15.19:0/1795086882 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.349+0000 7fedf37fe700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 0x7fedf4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf37fe700 1 -- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406b250 msgr2=0x7fedf4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf1ffb700 1 -- 172.21.15.19:0/1795086882 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036697916 0 0) 0x7fedf409ece0 con 0x7fedf406a770 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf37fe700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406b250 0x7fedf4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf37fe700 1 -- 172.21.15.19:0/1795086882 >> v1:172.21.15.19:6789/0 conn(0x7fedf406a770 legacy=0x7fedf406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf37fe700 1 -- 172.21.15.19:0/1795086882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf409e040 con 0x7fedf4136d80 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf37fe700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 0x7fedf4139160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fedec009dc0 tx=0x7fedec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1c234a9c3430a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf1ffb700 1 -- 172.21.15.19:0/1795086882 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00e070 con 0x7fedf4136d80 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf1ffb700 1 -- 172.21.15.19:0/1795086882 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec00bbd0 con 0x7fedf4136d80 2023-10-03T10:17:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.350+0000 7fedf1ffb700 1 -- 172.21.15.19:0/1795086882 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec012430 con 0x7fedf4136d80 2023-10-03T10:17:56.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 -- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 msgr2=0x7fedf4139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 0x7fedf4139160 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fedec009dc0 tx=0x7fedec00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 -- 172.21.15.19:0/1795086882 shutdown_connections 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf4136d80 0x7fedf4139160 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 --2- 172.21.15.19:0/1795086882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406b250 0x7fedf4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 -- 172.21.15.19:0/1795086882 >> 172.21.15.19:0/1795086882 conn(0x7fedf4066f50 msgr2=0x7fedf409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 -- 172.21.15.19:0/1795086882 shutdown_connections 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.351+0000 7fedf92a6700 1 -- 172.21.15.19:0/1795086882 wait complete. 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 Processor -- start 2023-10-03T10:17:56.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 -- start start 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf406b250 0x7fedf409b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 0x7fedf41c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf409a8d0 con 0x7fedf4136d80 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41222c0 con 0x7fedf406b250 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf92a6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fedf406e8e0 con 0x7fedf406a770 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:44962/0 (socket says 172.21.15.19:44962) 2023-10-03T10:17:56.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.353+0000 7fedf2ffd700 1 -- 172.21.15.19:0/709693846 learned_addr learned my addr 172.21.15.19:0/709693846 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf37fe700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 0x7fedf41c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 -- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf406b250 msgr2=0x7fedf409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf406b250 0x7fedf409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 -- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 msgr2=0x7fedf41c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 0x7fedf41c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 -- 172.21.15.19:0/709693846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec009a70 con 0x7fedf406a770 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf37fe700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 0x7fedf41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf2ffd700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fede400c520 tx=0x7fede400c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4004c80 con 0x7fedf406a770 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede4004de0 con 0x7fedf406a770 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4071e60 con 0x7fedf406a770 2023-10-03T10:17:56.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.354+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4007310 con 0x7fedf406a770 2023-10-03T10:17:56.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.355+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf409c010 con 0x7fedf406a770 2023-10-03T10:17:56.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.356+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fede4007470 con 0x7fedf406a770 2023-10-03T10:17:56.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.356+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fede403f280 con 0x7fedf406a770 2023-10-03T10:17:56.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.357+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf4074ea0 con 0x7fedf406a770 2023-10-03T10:17:56.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.363+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fede40123b0 con 0x7fedf406a770 2023-10-03T10:17:56.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.399+0000 7fb82d3af700 1 Processor -- start 2023-10-03T10:17:56.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.399+0000 7fb82d3af700 1 -- start start 2023-10-03T10:17:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb82d3af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb82d3af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb82d3af700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82812cd90 con 0x7fb828130260 2023-10-03T10:17:56.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb82d3af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82812d330 con 0x7fb82812cf60 2023-10-03T10:17:56.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb82d3af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8281306d0 con 0x7fb82812f8b0 2023-10-03T10:17:56.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56798/0 (socket says 172.21.15.19:56798) 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 -- 172.21.15.19:0/661952762 learned_addr learned my addr 172.21.15.19:0/661952762 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb8267fc700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 -- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 msgr2=0x7fb82812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 -- 172.21.15.19:0/661952762 >> v1:172.21.15.19:6789/0 conn(0x7fb828130260 legacy=0x7fb828136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb826ffd700 1 -- 172.21.15.19:0/661952762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb828071780 con 0x7fb82812cf60 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.400+0000 7fb8267fc700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.401+0000 7fb826ffd700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=442cd0f8a3e4dddc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.401+0000 7fb825ffb700 1 -- 172.21.15.19:0/661952762 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011830 con 0x7fb82812cf60 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.401+0000 7fb825ffb700 1 -- 172.21.15.19:0/661952762 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb818011990 con 0x7fb82812cf60 2023-10-03T10:17:56.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.401+0000 7fb825ffb700 1 -- 172.21.15.19:0/661952762 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818011d20 con 0x7fb82812cf60 2023-10-03T10:17:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 -- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 msgr2=0x7fb82806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb818009920 tx=0x7fb818009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:56.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 -- 172.21.15.19:0/661952762 shutdown_connections 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb82812cf60 0x7fb82806f5d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 --2- 172.21.15.19:0/661952762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 -- 172.21.15.19:0/661952762 >> 172.21.15.19:0/661952762 conn(0x7fb8280a2aa0 msgr2=0x7fb8280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 -- 172.21.15.19:0/661952762 shutdown_connections 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.402+0000 7fb82d3af700 1 -- 172.21.15.19:0/661952762 wait complete. 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.404+0000 7fb82d3af700 1 Processor -- start 2023-10-03T10:17:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.404+0000 7fb82d3af700 1 -- start start 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.404+0000 7fb82d3af700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb82d3af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82809c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb82d3af700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828130260 0x7fb8281c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb82d3af700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82809b810 con 0x7fb82812cf60 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb82d3af700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82809e6e0 con 0x7fb828130260 2023-10-03T10:17:56.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb82d3af700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb82809d5d0 con 0x7fb82812f8b0 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37216/0 (socket says 172.21.15.19:37216) 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 -- 172.21.15.19:0/3596653539 learned_addr learned my addr 172.21.15.19:0/3596653539 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb8277fe700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828130260 0x7fb8281c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb8267fc700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82809c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 -- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 msgr2=0x7fb82809c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82809c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 -- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828130260 msgr2=0x7fb8281c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828130260 0x7fb8281c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 -- 172.21.15.19:0/3596653539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0094a0 con 0x7fb82812cf60 2023-10-03T10:17:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.405+0000 7fb826ffd700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb82806fba0 tx=0x7fb818004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.406+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818004450 con 0x7fb82812cf60 2023-10-03T10:17:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.406+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8180045b0 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.406+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb818009550 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.406+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180038c0 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.406+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82812d800 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.407+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb818003a20 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.407+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb818021030 con 0x7fb82812cf60 2023-10-03T10:17:56.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.407+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82809c6b0 con 0x7fb82812cf60 2023-10-03T10:17:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.417+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb81802b080 con 0x7fb82812cf60 2023-10-03T10:17:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.443+0000 7fe366b61700 1 Processor -- start 2023-10-03T10:17:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.443+0000 7fe366b61700 1 -- start start 2023-10-03T10:17:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe366b61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009d6f0 0x7fe36009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe366b61700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe36009e000 0x7fe3601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe366b61700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36009b120 con 0x7fe36009e410 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe366b61700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36006b460 con 0x7fe36009e000 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe366b61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe36009a7e0 con 0x7fe36009d6f0 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe3650fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe36009e410 0x7fe360133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58464/0 (socket says 172.21.15.19:58464) 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe3650fe700 1 -- 172.21.15.19:0/2474913468 learned_addr learned my addr 172.21.15.19:0/2474913468 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe35ffff700 1 --2- 172.21.15.19:0/2474913468 >> v2:172.21.15.19:3300/0 conn(0x7fe36009e000 0x7fe3601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.444+0000 7fe3648fd700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009d6f0 0x7fe36009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35ffff700 1 -- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009d6f0 msgr2=0x7fe36009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35ffff700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009d6f0 0x7fe36009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35ffff700 1 -- 172.21.15.19:0/2474913468 >> v1:172.21.15.19:6789/0 conn(0x7fe36009e410 legacy=0x7fe360133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35ffff700 1 -- 172.21.15.19:0/2474913468 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36009a500 con 0x7fe36009e000 2023-10-03T10:17:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35ffff700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601339f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009840 tx=0x7fe34c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900da6201ff6c48e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35f7fe700 1 -- 172.21.15.19:0/2474913468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c011830 con 0x7fe36009e000 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35f7fe700 1 -- 172.21.15.19:0/2474913468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c011990 con 0x7fe36009e000 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.445+0000 7fe35f7fe700 1 -- 172.21.15.19:0/2474913468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c011d20 con 0x7fe36009e000 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 -- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 msgr2=0x7fe3601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601339f0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fe34c009840 tx=0x7fe34c009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 -- 172.21.15.19:0/2474913468 shutdown_connections 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009d6f0 0x7fe36009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 --2- 172.21.15.19:0/2474913468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601339f0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 -- 172.21.15.19:0/2474913468 >> 172.21.15.19:0/2474913468 conn(0x7fe360066f50 msgr2=0x7fe36009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 -- 172.21.15.19:0/2474913468 shutdown_connections 2023-10-03T10:17:56.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.446+0000 7fe366b61700 1 -- 172.21.15.19:0/2474913468 wait complete. 2023-10-03T10:17:56.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.448+0000 7fe366b61700 1 Processor -- start 2023-10-03T10:17:56.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.448+0000 7fe366b61700 1 -- start start 2023-10-03T10:17:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe36009d6f0 0x7fe3601a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 0x7fe3601a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3601a91f0 con 0x7fe36009e000 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36009c710 con 0x7fe36009d6f0 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe366b61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600a3160 con 0x7fe36009e410 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe35ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe35ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37236/0 (socket says 172.21.15.19:37236) 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe35ffff700 1 -- 172.21.15.19:0/3944742429 learned_addr learned my addr 172.21.15.19:0/3944742429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.449+0000 7fe3650fe700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 0x7fe3601a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 -- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe36009d6f0 msgr2=0x7fe3601a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe36009d6f0 0x7fe3601a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 -- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 msgr2=0x7fe3601a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 -- 172.21.15.19:0/3944742429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0094a0 con 0x7fe36009e410 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe3650fe700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 0x7fe3601a6a50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe35800caa0 tx=0x7fe35800cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800a9a0 con 0x7fe36009e410 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35800ab00 con 0x7fe36009e410 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3601a7b50 con 0x7fe36009e410 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35800ae70 con 0x7fe36009e410 2023-10-03T10:17:56.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.450+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3601a9f60 con 0x7fe36009e410 2023-10-03T10:17:56.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.451+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe360074ea0 con 0x7fe36009e410 2023-10-03T10:17:56.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.452+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe35801b3b0 con 0x7fe36009e410 2023-10-03T10:17:56.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.452+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe35803f320 con 0x7fe36009e410 2023-10-03T10:17:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.461+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe3580192c0 con 0x7fe36009e410 2023-10-03T10:17:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.478+0000 7fb3f1a18700 1 Processor -- start 2023-10-03T10:17:56.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.478+0000 7fb3f1a18700 1 -- start start 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3f1a18700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3ec133420 0x7fb3ec1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3f1a18700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 0x7fb3ec1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3f1a18700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec06b990 con 0x7fb3ec133e30 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3f1a18700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec0a0590 con 0x7fb3ec133420 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3f1a18700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec09fb80 con 0x7fb3ec134260 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3ec133420 0x7fb3ec1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb3ec133420 0x7fb3ec1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37250/0 (socket says 172.21.15.19:37250) 2023-10-03T10:17:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eaffd700 1 -- 172.21.15.19:0/2304539990 learned_addr learned my addr 172.21.15.19:0/2304539990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eb7fe700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 0x7fb3ec1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eaffd700 1 -- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 msgr2=0x7fb3ec1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3eaffd700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 0x7fb3ec1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3eaffd700 1 -- 172.21.15.19:0/2304539990 >> v1:172.21.15.19:6789/0 conn(0x7fb3ec133e30 legacy=0x7fb3ec12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3eaffd700 1 -- 172.21.15.19:0/2304539990 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0a0030 con 0x7fb3ec133420 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.479+0000 7fb3e9ffb700 1 -- 172.21.15.19:0/2304539990 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289951899 0 0) 0x7fb3ec06b990 con 0x7fb3ec133e30 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3eb7fe700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 0x7fb3ec1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3eaffd700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec133420 0x7fb3ec1337f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0098f0 tx=0x7fb3dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea07e865b25c439 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3e9ffb700 1 -- 172.21.15.19:0/2304539990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc011830 con 0x7fb3ec133420 2023-10-03T10:17:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3e9ffb700 1 -- 172.21.15.19:0/2304539990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc011990 con 0x7fb3ec133420 2023-10-03T10:17:56.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.480+0000 7fb3e9ffb700 1 -- 172.21.15.19:0/2304539990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc011d20 con 0x7fb3ec133420 2023-10-03T10:17:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 -- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec133420 msgr2=0x7fb3ec1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec133420 0x7fb3ec1337f0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0098f0 tx=0x7fb3dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:56.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 -- 172.21.15.19:0/2304539990 shutdown_connections 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec134260 0x7fb3ec1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/2304539990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec133420 0x7fb3ec1337f0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 -- 172.21.15.19:0/2304539990 >> 172.21.15.19:0/2304539990 conn(0x7fb3ec0a4210 msgr2=0x7fb3ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 -- 172.21.15.19:0/2304539990 shutdown_connections 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.481+0000 7fb3f1a18700 1 -- 172.21.15.19:0/2304539990 wait complete. 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.482+0000 7fb3f1a18700 1 Processor -- start 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.482+0000 7fb3f1a18700 1 -- start start 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ec133e30 0x7fb3ec09c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 0x7fb3ec09cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec09e040 con 0x7fb3ec134260 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec11f5b0 con 0x7fb3ec133e30 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3f1a18700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec09de50 con 0x7fb3ec133420 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45002/0 (socket says 172.21.15.19:45002) 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 -- 172.21.15.19:0/164957125 learned_addr learned my addr 172.21.15.19:0/164957125 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3ea7fc700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ec133e30 0x7fb3ec09c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eb7fe700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 0x7fb3ec09cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 -- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ec133e30 msgr2=0x7fb3ec09c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ec133e30 0x7fb3ec09c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 -- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 msgr2=0x7fb3ec09cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 0x7fb3ec09cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eaffd700 1 -- 172.21.15.19:0/164957125 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009a70 con 0x7fb3ec133420 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.483+0000 7fb3eb7fe700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 0x7fb3ec09cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.484+0000 7fb3eaffd700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0a06d0 tx=0x7fb3dc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.484+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc004380 con 0x7fb3ec133420 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.484+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc01f070 con 0x7fb3ec133420 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.484+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc0036a0 con 0x7fb3ec133420 2023-10-03T10:17:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.484+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc009550 con 0x7fb3ec133420 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.485+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec09d730 con 0x7fb3ec133420 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.485+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec11fc50 con 0x7fb3ec133420 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.485+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3dc021030 con 0x7fb3ec133420 2023-10-03T10:17:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.486+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3dc040a00 con 0x7fb3ec133420 2023-10-03T10:17:56.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.495+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3ec11fc50 con 0x7fb3ec133420 2023-10-03T10:17:56.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.585+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fedf409f6b0 con 0x7fedf406a770 2023-10-03T10:17:56.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.585+0000 7feddb7fe700 1 -- 172.21.15.19:0/709693846 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fede4011360 con 0x7fedf406a770 2023-10-03T10:17:56.585 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:56.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 msgr2=0x7fedf409af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fede400c520 tx=0x7fede400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:56.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 shutdown_connections 2023-10-03T10:17:56.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedf4136d80 0x7fedf41c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fedf406a770 0x7fedf409af00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 --2- 172.21.15.19:0/709693846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fedf406b250 0x7fedf409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 >> 172.21.15.19:0/709693846 conn(0x7fedf4066f50 msgr2=0x7fedf40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 shutdown_connections 2023-10-03T10:17:56.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.589+0000 7fedf92a6700 1 -- 172.21.15.19:0/709693846 wait complete. 2023-10-03T10:17:56.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:56.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.656+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb828074ea0 con 0x7fb82812cf60 2023-10-03T10:17:56.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.656+0000 7fb80f7fe700 1 -- 172.21.15.19:0/3596653539 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb818015020 con 0x7fb82812cf60 2023-10-03T10:17:56.656 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 msgr2=0x7fb82809bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fb82806fba0 tx=0x7fb818004750 comp rx=0 tx=0).stop 2023-10-03T10:17:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 shutdown_connections 2023-10-03T10:17:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb828130260 0x7fb8281c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb82812cf60 0x7fb82809bbd0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 --2- 172.21.15.19:0/3596653539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb82812f8b0 0x7fb82809c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 >> 172.21.15.19:0/3596653539 conn(0x7fb8280a2aa0 msgr2=0x7fb82806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 shutdown_connections 2023-10-03T10:17:56.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.660+0000 7fb82d3af700 1 -- 172.21.15.19:0/3596653539 wait complete. 2023-10-03T10:17:56.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:56.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.676+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe36006c360 con 0x7fe36009e410 2023-10-03T10:17:56.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.676+0000 7fe35d7fa700 1 -- 172.21.15.19:0/3944742429 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe358017070 con 0x7fe36009e410 2023-10-03T10:17:56.676 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:56.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 msgr2=0x7fe3601a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 0x7fe3601a6a50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fe35800caa0 tx=0x7fe35800cdb0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 shutdown_connections 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe36009e410 0x7fe3601a6a50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe36009d6f0 0x7fe3601a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 --2- 172.21.15.19:0/3944742429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe36009e000 0x7fe3601a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.678+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 >> 172.21.15.19:0/3944742429 conn(0x7fe360066f50 msgr2=0x7fe3601baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.679+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 shutdown_connections 2023-10-03T10:17:56.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.679+0000 7fe366b61700 1 -- 172.21.15.19:0/3944742429 wait complete. 2023-10-03T10:17:56.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:56.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.706+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb3ec11fc50 con 0x7fb3ec133420 2023-10-03T10:17:56.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.707+0000 7fb3d3fff700 1 -- 172.21.15.19:0/164957125 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3ec11fc50 con 0x7fb3ec133420 2023-10-03T10:17:56.707 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 msgr2=0x7fb3ec09c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:56.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0a06d0 tx=0x7fb3dc004750 comp rx=0 tx=0).stop 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 shutdown_connections 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ec134260 0x7fb3ec09cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ec133420 0x7fb3ec09c2d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 --2- 172.21.15.19:0/164957125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ec133e30 0x7fb3ec09c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 >> 172.21.15.19:0/164957125 conn(0x7fb3ec0a4210 msgr2=0x7fb3ec130480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 shutdown_connections 2023-10-03T10:17:56.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:56.709+0000 7fb3f1a18700 1 -- 172.21.15.19:0/164957125 wait complete. 2023-10-03T10:17:56.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:57.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:57.674 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:57.693 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:57.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:57.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.758+0000 7f4729c73700 1 Processor -- start 2023-10-03T10:17:57.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.758+0000 7f4729c73700 1 -- start start 2023-10-03T10:17:57.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4729c73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4729c73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 0x7f4724139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4729c73700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472409ece0 con 0x7f472406a770 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4729c73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472406b640 con 0x7f472406b250 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4729c73700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472409e760 con 0x7f4724136d80 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4723fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 0x7f4724139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56838/0 (socket says 172.21.15.19:56838) 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4723fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 0x7f4724139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45014/0 (socket says 172.21.15.19:45014) 2023-10-03T10:17:57.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.759+0000 7f4722ffd700 1 -- 172.21.15.19:0/2918132901 learned_addr learned my addr 172.21.15.19:0/2918132901 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f47227fc700 1 -- 172.21.15.19:0/2918132901 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943486330 0 0) 0x7f472409ece0 con 0x7f472406a770 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f47227fc700 1 -- 172.21.15.19:0/2918132901 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f470c0035b0 con 0x7f472406a770 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f4722ffd700 1 -- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 msgr2=0x7f4724139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f4722ffd700 1 --2- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 0x7f4724139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f4722ffd700 1 -- 172.21.15.19:0/2918132901 >> v1:172.21.15.19:6789/0 conn(0x7f472406a770 legacy=0x7f472406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f4722ffd700 1 -- 172.21.15.19:0/2918132901 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472409e040 con 0x7f472406b250 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f4722ffd700 1 --2- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4718009920 tx=0x7f4718009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9172edcbdb11bdf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f47227fc700 1 -- 172.21.15.19:0/2918132901 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718004230 con 0x7f472406b250 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f47227fc700 1 -- 172.21.15.19:0/2918132901 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718004390 con 0x7f472406b250 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.760+0000 7f47227fc700 1 -- 172.21.15.19:0/2918132901 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180036a0 con 0x7f472406b250 2023-10-03T10:17:57.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 -- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 msgr2=0x7f4724136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 --2- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4718009920 tx=0x7f4718009c30 comp rx=0 tx=0).stop 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 -- 172.21.15.19:0/2918132901 shutdown_connections 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 --2- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4724136d80 0x7f4724139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 --2- 172.21.15.19:0/2918132901 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f4724136840 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 -- 172.21.15.19:0/2918132901 >> 172.21.15.19:0/2918132901 conn(0x7f4724066f50 msgr2=0x7f472409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 -- 172.21.15.19:0/2918132901 shutdown_connections 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.761+0000 7f4729c73700 1 -- 172.21.15.19:0/2918132901 wait complete. 2023-10-03T10:17:57.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.762+0000 7f4729c73700 1 Processor -- start 2023-10-03T10:17:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.762+0000 7f4729c73700 1 -- start start 2023-10-03T10:17:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 0x7f47241c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4724136d80 0x7f472411c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724120260 con 0x7f4724136d80 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47241bbf70 con 0x7f472406b250 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4729c73700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472411fdb0 con 0x7f472406a770 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f47237fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 0x7f47241c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4722ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56854/0 (socket says 172.21.15.19:56854) 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4722ffd700 1 -- 172.21.15.19:0/2010603365 learned_addr learned my addr 172.21.15.19:0/2010603365 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4723fff700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4724136d80 0x7f472411c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4722ffd700 1 -- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 msgr2=0x7f47241c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.763+0000 7f4722ffd700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 0x7f47241c62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4722ffd700 1 -- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4724136d80 msgr2=0x7f472411c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4722ffd700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4724136d80 0x7f472411c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4722ffd700 1 -- 172.21.15.19:0/2010603365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718009550 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f47237fe700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 0x7f47241c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4722ffd700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4718009130 tx=0x7f4718004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4718003cf0 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47241323d0 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4718011630 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47180119e0 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.764+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472406e930 con 0x7f472406b250 2023-10-03T10:17:57.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.765+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4718021070 con 0x7f472406b250 2023-10-03T10:17:57.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.765+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47180247f0 con 0x7f472406b250 2023-10-03T10:17:57.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.766+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4724074ea0 con 0x7f472406b250 2023-10-03T10:17:57.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.772+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4718024470 con 0x7f472406b250 2023-10-03T10:17:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.821+0000 7fe87729e700 1 Processor -- start 2023-10-03T10:17:57.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.821+0000 7fe87729e700 1 -- start start 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87729e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 0x7fe870133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87729e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8701341d0 0x7fe87009de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87729e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87006f720 con 0x7fe87009e390 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87729e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe870070c80 con 0x7fe8701341d0 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87729e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe87006fce0 con 0x7fe8701338c0 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8701341d0 0x7fe87009de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87503a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 0x7fe870133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8701341d0 0x7fe87009de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37270/0 (socket says 172.21.15.19:37270) 2023-10-03T10:17:57.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 -- 172.21.15.19:0/198334368 learned_addr learned my addr 172.21.15.19:0/198334368 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 -- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 msgr2=0x7fe870133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 0x7fe870133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 -- 172.21.15.19:0/198334368 >> v1:172.21.15.19:6789/0 conn(0x7fe87009e390 legacy=0x7fe87013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe874839700 1 -- 172.21.15.19:0/198334368 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8701336a0 con 0x7fe8701341d0 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.822+0000 7fe87503a700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 0x7fe870133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.823+0000 7fe874839700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87009de50 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe8600098f0 tx=0x7fe860009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eac66b09663a9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.823+0000 7fe867fff700 1 -- 172.21.15.19:0/198334368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860004230 con 0x7fe8701341d0 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.823+0000 7fe867fff700 1 -- 172.21.15.19:0/198334368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe860004390 con 0x7fe8701341d0 2023-10-03T10:17:57.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.823+0000 7fe867fff700 1 -- 172.21.15.19:0/198334368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8600036a0 con 0x7fe8701341d0 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 -- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 msgr2=0x7fe87009de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87009de50 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fe8600098f0 tx=0x7fe860009c00 comp rx=0 tx=0).stop 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 -- 172.21.15.19:0/198334368 shutdown_connections 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8701338c0 0x7fe870133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 --2- 172.21.15.19:0/198334368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87009de50 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 -- 172.21.15.19:0/198334368 >> 172.21.15.19:0/198334368 conn(0x7fe8700a2aa0 msgr2=0x7fe8700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 -- 172.21.15.19:0/198334368 shutdown_connections 2023-10-03T10:17:57.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.824+0000 7fe87729e700 1 -- 172.21.15.19:0/198334368 wait complete. 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 Processor -- start 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 -- start start 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8701338c0 0x7fe87011ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87011d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87011fe90 con 0x7fe8701341d0 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870120150 con 0x7fe8701338c0 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.825+0000 7fe87729e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe87006f960 con 0x7fe87009e390 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45038/0 (socket says 172.21.15.19:45038) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87583b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87011d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 -- 172.21.15.19:0/3282092476 learned_addr learned my addr 172.21.15.19:0/3282092476 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 -- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8701338c0 msgr2=0x7fe87011ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8701338c0 0x7fe87011ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 -- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 msgr2=0x7fe87011d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87011d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 -- 172.21.15.19:0/3282092476 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c0094a0 con 0x7fe87009e390 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87503a700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00ebe0 tx=0x7fe86c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c009800 con 0x7fe87009e390 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00c910 con 0x7fe87009e390 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe860009550 con 0x7fe87009e390 2023-10-03T10:17:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.826+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00cc80 con 0x7fe87009e390 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.827+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe870120bc0 con 0x7fe87009e390 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.828+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe86c013470 con 0x7fe87009e390 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.828+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe86c03f8a0 con 0x7fe87009e390 2023-10-03T10:17:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.828+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe870074ea0 con 0x7fe87009e390 2023-10-03T10:17:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.833+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe86c013720 con 0x7fe87009e390 2023-10-03T10:17:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.907+0000 7f4cf5e58700 1 Processor -- start 2023-10-03T10:17:57.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.907+0000 7f4cf5e58700 1 -- start start 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cf5e58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf00a0a30 0x7f4cf00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cf5e58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cf5e58700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf009edd0 con 0x7f4cf00a1340 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cf5e58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf009e1f0 con 0x7f4cf0134170 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cf5e58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf009dc50 con 0x7f4cf00a0a30 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceeffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4cf00a1340 0x7f4cf0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58508/0 (socket says 172.21.15.19:58508) 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56876/0 (socket says 172.21.15.19:56876) 2023-10-03T10:17:57.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceeffd700 1 -- 172.21.15.19:0/3169771784 learned_addr learned my addr 172.21.15.19:0/3169771784 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:57.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cef7fe700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf00a0a30 0x7f4cf00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4cee7fc700 1 -- 172.21.15.19:0/3169771784 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208680083 0 0) 0x7f4cf009edd0 con 0x7f4cf00a1340 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 -- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf00a0a30 msgr2=0x7f4cf00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf00a0a30 0x7f4cf00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 -- 172.21.15.19:0/3169771784 >> v1:172.21.15.19:6789/0 conn(0x7f4cf00a1340 legacy=0x7f4cf0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.908+0000 7f4ceffff700 1 -- 172.21.15.19:0/3169771784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf00a1fe0 con 0x7f4cf0134170 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.909+0000 7f4ceffff700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009dc0 tx=0x7f4ce800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af8f2c558315527c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.909+0000 7f4cee7fc700 1 -- 172.21.15.19:0/3169771784 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800e070 con 0x7f4cf0134170 2023-10-03T10:17:57.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.909+0000 7f4cee7fc700 1 -- 172.21.15.19:0/3169771784 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce800bb20 con 0x7f4cf0134170 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.909+0000 7f4cee7fc700 1 -- 172.21.15.19:0/3169771784 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8012430 con 0x7f4cf0134170 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 -- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 msgr2=0x7f4cf013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009dc0 tx=0x7f4ce800b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 -- 172.21.15.19:0/3169771784 shutdown_connections 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf0134170 0x7f4cf013bd30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/3169771784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf00a0a30 0x7f4cf00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 -- 172.21.15.19:0/3169771784 >> 172.21.15.19:0/3169771784 conn(0x7f4cf00a6550 msgr2=0x7f4cf00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 -- 172.21.15.19:0/3169771784 shutdown_connections 2023-10-03T10:17:57.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7f4cf5e58700 1 -- 172.21.15.19:0/3169771784 wait complete. 2023-10-03T10:17:57.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7ffbd965c700 1 Processor -- start 2023-10-03T10:17:57.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.910+0000 7ffbd965c700 1 -- start start 2023-10-03T10:17:57.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7f4cf5e58700 1 Processor -- start 2023-10-03T10:17:57.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd965c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a1510 0x7ffbd4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd965c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbd4139250 0x7ffbd413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd965c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd409edd0 con 0x7ffbd40a0a30 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd965c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd40a18e0 con 0x7ffbd4139250 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd965c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd409e1f0 con 0x7ffbd40a1510 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7ffbd37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbd4139250 0x7ffbd413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffbd40a0a30 0x7ffbd40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58518/0 (socket says 172.21.15.19:58518) 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd2ffd700 1 -- 172.21.15.19:0/4278604589 learned_addr learned my addr 172.21.15.19:0/4278604589 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbd4139250 0x7ffbd413b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37292/0 (socket says 172.21.15.19:37292) 2023-10-03T10:17:57.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd27fc700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a1510 0x7ffbd4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.911+0000 7f4cf5e58700 1 -- start start 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf00a0a30 0x7f4cf006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf0134170 0x7f4cf006e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf00716e0 con 0x7f4cf00a1340 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf0071270 con 0x7f4cf00a0a30 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cf5e58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf006f6e0 con 0x7f4cf0134170 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4ceeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4ceeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37306/0 (socket says 172.21.15.19:37306) 2023-10-03T10:17:57.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4ceeffd700 1 -- 172.21.15.19:0/1862360746 learned_addr learned my addr 172.21.15.19:0/1862360746 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4ceffff700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf0134170 0x7f4cf006e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7f4cef7fe700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf00a0a30 0x7f4cf006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd37fe700 1 -- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a1510 msgr2=0x7ffbd4138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd37fe700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a1510 0x7ffbd4138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd37fe700 1 -- 172.21.15.19:0/4278604589 >> v1:172.21.15.19:6789/0 conn(0x7ffbd40a0a30 legacy=0x7ffbd40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd1ffb700 1 -- 172.21.15.19:0/4278604589 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278650761 0 0) 0x7ffbd409edd0 con 0x7ffbd40a0a30 2023-10-03T10:17:57.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.912+0000 7ffbd37fe700 1 -- 172.21.15.19:0/4278604589 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd409dc50 con 0x7ffbd4139250 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 -- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf0134170 msgr2=0x7f4cf006e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf0134170 0x7f4cf006e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 -- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf00a0a30 msgr2=0x7f4cf006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf00a0a30 0x7f4cf006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 -- 172.21.15.19:0/1862360746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce8009a70 con 0x7f4cf00a1340 2023-10-03T10:17:57.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7ffbd37fe700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd413b630 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009dc0 tx=0x7ffbcc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b267c3bb2b2a093e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7ffbd1ffb700 1 -- 172.21.15.19:0/4278604589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00e070 con 0x7ffbd4139250 2023-10-03T10:17:57.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7ffbd1ffb700 1 -- 172.21.15.19:0/4278604589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc00bae0 con 0x7ffbd4139250 2023-10-03T10:17:57.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7ffbd1ffb700 1 -- 172.21.15.19:0/4278604589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00be50 con 0x7ffbd4139250 2023-10-03T10:17:57.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4ceeffd700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c520 tx=0x7f4ce400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4004c80 con 0x7f4cf00a1340 2023-10-03T10:17:57.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce4004e00 con 0x7f4cf00a1340 2023-10-03T10:17:57.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf00a25e0 con 0x7f4cf00a1340 2023-10-03T10:17:57.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4007310 con 0x7f4cf00a1340 2023-10-03T10:17:57.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.913+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf01335c0 con 0x7f4cf00a1340 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 -- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 msgr2=0x7ffbd413b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd413b630 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009dc0 tx=0x7ffbcc00b330 comp rx=0 tx=0).stop 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 -- 172.21.15.19:0/4278604589 shutdown_connections 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd413b630 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 --2- 172.21.15.19:0/4278604589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a1510 0x7ffbd4138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 -- 172.21.15.19:0/4278604589 >> 172.21.15.19:0/4278604589 conn(0x7ffbd40a6550 msgr2=0x7ffbd40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 -- 172.21.15.19:0/4278604589 shutdown_connections 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7ffbd965c700 1 -- 172.21.15.19:0/4278604589 wait complete. 2023-10-03T10:17:57.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.914+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4ce4007470 con 0x7f4cf00a1340 2023-10-03T10:17:57.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.915+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4ce403f300 con 0x7f4cf00a1340 2023-10-03T10:17:57.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.915+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf00710e0 con 0x7f4cf00a1340 2023-10-03T10:17:57.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.916+0000 7ffbd965c700 1 Processor -- start 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.916+0000 7ffbd965c700 1 -- start start 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a0a30 0x7ffbd41225b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd4123030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4124fc0 con 0x7ffbd4139250 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd41241c0 con 0x7ffbd40a1510 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd965c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4125510 con 0x7ffbd40a0a30 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56890/0 (socket says 172.21.15.19:56890) 2023-10-03T10:17:57.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd27fc700 1 -- 172.21.15.19:0/3661103522 learned_addr learned my addr 172.21.15.19:0/3661103522 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.917+0000 7ffbd2ffd700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a0a30 0x7ffbd41225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 -- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a0a30 msgr2=0x7ffbd41225b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a0a30 0x7ffbd41225b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 -- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 msgr2=0x7ffbd4123030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd4123030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 -- 172.21.15.19:0/3661103522 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc009a70 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbd27fc700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9b0 tx=0x7ffbc800ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8009710 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc800c850 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.918+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800cbc0 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.919+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd41260d0 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.919+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd40a0220 con 0x7ffbd40a1510 2023-10-03T10:17:57.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.920+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40a1d00 con 0x7ffbd40a1510 2023-10-03T10:17:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.920+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbc800cd20 con 0x7ffbd40a1510 2023-10-03T10:17:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.921+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffbc803f870 con 0x7ffbd40a1510 2023-10-03T10:17:57.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.921+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ce40123b0 con 0x7f4cf00a1340 2023-10-03T10:17:57.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:57.926+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbc801bc30 con 0x7ffbd40a1510 2023-10-03T10:17:58.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.046+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe87006b9e0 con 0x7fe87009e390 2023-10-03T10:17:58.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.047+0000 7fe865ffb700 1 -- 172.21.15.19:0/3282092476 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe86c01b3b0 con 0x7fe87009e390 2023-10-03T10:17:58.046 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:58.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.049+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f472409f6b0 con 0x7f472406b250 2023-10-03T10:17:58.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.049+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 msgr2=0x7fe87011c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.049+0000 7fe87729e700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00ebe0 tx=0x7fe86c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.049+0000 7f470bfff700 1 -- 172.21.15.19:0/2010603365 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4718029070 con 0x7f472406b250 2023-10-03T10:17:58.049 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 shutdown_connections 2023-10-03T10:17:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8701341d0 0x7fe87011d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe87009e390 0x7fe87011c910 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 --2- 172.21.15.19:0/3282092476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8701338c0 0x7fe87011ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 >> 172.21.15.19:0/3282092476 conn(0x7fe8700a2aa0 msgr2=0x7fe87009f180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 shutdown_connections 2023-10-03T10:17:58.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.050+0000 7fe87729e700 1 -- 172.21.15.19:0/3282092476 wait complete. 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 msgr2=0x7f47241c6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f4718009130 tx=0x7f4718004750 comp rx=0 tx=0).stop 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 shutdown_connections 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4724136d80 0x7f472411c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f472406a770 0x7f47241c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 --2- 172.21.15.19:0/2010603365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472406b250 0x7f47241c6810 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 >> 172.21.15.19:0/2010603365 conn(0x7f4724066f50 msgr2=0x7f47240a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 shutdown_connections 2023-10-03T10:17:58.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.052+0000 7f4729c73700 1 -- 172.21.15.19:0/2010603365 wait complete. 2023-10-03T10:17:58.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:58.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.147+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cf0074ea0 con 0x7f4cf00a1340 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.147+0000 7f4cd7fff700 1 -- 172.21.15.19:0/1862360746 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ce4011360 con 0x7f4cf00a1340 2023-10-03T10:17:58.147 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 msgr2=0x7f4cf006e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400c520 tx=0x7f4ce400c830 comp rx=0 tx=0).stop 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 shutdown_connections 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cf0134170 0x7f4cf006e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cf00a0a30 0x7f4cf006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 --2- 172.21.15.19:0/1862360746 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cf00a1340 0x7f4cf006e000 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 >> 172.21.15.19:0/1862360746 conn(0x7f4cf00a6550 msgr2=0x7f4cf009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 shutdown_connections 2023-10-03T10:17:58.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.150+0000 7f4cf5e58700 1 -- 172.21.15.19:0/1862360746 wait complete. 2023-10-03T10:17:58.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.159+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffbd4074ea0 con 0x7ffbd40a1510 2023-10-03T10:17:58.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.159+0000 7ffbbb7fe700 1 -- 172.21.15.19:0/3661103522 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbc8017020 con 0x7ffbd40a1510 2023-10-03T10:17:58.159 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 msgr2=0x7ffbd4122af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800e9b0 tx=0x7ffbc800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 shutdown_connections 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbd4139250 0x7ffbd4123030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbd40a0a30 0x7ffbd41225b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 --2- 172.21.15.19:0/3661103522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbd40a1510 0x7ffbd4122af0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 >> 172.21.15.19:0/3661103522 conn(0x7ffbd40a6550 msgr2=0x7ffbd411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:58.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 shutdown_connections 2023-10-03T10:17:58.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:58.162+0000 7ffbd965c700 1 -- 172.21.15.19:0/3661103522 wait complete. 2023-10-03T10:17:58.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:58.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:17:59.068 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:17:59.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:17:59.164 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:17:59.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:17:59.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.221+0000 7f9d10ea8700 1 Processor -- start 2023-10-03T10:17:59.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.221+0000 7f9d10ea8700 1 -- start start 2023-10-03T10:17:59.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.221+0000 7f9d10ea8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d10ea8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 0x7f9d0c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d10ea8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d0c134260 0x7f9d0c1304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d10ea8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c06b990 con 0x7f9d0c134260 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d10ea8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0a0590 con 0x7f9d0c133420 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d10ea8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c09fb80 con 0x7f9d0c133e30 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d0a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d0ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d0c134260 0x7f9d0c1304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d0a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56900/0 (socket says 172.21.15.19:56900) 2023-10-03T10:17:59.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d0a59c700 1 -- 172.21.15.19:0/4237669877 learned_addr learned my addr 172.21.15.19:0/4237669877 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 0x7f9d0c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 -- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 msgr2=0x7f9d0c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 -- 172.21.15.19:0/4237669877 >> v2:172.21.15.19:3300/0 conn(0x7f9d0c134260 msgr2=0x7f9d0c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 --2- 172.21.15.19:0/4237669877 >> v2:172.21.15.19:3300/0 conn(0x7f9d0c134260 0x7f9d0c1304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d09d9b700 1 -- 172.21.15.19:0/4237669877 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0a0030 con 0x7f9d0c133e30 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.222+0000 7f9d0a59c700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.223+0000 7f9d09d9b700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 0x7f9d0c12ff90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009840 tx=0x7f9d00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=737be97dca4eb720 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.223+0000 7f9d0959a700 1 -- 172.21.15.19:0/4237669877 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00011830 con 0x7f9d0c133e30 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.223+0000 7f9d0959a700 1 -- 172.21.15.19:0/4237669877 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d00011990 con 0x7f9d0c133e30 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.223+0000 7f9d0959a700 1 -- 172.21.15.19:0/4237669877 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d00011d20 con 0x7f9d0c133e30 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 msgr2=0x7f9d0c12ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 0x7f9d0c12ff90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9d00009840 tx=0x7f9d00009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4237669877 shutdown_connections 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4237669877 >> v2:172.21.15.19:3300/0 conn(0x7f9d0c134260 0x7f9d0c1304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4237669877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c133e30 0x7f9d0c12ff90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4237669877 >> 172.21.15.19:0/4237669877 conn(0x7f9d0c0a4210 msgr2=0x7f9d0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4237669877 shutdown_connections 2023-10-03T10:17:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.224+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4237669877 wait complete. 2023-10-03T10:17:59.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 Processor -- start 2023-10-03T10:17:59.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 -- start start 2023-10-03T10:17:59.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0c133e30 0x7f9d0c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c134260 0x7f9d0c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c11ff90 con 0x7f9d0c133e30 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c120170 con 0x7f9d0c133420 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d10ea8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c12da20 con 0x7f9d0c134260 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d0a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d0a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56902/0 (socket says 172.21.15.19:56902) 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d0a59c700 1 -- 172.21.15.19:0/4101223776 learned_addr learned my addr 172.21.15.19:0/4101223776 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d0ad9d700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c134260 0x7f9d0c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.226+0000 7f9d09d9b700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0c133e30 0x7f9d0c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 -- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c134260 msgr2=0x7f9d0c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c134260 0x7f9d0c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 -- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0c133e30 msgr2=0x7f9d0c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0c133e30 0x7f9d0c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 -- 172.21.15.19:0/4101223776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc009550 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d0a59c700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00ebe0 tx=0x7f9cfc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00c850 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cfc00c9b0 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00cd20 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.227+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000094a0 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.228+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c11fbd0 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.229+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9cfc013470 con 0x7f9d0c133420 2023-10-03T10:17:59.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.229+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9cfc03fd10 con 0x7f9d0c133420 2023-10-03T10:17:59.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.229+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c11fdc0 con 0x7f9d0c133420 2023-10-03T10:17:59.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.235+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9cfc01b3b0 con 0x7f9d0c133420 2023-10-03T10:17:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.270+0000 7f173cb5e700 1 Processor -- start 2023-10-03T10:17:59.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.270+0000 7f173cb5e700 1 -- start start 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f173cb5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f173cb5e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1738139170 0x7f173813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f173cb5e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173809b120 con 0x7f173809d6f0 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f173cb5e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f173806b460 con 0x7f1738139170 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f173cb5e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173809a7e0 con 0x7f173809e1d0 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f1735d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f1735d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56910/0 (socket says 172.21.15.19:56910) 2023-10-03T10:17:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f1736d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1738139170 0x7f173813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.271+0000 7f1735d9b700 1 -- 172.21.15.19:0/1544722995 learned_addr learned my addr 172.21.15.19:0/1544722995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1736d9d700 1 -- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 msgr2=0x7f1738138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1736d9d700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1736d9d700 1 -- 172.21.15.19:0/1544722995 >> v1:172.21.15.19:6789/0 conn(0x7f173809d6f0 legacy=0x7f173809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1736d9d700 1 -- 172.21.15.19:0/1544722995 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173809a500 con 0x7f1738139170 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1735d9b700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f1736d9d700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1738139170 0x7f173813b550 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1730009d90 tx=0x7f173000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8d39ee5b798102 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f173559a700 1 -- 172.21.15.19:0/1544722995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000e070 con 0x7f1738139170 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f173559a700 1 -- 172.21.15.19:0/1544722995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000bb20 con 0x7f1738139170 2023-10-03T10:17:59.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.272+0000 7f173559a700 1 -- 172.21.15.19:0/1544722995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730012430 con 0x7f1738139170 2023-10-03T10:17:59.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 -- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1738139170 msgr2=0x7f173813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1738139170 0x7f173813b550 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1730009d90 tx=0x7f173000b330 comp rx=0 tx=0).stop 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 -- 172.21.15.19:0/1544722995 shutdown_connections 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1738139170 0x7f173813b550 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 --2- 172.21.15.19:0/1544722995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809e1d0 0x7f1738138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 -- 172.21.15.19:0/1544722995 >> 172.21.15.19:0/1544722995 conn(0x7f1738066f50 msgr2=0x7f173809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 -- 172.21.15.19:0/1544722995 shutdown_connections 2023-10-03T10:17:59.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.273+0000 7f173cb5e700 1 -- 172.21.15.19:0/1544722995 wait complete. 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.275+0000 7f173cb5e700 1 Processor -- start 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.275+0000 7f173cb5e700 1 -- start start 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 0x7f17381c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1738139170 0x7f17381c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1738122550 con 0x7f173809e1d0 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17381205b0 con 0x7f173809d6f0 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173cb5e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1738121f20 con 0x7f1738139170 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56924/0 (socket says 172.21.15.19:56924) 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f173659c700 1 -- 172.21.15.19:0/10677018 learned_addr learned my addr 172.21.15.19:0/10677018 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f1735d9b700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 0x7f17381c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.276+0000 7f1736d9d700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1738139170 0x7f17381c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 -- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1738139170 msgr2=0x7f17381c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1738139170 0x7f17381c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 -- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 msgr2=0x7f17381c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 0x7f17381c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 -- 172.21.15.19:0/10677018 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172c009550 con 0x7f173809d6f0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f1735d9b700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 0x7f17381c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173659c700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f172800c4e0 tx=0x7f172800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280052d0 con 0x7f173809d6f0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728005430 con 0x7f173809d6f0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1730009a70 con 0x7f173809d6f0 2023-10-03T10:17:59.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280038c0 con 0x7f173809d6f0 2023-10-03T10:17:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.277+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1738121220 con 0x7f173809d6f0 2023-10-03T10:17:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.279+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1738074ea0 con 0x7f173809d6f0 2023-10-03T10:17:59.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.280+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1728003a20 con 0x7f173809d6f0 2023-10-03T10:17:59.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.280+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f172803eca0 con 0x7f173809d6f0 2023-10-03T10:17:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.289+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f17280192c0 con 0x7f173809d6f0 2023-10-03T10:17:59.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.330+0000 7f62bf51d700 1 Processor -- start 2023-10-03T10:17:59.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.330+0000 7f62bf51d700 1 -- start start 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bf51d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f62b806a770 0x7f62b806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bf51d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bf51d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b809ece0 con 0x7f62b8131b40 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bf51d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b809e760 con 0x7f62b806a770 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bf51d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b809e040 con 0x7f62b806b080 2023-10-03T10:17:59.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bcab8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bcab8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56936/0 (socket says 172.21.15.19:56936) 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bcab8700 1 -- 172.21.15.19:0/1747803481 learned_addr learned my addr 172.21.15.19:0/1747803481 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/1747803481 >> v2:172.21.15.19:3300/0 conn(0x7f62b806a770 0x7f62b806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62affff700 1 -- 172.21.15.19:0/1747803481 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112467818 0 0) 0x7f62b809ece0 con 0x7f62b8131b40 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62affff700 1 -- 172.21.15.19:0/1747803481 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62a40035b0 con 0x7f62b8131b40 2023-10-03T10:17:59.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bd2b9700 1 -- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 msgr2=0x7f62b8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.331+0000 7f62bd2b9700 1 -- 172.21.15.19:0/1747803481 >> v1:172.21.15.19:6789/0 conn(0x7f62b8131b40 legacy=0x7f62b8138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62bd2b9700 1 -- 172.21.15.19:0/1747803481 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b809f630 con 0x7f62b806a770 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62bcab8700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806a770 0x7f62b806ab40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009840 tx=0x7f62b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d6f2741e33a8c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62affff700 1 -- 172.21.15.19:0/1747803481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011830 con 0x7f62b806a770 2023-10-03T10:17:59.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62affff700 1 -- 172.21.15.19:0/1747803481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b4011990 con 0x7f62b806a770 2023-10-03T10:17:59.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.332+0000 7f62affff700 1 -- 172.21.15.19:0/1747803481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4011d00 con 0x7f62b806a770 2023-10-03T10:17:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 -- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806a770 msgr2=0x7f62b806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806a770 0x7f62b806ab40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009840 tx=0x7f62b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:17:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 -- 172.21.15.19:0/1747803481 shutdown_connections 2023-10-03T10:17:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806a770 0x7f62b806ab40 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 --2- 172.21.15.19:0/1747803481 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b806b080 0x7f62b8131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 -- 172.21.15.19:0/1747803481 >> 172.21.15.19:0/1747803481 conn(0x7f62b8066f50 msgr2=0x7f62b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 -- 172.21.15.19:0/1747803481 shutdown_connections 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.333+0000 7f62bf51d700 1 -- 172.21.15.19:0/1747803481 wait complete. 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 Processor -- start 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 -- start start 2023-10-03T10:17:59.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806b080 0x7f62b809b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131b40 0x7f62b81c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8071e60 con 0x7f62b806b080 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b8125d70 con 0x7f62b8131b40 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.335+0000 7f62bf51d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b809b7f0 con 0x7f62b806a770 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45086/0 (socket says 172.21.15.19:45086) 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 -- 172.21.15.19:0/2373760527 learned_addr learned my addr 172.21.15.19:0/2373760527 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bdaba700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131b40 0x7f62b81c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bcab8700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806b080 0x7f62b809b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 -- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131b40 msgr2=0x7f62b81c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131b40 0x7f62b81c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 -- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806b080 msgr2=0x7f62b809b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806b080 0x7f62b809b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 -- 172.21.15.19:0/2373760527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8009550 con 0x7f62b806a770 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.336+0000 7f62bd2b9700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009b90 tx=0x7f62b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.337+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b4004550 con 0x7f62b806a770 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.337+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b401f070 con 0x7f62b806a770 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.337+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b40038a0 con 0x7f62b806a770 2023-10-03T10:17:59.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.337+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b40094a0 con 0x7f62b806a770 2023-10-03T10:17:59.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.337+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b8126aa0 con 0x7f62b806a770 2023-10-03T10:17:59.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.338+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b8126210 con 0x7f62b806a770 2023-10-03T10:17:59.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.339+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f62b4003a00 con 0x7f62b806a770 2023-10-03T10:17:59.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.339+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f62b4021070 con 0x7f62b806a770 2023-10-03T10:17:59.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.348+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f62b402f990 con 0x7f62b806a770 2023-10-03T10:17:59.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.363+0000 7f49691f7700 1 Processor -- start 2023-10-03T10:17:59.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.363+0000 7f49691f7700 1 -- start start 2023-10-03T10:17:59.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f496409e410 0x7f4964130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496409f520 con 0x7f496409e410 2023-10-03T10:17:59.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496409f130 con 0x7f496409e000 2023-10-03T10:17:59.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f49691f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f496409e930 con 0x7f496409d6f0 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f496259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.364+0000 7f4962d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f496259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56950/0 (socket says 172.21.15.19:56950) 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f496259c700 1 -- 172.21.15.19:0/142618560 learned_addr learned my addr 172.21.15.19:0/142618560 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f496359e700 1 --2- 172.21.15.19:0/142618560 >> v2:172.21.15.19:3300/0 conn(0x7f496409e410 0x7f4964130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 -- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 msgr2=0x7f4964130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 -- 172.21.15.19:0/142618560 >> v2:172.21.15.19:3300/0 conn(0x7f496409e410 msgr2=0x7f4964130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 --2- 172.21.15.19:0/142618560 >> v2:172.21.15.19:3300/0 conn(0x7f496409e410 0x7f4964130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 -- 172.21.15.19:0/142618560 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496409b2d0 con 0x7f496409d6f0 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f496259c700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4962d9d700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496409dac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f495400dc90 tx=0x7f495400f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc5bf9ca436c468f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.365+0000 7f4961d9b700 1 -- 172.21.15.19:0/142618560 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4954012070 con 0x7f496409d6f0 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f4961d9b700 1 -- 172.21.15.19:0/142618560 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495400d2e0 con 0x7f496409d6f0 2023-10-03T10:17:59.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f4961d9b700 1 -- 172.21.15.19:0/142618560 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400f8b0 con 0x7f496409d6f0 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 -- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 msgr2=0x7f496409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496409dac0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f495400dc90 tx=0x7f495400f050 comp rx=0 tx=0).stop 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 -- 172.21.15.19:0/142618560 shutdown_connections 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 --2- 172.21.15.19:0/142618560 >> v2:172.21.15.19:3300/0 conn(0x7f496409e410 0x7f4964130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496409dac0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 --2- 172.21.15.19:0/142618560 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f4964130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 -- 172.21.15.19:0/142618560 >> 172.21.15.19:0/142618560 conn(0x7f4964066f50 msgr2=0x7f496409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 -- 172.21.15.19:0/142618560 shutdown_connections 2023-10-03T10:17:59.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.366+0000 7f49691f7700 1 -- 172.21.15.19:0/142618560 wait complete. 2023-10-03T10:17:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.368+0000 7f49691f7700 1 Processor -- start 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.368+0000 7f49691f7700 1 -- start start 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f496411e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f496409e410 0x7f496411e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496411fb00 con 0x7f496409e410 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4964120d50 con 0x7f496409e000 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f49691f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49641217d0 con 0x7f496409d6f0 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f496259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f496411e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f4962d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f496259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f496411e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56966/0 (socket says 172.21.15.19:56966) 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f496259c700 1 -- 172.21.15.19:0/1006270120 learned_addr learned my addr 172.21.15.19:0/1006270120 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f4962d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45108/0 (socket says 172.21.15.19:45108) 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.369+0000 7f496359e700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f496409e410 0x7f496411e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 -- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 msgr2=0x7f496411e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f496411e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 -- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f496409e410 msgr2=0x7f496411e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f496409e410 0x7f496411e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 -- 172.21.15.19:0/1006270120 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495800b600 con 0x7f496409d6f0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f4962d9d700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4954019000 tx=0x7f4954004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400f6b0 con 0x7f496409d6f0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495400f810 con 0x7f496409d6f0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f495400d940 con 0x7f496409d6f0 2023-10-03T10:17:59.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.370+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495400fbc0 con 0x7f496409d6f0 2023-10-03T10:17:59.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.371+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640a3af0 con 0x7f496409d6f0 2023-10-03T10:17:59.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.372+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496409c700 con 0x7f496409d6f0 2023-10-03T10:17:59.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.372+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f495400fd20 con 0x7f496409d6f0 2023-10-03T10:17:59.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.373+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4954045030 con 0x7f496409d6f0 2023-10-03T10:17:59.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.377+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49540157a0 con 0x7f496409d6f0 2023-10-03T10:17:59.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.456+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9d0c074ea0 con 0x7f9d0c133420 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.456+0000 7f9cfaffd700 1 -- 172.21.15.19:0/4101223776 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9cfc011b00 con 0x7f9d0c133420 2023-10-03T10:17:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.458+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 msgr2=0x7f9d0c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.458+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00ebe0 tx=0x7f9cfc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 shutdown_connections 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d0c134260 0x7f9d0c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d0c133420 0x7f9d0c09c480 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 --2- 172.21.15.19:0/4101223776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d0c133e30 0x7f9d0c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 >> 172.21.15.19:0/4101223776 conn(0x7f9d0c0a4210 msgr2=0x7f9d0c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 shutdown_connections 2023-10-03T10:17:59.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.459+0000 7f9d10ea8700 1 -- 172.21.15.19:0/4101223776 wait complete. 2023-10-03T10:17:59.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:17:59.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.519+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f17380a2c20 con 0x7f173809d6f0 2023-10-03T10:17:59.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.519+0000 7f1726ffd700 1 -- 172.21.15.19:0/10677018 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1728017070 con 0x7f173809d6f0 2023-10-03T10:17:59.519 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 msgr2=0x7f17381c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f172800c4e0 tx=0x7f172800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 shutdown_connections 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1738139170 0x7f17381c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173809d6f0 0x7f17381c8360 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 --2- 172.21.15.19:0/10677018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173809e1d0 0x7f17381c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.522+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 >> 172.21.15.19:0/10677018 conn(0x7f1738066f50 msgr2=0x7f1738136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.523+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 shutdown_connections 2023-10-03T10:17:59.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.523+0000 7f173cb5e700 1 -- 172.21.15.19:0/10677018 wait complete. 2023-10-03T10:17:59.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:17:59.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.560+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f62b8074ea0 con 0x7f62b806a770 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.560+0000 7f62adffb700 1 -- 172.21.15.19:0/2373760527 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f62b4035090 con 0x7f62b806a770 2023-10-03T10:17:59.560 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:17:59.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 msgr2=0x7f62b809ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62b4009b90 tx=0x7f62b4004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 shutdown_connections 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f62b8131b40 0x7f62b81c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f62b806a770 0x7f62b809ad70 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 --2- 172.21.15.19:0/2373760527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f62b806b080 0x7f62b809b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 >> 172.21.15.19:0/2373760527 conn(0x7f62b8066f50 msgr2=0x7f62b806fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 shutdown_connections 2023-10-03T10:17:59.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.562+0000 7f62bf51d700 1 -- 172.21.15.19:0/2373760527 wait complete. 2023-10-03T10:17:59.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:17:59.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.587+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4964074ea0 con 0x7f496409d6f0 2023-10-03T10:17:59.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.587+0000 7f494b7fe700 1 -- 172.21.15.19:0/1006270120 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4954015390 con 0x7f496409d6f0 2023-10-03T10:17:59.587 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:17:59.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 msgr2=0x7f496411def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:17:59.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4954019000 tx=0x7f4954004750 comp rx=0 tx=0).stop 2023-10-03T10:17:59.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 shutdown_connections 2023-10-03T10:17:59.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f496409e410 0x7f496411e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f496409d6f0 0x7f496411def0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 --2- 172.21.15.19:0/1006270120 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f496409e000 0x7f496411e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:17:59.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 >> 172.21.15.19:0/1006270120 conn(0x7f4964066f50 msgr2=0x7f4964070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:17:59.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 shutdown_connections 2023-10-03T10:17:59.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:17:59.589+0000 7f49691f7700 1 -- 172.21.15.19:0/1006270120 wait complete. 2023-10-03T10:17:59.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:00.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:00.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:00.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:00.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.623+0000 7f0572451700 1 Processor -- start 2023-10-03T10:18:00.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.623+0000 7f0572451700 1 -- start start 2023-10-03T10:18:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.624+0000 7f0572451700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.624+0000 7f0572451700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f056c136fe0 0x7f056c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.624+0000 7f0572451700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c070940 con 0x7f056c09e930 2023-10-03T10:18:00.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.624+0000 7f0572451700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c06fd60 con 0x7f056c136fe0 2023-10-03T10:18:00.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.624+0000 7f0572451700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c06fa80 con 0x7f056c09f410 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f05709ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f056c136fe0 0x7f056c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f056c09e930 0x7f056c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58528/0 (socket says 172.21.15.19:58528) 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056bfff700 1 -- 172.21.15.19:0/1790680489 learned_addr learned my addr 172.21.15.19:0/1790680489 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 -- 172.21.15.19:0/1790680489 >> v2:172.21.15.19:3300/0 conn(0x7f056c136fe0 msgr2=0x7f056c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 --2- 172.21.15.19:0/1790680489 >> v2:172.21.15.19:3300/0 conn(0x7f056c136fe0 0x7f056c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 -- 172.21.15.19:0/1790680489 >> v1:172.21.15.19:6789/0 conn(0x7f056c09e930 legacy=0x7f056c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 -- 172.21.15.19:0/1790680489 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c09fb60 con 0x7f056c09f410 2023-10-03T10:18:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056b7fe700 1 --2- 172.21.15.19:0/1790680489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c136aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0560009840 tx=0x7f0560009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12078a1b11da10f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056affd700 1 -- 172.21.15.19:0/1790680489 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560004230 con 0x7f056c09f410 2023-10-03T10:18:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056affd700 1 -- 172.21.15.19:0/1790680489 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0560004390 con 0x7f056c09f410 2023-10-03T10:18:00.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.625+0000 7f056affd700 1 -- 172.21.15.19:0/1790680489 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600036a0 con 0x7f056c09f410 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.626+0000 7f0572451700 1 -- 172.21.15.19:0/1790680489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 msgr2=0x7f056c136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.626+0000 7f0572451700 1 --2- 172.21.15.19:0/1790680489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c136aa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0560009840 tx=0x7f0560009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 -- 172.21.15.19:0/1790680489 shutdown_connections 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 --2- 172.21.15.19:0/1790680489 >> v2:172.21.15.19:3300/0 conn(0x7f056c136fe0 0x7f056c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 --2- 172.21.15.19:0/1790680489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c136aa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 -- 172.21.15.19:0/1790680489 >> 172.21.15.19:0/1790680489 conn(0x7f056c0a4210 msgr2=0x7f056c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 -- 172.21.15.19:0/1790680489 shutdown_connections 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.627+0000 7f0572451700 1 -- 172.21.15.19:0/1790680489 wait complete. 2023-10-03T10:18:00.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 Processor -- start 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 -- start start 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 0x7f056c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11e1d0 con 0x7f056c136fe0 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11d3e0 con 0x7f056c09f410 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.628+0000 7f0572451700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f056c11d9f0 con 0x7f056c09e930 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f05709ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f05709ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37418/0 (socket says 172.21.15.19:37418) 2023-10-03T10:18:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56982/0 (socket says 172.21.15.19:56982) 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f05709ee700 1 -- 172.21.15.19:0/2803696075 learned_addr learned my addr 172.21.15.19:0/2803696075 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056bfff700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 0x7f056c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 -- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 msgr2=0x7f056c06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 0x7f056c06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 -- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 msgr2=0x7f056c11f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 -- 172.21.15.19:0/2803696075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600094a0 con 0x7f056c09f410 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f05709ee700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056bfff700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 0x7f056c06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.629+0000 7f056b7fe700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0560015000 tx=0x7f0560004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.630+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560003d80 con 0x7f056c09f410 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.630+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056001f070 con 0x7f056c09f410 2023-10-03T10:18:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.630+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560011870 con 0x7f056c09f410 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.630+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c1324d0 con 0x7f056c09f410 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.630+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c11e720 con 0x7f056c09f410 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.631+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0560021030 con 0x7f056c09f410 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.631+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0560040820 con 0x7f056c09f410 2023-10-03T10:18:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.631+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c074ea0 con 0x7f056c09f410 2023-10-03T10:18:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.637+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f05600119d0 con 0x7f056c09f410 2023-10-03T10:18:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.685+0000 7f1054f5a700 1 Processor -- start 2023-10-03T10:18:00.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.685+0000 7f1054f5a700 1 -- start start 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.685+0000 7f1054f5a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f1054f5a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 0x7f1050130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f1054f5a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105009f130 con 0x7f105009e000 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f1054f5a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105009f520 con 0x7f105009e410 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f1054f5a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105009e930 con 0x7f105009d6f0 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 0x7f1050130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56986/0 (socket says 172.21.15.19:56986) 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 0x7f1050130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37420/0 (socket says 172.21.15.19:37420) 2023-10-03T10:18:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 -- 172.21.15.19:0/4223155234 learned_addr learned my addr 172.21.15.19:0/4223155234 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 -- 172.21.15.19:0/4223155234 >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 msgr2=0x7f1050130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 --2- 172.21.15.19:0/4223155234 >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 0x7f1050130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 -- 172.21.15.19:0/4223155234 >> v1:172.21.15.19:6789/0 conn(0x7f105009e000 legacy=0x7f1050130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104e59c700 1 -- 172.21.15.19:0/4223155234 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105009b2d0 con 0x7f105009d6f0 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.686+0000 7f104d59a700 1 -- 172.21.15.19:0/4223155234 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348252961 0 0) 0x7f105009f130 con 0x7f105009e000 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.687+0000 7f104e59c700 1 --2- 172.21.15.19:0/4223155234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f10400098f0 tx=0x7f1040009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76848b3615ba7b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.687+0000 7f104d59a700 1 -- 172.21.15.19:0/4223155234 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011830 con 0x7f105009d6f0 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.687+0000 7f104d59a700 1 -- 172.21.15.19:0/4223155234 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1040011990 con 0x7f105009d6f0 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.687+0000 7f104d59a700 1 -- 172.21.15.19:0/4223155234 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1040011d20 con 0x7f105009d6f0 2023-10-03T10:18:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 -- 172.21.15.19:0/4223155234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 msgr2=0x7f105009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 --2- 172.21.15.19:0/4223155234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f10400098f0 tx=0x7f1040009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 -- 172.21.15.19:0/4223155234 shutdown_connections 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 --2- 172.21.15.19:0/4223155234 >> v2:172.21.15.19:3300/0 conn(0x7f105009e410 0x7f1050130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 --2- 172.21.15.19:0/4223155234 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009d6f0 0x7f105009dac0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 -- 172.21.15.19:0/4223155234 >> 172.21.15.19:0/4223155234 conn(0x7f1050066f50 msgr2=0x7f105009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 -- 172.21.15.19:0/4223155234 shutdown_connections 2023-10-03T10:18:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.688+0000 7f1054f5a700 1 -- 172.21.15.19:0/4223155234 wait complete. 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.689+0000 7f1054f5a700 1 Processor -- start 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.689+0000 7f1054f5a700 1 -- start start 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f105009d6f0 0x7f1050135a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f105009e000 0x7f1050135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1050138170 con 0x7f105009e000 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105013b8a0 con 0x7f105009e410 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f1054f5a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1050130fe0 con 0x7f105009d6f0 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57000/0 (socket says 172.21.15.19:57000) 2023-10-03T10:18:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 -- 172.21.15.19:0/688232972 learned_addr learned my addr 172.21.15.19:0/688232972 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104dd9b700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f105009e000 0x7f1050135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104e59c700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f105009d6f0 0x7f1050135a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 -- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f105009d6f0 msgr2=0x7f1050135a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f105009d6f0 0x7f1050135a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 -- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f105009e000 msgr2=0x7f1050135fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f105009e000 0x7f1050135fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.690+0000 7f104ed9d700 1 -- 172.21.15.19:0/688232972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1040009550 con 0x7f105009e410 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f104ed9d700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f104800efc0 tx=0x7f104800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800cc90 con 0x7f105009e410 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104800f040 con 0x7f105009e410 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10500a2140 con 0x7f105009e410 2023-10-03T10:18:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480146c0 con 0x7f105009e410 2023-10-03T10:18:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.691+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1050137bd0 con 0x7f105009e410 2023-10-03T10:18:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.692+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1048014820 con 0x7f105009e410 2023-10-03T10:18:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.692+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1050074ea0 con 0x7f105009e410 2023-10-03T10:18:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.692+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f10480404a0 con 0x7f105009e410 2023-10-03T10:18:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.697+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f104801d400 con 0x7f105009e410 2023-10-03T10:18:00.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.730+0000 7f8698a32700 1 Processor -- start 2023-10-03T10:18:00.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.730+0000 7f8698a32700 1 -- start start 2023-10-03T10:18:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8698a32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 0x7f8694138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8698a32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8698a32700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869406b990 con 0x7f8694133420 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8698a32700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869409b0e0 con 0x7f8694138dc0 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8698a32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8694133c20 con 0x7f86941337f0 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f869259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8694133420 0x7f8694133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58542/0 (socket says 172.21.15.19:58542) 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f8691d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 0x7f8694138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.731+0000 7f869259c700 1 -- 172.21.15.19:0/4159974387 learned_addr learned my addr 172.21.15.19:0/4159974387 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8692d9d700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f869159a700 1 -- 172.21.15.19:0/4159974387 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878851061 0 0) 0x7f869406b990 con 0x7f8694133420 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f869159a700 1 -- 172.21.15.19:0/4159974387 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c0035b0 con 0x7f8694133420 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8691d9b700 1 -- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 msgr2=0x7f869413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8691d9b700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8691d9b700 1 -- 172.21.15.19:0/4159974387 >> v1:172.21.15.19:6789/0 conn(0x7f8694133420 legacy=0x7f8694133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8691d9b700 1 -- 172.21.15.19:0/4159974387 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86940a0590 con 0x7f86941337f0 2023-10-03T10:18:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f8691d9b700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 0x7f8694138880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8688009870 tx=0x7f8688009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c4717baedb9ce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f869159a700 1 -- 172.21.15.19:0/4159974387 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688011830 con 0x7f86941337f0 2023-10-03T10:18:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f869159a700 1 -- 172.21.15.19:0/4159974387 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688011990 con 0x7f86941337f0 2023-10-03T10:18:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.732+0000 7f869159a700 1 -- 172.21.15.19:0/4159974387 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688011d00 con 0x7f86941337f0 2023-10-03T10:18:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.733+0000 7f8698a32700 1 -- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 msgr2=0x7f8694138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.733+0000 7f8698a32700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 0x7f8694138880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8688009870 tx=0x7f8688009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 -- 172.21.15.19:0/4159974387 shutdown_connections 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 --2- 172.21.15.19:0/4159974387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f86941337f0 0x7f8694138880 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 -- 172.21.15.19:0/4159974387 >> 172.21.15.19:0/4159974387 conn(0x7f86940a4210 msgr2=0x7f86940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 -- 172.21.15.19:0/4159974387 shutdown_connections 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.734+0000 7f8698a32700 1 -- 172.21.15.19:0/4159974387 wait complete. 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 Processor -- start 2023-10-03T10:18:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 -- start start 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 0x7f869412f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8694138ac0 con 0x7f86941337f0 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86941308c0 con 0x7f8694138dc0 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.735+0000 7f8698a32700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f869409c740 con 0x7f8694133420 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f8692d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45158/0 (socket says 172.21.15.19:45158) 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 -- 172.21.15.19:0/4273062020 learned_addr learned my addr 172.21.15.19:0/4273062020 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f8692d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57022/0 (socket says 172.21.15.19:57022) 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f8691d9b700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 0x7f869412f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 -- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 msgr2=0x7f869412f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 -- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 msgr2=0x7f869412f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 0x7f869412f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 -- 172.21.15.19:0/4273062020 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880094a0 con 0x7f8694133420 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f8691d9b700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 0x7f869412f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f8692d9d700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.736+0000 7f869259c700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f868400c730 tx=0x7f868400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.737+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684005d70 con 0x7f8694133420 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.737+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86840070d0 con 0x7f8694133420 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.737+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869409cce0 con 0x7f8694133420 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.737+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684007460 con 0x7f8694133420 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.737+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869409bf90 con 0x7f8694133420 2023-10-03T10:18:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.738+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f86840075c0 con 0x7f8694133420 2023-10-03T10:18:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.738+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f868403ebd0 con 0x7f8694133420 2023-10-03T10:18:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.739+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8694074ea0 con 0x7f8694133420 2023-10-03T10:18:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.743+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f868400e280 con 0x7f8694133420 2023-10-03T10:18:00.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.783+0000 7f16525f1700 1 Processor -- start 2023-10-03T10:18:00.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.783+0000 7f16525f1700 1 -- start start 2023-10-03T10:18:00.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f16525f1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 0x7f164c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f16525f1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f164c09d630 0x7f164c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f16525f1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0a2a70 con 0x7f164c133930 2023-10-03T10:18:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f16525f1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0a01d0 con 0x7f164c09d630 2023-10-03T10:18:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f16525f1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164c09e2b0 con 0x7f164c0a0a30 2023-10-03T10:18:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f164bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 0x7f164c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f164b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f164c09d630 0x7f164c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f164b7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f164c09d630 0x7f164c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37448/0 (socket says 172.21.15.19:37448) 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f164bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 0x7f164c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45166/0 (socket says 172.21.15.19:45166) 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.784+0000 7f164b7fe700 1 -- 172.21.15.19:0/3945928845 learned_addr learned my addr 172.21.15.19:0/3945928845 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164b7fe700 1 -- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 msgr2=0x7f164c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164b7fe700 1 --2- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 0x7f164c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164b7fe700 1 -- 172.21.15.19:0/3945928845 >> v1:172.21.15.19:6789/0 conn(0x7f164c133930 legacy=0x7f164c133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164b7fe700 1 -- 172.21.15.19:0/3945928845 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c09dc50 con 0x7f164c09d630 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164affd700 1 -- 172.21.15.19:0/3945928845 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968831825 0 0) 0x7f164c0a2a70 con 0x7f164c133930 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164b7fe700 1 --2- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c09d630 0x7f164c0a1340 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f16400098f0 tx=0x7f1640009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9629691a98c356bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164affd700 1 -- 172.21.15.19:0/3945928845 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011830 con 0x7f164c09d630 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164affd700 1 -- 172.21.15.19:0/3945928845 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640011990 con 0x7f164c09d630 2023-10-03T10:18:00.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.785+0000 7f164affd700 1 -- 172.21.15.19:0/3945928845 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011d20 con 0x7f164c09d630 2023-10-03T10:18:00.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 -- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c09d630 msgr2=0x7f164c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 --2- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c09d630 0x7f164c0a1340 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f16400098f0 tx=0x7f1640009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:00.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 -- 172.21.15.19:0/3945928845 shutdown_connections 2023-10-03T10:18:00.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 --2- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c0a0a30 0x7f164c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 --2- 172.21.15.19:0/3945928845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c09d630 0x7f164c0a1340 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 -- 172.21.15.19:0/3945928845 >> 172.21.15.19:0/3945928845 conn(0x7f164c0a3050 msgr2=0x7f164c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 -- 172.21.15.19:0/3945928845 shutdown_connections 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.786+0000 7f16525f1700 1 -- 172.21.15.19:0/3945928845 wait complete. 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.787+0000 7f16525f1700 1 Processor -- start 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.787+0000 7f16525f1700 1 -- start start 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f164c09d630 0x7f164c126020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c133930 0x7f164c126aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c129580 con 0x7f164c0a0a30 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c127960 con 0x7f164c09d630 2023-10-03T10:18:00.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f16525f1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0a4350 con 0x7f164c133930 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37454/0 (socket says 172.21.15.19:37454) 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 -- 172.21.15.19:0/1683913068 learned_addr learned my addr 172.21.15.19:0/1683913068 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f1650b8e700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c133930 0x7f164c126aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 -- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c133930 msgr2=0x7f164c126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c133930 0x7f164c126aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 -- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f164c09d630 msgr2=0x7f164c126020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f164c09d630 0x7f164c126020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.788+0000 7f164b7fe700 1 -- 172.21.15.19:0/1683913068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640009550 con 0x7f164c0a0a30 2023-10-03T10:18:00.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.789+0000 7f164b7fe700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1640013000 tx=0x7f1640004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.789+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640004380 con 0x7f164c0a0a30 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.789+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164001f070 con 0x7f164c0a0a30 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.789+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c1297d0 con 0x7f164c0a0a30 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.789+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400036a0 con 0x7f164c0a0a30 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.790+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c128f20 con 0x7f164c0a0a30 2023-10-03T10:18:00.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.790+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1640021030 con 0x7f164c0a0a30 2023-10-03T10:18:00.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.790+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1640015520 con 0x7f164c0a0a30 2023-10-03T10:18:00.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.791+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c132b80 con 0x7f164c0a0a30 2023-10-03T10:18:00.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.796+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f164000b9d0 con 0x7f164c0a0a30 2023-10-03T10:18:00.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.854+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f056c071d20 con 0x7f056c09f410 2023-10-03T10:18:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.854+0000 7f0568ff9700 1 -- 172.21.15.19:0/2803696075 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f056001b440 con 0x7f056c09f410 2023-10-03T10:18:00.854 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 msgr2=0x7f056c11eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0560015000 tx=0x7f0560004750 comp rx=0 tx=0).stop 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 shutdown_connections 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f056c136fe0 0x7f056c11f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f056c09e930 0x7f056c06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 --2- 172.21.15.19:0/2803696075 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f056c09f410 0x7f056c11eb70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 >> 172.21.15.19:0/2803696075 conn(0x7f056c0a4210 msgr2=0x7f056c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 shutdown_connections 2023-10-03T10:18:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.857+0000 7f0572451700 1 -- 172.21.15.19:0/2803696075 wait complete. 2023-10-03T10:18:00.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:00.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.912+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1050071f30 con 0x7f105009e410 2023-10-03T10:18:00.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.912+0000 7f103effd700 1 -- 172.21.15.19:0/688232972 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1048012340 con 0x7f105009e410 2023-10-03T10:18:00.912 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 msgr2=0x7f1050136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f104800efc0 tx=0x7f104800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 shutdown_connections 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f105009e410 0x7f1050136500 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f105009d6f0 0x7f1050135a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 --2- 172.21.15.19:0/688232972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f105009e000 0x7f1050135fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 >> 172.21.15.19:0/688232972 conn(0x7f1050066f50 msgr2=0x7f1050070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 shutdown_connections 2023-10-03T10:18:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.915+0000 7f1054f5a700 1 -- 172.21.15.19:0/688232972 wait complete. 2023-10-03T10:18:00.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.968+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f869409cac0 con 0x7f8694133420 2023-10-03T10:18:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.969+0000 7f8682ffd700 1 -- 172.21.15.19:0/4273062020 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8684017020 con 0x7f8694133420 2023-10-03T10:18:00.969 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 msgr2=0x7f869412ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f868400c730 tx=0x7f868400ca40 comp rx=0 tx=0).stop 2023-10-03T10:18:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 shutdown_connections 2023-10-03T10:18:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8694138dc0 0x7f869412f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8694133420 0x7f869412ee50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 --2- 172.21.15.19:0/4273062020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86941337f0 0x7f869412f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 >> 172.21.15.19:0/4273062020 conn(0x7f86940a4210 msgr2=0x7f8694131c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 shutdown_connections 2023-10-03T10:18:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:00.971+0000 7f8698a32700 1 -- 172.21.15.19:0/4273062020 wait complete. 2023-10-03T10:18:00.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.006+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f164c0a5780 con 0x7f164c0a0a30 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.006+0000 7f1648ff9700 1 -- 172.21.15.19:0/1683913068 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1640015020 con 0x7f164c0a0a30 2023-10-03T10:18:01.006 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 msgr2=0x7f164c126560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f1640013000 tx=0x7f1640004750 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 shutdown_connections 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f164c133930 0x7f164c126aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f164c09d630 0x7f164c126020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 --2- 172.21.15.19:0/1683913068 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f164c0a0a30 0x7f164c126560 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 >> 172.21.15.19:0/1683913068 conn(0x7f164c0a3050 msgr2=0x7f164c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 shutdown_connections 2023-10-03T10:18:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:01.009+0000 7f16525f1700 1 -- 172.21.15.19:0/1683913068 wait complete. 2023-10-03T10:18:01.022 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:01.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:01.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:01.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:02.022 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.023+0000 7f8075e9a700 1 Processor -- start 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.023+0000 7f8075e9a700 1 -- start start 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f8075e9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009d6f0 0x7f807009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f8075e9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f807009e410 0x7f8070134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f8075e9a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807009b120 con 0x7f807009e000 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f8075e9a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807006b460 con 0x7f807009e410 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f8075e9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f807009a7e0 con 0x7f807009d6f0 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f807009e410 0x7f8070134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f807009e000 0x7f80701339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58564/0 (socket says 172.21.15.19:58564) 2023-10-03T10:18:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806effd700 1 -- 172.21.15.19:0/4175431647 learned_addr learned my addr 172.21.15.19:0/4175431647 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:02.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806f7fe700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009d6f0 0x7f807009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806ffff700 1 -- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009d6f0 msgr2=0x7f807009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806ffff700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009d6f0 0x7f807009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.024+0000 7f806ffff700 1 -- 172.21.15.19:0/4175431647 >> v1:172.21.15.19:6789/0 conn(0x7f807009e000 legacy=0x7f80701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.025+0000 7f806ffff700 1 -- 172.21.15.19:0/4175431647 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807009a500 con 0x7f807009e410 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.025+0000 7f806ffff700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e410 0x7f8070134100 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8068009d90 tx=0x7f806800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c218e2bad91ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.025+0000 7f806e7fc700 1 -- 172.21.15.19:0/4175431647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806800e070 con 0x7f807009e410 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.025+0000 7f806e7fc700 1 -- 172.21.15.19:0/4175431647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806800bb20 con 0x7f807009e410 2023-10-03T10:18:02.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.025+0000 7f806e7fc700 1 -- 172.21.15.19:0/4175431647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068012430 con 0x7f807009e410 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 -- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e410 msgr2=0x7f8070134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e410 0x7f8070134100 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8068009d90 tx=0x7f806800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 -- 172.21.15.19:0/4175431647 shutdown_connections 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e410 0x7f8070134100 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4175431647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009d6f0 0x7f807009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.026+0000 7f8075e9a700 1 -- 172.21.15.19:0/4175431647 >> 172.21.15.19:0/4175431647 conn(0x7f8070066f50 msgr2=0x7f807009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.027+0000 7f8075e9a700 1 -- 172.21.15.19:0/4175431647 shutdown_connections 2023-10-03T10:18:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.027+0000 7f8075e9a700 1 -- 172.21.15.19:0/4175431647 wait complete. 2023-10-03T10:18:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 Processor -- start 2023-10-03T10:18:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 -- start start 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 0x7f80701a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 0x7f80701a63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 0x7f80701a6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80701a9630 con 0x7f807009e000 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80701a7b10 con 0x7f807009d6f0 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.028+0000 7f8075e9a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80700a2fb0 con 0x7f807009e410 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 0x7f80701a63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 0x7f80701a63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37468/0 (socket says 172.21.15.19:37468) 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806effd700 1 -- 172.21.15.19:0/4010445854 learned_addr learned my addr 172.21.15.19:0/4010445854 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806f7fe700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 0x7f80701a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 0x7f80701a6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 -- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 msgr2=0x7f80701a5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 0x7f80701a5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 -- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 msgr2=0x7f80701a63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 0x7f80701a63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 -- 172.21.15.19:0/4010445854 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8068009a70 con 0x7f807009e410 2023-10-03T10:18:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806f7fe700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 0x7f80701a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.029+0000 7f806ffff700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 0x7f80701a6900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8068009d90 tx=0x7f8068004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.030+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068012430 con 0x7f807009e410 2023-10-03T10:18:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.030+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068020070 con 0x7f807009e410 2023-10-03T10:18:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.030+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807009c710 con 0x7f807009e410 2023-10-03T10:18:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.030+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806801ba70 con 0x7f807009e410 2023-10-03T10:18:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.030+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80701a9910 con 0x7f807009e410 2023-10-03T10:18:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.031+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f806801bbd0 con 0x7f807009e410 2023-10-03T10:18:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.031+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8068022070 con 0x7f807009e410 2023-10-03T10:18:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.031+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80701a9770 con 0x7f807009e410 2023-10-03T10:18:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.037+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80701a9770 con 0x7f807009e410 2023-10-03T10:18:02.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.079+0000 7f88c1dfd700 1 Processor -- start 2023-10-03T10:18:02.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.079+0000 7f88c1dfd700 1 -- start start 2023-10-03T10:18:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.080+0000 7f88c1dfd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 0x7f88bc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.080+0000 7f88c1dfd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 0x7f88bc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.080+0000 7f88c1dfd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88bc070940 con 0x7f88bc09f240 2023-10-03T10:18:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.080+0000 7f88c1dfd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88bc06fd60 con 0x7f88bc09e930 2023-10-03T10:18:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.080+0000 7f88c1dfd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc06fa80 con 0x7f88bc09f650 2023-10-03T10:18:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 0x7f88bc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 0x7f88bc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 0x7f88bc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37470/0 (socket says 172.21.15.19:37470) 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bb7fe700 1 -- 172.21.15.19:0/1331701991 learned_addr learned my addr 172.21.15.19:0/1331701991 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 -- 172.21.15.19:0/1331701991 >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 msgr2=0x7f88bc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 --2- 172.21.15.19:0/1331701991 >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 0x7f88bc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 -- 172.21.15.19:0/1331701991 >> v1:172.21.15.19:6789/0 conn(0x7f88bc09f240 legacy=0x7f88bc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 -- 172.21.15.19:0/1331701991 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88bc09fb60 con 0x7f88bc09f650 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88bbfff700 1 --2- 172.21.15.19:0/1331701991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 0x7f88bc131f00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a8560b24b35b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.081+0000 7f88ba7fc700 1 -- 172.21.15.19:0/1331701991 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400e070 con 0x7f88bc09f650 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.082+0000 7f88ba7fc700 1 -- 172.21.15.19:0/1331701991 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400bb20 con 0x7f88bc09f650 2023-10-03T10:18:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.082+0000 7f88ba7fc700 1 -- 172.21.15.19:0/1331701991 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4012430 con 0x7f88bc09f650 2023-10-03T10:18:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.082+0000 7f88c1dfd700 1 -- 172.21.15.19:0/1331701991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 msgr2=0x7f88bc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.082+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/1331701991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 0x7f88bc131f00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009d90 tx=0x7f88b400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 -- 172.21.15.19:0/1331701991 shutdown_connections 2023-10-03T10:18:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/1331701991 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09f650 0x7f88bc131f00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/1331701991 >> v2:172.21.15.19:3300/0 conn(0x7f88bc09e930 0x7f88bc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 -- 172.21.15.19:0/1331701991 >> 172.21.15.19:0/1331701991 conn(0x7f88bc0a4210 msgr2=0x7f88bc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 -- 172.21.15.19:0/1331701991 shutdown_connections 2023-10-03T10:18:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.083+0000 7f88c1dfd700 1 -- 172.21.15.19:0/1331701991 wait complete. 2023-10-03T10:18:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.084+0000 7f88c1dfd700 1 Processor -- start 2023-10-03T10:18:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.084+0000 7f88c1dfd700 1 -- start start 2023-10-03T10:18:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09e930 0x7f88bc131a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 0x7f88bc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 0x7f88bc1c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc12f6c0 con 0x7f88bc09f240 2023-10-03T10:18:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc130330 con 0x7f88bc09e930 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88c1dfd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc12fad0 con 0x7f88bc09f650 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88bbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 0x7f88bc1c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88baffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 0x7f88bc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88bbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 0x7f88bc1c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45216/0 (socket says 172.21.15.19:45216) 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88bbfff700 1 -- 172.21.15.19:0/3576985553 learned_addr learned my addr 172.21.15.19:0/3576985553 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.085+0000 7f88bb7fe700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09e930 0x7f88bc131a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 -- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 msgr2=0x7f88bc1c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 0x7f88bc1c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 -- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09e930 msgr2=0x7f88bc131a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09e930 0x7f88bc131a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 -- 172.21.15.19:0/3576985553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b4009a70 con 0x7f88bc09f240 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88baffd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 0x7f88bc131fa0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000f60 tx=0x7f88b000c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b00052d0 con 0x7f88bc09f240 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b0005430 con 0x7f88bc09f240 2023-10-03T10:18:02.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.086+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b00038c0 con 0x7f88bc09f240 2023-10-03T10:18:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.087+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc0a0190 con 0x7f88bc09f240 2023-10-03T10:18:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.087+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc12ead0 con 0x7f88bc09f240 2023-10-03T10:18:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.088+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88bc074ea0 con 0x7f88bc09f240 2023-10-03T10:18:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.089+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88b0003a20 con 0x7f88bc09f240 2023-10-03T10:18:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.089+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88b003ee10 con 0x7f88bc09f240 2023-10-03T10:18:02.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.098+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88b0011590 con 0x7f88bc09f240 2023-10-03T10:18:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.144+0000 7f5ff67be700 1 Processor -- start 2023-10-03T10:18:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.144+0000 7f5ff67be700 1 -- start start 2023-10-03T10:18:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.144+0000 7f5ff67be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a14a0 0x7f5ff006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff67be700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ff0138cf0 0x7f5ff013b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff67be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00a2a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff67be700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff009e690 con 0x7f5ff0138cf0 2023-10-03T10:18:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff67be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00a1cc0 con 0x7f5ff00a14a0 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ff0138cf0 0x7f5ff013b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ff0138cf0 0x7f5ff013b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37490/0 (socket says 172.21.15.19:37490) 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 -- 172.21.15.19:0/3714895444 learned_addr learned my addr 172.21.15.19:0/3714895444 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5fef7fe700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a14a0 0x7f5ff006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 -- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a14a0 msgr2=0x7f5ff006c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a14a0 0x7f5ff006c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 -- 172.21.15.19:0/3714895444 >> v1:172.21.15.19:6789/0 conn(0x7f5ff00a09c0 legacy=0x7f5ff00a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 -- 172.21.15.19:0/3714895444 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00a1f40 con 0x7f5ff0138cf0 2023-10-03T10:18:02.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.145+0000 7f5ff4d5b700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff013b0d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009e50 tx=0x7f5fe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad154d86eed73cc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.146+0000 7f5feeffd700 1 -- 172.21.15.19:0/3714895444 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800e070 con 0x7f5ff0138cf0 2023-10-03T10:18:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.146+0000 7f5feeffd700 1 -- 172.21.15.19:0/3714895444 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe800b910 con 0x7f5ff0138cf0 2023-10-03T10:18:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.146+0000 7f5feeffd700 1 -- 172.21.15.19:0/3714895444 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe800bcc0 con 0x7f5ff0138cf0 2023-10-03T10:18:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 -- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 msgr2=0x7f5ff013b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff013b0d0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f5fe8009e50 tx=0x7f5fe800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 -- 172.21.15.19:0/3714895444 shutdown_connections 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff013b0d0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3714895444 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a14a0 0x7f5ff006c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 -- 172.21.15.19:0/3714895444 >> 172.21.15.19:0/3714895444 conn(0x7f5ff00a60c0 msgr2=0x7f5ff00a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 -- 172.21.15.19:0/3714895444 shutdown_connections 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.147+0000 7f5ff67be700 1 -- 172.21.15.19:0/3714895444 wait complete. 2023-10-03T10:18:02.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.148+0000 7f5ff67be700 1 Processor -- start 2023-10-03T10:18:02.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 -- start start 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 0x7f5ff01336e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ff00a14a0 0x7f5ff0133c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff01361b0 con 0x7f5ff0138cf0 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff0136ed0 con 0x7f5ff00a14a0 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff67be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00a3630 con 0x7f5ff00a09c0 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff4d5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5feffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 0x7f5ff01336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff4d5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37500/0 (socket says 172.21.15.19:37500) 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.149+0000 7f5ff4d5b700 1 -- 172.21.15.19:0/3950593468 learned_addr learned my addr 172.21.15.19:0/3950593468 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5fef7fe700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ff00a14a0 0x7f5ff0133c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 -- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ff00a14a0 msgr2=0x7f5ff0133c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ff00a14a0 0x7f5ff0133c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 -- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 msgr2=0x7f5ff0134160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 -- 172.21.15.19:0/3950593468 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe8009b30 con 0x7f5ff00a09c0 2023-10-03T10:18:02.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5ff4d5b700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.150+0000 7f5feffff700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 0x7f5ff01336e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c450 tx=0x7f5fe000c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.151+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00052d0 con 0x7f5ff00a09c0 2023-10-03T10:18:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.151+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0005430 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.151+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00038c0 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.151+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff009cea0 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.151+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff0137940 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.152+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5fe0003a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.152+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5fe003ea00 con 0x7f5ff00a09c0 2023-10-03T10:18:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.152+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff00a2a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.162+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ff00a2a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.172+0000 7f37e7bc5700 1 Processor -- start 2023-10-03T10:18:02.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 -- start start 2023-10-03T10:18:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37e0133540 0x7f37e0135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 0x7f37e0138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e00716a0 con 0x7f37e0130540 2023-10-03T10:18:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e0071290 con 0x7f37e0133540 2023-10-03T10:18:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e7bc5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0130340 con 0x7f37e0135e60 2023-10-03T10:18:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e6162700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 0x7f37e0138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e6162700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 0x7f37e0138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45250/0 (socket says 172.21.15.19:45250) 2023-10-03T10:18:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e5961700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f37e0130540 0x7f37e0130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58584/0 (socket says 172.21.15.19:58584) 2023-10-03T10:18:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e6162700 1 -- 172.21.15.19:0/805231977 learned_addr learned my addr 172.21.15.19:0/805231977 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.173+0000 7f37e5160700 1 --2- 172.21.15.19:0/805231977 >> v2:172.21.15.19:3300/0 conn(0x7f37e0133540 0x7f37e0135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e5160700 1 -- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 msgr2=0x7f37e0138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:02.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e5160700 1 --2- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 0x7f37e0138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e5160700 1 -- 172.21.15.19:0/805231977 >> v1:172.21.15.19:6789/0 conn(0x7f37e0130540 legacy=0x7f37e0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e5160700 1 -- 172.21.15.19:0/805231977 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0070b80 con 0x7f37e0133540 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e5160700 1 --2- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0133540 0x7f37e0135920 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009840 tx=0x7f37d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bf90b3c86f6815 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e495f700 1 -- 172.21.15.19:0/805231977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000f8a0 con 0x7f37e0133540 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e495f700 1 -- 172.21.15.19:0/805231977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000fa00 con 0x7f37e0133540 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.174+0000 7f37e495f700 1 -- 172.21.15.19:0/805231977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000fd90 con 0x7f37e0133540 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 -- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0133540 msgr2=0x7f37e0135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0133540 0x7f37e0135920 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f37d0009840 tx=0x7f37d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 -- 172.21.15.19:0/805231977 shutdown_connections 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0135e60 0x7f37e0138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/805231977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0133540 0x7f37e0135920 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 -- 172.21.15.19:0/805231977 >> 172.21.15.19:0/805231977 conn(0x7f37e00a2aa0 msgr2=0x7f37e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 -- 172.21.15.19:0/805231977 shutdown_connections 2023-10-03T10:18:02.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.175+0000 7f37e7bc5700 1 -- 172.21.15.19:0/805231977 wait complete. 2023-10-03T10:18:02.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.176+0000 7f37e7bc5700 1 Processor -- start 2023-10-03T10:18:02.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.176+0000 7f37e7bc5700 1 -- start start 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0130540 0x7f37e009d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e0133540 0x7f37e009d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e00718e0 con 0x7f37e0135e60 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e012de50 con 0x7f37e0133540 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e7bc5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e009cc10 con 0x7f37e0130540 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e5961700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0130540 0x7f37e009d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37516/0 (socket says 172.21.15.19:37516) 2023-10-03T10:18:02.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 -- 172.21.15.19:0/1909535279 learned_addr learned my addr 172.21.15.19:0/1909535279 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e5160700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e0133540 0x7f37e009d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 -- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0130540 msgr2=0x7f37e009d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0130540 0x7f37e009d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 -- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e0133540 msgr2=0x7f37e009d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e0133540 0x7f37e009d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.177+0000 7f37e6162700 1 -- 172.21.15.19:0/1909535279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d00094a0 con 0x7f37e0135e60 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37e6162700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f37d800efc0 tx=0x7f37d800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003c20 con 0x7f37e0135e60 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d800f040 con 0x7f37e0135e60 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e011e5c0 con 0x7f37e0135e60 2023-10-03T10:18:02.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d8009e30 con 0x7f37e0135e60 2023-10-03T10:18:02.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.178+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e009e210 con 0x7f37e0135e60 2023-10-03T10:18:02.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.179+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37d800c880 con 0x7f37e0135e60 2023-10-03T10:18:02.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.179+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37d803f8d0 con 0x7f37e0135e60 2023-10-03T10:18:02.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.179+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e0074ea0 con 0x7f37e0135e60 2023-10-03T10:18:02.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.184+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37d801c360 con 0x7f37e0135e60 2023-10-03T10:18:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.292+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f80701a9770 con 0x7f807009e410 2023-10-03T10:18:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.292+0000 7f8057fff700 1 -- 172.21.15.19:0/4010445854 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80701a9770 con 0x7f807009e410 2023-10-03T10:18:02.292 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.294+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 msgr2=0x7f80701a6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.294+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 0x7f80701a6900 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8068009d90 tx=0x7f8068004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 shutdown_connections 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f807009e410 0x7f80701a6900 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f807009d6f0 0x7f80701a5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 --2- 172.21.15.19:0/4010445854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f807009e000 0x7f80701a63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 >> 172.21.15.19:0/4010445854 conn(0x7f8070066f50 msgr2=0x7f80701bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 shutdown_connections 2023-10-03T10:18:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.295+0000 7f8075e9a700 1 -- 172.21.15.19:0/4010445854 wait complete. 2023-10-03T10:18:02.309 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.322+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f88bc06b250 con 0x7f88bc09f240 2023-10-03T10:18:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.323+0000 7f88a3fff700 1 -- 172.21.15.19:0/3576985553 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88b0017030 con 0x7f88bc09f240 2023-10-03T10:18:02.323 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 msgr2=0x7f88bc131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 0x7f88bc131fa0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f88b0000f60 tx=0x7f88b000c730 comp rx=0 tx=0).stop 2023-10-03T10:18:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 shutdown_connections 2023-10-03T10:18:02.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88bc09f650 0x7f88bc1c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88bc09e930 0x7f88bc131a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 --2- 172.21.15.19:0/3576985553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88bc09f240 0x7f88bc131fa0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 >> 172.21.15.19:0/3576985553 conn(0x7f88bc0a4210 msgr2=0x7f88bc06c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 shutdown_connections 2023-10-03T10:18:02.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.325+0000 7f88c1dfd700 1 -- 172.21.15.19:0/3576985553 wait complete. 2023-10-03T10:18:02.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.390+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f37e011e750 con 0x7f37e0135e60 2023-10-03T10:18:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.391+0000 7f37d67fc700 1 -- 172.21.15.19:0/1909535279 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37d8013b80 con 0x7f37e0135e60 2023-10-03T10:18:02.391 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:02.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 msgr2=0x7f37e01c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f37d800efc0 tx=0x7f37d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 shutdown_connections 2023-10-03T10:18:02.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e0135e60 0x7f37e01c80f0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e0130540 0x7f37e009d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 --2- 172.21.15.19:0/1909535279 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e0133540 0x7f37e009d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 >> 172.21.15.19:0/1909535279 conn(0x7f37e00a2aa0 msgr2=0x7f37e006ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 shutdown_connections 2023-10-03T10:18:02.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.393+0000 7f37e7bc5700 1 -- 172.21.15.19:0/1909535279 wait complete. 2023-10-03T10:18:02.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.399+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ff00a2a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.399+0000 7f5fecff9700 1 -- 172.21.15.19:0/3950593468 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ff00a2a20 con 0x7f5ff00a09c0 2023-10-03T10:18:02.399 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:02.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.401+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 msgr2=0x7f5ff01336e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.401+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 0x7f5ff01336e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c450 tx=0x7f5fe000c760 comp rx=0 tx=0).stop 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 shutdown_connections 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ff0138cf0 0x7f5ff0134160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ff00a09c0 0x7f5ff01336e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 --2- 172.21.15.19:0/3950593468 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ff00a14a0 0x7f5ff0133c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 >> 172.21.15.19:0/3950593468 conn(0x7f5ff00a60c0 msgr2=0x7f5ff013acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 shutdown_connections 2023-10-03T10:18:02.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:02.402+0000 7f5ff67be700 1 -- 172.21.15.19:0/3950593468 wait complete. 2023-10-03T10:18:02.408 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:02.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:03.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:03.340 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:03.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:03.416 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:03.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.473+0000 7f06861f6700 1 Processor -- start 2023-10-03T10:18:03.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.473+0000 7f06861f6700 1 -- start start 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f068009d6f0 0x7f068009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 0x7f06801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 0x7f0680133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068006b460 con 0x7f068009d6f0 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068009b120 con 0x7f068009e000 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f06861f6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f068009a7e0 con 0x7f068009e410 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f068009d6f0 0x7f068009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f068009d6f0 0x7f068009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37532/0 (socket says 172.21.15.19:37532) 2023-10-03T10:18:03.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067f7fe700 1 -- 172.21.15.19:0/3606226731 learned_addr learned my addr 172.21.15.19:0/3606226731 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067effd700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 0x7f06801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067ffff700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 0x7f0680133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.474+0000 7f067f7fe700 1 -- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 msgr2=0x7f0680133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067f7fe700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 0x7f0680133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067f7fe700 1 -- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 msgr2=0x7f06801339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067f7fe700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 0x7f06801339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067f7fe700 1 -- 172.21.15.19:0/3606226731 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068009a500 con 0x7f068009d6f0 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067effd700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 0x7f06801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067ffff700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 0x7f0680133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067f7fe700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009d6f0 0x7f068009dac0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f06700098f0 tx=0x7f0670009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e829f7209633a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067e7fc700 1 -- 172.21.15.19:0/3606226731 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670011830 con 0x7f068009d6f0 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067e7fc700 1 -- 172.21.15.19:0/3606226731 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0670011990 con 0x7f068009d6f0 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.475+0000 7f067e7fc700 1 -- 172.21.15.19:0/3606226731 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670011d20 con 0x7f068009d6f0 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 -- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009d6f0 msgr2=0x7f068009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009d6f0 0x7f068009dac0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f06700098f0 tx=0x7f0670009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 -- 172.21.15.19:0/3606226731 shutdown_connections 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009e410 0x7f0680133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009d6f0 0x7f068009dac0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 --2- 172.21.15.19:0/3606226731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e000 0x7f06801339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 -- 172.21.15.19:0/3606226731 >> 172.21.15.19:0/3606226731 conn(0x7f0680066f50 msgr2=0x7f068009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 -- 172.21.15.19:0/3606226731 shutdown_connections 2023-10-03T10:18:03.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.476+0000 7f06861f6700 1 -- 172.21.15.19:0/3606226731 wait complete. 2023-10-03T10:18:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.477+0000 7f06861f6700 1 Processor -- start 2023-10-03T10:18:03.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 -- start start 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 0x7f06801a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e410 0x7f06801c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06801b90e0 con 0x7f068009e000 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06801a4c00 con 0x7f068009e410 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.478+0000 7f06861f6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06801a7cd0 con 0x7f068009d6f0 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37542/0 (socket says 172.21.15.19:37542) 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 -- 172.21.15.19:0/1796685013 learned_addr learned my addr 172.21.15.19:0/1796685013 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067f7fe700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 0x7f06801a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 -- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 msgr2=0x7f06801a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 0x7f06801a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 -- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e410 msgr2=0x7f06801c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e410 0x7f06801c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 -- 172.21.15.19:0/1796685013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06740094a0 con 0x7f068009e000 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067f7fe700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 0x7f06801a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.479+0000 7f067effd700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f067400ebe0 tx=0x7f067400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.480+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0674009800 con 0x7f068009e000 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.480+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067400c910 con 0x7f068009e000 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.480+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067400cc80 con 0x7f068009e000 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.480+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0670009550 con 0x7f068009e000 2023-10-03T10:18:03.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.480+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06800a2020 con 0x7f068009e000 2023-10-03T10:18:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.481+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0680074ea0 con 0x7f068009e000 2023-10-03T10:18:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.482+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0674013470 con 0x7f068009e000 2023-10-03T10:18:03.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.482+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f067403fff0 con 0x7f068009e000 2023-10-03T10:18:03.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.490+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0674013720 con 0x7f068009e000 2023-10-03T10:18:03.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.510+0000 7f5dff34e700 1 Processor -- start 2023-10-03T10:18:03.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.510+0000 7f5dff34e700 1 -- start start 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dff34e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df81338a0 0x7f5df8133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dff34e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 0x7f5df809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dff34e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df806ef30 con 0x7f5df809e760 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dff34e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df806fef0 con 0x7f5df81338a0 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dff34e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81334b0 con 0x7f5df809de50 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dfd8eb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5df809e760 0x7f5df813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58592/0 (socket says 172.21.15.19:58592) 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dfd8eb700 1 -- 172.21.15.19:0/2753326508 learned_addr learned my addr 172.21.15.19:0/2753326508 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:03.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dfc8e9700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 0x7f5df809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.511+0000 7f5dfd0ea700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df81338a0 0x7f5df8133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5dfc8e9700 1 -- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df81338a0 msgr2=0x7f5df8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5dfc8e9700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df81338a0 0x7f5df8133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5dfc8e9700 1 -- 172.21.15.19:0/2753326508 >> v1:172.21.15.19:6789/0 conn(0x7f5df809e760 legacy=0x7f5df813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5dfc8e9700 1 -- 172.21.15.19:0/2753326508 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df806fc30 con 0x7f5df809de50 2023-10-03T10:18:03.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5dfc8e9700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 0x7f5df809e220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5de80098a0 tx=0x7f5de8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccaec5569983b0f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5deffff700 1 -- 172.21.15.19:0/2753326508 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8011830 con 0x7f5df809de50 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5deffff700 1 -- 172.21.15.19:0/2753326508 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8011990 con 0x7f5df809de50 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.512+0000 7f5deffff700 1 -- 172.21.15.19:0/2753326508 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8011d00 con 0x7f5df809de50 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 -- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 msgr2=0x7f5df809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 0x7f5df809e220 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5de80098a0 tx=0x7f5de8009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 -- 172.21.15.19:0/2753326508 shutdown_connections 2023-10-03T10:18:03.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df81338a0 0x7f5df8133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 --2- 172.21.15.19:0/2753326508 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df809de50 0x7f5df809e220 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.513+0000 7f5dff34e700 1 -- 172.21.15.19:0/2753326508 >> 172.21.15.19:0/2753326508 conn(0x7f5df80a2aa0 msgr2=0x7f5df80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.514+0000 7f5dff34e700 1 -- 172.21.15.19:0/2753326508 shutdown_connections 2023-10-03T10:18:03.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.514+0000 7f5dff34e700 1 -- 172.21.15.19:0/2753326508 wait complete. 2023-10-03T10:18:03.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.515+0000 7f5dff34e700 1 Processor -- start 2023-10-03T10:18:03.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.515+0000 7f5dff34e700 1 -- start start 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e760 0x7f5df811f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 0x7f5df811f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8121d20 con 0x7f5df809e760 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df812f6f0 con 0x7f5df809de50 2023-10-03T10:18:03.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dff34e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8120780 con 0x7f5df81338a0 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dfd0ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dfd0ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57124/0 (socket says 172.21.15.19:57124) 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dfd0ea700 1 -- 172.21.15.19:0/3450987375 learned_addr learned my addr 172.21.15.19:0/3450987375 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dfc8e9700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e760 0x7f5df811f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.516+0000 7f5dfd8eb700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 0x7f5df811f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 -- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 msgr2=0x7f5df811f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 0x7f5df811f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 -- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e760 msgr2=0x7f5df811f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e760 0x7f5df811f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 -- 172.21.15.19:0/3450987375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80094a0 con 0x7f5df809de50 2023-10-03T10:18:03.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd8eb700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 0x7f5df811f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dfd0ea700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e9e0 tx=0x7f5df400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4009710 con 0x7f5df809de50 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400c850 con 0x7f5df809de50 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400cbc0 con 0x7f5df809de50 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df8122640 con 0x7f5df809de50 2023-10-03T10:18:03.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.517+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df80a1140 con 0x7f5df809de50 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.519+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5df400cd20 con 0x7f5df809de50 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.519+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df8120050 con 0x7f5df809de50 2023-10-03T10:18:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.519+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5df403f820 con 0x7f5df809de50 2023-10-03T10:18:03.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.524+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5df4013990 con 0x7f5df809de50 2023-10-03T10:18:03.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.571+0000 7fd01c43a700 1 Processor -- start 2023-10-03T10:18:03.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.571+0000 7fd01c43a700 1 -- start start 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01c43a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 0x7fd01409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01c43a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 0x7fd014131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01c43a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd014070940 con 0x7fd01409f240 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01c43a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406fd60 con 0x7fd01409e930 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01c43a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd01406fa80 con 0x7fd01409f650 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a9d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 0x7fd014131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a9d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 0x7fd014131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45326/0 (socket says 172.21.15.19:45326) 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a9d7700 1 -- 172.21.15.19:0/1694146747 learned_addr learned my addr 172.21.15.19:0/1694146747 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 0x7fd01409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd0191d4700 1 -- 172.21.15.19:0/1694146747 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 789178179 0 0) 0x7fd014070940 con 0x7fd01409f240 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd0191d4700 1 -- 172.21.15.19:0/1694146747 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0000035b0 con 0x7fd01409f240 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a1d6700 1 -- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 msgr2=0x7fd014131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 0x7fd014131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a1d6700 1 -- 172.21.15.19:0/1694146747 >> v1:172.21.15.19:6789/0 conn(0x7fd01409f240 legacy=0x7fd0141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.572+0000 7fd01a1d6700 1 -- 172.21.15.19:0/1694146747 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01409fb60 con 0x7fd01409e930 2023-10-03T10:18:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.573+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 0x7fd01409ed00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd01000dc90 tx=0x7fd01000f050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c41efa6a8b382fa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.573+0000 7fd0191d4700 1 -- 172.21.15.19:0/1694146747 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010012070 con 0x7fd01409e930 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.573+0000 7fd0191d4700 1 -- 172.21.15.19:0/1694146747 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01000d2e0 con 0x7fd01409e930 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.573+0000 7fd0191d4700 1 -- 172.21.15.19:0/1694146747 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010004230 con 0x7fd01409e930 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 -- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 msgr2=0x7fd01409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 0x7fd01409ed00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd01000dc90 tx=0x7fd01000f050 comp rx=0 tx=0).stop 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 -- 172.21.15.19:0/1694146747 shutdown_connections 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f650 0x7fd014131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 --2- 172.21.15.19:0/1694146747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409e930 0x7fd01409ed00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 -- 172.21.15.19:0/1694146747 >> 172.21.15.19:0/1694146747 conn(0x7fd0140a4210 msgr2=0x7fd0140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 -- 172.21.15.19:0/1694146747 shutdown_connections 2023-10-03T10:18:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.574+0000 7fd01c43a700 1 -- 172.21.15.19:0/1694146747 wait complete. 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.575+0000 7fd01c43a700 1 Processor -- start 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.575+0000 7fd01c43a700 1 -- start start 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 0x7fd01411d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409f650 0x7fd01411dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd01411ec40 con 0x7fd01409e930 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd01411fe90 con 0x7fd01409f650 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01c43a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd01411f220 con 0x7fd01409f240 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd0199d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 0x7fd01411d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37562/0 (socket says 172.21.15.19:37562) 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd0199d5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 0x7fd01411d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45336/0 (socket says 172.21.15.19:45336) 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 -- 172.21.15.19:0/3093734783 learned_addr learned my addr 172.21.15.19:0/3093734783 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a9d7700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409f650 0x7fd01411dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 -- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 msgr2=0x7fd01411d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 0x7fd01411d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 -- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409f650 msgr2=0x7fd01411dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409f650 0x7fd01411dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.576+0000 7fd01a1d6700 1 -- 172.21.15.19:0/3093734783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01000d940 con 0x7fd01409e930 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.577+0000 7fd01a1d6700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd010019040 tx=0x7fd010004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.577+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010003e60 con 0x7fd01409e930 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.577+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01000f6b0 con 0x7fd01409e930 2023-10-03T10:18:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.577+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01000fa60 con 0x7fd01409e930 2023-10-03T10:18:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.578+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140a0190 con 0x7fd01409e930 2023-10-03T10:18:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.578+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0140a2f40 con 0x7fd01409e930 2023-10-03T10:18:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.579+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd01000fbc0 con 0x7fd01409e930 2023-10-03T10:18:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.579+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd010043ce0 con 0x7fd01409e930 2023-10-03T10:18:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.580+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd014074ea0 con 0x7fd01409e930 2023-10-03T10:18:03.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.585+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd01001b020 con 0x7fd01409e930 2023-10-03T10:18:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 Processor -- start 2023-10-03T10:18:03.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 -- start start 2023-10-03T10:18:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa4080a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4080a2a70 con 0x7fa408133930 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080a01d0 con 0x7fa4080a0a30 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.605+0000 7fa41032e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa40809e2b0 con 0x7fa40809d630 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40e8cb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa408133930 0x7fa408133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:58618/0 (socket says 172.21.15.19:58618) 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40e8cb700 1 -- 172.21.15.19:0/2493525628 learned_addr learned my addr 172.21.15.19:0/2493525628 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:03.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45352/0 (socket says 172.21.15.19:45352) 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40e0ca700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa4080a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 -- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 msgr2=0x7fa4080a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa4080a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 -- 172.21.15.19:0/2493525628 >> v1:172.21.15.19:6789/0 conn(0x7fa408133930 legacy=0x7fa408133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d0c8700 1 -- 172.21.15.19:0/2493525628 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496789018 0 0) 0x7fa4080a2a70 con 0x7fa408133930 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.606+0000 7fa40d8c9700 1 -- 172.21.15.19:0/2493525628 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40809dc50 con 0x7fa40809d630 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.607+0000 7fa40d8c9700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b55a1e0d8979dca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.607+0000 7fa40d0c8700 1 -- 172.21.15.19:0/2493525628 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011830 con 0x7fa40809d630 2023-10-03T10:18:03.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.607+0000 7fa40d0c8700 1 -- 172.21.15.19:0/2493525628 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f8011990 con 0x7fa40809d630 2023-10-03T10:18:03.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.607+0000 7fa40d0c8700 1 -- 172.21.15.19:0/2493525628 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011d20 con 0x7fa40809d630 2023-10-03T10:18:03.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 -- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 msgr2=0x7fa4080a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 -- 172.21.15.19:0/2493525628 shutdown_connections 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa4080a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 --2- 172.21.15.19:0/2493525628 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa40809d630 0x7fa4080a1340 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 -- 172.21.15.19:0/2493525628 >> 172.21.15.19:0/2493525628 conn(0x7fa4080a3050 msgr2=0x7fa4080a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 -- 172.21.15.19:0/2493525628 shutdown_connections 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.608+0000 7fa41032e700 1 -- 172.21.15.19:0/2493525628 wait complete. 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 Processor -- start 2023-10-03T10:18:03.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 -- start start 2023-10-03T10:18:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 0x7fa40811e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa408133930 0x7fa40811f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080a5de0 con 0x7fa40809d630 2023-10-03T10:18:03.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4080a0410 con 0x7fa4080a0a30 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa41032e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa408120550 con 0x7fa408133930 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa40d8c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa40d8c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57158/0 (socket says 172.21.15.19:57158) 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.609+0000 7fa40d8c9700 1 -- 172.21.15.19:0/2699978182 learned_addr learned my addr 172.21.15.19:0/2699978182 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 0x7fa40811e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e8cb700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa408133930 0x7fa40811f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 -- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa408133930 msgr2=0x7fa40811f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa408133930 0x7fa40811f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 -- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 msgr2=0x7fa40811edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 -- 172.21.15.19:0/2699978182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094a0 con 0x7fa40809d630 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40d8c9700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:03.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa40e0ca700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 0x7fa40811e8b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e810 tx=0x7fa40400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400c070 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa404013610 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa408122070 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040139a0 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.610+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408122ae0 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.611+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa404013b00 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.612+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa40403f440 con 0x7fa40809d630 2023-10-03T10:18:03.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.612+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4080747f0 con 0x7fa40809d630 2023-10-03T10:18:03.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.617+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4040108e0 con 0x7fa40809d630 2023-10-03T10:18:03.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.766+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06801a6360 con 0x7f068009e000 2023-10-03T10:18:03.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.767+0000 7f0667fff700 1 -- 172.21.15.19:0/1796685013 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0674024b00 con 0x7f068009e000 2023-10-03T10:18:03.767 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 msgr2=0x7f06801a5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f067400ebe0 tx=0x7f067400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 shutdown_connections 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f068009e410 0x7f06801c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f068009d6f0 0x7f06801a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 --2- 172.21.15.19:0/1796685013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f068009e000 0x7f06801a5750 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 >> 172.21.15.19:0/1796685013 conn(0x7f0680066f50 msgr2=0x7f06801bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 shutdown_connections 2023-10-03T10:18:03.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.769+0000 7f06861f6700 1 -- 172.21.15.19:0/1796685013 wait complete. 2023-10-03T10:18:03.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.792+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5df806f6a0 con 0x7f5df809de50 2023-10-03T10:18:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.793+0000 7f5dedffb700 1 -- 172.21.15.19:0/3450987375 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5df4021070 con 0x7f5df809de50 2023-10-03T10:18:03.793 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 msgr2=0x7f5df811eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5df400e9e0 tx=0x7f5df400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 shutdown_connections 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5df81338a0 0x7f5df811f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5df809de50 0x7f5df811eb70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 --2- 172.21.15.19:0/3450987375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df809e760 0x7f5df811f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.796+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 >> 172.21.15.19:0/3450987375 conn(0x7f5df80a2aa0 msgr2=0x7f5df809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.797+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 shutdown_connections 2023-10-03T10:18:03.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.797+0000 7f5dff34e700 1 -- 172.21.15.19:0/3450987375 wait complete. 2023-10-03T10:18:03.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.800+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd014071ce0 con 0x7fd01409e930 2023-10-03T10:18:03.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.800+0000 7fd00affd700 1 -- 172.21.15.19:0/3093734783 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd01000b970 con 0x7fd01409e930 2023-10-03T10:18:03.800 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 msgr2=0x7fd01411d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd010019040 tx=0x7fd010004750 comp rx=0 tx=0).stop 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 shutdown_connections 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd01409f650 0x7fd01411dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd01409e930 0x7fd01411d030 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 --2- 172.21.15.19:0/3093734783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd01409f240 0x7fd01411d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 >> 172.21.15.19:0/3093734783 conn(0x7fd0140a4210 msgr2=0x7fd014131d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 shutdown_connections 2023-10-03T10:18:03.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.804+0000 7fd01c43a700 1 -- 172.21.15.19:0/3093734783 wait complete. 2023-10-03T10:18:03.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:03.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.822+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa408121e40 con 0x7fa40809d630 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.823+0000 7fa3feffd700 1 -- 172.21.15.19:0/2699978182 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa40402b090 con 0x7fa40809d630 2023-10-03T10:18:03.822 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 msgr2=0x7fa40811e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 0x7fa40811e8b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fa40400e810 tx=0x7fa40400eb20 comp rx=0 tx=0).stop 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 shutdown_connections 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa408133930 0x7fa40811f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa40809d630 0x7fa40811e8b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 --2- 172.21.15.19:0/2699978182 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4080a0a30 0x7fa40811edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 >> 172.21.15.19:0/2699978182 conn(0x7fa4080a3050 msgr2=0x7fa40809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 shutdown_connections 2023-10-03T10:18:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:03.825+0000 7fa41032e700 1 -- 172.21.15.19:0/2699978182 wait complete. 2023-10-03T10:18:03.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:04.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:04.815 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:04.819 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:04.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.937+0000 7f2d0c544700 1 Processor -- start 2023-10-03T10:18:04.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.937+0000 7f2d0c544700 1 -- start start 2023-10-03T10:18:04.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0c544700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 0x7f2d0409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0c544700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0c544700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0409b120 con 0x7f2d0409e410 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0c544700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0406b460 con 0x7f2d0409d6f0 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0c544700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0409a7e0 con 0x7f2d0409e000 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0a2e0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 0x7f2d0409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0a2e0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 0x7f2d0409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37590/0 (socket says 172.21.15.19:37590) 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d0a2e0700 1 -- 172.21.15.19:0/2562234555 learned_addr learned my addr 172.21.15.19:0/2562234555 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d09adf700 1 --2- 172.21.15.19:0/2562234555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d09adf700 1 -- 172.21.15.19:0/2562234555 >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 msgr2=0x7f2d0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d09adf700 1 --2- 172.21.15.19:0/2562234555 >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 0x7f2d0409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d09adf700 1 -- 172.21.15.19:0/2562234555 >> v1:172.21.15.19:6789/0 conn(0x7f2d0409e410 legacy=0x7f2d04133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.938+0000 7f2d09adf700 1 -- 172.21.15.19:0/2562234555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0409a500 con 0x7f2d0409e000 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.939+0000 7f2d09adf700 1 --2- 172.21.15.19:0/2562234555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041339f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a747c35913b7bb81 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.939+0000 7f2d092de700 1 -- 172.21.15.19:0/2562234555 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4011830 con 0x7f2d0409e000 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.939+0000 7f2d092de700 1 -- 172.21.15.19:0/2562234555 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf4011990 con 0x7f2d0409e000 2023-10-03T10:18:04.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.939+0000 7f2d092de700 1 -- 172.21.15.19:0/2562234555 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf4011d20 con 0x7f2d0409e000 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 -- 172.21.15.19:0/2562234555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 msgr2=0x7f2d041339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 --2- 172.21.15.19:0/2562234555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041339f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4009870 tx=0x7f2cf4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 -- 172.21.15.19:0/2562234555 shutdown_connections 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 --2- 172.21.15.19:0/2562234555 >> v2:172.21.15.19:3300/0 conn(0x7f2d0409d6f0 0x7f2d0409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 --2- 172.21.15.19:0/2562234555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041339f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 -- 172.21.15.19:0/2562234555 >> 172.21.15.19:0/2562234555 conn(0x7f2d04066f50 msgr2=0x7f2d0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 -- 172.21.15.19:0/2562234555 shutdown_connections 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.940+0000 7f2d0c544700 1 -- 172.21.15.19:0/2562234555 wait complete. 2023-10-03T10:18:04.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 Processor -- start 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 -- start start 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d0409e410 0x7f2d041a6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.941+0000 7f2d0c544700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041a7340 con 0x7f2d0409d6f0 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0c544700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041a9920 con 0x7f2d0409e000 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0c544700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d041a8cd0 con 0x7f2d0409e410 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37594/0 (socket says 172.21.15.19:37594) 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 -- 172.21.15.19:0/1962734265 learned_addr learned my addr 172.21.15.19:0/1962734265 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d09adf700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 -- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d0409e410 msgr2=0x7f2d041a6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d0409e410 0x7f2d041a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 -- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 msgr2=0x7f2d041a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 -- 172.21.15.19:0/1962734265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40094a0 con 0x7f2d0409d6f0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d09adf700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.942+0000 7f2d0a2e0700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e940 tx=0x7f2d0000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.943+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d000096a0 con 0x7f2d0409d6f0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.943+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0000ee90 con 0x7f2d0409d6f0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.943+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d041a7b10 con 0x7f2d0409d6f0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.943+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d041a8810 con 0x7f2d0409d6f0 2023-10-03T10:18:04.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.943+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0000ca90 con 0x7f2d0409d6f0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.944+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d0000cc30 con 0x7f2d0409d6f0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.944+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d0003f580 con 0x7f2d0409d6f0 2023-10-03T10:18:04.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.944+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec0052e0 con 0x7f2d0409d6f0 2023-10-03T10:18:04.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.953+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d00013470 con 0x7f2d0409d6f0 2023-10-03T10:18:04.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.979+0000 7f17072bc700 1 Processor -- start 2023-10-03T10:18:04.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 Processor -- start 2023-10-03T10:18:04.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 -- start start 2023-10-03T10:18:04.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34a409e1d0 0x7f34a4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a4139170 0x7f34a413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a409b120 con 0x7f34a409d6f0 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406b460 con 0x7f34a409e1d0 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f34a8a36700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a409a7e0 con 0x7f34a4139170 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 -- start start 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f170009f130 con 0x7f170009e000 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170009f520 con 0x7f170009e410 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.980+0000 7f17072bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170009e930 con 0x7f170009d6f0 2023-10-03T10:18:04.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57192/0 (socket says 172.21.15.19:57192) 2023-10-03T10:18:04.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 -- 172.21.15.19:0/2963341550 learned_addr learned my addr 172.21.15.19:0/2963341550 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34a409e1d0 0x7f34a4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f34a409e1d0 0x7f34a4138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37598/0 (socket says 172.21.15.19:37598) 2023-10-03T10:18:04.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 -- 172.21.15.19:0/1785051858 learned_addr learned my addr 172.21.15.19:0/1785051858 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 -- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009d6f0 msgr2=0x7f170009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 --2- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 -- 172.21.15.19:0/2963341550 >> v1:172.21.15.19:6789/0 conn(0x7f170009e000 legacy=0x7f1700130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 -- 172.21.15.19:0/2963341550 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170009b2d0 con 0x7f170009e410 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a159a700 1 -- 172.21.15.19:0/1785051858 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231874746 0 0) 0x7f34a409b120 con 0x7f34a409d6f0 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a159a700 1 -- 172.21.15.19:0/1785051858 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f348c0035b0 con 0x7f34a409d6f0 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 -- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a4139170 msgr2=0x7f34a413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 --2- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a4139170 0x7f34a413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 -- 172.21.15.19:0/1785051858 >> v1:172.21.15.19:6789/0 conn(0x7f34a409d6f0 legacy=0x7f34a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f34a1d9b700 1 -- 172.21.15.19:0/1785051858 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a409a500 con 0x7f34a409e1d0 2023-10-03T10:18:04.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.981+0000 7f1705859700 1 --2- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e80 tx=0x7f16f800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507886bf6fcc4aff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f16f7fff700 1 -- 172.21.15.19:0/2963341550 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800e070 con 0x7f170009e410 2023-10-03T10:18:04.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f34a1d9b700 1 --2- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a4138c30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3498009920 tx=0x7f3498009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc1c0cedfad61aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f16f7fff700 1 -- 172.21.15.19:0/2963341550 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800b9c0 con 0x7f170009e410 2023-10-03T10:18:04.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f16f7fff700 1 -- 172.21.15.19:0/2963341550 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800bd70 con 0x7f170009e410 2023-10-03T10:18:04.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f34a159a700 1 -- 172.21.15.19:0/1785051858 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011830 con 0x7f34a409e1d0 2023-10-03T10:18:04.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f34a159a700 1 -- 172.21.15.19:0/1785051858 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498011990 con 0x7f34a409e1d0 2023-10-03T10:18:04.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.982+0000 7f34a159a700 1 -- 172.21.15.19:0/1785051858 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498011d20 con 0x7f34a409e1d0 2023-10-03T10:18:04.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 -- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 msgr2=0x7f1700130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 --2- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f16f8009e80 tx=0x7f16f800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:04.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 -- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 msgr2=0x7f34a4138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 --2- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a4138c30 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3498009920 tx=0x7f3498009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 -- 172.21.15.19:0/2963341550 shutdown_connections 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 --2- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009e410 0x7f1700130d70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 --2- 172.21.15.19:0/2963341550 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009d6f0 0x7f170009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 -- 172.21.15.19:0/2963341550 >> 172.21.15.19:0/2963341550 conn(0x7f1700066f50 msgr2=0x7f170009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 -- 172.21.15.19:0/1785051858 shutdown_connections 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 --2- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a4139170 0x7f34a413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 --2- 172.21.15.19:0/1785051858 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a4138c30 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 -- 172.21.15.19:0/1785051858 >> 172.21.15.19:0/1785051858 conn(0x7f34a4066f50 msgr2=0x7f34a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 -- 172.21.15.19:0/1785051858 shutdown_connections 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 -- 172.21.15.19:0/2963341550 shutdown_connections 2023-10-03T10:18:04.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f34a8a36700 1 -- 172.21.15.19:0/1785051858 wait complete. 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.983+0000 7f17072bc700 1 -- 172.21.15.19:0/2963341550 wait complete. 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.984+0000 7f17072bc700 1 Processor -- start 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.984+0000 7f17072bc700 1 -- start start 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.984+0000 7f34a8a36700 1 Processor -- start 2023-10-03T10:18:04.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.984+0000 7f34a8a36700 1 -- start start 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 0x7f1700138930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f170009e410 0x7f17001393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1700137980 con 0x7f170009e410 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17000725e0 con 0x7f170009d6f0 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f17072bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f170009c700 con 0x7f170009e000 2023-10-03T10:18:04.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 0x7f34a411e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a411ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a40a3b90 con 0x7f34a409e1d0 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a409c710 con 0x7f34a4139170 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a8a36700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4120410 con 0x7f34a409d6f0 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57224/0 (socket says 172.21.15.19:57224) 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a2d9d700 1 -- 172.21.15.19:0/70032071 learned_addr learned my addr 172.21.15.19:0/70032071 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f34a259c700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 0x7f34a411e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f1704857700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f1704857700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45396/0 (socket says 172.21.15.19:45396) 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f1704857700 1 -- 172.21.15.19:0/2947296562 learned_addr learned my addr 172.21.15.19:0/2947296562 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.985+0000 7f1705058700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 0x7f1700138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 -- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 msgr2=0x7f1700138e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 -- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f170009e410 msgr2=0x7f17001393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f170009e410 0x7f17001393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 -- 172.21.15.19:0/2947296562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009b30 con 0x7f170009d6f0 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 -- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 msgr2=0x7f34a411e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 0x7f34a411e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 -- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 msgr2=0x7f34a411ed20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a411ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 -- 172.21.15.19:0/70032071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3498009550 con 0x7f34a4139170 2023-10-03T10:18:04.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a259c700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 0x7f34a411e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1704857700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f1705058700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 0x7f1700138930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b410 tx=0x7f16fc00b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f34a2d9d700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b9e0 tx=0x7f349c00bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00c930 con 0x7f34a4139170 2023-10-03T10:18:04.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c00cad0 con 0x7f34a4139170 2023-10-03T10:18:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011830 con 0x7f170009d6f0 2023-10-03T10:18:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c00ce80 con 0x7f34a4139170 2023-10-03T10:18:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc00be90 con 0x7f170009d6f0 2023-10-03T10:18:04.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc011bd0 con 0x7f170009d6f0 2023-10-03T10:18:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.986+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1700136720 con 0x7f170009d6f0 2023-10-03T10:18:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.987+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a4121ce0 con 0x7f34a4139170 2023-10-03T10:18:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.987+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a4121940 con 0x7f34a4139170 2023-10-03T10:18:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.987+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170013a680 con 0x7f170009d6f0 2023-10-03T10:18:04.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.988+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16fc011d30 con 0x7f170009d6f0 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.988+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16fc040aa0 con 0x7f170009d6f0 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.988+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1700074ea0 con 0x7f170009d6f0 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.988+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f349c014440 con 0x7f34a4139170 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.988+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f349c006e40 con 0x7f34a4139170 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.989+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a4121f00 con 0x7f34a4139170 2023-10-03T10:18:04.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:04.998+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16fc015030 con 0x7f170009d6f0 2023-10-03T10:18:05.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.007+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f34a4121f00 con 0x7f34a4139170 2023-10-03T10:18:05.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.019+0000 7f29e85a5700 1 Processor -- start 2023-10-03T10:18:05.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.019+0000 7f29e85a5700 1 -- start start 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e85a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009d6f0 0x7f29e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e85a5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29e009e000 0x7f29e0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e85a5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e009f130 con 0x7f29e009e410 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e85a5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e009f520 con 0x7f29e009e000 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e85a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e009e930 con 0x7f29e009d6f0 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29e009e000 0x7f29e0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f29e009e000 0x7f29e0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37624/0 (socket says 172.21.15.19:37624) 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 -- 172.21.15.19:0/3586592386 learned_addr learned my addr 172.21.15.19:0/3586592386 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:05.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e6341700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009d6f0 0x7f29e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 -- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009d6f0 msgr2=0x7f29e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009d6f0 0x7f29e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 -- 172.21.15.19:0/3586592386 >> v1:172.21.15.19:6789/0 conn(0x7f29e009e410 legacy=0x7f29e0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.020+0000 7f29e5b40700 1 -- 172.21.15.19:0/3586592386 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e009b2d0 con 0x7f29e009e000 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.021+0000 7f29e5b40700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009e000 0x7f29e0130660 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f29d00098f0 tx=0x7f29d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1950b0fc9be4fbc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.021+0000 7f29e533f700 1 -- 172.21.15.19:0/3586592386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011830 con 0x7f29e009e000 2023-10-03T10:18:05.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.021+0000 7f29e533f700 1 -- 172.21.15.19:0/3586592386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d0011990 con 0x7f29e009e000 2023-10-03T10:18:05.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.021+0000 7f29e533f700 1 -- 172.21.15.19:0/3586592386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0011d20 con 0x7f29e009e000 2023-10-03T10:18:05.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 -- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009e000 msgr2=0x7f29e0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009e000 0x7f29e0130660 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f29d00098f0 tx=0x7f29d0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 -- 172.21.15.19:0/3586592386 shutdown_connections 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009d6f0 0x7f29e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 --2- 172.21.15.19:0/3586592386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009e000 0x7f29e0130660 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 -- 172.21.15.19:0/3586592386 >> 172.21.15.19:0/3586592386 conn(0x7f29e0066f50 msgr2=0x7f29e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 -- 172.21.15.19:0/3586592386 shutdown_connections 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.022+0000 7f29e85a5700 1 -- 172.21.15.19:0/3586592386 wait complete. 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.024+0000 7f29e85a5700 1 Processor -- start 2023-10-03T10:18:05.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.024+0000 7f29e85a5700 1 -- start start 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.024+0000 7f29e85a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009d6f0 0x7f29e012fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.024+0000 7f29e85a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f29e009e000 0x7f29e0130100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.024+0000 7f29e85a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e85a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0139510 con 0x7f29e009d6f0 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e85a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e013b7d0 con 0x7f29e009e410 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e85a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0072670 con 0x7f29e009e000 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:05.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:57238/0 (socket says 172.21.15.19:57238) 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 -- 172.21.15.19:0/298429398 learned_addr learned my addr 172.21.15.19:0/298429398 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 -- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f29e009e000 msgr2=0x7f29e0130100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f29e009e000 0x7f29e0130100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 -- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009d6f0 msgr2=0x7f29e012fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009d6f0 0x7f29e012fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 -- 172.21.15.19:0/298429398 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009550 con 0x7f29e009e410 2023-10-03T10:18:05.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29e6b42700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29d800cbc0 tx=0x7f29d800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.025+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8003c00 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.026+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8003d60 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.026+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e013a3d0 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.026+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d800abf0 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.026+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e0136460 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.027+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29d800ad50 con 0x7f29e009e410 2023-10-03T10:18:05.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.027+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29d80421c0 con 0x7f29e009e410 2023-10-03T10:18:05.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.027+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0074ea0 con 0x7f29e009e410 2023-10-03T10:18:05.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.037+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29d8044060 con 0x7f29e009e410 2023-10-03T10:18:05.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.182+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2cec005590 con 0x7f2d0409d6f0 2023-10-03T10:18:05.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.183+0000 7f2cfaffd700 1 -- 172.21.15.19:0/1962734265 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d0001b3b0 con 0x7f2d0409d6f0 2023-10-03T10:18:05.183 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:05.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 msgr2=0x7f2d041a5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000e940 tx=0x7f2d0000ec50 comp rx=0 tx=0).stop 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 shutdown_connections 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d0409e410 0x7f2d041a6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0409d6f0 0x7f2d041a5e90 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 --2- 172.21.15.19:0/1962734265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d0409e000 0x7f2d041a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 >> 172.21.15.19:0/1962734265 conn(0x7f2d04066f50 msgr2=0x7f2d041badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 shutdown_connections 2023-10-03T10:18:05.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.185+0000 7f2d0c544700 1 -- 172.21.15.19:0/1962734265 wait complete. 2023-10-03T10:18:05.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:05.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.210+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1700136040 con 0x7f170009d6f0 2023-10-03T10:18:05.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.210+0000 7f16f5ffb700 1 -- 172.21.15.19:0/2947296562 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16fc044060 con 0x7f170009d6f0 2023-10-03T10:18:05.210 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:05.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 msgr2=0x7f1700138930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 0x7f1700138930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00b410 tx=0x7f16fc00b720 comp rx=0 tx=0).stop 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 shutdown_connections 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f170009e410 0x7f17001393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f170009d6f0 0x7f1700138930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 --2- 172.21.15.19:0/2947296562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f170009e000 0x7f1700138e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 >> 172.21.15.19:0/2947296562 conn(0x7f1700066f50 msgr2=0x7f17000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.212+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 shutdown_connections 2023-10-03T10:18:05.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.213+0000 7f17072bc700 1 -- 172.21.15.19:0/2947296562 wait complete. 2023-10-03T10:18:05.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.217+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f34a4121f00 con 0x7f34a4139170 2023-10-03T10:18:05.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.217+0000 7f3492ffd700 1 -- 172.21.15.19:0/70032071 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f34a4121f00 con 0x7f34a4139170 2023-10-03T10:18:05.217 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:05.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 msgr2=0x7f34a411f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b9e0 tx=0x7f349c00bcf0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 shutdown_connections 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34a4139170 0x7f34a411f260 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34a409d6f0 0x7f34a411e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 --2- 172.21.15.19:0/70032071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34a409e1d0 0x7f34a411ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 >> 172.21.15.19:0/70032071 conn(0x7f34a4066f50 msgr2=0x7f34a4136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 shutdown_connections 2023-10-03T10:18:05.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.221+0000 7f34a8a36700 1 -- 172.21.15.19:0/70032071 wait complete. 2023-10-03T10:18:05.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:05.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:05.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.245+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f29e006c360 con 0x7f29e009e410 2023-10-03T10:18:05.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.246+0000 7f29d6ffd700 1 -- 172.21.15.19:0/298429398 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29d80198f0 con 0x7f29e009e410 2023-10-03T10:18:05.246 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 msgr2=0x7f29e0130640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f29d800cbc0 tx=0x7f29d800cf80 comp rx=0 tx=0).stop 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 shutdown_connections 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f29e009e410 0x7f29e0130640 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29e009d6f0 0x7f29e012fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 --2- 172.21.15.19:0/298429398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f29e009e000 0x7f29e0130100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.248+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 >> 172.21.15.19:0/298429398 conn(0x7f29e0066f50 msgr2=0x7f29e00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.249+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 shutdown_connections 2023-10-03T10:18:05.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:05.249+0000 7f29e85a5700 1 -- 172.21.15.19:0/298429398 wait complete. 2023-10-03T10:18:05.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:06.200 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:06.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:06.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:06.262 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:06.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.365+0000 7fb70a3bc700 1 Processor -- start 2023-10-03T10:18:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.365+0000 7fb70a3bc700 1 -- start start 2023-10-03T10:18:06.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.366+0000 7fb70a3bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.366+0000 7fb70a3bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 0x7fb704138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.366+0000 7fb70a3bc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70409f130 con 0x7fb70409d6f0 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.366+0000 7fb70a3bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70409f520 con 0x7fb704135e50 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.366+0000 7fb70a3bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70409e930 con 0x7fb70409e1d0 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 0x7fb704138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35262/0 (socket says 172.21.15.19:35262) 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb7037fe700 1 -- 172.21.15.19:0/3287782373 learned_addr learned my addr 172.21.15.19:0/3287782373 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb703fff700 1 --1- 172.21.15.19:0/3287782373 >> v1:172.21.15.19:6789/0 conn(0x7fb70409d6f0 0x7fb70409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48348/0 (socket says 172.21.15.19:48348) 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 -- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 msgr2=0x7fb704135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 -- 172.21.15.19:0/3287782373 >> v1:172.21.15.19:6789/0 conn(0x7fb70409d6f0 legacy=0x7fb70409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 -- 172.21.15.19:0/3287782373 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70409b2d0 con 0x7fb704135e50 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb7037fe700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb708959700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 0x7fb704138230 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009df0 tx=0x7fb6fc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f451337c2d911b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.367+0000 7fb702ffd700 1 -- 172.21.15.19:0/3287782373 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00e070 con 0x7fb704135e50 2023-10-03T10:18:06.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb702ffd700 1 -- 172.21.15.19:0/3287782373 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00baa0 con 0x7fb704135e50 2023-10-03T10:18:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb702ffd700 1 -- 172.21.15.19:0/3287782373 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00be50 con 0x7fb704135e50 2023-10-03T10:18:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 msgr2=0x7fb704138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 0x7fb704138230 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009df0 tx=0x7fb6fc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3287782373 shutdown_connections 2023-10-03T10:18:06.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb704135e50 0x7fb704138230 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3287782373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70409e1d0 0x7fb704135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3287782373 >> 172.21.15.19:0/3287782373 conn(0x7fb704066f50 msgr2=0x7fb70409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.368+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3287782373 shutdown_connections 2023-10-03T10:18:06.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.369+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3287782373 wait complete. 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.370+0000 7fb70a3bc700 1 Processor -- start 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.370+0000 7fb70a3bc700 1 -- start start 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 0x7fb704134a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 0x7fb70406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb704071c90 con 0x7fb70409d6f0 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7041260a0 con 0x7fb70409e1d0 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb70a3bc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb704071ec0 con 0x7fb704135e50 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb7037fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37764/0 (socket says 172.21.15.19:37764) 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb7037fe700 1 -- 172.21.15.19:0/3750806266 learned_addr learned my addr 172.21.15.19:0/3750806266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb703fff700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 0x7fb704134a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.371+0000 7fb708959700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 0x7fb70406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 -- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 msgr2=0x7fb70406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 0x7fb70406e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 -- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 msgr2=0x7fb704134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 0x7fb704134a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 -- 172.21.15.19:0/3750806266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f8009550 con 0x7fb70409e1d0 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb703fff700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 0x7fb704134a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb708959700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 0x7fb70406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb7037fe700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800ebe0 tx=0x7fb6f800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800c850 con 0x7fb70409e1d0 2023-10-03T10:18:06.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f800c9b0 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800cd40 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6fc009a70 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.372+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7040726a0 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.373+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb704074ea0 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.374+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb6f8013470 con 0x7fb70409e1d0 2023-10-03T10:18:06.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.375+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb6f8040070 con 0x7fb70409e1d0 2023-10-03T10:18:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.379+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb6f8024760 con 0x7fb70409e1d0 2023-10-03T10:18:06.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 Processor -- start 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 -- start start 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5d809e850 0x7fd5d809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d8131ea0 0x7fd5d8139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d809b560 con 0x7fd5d809f160 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80a0040 con 0x7fd5d809e850 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.400+0000 7fd5ddf04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80a02e0 con 0x7fd5d8131ea0 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5d809e850 0x7fd5d809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5d809e850 0x7fd5d809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45060/0 (socket says 172.21.15.19:45060) 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 -- 172.21.15.19:0/436451856 learned_addr learned my addr 172.21.15.19:0/436451856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d6ffd700 1 --1- 172.21.15.19:0/436451856 >> v1:172.21.15.19:6789/0 conn(0x7fd5d809f160 0x7fd5d8131790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48352/0 (socket says 172.21.15.19:48352) 2023-10-03T10:18:06.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d7fff700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d8131ea0 0x7fd5d8139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 -- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d8131ea0 msgr2=0x7fd5d8139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d8131ea0 0x7fd5d8139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 -- 172.21.15.19:0/436451856 >> v1:172.21.15.19:6789/0 conn(0x7fd5d809f160 legacy=0x7fd5d8131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 -- 172.21.15.19:0/436451856 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d809fab0 con 0x7fd5d809e850 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d77fe700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d809e850 0x7fd5d809ec20 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80098f0 tx=0x7fd5c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65fa605299e9cf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.401+0000 7fd5d67fc700 1 -- 172.21.15.19:0/436451856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8011830 con 0x7fd5d809e850 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5d67fc700 1 -- 172.21.15.19:0/436451856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8011990 con 0x7fd5d809e850 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5d67fc700 1 -- 172.21.15.19:0/436451856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8011d20 con 0x7fd5d809e850 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 -- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d809e850 msgr2=0x7fd5d809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d809e850 0x7fd5d809ec20 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80098f0 tx=0x7fd5c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 -- 172.21.15.19:0/436451856 shutdown_connections 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d8131ea0 0x7fd5d8139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/436451856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d809e850 0x7fd5d809ec20 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 -- 172.21.15.19:0/436451856 >> 172.21.15.19:0/436451856 conn(0x7fd5d80a3f70 msgr2=0x7fd5d80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 -- 172.21.15.19:0/436451856 shutdown_connections 2023-10-03T10:18:06.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.402+0000 7fd5ddf04700 1 -- 172.21.15.19:0/436451856 wait complete. 2023-10-03T10:18:06.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.403+0000 7fd5ddf04700 1 Processor -- start 2023-10-03T10:18:06.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 -- start start 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d809e850 0x7fd5d811b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 0x7fd5d811be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d811e950 con 0x7fd5d8131ea0 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d809d9a0 con 0x7fd5d809f160 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5ddf04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d811d4b0 con 0x7fd5d809e850 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37780/0 (socket says 172.21.15.19:37780) 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5d6ffd700 1 -- 172.21.15.19:0/1020167158 learned_addr learned my addr 172.21.15.19:0/1020167158 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.404+0000 7fd5d7fff700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 0x7fd5d811be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d77fe700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d809e850 0x7fd5d811b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 -- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d809e850 msgr2=0x7fd5d811b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d809e850 0x7fd5d811b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 -- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 msgr2=0x7fd5d811b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 -- 172.21.15.19:0/1020167158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c8009550 con 0x7fd5d8131ea0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d6ffd700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5d7fff700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 0x7fd5d811be10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d90 tx=0x7fd5d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0009c00 con 0x7fd5d8131ea0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000f040 con 0x7fd5d8131ea0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d806cc10 con 0x7fd5d8131ea0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0014480 con 0x7fd5d8131ea0 2023-10-03T10:18:06.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.405+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d811eb30 con 0x7fd5d8131ea0 2023-10-03T10:18:06.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.406+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5d00145e0 con 0x7fd5d8131ea0 2023-10-03T10:18:06.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.407+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5d00401b0 con 0x7fd5d8131ea0 2023-10-03T10:18:06.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.407+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d811e780 con 0x7fd5d8131ea0 2023-10-03T10:18:06.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.411+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5d0018070 con 0x7fd5d8131ea0 2023-10-03T10:18:06.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.415+0000 7f1ffdd6a700 1 Processor -- start 2023-10-03T10:18:06.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.415+0000 7f1ffdd6a700 1 -- start start 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ffdd6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 0x7f1ff809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ffdd6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 0x7f1ff8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ffdd6a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff809f130 con 0x7f1ff809e410 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ffdd6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff809f520 con 0x7f1ff809d6f0 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ffdd6a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff809e930 con 0x7f1ff809e000 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ff7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ff809e410 0x7f1ff8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48364/0 (socket says 172.21.15.19:48364) 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ff7fff700 1 -- 172.21.15.19:0/3739608667 learned_addr learned my addr 172.21.15.19:0/3739608667 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:06.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.416+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 0x7f1ff809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff77fe700 1 -- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 msgr2=0x7f1ff8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff6ffd700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 0x7f1ff8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff67fc700 1 -- 172.21.15.19:0/3739608667 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7736244 0 0) 0x7f1ff809f130 con 0x7f1ff809e410 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff77fe700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 0x7f1ff8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff77fe700 1 -- 172.21.15.19:0/3739608667 >> v1:172.21.15.19:6789/0 conn(0x7f1ff809e410 legacy=0x7f1ff8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff77fe700 1 -- 172.21.15.19:0/3739608667 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff809b2d0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff6ffd700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 0x7f1ff8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:06.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff77fe700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 0x7f1ff809dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009870 tx=0x7f1fe8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=931ec0bc43868e71 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff67fc700 1 -- 172.21.15.19:0/3739608667 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011830 con 0x7f1ff809d6f0 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff67fc700 1 -- 172.21.15.19:0/3739608667 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8011990 con 0x7f1ff809d6f0 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.417+0000 7f1ff67fc700 1 -- 172.21.15.19:0/3739608667 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8011d20 con 0x7f1ff809d6f0 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 msgr2=0x7f1ff809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 0x7f1ff809dac0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009870 tx=0x7f1fe8009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/3739608667 shutdown_connections 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809d6f0 0x7f1ff809dac0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/3739608667 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809e000 0x7f1ff8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/3739608667 >> 172.21.15.19:0/3739608667 conn(0x7f1ff8066f50 msgr2=0x7f1ff809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/3739608667 shutdown_connections 2023-10-03T10:18:06.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.418+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/3739608667 wait complete. 2023-10-03T10:18:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.419+0000 7f1ffdd6a700 1 Processor -- start 2023-10-03T10:18:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.419+0000 7f1ffdd6a700 1 -- start start 2023-10-03T10:18:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 0x7f1ff81c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809e410 0x7f1ff8131670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8133580 con 0x7f1ff809e000 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8135100 con 0x7f1ff809e410 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ffdd6a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff81c5e90 con 0x7f1ff809d6f0 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ff6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 0x7f1ff81c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ff77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35292/0 (socket says 172.21.15.19:35292) 2023-10-03T10:18:06.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.420+0000 7f1ff77fe700 1 -- 172.21.15.19:0/811306211 learned_addr learned my addr 172.21.15.19:0/811306211 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 -- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809e410 msgr2=0x7f1ff8131670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809e410 0x7f1ff8131670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 -- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 msgr2=0x7f1ff81c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 0x7f1ff81c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 -- 172.21.15.19:0/811306211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80094a0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff6ffd700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 0x7f1ff81c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ff77fe700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80090b0 tx=0x7f1fe8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8004400 con 0x7f1ff809d6f0 2023-10-03T10:18:06.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe801f070 con 0x7f1ff809d6f0 2023-10-03T10:18:06.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80038a0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff8133990 con 0x7f1ff809d6f0 2023-10-03T10:18:06.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.421+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff81344b0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.422+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1fe8021030 con 0x7f1ff809d6f0 2023-10-03T10:18:06.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.423+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1fe80408d0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.423+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff8131250 con 0x7f1ff809d6f0 2023-10-03T10:18:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.432+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1fe8015020 con 0x7f1ff809d6f0 2023-10-03T10:18:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.442+0000 7f2b216d9700 1 Processor -- start 2023-10-03T10:18:06.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.442+0000 7f2b216d9700 1 -- start start 2023-10-03T10:18:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b216d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 0x7f2b1c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b216d9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 0x7f2b1c0a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b216d9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0a1810 con 0x7f2b1c133920 2023-10-03T10:18:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b216d9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c09ea10 con 0x7f2b1c09d5c0 2023-10-03T10:18:06.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b216d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c09e210 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 0x7f2b1c0a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 0x7f2b1c0a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45092/0 (socket says 172.21.15.19:45092) 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1a7fc700 1 -- 172.21.15.19:0/3652110716 learned_addr learned my addr 172.21.15.19:0/3652110716 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1affd700 1 --2- 172.21.15.19:0/3652110716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 0x7f2b1c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1affd700 1 -- 172.21.15.19:0/3652110716 >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 msgr2=0x7f2b1c0a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1affd700 1 --2- 172.21.15.19:0/3652110716 >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 0x7f2b1c0a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1affd700 1 -- 172.21.15.19:0/3652110716 >> v1:172.21.15.19:6789/0 conn(0x7f2b1c133920 legacy=0x7f2b1c133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.443+0000 7f2b1affd700 1 -- 172.21.15.19:0/3652110716 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0a26f0 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b1affd700 1 --2- 172.21.15.19:0/3652110716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 0x7f2b1c0a0d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009d90 tx=0x7f2b0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b3daa55edfea30c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b19ffb700 1 -- 172.21.15.19:0/3652110716 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00e070 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b19ffb700 1 -- 172.21.15.19:0/3652110716 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00bb20 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b19ffb700 1 -- 172.21.15.19:0/3652110716 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c012430 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b216d9700 1 -- 172.21.15.19:0/3652110716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 msgr2=0x7f2b1c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b216d9700 1 --2- 172.21.15.19:0/3652110716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 0x7f2b1c0a0d90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009d90 tx=0x7f2b0c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:06.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b216d9700 1 -- 172.21.15.19:0/3652110716 shutdown_connections 2023-10-03T10:18:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.444+0000 7f2b216d9700 1 --2- 172.21.15.19:0/3652110716 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c0a09c0 0x7f2b1c0a0d90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.445+0000 7f2b216d9700 1 --2- 172.21.15.19:0/3652110716 >> v2:172.21.15.19:3300/0 conn(0x7f2b1c09d5c0 0x7f2b1c0a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.445+0000 7f2b216d9700 1 -- 172.21.15.19:0/3652110716 >> 172.21.15.19:0/3652110716 conn(0x7f2b1c0a2fe0 msgr2=0x7f2b1c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.445+0000 7f2b216d9700 1 -- 172.21.15.19:0/3652110716 shutdown_connections 2023-10-03T10:18:06.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.445+0000 7f2b216d9700 1 -- 172.21.15.19:0/3652110716 wait complete. 2023-10-03T10:18:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 Processor -- start 2023-10-03T10:18:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 -- start start 2023-10-03T10:18:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 0x7f2b1c11f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1c0a09c0 0x7f2b1c11f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 0x7f2b1c1c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c11eea0 con 0x7f2b1c133920 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1211e0 con 0x7f2b1c0a09c0 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b216d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c122130 con 0x7f2b1c09d5c0 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 0x7f2b1c11f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 0x7f2b1c11f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35310/0 (socket says 172.21.15.19:35310) 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b1affd700 1 -- 172.21.15.19:0/2203875954 learned_addr learned my addr 172.21.15.19:0/2203875954 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b1a7fc700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1c0a09c0 0x7f2b1c11f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.446+0000 7f2b1b7fe700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 0x7f2b1c1c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 -- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 msgr2=0x7f2b1c11f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 0x7f2b1c11f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 -- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1c0a09c0 msgr2=0x7f2b1c11f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1c0a09c0 0x7f2b1c11f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 -- 172.21.15.19:0/2203875954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c009a70 con 0x7f2b1c133920 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b1b7fe700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 0x7f2b1c1c7ff0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001a20 tx=0x7f2b14001d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14005220 con 0x7f2b1c133920 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b14005380 con 0x7f2b1c133920 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.447+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14006aa0 con 0x7f2b1c133920 2023-10-03T10:18:06.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.448+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c120610 con 0x7f2b1c133920 2023-10-03T10:18:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.448+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c122910 con 0x7f2b1c133920 2023-10-03T10:18:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.449+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b1400f070 con 0x7f2b1c133920 2023-10-03T10:18:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.449+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b1404f580 con 0x7f2b1c133920 2023-10-03T10:18:06.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.449+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c0747f0 con 0x7f2b1c133920 2023-10-03T10:18:06.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.454+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b14028030 con 0x7f2b1c133920 2023-10-03T10:18:06.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.603+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb704070a60 con 0x7fb70409e1d0 2023-10-03T10:18:06.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.603+0000 7fb700ff9700 1 -- 172.21.15.19:0/3750806266 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb6f8017020 con 0x7fb70409e1d0 2023-10-03T10:18:06.603 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 msgr2=0x7fb704134fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800ebe0 tx=0x7fb6f800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 shutdown_connections 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb704135e50 0x7fb70406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70409d6f0 0x7fb704134a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 --2- 172.21.15.19:0/3750806266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70409e1d0 0x7fb704134fa0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 >> 172.21.15.19:0/3750806266 conn(0x7fb704066f50 msgr2=0x7fb704136a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 shutdown_connections 2023-10-03T10:18:06.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.606+0000 7fb70a3bc700 1 -- 172.21.15.19:0/3750806266 wait complete. 2023-10-03T10:18:06.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:06.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.656+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5d80747f0 con 0x7fd5d8131ea0 2023-10-03T10:18:06.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.658+0000 7fd5bffff700 1 -- 172.21.15.19:0/1020167158 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5d0014890 con 0x7fd5d8131ea0 2023-10-03T10:18:06.658 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 msgr2=0x7fd5d811be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 0x7fd5d811be10 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0009d90 tx=0x7fd5d000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 shutdown_connections 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5d8131ea0 0x7fd5d811be10 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5d809e850 0x7fd5d811b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 --2- 172.21.15.19:0/1020167158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5d809f160 0x7fd5d811b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.660+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 >> 172.21.15.19:0/1020167158 conn(0x7fd5d80a3f70 msgr2=0x7fd5d80a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.661+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 shutdown_connections 2023-10-03T10:18:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.661+0000 7fd5ddf04700 1 -- 172.21.15.19:0/1020167158 wait complete. 2023-10-03T10:18:06.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.661+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b1c122bf0 con 0x7f2b1c133920 2023-10-03T10:18:06.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.662+0000 7f2b037fe700 1 -- 172.21.15.19:0/2203875954 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b1400f730 con 0x7f2b1c133920 2023-10-03T10:18:06.662 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 msgr2=0x7f2b1c1c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 0x7f2b1c1c7ff0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2b14001a20 tx=0x7f2b14001d30 comp rx=0 tx=0).stop 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 shutdown_connections 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1c133920 0x7f2b1c1c7ff0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1c09d5c0 0x7f2b1c11f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 --2- 172.21.15.19:0/2203875954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1c0a09c0 0x7f2b1c11f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 >> 172.21.15.19:0/2203875954 conn(0x7f2b1c0a2fe0 msgr2=0x7f2b1c1bbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 shutdown_connections 2023-10-03T10:18:06.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.664+0000 7f2b216d9700 1 -- 172.21.15.19:0/2203875954 wait complete. 2023-10-03T10:18:06.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.673+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1ff8074ea0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.673+0000 7f1fdffff700 1 -- 172.21.15.19:0/811306211 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1fe80239c0 con 0x7f1ff809d6f0 2023-10-03T10:18:06.673 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:06.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.675+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 msgr2=0x7f1ff81c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.675+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80090b0 tx=0x7f1fe8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 shutdown_connections 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ff809e410 0x7f1ff8131670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ff809d6f0 0x7f1ff81c62e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 --2- 172.21.15.19:0/811306211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ff809e000 0x7f1ff81c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 >> 172.21.15.19:0/811306211 conn(0x7f1ff8066f50 msgr2=0x7f1ff8070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 shutdown_connections 2023-10-03T10:18:06.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:06.676+0000 7f1ffdd6a700 1 -- 172.21.15.19:0/811306211 wait complete. 2023-10-03T10:18:06.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:06.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:06.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:07.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:07.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:07.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:07.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.787+0000 7f0c2c0e8700 1 Processor -- start 2023-10-03T10:18:07.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 -- start start 2023-10-03T10:18:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c24130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2409f130 con 0x7f0c2409e000 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2409f520 con 0x7f0c2409d6f0 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c2c0e8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2409e930 con 0x7f0c2409e410 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c29683700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c2409e000 0x7f0c24130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48378/0 (socket says 172.21.15.19:48378) 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c29683700 1 -- 172.21.15.19:0/1612769322 learned_addr learned my addr 172.21.15.19:0/1612769322 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.788+0000 7f0c29e84700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c2a685700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c24130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c28e82700 1 -- 172.21.15.19:0/1612769322 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504913358 0 0) 0x7f0c2409f130 con 0x7f0c2409e000 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c28e82700 1 -- 172.21.15.19:0/1612769322 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c100035b0 con 0x7f0c2409e000 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c29e84700 1 -- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 msgr2=0x7f0c24130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c29e84700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c24130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c29e84700 1 -- 172.21.15.19:0/1612769322 >> v1:172.21.15.19:6789/0 conn(0x7f0c2409e000 legacy=0x7f0c24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c29e84700 1 -- 172.21.15.19:0/1612769322 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c2409b2d0 con 0x7f0c2409d6f0 2023-10-03T10:18:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c29e84700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2409dac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009870 tx=0x7f0c20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fea92e702fbb248 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.789+0000 7f0c28e82700 1 -- 172.21.15.19:0/1612769322 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c20012b80 con 0x7f0c2409d6f0 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c28e82700 1 -- 172.21.15.19:0/1612769322 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c20012ce0 con 0x7f0c2409d6f0 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c28e82700 1 -- 172.21.15.19:0/1612769322 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2001b620 con 0x7f0c2409d6f0 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 msgr2=0x7f0c2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2409dac0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0c20009870 tx=0x7f0c20009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1612769322 shutdown_connections 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c24130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1612769322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2409dac0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1612769322 >> 172.21.15.19:0/1612769322 conn(0x7f0c24066f50 msgr2=0x7f0c2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1612769322 shutdown_connections 2023-10-03T10:18:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.790+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1612769322 wait complete. 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 Processor -- start 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 -- start start 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2411de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 0x7f0c2411e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c2411e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2411f270 con 0x7f0c2409e000 2023-10-03T10:18:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c24120020 con 0x7f0c2409d6f0 2023-10-03T10:18:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2c0e8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c241210e0 con 0x7f0c2409e410 2023-10-03T10:18:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c29683700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 0x7f0c2411e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c2a685700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c2411e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c29683700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 0x7f0c2411e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45112/0 (socket says 172.21.15.19:45112) 2023-10-03T10:18:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.792+0000 7f0c29683700 1 -- 172.21.15.19:0/1283337906 learned_addr learned my addr 172.21.15.19:0/1283337906 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c29e84700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2411de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 -- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 msgr2=0x7f0c2411de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2411de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 -- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 msgr2=0x7f0c2411e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 0x7f0c2411e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 -- 172.21.15.19:0/1283337906 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200094a0 con 0x7f0c2409e410 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c29e84700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2411de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2a685700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c2411e8b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009d90 tx=0x7f0c1c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c009c00 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c00f040 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2409c700 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c00c930 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.793+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2411fa40 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.795+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c24074ea0 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.795+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c1c00ca90 con 0x7f0c2409e410 2023-10-03T10:18:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.796+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c1c048360 con 0x7f0c2409e410 2023-10-03T10:18:07.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.804+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c1c007d70 con 0x7f0c2409e410 2023-10-03T10:18:07.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.826+0000 7fb4f0506700 1 Processor -- start 2023-10-03T10:18:07.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.826+0000 7fb4f0506700 1 -- start start 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4f0506700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130540 0x7fb4e8130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4f0506700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4e8130e50 0x7fb4e806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4f0506700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80716a0 con 0x7fb4e806fb20 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4f0506700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e809a390 con 0x7fb4e8130e50 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4f0506700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8071290 con 0x7fb4e8130540 2023-10-03T10:18:07.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4eeaa3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb4e806fb20 0x7fb4e8137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48392/0 (socket says 172.21.15.19:48392) 2023-10-03T10:18:07.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4eeaa3700 1 -- 172.21.15.19:0/1859820609 learned_addr learned my addr 172.21.15.19:0/1859820609 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:07.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4edaa1700 1 --2- 172.21.15.19:0/1859820609 >> v2:172.21.15.19:3300/0 conn(0x7fb4e8130e50 0x7fb4e806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.827+0000 7fb4ee2a2700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130540 0x7fb4e8130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4edaa1700 1 -- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130540 msgr2=0x7fb4e8130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4edaa1700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130540 0x7fb4e8130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4edaa1700 1 -- 172.21.15.19:0/1859820609 >> v1:172.21.15.19:6789/0 conn(0x7fb4e806fb20 legacy=0x7fb4e8137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4edaa1700 1 -- 172.21.15.19:0/1859820609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8130340 con 0x7fb4e8130e50 2023-10-03T10:18:07.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4edaa1700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130e50 0x7fb4e806f5e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009840 tx=0x7fb4d8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875f43e061479526 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4ed2a0700 1 -- 172.21.15.19:0/1859820609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8004230 con 0x7fb4e8130e50 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4ed2a0700 1 -- 172.21.15.19:0/1859820609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8004390 con 0x7fb4e8130e50 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.828+0000 7fb4ed2a0700 1 -- 172.21.15.19:0/1859820609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80036a0 con 0x7fb4e8130e50 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 -- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130e50 msgr2=0x7fb4e806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130e50 0x7fb4e806f5e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009840 tx=0x7fb4d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 -- 172.21.15.19:0/1859820609 shutdown_connections 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130540 0x7fb4e8130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 --2- 172.21.15.19:0/1859820609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130e50 0x7fb4e806f5e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 -- 172.21.15.19:0/1859820609 >> 172.21.15.19:0/1859820609 conn(0x7fb4e80a2aa0 msgr2=0x7fb4e80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 -- 172.21.15.19:0/1859820609 shutdown_connections 2023-10-03T10:18:07.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.829+0000 7fb4f0506700 1 -- 172.21.15.19:0/1859820609 wait complete. 2023-10-03T10:18:07.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.830+0000 7fb4f0506700 1 Processor -- start 2023-10-03T10:18:07.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.830+0000 7fb4f0506700 1 -- start start 2023-10-03T10:18:07.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 0x7fb4e81287a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130e50 0x7fb4e8128ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8129a00 con 0x7fb4e8130540 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e812a8d0 con 0x7fb4e806fb20 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4f0506700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80a05f0 con 0x7fb4e8130e50 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37818/0 (socket says 172.21.15.19:37818) 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 -- 172.21.15.19:0/427715737 learned_addr learned my addr 172.21.15.19:0/427715737 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4edaa1700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 0x7fb4e81287a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4eeaa3700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130e50 0x7fb4e8128ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 -- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130e50 msgr2=0x7fb4e8128ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130e50 0x7fb4e8128ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 -- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 msgr2=0x7fb4e81287a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 0x7fb4e81287a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4ee2a2700 1 -- 172.21.15.19:0/427715737 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80094a0 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.831+0000 7fb4edaa1700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 0x7fb4e81287a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4ee2a2700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400e9e0 tx=0x7fb4e400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4009710 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e400c850 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400cbc0 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e809db40 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.832+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e812ae70 con 0x7fb4e806fb20 2023-10-03T10:18:07.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.833+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4e400cd20 con 0x7fb4e806fb20 2023-10-03T10:18:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.833+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4e403f7a0 con 0x7fb4e806fb20 2023-10-03T10:18:07.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.833+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8071940 con 0x7fb4e806fb20 2023-10-03T10:18:07.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.838+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4e40232f0 con 0x7fb4e806fb20 2023-10-03T10:18:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.851+0000 7f22d27f4700 1 Processor -- start 2023-10-03T10:18:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.851+0000 7f22d27f4700 1 -- start start 2023-10-03T10:18:07.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.851+0000 7f22d27f4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22cc09d6f0 0x7f22cc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.851+0000 7f22d27f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09e410 0x7f22cc130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22d27f4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc09f130 con 0x7f22cc09e000 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22d27f4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc09f520 con 0x7f22cc09d6f0 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22d27f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc09e930 con 0x7f22cc09e410 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22cc09d6f0 0x7f22cc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22cc09e000 0x7f22cc130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48408/0 (socket says 172.21.15.19:48408) 2023-10-03T10:18:07.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cb7fe700 1 -- 172.21.15.19:0/2287287174 learned_addr learned my addr 172.21.15.19:0/2287287174 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22caffd700 1 -- 172.21.15.19:0/2287287174 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2071378694 0 0) 0x7f22cc09f130 con 0x7f22cc09e000 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22caffd700 1 -- 172.21.15.19:0/2287287174 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b40035b0 con 0x7f22cc09e000 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22d0d91700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09e410 0x7f22cc130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 -- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09e410 msgr2=0x7f22cc130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09e410 0x7f22cc130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 -- 172.21.15.19:0/2287287174 >> v1:172.21.15.19:6789/0 conn(0x7f22cc09e000 legacy=0x7f22cc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 -- 172.21.15.19:0/2287287174 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc09b2d0 con 0x7f22cc09d6f0 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.852+0000 7f22cbfff700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09d6f0 0x7f22cc09dac0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009840 tx=0x7f22bc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30317a95c008e618 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.853+0000 7f22caffd700 1 -- 172.21.15.19:0/2287287174 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011830 con 0x7f22cc09d6f0 2023-10-03T10:18:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.853+0000 7f22caffd700 1 -- 172.21.15.19:0/2287287174 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22bc011990 con 0x7f22cc09d6f0 2023-10-03T10:18:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.853+0000 7f22caffd700 1 -- 172.21.15.19:0/2287287174 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22bc011d20 con 0x7f22cc09d6f0 2023-10-03T10:18:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 -- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09d6f0 msgr2=0x7f22cc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09d6f0 0x7f22cc09dac0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f22bc009840 tx=0x7f22bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:07.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 -- 172.21.15.19:0/2287287174 shutdown_connections 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09e410 0x7f22cc130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 --2- 172.21.15.19:0/2287287174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09d6f0 0x7f22cc09dac0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 -- 172.21.15.19:0/2287287174 >> 172.21.15.19:0/2287287174 conn(0x7f22cc066f50 msgr2=0x7f22cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 -- 172.21.15.19:0/2287287174 shutdown_connections 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.854+0000 7f22d27f4700 1 -- 172.21.15.19:0/2287287174 wait complete. 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.855+0000 7f22d27f4700 1 Processor -- start 2023-10-03T10:18:07.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.856+0000 7f22d27f4700 1 -- start start 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.856+0000 7f22d27f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 0x7f22cc1c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d27f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d27f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22cc09e410 0x7f22cc131640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d27f4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc135070 con 0x7f22cc09e000 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d27f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc1c6c80 con 0x7f22cc09e410 2023-10-03T10:18:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d27f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc09c700 con 0x7f22cc09d6f0 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 0x7f22cc1c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 0x7f22cc1c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35370/0 (socket says 172.21.15.19:35370) 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45152/0 (socket says 172.21.15.19:45152) 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cbfff700 1 -- 172.21.15.19:0/3332092286 learned_addr learned my addr 172.21.15.19:0/3332092286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22d0d91700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22cc09e410 0x7f22cc131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 -- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 msgr2=0x7f22cc1c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 0x7f22cc1c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 -- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22cc09e410 msgr2=0x7f22cc131640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22cc09e410 0x7f22cc131640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 -- 172.21.15.19:0/3332092286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0094a0 con 0x7f22cc09e000 2023-10-03T10:18:07.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.857+0000 7f22cb7fe700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c490 tx=0x7f22c000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.858+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0005e30 con 0x7f22cc09e000 2023-10-03T10:18:07.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.858+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c00070d0 con 0x7f22cc09e000 2023-10-03T10:18:07.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.858+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22cc134160 con 0x7f22cc09e000 2023-10-03T10:18:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.858+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0007440 con 0x7f22cc09e000 2023-10-03T10:18:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.858+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc133900 con 0x7f22cc09e000 2023-10-03T10:18:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.860+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac0052e0 con 0x7f22cc09e000 2023-10-03T10:18:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.860+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22c00075a0 con 0x7f22cc09e000 2023-10-03T10:18:07.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.861+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22c0011d30 con 0x7f22cc09e000 2023-10-03T10:18:07.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.865+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22c0044060 con 0x7f22cc09e000 2023-10-03T10:18:07.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 Processor -- start 2023-10-03T10:18:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 -- start start 2023-10-03T10:18:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 0x7f4f540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f540a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540a2a70 con 0x7f4f54133930 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540a01d0 con 0x7f4f540a0a30 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f5a131700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5409e2b0 con 0x7f4f5409d630 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.878+0000 7f4f53fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4f54133930 0x7f4f54133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48418/0 (socket says 172.21.15.19:48418) 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f53fff700 1 -- 172.21.15.19:0/1431389977 learned_addr learned my addr 172.21.15.19:0/1431389977 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 0x7f4f540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f4bfff700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f540a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f52ffd700 1 -- 172.21.15.19:0/1431389977 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105306150 0 0) 0x7f4f540a2a70 con 0x7f4f54133930 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f52ffd700 1 -- 172.21.15.19:0/1431389977 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f400035b0 con 0x7f4f54133930 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 -- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 msgr2=0x7f4f540a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f540a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 -- 172.21.15.19:0/1431389977 >> v1:172.21.15.19:6789/0 conn(0x7f4f54133930 legacy=0x7f4f54133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 -- 172.21.15.19:0/1431389977 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f5409dc50 con 0x7f4f540a0a30 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f4bfff700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f540a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.879+0000 7f4f537fe700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 0x7f4f540a0e00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f44009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e71e1eab386a1da2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f52ffd700 1 -- 172.21.15.19:0/1431389977 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44011830 con 0x7f4f540a0a30 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f52ffd700 1 -- 172.21.15.19:0/1431389977 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f44011990 con 0x7f4f540a0a30 2023-10-03T10:18:07.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f52ffd700 1 -- 172.21.15.19:0/1431389977 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44011d20 con 0x7f4f540a0a30 2023-10-03T10:18:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 -- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 msgr2=0x7f4f540a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 0x7f4f540a0e00 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f44009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 -- 172.21.15.19:0/1431389977 shutdown_connections 2023-10-03T10:18:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f540a0a30 0x7f4f540a0e00 secure :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f44009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:07.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1431389977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f540a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.880+0000 7f4f5a131700 1 -- 172.21.15.19:0/1431389977 >> 172.21.15.19:0/1431389977 conn(0x7f4f540a3050 msgr2=0x7f4f540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.881+0000 7f4f5a131700 1 -- 172.21.15.19:0/1431389977 shutdown_connections 2023-10-03T10:18:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.881+0000 7f4f5a131700 1 -- 172.21.15.19:0/1431389977 wait complete. 2023-10-03T10:18:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 Processor -- start 2023-10-03T10:18:07.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 -- start start 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 0x7f4f5411f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 0x7f4f541c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5411eed0 con 0x7f4f541c8090 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540a0410 con 0x7f4f54133930 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f5a131700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5411fe40 con 0x7f4f5409d630 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f537fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f537fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35392/0 (socket says 172.21.15.19:35392) 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f537fe700 1 -- 172.21.15.19:0/1054436462 learned_addr learned my addr 172.21.15.19:0/1054436462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f4bfff700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 0x7f4f5411f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.882+0000 7f4f53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 0x7f4f541c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 -- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 msgr2=0x7f4f5411f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 -- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 msgr2=0x7f4f5411f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 0x7f4f5411f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 -- 172.21.15.19:0/1054436462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c0094a0 con 0x7f4f541c8090 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f537fe700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f4bfff700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 0x7f4f5411f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:07.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f53fff700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 0x7f4f541c8500 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00ca80 tx=0x7f4f4c00cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00a9e0 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c00ab40 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f440094a0 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.883+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c012400 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.884+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f54120600 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.884+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4f4c012560 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.885+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4f4c03f370 con 0x7f4f541c8090 2023-10-03T10:18:07.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.885+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f540a4090 con 0x7f4f541c8090 2023-10-03T10:18:07.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:07.890+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4f4c017020 con 0x7f4f541c8090 2023-10-03T10:18:08.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.047+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4e8074ea0 con 0x7fb4e806fb20 2023-10-03T10:18:08.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.048+0000 7fb4deffd700 1 -- 172.21.15.19:0/427715737 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4e4021020 con 0x7fb4e806fb20 2023-10-03T10:18:08.048 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 msgr2=0x7fb4e8128260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400e9e0 tx=0x7fb4e400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 shutdown_connections 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4e8130e50 0x7fb4e8128ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4e806fb20 0x7fb4e8128260 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 --2- 172.21.15.19:0/427715737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4e8130540 0x7fb4e81287a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 >> 172.21.15.19:0/427715737 conn(0x7fb4e80a2aa0 msgr2=0x7fb4e806e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 shutdown_connections 2023-10-03T10:18:08.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.051+0000 7fb4f0506700 1 -- 172.21.15.19:0/427715737 wait complete. 2023-10-03T10:18:08.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:08.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.072+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c24120c90 con 0x7f0c2409e410 2023-10-03T10:18:08.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.072+0000 7f0c1a7fc700 1 -- 172.21.15.19:0/1283337906 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c1c024070 con 0x7f0c2409e410 2023-10-03T10:18:08.072 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 msgr2=0x7f0c2411e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c2411e8b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c009d90 tx=0x7f0c1c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 shutdown_connections 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c2409e410 0x7f0c2411e8b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c2409d6f0 0x7f0c2411de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 --2- 172.21.15.19:0/1283337906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c2409e000 0x7f0c2411e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 >> 172.21.15.19:0/1283337906 conn(0x7f0c24066f50 msgr2=0x7f0c24070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 shutdown_connections 2023-10-03T10:18:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.075+0000 7f0c2c0e8700 1 -- 172.21.15.19:0/1283337906 wait complete. 2023-10-03T10:18:08.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.106+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4f540747f0 con 0x7f4f541c8090 2023-10-03T10:18:08.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.107+0000 7f4f50ff9700 1 -- 172.21.15.19:0/1054436462 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4f4c01b3b0 con 0x7f4f541c8090 2023-10-03T10:18:08.107 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 msgr2=0x7f4f541c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 0x7f4f541c8500 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c00ca80 tx=0x7f4f4c00cd90 comp rx=0 tx=0).stop 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 shutdown_connections 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f541c8090 0x7f4f541c8500 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4f5409d630 0x7f4f5411f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 --2- 172.21.15.19:0/1054436462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4f54133930 0x7f4f5411f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 >> 172.21.15.19:0/1054436462 conn(0x7f4f540a3050 msgr2=0x7f4f5409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 shutdown_connections 2023-10-03T10:18:08.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.109+0000 7f4f5a131700 1 -- 172.21.15.19:0/1054436462 wait complete. 2023-10-03T10:18:08.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.111+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22ac005590 con 0x7f22cc09e000 2023-10-03T10:18:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.111+0000 7f22c8ff9700 1 -- 172.21.15.19:0/3332092286 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22c0017020 con 0x7f22cc09e000 2023-10-03T10:18:08.111 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:08.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 msgr2=0x7f22cc1c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f22c000c490 tx=0x7f22c000c7a0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 shutdown_connections 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22cc09e410 0x7f22cc131640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22cc09d6f0 0x7f22cc1c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 --2- 172.21.15.19:0/3332092286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22cc09e000 0x7f22cc1c6740 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 >> 172.21.15.19:0/3332092286 conn(0x7f22cc066f50 msgr2=0x7f22cc070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 shutdown_connections 2023-10-03T10:18:08.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:08.113+0000 7f22d27f4700 1 -- 172.21.15.19:0/3332092286 wait complete. 2023-10-03T10:18:08.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:08.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:09.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:09.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:09.124 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:09.129 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.237+0000 7faa12d9c700 1 Processor -- start 2023-10-03T10:18:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.237+0000 7faa12d9c700 1 -- start start 2023-10-03T10:18:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.238+0000 7faa12d9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c138ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.238+0000 7faa12d9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faa0c1390e0 0x7faa0c13b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.238+0000 7faa12d9c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa0c133550 con 0x7faa0c133960 2023-10-03T10:18:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.238+0000 7faa12d9c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa0c06fab0 con 0x7faa0c1390e0 2023-10-03T10:18:09.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.238+0000 7faa12d9c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c134440 con 0x7faa0c1367c0 2023-10-03T10:18:09.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa10b38700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7faa0c133960 0x7faa0c133d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48426/0 (socket says 172.21.15.19:48426) 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa10b38700 1 -- 172.21.15.19:0/1474810519 learned_addr learned my addr 172.21.15.19:0/1474810519 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 --2- 172.21.15.19:0/1474810519 >> v2:172.21.15.19:3300/0 conn(0x7faa0c1390e0 0x7faa0c13b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa0bfff700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c138ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 -- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 msgr2=0x7faa0c138ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c138ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 -- 172.21.15.19:0/1474810519 >> v1:172.21.15.19:6789/0 conn(0x7faa0c133960 legacy=0x7faa0c133d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa0b7fe700 1 -- 172.21.15.19:0/1474810519 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58379980 0 0) 0x7faa0c133550 con 0x7faa0c133960 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 -- 172.21.15.19:0/1474810519 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c071e20 con 0x7faa0c1390e0 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.239+0000 7faa11339700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c1390e0 0x7faa0c13b4c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d87ec123722258 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.240+0000 7faa0b7fe700 1 -- 172.21.15.19:0/1474810519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0400e070 con 0x7faa0c1390e0 2023-10-03T10:18:09.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.240+0000 7faa0b7fe700 1 -- 172.21.15.19:0/1474810519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0400bb20 con 0x7faa0c1390e0 2023-10-03T10:18:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.240+0000 7faa0b7fe700 1 -- 172.21.15.19:0/1474810519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa04012430 con 0x7faa0c1390e0 2023-10-03T10:18:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 -- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c1390e0 msgr2=0x7faa0c13b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c1390e0 0x7faa0c13b4c0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7faa04009d90 tx=0x7faa0400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 -- 172.21.15.19:0/1474810519 shutdown_connections 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c1390e0 0x7faa0c13b4c0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 --2- 172.21.15.19:0/1474810519 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c138ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 -- 172.21.15.19:0/1474810519 >> 172.21.15.19:0/1474810519 conn(0x7faa0c0a2610 msgr2=0x7faa0c0a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 -- 172.21.15.19:0/1474810519 shutdown_connections 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.241+0000 7faa12d9c700 1 -- 172.21.15.19:0/1474810519 wait complete. 2023-10-03T10:18:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.242+0000 7faa12d9c700 1 Processor -- start 2023-10-03T10:18:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.242+0000 7faa12d9c700 1 -- start start 2023-10-03T10:18:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c11b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faa0c1390e0 0x7faa0c11b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c11e870 con 0x7faa0c133960 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c11e240 con 0x7faa0c1390e0 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.243+0000 7faa12d9c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c06f420 con 0x7faa0c1367c0 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa10b38700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa10b38700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45180/0 (socket says 172.21.15.19:45180) 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa10b38700 1 -- 172.21.15.19:0/2258163540 learned_addr learned my addr 172.21.15.19:0/2258163540 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa11339700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faa0c1390e0 0x7faa0c11b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c11b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 -- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faa0c1390e0 msgr2=0x7faa0c11b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faa0c1390e0 0x7faa0c11b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 -- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 msgr2=0x7faa0c11ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 -- 172.21.15.19:0/2258163540 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04009a70 con 0x7faa0c1367c0 2023-10-03T10:18:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa10b38700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.244+0000 7faa0bfff700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c11b2c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e900 tx=0x7fa9f800ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.245+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8013680 con 0x7faa0c1367c0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.245+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f80137e0 con 0x7faa0c1367c0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.245+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c11f530 con 0x7faa0c1367c0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.245+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8013b50 con 0x7faa0c1367c0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.245+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c11c860 con 0x7faa0c1367c0 2023-10-03T10:18:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.246+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c0747f0 con 0x7faa0c1367c0 2023-10-03T10:18:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.246+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f8013cb0 con 0x7faa0c1367c0 2023-10-03T10:18:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.246+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9f803f650 con 0x7faa0c1367c0 2023-10-03T10:18:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.251+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f801bc30 con 0x7faa0c1367c0 2023-10-03T10:18:09.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.267+0000 7fb38306e700 1 Processor -- start 2023-10-03T10:18:09.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 -- start start 2023-10-03T10:18:09.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 0x7fb37c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 0x7fb37c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb37c09f520 con 0x7fb37c09e410 2023-10-03T10:18:09.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c09f130 con 0x7fb37c09e000 2023-10-03T10:18:09.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.268+0000 7fb38306e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c09e930 con 0x7fb37c09d6f0 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35418/0 (socket says 172.21.15.19:35418) 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 -- 172.21.15.19:0/3623509123 learned_addr learned my addr 172.21.15.19:0/3623509123 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb37bfff700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 0x7fb37c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb38160b700 1 --2- 172.21.15.19:0/3623509123 >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 0x7fb37c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 -- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 msgr2=0x7fb37c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 0x7fb37c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 -- 172.21.15.19:0/3623509123 >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 msgr2=0x7fb37c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 --2- 172.21.15.19:0/3623509123 >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 0x7fb37c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 -- 172.21.15.19:0/3623509123 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb37c09b2d0 con 0x7fb37c09d6f0 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb38160b700 1 --2- 172.21.15.19:0/3623509123 >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 0x7fb37c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb37bfff700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 0x7fb37c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.269+0000 7fb380e0a700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb37000b9d0 tx=0x7fb37000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d954e08441702338 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.270+0000 7fb37b7fe700 1 -- 172.21.15.19:0/3623509123 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000cc20 con 0x7fb37c09d6f0 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.270+0000 7fb37b7fe700 1 -- 172.21.15.19:0/3623509123 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000cd80 con 0x7fb37c09d6f0 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.270+0000 7fb37b7fe700 1 -- 172.21.15.19:0/3623509123 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000f680 con 0x7fb37c09d6f0 2023-10-03T10:18:09.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 -- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 msgr2=0x7fb37c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb37000b9d0 tx=0x7fb37000bce0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 -- 172.21.15.19:0/3623509123 shutdown_connections 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 --2- 172.21.15.19:0/3623509123 >> v2:172.21.15.19:3300/0 conn(0x7fb37c09e410 0x7fb37c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09d6f0 0x7fb37c09dac0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 --2- 172.21.15.19:0/3623509123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09e000 0x7fb37c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 -- 172.21.15.19:0/3623509123 >> 172.21.15.19:0/3623509123 conn(0x7fb37c066f50 msgr2=0x7fb37c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 -- 172.21.15.19:0/3623509123 shutdown_connections 2023-10-03T10:18:09.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.271+0000 7fb38306e700 1 -- 172.21.15.19:0/3623509123 wait complete. 2023-10-03T10:18:09.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.272+0000 7fb38306e700 1 Processor -- start 2023-10-03T10:18:09.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.272+0000 7fb38306e700 1 -- start start 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09d6f0 0x7fb37c1c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09e000 0x7fb37c1c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c1bf060 con 0x7fb37c09e410 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c09c700 con 0x7fb37c09d6f0 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.273+0000 7fb38306e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c0a1af0 con 0x7fb37c09e000 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45194/0 (socket says 172.21.15.19:45194) 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb37bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09e000 0x7fb37c1c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 -- 172.21.15.19:0/154232339 learned_addr learned my addr 172.21.15.19:0/154232339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb380e0a700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09d6f0 0x7fb37c1c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 -- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09e000 msgr2=0x7fb37c1c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09e000 0x7fb37c1c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 -- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09d6f0 msgr2=0x7fb37c1c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09d6f0 0x7fb37c1c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 -- 172.21.15.19:0/154232339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680094a0 con 0x7fb37c09e410 2023-10-03T10:18:09.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.274+0000 7fb38160b700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e640 tx=0x7fb37400e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.275+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374003c20 con 0x7fb37c09e410 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.275+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37400b070 con 0x7fb37c09e410 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.275+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374004030 con 0x7fb37c09e410 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.276+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37400bc50 con 0x7fb37c09e410 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.276+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37000b600 con 0x7fb37c09e410 2023-10-03T10:18:09.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.277+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c09ddf0 con 0x7fb37c09e410 2023-10-03T10:18:09.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.277+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb374004190 con 0x7fb37c09e410 2023-10-03T10:18:09.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.280+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb374004440 con 0x7fb37c09e410 2023-10-03T10:18:09.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.282+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb374045060 con 0x7fb37c09e410 2023-10-03T10:18:09.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 Processor -- start 2023-10-03T10:18:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 -- start start 2023-10-03T10:18:09.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 0x7fb3ac06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ac070ee0 con 0x7fb3ac09eca0 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac071480 con 0x7fb3ac06ee80 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.305+0000 7fb3b476e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac071b90 con 0x7fb3ac06e570 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b1d09700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb3ac09eca0 0x7fb3ac134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48434/0 (socket says 172.21.15.19:48434) 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b1d09700 1 -- 172.21.15.19:0/1752384669 learned_addr learned my addr 172.21.15.19:0/1752384669 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b250a700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 0x7fb3ac06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b1508700 1 -- 172.21.15.19:0/1752384669 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144847998 0 0) 0x7fb3ac070ee0 con 0x7fb3ac09eca0 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b1508700 1 -- 172.21.15.19:0/1752384669 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3980035b0 con 0x7fb3ac09eca0 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 msgr2=0x7fb3ac06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 0x7fb3ac06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/1752384669 >> v1:172.21.15.19:6789/0 conn(0x7fb3ac09eca0 legacy=0x7fb3ac134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/1752384669 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0711a0 con 0x7fb3ac06ee80 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.306+0000 7fb3b250a700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 0x7fb3ac06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac134d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009dc0 tx=0x7fb3a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19625207a6662a01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b1508700 1 -- 172.21.15.19:0/1752384669 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a400e070 con 0x7fb3ac06ee80 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b1508700 1 -- 172.21.15.19:0/1752384669 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a400bb20 con 0x7fb3ac06ee80 2023-10-03T10:18:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b1508700 1 -- 172.21.15.19:0/1752384669 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4012430 con 0x7fb3ac06ee80 2023-10-03T10:18:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b476e700 1 -- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 msgr2=0x7fb3ac134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.307+0000 7fb3b476e700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac134d20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4009dc0 tx=0x7fb3a400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 -- 172.21.15.19:0/1752384669 shutdown_connections 2023-10-03T10:18:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac134d20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 --2- 172.21.15.19:0/1752384669 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac06e570 0x7fb3ac06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 -- 172.21.15.19:0/1752384669 >> 172.21.15.19:0/1752384669 conn(0x7fb3ac0a2aa0 msgr2=0x7fb3ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 -- 172.21.15.19:0/1752384669 shutdown_connections 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.308+0000 7fb3b476e700 1 -- 172.21.15.19:0/1752384669 wait complete. 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 Processor -- start 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 -- start start 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ac06e570 0x7fb3ac123230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac123770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac124690 con 0x7fb3ac06e570 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac135860 con 0x7fb3ac06ee80 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b476e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ac124f50 con 0x7fb3ac123cb0 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.309+0000 7fb3b2d0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35456/0 (socket says 172.21.15.19:35456) 2023-10-03T10:18:09.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/349107163 learned_addr learned my addr 172.21.15.19:0/349107163 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b250a700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ac06e570 0x7fb3ac123230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 msgr2=0x7fb3ac123770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac123770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ac06e570 msgr2=0x7fb3ac123230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ac06e570 0x7fb3ac123230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 -- 172.21.15.19:0/349107163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4009a70 con 0x7fb3ac123cb0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b2d0b700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4014040 tx=0x7fb3a4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4004960 con 0x7fb3ac123cb0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a4020070 con 0x7fb3ac123cb0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a40276a0 con 0x7fb3ac123cb0 2023-10-03T10:18:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ac126a70 con 0x7fb3ac123cb0 2023-10-03T10:18:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.310+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ac133d50 con 0x7fb3ac123cb0 2023-10-03T10:18:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.311+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3a4012430 con 0x7fb3ac123cb0 2023-10-03T10:18:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.312+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3a4022070 con 0x7fb3ac123cb0 2023-10-03T10:18:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.312+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ac074ea0 con 0x7fb3ac123cb0 2023-10-03T10:18:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.317+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3a401c400 con 0x7fb3ac123cb0 2023-10-03T10:18:09.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 Processor -- start 2023-10-03T10:18:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 -- start start 2023-10-03T10:18:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 0x7f68c813cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c813f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c80992c0 con 0x7f68c809d6f0 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c8099520 con 0x7f68c809e1d0 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68ceb6a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80997e0 con 0x7f68c813d480 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.318+0000 7f68cc906700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f68c809d6f0 0x7f68c809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48446/0 (socket says 172.21.15.19:48446) 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68cc906700 1 -- 172.21.15.19:0/2943413309 learned_addr learned my addr 172.21.15.19:0/2943413309 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:09.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 0x7f68c813cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c77fe700 1 -- 172.21.15.19:0/2943413309 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825114694 0 0) 0x7f68c80992c0 con 0x7f68c809d6f0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c77fe700 1 -- 172.21.15.19:0/2943413309 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b80035b0 con 0x7f68c809d6f0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 -- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 msgr2=0x7f68c813f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c813f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 -- 172.21.15.19:0/2943413309 >> v1:172.21.15.19:6789/0 conn(0x7f68c809d6f0 legacy=0x7f68c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 -- 172.21.15.19:0/2943413309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8099b30 con 0x7f68c809e1d0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.319+0000 7f68c7fff700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 0x7f68c813cf40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009870 tx=0x7f68b4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a1dc8034a1f416 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.320+0000 7f68c77fe700 1 -- 172.21.15.19:0/2943413309 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4011830 con 0x7f68c809e1d0 2023-10-03T10:18:09.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.320+0000 7f68c77fe700 1 -- 172.21.15.19:0/2943413309 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b4011990 con 0x7f68c809e1d0 2023-10-03T10:18:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.320+0000 7f68c77fe700 1 -- 172.21.15.19:0/2943413309 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4011d20 con 0x7f68c809e1d0 2023-10-03T10:18:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.320+0000 7f68ceb6a700 1 -- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 msgr2=0x7f68c813cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.320+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 0x7f68c813cf40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f68b4009870 tx=0x7f68b4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 -- 172.21.15.19:0/2943413309 shutdown_connections 2023-10-03T10:18:09.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c813f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/2943413309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809e1d0 0x7f68c813cf40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 -- 172.21.15.19:0/2943413309 >> 172.21.15.19:0/2943413309 conn(0x7f68c809f470 msgr2=0x7f68c80a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 -- 172.21.15.19:0/2943413309 shutdown_connections 2023-10-03T10:18:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.321+0000 7f68ceb6a700 1 -- 172.21.15.19:0/2943413309 wait complete. 2023-10-03T10:18:09.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 Processor -- start 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 -- start start 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809d6f0 0x7f68c8096cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c806f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c8071dc0 con 0x7f68c809e1d0 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c8071360 con 0x7f68c809d6f0 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.322+0000 7f68ceb6a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80a2040 con 0x7f68c813d480 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68cd107700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c806f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68cd107700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c806f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35464/0 (socket says 172.21.15.19:35464) 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45212/0 (socket says 172.21.15.19:45212) 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68cd107700 1 -- 172.21.15.19:0/786009214 learned_addr learned my addr 172.21.15.19:0/786009214 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 -- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 msgr2=0x7f68c806f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c806f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 -- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809d6f0 msgr2=0x7f68c8096cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809d6f0 0x7f68c8096cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 -- 172.21.15.19:0/786009214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40094a0 con 0x7f68c809e1d0 2023-10-03T10:18:09.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.323+0000 7f68c7fff700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f68c80980b0 tx=0x7f68b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.324+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4004300 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.324+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b401f070 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.324+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40036a0 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.324+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c8098c70 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.324+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c813d200 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.325+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f68b4021030 con 0x7f68c809e1d0 2023-10-03T10:18:09.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.325+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68b40407c0 con 0x7f68c809e1d0 2023-10-03T10:18:09.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.326+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c8090000 con 0x7f68c809e1d0 2023-10-03T10:18:09.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.335+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68b4015020 con 0x7f68c809e1d0 2023-10-03T10:18:09.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.468+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7faa0c11e6d0 con 0x7faa0c1367c0 2023-10-03T10:18:09.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.469+0000 7faa097fa700 1 -- 172.21.15.19:0/2258163540 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faa0c11e6d0 con 0x7faa0c1367c0 2023-10-03T10:18:09.469 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.471+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 msgr2=0x7faa0c11b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.471+0000 7faa12d9c700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c11b2c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9f800e900 tx=0x7fa9f800ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 shutdown_connections 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faa0c1390e0 0x7faa0c11b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa0c133960 0x7faa0c11ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 --2- 172.21.15.19:0/2258163540 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faa0c1367c0 0x7faa0c11b2c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 >> 172.21.15.19:0/2258163540 conn(0x7faa0c0a2610 msgr2=0x7faa0c070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 shutdown_connections 2023-10-03T10:18:09.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.472+0000 7faa12d9c700 1 -- 172.21.15.19:0/2258163540 wait complete. 2023-10-03T10:18:09.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.496+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb37c074ea0 con 0x7fb37c09e410 2023-10-03T10:18:09.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.496+0000 7fb3797fa700 1 -- 172.21.15.19:0/154232339 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb374045070 con 0x7fb37c09e410 2023-10-03T10:18:09.497 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 msgr2=0x7fb37c1cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e640 tx=0x7fb37400e670 comp rx=0 tx=0).stop 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 shutdown_connections 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb37c09e410 0x7fb37c1cc790 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb37c09d6f0 0x7fb37c1c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 --2- 172.21.15.19:0/154232339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb37c09e000 0x7fb37c1c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 >> 172.21.15.19:0/154232339 conn(0x7fb37c066f50 msgr2=0x7fb37c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 shutdown_connections 2023-10-03T10:18:09.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.499+0000 7fb38306e700 1 -- 172.21.15.19:0/154232339 wait complete. 2023-10-03T10:18:09.512 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:09.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.531+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb3ac138630 con 0x7fb3ac123cb0 2023-10-03T10:18:09.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.531+0000 7fb3a2ffd700 1 -- 172.21.15.19:0/349107163 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3a401a380 con 0x7fb3ac123cb0 2023-10-03T10:18:09.531 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:09.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.533+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 msgr2=0x7fb3ac1cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.533+0000 7fb3b476e700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4014040 tx=0x7fb3a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 shutdown_connections 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3ac123cb0 0x7fb3ac1cca00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3ac06e570 0x7fb3ac123230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 --2- 172.21.15.19:0/349107163 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3ac06ee80 0x7fb3ac123770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 >> 172.21.15.19:0/349107163 conn(0x7fb3ac0a2aa0 msgr2=0x7fb3ac134b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 shutdown_connections 2023-10-03T10:18:09.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.534+0000 7fb3b476e700 1 -- 172.21.15.19:0/349107163 wait complete. 2023-10-03T10:18:09.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.545+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f68c80747f0 con 0x7f68c809e1d0 2023-10-03T10:18:09.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.545+0000 7f68c57fa700 1 -- 172.21.15.19:0/786009214 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68b40239c0 con 0x7f68c809e1d0 2023-10-03T10:18:09.545 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:09.547 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 msgr2=0x7f68c806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f68c80980b0 tx=0x7f68b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 shutdown_connections 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68c813d480 0x7f68c806f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68c809d6f0 0x7f68c8096cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 --2- 172.21.15.19:0/786009214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68c809e1d0 0x7f68c806eef0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 >> 172.21.15.19:0/786009214 conn(0x7f68c809f470 msgr2=0x7f68c80a1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 shutdown_connections 2023-10-03T10:18:09.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:09.548+0000 7f68ceb6a700 1 -- 172.21.15.19:0/786009214 wait complete. 2023-10-03T10:18:09.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:10.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:10.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:10.548 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:10.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.652+0000 7ff2a8a1b700 1 Processor -- start 2023-10-03T10:18:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.652+0000 7ff2a8a1b700 1 -- start start 2023-10-03T10:18:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2a41341d0 0x7ff2a409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a4070c80 con 0x7ff2a41341d0 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a409ed20 con 0x7ff2a41338c0 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a8a1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a406f720 con 0x7ff2a409e390 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37928/0 (socket says 172.21.15.19:37928) 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a259c700 1 -- 172.21.15.19:0/368174596 learned_addr learned my addr 172.21.15.19:0/368174596 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a1d9b700 1 --2- 172.21.15.19:0/368174596 >> v2:172.21.15.19:3300/0 conn(0x7ff2a41341d0 0x7ff2a409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.653+0000 7ff2a2d9d700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 -- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 msgr2=0x7ff2a409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 -- 172.21.15.19:0/368174596 >> v2:172.21.15.19:3300/0 conn(0x7ff2a41341d0 msgr2=0x7ff2a409de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 --2- 172.21.15.19:0/368174596 >> v2:172.21.15.19:3300/0 conn(0x7ff2a41341d0 0x7ff2a409de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 -- 172.21.15.19:0/368174596 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a406fce0 con 0x7ff2a41338c0 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a259c700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff294009920 tx=0x7ff294009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d682e0a57acd0cdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a159a700 1 -- 172.21.15.19:0/368174596 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011830 con 0x7ff2a41338c0 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a159a700 1 -- 172.21.15.19:0/368174596 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff294011990 con 0x7ff2a41338c0 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.654+0000 7ff2a159a700 1 -- 172.21.15.19:0/368174596 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294011d20 con 0x7ff2a41338c0 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 msgr2=0x7ff2a4133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff294009920 tx=0x7ff294009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/368174596 shutdown_connections 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41338c0 0x7ff2a4133c90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/368174596 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/368174596 >> v2:172.21.15.19:3300/0 conn(0x7ff2a41341d0 0x7ff2a409de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/368174596 >> 172.21.15.19:0/368174596 conn(0x7ff2a40a2aa0 msgr2=0x7ff2a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/368174596 shutdown_connections 2023-10-03T10:18:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.655+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/368174596 wait complete. 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.657+0000 7ff2a8a1b700 1 Processor -- start 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.657+0000 7ff2a8a1b700 1 -- start start 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2a41338c0 0x7ff2a411efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4120ea0 con 0x7ff2a41338c0 2023-10-03T10:18:10.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a411fef0 con 0x7ff2a41341d0 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a8a1b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4120720 con 0x7ff2a409e390 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37932/0 (socket says 172.21.15.19:37932) 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35476/0 (socket says 172.21.15.19:35476) 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 -- 172.21.15.19:0/2857714515 learned_addr learned my addr 172.21.15.19:0/2857714515 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a1d9b700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2a41338c0 0x7ff2a411efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 -- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 msgr2=0x7ff2a411ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 -- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2a41338c0 msgr2=0x7ff2a411efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2a41338c0 0x7ff2a411efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.658+0000 7ff2a2d9d700 1 -- 172.21.15.19:0/2857714515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009550 con 0x7ff2a41341d0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff2a259c700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff2a2d9d700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00efc0 tx=0x7ff29c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c009ba0 con 0x7ff2a41341d0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c00f040 con 0x7ff2a41341d0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c014480 con 0x7ff2a41341d0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a4122240 con 0x7ff2a41341d0 2023-10-03T10:18:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.659+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a412f520 con 0x7ff2a41341d0 2023-10-03T10:18:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.660+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a4074ea0 con 0x7ff2a41341d0 2023-10-03T10:18:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.661+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff29c0145e0 con 0x7ff2a41341d0 2023-10-03T10:18:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.661+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff29c0404b0 con 0x7ff2a41341d0 2023-10-03T10:18:10.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.670+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff29c007510 con 0x7ff2a41341d0 2023-10-03T10:18:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.697+0000 7fa3ae1a4700 1 Processor -- start 2023-10-03T10:18:10.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.697+0000 7fa3ae1a4700 1 -- start start 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3ae1a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3ae1a4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3a809e000 0x7fa3a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3ae1a4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a809d2f0 con 0x7fa3a8133f30 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3ae1a4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a809a810 con 0x7fa3a809e000 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3ae1a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a809a470 con 0x7fa3a809d6f0 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3a7fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa3a8133f30 0x7fa3a813ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48462/0 (socket says 172.21.15.19:48462) 2023-10-03T10:18:10.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3a7fff700 1 -- 172.21.15.19:0/278357147 learned_addr learned my addr 172.21.15.19:0/278357147 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3a77fe700 1 --2- 172.21.15.19:0/278357147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.698+0000 7fa3a6ffd700 1 --2- 172.21.15.19:0/278357147 >> v2:172.21.15.19:3300/0 conn(0x7fa3a809e000 0x7fa3a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a77fe700 1 -- 172.21.15.19:0/278357147 >> v2:172.21.15.19:3300/0 conn(0x7fa3a809e000 msgr2=0x7fa3a81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a77fe700 1 --2- 172.21.15.19:0/278357147 >> v2:172.21.15.19:3300/0 conn(0x7fa3a809e000 0x7fa3a81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a77fe700 1 -- 172.21.15.19:0/278357147 >> v1:172.21.15.19:6789/0 conn(0x7fa3a8133f30 legacy=0x7fa3a813ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a77fe700 1 -- 172.21.15.19:0/278357147 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a809ec40 con 0x7fa3a809d6f0 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a77fe700 1 --2- 172.21.15.19:0/278357147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a809dac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa398009840 tx=0x7fa398009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b7944f59f7ef85 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a67fc700 1 -- 172.21.15.19:0/278357147 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011830 con 0x7fa3a809d6f0 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a67fc700 1 -- 172.21.15.19:0/278357147 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011990 con 0x7fa3a809d6f0 2023-10-03T10:18:10.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.699+0000 7fa3a67fc700 1 -- 172.21.15.19:0/278357147 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011d20 con 0x7fa3a809d6f0 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/278357147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 msgr2=0x7fa3a809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/278357147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a809dac0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa398009840 tx=0x7fa398009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/278357147 shutdown_connections 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/278357147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a809dac0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/278357147 >> v2:172.21.15.19:3300/0 conn(0x7fa3a809e000 0x7fa3a81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/278357147 >> 172.21.15.19:0/278357147 conn(0x7fa3a8066f50 msgr2=0x7fa3a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/278357147 shutdown_connections 2023-10-03T10:18:10.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.700+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/278357147 wait complete. 2023-10-03T10:18:10.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.702+0000 7fa3ae1a4700 1 Processor -- start 2023-10-03T10:18:10.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.702+0000 7fa3ae1a4700 1 -- start start 2023-10-03T10:18:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 0x7fa3a811f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a809c640 con 0x7fa3a8133f30 2023-10-03T10:18:10.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81205a0 con 0x7fa3a809e000 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3ae1a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a809a0c0 con 0x7fa3a809d6f0 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3a6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3a6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37948/0 (socket says 172.21.15.19:37948) 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3a6ffd700 1 -- 172.21.15.19:0/452245664 learned_addr learned my addr 172.21.15.19:0/452245664 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3a7fff700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 0x7fa3a811f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.703+0000 7fa3a77fe700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 -- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 msgr2=0x7fa3a811e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a811e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 -- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 msgr2=0x7fa3a811f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 0x7fa3a811f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 -- 172.21.15.19:0/452245664 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3980094a0 con 0x7fa3a809e000 2023-10-03T10:18:10.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a77fe700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a7fff700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 0x7fa3a811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3a6ffd700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e980 tx=0x7fa39c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c009710 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c00c690 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c00ca20 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a8133780 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.704+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a81332c0 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.705+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a8074ea0 con 0x7fa3a809e000 2023-10-03T10:18:10.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.705+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa39c00cb80 con 0x7fa3a809e000 2023-10-03T10:18:10.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.706+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa39c03f6b0 con 0x7fa3a809e000 2023-10-03T10:18:10.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.714+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa39c0232f0 con 0x7fa3a809e000 2023-10-03T10:18:10.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.729+0000 7f9264491700 1 Processor -- start 2023-10-03T10:18:10.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.729+0000 7f9264491700 1 -- start start 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9264491700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9264491700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9264491700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c09f130 con 0x7f925c09e410 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9264491700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c09f520 con 0x7f925c09d6f0 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9264491700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f925c09e930 con 0x7f925c09e000 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f926222d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9261a2c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9262a2e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f925c09e410 0x7f925c130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48468/0 (socket says 172.21.15.19:48468) 2023-10-03T10:18:10.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9262a2e700 1 -- 172.21.15.19:0/2741433134 learned_addr learned my addr 172.21.15.19:0/2741433134 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9261a2c700 1 -- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 msgr2=0x7f925c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9261a2c700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.730+0000 7f9261a2c700 1 -- 172.21.15.19:0/2741433134 >> v1:172.21.15.19:6789/0 conn(0x7f925c09e410 legacy=0x7f925c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f9261a2c700 1 -- 172.21.15.19:0/2741433134 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c09b2d0 con 0x7f925c09e000 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f926222d700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f9261a2c700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c130660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f924c0098a0 tx=0x7f924c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1183175724d697c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f926122b700 1 -- 172.21.15.19:0/2741433134 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c011830 con 0x7f925c09e000 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f926122b700 1 -- 172.21.15.19:0/2741433134 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924c011990 con 0x7f925c09e000 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.731+0000 7f926122b700 1 -- 172.21.15.19:0/2741433134 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924c011d20 con 0x7f925c09e000 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 -- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 msgr2=0x7f925c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c130660 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f924c0098a0 tx=0x7f924c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 -- 172.21.15.19:0/2741433134 shutdown_connections 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 --2- 172.21.15.19:0/2741433134 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c130660 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 -- 172.21.15.19:0/2741433134 >> 172.21.15.19:0/2741433134 conn(0x7f925c066f50 msgr2=0x7f925c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 -- 172.21.15.19:0/2741433134 shutdown_connections 2023-10-03T10:18:10.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.732+0000 7f9264491700 1 -- 172.21.15.19:0/2741433134 wait complete. 2023-10-03T10:18:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.733+0000 7f9264491700 1 Processor -- start 2023-10-03T10:18:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.733+0000 7f9264491700 1 -- start start 2023-10-03T10:18:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c120770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925c09e410 0x7f925c120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c123d50 con 0x7f925c09e410 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c121e40 con 0x7f925c09d6f0 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9264491700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0a2030 con 0x7f925c09e000 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37954/0 (socket says 172.21.15.19:37954) 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 -- 172.21.15.19:0/2761300281 learned_addr learned my addr 172.21.15.19:0/2761300281 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9261a2c700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c120770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f9262a2e700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925c09e410 0x7f925c120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 -- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 msgr2=0x7f925c120770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c120770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 -- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925c09e410 msgr2=0x7f925c120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925c09e410 0x7f925c120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.734+0000 7f926222d700 1 -- 172.21.15.19:0/2761300281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580094a0 con 0x7f925c09d6f0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f926222d700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f925800ebe0 tx=0x7f925800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800c850 con 0x7f925c09d6f0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800c9b0 con 0x7f925c09d6f0 2023-10-03T10:18:10.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800cd40 con 0x7f925c09d6f0 2023-10-03T10:18:10.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c0094a0 con 0x7f925c09d6f0 2023-10-03T10:18:10.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.735+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c130170 con 0x7f925c09d6f0 2023-10-03T10:18:10.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.736+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9258013470 con 0x7f925c09d6f0 2023-10-03T10:18:10.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.736+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c1238f0 con 0x7f925c09d6f0 2023-10-03T10:18:10.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.737+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f925803fb10 con 0x7f925c09d6f0 2023-10-03T10:18:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 Processor -- start 2023-10-03T10:18:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 -- start start 2023-10-03T10:18:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5c5809d6f0 0x7f5c5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 0x7f5c58130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c5809f130 con 0x7f5c5809e000 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c5809f520 con 0x7f5c5809d6f0 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c5df75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5809e930 con 0x7f5c5809e410 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c56ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5c5809e000 0x7f5c58130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48472/0 (socket says 172.21.15.19:48472) 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.740+0000 7f5c56ffd700 1 -- 172.21.15.19:0/1044896694 learned_addr learned my addr 172.21.15.19:0/1044896694 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c577fe700 1 --2- 172.21.15.19:0/1044896694 >> v2:172.21.15.19:3300/0 conn(0x7f5c5809d6f0 0x7f5c5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 --2- 172.21.15.19:0/1044896694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 0x7f5c58130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052230941 0 0) 0x7f5c5809f130 con 0x7f5c5809e000 2023-10-03T10:18:10.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c400035b0 con 0x7f5c5809e000 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142442942 0 0) 0x7f5c400035b0 con 0x7f5c5809e000 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 -- 172.21.15.19:0/1044896694 >> v2:172.21.15.19:3300/0 conn(0x7f5c5809d6f0 msgr2=0x7f5c5809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 --2- 172.21.15.19:0/1044896694 >> v2:172.21.15.19:3300/0 conn(0x7f5c5809d6f0 0x7f5c5809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 -- 172.21.15.19:0/1044896694 >> v1:172.21.15.19:6789/0 conn(0x7f5c5809e000 legacy=0x7f5c58130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 -- 172.21.15.19:0/1044896694 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5809b2d0 con 0x7f5c5809e410 2023-10-03T10:18:10.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.741+0000 7f5c57fff700 1 --2- 172.21.15.19:0/1044896694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 0x7f5c58130d70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009d90 tx=0x7f5c5000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48468e0c7f16c5d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000e070 con 0x7f5c5809e410 2023-10-03T10:18:10.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50003a20 con 0x7f5c5809e410 2023-10-03T10:18:10.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f5c567fc700 1 -- 172.21.15.19:0/1044896694 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c001670 con 0x7f5c5809e410 2023-10-03T10:18:10.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9258013720 con 0x7f925c09d6f0 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f5c5df75700 1 -- 172.21.15.19:0/1044896694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 msgr2=0x7f5c58130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.746+0000 7f5c5df75700 1 --2- 172.21.15.19:0/1044896694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 0x7f5c58130d70 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009d90 tx=0x7f5c5000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 -- 172.21.15.19:0/1044896694 shutdown_connections 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 --2- 172.21.15.19:0/1044896694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809e410 0x7f5c58130d70 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 --2- 172.21.15.19:0/1044896694 >> v2:172.21.15.19:3300/0 conn(0x7f5c5809d6f0 0x7f5c5809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 -- 172.21.15.19:0/1044896694 >> 172.21.15.19:0/1044896694 conn(0x7f5c58066f50 msgr2=0x7f5c5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 -- 172.21.15.19:0/1044896694 shutdown_connections 2023-10-03T10:18:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.747+0000 7f5c5df75700 1 -- 172.21.15.19:0/1044896694 wait complete. 2023-10-03T10:18:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.748+0000 7f5c5df75700 1 Processor -- start 2023-10-03T10:18:10.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.748+0000 7f5c5df75700 1 -- start start 2023-10-03T10:18:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c5809e000 0x7f5c5811e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c5809e410 0x7f5c5811e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58121040 con 0x7f5c5809e410 2023-10-03T10:18:10.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c58120b10 con 0x7f5c5809d6f0 2023-10-03T10:18:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c5df75700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5811f960 con 0x7f5c5809e000 2023-10-03T10:18:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37964/0 (socket says 172.21.15.19:37964) 2023-10-03T10:18:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.749+0000 7f5c577fe700 1 -- 172.21.15.19:0/3429022675 learned_addr learned my addr 172.21.15.19:0/3429022675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c56ffd700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c5809e000 0x7f5c5811e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 -- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c5809e000 msgr2=0x7f5c5811e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c5809e000 0x7f5c5811e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 -- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c5809e410 msgr2=0x7f5c5811e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c5809e410 0x7f5c5811e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 -- 172.21.15.19:0/3429022675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c50009a70 con 0x7f5c5809d6f0 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c577fe700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e9e0 tx=0x7f5c4800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c48009710 con 0x7f5c5809d6f0 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c48017c60 con 0x7f5c5809d6f0 2023-10-03T10:18:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.750+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4800c640 con 0x7f5c5809d6f0 2023-10-03T10:18:10.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.751+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c581214f0 con 0x7f5c5809d6f0 2023-10-03T10:18:10.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.751+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c5809c700 con 0x7f5c5809d6f0 2023-10-03T10:18:10.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.753+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5811ac20 con 0x7f5c5809d6f0 2023-10-03T10:18:10.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.753+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5c4800c7a0 con 0x7f5c5809d6f0 2023-10-03T10:18:10.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.754+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5c48047e30 con 0x7f5c5809d6f0 2023-10-03T10:18:10.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.762+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5c4801e580 con 0x7f5c5809d6f0 2023-10-03T10:18:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.893+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2a4122580 con 0x7ff2a41341d0 2023-10-03T10:18:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.893+0000 7ff292ffd700 1 -- 172.21.15.19:0/2857714515 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff29c02b090 con 0x7ff2a41341d0 2023-10-03T10:18:10.893 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 msgr2=0x7ff2a411f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00efc0 tx=0x7ff29c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 shutdown_connections 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2a41341d0 0x7ff2a411f510 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2a409e390 0x7ff2a411ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 --2- 172.21.15.19:0/2857714515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2a41338c0 0x7ff2a411efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 >> 172.21.15.19:0/2857714515 conn(0x7ff2a40a2aa0 msgr2=0x7ff2a409ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 shutdown_connections 2023-10-03T10:18:10.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.897+0000 7ff2a8a1b700 1 -- 172.21.15.19:0/2857714515 wait complete. 2023-10-03T10:18:10.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.943+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa3a8121eb0 con 0x7fa3a809e000 2023-10-03T10:18:10.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.944+0000 7fa38ffff700 1 -- 172.21.15.19:0/452245664 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa3a8121eb0 con 0x7fa3a809e000 2023-10-03T10:18:10.943 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:10.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.947+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 msgr2=0x7fa3a811ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.947+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00e980 tx=0x7fa39c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 shutdown_connections 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a8133f30 0x7fa3a811f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a809d6f0 0x7fa3a811e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 --2- 172.21.15.19:0/452245664 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a809e000 0x7fa3a811ed50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 >> 172.21.15.19:0/452245664 conn(0x7fa3a8066f50 msgr2=0x7fa3a806ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 shutdown_connections 2023-10-03T10:18:10.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.948+0000 7fa3ae1a4700 1 -- 172.21.15.19:0/452245664 wait complete. 2023-10-03T10:18:10.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.960+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f925c074ea0 con 0x7f925c09d6f0 2023-10-03T10:18:10.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.960+0000 7f9252ffd700 1 -- 172.21.15.19:0/2761300281 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9258011960 con 0x7f925c09d6f0 2023-10-03T10:18:10.960 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:10.962 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 msgr2=0x7f925c120230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f925800ebe0 tx=0x7f925800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 shutdown_connections 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925c09e410 0x7f925c120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925c09d6f0 0x7f925c120230 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 --2- 172.21.15.19:0/2761300281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925c09e000 0x7f925c120770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 >> 172.21.15.19:0/2761300281 conn(0x7f925c066f50 msgr2=0x7f925c06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 shutdown_connections 2023-10-03T10:18:10.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.963+0000 7f9264491700 1 -- 172.21.15.19:0/2761300281 wait complete. 2023-10-03T10:18:10.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.969+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c58074ea0 con 0x7f5c5809d6f0 2023-10-03T10:18:10.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.970+0000 7f5c3ffff700 1 -- 172.21.15.19:0/3429022675 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5c48024030 con 0x7f5c5809d6f0 2023-10-03T10:18:10.970 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 msgr2=0x7f5c5811dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5c4800e9e0 tx=0x7f5c4800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 shutdown_connections 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5c5809e410 0x7f5c5811e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5c5809d6f0 0x7f5c5811dcb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 --2- 172.21.15.19:0/3429022675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5c5809e000 0x7f5c5811e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:10.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 >> 172.21.15.19:0/3429022675 conn(0x7f5c58066f50 msgr2=0x7f5c581309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 shutdown_connections 2023-10-03T10:18:10.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:10.972+0000 7f5c5df75700 1 -- 172.21.15.19:0/3429022675 wait complete. 2023-10-03T10:18:10.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:10.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:11.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:11.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:11.977 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:11.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.080+0000 7f49f4424700 1 Processor -- start 2023-10-03T10:18:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.080+0000 7f49f4424700 1 -- start start 2023-10-03T10:18:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.081+0000 7f49f4424700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.081+0000 7f49f4424700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.081+0000 7f49f4424700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ec0716a0 con 0x7f49ec130540 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.081+0000 7f49f4424700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec071290 con 0x7f49ec133540 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.081+0000 7f49f4424700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec130340 con 0x7f49ec135e60 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f19bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f19bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37978/0 (socket says 172.21.15.19:37978) 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f21c0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f49ec130540 0x7f49ec130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48482/0 (socket says 172.21.15.19:48482) 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f19bf700 1 -- 172.21.15.19:0/2125888243 learned_addr learned my addr 172.21.15.19:0/2125888243 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 -- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 msgr2=0x7f49ec135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 -- 172.21.15.19:0/2125888243 >> v1:172.21.15.19:6789/0 conn(0x7f49ec130540 legacy=0x7f49ec130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 -- 172.21.15.19:0/2125888243 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ec070b80 con 0x7f49ec135e60 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f11be700 1 -- 172.21.15.19:0/2125888243 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492675363 0 0) 0x7f49ec0716a0 con 0x7f49ec130540 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f19bf700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.082+0000 7f49f29c1700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec138240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009dc0 tx=0x7f49e400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f170ce3286c83c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.083+0000 7f49f11be700 1 -- 172.21.15.19:0/2125888243 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e400e070 con 0x7f49ec135e60 2023-10-03T10:18:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.083+0000 7f49f11be700 1 -- 172.21.15.19:0/2125888243 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e400bb20 con 0x7f49ec135e60 2023-10-03T10:18:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.083+0000 7f49f11be700 1 -- 172.21.15.19:0/2125888243 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4012430 con 0x7f49ec135e60 2023-10-03T10:18:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 -- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 msgr2=0x7f49ec138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec138240 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f49e4009dc0 tx=0x7f49e400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 -- 172.21.15.19:0/2125888243 shutdown_connections 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec138240 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 --2- 172.21.15.19:0/2125888243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec133540 0x7f49ec135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 -- 172.21.15.19:0/2125888243 >> 172.21.15.19:0/2125888243 conn(0x7f49ec0a2aa0 msgr2=0x7f49ec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 -- 172.21.15.19:0/2125888243 shutdown_connections 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.084+0000 7f49f4424700 1 -- 172.21.15.19:0/2125888243 wait complete. 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 Processor -- start 2023-10-03T10:18:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 -- start start 2023-10-03T10:18:12.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49ec133540 0x7f49ec09ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec09cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec09e0f0 con 0x7f49ec133540 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec119a00 con 0x7f49ec130540 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.085+0000 7f49f4424700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec118f80 con 0x7f49ec135e60 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37982/0 (socket says 172.21.15.19:37982) 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 -- 172.21.15.19:0/577707812 learned_addr learned my addr 172.21.15.19:0/577707812 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f29c1700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec09cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f19bf700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49ec133540 0x7f49ec09ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 -- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 msgr2=0x7f49ec09cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec09cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 -- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49ec133540 msgr2=0x7f49ec09ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49ec133540 0x7f49ec09ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 -- 172.21.15.19:0/577707812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc00da00 con 0x7f49ec130540 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.086+0000 7f49f21c0700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f49e800c550 tx=0x7f49e800c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.087+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8004c80 con 0x7f49ec130540 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.087+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8004de0 con 0x7f49ec130540 2023-10-03T10:18:12.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.087+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8007310 con 0x7f49ec130540 2023-10-03T10:18:12.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.087+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e4009a70 con 0x7f49ec130540 2023-10-03T10:18:12.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.087+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec135930 con 0x7f49ec130540 2023-10-03T10:18:12.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.088+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49e8007470 con 0x7f49ec130540 2023-10-03T10:18:12.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.089+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49e803f2f0 con 0x7f49ec130540 2023-10-03T10:18:12.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.089+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec071940 con 0x7f49ec130540 2023-10-03T10:18:12.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.094+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49e80123b0 con 0x7f49ec130540 2023-10-03T10:18:12.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.115+0000 7ff5a8d58700 1 Processor -- start 2023-10-03T10:18:12.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.115+0000 7ff5a8d58700 1 -- start start 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.116+0000 7ff5a8d58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.116+0000 7ff5a8d58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.116+0000 7ff5a8d58700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a406f720 con 0x7ff5a409e390 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.116+0000 7ff5a8d58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4070c80 con 0x7ff5a41338c0 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.116+0000 7ff5a8d58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a406fce0 con 0x7ff5a41341d0 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35544/0 (socket says 172.21.15.19:35544) 2023-10-03T10:18:12.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 -- 172.21.15.19:0/1055734940 learned_addr learned my addr 172.21.15.19:0/1055734940 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a259c700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 -- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 msgr2=0x7ff5a4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 -- 172.21.15.19:0/1055734940 >> v1:172.21.15.19:6789/0 conn(0x7ff5a409e390 legacy=0x7ff5a413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 -- 172.21.15.19:0/1055734940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a41336a0 con 0x7ff5a41341d0 2023-10-03T10:18:12.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.117+0000 7ff5a1d9b700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff598009920 tx=0x7ff598009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3c45f0013979c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a159a700 1 -- 172.21.15.19:0/1055734940 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598011830 con 0x7ff5a41341d0 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a159a700 1 -- 172.21.15.19:0/1055734940 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff598011990 con 0x7ff5a41341d0 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a159a700 1 -- 172.21.15.19:0/1055734940 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff598011d20 con 0x7ff5a41341d0 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a8d58700 1 -- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 msgr2=0x7ff5a409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff598009920 tx=0x7ff598009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a8d58700 1 -- 172.21.15.19:0/1055734940 shutdown_connections 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.118+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/1055734940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a41341d0 0x7ff5a409de50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.119+0000 7ff5a8d58700 1 -- 172.21.15.19:0/1055734940 >> 172.21.15.19:0/1055734940 conn(0x7ff5a40a2aa0 msgr2=0x7ff5a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.119+0000 7ff5a8d58700 1 -- 172.21.15.19:0/1055734940 shutdown_connections 2023-10-03T10:18:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.119+0000 7ff5a8d58700 1 -- 172.21.15.19:0/1055734940 wait complete. 2023-10-03T10:18:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.120+0000 7ff5a8d58700 1 Processor -- start 2023-10-03T10:18:12.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.120+0000 7ff5a8d58700 1 -- start start 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 0x7ff5a4123840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 0x7ff5a41242c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4127d80 con 0x7ff5a41341d0 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a4126aa0 con 0x7ff5a41338c0 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a8d58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a41321f0 con 0x7ff5a409e390 2023-10-03T10:18:12.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38008/0 (socket says 172.21.15.19:38008) 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a1d9b700 1 -- 172.21.15.19:0/2104627246 learned_addr learned my addr 172.21.15.19:0/2104627246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a259c700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 0x7ff5a4123840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.121+0000 7ff5a2d9d700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 0x7ff5a41242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 -- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 msgr2=0x7ff5a4123d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 -- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 msgr2=0x7ff5a41242c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 0x7ff5a41242c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 -- 172.21.15.19:0/2104627246 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598009550 con 0x7ff5a409e390 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a1d9b700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a2d9d700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 0x7ff5a41242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:12.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a259c700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 0x7ff5a4123840 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e900 tx=0x7ff59400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594013680 con 0x7ff5a409e390 2023-10-03T10:18:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5940137e0 con 0x7ff5a409e390 2023-10-03T10:18:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a406f960 con 0x7ff5a409e390 2023-10-03T10:18:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594013b50 con 0x7ff5a409e390 2023-10-03T10:18:12.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.122+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41277d0 con 0x7ff5a409e390 2023-10-03T10:18:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.123+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff594013cb0 con 0x7ff5a409e390 2023-10-03T10:18:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.123+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4126cc0 con 0x7ff5a409e390 2023-10-03T10:18:12.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.124+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff59403f710 con 0x7ff5a409e390 2023-10-03T10:18:12.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.133+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff59401be10 con 0x7ff5a409e390 2023-10-03T10:18:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.159+0000 7f567a00b700 1 Processor -- start 2023-10-03T10:18:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.159+0000 7f567a00b700 1 -- start start 2023-10-03T10:18:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.159+0000 7f567a00b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 0x7f5674138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.159+0000 7f567a00b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f567413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f567a00b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567409b120 con 0x7f567409d6f0 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f567a00b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567406b460 con 0x7f567409e1d0 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f567a00b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f567409a7e0 con 0x7f5674139170 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f56737fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f567409d6f0 0x7f567409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48508/0 (socket says 172.21.15.19:48508) 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f56737fe700 1 -- 172.21.15.19:0/2499305564 learned_addr learned my addr 172.21.15.19:0/2499305564 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:12.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 0x7f5674138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 -- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 msgr2=0x7f567413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 --2- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f567413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f56727fc700 1 -- 172.21.15.19:0/2499305564 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476416229 0 0) 0x7f567409b120 con 0x7f567409d6f0 2023-10-03T10:18:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 -- 172.21.15.19:0/2499305564 >> v1:172.21.15.19:6789/0 conn(0x7f567409d6f0 legacy=0x7f567409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 -- 172.21.15.19:0/2499305564 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567409a500 con 0x7f567409e1d0 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.160+0000 7f5672ffd700 1 --2- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 0x7f5674138c30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5668009870 tx=0x7f5668009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6c8c7a4144c3cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f56727fc700 1 -- 172.21.15.19:0/2499305564 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011830 con 0x7f567409e1d0 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f56727fc700 1 -- 172.21.15.19:0/2499305564 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5668011990 con 0x7f567409e1d0 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f56727fc700 1 -- 172.21.15.19:0/2499305564 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668011d20 con 0x7f567409e1d0 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 -- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 msgr2=0x7f5674138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 --2- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 0x7f5674138c30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5668009870 tx=0x7f5668009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 -- 172.21.15.19:0/2499305564 shutdown_connections 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 --2- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f567413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 --2- 172.21.15.19:0/2499305564 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409e1d0 0x7f5674138c30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 -- 172.21.15.19:0/2499305564 >> 172.21.15.19:0/2499305564 conn(0x7f5674066f50 msgr2=0x7f567409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 -- 172.21.15.19:0/2499305564 shutdown_connections 2023-10-03T10:18:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.161+0000 7f567a00b700 1 -- 172.21.15.19:0/2499305564 wait complete. 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.162+0000 7f567a00b700 1 Processor -- start 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 -- start start 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567409e1d0 0x7f5674121cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f56741221f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56741252f0 con 0x7f567409e1d0 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567409c710 con 0x7f567409d6f0 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f567a00b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5674124cb0 con 0x7f5674139170 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f56737fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f5672ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567409e1d0 0x7f5674121cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f56737fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38036/0 (socket says 172.21.15.19:38036) 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f56737fe700 1 -- 172.21.15.19:0/392649751 learned_addr learned my addr 172.21.15.19:0/392649751 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.163+0000 7f5673fff700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f56741221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 -- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 msgr2=0x7f56741221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f56741221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 -- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567409e1d0 msgr2=0x7f5674121cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567409e1d0 0x7f5674121cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 -- 172.21.15.19:0/392649751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680094a0 con 0x7f567409d6f0 2023-10-03T10:18:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f56737fe700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f566400c550 tx=0x7f566400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664004c80 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664004e00 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674123450 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5664007310 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.164+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5674137650 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.165+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5664007470 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.165+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f566403f410 con 0x7f567409d6f0 2023-10-03T10:18:12.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.166+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56740a3c00 con 0x7f567409d6f0 2023-10-03T10:18:12.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.171+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56740a3c00 con 0x7f567409d6f0 2023-10-03T10:18:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.184+0000 7f7065bfe700 1 Processor -- start 2023-10-03T10:18:12.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.184+0000 7f7065bfe700 1 -- start start 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f7065bfe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f7065bfe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7060134ec0 0x7f70601379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f7065bfe700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7060134980 con 0x7f7060137f20 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f7065bfe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706006c4b0 con 0x7f7060134ec0 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f7065bfe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70600a09c0 con 0x7f706006c0e0 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38038/0 (socket says 172.21.15.19:38038) 2023-10-03T10:18:12.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f705f7fe700 1 -- 172.21.15.19:0/3419210466 learned_addr learned my addr 172.21.15.19:0/3419210466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f705effd700 1 --2- 172.21.15.19:0/3419210466 >> v2:172.21.15.19:3300/0 conn(0x7f7060134ec0 0x7f70601379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.185+0000 7f705e7fc700 1 -- 172.21.15.19:0/3419210466 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3422677644 0 0) 0x7f7060134980 con 0x7f7060137f20 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705e7fc700 1 -- 172.21.15.19:0/3419210466 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70480035b0 con 0x7f7060137f20 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705f7fe700 1 -- 172.21.15.19:0/3419210466 >> v2:172.21.15.19:3300/0 conn(0x7f7060134ec0 msgr2=0x7f70601379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705f7fe700 1 --2- 172.21.15.19:0/3419210466 >> v2:172.21.15.19:3300/0 conn(0x7f7060134ec0 0x7f70601379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705f7fe700 1 -- 172.21.15.19:0/3419210466 >> v1:172.21.15.19:6789/0 conn(0x7f7060137f20 legacy=0x7f706013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705f7fe700 1 -- 172.21.15.19:0/3419210466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70600a0600 con 0x7f706006c0e0 2023-10-03T10:18:12.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705f7fe700 1 --2- 172.21.15.19:0/3419210466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f7050009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7afd8c634c5588d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705e7fc700 1 -- 172.21.15.19:0/3419210466 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011830 con 0x7f706006c0e0 2023-10-03T10:18:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705e7fc700 1 -- 172.21.15.19:0/3419210466 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7050011990 con 0x7f706006c0e0 2023-10-03T10:18:12.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.186+0000 7f705e7fc700 1 -- 172.21.15.19:0/3419210466 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050011d20 con 0x7f706006c0e0 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 -- 172.21.15.19:0/3419210466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 msgr2=0x7f706009ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 --2- 172.21.15.19:0/3419210466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f7050009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 -- 172.21.15.19:0/3419210466 shutdown_connections 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 --2- 172.21.15.19:0/3419210466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f706009ac90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 --2- 172.21.15.19:0/3419210466 >> v2:172.21.15.19:3300/0 conn(0x7f7060134ec0 0x7f70601379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 -- 172.21.15.19:0/3419210466 >> 172.21.15.19:0/3419210466 conn(0x7f70600a4210 msgr2=0x7f70600a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 -- 172.21.15.19:0/3419210466 shutdown_connections 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.187+0000 7f7065bfe700 1 -- 172.21.15.19:0/3419210466 wait complete. 2023-10-03T10:18:12.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.188+0000 7f7065bfe700 1 Processor -- start 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.188+0000 7f7065bfe700 1 -- start start 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7060134ec0 0x7f70601cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7060137f20 0x7f706011a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70600a03f0 con 0x7f7060137f20 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706011d970 con 0x7f706006c0e0 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f7065bfe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7060133df0 con 0x7f7060134ec0 2023-10-03T10:18:12.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38040/0 (socket says 172.21.15.19:38040) 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 -- 172.21.15.19:0/1556656249 learned_addr learned my addr 172.21.15.19:0/1556656249 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705effd700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7060134ec0 0x7f70601cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705ffff700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7060137f20 0x7f706011a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 -- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7060134ec0 msgr2=0x7f70601cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7060134ec0 0x7f70601cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 -- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7060137f20 msgr2=0x7f706011a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7060137f20 0x7f706011a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.189+0000 7f705f7fe700 1 -- 172.21.15.19:0/1556656249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7050009550 con 0x7f706006c0e0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f705f7fe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7050009c40 tx=0x7f7050004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7050004300 con 0x7f706006c0e0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705001e070 con 0x7f706006c0e0 2023-10-03T10:18:12.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70601272a0 con 0x7f706006c0e0 2023-10-03T10:18:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70500036a0 con 0x7f706006c0e0 2023-10-03T10:18:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.190+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70601cd7d0 con 0x7f706006c0e0 2023-10-03T10:18:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.191+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7050020030 con 0x7f706006c0e0 2023-10-03T10:18:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.191+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70500402e0 con 0x7f706006c0e0 2023-10-03T10:18:12.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.192+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706011de70 con 0x7f706006c0e0 2023-10-03T10:18:12.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.197+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f706011de70 con 0x7f706006c0e0 2023-10-03T10:18:12.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.386+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5a4074ea0 con 0x7ff5a409e390 2023-10-03T10:18:12.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.387+0000 7ff592ffd700 1 -- 172.21.15.19:0/2104627246 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff59401b3b0 con 0x7ff5a409e390 2023-10-03T10:18:12.386 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 msgr2=0x7ff5a4123840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 0x7ff5a4123840 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff59400e900 tx=0x7ff59400ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 shutdown_connections 2023-10-03T10:18:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5a41341d0 0x7ff5a41242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5a409e390 0x7ff5a4123840 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 --2- 172.21.15.19:0/2104627246 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5a41338c0 0x7ff5a4123d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 >> 172.21.15.19:0/2104627246 conn(0x7ff5a40a2aa0 msgr2=0x7ff5a40a18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 shutdown_connections 2023-10-03T10:18:12.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.389+0000 7ff5a8d58700 1 -- 172.21.15.19:0/2104627246 wait complete. 2023-10-03T10:18:12.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.396+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49ec074ea0 con 0x7f49ec130540 2023-10-03T10:18:12.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.396+0000 7f49e2ffd700 1 -- 172.21.15.19:0/577707812 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49e8011360 con 0x7f49ec130540 2023-10-03T10:18:12.396 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 msgr2=0x7f49ec09c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f49e800c550 tx=0x7f49e800c860 comp rx=0 tx=0).stop 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 shutdown_connections 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49ec135e60 0x7f49ec09cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49ec130540 0x7f49ec09c530 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 --2- 172.21.15.19:0/577707812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49ec133540 0x7f49ec09ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 >> 172.21.15.19:0/577707812 conn(0x7f49ec0a2aa0 msgr2=0x7f49ec0a0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 shutdown_connections 2023-10-03T10:18:12.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.400+0000 7f49f4424700 1 -- 172.21.15.19:0/577707812 wait complete. 2023-10-03T10:18:12.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:12.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:12.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.436+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f56740a3c00 con 0x7f567409d6f0 2023-10-03T10:18:12.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.436+0000 7f565bfff700 1 -- 172.21.15.19:0/392649751 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56740a3c00 con 0x7f567409d6f0 2023-10-03T10:18:12.436 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.438+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 msgr2=0x7f5674121770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.438+0000 7f567a00b700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f566400c550 tx=0x7f566400c860 comp rx=0 tx=0).stop 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.438+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 shutdown_connections 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5674139170 0x7f56741221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f567409d6f0 0x7f5674121770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 --2- 172.21.15.19:0/392649751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f567409e1d0 0x7f5674121cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 >> 172.21.15.19:0/392649751 conn(0x7f5674066f50 msgr2=0x7f5674070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 shutdown_connections 2023-10-03T10:18:12.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.439+0000 7f567a00b700 1 -- 172.21.15.19:0/392649751 wait complete. 2023-10-03T10:18:12.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.452+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f706011de70 con 0x7f706006c0e0 2023-10-03T10:18:12.452 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:12.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.452+0000 7f7047fff700 1 -- 172.21.15.19:0/1556656249 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f706011de70 con 0x7f706006c0e0 2023-10-03T10:18:12.453 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.454+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 msgr2=0x7f70601ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f7050009c40 tx=0x7f7050004750 comp rx=0 tx=0).stop 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 shutdown_connections 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7060137f20 0x7f706011a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f706006c0e0 0x7f70601ccd50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 --2- 172.21.15.19:0/1556656249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7060134ec0 0x7f70601cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 >> 172.21.15.19:0/1556656249 conn(0x7f70600a4210 msgr2=0x7f706006c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 shutdown_connections 2023-10-03T10:18:12.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:12.455+0000 7f7065bfe700 1 -- 172.21.15.19:0/1556656249 wait complete. 2023-10-03T10:18:12.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:13.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:13.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:13.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:13.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:13.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 Processor -- start 2023-10-03T10:18:13.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 -- start start 2023-10-03T10:18:13.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 0x7f422c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f422c09e410 0x7f422c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c09f130 con 0x7f422c09e000 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422c09f520 con 0x7f422c09e410 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.561+0000 7f42326ff700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422c09e930 con 0x7f422c09d6f0 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f422b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f422c09e000 0x7f422c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48528/0 (socket says 172.21.15.19:48528) 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f422c09e410 0x7f422c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f422b7fe700 1 -- 172.21.15.19:0/3596781868 learned_addr learned my addr 172.21.15.19:0/3596781868 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f422bfff700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 0x7f422c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f422affd700 1 -- 172.21.15.19:0/3596781868 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469643362 0 0) 0x7f422c09f130 con 0x7f422c09e000 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 -- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 msgr2=0x7f422c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 0x7f422c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 -- 172.21.15.19:0/3596781868 >> v1:172.21.15.19:6789/0 conn(0x7f422c09e000 legacy=0x7f422c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 -- 172.21.15.19:0/3596781868 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c09b2d0 con 0x7f422c09e410 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f422bfff700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 0x7f422c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.562+0000 7f4230c9c700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c130d70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4224009dc0 tx=0x7f422400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd73fbc61d6130ff server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f422affd700 1 -- 172.21.15.19:0/3596781868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400e070 con 0x7f422c09e410 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f422affd700 1 -- 172.21.15.19:0/3596781868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400bb90 con 0x7f422c09e410 2023-10-03T10:18:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f422affd700 1 -- 172.21.15.19:0/3596781868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224012430 con 0x7f422c09e410 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 -- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 msgr2=0x7f422c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c130d70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4224009dc0 tx=0x7f422400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 -- 172.21.15.19:0/3596781868 shutdown_connections 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c130d70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 --2- 172.21.15.19:0/3596781868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09d6f0 0x7f422c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.563+0000 7f42326ff700 1 -- 172.21.15.19:0/3596781868 >> 172.21.15.19:0/3596781868 conn(0x7f422c066f50 msgr2=0x7f422c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.564+0000 7f42326ff700 1 -- 172.21.15.19:0/3596781868 shutdown_connections 2023-10-03T10:18:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.564+0000 7f42326ff700 1 -- 172.21.15.19:0/3596781868 wait complete. 2023-10-03T10:18:13.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.565+0000 7f42326ff700 1 Processor -- start 2023-10-03T10:18:13.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.565+0000 7f42326ff700 1 -- start start 2023-10-03T10:18:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09e000 0x7f422c11e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c11ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c11f460 con 0x7f422c09e410 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c130370 con 0x7f422c09d6f0 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f42326ff700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1201c0 con 0x7f422c09e000 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f422bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f422bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38050/0 (socket says 172.21.15.19:38050) 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f422bfff700 1 -- 172.21.15.19:0/1507021442 learned_addr learned my addr 172.21.15.19:0/1507021442 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c11ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 -- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09e000 msgr2=0x7f422c11e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09e000 0x7f422c11e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 -- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 msgr2=0x7f422c11df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f4230c9c700 1 -- 172.21.15.19:0/1507021442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224009a70 con 0x7f422c09e410 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.566+0000 7f422bfff700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f4230c9c700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c11ea10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f422c0a3e50 tx=0x7f4224004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224012430 con 0x7f422c09e410 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224020070 con 0x7f422c09e410 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224004280 con 0x7f422c09e410 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c120df0 con 0x7f422c09e410 2023-10-03T10:18:13.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.567+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c09c700 con 0x7f422c09e410 2023-10-03T10:18:13.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.568+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422c074ea0 con 0x7f422c09e410 2023-10-03T10:18:13.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.568+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f42240043e0 con 0x7f422c09e410 2023-10-03T10:18:13.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.568+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4224022070 con 0x7f422c09e410 2023-10-03T10:18:13.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.578+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f422401b400 con 0x7f422c09e410 2023-10-03T10:18:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.605+0000 7f0f0c384700 1 Processor -- start 2023-10-03T10:18:13.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.605+0000 7f0f0c384700 1 -- start start 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0c384700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0c384700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f04139170 0x7f0f0413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0c384700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0409b120 con 0x7f0f0409d6f0 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0c384700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0406b460 con 0x7f0f04139170 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0c384700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0409a7e0 con 0x7f0f0409e1d0 2023-10-03T10:18:13.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0991f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0991f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35610/0 (socket says 172.21.15.19:35610) 2023-10-03T10:18:13.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.606+0000 7f0f0991f700 1 -- 172.21.15.19:0/1178952398 learned_addr learned my addr 172.21.15.19:0/1178952398 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0991f700 1 -- 172.21.15.19:0/1178952398 >> v2:172.21.15.19:3300/0 conn(0x7f0f04139170 msgr2=0x7f0f0413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0991f700 1 --2- 172.21.15.19:0/1178952398 >> v2:172.21.15.19:3300/0 conn(0x7f0f04139170 0x7f0f0413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0991f700 1 -- 172.21.15.19:0/1178952398 >> v1:172.21.15.19:6789/0 conn(0x7f0f0409d6f0 legacy=0x7f0f0409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0991f700 1 -- 172.21.15.19:0/1178952398 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0409a500 con 0x7f0f0409e1d0 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0991f700 1 --2- 172.21.15.19:0/1178952398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009920 tx=0x7f0ef4009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=230d56b9f53ce705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0911e700 1 -- 172.21.15.19:0/1178952398 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4004230 con 0x7f0f0409e1d0 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0911e700 1 -- 172.21.15.19:0/1178952398 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef4004390 con 0x7f0f0409e1d0 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.607+0000 7f0f0911e700 1 -- 172.21.15.19:0/1178952398 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef4009e70 con 0x7f0f0409e1d0 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 -- 172.21.15.19:0/1178952398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 msgr2=0x7f0f04138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 --2- 172.21.15.19:0/1178952398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009920 tx=0x7f0ef4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 -- 172.21.15.19:0/1178952398 shutdown_connections 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 --2- 172.21.15.19:0/1178952398 >> v2:172.21.15.19:3300/0 conn(0x7f0f04139170 0x7f0f0413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 --2- 172.21.15.19:0/1178952398 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f0409e1d0 0x7f0f04138c30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 -- 172.21.15.19:0/1178952398 >> 172.21.15.19:0/1178952398 conn(0x7f0f04066f50 msgr2=0x7f0f0409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 -- 172.21.15.19:0/1178952398 shutdown_connections 2023-10-03T10:18:13.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.608+0000 7f0f0c384700 1 -- 172.21.15.19:0/1178952398 wait complete. 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.609+0000 7f0f0c384700 1 Processor -- start 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.609+0000 7f0f0c384700 1 -- start start 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f0409e1d0 0x7f0f041c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 0x7f0f04120990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f041be2f0 con 0x7f0f0409d6f0 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f041246a0 con 0x7f0f0409e1d0 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0c384700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f04136810 con 0x7f0f04139170 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45360/0 (socket says 172.21.15.19:45360) 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a921700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 0x7f0f04120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 -- 172.21.15.19:0/593953361 learned_addr learned my addr 172.21.15.19:0/593953361 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 -- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 msgr2=0x7f0f04120990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 0x7f0f04120990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 -- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f0409e1d0 msgr2=0x7f0f041c8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f0409e1d0 0x7f0f041c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a120700 1 -- 172.21.15.19:0/593953361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4009550 con 0x7f0f0409d6f0 2023-10-03T10:18:13.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.610+0000 7f0f0a921700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 0x7f0f04120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0f0a120700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c4a0 tx=0x7f0f0000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f000054e0 con 0x7f0f0409d6f0 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f00003680 con 0x7f0f0409d6f0 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f04123ec0 con 0x7f0f0409d6f0 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f00003a30 con 0x7f0f0409d6f0 2023-10-03T10:18:13.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.611+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f04124bd0 con 0x7f0f0409d6f0 2023-10-03T10:18:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.612+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f00003b90 con 0x7f0f0409d6f0 2023-10-03T10:18:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.612+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f04074ea0 con 0x7f0f0409d6f0 2023-10-03T10:18:13.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.612+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f0003eb40 con 0x7f0f0409d6f0 2023-10-03T10:18:13.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.617+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f00017070 con 0x7f0f0409d6f0 2023-10-03T10:18:13.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.644+0000 7f966097c700 1 Processor -- start 2023-10-03T10:18:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.645+0000 7f966097c700 1 -- start start 2023-10-03T10:18:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c12cf60 0x7f965c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f965c12f8b0 0x7f965c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c130260 0x7f965c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f965c12d330 con 0x7f965c12f8b0 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c12cd90 con 0x7f965c12cf60 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f966097c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1306d0 con 0x7f965c130260 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f965c12f8b0 0x7f965c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f965c12f8b0 0x7f965c12fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45374/0 (socket says 172.21.15.19:45374) 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 -- 172.21.15.19:0/2531225259 learned_addr learned my addr 172.21.15.19:0/2531225259 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f965ad9d700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c130260 0x7f965c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 -- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c130260 msgr2=0x7f965c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c130260 0x7f965c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 -- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c12cf60 msgr2=0x7f965c06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c12cf60 0x7f965c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 -- 172.21.15.19:0/2531225259 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c071780 con 0x7f965c12f8b0 2023-10-03T10:18:13.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7fa23a966700 1 Processor -- start 2023-10-03T10:18:13.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.646+0000 7f9659d9b700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12f8b0 0x7f965c12fd20 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9650009920 tx=0x7f9650009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c8cbd12a5af063 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7f965959a700 1 -- 172.21.15.19:0/2531225259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650011830 con 0x7f965c12f8b0 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7f965959a700 1 -- 172.21.15.19:0/2531225259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650011990 con 0x7f965c12f8b0 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7f965959a700 1 -- 172.21.15.19:0/2531225259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650011d20 con 0x7f965c12f8b0 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 -- start start 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa23406c0e0 0x7fa23409ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2341380f0 0x7fa23413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa234134980 con 0x7fa234134ec0 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23406c4b0 con 0x7fa2341380f0 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa23a966700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340a09c0 con 0x7fa23406c0e0 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa238f03700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2341380f0 0x7fa23413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa238f03700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa2341380f0 0x7fa23413fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45386/0 (socket says 172.21.15.19:45386) 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.647+0000 7fa238f03700 1 -- 172.21.15.19:0/376683464 learned_addr learned my addr 172.21.15.19:0/376683464 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa238f03700 1 -- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa23406c0e0 msgr2=0x7fa23409ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa238f03700 1 --2- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa23406c0e0 0x7fa23409ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa238f03700 1 -- 172.21.15.19:0/376683464 >> v1:172.21.15.19:6789/0 conn(0x7fa234134ec0 legacy=0x7fa2341379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa238f03700 1 -- 172.21.15.19:0/376683464 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340a0600 con 0x7fa2341380f0 2023-10-03T10:18:13.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa238f03700 1 --2- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2341380f0 0x7fa23413fd20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa2240098f0 tx=0x7fa224009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbca244eb9084a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 -- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12f8b0 msgr2=0x7f965c12fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12f8b0 0x7f965c12fd20 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f9650009920 tx=0x7f9650009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:13.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa232ffd700 1 -- 172.21.15.19:0/376683464 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224004230 con 0x7fa2341380f0 2023-10-03T10:18:13.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa232ffd700 1 -- 172.21.15.19:0/376683464 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224004390 con 0x7fa2341380f0 2023-10-03T10:18:13.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7fa232ffd700 1 -- 172.21.15.19:0/376683464 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2240036a0 con 0x7fa2341380f0 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 -- 172.21.15.19:0/2531225259 shutdown_connections 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c12cf60 0x7f965c06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c130260 0x7f965c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 --2- 172.21.15.19:0/2531225259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12f8b0 0x7f965c12fd20 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.648+0000 7f966097c700 1 -- 172.21.15.19:0/2531225259 >> 172.21.15.19:0/2531225259 conn(0x7f965c0a2aa0 msgr2=0x7f965c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7f966097c700 1 -- 172.21.15.19:0/2531225259 shutdown_connections 2023-10-03T10:18:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7f966097c700 1 -- 172.21.15.19:0/2531225259 wait complete. 2023-10-03T10:18:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 -- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2341380f0 msgr2=0x7fa23413fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 --2- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2341380f0 0x7fa23413fd20 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fa2240098f0 tx=0x7fa224009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:13.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 -- 172.21.15.19:0/376683464 shutdown_connections 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 --2- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa2341380f0 0x7fa23413fd20 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 --2- 172.21.15.19:0/376683464 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa23406c0e0 0x7fa23409ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 -- 172.21.15.19:0/376683464 >> 172.21.15.19:0/376683464 conn(0x7fa2340a4210 msgr2=0x7fa2340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 -- 172.21.15.19:0/376683464 shutdown_connections 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.649+0000 7fa23a966700 1 -- 172.21.15.19:0/376683464 wait complete. 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.650+0000 7fa23a966700 1 Processor -- start 2023-10-03T10:18:13.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.650+0000 7f966097c700 1 Processor -- start 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.650+0000 7fa23a966700 1 -- start start 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa234134ec0 0x7fa23411ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 0x7fa23411b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa23411c8c0 con 0x7fa23406c0e0 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa234138ad0 con 0x7fa2341380f0 2023-10-03T10:18:13.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa23a966700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa23411d9f0 con 0x7fa234134ec0 2023-10-03T10:18:13.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa233fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa233fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45394/0 (socket says 172.21.15.19:45394) 2023-10-03T10:18:13.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7fa233fff700 1 -- 172.21.15.19:0/2786409158 learned_addr learned my addr 172.21.15.19:0/2786409158 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.651+0000 7f966097c700 1 -- start start 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa2337fe700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa234134ec0 0x7fa23411ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa238f03700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 0x7fa23411b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 -- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa234134ec0 msgr2=0x7fa23411ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa234134ec0 0x7fa23411ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 -- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 msgr2=0x7fa23411b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 0x7fa23411b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 -- 172.21.15.19:0/2786409158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa224009550 con 0x7fa23406c0e0 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa238f03700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 0x7fa23411b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:13.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa233fff700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00ba80 tx=0x7fa22c00be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c12f8b0 0x7f965c1ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c130260 0x7f965c09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c13cef0 con 0x7f965c12cf60 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c12f5f0 con 0x7f965c130260 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f966097c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f965c129fa0 con 0x7f965c12f8b0 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f965a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f965a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45400/0 (socket says 172.21.15.19:45400) 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f965a59c700 1 -- 172.21.15.19:0/232111777 learned_addr learned my addr 172.21.15.19:0/232111777 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c00ca50 con 0x7fa23406c0e0 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c00cbd0 con 0x7fa23406c0e0 2023-10-03T10:18:13.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c014440 con 0x7fa23406c0e0 2023-10-03T10:18:13.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f9659d9b700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c12f8b0 0x7f965c1ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.652+0000 7f965ad9d700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c130260 0x7f965c09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 -- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c12f8b0 msgr2=0x7f965c1ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c12f8b0 0x7f965c1ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 -- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c130260 msgr2=0x7f965c09dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c130260 0x7f965c09dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 -- 172.21.15.19:0/232111777 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9650009550 con 0x7f965c12cf60 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f965a59c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b530 tx=0x7f964c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c011830 con 0x7f965c12cf60 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964c0119b0 con 0x7f965c12cf60 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964c011d60 con 0x7f965c12cf60 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c13bf50 con 0x7f965c12cf60 2023-10-03T10:18:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c13a620 con 0x7f965c12cf60 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa23411df00 con 0x7fa23406c0e0 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.653+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23411dc20 con 0x7fa23406c0e0 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa234074ea0 con 0x7fa23406c0e0 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c074ea0 con 0x7f965c12cf60 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f964c01a400 con 0x7f965c12cf60 2023-10-03T10:18:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f964c03f810 con 0x7f965c12cf60 2023-10-03T10:18:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa22c01d3b0 con 0x7fa23406c0e0 2023-10-03T10:18:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.655+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa22c03f5f0 con 0x7fa23406c0e0 2023-10-03T10:18:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.664+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f964c00f8d0 con 0x7f965c12cf60 2023-10-03T10:18:13.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.673+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa22c007370 con 0x7fa23406c0e0 2023-10-03T10:18:13.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.794+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f422c0a3c00 con 0x7f422c09e410 2023-10-03T10:18:13.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.794+0000 7f4228ff9700 1 -- 172.21.15.19:0/1507021442 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f422401ab70 con 0x7f422c09e410 2023-10-03T10:18:13.794 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:13.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 msgr2=0x7f422c11ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c11ea10 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f422c0a3e50 tx=0x7f4224004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 shutdown_connections 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422c09e410 0x7f422c11ea10 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422c09d6f0 0x7f422c11df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 --2- 172.21.15.19:0/1507021442 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422c09e000 0x7f422c11e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.796+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 >> 172.21.15.19:0/1507021442 conn(0x7f422c066f50 msgr2=0x7f422c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.797+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 shutdown_connections 2023-10-03T10:18:13.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.797+0000 7f42326ff700 1 -- 172.21.15.19:0/1507021442 wait complete. 2023-10-03T10:18:13.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:13.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.838+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f0406c360 con 0x7f0f0409d6f0 2023-10-03T10:18:13.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.839+0000 7f0efaffd700 1 -- 172.21.15.19:0/593953361 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f00003e40 con 0x7f0f0409d6f0 2023-10-03T10:18:13.839 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:13.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 msgr2=0x7f0f041c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c4a0 tx=0x7f0f0000c7b0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 shutdown_connections 2023-10-03T10:18:13.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f04139170 0x7f0f04120990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f0409d6f0 0x7f0f041c86b0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 --2- 172.21.15.19:0/593953361 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f0409e1d0 0x7f0f041c8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 >> 172.21.15.19:0/593953361 conn(0x7f0f04066f50 msgr2=0x7f0f04136b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 shutdown_connections 2023-10-03T10:18:13.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.841+0000 7f0f0c384700 1 -- 172.21.15.19:0/593953361 wait complete. 2023-10-03T10:18:13.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:13.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.899+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f965c071380 con 0x7f965c12cf60 2023-10-03T10:18:13.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.900+0000 7f964affd700 1 -- 172.21.15.19:0/232111777 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f964c015030 con 0x7f965c12cf60 2023-10-03T10:18:13.900 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 msgr2=0x7f965c1cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f964c00b530 tx=0x7f964c00b8f0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 shutdown_connections 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f965c130260 0x7f965c09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f965c12cf60 0x7f965c1cc890 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 --2- 172.21.15.19:0/232111777 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f965c12f8b0 0x7f965c1ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 >> 172.21.15.19:0/232111777 conn(0x7f965c0a2aa0 msgr2=0x7f965c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 shutdown_connections 2023-10-03T10:18:13.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.902+0000 7f966097c700 1 -- 172.21.15.19:0/232111777 wait complete. 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.906+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa23406b250 con 0x7fa23406c0e0 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.907+0000 7fa230ff9700 1 -- 172.21.15.19:0/2786409158 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa22c019070 con 0x7fa23406c0e0 2023-10-03T10:18:13.906 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 msgr2=0x7fa23411a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fa22c00ba80 tx=0x7fa22c00be40 comp rx=0 tx=0).stop 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 shutdown_connections 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa2341380f0 0x7fa23411b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa23406c0e0 0x7fa23411a8f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 --2- 172.21.15.19:0/2786409158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa234134ec0 0x7fa23411ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 >> 172.21.15.19:0/2786409158 conn(0x7fa2340a4210 msgr2=0x7fa2340a4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 shutdown_connections 2023-10-03T10:18:13.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:13.909+0000 7fa23a966700 1 -- 172.21.15.19:0/2786409158 wait complete. 2023-10-03T10:18:13.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:13.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:14.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:14.855 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:14.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:14.923 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.963+0000 7f08c68e1700 1 Processor -- start 2023-10-03T10:18:14.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.963+0000 7f08c68e1700 1 -- start start 2023-10-03T10:18:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c68e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 0x7f08c0135950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c68e1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f08c0135e90 0x7f08c0138270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c68e1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08c009c280 con 0x7f08c00954c0 2023-10-03T10:18:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c68e1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08c009aaf0 con 0x7f08c0135e90 2023-10-03T10:18:14.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c68e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c009b960 con 0x7f08c0133570 2023-10-03T10:18:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08bf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 0x7f08c0135950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08bf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 0x7f08c0135950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35666/0 (socket says 172.21.15.19:35666) 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08bf7fe700 1 -- 172.21.15.19:0/2690916028 learned_addr learned my addr 172.21.15.19:0/2690916028 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.964+0000 7f08c4e7e700 1 --2- 172.21.15.19:0/2690916028 >> v2:172.21.15.19:3300/0 conn(0x7f08c0135e90 0x7f08c0138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08c4e7e700 1 -- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 msgr2=0x7f08c0135950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08c4e7e700 1 --2- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 0x7f08c0135950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08c4e7e700 1 -- 172.21.15.19:0/2690916028 >> v1:172.21.15.19:6789/0 conn(0x7f08c00954c0 legacy=0x7f08c0095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08c4e7e700 1 -- 172.21.15.19:0/2690916028 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c009a7b0 con 0x7f08c0135e90 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08beffd700 1 -- 172.21.15.19:0/2690916028 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653735001 0 0) 0x7f08c009c280 con 0x7f08c00954c0 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08c4e7e700 1 --2- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c0135e90 0x7f08c0138270 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1677249176275f41 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08beffd700 1 -- 172.21.15.19:0/2690916028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800e070 con 0x7f08c0135e90 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08beffd700 1 -- 172.21.15.19:0/2690916028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b800bbd0 con 0x7f08c0135e90 2023-10-03T10:18:14.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.965+0000 7f08beffd700 1 -- 172.21.15.19:0/2690916028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8012430 con 0x7f08c0135e90 2023-10-03T10:18:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 -- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c0135e90 msgr2=0x7f08c0138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 --2- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c0135e90 0x7f08c0138270 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 -- 172.21.15.19:0/2690916028 shutdown_connections 2023-10-03T10:18:14.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 --2- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c0135e90 0x7f08c0138270 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 --2- 172.21.15.19:0/2690916028 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0133570 0x7f08c0135950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.966+0000 7f08c68e1700 1 -- 172.21.15.19:0/2690916028 >> 172.21.15.19:0/2690916028 conn(0x7f08c00a2360 msgr2=0x7f08c00a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.967+0000 7f08c68e1700 1 -- 172.21.15.19:0/2690916028 shutdown_connections 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.967+0000 7f08c68e1700 1 -- 172.21.15.19:0/2690916028 wait complete. 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.968+0000 7f08c68e1700 1 Processor -- start 2023-10-03T10:18:14.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.968+0000 7f08c68e1700 1 -- start start 2023-10-03T10:18:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f08c0133570 0x7f08c01305b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0135e90 0x7f08c006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08c012cb60 con 0x7f08c00954c0 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08c0072180 con 0x7f08c0133570 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08c68e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f08c009b000 con 0x7f08c0135e90 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45420/0 (socket says 172.21.15.19:45420) 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.969+0000 7f08bffff700 1 -- 172.21.15.19:0/1724616463 learned_addr learned my addr 172.21.15.19:0/1724616463 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08c4e7e700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0135e90 0x7f08c006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bf7fe700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f08c0133570 0x7f08c01305b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 -- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0135e90 msgr2=0x7f08c006f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0135e90 0x7f08c006f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 -- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f08c0133570 msgr2=0x7f08c01305b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f08c0133570 0x7f08c01305b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 -- 172.21.15.19:0/1724616463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8009a70 con 0x7f08c00954c0 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bffff700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001eb0 tx=0x7f08b000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00054e0 con 0x7f08c00954c0 2023-10-03T10:18:14.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b0003680 con 0x7f08c00954c0 2023-10-03T10:18:14.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.970+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00039f0 con 0x7f08c00954c0 2023-10-03T10:18:14.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.971+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08c012bc00 con 0x7f08c00954c0 2023-10-03T10:18:14.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.971+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08c0130af0 con 0x7f08c00954c0 2023-10-03T10:18:14.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.972+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08c012b650 con 0x7f08c00954c0 2023-10-03T10:18:14.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.972+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f08b0003b50 con 0x7f08c00954c0 2023-10-03T10:18:14.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.972+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f08b003eb70 con 0x7f08c00954c0 2023-10-03T10:18:14.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:14.981+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f08b001b3b0 con 0x7f08c00954c0 2023-10-03T10:18:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.014+0000 7f2a06ee6700 1 Processor -- start 2023-10-03T10:18:15.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.014+0000 7f2a06ee6700 1 -- start start 2023-10-03T10:18:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f2a06ee6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a0009d6d0 0x7f2a0009daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f2a06ee6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f2a06ee6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a0009a570 con 0x7f2a00133b00 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f2a06ee6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a0009b1c0 con 0x7f2a0009d6d0 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f2a06ee6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0009f240 con 0x7f2a0009dfe0 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f29fffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.015+0000 7f29fffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35684/0 (socket says 172.21.15.19:35684) 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 -- 172.21.15.19:0/3276782770 learned_addr learned my addr 172.21.15.19:0/3276782770 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f2a04c82700 1 --2- 172.21.15.19:0/3276782770 >> v2:172.21.15.19:3300/0 conn(0x7f2a0009d6d0 0x7f2a0009daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29ff7fe700 1 -- 172.21.15.19:0/3276782770 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 294796535 0 0) 0x7f2a0009a570 con 0x7f2a00133b00 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29ff7fe700 1 -- 172.21.15.19:0/3276782770 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29f00035b0 con 0x7f2a00133b00 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 -- 172.21.15.19:0/3276782770 >> v2:172.21.15.19:3300/0 conn(0x7f2a0009d6d0 msgr2=0x7f2a0009daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 --2- 172.21.15.19:0/3276782770 >> v2:172.21.15.19:3300/0 conn(0x7f2a0009d6d0 0x7f2a0009daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 -- 172.21.15.19:0/3276782770 >> v1:172.21.15.19:6789/0 conn(0x7f2a00133b00 legacy=0x7f2a0013aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 -- 172.21.15.19:0/3276782770 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a0009a2d0 con 0x7f2a0009dfe0 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29fffff700 1 --2- 172.21.15.19:0/3276782770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da56a18b71de37a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29ff7fe700 1 -- 172.21.15.19:0/3276782770 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec004230 con 0x7f2a0009dfe0 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29ff7fe700 1 -- 172.21.15.19:0/3276782770 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ec004390 con 0x7f2a0009dfe0 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.016+0000 7f29ff7fe700 1 -- 172.21.15.19:0/3276782770 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ec0036a0 con 0x7f2a0009dfe0 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.017+0000 7f2a06ee6700 1 -- 172.21.15.19:0/3276782770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 msgr2=0x7f2a001335c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.017+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/3276782770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f29ec0098f0 tx=0x7f29ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 -- 172.21.15.19:0/3276782770 shutdown_connections 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/3276782770 >> v2:172.21.15.19:3300/0 conn(0x7f2a0009d6d0 0x7f2a0009daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/3276782770 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009dfe0 0x7f2a001335c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 -- 172.21.15.19:0/3276782770 >> 172.21.15.19:0/3276782770 conn(0x7f2a00099c20 msgr2=0x7f2a000a2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 -- 172.21.15.19:0/3276782770 shutdown_connections 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.018+0000 7f2a06ee6700 1 -- 172.21.15.19:0/3276782770 wait complete. 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.019+0000 7f2a06ee6700 1 Processor -- start 2023-10-03T10:18:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.019+0000 7f2a06ee6700 1 -- start start 2023-10-03T10:18:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 0x7f2a0011d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 0x7f2a0011d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a00120640 con 0x7f2a00133b00 2023-10-03T10:18:15.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0011f730 con 0x7f2a0009dfe0 2023-10-03T10:18:15.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a06ee6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0011e9d0 con 0x7f2a0009d6d0 2023-10-03T10:18:15.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a04c82700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a04c82700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35688/0 (socket says 172.21.15.19:35688) 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a05483700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 0x7f2a0011d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f2a04c82700 1 -- 172.21.15.19:0/1286983309 learned_addr learned my addr 172.21.15.19:0/1286983309 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.020+0000 7f29fffff700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 0x7f2a0011d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 -- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 msgr2=0x7f2a0011cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 -- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 msgr2=0x7f2a0011d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 0x7f2a0011d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 -- 172.21.15.19:0/1286983309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec009550 con 0x7f2a00133b00 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a04c82700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f29fffff700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 0x7f2a0011d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a05483700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 0x7f2a0011d7a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c7c0 tx=0x7f29f800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8003e30 con 0x7f2a00133b00 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f8005070 con 0x7f2a00133b00 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f8005420 con 0x7f2a00133b00 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.021+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a000a0650 con 0x7f2a00133b00 2023-10-03T10:18:15.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.022+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a0011fbf0 con 0x7f2a00133b00 2023-10-03T10:18:15.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.023+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a0004f2a0 con 0x7f2a00133b00 2023-10-03T10:18:15.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.023+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f29f8005580 con 0x7f2a00133b00 2023-10-03T10:18:15.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.023+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f29f8005830 con 0x7f2a00133b00 2023-10-03T10:18:15.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.033+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f29f8044060 con 0x7f2a00133b00 2023-10-03T10:18:15.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.071+0000 7f3f58557700 1 Processor -- start 2023-10-03T10:18:15.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.071+0000 7f3f58557700 1 -- start start 2023-10-03T10:18:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f58557700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 0x7f3f5009ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f58557700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f500a0090 0x7f3f5009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f58557700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5009ba70 con 0x7f3f50131970 2023-10-03T10:18:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f58557700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5009d4a0 con 0x7f3f500a0090 2023-10-03T10:18:15.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f58557700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5009e8f0 con 0x7f3f5009c650 2023-10-03T10:18:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f56af4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f50131970 0x7f3f50131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48568/0 (socket says 172.21.15.19:48568) 2023-10-03T10:18:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f56af4700 1 -- 172.21.15.19:0/2588742420 learned_addr learned my addr 172.21.15.19:0/2588742420 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f562f3700 1 --2- 172.21.15.19:0/2588742420 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 0x7f3f5009ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.072+0000 7f3f55af2700 1 --2- 172.21.15.19:0/2588742420 >> v2:172.21.15.19:3300/0 conn(0x7f3f500a0090 0x7f3f5009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f562f3700 1 -- 172.21.15.19:0/2588742420 >> v2:172.21.15.19:3300/0 conn(0x7f3f500a0090 msgr2=0x7f3f5009cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f562f3700 1 --2- 172.21.15.19:0/2588742420 >> v2:172.21.15.19:3300/0 conn(0x7f3f500a0090 0x7f3f5009cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f562f3700 1 -- 172.21.15.19:0/2588742420 >> v1:172.21.15.19:6789/0 conn(0x7f3f50131970 legacy=0x7f3f50131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f562f3700 1 -- 172.21.15.19:0/2588742420 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f500a0760 con 0x7f3f5009c650 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f562f3700 1 --2- 172.21.15.19:0/2588742420 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 0x7f3f5009ca20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009840 tx=0x7f3f4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f46f07c979345ef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f552f1700 1 -- 172.21.15.19:0/2588742420 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c004230 con 0x7f3f5009c650 2023-10-03T10:18:15.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f552f1700 1 -- 172.21.15.19:0/2588742420 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c004390 con 0x7f3f5009c650 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.073+0000 7f3f552f1700 1 -- 172.21.15.19:0/2588742420 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0036a0 con 0x7f3f5009c650 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 -- 172.21.15.19:0/2588742420 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 msgr2=0x7f3f5009ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 --2- 172.21.15.19:0/2588742420 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 0x7f3f5009ca20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009840 tx=0x7f3f4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 -- 172.21.15.19:0/2588742420 shutdown_connections 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 --2- 172.21.15.19:0/2588742420 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f5009c650 0x7f3f5009ca20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 --2- 172.21.15.19:0/2588742420 >> v2:172.21.15.19:3300/0 conn(0x7f3f500a0090 0x7f3f5009cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 -- 172.21.15.19:0/2588742420 >> 172.21.15.19:0/2588742420 conn(0x7f3f500a3f70 msgr2=0x7f3f500a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 -- 172.21.15.19:0/2588742420 shutdown_connections 2023-10-03T10:18:15.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.074+0000 7f3f58557700 1 -- 172.21.15.19:0/2588742420 wait complete. 2023-10-03T10:18:15.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.075+0000 7f3f58557700 1 Processor -- start 2023-10-03T10:18:15.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 -- start start 2023-10-03T10:18:15.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f5009c650 0x7f3f5011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f50131970 0x7f3f5011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5012d690 con 0x7f3f5009c650 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5011d800 con 0x7f3f500a0090 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f58557700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5011bb90 con 0x7f3f50131970 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f55af2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f55af2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38128/0 (socket says 172.21.15.19:38128) 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f55af2700 1 -- 172.21.15.19:0/3839693917 learned_addr learned my addr 172.21.15.19:0/3839693917 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f56af4700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f50131970 0x7f3f5011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f55af2700 1 -- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f50131970 msgr2=0x7f3f5011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.076+0000 7f3f55af2700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f50131970 0x7f3f5011b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f55af2700 1 -- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f5009c650 msgr2=0x7f3f5011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f55af2700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f5009c650 0x7f3f5011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f55af2700 1 -- 172.21.15.19:0/3839693917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c0094a0 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f55af2700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e980 tx=0x7f3f4000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40009710 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4000c850 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50130080 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4000cbc0 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.077+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5011c760 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.078+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f500747f0 con 0x7f3f500a0090 2023-10-03T10:18:15.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.078+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f4000cd20 con 0x7f3f500a0090 2023-10-03T10:18:15.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.078+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f4003f990 con 0x7f3f500a0090 2023-10-03T10:18:15.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.083+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f40013b10 con 0x7f3f500a0090 2023-10-03T10:18:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.156+0000 7f5052829700 1 Processor -- start 2023-10-03T10:18:15.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.156+0000 7f5052829700 1 -- start start 2023-10-03T10:18:15.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f5052829700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f5052829700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f5052829700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c1313c0 con 0x7f504c099a40 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f5052829700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c06e8c0 con 0x7f504c131810 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f5052829700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f504c071d20 con 0x7f504c09a580 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f504bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f504bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c131be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38140/0 (socket says 172.21.15.19:38140) 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.157+0000 7f504bfff700 1 -- 172.21.15.19:0/2931273174 learned_addr learned my addr 172.21.15.19:0/2931273174 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:15.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f504affd700 1 -- 172.21.15.19:0/2931273174 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266817935 0 0) 0x7f504c1313c0 con 0x7f504c099a40 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 -- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 msgr2=0x7f504c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 -- 172.21.15.19:0/2931273174 >> v1:172.21.15.19:6789/0 conn(0x7f504c099a40 legacy=0x7f504c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 -- 172.21.15.19:0/2931273174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0721a0 con 0x7f504c09a580 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f5050dc6700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c139660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5044009dc0 tx=0x7f504400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99de615546194c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f504affd700 1 -- 172.21.15.19:0/2931273174 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f504400e070 con 0x7f504c09a580 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f504affd700 1 -- 172.21.15.19:0/2931273174 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f504400bb20 con 0x7f504c09a580 2023-10-03T10:18:15.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.158+0000 7f504affd700 1 -- 172.21.15.19:0/2931273174 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044012430 con 0x7f504c09a580 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 -- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 msgr2=0x7f504c139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c139660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5044009dc0 tx=0x7f504400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 -- 172.21.15.19:0/2931273174 shutdown_connections 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c139660 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 --2- 172.21.15.19:0/2931273174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 -- 172.21.15.19:0/2931273174 >> 172.21.15.19:0/2931273174 conn(0x7f504c0a2aa0 msgr2=0x7f504c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 -- 172.21.15.19:0/2931273174 shutdown_connections 2023-10-03T10:18:15.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.159+0000 7f5052829700 1 -- 172.21.15.19:0/2931273174 wait complete. 2023-10-03T10:18:15.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.161+0000 7f5052829700 1 Processor -- start 2023-10-03T10:18:15.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.161+0000 7f5052829700 1 -- start start 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c11bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c11c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c11f270 con 0x7f504c099a40 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c11d980 con 0x7f504c131810 2023-10-03T10:18:15.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5052829700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f504c11ea00 con 0x7f504c09a580 2023-10-03T10:18:15.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f504bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f5050dc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c11c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f504bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45450/0 (socket says 172.21.15.19:45450) 2023-10-03T10:18:15.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f504bfff700 1 -- 172.21.15.19:0/3373089196 learned_addr learned my addr 172.21.15.19:0/3373089196 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.162+0000 7f504b7fe700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c11bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 -- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 msgr2=0x7f504c11bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c11bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 -- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 msgr2=0x7f504c11c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c11c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 -- 172.21.15.19:0/3373089196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044009a70 con 0x7f504c099a40 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5050dc6700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c11c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f504bfff700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f503c00e910 tx=0x7f503c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0096a0 con 0x7f504c099a40 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c013680 con 0x7f504c099a40 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c013a30 con 0x7f504c099a40 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c06eb00 con 0x7f504c099a40 2023-10-03T10:18:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.163+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c12eb40 con 0x7f504c099a40 2023-10-03T10:18:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.164+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f503c013b90 con 0x7f504c099a40 2023-10-03T10:18:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.164+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c074ea0 con 0x7f504c099a40 2023-10-03T10:18:15.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.165+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f503c03f7e0 con 0x7f504c099a40 2023-10-03T10:18:15.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.172+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f503c01bdf0 con 0x7f504c099a40 2023-10-03T10:18:15.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.207+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f08c0074ea0 con 0x7f08c00954c0 2023-10-03T10:18:15.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.207+0000 7f08bcff9700 1 -- 172.21.15.19:0/1724616463 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f08b0017070 con 0x7f08c00954c0 2023-10-03T10:18:15.207 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.209+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 msgr2=0x7f08c0130070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.209+0000 7f08c68e1700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f08b0001eb0 tx=0x7f08b000c800 comp rx=0 tx=0).stop 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 shutdown_connections 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f08c0135e90 0x7f08c006f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f08c00954c0 0x7f08c0130070 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 --2- 172.21.15.19:0/1724616463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f08c0133570 0x7f08c01305b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 >> 172.21.15.19:0/1724616463 conn(0x7f08c00a2360 msgr2=0x7f08c0134250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 shutdown_connections 2023-10-03T10:18:15.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.210+0000 7f08c68e1700 1 -- 172.21.15.19:0/1724616463 wait complete. 2023-10-03T10:18:15.224 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:15.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.298+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3f50072840 con 0x7f3f500a0090 2023-10-03T10:18:15.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.299+0000 7f3f46ffd700 1 -- 172.21.15.19:0/3839693917 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f4001b3b0 con 0x7f3f500a0090 2023-10-03T10:18:15.299 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:15.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 msgr2=0x7f3f5011ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e980 tx=0x7f3f4000ed40 comp rx=0 tx=0).stop 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 shutdown_connections 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f50131970 0x7f3f5011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f5009c650 0x7f3f5011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 --2- 172.21.15.19:0/3839693917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f500a0090 0x7f3f5011ab60 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 >> 172.21.15.19:0/3839693917 conn(0x7f3f500a3f70 msgr2=0x7f3f5012ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 shutdown_connections 2023-10-03T10:18:15.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.301+0000 7f3f58557700 1 -- 172.21.15.19:0/3839693917 wait complete. 2023-10-03T10:18:15.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:15.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.320+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2a0006c230 con 0x7f2a00133b00 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.320+0000 7f29fd7fa700 1 -- 172.21.15.19:0/1286983309 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f29f8017030 con 0x7f2a00133b00 2023-10-03T10:18:15.320 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 msgr2=0x7f2a0011d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 0x7f2a0011d7a0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f29f800c7c0 tx=0x7f29f800cad0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 shutdown_connections 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a00133b00 0x7f2a0011d7a0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a0009d6d0 0x7f2a0011cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.322+0000 7f2a06ee6700 1 --2- 172.21.15.19:0/1286983309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a0009dfe0 0x7f2a0011d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.323+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 >> 172.21.15.19:0/1286983309 conn(0x7f2a00099c20 msgr2=0x7f2a00131ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.323+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 shutdown_connections 2023-10-03T10:18:15.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.323+0000 7f2a06ee6700 1 -- 172.21.15.19:0/1286983309 wait complete. 2023-10-03T10:18:15.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:15.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.395+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f504c11e5b0 con 0x7f504c099a40 2023-10-03T10:18:15.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.395+0000 7f5048ff9700 1 -- 172.21.15.19:0/3373089196 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f503c01b3b0 con 0x7f504c099a40 2023-10-03T10:18:15.395 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 msgr2=0x7f504c11b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f503c00e910 tx=0x7f503c00ec20 comp rx=0 tx=0).stop 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 shutdown_connections 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f504c131810 0x7f504c11c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f504c099a40 0x7f504c11b7e0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 --2- 172.21.15.19:0/3373089196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f504c09a580 0x7f504c11bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 >> 172.21.15.19:0/3373089196 conn(0x7f504c0a2aa0 msgr2=0x7f504c1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 shutdown_connections 2023-10-03T10:18:15.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:15.398+0000 7f5052829700 1 -- 172.21.15.19:0/3373089196 wait complete. 2023-10-03T10:18:15.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:16.226 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:16.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:16.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:16.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.373+0000 7f733111d700 1 Processor -- start 2023-10-03T10:18:16.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.373+0000 7f733111d700 1 -- start start 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 0x7f732c130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f732c130e50 0x7f732c06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c06fb20 0x7f732c06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0704b0 con 0x7f732c130e50 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c09a390 con 0x7f732c06fb20 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f733111d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732c0716a0 con 0x7f732c130540 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f732c130e50 0x7f732c06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f732c130e50 0x7f732c06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40974/0 (socket says 172.21.15.19:40974) 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 -- 172.21.15.19:0/542673053 learned_addr learned my addr 172.21.15.19:0/542673053 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732ad9d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 0x7f732c130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732b59e700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c06fb20 0x7f732c06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 -- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 msgr2=0x7f732c130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 0x7f732c130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 -- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c06fb20 msgr2=0x7f732c06ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c06fb20 0x7f732c06ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.374+0000 7f732a59c700 1 -- 172.21.15.19:0/542673053 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c071290 con 0x7f732c130e50 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.375+0000 7f732ad9d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 0x7f732c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.375+0000 7f732a59c700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c06f5e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7320009920 tx=0x7f7320009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c580165ba3e895 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.375+0000 7f7329d9b700 1 -- 172.21.15.19:0/542673053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011830 con 0x7f732c130e50 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.375+0000 7f7329d9b700 1 -- 172.21.15.19:0/542673053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7320011990 con 0x7f732c130e50 2023-10-03T10:18:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.375+0000 7f7329d9b700 1 -- 172.21.15.19:0/542673053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7320011d20 con 0x7f732c130e50 2023-10-03T10:18:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 -- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 msgr2=0x7f732c06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c06f5e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f7320009920 tx=0x7f7320009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 -- 172.21.15.19:0/542673053 shutdown_connections 2023-10-03T10:18:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c06fb20 0x7f732c06ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c130540 0x7f732c130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 --2- 172.21.15.19:0/542673053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c06f5e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 -- 172.21.15.19:0/542673053 >> 172.21.15.19:0/542673053 conn(0x7f732c0a2aa0 msgr2=0x7f732c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 -- 172.21.15.19:0/542673053 shutdown_connections 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.376+0000 7f733111d700 1 -- 172.21.15.19:0/542673053 wait complete. 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.377+0000 7f733111d700 1 Processor -- start 2023-10-03T10:18:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.377+0000 7f733111d700 1 -- start start 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c130540 0x7f732c11d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c11db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c120060 con 0x7f732c130e50 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c120c20 con 0x7f732c130540 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f733111d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f732c12bbf0 con 0x7f732c06fb20 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c11db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36770/0 (socket says 172.21.15.19:36770) 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 -- 172.21.15.19:0/3719592983 learned_addr learned my addr 172.21.15.19:0/3719592983 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 -- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c130540 msgr2=0x7f732c11d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c130540 0x7f732c11d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 -- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 msgr2=0x7f732c11db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c11db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732ad9d700 1 -- 172.21.15.19:0/3719592983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0094a0 con 0x7f732c06fb20 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.378+0000 7f732b59e700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c11db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f732ad9d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ebe0 tx=0x7f731c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c009800 con 0x7f732c06fb20 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c00c910 con 0x7f732c06fb20 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c00cc80 con 0x7f732c06fb20 2023-10-03T10:18:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7320009550 con 0x7f732c06fb20 2023-10-03T10:18:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.379+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c0718e0 con 0x7f732c06fb20 2023-10-03T10:18:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.380+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f731c013470 con 0x7f732c06fb20 2023-10-03T10:18:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.380+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f731c03fc50 con 0x7f732c06fb20 2023-10-03T10:18:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.380+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c074ea0 con 0x7f732c06fb20 2023-10-03T10:18:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.385+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f731c03fe60 con 0x7f732c06fb20 2023-10-03T10:18:16.412 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.461+0000 7f018f218700 1 Processor -- start 2023-10-03T10:18:16.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.461+0000 7f018f218700 1 -- start start 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018f218700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018f218700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 0x7f0188138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018f218700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880716a0 con 0x7f0188130540 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018f218700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0188071290 con 0x7f0188135e60 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018f218700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188130340 con 0x7f0188133540 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f0187fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f018d7b5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 0x7f0188138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f0187fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53970/0 (socket says 172.21.15.19:53970) 2023-10-03T10:18:16.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.462+0000 7f0187fff700 1 -- 172.21.15.19:0/738418378 learned_addr learned my addr 172.21.15.19:0/738418378 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f0187fff700 1 -- 172.21.15.19:0/738418378 >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 msgr2=0x7f0188138240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f0187fff700 1 --2- 172.21.15.19:0/738418378 >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 0x7f0188138240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f0187fff700 1 -- 172.21.15.19:0/738418378 >> v1:172.21.15.19:6789/0 conn(0x7f0188130540 legacy=0x7f0188130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f0187fff700 1 -- 172.21.15.19:0/738418378 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188070b80 con 0x7f0188133540 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f018d7b5700 1 --2- 172.21.15.19:0/738418378 >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 0x7f0188138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f0187fff700 1 --2- 172.21.15.19:0/738418378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01740098f0 tx=0x7f0174009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c0c75dffbed17c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f01877fe700 1 -- 172.21.15.19:0/738418378 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174004230 con 0x7f0188133540 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f01877fe700 1 -- 172.21.15.19:0/738418378 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174004390 con 0x7f0188133540 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.463+0000 7f01877fe700 1 -- 172.21.15.19:0/738418378 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400d800 con 0x7f0188133540 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 -- 172.21.15.19:0/738418378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 msgr2=0x7f0188135920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 --2- 172.21.15.19:0/738418378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f01740098f0 tx=0x7f0174009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 -- 172.21.15.19:0/738418378 shutdown_connections 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 --2- 172.21.15.19:0/738418378 >> v2:172.21.15.19:3300/0 conn(0x7f0188135e60 0x7f0188138240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 --2- 172.21.15.19:0/738418378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f0188135920 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 -- 172.21.15.19:0/738418378 >> 172.21.15.19:0/738418378 conn(0x7f01880a2aa0 msgr2=0x7f01880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 -- 172.21.15.19:0/738418378 shutdown_connections 2023-10-03T10:18:16.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.464+0000 7f018f218700 1 -- 172.21.15.19:0/738418378 wait complete. 2023-10-03T10:18:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.465+0000 7f018f218700 1 Processor -- start 2023-10-03T10:18:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.465+0000 7f018f218700 1 -- start start 2023-10-03T10:18:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 0x7f01881c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018812dbf0 con 0x7f0188130540 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880718e0 con 0x7f0188133540 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018f218700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f018811de10 con 0x7f0188135e60 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f0187fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018cfb4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018cfb4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41010/0 (socket says 172.21.15.19:41010) 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f0187fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53986/0 (socket says 172.21.15.19:53986) 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018cfb4700 1 -- 172.21.15.19:0/1563984830 learned_addr learned my addr 172.21.15.19:0/1563984830 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.466+0000 7f018d7b5700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 0x7f01881c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 -- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 msgr2=0x7f01881c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 0x7f01881c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 -- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 msgr2=0x7f018809d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 -- 172.21.15.19:0/1563984830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180009a70 con 0x7f0188133540 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f018cfb4700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f018d7b5700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 0x7f01881c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f0187fff700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0188070da0 tx=0x7f0174004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174003ab0 con 0x7f0188133540 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0174003c10 con 0x7f0188133540 2023-10-03T10:18:16.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0174009550 con 0x7f0188133540 2023-10-03T10:18:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174006bd0 con 0x7f0188133540 2023-10-03T10:18:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.467+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018809dcc0 con 0x7f0188133540 2023-10-03T10:18:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.468+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f01740193f0 con 0x7f0188133540 2023-10-03T10:18:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.468+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01880a22f0 con 0x7f0188133540 2023-10-03T10:18:16.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.469+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0174040b40 con 0x7f0188133540 2023-10-03T10:18:16.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.478+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0174040e60 con 0x7f0188133540 2023-10-03T10:18:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.504+0000 7fc6ed23a700 1 Processor -- start 2023-10-03T10:18:16.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 -- start start 2023-10-03T10:18:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6e809d6f0 0x7fc6e809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e000 0x7fc6e8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e809f130 con 0x7fc6e809e410 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6e809f520 con 0x7fc6e809d6f0 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.505+0000 7fc6ed23a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e809e930 con 0x7fc6e809e000 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e000 0x7fc6e8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e759e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc6e809e410 0x7fc6e8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40066/0 (socket says 172.21.15.19:40066) 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc6e809d6f0 0x7fc6e809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e759e700 1 -- 172.21.15.19:0/1470075192 learned_addr learned my addr 172.21.15.19:0/1470075192 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e5d9b700 1 -- 172.21.15.19:0/1470075192 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632434905 0 0) 0x7fc6e809f130 con 0x7fc6e809e410 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e5d9b700 1 -- 172.21.15.19:0/1470075192 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6d00035b0 con 0x7fc6e809e410 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 -- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e000 msgr2=0x7fc6e8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 --2- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e000 0x7fc6e8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 -- 172.21.15.19:0/1470075192 >> v1:172.21.15.19:6789/0 conn(0x7fc6e809e410 legacy=0x7fc6e8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 -- 172.21.15.19:0/1470075192 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e809b2d0 con 0x7fc6e809d6f0 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.506+0000 7fc6e6d9d700 1 --2- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809d6f0 0x7fc6e809dac0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800dc60 tx=0x7fc6d800df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffe6ab0d024c2d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.507+0000 7fc6e5d9b700 1 -- 172.21.15.19:0/1470075192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8012070 con 0x7fc6e809d6f0 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.507+0000 7fc6e5d9b700 1 -- 172.21.15.19:0/1470075192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800d2e0 con 0x7fc6e809d6f0 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.507+0000 7fc6e5d9b700 1 -- 172.21.15.19:0/1470075192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800f900 con 0x7fc6e809d6f0 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809d6f0 msgr2=0x7fc6e809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809d6f0 0x7fc6e809dac0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fc6d800dc60 tx=0x7fc6d800df70 comp rx=0 tx=0).stop 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1470075192 shutdown_connections 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809d6f0 0x7fc6e809dac0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1470075192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e000 0x7fc6e8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1470075192 >> 172.21.15.19:0/1470075192 conn(0x7fc6e8066f50 msgr2=0x7fc6e809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1470075192 shutdown_connections 2023-10-03T10:18:16.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.508+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1470075192 wait complete. 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.509+0000 7fc6ed23a700 1 Processor -- start 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.509+0000 7fc6ed23a700 1 -- start start 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e809d6f0 0x7fc6e811dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 0x7fc6e811e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e8121110 con 0x7fc6e809e000 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e811fa30 con 0x7fc6e809e410 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6ed23a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e81215c0 con 0x7fc6e809d6f0 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e759e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54004/0 (socket says 172.21.15.19:54004) 2023-10-03T10:18:16.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e759e700 1 -- 172.21.15.19:0/1172595035 learned_addr learned my addr 172.21.15.19:0/1172595035 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 0x7fc6e811e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 -- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e809d6f0 msgr2=0x7fc6e811dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e809d6f0 0x7fc6e811dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 -- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 msgr2=0x7fc6e811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e659c700 1 -- 172.21.15.19:0/1172595035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d800d940 con 0x7fc6e809e000 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.510+0000 7fc6e759e700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6e659c700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 0x7fc6e811e2c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e900 tx=0x7fc6dc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00ee50 con 0x7fc6e809e000 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc00c850 con 0x7fc6e809e000 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e80a2000 con 0x7fc6e809e000 2023-10-03T10:18:16.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc00cbc0 con 0x7fc6e809e000 2023-10-03T10:18:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.511+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e81218a0 con 0x7fc6e809e000 2023-10-03T10:18:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.512+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc6dc00cd20 con 0x7fc6e809e000 2023-10-03T10:18:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.512+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc6dc03faa0 con 0x7fc6e809e000 2023-10-03T10:18:16.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.512+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e8074ea0 con 0x7fc6e809e000 2023-10-03T10:18:16.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.517+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc6dc01b3b0 con 0x7fc6e809e000 2023-10-03T10:18:16.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.601+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f732c06b9e0 con 0x7f732c06fb20 2023-10-03T10:18:16.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.601+0000 7f73137fe700 1 -- 172.21.15.19:0/3719592983 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f731c021020 con 0x7f732c06fb20 2023-10-03T10:18:16.601 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 msgr2=0x7f732c11d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f731c00ebe0 tx=0x7f731c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 shutdown_connections 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f732c130e50 0x7f732c11db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f732c06fb20 0x7f732c11d0e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 --2- 172.21.15.19:0/3719592983 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f732c130540 0x7f732c11d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 >> 172.21.15.19:0/3719592983 conn(0x7f732c0a2aa0 msgr2=0x7f732c12d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 shutdown_connections 2023-10-03T10:18:16.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.604+0000 7f733111d700 1 -- 172.21.15.19:0/3719592983 wait complete. 2023-10-03T10:18:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.611+0000 7fc3a8937700 1 Processor -- start 2023-10-03T10:18:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.611+0000 7fc3a8937700 1 -- start start 2023-10-03T10:18:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a8937700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a8937700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 0x7fc3a409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a8937700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a406ef30 con 0x7fc3a409e760 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a8937700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a406fef0 con 0x7fc3a409de50 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a8937700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a41334b0 con 0x7fc3a41338a0 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36806/0 (socket says 172.21.15.19:36806) 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a259c700 1 -- 172.21.15.19:0/2647763195 learned_addr learned my addr 172.21.15.19:0/2647763195 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a1d9b700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 0x7fc3a409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a1d9b700 1 -- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 msgr2=0x7fc3a4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a1d9b700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a1d9b700 1 -- 172.21.15.19:0/2647763195 >> v1:172.21.15.19:6789/0 conn(0x7fc3a409e760 legacy=0x7fc3a413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.612+0000 7fc3a1d9b700 1 -- 172.21.15.19:0/2647763195 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a406fc30 con 0x7fc3a409de50 2023-10-03T10:18:16.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.613+0000 7fc3a1d9b700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 0x7fc3a409e220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc398009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=682ef36a24234dc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.613+0000 7fc3a159a700 1 -- 172.21.15.19:0/2647763195 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011830 con 0x7fc3a409de50 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.613+0000 7fc3a159a700 1 -- 172.21.15.19:0/2647763195 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc398011990 con 0x7fc3a409de50 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.613+0000 7fc3a159a700 1 -- 172.21.15.19:0/2647763195 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc398011d20 con 0x7fc3a409de50 2023-10-03T10:18:16.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 -- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 msgr2=0x7fc3a409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 0x7fc3a409e220 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc398009870 tx=0x7fc398009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 -- 172.21.15.19:0/2647763195 shutdown_connections 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 --2- 172.21.15.19:0/2647763195 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409de50 0x7fc3a409e220 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 -- 172.21.15.19:0/2647763195 >> 172.21.15.19:0/2647763195 conn(0x7fc3a40a2aa0 msgr2=0x7fc3a40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 -- 172.21.15.19:0/2647763195 shutdown_connections 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.614+0000 7fc3a8937700 1 -- 172.21.15.19:0/2647763195 wait complete. 2023-10-03T10:18:16.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.615+0000 7fc3a8937700 1 Processor -- start 2023-10-03T10:18:16.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 -- start start 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 0x7fc3a41200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4130720 con 0x7fc3a409de50 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4122d40 con 0x7fc3a409e760 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a8937700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a4121730 con 0x7fc3a41338a0 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.616+0000 7fc3a259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41046/0 (socket says 172.21.15.19:41046) 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 -- 172.21.15.19:0/1642585199 learned_addr learned my addr 172.21.15.19:0/1642585199 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a2d9d700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a1d9b700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 0x7fc3a41200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 -- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 msgr2=0x7fc3a4120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 -- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 msgr2=0x7fc3a41200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 0x7fc3a41200f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 -- 172.21.15.19:0/1642585199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3980094a0 con 0x7fc3a409de50 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a1d9b700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 0x7fc3a41200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:16.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc3a259c700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e940 tx=0x7fc39400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:16.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.617+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940096a0 con 0x7fc3a409de50 2023-10-03T10:18:16.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.618+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394013680 con 0x7fc3a409de50 2023-10-03T10:18:16.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.618+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394013a30 con 0x7fc3a409de50 2023-10-03T10:18:16.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.618+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a4123640 con 0x7fc3a409de50 2023-10-03T10:18:16.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.618+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a406f6a0 con 0x7fc3a409de50 2023-10-03T10:18:16.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.619+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc394013b90 con 0x7fc3a409de50 2023-10-03T10:18:16.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.619+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc39403f5e0 con 0x7fc3a409de50 2023-10-03T10:18:16.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.619+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a4074ea0 con 0x7fc3a409de50 2023-10-03T10:18:16.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:16.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.624+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc39400c450 con 0x7fc3a409de50 2023-10-03T10:18:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.728+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc6e806c360 con 0x7fc6e809e000 2023-10-03T10:18:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.728+0000 7fc6cf7fe700 1 -- 172.21.15.19:0/1172595035 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc6dc017020 con 0x7fc6e809e000 2023-10-03T10:18:16.728 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 msgr2=0x7fc6e811e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 0x7fc6e811e2c0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e900 tx=0x7fc6dc00ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 shutdown_connections 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc6e809e410 0x7fc6e811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc6e809d6f0 0x7fc6e811dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 --2- 172.21.15.19:0/1172595035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6e809e000 0x7fc6e811e2c0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 >> 172.21.15.19:0/1172595035 conn(0x7fc6e8066f50 msgr2=0x7fc6e809fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 shutdown_connections 2023-10-03T10:18:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.730+0000 7fc6ed23a700 1 -- 172.21.15.19:0/1172595035 wait complete. 2023-10-03T10:18:16.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:16.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.753+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0188074ea0 con 0x7f0188133540 2023-10-03T10:18:16.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.753+0000 7f01857fa700 1 -- 172.21.15.19:0/1563984830 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f017402b3d0 con 0x7f0188133540 2023-10-03T10:18:16.753 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.755+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 msgr2=0x7f018809d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.755+0000 7f018f218700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0188070da0 tx=0x7f0174004750 comp rx=0 tx=0).stop 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 shutdown_connections 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0188135e60 0x7f01881c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0188130540 0x7f018809d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 --2- 172.21.15.19:0/1563984830 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0188133540 0x7f018809d780 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 >> 172.21.15.19:0/1563984830 conn(0x7f01880a2aa0 msgr2=0x7f0188131300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 shutdown_connections 2023-10-03T10:18:16.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.756+0000 7f018f218700 1 -- 172.21.15.19:0/1563984830 wait complete. 2023-10-03T10:18:16.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:16.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.833+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3a4123420 con 0x7fc3a409de50 2023-10-03T10:18:16.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.834+0000 7fc392ffd700 1 -- 172.21.15.19:0/1642585199 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc394021030 con 0x7fc3a409de50 2023-10-03T10:18:16.834 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:16.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 msgr2=0x7fc3a411fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:16.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fc39400e940 tx=0x7fc39400ec50 comp rx=0 tx=0).stop 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 shutdown_connections 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3a41338a0 0x7fc3a4120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3a409de50 0x7fc3a411fbb0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 --2- 172.21.15.19:0/1642585199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3a409e760 0x7fc3a41200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 >> 172.21.15.19:0/1642585199 conn(0x7fc3a40a2aa0 msgr2=0x7fc3a409ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 shutdown_connections 2023-10-03T10:18:16.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:16.836+0000 7fc3a8937700 1 -- 172.21.15.19:0/1642585199 wait complete. 2023-10-03T10:18:16.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:17.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:17.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.769+0000 7f7b71e1d700 1 Processor -- start 2023-10-03T10:18:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 -- start start 2023-10-03T10:18:17.770 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c070940 con 0x7f7b6c09f650 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c06fd60 con 0x7f7b6c09f240 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b71e1d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c06fa80 con 0x7f7b6c09e930 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54030/0 (socket says 172.21.15.19:54030) 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36826/0 (socket says 172.21.15.19:36826) 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6affd700 1 -- 172.21.15.19:0/2640132038 learned_addr learned my addr 172.21.15.19:0/2640132038 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.770+0000 7f7b6bfff700 1 --1- 172.21.15.19:0/2640132038 >> v1:172.21.15.19:6789/0 conn(0x7f7b6c09f650 0x7f7b6c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40090/0 (socket says 172.21.15.19:40090) 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6b7fe700 1 -- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 msgr2=0x7f7b6c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6a7fc700 1 -- 172.21.15.19:0/2640132038 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761365225 0 0) 0x7f7b6c070940 con 0x7f7b6c09f650 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6b7fe700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6b7fe700 1 -- 172.21.15.19:0/2640132038 >> v1:172.21.15.19:6789/0 conn(0x7f7b6c09f650 legacy=0x7f7b6c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6b7fe700 1 -- 172.21.15.19:0/2640132038 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c09fb60 con 0x7f7b6c09e930 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6affd700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6b7fe700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009870 tx=0x7f7b5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36a9237e5a4b802 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6a7fc700 1 -- 172.21.15.19:0/2640132038 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011830 con 0x7f7b6c09e930 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6a7fc700 1 -- 172.21.15.19:0/2640132038 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c011990 con 0x7f7b6c09e930 2023-10-03T10:18:17.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.771+0000 7f7b6a7fc700 1 -- 172.21.15.19:0/2640132038 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c011d20 con 0x7f7b6c09e930 2023-10-03T10:18:17.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 -- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 msgr2=0x7f7b6c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c009870 tx=0x7f7b5c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:17.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 -- 172.21.15.19:0/2640132038 shutdown_connections 2023-10-03T10:18:17.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09e930 0x7f7b6c09ed00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/2640132038 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 -- 172.21.15.19:0/2640132038 >> 172.21.15.19:0/2640132038 conn(0x7f7b6c0a4210 msgr2=0x7f7b6c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 -- 172.21.15.19:0/2640132038 shutdown_connections 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.772+0000 7f7b71e1d700 1 -- 172.21.15.19:0/2640132038 wait complete. 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.774+0000 7f7b71e1d700 1 Processor -- start 2023-10-03T10:18:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.774+0000 7f7b71e1d700 1 -- start start 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 0x7f7b6c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1a87e0 con 0x7f7b6c09e930 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0a3260 con 0x7f7b6c09f240 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b71e1d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c06d470 con 0x7f7b6c09f650 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54042/0 (socket says 172.21.15.19:54042) 2023-10-03T10:18:17.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36832/0 (socket says 172.21.15.19:36832) 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6affd700 1 -- 172.21.15.19:0/4125707903 learned_addr learned my addr 172.21.15.19:0/4125707903 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.775+0000 7f7b6b7fe700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 0x7f7b6c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 -- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 msgr2=0x7f7b6c06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 -- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 msgr2=0x7f7b6c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 0x7f7b6c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 -- 172.21.15.19:0/4125707903 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60009550 con 0x7f7b6c09f240 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6bfff700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6b7fe700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 0x7f7b6c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b6affd700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000ebe0 tx=0x7f7b6000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000c850 con 0x7f7b6c09f240 2023-10-03T10:18:17.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6000c9b0 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c0094a0 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.776+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000cd60 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.777+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c0a0190 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.778+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7b60013470 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.778+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c1a0b30 con 0x7f7b6c09f240 2023-10-03T10:18:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.778+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7b6003f740 con 0x7f7b6c09f240 2023-10-03T10:18:17.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.783+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7b600232f0 con 0x7f7b6c09f240 2023-10-03T10:18:17.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:17.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.888+0000 7f535099a700 1 Processor -- start 2023-10-03T10:18:17.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.888+0000 7f535099a700 1 -- start start 2023-10-03T10:18:17.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f535099a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 0x7f534c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f535099a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f534c09de50 0x7f534c09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f535099a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f534c06ef30 con 0x7f534c09e760 2023-10-03T10:18:17.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f535099a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f534c06fef0 con 0x7f534c09de50 2023-10-03T10:18:17.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f535099a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f534c1334b0 con 0x7f534c1338a0 2023-10-03T10:18:17.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 0x7f534c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f534c09e760 0x7f534c13a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40096/0 (socket says 172.21.15.19:40096) 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534ad9d700 1 -- 172.21.15.19:0/2854774957 learned_addr learned my addr 172.21.15.19:0/2854774957 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f5349d9b700 1 --2- 172.21.15.19:0/2854774957 >> v2:172.21.15.19:3300/0 conn(0x7f534c09de50 0x7f534c09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534a59c700 1 -- 172.21.15.19:0/2854774957 >> v2:172.21.15.19:3300/0 conn(0x7f534c09de50 msgr2=0x7f534c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534a59c700 1 --2- 172.21.15.19:0/2854774957 >> v2:172.21.15.19:3300/0 conn(0x7f534c09de50 0x7f534c09e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534959a700 1 -- 172.21.15.19:0/2854774957 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064540801 0 0) 0x7f534c06ef30 con 0x7f534c09e760 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534a59c700 1 -- 172.21.15.19:0/2854774957 >> v1:172.21.15.19:6789/0 conn(0x7f534c09e760 legacy=0x7f534c13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.889+0000 7f534a59c700 1 -- 172.21.15.19:0/2854774957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534c06fc30 con 0x7f534c1338a0 2023-10-03T10:18:17.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.890+0000 7f534a59c700 1 --2- 172.21.15.19:0/2854774957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 0x7f534c133c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f533c009840 tx=0x7f533c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ae64c74dfb2b889 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.890+0000 7f534959a700 1 -- 172.21.15.19:0/2854774957 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c011830 con 0x7f534c1338a0 2023-10-03T10:18:17.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.890+0000 7f534959a700 1 -- 172.21.15.19:0/2854774957 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533c011990 con 0x7f534c1338a0 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.890+0000 7f534959a700 1 -- 172.21.15.19:0/2854774957 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533c011d20 con 0x7f534c1338a0 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 -- 172.21.15.19:0/2854774957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 msgr2=0x7f534c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 --2- 172.21.15.19:0/2854774957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 0x7f534c133c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f533c009840 tx=0x7f533c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 -- 172.21.15.19:0/2854774957 shutdown_connections 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 --2- 172.21.15.19:0/2854774957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c1338a0 0x7f534c133c70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 --2- 172.21.15.19:0/2854774957 >> v2:172.21.15.19:3300/0 conn(0x7f534c09de50 0x7f534c09e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 -- 172.21.15.19:0/2854774957 >> 172.21.15.19:0/2854774957 conn(0x7f534c0a2aa0 msgr2=0x7f534c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 -- 172.21.15.19:0/2854774957 shutdown_connections 2023-10-03T10:18:17.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.891+0000 7f535099a700 1 -- 172.21.15.19:0/2854774957 wait complete. 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.892+0000 7f535099a700 1 Processor -- start 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.892+0000 7f535099a700 1 -- start start 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c09e760 0x7f534c11ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 0x7f534c11b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534c11c890 con 0x7f534c09de50 2023-10-03T10:18:17.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f534c11e150 con 0x7f534c1338a0 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f535099a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f534c11d520 con 0x7f534c09e760 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 0x7f534c11b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41070/0 (socket says 172.21.15.19:41070) 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534a59c700 1 -- 172.21.15.19:0/3036315466 learned_addr learned my addr 172.21.15.19:0/3036315466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 -- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c09e760 msgr2=0x7f534c11ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c09e760 0x7f534c11ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 -- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 msgr2=0x7f534c11a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534ad9d700 1 -- 172.21.15.19:0/3036315466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0094a0 con 0x7f534c1338a0 2023-10-03T10:18:17.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.893+0000 7f534a59c700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f534ad9d700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 0x7f534c11b0b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f534400cbe0 tx=0x7f534400cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534400aaf0 con 0x7f534c1338a0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534400ac70 con 0x7f534c1338a0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53440070d0 con 0x7f534c1338a0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534c11ba70 con 0x7f534c1338a0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.894+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534c11c240 con 0x7f534c1338a0 2023-10-03T10:18:17.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.895+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5344007230 con 0x7f534c1338a0 2023-10-03T10:18:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.895+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f534403f130 con 0x7f534c1338a0 2023-10-03T10:18:17.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.896+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534c074ea0 con 0x7f534c1338a0 2023-10-03T10:18:17.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.905+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5344018080 con 0x7f534c1338a0 2023-10-03T10:18:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.915+0000 7f4ba7ff3700 1 Processor -- start 2023-10-03T10:18:17.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 -- start start 2023-10-03T10:18:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 0x7f4ba00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 0x7f4ba00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 0x7f4ba0133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba00a2a70 con 0x7f4ba0133930 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a01d0 con 0x7f4ba009d630 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba7ff3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba009e2b0 con 0x7f4ba00a0a30 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba6590700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 0x7f4ba0133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba6590700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 0x7f4ba0133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41086/0 (socket says 172.21.15.19:41086) 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba5d8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 0x7f4ba00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.916+0000 7f4ba6590700 1 -- 172.21.15.19:0/3672647484 learned_addr learned my addr 172.21.15.19:0/3672647484 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:17.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba558e700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 0x7f4ba00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 msgr2=0x7f4ba00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 0x7f4ba00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/3672647484 >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 msgr2=0x7f4ba0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/3672647484 >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 0x7f4ba0133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/3672647484 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba009dc50 con 0x7f4ba00a0a30 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba558e700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 0x7f4ba00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 0x7f4ba00a0e00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009840 tx=0x7f4b9c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4596c6584515ab6a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba4d8d700 1 -- 172.21.15.19:0/3672647484 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011830 con 0x7f4ba00a0a30 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba4d8d700 1 -- 172.21.15.19:0/3672647484 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c011990 con 0x7f4ba00a0a30 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.917+0000 7f4ba4d8d700 1 -- 172.21.15.19:0/3672647484 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c011d20 con 0x7f4ba00a0a30 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 msgr2=0x7f4ba00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 0x7f4ba00a0e00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c009840 tx=0x7f4b9c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/3672647484 shutdown_connections 2023-10-03T10:18:17.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/3672647484 >> v2:172.21.15.19:3300/0 conn(0x7f4ba0133930 0x7f4ba0133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba00a0a30 0x7f4ba00a0e00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/3672647484 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba009d630 0x7f4ba00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/3672647484 >> 172.21.15.19:0/3672647484 conn(0x7f4ba00a3050 msgr2=0x7f4ba00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/3672647484 shutdown_connections 2023-10-03T10:18:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.918+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/3672647484 wait complete. 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.919+0000 7f4ba7ff3700 1 Processor -- start 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.919+0000 7f4ba7ff3700 1 -- start start 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a0a30 0x7f4ba01c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 0x7f4ba01c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0122240 con 0x7f4ba00a0a30 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba0120530 con 0x7f4ba0133930 2023-10-03T10:18:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba7ff3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba00a0410 con 0x7f4ba009d630 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36890/0 (socket says 172.21.15.19:36890) 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/2555037769 learned_addr learned my addr 172.21.15.19:0/2555037769 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba558e700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a0a30 0x7f4ba01c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba6590700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 0x7f4ba01c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 msgr2=0x7f4ba01c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 0x7f4ba01c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a0a30 msgr2=0x7f4ba01c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a0a30 0x7f4ba01c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba5d8f700 1 -- 172.21.15.19:0/2555037769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900094a0 con 0x7f4ba009d630 2023-10-03T10:18:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.920+0000 7f4ba6590700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 0x7f4ba01c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4ba5d8f700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c004450 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c01f070 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c0094a0 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0038e0 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.921+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba0120d20 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.922+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b9c003a40 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.922+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b9c021070 con 0x7f4ba009d630 2023-10-03T10:18:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.922+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba0121f00 con 0x7f4ba009d630 2023-10-03T10:18:17.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.927+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4ba0121f00 con 0x7f4ba009d630 2023-10-03T10:18:17.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.994+0000 7f2343d65700 1 Processor -- start 2023-10-03T10:18:17.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 -- start start 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f233c09d6f0 0x7f233c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 0x7f233c130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c09f130 con 0x7f233c09e000 2023-10-03T10:18:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c09f520 con 0x7f233c09d6f0 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.995+0000 7f2343d65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f233c09e930 con 0x7f233c09e410 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2341300700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f233c09e000 0x7f233c130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40110/0 (socket says 172.21.15.19:40110) 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 0x7f233c130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2341300700 1 -- 172.21.15.19:0/469762122 learned_addr learned my addr 172.21.15.19:0/469762122 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2341b01700 1 --2- 172.21.15.19:0/469762122 >> v2:172.21.15.19:3300/0 conn(0x7f233c09d6f0 0x7f233c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 -- 172.21.15.19:0/469762122 >> v2:172.21.15.19:3300/0 conn(0x7f233c09d6f0 msgr2=0x7f233c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 --2- 172.21.15.19:0/469762122 >> v2:172.21.15.19:3300/0 conn(0x7f233c09d6f0 0x7f233c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2340aff700 1 -- 172.21.15.19:0/469762122 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903693828 0 0) 0x7f233c09f130 con 0x7f233c09e000 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 -- 172.21.15.19:0/469762122 >> v1:172.21.15.19:6789/0 conn(0x7f233c09e000 legacy=0x7f233c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 -- 172.21.15.19:0/469762122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c09b2d0 con 0x7f233c09e410 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2342302700 1 --2- 172.21.15.19:0/469762122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 0x7f233c130d70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13601423c43d5a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.996+0000 7f2340aff700 1 -- 172.21.15.19:0/469762122 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233400e070 con 0x7f233c09e410 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2340aff700 1 -- 172.21.15.19:0/469762122 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233400bbd0 con 0x7f233c09e410 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2340aff700 1 -- 172.21.15.19:0/469762122 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012430 con 0x7f233c09e410 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 -- 172.21.15.19:0/469762122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 msgr2=0x7f233c130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 --2- 172.21.15.19:0/469762122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 0x7f233c130d70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2334009d90 tx=0x7f233400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 -- 172.21.15.19:0/469762122 shutdown_connections 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 --2- 172.21.15.19:0/469762122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09e410 0x7f233c130d70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 --2- 172.21.15.19:0/469762122 >> v2:172.21.15.19:3300/0 conn(0x7f233c09d6f0 0x7f233c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 -- 172.21.15.19:0/469762122 >> 172.21.15.19:0/469762122 conn(0x7f233c066f50 msgr2=0x7f233c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 -- 172.21.15.19:0/469762122 shutdown_connections 2023-10-03T10:18:17.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.997+0000 7f2343d65700 1 -- 172.21.15.19:0/469762122 wait complete. 2023-10-03T10:18:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.998+0000 7f2343d65700 1 Processor -- start 2023-10-03T10:18:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.998+0000 7f2343d65700 1 -- start start 2023-10-03T10:18:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09d6f0 0x7f233c138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 0x7f233c138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 0x7f233c1393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c138380 con 0x7f233c09e000 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c139dc0 con 0x7f233c09e410 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2343d65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f233c09c700 con 0x7f233c09d6f0 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2341300700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 0x7f233c138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2341b01700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09d6f0 0x7f233c138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2341300700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 0x7f233c138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41094/0 (socket says 172.21.15.19:41094) 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2341300700 1 -- 172.21.15.19:0/2131977286 learned_addr learned my addr 172.21.15.19:0/2131977286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:17.999+0000 7f2342302700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 0x7f233c1393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 -- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09d6f0 msgr2=0x7f233c138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09d6f0 0x7f233c138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 -- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 msgr2=0x7f233c138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 0x7f233c138ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 -- 172.21.15.19:0/2131977286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009a70 con 0x7f233c09e410 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2342302700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 0x7f233c1393e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f233c072a80 tx=0x7f2334004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334012430 con 0x7f233c09e410 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2334020070 con 0x7f233c09e410 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0a39f0 con 0x7f233c09e410 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334004040 con 0x7f233c09e410 2023-10-03T10:18:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.000+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c1376e0 con 0x7f233c09e410 2023-10-03T10:18:18.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.001+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23340041a0 con 0x7f233c09e410 2023-10-03T10:18:18.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.001+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c137330 con 0x7f233c09e410 2023-10-03T10:18:18.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.002+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2334022070 con 0x7f233c09e410 2023-10-03T10:18:18.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.006+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f233401a380 con 0x7f233c09e410 2023-10-03T10:18:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.024+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7b6c074ea0 con 0x7f7b6c09f240 2023-10-03T10:18:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.024+0000 7f7b53fff700 1 -- 172.21.15.19:0/4125707903 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b60021030 con 0x7f7b6c09f240 2023-10-03T10:18:18.024 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 msgr2=0x7f7b6c06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000ebe0 tx=0x7f7b6000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 shutdown_connections 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7b6c09f650 0x7f7b6c06c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b6c09e930 0x7f7b6c06b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 --2- 172.21.15.19:0/4125707903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7b6c09f240 0x7f7b6c06bdc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 >> 172.21.15.19:0/4125707903 conn(0x7f7b6c0a4210 msgr2=0x7f7b6c1b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 shutdown_connections 2023-10-03T10:18:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.027+0000 7f7b71e1d700 1 -- 172.21.15.19:0/4125707903 wait complete. 2023-10-03T10:18:18.042 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:18.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.136+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f534c06b9e0 con 0x7f534c1338a0 2023-10-03T10:18:18.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.136+0000 7f533affd700 1 -- 172.21.15.19:0/3036315466 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f53440074e0 con 0x7f534c1338a0 2023-10-03T10:18:18.136 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.138+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 msgr2=0x7f534c11b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.138+0000 7f535099a700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 0x7f534c11b0b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f534400cbe0 tx=0x7f534400cef0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 shutdown_connections 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f534c1338a0 0x7f534c11b0b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f534c09de50 0x7f534c11a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 --2- 172.21.15.19:0/3036315466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f534c09e760 0x7f534c11ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 >> 172.21.15.19:0/3036315466 conn(0x7f534c0a2aa0 msgr2=0x7f534c130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 shutdown_connections 2023-10-03T10:18:18.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.139+0000 7f535099a700 1 -- 172.21.15.19:0/3036315466 wait complete. 2023-10-03T10:18:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.141+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ba0121f00 con 0x7f4ba009d630 2023-10-03T10:18:18.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.142+0000 7f4b967fc700 1 -- 172.21.15.19:0/2555037769 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4ba0121f00 con 0x7f4ba009d630 2023-10-03T10:18:18.142 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.145+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 msgr2=0x7f4ba01c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.145+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c000c00 tx=0x7f4b9c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:18.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.145+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 shutdown_connections 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4ba0133930 0x7f4ba01c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4ba009d630 0x7f4ba01c8000 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 --2- 172.21.15.19:0/2555037769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ba00a0a30 0x7f4ba01c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 >> 172.21.15.19:0/2555037769 conn(0x7f4ba00a3050 msgr2=0x7f4ba009ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 shutdown_connections 2023-10-03T10:18:18.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.146+0000 7f4ba7ff3700 1 -- 172.21.15.19:0/2555037769 wait complete. 2023-10-03T10:18:18.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:18.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:18.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.214+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f233c074ea0 con 0x7f233c09e410 2023-10-03T10:18:18.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.215+0000 7f23327fc700 1 -- 172.21.15.19:0/2131977286 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2334011b80 con 0x7f233c09e410 2023-10-03T10:18:18.215 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 msgr2=0x7f233c1393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 0x7f233c1393e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f233c072a80 tx=0x7f2334004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 shutdown_connections 2023-10-03T10:18:18.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f233c09e410 0x7f233c1393e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f233c09d6f0 0x7f233c138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 --2- 172.21.15.19:0/2131977286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c09e000 0x7f233c138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 >> 172.21.15.19:0/2131977286 conn(0x7f233c066f50 msgr2=0x7f233c070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 shutdown_connections 2023-10-03T10:18:18.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:18.217+0000 7f2343d65700 1 -- 172.21.15.19:0/2131977286 wait complete. 2023-10-03T10:18:18.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:19.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:19.156 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:19.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 Processor -- start 2023-10-03T10:18:19.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 -- start start 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 0x7fef18138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1809edd0 con 0x7fef180a0a30 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef180a18e0 con 0x7fef180a1510 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1ee58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef1809e1f0 con 0x7fef18139250 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1d3f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1d3f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36916/0 (socket says 172.21.15.19:36916) 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1d3f5700 1 -- 172.21.15.19:0/2759506819 learned_addr learned my addr 172.21.15.19:0/2759506819 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef1cbf4700 1 --1- 172.21.15.19:0/2759506819 >> v1:172.21.15.19:6789/0 conn(0x7fef180a0a30 0x7fef180a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40122/0 (socket says 172.21.15.19:40122) 2023-10-03T10:18:19.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.190+0000 7fef17fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 0x7fef18138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef1d3f5700 1 -- 172.21.15.19:0/2759506819 >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 msgr2=0x7fef18138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef1d3f5700 1 --2- 172.21.15.19:0/2759506819 >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 0x7fef18138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef1d3f5700 1 -- 172.21.15.19:0/2759506819 >> v1:172.21.15.19:6789/0 conn(0x7fef180a0a30 legacy=0x7fef180a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef1d3f5700 1 -- 172.21.15.19:0/2759506819 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1809dc50 con 0x7fef18139250 2023-10-03T10:18:19.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef17fff700 1 --2- 172.21.15.19:0/2759506819 >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 0x7fef18138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef1d3f5700 1 --2- 172.21.15.19:0/2759506819 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea76bf380a30b0d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef177fe700 1 -- 172.21.15.19:0/2759506819 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000e070 con 0x7fef18139250 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef177fe700 1 -- 172.21.15.19:0/2759506819 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1000b910 con 0x7fef18139250 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.191+0000 7fef177fe700 1 -- 172.21.15.19:0/2759506819 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1000bc80 con 0x7fef18139250 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 -- 172.21.15.19:0/2759506819 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 msgr2=0x7fef1813b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 --2- 172.21.15.19:0/2759506819 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fef10009e50 tx=0x7fef1000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 -- 172.21.15.19:0/2759506819 shutdown_connections 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 --2- 172.21.15.19:0/2759506819 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef18139250 0x7fef1813b630 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 --2- 172.21.15.19:0/2759506819 >> v2:172.21.15.19:3300/0 conn(0x7fef180a1510 0x7fef18138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 -- 172.21.15.19:0/2759506819 >> 172.21.15.19:0/2759506819 conn(0x7fef180a6550 msgr2=0x7fef180a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 -- 172.21.15.19:0/2759506819 shutdown_connections 2023-10-03T10:18:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.192+0000 7fef1ee58700 1 -- 172.21.15.19:0/2759506819 wait complete. 2023-10-03T10:18:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.193+0000 7fef1ee58700 1 Processor -- start 2023-10-03T10:18:19.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.193+0000 7fef1ee58700 1 -- start start 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 0x7fef181228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef18139250 0x7fef18123340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef18138160 con 0x7fef180a0a30 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef18138720 con 0x7fef18139250 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef1ee58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef181244e0 con 0x7fef180a1510 2023-10-03T10:18:19.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef17fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef17fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36926/0 (socket says 172.21.15.19:36926) 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.194+0000 7fef17fff700 1 -- 172.21.15.19:0/1580132233 learned_addr learned my addr 172.21.15.19:0/1580132233 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef1cbf4700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 0x7fef181228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef1d3f5700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef18139250 0x7fef18123340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 -- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef18139250 msgr2=0x7fef18123340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef18139250 0x7fef18123340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 -- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 msgr2=0x7fef181228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 0x7fef181228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 -- 172.21.15.19:0/1580132233 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0094a0 con 0x7fef180a1510 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef1cbf4700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 0x7fef181228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef17fff700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00ebe0 tx=0x7fef0c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00c850 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c00c9b0 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10009b30 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.195+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00cd40 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.196+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef18125ac0 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.196+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef0c013470 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.197+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef0c03fb10 con 0x7fef180a1510 2023-10-03T10:18:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.197+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef18074ea0 con 0x7fef180a1510 2023-10-03T10:18:19.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.206+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef0c013720 con 0x7fef180a1510 2023-10-03T10:18:19.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:19.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.305+0000 7f44dbae2700 1 Processor -- start 2023-10-03T10:18:19.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.305+0000 7f44dbae2700 1 -- start start 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 0x7f44d406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 0x7f44d4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f44d4131b40 0x7f44d4131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d409ece0 con 0x7f44d4131b40 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d409e760 con 0x7f44d406b080 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44dbae2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d409e040 con 0x7f44d406a770 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44d907d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 0x7f44d4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44d907d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 0x7f44d4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54074/0 (socket says 172.21.15.19:54074) 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44d907d700 1 -- 172.21.15.19:0/3517507418 learned_addr learned my addr 172.21.15.19:0/3517507418 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44d987e700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 0x7f44d406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.306+0000 7f44da07f700 1 --2- 172.21.15.19:0/3517507418 >> v2:172.21.15.19:3300/0 conn(0x7f44d4131b40 0x7f44d4131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 -- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 msgr2=0x7f44d4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 0x7f44d4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 -- 172.21.15.19:0/3517507418 >> v2:172.21.15.19:3300/0 conn(0x7f44d4131b40 msgr2=0x7f44d4131fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 --2- 172.21.15.19:0/3517507418 >> v2:172.21.15.19:3300/0 conn(0x7f44d4131b40 0x7f44d4131fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 -- 172.21.15.19:0/3517507418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d409f630 con 0x7f44d406a770 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d987e700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 0x7f44d406ab40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009840 tx=0x7f44d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce62726709032af6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d887c700 1 -- 172.21.15.19:0/3517507418 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0010a90 con 0x7f44d406a770 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d887c700 1 -- 172.21.15.19:0/3517507418 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d0010bf0 con 0x7f44d406a770 2023-10-03T10:18:19.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.307+0000 7f44d887c700 1 -- 172.21.15.19:0/3517507418 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0018440 con 0x7f44d406a770 2023-10-03T10:18:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 -- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 msgr2=0x7f44d406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 0x7f44d406ab40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009840 tx=0x7f44d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 -- 172.21.15.19:0/3517507418 shutdown_connections 2023-10-03T10:18:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 --2- 172.21.15.19:0/3517507418 >> v2:172.21.15.19:3300/0 conn(0x7f44d4131b40 0x7f44d4131fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406a770 0x7f44d406ab40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 --2- 172.21.15.19:0/3517507418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d406b080 0x7f44d4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 -- 172.21.15.19:0/3517507418 >> 172.21.15.19:0/3517507418 conn(0x7f44d4066f50 msgr2=0x7f44d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 -- 172.21.15.19:0/3517507418 shutdown_connections 2023-10-03T10:18:19.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.308+0000 7f44dbae2700 1 -- 172.21.15.19:0/3517507418 wait complete. 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 Processor -- start 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 -- start start 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 0x7f44d411af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 0x7f44d411b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d411ea20 con 0x7f44d406a770 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d411c3b0 con 0x7f44d4131b40 2023-10-03T10:18:19.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.310+0000 7f44dbae2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44d411ddd0 con 0x7f44d406b080 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d907d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d907d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36946/0 (socket says 172.21.15.19:36946) 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d907d700 1 -- 172.21.15.19:0/4034881551 learned_addr learned my addr 172.21.15.19:0/4034881551 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d987e700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 0x7f44d411af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 0x7f44d411b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 -- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 msgr2=0x7f44d411b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 -- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 msgr2=0x7f44d411af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 0x7f44d411af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44da07f700 1 -- 172.21.15.19:0/4034881551 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00094a0 con 0x7f44d4131b40 2023-10-03T10:18:19.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d987e700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 0x7f44d411af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.311+0000 7f44d907d700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44da07f700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 0x7f44d411b9d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007dc0 tx=0x7f44cc00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc018070 con 0x7f44d4131b40 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44cc00eb30 con 0x7f44d4131b40 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00eec0 con 0x7f44d4131b40 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d412e3b0 con 0x7f44d4131b40 2023-10-03T10:18:19.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.312+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d40a38a0 con 0x7f44d4131b40 2023-10-03T10:18:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.313+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d411f2c0 con 0x7f44d4131b40 2023-10-03T10:18:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.314+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f44cc003a20 con 0x7f44d4131b40 2023-10-03T10:18:19.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.314+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f44cc013380 con 0x7f44d4131b40 2023-10-03T10:18:19.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.323+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44cc044060 con 0x7f44d4131b40 2023-10-03T10:18:19.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.335+0000 7f6ecca2d700 1 Processor -- start 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 -- start start 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec809eca0 0x7f6ec813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec8070ee0 con 0x7f6ec806e570 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8071980 con 0x7f6ec809eca0 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ecca2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8071480 con 0x7f6ec806f050 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ec6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36950/0 (socket says 172.21.15.19:36950) 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 -- 172.21.15.19:0/3000032727 learned_addr learned my addr 172.21.15.19:0/3000032727 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.336+0000 7f6ec659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ec806e570 0x7f6ec806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40134/0 (socket says 172.21.15.19:40134) 2023-10-03T10:18:19.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec5d9b700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec809eca0 0x7f6ec813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec559a700 1 -- 172.21.15.19:0/3000032727 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859389980 0 0) 0x7f6ec8070ee0 con 0x7f6ec806e570 2023-10-03T10:18:19.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec559a700 1 -- 172.21.15.19:0/3000032727 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb00035b0 con 0x7f6ec806e570 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 -- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec809eca0 msgr2=0x7f6ec813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec809eca0 0x7f6ec813cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 -- 172.21.15.19:0/3000032727 >> v1:172.21.15.19:6789/0 conn(0x7f6ec806e570 legacy=0x7f6ec806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 -- 172.21.15.19:0/3000032727 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8071b90 con 0x7f6ec806f050 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.337+0000 7f6ec6d9d700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d350f0098053f7f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ec559a700 1 -- 172.21.15.19:0/3000032727 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000e070 con 0x7f6ec806f050 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ec559a700 1 -- 172.21.15.19:0/3000032727 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec000b910 con 0x7f6ec806f050 2023-10-03T10:18:19.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ec559a700 1 -- 172.21.15.19:0/3000032727 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec000bcc0 con 0x7f6ec806f050 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 -- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 msgr2=0x7f6ec813f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009e80 tx=0x7f6ec000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 -- 172.21.15.19:0/3000032727 shutdown_connections 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec813f3f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/3000032727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec809eca0 0x7f6ec813cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.338+0000 7f6ecca2d700 1 -- 172.21.15.19:0/3000032727 >> 172.21.15.19:0/3000032727 conn(0x7f6ec80a2aa0 msgr2=0x7f6ec80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.339+0000 7f6ecca2d700 1 -- 172.21.15.19:0/3000032727 shutdown_connections 2023-10-03T10:18:19.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.339+0000 7f6ecca2d700 1 -- 172.21.15.19:0/3000032727 wait complete. 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 Processor -- start 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 -- start start 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec812f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec81364b0 0x7f6ec812fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8138ab0 con 0x7f6ec81364b0 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec8138020 con 0x7f6ec806e570 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ecca2d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec81387f0 con 0x7f6ec806f050 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ec659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.340+0000 7f6ec659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54098/0 (socket says 172.21.15.19:54098) 2023-10-03T10:18:19.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 -- 172.21.15.19:0/2701658714 learned_addr learned my addr 172.21.15.19:0/2701658714 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec5d9b700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec812f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec6d9d700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec81364b0 0x7f6ec812fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 -- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 msgr2=0x7f6ec812f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec812f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 -- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec81364b0 msgr2=0x7f6ec812fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec81364b0 0x7f6ec812fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 -- 172.21.15.19:0/2701658714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec0009b30 con 0x7f6ec806e570 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ec659c700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c700 tx=0x7f6eb800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8005cb0 con 0x7f6ec806e570 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8005e10 con 0x7f6ec806e570 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec8130c60 con 0x7f6ec806e570 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.341+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80072d0 con 0x7f6ec806e570 2023-10-03T10:18:19.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.342+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec8139290 con 0x7f6ec806e570 2023-10-03T10:18:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.343+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6eb8007430 con 0x7f6ec806e570 2023-10-03T10:18:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.343+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec8138c20 con 0x7f6ec806e570 2023-10-03T10:18:19.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.343+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6eb803ea40 con 0x7f6ec806e570 2023-10-03T10:18:19.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.352+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6eb8012400 con 0x7f6ec806e570 2023-10-03T10:18:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.392+0000 7f13d64df700 1 Processor -- start 2023-10-03T10:18:19.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.392+0000 7f13d64df700 1 -- start start 2023-10-03T10:18:19.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.393+0000 7f13d64df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 0x7f13d00a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.393+0000 7f13d64df700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 0x7f13d00a13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.393+0000 7f13d64df700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00a1e00 con 0x7f13d013c120 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.393+0000 7f13d64df700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d006d060 con 0x7f13d00a0f70 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.393+0000 7f13d64df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00a2550 con 0x7f13d006cc90 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13d4a7c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f13d013c120 0x7f13d013e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40136/0 (socket says 172.21.15.19:40136) 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13d4a7c700 1 -- 172.21.15.19:0/3557455675 learned_addr learned my addr 172.21.15.19:0/3557455675 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 --2- 172.21.15.19:0/3557455675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 0x7f13d00a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cf7fe700 1 --2- 172.21.15.19:0/3557455675 >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 0x7f13d00a13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13ceffd700 1 -- 172.21.15.19:0/3557455675 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564395228 0 0) 0x7f13d00a1e00 con 0x7f13d013c120 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13ceffd700 1 -- 172.21.15.19:0/3557455675 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b80035b0 con 0x7f13d013c120 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 -- 172.21.15.19:0/3557455675 >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 msgr2=0x7f13d00a13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 --2- 172.21.15.19:0/3557455675 >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 0x7f13d00a13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 -- 172.21.15.19:0/3557455675 >> v1:172.21.15.19:6789/0 conn(0x7f13d013c120 legacy=0x7f13d013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 -- 172.21.15.19:0/3557455675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d009cfa0 con 0x7f13d006cc90 2023-10-03T10:18:19.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cf7fe700 1 --2- 172.21.15.19:0/3557455675 >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 0x7f13d00a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13cffff700 1 --2- 172.21.15.19:0/3557455675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 0x7f13d00a0a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009840 tx=0x7f13c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf59a5f74fdb0539 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13ceffd700 1 -- 172.21.15.19:0/3557455675 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011830 con 0x7f13d006cc90 2023-10-03T10:18:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.394+0000 7f13ceffd700 1 -- 172.21.15.19:0/3557455675 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c0011990 con 0x7f13d006cc90 2023-10-03T10:18:19.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.395+0000 7f13ceffd700 1 -- 172.21.15.19:0/3557455675 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011d20 con 0x7f13d006cc90 2023-10-03T10:18:19.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 -- 172.21.15.19:0/3557455675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 msgr2=0x7f13d00a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 --2- 172.21.15.19:0/3557455675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 0x7f13d00a0a30 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009840 tx=0x7f13c0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 -- 172.21.15.19:0/3557455675 shutdown_connections 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 --2- 172.21.15.19:0/3557455675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d006cc90 0x7f13d00a0a30 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 --2- 172.21.15.19:0/3557455675 >> v2:172.21.15.19:3300/0 conn(0x7f13d00a0f70 0x7f13d00a13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 -- 172.21.15.19:0/3557455675 >> 172.21.15.19:0/3557455675 conn(0x7f13d00a3050 msgr2=0x7f13d00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 -- 172.21.15.19:0/3557455675 shutdown_connections 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.396+0000 7f13d64df700 1 -- 172.21.15.19:0/3557455675 wait complete. 2023-10-03T10:18:19.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 Processor -- start 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 -- start start 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 0x7f13d0124fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f13d00a0f70 0x7f13d0125510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 0x7f13d0125a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0127300 con 0x7f13d006cc90 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01263f0 con 0x7f13d013c120 2023-10-03T10:18:19.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.397+0000 7f13d64df700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d013bee0 con 0x7f13d00a0f70 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13cffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 0x7f13d0124fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13cffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 0x7f13d0124fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41176/0 (socket says 172.21.15.19:41176) 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13cffff700 1 -- 172.21.15.19:0/1031872607 learned_addr learned my addr 172.21.15.19:0/1031872607 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 0x7f13d0125a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13cf7fe700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f13d00a0f70 0x7f13d0125510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:19.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 -- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f13d00a0f70 msgr2=0x7f13d0125510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f13d00a0f70 0x7f13d0125510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 -- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 msgr2=0x7f13d0124fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 0x7f13d0124fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 -- 172.21.15.19:0/1031872607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00094a0 con 0x7f13d013c120 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13d4a7c700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 0x7f13d0125a50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f13d00a0570 tx=0x7f13c800cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800a9e0 con 0x7f13d013c120 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.398+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800ab40 con 0x7f13d013c120 2023-10-03T10:18:19.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.399+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d009f9d0 con 0x7f13d013c120 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.399+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d0070980 con 0x7f13d013c120 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.399+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c8012400 con 0x7f13d013c120 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.400+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13c801b3b0 con 0x7f13d013c120 2023-10-03T10:18:19.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.400+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13c803f200 con 0x7f13d013c120 2023-10-03T10:18:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.401+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00052e0 con 0x7f13d013c120 2023-10-03T10:18:19.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.406+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13c80192c0 con 0x7f13d013c120 2023-10-03T10:18:19.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.455+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef180a1d10 con 0x7fef180a1510 2023-10-03T10:18:19.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.455+0000 7fef157fa700 1 -- 172.21.15.19:0/1580132233 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef0c021020 con 0x7fef180a1510 2023-10-03T10:18:19.455 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 msgr2=0x7fef18122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00ebe0 tx=0x7fef0c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 shutdown_connections 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef18139250 0x7fef18123340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef180a0a30 0x7fef181228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 --2- 172.21.15.19:0/1580132233 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef180a1510 0x7fef18122e00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 >> 172.21.15.19:0/1580132233 conn(0x7fef180a6550 msgr2=0x7fef180a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 shutdown_connections 2023-10-03T10:18:19.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.458+0000 7fef1ee58700 1 -- 172.21.15.19:0/1580132233 wait complete. 2023-10-03T10:18:19.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.545+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f44d411e6a0 con 0x7f44d4131b40 2023-10-03T10:18:19.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.546+0000 7f44ca7fc700 1 -- 172.21.15.19:0/4034881551 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f44cc044030 con 0x7f44d4131b40 2023-10-03T10:18:19.546 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 msgr2=0x7f44d411b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 0x7f44d411b9d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007dc0 tx=0x7f44cc00e3c0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 shutdown_connections 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f44d4131b40 0x7f44d411b9d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f44d406a770 0x7f44d411af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 --2- 172.21.15.19:0/4034881551 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f44d406b080 0x7f44d411b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 >> 172.21.15.19:0/4034881551 conn(0x7f44d4066f50 msgr2=0x7f44d4130ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 shutdown_connections 2023-10-03T10:18:19.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.548+0000 7f44dbae2700 1 -- 172.21.15.19:0/4034881551 wait complete. 2023-10-03T10:18:19.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:19.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.562+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ec8074ea0 con 0x7f6ec806e570 2023-10-03T10:18:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.562+0000 7f6eb6ffd700 1 -- 172.21.15.19:0/2701658714 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6eb8017030 con 0x7f6ec806e570 2023-10-03T10:18:19.563 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.564+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 msgr2=0x7f6ec812f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.564+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800c700 tx=0x7f6eb800ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 shutdown_connections 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ec81364b0 0x7f6ec812fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ec806e570 0x7f6ec812f410 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 --2- 172.21.15.19:0/2701658714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ec806f050 0x7f6ec812f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 >> 172.21.15.19:0/2701658714 conn(0x7f6ec80a2aa0 msgr2=0x7f6ec8130ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 shutdown_connections 2023-10-03T10:18:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.565+0000 7f6ecca2d700 1 -- 172.21.15.19:0/2701658714 wait complete. 2023-10-03T10:18:19.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:19.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.625+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f13b0005590 con 0x7f13d013c120 2023-10-03T10:18:19.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.625+0000 7f13ccff9700 1 -- 172.21.15.19:0/1031872607 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13c8017030 con 0x7f13d013c120 2023-10-03T10:18:19.625 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 msgr2=0x7f13d0125a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 0x7f13d0125a50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f13d00a0570 tx=0x7f13c800cd30 comp rx=0 tx=0).stop 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 shutdown_connections 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f13d013c120 0x7f13d0125a50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f13d006cc90 0x7f13d0124fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 --2- 172.21.15.19:0/1031872607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f13d00a0f70 0x7f13d0125510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 >> 172.21.15.19:0/1031872607 conn(0x7f13d00a3050 msgr2=0x7f13d00a6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 shutdown_connections 2023-10-03T10:18:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:19.628+0000 7f13d64df700 1 -- 172.21.15.19:0/1031872607 wait complete. 2023-10-03T10:18:19.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:20.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:20.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:20.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:20.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.620+0000 7f5158632700 1 Processor -- start 2023-10-03T10:18:20.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.620+0000 7f5158632700 1 -- start start 2023-10-03T10:18:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5158632700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 0x7f5150138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5158632700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5150139170 0x7f515013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5158632700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515009b120 con 0x7f515009d6f0 2023-10-03T10:18:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5158632700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515006b460 con 0x7f5150139170 2023-10-03T10:18:20.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5158632700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515009a7e0 con 0x7f515009e1d0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f51563ce700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f515009d6f0 0x7f515009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40152/0 (socket says 172.21.15.19:40152) 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f51563ce700 1 -- 172.21.15.19:0/1762837665 learned_addr learned my addr 172.21.15.19:0/1762837665 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5155bcd700 1 --2- 172.21.15.19:0/1762837665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 0x7f5150138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.621+0000 7f5156bcf700 1 --2- 172.21.15.19:0/1762837665 >> v2:172.21.15.19:3300/0 conn(0x7f5150139170 0x7f515013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f51553cc700 1 -- 172.21.15.19:0/1762837665 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274013569 0 0) 0x7f515009b120 con 0x7f515009d6f0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f51553cc700 1 -- 172.21.15.19:0/1762837665 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f513c0035b0 con 0x7f515009d6f0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f5155bcd700 1 -- 172.21.15.19:0/1762837665 >> v2:172.21.15.19:3300/0 conn(0x7f5150139170 msgr2=0x7f515013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f5155bcd700 1 --2- 172.21.15.19:0/1762837665 >> v2:172.21.15.19:3300/0 conn(0x7f5150139170 0x7f515013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f5155bcd700 1 -- 172.21.15.19:0/1762837665 >> v1:172.21.15.19:6789/0 conn(0x7f515009d6f0 legacy=0x7f515009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f5155bcd700 1 -- 172.21.15.19:0/1762837665 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515009a500 con 0x7f515009e1d0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f5155bcd700 1 --2- 172.21.15.19:0/1762837665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 0x7f5150138c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f5140009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=342f28e637907ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f51553cc700 1 -- 172.21.15.19:0/1762837665 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011830 con 0x7f515009e1d0 2023-10-03T10:18:20.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f51553cc700 1 -- 172.21.15.19:0/1762837665 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140011990 con 0x7f515009e1d0 2023-10-03T10:18:20.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.622+0000 7f51553cc700 1 -- 172.21.15.19:0/1762837665 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011d20 con 0x7f515009e1d0 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 -- 172.21.15.19:0/1762837665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 msgr2=0x7f5150138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 --2- 172.21.15.19:0/1762837665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 0x7f5150138c30 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5140009870 tx=0x7f5140009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 -- 172.21.15.19:0/1762837665 shutdown_connections 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 --2- 172.21.15.19:0/1762837665 >> v2:172.21.15.19:3300/0 conn(0x7f5150139170 0x7f515013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 --2- 172.21.15.19:0/1762837665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009e1d0 0x7f5150138c30 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 -- 172.21.15.19:0/1762837665 >> 172.21.15.19:0/1762837665 conn(0x7f5150066f50 msgr2=0x7f515009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 -- 172.21.15.19:0/1762837665 shutdown_connections 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.623+0000 7f5158632700 1 -- 172.21.15.19:0/1762837665 wait complete. 2023-10-03T10:18:20.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 Processor -- start 2023-10-03T10:18:20.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 -- start start 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 0x7f51501205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5150139170 0x7f5150121070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5150123500 con 0x7f5150139170 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51501240c0 con 0x7f515009d6f0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.625+0000 7f5158632700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51500a2840 con 0x7f515009e1d0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36982/0 (socket says 172.21.15.19:36982) 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 -- 172.21.15.19:0/132797039 learned_addr learned my addr 172.21.15.19:0/132797039 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f51563ce700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 0x7f51501205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 -- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 msgr2=0x7f51501205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 0x7f51501205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 -- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5150139170 msgr2=0x7f5150121070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:20.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5150139170 0x7f5150121070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 -- 172.21.15.19:0/132797039 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400094a0 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f51563ce700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 0x7f51501205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5155bcd700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400036a0 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514001f070 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515009c710 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.626+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140003a40 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.627+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5150123de0 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.627+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5140003ba0 con 0x7f515009e1d0 2023-10-03T10:18:20.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.627+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5140021070 con 0x7f515009e1d0 2023-10-03T10:18:20.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.631+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5150123a80 con 0x7f515009e1d0 2023-10-03T10:18:20.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.636+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5150123a80 con 0x7f515009e1d0 2023-10-03T10:18:20.641 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:20.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.710+0000 7f7c83299700 1 Processor -- start 2023-10-03T10:18:20.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.710+0000 7f7c83299700 1 -- start start 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c83299700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 0x7f7c7c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c83299700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c83299700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c070940 con 0x7f7c7c09e930 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c83299700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c06fd60 con 0x7f7c7c136fe0 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c83299700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c06fa80 con 0x7f7c7c09f410 2023-10-03T10:18:20.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c81035700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c7c09e930 0x7f7c7c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40164/0 (socket says 172.21.15.19:40164) 2023-10-03T10:18:20.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c81035700 1 -- 172.21.15.19:0/808787654 learned_addr learned my addr 172.21.15.19:0/808787654 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:20.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c80834700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 0x7f7c7c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.711+0000 7f7c81836700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c81836700 1 -- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 msgr2=0x7f7c7c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c81836700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 0x7f7c7c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c81836700 1 -- 172.21.15.19:0/808787654 >> v1:172.21.15.19:6789/0 conn(0x7f7c7c09e930 legacy=0x7f7c7c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c73fff700 1 -- 172.21.15.19:0/808787654 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484236750 0 0) 0x7f7c7c070940 con 0x7f7c7c09e930 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c81836700 1 -- 172.21.15.19:0/808787654 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c09fb60 con 0x7f7c7c136fe0 2023-10-03T10:18:20.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c80834700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 0x7f7c7c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c81836700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c1393c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009dc0 tx=0x7f7c7400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=920a17dde123e184 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c73fff700 1 -- 172.21.15.19:0/808787654 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400e070 con 0x7f7c7c136fe0 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c73fff700 1 -- 172.21.15.19:0/808787654 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400bb20 con 0x7f7c7c136fe0 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.712+0000 7f7c73fff700 1 -- 172.21.15.19:0/808787654 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74012430 con 0x7f7c7c136fe0 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 -- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 msgr2=0x7f7c7c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c1393c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009dc0 tx=0x7f7c7400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 -- 172.21.15.19:0/808787654 shutdown_connections 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c1393c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 --2- 172.21.15.19:0/808787654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09f410 0x7f7c7c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 -- 172.21.15.19:0/808787654 >> 172.21.15.19:0/808787654 conn(0x7f7c7c0a4210 msgr2=0x7f7c7c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 -- 172.21.15.19:0/808787654 shutdown_connections 2023-10-03T10:18:20.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.713+0000 7f7c83299700 1 -- 172.21.15.19:0/808787654 wait complete. 2023-10-03T10:18:20.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.714+0000 7f7c83299700 1 Processor -- start 2023-10-03T10:18:20.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.714+0000 7f7c83299700 1 -- start start 2023-10-03T10:18:20.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c11ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c11ffb0 con 0x7f7c7c09f410 2023-10-03T10:18:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c121ec0 con 0x7f7c7c136fe0 2023-10-03T10:18:20.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c83299700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c121270 con 0x7f7c7c09e930 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c81035700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c80834700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c81035700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36998/0 (socket says 172.21.15.19:36998) 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c80834700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41196/0 (socket says 172.21.15.19:41196) 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c81035700 1 -- 172.21.15.19:0/2812259862 learned_addr learned my addr 172.21.15.19:0/2812259862 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.715+0000 7f7c81836700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c11ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 -- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 msgr2=0x7f7c7c11ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c11ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 -- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 msgr2=0x7f7c7c11e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 -- 172.21.15.19:0/2812259862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0094a0 con 0x7f7c7c09e930 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c80834700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c81035700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800ef00 tx=0x7f7c78001bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800c070 con 0x7f7c7c09e930 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78004a90 con 0x7f7c7c09e930 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c74009a70 con 0x7f7c7c09e930 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.716+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78004e40 con 0x7f7c7c09e930 2023-10-03T10:18:20.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.717+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c071d20 con 0x7f7c7c09e930 2023-10-03T10:18:20.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.718+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c780070d0 con 0x7f7c7c09e930 2023-10-03T10:18:20.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.718+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c78050110 con 0x7f7c7c09e930 2023-10-03T10:18:20.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.718+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c074ea0 con 0x7f7c7c09e930 2023-10-03T10:18:20.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.723+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c78007380 con 0x7f7c7c09e930 2023-10-03T10:18:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.761+0000 7f28d0761700 1 Processor -- start 2023-10-03T10:18:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.761+0000 7f28d0761700 1 -- start start 2023-10-03T10:18:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c80a0a30 0x7f28c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c809d630 0x7f28c80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c8133930 0x7f28c8133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80a2a70 con 0x7f28c80a0a30 2023-10-03T10:18:20.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80a01d0 con 0x7f28c809d630 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28d0761700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c809e2b0 con 0x7f28c8133930 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c80a0a30 0x7f28c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28c80a0a30 0x7f28c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41206/0 (socket says 172.21.15.19:41206) 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 -- 172.21.15.19:0/1709743652 learned_addr learned my addr 172.21.15.19:0/1709743652 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28cecfe700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c8133930 0x7f28c8133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28cdcfc700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c809d630 0x7f28c80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 -- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c8133930 msgr2=0x7f28c8133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c8133930 0x7f28c8133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 -- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c809d630 msgr2=0x7f28c80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c809d630 0x7f28c80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.762+0000 7f28ce4fd700 1 -- 172.21.15.19:0/1709743652 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c809dc50 con 0x7f28c80a0a30 2023-10-03T10:18:20.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.763+0000 7f28ce4fd700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c80a0a30 0x7f28c80a0e00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f28c40098f0 tx=0x7f28c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10c60f4633394ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.763+0000 7f28cd4fb700 1 -- 172.21.15.19:0/1709743652 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4011830 con 0x7f28c80a0a30 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.763+0000 7f28cd4fb700 1 -- 172.21.15.19:0/1709743652 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4011990 con 0x7f28c80a0a30 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.763+0000 7f28cd4fb700 1 -- 172.21.15.19:0/1709743652 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4011d20 con 0x7f28c80a0a30 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 -- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c80a0a30 msgr2=0x7f28c80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c80a0a30 0x7f28c80a0e00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f28c40098f0 tx=0x7f28c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 -- 172.21.15.19:0/1709743652 shutdown_connections 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c8133930 0x7f28c8133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c80a0a30 0x7f28c80a0e00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 --2- 172.21.15.19:0/1709743652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c809d630 0x7f28c80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 -- 172.21.15.19:0/1709743652 >> 172.21.15.19:0/1709743652 conn(0x7f28c80a3050 msgr2=0x7f28c80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 -- 172.21.15.19:0/1709743652 shutdown_connections 2023-10-03T10:18:20.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.764+0000 7f28d0761700 1 -- 172.21.15.19:0/1709743652 wait complete. 2023-10-03T10:18:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.766+0000 7f28d0761700 1 Processor -- start 2023-10-03T10:18:20.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.766+0000 7f28d0761700 1 -- start start 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c809d630 0x7f28c81c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8133930 0x7f28c811e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c81bcf70 con 0x7f28c8133930 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8121d80 con 0x7f28c80a0a30 2023-10-03T10:18:20.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28d0761700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28c8122420 con 0x7f28c809d630 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54180/0 (socket says 172.21.15.19:54180) 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 -- 172.21.15.19:0/3235701302 learned_addr learned my addr 172.21.15.19:0/3235701302 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cecfe700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8133930 0x7f28c811e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28ce4fd700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c809d630 0x7f28c81c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 -- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c809d630 msgr2=0x7f28c81c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c809d630 0x7f28c81c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 -- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8133930 msgr2=0x7f28c811e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8133930 0x7f28c811e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 -- 172.21.15.19:0/3235701302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c4009550 con 0x7f28c80a0a30 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.767+0000 7f28cdcfc700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f28b800e9e0 tx=0x7f28b800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.768+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8009710 con 0x7f28c80a0a30 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.768+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b800ee80 con 0x7f28c80a0a30 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.768+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c80a4030 con 0x7f28c80a0a30 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.768+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b800ca50 con 0x7f28c80a0a30 2023-10-03T10:18:20.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.768+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8122ab0 con 0x7f28c80a0a30 2023-10-03T10:18:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.769+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28b800cbb0 con 0x7f28c80a0a30 2023-10-03T10:18:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.769+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28b8050bf0 con 0x7f28c80a0a30 2023-10-03T10:18:20.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.769+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c80008d0 con 0x7f28c80a0a30 2023-10-03T10:18:20.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.779+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28b8032070 con 0x7f28c80a0a30 2023-10-03T10:18:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.803+0000 7f2b151fd700 1 Processor -- start 2023-10-03T10:18:20.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.803+0000 7f2b151fd700 1 -- start start 2023-10-03T10:18:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.803+0000 7f2b151fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009e930 0x7f2b1009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.803+0000 7f2b151fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 0x7f2b101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b151fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b10131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b151fd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b10070940 con 0x7f2b1009f240 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b151fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1006fd60 con 0x7f2b1009f650 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b151fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1006fa80 con 0x7f2b1009e930 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 0x7f2b101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b10131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 0x7f2b101317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41234/0 (socket says 172.21.15.19:41234) 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0e59c700 1 -- 172.21.15.19:0/3602038112 learned_addr learned my addr 172.21.15.19:0/3602038112 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 -- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009e930 msgr2=0x7f2b1009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 --2- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009e930 0x7f2b1009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 -- 172.21.15.19:0/3602038112 >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 msgr2=0x7f2b101317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 --2- 172.21.15.19:0/3602038112 >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 0x7f2b101317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 -- 172.21.15.19:0/3602038112 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1009fb60 con 0x7f2b1009f650 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.804+0000 7f2b0f59e700 1 --2- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b10131d30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d90 tx=0x7f2b0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd9128c913d7b663 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b0dd9b700 1 -- 172.21.15.19:0/3602038112 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800bd20 con 0x7f2b1009f650 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b0dd9b700 1 -- 172.21.15.19:0/3602038112 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0800be80 con 0x7f2b1009f650 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b0dd9b700 1 -- 172.21.15.19:0/3602038112 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b08010710 con 0x7f2b1009f650 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 -- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 msgr2=0x7f2b10131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b10131d30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2b08009d90 tx=0x7f2b0800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:20.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 -- 172.21.15.19:0/3602038112 shutdown_connections 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b10131d30 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3602038112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009e930 0x7f2b1009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3602038112 >> v2:172.21.15.19:3300/0 conn(0x7f2b1009f240 0x7f2b101317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.805+0000 7f2b151fd700 1 -- 172.21.15.19:0/3602038112 >> 172.21.15.19:0/3602038112 conn(0x7f2b100a4210 msgr2=0x7f2b100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.806+0000 7f2b151fd700 1 -- 172.21.15.19:0/3602038112 shutdown_connections 2023-10-03T10:18:20.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.806+0000 7f2b151fd700 1 -- 172.21.15.19:0/3602038112 wait complete. 2023-10-03T10:18:20.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.807+0000 7f2b151fd700 1 Processor -- start 2023-10-03T10:18:20.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.807+0000 7f2b151fd700 1 -- start start 2023-10-03T10:18:20.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 0x7f2b101a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b101cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101a9370 con 0x7f2b1009e930 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101bda60 con 0x7f2b1009f650 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b151fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b101bd820 con 0x7f2b1009f240 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b0ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b0ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41244/0 (socket says 172.21.15.19:41244) 2023-10-03T10:18:20.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b0ed9d700 1 -- 172.21.15.19:0/3576287287 learned_addr learned my addr 172.21.15.19:0/3576287287 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.808+0000 7f2b0e59c700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 0x7f2b101a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0f59e700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b101cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 -- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 msgr2=0x7f2b101cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b101cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 -- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 msgr2=0x7f2b101a9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 -- 172.21.15.19:0/3576287287 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08009a70 con 0x7f2b1009f240 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0f59e700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b101cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0ed9d700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b0e59c700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 0x7f2b101a9c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e8e0 tx=0x7f2b0400ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04013680 con 0x7f2b1009f240 2023-10-03T10:18:20.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b040137e0 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b100a0190 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.809+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04013b50 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.810+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b101aaaa0 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.811+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2b04013cb0 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.811+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2b0403f5f0 con 0x7f2b1009f240 2023-10-03T10:18:20.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.811+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b10074ea0 con 0x7f2b1009f240 2023-10-03T10:18:20.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.820+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2b0401bde0 con 0x7f2b1009f240 2023-10-03T10:18:20.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.864+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5150123a80 con 0x7f515009e1d0 2023-10-03T10:18:20.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.865+0000 7f5146ffd700 1 -- 172.21.15.19:0/132797039 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5150123a80 con 0x7f515009e1d0 2023-10-03T10:18:20.865 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 msgr2=0x7f5150120b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5140000c00 tx=0x7f5140004750 comp rx=0 tx=0).stop 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 shutdown_connections 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5150139170 0x7f5150121070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f515009d6f0 0x7f51501205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 --2- 172.21.15.19:0/132797039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f515009e1d0 0x7f5150120b30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 >> 172.21.15.19:0/132797039 conn(0x7f5150066f50 msgr2=0x7f51500a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 shutdown_connections 2023-10-03T10:18:20.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.867+0000 7f5158632700 1 -- 172.21.15.19:0/132797039 wait complete. 2023-10-03T10:18:20.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.947+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c7c121ca0 con 0x7f7c7c09e930 2023-10-03T10:18:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.947+0000 7f7c71ffb700 1 -- 172.21.15.19:0/2812259862 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c7802faa0 con 0x7f7c7c09e930 2023-10-03T10:18:20.948 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 msgr2=0x7f7c7c11e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800ef00 tx=0x7f7c78001bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 shutdown_connections 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7c136fe0 0x7f7c7c11ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7c09e930 0x7f7c7c11e3a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 --2- 172.21.15.19:0/2812259862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c7c09f410 0x7f7c7c11e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:20.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 >> 172.21.15.19:0/2812259862 conn(0x7f7c7c0a4210 msgr2=0x7f7c7c134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:20.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 shutdown_connections 2023-10-03T10:18:20.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:20.950+0000 7f7c83299700 1 -- 172.21.15.19:0/2812259862 wait complete. 2023-10-03T10:18:20.963 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:21.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.033+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28c8122280 con 0x7f28c80a0a30 2023-10-03T10:18:21.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.034+0000 7f28beffd700 1 -- 172.21.15.19:0/3235701302 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28c8122280 con 0x7f28c80a0a30 2023-10-03T10:18:21.034 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 msgr2=0x7f28c81c8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f28b800e9e0 tx=0x7f28b800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 shutdown_connections 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28c8133930 0x7f28c811e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28c809d630 0x7f28c81c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 --2- 172.21.15.19:0/3235701302 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28c80a0a30 0x7f28c81c8920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 >> 172.21.15.19:0/3235701302 conn(0x7f28c80a3050 msgr2=0x7f28c809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 shutdown_connections 2023-10-03T10:18:21.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.036+0000 7f28d0761700 1 -- 172.21.15.19:0/3235701302 wait complete. 2023-10-03T10:18:21.049 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:21.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.065+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b101ab020 con 0x7f2b1009f240 2023-10-03T10:18:21.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.065+0000 7f2af77fe700 1 -- 172.21.15.19:0/3576287287 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2b04017030 con 0x7f2b1009f240 2023-10-03T10:18:21.065 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 msgr2=0x7f2b101a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 0x7f2b101a9c60 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e8e0 tx=0x7f2b0400ebf0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 shutdown_connections 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b1009f650 0x7f2b101cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b1009e930 0x7f2b101a9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 --2- 172.21.15.19:0/3576287287 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b1009f240 0x7f2b101a9c60 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:21.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 >> 172.21.15.19:0/3576287287 conn(0x7f2b100a4210 msgr2=0x7f2b1006c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:21.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 shutdown_connections 2023-10-03T10:18:21.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:21.068+0000 7f2b151fd700 1 -- 172.21.15.19:0/3576287287 wait complete. 2023-10-03T10:18:21.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:21.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:21.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:22.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.032+0000 7f072d708700 1 Processor -- start 2023-10-03T10:18:22.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.032+0000 7f072d708700 1 -- start start 2023-10-03T10:18:22.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f072d708700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f072d708700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f072d708700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07280a2a70 con 0x7f0728133930 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f072d708700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07280a01d0 con 0x7f07280a0a30 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f072d708700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f072809e2b0 con 0x7f072809d630 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f0726ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37030/0 (socket says 172.21.15.19:37030) 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 -- 172.21.15.19:0/365956683 learned_addr learned my addr 172.21.15.19:0/365956683 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 -- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 msgr2=0x7f07280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 -- 172.21.15.19:0/365956683 >> v1:172.21.15.19:6789/0 conn(0x7f0728133930 legacy=0x7f0728133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f0725ffb700 1 -- 172.21.15.19:0/365956683 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130235087 0 0) 0x7f07280a2a70 con 0x7f0728133930 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f07267fc700 1 -- 172.21.15.19:0/365956683 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072809dc50 con 0x7f072809d630 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.033+0000 7f0726ffd700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f07267fc700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0710009920 tx=0x7f0710009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d64a191bdc480264 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f0725ffb700 1 -- 172.21.15.19:0/365956683 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710011830 con 0x7f072809d630 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f0725ffb700 1 -- 172.21.15.19:0/365956683 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0710011990 con 0x7f072809d630 2023-10-03T10:18:22.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f0725ffb700 1 -- 172.21.15.19:0/365956683 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0710011d20 con 0x7f072809d630 2023-10-03T10:18:22.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 -- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 msgr2=0x7f07280a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0710009920 tx=0x7f0710009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:22.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 -- 172.21.15.19:0/365956683 shutdown_connections 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 --2- 172.21.15.19:0/365956683 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072809d630 0x7f07280a1340 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 -- 172.21.15.19:0/365956683 >> 172.21.15.19:0/365956683 conn(0x7f07280a3050 msgr2=0x7f07280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 -- 172.21.15.19:0/365956683 shutdown_connections 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.034+0000 7f072d708700 1 -- 172.21.15.19:0/365956683 wait complete. 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 Processor -- start 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 -- start start 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07281c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 0x7f07281c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07281336c0 con 0x7f072809d630 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0728122240 con 0x7f07280a0a30 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f072d708700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07280a4470 con 0x7f0728133930 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f0726ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f07267fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07281c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f0726ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41248/0 (socket says 172.21.15.19:41248) 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f0726ffd700 1 -- 172.21.15.19:0/1694721357 learned_addr learned my addr 172.21.15.19:0/1694721357 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.036+0000 7f07277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 0x7f07281c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 -- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 msgr2=0x7f07281c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 0x7f07281c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 -- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 msgr2=0x7f07281c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07281c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 -- 172.21.15.19:0/1694721357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07200094a0 con 0x7f072809d630 2023-10-03T10:18:22.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f07277fe700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 0x7f07281c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f07267fc700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07281c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f0726ffd700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f072000ebe0 tx=0x7f072000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000c7f0 con 0x7f072809d630 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072000c950 con 0x7f072809d630 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0710009550 con 0x7f072809d630 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072000cce0 con 0x7f072809d630 2023-10-03T10:18:22.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.037+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07280a0470 con 0x7f072809d630 2023-10-03T10:18:22.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.038+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0720013470 con 0x7f072809d630 2023-10-03T10:18:22.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.038+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f072003f780 con 0x7f072809d630 2023-10-03T10:18:22.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.038+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07280008d0 con 0x7f072809d630 2023-10-03T10:18:22.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.043+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0720021070 con 0x7f072809d630 2023-10-03T10:18:22.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:22.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.108+0000 7fd0f2bab700 1 Processor -- start 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.108+0000 7fd0f2bab700 1 -- start start 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f2bab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f2bab700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0ec09e410 0x7fd0ec130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f2bab700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ec09f130 con 0x7fd0ec09e000 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f2bab700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ec09f520 con 0x7fd0ec09e410 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f2bab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec09e930 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54208/0 (socket says 172.21.15.19:54208) 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 -- 172.21.15.19:0/4143329252 learned_addr learned my addr 172.21.15.19:0/4143329252 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f1148700 1 --2- 172.21.15.19:0/4143329252 >> v2:172.21.15.19:3300/0 conn(0x7fd0ec09e410 0x7fd0ec130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 -- 172.21.15.19:0/4143329252 >> v2:172.21.15.19:3300/0 conn(0x7fd0ec09e410 msgr2=0x7fd0ec130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 --2- 172.21.15.19:0/4143329252 >> v2:172.21.15.19:3300/0 conn(0x7fd0ec09e410 0x7fd0ec130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 -- 172.21.15.19:0/4143329252 >> v1:172.21.15.19:6789/0 conn(0x7fd0ec09e000 legacy=0x7fd0ec130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.109+0000 7fd0f0947700 1 -- 172.21.15.19:0/4143329252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec09b2d0 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.110+0000 7fd0f0947700 1 --2- 172.21.15.19:0/4143329252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098f0 tx=0x7fd0e0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d15c5286c53b21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.110+0000 7fd0eb7fe700 1 -- 172.21.15.19:0/4143329252 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0011830 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.110+0000 7fd0eb7fe700 1 -- 172.21.15.19:0/4143329252 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e0011990 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.110+0000 7fd0eb7fe700 1 -- 172.21.15.19:0/4143329252 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0011d20 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 -- 172.21.15.19:0/4143329252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 msgr2=0x7fd0ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/4143329252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd0e00098f0 tx=0x7fd0e0009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 -- 172.21.15.19:0/4143329252 shutdown_connections 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/4143329252 >> v2:172.21.15.19:3300/0 conn(0x7fd0ec09e410 0x7fd0ec130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/4143329252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec09dac0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 -- 172.21.15.19:0/4143329252 >> 172.21.15.19:0/4143329252 conn(0x7fd0ec066f50 msgr2=0x7fd0ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 -- 172.21.15.19:0/4143329252 shutdown_connections 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.111+0000 7fd0f2bab700 1 -- 172.21.15.19:0/4143329252 wait complete. 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.112+0000 7fd0f2bab700 1 Processor -- start 2023-10-03T10:18:22.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.113+0000 7fd0f2bab700 1 -- start start 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec12deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 0x7fd0ec12e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 0x7fd0ec12e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec12f9c0 con 0x7fd0ec09e410 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec130f60 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f2bab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec12fbf0 con 0x7fd0ec09e000 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 0x7fd0ec12e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f1148700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 0x7fd0ec12e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 0x7fd0ec12e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37058/0 (socket says 172.21.15.19:37058) 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f1148700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 0x7fd0ec12e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41276/0 (socket says 172.21.15.19:41276) 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0ebfff700 1 -- 172.21.15.19:0/2326768882 learned_addr learned my addr 172.21.15.19:0/2326768882 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec12deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 -- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 msgr2=0x7fd0ec12e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 0x7fd0ec12e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 -- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 msgr2=0x7fd0ec12e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 0x7fd0ec12e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.114+0000 7fd0f0947700 1 -- 172.21.15.19:0/2326768882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0009550 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0f0947700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec12deb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0016000 tx=0x7fd0e0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0004450 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e00036a0 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00045f0 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec130b10 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.115+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec131870 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.116+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0e0003a50 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.116+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0e00442a0 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.117+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ec074ea0 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.122+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0e0015070 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.203+0000 7f37b35fe700 1 Processor -- start 2023-10-03T10:18:22.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 -- start start 2023-10-03T10:18:22.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac09d630 0x7f37ac0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37ac138d80 0x7f37ac13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0a2a70 con 0x7f37ac0a0a30 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac0a01d0 con 0x7f37ac138d80 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.204+0000 7f37b35fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac09e2b0 con 0x7f37ac09d630 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37ac138d80 0x7f37ac13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37ac138d80 0x7f37ac13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41290/0 (socket says 172.21.15.19:41290) 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 -- 172.21.15.19:0/2289691681 learned_addr learned my addr 172.21.15.19:0/2289691681 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b0b99700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac09d630 0x7f37ac0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 -- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac09d630 msgr2=0x7f37ac0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac09d630 0x7f37ac0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 -- 172.21.15.19:0/2289691681 >> v1:172.21.15.19:6789/0 conn(0x7f37ac0a0a30 legacy=0x7f37ac0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37a3fff700 1 -- 172.21.15.19:0/2289691681 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862402170 0 0) 0x7f37ac0a2a70 con 0x7f37ac0a0a30 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 -- 172.21.15.19:0/2289691681 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac09dc50 con 0x7f37ac138d80 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.205+0000 7f37b1b9b700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac138d80 0x7f37ac13b160 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009e50 tx=0x7f37a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9192fc23cb85af46 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.206+0000 7f37a3fff700 1 -- 172.21.15.19:0/2289691681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400e070 con 0x7f37ac138d80 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.206+0000 7f37a3fff700 1 -- 172.21.15.19:0/2289691681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a400b910 con 0x7f37ac138d80 2023-10-03T10:18:22.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.206+0000 7f37a3fff700 1 -- 172.21.15.19:0/2289691681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a400bcc0 con 0x7f37ac138d80 2023-10-03T10:18:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 -- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac138d80 msgr2=0x7f37ac13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac138d80 0x7f37ac13b160 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009e50 tx=0x7f37a400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 -- 172.21.15.19:0/2289691681 shutdown_connections 2023-10-03T10:18:22.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac138d80 0x7f37ac13b160 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 --2- 172.21.15.19:0/2289691681 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac09d630 0x7f37ac0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 -- 172.21.15.19:0/2289691681 >> 172.21.15.19:0/2289691681 conn(0x7f37ac0a3050 msgr2=0x7f37ac0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 -- 172.21.15.19:0/2289691681 shutdown_connections 2023-10-03T10:18:22.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.207+0000 7f37b35fe700 1 -- 172.21.15.19:0/2289691681 wait complete. 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.208+0000 7f37b35fe700 1 Processor -- start 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.208+0000 7f37b35fe700 1 -- start start 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac0a0a30 0x7f37ac133b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37ac138d80 0x7f37ac134070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac1371a0 con 0x7f37ac09d630 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0a49c0 con 0x7f37ac0a0a30 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b35fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0a0410 con 0x7f37ac138d80 2023-10-03T10:18:22.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41300/0 (socket says 172.21.15.19:41300) 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 -- 172.21.15.19:0/1799766527 learned_addr learned my addr 172.21.15.19:0/1799766527 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b1b9b700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37ac138d80 0x7f37ac134070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b0b99700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac0a0a30 0x7f37ac133b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 -- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37ac138d80 msgr2=0x7f37ac134070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37ac138d80 0x7f37ac134070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 -- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac0a0a30 msgr2=0x7f37ac133b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac0a0a30 0x7f37ac133b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.209+0000 7f37b139a700 1 -- 172.21.15.19:0/1799766527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a4009b30 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37b139a700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f37a8001eb0 tx=0x7f37a800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80054e0 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8003680 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a80039f0 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac136af0 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.210+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac137820 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.211+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37a8003b50 con 0x7f37ac09d630 2023-10-03T10:18:22.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.211+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37a803eb40 con 0x7f37ac09d630 2023-10-03T10:18:22.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.212+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac135f30 con 0x7f37ac09d630 2023-10-03T10:18:22.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.216+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37a8017080 con 0x7f37ac09d630 2023-10-03T10:18:22.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.259+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07281223f0 con 0x7f072809d630 2023-10-03T10:18:22.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.259+0000 7f071f7fe700 1 -- 172.21.15.19:0/1694721357 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07281223f0 con 0x7f072809d630 2023-10-03T10:18:22.259 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:22.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 msgr2=0x7f07281c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f072000ebe0 tx=0x7f072000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 shutdown_connections 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0728133930 0x7f07281c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f072809d630 0x7f07281c8100 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 --2- 172.21.15.19:0/1694721357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07280a0a30 0x7f07281c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 >> 172.21.15.19:0/1694721357 conn(0x7f07280a3050 msgr2=0x7f07281bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f1330f48700 1 Processor -- start 2023-10-03T10:18:22.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.263+0000 7f1330f48700 1 -- start start 2023-10-03T10:18:22.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 shutdown_connections 2023-10-03T10:18:22.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1330f48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1330f48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1330f48700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f132c09b120 con 0x7f132c09e000 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1330f48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c06b460 con 0x7f132c09d6f0 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1330f48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132c09a7e0 con 0x7f132c09e410 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f132a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1329d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f132c09e000 0x7f132c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40196/0 (socket says 172.21.15.19:40196) 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f132a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54254/0 (socket says 172.21.15.19:54254) 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f1329d9b700 1 -- 172.21.15.19:0/3545338284 learned_addr learned my addr 172.21.15.19:0/3545338284 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:22.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f072d708700 1 -- 172.21.15.19:0/1694721357 wait complete. 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f132a59c700 1 -- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 msgr2=0x7f132c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.264+0000 7f132a59c700 1 --2- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132a59c700 1 -- 172.21.15.19:0/3545338284 >> v1:172.21.15.19:6789/0 conn(0x7f132c09e000 legacy=0x7f132c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132a59c700 1 -- 172.21.15.19:0/3545338284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c09a500 con 0x7f132c09d6f0 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132a59c700 1 --2- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1324009870 tx=0x7f1324009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2040314e2c01b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132959a700 1 -- 172.21.15.19:0/3545338284 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324004230 con 0x7f132c09d6f0 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132959a700 1 -- 172.21.15.19:0/3545338284 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1324004390 con 0x7f132c09d6f0 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.265+0000 7f132959a700 1 -- 172.21.15.19:0/3545338284 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13240036a0 con 0x7f132c09d6f0 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 -- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 msgr2=0x7f132c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 --2- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1324009870 tx=0x7f1324009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 -- 172.21.15.19:0/3545338284 shutdown_connections 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 --2- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 --2- 172.21.15.19:0/3545338284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09d6f0 0x7f132c09dac0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.266+0000 7f1330f48700 1 -- 172.21.15.19:0/3545338284 >> 172.21.15.19:0/3545338284 conn(0x7f132c066f50 msgr2=0x7f132c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.270+0000 7f1330f48700 1 -- 172.21.15.19:0/3545338284 shutdown_connections 2023-10-03T10:18:22.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.270+0000 7f1330f48700 1 -- 172.21.15.19:0/3545338284 wait complete. 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 Processor -- start 2023-10-03T10:18:22.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 -- start start 2023-10-03T10:18:22.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 0x7f132c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 0x7f132c1a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c1a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132c1a96f0 con 0x7f132c09d6f0 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132c1a9940 con 0x7f132c09e000 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.271+0000 7f1330f48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f132c1a8830 con 0x7f132c09e410 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f1329d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 0x7f132c1a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f1329d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 0x7f132c1a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54258/0 (socket says 172.21.15.19:54258) 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f1329d9b700 1 -- 172.21.15.19:0/2373807493 learned_addr learned my addr 172.21.15.19:0/2373807493 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 0x7f132c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 -- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 msgr2=0x7f132c1a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c1a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 -- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 msgr2=0x7f132c1a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 0x7f132c1a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 -- 172.21.15.19:0/2373807493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240094a0 con 0x7f132c09d6f0 2023-10-03T10:18:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.272+0000 7f132a59c700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 0x7f132c1a5eb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1324009870 tx=0x7f1324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.273+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011830 con 0x7f132c09d6f0 2023-10-03T10:18:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.273+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132401f070 con 0x7f132c09d6f0 2023-10-03T10:18:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.273+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1324011bd0 con 0x7f132c09d6f0 2023-10-03T10:18:22.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.273+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132c0a2180 con 0x7f132c09d6f0 2023-10-03T10:18:22.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.274+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132c1a7ad0 con 0x7f132c09d6f0 2023-10-03T10:18:22.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.275+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1324011d30 con 0x7f132c09d6f0 2023-10-03T10:18:22.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.275+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132c1a9550 con 0x7f132c09d6f0 2023-10-03T10:18:22.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.275+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1324021070 con 0x7f132c09d6f0 2023-10-03T10:18:22.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.280+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f132c1a9550 con 0x7f132c09d6f0 2023-10-03T10:18:22.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:22.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.342+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0ec06c360 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.343+0000 7fd0e97fa700 1 -- 172.21.15.19:0/2326768882 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0e0015020 con 0x7fd0ec09d6f0 2023-10-03T10:18:22.343 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 msgr2=0x7fd0ec12deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec12deb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0016000 tx=0x7fd0e0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 shutdown_connections 2023-10-03T10:18:22.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0ec09e410 0x7fd0ec12e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0ec09d6f0 0x7fd0ec12deb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 --2- 172.21.15.19:0/2326768882 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0ec09e000 0x7fd0ec12e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 >> 172.21.15.19:0/2326768882 conn(0x7fd0ec066f50 msgr2=0x7fd0ec0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 shutdown_connections 2023-10-03T10:18:22.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.345+0000 7fd0f2bab700 1 -- 172.21.15.19:0/2326768882 wait complete. 2023-10-03T10:18:22.359 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.467+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f37ac0747f0 con 0x7f37ac09d630 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.468+0000 7f37a1ffb700 1 -- 172.21.15.19:0/1799766527 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37a801b3b0 con 0x7f37ac09d630 2023-10-03T10:18:22.467 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 msgr2=0x7f37ac1335f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f37a8001eb0 tx=0x7f37a800c800 comp rx=0 tx=0).stop 2023-10-03T10:18:22.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 shutdown_connections 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37ac138d80 0x7f37ac134070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37ac09d630 0x7f37ac1335f0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 --2- 172.21.15.19:0/1799766527 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37ac0a0a30 0x7f37ac133b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 >> 172.21.15.19:0/1799766527 conn(0x7f37ac0a3050 msgr2=0x7f37ac13ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 shutdown_connections 2023-10-03T10:18:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.471+0000 7f37b35fe700 1 -- 172.21.15.19:0/1799766527 wait complete. 2023-10-03T10:18:22.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:22.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.517+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f132c1a9550 con 0x7f132c09d6f0 2023-10-03T10:18:22.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.517+0000 7f1322ffd700 1 -- 172.21.15.19:0/2373807493 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f132c1a9550 con 0x7f132c09d6f0 2023-10-03T10:18:22.517 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:22.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 msgr2=0x7f132c1a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 0x7f132c1a5eb0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f1324009870 tx=0x7f1324004750 comp rx=0 tx=0).stop 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 shutdown_connections 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f132c09e410 0x7f132c1a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f132c09d6f0 0x7f132c1a5eb0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 --2- 172.21.15.19:0/2373807493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f132c09e000 0x7f132c1a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.519+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 >> 172.21.15.19:0/2373807493 conn(0x7f132c066f50 msgr2=0x7f132c0a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.520+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 shutdown_connections 2023-10-03T10:18:22.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:22.520+0000 7f1330f48700 1 -- 172.21.15.19:0/2373807493 wait complete. 2023-10-03T10:18:22.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:23.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:23.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:23.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.432+0000 7f866f7f8700 1 Processor -- start 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 -- start start 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f8668133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86680a2a70 con 0x7f86680a0a30 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86680a01d0 con 0x7f8668133930 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866f7f8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f866809e2b0 con 0x7f866809d630 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866cd93700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.433+0000 7f866d594700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866d594700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41326/0 (socket says 172.21.15.19:41326) 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37094/0 (socket says 172.21.15.19:37094) 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866d594700 1 -- 172.21.15.19:0/3593649096 learned_addr learned my addr 172.21.15.19:0/3593649096 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866dd95700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f8668133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 -- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 msgr2=0x7f8668133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f8668133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 -- 172.21.15.19:0/3593649096 >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 msgr2=0x7f86680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 --2- 172.21.15.19:0/3593649096 >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 -- 172.21.15.19:0/3593649096 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866809dc50 con 0x7f866809d630 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866d594700 1 --2- 172.21.15.19:0/3593649096 >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f866cd93700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f865c009840 tx=0x7f865c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e31aa11e487ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f8667fff700 1 -- 172.21.15.19:0/3593649096 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c011830 con 0x7f866809d630 2023-10-03T10:18:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f8667fff700 1 -- 172.21.15.19:0/3593649096 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c011990 con 0x7f866809d630 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.434+0000 7f8667fff700 1 -- 172.21.15.19:0/3593649096 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c011d20 con 0x7f866809d630 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 -- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 msgr2=0x7f86680a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f865c009840 tx=0x7f865c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 -- 172.21.15.19:0/3593649096 shutdown_connections 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f8668133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3593649096 >> v2:172.21.15.19:3300/0 conn(0x7f86680a0a30 0x7f86680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3593649096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f86680a1340 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 -- 172.21.15.19:0/3593649096 >> 172.21.15.19:0/3593649096 conn(0x7f86680a3050 msgr2=0x7f86680a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 -- 172.21.15.19:0/3593649096 shutdown_connections 2023-10-03T10:18:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.435+0000 7f866f7f8700 1 -- 172.21.15.19:0/3593649096 wait complete. 2023-10-03T10:18:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.437+0000 7f866f7f8700 1 Processor -- start 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.437+0000 7f866f7f8700 1 -- start start 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.437+0000 7f866f7f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f866811f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866f7f8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866f7f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866f7f8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668121200 con 0x7f86680a0a30 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866f7f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86681334d0 con 0x7f8668133930 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866f7f8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86680a4130 con 0x7f866809d630 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866d594700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f866811f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866dd95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41338/0 (socket says 172.21.15.19:41338) 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866d594700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f866811f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37110/0 (socket says 172.21.15.19:37110) 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 -- 172.21.15.19:0/3805671591 learned_addr learned my addr 172.21.15.19:0/3805671591 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866dd95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54274/0 (socket says 172.21.15.19:54274) 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 -- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 msgr2=0x7f866811f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f866811f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 -- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 msgr2=0x7f86681c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 -- 172.21.15.19:0/3805671591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8658009b30 con 0x7f86680a0a30 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866dd95700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f866cd93700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c004450 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c01f070 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.438+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0038e0 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.439+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c0094a0 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.439+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866811fdc0 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.440+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86680747f0 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.440+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f865c003a40 con 0x7f86680a0a30 2023-10-03T10:18:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.441+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f865c021070 con 0x7f86680a0a30 2023-10-03T10:18:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.445+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f865c024970 con 0x7f86680a0a30 2023-10-03T10:18:23.490 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:23.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.501+0000 7fecec6f0700 1 Processor -- start 2023-10-03T10:18:23.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.501+0000 7fecec6f0700 1 -- start start 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.502+0000 7fecec6f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.502+0000 7fecec6f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 0x7fece4138540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.502+0000 7fecec6f0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece41301c0 con 0x7fece406f660 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.502+0000 7fecec6f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4071ff0 con 0x7fece41305f0 2023-10-03T10:18:23.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.502+0000 7fecec6f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece4070e70 con 0x7fece4070160 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54276/0 (socket says 172.21.15.19:54276) 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fece9c8b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fece406f660 0x7fece406fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40202/0 (socket says 172.21.15.19:40202) 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 -- 172.21.15.19:0/668769859 learned_addr learned my addr 172.21.15.19:0/668769859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7feceac8d700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 0x7fece4138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 -- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 msgr2=0x7fece4138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 0x7fece4138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fece948a700 1 -- 172.21.15.19:0/668769859 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574721913 0 0) 0x7fece41301c0 con 0x7fece406f660 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 -- 172.21.15.19:0/668769859 >> v1:172.21.15.19:6789/0 conn(0x7fece406f660 legacy=0x7fece406fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 -- 172.21.15.19:0/668769859 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece40722b0 con 0x7fece41305f0 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7feceac8d700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 0x7fece4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fecea48c700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fece0009920 tx=0x7fece0009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9b3b320a2d7643 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.503+0000 7fece948a700 1 -- 172.21.15.19:0/668769859 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011830 con 0x7fece41305f0 2023-10-03T10:18:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.504+0000 7fece948a700 1 -- 172.21.15.19:0/668769859 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0011990 con 0x7fece41305f0 2023-10-03T10:18:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.504+0000 7fece948a700 1 -- 172.21.15.19:0/668769859 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0011d20 con 0x7fece41305f0 2023-10-03T10:18:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 -- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 msgr2=0x7fece41309c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fece0009920 tx=0x7fece0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 -- 172.21.15.19:0/668769859 shutdown_connections 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece4070160 0x7fece4138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 --2- 172.21.15.19:0/668769859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece41305f0 0x7fece41309c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 -- 172.21.15.19:0/668769859 >> 172.21.15.19:0/668769859 conn(0x7fece40a2aa0 msgr2=0x7fece40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 -- 172.21.15.19:0/668769859 shutdown_connections 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.505+0000 7fecec6f0700 1 -- 172.21.15.19:0/668769859 wait complete. 2023-10-03T10:18:23.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.506+0000 7fecec6f0700 1 Processor -- start 2023-10-03T10:18:23.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.506+0000 7fecec6f0700 1 -- start start 2023-10-03T10:18:23.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece406f660 0x7fece4122dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece4070160 0x7fece4123310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece40a1220 con 0x7fece41305f0 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece4124f30 con 0x7fece4070160 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fecec6f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fece4124a60 con 0x7fece406f660 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7feceac8d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7feceac8d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41342/0 (socket says 172.21.15.19:41342) 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7feceac8d700 1 -- 172.21.15.19:0/2064059822 learned_addr learned my addr 172.21.15.19:0/2064059822 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.507+0000 7fece9c8b700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece4070160 0x7fece4123310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecea48c700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece406f660 0x7fece4122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 -- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece406f660 msgr2=0x7fece4122dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece406f660 0x7fece4122dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 -- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece4070160 msgr2=0x7fece4123310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece4070160 0x7fece4123310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 -- 172.21.15.19:0/2064059822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009a70 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7feceac8d700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00efc0 tx=0x7fecdc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00ca90 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00f040 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00ce10 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece0009550 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.508+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece4125140 con 0x7fece41305f0 2023-10-03T10:18:23.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.510+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece4070840 con 0x7fece41305f0 2023-10-03T10:18:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.510+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecdc014480 con 0x7fece41305f0 2023-10-03T10:18:23.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.510+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecdc03fcc0 con 0x7fece41305f0 2023-10-03T10:18:23.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.519+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecdc012930 con 0x7fece41305f0 2023-10-03T10:18:23.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.664+0000 7f071e6bf700 1 Processor -- start 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.664+0000 7f071e6bf700 1 -- start start 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071e6bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f071809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071e6bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071e6bf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071809f130 con 0x7f071809e410 2023-10-03T10:18:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071e6bf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071809f520 con 0x7f071809e000 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071e6bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f071809e930 con 0x7f071809d6f0 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f07177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071cc5c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f071809e410 0x7f0718130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40208/0 (socket says 172.21.15.19:40208) 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f071cc5c700 1 -- 172.21.15.19:0/2146110824 learned_addr learned my addr 172.21.15.19:0/2146110824 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.665+0000 7f0717fff700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f071809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0716ffd700 1 -- 172.21.15.19:0/2146110824 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801843211 0 0) 0x7f071809f130 con 0x7f071809e410 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0716ffd700 1 -- 172.21.15.19:0/2146110824 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07000035b0 con 0x7f071809e410 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f07177fe700 1 -- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 msgr2=0x7f071809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f07177fe700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f071809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f07177fe700 1 -- 172.21.15.19:0/2146110824 >> v1:172.21.15.19:6789/0 conn(0x7f071809e410 legacy=0x7f0718130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f07177fe700 1 -- 172.21.15.19:0/2146110824 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071809b2d0 con 0x7f071809e000 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0717fff700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f071809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f07177fe700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718130660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f070c00bb10 tx=0x7f070c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5371273905c8ddaa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0716ffd700 1 -- 172.21.15.19:0/2146110824 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00dc70 con 0x7f071809e000 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0716ffd700 1 -- 172.21.15.19:0/2146110824 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00ddd0 con 0x7f071809e000 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.666+0000 7f0716ffd700 1 -- 172.21.15.19:0/2146110824 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c010690 con 0x7f071809e000 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 -- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 msgr2=0x7f0718130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718130660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f070c00bb10 tx=0x7f070c00be20 comp rx=0 tx=0).stop 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 -- 172.21.15.19:0/2146110824 shutdown_connections 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f071809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2146110824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718130660 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 -- 172.21.15.19:0/2146110824 >> 172.21.15.19:0/2146110824 conn(0x7f0718066f50 msgr2=0x7f071809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 -- 172.21.15.19:0/2146110824 shutdown_connections 2023-10-03T10:18:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.667+0000 7f071e6bf700 1 -- 172.21.15.19:0/2146110824 wait complete. 2023-10-03T10:18:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.668+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8668120a90 con 0x7f86680a0a30 2023-10-03T10:18:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.669+0000 7f071e6bf700 1 Processor -- start 2023-10-03T10:18:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.669+0000 7f8665ffb700 1 -- 172.21.15.19:0/3805671591 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f865c034020 con 0x7f86680a0a30 2023-10-03T10:18:23.671 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.669+0000 7f071e6bf700 1 -- start start 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f0718122330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718122870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 0x7f0718122db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0718125480 con 0x7f071809e410 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0718125800 con 0x7f071809e000 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071e6bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0718124610 con 0x7f071809d6f0 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071cc5c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 0x7f0718122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f07177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718122870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071cc5c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 0x7f0718122db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41356/0 (socket says 172.21.15.19:41356) 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f071cc5c700 1 -- 172.21.15.19:0/2316522894 learned_addr learned my addr 172.21.15.19:0/2316522894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f0718122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 -- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 msgr2=0x7f0718122870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718122870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 -- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 msgr2=0x7f0718122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 0x7f0718122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.670+0000 7f0717fff700 1 -- 172.21.15.19:0/2316522894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07080094a0 con 0x7f071809d6f0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f0717fff700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f0718122330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f070800e9e0 tx=0x7f070800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800ee80 con 0x7f071809d6f0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800c850 con 0x7f071809d6f0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800cc00 con 0x7f071809d6f0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070c00b740 con 0x7f071809d6f0 2023-10-03T10:18:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0718125a30 con 0x7f071809d6f0 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 msgr2=0x7f866811f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.671+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 shutdown_connections 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8668133930 0x7f86681c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f866809d630 0x7f866811f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 --2- 172.21.15.19:0/3805671591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86680a0a30 0x7f866811f880 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 >> 172.21.15.19:0/3805671591 conn(0x7f86680a3050 msgr2=0x7f866809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 shutdown_connections 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f866f7f8700 1 -- 172.21.15.19:0/3805671591 wait complete. 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f070800cd60 con 0x7f071809d6f0 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.672+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f070803f730 con 0x7f071809d6f0 2023-10-03T10:18:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.674+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07180a3b70 con 0x7f071809d6f0 2023-10-03T10:18:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.679+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070801bde0 con 0x7f071809d6f0 2023-10-03T10:18:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.682+0000 7efc50090700 1 Processor -- start 2023-10-03T10:18:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.682+0000 7efc50090700 1 -- start start 2023-10-03T10:18:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.682+0000 7efc50090700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 0x7efc4813cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.682+0000 7efc50090700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc4813f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc50090700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc48070ee0 con 0x7efc4806e570 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc50090700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc48071980 con 0x7efc4809eca0 2023-10-03T10:18:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc50090700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc48071480 con 0x7efc4806f050 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4de2c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7efc4806e570 0x7efc4806e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40216/0 (socket says 172.21.15.19:40216) 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4de2c700 1 -- 172.21.15.19:0/3849297578 learned_addr learned my addr 172.21.15.19:0/3849297578 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4d62b700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 0x7efc4813cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4e62d700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc4813f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4ce2a700 1 -- 172.21.15.19:0/3849297578 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606088325 0 0) 0x7efc48070ee0 con 0x7efc4806e570 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4ce2a700 1 -- 172.21.15.19:0/3849297578 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc340035b0 con 0x7efc4806e570 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4d62b700 1 -- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 msgr2=0x7efc4813f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4d62b700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc4813f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4d62b700 1 -- 172.21.15.19:0/3849297578 >> v1:172.21.15.19:6789/0 conn(0x7efc4806e570 legacy=0x7efc4806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.683+0000 7efc4d62b700 1 -- 172.21.15.19:0/3849297578 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48071b90 con 0x7efc4809eca0 2023-10-03T10:18:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.684+0000 7efc4d62b700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 0x7efc4813cea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efc38009870 tx=0x7efc38009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a8e43b059c53c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.684+0000 7efc4ce2a700 1 -- 172.21.15.19:0/3849297578 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011830 con 0x7efc4809eca0 2023-10-03T10:18:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.684+0000 7efc4ce2a700 1 -- 172.21.15.19:0/3849297578 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc38011990 con 0x7efc4809eca0 2023-10-03T10:18:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.684+0000 7efc4ce2a700 1 -- 172.21.15.19:0/3849297578 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38011d20 con 0x7efc4809eca0 2023-10-03T10:18:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 -- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 msgr2=0x7efc4813cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 0x7efc4813cea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7efc38009870 tx=0x7efc38009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 -- 172.21.15.19:0/3849297578 shutdown_connections 2023-10-03T10:18:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc4813f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 --2- 172.21.15.19:0/3849297578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc4809eca0 0x7efc4813cea0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 -- 172.21.15.19:0/3849297578 >> 172.21.15.19:0/3849297578 conn(0x7efc480a2aa0 msgr2=0x7efc480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 -- 172.21.15.19:0/3849297578 shutdown_connections 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.685+0000 7efc50090700 1 -- 172.21.15.19:0/3849297578 wait complete. 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.686+0000 7efc50090700 1 Processor -- start 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.686+0000 7efc50090700 1 -- start start 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.686+0000 7efc50090700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 0x7efc481214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc50090700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc50090700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 0x7efc481d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc50090700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc48123b30 con 0x7efc4806e570 2023-10-03T10:18:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc50090700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc48070680 con 0x7efc48121f60 2023-10-03T10:18:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc50090700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc48138730 con 0x7efc4806f050 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4de2c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 0x7efc481214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37176/0 (socket says 172.21.15.19:37176) 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 -- 172.21.15.19:0/1201658608 learned_addr learned my addr 172.21.15.19:0/1201658608 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4de2c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 0x7efc481214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41368/0 (socket says 172.21.15.19:41368) 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4e62d700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 0x7efc481d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 -- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 msgr2=0x7efc481d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 0x7efc481d2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 -- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 msgr2=0x7efc481214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 0x7efc481214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4d62b700 1 -- 172.21.15.19:0/1201658608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380094a0 con 0x7efc4806f050 2023-10-03T10:18:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.687+0000 7efc4e62d700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 0x7efc481d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc4d62b700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc380090b0 tx=0x7efc38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38004450 con 0x7efc4806f050 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc380045b0 con 0x7efc4806f050 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48123e10 con 0x7efc4806f050 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc380038e0 con 0x7efc4806f050 2023-10-03T10:18:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.688+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc48099e10 con 0x7efc4806f050 2023-10-03T10:18:23.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.689+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc38003a40 con 0x7efc4806f050 2023-10-03T10:18:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.689+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc38040990 con 0x7efc4806f050 2023-10-03T10:18:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.689+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc48123930 con 0x7efc4806f050 2023-10-03T10:18:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.694+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc38015070 con 0x7efc4806f050 2023-10-03T10:18:23.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.776+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fece4074ea0 con 0x7fece41305f0 2023-10-03T10:18:23.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.776+0000 7fecdaffd700 1 -- 172.21.15.19:0/2064059822 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecdc01c3b0 con 0x7fece41305f0 2023-10-03T10:18:23.776 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:23.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 msgr2=0x7fece4123850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00efc0 tx=0x7fecdc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 shutdown_connections 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fece41305f0 0x7fece4123850 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fece406f660 0x7fece4122dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 --2- 172.21.15.19:0/2064059822 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fece4070160 0x7fece4123310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.778+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 >> 172.21.15.19:0/2064059822 conn(0x7fece40a2aa0 msgr2=0x7fece412feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.779+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 shutdown_connections 2023-10-03T10:18:23.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.779+0000 7fecec6f0700 1 -- 172.21.15.19:0/2064059822 wait complete. 2023-10-03T10:18:23.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.898+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0718074ea0 con 0x7f071809d6f0 2023-10-03T10:18:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.899+0000 7f0714ff9700 1 -- 172.21.15.19:0/2316522894 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0708017020 con 0x7f071809d6f0 2023-10-03T10:18:23.899 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efc48074ea0 con 0x7efc4806f050 2023-10-03T10:18:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7efc3e7fc700 1 -- 172.21.15.19:0/1201658608 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc3802e970 con 0x7efc4806f050 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 msgr2=0x7f0718122330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f0718122330 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f070800e9e0 tx=0x7f070800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 shutdown_connections 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f071809e410 0x7f0718122db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.901+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f071809d6f0 0x7f0718122330 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.902+0000 7f071e6bf700 1 --2- 172.21.15.19:0/2316522894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f071809e000 0x7f0718122870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.902+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 >> 172.21.15.19:0/2316522894 conn(0x7f0718066f50 msgr2=0x7f0718130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.902 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.902+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 shutdown_connections 2023-10-03T10:18:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.902+0000 7f071e6bf700 1 -- 172.21.15.19:0/2316522894 wait complete. 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 msgr2=0x7efc48121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efc380090b0 tx=0x7efc38004750 comp rx=0 tx=0).stop 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 shutdown_connections 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc48121f60 0x7efc481d2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc4806e570 0x7efc481214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 --2- 172.21.15.19:0/1201658608 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc4806f050 0x7efc48121a20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 >> 172.21.15.19:0/1201658608 conn(0x7efc480a2aa0 msgr2=0x7efc480a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 shutdown_connections 2023-10-03T10:18:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:23.904+0000 7efc50090700 1 -- 172.21.15.19:0/1201658608 wait complete. 2023-10-03T10:18:23.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:23.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:24.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:24.798 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 Processor -- start 2023-10-03T10:18:24.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 -- start start 2023-10-03T10:18:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff68133fa0 0x7eff68134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6809edd0 con 0x7eff68133fa0 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6809e1f0 con 0x7eff680a1340 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.845+0000 7eff6d0b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff6809dc50 con 0x7eff680a0a30 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff66d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff68133fa0 0x7eff68134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff66d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37192/0 (socket says 172.21.15.19:37192) 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54332/0 (socket says 172.21.15.19:54332) 2023-10-03T10:18:24.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff66d9d700 1 -- 172.21.15.19:0/1173439638 learned_addr learned my addr 172.21.15.19:0/1173439638 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7eff68133fa0 0x7eff68134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41378/0 (socket says 172.21.15.19:41378) 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 -- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 msgr2=0x7eff680a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 -- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 msgr2=0x7eff68133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 -- 172.21.15.19:0/1173439638 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680a1fe0 con 0x7eff68133fa0 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff66d9d700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6659c700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff6759e700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff68133fa0 0x7eff68134410 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7eff60009d90 tx=0x7eff6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913601049c6fe2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff65d9b700 1 -- 172.21.15.19:0/1173439638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6000e070 con 0x7eff68133fa0 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff65d9b700 1 -- 172.21.15.19:0/1173439638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6000bb20 con 0x7eff68133fa0 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.846+0000 7eff65d9b700 1 -- 172.21.15.19:0/1173439638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60012430 con 0x7eff68133fa0 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 -- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff68133fa0 msgr2=0x7eff68134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff68133fa0 0x7eff68134410 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7eff60009d90 tx=0x7eff6000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 -- 172.21.15.19:0/1173439638 shutdown_connections 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff68133fa0 0x7eff68134410 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff680a0a30 0x7eff680a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/1173439638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a1340 0x7eff68133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 -- 172.21.15.19:0/1173439638 >> 172.21.15.19:0/1173439638 conn(0x7eff680a6550 msgr2=0x7eff680a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 -- 172.21.15.19:0/1173439638 shutdown_connections 2023-10-03T10:18:24.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.847+0000 7eff6d0b2700 1 -- 172.21.15.19:0/1173439638 wait complete. 2023-10-03T10:18:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.848+0000 7eff6d0b2700 1 Processor -- start 2023-10-03T10:18:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 -- start start 2023-10-03T10:18:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 0x7eff68120610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 0x7eff68120b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff68121d80 con 0x7eff680a1340 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff68123910 con 0x7eff680a0a30 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6d0b2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7eff68122f30 con 0x7eff68133fa0 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff66d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6759e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 0x7eff68120b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff66d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54338/0 (socket says 172.21.15.19:54338) 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff66d9d700 1 -- 172.21.15.19:0/507241032 learned_addr learned my addr 172.21.15.19:0/507241032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.849+0000 7eff6659c700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 0x7eff68120610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 -- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 msgr2=0x7eff68120b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 0x7eff68120b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 -- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 msgr2=0x7eff68120610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 0x7eff68120610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 -- 172.21.15.19:0/507241032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009550 con 0x7eff680a0a30 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff6659c700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 0x7eff68120610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff6759e700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 0x7eff68120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff66d9d700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7eff5800ebe0 tx=0x7eff5800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800c850 con 0x7eff680a0a30 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5800c9b0 con 0x7eff680a0a30 2023-10-03T10:18:24.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800cd40 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5c0094a0 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.850+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff60009a70 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.851+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff58013470 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.851+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff5803fcf0 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.851+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff681235b0 con 0x7eff680a0a30 2023-10-03T10:18:24.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.856+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff5801b3b0 con 0x7eff680a0a30 2023-10-03T10:18:24.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:24.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.944+0000 7f9aa6093700 1 Processor -- start 2023-10-03T10:18:24.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.944+0000 7f9aa6093700 1 -- start start 2023-10-03T10:18:24.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9aa6093700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 0x7f9aa009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9aa6093700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 0x7f9aa0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9aa6093700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa009f130 con 0x7f9aa009e000 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9aa6093700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa009f520 con 0x7f9aa009d6f0 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9aa6093700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa009e930 con 0x7f9aa009e410 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9a9f7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 0x7f9aa009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9a9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 0x7f9aa0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9a9effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9aa009e000 0x7f9aa0130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40232/0 (socket says 172.21.15.19:40232) 2023-10-03T10:18:24.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.945+0000 7f9a9effd700 1 -- 172.21.15.19:0/2028971115 learned_addr learned my addr 172.21.15.19:0/2028971115 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:24.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9ffff700 1 -- 172.21.15.19:0/2028971115 >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 msgr2=0x7f9aa009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:24.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9ffff700 1 --2- 172.21.15.19:0/2028971115 >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 0x7f9aa009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9ffff700 1 -- 172.21.15.19:0/2028971115 >> v1:172.21.15.19:6789/0 conn(0x7f9aa009e000 legacy=0x7f9aa0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9e7fc700 1 -- 172.21.15.19:0/2028971115 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966504445 0 0) 0x7f9aa009f130 con 0x7f9aa009e000 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9ffff700 1 -- 172.21.15.19:0/2028971115 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa009b2d0 con 0x7f9aa009e410 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9f7fe700 1 --2- 172.21.15.19:0/2028971115 >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 0x7f9aa009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9ffff700 1 --2- 172.21.15.19:0/2028971115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 0x7f9aa0130d70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009d90 tx=0x7f9a9800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323aac0b0b001300 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.946+0000 7f9a9e7fc700 1 -- 172.21.15.19:0/2028971115 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800e070 con 0x7f9aa009e410 2023-10-03T10:18:24.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9a9e7fc700 1 -- 172.21.15.19:0/2028971115 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800bb20 con 0x7f9aa009e410 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9a9e7fc700 1 -- 172.21.15.19:0/2028971115 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98012430 con 0x7f9aa009e410 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 -- 172.21.15.19:0/2028971115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 msgr2=0x7f9aa0130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 --2- 172.21.15.19:0/2028971115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 0x7f9aa0130d70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009d90 tx=0x7f9a9800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 -- 172.21.15.19:0/2028971115 shutdown_connections 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 --2- 172.21.15.19:0/2028971115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e410 0x7f9aa0130d70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 --2- 172.21.15.19:0/2028971115 >> v2:172.21.15.19:3300/0 conn(0x7f9aa009d6f0 0x7f9aa009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 -- 172.21.15.19:0/2028971115 >> 172.21.15.19:0/2028971115 conn(0x7f9aa0066f50 msgr2=0x7f9aa009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 -- 172.21.15.19:0/2028971115 shutdown_connections 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.947+0000 7f9aa6093700 1 -- 172.21.15.19:0/2028971115 wait complete. 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 Processor -- start 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 -- start start 2023-10-03T10:18:24.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aa009d6f0 0x7f9aa013bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 0x7f9aa013c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 0x7f9aa013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa013d030 con 0x7f9aa009d6f0 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa013f710 con 0x7f9aa009e410 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.949+0000 7f9aa6093700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa013f060 con 0x7f9aa009e000 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 0x7f9aa013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 0x7f9aa013c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54352/0 (socket says 172.21.15.19:54352) 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9ffff700 1 -- 172.21.15.19:0/3211596818 learned_addr learned my addr 172.21.15.19:0/3211596818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9f7fe700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aa009d6f0 0x7f9aa013bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 0x7f9aa013c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 -- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 msgr2=0x7f9aa013c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 0x7f9aa013c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 -- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aa009d6f0 msgr2=0x7f9aa013bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aa009d6f0 0x7f9aa013bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 -- 172.21.15.19:0/3211596818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900094a0 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.950+0000 7f9a9effd700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 0x7f9aa013c0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c4a0 tx=0x7f9a9400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.951+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94004c80 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.951+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98009a70 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.951+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a94004de0 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.951+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a94007310 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.951+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9a94007470 con 0x7f9aa009e000 2023-10-03T10:18:24.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.952+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00a1d00 con 0x7f9aa009e000 2023-10-03T10:18:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.952+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9a94011d30 con 0x7f9aa009e000 2023-10-03T10:18:24.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.953+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa01310b0 con 0x7f9aa009e000 2023-10-03T10:18:24.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:24.958+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9a94044060 con 0x7f9aa009e000 2023-10-03T10:18:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.062+0000 7f34521eb700 1 Processor -- start 2023-10-03T10:18:25.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.062+0000 7f34521eb700 1 -- start start 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f34521eb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f34521eb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 0x7f344c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f34521eb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344c06b990 con 0x7f344c133e30 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f34521eb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344c0a0590 con 0x7f344c134260 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f34521eb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344c09fb80 con 0x7f344c133420 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37208/0 (socket says 172.21.15.19:37208) 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 -- 172.21.15.19:0/2988778725 learned_addr learned my addr 172.21.15.19:0/2988778725 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:25.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344bfff700 1 --2- 172.21.15.19:0/2988778725 >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 0x7f344c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344a7fc700 1 -- 172.21.15.19:0/2988778725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479190952 0 0) 0x7f344c06b990 con 0x7f344c133e30 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344a7fc700 1 -- 172.21.15.19:0/2988778725 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34340035b0 con 0x7f344c133e30 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 -- 172.21.15.19:0/2988778725 >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 msgr2=0x7f344c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 --2- 172.21.15.19:0/2988778725 >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 0x7f344c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.063+0000 7f344b7fe700 1 -- 172.21.15.19:0/2988778725 >> v1:172.21.15.19:6789/0 conn(0x7f344c133e30 legacy=0x7f344c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344b7fe700 1 -- 172.21.15.19:0/2988778725 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c0a0030 con 0x7f344c133420 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344bfff700 1 --2- 172.21.15.19:0/2988778725 >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 0x7f344c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344b7fe700 1 --2- 172.21.15.19:0/2988778725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a058595d8f475f31 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344a7fc700 1 -- 172.21.15.19:0/2988778725 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011830 con 0x7f344c133420 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344a7fc700 1 -- 172.21.15.19:0/2988778725 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c011990 con 0x7f344c133420 2023-10-03T10:18:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.064+0000 7f344a7fc700 1 -- 172.21.15.19:0/2988778725 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c011d20 con 0x7f344c133420 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 -- 172.21.15.19:0/2988778725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 msgr2=0x7f344c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 --2- 172.21.15.19:0/2988778725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098f0 tx=0x7f343c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 -- 172.21.15.19:0/2988778725 shutdown_connections 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 --2- 172.21.15.19:0/2988778725 >> v2:172.21.15.19:3300/0 conn(0x7f344c134260 0x7f344c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 --2- 172.21.15.19:0/2988778725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c133420 0x7f344c1337f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 -- 172.21.15.19:0/2988778725 >> 172.21.15.19:0/2988778725 conn(0x7f344c0a4210 msgr2=0x7f344c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 -- 172.21.15.19:0/2988778725 shutdown_connections 2023-10-03T10:18:25.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.065+0000 7f34521eb700 1 -- 172.21.15.19:0/2988778725 wait complete. 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.066+0000 7f34521eb700 1 Processor -- start 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.066+0000 7f34521eb700 1 -- start start 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f344c133e30 0x7f344c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c134260 0x7f344c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c09dd50 con 0x7f344c133420 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c11fe70 con 0x7f344c133e30 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f34521eb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f344c11fb40 con 0x7f344c134260 2023-10-03T10:18:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f344b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41432/0 (socket says 172.21.15.19:41432) 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f344b7fe700 1 -- 172.21.15.19:0/968223771 learned_addr learned my addr 172.21.15.19:0/968223771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f344affd700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f344c133e30 0x7f344c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.067+0000 7f344bfff700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c134260 0x7f344c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 -- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c134260 msgr2=0x7f344c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c134260 0x7f344c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 -- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f344c133e30 msgr2=0x7f344c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f344c133e30 0x7f344c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 -- 172.21.15.19:0/968223771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3444009a70 con 0x7f344c133420 2023-10-03T10:18:25.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f344b7fe700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c004240 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c0043a0 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c009550 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c022e60 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.068+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f344c11f420 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.069+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f343c0036a0 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.069+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344c074ea0 con 0x7f344c133420 2023-10-03T10:18:25.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.069+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f343c048ae0 con 0x7f344c133420 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.075+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7eff680a0220 con 0x7eff680a0a30 2023-10-03T10:18:25.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.076+0000 7eff4f7fe700 1 -- 172.21.15.19:0/507241032 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff58011b00 con 0x7eff680a0a30 2023-10-03T10:18:25.076 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:25.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.078+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f343c0333b0 con 0x7f344c133420 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.078+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 msgr2=0x7eff681200d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.078+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7eff5800ebe0 tx=0x7eff5800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 shutdown_connections 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7eff68133fa0 0x7eff68120b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7eff680a0a30 0x7eff681200d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 --2- 172.21.15.19:0/507241032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7eff680a1340 0x7eff68120610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 >> 172.21.15.19:0/507241032 conn(0x7eff680a6550 msgr2=0x7eff680a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 shutdown_connections 2023-10-03T10:18:25.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.079+0000 7eff6d0b2700 1 -- 172.21.15.19:0/507241032 wait complete. 2023-10-03T10:18:25.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:25.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 Processor -- start 2023-10-03T10:18:25.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 -- start start 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 0x7f1ca0130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca01384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca009c190 con 0x7f1ca009d6f0 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009b090 con 0x7f1ca009e250 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca62c1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca009a6c0 con 0x7f1ca0130750 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1c9ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 0x7f1ca0130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1c9f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1ca009d6f0 0x7f1ca009db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40240/0 (socket says 172.21.15.19:40240) 2023-10-03T10:18:25.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1c9f7fe700 1 -- 172.21.15.19:0/2759281021 learned_addr learned my addr 172.21.15.19:0/2759281021 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.114+0000 7f1ca485e700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca01384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9ffff700 1 -- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 msgr2=0x7f1ca01384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9effd700 1 -- 172.21.15.19:0/2759281021 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836957442 0 0) 0x7f1ca009c190 con 0x7f1ca009d6f0 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9ffff700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca01384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9ffff700 1 -- 172.21.15.19:0/2759281021 >> v1:172.21.15.19:6789/0 conn(0x7f1ca009d6f0 legacy=0x7f1ca009db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9ffff700 1 -- 172.21.15.19:0/2759281021 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0131060 con 0x7f1ca0130750 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9ffff700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 0x7f1ca0130b20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15f500adb82b9479 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9effd700 1 -- 172.21.15.19:0/2759281021 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011830 con 0x7f1ca0130750 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9effd700 1 -- 172.21.15.19:0/2759281021 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90011990 con 0x7f1ca0130750 2023-10-03T10:18:25.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.115+0000 7f1c9effd700 1 -- 172.21.15.19:0/2759281021 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90011d20 con 0x7f1ca0130750 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 -- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 msgr2=0x7f1ca0130b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 0x7f1ca0130b20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009870 tx=0x7f1c90009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 -- 172.21.15.19:0/2759281021 shutdown_connections 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca01384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/2759281021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca0130750 0x7f1ca0130b20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 -- 172.21.15.19:0/2759281021 >> 172.21.15.19:0/2759281021 conn(0x7f1ca009f470 msgr2=0x7f1ca00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 -- 172.21.15.19:0/2759281021 shutdown_connections 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.116+0000 7f1ca62c1700 1 -- 172.21.15.19:0/2759281021 wait complete. 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.117+0000 7f1ca62c1700 1 Processor -- start 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.117+0000 7f1ca62c1700 1 -- start start 2023-10-03T10:18:25.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca009d6f0 0x7f1ca01363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0130750 0x7f1ca01c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0136030 con 0x7f1ca0130750 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca01385d0 con 0x7f1ca009e250 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca62c1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca0138f30 con 0x7f1ca009d6f0 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54384/0 (socket says 172.21.15.19:54384) 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 -- 172.21.15.19:0/3505829939 learned_addr learned my addr 172.21.15.19:0/3505829939 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1ca485e700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0130750 0x7f1ca01c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9ffff700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca009d6f0 0x7f1ca01363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 -- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca009d6f0 msgr2=0x7f1ca01363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca009d6f0 0x7f1ca01363c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 -- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0130750 msgr2=0x7f1ca01c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0130750 0x7f1ca01c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 -- 172.21.15.19:0/3505829939 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900094a0 con 0x7f1ca009e250 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.118+0000 7f1c9f7fe700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c480 tx=0x7f1c9400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.119+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94004c80 con 0x7f1ca009e250 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.119+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c94004e00 con 0x7f1ca009e250 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.119+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c94007310 con 0x7f1ca009e250 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.119+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca01391f0 con 0x7f1ca009e250 2023-10-03T10:18:25.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.119+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca0135c00 con 0x7f1ca009e250 2023-10-03T10:18:25.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.120+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1c94007470 con 0x7f1ca009e250 2023-10-03T10:18:25.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.120+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca00747f0 con 0x7f1ca009e250 2023-10-03T10:18:25.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.120+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1c9403f180 con 0x7f1ca009e250 2023-10-03T10:18:25.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.125+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1c9401bda0 con 0x7f1ca009e250 2023-10-03T10:18:25.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.234+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9aa009c760 con 0x7f9aa009e000 2023-10-03T10:18:25.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.234+0000 7f9a87fff700 1 -- 172.21.15.19:0/3211596818 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9a94007720 con 0x7f9aa009e000 2023-10-03T10:18:25.234 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:25.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 msgr2=0x7f9aa013c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 0x7f9aa013c0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400c4a0 tx=0x7f9a9400c7b0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 shutdown_connections 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9aa009e410 0x7f9aa013c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9aa009d6f0 0x7f9aa013bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 --2- 172.21.15.19:0/3211596818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9aa009e000 0x7f9aa013c0c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.236+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 >> 172.21.15.19:0/3211596818 conn(0x7f9aa0066f50 msgr2=0x7f9aa00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.237+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 shutdown_connections 2023-10-03T10:18:25.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.237+0000 7f9aa6093700 1 -- 172.21.15.19:0/3211596818 wait complete. 2023-10-03T10:18:25.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:25.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.290+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f344c06b250 con 0x7f344c133420 2023-10-03T10:18:25.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.290+0000 7f3433fff700 1 -- 172.21.15.19:0/968223771 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f343c015030 con 0x7f344c133420 2023-10-03T10:18:25.290 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 msgr2=0x7f344c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f343c000c00 tx=0x7f343c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 shutdown_connections 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f344c134260 0x7f344c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f344c133420 0x7f344c09c480 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.292+0000 7f34521eb700 1 --2- 172.21.15.19:0/968223771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f344c133e30 0x7f344c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.293+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 >> 172.21.15.19:0/968223771 conn(0x7f344c0a4210 msgr2=0x7f344c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.293+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 shutdown_connections 2023-10-03T10:18:25.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.293+0000 7f34521eb700 1 -- 172.21.15.19:0/968223771 wait complete. 2023-10-03T10:18:25.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:25.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.330+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1ca0138bd0 con 0x7f1ca009e250 2023-10-03T10:18:25.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.330+0000 7f1c9cff9700 1 -- 172.21.15.19:0/3505829939 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1c9401b340 con 0x7f1ca009e250 2023-10-03T10:18:25.330 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 msgr2=0x7f1ca0136900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400c480 tx=0x7f1c9400c790 comp rx=0 tx=0).stop 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 shutdown_connections 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ca0130750 0x7f1ca01c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1ca009d6f0 0x7f1ca01363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 --2- 172.21.15.19:0/3505829939 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1ca009e250 0x7f1ca0136900 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 >> 172.21.15.19:0/3505829939 conn(0x7f1ca009f470 msgr2=0x7f1ca0071280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 shutdown_connections 2023-10-03T10:18:25.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:25.333+0000 7f1ca62c1700 1 -- 172.21.15.19:0/3505829939 wait complete. 2023-10-03T10:18:25.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:26.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:26.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.240+0000 7f61cd65f700 1 Processor -- start 2023-10-03T10:18:26.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.240+0000 7f61cd65f700 1 -- start start 2023-10-03T10:18:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c8133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61c8133fa0 0x7f61c8134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61c809edd0 con 0x7f61c8133fa0 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c809e1f0 con 0x7f61c80a1340 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61cd65f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c809dc50 con 0x7f61c80a0a30 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f61c8133fa0 0x7f61c8134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c8133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37248/0 (socket says 172.21.15.19:37248) 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c6ffd700 1 -- 172.21.15.19:0/2820693455 learned_addr learned my addr 172.21.15.19:0/2820693455 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 -- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 msgr2=0x7f61c80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 -- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 msgr2=0x7f61c8133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c8133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c77fe700 1 -- 172.21.15.19:0/2820693455 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c80a1fe0 con 0x7f61c8133fa0 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c67fc700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.241+0000 7f61c6ffd700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61c77fe700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8134410 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009d90 tx=0x7f61c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a3c570e95ff4ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61c5ffb700 1 -- 172.21.15.19:0/2820693455 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000e070 con 0x7f61c8133fa0 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61c5ffb700 1 -- 172.21.15.19:0/2820693455 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000bb20 con 0x7f61c8133fa0 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61c5ffb700 1 -- 172.21.15.19:0/2820693455 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0012430 con 0x7f61c8133fa0 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 -- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 msgr2=0x7f61c8134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8134410 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009d90 tx=0x7f61c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 -- 172.21.15.19:0/2820693455 shutdown_connections 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8134410 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 --2- 172.21.15.19:0/2820693455 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c8133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 -- 172.21.15.19:0/2820693455 >> 172.21.15.19:0/2820693455 conn(0x7f61c80a6550 msgr2=0x7f61c80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 -- 172.21.15.19:0/2820693455 shutdown_connections 2023-10-03T10:18:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.242+0000 7f61cd65f700 1 -- 172.21.15.19:0/2820693455 wait complete. 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 Processor -- start 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 -- start start 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8120b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81238f0 con 0x7f61c8133fa0 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61c8123af0 con 0x7f61c80a1340 2023-10-03T10:18:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61cd65f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61c81229e0 con 0x7f61c80a0a30 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37254/0 (socket says 172.21.15.19:37254) 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 -- 172.21.15.19:0/3365188304 learned_addr learned my addr 172.21.15.19:0/3365188304 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c67fc700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:54410/0 (socket says 172.21.15.19:54410) 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c77fe700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8120b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 -- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 msgr2=0x7f61c81205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 -- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 msgr2=0x7f61c8120b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.244+0000 7f61c6ffd700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8120b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61c6ffd700 1 -- 172.21.15.19:0/3365188304 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b8009550 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61c67fc700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61c77fe700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61c6ffd700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f61b800ec10 tx=0x7f61b800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800c850 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b800c9b0 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b00094a0 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b800cd40 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.245+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c0009a70 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.246+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f61b8013470 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.246+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f61b803fbc0 con 0x7f61c80a0a30 2023-10-03T10:18:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.246+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c80a34a0 con 0x7f61c80a0a30 2023-10-03T10:18:26.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.251+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f61b8013720 con 0x7f61c80a0a30 2023-10-03T10:18:26.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:26.307 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:26.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:26.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.396+0000 7ffa730d8700 1 Processor -- start 2023-10-03T10:18:26.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.396+0000 7ffa730d8700 1 -- start start 2023-10-03T10:18:26.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa730d8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa730d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa730d8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c09b120 con 0x7ffa6c09e410 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa730d8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c06b460 con 0x7ffa6c09d6f0 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa730d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c09a7e0 con 0x7ffa6c09e000 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa6bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.397+0000 7ffa6bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49592/0 (socket says 172.21.15.19:49592) 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 -- 172.21.15.19:0/1351760908 learned_addr learned my addr 172.21.15.19:0/1351760908 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa70e74700 1 --2- 172.21.15.19:0/1351760908 >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 -- 172.21.15.19:0/1351760908 >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d6f0 msgr2=0x7ffa6c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/1351760908 >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 -- 172.21.15.19:0/1351760908 >> v1:172.21.15.19:6789/0 conn(0x7ffa6c09e410 legacy=0x7ffa6c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 -- 172.21.15.19:0/1351760908 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c09a500 con 0x7ffa6c09e000 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/1351760908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009920 tx=0x7ffa58009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6d1b366a76e597e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6b7fe700 1 -- 172.21.15.19:0/1351760908 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58011830 con 0x7ffa6c09e000 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.398+0000 7ffa6b7fe700 1 -- 172.21.15.19:0/1351760908 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa58011990 con 0x7ffa6c09e000 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa6b7fe700 1 -- 172.21.15.19:0/1351760908 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58011d20 con 0x7ffa6c09e000 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 -- 172.21.15.19:0/1351760908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 msgr2=0x7ffa6c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 --2- 172.21.15.19:0/1351760908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ffa58009920 tx=0x7ffa58009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 -- 172.21.15.19:0/1351760908 shutdown_connections 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 --2- 172.21.15.19:0/1351760908 >> v2:172.21.15.19:3300/0 conn(0x7ffa6c09d6f0 0x7ffa6c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 --2- 172.21.15.19:0/1351760908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1339f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 -- 172.21.15.19:0/1351760908 >> 172.21.15.19:0/1351760908 conn(0x7ffa6c066f50 msgr2=0x7ffa6c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 -- 172.21.15.19:0/1351760908 shutdown_connections 2023-10-03T10:18:26.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.399+0000 7ffa730d8700 1 -- 172.21.15.19:0/1351760908 wait complete. 2023-10-03T10:18:26.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.401+0000 7ffa730d8700 1 Processor -- start 2023-10-03T10:18:26.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.401+0000 7ffa730d8700 1 -- start start 2023-10-03T10:18:26.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 0x7ffa6c1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1a7380 con 0x7ffa6c09d6f0 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1a7ae0 con 0x7ffa6c09e000 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa730d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1a8100 con 0x7ffa6c09e410 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa70e74700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa70e74700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c1a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57024/0 (socket says 172.21.15.19:57024) 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa70e74700 1 -- 172.21.15.19:0/3429792263 learned_addr learned my addr 172.21.15.19:0/3429792263 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa71675700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 0x7ffa6c1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.402+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 -- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 msgr2=0x7ffa6c1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 0x7ffa6c1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 -- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 msgr2=0x7ffa6c1a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c1a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 -- 172.21.15.19:0/3429792263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009550 con 0x7ffa6c09e000 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa71675700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 0x7ffa6c1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:26.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa6bfff700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1a6410 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffa58016000 tx=0x7ffa58004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58004510 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa580036a0 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c1a9710 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58003a50 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.403+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c09c710 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.404+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffa58003bb0 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.405+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c074ea0 con 0x7ffa6c09e000 2023-10-03T10:18:26.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.405+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffa58021030 con 0x7ffa6c09e000 2023-10-03T10:18:26.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.414+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffa58015080 con 0x7ffa6c09e000 2023-10-03T10:18:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.456+0000 7f4d78356700 1 Processor -- start 2023-10-03T10:18:26.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.456+0000 7f4d78356700 1 -- start start 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d78356700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 0x7f4d70133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d78356700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d7009e560 0x7f4d7013b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d78356700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7006f720 con 0x7f4d701341d0 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d78356700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70070c80 con 0x7f4d701338c0 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d78356700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006fce0 con 0x7f4d7009e560 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d758f1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d701341d0 0x7f4d7009de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44958/0 (socket says 172.21.15.19:44958) 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d760f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 0x7f4d70133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d758f1700 1 -- 172.21.15.19:0/3495016677 learned_addr learned my addr 172.21.15.19:0/3495016677 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.457+0000 7f4d768f3700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d7009e560 0x7f4d7013b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d760f2700 1 -- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d7009e560 msgr2=0x7f4d7013b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d760f2700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d7009e560 0x7f4d7013b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d760f2700 1 -- 172.21.15.19:0/3495016677 >> v1:172.21.15.19:6789/0 conn(0x7f4d701341d0 legacy=0x7f4d7009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d760f2700 1 -- 172.21.15.19:0/3495016677 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d701336a0 con 0x7f4d701338c0 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d760f2700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 0x7f4d70133c90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f12dc15c212fc21e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d750f0700 1 -- 172.21.15.19:0/3495016677 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c004230 con 0x7f4d701338c0 2023-10-03T10:18:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d750f0700 1 -- 172.21.15.19:0/3495016677 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c004390 con 0x7f4d701338c0 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.458+0000 7f4d750f0700 1 -- 172.21.15.19:0/3495016677 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0036a0 con 0x7f4d701338c0 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 -- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 msgr2=0x7f4d70133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 0x7f4d70133c90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 -- 172.21.15.19:0/3495016677 shutdown_connections 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d7009e560 0x7f4d7013b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 --2- 172.21.15.19:0/3495016677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d701338c0 0x7f4d70133c90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 -- 172.21.15.19:0/3495016677 >> 172.21.15.19:0/3495016677 conn(0x7f4d700a2aa0 msgr2=0x7f4d700a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 -- 172.21.15.19:0/3495016677 shutdown_connections 2023-10-03T10:18:26.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.459+0000 7f4d78356700 1 -- 172.21.15.19:0/3495016677 wait complete. 2023-10-03T10:18:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 Processor -- start 2023-10-03T10:18:26.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 -- start start 2023-10-03T10:18:26.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 0x7f4d7011fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d701341d0 0x7f4d70120310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7006f960 con 0x7f4d701338c0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70120c80 con 0x7f4d7009e560 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.461+0000 7f4d78356700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70122720 con 0x7f4d701341d0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49628/0 (socket says 172.21.15.19:49628) 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 -- 172.21.15.19:0/2397553912 learned_addr learned my addr 172.21.15.19:0/2397553912 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d768f3700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d701341d0 0x7f4d70120310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d758f1700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 0x7f4d7011fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 -- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d701341d0 msgr2=0x7f4d70120310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d701341d0 0x7f4d70120310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 -- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 msgr2=0x7f4d7011fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 0x7f4d7011fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 -- 172.21.15.19:0/2397553912 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0094a0 con 0x7f4d7009e560 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d758f1700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 0x7f4d7011fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.462+0000 7f4d760f2700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0090b0 tx=0x7f4d6c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.463+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c011630 con 0x7f4d7009e560 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.463+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c01f070 con 0x7f4d7009e560 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.463+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0119f0 con 0x7f4d7009e560 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.463+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d70122dd0 con 0x7f4d7009e560 2023-10-03T10:18:26.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.463+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d70123b00 con 0x7f4d7009e560 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.464+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d6c011b50 con 0x7f4d7009e560 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.464+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70074ea0 con 0x7f4d7009e560 2023-10-03T10:18:26.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.464+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d6c021070 con 0x7f4d7009e560 2023-10-03T10:18:26.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.469+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d6c024380 con 0x7f4d7009e560 2023-10-03T10:18:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.499+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f61c80a0220 con 0x7f61c80a0a30 2023-10-03T10:18:26.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.499+0000 7f61bf7fe700 1 -- 172.21.15.19:0/3365188304 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f61b8021030 con 0x7f61c80a0a30 2023-10-03T10:18:26.499 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.503+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 msgr2=0x7f61c81200b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.503+0000 7f61cd65f700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f61b800ec10 tx=0x7f61b800ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:26.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 shutdown_connections 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61c8133fa0 0x7f61c8120b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f61c80a0a30 0x7f61c81200b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 --2- 172.21.15.19:0/3365188304 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f61c80a1340 0x7f61c81205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 >> 172.21.15.19:0/3365188304 conn(0x7f61c80a6550 msgr2=0x7f61c809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 shutdown_connections 2023-10-03T10:18:26.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.504+0000 7f61cd65f700 1 -- 172.21.15.19:0/3365188304 wait complete. 2023-10-03T10:18:26.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 Processor -- start 2023-10-03T10:18:26.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 -- start start 2023-10-03T10:18:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccf809e1d0 0x7fccf8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf809f130 con 0x7fccf809d6f0 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.512+0000 7fccfe4d3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf809f520 con 0x7fccf809e1d0 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccfe4d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf809e930 con 0x7fccf8135e50 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccf809e1d0 0x7fccf8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fccf809e1d0 0x7fccf8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57044/0 (socket says 172.21.15.19:57044) 2023-10-03T10:18:26.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 -- 172.21.15.19:0/293307001 learned_addr learned my addr 172.21.15.19:0/293307001 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 -- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 msgr2=0x7fccf8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 --2- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 -- 172.21.15.19:0/293307001 >> v1:172.21.15.19:6789/0 conn(0x7fccf809d6f0 legacy=0x7fccf809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf6ffd700 1 -- 172.21.15.19:0/293307001 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145692240 0 0) 0x7fccf809f130 con 0x7fccf809d6f0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 -- 172.21.15.19:0/293307001 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf809b2d0 con 0x7fccf809e1d0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.513+0000 7fccf77fe700 1 --2- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf8135910 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fccec0098f0 tx=0x7fccec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35a5aa21482e495 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccf6ffd700 1 -- 172.21.15.19:0/293307001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00b8a0 con 0x7fccf809e1d0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccf6ffd700 1 -- 172.21.15.19:0/293307001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec00ba00 con 0x7fccf809e1d0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccf6ffd700 1 -- 172.21.15.19:0/293307001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00bd90 con 0x7fccf809e1d0 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 -- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 msgr2=0x7fccf8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf8135910 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fccec0098f0 tx=0x7fccec009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 -- 172.21.15.19:0/293307001 shutdown_connections 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/293307001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf8135910 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 -- 172.21.15.19:0/293307001 >> 172.21.15.19:0/293307001 conn(0x7fccf8066f50 msgr2=0x7fccf809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 -- 172.21.15.19:0/293307001 shutdown_connections 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.514+0000 7fccfe4d3700 1 -- 172.21.15.19:0/293307001 wait complete. 2023-10-03T10:18:26.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.516+0000 7fccfe4d3700 1 Processor -- start 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.516+0000 7fccfe4d3700 1 -- start start 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fccf809d6f0 0x7fccf81354b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf81343f0 con 0x7fccf809e1d0 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf813b330 con 0x7fccf8135e50 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccfe4d3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8130350 con 0x7fccf809d6f0 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57056/0 (socket says 172.21.15.19:57056) 2023-10-03T10:18:26.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 -- 172.21.15.19:0/460930146 learned_addr learned my addr 172.21.15.19:0/460930146 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 -- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fccf809d6f0 msgr2=0x7fccf81354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fccf809d6f0 0x7fccf81354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 -- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 msgr2=0x7fccf8139cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.517+0000 7fccf77fe700 1 -- 172.21.15.19:0/460930146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec009550 con 0x7fccf809e1d0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccf77fe700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fccf809b9e0 tx=0x7fccec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec0038a0 con 0x7fccf809e1d0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec01e070 con 0x7fccf809e1d0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf8133d30 con 0x7fccf809e1d0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec003c20 con 0x7fccf809e1d0 2023-10-03T10:18:26.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.518+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf8133f90 con 0x7fccf809e1d0 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.519+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fccec011420 con 0x7fccf809e1d0 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.519+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fccec020070 con 0x7fccf809e1d0 2023-10-03T10:18:26.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.519+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf8074ea0 con 0x7fccf809e1d0 2023-10-03T10:18:26.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.524+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fccec003d80 con 0x7fccf809e1d0 2023-10-03T10:18:26.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.652+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffa6c1a8d90 con 0x7ffa6c09e000 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.652+0000 7ffa697fa700 1 -- 172.21.15.19:0/3429792263 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffa5802b030 con 0x7ffa6c09e000 2023-10-03T10:18:26.652 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 msgr2=0x7ffa6c1a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1a6410 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ffa58016000 tx=0x7ffa58004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 shutdown_connections 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffa6c09e410 0x7ffa6c1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa6c09d6f0 0x7ffa6c1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 --2- 172.21.15.19:0/3429792263 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffa6c09e000 0x7ffa6c1a6410 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 >> 172.21.15.19:0/3429792263 conn(0x7ffa6c066f50 msgr2=0x7ffa6c1bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 shutdown_connections 2023-10-03T10:18:26.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.655+0000 7ffa730d8700 1 -- 172.21.15.19:0/3429792263 wait complete. 2023-10-03T10:18:26.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:26.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.695+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4d7006b9e0 con 0x7f4d7009e560 2023-10-03T10:18:26.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.696+0000 7f4d66ffd700 1 -- 172.21.15.19:0/2397553912 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d6c02b030 con 0x7f4d7009e560 2023-10-03T10:18:26.696 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:26.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 msgr2=0x7f4d7011f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0090b0 tx=0x7f4d6c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 shutdown_connections 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d701341d0 0x7f4d70120310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d7009e560 0x7f4d7011f890 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 --2- 172.21.15.19:0/2397553912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d701338c0 0x7f4d7011fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 >> 172.21.15.19:0/2397553912 conn(0x7f4d700a2aa0 msgr2=0x7f4d700a0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 shutdown_connections 2023-10-03T10:18:26.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.698+0000 7f4d78356700 1 -- 172.21.15.19:0/2397553912 wait complete. 2023-10-03T10:18:26.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:26.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.732+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fccf806c360 con 0x7fccf809e1d0 2023-10-03T10:18:26.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.733+0000 7fccf4ff9700 1 -- 172.21.15.19:0/460930146 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fccec023380 con 0x7fccf809e1d0 2023-10-03T10:18:26.733 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 msgr2=0x7fccf81397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fccf809b9e0 tx=0x7fccec004750 comp rx=0 tx=0).stop 2023-10-03T10:18:26.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 shutdown_connections 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fccf8135e50 0x7fccf8139cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fccf809d6f0 0x7fccf81354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 --2- 172.21.15.19:0/460930146 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fccf809e1d0 0x7fccf81397b0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 >> 172.21.15.19:0/460930146 conn(0x7fccf8066f50 msgr2=0x7fccf806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 shutdown_connections 2023-10-03T10:18:26.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:26.735+0000 7fccfe4d3700 1 -- 172.21.15.19:0/460930146 wait complete. 2023-10-03T10:18:26.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:27.525 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.668+0000 7f603484d700 1 Processor -- start 2023-10-03T10:18:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 -- start start 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 0x7f6030138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603009f130 con 0x7f603009d6f0 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603009f520 con 0x7f603009e1d0 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f603484d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f603009e930 con 0x7f6030135e50 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f602dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f602ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 0x7f6030138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f602dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49648/0 (socket says 172.21.15.19:49648) 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f602dd9b700 1 -- 172.21.15.19:0/3519558916 learned_addr learned my addr 172.21.15.19:0/3519558916 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.669+0000 7f602e59c700 1 --1- 172.21.15.19:0/3519558916 >> v1:172.21.15.19:6789/0 conn(0x7f603009d6f0 0x7f603009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44976/0 (socket says 172.21.15.19:44976) 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602ed9d700 1 -- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 msgr2=0x7f6030135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602ed9d700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602ed9d700 1 -- 172.21.15.19:0/3519558916 >> v1:172.21.15.19:6789/0 conn(0x7f603009d6f0 legacy=0x7f603009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602ed9d700 1 -- 172.21.15.19:0/3519558916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603009b2d0 con 0x7f6030135e50 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602d59a700 1 -- 172.21.15.19:0/3519558916 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048403487 0 0) 0x7f603009f130 con 0x7f603009d6f0 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602dd9b700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602ed9d700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 0x7f6030138230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6028009dc0 tx=0x7f602800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec61691dacf63fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602d59a700 1 -- 172.21.15.19:0/3519558916 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602800e070 con 0x7f6030135e50 2023-10-03T10:18:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602d59a700 1 -- 172.21.15.19:0/3519558916 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602800bb20 con 0x7f6030135e50 2023-10-03T10:18:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.670+0000 7f602d59a700 1 -- 172.21.15.19:0/3519558916 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6028012430 con 0x7f6030135e50 2023-10-03T10:18:27.672 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 -- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 msgr2=0x7f6030138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 0x7f6030138230 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f6028009dc0 tx=0x7f602800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 -- 172.21.15.19:0/3519558916 shutdown_connections 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6030135e50 0x7f6030138230 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 --2- 172.21.15.19:0/3519558916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f603009e1d0 0x7f6030135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 -- 172.21.15.19:0/3519558916 >> 172.21.15.19:0/3519558916 conn(0x7f6030066f50 msgr2=0x7f603009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 -- 172.21.15.19:0/3519558916 shutdown_connections 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.671+0000 7f603484d700 1 -- 172.21.15.19:0/3519558916 wait complete. 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.672+0000 7f603484d700 1 Processor -- start 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.672+0000 7f603484d700 1 -- start start 2023-10-03T10:18:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6030135e50 0x7f60301c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6030122f20 con 0x7f603009d6f0 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6030123100 con 0x7f6030135e50 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f603484d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6030131f50 con 0x7f603009e1d0 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602e59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57062/0 (socket says 172.21.15.19:57062) 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36314/0 (socket says 172.21.15.19:36314) 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602e59c700 1 -- 172.21.15.19:0/415499652 learned_addr learned my addr 172.21.15.19:0/415499652 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602ed9d700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6030135e50 0x7f60301c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 -- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6030135e50 msgr2=0x7f60301c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6030135e50 0x7f60301c8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 -- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 msgr2=0x7f6030070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 -- 172.21.15.19:0/415499652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6024009550 con 0x7f603009e1d0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602e59c700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f602dd9b700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f602400e9d0 tx=0x7f602400ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400ee70 con 0x7f603009e1d0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.673+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024004030 con 0x7f603009e1d0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.674+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6028009a70 con 0x7f603009e1d0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.674+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60240043c0 con 0x7f603009e1d0 2023-10-03T10:18:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.674+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60300704e0 con 0x7f603009e1d0 2023-10-03T10:18:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.674+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f602400c850 con 0x7f603009e1d0 2023-10-03T10:18:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.675+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f602403f9a0 con 0x7f603009e1d0 2023-10-03T10:18:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.675+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603009c700 con 0x7f603009e1d0 2023-10-03T10:18:27.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.680+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6024011d90 con 0x7f603009e1d0 2023-10-03T10:18:27.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:27.750 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 Processor -- start 2023-10-03T10:18:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 -- start start 2023-10-03T10:18:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff21809e930 0x7ff21809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff218131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff218070940 con 0x7ff21809f240 2023-10-03T10:18:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21806fd60 con 0x7ff21809e930 2023-10-03T10:18:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.816+0000 7ff21ea88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff21806fa80 con 0x7ff21809f650 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21d025700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff218131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff21809e930 0x7ff21809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff21809e930 0x7ff21809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57070/0 (socket says 172.21.15.19:57070) 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21d025700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff218131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36320/0 (socket says 172.21.15.19:36320) 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 -- 172.21.15.19:0/2687973740 learned_addr learned my addr 172.21.15.19:0/2687973740 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 -- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 msgr2=0x7ff218131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 --2- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff218131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 -- 172.21.15.19:0/2687973740 >> v1:172.21.15.19:6789/0 conn(0x7ff21809f240 legacy=0x7ff2181317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 -- 172.21.15.19:0/2687973740 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21809fb60 con 0x7ff21809e930 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff21c824700 1 --2- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff21809ed00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098f0 tx=0x7ff20c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d411007400d5bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff2177fe700 1 -- 172.21.15.19:0/2687973740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00b8a0 con 0x7ff21809e930 2023-10-03T10:18:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff2177fe700 1 -- 172.21.15.19:0/2687973740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00ba00 con 0x7ff21809e930 2023-10-03T10:18:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.817+0000 7ff2177fe700 1 -- 172.21.15.19:0/2687973740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00bd90 con 0x7ff21809e930 2023-10-03T10:18:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 -- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 msgr2=0x7ff21809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 --2- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff21809ed00 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0098f0 tx=0x7ff20c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 -- 172.21.15.19:0/2687973740 shutdown_connections 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 --2- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff218131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 --2- 172.21.15.19:0/2687973740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff21809ed00 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 -- 172.21.15.19:0/2687973740 >> 172.21.15.19:0/2687973740 conn(0x7ff2180a4210 msgr2=0x7ff2180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 -- 172.21.15.19:0/2687973740 shutdown_connections 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.818+0000 7ff21ea88700 1 -- 172.21.15.19:0/2687973740 wait complete. 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.819+0000 7ff21ea88700 1 Processor -- start 2023-10-03T10:18:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.819+0000 7ff21ea88700 1 -- start start 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff2181a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff2181a47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2181a7020 con 0x7ff21809e930 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218071d20 con 0x7ff21809f240 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21ea88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2180a3520 con 0x7ff21809f650 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21d025700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff2181a47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff217fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21c824700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff2181a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21c824700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff2181a3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57080/0 (socket says 172.21.15.19:57080) 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff217fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49672/0 (socket says 172.21.15.19:49672) 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.820+0000 7ff21c824700 1 -- 172.21.15.19:0/3334676891 learned_addr learned my addr 172.21.15.19:0/3334676891 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 -- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 msgr2=0x7ff2181a47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff2181a47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 -- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 msgr2=0x7ff2181a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff2181a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 -- 172.21.15.19:0/3334676891 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c009550 con 0x7ff21809f240 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff217fff700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff204000f60 tx=0x7ff20400c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040052d0 con 0x7ff21809f240 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204005430 con 0x7ff21809f240 2023-10-03T10:18:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.821+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040119b0 con 0x7ff21809f240 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.822+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2180a0190 con 0x7ff21809f240 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.822+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2181a6bd0 con 0x7ff21809f240 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.823+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2181a0b30 con 0x7ff21809f240 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.823+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff204011b10 con 0x7ff21809f240 2023-10-03T10:18:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.824+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff204042ba0 con 0x7ff21809f240 2023-10-03T10:18:27.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.833+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff20400ce30 con 0x7ff21809f240 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.859+0000 7fa6430c2700 1 Processor -- start 2023-10-03T10:18:27.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.859+0000 7fa6430c2700 1 -- start start 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa6430c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa6430c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa6430c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63c06b990 con 0x7fa63c133e30 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa6430c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c0a0590 con 0x7fa63c133420 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa6430c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c09fb80 con 0x7fa63c134260 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa640e5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa640e5e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49674/0 (socket says 172.21.15.19:49674) 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa640e5e700 1 -- 172.21.15.19:0/3989462654 learned_addr learned my addr 172.21.15.19:0/3989462654 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.860+0000 7fa64165f700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa640e5e700 1 -- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 msgr2=0x7fa63c1306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa640e5e700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c1306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa640e5e700 1 -- 172.21.15.19:0/3989462654 >> v1:172.21.15.19:6789/0 conn(0x7fa63c133e30 legacy=0x7fa63c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa640e5e700 1 -- 172.21.15.19:0/3989462654 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c0a0030 con 0x7fa63c133420 2023-10-03T10:18:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa640e5e700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa630009920 tx=0x7fa630009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66381db0c36b979d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa63b7fe700 1 -- 172.21.15.19:0/3989462654 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630011830 con 0x7fa63c133420 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa63b7fe700 1 -- 172.21.15.19:0/3989462654 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa630011990 con 0x7fa63c133420 2023-10-03T10:18:27.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.861+0000 7fa63b7fe700 1 -- 172.21.15.19:0/3989462654 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630011d20 con 0x7fa63c133420 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 -- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 msgr2=0x7fa63c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa630009920 tx=0x7fa630009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 -- 172.21.15.19:0/3989462654 shutdown_connections 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c1306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3989462654 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133420 0x7fa63c1337f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 -- 172.21.15.19:0/3989462654 >> 172.21.15.19:0/3989462654 conn(0x7fa63c0a4210 msgr2=0x7fa63c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 -- 172.21.15.19:0/3989462654 shutdown_connections 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.862+0000 7fa6430c2700 1 -- 172.21.15.19:0/3989462654 wait complete. 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.863+0000 7fa6430c2700 1 Processor -- start 2023-10-03T10:18:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.863+0000 7fa6430c2700 1 -- start start 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa63c133420 0x7fa63c09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133e30 0x7fa63c09ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c121140 con 0x7fa63c133420 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c1206b0 con 0x7fa63c133e30 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa6430c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c09e240 con 0x7fa63c134260 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa64165f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa64165f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36342/0 (socket says 172.21.15.19:36342) 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa64165f700 1 -- 172.21.15.19:0/3756085955 learned_addr learned my addr 172.21.15.19:0/3756085955 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa640e5e700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa63c133420 0x7fa63c09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa63bfff700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133e30 0x7fa63c09ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa64165f700 1 -- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133e30 msgr2=0x7fa63c09ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.864+0000 7fa64165f700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133e30 0x7fa63c09ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa64165f700 1 -- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa63c133420 msgr2=0x7fa63c09c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa64165f700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa63c133420 0x7fa63c09c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa64165f700 1 -- 172.21.15.19:0/3756085955 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630009550 con 0x7fa63c134260 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa64165f700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b6d0 tx=0x7fa63400b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634019070 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634007540 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.865+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634009ca0 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.866+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c11ffc0 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.866+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c120cd0 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.867+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63c1204c0 con 0x7fa63c134260 2023-10-03T10:18:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.867+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa6340078f0 con 0x7fa63c134260 2023-10-03T10:18:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.867+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa634048a20 con 0x7fa63c134260 2023-10-03T10:18:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.872+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa63401c3b0 con 0x7fa63c134260 2023-10-03T10:18:27.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.903+0000 7f22fd0a0700 1 Processor -- start 2023-10-03T10:18:27.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.903+0000 7f22fd0a0700 1 -- start start 2023-10-03T10:18:27.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.903+0000 7f22fd0a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22fd0a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 0x7f22f8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22fd0a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22f8070940 con 0x7f22f809f240 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22fd0a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22f806fd60 con 0x7f22f809f650 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22fd0a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f806fa80 con 0x7f22f809e930 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22f809f240 0x7f22f81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44994/0 (socket says 172.21.15.19:44994) 2023-10-03T10:18:27.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f659c700 1 -- 172.21.15.19:0/279242306 learned_addr learned my addr 172.21.15.19:0/279242306 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f759e700 1 --2- 172.21.15.19:0/279242306 >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 0x7f22f8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f5d9b700 1 -- 172.21.15.19:0/279242306 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733657294 0 0) 0x7f22f8070940 con 0x7f22f809f240 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f5d9b700 1 -- 172.21.15.19:0/279242306 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e00035b0 con 0x7f22f809f240 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f6d9d700 1 -- 172.21.15.19:0/279242306 >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 msgr2=0x7f22f8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f6d9d700 1 --2- 172.21.15.19:0/279242306 >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 0x7f22f8131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f6d9d700 1 -- 172.21.15.19:0/279242306 >> v1:172.21.15.19:6789/0 conn(0x7f22f809f240 legacy=0x7f22f81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f6d9d700 1 -- 172.21.15.19:0/279242306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f809fb60 con 0x7f22f809e930 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.904+0000 7f22f759e700 1 --2- 172.21.15.19:0/279242306 >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 0x7f22f8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f22f6d9d700 1 --2- 172.21.15.19:0/279242306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f809ed00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009840 tx=0x7f22e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6bbf24cdf893ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f22f5d9b700 1 -- 172.21.15.19:0/279242306 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8011830 con 0x7f22f809e930 2023-10-03T10:18:27.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f22f5d9b700 1 -- 172.21.15.19:0/279242306 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8011990 con 0x7f22f809e930 2023-10-03T10:18:27.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f22f5d9b700 1 -- 172.21.15.19:0/279242306 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e8011d20 con 0x7f22f809e930 2023-10-03T10:18:27.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6030074ea0 con 0x7f603009e1d0 2023-10-03T10:18:27.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.905+0000 7f601effd700 1 -- 172.21.15.19:0/415499652 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6024011350 con 0x7f603009e1d0 2023-10-03T10:18:27.907 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 -- 172.21.15.19:0/279242306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 msgr2=0x7f22f809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 --2- 172.21.15.19:0/279242306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f809ed00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009840 tx=0x7f22e8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 -- 172.21.15.19:0/279242306 shutdown_connections 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 --2- 172.21.15.19:0/279242306 >> v2:172.21.15.19:3300/0 conn(0x7f22f809f650 0x7f22f8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 --2- 172.21.15.19:0/279242306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f809ed00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 -- 172.21.15.19:0/279242306 >> 172.21.15.19:0/279242306 conn(0x7f22f80a4210 msgr2=0x7f22f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 -- 172.21.15.19:0/279242306 shutdown_connections 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.906+0000 7f22fd0a0700 1 -- 172.21.15.19:0/279242306 wait complete. 2023-10-03T10:18:27.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.908+0000 7f22fd0a0700 1 Processor -- start 2023-10-03T10:18:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.908+0000 7f22fd0a0700 1 -- start start 2023-10-03T10:18:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 msgr2=0x7f6030070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f602400e9d0 tx=0x7f602400ece0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22f809f240 0x7f22f813a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22f809f650 0x7f22f81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8138840 con 0x7f22f809f240 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8136380 con 0x7f22f809e930 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22fd0a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22f8136b30 con 0x7f22f809f650 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 shutdown_connections 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6030135e50 0x7f60301c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f603009d6f0 0x7f6030070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 --2- 172.21.15.19:0/415499652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f603009e1d0 0x7f6030070fa0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 >> 172.21.15.19:0/415499652 conn(0x7f6030066f50 msgr2=0x7f60300a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49690/0 (socket says 172.21.15.19:49690) 2023-10-03T10:18:27.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 -- 172.21.15.19:0/36806916 learned_addr learned my addr 172.21.15.19:0/36806916 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 shutdown_connections 2023-10-03T10:18:27.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f603484d700 1 -- 172.21.15.19:0/415499652 wait complete. 2023-10-03T10:18:27.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f759e700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22f809f650 0x7f22f81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:27.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 -- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22f809f650 msgr2=0x7f22f81c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22f809f650 0x7f22f81c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 -- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22f809f240 msgr2=0x7f22f813a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22f809f240 0x7f22f813a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.909+0000 7f22f6d9d700 1 -- 172.21.15.19:0/36806916 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f0009a70 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.910+0000 7f22f6d9d700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f22e80090b0 tx=0x7f22e8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.910+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80045d0 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.910+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e801f070 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.910+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80038a0 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.910+0000 7f22fd0a0700 1 -- 172.21.15.19:0/36806916 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80094a0 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.911+0000 7f22fd0a0700 1 -- 172.21.15.19:0/36806916 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22f80a0190 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.912+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d00052e0 con 0x7f22f809e930 2023-10-03T10:18:27.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.912+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22e8003a00 con 0x7f22f809e930 2023-10-03T10:18:27.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.912+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22e8021070 con 0x7f22f809e930 2023-10-03T10:18:27.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:27.921+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22e8019e10 con 0x7f22f809e930 2023-10-03T10:18:27.927 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:28.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.045+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2181a7430 con 0x7ff21809f240 2023-10-03T10:18:28.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.046+0000 7ff2157fa700 1 -- 172.21.15.19:0/3334676891 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff20401e030 con 0x7ff21809f240 2023-10-03T10:18:28.046 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 msgr2=0x7ff2181a42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff204000f60 tx=0x7ff20400c730 comp rx=0 tx=0).stop 2023-10-03T10:18:28.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 shutdown_connections 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff21809f650 0x7ff2181a47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff21809e930 0x7ff2181a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 --2- 172.21.15.19:0/3334676891 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff21809f240 0x7ff2181a42b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 >> 172.21.15.19:0/3334676891 conn(0x7ff2180a4210 msgr2=0x7ff2181b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 shutdown_connections 2023-10-03T10:18:28.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.048+0000 7ff21ea88700 1 -- 172.21.15.19:0/3334676891 wait complete. 2023-10-03T10:18:28.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.082+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa63c074ea0 con 0x7fa63c134260 2023-10-03T10:18:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.082+0000 7fa6397fa700 1 -- 172.21.15.19:0/3756085955 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa634022030 con 0x7fa63c134260 2023-10-03T10:18:28.083 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 msgr2=0x7fa63c09d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa63400b6d0 tx=0x7fa63400b9e0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 shutdown_connections 2023-10-03T10:18:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa63c134260 0x7fa63c09d340 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa63c133420 0x7fa63c09c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 --2- 172.21.15.19:0/3756085955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa63c133e30 0x7fa63c09ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 >> 172.21.15.19:0/3756085955 conn(0x7fa63c0a4210 msgr2=0x7fa63c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 shutdown_connections 2023-10-03T10:18:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.085+0000 7fa6430c2700 1 -- 172.21.15.19:0/3756085955 wait complete. 2023-10-03T10:18:28.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:28.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.127+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f22d0005590 con 0x7f22f809e930 2023-10-03T10:18:28.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.127+0000 7f22df7fe700 1 -- 172.21.15.19:0/36806916 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22e802b020 con 0x7f22f809e930 2023-10-03T10:18:28.127 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 msgr2=0x7f22f8139ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f22e80090b0 tx=0x7f22e8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 shutdown_connections 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22f809f650 0x7f22f81c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22f809e930 0x7f22f8139ae0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 --2- 172.21.15.19:0/36806916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22f809f240 0x7f22f813a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 >> 172.21.15.19:0/36806916 conn(0x7f22f80a4210 msgr2=0x7f22f80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 shutdown_connections 2023-10-03T10:18:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:28.129+0000 7f22dd7fa700 1 -- 172.21.15.19:0/36806916 wait complete. 2023-10-03T10:18:28.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:28.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:29.063 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:29.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 Processor -- start 2023-10-03T10:18:29.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 -- start start 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f8130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f809f520 con 0x7f27f809d6f0 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809f130 con 0x7f27f809e000 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.075+0000 7f27ff2b9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27f809e930 con 0x7f27f809e410 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd055700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd055700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57118/0 (socket says 172.21.15.19:57118) 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd055700 1 -- 172.21.15.19:0/3987487040 learned_addr learned my addr 172.21.15.19:0/3987487040 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f8130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fc854700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 -- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 msgr2=0x7f27f8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 -- 172.21.15.19:0/3987487040 >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 msgr2=0x7f27f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 --2- 172.21.15.19:0/3987487040 >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 -- 172.21.15.19:0/3987487040 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f809b2d0 con 0x7f27f809e410 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd055700 1 --2- 172.21.15.19:0/3987487040 >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fc854700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27fd856700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f8130ba0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009dc0 tx=0x7f27f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20cea9a3bc8c58b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27effff700 1 -- 172.21.15.19:0/3987487040 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000e070 con 0x7f27f809e410 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27effff700 1 -- 172.21.15.19:0/3987487040 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f000bae0 con 0x7f27f809e410 2023-10-03T10:18:29.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.076+0000 7f27effff700 1 -- 172.21.15.19:0/3987487040 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f000be90 con 0x7f27f809e410 2023-10-03T10:18:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 -- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 msgr2=0x7f27f8130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f8130ba0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009dc0 tx=0x7f27f000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 -- 172.21.15.19:0/3987487040 shutdown_connections 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f8130ba0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/3987487040 >> v2:172.21.15.19:3300/0 conn(0x7f27f809d6f0 0x7f27f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/3987487040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.077+0000 7f27ff2b9700 1 -- 172.21.15.19:0/3987487040 >> 172.21.15.19:0/3987487040 conn(0x7f27f8066f50 msgr2=0x7f27f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.078+0000 7f27ff2b9700 1 -- 172.21.15.19:0/3987487040 shutdown_connections 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.078+0000 7f27ff2b9700 1 -- 172.21.15.19:0/3987487040 wait complete. 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 Processor -- start 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 -- start start 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 0x7f27f811dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f811e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f81218b0 con 0x7f27f809d6f0 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80a16b0 con 0x7f27f809e000 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.079+0000 7f27ff2b9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8121040 con 0x7f27f809e410 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd055700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 0x7f27f811dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fc854700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f811e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd055700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 0x7f27f811dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57122/0 (socket says 172.21.15.19:57122) 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fc854700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49714/0 (socket says 172.21.15.19:49714) 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd055700 1 -- 172.21.15.19:0/732084434 learned_addr learned my addr 172.21.15.19:0/732084434 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 -- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 msgr2=0x7f27f811e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 -- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 msgr2=0x7f27f811dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 0x7f27f811dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 -- 172.21.15.19:0/732084434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f400b7f0 con 0x7f27f809e410 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fc854700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27fd856700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f811e810 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f27f0016000 tx=0x7f27f0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0004550 con 0x7f27f809e410 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0020070 con 0x7f27f809e410 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e80094a0 con 0x7f27f809e410 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.080+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0004950 con 0x7f27f809e410 2023-10-03T10:18:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.081+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f0009a70 con 0x7f27f809e410 2023-10-03T10:18:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.082+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f811ac20 con 0x7f27f809e410 2023-10-03T10:18:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.082+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f27f0027480 con 0x7f27f809e410 2023-10-03T10:18:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.082+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f27f0022070 con 0x7f27f809e410 2023-10-03T10:18:29.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.087+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f27f0011980 con 0x7f27f809e410 2023-10-03T10:18:29.099 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:29.144 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.216+0000 7ff8de3dc700 1 Processor -- start 2023-10-03T10:18:29.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.216+0000 7ff8de3dc700 1 -- start start 2023-10-03T10:18:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8de3dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8de3dc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 0x7ff8d813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8de3dc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d8134980 con 0x7ff8d8134ec0 2023-10-03T10:18:29.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8de3dc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d806c4b0 con 0x7ff8d81380f0 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8de3dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80a09c0 con 0x7ff8d806c0e0 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.217+0000 7ff8dc979700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 0x7ff8d813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8dc979700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 0x7ff8d813fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57124/0 (socket says 172.21.15.19:57124) 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36374/0 (socket says 172.21.15.19:36374) 2023-10-03T10:18:29.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8dc979700 1 -- 172.21.15.19:0/313332967 learned_addr learned my addr 172.21.15.19:0/313332967 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 -- 172.21.15.19:0/313332967 >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 msgr2=0x7ff8d813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 --2- 172.21.15.19:0/313332967 >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 0x7ff8d813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 -- 172.21.15.19:0/313332967 >> v1:172.21.15.19:6789/0 conn(0x7ff8d8134ec0 legacy=0x7ff8d81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 -- 172.21.15.19:0/313332967 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80a0600 con 0x7ff8d806c0e0 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d7fff700 1 --2- 172.21.15.19:0/313332967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009840 tx=0x7ff8c8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a55ca5a5b58e4926 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d6ffd700 1 -- 172.21.15.19:0/313332967 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011830 con 0x7ff8d806c0e0 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d6ffd700 1 -- 172.21.15.19:0/313332967 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8011990 con 0x7ff8d806c0e0 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.218+0000 7ff8d6ffd700 1 -- 172.21.15.19:0/313332967 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8011d20 con 0x7ff8d806c0e0 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 -- 172.21.15.19:0/313332967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 msgr2=0x7ff8d809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/313332967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009840 tx=0x7ff8c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 -- 172.21.15.19:0/313332967 shutdown_connections 2023-10-03T10:18:29.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/313332967 >> v2:172.21.15.19:3300/0 conn(0x7ff8d81380f0 0x7ff8d813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/313332967 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d806c0e0 0x7ff8d809ac90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 -- 172.21.15.19:0/313332967 >> 172.21.15.19:0/313332967 conn(0x7ff8d80a4210 msgr2=0x7ff8d80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 -- 172.21.15.19:0/313332967 shutdown_connections 2023-10-03T10:18:29.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.219+0000 7ff8de3dc700 1 -- 172.21.15.19:0/313332967 wait complete. 2023-10-03T10:18:29.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.220+0000 7ff8de3dc700 1 Processor -- start 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 -- start start 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 0x7ff8d81ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d81380f0 0x7ff8d811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8134470 con 0x7ff8d8134ec0 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8133f60 con 0x7ff8d806c0e0 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8de3dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80a03f0 con 0x7ff8d81380f0 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.221+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57128/0 (socket says 172.21.15.19:57128) 2023-10-03T10:18:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 -- 172.21.15.19:0/4189158168 learned_addr learned my addr 172.21.15.19:0/4189158168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d7fff700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 0x7ff8d81ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8dc979700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d81380f0 0x7ff8d811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 -- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d81380f0 msgr2=0x7ff8d811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d81380f0 0x7ff8d811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 -- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 msgr2=0x7ff8d81ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 0x7ff8d81ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 -- 172.21.15.19:0/4189158168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80094a0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d7fff700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 0x7ff8d81ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d77fe700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c4b0 tx=0x7ff8cc00c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0052d0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc005430 con 0x7ff8d8134ec0 2023-10-03T10:18:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.222+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d811c540 con 0x7ff8d8134ec0 2023-10-03T10:18:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.223+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc003880 con 0x7ff8d8134ec0 2023-10-03T10:18:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.223+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d811e550 con 0x7ff8d8134ec0 2023-10-03T10:18:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.224+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d8074ea0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.224+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff8cc0039e0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.224+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff8cc03e9c0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.233+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff8cc019b40 con 0x7ff8d8134ec0 2023-10-03T10:18:29.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 Processor -- start 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 -- start start 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d8d0 0x7fa05809dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 0x7fa058130460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa05809e610 0x7fa0581309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05809b6e0 con 0x7fa05809e610 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05809b470 con 0x7fa05809e1e0 2023-10-03T10:18:29.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa05d1a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa05809eb80 con 0x7fa05809d8d0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.252+0000 7fa0577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 0x7fa058130460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa0577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 0x7fa058130460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49736/0 (socket says 172.21.15.19:49736) 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa0577fe700 1 -- 172.21.15.19:0/198301789 learned_addr learned my addr 172.21.15.19:0/198301789 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 --2- 172.21.15.19:0/198301789 >> v2:172.21.15.19:3300/0 conn(0x7fa05809e610 0x7fa0581309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa057fff700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d8d0 0x7fa05809dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 -- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d8d0 msgr2=0x7fa05809dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d8d0 0x7fa05809dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 -- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 msgr2=0x7fa058130460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 0x7fa058130460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 -- 172.21.15.19:0/198301789 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05809ae00 con 0x7fa05809e610 2023-10-03T10:18:29.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.253+0000 7fa05c9a1700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa0581309a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa050009d90 tx=0x7fa05000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9484f61cf8987b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.254+0000 7fa056ffd700 1 -- 172.21.15.19:0/198301789 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000e070 con 0x7fa05809e610 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.254+0000 7fa056ffd700 1 -- 172.21.15.19:0/198301789 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000bb20 con 0x7fa05809e610 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.254+0000 7fa056ffd700 1 -- 172.21.15.19:0/198301789 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050012430 con 0x7fa05809e610 2023-10-03T10:18:29.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 -- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 msgr2=0x7fa0581309a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa0581309a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fa050009d90 tx=0x7fa05000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 -- 172.21.15.19:0/198301789 shutdown_connections 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa0581309a0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809d8d0 0x7fa05809dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/198301789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809e1e0 0x7fa058130460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 -- 172.21.15.19:0/198301789 >> 172.21.15.19:0/198301789 conn(0x7fa0580a2e20 msgr2=0x7fa0580a3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 -- 172.21.15.19:0/198301789 shutdown_connections 2023-10-03T10:18:29.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.255+0000 7fa05d1a2700 1 -- 172.21.15.19:0/198301789 wait complete. 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.256+0000 7fa05d1a2700 1 Processor -- start 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 -- start start 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 0x7fa05811ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 0x7fa05811f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa05811f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058130170 con 0x7fa05809e610 2023-10-03T10:18:29.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa058120290 con 0x7fa05809d8d0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.257+0000 7fa05d1a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa058121840 con 0x7fa05809e1e0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa057fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 0x7fa05811ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa057fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 0x7fa05811ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49738/0 (socket says 172.21.15.19:49738) 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa057fff700 1 -- 172.21.15.19:0/4234297703 learned_addr learned my addr 172.21.15.19:0/4234297703 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa05c9a1700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa05811f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 0x7fa05811f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 -- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 msgr2=0x7fa05811ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 0x7fa05811ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 -- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 msgr2=0x7fa05811f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa05811f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 -- 172.21.15.19:0/4234297703 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009a70 con 0x7fa05809e1e0 2023-10-03T10:18:29.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa0577fe700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 0x7fa05811f370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa04c006fd0 tx=0x7fa04c00eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.258+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c013680 con 0x7fa05809e1e0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.259+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c0137e0 con 0x7fa05809e1e0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.259+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa058122320 con 0x7fa05809e1e0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.259+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05809c600 con 0x7fa05809e1e0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.259+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c013b70 con 0x7fa05809e1e0 2023-10-03T10:18:29.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.260+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa04c013cd0 con 0x7fa05809e1e0 2023-10-03T10:18:29.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.260+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa04c0128f0 con 0x7fa05809e1e0 2023-10-03T10:18:29.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.260+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0380052e0 con 0x7fa05809e1e0 2023-10-03T10:18:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.265+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa04c044060 con 0x7fa05809e1e0 2023-10-03T10:18:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.295+0000 7f0621a5b700 1 Processor -- start 2023-10-03T10:18:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.295+0000 7f0621a5b700 1 -- start start 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f0621a5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f0621a5b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f061c139250 0x7f061c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f0621a5b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f061c09edd0 con 0x7f061c0a0a30 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f0621a5b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f061c0a18e0 con 0x7f061c139250 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f0621a5b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061c09e1f0 con 0x7f061c0a1510 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f061a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f061a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36416/0 (socket says 172.21.15.19:36416) 2023-10-03T10:18:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f061a7fc700 1 -- 172.21.15.19:0/1482310041 learned_addr learned my addr 172.21.15.19:0/1482310041 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.296+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1482310041 >> v2:172.21.15.19:3300/0 conn(0x7f061c139250 0x7f061c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061b7fe700 1 -- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 msgr2=0x7f061c138d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061b7fe700 1 -- 172.21.15.19:0/1482310041 >> v1:172.21.15.19:6789/0 conn(0x7f061c0a0a30 legacy=0x7f061c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f0619ffb700 1 -- 172.21.15.19:0/1482310041 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003816423 0 0) 0x7f061c09edd0 con 0x7f061c0a0a30 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061b7fe700 1 -- 172.21.15.19:0/1482310041 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c09dc50 con 0x7f061c139250 2023-10-03T10:18:29.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061a7fc700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c139250 0x7f061c13b630 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80e0c162442701d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f0619ffb700 1 -- 172.21.15.19:0/1482310041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400e070 con 0x7f061c139250 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f0619ffb700 1 -- 172.21.15.19:0/1482310041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400bae0 con 0x7f061c139250 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.297+0000 7f0619ffb700 1 -- 172.21.15.19:0/1482310041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400be90 con 0x7f061c139250 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 -- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c139250 msgr2=0x7f061c13b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c139250 0x7f061c13b630 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f0614009dc0 tx=0x7f061400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 -- 172.21.15.19:0/1482310041 shutdown_connections 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c139250 0x7f061c13b630 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1482310041 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c0a1510 0x7f061c138d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 -- 172.21.15.19:0/1482310041 >> 172.21.15.19:0/1482310041 conn(0x7f061c0a6550 msgr2=0x7f061c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 -- 172.21.15.19:0/1482310041 shutdown_connections 2023-10-03T10:18:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.298+0000 7f0621a5b700 1 -- 172.21.15.19:0/1482310041 wait complete. 2023-10-03T10:18:29.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.300+0000 7f0621a5b700 1 Processor -- start 2023-10-03T10:18:29.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.300+0000 7f0621a5b700 1 -- start start 2023-10-03T10:18:29.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c0a0a30 0x7f061c122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f061c0a1510 0x7f061c122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061c125950 con 0x7f061c0a0a30 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061c124320 con 0x7f061c0a1510 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f0621a5b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f061c138070 con 0x7f061c139250 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36418/0 (socket says 172.21.15.19:36418) 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061b7fe700 1 -- 172.21.15.19:0/1216946113 learned_addr learned my addr 172.21.15.19:0/1216946113 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061a7fc700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f061c0a1510 0x7f061c122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061affd700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c0a0a30 0x7f061c122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.301+0000 7f061b7fe700 1 -- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f061c0a1510 msgr2=0x7f061c122c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f061c0a1510 0x7f061c122c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f061b7fe700 1 -- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c0a0a30 msgr2=0x7f061c122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c0a0a30 0x7f061c122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f061b7fe700 1 -- 172.21.15.19:0/1216946113 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610009550 con 0x7f061c139250 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f061b7fe700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0614013000 tx=0x7f0614004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06140045d0 con 0x7f061c139250 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614020070 con 0x7f061c139250 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0614009a70 con 0x7f061c139250 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0614004970 con 0x7f061c139250 2023-10-03T10:18:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.302+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061c0a0220 con 0x7f061c139250 2023-10-03T10:18:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.303+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0614027480 con 0x7f061c139250 2023-10-03T10:18:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.303+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0614022070 con 0x7f061c139250 2023-10-03T10:18:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.304+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061c125bd0 con 0x7f061c139250 2023-10-03T10:18:29.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.308+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27f8074ea0 con 0x7f27f809e410 2023-10-03T10:18:29.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.309+0000 7f27edffb700 1 -- 172.21.15.19:0/732084434 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f27f0035020 con 0x7f27f809e410 2023-10-03T10:18:29.309 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:29.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.309+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0614046060 con 0x7f061c139250 2023-10-03T10:18:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 msgr2=0x7f27f811e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f811e810 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f27f0016000 tx=0x7f27f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 shutdown_connections 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f27f809e410 0x7f27f811e810 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f27f809d6f0 0x7f27f811dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 --2- 172.21.15.19:0/732084434 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f27f809e000 0x7f27f811e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 >> 172.21.15.19:0/732084434 conn(0x7f27f8066f50 msgr2=0x7f27f8130970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 shutdown_connections 2023-10-03T10:18:29.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.311+0000 7f27ff2b9700 1 -- 172.21.15.19:0/732084434 wait complete. 2023-10-03T10:18:29.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:29.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.444+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff8d811e0b0 con 0x7ff8d8134ec0 2023-10-03T10:18:29.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.445+0000 7ff8d4ff9700 1 -- 172.21.15.19:0/4189158168 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff8cc017070 con 0x7ff8d8134ec0 2023-10-03T10:18:29.445 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 msgr2=0x7ff8d81cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00c4b0 tx=0x7ff8cc00c7c0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 shutdown_connections 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff8d81380f0 0x7ff8d811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff8d806c0e0 0x7ff8d81ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 --2- 172.21.15.19:0/4189158168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8d8134ec0 0x7ff8d81cd290 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 >> 172.21.15.19:0/4189158168 conn(0x7ff8d80a4210 msgr2=0x7ff8d80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.447+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 shutdown_connections 2023-10-03T10:18:29.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.448+0000 7ff8de3dc700 1 -- 172.21.15.19:0/4189158168 wait complete. 2023-10-03T10:18:29.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.475+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa038005590 con 0x7fa05809e1e0 2023-10-03T10:18:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.476+0000 7fa054ff9700 1 -- 172.21.15.19:0/4234297703 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa04c017020 con 0x7fa05809e1e0 2023-10-03T10:18:29.475 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 msgr2=0x7fa05811f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 0x7fa05811f370 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa04c006fd0 tx=0x7fa04c00eb00 comp rx=0 tx=0).stop 2023-10-03T10:18:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 shutdown_connections 2023-10-03T10:18:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa05809e610 0x7fa05811f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa05809d8d0 0x7fa05811ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 --2- 172.21.15.19:0/4234297703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa05809e1e0 0x7fa05811f370 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 >> 172.21.15.19:0/4234297703 conn(0x7fa0580a2e20 msgr2=0x7fa0581192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 shutdown_connections 2023-10-03T10:18:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.478+0000 7fa05d1a2700 1 -- 172.21.15.19:0/4234297703 wait complete. 2023-10-03T10:18:29.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:29.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.516+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f061c074ea0 con 0x7f061c139250 2023-10-03T10:18:29.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.517+0000 7f0603fff700 1 -- 172.21.15.19:0/1216946113 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0614025970 con 0x7f061c139250 2023-10-03T10:18:29.517 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 msgr2=0x7f061c123190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0614013000 tx=0x7f0614004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 shutdown_connections 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f061c139250 0x7f061c123190 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f061c0a0a30 0x7f061c122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 --2- 172.21.15.19:0/1216946113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f061c0a1510 0x7f061c122c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:29.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 >> 172.21.15.19:0/1216946113 conn(0x7f061c0a6550 msgr2=0x7f061c11c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:29.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 shutdown_connections 2023-10-03T10:18:29.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:29.519+0000 7f0621a5b700 1 -- 172.21.15.19:0/1216946113 wait complete. 2023-10-03T10:18:29.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:30.326 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:30.462 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:30.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.472+0000 7f877453c700 1 Processor -- start 2023-10-03T10:18:30.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.472+0000 7f877453c700 1 -- start start 2023-10-03T10:18:30.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f877453c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c09e1d0 0x7f876c138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f877453c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 0x7f876c13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f877453c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c09b120 con 0x7f876c09d6f0 2023-10-03T10:18:30.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f877453c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c06b460 con 0x7f876c09e1d0 2023-10-03T10:18:30.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f877453c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f876c09a7e0 con 0x7f876c139170 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8772ad9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 0x7f876c13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f87722d8700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f876c09d6f0 0x7f876c09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45018/0 (socket says 172.21.15.19:45018) 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f87722d8700 1 -- 172.21.15.19:0/4129808217 learned_addr learned my addr 172.21.15.19:0/4129808217 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8771ad7700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c09e1d0 0x7f876c138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8772ad9700 1 -- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c09e1d0 msgr2=0x7f876c138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8772ad9700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c09e1d0 0x7f876c138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8772ad9700 1 -- 172.21.15.19:0/4129808217 >> v1:172.21.15.19:6789/0 conn(0x7f876c09d6f0 legacy=0x7f876c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f87712d6700 1 -- 172.21.15.19:0/4129808217 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2707679586 0 0) 0x7f876c09b120 con 0x7f876c09d6f0 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.473+0000 7f8772ad9700 1 -- 172.21.15.19:0/4129808217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c09a500 con 0x7f876c139170 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f8772ad9700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 0x7f876c13b550 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8764009df0 tx=0x7f876400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d38e298fe6601d1e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f87712d6700 1 -- 172.21.15.19:0/4129808217 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400e070 con 0x7f876c139170 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f87712d6700 1 -- 172.21.15.19:0/4129808217 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876400bae0 con 0x7f876c139170 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f87712d6700 1 -- 172.21.15.19:0/4129808217 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400be90 con 0x7f876c139170 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f877453c700 1 -- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 msgr2=0x7f876c13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.474+0000 7f877453c700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 0x7f876c13b550 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8764009df0 tx=0x7f876400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 -- 172.21.15.19:0/4129808217 shutdown_connections 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c139170 0x7f876c13b550 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 --2- 172.21.15.19:0/4129808217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c09e1d0 0x7f876c138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 -- 172.21.15.19:0/4129808217 >> 172.21.15.19:0/4129808217 conn(0x7f876c066f50 msgr2=0x7f876c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 -- 172.21.15.19:0/4129808217 shutdown_connections 2023-10-03T10:18:30.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.475+0000 7f877453c700 1 -- 172.21.15.19:0/4129808217 wait complete. 2023-10-03T10:18:30.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 Processor -- start 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 -- start start 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c09e1d0 0x7f876c1199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 0x7f876c119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.476+0000 7f877453c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c138f20 con 0x7f876c09d6f0 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f877453c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c11c320 con 0x7f876c139170 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f877453c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f876c11b9b0 con 0x7f876c09e1d0 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57164/0 (socket says 172.21.15.19:57164) 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 -- 172.21.15.19:0/2835313095 learned_addr learned my addr 172.21.15.19:0/2835313095 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8772ad9700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 0x7f876c119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8771ad7700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c09e1d0 0x7f876c1199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 -- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c09e1d0 msgr2=0x7f876c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c09e1d0 0x7f876c1199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 -- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 msgr2=0x7f876c119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 0x7f876c119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 -- 172.21.15.19:0/2835313095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764009a70 con 0x7f876c09d6f0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8772ad9700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 0x7f876c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f87722d8700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f876800c550 tx=0x7f876800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768004c80 con 0x7f876c09d6f0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8768004de0 con 0x7f876c09d6f0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c11acf0 con 0x7f876c09d6f0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.477+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007310 con 0x7f876c09d6f0 2023-10-03T10:18:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.478+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c138730 con 0x7f876c09d6f0 2023-10-03T10:18:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.479+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876c11b140 con 0x7f876c09d6f0 2023-10-03T10:18:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.479+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8768007470 con 0x7f876c09d6f0 2023-10-03T10:18:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.479+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f876803f8f0 con 0x7f876c09d6f0 2023-10-03T10:18:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.484+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f87680133c0 con 0x7f876c09d6f0 2023-10-03T10:18:30.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:30.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:30.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 Processor -- start 2023-10-03T10:18:30.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 -- start start 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b8070940 con 0x7fb3b809f240 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b806fd60 con 0x7fb3b809e930 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.607+0000 7fb3bfdb9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b806fa80 con 0x7fb3b809f650 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49762/0 (socket says 172.21.15.19:49762) 2023-10-03T10:18:30.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 -- 172.21.15.19:0/937776794 learned_addr learned my addr 172.21.15.19:0/937776794 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 -- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 msgr2=0x7fb3b8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 --2- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 -- 172.21.15.19:0/937776794 >> v1:172.21.15.19:6789/0 conn(0x7fb3b809f240 legacy=0x7fb3b81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 -- 172.21.15.19:0/937776794 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b809fb60 con 0x7fb3b809e930 2023-10-03T10:18:30.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bdb55700 1 --2- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009920 tx=0x7fb3b4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e285b685e73537b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.608+0000 7fb3bcb53700 1 -- 172.21.15.19:0/937776794 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4004230 con 0x7fb3b809e930 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bcb53700 1 -- 172.21.15.19:0/937776794 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4004390 con 0x7fb3b809e930 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bcb53700 1 -- 172.21.15.19:0/937776794 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4009e70 con 0x7fb3b809e930 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 msgr2=0x7fb3b809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009920 tx=0x7fb3b4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/937776794 shutdown_connections 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/937776794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809e930 0x7fb3b809ed00 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/937776794 >> 172.21.15.19:0/937776794 conn(0x7fb3b80a4210 msgr2=0x7fb3b80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/937776794 shutdown_connections 2023-10-03T10:18:30.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.609+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/937776794 wait complete. 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.611+0000 7fb3bfdb9700 1 Processor -- start 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.611+0000 7fb3bfdb9700 1 -- start start 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809f240 0x7fb3b81a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b81a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b81a4990 con 0x7fb3b809e930 2023-10-03T10:18:30.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b81a5be0 con 0x7fb3b809f240 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bfdb9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b81a6660 con 0x7fb3b809f650 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57168/0 (socket says 172.21.15.19:57168) 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 -- 172.21.15.19:0/2145166072 learned_addr learned my addr 172.21.15.19:0/2145166072 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bd354700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809f240 0x7fb3b81a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 -- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 msgr2=0x7fb3b81a3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b81a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 -- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809f240 msgr2=0x7fb3b81a3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809f240 0x7fb3b81a3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.612+0000 7fb3bdb55700 1 -- 172.21.15.19:0/2145166072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b4009550 con 0x7fb3b809e930 2023-10-03T10:18:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3bdb55700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098f0 tx=0x7fb3b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b400bca0 con 0x7fb3b809e930 2023-10-03T10:18:30.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b401f070 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b80a0190 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40036a0 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.613+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b80a37a0 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.614+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3b4021030 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.614+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3b401a7c0 con 0x7fb3b809e930 2023-10-03T10:18:30.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.614+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8074ea0 con 0x7fb3b809e930 2023-10-03T10:18:30.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.620+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3b4046060 con 0x7fb3b809e930 2023-10-03T10:18:30.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.640+0000 7fed6a0c7700 1 Processor -- start 2023-10-03T10:18:30.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 -- start start 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed6412f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed6412c2f0 0x7fed6412fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6409a510 con 0x7fed6412c2f0 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6412c7d0 con 0x7fed6412cc20 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed6a0c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed6409c190 con 0x7fed6412cff0 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed62ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed6412c2f0 0x7fed6412fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed62ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fed6412c2f0 0x7fed6412fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57180/0 (socket says 172.21.15.19:57180) 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed62ffd700 1 -- 172.21.15.19:0/134724080 learned_addr learned my addr 172.21.15.19:0/134724080 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.641+0000 7fed63fff700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed637fe700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed6412f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 -- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 msgr2=0x7fed641303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 -- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 msgr2=0x7fed6412f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed6412f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 -- 172.21.15.19:0/134724080 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6409b540 con 0x7fed6412c2f0 2023-10-03T10:18:30.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed62ffd700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed6412fe70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fed5800bbc0 tx=0x7fed5800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d2112e3b84ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed627fc700 1 -- 172.21.15.19:0/134724080 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5800dcf0 con 0x7fed6412c2f0 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed627fc700 1 -- 172.21.15.19:0/134724080 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5800de50 con 0x7fed6412c2f0 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.642+0000 7fed627fc700 1 -- 172.21.15.19:0/134724080 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58010690 con 0x7fed6412c2f0 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.643+0000 7fed6a0c7700 1 -- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 msgr2=0x7fed6412fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.643+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed6412fe70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fed5800bbc0 tx=0x7fed5800bed0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 -- 172.21.15.19:0/134724080 shutdown_connections 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed6412f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641303b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/134724080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed6412fe70 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 -- 172.21.15.19:0/134724080 >> 172.21.15.19:0/134724080 conn(0x7fed6409f470 msgr2=0x7fed640a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 -- 172.21.15.19:0/134724080 shutdown_connections 2023-10-03T10:18:30.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.644+0000 7fed6a0c7700 1 -- 172.21.15.19:0/134724080 wait complete. 2023-10-03T10:18:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.645+0000 7fed6a0c7700 1 Processor -- start 2023-10-03T10:18:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.645+0000 7fed6a0c7700 1 -- start start 2023-10-03T10:18:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed641b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6408bd90 con 0x7fed6412c2f0 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed64129fa0 con 0x7fed6412cc20 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed6a0c7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed641b6f90 con 0x7fed6412cff0 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57194/0 (socket says 172.21.15.19:57194) 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 -- 172.21.15.19:0/638564844 learned_addr learned my addr 172.21.15.19:0/638564844 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed63fff700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 -- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 msgr2=0x7fed641c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 -- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 msgr2=0x7fed641b7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed641b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.646+0000 7fed637fe700 1 -- 172.21.15.19:0/638564844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5800b7f0 con 0x7fed6412c2f0 2023-10-03T10:18:30.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed637fe700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e810 tx=0x7fed5400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54013610 con 0x7fed6412c2f0 2023-10-03T10:18:30.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed54013770 con 0x7fed6412c2f0 2023-10-03T10:18:30.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6412bf90 con 0x7fed6412c2f0 2023-10-03T10:18:30.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed54013ae0 con 0x7fed6412c2f0 2023-10-03T10:18:30.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.647+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64071d10 con 0x7fed6412c2f0 2023-10-03T10:18:30.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.648+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed640747f0 con 0x7fed6412c2f0 2023-10-03T10:18:30.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.649+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fed54013c40 con 0x7fed6412c2f0 2023-10-03T10:18:30.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.649+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fed5403f940 con 0x7fed6412c2f0 2023-10-03T10:18:30.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.654+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fed54026480 con 0x7fed6412c2f0 2023-10-03T10:18:30.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.699+0000 7ff969376700 1 Processor -- start 2023-10-03T10:18:30.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.699+0000 7ff969376700 1 -- start start 2023-10-03T10:18:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff969376700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff969376700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f240 0x7ff9641317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff969376700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff964070940 con 0x7ff96409f650 2023-10-03T10:18:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff969376700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96406fd60 con 0x7ff96409e930 2023-10-03T10:18:30.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff969376700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff96406fa80 con 0x7ff96409f240 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff962ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff962ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49790/0 (socket says 172.21.15.19:49790) 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff962ffd700 1 -- 172.21.15.19:0/302825466 learned_addr learned my addr 172.21.15.19:0/302825466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff9627fc700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f240 0x7ff9641317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff962ffd700 1 -- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f240 msgr2=0x7ff9641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff962ffd700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f240 0x7ff9641317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff962ffd700 1 -- 172.21.15.19:0/302825466 >> v1:172.21.15.19:6789/0 conn(0x7ff96409f650 legacy=0x7ff964131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.700+0000 7ff961ffb700 1 -- 172.21.15.19:0/302825466 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261627574 0 0) 0x7ff964070940 con 0x7ff96409f650 2023-10-03T10:18:30.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff962ffd700 1 -- 172.21.15.19:0/302825466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96409fb60 con 0x7ff96409e930 2023-10-03T10:18:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff962ffd700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff954009920 tx=0x7ff954009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e382649d80cf29 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff961ffb700 1 -- 172.21.15.19:0/302825466 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954011830 con 0x7ff96409e930 2023-10-03T10:18:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff961ffb700 1 -- 172.21.15.19:0/302825466 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff954011990 con 0x7ff96409e930 2023-10-03T10:18:30.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.701+0000 7ff961ffb700 1 -- 172.21.15.19:0/302825466 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954011d20 con 0x7ff96409e930 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 -- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 msgr2=0x7ff96409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff954009920 tx=0x7ff954009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 -- 172.21.15.19:0/302825466 shutdown_connections 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff96409ed00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 --2- 172.21.15.19:0/302825466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f240 0x7ff9641317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 -- 172.21.15.19:0/302825466 >> 172.21.15.19:0/302825466 conn(0x7ff9640a4210 msgr2=0x7ff9640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 -- 172.21.15.19:0/302825466 shutdown_connections 2023-10-03T10:18:30.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.702+0000 7ff969376700 1 -- 172.21.15.19:0/302825466 wait complete. 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.703+0000 7ff969376700 1 Processor -- start 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.703+0000 7ff969376700 1 -- start start 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff9641a3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f650 0x7ff9641a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641a7640 con 0x7ff96409f240 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641a6a10 con 0x7ff96409e930 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff969376700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9641a4f80 con 0x7ff96409f650 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57208/0 (socket says 172.21.15.19:57208) 2023-10-03T10:18:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 -- 172.21.15.19:0/488158621 learned_addr learned my addr 172.21.15.19:0/488158621 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff962ffd700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff9641a3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 -- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f650 msgr2=0x7ff9641a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f650 0x7ff9641a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 -- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 msgr2=0x7ff9641a3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff9641a3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 -- 172.21.15.19:0/488158621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954009550 con 0x7ff96409f240 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.704+0000 7ff9627fc700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e9b0 tx=0x7ff95800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.705+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff958009710 con 0x7ff96409f240 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.705+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95800c850 con 0x7ff96409f240 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.705+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9640a0190 con 0x7ff96409f240 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.705+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9640a33f0 con 0x7ff96409f240 2023-10-03T10:18:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.705+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95800cbe0 con 0x7ff96409f240 2023-10-03T10:18:30.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.706+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff95800cd40 con 0x7ff96409f240 2023-10-03T10:18:30.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.706+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9440052e0 con 0x7ff96409f240 2023-10-03T10:18:30.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.707+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff95803fc20 con 0x7ff96409f240 2023-10-03T10:18:30.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.716+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff95801b3b0 con 0x7ff96409f240 2023-10-03T10:18:30.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.722+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f876c074ed0 con 0x7f876c09d6f0 2023-10-03T10:18:30.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.722+0000 7f8762ffd700 1 -- 172.21.15.19:0/2835313095 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f876801b340 con 0x7f876c09d6f0 2023-10-03T10:18:30.722 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:30.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 msgr2=0x7f876c119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f876800c550 tx=0x7f876800c860 comp rx=0 tx=0).stop 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 shutdown_connections 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876c139170 0x7f876c119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876c09d6f0 0x7f876c119480 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 --2- 172.21.15.19:0/2835313095 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876c09e1d0 0x7f876c1199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.725+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 >> 172.21.15.19:0/2835313095 conn(0x7f876c066f50 msgr2=0x7f876c1326f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.726+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 shutdown_connections 2023-10-03T10:18:30.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.726+0000 7f877453c700 1 -- 172.21.15.19:0/2835313095 wait complete. 2023-10-03T10:18:30.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.850+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb3b8074ea0 con 0x7fb3b809e930 2023-10-03T10:18:30.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.850+0000 7fb3ae7fc700 1 -- 172.21.15.19:0/2145166072 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3b401a440 con 0x7fb3b809e930 2023-10-03T10:18:30.851 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:30.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 msgr2=0x7fb3b81a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098f0 tx=0x7fb3b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:30.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 shutdown_connections 2023-10-03T10:18:30.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb3b809f650 0x7fb3b81a3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3b809e930 0x7fb3b81a2e10 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 --2- 172.21.15.19:0/2145166072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb3b809f240 0x7fb3b81a3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 >> 172.21.15.19:0/2145166072 conn(0x7fb3b80a4210 msgr2=0x7fb3b81b8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 shutdown_connections 2023-10-03T10:18:30.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.854+0000 7fb3bfdb9700 1 -- 172.21.15.19:0/2145166072 wait complete. 2023-10-03T10:18:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.866+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fed6406b250 con 0x7fed6412c2f0 2023-10-03T10:18:30.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.867+0000 7fed4bfff700 1 -- 172.21.15.19:0/638564844 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed5401a360 con 0x7fed6412c2f0 2023-10-03T10:18:30.867 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 msgr2=0x7fed641b7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fed5400e810 tx=0x7fed5400eb20 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 shutdown_connections 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fed6412cff0 0x7fed641c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fed6412c2f0 0x7fed641b7430 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 --2- 172.21.15.19:0/638564844 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fed6412cc20 0x7fed641b7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 >> 172.21.15.19:0/638564844 conn(0x7fed6409f470 msgr2=0x7fed640992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 shutdown_connections 2023-10-03T10:18:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.869+0000 7fed6a0c7700 1 -- 172.21.15.19:0/638564844 wait complete. 2023-10-03T10:18:30.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:30.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.945+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff944005590 con 0x7ff96409f240 2023-10-03T10:18:30.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.946+0000 7ff94b7fe700 1 -- 172.21.15.19:0/488158621 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff958011b40 con 0x7ff96409f240 2023-10-03T10:18:30.946 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 msgr2=0x7ff9641a4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7ff95800e9b0 tx=0x7ff95800ed70 comp rx=0 tx=0).stop 2023-10-03T10:18:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 shutdown_connections 2023-10-03T10:18:30.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff96409f650 0x7ff9641a45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff96409e930 0x7ff9641a3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 --2- 172.21.15.19:0/488158621 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff96409f240 0x7ff9641a4060 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 >> 172.21.15.19:0/488158621 conn(0x7ff9640a4210 msgr2=0x7ff9641b8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 shutdown_connections 2023-10-03T10:18:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:30.948+0000 7ff969376700 1 -- 172.21.15.19:0/488158621 wait complete. 2023-10-03T10:18:30.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:31.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:31.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:31.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.893+0000 7f6435b1e700 1 Processor -- start 2023-10-03T10:18:31.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.893+0000 7f6435b1e700 1 -- start start 2023-10-03T10:18:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6435b1e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f6430138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6435b1e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6430139170 0x7f643013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6435b1e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643009b120 con 0x7f643009d6f0 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6435b1e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643006b460 con 0x7f6430139170 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6435b1e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643009a7e0 con 0x7f643009e1d0 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f6426ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f6430138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f642ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6430139170 0x7f643013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f642f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f643009d6f0 0x7f643009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45042/0 (socket says 172.21.15.19:45042) 2023-10-03T10:18:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.894+0000 7f642f7fe700 1 -- 172.21.15.19:0/2626728202 learned_addr learned my addr 172.21.15.19:0/2626728202 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642ffff700 1 -- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 msgr2=0x7f6430138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642ffff700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f6430138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642ffff700 1 -- 172.21.15.19:0/2626728202 >> v1:172.21.15.19:6789/0 conn(0x7f643009d6f0 legacy=0x7f643009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642ffff700 1 -- 172.21.15.19:0/2626728202 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643009a500 con 0x7f6430139170 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f6426ffd700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f6430138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642ffff700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643013b550 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2b0bae976e5745 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642effd700 1 -- 172.21.15.19:0/2626728202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642800e070 con 0x7f6430139170 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642effd700 1 -- 172.21.15.19:0/2626728202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642800bb20 con 0x7f6430139170 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.895+0000 7f642effd700 1 -- 172.21.15.19:0/2626728202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428012430 con 0x7f6430139170 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 -- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 msgr2=0x7f643013b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643013b550 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6428009d90 tx=0x7f642800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 -- 172.21.15.19:0/2626728202 shutdown_connections 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643013b550 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 --2- 172.21.15.19:0/2626728202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f6430138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 -- 172.21.15.19:0/2626728202 >> 172.21.15.19:0/2626728202 conn(0x7f6430066f50 msgr2=0x7f643009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:31.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 -- 172.21.15.19:0/2626728202 shutdown_connections 2023-10-03T10:18:31.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.896+0000 7f6435b1e700 1 -- 172.21.15.19:0/2626728202 wait complete. 2023-10-03T10:18:31.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.897+0000 7f6435b1e700 1 Processor -- start 2023-10-03T10:18:31.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 -- start start 2023-10-03T10:18:31.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 0x7f64301c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f64301c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430120560 con 0x7f6430139170 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6430120370 con 0x7f643009e1d0 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6435b1e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6430121ad0 con 0x7f643009d6f0 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f642ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f642ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57226/0 (socket says 172.21.15.19:57226) 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f642ffff700 1 -- 172.21.15.19:0/3892348080 learned_addr learned my addr 172.21.15.19:0/3892348080 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:31.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f642f7fe700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 0x7f64301c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.898+0000 7f6426ffd700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f64301c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 -- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 msgr2=0x7f64301c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f64301c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 -- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 msgr2=0x7f643011e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 -- 172.21.15.19:0/3892348080 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64180094a0 con 0x7f643009d6f0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642ffff700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642f7fe700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 0x7f64301c8560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f642000c500 tx=0x7f642000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:31.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420005d70 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64200070d0 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6420007440 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6428009a70 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.899+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6430121fa0 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.900+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f64200075a0 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.901+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6430074ea0 con 0x7f643009d6f0 2023-10-03T10:18:31.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.901+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f642003e970 con 0x7f643009d6f0 2023-10-03T10:18:31.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:31.906+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6420019d20 con 0x7f643009d6f0 2023-10-03T10:18:31.962 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:32.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.017+0000 7facc16c8700 1 Processor -- start 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.017+0000 7facc16c8700 1 -- start start 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facc16c8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 0x7facbc09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facc16c8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facc16c8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facbc09a810 con 0x7facbc13c1e0 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facc16c8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc06ab40 con 0x7facbc09dc30 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facc16c8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facbc09ebc0 con 0x7facbc06a770 2023-10-03T10:18:32.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facba7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facba7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49828/0 (socket says 172.21.15.19:49828) 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facba7fc700 1 -- 172.21.15.19:0/1614748450 learned_addr learned my addr 172.21.15.19:0/1614748450 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:32.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facbaffd700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 0x7facbc09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facbaffd700 1 -- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 msgr2=0x7facbc09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facbaffd700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facbaffd700 1 -- 172.21.15.19:0/1614748450 >> v1:172.21.15.19:6789/0 conn(0x7facbc13c1e0 legacy=0x7facbc13e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facbaffd700 1 -- 172.21.15.19:0/1614748450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc09e920 con 0x7facbc06a770 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.018+0000 7facba7fc700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.019+0000 7facbaffd700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 0x7facbc09d6f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7facac0098a0 tx=0x7facac009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac317c6718f96897 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.019+0000 7facb9ffb700 1 -- 172.21.15.19:0/1614748450 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011830 con 0x7facbc06a770 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.019+0000 7facb9ffb700 1 -- 172.21.15.19:0/1614748450 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac011990 con 0x7facbc06a770 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.019+0000 7facb9ffb700 1 -- 172.21.15.19:0/1614748450 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac011d20 con 0x7facbc06a770 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 -- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 msgr2=0x7facbc09d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 0x7facbc09d6f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7facac0098a0 tx=0x7facac009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 -- 172.21.15.19:0/1614748450 shutdown_connections 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc06a770 0x7facbc09d6f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 --2- 172.21.15.19:0/1614748450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc09dc30 0x7facbc09e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 -- 172.21.15.19:0/1614748450 >> 172.21.15.19:0/1614748450 conn(0x7facbc066f50 msgr2=0x7facbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 -- 172.21.15.19:0/1614748450 shutdown_connections 2023-10-03T10:18:32.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.020+0000 7facc16c8700 1 -- 172.21.15.19:0/1614748450 wait complete. 2023-10-03T10:18:32.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.021+0000 7facc16c8700 1 Processor -- start 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.021+0000 7facc16c8700 1 -- start start 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc06a770 0x7facbc13e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 0x7facbc13a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facbc134be0 con 0x7facbc09dc30 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facbc09f1a0 con 0x7facbc06a770 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facc16c8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7facbc071e50 con 0x7facbc13c1e0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facbb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facbb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36524/0 (socket says 172.21.15.19:36524) 2023-10-03T10:18:32.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.022+0000 7facbb7fe700 1 -- 172.21.15.19:0/3348709853 learned_addr learned my addr 172.21.15.19:0/3348709853 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbaffd700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc06a770 0x7facbc13e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facba7fc700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 0x7facbc13a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 -- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc06a770 msgr2=0x7facbc13e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc06a770 0x7facbc13e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 -- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 msgr2=0x7facbc13a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 0x7facbc13a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 -- 172.21.15.19:0/3348709853 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009550 con 0x7facbc13c1e0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facba7fc700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 0x7facbc13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facbb7fe700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7facb400cc50 tx=0x7facb400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb4003c00 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb4003d60 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac0094a0 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb400ab60 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.023+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facbc140070 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.025+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7facb400acc0 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.025+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7facb403f650 con 0x7facbc13c1e0 2023-10-03T10:18:32.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.025+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facbc074ea0 con 0x7facbc13c1e0 2023-10-03T10:18:32.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.030+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7facb40198f0 con 0x7facbc13c1e0 2023-10-03T10:18:32.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.040+0000 7f84d1fa4700 1 Processor -- start 2023-10-03T10:18:32.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.040+0000 7f84d1fa4700 1 -- start start 2023-10-03T10:18:32.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84d1fa4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc0a0a30 0x7f84cc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84d1fa4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84d1fa4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84cc0a2a70 con 0x7f84cc133930 2023-10-03T10:18:32.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84d1fa4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0a01d0 con 0x7f84cc0a0a30 2023-10-03T10:18:32.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84d1fa4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc09e2b0 con 0x7f84cc09d630 2023-10-03T10:18:32.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84cbfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f84cc133930 0x7f84cc133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45050/0 (socket says 172.21.15.19:45050) 2023-10-03T10:18:32.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84cbfff700 1 -- 172.21.15.19:0/3820445922 learned_addr learned my addr 172.21.15.19:0/3820445922 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:32.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84cb7fe700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc0a0a30 0x7f84cc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.041+0000 7f84caffd700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84caffd700 1 -- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc0a0a30 msgr2=0x7f84cc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84caffd700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc0a0a30 0x7f84cc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84caffd700 1 -- 172.21.15.19:0/3820445922 >> v1:172.21.15.19:6789/0 conn(0x7f84cc133930 legacy=0x7f84cc133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84caffd700 1 -- 172.21.15.19:0/3820445922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc09dc50 con 0x7f84cc09d630 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84caffd700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc0a1340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009870 tx=0x7f84c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a5e47075d9ac1f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84ca7fc700 1 -- 172.21.15.19:0/3820445922 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011830 con 0x7f84cc09d630 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84ca7fc700 1 -- 172.21.15.19:0/3820445922 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c0011990 con 0x7f84cc09d630 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.042+0000 7f84ca7fc700 1 -- 172.21.15.19:0/3820445922 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0011d20 con 0x7f84cc09d630 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 msgr2=0x7f84cc0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc0a1340 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f84c0009870 tx=0x7f84c0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3820445922 shutdown_connections 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc0a0a30 0x7f84cc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3820445922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc0a1340 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3820445922 >> 172.21.15.19:0/3820445922 conn(0x7f84cc0a3050 msgr2=0x7f84cc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3820445922 shutdown_connections 2023-10-03T10:18:32.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.043+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3820445922 wait complete. 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.044+0000 7f84d1fa4700 1 Processor -- start 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 -- start start 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84cc0a0a30 0x7f84cc1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc133930 0x7f84cc1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1206f0 con 0x7f84cc0a0a30 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc0a0410 con 0x7f84cc133930 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84d1fa4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84cc1334a0 con 0x7f84cc09d630 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84cb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84cb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36538/0 (socket says 172.21.15.19:36538) 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84cb7fe700 1 -- 172.21.15.19:0/3767216574 learned_addr learned my addr 172.21.15.19:0/3767216574 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.045+0000 7f84cbfff700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc133930 0x7f84cc1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 -- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc133930 msgr2=0x7f84cc1c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc133930 0x7f84cc1c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 -- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84cc0a0a30 msgr2=0x7f84cc1c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84cc0a0a30 0x7f84cc1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 -- 172.21.15.19:0/3767216574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c00094a0 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84cb7fe700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00e9b0 tx=0x7f84bc00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc009710 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00c850 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84cc121ee0 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00cbc0 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.046+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84cc122c10 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.047+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84bc00cd20 con 0x7f84cc09d630 2023-10-03T10:18:32.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.047+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84bc03f870 con 0x7f84cc09d630 2023-10-03T10:18:32.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.048+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84cc0747f0 con 0x7f84cc09d630 2023-10-03T10:18:32.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.053+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84bc017080 con 0x7f84cc09d630 2023-10-03T10:18:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.129+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6430120b60 con 0x7f643009d6f0 2023-10-03T10:18:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.129+0000 7f642cff9700 1 -- 172.21.15.19:0/3892348080 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6420017020 con 0x7f643009d6f0 2023-10-03T10:18:32.129 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.131+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 msgr2=0x7f64301c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.131+0000 7f6435b1e700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 0x7f64301c8560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f642000c500 tx=0x7f642000c810 comp rx=0 tx=0).stop 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 shutdown_connections 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6430139170 0x7f643011e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f643009d6f0 0x7f64301c8560 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 --2- 172.21.15.19:0/3892348080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f643009e1d0 0x7f64301c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 >> 172.21.15.19:0/3892348080 conn(0x7f6430066f50 msgr2=0x7f64300a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 shutdown_connections 2023-10-03T10:18:32.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.132+0000 7f6435b1e700 1 -- 172.21.15.19:0/3892348080 wait complete. 2023-10-03T10:18:32.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.150+0000 7f1b05250700 1 Processor -- start 2023-10-03T10:18:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 -- start start 2023-10-03T10:18:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b0009d6f0 0x7f1b0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 0x7f1b00130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0009f130 con 0x7f1b0009e000 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0009f520 con 0x7f1b0009d6f0 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.151+0000 7f1b05250700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0009e930 con 0x7f1b0009e410 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1aff59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 0x7f1b00130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b0009d6f0 0x7f1b0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1aff59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 0x7f1b00130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36548/0 (socket says 172.21.15.19:36548) 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b0009d6f0 0x7f1b0009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57246/0 (socket says 172.21.15.19:57246) 2023-10-03T10:18:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1aff59e700 1 -- 172.21.15.19:0/4219741663 learned_addr learned my addr 172.21.15.19:0/4219741663 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afdd9b700 1 -- 172.21.15.19:0/4219741663 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760182286 0 0) 0x7f1b0009f130 con 0x7f1b0009e000 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afdd9b700 1 -- 172.21.15.19:0/4219741663 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae80035b0 con 0x7f1b0009e000 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 -- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 msgr2=0x7f1b00130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 --2- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 0x7f1b00130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 -- 172.21.15.19:0/4219741663 >> v1:172.21.15.19:6789/0 conn(0x7f1b0009e000 legacy=0x7f1b00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 -- 172.21.15.19:0/4219741663 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0009b2d0 con 0x7f1b0009d6f0 2023-10-03T10:18:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afed9d700 1 --2- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009d6f0 0x7f1b0009dac0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009840 tx=0x7f1af0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726478b0facf33bf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afdd9b700 1 -- 172.21.15.19:0/4219741663 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011830 con 0x7f1b0009d6f0 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.152+0000 7f1afdd9b700 1 -- 172.21.15.19:0/4219741663 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af0011990 con 0x7f1b0009d6f0 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1afdd9b700 1 -- 172.21.15.19:0/4219741663 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0011d20 con 0x7f1b0009d6f0 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 -- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009d6f0 msgr2=0x7f1b0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 --2- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009d6f0 0x7f1b0009dac0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f1af0009840 tx=0x7f1af0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 -- 172.21.15.19:0/4219741663 shutdown_connections 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 --2- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e410 0x7f1b00130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 --2- 172.21.15.19:0/4219741663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009d6f0 0x7f1b0009dac0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 -- 172.21.15.19:0/4219741663 >> 172.21.15.19:0/4219741663 conn(0x7f1b00066f50 msgr2=0x7f1b0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 -- 172.21.15.19:0/4219741663 shutdown_connections 2023-10-03T10:18:32.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.153+0000 7f1b05250700 1 -- 172.21.15.19:0/4219741663 wait complete. 2023-10-03T10:18:32.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.155+0000 7f1b05250700 1 Processor -- start 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.155+0000 7f1b05250700 1 -- start start 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e000 0x7f1b001368e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 0x7f1b00136e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b000a3820 con 0x7f1b0009e410 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00138aa0 con 0x7f1b0009d6f0 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1b05250700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0013b0f0 con 0x7f1b0009e000 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49864/0 (socket says 172.21.15.19:49864) 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 -- 172.21.15.19:0/3305539499 learned_addr learned my addr 172.21.15.19:0/3305539499 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1aff59e700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 0x7f1b00136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afe59c700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e000 0x7f1b001368e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 -- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e000 msgr2=0x7f1b001368e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e000 0x7f1b001368e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.156+0000 7f1afed9d700 1 -- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 msgr2=0x7f1b00136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1afed9d700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 0x7f1b00136e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1afed9d700 1 -- 172.21.15.19:0/3305539499 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af00094a0 con 0x7f1b0009d6f0 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1aff59e700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 0x7f1b00136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:32.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1afed9d700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1af00090b0 tx=0x7f1af0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0004590 con 0x7f1b0009d6f0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af001f070 con 0x7f1b0009d6f0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0013a120 con 0x7f1b0009d6f0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af00038e0 con 0x7f1b0009d6f0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.157+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0013ab90 con 0x7f1b0009d6f0 2023-10-03T10:18:32.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.158+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1af0003a40 con 0x7f1b0009d6f0 2023-10-03T10:18:32.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.158+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b00139f60 con 0x7f1b0009d6f0 2023-10-03T10:18:32.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.158+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1af0021070 con 0x7f1b0009d6f0 2023-10-03T10:18:32.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.163+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1af001a430 con 0x7f1b0009d6f0 2023-10-03T10:18:32.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.263+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f84cc072980 con 0x7f84cc09d630 2023-10-03T10:18:32.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.263+0000 7f84b3fff700 1 -- 172.21.15.19:0/3767216574 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84bc01b820 con 0x7f84cc09d630 2023-10-03T10:18:32.263 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 msgr2=0x7f84cc1c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00e9b0 tx=0x7f84bc00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 shutdown_connections 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84cc133930 0x7f84cc1c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84cc09d630 0x7f84cc1c8190 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 --2- 172.21.15.19:0/3767216574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84cc0a0a30 0x7f84cc1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.265+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 >> 172.21.15.19:0/3767216574 conn(0x7f84cc0a3050 msgr2=0x7f84cc1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.266+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 shutdown_connections 2023-10-03T10:18:32.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.266+0000 7f84d1fa4700 1 -- 172.21.15.19:0/3767216574 wait complete. 2023-10-03T10:18:32.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:32.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.296+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7facbc06c360 con 0x7facbc13c1e0 2023-10-03T10:18:32.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.296+0000 7faca37fe700 1 -- 172.21.15.19:0/3348709853 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facb4019300 con 0x7facbc13c1e0 2023-10-03T10:18:32.296 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 msgr2=0x7facbc13a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7facb400cc50 tx=0x7facb400cf60 comp rx=0 tx=0).stop 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 shutdown_connections 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7facbc13c1e0 0x7facbc13a9e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7facbc06a770 0x7facbc13e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 --2- 172.21.15.19:0/3348709853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7facbc09dc30 0x7facbc13a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 >> 172.21.15.19:0/3348709853 conn(0x7facbc066f50 msgr2=0x7facbc0a15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 shutdown_connections 2023-10-03T10:18:32.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.298+0000 7facc16c8700 1 -- 172.21.15.19:0/3348709853 wait complete. 2023-10-03T10:18:32.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:32.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.370+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1b00074ea0 con 0x7f1b0009d6f0 2023-10-03T10:18:32.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.370+0000 7f1ae77fe700 1 -- 172.21.15.19:0/3305539499 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1af0015070 con 0x7f1b0009d6f0 2023-10-03T10:18:32.370 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:32.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 msgr2=0x7f1b00130c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1af00090b0 tx=0x7f1af0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 shutdown_connections 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b0009e410 0x7f1b00136e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b0009d6f0 0x7f1b00130c50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 --2- 172.21.15.19:0/3305539499 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b0009e000 0x7f1b001368e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.372+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 >> 172.21.15.19:0/3305539499 conn(0x7f1b00066f50 msgr2=0x7f1b000a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.373+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 shutdown_connections 2023-10-03T10:18:32.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:32.373+0000 7f1b05250700 1 -- 172.21.15.19:0/3305539499 wait complete. 2023-10-03T10:18:32.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:33.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:33.280 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.293+0000 7fba053ee700 1 Processor -- start 2023-10-03T10:18:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.293+0000 7fba053ee700 1 -- start start 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fba053ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 0x7fba00135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fba053ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba00138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fba053ee700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0009f130 con 0x7fba0009d6f0 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fba053ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0009f520 con 0x7fba0009e1d0 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fba053ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba0009e930 con 0x7fba00135e50 2023-10-03T10:18:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fb9feffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba0009d6f0 0x7fba0009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45056/0 (socket says 172.21.15.19:45056) 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fb9feffd700 1 -- 172.21.15.19:0/3171471252 learned_addr learned my addr 172.21.15.19:0/3171471252 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fb9fe7fc700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 0x7fba00135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.294+0000 7fb9ff7fe700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba00138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fe7fc700 1 -- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 msgr2=0x7fba00138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fe7fc700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba00138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fe7fc700 1 -- 172.21.15.19:0/3171471252 >> v1:172.21.15.19:6789/0 conn(0x7fba0009d6f0 legacy=0x7fba0009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fdffb700 1 -- 172.21.15.19:0/3171471252 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2853933910 0 0) 0x7fba0009f130 con 0x7fba0009d6f0 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fe7fc700 1 -- 172.21.15.19:0/3171471252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0009b2d0 con 0x7fba0009e1d0 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9ff7fe700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba00138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fe7fc700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 0x7fba00135910 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5369771d9471e32f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fdffb700 1 -- 172.21.15.19:0/3171471252 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4011830 con 0x7fba0009e1d0 2023-10-03T10:18:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fdffb700 1 -- 172.21.15.19:0/3171471252 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f4011990 con 0x7fba0009e1d0 2023-10-03T10:18:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.295+0000 7fb9fdffb700 1 -- 172.21.15.19:0/3171471252 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4011d20 con 0x7fba0009e1d0 2023-10-03T10:18:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 -- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 msgr2=0x7fba00135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 0x7fba00135910 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009870 tx=0x7fb9f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 -- 172.21.15.19:0/3171471252 shutdown_connections 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba00138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 --2- 172.21.15.19:0/3171471252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009e1d0 0x7fba00135910 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 -- 172.21.15.19:0/3171471252 >> 172.21.15.19:0/3171471252 conn(0x7fba00066f50 msgr2=0x7fba0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 -- 172.21.15.19:0/3171471252 shutdown_connections 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.296+0000 7fba053ee700 1 -- 172.21.15.19:0/3171471252 wait complete. 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 Processor -- start 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 -- start start 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009d6f0 0x7fba001c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba001c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0011c9b0 con 0x7fba0009e1d0 2023-10-03T10:18:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0009c770 con 0x7fba0009d6f0 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.297+0000 7fba053ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba001219f0 con 0x7fba00135e50 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9fe7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba001c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9fe7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57256/0 (socket says 172.21.15.19:57256) 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9fe7fc700 1 -- 172.21.15.19:0/1382318465 learned_addr learned my addr 172.21.15.19:0/1382318465 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9feffd700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009d6f0 0x7fba001c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 -- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009d6f0 msgr2=0x7fba001c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009d6f0 0x7fba001c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 -- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 msgr2=0x7fba001c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 -- 172.21.15.19:0/1382318465 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f8009a70 con 0x7fba00135e50 2023-10-03T10:18:33.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9fe7fc700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9ff7fe700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba001c8c60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800efc0 tx=0x7fb9f800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800ca90 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f800f040 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.298+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f40094a0 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.299+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f800ce30 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.299+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0006e890 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.299+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9f8014480 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.299+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba00122070 con 0x7fba00135e50 2023-10-03T10:18:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.300+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9f803fc60 con 0x7fba00135e50 2023-10-03T10:18:33.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.304+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9f8012910 con 0x7fba00135e50 2023-10-03T10:18:33.313 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:33.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.433+0000 7fe1b4562700 1 Processor -- start 2023-10-03T10:18:33.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 -- start start 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac131810 0x7fe1ac131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 0x7fe1ac099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1ac09a3b0 0x7fe1ac138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac09b580 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1313c0 con 0x7fe1ac099a40 2023-10-03T10:18:33.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.434+0000 7fe1b4562700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06e8c0 con 0x7fe1ac131810 2023-10-03T10:18:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b1afd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 0x7fe1ac099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b1afd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 0x7fe1ac099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49906/0 (socket says 172.21.15.19:49906) 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b1afd700 1 -- 172.21.15.19:0/2500292103 learned_addr learned my addr 172.21.15.19:0/2500292103 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/2500292103 >> v2:172.21.15.19:3300/0 conn(0x7fe1ac09a3b0 0x7fe1ac138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b22fe700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac131810 0x7fe1ac131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 -- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac131810 msgr2=0x7fe1ac131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac131810 0x7fe1ac131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 -- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 msgr2=0x7fe1ac099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 0x7fe1ac099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 -- 172.21.15.19:0/2500292103 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac09a820 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.435+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac09a3b0 0x7fe1ac138650 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400f370 tx=0x7fe1a400f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb52436abe4a0b44 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.436+0000 7fe1b12fc700 1 -- 172.21.15.19:0/2500292103 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4012070 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.436+0000 7fe1b12fc700 1 -- 172.21.15.19:0/2500292103 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400d0d0 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.436+0000 7fe1b12fc700 1 -- 172.21.15.19:0/2500292103 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400d480 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.436+0000 7fe1b4562700 1 -- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac09a3b0 msgr2=0x7fe1ac138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.436+0000 7fe1b4562700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac09a3b0 0x7fe1ac138650 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400f370 tx=0x7fe1a400f680 comp rx=0 tx=0).stop 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 -- 172.21.15.19:0/2500292103 shutdown_connections 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac09a3b0 0x7fe1ac138650 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac131810 0x7fe1ac131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 --2- 172.21.15.19:0/2500292103 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac099a40 0x7fe1ac099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 -- 172.21.15.19:0/2500292103 >> 172.21.15.19:0/2500292103 conn(0x7fe1ac0a2aa0 msgr2=0x7fe1ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 -- 172.21.15.19:0/2500292103 shutdown_connections 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.437+0000 7fe1b4562700 1 -- 172.21.15.19:0/2500292103 wait complete. 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 Processor -- start 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 -- start start 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac099a40 0x7fe1ac11b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac09a3b0 0x7fe1ac11bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac11e910 con 0x7fe1ac099a40 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac06eb00 con 0x7fe1ac131810 2023-10-03T10:18:33.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b4562700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac130870 con 0x7fe1ac09a3b0 2023-10-03T10:18:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b2aff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b2aff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49918/0 (socket says 172.21.15.19:49918) 2023-10-03T10:18:33.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.438+0000 7fe1b2aff700 1 -- 172.21.15.19:0/1578255249 learned_addr learned my addr 172.21.15.19:0/1578255249 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b1afd700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac09a3b0 0x7fe1ac11bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b22fe700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac099a40 0x7fe1ac11b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 -- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac09a3b0 msgr2=0x7fe1ac11bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac09a3b0 0x7fe1ac11bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 -- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac099a40 msgr2=0x7fe1ac11b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac099a40 0x7fe1ac11b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 -- 172.21.15.19:0/1578255249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a400f050 con 0x7fe1ac131810 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.439+0000 7fe1b2aff700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f030 tx=0x7fe1a4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.440+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400bb50 con 0x7fe1ac131810 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.440+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400bcb0 con 0x7fe1ac131810 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.440+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac11d270 con 0x7fe1ac131810 2023-10-03T10:18:33.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.440+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4004260 con 0x7fe1ac131810 2023-10-03T10:18:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.440+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac11f680 con 0x7fe1ac131810 2023-10-03T10:18:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.441+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac11eb40 con 0x7fe1ac131810 2023-10-03T10:18:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.442+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1a40043c0 con 0x7fe1ac131810 2023-10-03T10:18:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.442+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1a4045bb0 con 0x7fe1ac131810 2023-10-03T10:18:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.447+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1a401f990 con 0x7fe1ac131810 2023-10-03T10:18:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 Processor -- start 2023-10-03T10:18:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 -- start start 2023-10-03T10:18:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 0x7fc090133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 0x7fc09009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09006ef30 con 0x7fc09009e760 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09006fef0 con 0x7fc0901338a0 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.470+0000 7fc098508700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0901334b0 con 0x7fc09009de50 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc096aa5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc09009e760 0x7fc09013a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45072/0 (socket says 172.21.15.19:45072) 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc096aa5700 1 -- 172.21.15.19:0/191749561 learned_addr learned my addr 172.21.15.19:0/191749561 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0962a4700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 0x7fc090133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc095aa3700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 0x7fc09009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0952a2700 1 -- 172.21.15.19:0/191749561 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2288448243 0 0) 0x7fc09006ef30 con 0x7fc09009e760 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0952a2700 1 -- 172.21.15.19:0/191749561 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc07c0035b0 con 0x7fc09009e760 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0962a4700 1 -- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 msgr2=0x7fc09009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0962a4700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 0x7fc09009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0962a4700 1 -- 172.21.15.19:0/191749561 >> v1:172.21.15.19:6789/0 conn(0x7fc09009e760 legacy=0x7fc09013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc0962a4700 1 -- 172.21.15.19:0/191749561 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09006fc30 con 0x7fc0901338a0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.471+0000 7fc095aa3700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 0x7fc09009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc0962a4700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 0x7fc090133c70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009870 tx=0x7fc08c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304cf092d5597856 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc0952a2700 1 -- 172.21.15.19:0/191749561 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011830 con 0x7fc0901338a0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc0952a2700 1 -- 172.21.15.19:0/191749561 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c011990 con 0x7fc0901338a0 2023-10-03T10:18:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc0952a2700 1 -- 172.21.15.19:0/191749561 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c011d20 con 0x7fc0901338a0 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc098508700 1 -- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 msgr2=0x7fc090133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.472+0000 7fc098508700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 0x7fc090133c70 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009870 tx=0x7fc08c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 -- 172.21.15.19:0/191749561 shutdown_connections 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0901338a0 0x7fc090133c70 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 --2- 172.21.15.19:0/191749561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009de50 0x7fc09009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 -- 172.21.15.19:0/191749561 >> 172.21.15.19:0/191749561 conn(0x7fc0900a2aa0 msgr2=0x7fc0900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 -- 172.21.15.19:0/191749561 shutdown_connections 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.473+0000 7fc098508700 1 -- 172.21.15.19:0/191749561 wait complete. 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 Processor -- start 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 -- start start 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc09009de50 0x7fc09011a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 0x7fc09011b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09011bdf0 con 0x7fc0901338a0 2023-10-03T10:18:33.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09012dc30 con 0x7fc09009de50 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc098508700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc09011ca70 con 0x7fc09009e760 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc096aa5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 0x7fc09011b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc095aa3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc096aa5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 0x7fc09011b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57288/0 (socket says 172.21.15.19:57288) 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc096aa5700 1 -- 172.21.15.19:0/519018174 learned_addr learned my addr 172.21.15.19:0/519018174 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.474+0000 7fc095aa3700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36614/0 (socket says 172.21.15.19:36614) 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc0962a4700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc09009de50 0x7fc09011a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 -- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc09009de50 msgr2=0x7fc09011a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc09009de50 0x7fc09011a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 -- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 msgr2=0x7fc09011b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 0x7fc09011b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 -- 172.21.15.19:0/519018174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0800094a0 con 0x7fc09009e760 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc095aa3700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e900 tx=0x7fc08000ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.475+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080013680 con 0x7fc09009e760 2023-10-03T10:18:33.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.476+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c0094a0 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.476+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09011db50 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.476+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0800137e0 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.476+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080013b50 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.477+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc080013cb0 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.477+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc08003fb10 con 0x7fc09009e760 2023-10-03T10:18:33.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.479+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0780052e0 con 0x7fc09009e760 2023-10-03T10:18:33.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.484+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc080017080 con 0x7fc09009e760 2023-10-03T10:18:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.526+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fba00121b30 con 0x7fba00135e50 2023-10-03T10:18:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.526+0000 7fb9e77fe700 1 -- 172.21.15.19:0/1382318465 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9f8009cc0 con 0x7fba00135e50 2023-10-03T10:18:33.526 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:33.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 msgr2=0x7fba001c8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba001c8c60 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800efc0 tx=0x7fb9f800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 shutdown_connections 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba00135e50 0x7fba001c8c60 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba0009d6f0 0x7fba001c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 --2- 172.21.15.19:0/1382318465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba0009e1d0 0x7fba001c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.529+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 >> 172.21.15.19:0/1382318465 conn(0x7fba00066f50 msgr2=0x7fba001339c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.530+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 shutdown_connections 2023-10-03T10:18:33.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.530+0000 7fba053ee700 1 -- 172.21.15.19:0/1382318465 wait complete. 2023-10-03T10:18:33.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.536+0000 7f17352bf700 1 Processor -- start 2023-10-03T10:18:33.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.536+0000 7f17352bf700 1 -- start start 2023-10-03T10:18:33.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f17352bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 0x7f1730130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f17352bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 0x7f173006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f17352bf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1730130260 con 0x7f173006ffd0 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f17352bf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173009a350 con 0x7f1730130670 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f17352bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1730071ff0 con 0x7f173006f680 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f173006ffd0 0x7f1730137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45074/0 (socket says 172.21.15.19:45074) 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172f7fe700 1 -- 172.21.15.19:0/2946025226 learned_addr learned my addr 172.21.15.19:0/2946025226 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172effd700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 0x7f1730130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172e7fc700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 0x7f173006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172effd700 1 -- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 msgr2=0x7f173006fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172effd700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 0x7f173006fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172effd700 1 -- 172.21.15.19:0/2946025226 >> v1:172.21.15.19:6789/0 conn(0x7f173006ffd0 legacy=0x7f1730137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172dffb700 1 -- 172.21.15.19:0/2946025226 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451782275 0 0) 0x7f1730130260 con 0x7f173006ffd0 2023-10-03T10:18:33.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172effd700 1 -- 172.21.15.19:0/2946025226 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730070470 con 0x7f1730130670 2023-10-03T10:18:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.537+0000 7f172e7fc700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 0x7f173006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.538+0000 7f172effd700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 0x7f1730130a40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1720009870 tx=0x7f1720009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f03c7547618145ba server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.538+0000 7f172dffb700 1 -- 172.21.15.19:0/2946025226 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720011830 con 0x7f1730130670 2023-10-03T10:18:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.538+0000 7f172dffb700 1 -- 172.21.15.19:0/2946025226 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1720011990 con 0x7f1730130670 2023-10-03T10:18:33.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.538+0000 7f172dffb700 1 -- 172.21.15.19:0/2946025226 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1720011d20 con 0x7f1730130670 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 -- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 msgr2=0x7f1730130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 0x7f1730130a40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1720009870 tx=0x7f1720009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 -- 172.21.15.19:0/2946025226 shutdown_connections 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1730130670 0x7f1730130a40 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 --2- 172.21.15.19:0/2946025226 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f173006f680 0x7f173006fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 -- 172.21.15.19:0/2946025226 >> 172.21.15.19:0/2946025226 conn(0x7f17300a2aa0 msgr2=0x7f17300a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 -- 172.21.15.19:0/2946025226 shutdown_connections 2023-10-03T10:18:33.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.539+0000 7f17352bf700 1 -- 172.21.15.19:0/2946025226 wait complete. 2023-10-03T10:18:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.540+0000 7f17352bf700 1 Processor -- start 2023-10-03T10:18:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 -- start start 2023-10-03T10:18:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173006ffd0 0x7f173011ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 0x7f173011b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173011e9e0 con 0x7f173006ffd0 2023-10-03T10:18:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173011c110 con 0x7f173006f680 2023-10-03T10:18:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f17352bf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f173011c730 con 0x7f1730130670 2023-10-03T10:18:33.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f172effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f172f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 0x7f173011b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f172effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49960/0 (socket says 172.21.15.19:49960) 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.541+0000 7f172effd700 1 -- 172.21.15.19:0/1711948895 learned_addr learned my addr 172.21.15.19:0/1711948895 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172e7fc700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173006ffd0 0x7f173011ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 -- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 msgr2=0x7f173011a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 -- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173006ffd0 msgr2=0x7f173011ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173006ffd0 0x7f173011ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 -- 172.21.15.19:0/1711948895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200094a0 con 0x7f1730130670 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172effd700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f172f7fe700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 0x7f173011b0b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f172800f7a0 tx=0x7f172800fab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728011070 con 0x7f1730130670 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728016420 con 0x7f1730130670 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728004ea0 con 0x7f1730130670 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173011d360 con 0x7f1730130670 2023-10-03T10:18:33.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.542+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1730071820 con 0x7f1730130670 2023-10-03T10:18:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.544+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1730074ea0 con 0x7f1730130670 2023-10-03T10:18:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.545+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f17280203f0 con 0x7f1730130670 2023-10-03T10:18:33.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.545+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f172803f130 con 0x7f1730130670 2023-10-03T10:18:33.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:33.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.549+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1728020e00 con 0x7f1730130670 2023-10-03T10:18:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.739+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe1ac11ed20 con 0x7fe1ac131810 2023-10-03T10:18:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.740+0000 7fe1a2ffd700 1 -- 172.21.15.19:0/1578255249 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1a4037030 con 0x7fe1ac131810 2023-10-03T10:18:33.740 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 msgr2=0x7fe1ac11c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac06f030 tx=0x7fe1a4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 shutdown_connections 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1ac131810 0x7fe1ac11c1c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1ac099a40 0x7fe1ac11b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 --2- 172.21.15.19:0/1578255249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1ac09a3b0 0x7fe1ac11bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 >> 172.21.15.19:0/1578255249 conn(0x7fe1ac0a2aa0 msgr2=0x7fe1ac071240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 shutdown_connections 2023-10-03T10:18:33.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.743+0000 7fe1b4562700 1 -- 172.21.15.19:0/1578255249 wait complete. 2023-10-03T10:18:33.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.765+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1730072210 con 0x7f1730130670 2023-10-03T10:18:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.766+0000 7f17177fe700 1 -- 172.21.15.19:0/1711948895 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f172801b020 con 0x7f1730130670 2023-10-03T10:18:33.766 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc078005590 con 0x7fc09009e760 2023-10-03T10:18:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 msgr2=0x7f173011b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 0x7f173011b0b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f172800f7a0 tx=0x7f172800fab0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 shutdown_connections 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1730130670 0x7f173011b0b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f173006f680 0x7f173011a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 --2- 172.21.15.19:0/1711948895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f173006ffd0 0x7f173011ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 >> 172.21.15.19:0/1711948895 conn(0x7f17300a2aa0 msgr2=0x7f17300a1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 shutdown_connections 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7f17352bf700 1 -- 172.21.15.19:0/1711948895 wait complete. 2023-10-03T10:18:33.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.768+0000 7fc086ffd700 1 -- 172.21.15.19:0/519018174 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc08002b090 con 0x7fc09009e760 2023-10-03T10:18:33.770 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.770+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 msgr2=0x7fc09011ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.770+0000 7fc098508700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc08000e900 tx=0x7fc08000ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 shutdown_connections 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0901338a0 0x7fc09011b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc09009de50 0x7fc09011a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 --2- 172.21.15.19:0/519018174 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc09009e760 0x7fc09011ae60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 >> 172.21.15.19:0/519018174 conn(0x7fc0900a2aa0 msgr2=0x7fc09012f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 shutdown_connections 2023-10-03T10:18:33.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:33.771+0000 7fc098508700 1 -- 172.21.15.19:0/519018174 wait complete. 2023-10-03T10:18:33.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:33.784 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:34.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.692+0000 7f441e939700 1 Processor -- start 2023-10-03T10:18:34.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.692+0000 7f441e939700 1 -- start start 2023-10-03T10:18:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441e939700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441e939700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 0x7f4418131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441e939700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4418070940 con 0x7f441809f240 2023-10-03T10:18:34.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441e939700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441806fd60 con 0x7f441809f650 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441e939700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f441806fa80 con 0x7f441809e930 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441ced6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 0x7f4418131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f44177fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f441809f240 0x7f44181317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45088/0 (socket says 172.21.15.19:45088) 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f44177fe700 1 -- 172.21.15.19:0/2123505335 learned_addr learned my addr 172.21.15.19:0/2123505335 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 -- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 msgr2=0x7f4418131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 0x7f4418131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 -- 172.21.15.19:0/2123505335 >> v1:172.21.15.19:6789/0 conn(0x7f441809f240 legacy=0x7f44181317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4416ffd700 1 -- 172.21.15.19:0/2123505335 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998559327 0 0) 0x7f4418070940 con 0x7f441809f240 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 -- 172.21.15.19:0/2123505335 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441809fb60 con 0x7f441809e930 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f441ced6700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 0x7f4418131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.693+0000 7f4417fff700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441809ed00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4408009870 tx=0x7f4408009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=480ba1a5c715bad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f4416ffd700 1 -- 172.21.15.19:0/2123505335 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408011830 con 0x7f441809e930 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f4416ffd700 1 -- 172.21.15.19:0/2123505335 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408011990 con 0x7f441809e930 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f4416ffd700 1 -- 172.21.15.19:0/2123505335 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408011d20 con 0x7f441809e930 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 -- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 msgr2=0x7f441809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441809ed00 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4408009870 tx=0x7f4408009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 -- 172.21.15.19:0/2123505335 shutdown_connections 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f650 0x7f4418131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 --2- 172.21.15.19:0/2123505335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441809ed00 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 -- 172.21.15.19:0/2123505335 >> 172.21.15.19:0/2123505335 conn(0x7f44180a4210 msgr2=0x7f44180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 -- 172.21.15.19:0/2123505335 shutdown_connections 2023-10-03T10:18:34.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.694+0000 7f441e939700 1 -- 172.21.15.19:0/2123505335 wait complete. 2023-10-03T10:18:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.695+0000 7f441e939700 1 Processor -- start 2023-10-03T10:18:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 -- start start 2023-10-03T10:18:34.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 0x7f441806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441809f650 0x7f441806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44181a9680 con 0x7f441809f650 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44181a8910 con 0x7f441809f240 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441e939700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f44181b7200 con 0x7f441809e930 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f4417fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f44177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 0x7f441806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f4417fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36658/0 (socket says 172.21.15.19:36658) 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f4417fff700 1 -- 172.21.15.19:0/2699542561 learned_addr learned my addr 172.21.15.19:0/2699542561 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.696+0000 7f441ced6700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441809f650 0x7f441806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 -- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 msgr2=0x7f441806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 0x7f441806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 -- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441809f650 msgr2=0x7f441806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441809f650 0x7f441806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 -- 172.21.15.19:0/2699542561 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4410009a70 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f44177fe700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 0x7f441806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4417fff700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4408009840 tx=0x7f4408004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408004510 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f440801f070 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44080094a0 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080038e0 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.697+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44180a0190 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.698+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4408003a40 con 0x7f441809e930 2023-10-03T10:18:34.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.698+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4408021070 con 0x7f441809e930 2023-10-03T10:18:34.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.698+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4418074ea0 con 0x7f441809e930 2023-10-03T10:18:34.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.703+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4408015080 con 0x7f441809e930 2023-10-03T10:18:34.762 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:34.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:34.785 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:34.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.916+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f44181a8c90 con 0x7f441809e930 2023-10-03T10:18:34.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.916+0000 7f4414ff9700 1 -- 172.21.15.19:0/2699542561 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f440801a430 con 0x7f441809e930 2023-10-03T10:18:34.916 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:34.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.918+0000 7fc330aae700 1 Processor -- start 2023-10-03T10:18:34.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.918+0000 7fc330aae700 1 -- start start 2023-10-03T10:18:34.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc330aae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc330aae700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc32c137120 0x7fc32c139500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc330aae700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32c09b560 con 0x7fc32c09e850 2023-10-03T10:18:34.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc330aae700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32c09f720 con 0x7fc32c137120 2023-10-03T10:18:34.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc330aae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c0a0040 con 0x7fc32c09f330 2023-10-03T10:18:34.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.919+0000 7fc329d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36670/0 (socket says 172.21.15.19:36670) 2023-10-03T10:18:34.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 -- 172.21.15.19:0/2001928259 learned_addr learned my addr 172.21.15.19:0/2001928259 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 msgr2=0x7f441806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7f441e939700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4408009840 tx=0x7f4408004750 comp rx=0 tx=0).stop 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 -- 172.21.15.19:0/2001928259 >> v2:172.21.15.19:3300/0 conn(0x7fc32c137120 msgr2=0x7fc32c139500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 --2- 172.21.15.19:0/2001928259 >> v2:172.21.15.19:3300/0 conn(0x7fc32c137120 0x7fc32c139500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 -- 172.21.15.19:0/2001928259 >> v1:172.21.15.19:6789/0 conn(0x7fc32c09e850 legacy=0x7fc32c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 -- 172.21.15.19:0/2001928259 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0a02e0 con 0x7fc32c09f330 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc329d9b700 1 --2- 172.21.15.19:0/2001928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3200098f0 tx=0x7fc320009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6f73c4be7551ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc32959a700 1 -- 172.21.15.19:0/2001928259 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000b8a0 con 0x7fc32c09f330 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc32959a700 1 -- 172.21.15.19:0/2001928259 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000ba00 con 0x7fc32c09f330 2023-10-03T10:18:34.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.920+0000 7fc32959a700 1 -- 172.21.15.19:0/2001928259 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000bd90 con 0x7fc32c09f330 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 shutdown_connections 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f441809f650 0x7f441806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f441809e930 0x7f441806b8b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 --2- 172.21.15.19:0/2699542561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f441809f240 0x7f441806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 >> 172.21.15.19:0/2699542561 conn(0x7f44180a4210 msgr2=0x7f44181b8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 shutdown_connections 2023-10-03T10:18:34.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7f441e939700 1 -- 172.21.15.19:0/2699542561 wait complete. 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 -- 172.21.15.19:0/2001928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 msgr2=0x7fc32c136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 --2- 172.21.15.19:0/2001928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc3200098f0 tx=0x7fc320009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 -- 172.21.15.19:0/2001928259 shutdown_connections 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 --2- 172.21.15.19:0/2001928259 >> v2:172.21.15.19:3300/0 conn(0x7fc32c137120 0x7fc32c139500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 --2- 172.21.15.19:0/2001928259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09f330 0x7fc32c136be0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.921+0000 7fc330aae700 1 -- 172.21.15.19:0/2001928259 >> 172.21.15.19:0/2001928259 conn(0x7fc32c0a3f70 msgr2=0x7fc32c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.922+0000 7fc330aae700 1 -- 172.21.15.19:0/2001928259 shutdown_connections 2023-10-03T10:18:34.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.922+0000 7fc330aae700 1 -- 172.21.15.19:0/2001928259 wait complete. 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 Processor -- start 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 -- start start 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc32c09f330 0x7fc32c1c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc32c137120 0x7fc32c1c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c1212f0 con 0x7fc32c09f330 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c120c40 con 0x7fc32c137120 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.923+0000 7fc330aae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc32c120780 con 0x7fc32c09e850 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36682/0 (socket says 172.21.15.19:36682) 2023-10-03T10:18:34.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 -- 172.21.15.19:0/1378311452 learned_addr learned my addr 172.21.15.19:0/1378311452 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc329d9b700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc32c09f330 0x7fc32c1c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32ad9d700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc32c137120 0x7fc32c1c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 -- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc32c137120 msgr2=0x7fc32c1c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc32c137120 0x7fc32c1c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 -- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc32c09f330 msgr2=0x7fc32c1c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc32c09f330 0x7fc32c1c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 -- 172.21.15.19:0/1378311452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc320009550 con 0x7fc32c09e850 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.924+0000 7fc32a59c700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c4e0 tx=0x7fc31c00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.925+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0052d0 con 0x7fc32c09e850 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.925+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c005430 con 0x7fc32c09e850 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.925+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0038c0 con 0x7fc32c09e850 2023-10-03T10:18:34.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.925+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32c1215b0 con 0x7fc32c09e850 2023-10-03T10:18:34.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.925+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32c06d6a0 con 0x7fc32c09e850 2023-10-03T10:18:34.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.926+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc31c003a20 con 0x7fc32c09e850 2023-10-03T10:18:34.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.926+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32c0747f0 con 0x7fc32c09e850 2023-10-03T10:18:34.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.926+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc31c03e9b0 con 0x7fc32c09e850 2023-10-03T10:18:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.935+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc31c011590 con 0x7fc32c09e850 2023-10-03T10:18:34.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 Processor -- start 2023-10-03T10:18:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 -- start start 2023-10-03T10:18:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 0x7f7a08138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 0x7f7a0813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0809b120 con 0x7f7a0809d6f0 2023-10-03T10:18:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806b460 con 0x7f7a08139170 2023-10-03T10:18:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a0e7a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0809a7e0 con 0x7f7a0809e1d0 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a07fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7a0809d6f0 0x7f7a0809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45106/0 (socket says 172.21.15.19:45106) 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a07fff700 1 -- 172.21.15.19:0/3230782620 learned_addr learned my addr 172.21.15.19:0/3230782620 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.956+0000 7f7a077fe700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 0x7f7a08138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 0x7f7a0813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 -- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 msgr2=0x7f7a08138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 0x7f7a08138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 -- 172.21.15.19:0/3230782620 >> v1:172.21.15.19:6789/0 conn(0x7f7a0809d6f0 legacy=0x7f7a0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 -- 172.21.15.19:0/3230782620 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0809a500 con 0x7f7a08139170 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a06ffd700 1 -- 172.21.15.19:0/3230782620 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226353999 0 0) 0x7f7a0809b120 con 0x7f7a0809d6f0 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a077fe700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 0x7f7a08138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 0x7f7a0813b550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009dc0 tx=0x7f7a0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91ca986e5092fc88 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a06ffd700 1 -- 172.21.15.19:0/3230782620 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000e070 con 0x7f7a08139170 2023-10-03T10:18:34.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a06ffd700 1 -- 172.21.15.19:0/3230782620 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000bb20 con 0x7f7a08139170 2023-10-03T10:18:34.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.957+0000 7f7a06ffd700 1 -- 172.21.15.19:0/3230782620 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00012430 con 0x7f7a08139170 2023-10-03T10:18:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 msgr2=0x7f7a0813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 0x7f7a0813b550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009dc0 tx=0x7f7a0000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/3230782620 shutdown_connections 2023-10-03T10:18:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a08139170 0x7f7a0813b550 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/3230782620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809e1d0 0x7f7a08138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/3230782620 >> 172.21.15.19:0/3230782620 conn(0x7f7a08066f50 msgr2=0x7f7a0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/3230782620 shutdown_connections 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.958+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/3230782620 wait complete. 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.959+0000 7f7a0e7a3700 1 Processor -- start 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 -- start start 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 0x7f7a08120b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 0x7f7a08121060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081221f0 con 0x7f7a0809e1d0 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08122810 con 0x7f7a0809d6f0 2023-10-03T10:18:34.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0e7a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0809c780 con 0x7f7a08139170 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50020/0 (socket says 172.21.15.19:50020) 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a07fff700 1 -- 172.21.15.19:0/2740641148 learned_addr learned my addr 172.21.15.19:0/2740641148 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 0x7f7a08121060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.960+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 0x7f7a08120b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 -- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 msgr2=0x7f7a081205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 -- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 msgr2=0x7f7a08120b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 0x7f7a08120b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 -- 172.21.15.19:0/2740641148 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0094a0 con 0x7f7a08139170 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a07fff700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 0x7f7a08120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0cd40700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 0x7f7a08121060 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009dc0 tx=0x7f7a00004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00012430 con 0x7f7a08139170 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00020070 con 0x7f7a08139170 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a00009a70 con 0x7f7a08139170 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a00012ea0 con 0x7f7a08139170 2023-10-03T10:18:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.961+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a08123e20 con 0x7f7a08139170 2023-10-03T10:18:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.962+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a08074ea0 con 0x7f7a08139170 2023-10-03T10:18:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.962+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a00004280 con 0x7f7a08139170 2023-10-03T10:18:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.963+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a00022070 con 0x7f7a08139170 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.965+0000 7fea7718c700 1 Processor -- start 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.965+0000 7fea7718c700 1 -- start start 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.965+0000 7fea7718c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.965+0000 7fea7718c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009f650 0x7fea70131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea7718c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea70070940 con 0x7fea7009f240 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea7718c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7006fd60 con 0x7fea7009f650 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea7718c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea7006fa80 con 0x7fea7009e930 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36698/0 (socket says 172.21.15.19:36698) 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 -- 172.21.15.19:0/2838502736 learned_addr learned my addr 172.21.15.19:0/2838502736 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea75729700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009f650 0x7fea70131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 -- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009f650 msgr2=0x7fea70131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009f650 0x7fea70131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 -- 172.21.15.19:0/2838502736 >> v1:172.21.15.19:6789/0 conn(0x7fea7009f240 legacy=0x7fea701317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 -- 172.21.15.19:0/2838502736 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea7009fb60 con 0x7fea7009e930 2023-10-03T10:18:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.966+0000 7fea74f28700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fea64009920 tx=0x7fea64009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4011be9799a9e69c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.968+0000 7fea6f7fe700 1 -- 172.21.15.19:0/2838502736 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64004230 con 0x7fea7009e930 2023-10-03T10:18:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.968+0000 7fea6f7fe700 1 -- 172.21.15.19:0/2838502736 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea64004390 con 0x7fea7009e930 2023-10-03T10:18:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.968+0000 7fea6f7fe700 1 -- 172.21.15.19:0/2838502736 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea640036a0 con 0x7fea7009e930 2023-10-03T10:18:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.968+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a00026db0 con 0x7f7a08139170 2023-10-03T10:18:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 -- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 msgr2=0x7fea7009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fea64009920 tx=0x7fea64009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 -- 172.21.15.19:0/2838502736 shutdown_connections 2023-10-03T10:18:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009f650 0x7fea70131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 --2- 172.21.15.19:0/2838502736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009e930 0x7fea7009ed00 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 -- 172.21.15.19:0/2838502736 >> 172.21.15.19:0/2838502736 conn(0x7fea700a4210 msgr2=0x7fea700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 -- 172.21.15.19:0/2838502736 shutdown_connections 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.969+0000 7fea7718c700 1 -- 172.21.15.19:0/2838502736 wait complete. 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.971+0000 7fea7718c700 1 Processor -- start 2023-10-03T10:18:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.971+0000 7fea7718c700 1 -- start start 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 0x7fea701a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea7009f650 0x7fea701a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea701a5290 con 0x7fea7009f650 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea701a6020 con 0x7fea7009e930 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea7718c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea701a70e0 con 0x7fea7009f240 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36708/0 (socket says 172.21.15.19:36708) 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 -- 172.21.15.19:0/209435687 learned_addr learned my addr 172.21.15.19:0/209435687 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea75729700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea7009f650 0x7fea701a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea74f28700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 0x7fea701a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 -- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 msgr2=0x7fea701a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 0x7fea701a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 -- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea7009f650 msgr2=0x7fea701a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea7009f650 0x7fea701a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 -- 172.21.15.19:0/209435687 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea64009550 con 0x7fea7009f240 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea74f28700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 0x7fea701a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6ffff700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c4d0 tx=0x7fea5c00c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.972+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0054e0 con 0x7fea7009f240 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.973+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c003680 con 0x7fea7009f240 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.973+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea700a0190 con 0x7fea7009f240 2023-10-03T10:18:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.973+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c003a10 con 0x7fea7009f240 2023-10-03T10:18:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.973+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea700a3780 con 0x7fea7009f240 2023-10-03T10:18:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.974+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fea5c003b70 con 0x7fea7009f240 2023-10-03T10:18:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.974+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fea5c03eae0 con 0x7fea7009f240 2023-10-03T10:18:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.974+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea701a0b30 con 0x7fea7009f240 2023-10-03T10:18:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:34.979+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fea5c017070 con 0x7fea7009f240 2023-10-03T10:18:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.151+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc32c06d6a0 con 0x7fc32c09e850 2023-10-03T10:18:35.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.151+0000 7fc31affd700 1 -- 172.21.15.19:0/1378311452 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc32c06d6a0 con 0x7fc32c09e850 2023-10-03T10:18:35.151 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 msgr2=0x7fc32c1c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c4e0 tx=0x7fc31c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 shutdown_connections 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc32c137120 0x7fc32c1c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc32c09e850 0x7fc32c1c8eb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 --2- 172.21.15.19:0/1378311452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc32c09f330 0x7fc32c1c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 >> 172.21.15.19:0/1378311452 conn(0x7fc32c0a3f70 msgr2=0x7fc32c1319a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 shutdown_connections 2023-10-03T10:18:35.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.155+0000 7fc330aae700 1 -- 172.21.15.19:0/1378311452 wait complete. 2023-10-03T10:18:35.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:35.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.177+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a081229e0 con 0x7f7a08139170 2023-10-03T10:18:35.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.177+0000 7f7a04ff9700 1 -- 172.21.15.19:0/2740641148 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a00026bd0 con 0x7f7a08139170 2023-10-03T10:18:35.177 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 msgr2=0x7f7a08121060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 0x7f7a08121060 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009dc0 tx=0x7f7a00004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 shutdown_connections 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a08139170 0x7f7a08121060 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809d6f0 0x7f7a081205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 --2- 172.21.15.19:0/2740641148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0809e1d0 0x7f7a08120b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.179+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 >> 172.21.15.19:0/2740641148 conn(0x7f7a08066f50 msgr2=0x7f7a08136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.180+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 shutdown_connections 2023-10-03T10:18:35.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.180+0000 7f7a0e7a3700 1 -- 172.21.15.19:0/2740641148 wait complete. 2023-10-03T10:18:35.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.194+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea701a5aa0 con 0x7fea7009f240 2023-10-03T10:18:35.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.194+0000 7fea6d7fa700 1 -- 172.21.15.19:0/209435687 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fea5c012400 con 0x7fea7009f240 2023-10-03T10:18:35.194 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 msgr2=0x7fea701a4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00c4d0 tx=0x7fea5c00c7e0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 shutdown_connections 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea7009f650 0x7fea701a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fea7009e930 0x7fea701a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 --2- 172.21.15.19:0/209435687 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fea7009f240 0x7fea701a4370 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 >> 172.21.15.19:0/209435687 conn(0x7fea700a4210 msgr2=0x7fea701b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 shutdown_connections 2023-10-03T10:18:35.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:35.196+0000 7fea7718c700 1 -- 172.21.15.19:0/209435687 wait complete. 2023-10-03T10:18:35.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:35.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.088+0000 7faefac7d700 1 Processor -- start 2023-10-03T10:18:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 -- start start 2023-10-03T10:18:36.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 0x7faef4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faef4070940 con 0x7faef409f240 2023-10-03T10:18:36.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef406fd60 con 0x7faef409f650 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.089+0000 7faefac7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef406fa80 con 0x7faef409e930 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef921a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 0x7faef4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50048/0 (socket says 172.21.15.19:50048) 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 -- 172.21.15.19:0/2479240447 learned_addr learned my addr 172.21.15.19:0/2479240447 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7faef409f240 0x7faef41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45126/0 (socket says 172.21.15.19:45126) 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 -- 172.21.15.19:0/2479240447 >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 msgr2=0x7faef4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 --2- 172.21.15.19:0/2479240447 >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 0x7faef4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 -- 172.21.15.19:0/2479240447 >> v1:172.21.15.19:6789/0 conn(0x7faef409f240 legacy=0x7faef41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 -- 172.21.15.19:0/2479240447 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef409fb60 con 0x7faef409e930 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef37fe700 1 -- 172.21.15.19:0/2479240447 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743248650 0 0) 0x7faef4070940 con 0x7faef409f240 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef921a700 1 --2- 172.21.15.19:0/2479240447 >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 0x7faef4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef8a19700 1 --2- 172.21.15.19:0/2479240447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faee40098f0 tx=0x7faee4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c298accc6091af10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef37fe700 1 -- 172.21.15.19:0/2479240447 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011830 con 0x7faef409e930 2023-10-03T10:18:36.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef37fe700 1 -- 172.21.15.19:0/2479240447 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee4011990 con 0x7faef409e930 2023-10-03T10:18:36.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.090+0000 7faef37fe700 1 -- 172.21.15.19:0/2479240447 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4011d20 con 0x7faef409e930 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 -- 172.21.15.19:0/2479240447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 msgr2=0x7faef409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 --2- 172.21.15.19:0/2479240447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7faee40098f0 tx=0x7faee4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 -- 172.21.15.19:0/2479240447 shutdown_connections 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 --2- 172.21.15.19:0/2479240447 >> v2:172.21.15.19:3300/0 conn(0x7faef409f650 0x7faef4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 --2- 172.21.15.19:0/2479240447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef409ed00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 -- 172.21.15.19:0/2479240447 >> 172.21.15.19:0/2479240447 conn(0x7faef40a4210 msgr2=0x7faef40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 -- 172.21.15.19:0/2479240447 shutdown_connections 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.091+0000 7faefac7d700 1 -- 172.21.15.19:0/2479240447 wait complete. 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.092+0000 7faefac7d700 1 Processor -- start 2023-10-03T10:18:36.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.092+0000 7faefac7d700 1 -- start start 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faef409f650 0x7faef41c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef41a4410 con 0x7faef409f240 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef41a4220 con 0x7faef409e930 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faefac7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faef40a3220 con 0x7faef409f650 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57338/0 (socket says 172.21.15.19:57338) 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50062/0 (socket says 172.21.15.19:50062) 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef3fff700 1 -- 172.21.15.19:0/3194547796 learned_addr learned my addr 172.21.15.19:0/3194547796 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef921a700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faef409f650 0x7faef41c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 -- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faef409f650 msgr2=0x7faef41c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faef409f650 0x7faef41c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 -- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 msgr2=0x7faef41c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 -- 172.21.15.19:0/3194547796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec009a70 con 0x7faef409e930 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef3fff700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.093+0000 7faef8a19700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faee4016000 tx=0x7faee4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4004340 con 0x7faef409e930 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee401f070 con 0x7faef409e930 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee4009550 con 0x7faef409e930 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40036a0 con 0x7faef409e930 2023-10-03T10:18:36.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef40a0190 con 0x7faef409e930 2023-10-03T10:18:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.094+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faee4021030 con 0x7faef409e930 2023-10-03T10:18:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.095+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faee4040930 con 0x7faef409e930 2023-10-03T10:18:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.095+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef41a5d70 con 0x7faef409e930 2023-10-03T10:18:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.100+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faee4015080 con 0x7faef409e930 2023-10-03T10:18:36.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:36.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:36.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:36.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.314+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faef41a6200 con 0x7faef409e930 2023-10-03T10:18:36.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.315+0000 7faef17fa700 1 -- 172.21.15.19:0/3194547796 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faee40239c0 con 0x7faef409e930 2023-10-03T10:18:36.315 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.317+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 msgr2=0x7faef41c5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.317+0000 7faefac7d700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7faee4016000 tx=0x7faee4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 shutdown_connections 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faef409f650 0x7faef41c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faef409e930 0x7faef41c5e90 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 --2- 172.21.15.19:0/3194547796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faef409f240 0x7faef41c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 >> 172.21.15.19:0/3194547796 conn(0x7faef40a4210 msgr2=0x7faef41b9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 shutdown_connections 2023-10-03T10:18:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.318+0000 7faefac7d700 1 -- 172.21.15.19:0/3194547796 wait complete. 2023-10-03T10:18:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.321+0000 7f8d6e3a1700 1 Processor -- start 2023-10-03T10:18:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.321+0000 7f8d6e3a1700 1 -- start start 2023-10-03T10:18:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6e3a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d681368c0 0x7f8d68138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6e3a1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d681391e0 0x7f8d6813b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6e3a1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68099780 con 0x7f8d68133870 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6e3a1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6809aa80 con 0x7f8d681391e0 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6e3a1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68133650 con 0x7f8d681368c0 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6dba0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8d681391e0 0x7f8d6813b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6d39f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8d68133870 0x7f8d68133c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:45128/0 (socket says 172.21.15.19:45128) 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6d39f700 1 -- 172.21.15.19:0/2980382301 learned_addr learned my addr 172.21.15.19:0/2980382301 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d681368c0 msgr2=0x7f8d68138ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6dba0700 1 --2- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d681368c0 0x7f8d68138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2980382301 >> v1:172.21.15.19:6789/0 conn(0x7f8d68133870 legacy=0x7f8d68133c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d5ffff700 1 -- 172.21.15.19:0/2980382301 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053388126 0 0) 0x7f8d68099780 con 0x7f8d68133870 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.322+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2980382301 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6809ebc0 con 0x7f8d681391e0 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.323+0000 7f8d6dba0700 1 --2- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681391e0 0x7f8d6813b5c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb44a700435054ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.323+0000 7f8d5ffff700 1 -- 172.21.15.19:0/2980382301 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000e070 con 0x7f8d681391e0 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.323+0000 7f8d5ffff700 1 -- 172.21.15.19:0/2980382301 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6000bbd0 con 0x7f8d681391e0 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.323+0000 7f8d5ffff700 1 -- 172.21.15.19:0/2980382301 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60012430 con 0x7f8d681391e0 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681391e0 msgr2=0x7f8d6813b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681391e0 0x7f8d6813b5c0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009d90 tx=0x7f8d6000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2980382301 shutdown_connections 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681391e0 0x7f8d6813b5c0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2980382301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d681368c0 0x7f8d68138ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2980382301 >> 172.21.15.19:0/2980382301 conn(0x7f8d680a2540 msgr2=0x7f8d680a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2980382301 shutdown_connections 2023-10-03T10:18:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.324+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2980382301 wait complete. 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 Processor -- start 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 -- start start 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d68133870 0x7f8d6808ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 0x7f8d6808d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680908a0 con 0x7f8d681368c0 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68091760 con 0x7f8d68133870 2023-10-03T10:18:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.325+0000 7f8d6e3a1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680905e0 con 0x7f8d681391e0 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6cb9e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 0x7f8d6808d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6d39f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d68133870 0x7f8d6808ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36728/0 (socket says 172.21.15.19:36728) 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2744156756 learned_addr learned my addr 172.21.15.19:0/2744156756 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d68133870 msgr2=0x7f8d6808ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d68133870 0x7f8d6808ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 msgr2=0x7f8d6808d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 0x7f8d6808d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 -- 172.21.15.19:0/2744156756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d60009a70 con 0x7f8d681391e0 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6cb9e700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 0x7f8d6808d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.326+0000 7f8d6dba0700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8d68099910 tx=0x7f8d60004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.327+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60012430 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.327+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6808e860 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.327+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6808de80 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.328+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60020070 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.328+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600098f0 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.328+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8d60004040 con 0x7f8d681391e0 2023-10-03T10:18:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.328+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8d60022070 con 0x7f8d681391e0 2023-10-03T10:18:36.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.329+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d68096f70 con 0x7f8d681391e0 2023-10-03T10:18:36.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:36.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.338+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8d60025740 con 0x7f8d681391e0 2023-10-03T10:18:36.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.364+0000 7f90db6ec700 1 Processor -- start 2023-10-03T10:18:36.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.364+0000 7f90db6ec700 1 -- start start 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d4133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 0x7f90d413a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d406c570 con 0x7f90d4130870 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d406bc00 con 0x7f90d412ff20 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90db6ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40a0040 con 0x7f90d4133a80 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90d8c87700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90d8c87700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51334/0 (socket says 172.21.15.19:51334) 2023-10-03T10:18:36.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90d9c89700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 0x7f90d413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90d8c87700 1 -- 172.21.15.19:0/214622800 learned_addr learned my addr 172.21.15.19:0/214622800 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.365+0000 7f90d9488700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d4133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 -- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 msgr2=0x7f90d4133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d4133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 -- 172.21.15.19:0/214622800 >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 msgr2=0x7f90d413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 --2- 172.21.15.19:0/214622800 >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 0x7f90d413a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 -- 172.21.15.19:0/214622800 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d4133860 con 0x7f90d412ff20 2023-10-03T10:18:36.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d9c89700 1 --2- 172.21.15.19:0/214622800 >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 0x7f90d413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90d8c87700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f90c40098f0 tx=0x7f90c4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2768c54b013f1467 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90cbfff700 1 -- 172.21.15.19:0/214622800 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4011830 con 0x7f90d412ff20 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90cbfff700 1 -- 172.21.15.19:0/214622800 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c4011990 con 0x7f90d412ff20 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.366+0000 7f90cbfff700 1 -- 172.21.15.19:0/214622800 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4011d20 con 0x7f90d412ff20 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 -- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 msgr2=0x7f90d4130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f90c40098f0 tx=0x7f90c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 -- 172.21.15.19:0/214622800 shutdown_connections 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 --2- 172.21.15.19:0/214622800 >> v2:172.21.15.19:3300/0 conn(0x7f90d4130870 0x7f90d413a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d4133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 --2- 172.21.15.19:0/214622800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d412ff20 0x7f90d4130330 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 -- 172.21.15.19:0/214622800 >> 172.21.15.19:0/214622800 conn(0x7f90d40a4210 msgr2=0x7f90d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 -- 172.21.15.19:0/214622800 shutdown_connections 2023-10-03T10:18:36.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.367+0000 7f90db6ec700 1 -- 172.21.15.19:0/214622800 wait complete. 2023-10-03T10:18:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.368+0000 7f90db6ec700 1 Processor -- start 2023-10-03T10:18:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.368+0000 7f90db6ec700 1 -- start start 2023-10-03T10:18:36.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 0x7f90d409c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d409cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d406cfa0 con 0x7f90d412ff20 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d412dc00 con 0x7f90d4130870 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90db6ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90d411f510 con 0x7f90d4133a80 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d9488700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d9488700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45680/0 (socket says 172.21.15.19:45680) 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d9488700 1 -- 172.21.15.19:0/3506285972 learned_addr learned my addr 172.21.15.19:0/3506285972 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 0x7f90d409c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d9c89700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d409cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 -- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 msgr2=0x7f90d409cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d409cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 -- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 msgr2=0x7f90d409c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d8c87700 1 -- 172.21.15.19:0/3506285972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009550 con 0x7f90d4130870 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.369+0000 7f90d9488700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90d8c87700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 0x7f90d409c6c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f90c4016000 tx=0x7f90c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4004300 con 0x7f90d4130870 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c401f070 con 0x7f90d4130870 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d41201d0 con 0x7f90d4130870 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40036a0 con 0x7f90d4130870 2023-10-03T10:18:36.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.370+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d411fef0 con 0x7f90d4130870 2023-10-03T10:18:36.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.371+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f90c4021030 con 0x7f90d4130870 2023-10-03T10:18:36.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.371+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d4074ea0 con 0x7f90d4130870 2023-10-03T10:18:36.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.371+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f90c4040800 con 0x7f90d4130870 2023-10-03T10:18:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.371+0000 7f49d2bb4700 1 Processor -- start 2023-10-03T10:18:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 -- start start 2023-10-03T10:18:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49cc0716a0 con 0x7f49cc130540 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc071290 con 0x7f49cc135e60 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d2bb4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc130340 con 0x7f49cc133540 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d1151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d1151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51354/0 (socket says 172.21.15.19:51354) 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50060/0 (socket says 172.21.15.19:50060) 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d1151700 1 -- 172.21.15.19:0/460072972 learned_addr learned my addr 172.21.15.19:0/460072972 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.373+0000 7f49d0950700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f49cc130540 0x7f49cc130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57648/0 (socket says 172.21.15.19:57648) 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49cb7fe700 1 -- 172.21.15.19:0/460072972 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905551573 0 0) 0x7f49cc0716a0 con 0x7f49cc130540 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49d1151700 1 -- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 msgr2=0x7f49cc135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:36.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49d1151700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49d1151700 1 -- 172.21.15.19:0/460072972 >> v1:172.21.15.19:6789/0 conn(0x7f49cc130540 legacy=0x7f49cc130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49d1151700 1 -- 172.21.15.19:0/460072972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc070b80 con 0x7f49cc135e60 2023-10-03T10:18:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49cbfff700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.374+0000 7f49d1151700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009e80 tx=0x7f49c400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc8cea455ca0bb4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.377+0000 7f49cb7fe700 1 -- 172.21.15.19:0/460072972 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400e070 con 0x7f49cc135e60 2023-10-03T10:18:36.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.377+0000 7f49cb7fe700 1 -- 172.21.15.19:0/460072972 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c400b910 con 0x7f49cc135e60 2023-10-03T10:18:36.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.377+0000 7f49cb7fe700 1 -- 172.21.15.19:0/460072972 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c400bcc0 con 0x7f49cc135e60 2023-10-03T10:18:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.377+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f90c400b9d0 con 0x7f90d4130870 2023-10-03T10:18:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 -- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 msgr2=0x7f49cc138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f49c4009e80 tx=0x7f49c400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 -- 172.21.15.19:0/460072972 shutdown_connections 2023-10-03T10:18:36.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc138240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/460072972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc133540 0x7f49cc135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 -- 172.21.15.19:0/460072972 >> 172.21.15.19:0/460072972 conn(0x7f49cc0a2aa0 msgr2=0x7f49cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 -- 172.21.15.19:0/460072972 shutdown_connections 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.378+0000 7f49d2bb4700 1 -- 172.21.15.19:0/460072972 wait complete. 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.379+0000 7f49d2bb4700 1 Processor -- start 2023-10-03T10:18:36.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.379+0000 7f49d2bb4700 1 -- start start 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 0x7f49cc09cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc118fc0 con 0x7f49cc133540 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc09c230 con 0x7f49cc135e60 2023-10-03T10:18:36.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d2bb4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f49cc09dab0 con 0x7f49cc130540 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d0950700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d1151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49cbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 0x7f49cc09cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d1151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51358/0 (socket says 172.21.15.19:51358) 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d0950700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50064/0 (socket says 172.21.15.19:50064) 2023-10-03T10:18:36.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.380+0000 7f49d1151700 1 -- 172.21.15.19:0/3142326690 learned_addr learned my addr 172.21.15.19:0/3142326690 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 -- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 msgr2=0x7f49cc1cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 -- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 msgr2=0x7f49cc09cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 0x7f49cc09cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 -- 172.21.15.19:0/3142326690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80094a0 con 0x7f49cc130540 2023-10-03T10:18:36.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d1151700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49cbfff700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 0x7f49cc09cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d0950700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c3f0 tx=0x7f49c000c700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0004c80 con 0x7f49cc130540 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c4009b30 con 0x7f49cc130540 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49cc119b40 con 0x7f49cc130540 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c0004de0 con 0x7f49cc130540 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.381+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0007310 con 0x7f49cc130540 2023-10-03T10:18:36.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.382+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f49c0007470 con 0x7f49cc130540 2023-10-03T10:18:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.383+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f49c003f2c0 con 0x7f49cc130540 2023-10-03T10:18:36.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.383+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0052e0 con 0x7f49cc130540 2023-10-03T10:18:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.392+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f49c00123b0 con 0x7f49cc130540 2023-10-03T10:18:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.574+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8d68091460 con 0x7f8d681391e0 2023-10-03T10:18:36.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.574+0000 7f8d5dffb700 1 -- 172.21.15.19:0/2744156756 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8d60035090 con 0x7f8d681391e0 2023-10-03T10:18:36.574 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 msgr2=0x7f8d6808d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8d68099910 tx=0x7f8d60004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 shutdown_connections 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8d681391e0 0x7f8d6808d940 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8d68133870 0x7f8d6808ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 --2- 172.21.15.19:0/2744156756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d681368c0 0x7f8d6808d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 >> 172.21.15.19:0/2744156756 conn(0x7f8d680a2540 msgr2=0x7f8d6809ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 shutdown_connections 2023-10-03T10:18:36.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.576+0000 7f8d6e3a1700 1 -- 172.21.15.19:0/2744156756 wait complete. 2023-10-03T10:18:36.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.587+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f90d406b250 con 0x7f90d4130870 2023-10-03T10:18:36.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.587+0000 7f90c9ffb700 1 -- 172.21.15.19:0/3506285972 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f90c4015020 con 0x7f90d4130870 2023-10-03T10:18:36.587 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.590+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 msgr2=0x7f90d409c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.590+0000 7f90db6ec700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 0x7f90d409c6c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f90c4016000 tx=0x7f90c4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:36.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 shutdown_connections 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90d4133a80 0x7f90d409cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90d412ff20 0x7f90d409c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 --2- 172.21.15.19:0/3506285972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90d4130870 0x7f90d409c6c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 >> 172.21.15.19:0/3506285972 conn(0x7f90d40a4210 msgr2=0x7f90d409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 shutdown_connections 2023-10-03T10:18:36.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.591+0000 7f90db6ec700 1 -- 172.21.15.19:0/3506285972 wait complete. 2023-10-03T10:18:36.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:36.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.608+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f49ac005590 con 0x7f49cc130540 2023-10-03T10:18:36.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.609+0000 7f49c97fa700 1 -- 172.21.15.19:0/3142326690 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49c0011360 con 0x7f49cc130540 2023-10-03T10:18:36.609 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:36.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 msgr2=0x7f49cc09c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:36.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f49c000c3f0 tx=0x7f49c000c700 comp rx=0 tx=0).stop 2023-10-03T10:18:36.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 shutdown_connections 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49cc135e60 0x7f49cc1cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49cc130540 0x7f49cc09c890 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 --2- 172.21.15.19:0/3142326690 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49cc133540 0x7f49cc09cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.611+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 >> 172.21.15.19:0/3142326690 conn(0x7f49cc0a2aa0 msgr2=0x7f49cc131320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.612+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 shutdown_connections 2023-10-03T10:18:36.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:36.612+0000 7f49d2bb4700 1 -- 172.21.15.19:0/3142326690 wait complete. 2023-10-03T10:18:36.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:37.337 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.483+0000 7fcfcf4dc700 1 Processor -- start 2023-10-03T10:18:37.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.483+0000 7fcfcf4dc700 1 -- start start 2023-10-03T10:18:37.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcf4dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcf4dc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcfc809eca0 0x7fcfc806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcf4dc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc8070ee0 con 0x7fcfc8134610 2023-10-03T10:18:37.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcf4dc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc8071480 con 0x7fcfc809eca0 2023-10-03T10:18:37.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcf4dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc806f3c0 con 0x7fcfc806e570 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcd278700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcfc809eca0 0x7fcfc806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcd278700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50074/0 (socket says 172.21.15.19:50074) 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcd278700 1 -- 172.21.15.19:0/2054822584 learned_addr learned my addr 172.21.15.19:0/2054822584 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcda79700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcfc8134610 0x7fcfc8134a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57654/0 (socket says 172.21.15.19:57654) 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfbffff700 1 -- 172.21.15.19:0/2054822584 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070225250 0 0) 0x7fcfc8070ee0 con 0x7fcfc8134610 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfbffff700 1 -- 172.21.15.19:0/2054822584 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb40035b0 con 0x7fcfc8134610 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 -- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 msgr2=0x7fcfc806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 -- 172.21.15.19:0/2054822584 >> v1:172.21.15.19:6789/0 conn(0x7fcfc8134610 legacy=0x7fcfc8134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 -- 172.21.15.19:0/2054822584 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8071b90 con 0x7fcfc809eca0 2023-10-03T10:18:37.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcd278700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfcca77700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc809eca0 0x7fcfc806ee80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009840 tx=0x7fcfb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6184f7ee3b502112 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.484+0000 7fcfbffff700 1 -- 172.21.15.19:0/2054822584 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8011830 con 0x7fcfc809eca0 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfbffff700 1 -- 172.21.15.19:0/2054822584 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8011990 con 0x7fcfc809eca0 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfbffff700 1 -- 172.21.15.19:0/2054822584 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8011d20 con 0x7fcfc809eca0 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc809eca0 msgr2=0x7fcfc806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc809eca0 0x7fcfc806ee80 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8009840 tx=0x7fcfb8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/2054822584 shutdown_connections 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc806e570 0x7fcfc806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/2054822584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc809eca0 0x7fcfc806ee80 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/2054822584 >> 172.21.15.19:0/2054822584 conn(0x7fcfc80a2aa0 msgr2=0x7fcfc80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/2054822584 shutdown_connections 2023-10-03T10:18:37.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.485+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/2054822584 wait complete. 2023-10-03T10:18:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 Processor -- start 2023-10-03T10:18:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 -- start start 2023-10-03T10:18:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcfc806e570 0x7fcfc81214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc8125050 0x7fcfc8121f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc81242e0 con 0x7fcfc8134610 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc8123510 con 0x7fcfc806e570 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.487+0000 7fcfcf4dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc81231f0 con 0x7fcfc8125050 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcd278700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcfc806e570 0x7fcfc81214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45706/0 (socket says 172.21.15.19:45706) 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 -- 172.21.15.19:0/746709002 learned_addr learned my addr 172.21.15.19:0/746709002 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcda79700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc8125050 0x7fcfc8121f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 -- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc8125050 msgr2=0x7fcfc8121f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc8125050 0x7fcfc8121f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 -- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcfc806e570 msgr2=0x7fcfc81214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcfc806e570 0x7fcfc81214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 -- 172.21.15.19:0/746709002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4009550 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcca77700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80090b0 tx=0x7fcfb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004590 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb801f070 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80038e0 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.488+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80094a0 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.489+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc8124bf0 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.489+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcfb8003a40 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.489+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcfb8021070 con 0x7fcfc8134610 2023-10-03T10:18:37.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.490+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc81244f0 con 0x7fcfc8134610 2023-10-03T10:18:37.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.495+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcfc81244f0 con 0x7fcfc8134610 2023-10-03T10:18:37.592 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:37.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:37.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.729+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcfc81244f0 con 0x7fcfc8134610 2023-10-03T10:18:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.729+0000 7fcfbdffb700 1 -- 172.21.15.19:0/746709002 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcfc81244f0 con 0x7fcfc8134610 2023-10-03T10:18:37.729 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 msgr2=0x7fcfc8121a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80090b0 tx=0x7fcfb8004750 comp rx=0 tx=0).stop 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 shutdown_connections 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcfc8125050 0x7fcfc8121f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcfc806e570 0x7fcfc81214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 --2- 172.21.15.19:0/746709002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfc8134610 0x7fcfc8121a20 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 >> 172.21.15.19:0/746709002 conn(0x7fcfc80a2aa0 msgr2=0x7fcfc81bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 shutdown_connections 2023-10-03T10:18:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.732+0000 7fcfcf4dc700 1 -- 172.21.15.19:0/746709002 wait complete. 2023-10-03T10:18:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.740+0000 7f7878eb6700 1 Processor -- start 2023-10-03T10:18:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.740+0000 7f7878eb6700 1 -- start start 2023-10-03T10:18:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.740+0000 7f7878eb6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.740+0000 7f7878eb6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7878eb6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787409f130 con 0x7f787409e410 2023-10-03T10:18:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7878eb6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787409f520 con 0x7f787409d6f0 2023-10-03T10:18:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7878eb6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f787409e930 con 0x7f787409e000 2023-10-03T10:18:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f787259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50090/0 (socket says 172.21.15.19:50090) 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f787259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45708/0 (socket says 172.21.15.19:45708) 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 -- 172.21.15.19:0/3051040037 learned_addr learned my addr 172.21.15.19:0/3051040037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 -- 172.21.15.19:0/3051040037 >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 msgr2=0x7f787409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 --2- 172.21.15.19:0/3051040037 >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 -- 172.21.15.19:0/3051040037 >> v1:172.21.15.19:6789/0 conn(0x7f787409e410 legacy=0x7f7874130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 -- 172.21.15.19:0/3051040037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787409b2d0 con 0x7f787409e000 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f787259c700 1 --2- 172.21.15.19:0/3051040037 >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.741+0000 7f7871d9b700 1 --2- 172.21.15.19:0/3051040037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f78680098f0 tx=0x7f7868009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c179c0333c7848 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.742+0000 7f787159a700 1 -- 172.21.15.19:0/3051040037 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868004230 con 0x7f787409e000 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.742+0000 7f787159a700 1 -- 172.21.15.19:0/3051040037 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868004390 con 0x7f787409e000 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.742+0000 7f787159a700 1 -- 172.21.15.19:0/3051040037 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78680036a0 con 0x7f787409e000 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.742+0000 7f7878eb6700 1 -- 172.21.15.19:0/3051040037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 msgr2=0x7f7874130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.742+0000 7f7878eb6700 1 --2- 172.21.15.19:0/3051040037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f78680098f0 tx=0x7f7868009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 -- 172.21.15.19:0/3051040037 shutdown_connections 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 --2- 172.21.15.19:0/3051040037 >> v2:172.21.15.19:3300/0 conn(0x7f787409d6f0 0x7f787409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 --2- 172.21.15.19:0/3051040037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874130660 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 -- 172.21.15.19:0/3051040037 >> 172.21.15.19:0/3051040037 conn(0x7f7874066f50 msgr2=0x7f787409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 -- 172.21.15.19:0/3051040037 shutdown_connections 2023-10-03T10:18:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.743+0000 7f7878eb6700 1 -- 172.21.15.19:0/3051040037 wait complete. 2023-10-03T10:18:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.744+0000 7f7878eb6700 1 Processor -- start 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.744+0000 7f7878eb6700 1 -- start start 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 0x7f7874131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 0x7f78741320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78740a19a0 con 0x7f787409e410 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78741353d0 con 0x7f787409d6f0 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7878eb6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7874132c10 con 0x7f787409e000 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7872d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 0x7f78741320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7872d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 0x7f78741320b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45710/0 (socket says 172.21.15.19:45710) 2023-10-03T10:18:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7872d9d700 1 -- 172.21.15.19:0/4027976149 learned_addr learned my addr 172.21.15.19:0/4027976149 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f787259c700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 0x7f7874131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 -- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 msgr2=0x7f7874131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 0x7f7874131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 -- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 msgr2=0x7f78741320b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 0x7f78741320b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f7871d9b700 1 -- 172.21.15.19:0/4027976149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78640094a0 con 0x7f787409e000 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.745+0000 7f787259c700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 0x7f7874131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7871d9b700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874131b70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7868015000 tx=0x7f7868004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868003b20 con 0x7f787409e000 2023-10-03T10:18:37.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786801f070 con 0x7f787409e000 2023-10-03T10:18:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868003e80 con 0x7f787409e000 2023-10-03T10:18:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7868009550 con 0x7f787409e000 2023-10-03T10:18:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.746+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78741341c0 con 0x7f787409e000 2023-10-03T10:18:37.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.747+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78741343b0 con 0x7f787409e000 2023-10-03T10:18:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.748+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7868021030 con 0x7f787409e000 2023-10-03T10:18:37.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.748+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7868040d20 con 0x7f787409e000 2023-10-03T10:18:37.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:37.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.757+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f786800b7f0 con 0x7f787409e000 2023-10-03T10:18:37.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.788+0000 7f516ebcd700 1 Processor -- start 2023-10-03T10:18:37.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 -- start start 2023-10-03T10:18:37.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f516806c0e0 0x7f516809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 0x7f516813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5168134980 con 0x7f5168134ec0 2023-10-03T10:18:37.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516806c4b0 con 0x7f516806c0e0 2023-10-03T10:18:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516ebcd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51680a09c0 con 0x7f51681380f0 2023-10-03T10:18:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516d16a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 0x7f516813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f5167fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5168134ec0 0x7f51681379e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57672/0 (socket says 172.21.15.19:57672) 2023-10-03T10:18:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f516c969700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f516806c0e0 0x7f516809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.789+0000 7f5167fff700 1 -- 172.21.15.19:0/2715370535 learned_addr learned my addr 172.21.15.19:0/2715370535 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516c969700 1 -- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 msgr2=0x7f516813fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516c969700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 0x7f516813fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516c969700 1 -- 172.21.15.19:0/2715370535 >> v1:172.21.15.19:6789/0 conn(0x7f5168134ec0 legacy=0x7f51681379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516c969700 1 -- 172.21.15.19:0/2715370535 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51680a0600 con 0x7f516806c0e0 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516d16a700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 0x7f516813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f516c969700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f516806c0e0 0x7f516809ac90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f515c009840 tx=0x7f515c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b520beae1d21733 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f51677fe700 1 -- 172.21.15.19:0/2715370535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c011830 con 0x7f516806c0e0 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f51677fe700 1 -- 172.21.15.19:0/2715370535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c011990 con 0x7f516806c0e0 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.790+0000 7f51677fe700 1 -- 172.21.15.19:0/2715370535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c011d20 con 0x7f516806c0e0 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 -- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f516806c0e0 msgr2=0x7f516809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f516806c0e0 0x7f516809ac90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f515c009840 tx=0x7f515c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 -- 172.21.15.19:0/2715370535 shutdown_connections 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51681380f0 0x7f516813fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 --2- 172.21.15.19:0/2715370535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f516806c0e0 0x7f516809ac90 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 -- 172.21.15.19:0/2715370535 >> 172.21.15.19:0/2715370535 conn(0x7f51680a4210 msgr2=0x7f51680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 -- 172.21.15.19:0/2715370535 shutdown_connections 2023-10-03T10:18:37.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.791+0000 7f516ebcd700 1 -- 172.21.15.19:0/2715370535 wait complete. 2023-10-03T10:18:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.792+0000 7f516ebcd700 1 Processor -- start 2023-10-03T10:18:37.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.792+0000 7f516ebcd700 1 -- start start 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.792+0000 7f516ebcd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 0x7f5168134080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516ebcd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516ebcd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516ebcd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51680a0480 con 0x7f51681380f0 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516ebcd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5168140f40 con 0x7f516806c0e0 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516ebcd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51681345c0 con 0x7f5168134ec0 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f5167fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45718/0 (socket says 172.21.15.19:45718) 2023-10-03T10:18:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516c969700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 0x7f5168134080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f5167fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50108/0 (socket says 172.21.15.19:50108) 2023-10-03T10:18:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 -- 172.21.15.19:0/1430044170 learned_addr learned my addr 172.21.15.19:0/1430044170 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f00d3fd0700 1 Processor -- start 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 -- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 msgr2=0x7f5168132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 -- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 msgr2=0x7f5168134080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 0x7f5168134080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516d16a700 1 -- 172.21.15.19:0/1430044170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5160009a70 con 0x7f51681380f0 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f516c969700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 0x7f5168134080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f5167fff700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.793+0000 7f00d3fd0700 1 -- start start 2023-10-03T10:18:37.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f516d16a700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5160009f00 tx=0x7f516000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160009d70 con 0x7f51681380f0 2023-10-03T10:18:37.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000f040 con 0x7f51681380f0 2023-10-03T10:18:37.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516000cd70 con 0x7f51681380f0 2023-10-03T10:18:37.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c0094a0 con 0x7f51681380f0 2023-10-03T10:18:37.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516811c7d0 con 0x7f51681380f0 2023-10-03T10:18:37.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d3fd0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 0x7f00cc130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d3fd0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d3fd0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00cc0716a0 con 0x7f00cc06fb20 2023-10-03T10:18:37.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d3fd0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00cc09a390 con 0x7f00cc130540 2023-10-03T10:18:37.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d3fd0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc071290 con 0x7f00cc130e50 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d256d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f00cc06fb20 0x7f00cc137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57678/0 (socket says 172.21.15.19:57678) 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d256d700 1 -- 172.21.15.19:0/192951930 learned_addr learned my addr 172.21.15.19:0/192951930 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.794+0000 7f00d156b700 1 --2- 172.21.15.19:0/192951930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d1d6c700 1 --2- 172.21.15.19:0/192951930 >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 0x7f00cc130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d156b700 1 -- 172.21.15.19:0/192951930 >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 msgr2=0x7f00cc130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d156b700 1 --2- 172.21.15.19:0/192951930 >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 0x7f00cc130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d156b700 1 -- 172.21.15.19:0/192951930 >> v1:172.21.15.19:6789/0 conn(0x7f00cc06fb20 legacy=0x7f00cc137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d156b700 1 -- 172.21.15.19:0/192951930 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc130340 con 0x7f00cc130e50 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d1d6c700 1 --2- 172.21.15.19:0/192951930 >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 0x7f00cc130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:37.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d156b700 1 --2- 172.21.15.19:0/192951930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc06f5e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f00c80098d0 tx=0x7f00c8009be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daefc2fd7a1986d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516811d7a0 con 0x7f51681380f0 2023-10-03T10:18:37.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d0d6a700 1 -- 172.21.15.19:0/192951930 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8004230 con 0x7f00cc130e50 2023-10-03T10:18:37.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5160014480 con 0x7f51681380f0 2023-10-03T10:18:37.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d0d6a700 1 -- 172.21.15.19:0/192951930 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8004390 con 0x7f00cc130e50 2023-10-03T10:18:37.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.795+0000 7f00d0d6a700 1 -- 172.21.15.19:0/192951930 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c80108c0 con 0x7f00cc130e50 2023-10-03T10:18:37.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f516003fd60 con 0x7f51681380f0 2023-10-03T10:18:37.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 -- 172.21.15.19:0/192951930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 msgr2=0x7f00cc06f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/192951930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc06f5e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f00c80098d0 tx=0x7f00c8009be0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 -- 172.21.15.19:0/192951930 shutdown_connections 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/192951930 >> v2:172.21.15.19:3300/0 conn(0x7f00cc130540 0x7f00cc130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/192951930 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc06f5e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 -- 172.21.15.19:0/192951930 >> 172.21.15.19:0/192951930 conn(0x7f00cc0a2aa0 msgr2=0x7f00cc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 -- 172.21.15.19:0/192951930 shutdown_connections 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.796+0000 7f00d3fd0700 1 -- 172.21.15.19:0/192951930 wait complete. 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.797+0000 7f00d3fd0700 1 Processor -- start 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.797+0000 7f00d3fd0700 1 -- start start 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 0x7f00cc11ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc11b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc11df30 con 0x7f00cc06fb20 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc11d020 con 0x7f00cc130540 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d3fd0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00cc11c2c0 con 0x7f00cc130e50 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d1d6c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d1d6c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45730/0 (socket says 172.21.15.19:45730) 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d1d6c700 1 -- 172.21.15.19:0/3655385615 learned_addr learned my addr 172.21.15.19:0/3655385615 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d256d700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc11b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d156b700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 0x7f00cc11ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d1d6c700 1 -- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 msgr2=0x7f00cc11b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.798+0000 7f00d1d6c700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc11b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d1d6c700 1 -- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 msgr2=0x7f00cc11ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d1d6c700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 0x7f00cc11ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d1d6c700 1 -- 172.21.15.19:0/3655385615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80094a0 con 0x7f00cc06fb20 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d256d700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc11b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d156b700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 0x7f00cc11ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.799+0000 7f00d1d6c700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00dd00 tx=0x7f00bc00a3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00ab10 con 0x7f00cc06fb20 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc00ac70 con 0x7f00cc06fb20 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00cc0a0bb0 con 0x7f00cc06fb20 2023-10-03T10:18:37.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc019480 con 0x7f00cc06fb20 2023-10-03T10:18:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00cc11d4e0 con 0x7f00cc06fb20 2023-10-03T10:18:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.805+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5160012930 con 0x7f51681380f0 2023-10-03T10:18:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.806+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f00bc0195e0 con 0x7f00cc06fb20 2023-10-03T10:18:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.806+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc09cd40 con 0x7f00cc06fb20 2023-10-03T10:18:37.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.806+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00bc014070 con 0x7f00cc06fb20 2023-10-03T10:18:37.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.811+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f00bc0189d0 con 0x7f00cc06fb20 2023-10-03T10:18:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.970+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78741343b0 con 0x7f787409e000 2023-10-03T10:18:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.971+0000 7f7862ffd700 1 -- 172.21.15.19:0/4027976149 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78741343b0 con 0x7f787409e000 2023-10-03T10:18:37.971 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 msgr2=0x7f7874131b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874131b70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7868015000 tx=0x7f7868004750 comp rx=0 tx=0).stop 2023-10-03T10:18:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 shutdown_connections 2023-10-03T10:18:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f787409e410 0x7f78741320b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f787409d6f0 0x7f7874131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 --2- 172.21.15.19:0/4027976149 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f787409e000 0x7f7874131b70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 >> 172.21.15.19:0/4027976149 conn(0x7f7874066f50 msgr2=0x7f787406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 shutdown_connections 2023-10-03T10:18:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:37.973+0000 7f7878eb6700 1 -- 172.21.15.19:0/4027976149 wait complete. 2023-10-03T10:18:37.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:38.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.014+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5168074ea0 con 0x7f51681380f0 2023-10-03T10:18:38.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.014+0000 7f51657fa700 1 -- 172.21.15.19:0/1430044170 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5160012340 con 0x7f51681380f0 2023-10-03T10:18:38.014 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.014+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f00cc074ea0 con 0x7f00cc06fb20 2023-10-03T10:18:38.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.015+0000 7f00c27fc700 1 -- 172.21.15.19:0/3655385615 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f00bc00f3d0 con 0x7f00cc06fb20 2023-10-03T10:18:38.015 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 msgr2=0x7f5168133110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f5160009f00 tx=0x7f516000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 msgr2=0x7f00cc11a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00dd00 tx=0x7f00bc00a3b0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 shutdown_connections 2023-10-03T10:18:38.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51681380f0 0x7f5168133110 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f516806c0e0 0x7f5168134080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 --2- 172.21.15.19:0/1430044170 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5168134ec0 0x7f5168132bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 >> 172.21.15.19:0/1430044170 conn(0x7f51680a4210 msgr2=0x7f51680a4810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 shutdown_connections 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f00cc130e50 0x7f00cc11b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f00cc06fb20 0x7f00cc11a610 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 --2- 172.21.15.19:0/3655385615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f00cc130540 0x7f00cc11ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 >> 172.21.15.19:0/3655385615 conn(0x7f00cc0a2aa0 msgr2=0x7f00cc12d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 shutdown_connections 2023-10-03T10:18:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f516ebcd700 1 -- 172.21.15.19:0/1430044170 wait complete. 2023-10-03T10:18:38.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 shutdown_connections 2023-10-03T10:18:38.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.017+0000 7f00d3fd0700 1 -- 172.21.15.19:0/3655385615 wait complete. 2023-10-03T10:18:38.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:38.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:38.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.897+0000 7ff2c9e31700 1 Processor -- start 2023-10-03T10:18:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.897+0000 7ff2c9e31700 1 -- start start 2023-10-03T10:18:38.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c9e31700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2c409e930 0x7ff2c409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c9e31700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 0x7ff2c4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c9e31700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c4070940 con 0x7ff2c409f240 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c9e31700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c406fd60 con 0x7ff2c409e930 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c9e31700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c406fa80 con 0x7ff2c409f650 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2c409e930 0x7ff2c409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff2c409f240 0x7ff2c41317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57686/0 (socket says 172.21.15.19:57686) 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 0x7ff2c4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c2ffd700 1 -- 172.21.15.19:0/992317888 learned_addr learned my addr 172.21.15.19:0/992317888 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2c409e930 0x7ff2c409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45738/0 (socket says 172.21.15.19:45738) 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 -- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 msgr2=0x7ff2c4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 0x7ff2c4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 -- 172.21.15.19:0/992317888 >> v1:172.21.15.19:6789/0 conn(0x7ff2c409f240 legacy=0x7ff2c41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c37fe700 1 -- 172.21.15.19:0/992317888 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c409fb60 con 0x7ff2c409e930 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c3fff700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 0x7ff2c4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.898+0000 7ff2c27fc700 1 -- 172.21.15.19:0/992317888 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990577720 0 0) 0x7ff2c4070940 con 0x7ff2c409f240 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c37fe700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409e930 0x7ff2c409ed00 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009840 tx=0x7ff2b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503c8becad1bd0c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c27fc700 1 -- 172.21.15.19:0/992317888 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4011830 con 0x7ff2c409e930 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c27fc700 1 -- 172.21.15.19:0/992317888 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b4011990 con 0x7ff2c409e930 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c27fc700 1 -- 172.21.15.19:0/992317888 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4011d20 con 0x7ff2c409e930 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 -- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409e930 msgr2=0x7ff2c409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409e930 0x7ff2c409ed00 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009840 tx=0x7ff2b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 -- 172.21.15.19:0/992317888 shutdown_connections 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f650 0x7ff2c4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/992317888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409e930 0x7ff2c409ed00 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 -- 172.21.15.19:0/992317888 >> 172.21.15.19:0/992317888 conn(0x7ff2c40a4210 msgr2=0x7ff2c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:38.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 -- 172.21.15.19:0/992317888 shutdown_connections 2023-10-03T10:18:38.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.899+0000 7ff2c9e31700 1 -- 172.21.15.19:0/992317888 wait complete. 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.900+0000 7ff2c9e31700 1 Processor -- start 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 -- start start 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 0x7ff2c41a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f240 0x7ff2c41a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41b72a0 con 0x7ff2c409f650 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41a6d10 con 0x7ff2c409e930 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c9e31700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c41a60a0 con 0x7ff2c409f240 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 0x7ff2c41a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f240 0x7ff2c41a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45744/0 (socket says 172.21.15.19:45744) 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.901+0000 7ff2c3fff700 1 -- 172.21.15.19:0/1415762329 learned_addr learned my addr 172.21.15.19:0/1415762329 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 -- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f240 msgr2=0x7ff2c41a43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f240 0x7ff2c41a43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 -- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 msgr2=0x7ff2c41a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 -- 172.21.15.19:0/1415762329 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc009a70 con 0x7ff2c409e930 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c3fff700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c37fe700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 0x7ff2c41a3eb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4016000 tx=0x7ff2b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40036a0 con 0x7ff2c409e930 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b401f070 con 0x7ff2c409e930 2023-10-03T10:18:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b40094a0 con 0x7ff2c409e930 2023-10-03T10:18:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4003a20 con 0x7ff2c409e930 2023-10-03T10:18:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.902+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c40a0190 con 0x7ff2c409e930 2023-10-03T10:18:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.903+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2b4003b80 con 0x7ff2c409e930 2023-10-03T10:18:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.903+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2b4021070 con 0x7ff2c409e930 2023-10-03T10:18:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.903+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c41a0b30 con 0x7ff2c409e930 2023-10-03T10:18:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:38.908+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2b402b070 con 0x7ff2c409e930 2023-10-03T10:18:38.987 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:39.032 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:39.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:39.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.115+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff2c40a3260 con 0x7ff2c409e930 2023-10-03T10:18:39.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.115+0000 7ff2abfff700 1 -- 172.21.15.19:0/1415762329 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2b4015030 con 0x7ff2c409e930 2023-10-03T10:18:39.116 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 msgr2=0x7ff2c41a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 0x7ff2c41a3eb0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4016000 tx=0x7ff2b4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 shutdown_connections 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2c409f650 0x7ff2c41a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2c409e930 0x7ff2c41a3eb0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 --2- 172.21.15.19:0/1415762329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2c409f240 0x7ff2c41a43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 >> 172.21.15.19:0/1415762329 conn(0x7ff2c40a4210 msgr2=0x7ff2c41b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 shutdown_connections 2023-10-03T10:18:39.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.119+0000 7ff2c9e31700 1 -- 172.21.15.19:0/1415762329 wait complete. 2023-10-03T10:18:39.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.134+0000 7f8390df6700 1 Processor -- start 2023-10-03T10:18:39.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.134+0000 7f8390df6700 1 -- start start 2023-10-03T10:18:39.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.135+0000 7f8390df6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838c09d6f0 0x7f838c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.135+0000 7f8390df6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.135+0000 7f8390df6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c09b120 con 0x7f838c09e000 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.135+0000 7f8390df6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c06b460 con 0x7f838c09d6f0 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.135+0000 7f8390df6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c09a7e0 con 0x7f838c09e440 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838c09d6f0 0x7f838c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838c09d6f0 0x7f838c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45754/0 (socket says 172.21.15.19:45754) 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 -- 172.21.15.19:0/2586016431 learned_addr learned my addr 172.21.15.19:0/2586016431 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838ad9d700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.138 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:39.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 -- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 msgr2=0x7f838c134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 -- 172.21.15.19:0/2586016431 >> v1:172.21.15.19:6789/0 conn(0x7f838c09e000 legacy=0x7f838c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 -- 172.21.15.19:0/2586016431 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c09a500 con 0x7f838c09d6f0 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838a59c700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c09dac0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f837c009920 tx=0x7f837c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40dd59e304fc6dc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.136+0000 7f838959a700 1 -- 172.21.15.19:0/2586016431 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011830 con 0x7f838c09d6f0 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f838959a700 1 -- 172.21.15.19:0/2586016431 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c011990 con 0x7f838c09d6f0 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f838959a700 1 -- 172.21.15.19:0/2586016431 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011d20 con 0x7f838c09d6f0 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 -- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 msgr2=0x7f838c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c09dac0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f837c009920 tx=0x7f837c009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 -- 172.21.15.19:0/2586016431 shutdown_connections 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 --2- 172.21.15.19:0/2586016431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c09dac0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 -- 172.21.15.19:0/2586016431 >> 172.21.15.19:0/2586016431 conn(0x7f838c066f50 msgr2=0x7f838c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 -- 172.21.15.19:0/2586016431 shutdown_connections 2023-10-03T10:18:39.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.137+0000 7f8390df6700 1 -- 172.21.15.19:0/2586016431 wait complete. 2023-10-03T10:18:39.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 Processor -- start 2023-10-03T10:18:39.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 -- start start 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838c09e000 0x7f838c1a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c1a6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c09c710 con 0x7f838c09d6f0 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a81b0 con 0x7f838c09e440 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f8390df6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1a7b60 con 0x7f838c09e000 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f838a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f838a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45764/0 (socket says 172.21.15.19:45764) 2023-10-03T10:18:39.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f838a59c700 1 -- 172.21.15.19:0/2080762207 learned_addr learned my addr 172.21.15.19:0/2080762207 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.139+0000 7f838ad9d700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c1a6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f8389d9b700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838c09e000 0x7f838c1a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 -- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838c09e000 msgr2=0x7f838c1a64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838c09e000 0x7f838c1a64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 -- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 msgr2=0x7f838c1a6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c1a6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 -- 172.21.15.19:0/2080762207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009550 con 0x7f838c09d6f0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838ad9d700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c1a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f838a59c700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f837c009c70 tx=0x7f837c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c004300 con 0x7f838c09d6f0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c01f070 con 0x7f838c09d6f0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0036a0 con 0x7f838c09d6f0 2023-10-03T10:18:39.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c1a9a70 con 0x7f838c09d6f0 2023-10-03T10:18:39.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.140+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c1a9790 con 0x7f838c09d6f0 2023-10-03T10:18:39.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.141+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f837c021030 con 0x7f838c09d6f0 2023-10-03T10:18:39.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.142+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f837c0407f0 con 0x7f838c09d6f0 2023-10-03T10:18:39.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.142+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c074ea0 con 0x7f838c09d6f0 2023-10-03T10:18:39.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.147+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f837c015080 con 0x7f838c09d6f0 2023-10-03T10:18:39.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.178+0000 7f0c13db3700 1 Processor -- start 2023-10-03T10:18:39.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 -- start start 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c0c0a0a30 0x7f0c0c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a1340 0x7f0c0c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c09edd0 con 0x7f0c0c0a0a30 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c09e1f0 con 0x7f0c0c133fa0 2023-10-03T10:18:39.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c13db3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c09dc50 con 0x7f0c0c0a1340 2023-10-03T10:18:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c12350700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c1134e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a1340 0x7f0c0c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c12350700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51412/0 (socket says 172.21.15.19:51412) 2023-10-03T10:18:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c12350700 1 -- 172.21.15.19:0/2797794006 learned_addr learned my addr 172.21.15.19:0/2797794006 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.179+0000 7f0c11b4f700 1 --2- 172.21.15.19:0/2797794006 >> v2:172.21.15.19:3300/0 conn(0x7f0c0c0a0a30 0x7f0c0c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 -- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a1340 msgr2=0x7f0c0c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 --2- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a1340 0x7f0c0c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 -- 172.21.15.19:0/2797794006 >> v2:172.21.15.19:3300/0 conn(0x7f0c0c0a0a30 msgr2=0x7f0c0c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 --2- 172.21.15.19:0/2797794006 >> v2:172.21.15.19:3300/0 conn(0x7f0c0c0a0a30 0x7f0c0c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 -- 172.21.15.19:0/2797794006 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0a1fe0 con 0x7f0c0c133fa0 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c12350700 1 --2- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009e80 tx=0x7f0c0400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2d05b5b0efd6209 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c10b4d700 1 -- 172.21.15.19:0/2797794006 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400e070 con 0x7f0c0c133fa0 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c10b4d700 1 -- 172.21.15.19:0/2797794006 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0400b8d0 con 0x7f0c0c133fa0 2023-10-03T10:18:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.180+0000 7f0c10b4d700 1 -- 172.21.15.19:0/2797794006 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0400bc40 con 0x7f0c0c133fa0 2023-10-03T10:18:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 -- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 msgr2=0x7f0c0c134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 --2- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009e80 tx=0x7f0c0400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 -- 172.21.15.19:0/2797794006 shutdown_connections 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 --2- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c134410 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 --2- 172.21.15.19:0/2797794006 >> v2:172.21.15.19:3300/0 conn(0x7f0c0c0a0a30 0x7f0c0c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 --2- 172.21.15.19:0/2797794006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a1340 0x7f0c0c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 -- 172.21.15.19:0/2797794006 >> 172.21.15.19:0/2797794006 conn(0x7f0c0c0a6550 msgr2=0x7f0c0c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 -- 172.21.15.19:0/2797794006 shutdown_connections 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.181+0000 7f0c13db3700 1 -- 172.21.15.19:0/2797794006 wait complete. 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.182+0000 7f0c13db3700 1 Processor -- start 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.182+0000 7f0c13db3700 1 -- start start 2023-10-03T10:18:39.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.182+0000 7f0c13db3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 0x7f0c0c120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.182+0000 7f0c13db3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 0x7f0c0c1206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c13db3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c13db3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c122f40 con 0x7f0c0c0a1340 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c13db3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c123920 con 0x7f0c0c133fa0 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c13db3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c121e00 con 0x7f0c0c0a0a30 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51420/0 (socket says 172.21.15.19:51420) 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 -- 172.21.15.19:0/3876918366 learned_addr learned my addr 172.21.15.19:0/3876918366 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c1134e700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 0x7f0c0c1206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c11b4f700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 0x7f0c0c120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 -- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 msgr2=0x7f0c0c120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 0x7f0c0c120180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 -- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 msgr2=0x7f0c0c1206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 0x7f0c0c1206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 -- 172.21.15.19:0/3876918366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04009b30 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c1134e700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 0x7f0c0c1206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c11b4f700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 0x7f0c0c120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c12350700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400b680 tx=0x7f0c04004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.183+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04004450 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.184+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04007160 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.184+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04004810 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.184+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c0a3430 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.184+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c123c00 con 0x7f0c0c133fa0 2023-10-03T10:18:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.185+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c0401c410 con 0x7f0c0c133fa0 2023-10-03T10:18:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.185+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c123a60 con 0x7f0c0c133fa0 2023-10-03T10:18:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.185+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c04040e10 con 0x7f0c0c133fa0 2023-10-03T10:18:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.190+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c0c123a60 con 0x7f0c0c133fa0 2023-10-03T10:18:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 Processor -- start 2023-10-03T10:18:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 -- start start 2023-10-03T10:18:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 0x7f46d0130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 0x7f46d006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d009a390 con 0x7f46d006fb20 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00716a0 con 0x7f46d0130e50 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.192+0000 7f46d5fa8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d0071290 con 0x7f46d0130540 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51426/0 (socket says 172.21.15.19:51426) 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 -- 172.21.15.19:0/1454451141 learned_addr learned my addr 172.21.15.19:0/1454451141 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46cffff700 1 --2- 172.21.15.19:0/1454451141 >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 0x7f46d006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46cf7fe700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 0x7f46d0130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 -- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 msgr2=0x7f46d0130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 0x7f46d0130910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 -- 172.21.15.19:0/1454451141 >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 msgr2=0x7f46d006ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 --2- 172.21.15.19:0/1454451141 >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 0x7f46d006ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 -- 172.21.15.19:0/1454451141 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d0130340 con 0x7f46d0130e50 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46cffff700 1 --2- 172.21.15.19:0/1454451141 >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 0x7f46d006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46cf7fe700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 0x7f46d0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.193+0000 7f46ceffd700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009920 tx=0x7f46c4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9997ac7d034f372 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46ce7fc700 1 -- 172.21.15.19:0/1454451141 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4011830 con 0x7f46d0130e50 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46ce7fc700 1 -- 172.21.15.19:0/1454451141 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c4011990 con 0x7f46d0130e50 2023-10-03T10:18:39.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46ce7fc700 1 -- 172.21.15.19:0/1454451141 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c4011d20 con 0x7f46d0130e50 2023-10-03T10:18:39.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 -- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 msgr2=0x7f46d006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f46c4009920 tx=0x7f46c4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:39.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 -- 172.21.15.19:0/1454451141 shutdown_connections 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/1454451141 >> v2:172.21.15.19:3300/0 conn(0x7f46d006fb20 0x7f46d006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d0130540 0x7f46d0130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/1454451141 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d006f5e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 -- 172.21.15.19:0/1454451141 >> 172.21.15.19:0/1454451141 conn(0x7f46d00a2aa0 msgr2=0x7f46d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 -- 172.21.15.19:0/1454451141 shutdown_connections 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.194+0000 7f46d5fa8700 1 -- 172.21.15.19:0/1454451141 wait complete. 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.195+0000 7f46d5fa8700 1 Processor -- start 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 -- start start 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d0130540 0x7f46d0119210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d0119750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d011bdc0 con 0x7f46d0130540 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d011bfa0 con 0x7f46d0130e50 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46d5fa8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d00718e0 con 0x7f46d006fb20 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46cf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d0119750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46cf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50186/0 (socket says 172.21.15.19:50186) 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46cf7fe700 1 -- 172.21.15.19:0/2602300945 learned_addr learned my addr 172.21.15.19:0/2602300945 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.196+0000 7f46ceffd700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d0130540 0x7f46d0119210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 -- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 msgr2=0x7f46d0118cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 -- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d0130540 msgr2=0x7f46d0119210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d0130540 0x7f46d0119210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 -- 172.21.15.19:0/2602300945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c800f050 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cf7fe700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46cffff700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d0119750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f46c800f530 tx=0x7f46c800f840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8012050 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8013040 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c00094a0 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8003e20 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.197+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c4009550 con 0x7f46d0130e50 2023-10-03T10:18:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.198+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46c8004000 con 0x7f46d0130e50 2023-10-03T10:18:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.198+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d0074ea0 con 0x7f46d0130e50 2023-10-03T10:18:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.199+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46c8044180 con 0x7f46d0130e50 2023-10-03T10:18:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.203+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46c800be20 con 0x7f46d0130e50 2023-10-03T10:18:39.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.388+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f838c1a9290 con 0x7f838c09d6f0 2023-10-03T10:18:39.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.388+0000 7f837affd700 1 -- 172.21.15.19:0/2080762207 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837c0199a0 con 0x7f838c09d6f0 2023-10-03T10:18:39.390 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 msgr2=0x7f838c1a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f837c009c70 tx=0x7f837c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 shutdown_connections 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838c09e440 0x7f838c1a6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838c09d6f0 0x7f838c1a5fa0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 --2- 172.21.15.19:0/2080762207 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838c09e000 0x7f838c1a64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 >> 172.21.15.19:0/2080762207 conn(0x7f838c066f50 msgr2=0x7f838c1baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 shutdown_connections 2023-10-03T10:18:39.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.391+0000 7f8390df6700 1 -- 172.21.15.19:0/2080762207 wait complete. 2023-10-03T10:18:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.398+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0c0c123a60 con 0x7f0c0c133fa0 2023-10-03T10:18:39.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.398+0000 7f0c0a7fc700 1 -- 172.21.15.19:0/3876918366 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c0c123a60 con 0x7f0c0c133fa0 2023-10-03T10:18:39.399 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 msgr2=0x7f0c0c120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0c0400b680 tx=0x7f0c04004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 shutdown_connections 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c0c133fa0 0x7f0c0c120c00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c0c0a0a30 0x7f0c0c120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 --2- 172.21.15.19:0/3876918366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c0c0a1340 0x7f0c0c1206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 >> 172.21.15.19:0/3876918366 conn(0x7f0c0c0a6550 msgr2=0x7f0c0c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 shutdown_connections 2023-10-03T10:18:39.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.401+0000 7f0c13db3700 1 -- 172.21.15.19:0/3876918366 wait complete. 2023-10-03T10:18:39.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:39.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.423+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46d011b350 con 0x7f46d0130e50 2023-10-03T10:18:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.423+0000 7f46b7fff700 1 -- 172.21.15.19:0/2602300945 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46c8018370 con 0x7f46d0130e50 2023-10-03T10:18:39.424 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 msgr2=0x7f46d0119750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d0119750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f46c800f530 tx=0x7f46c800f840 comp rx=0 tx=0).stop 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 shutdown_connections 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d0130e50 0x7f46d0119750 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d006fb20 0x7f46d0118cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 --2- 172.21.15.19:0/2602300945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d0130540 0x7f46d0119210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 >> 172.21.15.19:0/2602300945 conn(0x7f46d00a2aa0 msgr2=0x7f46d012d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 shutdown_connections 2023-10-03T10:18:39.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:39.426+0000 7f46d5fa8700 1 -- 172.21.15.19:0/2602300945 wait complete. 2023-10-03T10:18:39.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:40.139 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.286+0000 7f429a112700 1 Processor -- start 2023-10-03T10:18:40.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.286+0000 7f429a112700 1 -- start start 2023-10-03T10:18:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f429a112700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 0x7f429409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f429a112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 0x7f4294130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f429a112700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429409f130 con 0x7f429409e410 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f429a112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429409f520 con 0x7f429409e000 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f429a112700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f429409e930 con 0x7f429409d6f0 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4293fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f429409e410 0x7f4294130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57696/0 (socket says 172.21.15.19:57696) 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f42937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 0x7f429409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4293fff700 1 -- 172.21.15.19:0/843698632 learned_addr learned my addr 172.21.15.19:0/843698632 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4292ffd700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 0x7f4294130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f42927fc700 1 -- 172.21.15.19:0/843698632 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408285055 0 0) 0x7f429409f130 con 0x7f429409e410 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4292ffd700 1 -- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 msgr2=0x7f429409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4292ffd700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 0x7f429409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4292ffd700 1 -- 172.21.15.19:0/843698632 >> v1:172.21.15.19:6789/0 conn(0x7f429409e410 legacy=0x7f4294130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.287+0000 7f4292ffd700 1 -- 172.21.15.19:0/843698632 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429409b2d0 con 0x7f429409e000 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f42937fe700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 0x7f429409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f4292ffd700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 0x7f4294130660 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f4288009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ef575098e130dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f42927fc700 1 -- 172.21.15.19:0/843698632 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011830 con 0x7f429409e000 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f42927fc700 1 -- 172.21.15.19:0/843698632 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4288011990 con 0x7f429409e000 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f42927fc700 1 -- 172.21.15.19:0/843698632 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288011d20 con 0x7f429409e000 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f429a112700 1 -- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 msgr2=0x7f4294130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.288+0000 7f429a112700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 0x7f4294130660 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4288009870 tx=0x7f4288009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 -- 172.21.15.19:0/843698632 shutdown_connections 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409d6f0 0x7f429409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 --2- 172.21.15.19:0/843698632 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409e000 0x7f4294130660 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 -- 172.21.15.19:0/843698632 >> 172.21.15.19:0/843698632 conn(0x7f4294066f50 msgr2=0x7f429409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 -- 172.21.15.19:0/843698632 shutdown_connections 2023-10-03T10:18:40.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.289+0000 7f429a112700 1 -- 172.21.15.19:0/843698632 wait complete. 2023-10-03T10:18:40.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 Processor -- start 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 -- start start 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 0x7f4294138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f429409e410 0x7f42941393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4294136940 con 0x7f429409e410 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4294139dc0 con 0x7f429409d6f0 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.290+0000 7f429a112700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4294137f50 con 0x7f429409e000 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f42937fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 0x7f4294138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f42937fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51458/0 (socket says 172.21.15.19:51458) 2023-10-03T10:18:40.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f42937fe700 1 -- 172.21.15.19:0/2979757762 learned_addr learned my addr 172.21.15.19:0/2979757762 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4293fff700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f429409e410 0x7f42941393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 -- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 msgr2=0x7f4294138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 -- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f429409e410 msgr2=0x7f42941393e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f429409e410 0x7f42941393e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 -- 172.21.15.19:0/2979757762 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840094a0 con 0x7f429409e000 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f42937fe700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f4292ffd700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 0x7f4294138ea0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f42940a3e20 tx=0x7f4288004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288024620 con 0x7f429409e000 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42880247a0 con 0x7f429409e000 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880094a0 con 0x7f429409e000 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288024b50 con 0x7f429409e000 2023-10-03T10:18:40.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.291+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42940a1eb0 con 0x7f429409e000 2023-10-03T10:18:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.292+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4288022070 con 0x7f429409e000 2023-10-03T10:18:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.292+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4288040990 con 0x7f429409e000 2023-10-03T10:18:40.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.292+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4294074ea0 con 0x7f429409e000 2023-10-03T10:18:40.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.297+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4288015080 con 0x7f429409e000 2023-10-03T10:18:40.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:40.416 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:40.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.510+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f429413a570 con 0x7f429409e000 2023-10-03T10:18:40.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.510+0000 7f427bfff700 1 -- 172.21.15.19:0/2979757762 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4288029020 con 0x7f429409e000 2023-10-03T10:18:40.511 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 msgr2=0x7f4294138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 0x7f4294138ea0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f42940a3e20 tx=0x7f4288004750 comp rx=0 tx=0).stop 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 shutdown_connections 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f429409e410 0x7f42941393e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f429409d6f0 0x7f4294138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 --2- 172.21.15.19:0/2979757762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f429409e000 0x7f4294138ea0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 >> 172.21.15.19:0/2979757762 conn(0x7f4294066f50 msgr2=0x7f4294070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 shutdown_connections 2023-10-03T10:18:40.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.514+0000 7f429a112700 1 -- 172.21.15.19:0/2979757762 wait complete. 2023-10-03T10:18:40.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:40.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 Processor -- start 2023-10-03T10:18:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 -- start start 2023-10-03T10:18:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 0x7f36a4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 0x7f36a4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a409ece0 con 0x7f36a406a770 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a406b640 con 0x7f36a406b250 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a9ac5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a409e760 con 0x7f36a4136d80 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 0x7f36a4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f36a406a770 0x7f36a406ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57706/0 (socket says 172.21.15.19:57706) 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a37fe700 1 -- 172.21.15.19:0/61833391 learned_addr learned my addr 172.21.15.19:0/61833391 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:40.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.553+0000 7f36a2ffd700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 0x7f36a4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a27fc700 1 -- 172.21.15.19:0/61833391 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999093450 0 0) 0x7f36a409ece0 con 0x7f36a406a770 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a27fc700 1 -- 172.21.15.19:0/61833391 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f368c0035b0 con 0x7f36a406a770 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a3fff700 1 -- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 msgr2=0x7f36a4136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a3fff700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 0x7f36a4136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a3fff700 1 -- 172.21.15.19:0/61833391 >> v1:172.21.15.19:6789/0 conn(0x7f36a406a770 legacy=0x7f36a406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a3fff700 1 -- 172.21.15.19:0/61833391 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a409e040 con 0x7f36a4136d80 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a2ffd700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 0x7f36a4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a3fff700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 0x7f36a4139160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f369c009dc0 tx=0x7f369c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3367ed518a7c0616 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a27fc700 1 -- 172.21.15.19:0/61833391 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00e070 con 0x7f36a4136d80 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a27fc700 1 -- 172.21.15.19:0/61833391 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c00bb20 con 0x7f36a4136d80 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.554+0000 7f36a27fc700 1 -- 172.21.15.19:0/61833391 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c012430 con 0x7f36a4136d80 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 -- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 msgr2=0x7f36a4139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 0x7f36a4139160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f369c009dc0 tx=0x7f369c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 -- 172.21.15.19:0/61833391 shutdown_connections 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a4136d80 0x7f36a4139160 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/61833391 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a406b250 0x7f36a4136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 -- 172.21.15.19:0/61833391 >> 172.21.15.19:0/61833391 conn(0x7f36a4066f50 msgr2=0x7f36a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 -- 172.21.15.19:0/61833391 shutdown_connections 2023-10-03T10:18:40.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.555+0000 7f36a9ac5700 1 -- 172.21.15.19:0/61833391 wait complete. 2023-10-03T10:18:40.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.556+0000 7f36a9ac5700 1 Processor -- start 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 -- start start 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a406a770 0x7f36a41c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a4136d80 0x7f36a411c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a411fd30 con 0x7f36a406b250 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a411e020 con 0x7f36a4136d80 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a9ac5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36a41322e0 con 0x7f36a406a770 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45832/0 (socket says 172.21.15.19:45832) 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a2ffd700 1 -- 172.21.15.19:0/2379393321 learned_addr learned my addr 172.21.15.19:0/2379393321 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:40.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a3fff700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a4136d80 0x7f36a411c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.557+0000 7f36a37fe700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a406a770 0x7f36a41c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 -- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a406a770 msgr2=0x7f36a41c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a406a770 0x7f36a41c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 -- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a4136d80 msgr2=0x7f36a411c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a4136d80 0x7f36a411c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 -- 172.21.15.19:0/2379393321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36980094a0 con 0x7f36a406b250 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a2ffd700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f369800ebe0 tx=0x7f369800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698009800 con 0x7f36a406b250 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800c910 con 0x7f36a406b250 2023-10-03T10:18:40.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c009a70 con 0x7f36a406b250 2023-10-03T10:18:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800cc80 con 0x7f36a406b250 2023-10-03T10:18:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.558+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a40712e0 con 0x7f36a406b250 2023-10-03T10:18:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.559+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3698013470 con 0x7f36a406b250 2023-10-03T10:18:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.559+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f369803fcf0 con 0x7f36a406b250 2023-10-03T10:18:40.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.559+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a41207e0 con 0x7f36a406b250 2023-10-03T10:18:40.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.564+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3698021020 con 0x7f36a406b250 2023-10-03T10:18:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.597+0000 7ff414a6c700 1 Processor -- start 2023-10-03T10:18:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.597+0000 7ff414a6c700 1 -- start start 2023-10-03T10:18:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.597+0000 7fb944762700 1 Processor -- start 2023-10-03T10:18:40.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.597+0000 7fb944762700 1 -- start start 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff414a6c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff414a6c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff41009f240 0x7ff4101317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff414a6c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410070940 con 0x7ff41009f650 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff414a6c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff41006fd60 con 0x7ff41009f240 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff414a6c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41006fa80 con 0x7ff41009e930 2023-10-03T10:18:40.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff40ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff41009f650 0x7ff410131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57716/0 (socket says 172.21.15.19:57716) 2023-10-03T10:18:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff40ed9d700 1 -- 172.21.15.19:0/4049969199 learned_addr learned my addr 172.21.15.19:0/4049969199 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb944762700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb944762700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/4049969199 >> v2:172.21.15.19:3300/0 conn(0x7ff41009f240 0x7ff4101317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb944762700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c09f130 con 0x7fb93c09d6f0 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb944762700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c09f520 con 0x7fb93c135e50 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb944762700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c09e930 con 0x7fb93c09e1d0 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb941cfd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb942cff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb941cfd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50234/0 (socket says 172.21.15.19:50234) 2023-10-03T10:18:40.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb942cff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51498/0 (socket says 172.21.15.19:51498) 2023-10-03T10:18:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.598+0000 7fb941cfd700 1 -- 172.21.15.19:0/3474543609 learned_addr learned my addr 172.21.15.19:0/3474543609 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40e59c700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40dd9b700 1 -- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 msgr2=0x7ff41009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40dd9b700 1 -- 172.21.15.19:0/4049969199 >> v1:172.21.15.19:6789/0 conn(0x7ff41009f650 legacy=0x7ff410131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40dd9b700 1 -- 172.21.15.19:0/4049969199 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41009fb60 con 0x7ff41009f240 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb941cfd700 1 -- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 msgr2=0x7fb93c138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb941cfd700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb941cfd700 1 -- 172.21.15.19:0/3474543609 >> v1:172.21.15.19:6789/0 conn(0x7fb93c09d6f0 legacy=0x7fb93c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb941cfd700 1 -- 172.21.15.19:0/3474543609 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c09b2d0 con 0x7fb93c09e1d0 2023-10-03T10:18:40.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb942cff700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f240 0x7ff4101317f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff404009840 tx=0x7ff404009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac9edf19b2194820 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7fb941cfd700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00b9d0 tx=0x7fb92c00bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf376980a105dd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40d59a700 1 -- 172.21.15.19:0/4049969199 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011830 con 0x7ff41009f240 2023-10-03T10:18:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40d59a700 1 -- 172.21.15.19:0/4049969199 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff404011990 con 0x7ff41009f240 2023-10-03T10:18:40.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.599+0000 7ff40d59a700 1 -- 172.21.15.19:0/4049969199 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff404011d20 con 0x7ff41009f240 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb9414fc700 1 -- 172.21.15.19:0/3474543609 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00cc60 con 0x7fb93c09e1d0 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb9414fc700 1 -- 172.21.15.19:0/3474543609 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c00cdc0 con 0x7fb93c09e1d0 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb9414fc700 1 -- 172.21.15.19:0/3474543609 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00f680 con 0x7fb93c09e1d0 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 -- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f240 msgr2=0x7ff4101317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f240 0x7ff4101317f0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7ff404009840 tx=0x7ff404009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:40.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 -- 172.21.15.19:0/4049969199 shutdown_connections 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 --2- 172.21.15.19:0/4049969199 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f240 0x7ff4101317f0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 -- 172.21.15.19:0/4049969199 >> 172.21.15.19:0/4049969199 conn(0x7ff4100a4210 msgr2=0x7ff4100a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 -- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 msgr2=0x7fb93c135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb92c00b9d0 tx=0x7fb92c00bce0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7ff414a6c700 1 -- 172.21.15.19:0/4049969199 shutdown_connections 2023-10-03T10:18:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 -- 172.21.15.19:0/3474543609 shutdown_connections 2023-10-03T10:18:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 --2- 172.21.15.19:0/3474543609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c135910 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.600+0000 7fb944762700 1 -- 172.21.15.19:0/3474543609 >> 172.21.15.19:0/3474543609 conn(0x7fb93c066f50 msgr2=0x7fb93c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.601+0000 7ff414a6c700 1 -- 172.21.15.19:0/4049969199 wait complete. 2023-10-03T10:18:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.601+0000 7fb944762700 1 -- 172.21.15.19:0/3474543609 shutdown_connections 2023-10-03T10:18:40.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7fb944762700 1 -- 172.21.15.19:0/3474543609 wait complete. 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 Processor -- start 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 -- start start 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f650 0x7ff41006c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41006cd80 con 0x7ff41009f650 2023-10-03T10:18:40.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101b71f0 con 0x7ff41009e930 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff414a6c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101a93a0 con 0x7ff41009f240 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff40e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff40dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50238/0 (socket says 172.21.15.19:50238) 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff40e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51510/0 (socket says 172.21.15.19:51510) 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.602+0000 7ff40dd9b700 1 -- 172.21.15.19:0/480047801 learned_addr learned my addr 172.21.15.19:0/480047801 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 -- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 msgr2=0x7ff41006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 -- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f650 msgr2=0x7ff41006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f650 0x7ff41006c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 -- 172.21.15.19:0/480047801 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4040094a0 con 0x7ff41009f240 2023-10-03T10:18:40.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7fb944762700 1 Processor -- start 2023-10-03T10:18:40.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7fb944762700 1 -- start start 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff40dd9b700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff4040090b0 tx=0x7ff404004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4040045d0 con 0x7ff41009f240 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40401f070 con 0x7ff41009f240 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4100a0190 con 0x7ff41009f240 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4040038e0 con 0x7ff41009f240 2023-10-03T10:18:40.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.603+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4101a90d0 con 0x7ff41009f240 2023-10-03T10:18:40.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c11a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c1c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c11cf60 con 0x7fb93c09d6f0 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c119ef0 con 0x7fb93c135e50 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb944762700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0a1f20 con 0x7fb93c09e1d0 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45864/0 (socket says 172.21.15.19:45864) 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 -- 172.21.15.19:0/4063731812 learned_addr learned my addr 172.21.15.19:0/4063731812 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 -- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 msgr2=0x7fb93c11a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c11a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 -- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 msgr2=0x7fb93c1c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c1c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.604+0000 7fb9424fe700 1 -- 172.21.15.19:0/4063731812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93400f050 con 0x7fb93c09d6f0 2023-10-03T10:18:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb9424fe700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fb93800c450 tx=0x7fb93800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380052d0 con 0x7fb93c09d6f0 2023-10-03T10:18:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff404003a40 con 0x7ff41009f240 2023-10-03T10:18:40.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb938005430 con 0x7fb93c09d6f0 2023-10-03T10:18:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c00b600 con 0x7fb93c09d6f0 2023-10-03T10:18:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4100a3590 con 0x7ff41009f240 2023-10-03T10:18:40.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff404021070 con 0x7ff41009f240 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9380038c0 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.605+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c11d500 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.606+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb938003a20 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.606+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb93803eb70 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.606+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c11d0d0 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.611+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb938018260 con 0x7fb93c09d6f0 2023-10-03T10:18:40.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.615+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4040253e0 con 0x7ff41009f240 2023-10-03T10:18:40.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.776+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f36a4074ea0 con 0x7f36a406b250 2023-10-03T10:18:40.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.776+0000 7f368bfff700 1 -- 172.21.15.19:0/2379393321 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f369800ce80 con 0x7f36a406b250 2023-10-03T10:18:40.777 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.778+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 msgr2=0x7f36a41c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.778+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f369800ebe0 tx=0x7f369800eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 shutdown_connections 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36a4136d80 0x7f36a411c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36a406a770 0x7f36a41c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 --2- 172.21.15.19:0/2379393321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36a406b250 0x7f36a41c6750 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 >> 172.21.15.19:0/2379393321 conn(0x7f36a4066f50 msgr2=0x7f36a406ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 shutdown_connections 2023-10-03T10:18:40.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.779+0000 7f36a9ac5700 1 -- 172.21.15.19:0/2379393321 wait complete. 2023-10-03T10:18:40.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.820+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb93c0a38a0 con 0x7fb93c09d6f0 2023-10-03T10:18:40.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.821+0000 7fb932ffd700 1 -- 172.21.15.19:0/4063731812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb938017020 con 0x7fb93c09d6f0 2023-10-03T10:18:40.822 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 msgr2=0x7fb93c11a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fb93800c450 tx=0x7fb93800c810 comp rx=0 tx=0).stop 2023-10-03T10:18:40.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 shutdown_connections 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb93c135e50 0x7fb93c1c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb93c09d6f0 0x7fb93c11a320 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 --2- 172.21.15.19:0/4063731812 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb93c09e1d0 0x7fb93c11a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 >> 172.21.15.19:0/4063731812 conn(0x7fb93c066f50 msgr2=0x7fb93c06f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 shutdown_connections 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.824+0000 7fb944762700 1 -- 172.21.15.19:0/4063731812 wait complete. 2023-10-03T10:18:40.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.826+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff4101a0b30 con 0x7ff41009f240 2023-10-03T10:18:40.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.826+0000 7ff3feffd700 1 -- 172.21.15.19:0/480047801 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff404010b70 con 0x7ff41009f240 2023-10-03T10:18:40.827 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 msgr2=0x7ff41006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff4040090b0 tx=0x7ff404004750 comp rx=0 tx=0).stop 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 shutdown_connections 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff41009f650 0x7ff41006c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff41009e930 0x7ff41006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 --2- 172.21.15.19:0/480047801 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff41009f240 0x7ff41006bdf0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 >> 172.21.15.19:0/480047801 conn(0x7ff4100a4210 msgr2=0x7ff4101b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:40.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 shutdown_connections 2023-10-03T10:18:40.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:40.829+0000 7ff414a6c700 1 -- 172.21.15.19:0/480047801 wait complete. 2023-10-03T10:18:40.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:40.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:41.533 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.678+0000 7fc9216a0700 1 Processor -- start 2023-10-03T10:18:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.678+0000 7fc9216a0700 1 -- start start 2023-10-03T10:18:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 0x7fc91c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c0a2a70 con 0x7fc91c0a0a30 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0a01d0 con 0x7fc91c133930 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc9216a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c09e2b0 con 0x7fc91c09d630 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 0x7fc91c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45870/0 (socket says 172.21.15.19:45870) 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51528/0 (socket says 172.21.15.19:51528) 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 0x7fc91c0a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50254/0 (socket says 172.21.15.19:50254) 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91affd700 1 -- 172.21.15.19:0/3414166541 learned_addr learned my addr 172.21.15.19:0/3414166541 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 -- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 msgr2=0x7fc91c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 0x7fc91c0a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 -- 172.21.15.19:0/3414166541 >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 msgr2=0x7fc91c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/3414166541 >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 -- 172.21.15.19:0/3414166541 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c09dc50 con 0x7fc91c133930 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91affd700 1 --2- 172.21.15.19:0/3414166541 >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=192a35365f6ea0b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.679+0000 7fc919ffb700 1 -- 172.21.15.19:0/3414166541 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91400e070 con 0x7fc91c133930 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc919ffb700 1 -- 172.21.15.19:0/3414166541 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400bb20 con 0x7fc91c133930 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc919ffb700 1 -- 172.21.15.19:0/3414166541 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914012430 con 0x7fc91c133930 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 -- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 msgr2=0x7fc91c133db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 --2- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fc914009d90 tx=0x7fc91400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:41.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 -- 172.21.15.19:0/3414166541 shutdown_connections 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 --2- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c133db0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 --2- 172.21.15.19:0/3414166541 >> v2:172.21.15.19:3300/0 conn(0x7fc91c0a0a30 0x7fc91c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 --2- 172.21.15.19:0/3414166541 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c09d630 0x7fc91c0a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 -- 172.21.15.19:0/3414166541 >> 172.21.15.19:0/3414166541 conn(0x7fc91c0a3050 msgr2=0x7fc91c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 -- 172.21.15.19:0/3414166541 shutdown_connections 2023-10-03T10:18:41.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.680+0000 7fc9216a0700 1 -- 172.21.15.19:0/3414166541 wait complete. 2023-10-03T10:18:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.681+0000 7fc9216a0700 1 Processor -- start 2023-10-03T10:18:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.681+0000 7fc9216a0700 1 -- start start 2023-10-03T10:18:41.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 0x7fc91c11ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c11f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c120a40 con 0x7fc91c09d630 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0a0480 con 0x7fc91c133930 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc9216a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1205a0 con 0x7fc91c0a0a30 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 0x7fc91c11ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45882/0 (socket says 172.21.15.19:45882) 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91affd700 1 -- 172.21.15.19:0/2566166825 learned_addr learned my addr 172.21.15.19:0/2566166825 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c11f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 -- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 msgr2=0x7fc91c11ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 0x7fc91c11ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 -- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 msgr2=0x7fc91c11e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91b7fe700 1 -- 172.21.15.19:0/2566166825 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c009550 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91affd700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.682+0000 7fc91a7fc700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 0x7fc91c11ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc91b7fe700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c11f290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc914016000 tx=0x7fc914004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914012430 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc914020070 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc914009a70 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914004280 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.683+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c122050 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.684+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc9140043e0 con 0x7fc91c133930 2023-10-03T10:18:41.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.684+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc914022070 con 0x7fc91c133930 2023-10-03T10:18:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.684+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c120c70 con 0x7fc91c133930 2023-10-03T10:18:41.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.689+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc914004690 con 0x7fc91c133930 2023-10-03T10:18:41.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:41.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:41.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:41.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.894+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc91c0747f0 con 0x7fc91c133930 2023-10-03T10:18:41.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.894+0000 7fc9137fe700 1 -- 172.21.15.19:0/2566166825 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc91402c020 con 0x7fc91c133930 2023-10-03T10:18:41.895 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 msgr2=0x7fc91c11f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c11f290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc914016000 tx=0x7fc914004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 shutdown_connections 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc91c133930 0x7fc91c11f290 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc91c09d630 0x7fc91c11e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 --2- 172.21.15.19:0/2566166825 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc91c0a0a30 0x7fc91c11ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.898+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 >> 172.21.15.19:0/2566166825 conn(0x7fc91c0a3050 msgr2=0x7fc91c1bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.899+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 shutdown_connections 2023-10-03T10:18:41.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.899+0000 7fc9216a0700 1 -- 172.21.15.19:0/2566166825 wait complete. 2023-10-03T10:18:41.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:41.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.936+0000 7f9fed332700 1 Processor -- start 2023-10-03T10:18:41.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.936+0000 7f9fed332700 1 -- start start 2023-10-03T10:18:41.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe81313c0 con 0x7f9fe8099a40 2023-10-03T10:18:41.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806e8c0 con 0x7f9fe8131810 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fed332700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe809a820 con 0x7f9fe809a3b0 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fe67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fe67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45894/0 (socket says 172.21.15.19:45894) 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fe67fc700 1 -- 172.21.15.19:0/3805280418 learned_addr learned my addr 172.21.15.19:0/3805280418 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.937+0000 7f9fe6ffd700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 -- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8131810 msgr2=0x7f9fe8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 -- 172.21.15.19:0/3805280418 >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 msgr2=0x7f9fe8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/3805280418 >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 -- 172.21.15.19:0/3805280418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8071d20 con 0x7f9fe809a3b0 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009d90 tx=0x7f9fe000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd3188a409414141 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe5ffb700 1 -- 172.21.15.19:0/3805280418 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000e070 con 0x7f9fe809a3b0 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe5ffb700 1 -- 172.21.15.19:0/3805280418 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000bb20 con 0x7f9fe809a3b0 2023-10-03T10:18:41.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.938+0000 7f9fe5ffb700 1 -- 172.21.15.19:0/3805280418 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0012430 con 0x7f9fe809a3b0 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 -- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 msgr2=0x7f9fe8138650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0009d90 tx=0x7f9fe000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 -- 172.21.15.19:0/3805280418 shutdown_connections 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8131810 0x7f9fe8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 --2- 172.21.15.19:0/3805280418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe8138650 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 --2- 172.21.15.19:0/3805280418 >> v2:172.21.15.19:3300/0 conn(0x7f9fe8099a40 0x7f9fe8099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 -- 172.21.15.19:0/3805280418 >> 172.21.15.19:0/3805280418 conn(0x7f9fe80a2aa0 msgr2=0x7f9fe80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 -- 172.21.15.19:0/3805280418 shutdown_connections 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.939+0000 7f9fed332700 1 -- 172.21.15.19:0/3805280418 wait complete. 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.940+0000 7f9fed332700 1 Processor -- start 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.940+0000 7f9fed332700 1 -- start start 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8099a40 0x7f9fe806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 0x7f9fe8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe812cb70 con 0x7f9fe8131810 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811ed20 con 0x7f9fe8099a40 2023-10-03T10:18:41.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fed332700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe811e240 con 0x7f9fe809a3b0 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50286/0 (socket says 172.21.15.19:50286) 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe67fc700 1 -- 172.21.15.19:0/1900471432 learned_addr learned my addr 172.21.15.19:0/1900471432 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 0x7f9fe8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe6ffd700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8099a40 0x7f9fe806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 -- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 msgr2=0x7f9fe806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 -- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8099a40 msgr2=0x7f9fe806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8099a40 0x7f9fe806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe77fe700 1 -- 172.21.15.19:0/1900471432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0009a70 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.941+0000 7f9fe67fc700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fe77fe700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 0x7f9fe8070090 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0016000 tx=0x7f9fe0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0012430 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe0020070 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe0004280 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe811efe0 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.942+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80a1ad0 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.943+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe806eb00 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.943+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fe00043e0 con 0x7f9fe8131810 2023-10-03T10:18:41.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.943+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9fe0022070 con 0x7f9fe8131810 2023-10-03T10:18:41.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.948+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fe0004690 con 0x7f9fe8131810 2023-10-03T10:18:41.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.985+0000 7fbce62f7700 1 Processor -- start 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.985+0000 7fbce62f7700 1 -- start start 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbce009e000 0x7fbce01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009e410 0x7fbce0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce006b460 con 0x7fbce009e000 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce009b120 con 0x7fbce009e410 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce62f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce009a7e0 con 0x7fbce009d6f0 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50290/0 (socket says 172.21.15.19:50290) 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 -- 172.21.15.19:0/329332553 learned_addr learned my addr 172.21.15.19:0/329332553 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbce4894700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009e410 0x7fbce0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdf7fe700 1 --2- 172.21.15.19:0/329332553 >> v2:172.21.15.19:3300/0 conn(0x7fbce009e000 0x7fbce01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 -- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009e410 msgr2=0x7fbce0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009e410 0x7fbce0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 -- 172.21.15.19:0/329332553 >> v2:172.21.15.19:3300/0 conn(0x7fbce009e000 msgr2=0x7fbce01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 --2- 172.21.15.19:0/329332553 >> v2:172.21.15.19:3300/0 conn(0x7fbce009e000 0x7fbce01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 -- 172.21.15.19:0/329332553 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce009a500 con 0x7fbce009d6f0 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.986+0000 7fbcdffff700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009920 tx=0x7fbcd0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e690a83aac73c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.987+0000 7fbcdeffd700 1 -- 172.21.15.19:0/329332553 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0011830 con 0x7fbce009d6f0 2023-10-03T10:18:41.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.987+0000 7fbcdeffd700 1 -- 172.21.15.19:0/329332553 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0011990 con 0x7fbce009d6f0 2023-10-03T10:18:41.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.987+0000 7fbcdeffd700 1 -- 172.21.15.19:0/329332553 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0011d20 con 0x7fbce009d6f0 2023-10-03T10:18:41.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 -- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 msgr2=0x7fbce009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbcd0009920 tx=0x7fbcd0009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:41.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 -- 172.21.15.19:0/329332553 shutdown_connections 2023-10-03T10:18:41.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009e410 0x7fbce0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 --2- 172.21.15.19:0/329332553 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009d6f0 0x7fbce009dac0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 --2- 172.21.15.19:0/329332553 >> v2:172.21.15.19:3300/0 conn(0x7fbce009e000 0x7fbce01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 -- 172.21.15.19:0/329332553 >> 172.21.15.19:0/329332553 conn(0x7fbce0066f50 msgr2=0x7fbce009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 -- 172.21.15.19:0/329332553 shutdown_connections 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.988+0000 7fbce62f7700 1 -- 172.21.15.19:0/329332553 wait complete. 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.989+0000 7fbce62f7700 1 Processor -- start 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.989+0000 7fbce62f7700 1 -- start start 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009d6f0 0x7fbce01a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009e410 0x7fbce01a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce01a8150 con 0x7fbce009e000 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce01a92a0 con 0x7fbce009d6f0 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce62f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbce01a7c20 con 0x7fbce009e410 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45930/0 (socket says 172.21.15.19:45930) 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 -- 172.21.15.19:0/660710322 learned_addr learned my addr 172.21.15.19:0/660710322 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdffff700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009d6f0 0x7fbce01a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbce4894700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009e410 0x7fbce01a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 -- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009e410 msgr2=0x7fbce01a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009e410 0x7fbce01a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 -- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009d6f0 msgr2=0x7fbce01a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009d6f0 0x7fbce01a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 -- 172.21.15.19:0/660710322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0009550 con 0x7fbce009e000 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.990+0000 7fbcdf7fe700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400e9e0 tx=0x7fbcd400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.991+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4009710 con 0x7fbce009e000 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.991+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd400ee80 con 0x7fbce009e000 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.991+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce01a8600 con 0x7fbce009e000 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.991+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400ca70 con 0x7fbce009e000 2023-10-03T10:18:41.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.991+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce00a2100 con 0x7fbce009e000 2023-10-03T10:18:41.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.992+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce0074ea0 con 0x7fbce009e000 2023-10-03T10:18:41.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.992+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcd400cbd0 con 0x7fbce009e000 2023-10-03T10:18:41.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.992+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcd403f6d0 con 0x7fbce009e000 2023-10-03T10:18:41.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:41.997+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcd4013470 con 0x7fbce009e000 2023-10-03T10:18:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.042+0000 7f9eb8470700 1 Processor -- start 2023-10-03T10:18:42.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.042+0000 7f9eb8470700 1 -- start start 2023-10-03T10:18:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb8470700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb8470700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 0x7f9eb00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb8470700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb00a2a70 con 0x7f9eb0133930 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb8470700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb00a01d0 con 0x7f9eb00a0a30 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb8470700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb009e2b0 con 0x7f9eb009d630 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb6a0d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9eb0133930 0x7f9eb0133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57726/0 (socket says 172.21.15.19:57726) 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb6a0d700 1 -- 172.21.15.19:0/2928286548 learned_addr learned my addr 172.21.15.19:0/2928286548 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.043+0000 7f9eb620c700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb5a0b700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 0x7f9eb00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb520a700 1 -- 172.21.15.19:0/2928286548 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373762285 0 0) 0x7f9eb00a2a70 con 0x7f9eb0133930 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb520a700 1 -- 172.21.15.19:0/2928286548 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c0035b0 con 0x7f9eb0133930 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb620c700 1 -- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 msgr2=0x7f9eb00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb620c700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 0x7f9eb00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb620c700 1 -- 172.21.15.19:0/2928286548 >> v1:172.21.15.19:6789/0 conn(0x7f9eb0133930 legacy=0x7f9eb0133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb620c700 1 -- 172.21.15.19:0/2928286548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb009dc50 con 0x7f9eb00a0a30 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb5a0b700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 0x7f9eb00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb620c700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb00a0e00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009dc0 tx=0x7f9eac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1385d896a285f4ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb520a700 1 -- 172.21.15.19:0/2928286548 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00e070 con 0x7f9eb00a0a30 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb520a700 1 -- 172.21.15.19:0/2928286548 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac00bb20 con 0x7f9eb00a0a30 2023-10-03T10:18:42.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.044+0000 7f9eb520a700 1 -- 172.21.15.19:0/2928286548 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac012430 con 0x7f9eb00a0a30 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 -- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 msgr2=0x7f9eb00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb00a0e00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009dc0 tx=0x7f9eac00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 -- 172.21.15.19:0/2928286548 shutdown_connections 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb00a0e00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 --2- 172.21.15.19:0/2928286548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb009d630 0x7f9eb00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 -- 172.21.15.19:0/2928286548 >> 172.21.15.19:0/2928286548 conn(0x7f9eb00a3050 msgr2=0x7f9eb00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 -- 172.21.15.19:0/2928286548 shutdown_connections 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.045+0000 7f9eb8470700 1 -- 172.21.15.19:0/2928286548 wait complete. 2023-10-03T10:18:42.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.046+0000 7f9eb8470700 1 Processor -- start 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.046+0000 7f9eb8470700 1 -- start start 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb011f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 0x7f9eb01c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb011ed60 con 0x7f9eb009d630 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01224a0 con 0x7f9eb00a0a30 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb8470700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0120490 con 0x7f9eb0133930 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb620c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb620c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45936/0 (socket says 172.21.15.19:45936) 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb620c700 1 -- 172.21.15.19:0/578238088 learned_addr learned my addr 172.21.15.19:0/578238088 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:42.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 0x7f9eb01c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb5a0b700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb011f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 -- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 msgr2=0x7f9eb011f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb011f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 -- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 msgr2=0x7f9eb011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb6a0d700 1 -- 172.21.15.19:0/578238088 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea00094a0 con 0x7f9eb0133930 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.047+0000 7f9eb620c700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9eb6a0d700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 0x7f9eb01c7e80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800c400 tx=0x7f9ea800c710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8005d70 con 0x7f9eb0133930 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80070d0 con 0x7f9eb0133930 2023-10-03T10:18:42.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea8007440 con 0x7f9eb0133930 2023-10-03T10:18:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac009a70 con 0x7f9eb0133930 2023-10-03T10:18:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.048+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb00a0410 con 0x7f9eb0133930 2023-10-03T10:18:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.049+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9ea80075a0 con 0x7f9eb0133930 2023-10-03T10:18:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.049+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9ea803ea40 con 0x7f9eb0133930 2023-10-03T10:18:42.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.049+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb011fd60 con 0x7f9eb0133930 2023-10-03T10:18:42.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.054+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9ea8019b40 con 0x7f9eb0133930 2023-10-03T10:18:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.161+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9fe8074ea0 con 0x7f9fe8131810 2023-10-03T10:18:42.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.162+0000 7f9fcf7fe700 1 -- 172.21.15.19:0/1900471432 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fe00263e0 con 0x7f9fe8131810 2023-10-03T10:18:42.163 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 msgr2=0x7f9fe8070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 0x7f9fe8070090 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0016000 tx=0x7f9fe0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 shutdown_connections 2023-10-03T10:18:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fe8131810 0x7f9fe8070090 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fe8099a40 0x7f9fe806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 --2- 172.21.15.19:0/1900471432 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fe809a3b0 0x7f9fe806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 >> 172.21.15.19:0/1900471432 conn(0x7f9fe80a2aa0 msgr2=0x7f9fe812e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 shutdown_connections 2023-10-03T10:18:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.164+0000 7f9fed332700 1 -- 172.21.15.19:0/1900471432 wait complete. 2023-10-03T10:18:42.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:42.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.223+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbce01a89a0 con 0x7fbce009e000 2023-10-03T10:18:42.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.224+0000 7fbcdcff9700 1 -- 172.21.15.19:0/660710322 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcd4021030 con 0x7fbce009e000 2023-10-03T10:18:42.225 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 msgr2=0x7fbce01a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400e9e0 tx=0x7fbcd400ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 shutdown_connections 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbce009e410 0x7fbce01a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbce009d6f0 0x7fbce01a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 --2- 172.21.15.19:0/660710322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbce009e000 0x7fbce01a5390 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 >> 172.21.15.19:0/660710322 conn(0x7fbce0066f50 msgr2=0x7fbce01bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 shutdown_connections 2023-10-03T10:18:42.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.226+0000 7fbce62f7700 1 -- 172.21.15.19:0/660710322 wait complete. 2023-10-03T10:18:42.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:42.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.258+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9eb01222e0 con 0x7f9eb0133930 2023-10-03T10:18:42.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.259+0000 7f9ea6ffd700 1 -- 172.21.15.19:0/578238088 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9eb01222e0 con 0x7f9eb0133930 2023-10-03T10:18:42.260 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:42.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 msgr2=0x7f9eb01c7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:42.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 0x7f9eb01c7e80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800c400 tx=0x7f9ea800c710 comp rx=0 tx=0).stop 2023-10-03T10:18:42.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 shutdown_connections 2023-10-03T10:18:42.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9eb0133930 0x7f9eb01c7e80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9eb009d630 0x7f9eb011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 --2- 172.21.15.19:0/578238088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9eb00a0a30 0x7f9eb011f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:42.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 >> 172.21.15.19:0/578238088 conn(0x7f9eb00a3050 msgr2=0x7f9eb01bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:42.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 shutdown_connections 2023-10-03T10:18:42.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:42.261+0000 7f9eb8470700 1 -- 172.21.15.19:0/578238088 wait complete. 2023-10-03T10:18:42.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:42.918 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 Processor -- start 2023-10-03T10:18:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 -- start start 2023-10-03T10:18:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 0x7f4194130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419409c190 con 0x7f419409d6f0 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419409b090 con 0x7f4194130750 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.064+0000 7f4199743700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419409a6c0 con 0x7f419409e250 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41927fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f419409d6f0 0x7f419409db40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57738/0 (socket says 172.21.15.19:57738) 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50322/0 (socket says 172.21.15.19:50322) 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41927fc700 1 -- 172.21.15.19:0/3438898884 learned_addr learned my addr 172.21.15.19:0/3438898884 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4192ffd700 1 --2- 172.21.15.19:0/3438898884 >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 0x7f4194130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 -- 172.21.15.19:0/3438898884 >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 msgr2=0x7f4194130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 --2- 172.21.15.19:0/3438898884 >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 0x7f4194130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 -- 172.21.15.19:0/3438898884 >> v1:172.21.15.19:6789/0 conn(0x7f419409d6f0 legacy=0x7f419409db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4191ffb700 1 -- 172.21.15.19:0/3438898884 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850455476 0 0) 0x7f419409c190 con 0x7f419409d6f0 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 -- 172.21.15.19:0/3438898884 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194131060 con 0x7f419409e250 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4192ffd700 1 --2- 172.21.15.19:0/3438898884 >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 0x7f4194130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f41937fe700 1 --2- 172.21.15.19:0/3438898884 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f418c009d90 tx=0x7f418c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cd0c0fde71a851a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4191ffb700 1 -- 172.21.15.19:0/3438898884 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00e070 con 0x7f419409e250 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4191ffb700 1 -- 172.21.15.19:0/3438898884 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00bb20 con 0x7f419409e250 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.065+0000 7f4191ffb700 1 -- 172.21.15.19:0/3438898884 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c012430 con 0x7f419409e250 2023-10-03T10:18:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 -- 172.21.15.19:0/3438898884 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 msgr2=0x7f41941384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 --2- 172.21.15.19:0/3438898884 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f418c009d90 tx=0x7f418c00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 -- 172.21.15.19:0/3438898884 shutdown_connections 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 --2- 172.21.15.19:0/3438898884 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f419409e250 0x7f41941384c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 --2- 172.21.15.19:0/3438898884 >> v2:172.21.15.19:3300/0 conn(0x7f4194130750 0x7f4194130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 -- 172.21.15.19:0/3438898884 >> 172.21.15.19:0/3438898884 conn(0x7f419409f470 msgr2=0x7f41940a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 -- 172.21.15.19:0/3438898884 shutdown_connections 2023-10-03T10:18:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.066+0000 7f4199743700 1 -- 172.21.15.19:0/3438898884 wait complete. 2023-10-03T10:18:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.067+0000 7f4199743700 1 Processor -- start 2023-10-03T10:18:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.067+0000 7f4199743700 1 -- start start 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 0x7f419412d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419408b730 con 0x7f419409e250 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419409d040 con 0x7f419409d6f0 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4199743700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f419412e050 con 0x7f4194130750 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4192ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4192ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51602/0 (socket says 172.21.15.19:51602) 2023-10-03T10:18:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50332/0 (socket says 172.21.15.19:50332) 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4192ffd700 1 -- 172.21.15.19:0/2568643030 learned_addr learned my addr 172.21.15.19:0/2568643030 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41927fc700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 0x7f419412d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 -- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 msgr2=0x7f419412cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 -- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 msgr2=0x7f419412d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 0x7f419412d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 -- 172.21.15.19:0/2568643030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418400ba70 con 0x7f4194130750 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f4192ffd700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41927fc700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 0x7f419412d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.068+0000 7f41937fe700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f418c016000 tx=0x7f418c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c012430 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c020070 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c009a70 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c004280 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419412e870 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.069+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f418c0043e0 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.070+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f418c022070 con 0x7f4194130750 2023-10-03T10:18:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.070+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419408b0f0 con 0x7f4194130750 2023-10-03T10:18:43.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.075+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f419408b0f0 con 0x7f4194130750 2023-10-03T10:18:43.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:43.241 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:43.276 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:43.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.283+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f419408b0f0 con 0x7f4194130750 2023-10-03T10:18:43.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.284+0000 7f418b7fe700 1 -- 172.21.15.19:0/2568643030 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f419408b0f0 con 0x7f4194130750 2023-10-03T10:18:43.285 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:43.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 msgr2=0x7f419412d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f418c016000 tx=0x7f418c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 shutdown_connections 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4194130750 0x7f419412d6e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f419409d6f0 0x7f419412cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 --2- 172.21.15.19:0/2568643030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f419409e250 0x7f419412d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 >> 172.21.15.19:0/2568643030 conn(0x7f419409f470 msgr2=0x7f4194098650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.286+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 shutdown_connections 2023-10-03T10:18:43.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.287+0000 7f4199743700 1 -- 172.21.15.19:0/2568643030 wait complete. 2023-10-03T10:18:43.305 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:43.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.319+0000 7f9160114700 1 Processor -- start 2023-10-03T10:18:43.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.320+0000 7f9160114700 1 -- start start 2023-10-03T10:18:43.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.320+0000 7f9160114700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 0x7f9158131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.320+0000 7f9160114700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 0x7f9158139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f9160114700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f915809e130 con 0x7f915809d9f0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f9160114700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91581312b0 con 0x7f91581316c0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f9160114700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f915809f6e0 con 0x7f915806ae80 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915d6af700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f915809d9f0 0x7f915806a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57740/0 (socket says 172.21.15.19:57740) 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915d6af700 1 -- 172.21.15.19:0/4051542979 learned_addr learned my addr 172.21.15.19:0/4051542979 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 --2- 172.21.15.19:0/4051542979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 0x7f9158139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915deb0700 1 --2- 172.21.15.19:0/4051542979 >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 0x7f9158131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915ceae700 1 -- 172.21.15.19:0/4051542979 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652787400 0 0) 0x7f9148001110 con 0x7f915809d9f0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915ceae700 1 -- 172.21.15.19:0/4051542979 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91440035b0 con 0x7f915809d9f0 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 -- 172.21.15.19:0/4051542979 >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 msgr2=0x7f9158131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 --2- 172.21.15.19:0/4051542979 >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 0x7f9158131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 -- 172.21.15.19:0/4051542979 >> v1:172.21.15.19:6789/0 conn(0x7f915809d9f0 legacy=0x7f915806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 -- 172.21.15.19:0/4051542979 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915809e760 con 0x7f915806ae80 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915deb0700 1 --2- 172.21.15.19:0/4051542979 >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 0x7f9158131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.321+0000 7f915e6b1700 1 --2- 172.21.15.19:0/4051542979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 0x7f9158139550 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9150009d90 tx=0x7f915000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=101ac13fd89feeac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.322+0000 7f915ceae700 1 -- 172.21.15.19:0/4051542979 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915000e070 con 0x7f915806ae80 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.322+0000 7f915ceae700 1 -- 172.21.15.19:0/4051542979 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f915000bb20 con 0x7f915806ae80 2023-10-03T10:18:43.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.322+0000 7f915ceae700 1 -- 172.21.15.19:0/4051542979 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9150012430 con 0x7f915806ae80 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 -- 172.21.15.19:0/4051542979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 msgr2=0x7f9158139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 --2- 172.21.15.19:0/4051542979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 0x7f9158139550 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9150009d90 tx=0x7f915000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 -- 172.21.15.19:0/4051542979 shutdown_connections 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 --2- 172.21.15.19:0/4051542979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915806ae80 0x7f9158139550 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 --2- 172.21.15.19:0/4051542979 >> v2:172.21.15.19:3300/0 conn(0x7f91581316c0 0x7f9158131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 -- 172.21.15.19:0/4051542979 >> 172.21.15.19:0/4051542979 conn(0x7f9158066f50 msgr2=0x7f915809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 -- 172.21.15.19:0/4051542979 shutdown_connections 2023-10-03T10:18:43.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.323+0000 7f9160114700 1 -- 172.21.15.19:0/4051542979 wait complete. 2023-10-03T10:18:43.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.324+0000 7f9160114700 1 Processor -- start 2023-10-03T10:18:43.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.324+0000 7f9160114700 1 -- start start 2023-10-03T10:18:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915809d9f0 0x7f915809a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91581316c0 0x7f915809ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915811f690 con 0x7f915806ae80 2023-10-03T10:18:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915809b7d0 con 0x7f91581316c0 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f9160114700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f915812b430 con 0x7f915809d9f0 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f915deb0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f915d6af700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915809d9f0 0x7f915809a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f915deb0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45984/0 (socket says 172.21.15.19:45984) 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.325+0000 7f915deb0700 1 -- 172.21.15.19:0/25551732 learned_addr learned my addr 172.21.15.19:0/25551732 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 -- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915809d9f0 msgr2=0x7f915809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915809d9f0 0x7f915809a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 -- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91581316c0 msgr2=0x7f915809ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91581316c0 0x7f915809ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 -- 172.21.15.19:0/25551732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009a70 con 0x7f915806ae80 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f915deb0700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f915400e810 tx=0x7f915400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154013610 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9154013770 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9158120090 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9154013b20 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.326+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915811fa10 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.327+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9154013c80 con 0x7f915806ae80 2023-10-03T10:18:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.327+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f915403f4e0 con 0x7f915806ae80 2023-10-03T10:18:43.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.327+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915812b030 con 0x7f915806ae80 2023-10-03T10:18:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.332+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f915812b030 con 0x7f915806ae80 2023-10-03T10:18:43.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.390+0000 7f0367906700 1 Processor -- start 2023-10-03T10:18:43.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.390+0000 7f0367906700 1 -- start start 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0367906700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 0x7f036009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0367906700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f036009e000 0x7f03601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0367906700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036009b120 con 0x7f036009e410 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0367906700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036006b460 con 0x7f036009e000 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0367906700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f036009a7e0 con 0x7f036009d6f0 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f03656a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 0x7f036009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f036009e000 0x7f03601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f036009e000 0x7f03601339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45994/0 (socket says 172.21.15.19:45994) 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f03656a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 0x7f036009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50352/0 (socket says 172.21.15.19:50352) 2023-10-03T10:18:43.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 -- 172.21.15.19:0/129939272 learned_addr learned my addr 172.21.15.19:0/129939272 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 -- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 msgr2=0x7f036009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 --2- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 0x7f036009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 -- 172.21.15.19:0/129939272 >> v1:172.21.15.19:6789/0 conn(0x7f036009e410 legacy=0x7f0360133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.391+0000 7f0364ea1700 1 -- 172.21.15.19:0/129939272 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036009a500 con 0x7f036009e000 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.392+0000 7f0364ea1700 1 --2- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009e000 0x7f03601339f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f03500098f0 tx=0x7f0350009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbdb98fa4ce1bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.392+0000 7f0357fff700 1 -- 172.21.15.19:0/129939272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350011830 con 0x7f036009e000 2023-10-03T10:18:43.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.392+0000 7f0357fff700 1 -- 172.21.15.19:0/129939272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0350011990 con 0x7f036009e000 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.392+0000 7f0357fff700 1 -- 172.21.15.19:0/129939272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0350011d20 con 0x7f036009e000 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.392+0000 7f0367906700 1 -- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009e000 msgr2=0x7f03601339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 --2- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009e000 0x7f03601339f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f03500098f0 tx=0x7f0350009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 -- 172.21.15.19:0/129939272 shutdown_connections 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 --2- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009d6f0 0x7f036009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 --2- 172.21.15.19:0/129939272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009e000 0x7f03601339f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 -- 172.21.15.19:0/129939272 >> 172.21.15.19:0/129939272 conn(0x7f0360066f50 msgr2=0x7f036009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 -- 172.21.15.19:0/129939272 shutdown_connections 2023-10-03T10:18:43.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.393+0000 7f0367906700 1 -- 172.21.15.19:0/129939272 wait complete. 2023-10-03T10:18:43.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 Processor -- start 2023-10-03T10:18:43.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 -- start start 2023-10-03T10:18:43.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 0x7f03601a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f036009e000 0x7f03601a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 0x7f03601a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601a91f0 con 0x7f036009d6f0 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036009c710 con 0x7f036009e000 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f0367906700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03600a3160 con 0x7f036009e410 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f03656a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 0x7f03601a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f03656a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 0x7f03601a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45996/0 (socket says 172.21.15.19:45996) 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.394+0000 7f03656a2700 1 -- 172.21.15.19:0/2091944171 learned_addr learned my addr 172.21.15.19:0/2091944171 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 0x7f03601a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0364ea1700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f036009e000 0x7f03601a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 -- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f036009e000 msgr2=0x7f03601a6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f036009e000 0x7f03601a6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 -- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 msgr2=0x7f03601a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 0x7f03601a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 -- 172.21.15.19:0/2091944171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0350009550 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0365ea3700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 0x7f03601a6a50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f035800cb90 tx=0x7f035800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358003c00 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0358003d60 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035800aa80 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.395+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03601a7b50 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.396+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03601a9f60 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.396+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f035800abe0 con 0x7f036009e410 2023-10-03T10:18:43.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.397+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f035803f530 con 0x7f036009e410 2023-10-03T10:18:43.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.397+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360074ea0 con 0x7f036009e410 2023-10-03T10:18:43.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.402+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03580198f0 con 0x7f036009e410 2023-10-03T10:18:43.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 Processor -- start 2023-10-03T10:18:43.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 -- start start 2023-10-03T10:18:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd00139250 0x7fbd0013b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd0009edd0 con 0x7fbd000a0a30 2023-10-03T10:18:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000a18e0 con 0x7fbd000a1510 2023-10-03T10:18:43.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.431+0000 7fbd07132700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0009e1f0 con 0x7fbd00139250 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51630/0 (socket says 172.21.15.19:51630) 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 -- 172.21.15.19:0/2495353725 learned_addr learned my addr 172.21.15.19:0/2495353725 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbd056cf700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd00139250 0x7fbd0013b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 -- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd00139250 msgr2=0x7fbd0013b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd00139250 0x7fbd0013b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 -- 172.21.15.19:0/2495353725 >> v1:172.21.15.19:6789/0 conn(0x7fbd000a0a30 legacy=0x7fbd000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 -- 172.21.15.19:0/2495353725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0009dc50 con 0x7fbd000a1510 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcfffff700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009920 tx=0x7fbcf4009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd1094fac354c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcff7fe700 1 -- 172.21.15.19:0/2495353725 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf400ba60 con 0x7fbd000a1510 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcff7fe700 1 -- 172.21.15.19:0/2495353725 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf400bbc0 con 0x7fbd000a1510 2023-10-03T10:18:43.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.432+0000 7fbcff7fe700 1 -- 172.21.15.19:0/2495353725 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4009e70 con 0x7fbd000a1510 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 -- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 msgr2=0x7fbd00138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009920 tx=0x7fbcf4009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 -- 172.21.15.19:0/2495353725 shutdown_connections 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd00139250 0x7fbd0013b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 --2- 172.21.15.19:0/2495353725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a1510 0x7fbd00138d10 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 -- 172.21.15.19:0/2495353725 >> 172.21.15.19:0/2495353725 conn(0x7fbd000a6550 msgr2=0x7fbd000a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 -- 172.21.15.19:0/2495353725 shutdown_connections 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.433+0000 7fbd07132700 1 -- 172.21.15.19:0/2495353725 wait complete. 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.434+0000 7fbd07132700 1 Processor -- start 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.434+0000 7fbd07132700 1 -- start start 2023-10-03T10:18:43.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a0a30 0x7fbd001c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 0x7fbd001c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd001252a0 con 0x7fbd00139250 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000a0220 con 0x7fbd000a0a30 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd07132700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd00123590 con 0x7fbd000a1510 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50382/0 (socket says 172.21.15.19:50382) 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 -- 172.21.15.19:0/1746222296 learned_addr learned my addr 172.21.15.19:0/1746222296 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd056cf700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 0x7fbd001c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbd04ece700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a0a30 0x7fbd001c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 -- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a0a30 msgr2=0x7fbd001c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a0a30 0x7fbd001c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 -- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 msgr2=0x7fbd001c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 0x7fbd001c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.435+0000 7fbcfffff700 1 -- 172.21.15.19:0/1746222296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf4009550 con 0x7fbd000a1510 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbd056cf700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 0x7fbd001c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbcfffff700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40098f0 tx=0x7fbcf4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4004550 con 0x7fbd000a1510 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf40036a0 con 0x7fbd000a1510 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4003a50 con 0x7fbd000a1510 2023-10-03T10:18:43.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd00138c40 con 0x7fbd000a1510 2023-10-03T10:18:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.436+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd00124200 con 0x7fbd000a1510 2023-10-03T10:18:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.437+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcf4021020 con 0x7fbd000a1510 2023-10-03T10:18:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.437+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcf4040890 con 0x7fbd000a1510 2023-10-03T10:18:43.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.437+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00124f60 con 0x7fbd000a1510 2023-10-03T10:18:43.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.442+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd00124f60 con 0x7fbd000a1510 2023-10-03T10:18:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.586+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f915812b030 con 0x7f915806ae80 2023-10-03T10:18:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.587+0000 7f914e7fc700 1 -- 172.21.15.19:0/25551732 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f915812b030 con 0x7f915806ae80 2023-10-03T10:18:43.588 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 msgr2=0x7f915809a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f915400e810 tx=0x7f915400eb20 comp rx=0 tx=0).stop 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 shutdown_connections 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91581316c0 0x7f915809ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f915806ae80 0x7f915809a400 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 --2- 172.21.15.19:0/25551732 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f915809d9f0 0x7f915809a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 >> 172.21.15.19:0/25551732 conn(0x7f9158066f50 msgr2=0x7f915812e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 shutdown_connections 2023-10-03T10:18:43.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.589+0000 7f9160114700 1 -- 172.21.15.19:0/25551732 wait complete. 2023-10-03T10:18:43.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:43.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.650+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd00074ea0 con 0x7fbd000a1510 2023-10-03T10:18:43.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.650+0000 7fbcfd7fa700 1 -- 172.21.15.19:0/1746222296 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcf4029020 con 0x7fbd000a1510 2023-10-03T10:18:43.651 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:43.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.652+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f036006c360 con 0x7f036009e410 2023-10-03T10:18:43.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.652+0000 7f0355ffb700 1 -- 172.21.15.19:0/2091944171 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0358019300 con 0x7f036009e410 2023-10-03T10:18:43.653 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.652+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 msgr2=0x7fbd001c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.652+0000 7fbd07132700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbcf40098f0 tx=0x7fbcf4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 shutdown_connections 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd00139250 0x7fbd001c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd000a0a30 0x7fbd001c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 --2- 172.21.15.19:0/1746222296 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd000a1510 0x7fbd001c89f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 >> 172.21.15.19:0/1746222296 conn(0x7fbd000a6550 msgr2=0x7fbd00137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 shutdown_connections 2023-10-03T10:18:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.653+0000 7fbd07132700 1 -- 172.21.15.19:0/1746222296 wait complete. 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 msgr2=0x7f03601a6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 0x7f03601a6a50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f035800cb90 tx=0x7f035800cea0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 shutdown_connections 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f036009e410 0x7f03601a6a50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f036009d6f0 0x7f03601a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 --2- 172.21.15.19:0/2091944171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f036009e000 0x7f03601a6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.654+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 >> 172.21.15.19:0/2091944171 conn(0x7f0360066f50 msgr2=0x7f03601baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.655+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 shutdown_connections 2023-10-03T10:18:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:43.655+0000 7f0367906700 1 -- 172.21.15.19:0/2091944171 wait complete. 2023-10-03T10:18:43.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:43.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:44.306 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.450+0000 7fd3c8229700 1 Processor -- start 2023-10-03T10:18:44.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.450+0000 7fd3c8229700 1 -- start start 2023-10-03T10:18:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c8229700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 0x7fd3c012f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c8229700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 0x7fd3c012fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c8229700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c009a510 con 0x7fd3c012cff0 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c8229700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c012c7d0 con 0x7fd3c012c2f0 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c8229700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c009c190 con 0x7fd3c012cc20 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c57c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 0x7fd3c012fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c5fc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 0x7fd3c012f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c67c6700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd3c012cff0 0x7fd3c0136cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57772/0 (socket says 172.21.15.19:57772) 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c67c6700 1 -- 172.21.15.19:0/2667838194 learned_addr learned my addr 172.21.15.19:0/2667838194 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c5fc5700 1 -- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 msgr2=0x7fd3c012fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c5fc5700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 0x7fd3c012fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c5fc5700 1 -- 172.21.15.19:0/2667838194 >> v1:172.21.15.19:6789/0 conn(0x7fd3c012cff0 legacy=0x7fd3c0136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c4fc3700 1 -- 172.21.15.19:0/2667838194 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474080922 0 0) 0x7fd3c009a510 con 0x7fd3c012cff0 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c5fc5700 1 -- 172.21.15.19:0/2667838194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c009b540 con 0x7fd3c012cc20 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.451+0000 7fd3c57c4700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 0x7fd3c012fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c5fc5700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 0x7fd3c012f930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8f9c45387ace9b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c4fc3700 1 -- 172.21.15.19:0/2667838194 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011830 con 0x7fd3c012cc20 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c4fc3700 1 -- 172.21.15.19:0/2667838194 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc011990 con 0x7fd3c012cc20 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c4fc3700 1 -- 172.21.15.19:0/2667838194 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc011d20 con 0x7fd3c012cc20 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 -- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 msgr2=0x7fd3c012f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 0x7fd3c012f930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009870 tx=0x7fd3bc009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 -- 172.21.15.19:0/2667838194 shutdown_connections 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012cc20 0x7fd3c012f930 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 --2- 172.21.15.19:0/2667838194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012c2f0 0x7fd3c012fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.452+0000 7fd3c8229700 1 -- 172.21.15.19:0/2667838194 >> 172.21.15.19:0/2667838194 conn(0x7fd3c009f470 msgr2=0x7fd3c00a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.453+0000 7fd3c8229700 1 -- 172.21.15.19:0/2667838194 shutdown_connections 2023-10-03T10:18:44.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.453+0000 7fd3c8229700 1 -- 172.21.15.19:0/2667838194 wait complete. 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.453+0000 7fd3c8229700 1 Processor -- start 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 -- start start 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 0x7fd3c013af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0139980 con 0x7fd3c012cc20 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c012a020 con 0x7fd3c012cff0 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c8229700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c006ea40 con 0x7fd3c012c2f0 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c5fc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c67c6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 0x7fd3c013af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46020/0 (socket says 172.21.15.19:46020) 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c5fc5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50394/0 (socket says 172.21.15.19:50394) 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 -- 172.21.15.19:0/1353719835 learned_addr learned my addr 172.21.15.19:0/1353719835 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 -- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 msgr2=0x7fd3c013a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 -- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 msgr2=0x7fd3c013af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 0x7fd3c013af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c57c4700 1 -- 172.21.15.19:0/1353719835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b40094a0 con 0x7fd3c012cc20 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c5fc5700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.454+0000 7fd3c67c6700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 0x7fd3c013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3c57c4700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ebb0 tx=0x7fd3b400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400c850 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400c9b0 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400cd40 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0094a0 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.455+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c006fa80 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.456+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3b4013470 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.456+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3b403f760 con 0x7fd3c012cc20 2023-10-03T10:18:44.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.456+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c00747f0 con 0x7fd3c012cc20 2023-10-03T10:18:44.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.461+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3b40232f0 con 0x7fd3c012cc20 2023-10-03T10:18:44.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:44.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:44.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.670+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd3c006f700 con 0x7fd3c012cc20 2023-10-03T10:18:44.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:44.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.670+0000 7fd3b27fc700 1 -- 172.21.15.19:0/1353719835 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3b4021030 con 0x7fd3c012cc20 2023-10-03T10:18:44.673 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 msgr2=0x7fd3c013aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400ebb0 tx=0x7fd3b400eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 shutdown_connections 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c012cff0 0x7fd3c013af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c012c2f0 0x7fd3c013a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 --2- 172.21.15.19:0/1353719835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c012cc20 0x7fd3c013aa40 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 >> 172.21.15.19:0/1353719835 conn(0x7fd3c009f470 msgr2=0x7fd3c00992c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 shutdown_connections 2023-10-03T10:18:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.673+0000 7fd3c8229700 1 -- 172.21.15.19:0/1353719835 wait complete. 2023-10-03T10:18:44.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.749+0000 7f20dd81f700 1 Processor -- start 2023-10-03T10:18:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.749+0000 7f20dd81f700 1 -- start start 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20dd81f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 0x7f20d8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20dd81f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 0x7f20d813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20dd81f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d806ef30 con 0x7f20d81338a0 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20dd81f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d806fef0 con 0x7f20d8136710 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20dd81f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d81334b0 con 0x7f20d8139030 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20d67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 0x7f20d8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20d6ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f20d81338a0 0x7f20d8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57780/0 (socket says 172.21.15.19:57780) 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20d6ffd700 1 -- 172.21.15.19:0/682721314 learned_addr learned my addr 172.21.15.19:0/682721314 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.750+0000 7f20d77fe700 1 --2- 172.21.15.19:0/682721314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 0x7f20d813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d77fe700 1 -- 172.21.15.19:0/682721314 >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 msgr2=0x7f20d8138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d77fe700 1 --2- 172.21.15.19:0/682721314 >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 0x7f20d8138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d77fe700 1 -- 172.21.15.19:0/682721314 >> v1:172.21.15.19:6789/0 conn(0x7f20d81338a0 legacy=0x7f20d8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d77fe700 1 -- 172.21.15.19:0/682721314 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d806fc30 con 0x7f20d8139030 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d5ffb700 1 -- 172.21.15.19:0/682721314 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933208400 0 0) 0x7f20d806ef30 con 0x7f20d81338a0 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d67fc700 1 --2- 172.21.15.19:0/682721314 >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 0x7f20d8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d77fe700 1 --2- 172.21.15.19:0/682721314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 0x7f20d813b410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d90 tx=0x7f20d000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=524532b930f6af76 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d5ffb700 1 -- 172.21.15.19:0/682721314 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d000e070 con 0x7f20d8139030 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d5ffb700 1 -- 172.21.15.19:0/682721314 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d000bb20 con 0x7f20d8139030 2023-10-03T10:18:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.751+0000 7f20d5ffb700 1 -- 172.21.15.19:0/682721314 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d0012430 con 0x7f20d8139030 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 -- 172.21.15.19:0/682721314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 msgr2=0x7f20d813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 --2- 172.21.15.19:0/682721314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 0x7f20d813b410 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009d90 tx=0x7f20d000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 -- 172.21.15.19:0/682721314 shutdown_connections 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 --2- 172.21.15.19:0/682721314 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8139030 0x7f20d813b410 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 --2- 172.21.15.19:0/682721314 >> v2:172.21.15.19:3300/0 conn(0x7f20d8136710 0x7f20d8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 -- 172.21.15.19:0/682721314 >> 172.21.15.19:0/682721314 conn(0x7f20d80a2aa0 msgr2=0x7f20d80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 -- 172.21.15.19:0/682721314 shutdown_connections 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.752+0000 7f20dd81f700 1 -- 172.21.15.19:0/682721314 wait complete. 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.753+0000 7f20dd81f700 1 Processor -- start 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.753+0000 7f20dd81f700 1 -- start start 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20d81338a0 0x7f20d811ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 0x7f20d811b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d811e760 con 0x7f20d8139030 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d811de50 con 0x7f20d81338a0 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20dd81f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20d806f640 con 0x7f20d8136710 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50426/0 (socket says 172.21.15.19:50426) 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 -- 172.21.15.19:0/2264551048 learned_addr learned my addr 172.21.15.19:0/2264551048 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:44.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d77fe700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 0x7f20d811b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 -- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20d81338a0 msgr2=0x7f20d811ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20d81338a0 0x7f20d811ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 -- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 msgr2=0x7f20d811b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 0x7f20d811b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 -- 172.21.15.19:0/2264551048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc0094a0 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d77fe700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 0x7f20d811b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.754+0000 7f20d67fc700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00ec10 tx=0x7f20cc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.755+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00c910 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.755+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20cc00ca70 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.755+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20cc00cde0 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.755+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d0009a70 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.755+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d811cf60 con 0x7f20d8136710 2023-10-03T10:18:44.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.756+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f20cc013470 con 0x7f20d8136710 2023-10-03T10:18:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.756+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d8074ea0 con 0x7f20d8136710 2023-10-03T10:18:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.756+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f20cc03fbe0 con 0x7f20d8136710 2023-10-03T10:18:44.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.761+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f20cc01b3b0 con 0x7f20d8136710 2023-10-03T10:18:44.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.815+0000 7fd19ed80700 1 Processor -- start 2023-10-03T10:18:44.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.815+0000 7fd19ed80700 1 -- start start 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19ed80700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1980a0a30 0x7fd1980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19ed80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 0x7fd198133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19ed80700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19809edd0 con 0x7fd198133fa0 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19ed80700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd19809e1f0 con 0x7fd1980a0a30 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19ed80700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd19809dc50 con 0x7fd1980a1340 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19cb1c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1980a0a30 0x7fd1980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 0x7fd198133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19d31d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd198133fa0 0x7fd19813ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57786/0 (socket says 172.21.15.19:57786) 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19d31d700 1 -- 172.21.15.19:0/1667602954 learned_addr learned my addr 172.21.15.19:0/1667602954 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:44.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19cb1c700 1 -- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 msgr2=0x7fd198133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19cb1c700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 0x7fd198133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19cb1c700 1 -- 172.21.15.19:0/1667602954 >> v1:172.21.15.19:6789/0 conn(0x7fd198133fa0 legacy=0x7fd19813ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd1977fe700 1 -- 172.21.15.19:0/1667602954 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1963746763 0 0) 0x7fd19809edd0 con 0x7fd198133fa0 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.816+0000 7fd19cb1c700 1 -- 172.21.15.19:0/1667602954 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980a1fe0 con 0x7fd1980a0a30 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.817+0000 7fd197fff700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 0x7fd198133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.817+0000 7fd19cb1c700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a0a30 0x7fd1980a0e00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009840 tx=0x7fd18c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e404d73ee38eef97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.817+0000 7fd1977fe700 1 -- 172.21.15.19:0/1667602954 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011830 con 0x7fd1980a0a30 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.817+0000 7fd1977fe700 1 -- 172.21.15.19:0/1667602954 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c011990 con 0x7fd1980a0a30 2023-10-03T10:18:44.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.817+0000 7fd1977fe700 1 -- 172.21.15.19:0/1667602954 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c011d20 con 0x7fd1980a0a30 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 -- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a0a30 msgr2=0x7fd1980a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a0a30 0x7fd1980a0e00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009840 tx=0x7fd18c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 -- 172.21.15.19:0/1667602954 shutdown_connections 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a0a30 0x7fd1980a0e00 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 --2- 172.21.15.19:0/1667602954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a1340 0x7fd198133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 -- 172.21.15.19:0/1667602954 >> 172.21.15.19:0/1667602954 conn(0x7fd1980a6550 msgr2=0x7fd1980a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 -- 172.21.15.19:0/1667602954 shutdown_connections 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.818+0000 7fd19ed80700 1 -- 172.21.15.19:0/1667602954 wait complete. 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 Processor -- start 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 -- start start 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a0a30 0x7fd1981228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 0x7fd198123350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd198124630 con 0x7fd1980a1340 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd198124440 con 0x7fd198133fa0 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.819+0000 7fd19ed80700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd198124d30 con 0x7fd1980a0a30 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46042/0 (socket says 172.21.15.19:46042) 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 -- 172.21.15.19:0/3901821543 learned_addr learned my addr 172.21.15.19:0/3901821543 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd19cb1c700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a0a30 0x7fd1981228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd19d31d700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 0x7fd198123350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 -- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a0a30 msgr2=0x7fd1981228d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a0a30 0x7fd1981228d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 -- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 msgr2=0x7fd198123350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 0x7fd198123350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 -- 172.21.15.19:0/3901821543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1840094a0 con 0x7fd1980a1340 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd19d31d700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 0x7fd198123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd197fff700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd18400ebe0 tx=0x7fd18400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400c850 con 0x7fd1980a1340 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.820+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18400c9b0 con 0x7fd1980a1340 2023-10-03T10:18:44.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.821+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0094a0 con 0x7fd1980a1340 2023-10-03T10:18:44.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.821+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400cd40 con 0x7fd1980a1340 2023-10-03T10:18:44.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.821+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198133350 con 0x7fd1980a1340 2023-10-03T10:18:44.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.821+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd184013470 con 0x7fd1980a1340 2023-10-03T10:18:44.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.821+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd198125d10 con 0x7fd1980a1340 2023-10-03T10:18:44.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.822+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd18403f790 con 0x7fd1980a1340 2023-10-03T10:18:44.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.825+0000 7f7e4798c700 1 Processor -- start 2023-10-03T10:18:44.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.825+0000 7f7e4798c700 1 -- start start 2023-10-03T10:18:44.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e4006a770 0x7f7e4006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 0x7f7e40131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4009ece0 con 0x7f7e4006a770 2023-10-03T10:18:44.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4009e760 con 0x7f7e4006b080 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e4798c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4009e040 con 0x7f7e40131b40 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e44f27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e45f29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 0x7f7e40131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e44f27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51676/0 (socket says 172.21.15.19:51676) 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e45f29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 0x7f7e40131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50456/0 (socket says 172.21.15.19:50456) 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e44f27700 1 -- 172.21.15.19:0/489049980 learned_addr learned my addr 172.21.15.19:0/489049980 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e45728700 1 --2- 172.21.15.19:0/489049980 >> v2:172.21.15.19:3300/0 conn(0x7f7e4006a770 0x7f7e4006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e44f27700 1 -- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 msgr2=0x7f7e40131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.826+0000 7f7e44f27700 1 --2- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 0x7f7e40131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e44f27700 1 -- 172.21.15.19:0/489049980 >> v2:172.21.15.19:3300/0 conn(0x7f7e4006a770 msgr2=0x7f7e4006ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e44f27700 1 --2- 172.21.15.19:0/489049980 >> v2:172.21.15.19:3300/0 conn(0x7f7e4006a770 0x7f7e4006ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e44f27700 1 -- 172.21.15.19:0/489049980 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4009f630 con 0x7f7e4006b080 2023-10-03T10:18:44.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e44f27700 1 --2- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098f0 tx=0x7f7e30009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fec5cb3c5c308c75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e37fff700 1 -- 172.21.15.19:0/489049980 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30010a90 con 0x7f7e4006b080 2023-10-03T10:18:44.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e37fff700 1 -- 172.21.15.19:0/489049980 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30010bf0 con 0x7f7e4006b080 2023-10-03T10:18:44.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7f7e37fff700 1 -- 172.21.15.19:0/489049980 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30018440 con 0x7f7e4006b080 2023-10-03T10:18:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.827+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd198125d10 con 0x7fd1980a1340 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 -- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 msgr2=0x7f7e40131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 --2- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098f0 tx=0x7f7e30009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 -- 172.21.15.19:0/489049980 shutdown_connections 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 --2- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e40131b40 0x7f7e40131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 --2- 172.21.15.19:0/489049980 >> v2:172.21.15.19:3300/0 conn(0x7f7e4006a770 0x7f7e4006ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 --2- 172.21.15.19:0/489049980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e40131600 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 -- 172.21.15.19:0/489049980 >> 172.21.15.19:0/489049980 conn(0x7f7e40066f50 msgr2=0x7f7e4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 -- 172.21.15.19:0/489049980 shutdown_connections 2023-10-03T10:18:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.828+0000 7f7e4798c700 1 -- 172.21.15.19:0/489049980 wait complete. 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 Processor -- start 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 -- start start 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e4006a770 0x7f7e401c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e40131b40 0x7f7e4011e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40121d80 con 0x7f7e40131b40 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e401c4ca0 con 0x7f7e4006b080 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.829+0000 7f7e4798c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e40130dd0 con 0x7f7e4006a770 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51682/0 (socket says 172.21.15.19:51682) 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 -- 172.21.15.19:0/276810740 learned_addr learned my addr 172.21.15.19:0/276810740 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e45728700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e4006a770 0x7f7e401c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 -- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e4006a770 msgr2=0x7f7e401c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e4006a770 0x7f7e401c4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 -- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e40131b40 msgr2=0x7f7e4011e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e40131b40 0x7f7e4011e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 -- 172.21.15.19:0/276810740 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e30009550 con 0x7f7e4006b080 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e44f27700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009c40 tx=0x7f7e30004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30003ab0 con 0x7f7e4006b080 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30003c30 con 0x7f7e4006b080 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30010a10 con 0x7f7e4006b080 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.830+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e40120070 con 0x7f7e4006b080 2023-10-03T10:18:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.831+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4009a6f0 con 0x7f7e4006b080 2023-10-03T10:18:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.832+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e40074ea0 con 0x7f7e4006b080 2023-10-03T10:18:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.832+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e3001f070 con 0x7f7e4006b080 2023-10-03T10:18:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.832+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e30044ef0 con 0x7f7e4006b080 2023-10-03T10:18:44.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.842+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e30020380 con 0x7f7e4006b080 2023-10-03T10:18:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.982+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f20d806b9e0 con 0x7f20d8136710 2023-10-03T10:18:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.983+0000 7f20bffff700 1 -- 172.21.15.19:0/2264551048 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20cc021020 con 0x7f20d8136710 2023-10-03T10:18:44.984 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 msgr2=0x7f20d811b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f20cc00ec10 tx=0x7f20cc00ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 shutdown_connections 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20d8139030 0x7f20d811b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f20d81338a0 0x7f20d811ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 --2- 172.21.15.19:0/2264551048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f20d8136710 0x7f20d811b180 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.986+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 >> 172.21.15.19:0/2264551048 conn(0x7f20d80a2aa0 msgr2=0x7f20d8137100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.987+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 shutdown_connections 2023-10-03T10:18:44.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:44.987+0000 7f20dd81f700 1 -- 172.21.15.19:0/2264551048 wait complete. 2023-10-03T10:18:45.006 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:45.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.047+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e40121980 con 0x7f7e4006b080 2023-10-03T10:18:45.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.048+0000 7f7e35ffb700 1 -- 172.21.15.19:0/276810740 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e30027020 con 0x7f7e4006b080 2023-10-03T10:18:45.049 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.049+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd198125d10 con 0x7fd1980a1340 2023-10-03T10:18:45.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.049+0000 7fd1957fa700 1 -- 172.21.15.19:0/3901821543 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd198125d10 con 0x7fd1980a1340 2023-10-03T10:18:45.050 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:45.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.050+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 msgr2=0x7f7e401c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.050+0000 7f7e4798c700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009c40 tx=0x7f7e30004750 comp rx=0 tx=0).stop 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 shutdown_connections 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e40131b40 0x7f7e4011e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e4006a770 0x7f7e401c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 --2- 172.21.15.19:0/276810740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e4006b080 0x7f7e401c4760 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 >> 172.21.15.19:0/276810740 conn(0x7f7e40066f50 msgr2=0x7f7e400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 shutdown_connections 2023-10-03T10:18:45.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.051+0000 7f7e4798c700 1 -- 172.21.15.19:0/276810740 wait complete. 2023-10-03T10:18:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 msgr2=0x7fd198122e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fd18400ebe0 tx=0x7fd18400eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 shutdown_connections 2023-10-03T10:18:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd198133fa0 0x7fd198123350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1980a0a30 0x7fd1981228d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 --2- 172.21.15.19:0/3901821543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1980a1340 0x7fd198122e10 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 >> 172.21.15.19:0/3901821543 conn(0x7fd1980a6550 msgr2=0x7fd19811c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 shutdown_connections 2023-10-03T10:18:45.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.052+0000 7fd19ed80700 1 -- 172.21.15.19:0/3901821543 wait complete. 2023-10-03T10:18:45.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:45.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:45.692 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:45.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.837+0000 7f9f43938700 1 Processor -- start 2023-10-03T10:18:45.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.837+0000 7f9f43938700 1 -- start start 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f43938700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 0x7f9f3c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f43938700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f3c06ae80 0x7f9f3c139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f43938700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c09e130 con 0x7f9f3c09d9f0 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f43938700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f3c1312b0 con 0x7f9f3c06ae80 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f43938700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c09f6e0 con 0x7f9f3c1316c0 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f416d4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 0x7f9f3c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f41ed5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f3c06ae80 0x7f9f3c139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f40ed3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9f3c09d9f0 0x7f9f3c06a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57798/0 (socket says 172.21.15.19:57798) 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f40ed3700 1 -- 172.21.15.19:0/3231744385 learned_addr learned my addr 172.21.15.19:0/3231744385 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:45.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f41ed5700 1 -- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 msgr2=0x7f9f3c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f41ed5700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 0x7f9f3c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f41ed5700 1 -- 172.21.15.19:0/3231744385 >> v1:172.21.15.19:6789/0 conn(0x7f9f3c09d9f0 legacy=0x7f9f3c06a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f41ed5700 1 -- 172.21.15.19:0/3231744385 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c09e760 con 0x7f9f3c06ae80 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f2ffff700 1 -- 172.21.15.19:0/3231744385 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597131192 0 0) 0x7f9f30001110 con 0x7f9f3c09d9f0 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.838+0000 7f9f416d4700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 0x7f9f3c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f41ed5700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c06ae80 0x7f9f3c139550 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21af06fc4d59442 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f2ffff700 1 -- 172.21.15.19:0/3231744385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3400e070 con 0x7f9f3c06ae80 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f2ffff700 1 -- 172.21.15.19:0/3231744385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3400bb20 con 0x7f9f3c06ae80 2023-10-03T10:18:45.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f2ffff700 1 -- 172.21.15.19:0/3231744385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f34012430 con 0x7f9f3c06ae80 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 -- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c06ae80 msgr2=0x7f9f3c139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c06ae80 0x7f9f3c139550 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009d90 tx=0x7f9f3400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 -- 172.21.15.19:0/3231744385 shutdown_connections 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c06ae80 0x7f9f3c139550 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 --2- 172.21.15.19:0/3231744385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c1316c0 0x7f9f3c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 -- 172.21.15.19:0/3231744385 >> 172.21.15.19:0/3231744385 conn(0x7f9f3c066f50 msgr2=0x7f9f3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:45.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 -- 172.21.15.19:0/3231744385 shutdown_connections 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.839+0000 7f9f43938700 1 -- 172.21.15.19:0/3231744385 wait complete. 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.840+0000 7f9f43938700 1 Processor -- start 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.840+0000 7f9f43938700 1 -- start start 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c09d9f0 0x7f9f3c1c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c1316c0 0x7f9f3c070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c09bd40 con 0x7f9f3c09d9f0 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c09bf20 con 0x7f9f3c1316c0 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f43938700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c12b900 con 0x7f9f3c06ae80 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f40ed3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c09d9f0 0x7f9f3c1c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50494/0 (socket says 172.21.15.19:50494) 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 -- 172.21.15.19:0/504813130 learned_addr learned my addr 172.21.15.19:0/504813130 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f41ed5700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c1316c0 0x7f9f3c070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 -- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c1316c0 msgr2=0x7f9f3c070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c1316c0 0x7f9f3c070bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 -- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c09d9f0 msgr2=0x7f9f3c1c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c09d9f0 0x7f9f3c1c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.841+0000 7f9f416d4700 1 -- 172.21.15.19:0/504813130 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380094a0 con 0x7f9f3c06ae80 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f416d4700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800ec10 tx=0x7f9f3800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800c850 con 0x7f9f3c06ae80 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3800c9b0 con 0x7f9f3c06ae80 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f34009a70 con 0x7f9f3c06ae80 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3800cd20 con 0x7f9f3c06ae80 2023-10-03T10:18:45.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.842+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c09ead0 con 0x7f9f3c06ae80 2023-10-03T10:18:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.843+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f38013470 con 0x7f9f3c06ae80 2023-10-03T10:18:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.843+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f3803f900 con 0x7f9f3c06ae80 2023-10-03T10:18:45.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.843+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c128650 con 0x7f9f3c06ae80 2023-10-03T10:18:45.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:45.848+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f38013720 con 0x7f9f3c06ae80 2023-10-03T10:18:46.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:46.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.060+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9f3c074ea0 con 0x7f9f3c06ae80 2023-10-03T10:18:46.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.060+0000 7f9f2dffb700 1 -- 172.21.15.19:0/504813130 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f3802a090 con 0x7f9f3c06ae80 2023-10-03T10:18:46.061 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 msgr2=0x7f9f3c1c85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9f3800ec10 tx=0x7f9f3800ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 shutdown_connections 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f3c1316c0 0x7f9f3c070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f3c06ae80 0x7f9f3c1c85a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 --2- 172.21.15.19:0/504813130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c09d9f0 0x7f9f3c1c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 >> 172.21.15.19:0/504813130 conn(0x7f9f3c066f50 msgr2=0x7f9f3c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 shutdown_connections 2023-10-03T10:18:46.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.063+0000 7f9f43938700 1 -- 172.21.15.19:0/504813130 wait complete. 2023-10-03T10:18:46.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:46.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:46.080 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:46.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.149+0000 7f1146603700 1 Processor -- start 2023-10-03T10:18:46.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.149+0000 7f1146603700 1 -- start start 2023-10-03T10:18:46.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1146603700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f11400a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1146603700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1140138d80 0x7f114013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1146603700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400a2a70 con 0x7f114009d630 2023-10-03T10:18:46.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1146603700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400a01d0 con 0x7f1140138d80 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1146603700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114009e2b0 con 0x7f11400a0a30 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f113f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f114009d630 0x7f11400a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:57802/0 (socket says 172.21.15.19:57802) 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f113f7fe700 1 -- 172.21.15.19:0/3401875566 learned_addr learned my addr 172.21.15.19:0/3401875566 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f113ffff700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f11400a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.150+0000 7f1144ba0700 1 --2- 172.21.15.19:0/3401875566 >> v2:172.21.15.19:3300/0 conn(0x7f1140138d80 0x7f114013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113effd700 1 -- 172.21.15.19:0/3401875566 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020759651 0 0) 0x7f11400a2a70 con 0x7f114009d630 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113effd700 1 -- 172.21.15.19:0/3401875566 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11280035b0 con 0x7f114009d630 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f1144ba0700 1 -- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 msgr2=0x7f11400a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f1144ba0700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f11400a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f1144ba0700 1 -- 172.21.15.19:0/3401875566 >> v1:172.21.15.19:6789/0 conn(0x7f114009d630 legacy=0x7f11400a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f1144ba0700 1 -- 172.21.15.19:0/3401875566 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114009dc50 con 0x7f1140138d80 2023-10-03T10:18:46.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113ffff700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f11400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f1144ba0700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f114013b160 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fdf99570226379 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113effd700 1 -- 172.21.15.19:0/3401875566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113800e070 con 0x7f1140138d80 2023-10-03T10:18:46.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113effd700 1 -- 172.21.15.19:0/3401875566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113800bb20 con 0x7f1140138d80 2023-10-03T10:18:46.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.151+0000 7f113effd700 1 -- 172.21.15.19:0/3401875566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138012430 con 0x7f1140138d80 2023-10-03T10:18:46.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 -- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 msgr2=0x7f114013b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f114013b160 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:46.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 -- 172.21.15.19:0/3401875566 shutdown_connections 2023-10-03T10:18:46.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f114013b160 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 --2- 172.21.15.19:0/3401875566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f11400a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 -- 172.21.15.19:0/3401875566 >> 172.21.15.19:0/3401875566 conn(0x7f11400a3050 msgr2=0x7f11400a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 -- 172.21.15.19:0/3401875566 shutdown_connections 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.152+0000 7f1146603700 1 -- 172.21.15.19:0/3401875566 wait complete. 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.153+0000 7f1146603700 1 Processor -- start 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.153+0000 7f1146603700 1 -- start start 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 0x7f1140133740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f11401341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140134c10 con 0x7f1140138d80 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11401365c0 con 0x7f11400a0a30 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f1146603700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1140137210 con 0x7f114009d630 2023-10-03T10:18:46.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f113ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 0x7f1140133740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f113ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 0x7f1140133740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50508/0 (socket says 172.21.15.19:50508) 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f113f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51714/0 (socket says 172.21.15.19:51714) 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.154+0000 7f113ffff700 1 -- 172.21.15.19:0/3968603597 learned_addr learned my addr 172.21.15.19:0/3968603597 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f1144ba0700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f11401341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 -- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 msgr2=0x7f1140133740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 0x7f1140133740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 -- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 msgr2=0x7f11401341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f11401341c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 -- 172.21.15.19:0/3968603597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300094a0 con 0x7f11400a0a30 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113f7fe700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f113400c460 tx=0x7f113400c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134005d70 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11340070d0 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1138009a70 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1134007440 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.155+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11400a0460 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.156+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f11340075a0 con 0x7f11400a0a30 2023-10-03T10:18:46.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.157+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140136ac0 con 0x7f11400a0a30 2023-10-03T10:18:46.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.157+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f113403ea30 con 0x7f11400a0a30 2023-10-03T10:18:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.162+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1134019d20 con 0x7f11400a0a30 2023-10-03T10:18:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.210+0000 7fa740c4d700 1 Processor -- start 2023-10-03T10:18:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.210+0000 7fa740c4d700 1 -- start start 2023-10-03T10:18:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.210+0000 7f2f014ec700 1 Processor -- start 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.210+0000 7f2f014ec700 1 -- start start 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.210+0000 7f2f014ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc134630 0x7f2efc136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7f2f014ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7f2f014ec700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2efc09b4f0 con 0x7f2efc131810 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7f2f014ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1313c0 con 0x7f2efc136f50 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7f2f014ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc06e8c0 con 0x7f2efc134630 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7fa740c4d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 0x7fa73c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7fa740c4d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73c06b080 0x7fa73c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7fa740c4d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c09ece0 con 0x7fa73c131b40 2023-10-03T10:18:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7fa740c4d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c09e760 con 0x7fa73c06b080 2023-10-03T10:18:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.211+0000 7fa740c4d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c09e040 con 0x7fa73c06a770 2023-10-03T10:18:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51722/0 (socket says 172.21.15.19:51722) 2023-10-03T10:18:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 -- 172.21.15.19:0/2681164789 learned_addr learned my addr 172.21.15.19:0/2681164789 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73c06b080 0x7fa73c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa73a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 0x7fa73c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73c06b080 0x7fa73c131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46112/0 (socket says 172.21.15.19:46112) 2023-10-03T10:18:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 -- 172.21.15.19:0/3276082536 learned_addr learned my addr 172.21.15.19:0/3276082536 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efa7fc700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc134630 0x7f2efc136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 -- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 msgr2=0x7fa73c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 0x7fa73c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 -- 172.21.15.19:0/3276082536 >> v1:172.21.15.19:6789/0 conn(0x7fa73c131b40 legacy=0x7fa73c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 -- 172.21.15.19:0/3276082536 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c09f630 con 0x7fa73c06b080 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 -- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc134630 msgr2=0x7f2efc136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc134630 0x7f2efc136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 -- 172.21.15.19:0/2681164789 >> v1:172.21.15.19:6789/0 conn(0x7f2efc131810 legacy=0x7f2efc131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa73a59c700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 0x7fa73c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2ef9ffb700 1 -- 172.21.15.19:0/2681164789 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159063336 0 0) 0x7f2efc09b4f0 con 0x7f2efc131810 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 -- 172.21.15.19:0/2681164789 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc071d20 con 0x7f2efc136f50 2023-10-03T10:18:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7fa739d9b700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06b080 0x7fa73c131600 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098f0 tx=0x7fa730009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4853015561ae7400 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.212+0000 7f2efb7fe700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009e80 tx=0x7f2ef400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=526daa9c7202c1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7fa73959a700 1 -- 172.21.15.19:0/3276082536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730011830 con 0x7fa73c06b080 2023-10-03T10:18:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2ef9ffb700 1 -- 172.21.15.19:0/2681164789 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400e070 con 0x7f2efc136f50 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7fa73959a700 1 -- 172.21.15.19:0/3276082536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730011990 con 0x7fa73c06b080 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7fa73959a700 1 -- 172.21.15.19:0/3276082536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730011d20 con 0x7fa73c06b080 2023-10-03T10:18:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2ef9ffb700 1 -- 172.21.15.19:0/2681164789 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef400b9c0 con 0x7f2efc136f50 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2ef9ffb700 1 -- 172.21.15.19:0/2681164789 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef400bd30 con 0x7f2efc136f50 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2f014ec700 1 -- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 msgr2=0x7f2efc139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2f014ec700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009e80 tx=0x7f2ef400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2f014ec700 1 -- 172.21.15.19:0/2681164789 shutdown_connections 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2f014ec700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc136f50 0x7f2efc139330 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.213+0000 7f2f014ec700 1 --2- 172.21.15.19:0/2681164789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc134630 0x7f2efc136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7f2f014ec700 1 -- 172.21.15.19:0/2681164789 >> 172.21.15.19:0/2681164789 conn(0x7f2efc0a2aa0 msgr2=0x7f2efc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7f2f014ec700 1 -- 172.21.15.19:0/2681164789 shutdown_connections 2023-10-03T10:18:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7f2f014ec700 1 -- 172.21.15.19:0/2681164789 wait complete. 2023-10-03T10:18:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 -- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06b080 msgr2=0x7fa73c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06b080 0x7fa73c131600 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fa7300098f0 tx=0x7fa730009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 -- 172.21.15.19:0/3276082536 shutdown_connections 2023-10-03T10:18:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06a770 0x7fa73c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3276082536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06b080 0x7fa73c131600 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 -- 172.21.15.19:0/3276082536 >> 172.21.15.19:0/3276082536 conn(0x7fa73c066f50 msgr2=0x7fa73c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 -- 172.21.15.19:0/3276082536 shutdown_connections 2023-10-03T10:18:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.214+0000 7fa740c4d700 1 -- 172.21.15.19:0/3276082536 wait complete. 2023-10-03T10:18:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 Processor -- start 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 -- start start 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc136f50 0x7f2efc139c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc09d430 con 0x7f2efc134630 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc1383f0 con 0x7f2efc131810 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2f014ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc06eb00 con 0x7f2efc136f50 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.215+0000 7f2efa7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efa7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46116/0 (socket says 172.21.15.19:46116) 2023-10-03T10:18:46.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51730/0 (socket says 172.21.15.19:51730) 2023-10-03T10:18:46.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efa7fc700 1 -- 172.21.15.19:0/4259549530 learned_addr learned my addr 172.21.15.19:0/4259549530 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:46.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 Processor -- start 2023-10-03T10:18:46.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 -- start start 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 -- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc136f50 msgr2=0x7f2efc139c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc136f50 0x7f2efc139c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 -- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 msgr2=0x7f2efc139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 -- 172.21.15.19:0/4259549530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4009b30 con 0x7f2efc131810 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efa7fc700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2efaffd700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c430 tx=0x7f2eec00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec0054e0 con 0x7f2efc131810 2023-10-03T10:18:46.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec003680 con 0x7f2efc131810 2023-10-03T10:18:46.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec003a30 con 0x7f2efc131810 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 0x7fa73c11d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73c131b40 0x7fa73c1c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11ff60 con 0x7fa73c06a770 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c131670 con 0x7fa73c131b40 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7fa740c4d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c11ccd0 con 0x7fa73c06b080 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46118/0 (socket says 172.21.15.19:46118) 2023-10-03T10:18:46.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 -- 172.21.15.19:0/3951677006 learned_addr learned my addr 172.21.15.19:0/3951677006 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73ad9d700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73c131b40 0x7fa73c1c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa739d9b700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 0x7fa73c11d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 -- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 msgr2=0x7fa73c11d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 0x7fa73c11d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 -- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73c131b40 msgr2=0x7fa73c1c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73c131b40 0x7fa73c1c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 -- 172.21.15.19:0/3951677006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c0094a0 con 0x7fa73c06a770 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa739d9b700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 0x7fa73c11d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa73a59c700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00ebe0 tx=0x7fa72c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c009800 con 0x7fa73c06a770 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c00c910 con 0x7fa73c06a770 2023-10-03T10:18:46.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c00cc80 con 0x7fa73c06a770 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.218+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa730009550 con 0x7fa73c06a770 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.218+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c11fca0 con 0x7fa73c06a770 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.216+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc13a670 con 0x7f2efc131810 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.217+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc12ec60 con 0x7f2efc131810 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.218+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc070d80 con 0x7f2efc131810 2023-10-03T10:18:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.219+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2eec003b90 con 0x7f2efc131810 2023-10-03T10:18:46.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.219+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2eec03efd0 con 0x7f2efc131810 2023-10-03T10:18:46.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.219+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa72c013470 con 0x7fa73c06a770 2023-10-03T10:18:46.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.219+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa72c03fc00 con 0x7fa73c06a770 2023-10-03T10:18:46.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.219+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73c06f6c0 con 0x7fa73c06a770 2023-10-03T10:18:46.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.223+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2eec003e40 con 0x7f2efc131810 2023-10-03T10:18:46.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.229+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa72c021080 con 0x7fa73c06a770 2023-10-03T10:18:46.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.378+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f11400a4b90 con 0x7f11400a0a30 2023-10-03T10:18:46.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.378+0000 7f113cff9700 1 -- 172.21.15.19:0/3968603597 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11340192c0 con 0x7f11400a0a30 2023-10-03T10:18:46.379 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 msgr2=0x7f1140133c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f113400c460 tx=0x7f113400c770 comp rx=0 tx=0).stop 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 shutdown_connections 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1140138d80 0x7f11401341c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f114009d630 0x7f1140133740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 --2- 172.21.15.19:0/3968603597 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f11400a0a30 0x7f1140133c80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 >> 172.21.15.19:0/3968603597 conn(0x7f11400a3050 msgr2=0x7f114009ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 shutdown_connections 2023-10-03T10:18:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.381+0000 7f1146603700 1 -- 172.21.15.19:0/3968603597 wait complete. 2023-10-03T10:18:46.396 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:46.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.432+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2efc138190 con 0x7f2efc131810 2023-10-03T10:18:46.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.432+0000 7f2ee37fe700 1 -- 172.21.15.19:0/4259549530 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2eec0192c0 con 0x7f2efc131810 2023-10-03T10:18:46.433 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.434+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 msgr2=0x7f2efc139210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00c430 tx=0x7f2eec00c740 comp rx=0 tx=0).stop 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 shutdown_connections 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2efc136f50 0x7f2efc139c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2efc131810 0x7f2efc139210 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 --2- 172.21.15.19:0/4259549530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2efc134630 0x7f2efc139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 >> 172.21.15.19:0/4259549530 conn(0x7f2efc0a2aa0 msgr2=0x7f2efc1339d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 shutdown_connections 2023-10-03T10:18:46.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.435+0000 7f2f014ec700 1 -- 172.21.15.19:0/4259549530 wait complete. 2023-10-03T10:18:46.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.437+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa73c074ea0 con 0x7fa73c06a770 2023-10-03T10:18:46.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.437+0000 7fa72affd700 1 -- 172.21.15.19:0/3951677006 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa72c017020 con 0x7fa73c06a770 2023-10-03T10:18:46.438 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:46.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 msgr2=0x7fa73c11d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00ebe0 tx=0x7fa72c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 shutdown_connections 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73c131b40 0x7fa73c1c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73c06a770 0x7fa73c11d140 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 --2- 172.21.15.19:0/3951677006 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73c06b080 0x7fa73c11d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 >> 172.21.15.19:0/3951677006 conn(0x7fa73c066f50 msgr2=0x7fa73c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.439+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 shutdown_connections 2023-10-03T10:18:46.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:46.440+0000 7fa740c4d700 1 -- 172.21.15.19:0/3951677006 wait complete. 2023-10-03T10:18:46.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:46.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:47.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.226+0000 7fd990d4e700 1 Processor -- start 2023-10-03T10:18:47.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 -- start start 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 0x7fd98c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd98c134120 0x7fd98c134590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c06c670 con 0x7fd98c134120 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06c9f0 con 0x7fd98c09f240 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd990d4e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06bc90 con 0x7fd98c09e930 2023-10-03T10:18:47.229 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd98ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd98c134120 0x7fd98c134590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd989d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 0x7fd98c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd989d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50646/0 (socket says 172.21.15.19:50646) 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd98ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd98c134120 0x7fd98c134590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50770/0 (socket says 172.21.15.19:50770) 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 0x7fd98c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49340/0 (socket says 172.21.15.19:49340) 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.227+0000 7fd989d9b700 1 -- 172.21.15.19:0/1903021956 learned_addr learned my addr 172.21.15.19:0/1903021956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 -- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 msgr2=0x7fd98c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 0x7fd98c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 -- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 msgr2=0x7fd98c133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 -- 172.21.15.19:0/1903021956 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c06d860 con 0x7fd98c134120 2023-10-03T10:18:47.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd989d9b700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98ad9d700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c134120 0x7fd98c134590 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d90 tx=0x7fd98400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb90dc99f8c5f3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98959a700 1 -- 172.21.15.19:0/1903021956 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd98400e070 con 0x7fd98c134120 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98959a700 1 -- 172.21.15.19:0/1903021956 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd98400bb20 con 0x7fd98c134120 2023-10-03T10:18:47.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.228+0000 7fd98959a700 1 -- 172.21.15.19:0/1903021956 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd984012430 con 0x7fd98c134120 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 -- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c134120 msgr2=0x7fd98c134590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c134120 0x7fd98c134590 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fd984009d90 tx=0x7fd98400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 -- 172.21.15.19:0/1903021956 shutdown_connections 2023-10-03T10:18:47.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c134120 0x7fd98c134590 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09e930 0x7fd98c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 --2- 172.21.15.19:0/1903021956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f240 0x7fd98c133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 -- 172.21.15.19:0/1903021956 >> 172.21.15.19:0/1903021956 conn(0x7fd98c0a4210 msgr2=0x7fd98c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 -- 172.21.15.19:0/1903021956 shutdown_connections 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.229+0000 7fd990d4e700 1 -- 172.21.15.19:0/1903021956 wait complete. 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.230+0000 7fd990d4e700 1 Processor -- start 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.230+0000 7fd990d4e700 1 -- start start 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 0x7fd98c122e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 0x7fd98c1233a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c124530 con 0x7fd98c09e930 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c123d80 con 0x7fd98c134120 2023-10-03T10:18:47.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1334b0 con 0x7fd98c09f240 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd989d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 0x7fd98c122e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50784/0 (socket says 172.21.15.19:50784) 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd989d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 0x7fd98c122e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49346/0 (socket says 172.21.15.19:49346) 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 -- 172.21.15.19:0/3498525387 learned_addr learned my addr 172.21.15.19:0/3498525387 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98ad9d700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 0x7fd98c1233a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 -- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 msgr2=0x7fd98c122e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 0x7fd98c122e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 -- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 msgr2=0x7fd98c1233a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 0x7fd98c1233a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 -- 172.21.15.19:0/3498525387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd980009550 con 0x7fd98c09e930 2023-10-03T10:18:47.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98ad9d700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 0x7fd98c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd98a59c700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e9e0 tx=0x7fd97c00ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c009710 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c00ee80 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd984009a70 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.231+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c00ca50 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.232+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c126490 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.232+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd97c00cbb0 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.232+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd97c03f560 con 0x7fd98c09e930 2023-10-03T10:18:47.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.233+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c126490 con 0x7fd98c09e930 2023-10-03T10:18:47.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.237+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd98c126490 con 0x7fd98c09e930 2023-10-03T10:18:47.397 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:47.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.441+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd98c126490 con 0x7fd98c09e930 2023-10-03T10:18:47.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.442+0000 7fd97affd700 1 -- 172.21.15.19:0/3498525387 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd98c126490 con 0x7fd98c09e930 2023-10-03T10:18:47.443 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:47.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 msgr2=0x7fd98c122920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00e9e0 tx=0x7fd97c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 shutdown_connections 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c134120 0x7fd98c1233a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09e930 0x7fd98c122920 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 --2- 172.21.15.19:0/3498525387 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c09f240 0x7fd98c122e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 >> 172.21.15.19:0/3498525387 conn(0x7fd98c0a4210 msgr2=0x7fd98c070ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 shutdown_connections 2023-10-03T10:18:47.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.444+0000 7fd990d4e700 1 -- 172.21.15.19:0/3498525387 wait complete. 2023-10-03T10:18:47.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:47.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:47.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.541+0000 7f30d2598700 1 Processor -- start 2023-10-03T10:18:47.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.541+0000 7f30d2598700 1 -- start start 2023-10-03T10:18:47.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06b080 0x7f30cc131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 0x7f30cc131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc09ece0 con 0x7f30cc06a770 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc09e760 con 0x7f30cc06b080 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d2598700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc09e040 con 0x7f30cc131b40 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30cbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30cbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50786/0 (socket says 172.21.15.19:50786) 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30cbfff700 1 -- 172.21.15.19:0/1021188224 learned_addr learned my addr 172.21.15.19:0/1021188224 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 0x7f30cc131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30cb7fe700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06b080 0x7f30cc131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 -- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06b080 msgr2=0x7f30cc131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06b080 0x7f30cc131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 -- 172.21.15.19:0/1021188224 >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 msgr2=0x7f30cc06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 --2- 172.21.15.19:0/1021188224 >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30d0b35700 1 -- 172.21.15.19:0/1021188224 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc09f630 con 0x7f30cc131b40 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.542+0000 7f30cbfff700 1 --2- 172.21.15.19:0/1021188224 >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30d0b35700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 0x7f30cc131fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36a1d8431c7387b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30caffd700 1 -- 172.21.15.19:0/1021188224 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400e070 con 0x7f30cc131b40 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30caffd700 1 -- 172.21.15.19:0/1021188224 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c400bb20 con 0x7f30cc131b40 2023-10-03T10:18:47.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30caffd700 1 -- 172.21.15.19:0/1021188224 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4012430 con 0x7f30cc131b40 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30d2598700 1 -- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 msgr2=0x7f30cc131fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.543+0000 7f30d2598700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 0x7f30cc131fa0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009d90 tx=0x7f30c400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 -- 172.21.15.19:0/1021188224 shutdown_connections 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc131b40 0x7f30cc131fa0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 --2- 172.21.15.19:0/1021188224 >> v2:172.21.15.19:3300/0 conn(0x7f30cc06a770 0x7f30cc06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 --2- 172.21.15.19:0/1021188224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06b080 0x7f30cc131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 -- 172.21.15.19:0/1021188224 >> 172.21.15.19:0/1021188224 conn(0x7f30cc066f50 msgr2=0x7f30cc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 -- 172.21.15.19:0/1021188224 shutdown_connections 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.544+0000 7f30d2598700 1 -- 172.21.15.19:0/1021188224 wait complete. 2023-10-03T10:18:47.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 Processor -- start 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 -- start start 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc06b080 0x7f30cc1c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 0x7f30cc1c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc123c80 con 0x7f30cc131b40 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc124220 con 0x7f30cc06a770 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.545+0000 7f30d2598700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc123f40 con 0x7f30cc06b080 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50662/0 (socket says 172.21.15.19:50662) 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 -- 172.21.15.19:0/3186139523 learned_addr learned my addr 172.21.15.19:0/3186139523 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30d0b35700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 0x7f30cc1c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 -- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc06b080 msgr2=0x7f30cc1c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc06b080 0x7f30cc1c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 -- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 msgr2=0x7f30cc1c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 0x7f30cc1c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 -- 172.21.15.19:0/3186139523 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc009550 con 0x7f30cc06a770 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30d0b35700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 0x7f30cc1c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30cbfff700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ebe0 tx=0x7f30bc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00c850 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc00c9b0 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00cd20 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.546+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c4009a70 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.547+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc131660 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.547+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30bc013470 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.548+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30bc03fcf0 con 0x7f30cc06a770 2023-10-03T10:18:47.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.548+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc074ea0 con 0x7f30cc06a770 2023-10-03T10:18:47.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.553+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30bc017080 con 0x7f30cc06a770 2023-10-03T10:18:47.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.596+0000 7fd3d049a700 1 Processor -- start 2023-10-03T10:18:47.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.596+0000 7fd3d049a700 1 -- start start 2023-10-03T10:18:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3d049a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 0x7fd3c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3d049a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3d049a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c809f130 con 0x7fd3c809e000 2023-10-03T10:18:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3d049a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c809f520 con 0x7fd3c809d6f0 2023-10-03T10:18:47.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3d049a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c809e930 con 0x7fd3c809e410 2023-10-03T10:18:47.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.597+0000 7fd3cea37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50674/0 (socket says 172.21.15.19:50674) 2023-10-03T10:18:47.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 -- 172.21.15.19:0/1003596451 learned_addr learned my addr 172.21.15.19:0/1003596451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3ce236700 1 --2- 172.21.15.19:0/1003596451 >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 0x7fd3c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 -- 172.21.15.19:0/1003596451 >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 msgr2=0x7fd3c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 --2- 172.21.15.19:0/1003596451 >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 0x7fd3c809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 -- 172.21.15.19:0/1003596451 >> v1:172.21.15.19:6789/0 conn(0x7fd3c809e000 legacy=0x7fd3c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 -- 172.21.15.19:0/1003596451 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c809b2d0 con 0x7fd3c809e410 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3ce236700 1 --2- 172.21.15.19:0/1003596451 >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 0x7fd3c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.598+0000 7fd3cea37700 1 --2- 172.21.15.19:0/1003596451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009e50 tx=0x7fd3c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26bc245178f8df17 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.599+0000 7fd3cd234700 1 -- 172.21.15.19:0/1003596451 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000e070 con 0x7fd3c809e410 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.599+0000 7fd3cd234700 1 -- 172.21.15.19:0/1003596451 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000b910 con 0x7fd3c809e410 2023-10-03T10:18:47.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.599+0000 7fd3cd234700 1 -- 172.21.15.19:0/1003596451 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000bcc0 con 0x7fd3c809e410 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 -- 172.21.15.19:0/1003596451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 msgr2=0x7fd3c8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 --2- 172.21.15.19:0/1003596451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0009e50 tx=0x7fd3c000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 -- 172.21.15.19:0/1003596451 shutdown_connections 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 --2- 172.21.15.19:0/1003596451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809e410 0x7fd3c8130d70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 --2- 172.21.15.19:0/1003596451 >> v2:172.21.15.19:3300/0 conn(0x7fd3c809d6f0 0x7fd3c809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 -- 172.21.15.19:0/1003596451 >> 172.21.15.19:0/1003596451 conn(0x7fd3c8066f50 msgr2=0x7fd3c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 -- 172.21.15.19:0/1003596451 shutdown_connections 2023-10-03T10:18:47.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.600+0000 7fd3d049a700 1 -- 172.21.15.19:0/1003596451 wait complete. 2023-10-03T10:18:47.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.601+0000 7fd3d049a700 1 Processor -- start 2023-10-03T10:18:47.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.601+0000 7fd3d049a700 1 -- start start 2023-10-03T10:18:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809d6f0 0x7fd3c812dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c809e410 0x7fd3c812e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c812ff30 con 0x7fd3c809e000 2023-10-03T10:18:47.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c812f790 con 0x7fd3c809d6f0 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3d049a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c812fca0 con 0x7fd3c809e410 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50814/0 (socket says 172.21.15.19:50814) 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 -- 172.21.15.19:0/2481618483 learned_addr learned my addr 172.21.15.19:0/2481618483 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3ce236700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809d6f0 0x7fd3c812dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cea37700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c809e410 0x7fd3c812e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 -- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c809e410 msgr2=0x7fd3c812e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c809e410 0x7fd3c812e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 -- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809d6f0 msgr2=0x7fd3c812dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809d6f0 0x7fd3c812dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.602+0000 7fd3cda35700 1 -- 172.21.15.19:0/2481618483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40094a0 con 0x7fd3c809e000 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3cda35700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c4e0 tx=0x7fd3bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0052d0 con 0x7fd3c809e000 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c0009b30 con 0x7fd3c809e000 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc005430 con 0x7fd3c809e000 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0038c0 con 0x7fd3c809e000 2023-10-03T10:18:47.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.603+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c81321b0 con 0x7fd3c809e000 2023-10-03T10:18:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.604+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd3bc003a20 con 0x7fd3c809e000 2023-10-03T10:18:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.604+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd3bc03eac0 con 0x7fd3c809e000 2023-10-03T10:18:47.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.604+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c8074ea0 con 0x7fd3c809e000 2023-10-03T10:18:47.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.611+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd3bc018260 con 0x7fd3c809e000 2023-10-03T10:18:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.647+0000 7f606a0ee700 1 Processor -- start 2023-10-03T10:18:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.647+0000 7f606a0ee700 1 -- start start 2023-10-03T10:18:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f606a0ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f606409e850 0x7f606409ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f606a0ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6064134300 0x7f606413bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f606a0ee700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606409f960 con 0x7f606409f160 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f606a0ee700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f606409ae60 con 0x7f606409e850 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f606a0ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606406cb10 con 0x7f6064134300 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f606409e850 0x7f606409ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f606409e850 0x7f606409ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50818/0 (socket says 172.21.15.19:50818) 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 -- 172.21.15.19:0/2659873855 learned_addr learned my addr 172.21.15.19:0/2659873855 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f6063fff700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6064134300 0x7f606413bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 -- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6064134300 msgr2=0x7f606413bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6064134300 0x7f606413bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 -- 172.21.15.19:0/2659873855 >> v1:172.21.15.19:6789/0 conn(0x7f606409f160 legacy=0x7f6064133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60637fe700 1 -- 172.21.15.19:0/2659873855 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606406b990 con 0x7f606409e850 2023-10-03T10:18:47.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.648+0000 7f60627fc700 1 -- 172.21.15.19:0/2659873855 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048184606 0 0) 0x7f606409f960 con 0x7f606409f160 2023-10-03T10:18:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f60637fe700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f606409e850 0x7f606409ec20 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f60540098f0 tx=0x7f6054009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525a8b3fa36f19ed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f60627fc700 1 -- 172.21.15.19:0/2659873855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054011830 con 0x7f606409e850 2023-10-03T10:18:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f60627fc700 1 -- 172.21.15.19:0/2659873855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054011990 con 0x7f606409e850 2023-10-03T10:18:47.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f60627fc700 1 -- 172.21.15.19:0/2659873855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054011d20 con 0x7f606409e850 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f606a0ee700 1 -- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f606409e850 msgr2=0x7f606409ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f606a0ee700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f606409e850 0x7f606409ec20 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f60540098f0 tx=0x7f6054009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f606a0ee700 1 -- 172.21.15.19:0/2659873855 shutdown_connections 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f606a0ee700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6064134300 0x7f606413bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.649+0000 7f606a0ee700 1 --2- 172.21.15.19:0/2659873855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f606409e850 0x7f606409ec20 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.650+0000 7f606a0ee700 1 -- 172.21.15.19:0/2659873855 >> 172.21.15.19:0/2659873855 conn(0x7f60640a3f70 msgr2=0x7f60640a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.650+0000 7f606a0ee700 1 -- 172.21.15.19:0/2659873855 shutdown_connections 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.650+0000 7f606a0ee700 1 -- 172.21.15.19:0/2659873855 wait complete. 2023-10-03T10:18:47.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.651+0000 7f606a0ee700 1 Processor -- start 2023-10-03T10:18:47.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.651+0000 7f606a0ee700 1 -- start start 2023-10-03T10:18:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6064134300 0x7f6064123410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:47.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60641261d0 con 0x7f6064134300 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60641246b0 con 0x7f606409f160 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f606a0ee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f606406cd30 con 0x7f606409e850 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f60637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f60637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49386/0 (socket says 172.21.15.19:49386) 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f6062ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50702/0 (socket says 172.21.15.19:50702) 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f60637fe700 1 -- 172.21.15.19:0/3493839037 learned_addr learned my addr 172.21.15.19:0/3493839037 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.652+0000 7f6063fff700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6064134300 0x7f6064123410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 -- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 msgr2=0x7f6064122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 -- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6064134300 msgr2=0x7f6064123410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6064134300 0x7f6064123410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 -- 172.21.15.19:0/3493839037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054009550 con 0x7f606409e850 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f6062ffd700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f60637fe700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c40 tx=0x7f6054004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054004510 con 0x7f606409e850 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60540036a0 con 0x7f606409e850 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054003a50 con 0x7f606409e850 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60640a17f0 con 0x7f606409e850 2023-10-03T10:18:47.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.653+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6064126c40 con 0x7f606409e850 2023-10-03T10:18:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.654+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60640747f0 con 0x7f606409e850 2023-10-03T10:18:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.654+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6054021070 con 0x7f606409e850 2023-10-03T10:18:47.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.654+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6054040a60 con 0x7f606409e850 2023-10-03T10:18:47.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.659+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6054019770 con 0x7f606409e850 2023-10-03T10:18:47.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.771+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f30cc0a1ae0 con 0x7f30cc06a770 2023-10-03T10:18:47.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.771+0000 7f30c8ff9700 1 -- 172.21.15.19:0/3186139523 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30bc01b3b0 con 0x7f30cc06a770 2023-10-03T10:18:47.772 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 msgr2=0x7f30cc1c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00ebe0 tx=0x7f30bc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 shutdown_connections 2023-10-03T10:18:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30cc131b40 0x7f30cc1c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30cc06a770 0x7f30cc1c5f20 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 --2- 172.21.15.19:0/3186139523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30cc06b080 0x7f30cc1c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 >> 172.21.15.19:0/3186139523 conn(0x7f30cc066f50 msgr2=0x7f30cc0700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 shutdown_connections 2023-10-03T10:18:47.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.775+0000 7f30d2598700 1 -- 172.21.15.19:0/3186139523 wait complete. 2023-10-03T10:18:47.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:47.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.824+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd3c8130cf0 con 0x7fd3c809e000 2023-10-03T10:18:47.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.824+0000 7fd3baffd700 1 -- 172.21.15.19:0/2481618483 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd3bc017020 con 0x7fd3c809e000 2023-10-03T10:18:47.825 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.826+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 msgr2=0x7fd3c812e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.826+0000 7fd3d049a700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc00c4e0 tx=0x7fd3bc00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 shutdown_connections 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd3c809e410 0x7fd3c812e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd3c809d6f0 0x7fd3c812dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 --2- 172.21.15.19:0/2481618483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd3c809e000 0x7fd3c812e110 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 >> 172.21.15.19:0/2481618483 conn(0x7fd3c8066f50 msgr2=0x7fd3c812a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 shutdown_connections 2023-10-03T10:18:47.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.827+0000 7fd3d049a700 1 -- 172.21.15.19:0/2481618483 wait complete. 2023-10-03T10:18:47.841 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.864+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f606406bbb0 con 0x7f606409e850 2023-10-03T10:18:47.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.865+0000 7f604bfff700 1 -- 172.21.15.19:0/3493839037 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6054029030 con 0x7f606409e850 2023-10-03T10:18:47.866 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 msgr2=0x7f6064122990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c40 tx=0x7f6054004750 comp rx=0 tx=0).stop 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 shutdown_connections 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6064134300 0x7f6064123410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f606409e850 0x7f6064122990 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 --2- 172.21.15.19:0/3493839037 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f606409f160 0x7f6064122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:47.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 >> 172.21.15.19:0/3493839037 conn(0x7f60640a3f70 msgr2=0x7f6064070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:47.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 shutdown_connections 2023-10-03T10:18:47.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:47.867+0000 7f606a0ee700 1 -- 172.21.15.19:0/3493839037 wait complete. 2023-10-03T10:18:47.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:48.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:48.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.605+0000 7f7ff2b08700 1 Processor -- start 2023-10-03T10:18:48.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.605+0000 7f7ff2b08700 1 -- start start 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 0x7f7fec1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fec070940 con 0x7f7fec09e930 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec06fd60 con 0x7f7fec09f240 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff2b08700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec06fa80 con 0x7f7fec09f650 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff08a4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff10a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7febfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 0x7f7fec1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff10a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49400/0 (socket says 172.21.15.19:49400) 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7febfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 0x7f7fec1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50710/0 (socket says 172.21.15.19:50710) 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff10a5700 1 -- 172.21.15.19:0/828639522 learned_addr learned my addr 172.21.15.19:0/828639522 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff08a4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50838/0 (socket says 172.21.15.19:50838) 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff10a5700 1 -- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 msgr2=0x7f7fec1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.606+0000 7f7ff10a5700 1 --2- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 0x7f7fec1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff10a5700 1 -- 172.21.15.19:0/828639522 >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 msgr2=0x7f7fec09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff10a5700 1 --2- 172.21.15.19:0/828639522 >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff10a5700 1 -- 172.21.15.19:0/828639522 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec09fb60 con 0x7f7fec09f650 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff08a4700 1 --2- 172.21.15.19:0/828639522 >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff10a5700 1 --2- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009e50 tx=0x7f7fe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206e33c3445863ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7feb7fe700 1 -- 172.21.15.19:0/828639522 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400e070 con 0x7f7fec09f650 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7feb7fe700 1 -- 172.21.15.19:0/828639522 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe400b910 con 0x7f7fec09f650 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7feb7fe700 1 -- 172.21.15.19:0/828639522 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe400bcc0 con 0x7f7fec09f650 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff2b08700 1 -- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 msgr2=0x7f7fec131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.607+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009e50 tx=0x7f7fe400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 -- 172.21.15.19:0/828639522 shutdown_connections 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09f650 0x7f7fec131d30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/828639522 >> v2:172.21.15.19:3300/0 conn(0x7f7fec09e930 0x7f7fec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/828639522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f240 0x7f7fec1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 -- 172.21.15.19:0/828639522 >> 172.21.15.19:0/828639522 conn(0x7f7fec0a4210 msgr2=0x7f7fec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 -- 172.21.15.19:0/828639522 shutdown_connections 2023-10-03T10:18:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.608+0000 7f7ff2b08700 1 -- 172.21.15.19:0/828639522 wait complete. 2023-10-03T10:18:48.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 Processor -- start 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 -- start start 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fec09f240 0x7f7fec06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f650 0x7f7fec06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec1b7230 con 0x7f7fec09f240 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec1a93e0 con 0x7f7fec09f650 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff2b08700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7fec1a8900 con 0x7f7fec09e930 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff08a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7febfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fec09f240 0x7f7fec06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff08a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49404/0 (socket says 172.21.15.19:49404) 2023-10-03T10:18:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.609+0000 7f7ff08a4700 1 -- 172.21.15.19:0/1610348588 learned_addr learned my addr 172.21.15.19:0/1610348588 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff10a5700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f650 0x7f7fec06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 -- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f650 msgr2=0x7f7fec06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f650 0x7f7fec06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 -- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fec09f240 msgr2=0x7f7fec06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fec09f240 0x7f7fec06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 -- 172.21.15.19:0/1610348588 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe00094a0 con 0x7f7fec09e930 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff08a4700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ebe0 tx=0x7f7fe000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0009780 con 0x7f7fec09e930 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c850 con 0x7f7fec09e930 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000cbe0 con 0x7f7fec09e930 2023-10-03T10:18:48.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe4009b30 con 0x7f7fec09e930 2023-10-03T10:18:48.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.610+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fec0a0190 con 0x7f7fec09e930 2023-10-03T10:18:48.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.611+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7fe000cd40 con 0x7f7fec09e930 2023-10-03T10:18:48.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.611+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7fe003fb00 con 0x7f7fec09e930 2023-10-03T10:18:48.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.611+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fec071d80 con 0x7f7fec09e930 2023-10-03T10:18:48.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.616+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7fe0021080 con 0x7f7fec09e930 2023-10-03T10:18:48.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:48.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.819+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7fec074ea0 con 0x7f7fec09e930 2023-10-03T10:18:48.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.820+0000 7f7fe97fa700 1 -- 172.21.15.19:0/1610348588 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7fe001b3b0 con 0x7f7fec09e930 2023-10-03T10:18:48.821 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:48.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 msgr2=0x7f7fec06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000ebe0 tx=0x7f7fe000eef0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 shutdown_connections 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7fec09f650 0x7f7fec06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7fec09e930 0x7f7fec06b8b0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 --2- 172.21.15.19:0/1610348588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7fec09f240 0x7f7fec06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 >> 172.21.15.19:0/1610348588 conn(0x7f7fec0a4210 msgr2=0x7f7fec1b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.822+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 shutdown_connections 2023-10-03T10:18:48.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.823+0000 7f7ff2b08700 1 -- 172.21.15.19:0/1610348588 wait complete. 2023-10-03T10:18:48.839 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:48.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:48.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:48.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.931+0000 7f1228eb3700 1 Processor -- start 2023-10-03T10:18:48.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 -- start start 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 0x7f122409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f12241317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f122409f650 0x7f1224131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1224070940 con 0x7f122409f650 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.932+0000 7f1228eb3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122406fd60 con 0x7f122409f240 2023-10-03T10:18:48.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1228eb3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f122406fa80 con 0x7f122409e930 2023-10-03T10:18:48.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f122259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 0x7f122409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f122259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 0x7f122409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49420/0 (socket says 172.21.15.19:49420) 2023-10-03T10:18:48.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f122259c700 1 -- 172.21.15.19:0/1544516493 learned_addr learned my addr 172.21.15.19:0/1544516493 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:48.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 --2- 172.21.15.19:0/1544516493 >> v2:172.21.15.19:3300/0 conn(0x7f122409f650 0x7f1224131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1221d9b700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f12241317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 -- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 msgr2=0x7f122409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 0x7f122409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 -- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 msgr2=0x7f12241317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f12241317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 -- 172.21.15.19:0/1544516493 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122409fb60 con 0x7f122409f650 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.933+0000 7f1222d9d700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409f650 0x7f1224131d30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f121c009840 tx=0x7f121c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f404f37f122fd15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f122159a700 1 -- 172.21.15.19:0/1544516493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c010a90 con 0x7f122409f650 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f122159a700 1 -- 172.21.15.19:0/1544516493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c010bf0 con 0x7f122409f650 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f122159a700 1 -- 172.21.15.19:0/1544516493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c018440 con 0x7f122409f650 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 -- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409f650 msgr2=0x7f1224131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409f650 0x7f1224131d30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f121c009840 tx=0x7f121c009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 -- 172.21.15.19:0/1544516493 shutdown_connections 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409f650 0x7f1224131d30 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409e930 0x7f122409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1544516493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f12241317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 -- 172.21.15.19:0/1544516493 >> 172.21.15.19:0/1544516493 conn(0x7f12240a4210 msgr2=0x7f12240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.934+0000 7f1228eb3700 1 -- 172.21.15.19:0/1544516493 shutdown_connections 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.935+0000 7f1228eb3700 1 -- 172.21.15.19:0/1544516493 wait complete. 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 Processor -- start 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 -- start start 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f122411e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409f650 0x7f122411ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1224120520 con 0x7f122409e930 2023-10-03T10:18:48.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12240a2f40 con 0x7f122409f240 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1228eb3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1224121610 con 0x7f122409f650 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f122259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f1221d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f122411e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f122259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50868/0 (socket says 172.21.15.19:50868) 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.936+0000 7f122259c700 1 -- 172.21.15.19:0/1659477792 learned_addr learned my addr 172.21.15.19:0/1659477792 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1222d9d700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409f650 0x7f122411ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 -- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409f650 msgr2=0x7f122411ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409f650 0x7f122411ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 -- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 msgr2=0x7f122411e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 -- 172.21.15.19:0/1659477792 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0094a0 con 0x7f122409f240 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f122259c700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:48.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1221d9b700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f122411e930 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f120c00e8d0 tx=0x7f120c00ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00c690 con 0x7f122409f240 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c00c7f0 con 0x7f122409f240 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12240a0190 con 0x7f122409f240 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c00cb60 con 0x7f122409f240 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.937+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1224122610 con 0x7f122409f240 2023-10-03T10:18:48.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.939+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12241217e0 con 0x7f122409f240 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.939+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f120c00ccc0 con 0x7f122409f240 2023-10-03T10:18:48.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.940+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f120c03f7d0 con 0x7f122409f240 2023-10-03T10:18:48.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:48.947+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f120c0232f0 con 0x7f122409f240 2023-10-03T10:18:49.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 Processor -- start 2023-10-03T10:18:49.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 -- start start 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f341809e410 0x7f3418130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341809f520 con 0x7f341809e410 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341809f130 con 0x7f341809d6f0 2023-10-03T10:18:49.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f341daa2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f341809e930 con 0x7f341809e000 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f3416ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f34177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f34177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50750/0 (socket says 172.21.15.19:50750) 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f3416ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49430/0 (socket says 172.21.15.19:49430) 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.025+0000 7f34177fe700 1 -- 172.21.15.19:0/2121098713 learned_addr learned my addr 172.21.15.19:0/2121098713 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 -- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 msgr2=0x7f3418130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 -- 172.21.15.19:0/2121098713 >> v2:172.21.15.19:3300/0 conn(0x7f341809e410 msgr2=0x7f3418130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 --2- 172.21.15.19:0/2121098713 >> v2:172.21.15.19:3300/0 conn(0x7f341809e410 0x7f3418130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 -- 172.21.15.19:0/2121098713 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341809b2d0 con 0x7f341809d6f0 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f3416ffd700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34177fe700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3408009920 tx=0x7f3408009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c11e5f9d5db850f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34167fc700 1 -- 172.21.15.19:0/2121098713 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408011830 con 0x7f341809d6f0 2023-10-03T10:18:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34167fc700 1 -- 172.21.15.19:0/2121098713 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408011990 con 0x7f341809d6f0 2023-10-03T10:18:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.026+0000 7f34167fc700 1 -- 172.21.15.19:0/2121098713 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408011d20 con 0x7f341809d6f0 2023-10-03T10:18:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 -- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 msgr2=0x7f341809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3408009920 tx=0x7f3408009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 -- 172.21.15.19:0/2121098713 shutdown_connections 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341809dac0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 --2- 172.21.15.19:0/2121098713 >> v2:172.21.15.19:3300/0 conn(0x7f341809e410 0x7f3418130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 --2- 172.21.15.19:0/2121098713 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e000 0x7f3418130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.027+0000 7f341daa2700 1 -- 172.21.15.19:0/2121098713 >> 172.21.15.19:0/2121098713 conn(0x7f3418066f50 msgr2=0x7f341809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.029+0000 7f341daa2700 1 -- 172.21.15.19:0/2121098713 shutdown_connections 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.029+0000 7f341daa2700 1 -- 172.21.15.19:0/2121098713 wait complete. 2023-10-03T10:18:49.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.030+0000 7f341daa2700 1 Processor -- start 2023-10-03T10:18:49.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.030+0000 7f341daa2700 1 -- start start 2023-10-03T10:18:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341809e000 0x7f3418132ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f1b8ce3d700 1 Processor -- start 2023-10-03T10:18:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e410 0x7f3418133400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3418137300 con 0x7f341809e000 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341809c700 con 0x7f341809d6f0 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f341daa2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f34180725f0 con 0x7f341809e410 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f34177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f34177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50758/0 (socket says 172.21.15.19:50758) 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f34177fe700 1 -- 172.21.15.19:0/1858348187 learned_addr learned my addr 172.21.15.19:0/1858348187 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f3416ffd700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341809e000 0x7f3418132ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 -- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e410 msgr2=0x7f3418133400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e410 0x7f3418133400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 -- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341809e000 msgr2=0x7f3418132ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341809e000 0x7f3418132ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 -- 172.21.15.19:0/1858348187 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c0094a0 con 0x7f341809d6f0 2023-10-03T10:18:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f34177fe700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3408009c70 tx=0x7f3408004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3408004380 con 0x7f341809d6f0 2023-10-03T10:18:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f340801f070 con 0x7f341809d6f0 2023-10-03T10:18:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3408009550 con 0x7f341809d6f0 2023-10-03T10:18:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.031+0000 7f1b8ce3d700 1 -- start start 2023-10-03T10:18:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8ce3d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8809de00 0x7f1b8809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8ce3d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1b8813d1f0 0x7f1b8813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8ce3d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8809a810 con 0x7f1b8806a770 2023-10-03T10:18:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8ce3d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8806ab40 con 0x7f1b8813d1f0 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8ce3d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8809ebc0 con 0x7f1b8809de00 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b8806a770 0x7f1b8809d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39878/0 (socket says 172.21.15.19:39878) 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f1b8659c700 1 -- 172.21.15.19:0/3800072051 learned_addr learned my addr 172.21.15.19:0/3800072051 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 --2- 172.21.15.19:0/3800072051 >> v2:172.21.15.19:3300/0 conn(0x7f1b8813d1f0 0x7f1b8813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b8559a700 1 -- 172.21.15.19:0/3800072051 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064393992 0 0) 0x7f1b8809a810 con 0x7f1b8806a770 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b8559a700 1 -- 172.21.15.19:0/3800072051 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b700035b0 con 0x7f1b8806a770 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 -- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8809de00 msgr2=0x7f1b8809e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 --2- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8809de00 0x7f1b8809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 -- 172.21.15.19:0/3800072051 >> v1:172.21.15.19:6789/0 conn(0x7f1b8806a770 legacy=0x7f1b8809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 -- 172.21.15.19:0/3800072051 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8809e920 con 0x7f1b8813d1f0 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b86d9d700 1 --2- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8813d1f0 0x7f1b8813f5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009d90 tx=0x7f1b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a65f7b7cf79635 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f1b8559a700 1 -- 172.21.15.19:0/3800072051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000e070 con 0x7f1b8813d1f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8559a700 1 -- 172.21.15.19:0/3800072051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8000bb20 con 0x7f1b8813d1f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8559a700 1 -- 172.21.15.19:0/3800072051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b80012430 con 0x7f1b8813d1f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080036a0 con 0x7f341809d6f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.032+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3418136660 con 0x7f341809d6f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3408021030 con 0x7f341809d6f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3408040b20 con 0x7f341809d6f0 2023-10-03T10:18:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.033+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3418074ea0 con 0x7f341809d6f0 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8813d1f0 msgr2=0x7f1b8813f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8813d1f0 0x7f1b8813f5d0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009d90 tx=0x7f1b8000b330 comp rx=0 tx=0).stop 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/3800072051 shutdown_connections 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8813d1f0 0x7f1b8813f5d0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/3800072051 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8809de00 0x7f1b8809e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/3800072051 >> 172.21.15.19:0/3800072051 conn(0x7f1b88066f50 msgr2=0x7f1b8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.034+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/3800072051 shutdown_connections 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.035+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/3800072051 wait complete. 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 Processor -- start 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 -- start start 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b8809de00 0x7f1b8813b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8813d1f0 0x7f1b8813bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8811e2c0 con 0x7f1b8806a770 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8811f080 con 0x7f1b8813d1f0 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8ce3d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8811e710 con 0x7f1b8809de00 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50896/0 (socket says 172.21.15.19:50896) 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b8659c700 1 -- 172.21.15.19:0/843814774 learned_addr learned my addr 172.21.15.19:0/843814774 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.036+0000 7f1b85d9b700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b8809de00 0x7f1b8813b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 -- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b8809de00 msgr2=0x7f1b8813b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b8809de00 0x7f1b8813b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 -- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8813d1f0 msgr2=0x7f1b8813bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8813d1f0 0x7f1b8813bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 -- 172.21.15.19:0/843814774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80009a70 con 0x7f1b8806a770 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8659c700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c700 tx=0x7f1b7800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78005d70 con 0x7f1b8806a770 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b780070d0 con 0x7f1b8806a770 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8813cd80 con 0x7f1b8806a770 2023-10-03T10:18:49.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78007460 con 0x7f1b8806a770 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.037+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88072240 con 0x7f1b8806a770 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.038+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8811f7d0 con 0x7f1b8806a770 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.039+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b780075c0 con 0x7f1b8806a770 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.039+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b7803f090 con 0x7f1b8806a770 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.040+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3408015020 con 0x7f341809d6f0 2023-10-03T10:18:49.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.044+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b7800e280 con 0x7f1b8806a770 2023-10-03T10:18:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.162+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1224074ea0 con 0x7f122409f240 2023-10-03T10:18:49.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.162+0000 7f121affd700 1 -- 172.21.15.19:0/1659477792 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f120c021020 con 0x7f122409f240 2023-10-03T10:18:49.163 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.164+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 msgr2=0x7f122411e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.164+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f122411e930 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f120c00e8d0 tx=0x7f120c00ebe0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 shutdown_connections 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f122409f650 0x7f122411ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f122409e930 0x7f122411e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 --2- 172.21.15.19:0/1659477792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f122409f240 0x7f122411e930 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 >> 172.21.15.19:0/1659477792 conn(0x7f12240a4210 msgr2=0x7f1224131b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 shutdown_connections 2023-10-03T10:18:49.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.165+0000 7f1228eb3700 1 -- 172.21.15.19:0/1659477792 wait complete. 2023-10-03T10:18:49.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.272+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3418135220 con 0x7f341809d6f0 2023-10-03T10:18:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.273+0000 7f33fffff700 1 -- 172.21.15.19:0/1858348187 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f340800b9d0 con 0x7f341809d6f0 2023-10-03T10:18:49.274 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 msgr2=0x7f341812d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3408009c70 tx=0x7f3408004750 comp rx=0 tx=0).stop 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 shutdown_connections 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f341809e410 0x7f3418133400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f341809d6f0 0x7f341812d080 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 --2- 172.21.15.19:0/1858348187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f341809e000 0x7f3418132ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 >> 172.21.15.19:0/1858348187 conn(0x7f3418066f50 msgr2=0x7f341806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.275+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 shutdown_connections 2023-10-03T10:18:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.276+0000 7f341daa2700 1 -- 172.21.15.19:0/1858348187 wait complete. 2023-10-03T10:18:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.279+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1b8804ea50 con 0x7f1b8806a770 2023-10-03T10:18:49.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.279+0000 7f1b76ffd700 1 -- 172.21.15.19:0/843814774 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b78011360 con 0x7f1b8806a770 2023-10-03T10:18:49.280 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 msgr2=0x7f1b88071640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c700 tx=0x7f1b7800ca10 comp rx=0 tx=0).stop 2023-10-03T10:18:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 shutdown_connections 2023-10-03T10:18:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b8813d1f0 0x7f1b8813bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b8806a770 0x7f1b88071640 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 --2- 172.21.15.19:0/843814774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b8809de00 0x7f1b8813b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 >> 172.21.15.19:0/843814774 conn(0x7f1b88066f50 msgr2=0x7f1b8813ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 shutdown_connections 2023-10-03T10:18:49.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.282+0000 7f1b8ce3d700 1 -- 172.21.15.19:0/843814774 wait complete. 2023-10-03T10:18:49.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:49.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:49.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:49.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.985+0000 7f8860567700 1 Processor -- start 2023-10-03T10:18:49.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.985+0000 7f8860567700 1 -- start start 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.986+0000 7f8860567700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.986+0000 7f8860567700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 0x7f8858139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.986+0000 7f8860567700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885809e130 con 0x7f885809d9f0 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.986+0000 7f8860567700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88581312b0 con 0x7f885806ae80 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.986+0000 7f8860567700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f885809f6e0 con 0x7f88581316c0 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885eb04700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 0x7f8858139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49470/0 (socket says 172.21.15.19:49470) 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 -- 172.21.15.19:0/1378057264 learned_addr learned my addr 172.21.15.19:0/1378057264 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:49.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 -- 172.21.15.19:0/1378057264 >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 msgr2=0x7f8858139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:49.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 --2- 172.21.15.19:0/1378057264 >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 0x7f8858139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 -- 172.21.15.19:0/1378057264 >> v1:172.21.15.19:6789/0 conn(0x7f885809d9f0 legacy=0x7f885806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 -- 172.21.15.19:0/1378057264 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885809e760 con 0x7f88581316c0 2023-10-03T10:18:49.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885eb04700 1 --2- 172.21.15.19:0/1378057264 >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 0x7f8858139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885e303700 1 --2- 172.21.15.19:0/1378057264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f88540098f0 tx=0x7f8854009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5154084602879041 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885d301700 1 -- 172.21.15.19:0/1378057264 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854011830 con 0x7f88581316c0 2023-10-03T10:18:49.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885d301700 1 -- 172.21.15.19:0/1378057264 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854011990 con 0x7f88581316c0 2023-10-03T10:18:49.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.987+0000 7f885d301700 1 -- 172.21.15.19:0/1378057264 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854011d20 con 0x7f88581316c0 2023-10-03T10:18:49.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 -- 172.21.15.19:0/1378057264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 msgr2=0x7f8858131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 --2- 172.21.15.19:0/1378057264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f88540098f0 tx=0x7f8854009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 -- 172.21.15.19:0/1378057264 shutdown_connections 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 --2- 172.21.15.19:0/1378057264 >> v2:172.21.15.19:3300/0 conn(0x7f885806ae80 0x7f8858139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 --2- 172.21.15.19:0/1378057264 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88581316c0 0x7f8858131a90 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 -- 172.21.15.19:0/1378057264 >> 172.21.15.19:0/1378057264 conn(0x7f8858066f50 msgr2=0x7f885809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 -- 172.21.15.19:0/1378057264 shutdown_connections 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.988+0000 7f8860567700 1 -- 172.21.15.19:0/1378057264 wait complete. 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.989+0000 7f8860567700 1 Processor -- start 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.989+0000 7f8860567700 1 -- start start 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.989+0000 7f8860567700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 0x7f88580710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88581316c0 0x7f88580715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885812b970 con 0x7f88581316c0 2023-10-03T10:18:49.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885811ac20 con 0x7f885806ae80 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f885811a960 con 0x7f885809d9f0 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885e303700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 0x7f88580710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885e303700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50768/0 (socket says 172.21.15.19:50768) 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885e303700 1 -- 172.21.15.19:0/3128272337 learned_addr learned my addr 172.21.15.19:0/3128272337 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885eb04700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88581316c0 0x7f88580715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 -- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 msgr2=0x7f8858070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 -- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88581316c0 msgr2=0x7f88580715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:49.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88581316c0 0x7f88580715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 -- 172.21.15.19:0/3128272337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850009a70 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885e303700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f885db02700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 0x7f88580710a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f885809d810 tx=0x7f884800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480052d0 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8848005430 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480038c0 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8854009550 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.990+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885811b690 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.991+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8848003a20 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.991+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858074ea0 con 0x7f885809d9f0 2023-10-03T10:18:49.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.991+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f884803e750 con 0x7f885809d9f0 2023-10-03T10:18:49.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:49.996+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f884801b3b0 con 0x7f885809d9f0 2023-10-03T10:18:50.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.202+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f885809e130 con 0x7f885809d9f0 2023-10-03T10:18:50.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.203+0000 7f884effd700 1 -- 172.21.15.19:0/3128272337 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f885809e130 con 0x7f885809d9f0 2023-10-03T10:18:50.203 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:50.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 msgr2=0x7f88580710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 0x7f88580710a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f885809d810 tx=0x7f884800c730 comp rx=0 tx=0).stop 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 shutdown_connections 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88581316c0 0x7f88580715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f885806ae80 0x7f8858070b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 --2- 172.21.15.19:0/3128272337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f885809d9f0 0x7f88580710a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 >> 172.21.15.19:0/3128272337 conn(0x7f8858066f50 msgr2=0x7f88580a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 shutdown_connections 2023-10-03T10:18:50.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.205+0000 7f8860567700 1 -- 172.21.15.19:0/3128272337 wait complete. 2023-10-03T10:18:50.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:50.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:50.298 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.322+0000 7f4226d77700 1 Processor -- start 2023-10-03T10:18:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.322+0000 7f4226d77700 1 -- start start 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 0x7f4220130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e410 0x7f4220130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422009f520 con 0x7f422009e000 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422009f130 con 0x7f422009e410 2023-10-03T10:18:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4226d77700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422009e930 con 0x7f422009d6f0 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f421ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 0x7f4220130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f421ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 0x7f4220130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50924/0 (socket says 172.21.15.19:50924) 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4225314700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e410 0x7f4220130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f421ffff700 1 -- 172.21.15.19:0/270889228 learned_addr learned my addr 172.21.15.19:0/270889228 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.323+0000 7f4224b13700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 -- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e410 msgr2=0x7f4220130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e410 0x7f4220130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 -- 172.21.15.19:0/270889228 >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 msgr2=0x7f4220130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 --2- 172.21.15.19:0/270889228 >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 0x7f4220130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 -- 172.21.15.19:0/270889228 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422009b2d0 con 0x7f422009d6f0 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f4224b13700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422009dac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4214009870 tx=0x7f4214009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=639a139722919d0f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f421f7fe700 1 -- 172.21.15.19:0/270889228 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011830 con 0x7f422009d6f0 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f421f7fe700 1 -- 172.21.15.19:0/270889228 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4214011990 con 0x7f422009d6f0 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.324+0000 7f421f7fe700 1 -- 172.21.15.19:0/270889228 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4214011d20 con 0x7f422009d6f0 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 -- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 msgr2=0x7f422009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422009dac0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4214009870 tx=0x7f4214009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 -- 172.21.15.19:0/270889228 shutdown_connections 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e410 0x7f4220130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 --2- 172.21.15.19:0/270889228 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422009dac0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 --2- 172.21.15.19:0/270889228 >> v2:172.21.15.19:3300/0 conn(0x7f422009e000 0x7f4220130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 -- 172.21.15.19:0/270889228 >> 172.21.15.19:0/270889228 conn(0x7f4220066f50 msgr2=0x7f422009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 -- 172.21.15.19:0/270889228 shutdown_connections 2023-10-03T10:18:50.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.325+0000 7f4226d77700 1 -- 172.21.15.19:0/270889228 wait complete. 2023-10-03T10:18:50.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.326+0000 7f4226d77700 1 Processor -- start 2023-10-03T10:18:50.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.326+0000 7f4226d77700 1 -- start start 2023-10-03T10:18:50.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422012c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 0x7f422012caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 0x7f422012d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220136550 con 0x7f422009e410 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4220072560 con 0x7f422009e000 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4226d77700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f422009c700 con 0x7f422009d6f0 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4225314700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 0x7f422012d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4224b13700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422012c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 0x7f422012caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4225314700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 0x7f422012d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50938/0 (socket says 172.21.15.19:50938) 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f4225314700 1 -- 172.21.15.19:0/3391380548 learned_addr learned my addr 172.21.15.19:0/3391380548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:50.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 -- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 msgr2=0x7f422012c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422012c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 -- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 msgr2=0x7f422012d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 0x7f422012d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.327+0000 7f421ffff700 1 -- 172.21.15.19:0/3391380548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42140094a0 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f421ffff700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 0x7f422012caf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f420c00e840 tx=0x7f420c00eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c013680 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c0137e0 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42201349c0 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c013b50 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.328+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220137410 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.329+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f420c013cb0 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.329+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f420c03f560 con 0x7f422009e000 2023-10-03T10:18:50.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.329+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4220074ea0 con 0x7f422009e000 2023-10-03T10:18:50.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.335+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f420c01bdc0 con 0x7f422009e000 2023-10-03T10:18:50.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.433+0000 7f4730379700 1 Processor -- start 2023-10-03T10:18:50.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 -- start start 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 0x7f4728131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 0x7f4728139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47281313c0 con 0x7f4728099a40 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472809b580 con 0x7f472809a580 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f4730379700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472806e8c0 con 0x7f4728131810 2023-10-03T10:18:50.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f472e916700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 0x7f4728139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f472d914700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4728099a40 0x7f4728099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39894/0 (socket says 172.21.15.19:39894) 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f472d914700 1 -- 172.21.15.19:0/2515931725 learned_addr learned my addr 172.21.15.19:0/2515931725 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.434+0000 7f472e115700 1 --2- 172.21.15.19:0/2515931725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 0x7f4728131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e115700 1 -- 172.21.15.19:0/2515931725 >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 msgr2=0x7f4728139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e115700 1 --2- 172.21.15.19:0/2515931725 >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 0x7f4728139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e115700 1 -- 172.21.15.19:0/2515931725 >> v1:172.21.15.19:6789/0 conn(0x7f4728099a40 legacy=0x7f4728099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e115700 1 -- 172.21.15.19:0/2515931725 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4728071d20 con 0x7f4728131810 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472d113700 1 -- 172.21.15.19:0/2515931725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018327330 0 0) 0x7f47281313c0 con 0x7f4728099a40 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e916700 1 --2- 172.21.15.19:0/2515931725 >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 0x7f4728139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472e115700 1 --2- 172.21.15.19:0/2515931725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 0x7f4728131be0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4724009870 tx=0x7f4724009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97056530ea59b99e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472d113700 1 -- 172.21.15.19:0/2515931725 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011830 con 0x7f4728131810 2023-10-03T10:18:50.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472d113700 1 -- 172.21.15.19:0/2515931725 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724011990 con 0x7f4728131810 2023-10-03T10:18:50.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.435+0000 7f472d113700 1 -- 172.21.15.19:0/2515931725 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724011d20 con 0x7f4728131810 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 -- 172.21.15.19:0/2515931725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 msgr2=0x7f4728131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 --2- 172.21.15.19:0/2515931725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 0x7f4728131be0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4724009870 tx=0x7f4724009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 -- 172.21.15.19:0/2515931725 shutdown_connections 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 --2- 172.21.15.19:0/2515931725 >> v2:172.21.15.19:3300/0 conn(0x7f472809a580 0x7f4728139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 --2- 172.21.15.19:0/2515931725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728131810 0x7f4728131be0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 -- 172.21.15.19:0/2515931725 >> 172.21.15.19:0/2515931725 conn(0x7f47280a2aa0 msgr2=0x7f47280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 -- 172.21.15.19:0/2515931725 shutdown_connections 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.436+0000 7f4730379700 1 -- 172.21.15.19:0/2515931725 wait complete. 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 Processor -- start 2023-10-03T10:18:50.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 -- start start 2023-10-03T10:18:50.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 0x7f472806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4728131810 0x7f4728070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472811efe0 con 0x7f4728131810 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472812cb60 con 0x7f472809a580 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.438+0000 7f4730379700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f472811df80 con 0x7f4728099a40 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49526/0 (socket says 172.21.15.19:49526) 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 -- 172.21.15.19:0/382509984 learned_addr learned my addr 172.21.15.19:0/382509984 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472d914700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 0x7f472806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e916700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4728131810 0x7f4728070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 -- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 msgr2=0x7f472806fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 0x7f472806fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 -- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4728131810 msgr2=0x7f4728070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4728131810 0x7f4728070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 -- 172.21.15.19:0/382509984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4720009a70 con 0x7f4728099a40 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472d914700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 0x7f472806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:50.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f472e115700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4724000c00 tx=0x7f4724004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47240036a0 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472401f070 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.439+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240094a0 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.440+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724003a20 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.440+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472806eb00 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.441+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4724003b80 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.441+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4728074ea0 con 0x7f4728099a40 2023-10-03T10:18:50.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.441+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4724021070 con 0x7f4728099a40 2023-10-03T10:18:50.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.446+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4724015030 con 0x7f4728099a40 2023-10-03T10:18:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 Processor -- start 2023-10-03T10:18:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 -- start start 2023-10-03T10:18:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 0x7fb02c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c09ece0 con 0x7fb02c06a770 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c06b640 con 0x7fb02c136d80 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.465+0000 7fb03241d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c09e760 con 0x7fb02c06b250 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb0309ba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb02bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb02c06a770 0x7fb02c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39902/0 (socket says 172.21.15.19:39902) 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb02bfff700 1 -- 172.21.15.19:0/1937615488 learned_addr learned my addr 172.21.15.19:0/1937615488 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 0x7fb02c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 22833696 0 0) 0x7fb02c09ece0 con 0x7fb02c06a770 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0180035b0 con 0x7fb02c06a770 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 -- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 msgr2=0x7fb02c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 -- 172.21.15.19:0/1937615488 >> v1:172.21.15.19:6789/0 conn(0x7fb02c06a770 legacy=0x7fb02c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264714666 0 0) 0x7fb0180035b0 con 0x7fb02c06a770 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 -- 172.21.15.19:0/1937615488 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c09e040 con 0x7fb02c06b250 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.466+0000 7fb023fff700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 0x7fb02c136840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb014009870 tx=0x7fb014009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a336edfe49ee21 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c001670 con 0x7fb02c06b250 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014004030 con 0x7fb02c06b250 2023-10-03T10:18:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb02b7fe700 1 -- 172.21.15.19:0/1937615488 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140043c0 con 0x7fb02c06b250 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 -- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 msgr2=0x7fb02c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 0x7fb02c136840 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb014009870 tx=0x7fb014009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 -- 172.21.15.19:0/1937615488 shutdown_connections 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 --2- 172.21.15.19:0/1937615488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06b250 0x7fb02c136840 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 -- 172.21.15.19:0/1937615488 >> 172.21.15.19:0/1937615488 conn(0x7fb02c066f50 msgr2=0x7fb02c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 -- 172.21.15.19:0/1937615488 shutdown_connections 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.467+0000 7fb03241d700 1 -- 172.21.15.19:0/1937615488 wait complete. 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.468+0000 7fb03241d700 1 Processor -- start 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.468+0000 7fb03241d700 1 -- start start 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 0x7fb02c121860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 0x7fb02c121da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c1222e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c124de0 con 0x7fb02c06b250 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c123cd0 con 0x7fb02c136d80 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb03241d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c123510 con 0x7fb02c06a770 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb023fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 0x7fb02c121da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb02bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 0x7fb02c121860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb023fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 0x7fb02c121da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50960/0 (socket says 172.21.15.19:50960) 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb023fff700 1 -- 172.21.15.19:0/2743318774 learned_addr learned my addr 172.21.15.19:0/2743318774 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb0309ba700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c1222e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb02bfff700 1 -- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 msgr2=0x7fb02c1222e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.469+0000 7fb02bfff700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c1222e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb02bfff700 1 -- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 msgr2=0x7fb02c121da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb02bfff700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 0x7fb02c121da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb02bfff700 1 -- 172.21.15.19:0/2743318774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140094a0 con 0x7fb02c06a770 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb02bfff700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 0x7fb02c121860 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c550 tx=0x7fb01c00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c004c80 con 0x7fb02c06a770 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c004e00 con 0x7fb02c06a770 2023-10-03T10:18:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c09a7c0 con 0x7fb02c06a770 2023-10-03T10:18:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c007310 con 0x7fb02c06a770 2023-10-03T10:18:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.470+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c125b10 con 0x7fb02c06a770 2023-10-03T10:18:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.471+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c074ea0 con 0x7fb02c06a770 2023-10-03T10:18:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.471+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb01c007470 con 0x7fb02c06a770 2023-10-03T10:18:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.471+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb01c03f2d0 con 0x7fb02c06a770 2023-10-03T10:18:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.476+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb01c0133c0 con 0x7fb02c06a770 2023-10-03T10:18:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.549+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f422006c360 con 0x7f422009e000 2023-10-03T10:18:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.550+0000 7f421d7fa700 1 -- 172.21.15.19:0/3391380548 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f420c021020 con 0x7f422009e000 2023-10-03T10:18:50.551 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 msgr2=0x7f422012caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 0x7f422012caf0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f420c00e840 tx=0x7f420c00eb50 comp rx=0 tx=0).stop 2023-10-03T10:18:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 shutdown_connections 2023-10-03T10:18:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f422009e410 0x7f422012d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f422009d6f0 0x7f422012c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 --2- 172.21.15.19:0/3391380548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f422009e000 0x7f422012caf0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 >> 172.21.15.19:0/3391380548 conn(0x7f4220066f50 msgr2=0x7f422006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 shutdown_connections 2023-10-03T10:18:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.553+0000 7f4226d77700 1 -- 172.21.15.19:0/3391380548 wait complete. 2023-10-03T10:18:50.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:50.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.657+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f472806b9e0 con 0x7f4728099a40 2023-10-03T10:18:50.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.658+0000 7f471effd700 1 -- 172.21.15.19:0/382509984 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4724024cc0 con 0x7f4728099a40 2023-10-03T10:18:50.659 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:50.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 msgr2=0x7f472806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4724000c00 tx=0x7f4724004750 comp rx=0 tx=0).stop 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 shutdown_connections 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4728131810 0x7f4728070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4728099a40 0x7f472806f610 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 --2- 172.21.15.19:0/382509984 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f472809a580 0x7f472806fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 >> 172.21.15.19:0/382509984 conn(0x7f47280a2aa0 msgr2=0x7f472812e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 shutdown_connections 2023-10-03T10:18:50.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.660+0000 7f4730379700 1 -- 172.21.15.19:0/382509984 wait complete. 2023-10-03T10:18:50.675 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:50.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.684+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb02c06c360 con 0x7fb02c06a770 2023-10-03T10:18:50.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.685+0000 7fb0297fa700 1 -- 172.21.15.19:0/2743318774 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb01c011360 con 0x7fb02c06a770 2023-10-03T10:18:50.686 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:50.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 msgr2=0x7fb02c121860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:50.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 0x7fb02c121860 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fb01c00c550 tx=0x7fb01c00c860 comp rx=0 tx=0).stop 2023-10-03T10:18:50.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 shutdown_connections 2023-10-03T10:18:50.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb02c136d80 0x7fb02c1222e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb02c06a770 0x7fb02c121860 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 --2- 172.21.15.19:0/2743318774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb02c06b250 0x7fb02c121da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:50.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 >> 172.21.15.19:0/2743318774 conn(0x7fb02c066f50 msgr2=0x7fb02c1bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:50.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 shutdown_connections 2023-10-03T10:18:50.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:50.687+0000 7fb03241d700 1 -- 172.21.15.19:0/2743318774 wait complete. 2023-10-03T10:18:50.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:51.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 Processor -- start 2023-10-03T10:18:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 -- start start 2023-10-03T10:18:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07ec09d630 0x7f07ec0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07ec0a2a70 con 0x7f07ec133930 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ec0a01d0 con 0x7f07ec09d630 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07f1a2e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec09e2b0 con 0x7f07ec0a0a30 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07ea7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07ec09d630 0x7f07ec0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07eb7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f07ec133930 0x7f07ec133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39918/0 (socket says 172.21.15.19:39918) 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.368+0000 7f07eaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07eb7fe700 1 -- 172.21.15.19:0/368344220 learned_addr learned my addr 172.21.15.19:0/368344220 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07ea7fc700 1 -- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 msgr2=0x7f07ec0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07ea7fc700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07ea7fc700 1 -- 172.21.15.19:0/368344220 >> v1:172.21.15.19:6789/0 conn(0x7f07ec133930 legacy=0x7f07ec133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07ea7fc700 1 -- 172.21.15.19:0/368344220 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec09dc50 con 0x7f07ec09d630 2023-10-03T10:18:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07e9ffb700 1 -- 172.21.15.19:0/368344220 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934095353 0 0) 0x7f07ec0a2a70 con 0x7f07ec133930 2023-10-03T10:18:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07eaffd700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07ea7fc700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec09d630 0x7f07ec0a1340 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009840 tx=0x7f07e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22452120c7efdb58 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07e9ffb700 1 -- 172.21.15.19:0/368344220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0011830 con 0x7f07ec09d630 2023-10-03T10:18:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07e9ffb700 1 -- 172.21.15.19:0/368344220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0011990 con 0x7f07ec09d630 2023-10-03T10:18:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.369+0000 7f07e9ffb700 1 -- 172.21.15.19:0/368344220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e0011d20 con 0x7f07ec09d630 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 -- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec09d630 msgr2=0x7f07ec0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec09d630 0x7f07ec0a1340 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009840 tx=0x7f07e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 -- 172.21.15.19:0/368344220 shutdown_connections 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/368344220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec09d630 0x7f07ec0a1340 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 -- 172.21.15.19:0/368344220 >> 172.21.15.19:0/368344220 conn(0x7f07ec0a3050 msgr2=0x7f07ec0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 -- 172.21.15.19:0/368344220 shutdown_connections 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.370+0000 7f07f1a2e700 1 -- 172.21.15.19:0/368344220 wait complete. 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 Processor -- start 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 -- start start 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 0x7f07ec1c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec1c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec1210e0 con 0x7f07ec133930 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec1207f0 con 0x7f07ec0a0a30 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.371+0000 7f07f1a2e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ec1209e0 con 0x7f07ec09d630 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07ea7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec1c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50966/0 (socket says 172.21.15.19:50966) 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 -- 172.21.15.19:0/448628697 learned_addr learned my addr 172.21.15.19:0/448628697 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eaffd700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 0x7f07ec1c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 -- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 msgr2=0x7f07ec1c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 0x7f07ec1c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 -- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 msgr2=0x7f07ec1c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec1c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 -- 172.21.15.19:0/448628697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc0094a0 con 0x7f07ec133930 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07ea7fc700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eaffd700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 0x7f07ec1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07eb7fe700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f07e400cc70 tx=0x7f07e400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e400aac0 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e400ac40 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00094a0 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.372+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e40070d0 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.373+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ec0a0410 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.373+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07e4007250 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.373+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07e403f4f0 con 0x7f07ec133930 2023-10-03T10:18:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.374+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ec122380 con 0x7f07ec133930 2023-10-03T10:18:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.378+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07e4018080 con 0x7f07ec133930 2023-10-03T10:18:51.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:51.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.584+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07ec0a5780 con 0x7f07ec133930 2023-10-03T10:18:51.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.585+0000 7f07d3fff700 1 -- 172.21.15.19:0/448628697 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07e4007500 con 0x7f07ec133930 2023-10-03T10:18:51.586 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:51.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 msgr2=0x7f07ec1c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f07e400cc70 tx=0x7f07e400cf80 comp rx=0 tx=0).stop 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 shutdown_connections 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ec133930 0x7f07ec1c8c10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ec09d630 0x7f07ec1c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 --2- 172.21.15.19:0/448628697 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ec0a0a30 0x7f07ec1c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.587+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 >> 172.21.15.19:0/448628697 conn(0x7f07ec0a3050 msgr2=0x7f07ec1bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.588+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 shutdown_connections 2023-10-03T10:18:51.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.588+0000 7f07f1a2e700 1 -- 172.21.15.19:0/448628697 wait complete. 2023-10-03T10:18:51.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:51.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:51.703 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:51.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.706+0000 7f88276eb700 1 Processor -- start 2023-10-03T10:18:51.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.706+0000 7f88276eb700 1 -- start start 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f88276eb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 0x7f88200a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f88276eb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 0x7f882013b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f88276eb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88200a2a70 con 0x7f88200a0a30 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f88276eb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88200a01d0 con 0x7f8820138d80 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f88276eb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f882009e2b0 con 0x7f882009d630 2023-10-03T10:18:51.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8825c88700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 0x7f882013b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8825487700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f88200a0a30 0x7f88200a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39932/0 (socket says 172.21.15.19:39932) 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8825c88700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 0x7f882013b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50980/0 (socket says 172.21.15.19:50980) 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8825487700 1 -- 172.21.15.19:0/3985115794 learned_addr learned my addr 172.21.15.19:0/3985115794 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8824c86700 1 --2- 172.21.15.19:0/3985115794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 0x7f88200a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8824c86700 1 -- 172.21.15.19:0/3985115794 >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 msgr2=0x7f882013b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8824c86700 1 --2- 172.21.15.19:0/3985115794 >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 0x7f882013b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.707+0000 7f8824c86700 1 -- 172.21.15.19:0/3985115794 >> v1:172.21.15.19:6789/0 conn(0x7f88200a0a30 legacy=0x7f88200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8824c86700 1 -- 172.21.15.19:0/3985115794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882009dc50 con 0x7f882009d630 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8817fff700 1 -- 172.21.15.19:0/3985115794 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101891926 0 0) 0x7f88200a2a70 con 0x7f88200a0a30 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8824c86700 1 --2- 172.21.15.19:0/3985115794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 0x7f88200a1510 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8810009840 tx=0x7f8810009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcc9d22818e4ec2c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8817fff700 1 -- 172.21.15.19:0/3985115794 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011830 con 0x7f882009d630 2023-10-03T10:18:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8817fff700 1 -- 172.21.15.19:0/3985115794 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810011990 con 0x7f882009d630 2023-10-03T10:18:51.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.708+0000 7f8817fff700 1 -- 172.21.15.19:0/3985115794 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810011d20 con 0x7f882009d630 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 -- 172.21.15.19:0/3985115794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 msgr2=0x7f88200a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 --2- 172.21.15.19:0/3985115794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 0x7f88200a1510 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8810009840 tx=0x7f8810009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 -- 172.21.15.19:0/3985115794 shutdown_connections 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 --2- 172.21.15.19:0/3985115794 >> v2:172.21.15.19:3300/0 conn(0x7f8820138d80 0x7f882013b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 --2- 172.21.15.19:0/3985115794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f882009d630 0x7f88200a1510 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 -- 172.21.15.19:0/3985115794 >> 172.21.15.19:0/3985115794 conn(0x7f88200a3050 msgr2=0x7f88200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 -- 172.21.15.19:0/3985115794 shutdown_connections 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.709+0000 7f88276eb700 1 -- 172.21.15.19:0/3985115794 wait complete. 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.710+0000 7f88276eb700 1 Processor -- start 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.710+0000 7f88276eb700 1 -- start start 2023-10-03T10:18:51.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f882009d630 0x7f88201336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8820138d80 0x7f8820134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8820137130 con 0x7f8820138d80 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8820136020 con 0x7f882009d630 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f88276eb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f882013ac80 con 0x7f88200a0a30 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f8824c86700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f8825487700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f882009d630 0x7f88201336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f8824c86700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49568/0 (socket says 172.21.15.19:49568) 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.711+0000 7f8824c86700 1 -- 172.21.15.19:0/425689496 learned_addr learned my addr 172.21.15.19:0/425689496 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8825c88700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8820138d80 0x7f8820134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 -- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f882009d630 msgr2=0x7f88201336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f882009d630 0x7f88201336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 -- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8820138d80 msgr2=0x7f8820134120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8820138d80 0x7f8820134120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 -- 172.21.15.19:0/425689496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094a0 con 0x7f88200a0a30 2023-10-03T10:18:51.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8824c86700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f8810004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100036a0 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881001f070 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88200a0410 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.712+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810003a60 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.713+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8820134a70 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.714+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8810003bc0 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.714+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8810021070 con 0x7f88200a0a30 2023-10-03T10:18:51.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.714+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88200747f0 con 0x7f88200a0a30 2023-10-03T10:18:51.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.719+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88100253e0 con 0x7f88200a0a30 2023-10-03T10:18:51.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 Processor -- start 2023-10-03T10:18:51.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 -- start start 2023-10-03T10:18:51.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 0x7fd1d4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 0x7fd1d413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d409b120 con 0x7fd1d409d6f0 2023-10-03T10:18:51.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d406b460 con 0x7fd1d409e1d0 2023-10-03T10:18:51.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d9fb5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d409a7e0 con 0x7fd1d4139170 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 0x7fd1d4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.830+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 0x7fd1d413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd1d409d6f0 0x7fd1d409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39936/0 (socket says 172.21.15.19:39936) 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d37fe700 1 -- 172.21.15.19:0/2107864402 learned_addr learned my addr 172.21.15.19:0/2107864402 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d3fff700 1 -- 172.21.15.19:0/2107864402 >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 msgr2=0x7fd1d4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d3fff700 1 --2- 172.21.15.19:0/2107864402 >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 0x7fd1d4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d3fff700 1 -- 172.21.15.19:0/2107864402 >> v1:172.21.15.19:6789/0 conn(0x7fd1d409d6f0 legacy=0x7fd1d409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d3fff700 1 -- 172.21.15.19:0/2107864402 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d409a500 con 0x7fd1d4139170 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d27fc700 1 -- 172.21.15.19:0/2107864402 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539399318 0 0) 0x7fd1d409b120 con 0x7fd1d409d6f0 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d2ffd700 1 --2- 172.21.15.19:0/2107864402 >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 0x7fd1d4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d3fff700 1 --2- 172.21.15.19:0/2107864402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 0x7fd1d413b550 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009dc0 tx=0x7fd1cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa85e0dd4cc6d2fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d27fc700 1 -- 172.21.15.19:0/2107864402 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00e070 con 0x7fd1d4139170 2023-10-03T10:18:51.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d27fc700 1 -- 172.21.15.19:0/2107864402 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00bae0 con 0x7fd1d4139170 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.831+0000 7fd1d27fc700 1 -- 172.21.15.19:0/2107864402 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00be90 con 0x7fd1d4139170 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2107864402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 msgr2=0x7fd1d413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2107864402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 0x7fd1d413b550 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009dc0 tx=0x7fd1cc00b330 comp rx=0 tx=0).stop 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2107864402 shutdown_connections 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2107864402 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d4139170 0x7fd1d413b550 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2107864402 >> v2:172.21.15.19:3300/0 conn(0x7fd1d409e1d0 0x7fd1d4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2107864402 >> 172.21.15.19:0/2107864402 conn(0x7fd1d4066f50 msgr2=0x7fd1d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2107864402 shutdown_connections 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.832+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2107864402 wait complete. 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.833+0000 7fd1d9fb5700 1 Processor -- start 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.833+0000 7fd1d9fb5700 1 -- start start 2023-10-03T10:18:51.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 0x7fd1d411ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4122210 con 0x7fd1d4139170 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d4134540 con 0x7fd1d409d6f0 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d9fb5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d409c710 con 0x7fd1d409e1d0 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50882/0 (socket says 172.21.15.19:50882) 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51002/0 (socket says 172.21.15.19:51002) 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 -- 172.21.15.19:0/2802450060 learned_addr learned my addr 172.21.15.19:0/2802450060 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d2ffd700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 0x7fd1d411ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 -- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 msgr2=0x7fd1d411ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 0x7fd1d411ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 -- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 msgr2=0x7fd1d411f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 -- 172.21.15.19:0/2802450060 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094a0 con 0x7fd1d409d6f0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d3fff700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d2ffd700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 0x7fd1d411ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.834+0000 7fd1d37fe700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c550 tx=0x7fd1c400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.835+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4004c80 con 0x7fd1d409d6f0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.835+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c4004e00 con 0x7fd1d409d6f0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.835+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1cc009a70 con 0x7fd1d409d6f0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.835+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4007310 con 0x7fd1d409d6f0 2023-10-03T10:18:51.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.835+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d4120ac0 con 0x7fd1d409d6f0 2023-10-03T10:18:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.836+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1c4007470 con 0x7fd1d409d6f0 2023-10-03T10:18:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.836+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d4121fb0 con 0x7fd1d409d6f0 2023-10-03T10:18:51.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.836+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1c403f3c0 con 0x7fd1d409d6f0 2023-10-03T10:18:51.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.841+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1c40133c0 con 0x7fd1d409d6f0 2023-10-03T10:18:51.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.851+0000 7efd2a2f8700 1 Processor -- start 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.851+0000 7efd2a2f8700 1 -- start start 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 0x7efd24130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2409f520 con 0x7efd2409e000 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2409f130 con 0x7efd2409d6f0 2023-10-03T10:18:51.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd2a2f8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd2409e930 con 0x7efd2409e410 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd237fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 0x7efd24130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd237fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 0x7efd24130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51008/0 (socket says 172.21.15.19:51008) 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd237fe700 1 -- 172.21.15.19:0/440287321 learned_addr learned my addr 172.21.15.19:0/440287321 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50892/0 (socket says 172.21.15.19:50892) 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd28895700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 -- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 msgr2=0x7efd24130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 -- 172.21.15.19:0/440287321 >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 msgr2=0x7efd24130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 --2- 172.21.15.19:0/440287321 >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 0x7efd24130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd23fff700 1 -- 172.21.15.19:0/440287321 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2409b2d0 con 0x7efd2409d6f0 2023-10-03T10:18:51.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.852+0000 7efd28895700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd23fff700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd1400bae0 tx=0x7efd1400bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6863d72943f7e02c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd22ffd700 1 -- 172.21.15.19:0/440287321 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1400dc70 con 0x7efd2409d6f0 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd22ffd700 1 -- 172.21.15.19:0/440287321 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1400ddd0 con 0x7efd2409d6f0 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd22ffd700 1 -- 172.21.15.19:0/440287321 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14010690 con 0x7efd2409d6f0 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 -- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 msgr2=0x7efd2409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7efd1400bae0 tx=0x7efd1400bdf0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 -- 172.21.15.19:0/440287321 shutdown_connections 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd2409dac0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/440287321 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/440287321 >> v2:172.21.15.19:3300/0 conn(0x7efd2409e000 0x7efd24130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 -- 172.21.15.19:0/440287321 >> 172.21.15.19:0/440287321 conn(0x7efd24066f50 msgr2=0x7efd2409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 -- 172.21.15.19:0/440287321 shutdown_connections 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.853+0000 7efd2a2f8700 1 -- 172.21.15.19:0/440287321 wait complete. 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.854+0000 7efd2a2f8700 1 Processor -- start 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 -- start start 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd24122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd24125cb0 con 0x7efd2409e000 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd24124190 con 0x7efd2409d6f0 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd2a2f8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd240a18c0 con 0x7efd2409e410 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd237fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd28895700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd237fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51010/0 (socket says 172.21.15.19:51010) 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd28895700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24122ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49598/0 (socket says 172.21.15.19:49598) 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd237fe700 1 -- 172.21.15.19:0/1092985624 learned_addr learned my addr 172.21.15.19:0/1092985624 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.855+0000 7efd23fff700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd24122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 -- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 msgr2=0x7efd24122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 -- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 msgr2=0x7efd24122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd24122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 -- 172.21.15.19:0/1092985624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009a70 con 0x7efd2409e000 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd23fff700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd24122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd237fe700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7efd1800e980 tx=0x7efd1800ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1800ee60 con 0x7efd2409e000 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1800c850 con 0x7efd2409e000 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1400b740 con 0x7efd2409e000 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1800cbc0 con 0x7efd2409e000 2023-10-03T10:18:51.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.856+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2409c750 con 0x7efd2409e000 2023-10-03T10:18:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.857+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd1800cd20 con 0x7efd2409e000 2023-10-03T10:18:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.857+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd1803fbb0 con 0x7efd2409e000 2023-10-03T10:18:51.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.857+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd241267e0 con 0x7efd2409e000 2023-10-03T10:18:51.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.863+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd18017080 con 0x7efd2409e000 2023-10-03T10:18:51.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.947+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8820072980 con 0x7f88200a0a30 2023-10-03T10:18:51.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.948+0000 7f8815ffb700 1 -- 172.21.15.19:0/425689496 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8810010b70 con 0x7f88200a0a30 2023-10-03T10:18:51.949 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:51.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 msgr2=0x7f8820133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:51.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f8810009fd0 tx=0x7f8810004750 comp rx=0 tx=0).stop 2023-10-03T10:18:51.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 shutdown_connections 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8820138d80 0x7f8820134120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f882009d630 0x7f88201336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 --2- 172.21.15.19:0/425689496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88200a0a30 0x7f8820133be0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 >> 172.21.15.19:0/425689496 conn(0x7f88200a3050 msgr2=0x7f88200a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 shutdown_connections 2023-10-03T10:18:51.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:51.950+0000 7f88276eb700 1 -- 172.21.15.19:0/425689496 wait complete. 2023-10-03T10:18:51.965 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.052+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd1d4074ea0 con 0x7fd1d409d6f0 2023-10-03T10:18:52.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.052+0000 7fd1bbfff700 1 -- 172.21.15.19:0/2802450060 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1c4011360 con 0x7fd1d409d6f0 2023-10-03T10:18:52.053 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:52.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 msgr2=0x7fd1d411e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400c550 tx=0x7fd1c400c860 comp rx=0 tx=0).stop 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 shutdown_connections 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1d4139170 0x7fd1d411f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1d409d6f0 0x7fd1d411e720 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 --2- 172.21.15.19:0/2802450060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1d409e1d0 0x7fd1d411ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.054+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 >> 172.21.15.19:0/2802450060 conn(0x7fd1d4066f50 msgr2=0x7fd1d4136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.055+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 shutdown_connections 2023-10-03T10:18:52.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.055+0000 7fd1d9fb5700 1 -- 172.21.15.19:0/2802450060 wait complete. 2023-10-03T10:18:52.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:52.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.073+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efd24074ea0 con 0x7efd2409e000 2023-10-03T10:18:52.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.073+0000 7efd20ff9700 1 -- 172.21.15.19:0/1092985624 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd1801adc0 con 0x7efd2409e000 2023-10-03T10:18:52.074 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 msgr2=0x7efd241229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7efd1800e980 tx=0x7efd1800ed40 comp rx=0 tx=0).stop 2023-10-03T10:18:52.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 shutdown_connections 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd2409e410 0x7efd24122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd2409d6f0 0x7efd24122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 --2- 172.21.15.19:0/1092985624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd2409e000 0x7efd241229b0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 >> 172.21.15.19:0/1092985624 conn(0x7efd24066f50 msgr2=0x7efd2406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 shutdown_connections 2023-10-03T10:18:52.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.075+0000 7efd2a2f8700 1 -- 172.21.15.19:0/1092985624 wait complete. 2023-10-03T10:18:52.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:52.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 Processor -- start 2023-10-03T10:18:52.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 -- start start 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b30138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 0x7f8b3013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b3009b120 con 0x7f8b3009d6f0 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3006b460 con 0x7f8b3009e1d0 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b36312700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3009a7e0 con 0x7f8b30139170 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b30138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b2ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8b3009d6f0 0x7f8b3009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39946/0 (socket says 172.21.15.19:39946) 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b2ffff700 1 -- 172.21.15.19:0/260173791 learned_addr learned my addr 172.21.15.19:0/260173791 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:52.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.750+0000 7f8b348af700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 0x7f8b3013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2effd700 1 -- 172.21.15.19:0/260173791 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926610796 0 0) 0x7f8b3009b120 con 0x7f8b3009d6f0 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 msgr2=0x7f8b3013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2f7fe700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 0x7f8b3013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/260173791 >> v1:172.21.15.19:6789/0 conn(0x7f8b3009d6f0 legacy=0x7f8b3009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/260173791 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3009a500 con 0x7f8b3009e1d0 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b348af700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 0x7f8b3013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2f7fe700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b30138c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009870 tx=0x7f8b24009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfedce5e4b5b6897 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2effd700 1 -- 172.21.15.19:0/260173791 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011830 con 0x7f8b3009e1d0 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2effd700 1 -- 172.21.15.19:0/260173791 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b24011990 con 0x7f8b3009e1d0 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.751+0000 7f8b2effd700 1 -- 172.21.15.19:0/260173791 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24011d20 con 0x7f8b3009e1d0 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 -- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 msgr2=0x7f8b30138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b30138c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009870 tx=0x7f8b24009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 -- 172.21.15.19:0/260173791 shutdown_connections 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b30139170 0x7f8b3013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 --2- 172.21.15.19:0/260173791 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b30138c30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 -- 172.21.15.19:0/260173791 >> 172.21.15.19:0/260173791 conn(0x7f8b30066f50 msgr2=0x7f8b3009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 -- 172.21.15.19:0/260173791 shutdown_connections 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.752+0000 7f8b36312700 1 -- 172.21.15.19:0/260173791 wait complete. 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 Processor -- start 2023-10-03T10:18:52.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 -- start start 2023-10-03T10:18:52.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b3011ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 0x7f8b3011f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b300a20d0 con 0x7f8b30139170 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30134190 con 0x7f8b3009e1d0 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.753+0000 7f8b36312700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30121be0 con 0x7f8b3009d6f0 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b3011ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49612/0 (socket says 172.21.15.19:49612) 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2ffff700 1 -- 172.21.15.19:0/3525365656 learned_addr learned my addr 172.21.15.19:0/3525365656 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b348af700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 0x7f8b3011f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 msgr2=0x7f8b3011e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 msgr2=0x7f8b3011f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 0x7f8b3011f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 -- 172.21.15.19:0/3525365656 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009a70 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2ffff700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b348af700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 0x7f8b3011f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2f7fe700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b3011ec30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b24016000 tx=0x7f8b24004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240045d0 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2401f070 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b240094a0 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240038c0 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.754+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b3009c710 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.756+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30134590 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.756+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8b24003a20 con 0x7f8b3009e1d0 2023-10-03T10:18:52.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.756+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8b24021070 con 0x7f8b3009e1d0 2023-10-03T10:18:52.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.761+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8b2402f3a0 con 0x7f8b3009e1d0 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.963+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b30074ea0 con 0x7f8b3009e1d0 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.963+0000 7f8b2cff9700 1 -- 172.21.15.19:0/3525365656 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8b2402b030 con 0x7f8b3009e1d0 2023-10-03T10:18:52.964 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:52.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:52.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 msgr2=0x7f8b3011ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:52.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b3011ec30 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f8b24016000 tx=0x7f8b24004750 comp rx=0 tx=0).stop 2023-10-03T10:18:52.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 shutdown_connections 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b30139170 0x7f8b3011f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b3009d6f0 0x7f8b3011e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 --2- 172.21.15.19:0/3525365656 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b3009e1d0 0x7f8b3011ec30 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 >> 172.21.15.19:0/3525365656 conn(0x7f8b30066f50 msgr2=0x7f8b30136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 shutdown_connections 2023-10-03T10:18:52.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:52.966+0000 7f8b36312700 1 -- 172.21.15.19:0/3525365656 wait complete. 2023-10-03T10:18:52.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:53.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:53.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:53.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.103+0000 7fc0f66e0700 1 Processor -- start 2023-10-03T10:18:53.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 -- start start 2023-10-03T10:18:53.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 0x7fc0f0136530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 0x7fc0f0138e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f009e130 con 0x7fc0f01316c0 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01321a0 con 0x7fc0f0136a70 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.104+0000 7fc0f66e0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f01312b0 con 0x7fc0f009d9f0 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0effff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc0f01316c0 0x7fc0f0131a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39962/0 (socket says 172.21.15.19:39962) 2023-10-03T10:18:53.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0effff700 1 -- 172.21.15.19:0/2870632036 learned_addr learned my addr 172.21.15.19:0/2870632036 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:53.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0f4c7d700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 0x7fc0f0138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 0x7fc0f0136530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 msgr2=0x7fc0f0138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 0x7fc0f0138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2870632036 >> v1:172.21.15.19:6789/0 conn(0x7fc0f01316c0 legacy=0x7fc0f0131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2870632036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f009f6e0 con 0x7fc0f009d9f0 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0f4c7d700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 0x7fc0f0138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 0x7fc0f0136530 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098a0 tx=0x7fc0e4009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e809b7f00bf403d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0eeffd700 1 -- 172.21.15.19:0/2870632036 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4011830 con 0x7fc0f009d9f0 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0eeffd700 1 -- 172.21.15.19:0/2870632036 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e4011990 con 0x7fc0f009d9f0 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.105+0000 7fc0eeffd700 1 -- 172.21.15.19:0/2870632036 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4011d20 con 0x7fc0f009d9f0 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 msgr2=0x7fc0f0136530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 0x7fc0f0136530 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc0e40098a0 tx=0x7fc0e4009bb0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2870632036 shutdown_connections 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f0136a70 0x7fc0f0138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2870632036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f009d9f0 0x7fc0f0136530 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2870632036 >> 172.21.15.19:0/2870632036 conn(0x7fc0f0066f50 msgr2=0x7fc0f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2870632036 shutdown_connections 2023-10-03T10:18:53.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.106+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2870632036 wait complete. 2023-10-03T10:18:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.107+0000 7fc0f66e0700 1 Processor -- start 2023-10-03T10:18:53.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 -- start start 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f009d9f0 0x7fc0f012ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0f0136a70 0x7fc0f0134570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f00728b0 con 0x7fc0f0136a70 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f009bb40 con 0x7fc0f009d9f0 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f66e0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f0138f80 con 0x7fc0f01316c0 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0ef7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0f4c7d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0f0136a70 0x7fc0f0134570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0ef7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49632/0 (socket says 172.21.15.19:49632) 2023-10-03T10:18:53.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2121390389 learned_addr learned my addr 172.21.15.19:0/2121390389 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.108+0000 7fc0effff700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f009d9f0 0x7fc0f012ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f009d9f0 msgr2=0x7fc0f012ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f009d9f0 0x7fc0f012ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0f0136a70 msgr2=0x7fc0f0134570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0f0136a70 0x7fc0f0134570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 -- 172.21.15.19:0/2121390389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e8009a70 con 0x7fc0f01316c0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ef7fe700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4004550 con 0x7fc0f01316c0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e401e070 con 0x7fc0f01316c0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e40094a0 con 0x7fc0f01316c0 2023-10-03T10:18:53.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e40038e0 con 0x7fc0f01316c0 2023-10-03T10:18:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.109+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f009a4a0 con 0x7fc0f01316c0 2023-10-03T10:18:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.110+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0e4003a40 con 0x7fc0f01316c0 2023-10-03T10:18:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.111+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0e4040420 con 0x7fc0f01316c0 2023-10-03T10:18:53.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.111+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f00a0800 con 0x7fc0f01316c0 2023-10-03T10:18:53.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.116+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0e4015030 con 0x7fc0f01316c0 2023-10-03T10:18:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.210+0000 7f4fdd932700 1 Processor -- start 2023-10-03T10:18:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 -- start start 2023-10-03T10:18:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 0x7f4fd8138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 0x7f4fd813b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd809ea10 con 0x7f4fd80a09c0 2023-10-03T10:18:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd809e210 con 0x7f4fd80a14a0 2023-10-03T10:18:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fdd932700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80a26f0 con 0x7f4fd809d5c0 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fd77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 0x7f4fd813b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fd6ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4fd80a09c0 0x7f4fd80a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39972/0 (socket says 172.21.15.19:39972) 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fd6ffd700 1 -- 172.21.15.19:0/3379640428 learned_addr learned my addr 172.21.15.19:0/3379640428 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.211+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 0x7f4fd8138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 msgr2=0x7f4fd813b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 0x7f4fd813b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3379640428 >> v1:172.21.15.19:6789/0 conn(0x7f4fd80a09c0 legacy=0x7f4fd80a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3379640428 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd809db70 con 0x7f4fd809d5c0 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fd67fc700 1 -- 172.21.15.19:0/3379640428 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760849716 0 0) 0x7f4fd809ea10 con 0x7f4fd80a09c0 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fd77fe700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 0x7f4fd813b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 0x7f4fd8138d70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009870 tx=0x7f4fc0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caac3aaa37d15385 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fd67fc700 1 -- 172.21.15.19:0/3379640428 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011830 con 0x7f4fd809d5c0 2023-10-03T10:18:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fd67fc700 1 -- 172.21.15.19:0/3379640428 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc0011990 con 0x7f4fd809d5c0 2023-10-03T10:18:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.212+0000 7f4fd67fc700 1 -- 172.21.15.19:0/3379640428 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0011d20 con 0x7f4fd809d5c0 2023-10-03T10:18:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 -- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 msgr2=0x7f4fd8138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 0x7f4fd8138d70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009870 tx=0x7f4fc0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 -- 172.21.15.19:0/3379640428 shutdown_connections 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd80a14a0 0x7f4fd813b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3379640428 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd809d5c0 0x7f4fd8138d70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 -- 172.21.15.19:0/3379640428 >> 172.21.15.19:0/3379640428 conn(0x7f4fd80a2fe0 msgr2=0x7f4fd80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 -- 172.21.15.19:0/3379640428 shutdown_connections 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.213+0000 7f4fdd932700 1 -- 172.21.15.19:0/3379640428 wait complete. 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.214+0000 7f4fdd932700 1 Processor -- start 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 -- start start 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd809d5c0 0x7f4fd811c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80a14a0 0x7f4fd811d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd809cec0 con 0x7f4fd80a14a0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd811f510 con 0x7f4fd809d5c0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fdd932700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd809c1c0 con 0x7f4fd80a09c0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fce7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fce7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49650/0 (socket says 172.21.15.19:49650) 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3178015337 learned_addr learned my addr 172.21.15.19:0/3178015337 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fd77fe700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80a14a0 0x7f4fd811d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.215+0000 7f4fd6ffd700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd809d5c0 0x7f4fd811c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd809d5c0 msgr2=0x7f4fd811c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd809d5c0 0x7f4fd811c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80a14a0 msgr2=0x7f4fd811d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80a14a0 0x7f4fd811d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 -- 172.21.15.19:0/3178015337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009a70 con 0x7f4fd80a09c0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fce7fc700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009840 tx=0x7f4fc0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00045d0 con 0x7f4fd80a09c0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc001f070 con 0x7f4fd80a09c0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc00094a0 con 0x7f4fd80a09c0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc00038e0 con 0x7f4fd80a09c0 2023-10-03T10:18:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.216+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd811f0c0 con 0x7f4fd80a09c0 2023-10-03T10:18:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.217+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4fc0003a40 con 0x7f4fd80a09c0 2023-10-03T10:18:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.217+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd811f740 con 0x7f4fd80a09c0 2023-10-03T10:18:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.217+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4fc0021070 con 0x7f4fd80a09c0 2023-10-03T10:18:53.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.227+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4fd811f740 con 0x7f4fd80a09c0 2023-10-03T10:18:53.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.245+0000 7fe12ea16700 1 Processor -- start 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.245+0000 7fe12ea16700 1 -- start start 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12ea16700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12812cf60 0x7fe12806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12ea16700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe12812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12ea16700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12812cd90 con 0x7fe128130260 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12ea16700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12812d330 con 0x7fe12812cf60 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12ea16700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281306d0 con 0x7fe12812f8b0 2023-10-03T10:18:53.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe1277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe12812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12cfb3700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe128130260 0x7fe128136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39988/0 (socket says 172.21.15.19:39988) 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe12cfb3700 1 -- 172.21.15.19:0/2509252480 learned_addr learned my addr 172.21.15.19:0/2509252480 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.246+0000 7fe127fff700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12812cf60 0x7fe12806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe1277fe700 1 -- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12812cf60 msgr2=0x7fe12806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe1277fe700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12812cf60 0x7fe12806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe1277fe700 1 -- 172.21.15.19:0/2509252480 >> v1:172.21.15.19:6789/0 conn(0x7fe128130260 legacy=0x7fe128136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe1277fe700 1 -- 172.21.15.19:0/2509252480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128071780 con 0x7fe12812f8b0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe1277fe700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe12812fd20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009870 tx=0x7fe11c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4fe44c64eb3e9aa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe126ffd700 1 -- 172.21.15.19:0/2509252480 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c011830 con 0x7fe12812f8b0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe126ffd700 1 -- 172.21.15.19:0/2509252480 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c011990 con 0x7fe12812f8b0 2023-10-03T10:18:53.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.247+0000 7fe126ffd700 1 -- 172.21.15.19:0/2509252480 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c011d20 con 0x7fe12812f8b0 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 -- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 msgr2=0x7fe12812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe12812fd20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe11c009870 tx=0x7fe11c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 -- 172.21.15.19:0/2509252480 shutdown_connections 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe12812cf60 0x7fe12806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 --2- 172.21.15.19:0/2509252480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe12812fd20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 -- 172.21.15.19:0/2509252480 >> 172.21.15.19:0/2509252480 conn(0x7fe1280a2aa0 msgr2=0x7fe1280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 -- 172.21.15.19:0/2509252480 shutdown_connections 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.248+0000 7fe12ea16700 1 -- 172.21.15.19:0/2509252480 wait complete. 2023-10-03T10:18:53.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.249+0000 7fe12ea16700 1 Processor -- start 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.249+0000 7fe12ea16700 1 -- start start 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.249+0000 7fe12ea16700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 0x7fe1281c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.249+0000 7fe12ea16700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.249+0000 7fe12ea16700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe128130260 0x7fe1281c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe12ea16700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe128137770 con 0x7fe12812cf60 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe12ea16700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12812f590 con 0x7fe128130260 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe12ea16700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe128129fa0 con 0x7fe12812f8b0 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe127fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 0x7fe1281c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe127fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 0x7fe1281c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51036/0 (socket says 172.21.15.19:51036) 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49674/0 (socket says 172.21.15.19:49674) 2023-10-03T10:18:53.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe127fff700 1 -- 172.21.15.19:0/3428811731 learned_addr learned my addr 172.21.15.19:0/3428811731 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe12cfb3700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe128130260 0x7fe1281c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 -- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe128130260 msgr2=0x7fe1281c8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe128130260 0x7fe1281c8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 -- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 msgr2=0x7fe1281c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 0x7fe1281c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 -- 172.21.15.19:0/3428811731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c0094a0 con 0x7fe12812f8b0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe1277fe700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe11c016000 tx=0x7fe11c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c004450 con 0x7fe12812f8b0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.250+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11c01f070 con 0x7fe12812f8b0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.251+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe128135860 con 0x7fe12812f8b0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.251+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11c0038e0 con 0x7fe12812f8b0 2023-10-03T10:18:53.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.251+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1281360c0 con 0x7fe12812f8b0 2023-10-03T10:18:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.252+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe128074ea0 con 0x7fe12812f8b0 2023-10-03T10:18:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.252+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe11c003a40 con 0x7fe12812f8b0 2023-10-03T10:18:53.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.252+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe11c021070 con 0x7fe12812f8b0 2023-10-03T10:18:53.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.257+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe11c0045b0 con 0x7fe12812f8b0 2023-10-03T10:18:53.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.335+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc0f0074ea0 con 0x7fc0f01316c0 2023-10-03T10:18:53.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.335+0000 7fc0ecff9700 1 -- 172.21.15.19:0/2121390389 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0e4006de0 con 0x7fc0f01316c0 2023-10-03T10:18:53.336 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 msgr2=0x7fc0f012b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009870 tx=0x7fc0e4004750 comp rx=0 tx=0).stop 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 shutdown_connections 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0f0136a70 0x7fc0f0134570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0f009d9f0 0x7fc0f012ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 --2- 172.21.15.19:0/2121390389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0f01316c0 0x7fc0f012b150 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 >> 172.21.15.19:0/2121390389 conn(0x7fc0f0066f50 msgr2=0x7fc0f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 shutdown_connections 2023-10-03T10:18:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.338+0000 7fc0f66e0700 1 -- 172.21.15.19:0/2121390389 wait complete. 2023-10-03T10:18:53.353 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:53.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.436+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4fd811f740 con 0x7f4fd80a09c0 2023-10-03T10:18:53.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.437+0000 7f4fd4ff9700 1 -- 172.21.15.19:0/3178015337 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4fd811f740 con 0x7f4fd80a09c0 2023-10-03T10:18:53.438 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:53.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 msgr2=0x7f4fd811ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0009840 tx=0x7f4fc0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:53.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 shutdown_connections 2023-10-03T10:18:53.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fd80a14a0 0x7f4fd811d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4fd809d5c0 0x7f4fd811c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 --2- 172.21.15.19:0/3178015337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4fd80a09c0 0x7f4fd811ccf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 >> 172.21.15.19:0/3178015337 conn(0x7f4fd80a2fe0 msgr2=0x7f4fd8136cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 shutdown_connections 2023-10-03T10:18:53.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.439+0000 7f4fdd932700 1 -- 172.21.15.19:0/3178015337 wait complete. 2023-10-03T10:18:53.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:53.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.461+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1280713a0 con 0x7fe12812f8b0 2023-10-03T10:18:53.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.462+0000 7fe124ff9700 1 -- 172.21.15.19:0/3428811731 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe11c02b070 con 0x7fe12812f8b0 2023-10-03T10:18:53.463 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 msgr2=0x7fe1281c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe11c016000 tx=0x7fe11c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 shutdown_connections 2023-10-03T10:18:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe128130260 0x7fe1281c8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe12812cf60 0x7fe1281c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 --2- 172.21.15.19:0/3428811731 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe12812f8b0 0x7fe1281c89e0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:53.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 >> 172.21.15.19:0/3428811731 conn(0x7fe1280a2aa0 msgr2=0x7fe12806e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:53.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 shutdown_connections 2023-10-03T10:18:53.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:53.464+0000 7fe12ea16700 1 -- 172.21.15.19:0/3428811731 wait complete. 2023-10-03T10:18:53.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:53.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:54.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.127+0000 7f8fd32ec700 1 Processor -- start 2023-10-03T10:18:54.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.127+0000 7f8fd32ec700 1 -- start start 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.127+0000 7f8fd32ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.127+0000 7f8fd32ec700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fcc09e000 0x7f8fcc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd32ec700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fcc09f130 con 0x7f8fcc09e410 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd32ec700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fcc09f520 con 0x7f8fcc09e000 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd32ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc09e930 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd1088700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd1088700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49688/0 (socket says 172.21.15.19:49688) 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fcc09e000 0x7f8fcc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd1088700 1 -- 172.21.15.19:0/56805503 learned_addr learned my addr 172.21.15.19:0/56805503 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd1889700 1 --1- 172.21.15.19:0/56805503 >> v1:172.21.15.19:6789/0 conn(0x7f8fcc09e410 0x7f8fcc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39992/0 (socket says 172.21.15.19:39992) 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 -- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 msgr2=0x7f8fcc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 -- 172.21.15.19:0/56805503 >> v1:172.21.15.19:6789/0 conn(0x7f8fcc09e410 legacy=0x7f8fcc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 -- 172.21.15.19:0/56805503 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc09b2d0 con 0x7f8fcc09e000 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fc3fff700 1 -- 172.21.15.19:0/56805503 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151757096 0 0) 0x7f8fcc09f130 con 0x7f8fcc09e410 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd1088700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fd0887700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09e000 0x7f8fcc130660 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009840 tx=0x7f8fc8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68bbb002518cc9e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fc3fff700 1 -- 172.21.15.19:0/56805503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011830 con 0x7f8fcc09e000 2023-10-03T10:18:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fc3fff700 1 -- 172.21.15.19:0/56805503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc8011990 con 0x7f8fcc09e000 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.128+0000 7f8fc3fff700 1 -- 172.21.15.19:0/56805503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc8011d20 con 0x7f8fcc09e000 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 -- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09e000 msgr2=0x7f8fcc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09e000 0x7f8fcc130660 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8009840 tx=0x7f8fc8009b50 comp rx=0 tx=0).stop 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 -- 172.21.15.19:0/56805503 shutdown_connections 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09d6f0 0x7f8fcc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/56805503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09e000 0x7f8fcc130660 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 -- 172.21.15.19:0/56805503 >> 172.21.15.19:0/56805503 conn(0x7f8fcc066f50 msgr2=0x7f8fcc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 -- 172.21.15.19:0/56805503 shutdown_connections 2023-10-03T10:18:54.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.129+0000 7f8fd32ec700 1 -- 172.21.15.19:0/56805503 wait complete. 2023-10-03T10:18:54.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.130+0000 7f8fd32ec700 1 Processor -- start 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 -- start start 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09e000 0x7f8fcc11e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 0x7f8fcc11ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc11f490 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc1303a0 con 0x7f8fcc09e410 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd32ec700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fcc120e20 con 0x7f8fcc09e000 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd1088700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd1088700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51052/0 (socket says 172.21.15.19:51052) 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd1088700 1 -- 172.21.15.19:0/2379870492 learned_addr learned my addr 172.21.15.19:0/2379870492 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd1889700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 0x7f8fcc11ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.131+0000 7f8fd0887700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09e000 0x7f8fcc11e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 -- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09e000 msgr2=0x7f8fcc11e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09e000 0x7f8fcc11e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 -- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 msgr2=0x7f8fcc11ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 0x7f8fcc11ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 -- 172.21.15.19:0/2379870492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc00b7f0 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1889700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 0x7f8fcc11ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd1088700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc010e60 tx=0x7f8fbc00e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011450 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fbc0115b0 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc80094a0 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fbc011920 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.132+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fcc121270 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.133+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fbc011a80 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.133+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fbc0422f0 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.133+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fcc072680 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.138+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fbc01e080 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.346+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fcc11ac20 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.347+0000 7f8fc1ffb700 1 -- 172.21.15.19:0/2379870492 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fbc017da0 con 0x7f8fcc09d6f0 2023-10-03T10:18:54.348 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:54.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 msgr2=0x7f8fcc11dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc010e60 tx=0x7f8fbc00e640 comp rx=0 tx=0).stop 2023-10-03T10:18:54.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 shutdown_connections 2023-10-03T10:18:54.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fcc09e410 0x7f8fcc11ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fcc09d6f0 0x7f8fcc11dfc0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 --2- 172.21.15.19:0/2379870492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fcc09e000 0x7f8fcc11e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 >> 172.21.15.19:0/2379870492 conn(0x7f8fcc066f50 msgr2=0x7f8fcc130b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 shutdown_connections 2023-10-03T10:18:54.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.349+0000 7f8fd32ec700 1 -- 172.21.15.19:0/2379870492 wait complete. 2023-10-03T10:18:54.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:54.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:54.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:54.479 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:54.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.490+0000 7f8c74f45700 1 Processor -- start 2023-10-03T10:18:54.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.490+0000 7f8c74f45700 1 -- start start 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c74f45700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c74f45700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c70135e50 0x7f8c70138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c74f45700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7009f130 con 0x7f8c7009d6f0 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c74f45700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7009f520 con 0x7f8c70135e50 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c74f45700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7009e930 con 0x7f8c7009e1d0 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50976/0 (socket says 172.21.15.19:50976) 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8c70135e50 0x7f8c70138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6dd9b700 1 -- 172.21.15.19:0/3995696087 learned_addr learned my addr 172.21.15.19:0/3995696087 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 -- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 msgr2=0x7f8c70135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 -- 172.21.15.19:0/3995696087 >> v1:172.21.15.19:6789/0 conn(0x7f8c7009d6f0 legacy=0x7f8c7009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 -- 172.21.15.19:0/3995696087 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7009b2d0 con 0x7f8c70135e50 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6d59a700 1 -- 172.21.15.19:0/3995696087 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017162893 0 0) 0x7f8c7009f130 con 0x7f8c7009d6f0 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6dd9b700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.491+0000 7f8c6ed9d700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c70135e50 0x7f8c70138230 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009dc0 tx=0x7f8c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6e981825cdf561 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c6d59a700 1 -- 172.21.15.19:0/3995696087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800e070 con 0x7f8c70135e50 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c6d59a700 1 -- 172.21.15.19:0/3995696087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6800bae0 con 0x7f8c70135e50 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c6d59a700 1 -- 172.21.15.19:0/3995696087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6800be90 con 0x7f8c70135e50 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 -- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c70135e50 msgr2=0x7f8c70138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c70135e50 0x7f8c70138230 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009dc0 tx=0x7f8c6800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 -- 172.21.15.19:0/3995696087 shutdown_connections 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c70135e50 0x7f8c70138230 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 --2- 172.21.15.19:0/3995696087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009e1d0 0x7f8c70135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.492+0000 7f8c74f45700 1 -- 172.21.15.19:0/3995696087 >> 172.21.15.19:0/3995696087 conn(0x7f8c70066f50 msgr2=0x7f8c7009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.493+0000 7f8c74f45700 1 -- 172.21.15.19:0/3995696087 shutdown_connections 2023-10-03T10:18:54.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.493+0000 7f8c74f45700 1 -- 172.21.15.19:0/3995696087 wait complete. 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 Processor -- start 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 -- start start 2023-10-03T10:18:54.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 0x7f8c701c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70132130 con 0x7f8c7009e1d0 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c701213d0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.494+0000 7f8c74f45700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8c70072070 con 0x7f8c70135e50 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50992/0 (socket says 172.21.15.19:50992) 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 -- 172.21.15.19:0/2027766924 learned_addr learned my addr 172.21.15.19:0/2027766924 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51058/0 (socket says 172.21.15.19:51058) 2023-10-03T10:18:54.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6ed9d700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 0x7f8c701c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 -- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 msgr2=0x7f8c701c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 0x7f8c701c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 -- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 msgr2=0x7f8c70120660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 -- 172.21.15.19:0/2027766924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64009550 con 0x7f8c7009d6f0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6dd9b700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6ed9d700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 0x7f8c701c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c6e59c700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c60001eb0 tx=0x7f8c6000c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.495+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600054e0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.496+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60003680 con 0x7f8c7009d6f0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.496+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c600039f0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.496+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c68009a70 con 0x7f8c7009d6f0 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.496+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c70122d40 con 0x7f8c7009d6f0 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.496+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8c60003b50 con 0x7f8c7009d6f0 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.497+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8c6003ea30 con 0x7f8c7009d6f0 2023-10-03T10:18:54.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.497+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7009a2d0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.506+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8c6001b3b0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.599+0000 7f61a4720700 1 Processor -- start 2023-10-03T10:18:54.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.599+0000 7f61a4720700 1 -- start start 2023-10-03T10:18:54.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a4720700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a4720700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 0x7f619c12ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a4720700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c06b990 con 0x7f619c134260 2023-10-03T10:18:54.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a4720700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0a0590 con 0x7f619c133420 2023-10-03T10:18:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a4720700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619c09fb80 con 0x7f619c133e30 2023-10-03T10:18:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a24bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a24bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:50998/0 (socket says 172.21.15.19:50998) 2023-10-03T10:18:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a24bc700 1 -- 172.21.15.19:0/1204654062 learned_addr learned my addr 172.21.15.19:0/1204654062 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.600+0000 7f61a1cbb700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 0x7f619c12ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a24bc700 1 -- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 msgr2=0x7f619c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a24bc700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 0x7f619c12ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a24bc700 1 -- 172.21.15.19:0/1204654062 >> v1:172.21.15.19:6789/0 conn(0x7f619c134260 legacy=0x7f619c1304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a24bc700 1 -- 172.21.15.19:0/1204654062 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0a0030 con 0x7f619c133420 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a1cbb700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 0x7f619c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a24bc700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6198009920 tx=0x7f6198009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a085d6d6e3a28f59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a14ba700 1 -- 172.21.15.19:0/1204654062 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198011830 con 0x7f619c133420 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a14ba700 1 -- 172.21.15.19:0/1204654062 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198011990 con 0x7f619c133420 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.601+0000 7f61a14ba700 1 -- 172.21.15.19:0/1204654062 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198011d20 con 0x7f619c133420 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 -- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 msgr2=0x7f619c1337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6198009920 tx=0x7f6198009c30 comp rx=0 tx=0).stop 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 -- 172.21.15.19:0/1204654062 shutdown_connections 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c133420 0x7f619c1337f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 --2- 172.21.15.19:0/1204654062 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133e30 0x7f619c12ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 -- 172.21.15.19:0/1204654062 >> 172.21.15.19:0/1204654062 conn(0x7f619c0a4210 msgr2=0x7f619c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 -- 172.21.15.19:0/1204654062 shutdown_connections 2023-10-03T10:18:54.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.602+0000 7f61a4720700 1 -- 172.21.15.19:0/1204654062 wait complete. 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 Processor -- start 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 -- start start 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133420 0x7f619c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 0x7f619c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c120510 con 0x7f619c133e30 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c121030 con 0x7f619c134260 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.604+0000 7f61a4720700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f619c11fd30 con 0x7f619c133420 2023-10-03T10:18:54.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51074/0 (socket says 172.21.15.19:51074) 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 -- 172.21.15.19:0/2924503971 learned_addr learned my addr 172.21.15.19:0/2924503971 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a2cbd700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 0x7f619c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a24bc700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133420 0x7f619c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 -- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133420 msgr2=0x7f619c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133420 0x7f619c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 -- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 msgr2=0x7f619c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 0x7f619c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 -- 172.21.15.19:0/2924503971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094a0 con 0x7f619c133e30 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a2cbd700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 0x7f619c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a1cbb700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f618c00ebb0 tx=0x7f618c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00c850 con 0x7f619c133e30 2023-10-03T10:18:54.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618c00c9b0 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198009550 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.605+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00cd40 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.606+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c12d750 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.607+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f618c013470 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.607+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c120b20 con 0x7f619c133e30 2023-10-03T10:18:54.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.607+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f618c03f770 con 0x7f619c133e30 2023-10-03T10:18:54.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.612+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f618c0232f0 con 0x7f619c133e30 2023-10-03T10:18:54.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.641+0000 7ff0a779e700 1 Processor -- start 2023-10-03T10:18:54.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.641+0000 7ff0a779e700 1 -- start start 2023-10-03T10:18:54.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.641+0000 7ff0a779e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff0a0133c30 0x7ff0a0134000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a779e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a013ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a779e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a0072970 con 0x7ff0a00723b0 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a779e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0a0099680 con 0x7ff0a0133c30 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a779e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a0099e50 con 0x7ff0a009d960 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a4d39700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff0a00723b0 0x7ff0a009d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40024/0 (socket says 172.21.15.19:40024) 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a4d39700 1 -- 172.21.15.19:0/1200691812 learned_addr learned my addr 172.21.15.19:0/1200691812 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a5d3b700 1 --2- 172.21.15.19:0/1200691812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a013ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a553a700 1 --2- 172.21.15.19:0/1200691812 >> v2:172.21.15.19:3300/0 conn(0x7ff0a0133c30 0x7ff0a0134000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff097fff700 1 -- 172.21.15.19:0/1200691812 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304725371 0 0) 0x7ff090001290 con 0x7ff0a00723b0 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff097fff700 1 -- 172.21.15.19:0/1200691812 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff08c0035b0 con 0x7ff0a00723b0 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a5d3b700 1 -- 172.21.15.19:0/1200691812 >> v2:172.21.15.19:3300/0 conn(0x7ff0a0133c30 msgr2=0x7ff0a0134000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:54.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a5d3b700 1 --2- 172.21.15.19:0/1200691812 >> v2:172.21.15.19:3300/0 conn(0x7ff0a0133c30 0x7ff0a0134000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a5d3b700 1 -- 172.21.15.19:0/1200691812 >> v1:172.21.15.19:6789/0 conn(0x7ff0a00723b0 legacy=0x7ff0a009d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.642+0000 7ff0a5d3b700 1 -- 172.21.15.19:0/1200691812 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a009a060 con 0x7ff0a009d960 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a5d3b700 1 --2- 172.21.15.19:0/1200691812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a013ba50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff098009d90 tx=0x7ff09800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b986abb18ad3b12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff097fff700 1 -- 172.21.15.19:0/1200691812 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09800e070 con 0x7ff0a009d960 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff097fff700 1 -- 172.21.15.19:0/1200691812 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09800bb20 con 0x7ff0a009d960 2023-10-03T10:18:54.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff097fff700 1 -- 172.21.15.19:0/1200691812 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff098012430 con 0x7ff0a009d960 2023-10-03T10:18:54.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 -- 172.21.15.19:0/1200691812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 msgr2=0x7ff0a013ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 --2- 172.21.15.19:0/1200691812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a013ba50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff098009d90 tx=0x7ff09800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:54.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 -- 172.21.15.19:0/1200691812 shutdown_connections 2023-10-03T10:18:54.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 --2- 172.21.15.19:0/1200691812 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a013ba50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 --2- 172.21.15.19:0/1200691812 >> v2:172.21.15.19:3300/0 conn(0x7ff0a0133c30 0x7ff0a0134000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.643+0000 7ff0a779e700 1 -- 172.21.15.19:0/1200691812 >> 172.21.15.19:0/1200691812 conn(0x7ff0a00a25a0 msgr2=0x7ff0a00a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.644+0000 7ff0a779e700 1 -- 172.21.15.19:0/1200691812 shutdown_connections 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.644+0000 7ff0a779e700 1 -- 172.21.15.19:0/1200691812 wait complete. 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 Processor -- start 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 -- start start 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0a00723b0 0x7ff0a012c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0a0133c30 0x7ff0a012caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a012f9b0 con 0x7ff0a00723b0 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a012f1b0 con 0x7ff0a009d960 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a779e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a009c2e0 con 0x7ff0a0133c30 2023-10-03T10:18:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a4d39700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a4d39700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51036/0 (socket says 172.21.15.19:51036) 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a4d39700 1 -- 172.21.15.19:0/277279723 learned_addr learned my addr 172.21.15.19:0/277279723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.645+0000 7ff0a553a700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0a00723b0 0x7ff0a012c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 -- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0a0133c30 msgr2=0x7ff0a012caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0a0133c30 0x7ff0a012caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 -- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0a00723b0 msgr2=0x7ff0a012c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0a00723b0 0x7ff0a012c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 -- 172.21.15.19:0/277279723 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098009a70 con 0x7ff0a009d960 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a4d39700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff0900013f0 tx=0x7ff09000ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090005c40 con 0x7ff0a009d960 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff090005da0 con 0x7ff0a009d960 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a012ecf0 con 0x7ff0a009d960 2023-10-03T10:18:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0900072d0 con 0x7ff0a009d960 2023-10-03T10:18:54.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.646+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a01311a0 con 0x7ff0a009d960 2023-10-03T10:18:54.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.647+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff090007430 con 0x7ff0a009d960 2023-10-03T10:18:54.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.647+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff09003ea80 con 0x7ff0a009d960 2023-10-03T10:18:54.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.648+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a0072970 con 0x7ff0a009d960 2023-10-03T10:18:54.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.653+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff0a0072970 con 0x7ff0a009d960 2023-10-03T10:18:54.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.732+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8c70074ea0 con 0x7f8c7009d6f0 2023-10-03T10:18:54.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.732+0000 7f8c5effd700 1 -- 172.21.15.19:0/2027766924 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8c60017020 con 0x7f8c7009d6f0 2023-10-03T10:18:54.733 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 msgr2=0x7f8c70120120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f8c60001eb0 tx=0x7f8c6000c800 comp rx=0 tx=0).stop 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 shutdown_connections 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8c70135e50 0x7f8c701c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8c7009d6f0 0x7f8c70120120 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 --2- 172.21.15.19:0/2027766924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c7009e1d0 0x7f8c70120660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 >> 172.21.15.19:0/2027766924 conn(0x7f8c70066f50 msgr2=0x7f8c7009fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 shutdown_connections 2023-10-03T10:18:54.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.735+0000 7f8c74f45700 1 -- 172.21.15.19:0/2027766924 wait complete. 2023-10-03T10:18:54.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.821+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f619c074ea0 con 0x7f619c133e30 2023-10-03T10:18:54.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.822+0000 7f6192ffd700 1 -- 172.21.15.19:0/2924503971 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f618c021020 con 0x7f619c133e30 2023-10-03T10:18:54.823 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 msgr2=0x7f619c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f618c00ebb0 tx=0x7f618c00eec0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 shutdown_connections 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f619c134260 0x7f619c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f619c133420 0x7f619c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 --2- 172.21.15.19:0/2924503971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f619c133e30 0x7f619c09c9c0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 >> 172.21.15.19:0/2924503971 conn(0x7f619c0a4210 msgr2=0x7f619c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 shutdown_connections 2023-10-03T10:18:54.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.824+0000 7f61a4720700 1 -- 172.21.15.19:0/2924503971 wait complete. 2023-10-03T10:18:54.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:54.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.858+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff0a0072970 con 0x7ff0a009d960 2023-10-03T10:18:54.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.859+0000 7ff095ffb700 1 -- 172.21.15.19:0/277279723 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff0a0072970 con 0x7ff0a009d960 2023-10-03T10:18:54.860 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:54.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 msgr2=0x7ff0a012c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff0900013f0 tx=0x7ff09000ca90 comp rx=0 tx=0).stop 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 shutdown_connections 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff0a0133c30 0x7ff0a012caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff0a00723b0 0x7ff0a012c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 --2- 172.21.15.19:0/277279723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff0a009d960 0x7ff0a012c5b0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.861+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 >> 172.21.15.19:0/277279723 conn(0x7ff0a00a25a0 msgr2=0x7ff0a01baee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.862+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 shutdown_connections 2023-10-03T10:18:54.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:54.862+0000 7ff0a779e700 1 -- 172.21.15.19:0/277279723 wait complete. 2023-10-03T10:18:54.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:55.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.509+0000 7f84dfe7d700 1 Processor -- start 2023-10-03T10:18:55.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 -- start start 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d809f130 con 0x7f84d809e000 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809f520 con 0x7f84d809e410 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dfe7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809e930 con 0x7f84d809d6f0 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84ddc19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84de41a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dd418700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f84d809e000 0x7f84d8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40036/0 (socket says 172.21.15.19:40036) 2023-10-03T10:18:55.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84de41a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51050/0 (socket says 172.21.15.19:51050) 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84dd418700 1 -- 172.21.15.19:0/4215197583 learned_addr learned my addr 172.21.15.19:0/4215197583 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.510+0000 7f84ddc19700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49718/0 (socket says 172.21.15.19:49718) 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84de41a700 1 -- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 msgr2=0x7f84d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84de41a700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84de41a700 1 -- 172.21.15.19:0/4215197583 >> v1:172.21.15.19:6789/0 conn(0x7f84d809e000 legacy=0x7f84d8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dcc17700 1 -- 172.21.15.19:0/4215197583 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 376890988 0 0) 0x7f84d809f130 con 0x7f84d809e000 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84de41a700 1 -- 172.21.15.19:0/4215197583 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d809b2d0 con 0x7f84d809e410 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84ddc19700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84de41a700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2efe19399c90795 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dcc17700 1 -- 172.21.15.19:0/4215197583 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0011830 con 0x7f84d809e410 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dcc17700 1 -- 172.21.15.19:0/4215197583 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d0011990 con 0x7f84d809e410 2023-10-03T10:18:55.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dcc17700 1 -- 172.21.15.19:0/4215197583 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0011d20 con 0x7f84d809e410 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dfe7d700 1 -- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 msgr2=0x7f84d8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.511+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009870 tx=0x7f84d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 -- 172.21.15.19:0/4215197583 shutdown_connections 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d8130d70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/4215197583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d6f0 0x7f84d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 -- 172.21.15.19:0/4215197583 >> 172.21.15.19:0/4215197583 conn(0x7f84d8066f50 msgr2=0x7f84d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 -- 172.21.15.19:0/4215197583 shutdown_connections 2023-10-03T10:18:55.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.512+0000 7f84dfe7d700 1 -- 172.21.15.19:0/4215197583 wait complete. 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.513+0000 7f84dfe7d700 1 Processor -- start 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.513+0000 7f84dfe7d700 1 -- start start 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809e000 0x7f84d811e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d811e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8121600 con 0x7f84d809d6f0 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d811fae0 con 0x7f84d809e410 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dfe7d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8072090 con 0x7f84d809e000 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84ddc19700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84ddc19700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51096/0 (socket says 172.21.15.19:51096) 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d811e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84ddc19700 1 -- 172.21.15.19:0/1564989796 learned_addr learned my addr 172.21.15.19:0/1564989796 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84dd418700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809e000 0x7f84d811e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 -- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809e000 msgr2=0x7f84d811e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809e000 0x7f84d811e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 -- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 msgr2=0x7f84d811ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84de41a700 1 -- 172.21.15.19:0/1564989796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d400bc80 con 0x7f84d809e410 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.514+0000 7f84ddc19700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84de41a700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d811e840 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f84d0016000 tx=0x7f84d0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0004450 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d00045b0 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d00094a0 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00038e0 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d8120c20 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.515+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84d0003a40 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.516+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84d00408e0 con 0x7f84d809e410 2023-10-03T10:18:55.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.516+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d811ac20 con 0x7f84d809e410 2023-10-03T10:18:55.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.521+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84d0015070 con 0x7f84d809e410 2023-10-03T10:18:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.728+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84d8074ea0 con 0x7f84d809e410 2023-10-03T10:18:55.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.728+0000 7f84ce7fc700 1 -- 172.21.15.19:0/1564989796 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84d002d3a0 con 0x7f84d809e410 2023-10-03T10:18:55.729 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.730+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 msgr2=0x7f84d811e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d811e840 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f84d0016000 tx=0x7f84d0004750 comp rx=0 tx=0).stop 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 shutdown_connections 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d809e410 0x7f84d811e840 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809d6f0 0x7f84d811ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 --2- 172.21.15.19:0/1564989796 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809e000 0x7f84d811e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 >> 172.21.15.19:0/1564989796 conn(0x7f84d8066f50 msgr2=0x7f84d8130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 shutdown_connections 2023-10-03T10:18:55.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.731+0000 7f84dfe7d700 1 -- 172.21.15.19:0/1564989796 wait complete. 2023-10-03T10:18:55.745 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:55.751 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:55.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:55.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.887+0000 7f17301e8700 1 Processor -- start 2023-10-03T10:18:55.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 -- start start 2023-10-03T10:18:55.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 0x7f172809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f650 0x7f1728131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1728070940 con 0x7f172809e930 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f172806fd60 con 0x7f172809f240 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.888+0000 7f17301e8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f172806fa80 con 0x7f172809f650 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172df84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 0x7f172809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51078/0 (socket says 172.21.15.19:51078) 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172df84700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 0x7f172809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51108/0 (socket says 172.21.15.19:51108) 2023-10-03T10:18:55.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 -- 172.21.15.19:0/1728090306 learned_addr learned my addr 172.21.15.19:0/1728090306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172e785700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f650 0x7f1728131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 -- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f650 msgr2=0x7f1728131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f650 0x7f1728131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 -- 172.21.15.19:0/1728090306 >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 msgr2=0x7f172809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 --2- 172.21.15.19:0/1728090306 >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 0x7f172809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 -- 172.21.15.19:0/1728090306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f172809fb60 con 0x7f172809f240 2023-10-03T10:18:55.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172d783700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f17180098f0 tx=0x7f1718009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64d206d59e36e9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172cf82700 1 -- 172.21.15.19:0/1728090306 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011830 con 0x7f172809f240 2023-10-03T10:18:55.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172cf82700 1 -- 172.21.15.19:0/1728090306 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718011990 con 0x7f172809f240 2023-10-03T10:18:55.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.889+0000 7f172cf82700 1 -- 172.21.15.19:0/1728090306 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718011d20 con 0x7f172809f240 2023-10-03T10:18:55.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 -- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 msgr2=0x7f17281317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f17180098f0 tx=0x7f1718009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 -- 172.21.15.19:0/1728090306 shutdown_connections 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f650 0x7f1728131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 --2- 172.21.15.19:0/1728090306 >> v2:172.21.15.19:3300/0 conn(0x7f172809e930 0x7f172809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 --2- 172.21.15.19:0/1728090306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809f240 0x7f17281317f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 -- 172.21.15.19:0/1728090306 >> 172.21.15.19:0/1728090306 conn(0x7f17280a4210 msgr2=0x7f17280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 -- 172.21.15.19:0/1728090306 shutdown_connections 2023-10-03T10:18:55.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.890+0000 7f17301e8700 1 -- 172.21.15.19:0/1728090306 wait complete. 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.892+0000 7f17301e8700 1 Processor -- start 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.892+0000 7f17301e8700 1 -- start start 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f240 0x7f17281a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f172809f650 0x7f17281a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17281a50e0 con 0x7f172809f650 2023-10-03T10:18:55.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17281a5840 con 0x7f172809e930 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f17301e8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17281a6a90 con 0x7f172809f240 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:51086/0 (socket says 172.21.15.19:51086) 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 -- 172.21.15.19:0/3488317414 learned_addr learned my addr 172.21.15.19:0/3488317414 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172e785700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f172809f650 0x7f17281a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172d783700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f240 0x7f17281a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 -- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f240 msgr2=0x7f17281a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f240 0x7f17281a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 -- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f172809f650 msgr2=0x7f17281a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f172809f650 0x7f17281a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.893+0000 7f172df84700 1 -- 172.21.15.19:0/3488317414 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009550 con 0x7f172809e930 2023-10-03T10:18:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f172df84700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f172400ef30 tx=0x7f172400b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724010040 con 0x7f172809e930 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172400bdb0 con 0x7f172809e930 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280a0190 con 0x7f172809e930 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1724014620 con 0x7f172809e930 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.894+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17281a74c0 con 0x7f172809e930 2023-10-03T10:18:55.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.895+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1724014780 con 0x7f172809e930 2023-10-03T10:18:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.895+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17100052e0 con 0x7f172809e930 2023-10-03T10:18:55.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.895+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f172403f8d0 con 0x7f172809e930 2023-10-03T10:18:55.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.902+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1724014a30 con 0x7f172809e930 2023-10-03T10:18:55.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.982+0000 7f8e3edd8700 1 Processor -- start 2023-10-03T10:18:55.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.982+0000 7f8e3edd8700 1 -- start start 2023-10-03T10:18:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3edd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3edd8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8e38136d80 0x7f8e38139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3edd8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3809ece0 con 0x7f8e3806a770 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3edd8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3806b640 con 0x7f8e38136d80 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3edd8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3809e760 con 0x7f8e3806b250 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49746/0 (socket says 172.21.15.19:49746) 2023-10-03T10:18:55.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 -- 172.21.15.19:0/4178688351 learned_addr learned my addr 172.21.15.19:0/4178688351 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e3d375700 1 --2- 172.21.15.19:0/4178688351 >> v2:172.21.15.19:3300/0 conn(0x7f8e38136d80 0x7f8e38139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 -- 172.21.15.19:0/4178688351 >> v2:172.21.15.19:3300/0 conn(0x7f8e38136d80 msgr2=0x7f8e38139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 --2- 172.21.15.19:0/4178688351 >> v2:172.21.15.19:3300/0 conn(0x7f8e38136d80 0x7f8e38139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 -- 172.21.15.19:0/4178688351 >> v1:172.21.15.19:6789/0 conn(0x7f8e3806a770 legacy=0x7f8e3806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e377fe700 1 -- 172.21.15.19:0/4178688351 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155692973 0 0) 0x7f8e3809ece0 con 0x7f8e3806a770 2023-10-03T10:18:55.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 -- 172.21.15.19:0/4178688351 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3809e040 con 0x7f8e3806b250 2023-10-03T10:18:55.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.983+0000 7f8e37fff700 1 --2- 172.21.15.19:0/4178688351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786c9fa9e51be8e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e377fe700 1 -- 172.21.15.19:0/4178688351 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011830 con 0x7f8e3806b250 2023-10-03T10:18:55.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e377fe700 1 -- 172.21.15.19:0/4178688351 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e24011990 con 0x7f8e3806b250 2023-10-03T10:18:55.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e377fe700 1 -- 172.21.15.19:0/4178688351 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24011d20 con 0x7f8e3806b250 2023-10-03T10:18:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 -- 172.21.15.19:0/4178688351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 msgr2=0x7f8e38136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 --2- 172.21.15.19:0/4178688351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8e240098f0 tx=0x7f8e24009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 -- 172.21.15.19:0/4178688351 shutdown_connections 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 --2- 172.21.15.19:0/4178688351 >> v2:172.21.15.19:3300/0 conn(0x7f8e38136d80 0x7f8e38139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 --2- 172.21.15.19:0/4178688351 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806b250 0x7f8e38136840 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 -- 172.21.15.19:0/4178688351 >> 172.21.15.19:0/4178688351 conn(0x7f8e38066f50 msgr2=0x7f8e3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 -- 172.21.15.19:0/4178688351 shutdown_connections 2023-10-03T10:18:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.984+0000 7f8e3edd8700 1 -- 172.21.15.19:0/4178688351 wait complete. 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.986+0000 7f8e3edd8700 1 Processor -- start 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.986+0000 7f8e3edd8700 1 -- start start 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 0x7f8e3809add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e38136d80 0x7f8e381c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38121580 con 0x7f8e3806b250 2023-10-03T10:18:55.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e381322e0 con 0x7f8e38136d80 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3edd8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3809a8e0 con 0x7f8e3806a770 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3cb74700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 0x7f8e3809add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51144/0 (socket says 172.21.15.19:51144) 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 -- 172.21.15.19:0/1691284703 learned_addr learned my addr 172.21.15.19:0/1691284703 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:55.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3d375700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e38136d80 0x7f8e381c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 -- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 msgr2=0x7f8e3809add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 0x7f8e3809add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 -- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e38136d80 msgr2=0x7f8e381c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e38136d80 0x7f8e381c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e37fff700 1 -- 172.21.15.19:0/1691284703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009550 con 0x7f8e3806b250 2023-10-03T10:18:55.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.987+0000 7f8e3cb74700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 0x7f8e3809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e37fff700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009c40 tx=0x7f8e24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24004550 con 0x7f8e3806b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e240036a0 con 0x7f8e3806b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24003a30 con 0x7f8e3806b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e3edd8700 1 -- 172.21.15.19:0/1691284703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e38071e60 con 0x7f8e3806b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.988+0000 7f8e3edd8700 1 -- 172.21.15.19:0/1691284703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3809c010 con 0x7f8e3806b250 2023-10-03T10:18:55.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.989+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8e24021070 con 0x7f8e3806b250 2023-10-03T10:18:55.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.989+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8e24040b60 con 0x7f8e3806b250 2023-10-03T10:18:55.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.989+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100052e0 con 0x7f8e3806b250 2023-10-03T10:18:55.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:55.994+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8e24015080 con 0x7f8e3806b250 2023-10-03T10:18:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.025+0000 7f5ebcaf3700 1 Processor -- start 2023-10-03T10:18:56.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.025+0000 7f5ebcaf3700 1 -- start start 2023-10-03T10:18:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5ebcaf3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5eb80a0a30 0x7f5eb80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5ebcaf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 0x7f5eb80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5ebcaf3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb80a2a70 con 0x7f5eb8133930 2023-10-03T10:18:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5ebcaf3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb80a01d0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5ebcaf3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb809e2b0 con 0x7f5eb809d630 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5eb659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5eb80a0a30 0x7f5eb80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5eb6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5eb8133930 0x7f5eb8133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40052/0 (socket says 172.21.15.19:40052) 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5eb6d9d700 1 -- 172.21.15.19:0/4182058724 learned_addr learned my addr 172.21.15.19:0/4182058724 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.026+0000 7f5eb5d9b700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 0x7f5eb80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb659c700 1 -- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 msgr2=0x7f5eb80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb659c700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 0x7f5eb80a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb659c700 1 -- 172.21.15.19:0/4182058724 >> v1:172.21.15.19:6789/0 conn(0x7f5eb8133930 legacy=0x7f5eb8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb659c700 1 -- 172.21.15.19:0/4182058724 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb809dc50 con 0x7f5eb80a0a30 2023-10-03T10:18:56.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb5d9b700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 0x7f5eb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb659c700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb80a0a30 0x7f5eb80a0e00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009d90 tx=0x7f5ea800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb309f249d90b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb559a700 1 -- 172.21.15.19:0/4182058724 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea800e070 con 0x7f5eb80a0a30 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb559a700 1 -- 172.21.15.19:0/4182058724 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea8003a20 con 0x7f5eb80a0a30 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.027+0000 7f5eb559a700 1 -- 172.21.15.19:0/4182058724 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea8003dd0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb80a0a30 msgr2=0x7f5eb80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb80a0a30 0x7f5eb80a0e00 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f5ea8009d90 tx=0x7f5ea800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/4182058724 shutdown_connections 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb80a0a30 0x7f5eb80a0e00 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/4182058724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb809d630 0x7f5eb80a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/4182058724 >> 172.21.15.19:0/4182058724 conn(0x7f5eb80a3050 msgr2=0x7f5eb80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/4182058724 shutdown_connections 2023-10-03T10:18:56.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.028+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/4182058724 wait complete. 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.029+0000 7f5ebcaf3700 1 Processor -- start 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.029+0000 7f5ebcaf3700 1 -- start start 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.029+0000 7f5ebcaf3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5eb809d630 0x7f5eb81323b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.029+0000 7f5ebcaf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.029+0000 7f5ebcaf3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 0x7f5eb8132e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5ebcaf3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8122250 con 0x7f5eb8133930 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5ebcaf3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8120540 con 0x7f5eb809d630 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5ebcaf3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb80a4130 con 0x7f5eb80a0a30 2023-10-03T10:18:56.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49774/0 (socket says 172.21.15.19:49774) 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 -- 172.21.15.19:0/686665578 learned_addr learned my addr 172.21.15.19:0/686665578 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb6d9d700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 0x7f5eb8132e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb659c700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5eb809d630 0x7f5eb81323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 -- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5eb809d630 msgr2=0x7f5eb81323b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5eb809d630 0x7f5eb81323b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 -- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 msgr2=0x7f5eb8132e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 0x7f5eb8132e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 -- 172.21.15.19:0/686665578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea00094a0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb5d9b700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ec10 tx=0x7f5ea000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eb6d9d700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 0x7f5eb8132e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.030+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000c850 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.031+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000c9b0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.031+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea8009a70 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.031+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000cd20 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.031+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb81211b0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.032+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ea0013470 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.032+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ea003f810 con 0x7f5eb80a0a30 2023-10-03T10:18:56.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.032+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb80747f0 con 0x7f5eb80a0a30 2023-10-03T10:18:56.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.037+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ea0013720 con 0x7f5eb80a0a30 2023-10-03T10:18:56.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.111+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1710005590 con 0x7f172809e930 2023-10-03T10:18:56.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.112+0000 7f171e7fc700 1 -- 172.21.15.19:0/3488317414 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1724018070 con 0x7f172809e930 2023-10-03T10:18:56.113 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 msgr2=0x7f17281a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f172400ef30 tx=0x7f172400b390 comp rx=0 tx=0).stop 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 shutdown_connections 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f172809f650 0x7f17281a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f172809e930 0x7f17281a3c30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 --2- 172.21.15.19:0/3488317414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f172809f240 0x7f17281a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 >> 172.21.15.19:0/3488317414 conn(0x7f17280a4210 msgr2=0x7f17281b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 shutdown_connections 2023-10-03T10:18:56.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.114+0000 7f17301e8700 1 -- 172.21.15.19:0/3488317414 wait complete. 2023-10-03T10:18:56.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:56.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.200+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8e10005590 con 0x7f8e3806b250 2023-10-03T10:18:56.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.201+0000 7f8e357fa700 1 -- 172.21.15.19:0/1691284703 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8e24029020 con 0x7f8e3806b250 2023-10-03T10:18:56.202 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:56.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 msgr2=0x7f8e3809b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009c40 tx=0x7f8e24004750 comp rx=0 tx=0).stop 2023-10-03T10:18:56.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 shutdown_connections 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8e38136d80 0x7f8e381c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8e3806a770 0x7f8e3809add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 --2- 172.21.15.19:0/1691284703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e3806b250 0x7f8e3809b310 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 >> 172.21.15.19:0/1691284703 conn(0x7f8e38066f50 msgr2=0x7f8e380700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 shutdown_connections 2023-10-03T10:18:56.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.203+0000 7f8e22ffd700 1 -- 172.21.15.19:0/1691284703 wait complete. 2023-10-03T10:18:56.217 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.248+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5eb8072980 con 0x7f5eb80a0a30 2023-10-03T10:18:56.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.248+0000 7f5eaeffd700 1 -- 172.21.15.19:0/686665578 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ea001a360 con 0x7f5eb80a0a30 2023-10-03T10:18:56.249 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 msgr2=0x7f5eb81328f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5ea000ec10 tx=0x7f5ea000ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 shutdown_connections 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5eb8133930 0x7f5eb8132e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5eb809d630 0x7f5eb81323b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 --2- 172.21.15.19:0/686665578 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5eb80a0a30 0x7f5eb81328f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 >> 172.21.15.19:0/686665578 conn(0x7f5eb80a3050 msgr2=0x7f5eb81bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 shutdown_connections 2023-10-03T10:18:56.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.251+0000 7f5ebcaf3700 1 -- 172.21.15.19:0/686665578 wait complete. 2023-10-03T10:18:56.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:56.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:56.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 Processor -- start 2023-10-03T10:18:56.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 -- start start 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e670 0x7f836c09ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06b910 con 0x7f836c09f8a0 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c06c0c0 con 0x7f836c09e670 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836b59e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836c09f4c0 con 0x7f836c133960 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f8369d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.892+0000 7f836a59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e670 0x7f836c09ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52870/0 (socket says 172.21.15.19:52870) 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f8369d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51376/0 (socket says 172.21.15.19:51376) 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 -- 172.21.15.19:0/2756344087 learned_addr learned my addr 172.21.15.19:0/2756344087 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 -- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e670 msgr2=0x7f836c09ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 --2- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e670 0x7f836c09ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 -- 172.21.15.19:0/2756344087 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 msgr2=0x7f836c09ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 --2- 172.21.15.19:0/2756344087 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 -- 172.21.15.19:0/2756344087 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c09fd20 con 0x7f836c133960 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f8369d9b700 1 --2- 172.21.15.19:0/2756344087 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836ad9d700 1 --2- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8364009e50 tx=0x7f836400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c27022b79633131 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836959a700 1 -- 172.21.15.19:0/2756344087 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400e070 con 0x7f836c133960 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836959a700 1 -- 172.21.15.19:0/2756344087 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400b910 con 0x7f836c133960 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.893+0000 7f836959a700 1 -- 172.21.15.19:0/2756344087 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400bcc0 con 0x7f836c133960 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 -- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 msgr2=0x7f836c133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 --2- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8364009e50 tx=0x7f836400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 -- 172.21.15.19:0/2756344087 shutdown_connections 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 --2- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09e670 0x7f836c09ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 --2- 172.21.15.19:0/2756344087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c133960 0x7f836c133dc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 --2- 172.21.15.19:0/2756344087 >> v2:172.21.15.19:3300/0 conn(0x7f836c09f8a0 0x7f836c09ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 -- 172.21.15.19:0/2756344087 >> 172.21.15.19:0/2756344087 conn(0x7f836c0a0c90 msgr2=0x7f836c0a1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 -- 172.21.15.19:0/2756344087 shutdown_connections 2023-10-03T10:18:56.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.894+0000 7f836b59e700 1 -- 172.21.15.19:0/2756344087 wait complete. 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.895+0000 7f836b59e700 1 Processor -- start 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.895+0000 7f836b59e700 1 -- start start 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c121b70 con 0x7f836c133960 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c122dc0 con 0x7f836c09f8a0 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836b59e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f836c122150 con 0x7f836c09e670 2023-10-03T10:18:56.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8369d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8369d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42318/0 (socket says 172.21.15.19:42318) 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51388/0 (socket says 172.21.15.19:51388) 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52874/0 (socket says 172.21.15.19:52874) 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8369d9b700 1 -- 172.21.15.19:0/3588861217 learned_addr learned my addr 172.21.15.19:0/3588861217 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 -- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 msgr2=0x7f836c120580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 -- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 msgr2=0x7f836c120ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 -- 172.21.15.19:0/3588861217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094a0 con 0x7f836c09e670 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8369d9b700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836ad9d700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f836a59c700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f835c00e900 tx=0x7f835c00ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c013680 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.896+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c0137e0 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c013b50 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8364009b30 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0a0480 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f835c013cb0 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f835c03f5e0 con 0x7f836c09e670 2023-10-03T10:18:56.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.897+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c070db0 con 0x7f836c09e670 2023-10-03T10:18:56.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:56.902+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f835c021020 con 0x7f836c09e670 2023-10-03T10:18:57.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.105+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f836c04f2a0 con 0x7f836c09e670 2023-10-03T10:18:57.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.105+0000 7f8362ffd700 1 -- 172.21.15.19:0/3588861217 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f835c01bbe0 con 0x7f836c09e670 2023-10-03T10:18:57.106 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 msgr2=0x7f836c120040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f835c00e900 tx=0x7f835c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 shutdown_connections 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f836c133960 0x7f836c120ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f836c09e670 0x7f836c120040 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 --2- 172.21.15.19:0/3588861217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f836c09f8a0 0x7f836c120580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 >> 172.21.15.19:0/3588861217 conn(0x7f836c0a0c90 msgr2=0x7f836c1bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 shutdown_connections 2023-10-03T10:18:57.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.107+0000 7f836b59e700 1 -- 172.21.15.19:0/3588861217 wait complete. 2023-10-03T10:18:57.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:57.130 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:57.218 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:57.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:57.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.268+0000 7f07f7e9b700 1 Processor -- start 2023-10-03T10:18:57.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.268+0000 7f07f7e9b700 1 -- start start 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f7e9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0133510 0x7f07f01358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f7e9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f0138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f7e9b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f0130260 con 0x7f07f0130670 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f7e9b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f009a350 con 0x7f07f0133510 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f7e9b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0071ff0 con 0x7f07f0135e30 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f6438700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f0138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f5436700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0133510 0x7f07f01358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f5c37700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f07f0130670 0x7f07f0130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36358/0 (socket says 172.21.15.19:36358) 2023-10-03T10:18:57.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f5c37700 1 -- 172.21.15.19:0/4059808238 learned_addr learned my addr 172.21.15.19:0/4059808238 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f6438700 1 -- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0133510 msgr2=0x7f07f01358f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f6438700 1 --2- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0133510 0x7f07f01358f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f4c35700 1 -- 172.21.15.19:0/4059808238 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524225931 0 0) 0x7f07f0130260 con 0x7f07f0130670 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f6438700 1 -- 172.21.15.19:0/4059808238 >> v1:172.21.15.19:6789/0 conn(0x7f07f0130670 legacy=0x7f07f0130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.269+0000 7f07f6438700 1 -- 172.21.15.19:0/4059808238 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f009ecf0 con 0x7f07f0135e30 2023-10-03T10:18:57.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.270+0000 7f07f6438700 1 --2- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f0138210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009dc0 tx=0x7f07e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d467b559f7cae461 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.270+0000 7f07f4c35700 1 -- 172.21.15.19:0/4059808238 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e800bd20 con 0x7f07f0135e30 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.270+0000 7f07f4c35700 1 -- 172.21.15.19:0/4059808238 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e800be80 con 0x7f07f0135e30 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.270+0000 7f07f4c35700 1 -- 172.21.15.19:0/4059808238 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80116a0 con 0x7f07f0135e30 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 -- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 msgr2=0x7f07f0138210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f0138210 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009dc0 tx=0x7f07e800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 -- 172.21.15.19:0/4059808238 shutdown_connections 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f0138210 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/4059808238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0133510 0x7f07f01358f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 -- 172.21.15.19:0/4059808238 >> 172.21.15.19:0/4059808238 conn(0x7f07f00a2aa0 msgr2=0x7f07f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 -- 172.21.15.19:0/4059808238 shutdown_connections 2023-10-03T10:18:57.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.271+0000 7f07f7e9b700 1 -- 172.21.15.19:0/4059808238 wait complete. 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.272+0000 7f07f7e9b700 1 Processor -- start 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.272+0000 7f07f7e9b700 1 -- start start 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f0133510 0x7f07f012d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f01c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f012ff50 con 0x7f07f0133510 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f011e890 con 0x7f07f0130670 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f7e9b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07f011eb50 con 0x7f07f0135e30 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42338/0 (socket says 172.21.15.19:42338) 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 -- 172.21.15.19:0/1410416319 learned_addr learned my addr 172.21.15.19:0/1410416319 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f6438700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f01c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5436700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f0133510 0x7f07f012d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 -- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 msgr2=0x7f07f01c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f01c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 -- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f0133510 msgr2=0x7f07f012d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f0133510 0x7f07f012d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f5c37700 1 -- 172.21.15.19:0/1410416319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009a70 con 0x7f07f0130670 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.273+0000 7f07f6438700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f01c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07f5c37700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c520 tx=0x7f07ec00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec004c80 con 0x7f07f0130670 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec004e00 con 0x7f07f0130670 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec007310 con 0x7f07f0130670 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f012dbe0 con 0x7f07f0130670 2023-10-03T10:18:57.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.274+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f011d4d0 con 0x7f07f0130670 2023-10-03T10:18:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.275+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07ec007470 con 0x7f07f0130670 2023-10-03T10:18:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.275+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f011d750 con 0x7f07f0130670 2023-10-03T10:18:57.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.275+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07ec03f3a0 con 0x7f07f0130670 2023-10-03T10:18:57.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.280+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07ec0123b0 con 0x7f07f0130670 2023-10-03T10:18:57.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.367+0000 7fd99359f700 1 Processor -- start 2023-10-03T10:18:57.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.367+0000 7fd99359f700 1 -- start start 2023-10-03T10:18:57.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99359f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd98c09e850 0x7fd98c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99359f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99359f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd98c06bc50 con 0x7fd98c1340c0 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99359f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd98c09ae60 con 0x7fd98c09e850 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99359f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06b990 con 0x7fd98c09f160 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42348/0 (socket says 172.21.15.19:42348) 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 -- 172.21.15.19:0/1906292305 learned_addr learned my addr 172.21.15.19:0/1906292305 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd99133b700 1 --2- 172.21.15.19:0/1906292305 >> v2:172.21.15.19:3300/0 conn(0x7fd98c09e850 0x7fd98c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 -- 172.21.15.19:0/1906292305 >> v2:172.21.15.19:3300/0 conn(0x7fd98c09e850 msgr2=0x7fd98c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 --2- 172.21.15.19:0/1906292305 >> v2:172.21.15.19:3300/0 conn(0x7fd98c09e850 0x7fd98c09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.368+0000 7fd990b3a700 1 -- 172.21.15.19:0/1906292305 >> v1:172.21.15.19:6789/0 conn(0x7fd98c1340c0 legacy=0x7fd98c13ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.369+0000 7fd990b3a700 1 -- 172.21.15.19:0/1906292305 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd98c06cb10 con 0x7fd98c09f160 2023-10-03T10:18:57.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.369+0000 7fd990b3a700 1 --2- 172.21.15.19:0/1906292305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0098f0 tx=0x7fd97c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eea4b88546216ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.369+0000 7fd983fff700 1 -- 172.21.15.19:0/1906292305 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c011830 con 0x7fd98c09f160 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.369+0000 7fd983fff700 1 -- 172.21.15.19:0/1906292305 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c011990 con 0x7fd98c09f160 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.369+0000 7fd983fff700 1 -- 172.21.15.19:0/1906292305 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c011d20 con 0x7fd98c09f160 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 -- 172.21.15.19:0/1906292305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 msgr2=0x7fd98c133b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 --2- 172.21.15.19:0/1906292305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd97c0098f0 tx=0x7fd97c009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 -- 172.21.15.19:0/1906292305 shutdown_connections 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 --2- 172.21.15.19:0/1906292305 >> v2:172.21.15.19:3300/0 conn(0x7fd98c09e850 0x7fd98c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 --2- 172.21.15.19:0/1906292305 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09f160 0x7fd98c133b80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 -- 172.21.15.19:0/1906292305 >> 172.21.15.19:0/1906292305 conn(0x7fd98c0a3f70 msgr2=0x7fd98c0a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 -- 172.21.15.19:0/1906292305 shutdown_connections 2023-10-03T10:18:57.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.370+0000 7fd99359f700 1 -- 172.21.15.19:0/1906292305 wait complete. 2023-10-03T10:18:57.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.371+0000 7fd99359f700 1 Processor -- start 2023-10-03T10:18:57.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.371+0000 7fd99359f700 1 -- start start 2023-10-03T10:18:57.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c1340c0 0x7fd98c1c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1208b0 con 0x7fd98c09f160 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c1220a0 con 0x7fd98c09e850 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99359f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c06cd30 con 0x7fd98c1340c0 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99133b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51416/0 (socket says 172.21.15.19:51416) 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99133b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42354/0 (socket says 172.21.15.19:42354) 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 -- 172.21.15.19:0/4259228280 learned_addr learned my addr 172.21.15.19:0/4259228280 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd991b3c700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c1340c0 0x7fd98c1c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 -- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c1340c0 msgr2=0x7fd98c1c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c1340c0 0x7fd98c1c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 -- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 msgr2=0x7fd98c1c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd990b3a700 1 -- 172.21.15.19:0/4259228280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c009550 con 0x7fd98c09f160 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.372+0000 7fd99133b700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd990b3a700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000c00 tx=0x7fd97c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c0036a0 con 0x7fd98c09f160 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c003800 con 0x7fd98c09f160 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd99359f700 1 -- 172.21.15.19:0/4259228280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c1335d0 con 0x7fd98c09f160 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c003bb0 con 0x7fd98c09f160 2023-10-03T10:18:57.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.373+0000 7fd99359f700 1 -- 172.21.15.19:0/4259228280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c122dd0 con 0x7fd98c09f160 2023-10-03T10:18:57.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.374+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd97c021070 con 0x7fd98c09f160 2023-10-03T10:18:57.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.374+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd97c040dd0 con 0x7fd98c09f160 2023-10-03T10:18:57.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.374+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640052e0 con 0x7fd98c09f160 2023-10-03T10:18:57.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.379+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd97c015020 con 0x7fd98c09f160 2023-10-03T10:18:57.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.426+0000 7f99261dd700 1 Processor -- start 2023-10-03T10:18:57.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.426+0000 7f99261dd700 1 -- start start 2023-10-03T10:18:57.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f99261dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 0x7f9920095890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f99261dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 0x7f99201385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f99261dd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992009c280 con 0x7f9920099680 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f99261dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992009aaf0 con 0x7f99200954c0 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f99261dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992009b960 con 0x7f992009a1c0 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9920099680 0x7f9920099ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36380/0 (socket says 172.21.15.19:36380) 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991effd700 1 -- 172.21.15.19:0/374815954 learned_addr learned my addr 172.21.15.19:0/374815954 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991ffff700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 0x7f99201385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991f7fe700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 0x7f9920095890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991ffff700 1 -- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 msgr2=0x7f9920095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:57.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991ffff700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 0x7f9920095890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991ffff700 1 -- 172.21.15.19:0/374815954 >> v1:172.21.15.19:6789/0 conn(0x7f9920099680 legacy=0x7f9920099ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991ffff700 1 -- 172.21.15.19:0/374815954 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992009a7b0 con 0x7f992009a1c0 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.427+0000 7f991f7fe700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 0x7f9920095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f991ffff700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 0x7f99201385a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9918009dc0 tx=0x7f991800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=313c90c3b99698d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f991e7fc700 1 -- 172.21.15.19:0/374815954 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991800e070 con 0x7f992009a1c0 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f991e7fc700 1 -- 172.21.15.19:0/374815954 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918003a20 con 0x7f992009a1c0 2023-10-03T10:18:57.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f991e7fc700 1 -- 172.21.15.19:0/374815954 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918003dd0 con 0x7f992009a1c0 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 -- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 msgr2=0x7f99201385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 0x7f99201385a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9918009dc0 tx=0x7f991800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 -- 172.21.15.19:0/374815954 shutdown_connections 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f992009a1c0 0x7f99201385a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 --2- 172.21.15.19:0/374815954 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99200954c0 0x7f9920095890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.428+0000 7f99261dd700 1 -- 172.21.15.19:0/374815954 >> 172.21.15.19:0/374815954 conn(0x7f99200a2360 msgr2=0x7f99200a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.429+0000 7f99261dd700 1 -- 172.21.15.19:0/374815954 shutdown_connections 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.429+0000 7f99261dd700 1 -- 172.21.15.19:0/374815954 wait complete. 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 Processor -- start 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 -- start start 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 0x7f9920127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992009a1c0 0x7f9920127cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201bcee0 con 0x7f9920099680 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99201299f0 con 0x7f992009a1c0 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f99261dd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9920128300 con 0x7f99200954c0 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f991f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f991f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52926/0 (socket says 172.21.15.19:52926) 2023-10-03T10:18:57.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f991f7fe700 1 -- 172.21.15.19:0/2196691784 learned_addr learned my addr 172.21.15.19:0/2196691784 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.430+0000 7f991effd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 0x7f9920127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991ffff700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992009a1c0 0x7f9920127cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 -- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992009a1c0 msgr2=0x7f9920127cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992009a1c0 0x7f9920127cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 -- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 msgr2=0x7f9920127780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 0x7f9920127780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 -- 172.21.15.19:0/2196691784 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991000b740 con 0x7f99200954c0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991effd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 0x7f9920127780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f991f7fe700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f991000ed40 tx=0x7f991000d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991000dd90 con 0x7f99200954c0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910010440 con 0x7f99200954c0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9918009a70 con 0x7f99200954c0 2023-10-03T10:18:57.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100107b0 con 0x7f99200954c0 2023-10-03T10:18:57.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.431+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992009b000 con 0x7f99200954c0 2023-10-03T10:18:57.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.432+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9910010910 con 0x7f99200954c0 2023-10-03T10:18:57.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.432+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9910014030 con 0x7f99200954c0 2023-10-03T10:18:57.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.433+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920129620 con 0x7f99200954c0 2023-10-03T10:18:57.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.437+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f991000f3d0 con 0x7f99200954c0 2023-10-03T10:18:57.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.488+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f07f0074ea0 con 0x7f07f0130670 2023-10-03T10:18:57.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.488+0000 7f07e67fc700 1 -- 172.21.15.19:0/1410416319 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07ec011360 con 0x7f07f0130670 2023-10-03T10:18:57.489 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 msgr2=0x7f07f012d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00c520 tx=0x7f07ec00c830 comp rx=0 tx=0).stop 2023-10-03T10:18:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 shutdown_connections 2023-10-03T10:18:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07f0135e30 0x7f07f01c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07f0130670 0x7f07f012d160 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 --2- 172.21.15.19:0/1410416319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07f0133510 0x7f07f012d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 >> 172.21.15.19:0/1410416319 conn(0x7f07f00a2aa0 msgr2=0x7f07f012e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 shutdown_connections 2023-10-03T10:18:57.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.492+0000 7f07f7e9b700 1 -- 172.21.15.19:0/1410416319 wait complete. 2023-10-03T10:18:57.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.604+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd964005590 con 0x7fd98c09f160 2023-10-03T10:18:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.604+0000 7fd981ffb700 1 -- 172.21.15.19:0/4259228280 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd97c029070 con 0x7fd98c09f160 2023-10-03T10:18:57.605 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 msgr2=0x7fd98c1c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd97c000c00 tx=0x7fd97c004750 comp rx=0 tx=0).stop 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 shutdown_connections 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd98c1340c0 0x7fd98c1c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd98c09e850 0x7fd98c1c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 --2- 172.21.15.19:0/4259228280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd98c09f160 0x7fd98c1c8c40 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.606+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 >> 172.21.15.19:0/4259228280 conn(0x7fd98c0a3f70 msgr2=0x7fd98c0a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.607+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 shutdown_connections 2023-10-03T10:18:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.607+0000 7fd9777fe700 1 -- 172.21.15.19:0/4259228280 wait complete. 2023-10-03T10:18:57.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.645+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9920074ea0 con 0x7f99200954c0 2023-10-03T10:18:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.645+0000 7f9907fff700 1 -- 172.21.15.19:0/2196691784 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9910016660 con 0x7f99200954c0 2023-10-03T10:18:57.646 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 msgr2=0x7f9920127240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f991000ed40 tx=0x7f991000d630 comp rx=0 tx=0).stop 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 shutdown_connections 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992009a1c0 0x7f9920127cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99200954c0 0x7f9920127240 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 --2- 172.21.15.19:0/2196691784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9920099680 0x7f9920127780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.647+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 >> 172.21.15.19:0/2196691784 conn(0x7f99200a2360 msgr2=0x7f99201b6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:57.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.648+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 shutdown_connections 2023-10-03T10:18:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:57.648+0000 7f99261dd700 1 -- 172.21.15.19:0/2196691784 wait complete. 2023-10-03T10:18:57.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:58.122 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:58.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 Processor -- start 2023-10-03T10:18:58.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 -- start start 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47c09b0f0 con 0x7fe47c09e000 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c09d2f0 con 0x7fe47c133f30 2023-10-03T10:18:58.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.269+0000 7fe483e4f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c09a810 con 0x7fe47c09d6f0 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4813ea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe481beb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe481beb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52932/0 (socket says 172.21.15.19:52932) 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42382/0 (socket says 172.21.15.19:42382) 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4813ea700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51434/0 (socket says 172.21.15.19:51434) 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 -- 172.21.15.19:0/1329194032 learned_addr learned my addr 172.21.15.19:0/1329194032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 -- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 msgr2=0x7fe47c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 -- 172.21.15.19:0/1329194032 >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 msgr2=0x7fe47c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 --2- 172.21.15.19:0/1329194032 >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 -- 172.21.15.19:0/1329194032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c09a470 con 0x7fe47c133f30 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe481beb700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4813ea700 1 --2- 172.21.15.19:0/1329194032 >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe4823ec700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e50 tx=0x7fe47400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8451fc1433b3aec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe480be9700 1 -- 172.21.15.19:0/1329194032 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400e070 con 0x7fe47c133f30 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe480be9700 1 -- 172.21.15.19:0/1329194032 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47400b910 con 0x7fe47c133f30 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.270+0000 7fe480be9700 1 -- 172.21.15.19:0/1329194032 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47400bcc0 con 0x7fe47c133f30 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 -- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 msgr2=0x7fe47c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe474009e50 tx=0x7fe47400b330 comp rx=0 tx=0).stop 2023-10-03T10:18:58.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 -- 172.21.15.19:0/1329194032 shutdown_connections 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c133f30 0x7fe47c1343b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 --2- 172.21.15.19:0/1329194032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09d6f0 0x7fe47c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 --2- 172.21.15.19:0/1329194032 >> v2:172.21.15.19:3300/0 conn(0x7fe47c09e000 0x7fe47c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 -- 172.21.15.19:0/1329194032 >> 172.21.15.19:0/1329194032 conn(0x7fe47c066f50 msgr2=0x7fe47c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 -- 172.21.15.19:0/1329194032 shutdown_connections 2023-10-03T10:18:58.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.271+0000 7fe483e4f700 1 -- 172.21.15.19:0/1329194032 wait complete. 2023-10-03T10:18:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.272+0000 7fe483e4f700 1 Processor -- start 2023-10-03T10:18:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.272+0000 7fe483e4f700 1 -- start start 2023-10-03T10:18:58.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 0x7fe47c1c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 0x7fe47c1c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c122300 con 0x7fe47c133f30 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c133670 con 0x7fe47c09d6f0 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe483e4f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c120850 con 0x7fe47c09e000 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42396/0 (socket says 172.21.15.19:42396) 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe4823ec700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 0x7fe47c1c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 -- 172.21.15.19:0/4228162392 learned_addr learned my addr 172.21.15.19:0/4228162392 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe4813ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 0x7fe47c1c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 -- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 msgr2=0x7fe47c1c8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 0x7fe47c1c8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 -- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 msgr2=0x7fe47c1c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 0x7fe47c1c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 -- 172.21.15.19:0/4228162392 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4780094a0 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe4813ea700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 0x7fe47c1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe4823ec700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 0x7fe47c1c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe481beb700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe47800ec10 tx=0x7fe47800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.273+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800c850 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.274+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800c9b0 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.274+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4700094a0 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.274+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47800cd20 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.274+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe474009b30 con 0x7fe47c09d6f0 2023-10-03T10:18:58.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.274+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe478013470 con 0x7fe47c09d6f0 2023-10-03T10:18:58.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.275+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe47803fc20 con 0x7fe47c09d6f0 2023-10-03T10:18:58.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.275+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c122450 con 0x7fe47c09d6f0 2023-10-03T10:18:58.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.280+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe478017080 con 0x7fe47c09d6f0 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.481+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe47c074ea0 con 0x7fe47c09d6f0 2023-10-03T10:18:58.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.482+0000 7fe46e7fc700 1 -- 172.21.15.19:0/4228162392 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe47800ce80 con 0x7fe47c09d6f0 2023-10-03T10:18:58.483 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 msgr2=0x7fe47c1c7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe47800ec10 tx=0x7fe47800ef20 comp rx=0 tx=0).stop 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 shutdown_connections 2023-10-03T10:18:58.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe47c133f30 0x7fe47c1c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe47c09d6f0 0x7fe47c1c7fc0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 --2- 172.21.15.19:0/4228162392 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe47c09e000 0x7fe47c1c8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 >> 172.21.15.19:0/4228162392 conn(0x7fe47c066f50 msgr2=0x7fe47c1bbaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 shutdown_connections 2023-10-03T10:18:58.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.484+0000 7fe483e4f700 1 -- 172.21.15.19:0/4228162392 wait complete. 2023-10-03T10:18:58.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:58.508 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:18:58.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:18:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.647+0000 7f943ea51700 1 Processor -- start 2023-10-03T10:18:58.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 -- start start 2023-10-03T10:18:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9438070940 con 0x7f943809f650 2023-10-03T10:18:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943806fd60 con 0x7f943809f240 2023-10-03T10:18:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f943ea51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f943806fa80 con 0x7f943809e930 2023-10-03T10:18:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f94377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f9437fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f9437fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52956/0 (socket says 172.21.15.19:52956) 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f94377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42400/0 (socket says 172.21.15.19:42400) 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.648+0000 7f9437fff700 1 -- 172.21.15.19:0/2086978055 learned_addr learned my addr 172.21.15.19:0/2086978055 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f94377fe700 1 -- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 msgr2=0x7f943809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f94377fe700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f94377fe700 1 -- 172.21.15.19:0/2086978055 >> v1:172.21.15.19:6789/0 conn(0x7f943809f650 legacy=0x7f9438131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f94377fe700 1 -- 172.21.15.19:0/2086978055 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943809fb60 con 0x7f943809f240 2023-10-03T10:18:58.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f9437fff700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f94377fe700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f942c009870 tx=0x7f942c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea35654e864a3691 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f9436ffd700 1 -- 172.21.15.19:0/2086978055 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011830 con 0x7f943809f240 2023-10-03T10:18:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f9436ffd700 1 -- 172.21.15.19:0/2086978055 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c011990 con 0x7f943809f240 2023-10-03T10:18:58.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.649+0000 7f9436ffd700 1 -- 172.21.15.19:0/2086978055 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c011d20 con 0x7f943809f240 2023-10-03T10:18:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 -- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 msgr2=0x7f94381317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f942c009870 tx=0x7f942c009b80 comp rx=0 tx=0).stop 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 -- 172.21.15.19:0/2086978055 shutdown_connections 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809e930 0x7f943809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 --2- 172.21.15.19:0/2086978055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809f240 0x7f94381317f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 -- 172.21.15.19:0/2086978055 >> 172.21.15.19:0/2086978055 conn(0x7f94380a4210 msgr2=0x7f94380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 -- 172.21.15.19:0/2086978055 shutdown_connections 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.650+0000 7f943ea51700 1 -- 172.21.15.19:0/2086978055 wait complete. 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.651+0000 7f943ea51700 1 Processor -- start 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.651+0000 7f943ea51700 1 -- start start 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 0x7f943806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 0x7f943806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94381aa9b0 con 0x7f943809f650 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94381ab9f0 con 0x7f943809e930 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943ea51700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94381ab180 con 0x7f943809f240 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f9437fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f9437fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42412/0 (socket says 172.21.15.19:42412) 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f9437fff700 1 -- 172.21.15.19:0/324330450 learned_addr learned my addr 172.21.15.19:0/324330450 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f94377fe700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 0x7f943806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.652+0000 7f943cfee700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 0x7f943806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 -- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 msgr2=0x7f943806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 0x7f943806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 -- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 msgr2=0x7f943806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 -- 172.21.15.19:0/324330450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009550 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f9437fff700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f94377fe700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 0x7f943806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943cfee700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 0x7f943806c330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f943809faf0 tx=0x7f943000ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430003c00 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430003d60 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c0094a0 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943000a9c0 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.653+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94380a0190 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.654+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f943000ab20 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.654+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f943003f560 con 0x7f943809f650 2023-10-03T10:18:58.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.654+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94381a2b40 con 0x7f943809f650 2023-10-03T10:18:58.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.659+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9430012420 con 0x7f943809f650 2023-10-03T10:18:58.662 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:18:58.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.768+0000 7f0d241d3700 1 Processor -- start 2023-10-03T10:18:58.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.768+0000 7f0d241d3700 1 -- start start 2023-10-03T10:18:58.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d241d3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d1c09d630 0x7f0d1c0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d241d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d241d3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1c0a2a70 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d241d3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1c0a01d0 con 0x7f0d1c09d630 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d241d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c09e2b0 con 0x7f0d1c138d80 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d22770700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d22770700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42418/0 (socket says 172.21.15.19:42418) 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d2176e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0d1c09d630 0x7f0d1c0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.769+0000 7f0d22770700 1 -- 172.21.15.19:0/3835432715 learned_addr learned my addr 172.21.15.19:0/3835432715 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d22770700 1 -- 172.21.15.19:0/3835432715 >> v2:172.21.15.19:3300/0 conn(0x7f0d1c09d630 msgr2=0x7f0d1c0a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d22770700 1 --2- 172.21.15.19:0/3835432715 >> v2:172.21.15.19:3300/0 conn(0x7f0d1c09d630 0x7f0d1c0a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d22770700 1 -- 172.21.15.19:0/3835432715 >> v1:172.21.15.19:6789/0 conn(0x7f0d1c0a0a30 legacy=0x7f0d1c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d22770700 1 -- 172.21.15.19:0/3835432715 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c09dc50 con 0x7f0d1c138d80 2023-10-03T10:18:58.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d22770700 1 --2- 172.21.15.19:0/3835432715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0d140098f0 tx=0x7f0d14009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fecb9bbfd7a9f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d20f6d700 1 -- 172.21.15.19:0/3835432715 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14011830 con 0x7f0d1c138d80 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d20f6d700 1 -- 172.21.15.19:0/3835432715 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d14011990 con 0x7f0d1c138d80 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.770+0000 7f0d20f6d700 1 -- 172.21.15.19:0/3835432715 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14011d20 con 0x7f0d1c138d80 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 -- 172.21.15.19:0/3835432715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 msgr2=0x7f0d1c13b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 --2- 172.21.15.19:0/3835432715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0d140098f0 tx=0x7f0d14009c00 comp rx=0 tx=0).stop 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 -- 172.21.15.19:0/3835432715 shutdown_connections 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 --2- 172.21.15.19:0/3835432715 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c138d80 0x7f0d1c13b160 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 --2- 172.21.15.19:0/3835432715 >> v2:172.21.15.19:3300/0 conn(0x7f0d1c09d630 0x7f0d1c0a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 -- 172.21.15.19:0/3835432715 >> 172.21.15.19:0/3835432715 conn(0x7f0d1c0a3050 msgr2=0x7f0d1c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 -- 172.21.15.19:0/3835432715 shutdown_connections 2023-10-03T10:18:58.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.771+0000 7f0d241d3700 1 -- 172.21.15.19:0/3835432715 wait complete. 2023-10-03T10:18:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.772+0000 7f0d241d3700 1 Processor -- start 2023-10-03T10:18:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.772+0000 7f0d241d3700 1 -- start start 2023-10-03T10:18:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 0x7f0d1c120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 0x7f0d1c120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 0x7f0d1c1210a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c124140 con 0x7f0d1c138d80 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c1234f0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d241d3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d1c138b20 con 0x7f0d1c09d630 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d21f6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 0x7f0d1c120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d21f6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 0x7f0d1c120620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52976/0 (socket says 172.21.15.19:52976) 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d21f6f700 1 -- 172.21.15.19:0/232207593 learned_addr learned my addr 172.21.15.19:0/232207593 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d2176e700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 0x7f0d1c120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.773+0000 7f0d22770700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 0x7f0d1c1210a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 -- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 msgr2=0x7f0d1c120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 0x7f0d1c120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 -- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 msgr2=0x7f0d1c1210a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 0x7f0d1c1210a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 -- 172.21.15.19:0/232207593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14009550 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d22770700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 0x7f0d1c1210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d2176e700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 0x7f0d1c120b60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00e900 tx=0x7f0d0c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00ee50 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c00c850 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1c13afc0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c00cbc0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.774+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1c1248d0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.775+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1c0747f0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.776+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d0c00cd20 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.776+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d0c03fef0 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.781+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d0c011350 con 0x7f0d1c0a0a30 2023-10-03T10:18:58.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.803+0000 7f4cd5fde700 1 Processor -- start 2023-10-03T10:18:58.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.803+0000 7f4cd5fde700 1 -- start start 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4cd5fde700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009d6f0 0x7f4cd009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4cd5fde700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4cd5fde700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd009b120 con 0x7f4cd009e000 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4cd5fde700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd006b460 con 0x7f4cd009e410 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4cd5fde700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd009a7e0 con 0x7f4cd009d6f0 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42442/0 (socket says 172.21.15.19:42442) 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 -- 172.21.15.19:0/501864031 learned_addr learned my addr 172.21.15.19:0/501864031 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccf7fe700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009d6f0 0x7f4cd009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 -- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009d6f0 msgr2=0x7f4cd009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009d6f0 0x7f4cd009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 -- 172.21.15.19:0/501864031 >> v1:172.21.15.19:6789/0 conn(0x7f4cd009e000 legacy=0x7f4cd01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.804+0000 7f4ccffff700 1 -- 172.21.15.19:0/501864031 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd009a500 con 0x7f4cd009e410 2023-10-03T10:18:58.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.805+0000 7f4ccffff700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009e80 tx=0x7f4cc800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8678982914bb4c54 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.805+0000 7f4cce7fc700 1 -- 172.21.15.19:0/501864031 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc800e070 con 0x7f4cd009e410 2023-10-03T10:18:58.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.805+0000 7f4cce7fc700 1 -- 172.21.15.19:0/501864031 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc800b910 con 0x7f4cd009e410 2023-10-03T10:18:58.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.805+0000 7f4cce7fc700 1 -- 172.21.15.19:0/501864031 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc800bcc0 con 0x7f4cd009e410 2023-10-03T10:18:58.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 -- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 msgr2=0x7f4cd0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8009e80 tx=0x7f4cc800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 -- 172.21.15.19:0/501864031 shutdown_connections 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0134100 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/501864031 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009d6f0 0x7f4cd009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 -- 172.21.15.19:0/501864031 >> 172.21.15.19:0/501864031 conn(0x7f4cd0066f50 msgr2=0x7f4cd009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 -- 172.21.15.19:0/501864031 shutdown_connections 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.806+0000 7f4cd5fde700 1 -- 172.21.15.19:0/501864031 wait complete. 2023-10-03T10:18:58.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.807+0000 7f4cd5fde700 1 Processor -- start 2023-10-03T10:18:58.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 -- start start 2023-10-03T10:18:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009e000 0x7f4cd0122b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0123040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd00a2180 con 0x7f4cd009d6f0 2023-10-03T10:18:58.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd01242e0 con 0x7f4cd009e410 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.808+0000 7f4cd5fde700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd009c710 con 0x7f4cd009e000 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51480/0 (socket says 172.21.15.19:51480) 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 -- 172.21.15.19:0/710049370 learned_addr learned my addr 172.21.15.19:0/710049370 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccffff700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0123040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4cceffd700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009e000 0x7f4cd0122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 -- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009e000 msgr2=0x7f4cd0122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009e000 0x7f4cd0122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 -- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 msgr2=0x7f4cd0123040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0123040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 -- 172.21.15.19:0/710049370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc8009b30 con 0x7f4cd009d6f0 2023-10-03T10:18:58.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccffff700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4ccf7fe700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9b0 tx=0x7f4cc000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0009710 con 0x7f4cd009d6f0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc000ee50 con 0x7f4cd009d6f0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.809+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc000ca50 con 0x7f4cd009d6f0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.810+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd0125b40 con 0x7f4cd009d6f0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.810+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd0126870 con 0x7f4cd009d6f0 2023-10-03T10:18:58.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.811+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4cc000cbb0 con 0x7f4cd009d6f0 2023-10-03T10:18:58.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.811+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd0074ea0 con 0x7f4cd009d6f0 2023-10-03T10:18:58.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.811+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4cc003fa60 con 0x7f4cd009d6f0 2023-10-03T10:18:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.815+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4cc001b3b0 con 0x7f4cd009d6f0 2023-10-03T10:18:58.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.891+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f94380a3850 con 0x7f943809f650 2023-10-03T10:18:58.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.892+0000 7f9434ff9700 1 -- 172.21.15.19:0/324330450 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9430011380 con 0x7f943809f650 2023-10-03T10:18:58.893 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 msgr2=0x7f943806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 0x7f943806c330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f943809faf0 tx=0x7f943000ce70 comp rx=0 tx=0).stop 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 shutdown_connections 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f943809f650 0x7f943806c330 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f943809e930 0x7f943806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 --2- 172.21.15.19:0/324330450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f943809f240 0x7f943806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:58.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 >> 172.21.15.19:0/324330450 conn(0x7f94380a4210 msgr2=0x7f943809ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:58.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 shutdown_connections 2023-10-03T10:18:58.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:58.894+0000 7f943ea51700 1 -- 172.21.15.19:0/324330450 wait complete. 2023-10-03T10:18:58.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:18:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.008+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0d1c0a0410 con 0x7f0d1c0a0a30 2023-10-03T10:18:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.009+0000 7f0d127fc700 1 -- 172.21.15.19:0/232207593 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d1c0a0410 con 0x7f0d1c0a0a30 2023-10-03T10:18:59.010 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:18:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 msgr2=0x7f0d1c120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 0x7f0d1c120b60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00e900 tx=0x7f0d0c00ec10 comp rx=0 tx=0).stop 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 shutdown_connections 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d1c138d80 0x7f0d1c1210a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d1c09d630 0x7f0d1c120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 --2- 172.21.15.19:0/232207593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d1c0a0a30 0x7f0d1c120b60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 >> 172.21.15.19:0/232207593 conn(0x7f0d1c0a3050 msgr2=0x7f0d1c139150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 shutdown_connections 2023-10-03T10:18:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.011+0000 7f0d241d3700 1 -- 172.21.15.19:0/232207593 wait complete. 2023-10-03T10:18:59.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.022+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4cd0125cd0 con 0x7f4cd009d6f0 2023-10-03T10:18:59.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.023+0000 7f4cb7fff700 1 -- 172.21.15.19:0/710049370 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4cd0125cd0 con 0x7f4cd009d6f0 2023-10-03T10:18:59.024 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:18:59.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:18:59.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 msgr2=0x7f4cd01225c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f4cc000e9b0 tx=0x7f4cc000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 shutdown_connections 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4cd009e410 0x7f4cd0123040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4cd009d6f0 0x7f4cd01225c0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 --2- 172.21.15.19:0/710049370 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4cd009e000 0x7f4cd0122b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.025+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 >> 172.21.15.19:0/710049370 conn(0x7f4cd0066f50 msgr2=0x7f4cd0133f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.026+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 shutdown_connections 2023-10-03T10:18:59.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.026+0000 7f4cd5fde700 1 -- 172.21.15.19:0/710049370 wait complete. 2023-10-03T10:18:59.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:18:59.500 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:18:59.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.646+0000 7f4d563a5700 1 Processor -- start 2023-10-03T10:18:59.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.646+0000 7f4d563a5700 1 -- start start 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d563a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 0x7f4d5009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d563a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d50130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d563a5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5009f130 con 0x7f4d5009e000 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d563a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5009f520 con 0x7f4d5009d6f0 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d563a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5009e930 con 0x7f4d5009e410 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d54942700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d50130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d4f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4d5009e000 0x7f4d50130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36428/0 (socket says 172.21.15.19:36428) 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d4f7fe700 1 -- 172.21.15.19:0/436829680 learned_addr learned my addr 172.21.15.19:0/436829680 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d4ffff700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 0x7f4d5009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d54942700 1 -- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 msgr2=0x7f4d5009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d54942700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 0x7f4d5009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d4effd700 1 -- 172.21.15.19:0/436829680 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513986921 0 0) 0x7f4d5009f130 con 0x7f4d5009e000 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d54942700 1 -- 172.21.15.19:0/436829680 >> v1:172.21.15.19:6789/0 conn(0x7f4d5009e000 legacy=0x7f4d50130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d54942700 1 -- 172.21.15.19:0/436829680 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5009b2d0 con 0x7f4d5009e410 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.647+0000 7f4d4ffff700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 0x7f4d5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d54942700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d50130d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f0156c60602e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d4effd700 1 -- 172.21.15.19:0/436829680 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800e070 con 0x7f4d5009e410 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d4effd700 1 -- 172.21.15.19:0/436829680 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800bb20 con 0x7f4d5009e410 2023-10-03T10:18:59.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d4effd700 1 -- 172.21.15.19:0/436829680 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48012430 con 0x7f4d5009e410 2023-10-03T10:18:59.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 -- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 msgr2=0x7f4d50130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d50130d70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009dc0 tx=0x7f4d4800b330 comp rx=0 tx=0).stop 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 -- 172.21.15.19:0/436829680 shutdown_connections 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d50130d70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 --2- 172.21.15.19:0/436829680 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009d6f0 0x7f4d5009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 -- 172.21.15.19:0/436829680 >> 172.21.15.19:0/436829680 conn(0x7f4d50066f50 msgr2=0x7f4d5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 -- 172.21.15.19:0/436829680 shutdown_connections 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.648+0000 7f4d563a5700 1 -- 172.21.15.19:0/436829680 wait complete. 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.650+0000 7f4d563a5700 1 Processor -- start 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.650+0000 7f4d563a5700 1 -- start start 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009e000 0x7f4d5011e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d5011e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5011f2a0 con 0x7f4d5009d6f0 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5011fa20 con 0x7f4d5009e000 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50120040 con 0x7f4d5009e410 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009e000 0x7f4d5011e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51494/0 (socket says 172.21.15.19:51494) 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d54942700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d5011e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 -- 172.21.15.19:0/2089077032 learned_addr learned my addr 172.21.15.19:0/2089077032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 -- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 msgr2=0x7f4d5011e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d5011e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 -- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009e000 msgr2=0x7f4d5011e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009e000 0x7f4d5011e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 -- 172.21.15.19:0/2089077032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d400094a0 con 0x7f4d5009d6f0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d54942700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d5011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4ffff700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d40010f20 tx=0x7f4d4000b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40015070 con 0x7f4d5009d6f0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4000bb90 con 0x7f4d5009d6f0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d48009a70 con 0x7f4d5009d6f0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.651+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d40019410 con 0x7f4d5009d6f0 2023-10-03T10:18:59.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.652+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d50072040 con 0x7f4d5009d6f0 2023-10-03T10:18:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.652+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d40019570 con 0x7f4d5009d6f0 2023-10-03T10:18:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.652+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d40042f90 con 0x7f4d5009d6f0 2023-10-03T10:18:59.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.652+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5009c760 con 0x7f4d5009d6f0 2023-10-03T10:18:59.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.657+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4d4001e070 con 0x7f4d5009d6f0 2023-10-03T10:18:59.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.866+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4d5011ac20 con 0x7f4d5009d6f0 2023-10-03T10:18:59.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.867+0000 7f4d4cff9700 1 -- 172.21.15.19:0/2089077032 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4d40018730 con 0x7f4d5009d6f0 2023-10-03T10:18:59.868 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:18:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 msgr2=0x7f4d5011de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:18:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f4d40010f20 tx=0x7f4d4000b420 comp rx=0 tx=0).stop 2023-10-03T10:18:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 shutdown_connections 2023-10-03T10:18:59.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4d5009e410 0x7f4d5011e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d5009d6f0 0x7f4d5011de10 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 --2- 172.21.15.19:0/2089077032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4d5009e000 0x7f4d5011e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:18:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 >> 172.21.15.19:0/2089077032 conn(0x7f4d50066f50 msgr2=0x7f4d50130890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:18:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 shutdown_connections 2023-10-03T10:18:59.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:18:59.869+0000 7f4d563a5700 1 -- 172.21.15.19:0/2089077032 wait complete. 2023-10-03T10:18:59.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:18:59.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:00.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:00.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.054+0000 7f88b7b34700 1 Processor -- start 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 -- start start 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 0x7f88b0138f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 0x7f88b013b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b006bec0 con 0x7f88b009e850 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00a0030 con 0x7f88b0139450 2023-10-03T10:19:00.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b7b34700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00a0830 con 0x7f88b009f330 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b50cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 0x7f88b0138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b58d0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f88b009e850 0x7f88b009ec20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36442/0 (socket says 172.21.15.19:36442) 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b58d0700 1 -- 172.21.15.19:0/2408006319 learned_addr learned my addr 172.21.15.19:0/2408006319 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.055+0000 7f88b60d1700 1 --2- 172.21.15.19:0/2408006319 >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 0x7f88b013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b50cf700 1 -- 172.21.15.19:0/2408006319 >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 msgr2=0x7f88b013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b50cf700 1 --2- 172.21.15.19:0/2408006319 >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 0x7f88b013b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b50cf700 1 -- 172.21.15.19:0/2408006319 >> v1:172.21.15.19:6789/0 conn(0x7f88b009e850 legacy=0x7f88b009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b50cf700 1 -- 172.21.15.19:0/2408006319 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b006caa0 con 0x7f88b009f330 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b60d1700 1 --2- 172.21.15.19:0/2408006319 >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 0x7f88b013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b50cf700 1 --2- 172.21.15.19:0/2408006319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 0x7f88b0138f10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009840 tx=0x7f88a0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21e89c4bd5387667 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b48ce700 1 -- 172.21.15.19:0/2408006319 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011830 con 0x7f88b009f330 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b48ce700 1 -- 172.21.15.19:0/2408006319 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0011990 con 0x7f88b009f330 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.056+0000 7f88b48ce700 1 -- 172.21.15.19:0/2408006319 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011d20 con 0x7f88b009f330 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 -- 172.21.15.19:0/2408006319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 msgr2=0x7f88b0138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2408006319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 0x7f88b0138f10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009840 tx=0x7f88a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 -- 172.21.15.19:0/2408006319 shutdown_connections 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2408006319 >> v2:172.21.15.19:3300/0 conn(0x7f88b0139450 0x7f88b013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2408006319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009f330 0x7f88b0138f10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 -- 172.21.15.19:0/2408006319 >> 172.21.15.19:0/2408006319 conn(0x7f88b00a3f70 msgr2=0x7f88b00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 -- 172.21.15.19:0/2408006319 shutdown_connections 2023-10-03T10:19:00.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.057+0000 7f88b7b34700 1 -- 172.21.15.19:0/2408006319 wait complete. 2023-10-03T10:19:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.058+0000 7f88b7b34700 1 Processor -- start 2023-10-03T10:19:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.058+0000 7f88b7b34700 1 -- start start 2023-10-03T10:19:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88b009f330 0x7f88b01c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b0121f50 con 0x7f88b009f330 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b006f860 con 0x7f88b009e850 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b7b34700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01be5d0 con 0x7f88b0139450 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b60d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42500/0 (socket says 172.21.15.19:42500) 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b60d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53014/0 (socket says 172.21.15.19:53014) 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 -- 172.21.15.19:0/2691158072 learned_addr learned my addr 172.21.15.19:0/2691158072 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 -- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 msgr2=0x7f88b011ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 -- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88b009f330 msgr2=0x7f88b01c8df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88b009f330 0x7f88b01c8df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b58d0700 1 -- 172.21.15.19:0/2691158072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8009a70 con 0x7f88b009e850 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.059+0000 7f88b60d1700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88b58d0700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c480 tx=0x7f88ac00c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac005d70 con 0x7f88b009e850 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac0070d0 con 0x7f88b009e850 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a00094a0 con 0x7f88b009e850 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac007440 con 0x7f88b009e850 2023-10-03T10:19:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.060+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b006ccc0 con 0x7f88b009e850 2023-10-03T10:19:00.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.061+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f88ac0075a0 con 0x7f88b009e850 2023-10-03T10:19:00.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.061+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b00747f0 con 0x7f88b009e850 2023-10-03T10:19:00.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.061+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88ac03ea00 con 0x7f88b009e850 2023-10-03T10:19:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.066+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f88ac019b40 con 0x7f88b009e850 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.168+0000 7fb405b49700 1 Processor -- start 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.168+0000 7fb405b49700 1 -- start start 2023-10-03T10:19:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb405b49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4000a0a30 0x7fb4000a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb405b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb4000a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb405b49700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4000a2a70 con 0x7fb400133930 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb405b49700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000a01d0 con 0x7fb4000a0a30 2023-10-03T10:19:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb405b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb40009e2b0 con 0x7fb40009d630 2023-10-03T10:19:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3ff7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4000a0a30 0x7fb4000a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb4000a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3fffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb400133930 0x7fb400133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36444/0 (socket says 172.21.15.19:36444) 2023-10-03T10:19:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3fffff700 1 -- 172.21.15.19:0/4009494182 learned_addr learned my addr 172.21.15.19:0/4009494182 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 -- 172.21.15.19:0/4009494182 >> v2:172.21.15.19:3300/0 conn(0x7fb4000a0a30 msgr2=0x7fb4000a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 --2- 172.21.15.19:0/4009494182 >> v2:172.21.15.19:3300/0 conn(0x7fb4000a0a30 0x7fb4000a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 -- 172.21.15.19:0/4009494182 >> v1:172.21.15.19:6789/0 conn(0x7fb400133930 legacy=0x7fb400133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 -- 172.21.15.19:0/4009494182 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40009dc50 con 0x7fb40009d630 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.169+0000 7fb3feffd700 1 --2- 172.21.15.19:0/4009494182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb4000a1340 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbc4818f751d437c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb3fe7fc700 1 -- 172.21.15.19:0/4009494182 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011830 con 0x7fb40009d630 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb3fe7fc700 1 -- 172.21.15.19:0/4009494182 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011990 con 0x7fb40009d630 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb3fe7fc700 1 -- 172.21.15.19:0/4009494182 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011d20 con 0x7fb40009d630 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 -- 172.21.15.19:0/4009494182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 msgr2=0x7fb4000a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 --2- 172.21.15.19:0/4009494182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb4000a1340 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fb3f4009840 tx=0x7fb3f4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 -- 172.21.15.19:0/4009494182 shutdown_connections 2023-10-03T10:19:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 --2- 172.21.15.19:0/4009494182 >> v2:172.21.15.19:3300/0 conn(0x7fb4000a0a30 0x7fb4000a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 --2- 172.21.15.19:0/4009494182 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb4000a1340 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 -- 172.21.15.19:0/4009494182 >> 172.21.15.19:0/4009494182 conn(0x7fb4000a3050 msgr2=0x7fb4000a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.170+0000 7fb405b49700 1 -- 172.21.15.19:0/4009494182 shutdown_connections 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.171+0000 7fb405b49700 1 -- 172.21.15.19:0/4009494182 wait complete. 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.172+0000 7fb405b49700 1 Processor -- start 2023-10-03T10:19:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.172+0000 7fb405b49700 1 -- start start 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4000a0a30 0x7fb40011f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb400133930 0x7fb4001c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb400121fb0 con 0x7fb400133930 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40011eef0 con 0x7fb4000a0a30 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb405b49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb400120640 con 0x7fb40009d630 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb3ff7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb3ff7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53032/0 (socket says 172.21.15.19:53032) 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb3ff7fe700 1 -- 172.21.15.19:0/1941036637 learned_addr learned my addr 172.21.15.19:0/1941036637 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb3feffd700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4000a0a30 0x7fb40011f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.173+0000 7fb3fffff700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb400133930 0x7fb4001c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 -- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4000a0a30 msgr2=0x7fb40011f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4000a0a30 0x7fb40011f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 -- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb400133930 msgr2=0x7fb4001c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb400133930 0x7fb4001c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 -- 172.21.15.19:0/1941036637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f40094a0 con 0x7fb40009d630 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3ff7fe700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000efc0 tx=0x7fb3f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f000cdc0 con 0x7fb40009d630 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f000f040 con 0x7fb40009d630 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4000a5040 con 0x7fb40009d630 2023-10-03T10:19:00.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00146a0 con 0x7fb40009d630 2023-10-03T10:19:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.174+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4001334e0 con 0x7fb40009d630 2023-10-03T10:19:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.175+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb3f0014800 con 0x7fb40009d630 2023-10-03T10:19:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.175+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40011ff10 con 0x7fb40009d630 2023-10-03T10:19:00.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.175+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb3f003ff30 con 0x7fb40009d630 2023-10-03T10:19:00.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.180+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb3f00133e0 con 0x7fb40009d630 2023-10-03T10:19:00.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 Processor -- start 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 -- start start 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ef4131810 0x7f0ef4131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef409a580 0x7f0ef4139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef41313c0 con 0x7f0ef4099a40 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef406e8c0 con 0x7f0ef4131810 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.197+0000 7f0efbd2f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4071d20 con 0x7f0ef409a580 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0ef4131810 0x7f0ef4131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef92ca700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0ef4099a40 0x7f0ef4099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36458/0 (socket says 172.21.15.19:36458) 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef92ca700 1 -- 172.21.15.19:0/1586725846 learned_addr learned my addr 172.21.15.19:0/1586725846 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:00.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0efa2cc700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef409a580 0x7f0ef4139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 -- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef409a580 msgr2=0x7f0ef4139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef409a580 0x7f0ef4139660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 -- 172.21.15.19:0/1586725846 >> v1:172.21.15.19:6789/0 conn(0x7f0ef4099a40 legacy=0x7f0ef4099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 -- 172.21.15.19:0/1586725846 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef40721a0 con 0x7f0ef4131810 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef8ac9700 1 -- 172.21.15.19:0/1586725846 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672896694 0 0) 0x7f0ef41313c0 con 0x7f0ef4099a40 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef9acb700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef4131be0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009840 tx=0x7f0ef0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62850f6b915c24e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef8ac9700 1 -- 172.21.15.19:0/1586725846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0011830 con 0x7f0ef4131810 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef8ac9700 1 -- 172.21.15.19:0/1586725846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0011990 con 0x7f0ef4131810 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.198+0000 7f0ef8ac9700 1 -- 172.21.15.19:0/1586725846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0011d20 con 0x7f0ef4131810 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 -- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 msgr2=0x7f0ef4131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef4131be0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0009840 tx=0x7f0ef0009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 -- 172.21.15.19:0/1586725846 shutdown_connections 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef409a580 0x7f0ef4139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/1586725846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef4131be0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 -- 172.21.15.19:0/1586725846 >> 172.21.15.19:0/1586725846 conn(0x7f0ef40a2aa0 msgr2=0x7f0ef40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 -- 172.21.15.19:0/1586725846 shutdown_connections 2023-10-03T10:19:00.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.199+0000 7f0efbd2f700 1 -- 172.21.15.19:0/1586725846 wait complete. 2023-10-03T10:19:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 Processor -- start 2023-10-03T10:19:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 -- start start 2023-10-03T10:19:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ef409a580 0x7f0ef4119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef411c900 con 0x7f0ef4131810 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef411b220 con 0x7f0ef4099a40 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.201+0000 7f0efbd2f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef411cdb0 con 0x7f0ef409a580 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42514/0 (socket says 172.21.15.19:42514) 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 -- 172.21.15.19:0/3892914169 learned_addr learned my addr 172.21.15.19:0/3892914169 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0efa2cc700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 -- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ef409a580 msgr2=0x7f0ef4119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ef409a580 0x7f0ef4119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 -- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 msgr2=0x7f0ef411a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef411a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 -- 172.21.15.19:0/3892914169 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef00094a0 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0efa2cc700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0ef9acb700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00090b0 tx=0x7f0ef0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0004570 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef001f070 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef40a1b10 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef00038c0 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.202+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef406eb50 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.203+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ef0021030 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.203+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ef0040950 con 0x7f0ef4099a40 2023-10-03T10:19:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.204+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef411d1b0 con 0x7f0ef4099a40 2023-10-03T10:19:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.209+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ef0003a20 con 0x7f0ef4099a40 2023-10-03T10:19:00.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.278+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88b0122cc0 con 0x7f88b009e850 2023-10-03T10:19:00.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.278+0000 7f88a67fc700 1 -- 172.21.15.19:0/2691158072 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f88ac019730 con 0x7f88b009e850 2023-10-03T10:19:00.279 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 msgr2=0x7f88b01c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00c480 tx=0x7f88ac00c840 comp rx=0 tx=0).stop 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 shutdown_connections 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f88b0139450 0x7f88b011ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f88b009e850 0x7f88b01c88b0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 --2- 172.21.15.19:0/2691158072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f88b009f330 0x7f88b01c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 >> 172.21.15.19:0/2691158072 conn(0x7f88b00a3f70 msgr2=0x7f88b00710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 shutdown_connections 2023-10-03T10:19:00.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.281+0000 7f88b7b34700 1 -- 172.21.15.19:0/2691158072 wait complete. 2023-10-03T10:19:00.296 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:00.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.388+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb4000747f0 con 0x7fb40009d630 2023-10-03T10:19:00.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.388+0000 7fb3e7fff700 1 -- 172.21.15.19:0/1941036637 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb3f001a2c0 con 0x7fb40009d630 2023-10-03T10:19:00.390 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 msgr2=0x7fb40011f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb3f000efc0 tx=0x7fb3f000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 shutdown_connections 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb400133930 0x7fb4001c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb40009d630 0x7fb40011f490 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 --2- 172.21.15.19:0/1941036637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4000a0a30 0x7fb40011f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 >> 172.21.15.19:0/1941036637 conn(0x7fb4000a3050 msgr2=0x7fb4001bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 shutdown_connections 2023-10-03T10:19:00.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.391+0000 7fb405b49700 1 -- 172.21.15.19:0/1941036637 wait complete. 2023-10-03T10:19:00.405 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:00.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.413+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0ef4074ea0 con 0x7f0ef4099a40 2023-10-03T10:19:00.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.413+0000 7f0eea7fc700 1 -- 172.21.15.19:0/3892914169 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ef0015020 con 0x7f0ef4099a40 2023-10-03T10:19:00.414 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 msgr2=0x7f0ef41195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00090b0 tx=0x7f0ef0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 shutdown_connections 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0ef4131810 0x7f0ef411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0ef4099a40 0x7f0ef41195c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 --2- 172.21.15.19:0/3892914169 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0ef409a580 0x7f0ef4119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 >> 172.21.15.19:0/3892914169 conn(0x7f0ef40a2aa0 msgr2=0x7f0ef412e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 shutdown_connections 2023-10-03T10:19:00.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:00.416+0000 7f0efbd2f700 1 -- 172.21.15.19:0/3892914169 wait complete. 2023-10-03T10:19:00.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:00.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 Processor -- start 2023-10-03T10:19:01.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 -- start start 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 0x7fc34409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 0x7fc344131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc344070940 con 0x7fc34409f240 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406fd60 con 0x7fc34409e930 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.030+0000 7fc34a797700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc34406fa80 con 0x7fc34409f650 2023-10-03T10:19:01.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc343fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 0x7fc34409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc3437fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc34409f240 0x7fc3441317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36464/0 (socket says 172.21.15.19:36464) 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc3437fe700 1 -- 172.21.15.19:0/1007037780 learned_addr learned my addr 172.21.15.19:0/1007037780 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 0x7fc344131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc342ffd700 1 -- 172.21.15.19:0/1007037780 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480698901 0 0) 0x7fc344070940 con 0x7fc34409f240 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 -- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 msgr2=0x7fc34409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 0x7fc34409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 -- 172.21.15.19:0/1007037780 >> v1:172.21.15.19:6789/0 conn(0x7fc34409f240 legacy=0x7fc3441317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 -- 172.21.15.19:0/1007037780 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc34409fb60 con 0x7fc34409f650 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc343fff700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 0x7fc34409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc348d34700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 0x7fc344131f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009dc0 tx=0x7fc33c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3ca90312070dcd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc342ffd700 1 -- 172.21.15.19:0/1007037780 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00e070 con 0x7fc34409f650 2023-10-03T10:19:01.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc342ffd700 1 -- 172.21.15.19:0/1007037780 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33c00bb20 con 0x7fc34409f650 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.031+0000 7fc342ffd700 1 -- 172.21.15.19:0/1007037780 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33c012430 con 0x7fc34409f650 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 -- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 msgr2=0x7fc344131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 0x7fc344131f00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fc33c009dc0 tx=0x7fc33c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 -- 172.21.15.19:0/1007037780 shutdown_connections 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f650 0x7fc344131f00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 --2- 172.21.15.19:0/1007037780 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409e930 0x7fc34409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 -- 172.21.15.19:0/1007037780 >> 172.21.15.19:0/1007037780 conn(0x7fc3440a4210 msgr2=0x7fc3440a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 -- 172.21.15.19:0/1007037780 shutdown_connections 2023-10-03T10:19:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.032+0000 7fc34a797700 1 -- 172.21.15.19:0/1007037780 wait complete. 2023-10-03T10:19:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.033+0000 7fc34a797700 1 Processor -- start 2023-10-03T10:19:01.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 -- start start 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f240 0x7fc3441a4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409f650 0x7fc3441a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441a7680 con 0x7fc34409e930 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3440a32d0 con 0x7fc34409f650 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc34a797700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3441a6e10 con 0x7fc34409f240 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc343fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc343fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51544/0 (socket says 172.21.15.19:51544) 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc343fff700 1 -- 172.21.15.19:0/947994586 learned_addr learned my addr 172.21.15.19:0/947994586 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.034+0000 7fc3437fe700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f240 0x7fc3441a4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc348d34700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409f650 0x7fc3441a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 -- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f240 msgr2=0x7fc3441a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f240 0x7fc3441a4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 -- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409f650 msgr2=0x7fc3441a4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409f650 0x7fc3441a4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 -- 172.21.15.19:0/947994586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3340094a0 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc343fff700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc33400ebe0 tx=0x7fc33400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400c850 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33400c9b0 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c009a70 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc33400cd40 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.035+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3440a0190 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.036+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc334013470 con 0x7fc34409e930 2023-10-03T10:19:01.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.036+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc33403f770 con 0x7fc34409e930 2023-10-03T10:19:01.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.036+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc344074ea0 con 0x7fc34409e930 2023-10-03T10:19:01.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.041+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc334013720 con 0x7fc34409e930 2023-10-03T10:19:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.244+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc3441a69c0 con 0x7fc34409e930 2023-10-03T10:19:01.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.245+0000 7fc340ff9700 1 -- 172.21.15.19:0/947994586 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc334021030 con 0x7fc34409e930 2023-10-03T10:19:01.246 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:01.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 msgr2=0x7fc3441a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fc33400ebe0 tx=0x7fc33400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 shutdown_connections 2023-10-03T10:19:01.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc34409f650 0x7fc3441a4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc34409e930 0x7fc3441a3bf0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 --2- 172.21.15.19:0/947994586 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc34409f240 0x7fc3441a4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 >> 172.21.15.19:0/947994586 conn(0x7fc3440a4210 msgr2=0x7fc3441b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 shutdown_connections 2023-10-03T10:19:01.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.247+0000 7fc34a797700 1 -- 172.21.15.19:0/947994586 wait complete. 2023-10-03T10:19:01.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:01.297 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:01.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:01.430 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:01.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.438+0000 7f91e3927700 1 Processor -- start 2023-10-03T10:19:01.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.438+0000 7f91e3927700 1 -- start start 2023-10-03T10:19:01.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 0x7f91dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 0x7f91dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 0x7f91dc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91dc09f520 con 0x7f91dc09e000 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc09f130 con 0x7f91dc09d6f0 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e3927700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc09e930 con 0x7f91dc09e410 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e16c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 0x7f91dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e1ec4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 0x7f91dc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e16c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 0x7f91dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42536/0 (socket says 172.21.15.19:42536) 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e16c3700 1 -- 172.21.15.19:0/2146422916 learned_addr learned my addr 172.21.15.19:0/2146422916 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.439+0000 7f91e0ec2700 1 --2- 172.21.15.19:0/2146422916 >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 0x7f91dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 -- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 msgr2=0x7f91dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 --2- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 0x7f91dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 -- 172.21.15.19:0/2146422916 >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 msgr2=0x7f91dc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 --2- 172.21.15.19:0/2146422916 >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 0x7f91dc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 -- 172.21.15.19:0/2146422916 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc09b2d0 con 0x7f91dc09e410 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e0ec2700 1 --2- 172.21.15.19:0/2146422916 >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 0x7f91dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91e1ec4700 1 --2- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 0x7f91dc130ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009dc0 tx=0x7f91d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e142792c2146c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91dbfff700 1 -- 172.21.15.19:0/2146422916 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400e070 con 0x7f91dc09e410 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91dbfff700 1 -- 172.21.15.19:0/2146422916 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d400bae0 con 0x7f91dc09e410 2023-10-03T10:19:01.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.440+0000 7f91dbfff700 1 -- 172.21.15.19:0/2146422916 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d400be90 con 0x7f91dc09e410 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 -- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 msgr2=0x7f91dc130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 --2- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 0x7f91dc130ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009dc0 tx=0x7f91d400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 -- 172.21.15.19:0/2146422916 shutdown_connections 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 --2- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09d6f0 0x7f91dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 --2- 172.21.15.19:0/2146422916 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e410 0x7f91dc130ba0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 --2- 172.21.15.19:0/2146422916 >> v2:172.21.15.19:3300/0 conn(0x7f91dc09e000 0x7f91dc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 -- 172.21.15.19:0/2146422916 >> 172.21.15.19:0/2146422916 conn(0x7f91dc066f50 msgr2=0x7f91dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 -- 172.21.15.19:0/2146422916 shutdown_connections 2023-10-03T10:19:01.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.441+0000 7f91e3927700 1 -- 172.21.15.19:0/2146422916 wait complete. 2023-10-03T10:19:01.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.443+0000 7f91e3927700 1 Processor -- start 2023-10-03T10:19:01.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.443+0000 7f91e3927700 1 -- start start 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09e410 0x7f91dc1383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc11a670 con 0x7f91dc09d6f0 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc11a9c0 con 0x7f91dc09e410 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e3927700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91dc09c700 con 0x7f91dc09e000 2023-10-03T10:19:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e16c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53056/0 (socket says 172.21.15.19:53056) 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e16c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51564/0 (socket says 172.21.15.19:51564) 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 -- 172.21.15.19:0/1501787284 learned_addr learned my addr 172.21.15.19:0/1501787284 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e1ec4700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09e410 0x7f91dc1383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 -- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09e410 msgr2=0x7f91dc1383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09e410 0x7f91dc1383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 -- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 msgr2=0x7f91dc137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e0ec2700 1 -- 172.21.15.19:0/1501787284 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d4009a70 con 0x7f91dc09e000 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.444+0000 7f91e16c3700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91e0ec2700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f91d000e810 tx=0x7f91d000eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000c070 con 0x7f91dc09e000 2023-10-03T10:19:01.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d0013610 con 0x7f91dc09e000 2023-10-03T10:19:01.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00139c0 con 0x7f91dc09e000 2023-10-03T10:19:01.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91dc11a310 con 0x7f91dc09e000 2023-10-03T10:19:01.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.445+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91dc0a1d00 con 0x7f91dc09e000 2023-10-03T10:19:01.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.446+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91d0013b20 con 0x7f91dc09e000 2023-10-03T10:19:01.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.446+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc074ea0 con 0x7f91dc09e000 2023-10-03T10:19:01.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.446+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91d003f350 con 0x7f91dc09e000 2023-10-03T10:19:01.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.452+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91d00108a0 con 0x7f91dc09e000 2023-10-03T10:19:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.549+0000 7f31e6d38700 1 Processor -- start 2023-10-03T10:19:01.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.549+0000 7f31e6d38700 1 -- start start 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e6d38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009d6f0 0x7f31e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e6d38700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31e009e410 0x7f31e0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e6d38700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e009b120 con 0x7f31e009e000 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e6d38700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e006b460 con 0x7f31e009e410 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e6d38700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e009a7e0 con 0x7f31e009d6f0 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e52d5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f31e009e410 0x7f31e0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31dffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f31e009e000 0x7f31e01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36470/0 (socket says 172.21.15.19:36470) 2023-10-03T10:19:01.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31dffff700 1 -- 172.21.15.19:0/2530192135 learned_addr learned my addr 172.21.15.19:0/2530192135 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:01.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31e4ad4700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009d6f0 0x7f31e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.550+0000 7f31df7fe700 1 -- 172.21.15.19:0/2530192135 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088001510 0 0) 0x7f31e009b120 con 0x7f31e009e000 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31df7fe700 1 -- 172.21.15.19:0/2530192135 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d00035b0 con 0x7f31e009e000 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31e52d5700 1 -- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009d6f0 msgr2=0x7f31e009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31e52d5700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009d6f0 0x7f31e009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31e52d5700 1 -- 172.21.15.19:0/2530192135 >> v1:172.21.15.19:6789/0 conn(0x7f31e009e000 legacy=0x7f31e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31e52d5700 1 -- 172.21.15.19:0/2530192135 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e009a500 con 0x7f31e009e410 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31e52d5700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009e410 0x7f31e0134100 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009d90 tx=0x7f31d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79249480bc92b4cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31df7fe700 1 -- 172.21.15.19:0/2530192135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d800e070 con 0x7f31e009e410 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31df7fe700 1 -- 172.21.15.19:0/2530192135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800bb20 con 0x7f31e009e410 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.551+0000 7f31df7fe700 1 -- 172.21.15.19:0/2530192135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8012430 con 0x7f31e009e410 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 -- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009e410 msgr2=0x7f31e0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009e410 0x7f31e0134100 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f31d8009d90 tx=0x7f31d800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 -- 172.21.15.19:0/2530192135 shutdown_connections 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009e410 0x7f31e0134100 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2530192135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009d6f0 0x7f31e009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 -- 172.21.15.19:0/2530192135 >> 172.21.15.19:0/2530192135 conn(0x7f31e0066f50 msgr2=0x7f31e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 -- 172.21.15.19:0/2530192135 shutdown_connections 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.552+0000 7f31e6d38700 1 -- 172.21.15.19:0/2530192135 wait complete. 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.553+0000 7f31e6d38700 1 Processor -- start 2023-10-03T10:19:01.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.553+0000 7f31e6d38700 1 -- start start 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009e000 0x7f31e01c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31e009e410 0x7f31e01c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01a64d0 con 0x7f31e009d6f0 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e009c710 con 0x7f31e009e000 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e6d38700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01b9280 con 0x7f31e009e410 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e4ad4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e4ad4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51588/0 (socket says 172.21.15.19:51588) 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e4ad4700 1 -- 172.21.15.19:0/2298570857 learned_addr learned my addr 172.21.15.19:0/2298570857 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31dffff700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009e000 0x7f31e01c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e52d5700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31e009e410 0x7f31e01c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e4ad4700 1 -- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31e009e410 msgr2=0x7f31e01c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.554+0000 7f31e4ad4700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31e009e410 0x7f31e01c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e4ad4700 1 -- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009e000 msgr2=0x7f31e01c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e4ad4700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009e000 0x7f31e01c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e4ad4700 1 -- 172.21.15.19:0/2298570857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009a70 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e4ad4700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f31d400e9b0 tx=0x7f31d400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d4009710 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400ee50 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e01a7cc0 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400ca50 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.555+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01a6fc0 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.556+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31d400cbb0 con 0x7f31e009d6f0 2023-10-03T10:19:01.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.556+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31d403f720 con 0x7f31e009d6f0 2023-10-03T10:19:01.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.557+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e0074ea0 con 0x7f31e009d6f0 2023-10-03T10:19:01.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.562+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31d40232f0 con 0x7f31e009d6f0 2023-10-03T10:19:01.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.580+0000 7fe1d8f52700 1 Processor -- start 2023-10-03T10:19:01.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.580+0000 7fe1d8f52700 1 -- start start 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d8f52700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d409f410 0x7fe1d4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d8f52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 0x7fe1d41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d8f52700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d4070940 con 0x7fe1d409e930 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d8f52700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d406fd60 con 0x7fe1d409f410 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d8f52700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d406fa80 con 0x7fe1d4136fe0 2023-10-03T10:19:01.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d1d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe1d409f410 0x7fe1d4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d2d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 0x7fe1d41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe1d409e930 0x7fe1d409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36482/0 (socket says 172.21.15.19:36482) 2023-10-03T10:19:01.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.581+0000 7fe1d259c700 1 -- 172.21.15.19:0/3503833700 learned_addr learned my addr 172.21.15.19:0/3503833700 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d1d9b700 1 -- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 msgr2=0x7fe1d41393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d1d9b700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 0x7fe1d41393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d1d9b700 1 -- 172.21.15.19:0/3503833700 >> v1:172.21.15.19:6789/0 conn(0x7fe1d409e930 legacy=0x7fe1d409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d1d9b700 1 -- 172.21.15.19:0/3503833700 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d409fb60 con 0x7fe1d409f410 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d159a700 1 -- 172.21.15.19:0/3503833700 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774539681 0 0) 0x7fe1d4070940 con 0x7fe1d409e930 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d2d9d700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 0x7fe1d41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d1d9b700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d409f410 0x7fe1d4136aa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009840 tx=0x7fe1c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93607995781d086e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d159a700 1 -- 172.21.15.19:0/3503833700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011830 con 0x7fe1d409f410 2023-10-03T10:19:01.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d159a700 1 -- 172.21.15.19:0/3503833700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8011990 con 0x7fe1d409f410 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.582+0000 7fe1d159a700 1 -- 172.21.15.19:0/3503833700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011d20 con 0x7fe1d409f410 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d409f410 msgr2=0x7fe1d4136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d409f410 0x7fe1d4136aa0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009840 tx=0x7fe1c8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3503833700 shutdown_connections 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d4136fe0 0x7fe1d41393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3503833700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d409f410 0x7fe1d4136aa0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3503833700 >> 172.21.15.19:0/3503833700 conn(0x7fe1d40a4210 msgr2=0x7fe1d40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3503833700 shutdown_connections 2023-10-03T10:19:01.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.583+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3503833700 wait complete. 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.584+0000 7fe1d8f52700 1 Processor -- start 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.584+0000 7fe1d8f52700 1 -- start start 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d409e930 0x7fe1d4122a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d409f410 0x7fe1d4122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4071d90 con 0x7fe1d4136fe0 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d40a31b0 con 0x7fe1d409e930 2023-10-03T10:19:01.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d8f52700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4124f00 con 0x7fe1d409f410 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51608/0 (socket says 172.21.15.19:51608) 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 -- 172.21.15.19:0/3734584733 learned_addr learned my addr 172.21.15.19:0/3734584733 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d259c700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d409e930 0x7fe1d4122a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d409f410 0x7fe1d4122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 -- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d409f410 msgr2=0x7fe1d4122fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d409f410 0x7fe1d4122fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 -- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d409e930 msgr2=0x7fe1d4122a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d409e930 0x7fe1d4122a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 -- 172.21.15.19:0/3734584733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc009a70 con 0x7fe1d4136fe0 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.585+0000 7fe1d2d9d700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00efc0 tx=0x7fe1cc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:01.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.586+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00ca90 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.586+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1cc00f040 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.586+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c80094a0 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.586+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc00ce10 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.586+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d4124c10 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.587+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d4074ea0 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.587+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe1cc003a20 con 0x7fe1d4136fe0 2023-10-03T10:19:01.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.587+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1cc0407a0 con 0x7fe1d4136fe0 2023-10-03T10:19:01.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.596+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1cc01c3b0 con 0x7fe1d4136fe0 2023-10-03T10:19:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.666+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f91dc119c10 con 0x7f91dc09e000 2023-10-03T10:19:01.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.666+0000 7f91d9ffb700 1 -- 172.21.15.19:0/1501787284 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91d00108a0 con 0x7f91dc09e000 2023-10-03T10:19:01.667 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 msgr2=0x7f91dc137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f91d000e810 tx=0x7f91d000eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 shutdown_connections 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91dc09e410 0x7f91dc1383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91dc09d6f0 0x7f91dc137920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 --2- 172.21.15.19:0/1501787284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91dc09e000 0x7f91dc137e60 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.670+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 >> 172.21.15.19:0/1501787284 conn(0x7f91dc066f50 msgr2=0x7f91dc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.671+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 shutdown_connections 2023-10-03T10:19:01.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.671+0000 7f91e3927700 1 -- 172.21.15.19:0/1501787284 wait complete. 2023-10-03T10:19:01.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.778+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f31e006c360 con 0x7f31e009d6f0 2023-10-03T10:19:01.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.778+0000 7f31dd7fa700 1 -- 172.21.15.19:0/2298570857 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31d4017020 con 0x7f31e009d6f0 2023-10-03T10:19:01.779 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 msgr2=0x7f31e01c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f31d400e9b0 tx=0x7f31d400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 shutdown_connections 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31e009e410 0x7f31e01c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31e009d6f0 0x7f31e01c8040 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 --2- 172.21.15.19:0/2298570857 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31e009e000 0x7f31e01c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 >> 172.21.15.19:0/2298570857 conn(0x7f31e0066f50 msgr2=0x7f31e006efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 shutdown_connections 2023-10-03T10:19:01.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.781+0000 7f31e6d38700 1 -- 172.21.15.19:0/2298570857 wait complete. 2023-10-03T10:19:01.796 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.805+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe1d4136a10 con 0x7fe1d4136fe0 2023-10-03T10:19:01.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.805+0000 7fe1c2ffd700 1 -- 172.21.15.19:0/3734584733 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe1cc02b090 con 0x7fe1d4136fe0 2023-10-03T10:19:01.806 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 msgr2=0x7fe1d4123510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00efc0 tx=0x7fe1cc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 shutdown_connections 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe1d4136fe0 0x7fe1d4123510 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe1d409e930 0x7fe1d4122a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 --2- 172.21.15.19:0/3734584733 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe1d409f410 0x7fe1d4122fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 >> 172.21.15.19:0/3734584733 conn(0x7fe1d40a4210 msgr2=0x7fe1d406bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 shutdown_connections 2023-10-03T10:19:01.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:01.808+0000 7fe1d8f52700 1 -- 172.21.15.19:0/3734584733 wait complete. 2023-10-03T10:19:01.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:02.263 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:02.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.408+0000 7f6bc027b700 1 Processor -- start 2023-10-03T10:19:02.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.408+0000 7f6bc027b700 1 -- start start 2023-10-03T10:19:02.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bc027b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bb809e1d0 0x7f6bb8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bc027b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bc027b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb809f130 con 0x7f6bb809d6f0 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bc027b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb809f520 con 0x7f6bb809e1d0 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bc027b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb809e930 con 0x7f6bb8135e50 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbe818700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bb809e1d0 0x7f6bb8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbe818700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42590/0 (socket says 172.21.15.19:42590) 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbe818700 1 -- 172.21.15.19:0/3122671824 learned_addr learned my addr 172.21.15.19:0/3122671824 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6bb809e1d0 0x7f6bb8135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51616/0 (socket says 172.21.15.19:51616) 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbe017700 1 --1- 172.21.15.19:0/3122671824 >> v1:172.21.15.19:6789/0 conn(0x7f6bb809d6f0 0x7f6bb809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36490/0 (socket says 172.21.15.19:36490) 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 -- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 msgr2=0x7f6bb8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 -- 172.21.15.19:0/3122671824 >> v1:172.21.15.19:6789/0 conn(0x7f6bb809d6f0 legacy=0x7f6bb809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 -- 172.21.15.19:0/3122671824 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb809b2d0 con 0x7f6bb809e1d0 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd015700 1 -- 172.21.15.19:0/3122671824 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964866448 0 0) 0x7f6bb809f130 con 0x7f6bb809d6f0 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbe818700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.409+0000 7f6bbd816700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb8135910 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009840 tx=0x7f6bac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a906e80a64bf2d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bbd015700 1 -- 172.21.15.19:0/3122671824 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac011830 con 0x7f6bb809e1d0 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bbd015700 1 -- 172.21.15.19:0/3122671824 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac011990 con 0x7f6bb809e1d0 2023-10-03T10:19:02.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bbd015700 1 -- 172.21.15.19:0/3122671824 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac011d20 con 0x7f6bb809e1d0 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 -- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 msgr2=0x7f6bb8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb8135910 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f6bac009840 tx=0x7f6bac009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 -- 172.21.15.19:0/3122671824 shutdown_connections 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 --2- 172.21.15.19:0/3122671824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb8135910 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 -- 172.21.15.19:0/3122671824 >> 172.21.15.19:0/3122671824 conn(0x7f6bb8066f50 msgr2=0x7f6bb809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 -- 172.21.15.19:0/3122671824 shutdown_connections 2023-10-03T10:19:02.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.410+0000 7f6bc027b700 1 -- 172.21.15.19:0/3122671824 wait complete. 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.411+0000 7f6bc027b700 1 Processor -- start 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.411+0000 7f6bc027b700 1 -- start start 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 0x7f6bb81c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb81bb140 con 0x7f6bb809e1d0 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb81233d0 con 0x7f6bb8135e50 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bc027b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb8131fe0 con 0x7f6bb809d6f0 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbd816700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe017700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 0x7f6bb81c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbd816700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51620/0 (socket says 172.21.15.19:51620) 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbd816700 1 -- 172.21.15.19:0/618322482 learned_addr learned my addr 172.21.15.19:0/618322482 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 -- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 msgr2=0x7f6bb81c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 0x7f6bb81c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 -- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 msgr2=0x7f6bb81c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 -- 172.21.15.19:0/618322482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0009b30 con 0x7f6bb8135e50 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe017700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 0x7f6bb81c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbd816700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.412+0000 7f6bbe818700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb806e870 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000ef90 tx=0x7f6bb000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0018070 con 0x7f6bb8135e50 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000f040 con 0x7f6bb8135e50 2023-10-03T10:19:02.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac0094a0 con 0x7f6bb8135e50 2023-10-03T10:19:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0003c60 con 0x7f6bb8135e50 2023-10-03T10:19:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb8122c60 con 0x7f6bb8135e50 2023-10-03T10:19:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.413+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6bb000c880 con 0x7f6bb8135e50 2023-10-03T10:19:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.414+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6bb003f6c0 con 0x7f6bb8135e50 2023-10-03T10:19:02.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.414+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb809c700 con 0x7f6bb8135e50 2023-10-03T10:19:02.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.419+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6bb0003dc0 con 0x7f6bb8135e50 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.625+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6bb8070480 con 0x7f6bb8135e50 2023-10-03T10:19:02.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.626+0000 7f6baaffd700 1 -- 172.21.15.19:0/618322482 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6bb001cbb0 con 0x7f6bb8135e50 2023-10-03T10:19:02.627 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 msgr2=0x7f6bb806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb806e870 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000ef90 tx=0x7f6bb000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 shutdown_connections 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6bb8135e50 0x7f6bb806e870 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6bb809d6f0 0x7f6bb81c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 --2- 172.21.15.19:0/618322482 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bb809e1d0 0x7f6bb81c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 >> 172.21.15.19:0/618322482 conn(0x7f6bb8066f50 msgr2=0x7f6bb8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 shutdown_connections 2023-10-03T10:19:02.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.628+0000 7f6bc027b700 1 -- 172.21.15.19:0/618322482 wait complete. 2023-10-03T10:19:02.643 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:02.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:02.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:02.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:02.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.829+0000 7fd274d58700 1 Processor -- start 2023-10-03T10:19:02.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.829+0000 7fd274d58700 1 -- start start 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.829+0000 7fd274d58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd274d58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd274d58700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd274d58700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27006b460 con 0x7fd27009e410 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd274d58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27009b120 con 0x7fd27009e000 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd274d58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd27009a7e0 con 0x7fd27009d6f0 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26ed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51636/0 (socket says 172.21.15.19:51636) 2023-10-03T10:19:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53092/0 (socket says 172.21.15.19:53092) 2023-10-03T10:19:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42598/0 (socket says 172.21.15.19:42598) 2023-10-03T10:19:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26ed9d700 1 -- 172.21.15.19:0/105725241 learned_addr learned my addr 172.21.15.19:0/105725241 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 -- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 msgr2=0x7fd2701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 --2- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 -- 172.21.15.19:0/105725241 >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 msgr2=0x7fd270133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 --2- 172.21.15.19:0/105725241 >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 -- 172.21.15.19:0/105725241 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27009a500 con 0x7fd27009d6f0 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26ed9d700 1 --2- 172.21.15.19:0/105725241 >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.830+0000 7fd26e59c700 1 --2- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd260009870 tx=0x7fd260009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a43b6de3e281b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.831+0000 7fd26d59a700 1 -- 172.21.15.19:0/105725241 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260011830 con 0x7fd27009d6f0 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.831+0000 7fd26d59a700 1 -- 172.21.15.19:0/105725241 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260011990 con 0x7fd27009d6f0 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.831+0000 7fd26d59a700 1 -- 172.21.15.19:0/105725241 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260011d20 con 0x7fd27009d6f0 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 -- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 msgr2=0x7fd27009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 --2- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd260009870 tx=0x7fd260009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 -- 172.21.15.19:0/105725241 shutdown_connections 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 --2- 172.21.15.19:0/105725241 >> v2:172.21.15.19:3300/0 conn(0x7fd27009e410 0x7fd270133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 --2- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd27009dac0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 --2- 172.21.15.19:0/105725241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e000 0x7fd2701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 -- 172.21.15.19:0/105725241 >> 172.21.15.19:0/105725241 conn(0x7fd270066f50 msgr2=0x7fd27009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 -- 172.21.15.19:0/105725241 shutdown_connections 2023-10-03T10:19:02.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.832+0000 7fd274d58700 1 -- 172.21.15.19:0/105725241 wait complete. 2023-10-03T10:19:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.833+0000 7fd274d58700 1 Processor -- start 2023-10-03T10:19:02.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.833+0000 7fd274d58700 1 -- start start 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 0x7fd2701a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e410 0x7fd2701a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701a8600 con 0x7fd27009e000 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700a31a0 con 0x7fd27009e410 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd274d58700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701a6ae0 con 0x7fd27009d6f0 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53094/0 (socket says 172.21.15.19:53094) 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 -- 172.21.15.19:0/73760084 learned_addr learned my addr 172.21.15.19:0/73760084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26ed9d700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e410 0x7fd2701a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26dd9b700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 0x7fd2701a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 -- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e410 msgr2=0x7fd2701a5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e410 0x7fd2701a5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 -- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 msgr2=0x7fd2701a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 0x7fd2701a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26e59c700 1 -- 172.21.15.19:0/73760084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd268009b30 con 0x7fd27009d6f0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.834+0000 7fd26dd9b700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 0x7fd2701a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd26e59c700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd2600090b0 tx=0x7fd260004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd260004510 con 0x7fd27009d6f0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26001f070 con 0x7fd27009d6f0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2600094a0 con 0x7fd27009d6f0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600038c0 con 0x7fd27009d6f0 2023-10-03T10:19:02.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.835+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2701a7c20 con 0x7fd27009d6f0 2023-10-03T10:19:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.836+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270074ea0 con 0x7fd27009d6f0 2023-10-03T10:19:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.836+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd260003a20 con 0x7fd27009d6f0 2023-10-03T10:19:02.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.837+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd260021070 con 0x7fd27009d6f0 2023-10-03T10:19:02.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.841+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd260010380 con 0x7fd27009d6f0 2023-10-03T10:19:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.941+0000 7f435aa7e700 1 Processor -- start 2023-10-03T10:19:02.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.941+0000 7f435aa7e700 1 -- start start 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435aa7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f43540a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435aa7e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4354138d80 0x7f435413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435aa7e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540a2a70 con 0x7f43540a0a30 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435aa7e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43540a01d0 con 0x7f4354138d80 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435aa7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f435409e2b0 con 0x7f435409d630 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435881a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f43540a0a30 0x7f43540a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36492/0 (socket says 172.21.15.19:36492) 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435881a700 1 -- 172.21.15.19:0/4132289599 learned_addr learned my addr 172.21.15.19:0/4132289599 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:02.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f4353fff700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f43540a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435901b700 1 --2- 172.21.15.19:0/4132289599 >> v2:172.21.15.19:3300/0 conn(0x7f4354138d80 0x7f435413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435901b700 1 -- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 msgr2=0x7f43540a1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435901b700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f43540a1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435901b700 1 -- 172.21.15.19:0/4132289599 >> v1:172.21.15.19:6789/0 conn(0x7f43540a0a30 legacy=0x7f43540a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f435901b700 1 -- 172.21.15.19:0/4132289599 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435409dc50 con 0x7f4354138d80 2023-10-03T10:19:02.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.942+0000 7f4353fff700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f43540a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.943+0000 7f435901b700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4354138d80 0x7f435413b160 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f434c009d90 tx=0x7f434c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64d7d063963f41a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.943+0000 7f43537fe700 1 -- 172.21.15.19:0/4132289599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c00e070 con 0x7f4354138d80 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.943+0000 7f43537fe700 1 -- 172.21.15.19:0/4132289599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c00bb20 con 0x7f4354138d80 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.943+0000 7f43537fe700 1 -- 172.21.15.19:0/4132289599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c012430 con 0x7f4354138d80 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 -- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4354138d80 msgr2=0x7f435413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4354138d80 0x7f435413b160 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f434c009d90 tx=0x7f434c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 -- 172.21.15.19:0/4132289599 shutdown_connections 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4354138d80 0x7f435413b160 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 --2- 172.21.15.19:0/4132289599 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f43540a1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 -- 172.21.15.19:0/4132289599 >> 172.21.15.19:0/4132289599 conn(0x7f43540a3050 msgr2=0x7f43540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 -- 172.21.15.19:0/4132289599 shutdown_connections 2023-10-03T10:19:02.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.944+0000 7f435aa7e700 1 -- 172.21.15.19:0/4132289599 wait complete. 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.945+0000 7f435aa7e700 1 Processor -- start 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.945+0000 7f435aa7e700 1 -- start start 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.945+0000 7f435aa7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f4354133850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.945+0000 7f435aa7e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 0x7f4354133d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435aa7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 0x7f43541342d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435aa7e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4354137000 con 0x7f43540a0a30 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435aa7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43541359f0 con 0x7f4354138d80 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435aa7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43540a0480 con 0x7f435409d630 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435881a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f4354133850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435901b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 0x7f43541342d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435881a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f4354133850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53102/0 (socket says 172.21.15.19:53102) 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 0x7f4354133d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435881a700 1 -- 172.21.15.19:0/3267396000 learned_addr learned my addr 172.21.15.19:0/3267396000 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 -- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 msgr2=0x7f4354133850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f4354133850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 -- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 msgr2=0x7f43541342d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 0x7f43541342d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 -- 172.21.15.19:0/3267396000 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43400094a0 con 0x7f43540a0a30 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f435901b700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 0x7f43541342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f4353fff700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 0x7f4354133d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f434000e9e0 tx=0x7f434000ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.946+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000ee80 con 0x7f43540a0a30 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.947+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434000c7f0 con 0x7f43540a0a30 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.947+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434c009a70 con 0x7f43540a0a30 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.947+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434000cba0 con 0x7f43540a0a30 2023-10-03T10:19:02.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.947+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4354137ec0 con 0x7f43540a0a30 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.948+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43540747f0 con 0x7f43540a0a30 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.948+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f434000cd00 con 0x7f43540a0a30 2023-10-03T10:19:02.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.948+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f434003f740 con 0x7f43540a0a30 2023-10-03T10:19:02.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.953+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43400232f0 con 0x7f43540a0a30 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.970+0000 7f82242f9700 1 Processor -- start 2023-10-03T10:19:02.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.970+0000 7f82242f9700 1 -- start start 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f82242f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09f410 0x7f821c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f82242f9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f821c136fe0 0x7f821c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f82242f9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c070940 con 0x7f821c09e930 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f82242f9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c06fd60 con 0x7f821c136fe0 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f82242f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821c06fa80 con 0x7f821c09f410 2023-10-03T10:19:02.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f8222095700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f821c09e930 0x7f821c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36508/0 (socket says 172.21.15.19:36508) 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f8222095700 1 -- 172.21.15.19:0/3541895177 learned_addr learned my addr 172.21.15.19:0/3541895177 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f8222896700 1 --2- 172.21.15.19:0/3541895177 >> v2:172.21.15.19:3300/0 conn(0x7f821c136fe0 0x7f821c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.971+0000 7f8221894700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09f410 0x7f821c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8222896700 1 -- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09f410 msgr2=0x7f821c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8222896700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09f410 0x7f821c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8222896700 1 -- 172.21.15.19:0/3541895177 >> v1:172.21.15.19:6789/0 conn(0x7f821c09e930 legacy=0x7f821c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8222896700 1 -- 172.21.15.19:0/3541895177 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c09fb60 con 0x7f821c136fe0 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8221093700 1 -- 172.21.15.19:0/3541895177 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600314620 0 0) 0x7f821c070940 con 0x7f821c09e930 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8222896700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c136fe0 0x7f821c1393c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8214009d90 tx=0x7f821400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d2e017f5a366d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8221093700 1 -- 172.21.15.19:0/3541895177 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821400e070 con 0x7f821c136fe0 2023-10-03T10:19:02.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8221093700 1 -- 172.21.15.19:0/3541895177 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821400bb20 con 0x7f821c136fe0 2023-10-03T10:19:02.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.972+0000 7f8221093700 1 -- 172.21.15.19:0/3541895177 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214012430 con 0x7f821c136fe0 2023-10-03T10:19:02.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 -- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c136fe0 msgr2=0x7f821c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c136fe0 0x7f821c1393c0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f8214009d90 tx=0x7f821400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:02.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 -- 172.21.15.19:0/3541895177 shutdown_connections 2023-10-03T10:19:02.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c136fe0 0x7f821c1393c0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 --2- 172.21.15.19:0/3541895177 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09f410 0x7f821c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 -- 172.21.15.19:0/3541895177 >> 172.21.15.19:0/3541895177 conn(0x7f821c0a4210 msgr2=0x7f821c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 -- 172.21.15.19:0/3541895177 shutdown_connections 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.973+0000 7f82242f9700 1 -- 172.21.15.19:0/3541895177 wait complete. 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.974+0000 7f82242f9700 1 Processor -- start 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.974+0000 7f82242f9700 1 -- start start 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 0x7f821c1c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 0x7f821c11c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:02.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c11ffb0 con 0x7f821c09f410 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c11dbc0 con 0x7f821c136fe0 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f82242f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f821c120190 con 0x7f821c09e930 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f8222095700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f8221894700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 0x7f821c1c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f8222095700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53116/0 (socket says 172.21.15.19:53116) 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.975+0000 7f8222095700 1 -- 172.21.15.19:0/2285007235 learned_addr learned my addr 172.21.15.19:0/2285007235 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222896700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 0x7f821c11c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 -- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 msgr2=0x7f821c11c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 0x7f821c11c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 -- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 msgr2=0x7f821c1c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 0x7f821c1c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:02.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 -- 172.21.15.19:0/2285007235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009a70 con 0x7f821c09e930 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222896700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 0x7f821c11c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8221894700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 0x7f821c1c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8222095700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f821800c520 tx=0x7f821800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218004c80 con 0x7f821c09e930 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218004de0 con 0x7f821c09e930 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c1bc0c0 con 0x7f821c09e930 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218007310 con 0x7f821c09e930 2023-10-03T10:19:02.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.976+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c1c6f00 con 0x7f821c09e930 2023-10-03T10:19:02.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.977+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8218007470 con 0x7f821c09e930 2023-10-03T10:19:02.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.977+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f821803f3f0 con 0x7f821c09e930 2023-10-03T10:19:02.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.977+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c074ea0 con 0x7f821c09e930 2023-10-03T10:19:02.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:02.982+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82180123b0 con 0x7f821c09e930 2023-10-03T10:19:03.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.052+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd27006c360 con 0x7fd27009d6f0 2023-10-03T10:19:03.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.052+0000 7fd25effd700 1 -- 172.21.15.19:0/73760084 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd260015030 con 0x7fd27009d6f0 2023-10-03T10:19:03.053 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:03.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.054+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 msgr2=0x7fd2701a4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.054+0000 7fd274d58700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd2600090b0 tx=0x7fd260004750 comp rx=0 tx=0).stop 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 shutdown_connections 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27009e410 0x7fd2701a5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27009d6f0 0x7fd2701a4ed0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 --2- 172.21.15.19:0/73760084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd27009e000 0x7fd2701a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 >> 172.21.15.19:0/73760084 conn(0x7fd270066f50 msgr2=0x7fd2701b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 shutdown_connections 2023-10-03T10:19:03.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.055+0000 7fd274d58700 1 -- 172.21.15.19:0/73760084 wait complete. 2023-10-03T10:19:03.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.164+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4354135bc0 con 0x7f43540a0a30 2023-10-03T10:19:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.164+0000 7f43517fa700 1 -- 172.21.15.19:0/3267396000 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f434001bb60 con 0x7f43540a0a30 2023-10-03T10:19:03.165 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 msgr2=0x7f4354133d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 0x7f4354133d90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f434000e9e0 tx=0x7f434000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 shutdown_connections 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4354138d80 0x7f43541342d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f435409d630 0x7f4354133850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 --2- 172.21.15.19:0/3267396000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43540a0a30 0x7f4354133d90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 >> 172.21.15.19:0/3267396000 conn(0x7f43540a3050 msgr2=0x7f435409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 shutdown_connections 2023-10-03T10:19:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.166+0000 7f435aa7e700 1 -- 172.21.15.19:0/3267396000 wait complete. 2023-10-03T10:19:03.181 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:03.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.188+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f821c09dc10 con 0x7f821c09e930 2023-10-03T10:19:03.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.189+0000 7f8212ffd700 1 -- 172.21.15.19:0/2285007235 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f821801b340 con 0x7f821c09e930 2023-10-03T10:19:03.190 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 msgr2=0x7f821c1c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f821800c520 tx=0x7f821800c830 comp rx=0 tx=0).stop 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 shutdown_connections 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f821c136fe0 0x7f821c11c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f821c09e930 0x7f821c1c6480 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 --2- 172.21.15.19:0/2285007235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f821c09f410 0x7f821c1c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 >> 172.21.15.19:0/2285007235 conn(0x7f821c0a4210 msgr2=0x7f821c134a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 shutdown_connections 2023-10-03T10:19:03.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.191+0000 7f82242f9700 1 -- 172.21.15.19:0/2285007235 wait complete. 2023-10-03T10:19:03.205 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:03.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.788+0000 7f3f521b3700 1 Processor -- start 2023-10-03T10:19:03.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.788+0000 7f3f521b3700 1 -- start start 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f521b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 0x7f3f4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f521b3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f4c09e000 0x7f3f4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f521b3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c09b120 con 0x7f3f4c09e410 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f521b3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c06b460 con 0x7f3f4c09e000 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f521b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c09a7e0 con 0x7f3f4c09d6f0 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 0x7f3f4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3f4c09e000 0x7f3f4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3f4c09e410 0x7f3f4c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36520/0 (socket says 172.21.15.19:36520) 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4bfff700 1 -- 172.21.15.19:0/1525999407 learned_addr learned my addr 172.21.15.19:0/1525999407 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 -- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 msgr2=0x7f3f4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 0x7f3f4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 -- 172.21.15.19:0/1525999407 >> v1:172.21.15.19:6789/0 conn(0x7f3f4c09e410 legacy=0x7f3f4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 -- 172.21.15.19:0/1525999407 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c09a500 con 0x7f3f4c09e000 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4b7fe700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 0x7f3f4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.789+0000 7f3f4affd700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1339f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009840 tx=0x7f3f34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a99ba08faa41731 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f4a7fc700 1 -- 172.21.15.19:0/1525999407 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011830 con 0x7f3f4c09e000 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f4a7fc700 1 -- 172.21.15.19:0/1525999407 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f34011990 con 0x7f3f4c09e000 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f4a7fc700 1 -- 172.21.15.19:0/1525999407 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34011d20 con 0x7f3f4c09e000 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 -- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 msgr2=0x7f3f4c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1339f0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009840 tx=0x7f3f34009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 -- 172.21.15.19:0/1525999407 shutdown_connections 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09d6f0 0x7f3f4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 --2- 172.21.15.19:0/1525999407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1339f0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 -- 172.21.15.19:0/1525999407 >> 172.21.15.19:0/1525999407 conn(0x7f3f4c066f50 msgr2=0x7f3f4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 -- 172.21.15.19:0/1525999407 shutdown_connections 2023-10-03T10:19:03.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.790+0000 7f3f521b3700 1 -- 172.21.15.19:0/1525999407 wait complete. 2023-10-03T10:19:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.792+0000 7f3f521b3700 1 Processor -- start 2023-10-03T10:19:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.792+0000 7f3f521b3700 1 -- start start 2023-10-03T10:19:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 0x7f3f4c1a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c1a93e0 con 0x7f3f4c09e000 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c1a8d30 con 0x7f3f4c09d6f0 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f521b3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c09c710 con 0x7f3f4c09e410 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 0x7f3f4c1a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42632/0 (socket says 172.21.15.19:42632) 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4b7fe700 1 -- 172.21.15.19:0/133214231 learned_addr learned my addr 172.21.15.19:0/133214231 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 -- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 msgr2=0x7f3f4c1a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 -- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 msgr2=0x7f3f4c1a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 -- 172.21.15.19:0/133214231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c0094a0 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4b7fe700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4affd700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f4bfff700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 0x7f3f4c1a6970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400caa0 tx=0x7f3f4400cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.793+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400a9a0 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400ab00 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400ae70 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f340094a0 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c1a8870 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3f4401b3b0 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.794+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3f4403f330 con 0x7f3f4c09e410 2023-10-03T10:19:03.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.795+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c074ea0 con 0x7f3f4c09e410 2023-10-03T10:19:03.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:03.800+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3f440192c0 con 0x7f3f4c09e410 2023-10-03T10:19:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.006+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3f4c1a9550 con 0x7f3f4c09e410 2023-10-03T10:19:04.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.007+0000 7f3f43fff700 1 -- 172.21.15.19:0/133214231 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f44017020 con 0x7f3f4c09e410 2023-10-03T10:19:04.007 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 msgr2=0x7f3f4c1a6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 0x7f3f4c1a6970 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400caa0 tx=0x7f3f4400cdb0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 shutdown_connections 2023-10-03T10:19:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3f4c09e410 0x7f3f4c1a6970 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3f4c09d6f0 0x7f3f4c1a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 --2- 172.21.15.19:0/133214231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3f4c09e000 0x7f3f4c1a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 >> 172.21.15.19:0/133214231 conn(0x7f3f4c066f50 msgr2=0x7f3f4c1baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 shutdown_connections 2023-10-03T10:19:04.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.009+0000 7f3f521b3700 1 -- 172.21.15.19:0/133214231 wait complete. 2023-10-03T10:19:04.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:04.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:04.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:04.206 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.210+0000 7fc5f0dce700 1 Processor -- start 2023-10-03T10:19:04.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.210+0000 7fc5f0dce700 1 -- start start 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 0x7fc5ec1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5ec09e410 0x7fc5ec133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5ec06b460 con 0x7fc5ec09e410 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec09b120 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5f0dce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec09a7e0 con 0x7fc5ec09e000 2023-10-03T10:19:04.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5ec09e410 0x7fc5ec133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ea59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5e9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 0x7fc5ec1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5ec09e410 0x7fc5ec133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51702/0 (socket says 172.21.15.19:51702) 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ea59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42634/0 (socket says 172.21.15.19:42634) 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5e9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 0x7fc5ec1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53146/0 (socket says 172.21.15.19:53146) 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 -- 172.21.15.19:0/3247374971 learned_addr learned my addr 172.21.15.19:0/3247374971 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 -- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 msgr2=0x7fc5ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 0x7fc5ec1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 -- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 msgr2=0x7fc5ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ead9d700 1 -- 172.21.15.19:0/3247374971 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5ec09a500 con 0x7fc5ec09e410 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.211+0000 7fc5ea59c700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.212+0000 7fc5ead9d700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec133f30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40098f0 tx=0x7fc5e4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65f471cd8f0db95 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.212+0000 7fc5e959a700 1 -- 172.21.15.19:0/3247374971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011830 con 0x7fc5ec09e410 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.212+0000 7fc5e959a700 1 -- 172.21.15.19:0/3247374971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e4011990 con 0x7fc5ec09e410 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.212+0000 7fc5e959a700 1 -- 172.21.15.19:0/3247374971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4011d20 con 0x7fc5ec09e410 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 -- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 msgr2=0x7fc5ec133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec133f30 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40098f0 tx=0x7fc5e4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 -- 172.21.15.19:0/3247374971 shutdown_connections 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09d6f0 0x7fc5ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec133f30 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/3247374971 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09e000 0x7fc5ec1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 -- 172.21.15.19:0/3247374971 >> 172.21.15.19:0/3247374971 conn(0x7fc5ec066f50 msgr2=0x7fc5ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 -- 172.21.15.19:0/3247374971 shutdown_connections 2023-10-03T10:19:04.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.213+0000 7fc5f0dce700 1 -- 172.21.15.19:0/3247374971 wait complete. 2023-10-03T10:19:04.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.214+0000 7fc5f0dce700 1 Processor -- start 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.214+0000 7fc5f0dce700 1 -- start start 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 0x7fc5ec1c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 0x7fc5ec1c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1a97b0 con 0x7fc5ec09e410 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec1c59a0 con 0x7fc5ec09e000 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5f0dce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5ec0a1fb0 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5ead9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5ead9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51706/0 (socket says 172.21.15.19:51706) 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5ead9d700 1 -- 172.21.15.19:0/1165635723 learned_addr learned my addr 172.21.15.19:0/1165635723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5ea59c700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 0x7fc5ec1c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.215+0000 7fc5e9d9b700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 0x7fc5ec1c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 -- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 msgr2=0x7fc5ec1c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 0x7fc5ec1c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 -- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 msgr2=0x7fc5ec1c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 -- 172.21.15.19:0/1165635723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc009a70 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ead9d700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5e9d9b700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 0x7fc5ec1c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5ea59c700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 0x7fc5ec1c4f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009e60 tx=0x7fc5dc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00cd10 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc00f040 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4009550 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0146c0 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.216+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5ec1a78a0 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.217+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5ec074ea0 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.218+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc5dc014820 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.218+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc5dc040860 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.223+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5dc012930 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.323+0000 7feff4aed700 1 Processor -- start 2023-10-03T10:19:04.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.323+0000 7feff4aed700 1 -- start start 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.323+0000 7feff4aed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feff00a0090 0x7feff0136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7feff4aed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff009d130 0x7feff0139170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7feff4aed700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feff009ba70 con 0x7feff009c650 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7feff4aed700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feff009e8f0 con 0x7feff00a0090 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7feff4aed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff00a0760 con 0x7feff009d130 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefee59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7feff009c650 0x7feff009ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36534/0 (socket says 172.21.15.19:36534) 2023-10-03T10:19:04.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefee59c700 1 -- 172.21.15.19:0/578324065 learned_addr learned my addr 172.21.15.19:0/578324065 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 --2- 172.21.15.19:0/578324065 >> v2:172.21.15.19:3300/0 conn(0x7feff00a0090 0x7feff0136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefeed9d700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff009d130 0x7feff0139170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 -- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff009d130 msgr2=0x7feff0139170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff009d130 0x7feff0139170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 -- 172.21.15.19:0/578324065 >> v1:172.21.15.19:6789/0 conn(0x7feff009c650 legacy=0x7feff009ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefed59a700 1 -- 172.21.15.19:0/578324065 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764269551 0 0) 0x7feff009ba70 con 0x7feff009c650 2023-10-03T10:19:04.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 -- 172.21.15.19:0/578324065 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff009a080 con 0x7feff00a0090 2023-10-03T10:19:04.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.324+0000 7fefedd9b700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff00a0090 0x7feff0136c20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009840 tx=0x7fefe4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ad0be24f1bc8f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7fefed59a700 1 -- 172.21.15.19:0/578324065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4010a90 con 0x7feff00a0090 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7fefed59a700 1 -- 172.21.15.19:0/578324065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe4010bf0 con 0x7feff00a0090 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7fefed59a700 1 -- 172.21.15.19:0/578324065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4018440 con 0x7feff00a0090 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 -- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff00a0090 msgr2=0x7feff0136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff00a0090 0x7feff0136c20 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009840 tx=0x7fefe4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 -- 172.21.15.19:0/578324065 shutdown_connections 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff009d130 0x7feff0139170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 --2- 172.21.15.19:0/578324065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff00a0090 0x7feff0136c20 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 -- 172.21.15.19:0/578324065 >> 172.21.15.19:0/578324065 conn(0x7feff00a3f70 msgr2=0x7feff00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.325+0000 7feff4aed700 1 -- 172.21.15.19:0/578324065 shutdown_connections 2023-10-03T10:19:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.326+0000 7feff4aed700 1 -- 172.21.15.19:0/578324065 wait complete. 2023-10-03T10:19:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 Processor -- start 2023-10-03T10:19:04.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 -- start start 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feff009c650 0x7feff011a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff00a0090 0x7feff011b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff011d740 con 0x7feff009d130 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff012d5b0 con 0x7feff00a0090 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7feff4aed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feff011ba60 con 0x7feff009c650 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7fefedd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51712/0 (socket says 172.21.15.19:51712) 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7fefedd9b700 1 -- 172.21.15.19:0/2482078349 learned_addr learned my addr 172.21.15.19:0/2482078349 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.327+0000 7fefeed9d700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff00a0090 0x7feff011b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 -- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feff009c650 msgr2=0x7feff011a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feff009c650 0x7feff011a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 -- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff00a0090 msgr2=0x7feff011b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff00a0090 0x7feff011b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 -- 172.21.15.19:0/2482078349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40094a0 con 0x7feff009d130 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefedd9b700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009b90 tx=0x7fefe4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4003c70 con 0x7feff009d130 2023-10-03T10:19:04.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe4003df0 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feff011d940 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4023690 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.328+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feff011c180 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.329+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fefe401f070 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.329+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feff00747f0 con 0x7feff009d130 2023-10-03T10:19:04.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.329+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fefe4045230 con 0x7feff009d130 2023-10-03T10:19:04.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.335+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fefe4027070 con 0x7feff009d130 2023-10-03T10:19:04.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.352+0000 7f8571390700 1 Processor -- start 2023-10-03T10:19:04.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.352+0000 7f8571390700 1 -- start start 2023-10-03T10:19:04.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8571390700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f856c133a80 0x7f856c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8571390700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8571390700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c06bc00 con 0x7f856c130870 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8571390700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c06c570 con 0x7f856c133a80 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8571390700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0a0040 con 0x7f856c12ff20 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53168/0 (socket says 172.21.15.19:53168) 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 -- 172.21.15.19:0/745883820 learned_addr learned my addr 172.21.15.19:0/745883820 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:04.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856b7fe700 1 --1- 172.21.15.19:0/745883820 >> v1:172.21.15.19:6789/0 conn(0x7f856c130870 0x7f856c13a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36550/0 (socket says 172.21.15.19:36550) 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856affd700 1 --2- 172.21.15.19:0/745883820 >> v2:172.21.15.19:3300/0 conn(0x7f856c133a80 0x7f856c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 -- 172.21.15.19:0/745883820 >> v2:172.21.15.19:3300/0 conn(0x7f856c133a80 msgr2=0x7f856c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 --2- 172.21.15.19:0/745883820 >> v2:172.21.15.19:3300/0 conn(0x7f856c133a80 0x7f856c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 -- 172.21.15.19:0/745883820 >> v1:172.21.15.19:6789/0 conn(0x7f856c130870 legacy=0x7f856c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f856a7fc700 1 -- 172.21.15.19:0/745883820 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c133860 con 0x7f856c12ff20 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.353+0000 7f8569ffb700 1 -- 172.21.15.19:0/745883820 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824479439 0 0) 0x7f856c06bc00 con 0x7f856c130870 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f856a7fc700 1 --2- 172.21.15.19:0/745883820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f85600098f0 tx=0x7f8560009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8adb99bc83545b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8569ffb700 1 -- 172.21.15.19:0/745883820 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011830 con 0x7f856c12ff20 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8569ffb700 1 -- 172.21.15.19:0/745883820 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560011990 con 0x7f856c12ff20 2023-10-03T10:19:04.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8569ffb700 1 -- 172.21.15.19:0/745883820 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560011d20 con 0x7f856c12ff20 2023-10-03T10:19:04.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 -- 172.21.15.19:0/745883820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 msgr2=0x7f856c130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 --2- 172.21.15.19:0/745883820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f85600098f0 tx=0x7f8560009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:04.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 -- 172.21.15.19:0/745883820 shutdown_connections 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 --2- 172.21.15.19:0/745883820 >> v2:172.21.15.19:3300/0 conn(0x7f856c133a80 0x7f856c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 --2- 172.21.15.19:0/745883820 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c12ff20 0x7f856c130330 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 -- 172.21.15.19:0/745883820 >> 172.21.15.19:0/745883820 conn(0x7f856c0a4210 msgr2=0x7f856c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.354+0000 7f8571390700 1 -- 172.21.15.19:0/745883820 shutdown_connections 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.355+0000 7f8571390700 1 -- 172.21.15.19:0/745883820 wait complete. 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.356+0000 7f8571390700 1 Processor -- start 2023-10-03T10:19:04.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.356+0000 7f8571390700 1 -- start start 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f856c12ff20 0x7f856c09c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f856c133a80 0x7f856c09d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c11ff70 con 0x7f856c133a80 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c12d9b0 con 0x7f856c12ff20 2023-10-03T10:19:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f8571390700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0a1f30 con 0x7f856c130870 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53180/0 (socket says 172.21.15.19:53180) 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 -- 172.21.15.19:0/1186887709 learned_addr learned my addr 172.21.15.19:0/1186887709 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856b7fe700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f856c133a80 0x7f856c09d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856affd700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f856c12ff20 0x7f856c09c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 -- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f856c12ff20 msgr2=0x7f856c09c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f856c12ff20 0x7f856c09c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 -- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f856c133a80 msgr2=0x7f856c09d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.357+0000 7f856a7fc700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f856c133a80 0x7f856c09d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f856a7fc700 1 -- 172.21.15.19:0/1186887709 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560009550 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f856a7fc700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8560009c40 tx=0x7f8560004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560004380 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8560027070 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c120170 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600036a0 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.358+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c11fbd0 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.359+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8560029030 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.359+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8560049540 con 0x7f856c130870 2023-10-03T10:19:04.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.359+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c11fdc0 con 0x7f856c130870 2023-10-03T10:19:04.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.364+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f856000b9d0 con 0x7f856c130870 2023-10-03T10:19:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.433+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc5ec1a9430 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.433+0000 7fc5daffd700 1 -- 172.21.15.19:0/1165635723 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc5ec1a9430 con 0x7fc5ec09d6f0 2023-10-03T10:19:04.436 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.435+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 msgr2=0x7fc5ec1c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.435+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 0x7fc5ec1c4f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009e60 tx=0x7fc5dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 shutdown_connections 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc5ec09e410 0x7fc5ec1c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc5ec09d6f0 0x7fc5ec1c4f20 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 --2- 172.21.15.19:0/1165635723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5ec09e000 0x7fc5ec1c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 >> 172.21.15.19:0/1165635723 conn(0x7fc5ec066f50 msgr2=0x7fc5ec1bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 shutdown_connections 2023-10-03T10:19:04.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.436+0000 7fc5f0dce700 1 -- 172.21.15.19:0/1165635723 wait complete. 2023-10-03T10:19:04.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.543+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feff0072840 con 0x7feff009d130 2023-10-03T10:19:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.543+0000 7fefdeffd700 1 -- 172.21.15.19:0/2482078349 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefe401d030 con 0x7feff009d130 2023-10-03T10:19:04.546 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 msgr2=0x7feff011ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009b90 tx=0x7fefe4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 shutdown_connections 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feff00a0090 0x7feff011b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feff009c650 0x7feff011a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 --2- 172.21.15.19:0/2482078349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feff009d130 0x7feff011ab60 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 >> 172.21.15.19:0/2482078349 conn(0x7feff00a3f70 msgr2=0x7feff012eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 shutdown_connections 2023-10-03T10:19:04.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.545+0000 7feff4aed700 1 -- 172.21.15.19:0/2482078349 wait complete. 2023-10-03T10:19:04.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.570+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f856c074ea0 con 0x7f856c130870 2023-10-03T10:19:04.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.570+0000 7f85537fe700 1 -- 172.21.15.19:0/1186887709 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8560015030 con 0x7f856c130870 2023-10-03T10:19:04.571 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:04.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 msgr2=0x7f856c09cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8560009c40 tx=0x7f8560004750 comp rx=0 tx=0).stop 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 shutdown_connections 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f856c133a80 0x7f856c09d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f856c12ff20 0x7f856c09c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 --2- 172.21.15.19:0/1186887709 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f856c130870 0x7f856c09cc20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 >> 172.21.15.19:0/1186887709 conn(0x7f856c0a4210 msgr2=0x7f856c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.572+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 shutdown_connections 2023-10-03T10:19:04.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:04.573+0000 7f8571390700 1 -- 172.21.15.19:0/1186887709 wait complete. 2023-10-03T10:19:04.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:05.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 Processor -- start 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 -- start start 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 0x7ff5ac139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac09ece0 con 0x7ff5ac06b080 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac09e760 con 0x7ff5ac131d10 2023-10-03T10:19:05.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5b1dfb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac09e040 con 0x7ff5ac06a770 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42684/0 (socket says 172.21.15.19:42684) 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/3951273080 learned_addr learned my addr 172.21.15.19:0/3951273080 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5aaffd700 1 --1- 172.21.15.19:0/3951273080 >> v1:172.21.15.19:6789/0 conn(0x7ff5ac06b080 0x7ff5ac131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36566/0 (socket says 172.21.15.19:36566) 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.169+0000 7ff5abfff700 1 --2- 172.21.15.19:0/3951273080 >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 0x7ff5ac139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/3951273080 >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 msgr2=0x7ff5ac139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5ab7fe700 1 --2- 172.21.15.19:0/3951273080 >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 0x7ff5ac139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/3951273080 >> v1:172.21.15.19:6789/0 conn(0x7ff5ac06b080 legacy=0x7ff5ac131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/3951273080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac09f630 con 0x7ff5ac06a770 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5abfff700 1 --2- 172.21.15.19:0/3951273080 >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 0x7ff5ac139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5ab7fe700 1 --2- 172.21.15.19:0/3951273080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098f0 tx=0x7ff594009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104ff2eb206acb50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5aa7fc700 1 -- 172.21.15.19:0/3951273080 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594011830 con 0x7ff5ac06a770 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5aa7fc700 1 -- 172.21.15.19:0/3951273080 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594011990 con 0x7ff5ac06a770 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.170+0000 7ff5aa7fc700 1 -- 172.21.15.19:0/3951273080 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594011d20 con 0x7ff5ac06a770 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/3951273080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 msgr2=0x7ff5ac06ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/3951273080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff5940098f0 tx=0x7ff594009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/3951273080 shutdown_connections 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/3951273080 >> v2:172.21.15.19:3300/0 conn(0x7ff5ac131d10 0x7ff5ac139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/3951273080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac06ab40 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/3951273080 >> 172.21.15.19:0/3951273080 conn(0x7ff5ac066f50 msgr2=0x7ff5ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/3951273080 shutdown_connections 2023-10-03T10:19:05.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.171+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/3951273080 wait complete. 2023-10-03T10:19:05.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.172+0000 7ff5b1dfb700 1 Processor -- start 2023-10-03T10:19:05.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.172+0000 7ff5b1dfb700 1 -- start start 2023-10-03T10:19:05.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.172+0000 7ff5b1dfb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.172+0000 7ff5b1dfb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 0x7ff5ac1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 0x7ff5ac1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1265a0 con 0x7ff5ac131d10 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1253f0 con 0x7ff5ac06a770 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac125e70 con 0x7ff5ac06b080 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42686/0 (socket says 172.21.15.19:42686) 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/869138278 learned_addr learned my addr 172.21.15.19:0/869138278 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5abfff700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 0x7ff5ac1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5aaffd700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 0x7ff5ac1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 msgr2=0x7ff5ac1c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 0x7ff5ac1c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 msgr2=0x7ff5ac1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 0x7ff5ac1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 -- 172.21.15.19:0/869138278 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac06a770 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5abfff700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 0x7ff5ac1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5aaffd700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 0x7ff5ac1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5ab7fe700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff594000c00 tx=0x7ff594004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940043c0 con 0x7ff5ac06a770 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59401f070 con 0x7ff5ac06a770 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940038c0 con 0x7ff5ac06a770 2023-10-03T10:19:05.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff594009550 con 0x7ff5ac06a770 2023-10-03T10:19:05.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.173+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac126ba0 con 0x7ff5ac06a770 2023-10-03T10:19:05.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.174+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff594021030 con 0x7ff5ac06a770 2023-10-03T10:19:05.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.174+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff5940408f0 con 0x7ff5ac06a770 2023-10-03T10:19:05.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.174+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac126210 con 0x7ff5ac06a770 2023-10-03T10:19:05.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.179+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff594015070 con 0x7ff5ac06a770 2023-10-03T10:19:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.384+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5ac074ea0 con 0x7ff5ac06a770 2023-10-03T10:19:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.384+0000 7ff5a3fff700 1 -- 172.21.15.19:0/869138278 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff594004560 con 0x7ff5ac06a770 2023-10-03T10:19:05.385 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 msgr2=0x7ff5ac1c8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff594000c00 tx=0x7ff594004750 comp rx=0 tx=0).stop 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 shutdown_connections 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff5ac131d10 0x7ff5ac1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff5ac06a770 0x7ff5ac1c8250 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 --2- 172.21.15.19:0/869138278 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff5ac06b080 0x7ff5ac1c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 >> 172.21.15.19:0/869138278 conn(0x7ff5ac066f50 msgr2=0x7ff5ac0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 shutdown_connections 2023-10-03T10:19:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.387+0000 7ff5b1dfb700 1 -- 172.21.15.19:0/869138278 wait complete. 2023-10-03T10:19:05.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:05.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:05.561 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:05.587 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:05.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.592+0000 7f2a4ba6b700 1 Processor -- start 2023-10-03T10:19:05.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.593+0000 7f2a4ba6b700 1 -- start start 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.593+0000 7f2a4ba6b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a4409e1d0 0x7f2a44135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.593+0000 7f2a4ba6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a44138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.593+0000 7f2a4ba6b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4409f130 con 0x7f2a4409d6f0 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.593+0000 7f2a4ba6b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4409f520 con 0x7f2a4409e1d0 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a4ba6b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4409e930 con 0x7f2a44135e50 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a4a008700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a44138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49807700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2a4409d6f0 0x7f2a4409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36572/0 (socket says 172.21.15.19:36572) 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2a4409e1d0 0x7f2a44135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49807700 1 -- 172.21.15.19:0/462920228 learned_addr learned my addr 172.21.15.19:0/462920228 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:05.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 -- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 msgr2=0x7f2a44138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 --2- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a44138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 -- 172.21.15.19:0/462920228 >> v1:172.21.15.19:6789/0 conn(0x7f2a4409d6f0 legacy=0x7f2a4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 -- 172.21.15.19:0/462920228 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4409b2d0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a48805700 1 -- 172.21.15.19:0/462920228 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593328348 0 0) 0x7f2a4409f130 con 0x7f2a4409d6f0 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.594+0000 7f2a49006700 1 --2- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a44135910 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009840 tx=0x7f2a34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560e16409576cf03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.595+0000 7f2a48805700 1 -- 172.21.15.19:0/462920228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011830 con 0x7f2a4409e1d0 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.595+0000 7f2a48805700 1 -- 172.21.15.19:0/462920228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34011990 con 0x7f2a4409e1d0 2023-10-03T10:19:05.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.595+0000 7f2a48805700 1 -- 172.21.15.19:0/462920228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34011d20 con 0x7f2a4409e1d0 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 msgr2=0x7f2a44135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a44135910 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f2a34009840 tx=0x7f2a34009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/462920228 shutdown_connections 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a44138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/462920228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a44135910 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/462920228 >> 172.21.15.19:0/462920228 conn(0x7f2a44066f50 msgr2=0x7f2a4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/462920228 shutdown_connections 2023-10-03T10:19:05.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.596+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/462920228 wait complete. 2023-10-03T10:19:05.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.597+0000 7f2a4ba6b700 1 Processor -- start 2023-10-03T10:19:05.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.597+0000 7f2a4ba6b700 1 -- start start 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 0x7f2a4411d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a4411e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44120860 con 0x7f2a4409e1d0 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4409c700 con 0x7f2a44135e50 2023-10-03T10:19:05.600 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4ba6b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44136640 con 0x7f2a4409d6f0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49807700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 0x7f2a4411d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49807700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 0x7f2a4411d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53190/0 (socket says 172.21.15.19:53190) 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49807700 1 -- 172.21.15.19:0/3902338741 learned_addr learned my addr 172.21.15.19:0/3902338741 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51772/0 (socket says 172.21.15.19:51772) 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a4a008700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a4411e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 -- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 msgr2=0x7f2a4411d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 0x7f2a4411d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 -- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 msgr2=0x7f2a4411e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a4411e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.598+0000 7f2a49006700 1 -- 172.21.15.19:0/3902338741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340094a0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a49006700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f2a34016000 tx=0x7f2a34004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a340036a0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3401e070 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34003a40 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4411f1c0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.599+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a441215d0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.600+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2a34003ba0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.600+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2a340405a0 con 0x7f2a4409e1d0 2023-10-03T10:19:05.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.600+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44120a90 con 0x7f2a4409e1d0 2023-10-03T10:19:05.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.605+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2a44120a90 con 0x7f2a4409e1d0 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.702+0000 7f347be43700 1 Processor -- start 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.702+0000 7f347be43700 1 -- start start 2023-10-03T10:19:05.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.702+0000 7f347be43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34740a0a30 0x7f34740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.702+0000 7f347be43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 0x7f34740a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f347be43700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740a2a70 con 0x7f3474133930 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f347be43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740a01d0 con 0x7f347409d630 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f347be43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f347409e2b0 con 0x7f34740a0a30 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 0x7f34740a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f347a3e0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3474133930 0x7f3474133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36574/0 (socket says 172.21.15.19:36574) 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f347a3e0700 1 -- 172.21.15.19:0/777873306 learned_addr learned my addr 172.21.15.19:0/777873306 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:05.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f3479bdf700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34740a0a30 0x7f34740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f3478bdd700 1 -- 172.21.15.19:0/777873306 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456490541 0 0) 0x7f34740a2a70 con 0x7f3474133930 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 -- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34740a0a30 msgr2=0x7f34740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34740a0a30 0x7f34740a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 -- 172.21.15.19:0/777873306 >> v1:172.21.15.19:6789/0 conn(0x7f3474133930 legacy=0x7f3474133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 -- 172.21.15.19:0/777873306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347409dc50 con 0x7f347409d630 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.703+0000 7f34793de700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 0x7f34740a1340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3464009870 tx=0x7f3464009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab7eaf896691d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f3478bdd700 1 -- 172.21.15.19:0/777873306 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464011830 con 0x7f347409d630 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f3478bdd700 1 -- 172.21.15.19:0/777873306 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3464011990 con 0x7f347409d630 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f3478bdd700 1 -- 172.21.15.19:0/777873306 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464011d20 con 0x7f347409d630 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 -- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 msgr2=0x7f34740a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 0x7f34740a1340 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3464009870 tx=0x7f3464009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 -- 172.21.15.19:0/777873306 shutdown_connections 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f34740a0a30 0x7f34740a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 --2- 172.21.15.19:0/777873306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f347409d630 0x7f34740a1340 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.704+0000 7f347be43700 1 -- 172.21.15.19:0/777873306 >> 172.21.15.19:0/777873306 conn(0x7f34740a3050 msgr2=0x7f34740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.705+0000 7f347be43700 1 -- 172.21.15.19:0/777873306 shutdown_connections 2023-10-03T10:19:05.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.705+0000 7f347be43700 1 -- 172.21.15.19:0/777873306 wait complete. 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 Processor -- start 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 -- start start 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f347409d630 0x7f34741c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 0x7f34741c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34741c8f40 con 0x7f347409d630 2023-10-03T10:19:05.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740a0480 con 0x7f34740a0a30 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347be43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3474133400 con 0x7f3474133930 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347a3e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347a3e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53216/0 (socket says 172.21.15.19:53216) 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.706+0000 7f347a3e0700 1 -- 172.21.15.19:0/3115982572 learned_addr learned my addr 172.21.15.19:0/3115982572 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f3479bdf700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f347409d630 0x7f34741c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f34793de700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 0x7f34741c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 -- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 msgr2=0x7f34741c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 0x7f34741c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 -- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f347409d630 msgr2=0x7f34741c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f347409d630 0x7f34741c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 -- 172.21.15.19:0/3115982572 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640094a0 con 0x7f3474133930 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f34793de700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 0x7f34741c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:05.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347a3e0700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f346c00cc70 tx=0x7f346c00a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c00ad40 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c00ce70 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34741209a0 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0072f0 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.707+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3474120480 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.708+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f346c007450 con 0x7f3474133930 2023-10-03T10:19:05.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.708+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34740747f0 con 0x7f3474133930 2023-10-03T10:19:05.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.708+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f346c03f590 con 0x7f3474133930 2023-10-03T10:19:05.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.717+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f346c01c3b0 con 0x7f3474133930 2023-10-03T10:19:05.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 Processor -- start 2023-10-03T10:19:05.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 -- start start 2023-10-03T10:19:05.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280a2a70 con 0x7f9b28133930 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280a01d0 con 0x7f9b280a0a30 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.737+0000 7f9b2f4a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2809e2b0 con 0x7f9b2809d630 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53224/0 (socket says 172.21.15.19:53224) 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/4068068140 learned_addr learned my addr 172.21.15.19:0/4068068140 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2d23c700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b1ffff700 1 -- 172.21.15.19:0/4068068140 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716626061 0 0) 0x7f9b280a2a70 con 0x7f9b28133930 2023-10-03T10:19:05.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b1ffff700 1 -- 172.21.15.19:0/4068068140 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b140035b0 con 0x7f9b28133930 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 msgr2=0x7f9b280a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b280a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/4068068140 >> v1:172.21.15.19:6789/0 conn(0x7f9b28133930 legacy=0x7f9b28133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/4068068140 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2809dc50 con 0x7f9b2809d630 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.738+0000 7f9b2ca3b700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009920 tx=0x7f9b18009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd0fff64d65457e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b1ffff700 1 -- 172.21.15.19:0/4068068140 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011830 con 0x7f9b2809d630 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b1ffff700 1 -- 172.21.15.19:0/4068068140 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18011990 con 0x7f9b2809d630 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b1ffff700 1 -- 172.21.15.19:0/4068068140 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011d20 con 0x7f9b2809d630 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 msgr2=0x7f9b280a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009920 tx=0x7f9b18009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/4068068140 shutdown_connections 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b280a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/4068068140 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b280a1340 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.739+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/4068068140 >> 172.21.15.19:0/4068068140 conn(0x7f9b280a3050 msgr2=0x7f9b280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.740+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/4068068140 shutdown_connections 2023-10-03T10:19:05.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.740+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/4068068140 wait complete. 2023-10-03T10:19:05.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.740+0000 7f9b2f4a0700 1 Processor -- start 2023-10-03T10:19:05.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 -- start start 2023-10-03T10:19:05.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b281c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 0x7f9b281c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28120460 con 0x7f9b28133930 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280a4490 con 0x7f9b280a0a30 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2f4a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280a0410 con 0x7f9b2809d630 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2ca3b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2ca3b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:42738/0 (socket says 172.21.15.19:42738) 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/3417090928 learned_addr learned my addr 172.21.15.19:0/3417090928 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2d23c700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b281c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.741+0000 7f9b2da3d700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 0x7f9b281c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 msgr2=0x7f9b281c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b281c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 msgr2=0x7f9b281c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 0x7f9b281c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 -- 172.21.15.19:0/3417090928 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009550 con 0x7f9b280a0a30 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2da3d700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 0x7f9b281c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2ca3b700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9b18000c00 tx=0x7f9b18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18004450 con 0x7f9b280a0a30 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b180045b0 con 0x7f9b280a0a30 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28121dd0 con 0x7f9b280a0a30 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b180038c0 con 0x7f9b280a0a30 2023-10-03T10:19:05.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.742+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b281223e0 con 0x7f9b280a0a30 2023-10-03T10:19:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.743+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9b18021070 con 0x7f9b280a0a30 2023-10-03T10:19:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.743+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9b18040900 con 0x7f9b280a0a30 2023-10-03T10:19:05.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.744+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280747f0 con 0x7f9b280a0a30 2023-10-03T10:19:05.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.749+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9b18015080 con 0x7f9b280a0a30 2023-10-03T10:19:05.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.820+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a44120a90 con 0x7f2a4409e1d0 2023-10-03T10:19:05.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.820+0000 7f2a3a7fc700 1 -- 172.21.15.19:0/3902338741 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a44120a90 con 0x7f2a4409e1d0 2023-10-03T10:19:05.821 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 msgr2=0x7f2a4411daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f2a34016000 tx=0x7f2a34004750 comp rx=0 tx=0).stop 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 shutdown_connections 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2a44135e50 0x7f2a4411e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2a4409d6f0 0x7f2a4411d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 --2- 172.21.15.19:0/3902338741 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4409e1d0 0x7f2a4411daf0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 >> 172.21.15.19:0/3902338741 conn(0x7f2a44066f50 msgr2=0x7f2a44070850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 shutdown_connections 2023-10-03T10:19:05.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.823+0000 7f2a4ba6b700 1 -- 172.21.15.19:0/3902338741 wait complete. 2023-10-03T10:19:05.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:05.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.925+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3474122140 con 0x7f3474133930 2023-10-03T10:19:05.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.926+0000 7f346a7fc700 1 -- 172.21.15.19:0/3115982572 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f346c018020 con 0x7f3474133930 2023-10-03T10:19:05.926 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 msgr2=0x7f347411e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f346c00cc70 tx=0x7f346c00a340 comp rx=0 tx=0).stop 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 shutdown_connections 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3474133930 0x7f347411e990 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f347409d630 0x7f34741c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 --2- 172.21.15.19:0/3115982572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34740a0a30 0x7f34741c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 >> 172.21.15.19:0/3115982572 conn(0x7f34740a3050 msgr2=0x7f34741bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 shutdown_connections 2023-10-03T10:19:05.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.928+0000 7f347be43700 1 -- 172.21.15.19:0/3115982572 wait complete. 2023-10-03T10:19:05.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.956+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9b28072980 con 0x7f9b280a0a30 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.956+0000 7f9b1dffb700 1 -- 172.21.15.19:0/3417090928 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9b18029030 con 0x7f9b280a0a30 2023-10-03T10:19:05.957 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 msgr2=0x7f9b281c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9b18000c00 tx=0x7f9b18004750 comp rx=0 tx=0).stop 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 shutdown_connections 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9b28133930 0x7f9b281c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9b2809d630 0x7f9b281c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 --2- 172.21.15.19:0/3417090928 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9b280a0a30 0x7f9b281c84d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 >> 172.21.15.19:0/3417090928 conn(0x7f9b280a3050 msgr2=0x7f9b281bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 shutdown_connections 2023-10-03T10:19:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:05.959+0000 7f9b2f4a0700 1 -- 172.21.15.19:0/3417090928 wait complete. 2023-10-03T10:19:05.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:06.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:06.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.548+0000 7f9a0454a700 1 Processor -- start 2023-10-03T10:19:06.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.548+0000 7f9a0454a700 1 -- start start 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a0454a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09e930 0x7f99fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a0454a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99fc09f650 0x7f99fc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a0454a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc070940 con 0x7f99fc09f240 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a0454a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc06fd60 con 0x7f99fc09f650 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a0454a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc06fa80 con 0x7f99fc09e930 2023-10-03T10:19:06.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a02ae7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f99fc09f650 0x7f99fc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a01ae5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f99fc09f240 0x7f99fc1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:46980/0 (socket says 172.21.15.19:46980) 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a01ae5700 1 -- 172.21.15.19:0/3673815625 learned_addr learned my addr 172.21.15.19:0/3673815625 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a022e6700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09e930 0x7f99fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.549+0000 7f9a02ae7700 1 -- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09e930 msgr2=0x7f99fc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a02ae7700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09e930 0x7f99fc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a02ae7700 1 -- 172.21.15.19:0/3673815625 >> v1:172.21.15.19:6789/0 conn(0x7f99fc09f240 legacy=0x7f99fc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a02ae7700 1 -- 172.21.15.19:0/3673815625 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc09fb60 con 0x7f99fc09f650 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a012e4700 1 -- 172.21.15.19:0/3673815625 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741783785 0 0) 0x7f99fc070940 con 0x7f99fc09f240 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a02ae7700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09f650 0x7f99fc131f00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009d90 tx=0x7f99f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac308d549e89afa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a012e4700 1 -- 172.21.15.19:0/3673815625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f400e070 con 0x7f99fc09f650 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a012e4700 1 -- 172.21.15.19:0/3673815625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400bb20 con 0x7f99fc09f650 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a012e4700 1 -- 172.21.15.19:0/3673815625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4012430 con 0x7f99fc09f650 2023-10-03T10:19:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a0454a700 1 -- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09f650 msgr2=0x7f99fc131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.550+0000 7f9a0454a700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09f650 0x7f99fc131f00 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009d90 tx=0x7f99f400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 -- 172.21.15.19:0/3673815625 shutdown_connections 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09f650 0x7f99fc131f00 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 --2- 172.21.15.19:0/3673815625 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09e930 0x7f99fc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 -- 172.21.15.19:0/3673815625 >> 172.21.15.19:0/3673815625 conn(0x7f99fc0a4210 msgr2=0x7f99fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 -- 172.21.15.19:0/3673815625 shutdown_connections 2023-10-03T10:19:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.551+0000 7f9a0454a700 1 -- 172.21.15.19:0/3673815625 wait complete. 2023-10-03T10:19:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 Processor -- start 2023-10-03T10:19:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 -- start start 2023-10-03T10:19:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 0x7f99fc1c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 0x7f99fc1c5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1aa920 con 0x7f99fc09e930 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1c48e0 con 0x7f99fc09f240 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a0454a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1abaf0 con 0x7f99fc09f650 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a02ae7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a01ae5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 0x7f99fc1c5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a02ae7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52876/0 (socket says 172.21.15.19:52876) 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a022e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 0x7f99fc1c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a01ae5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 0x7f99fc1c5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:32984/0 (socket says 172.21.15.19:32984) 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.552+0000 7f9a02ae7700 1 -- 172.21.15.19:0/1983388450 learned_addr learned my addr 172.21.15.19:0/1983388450 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 -- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 msgr2=0x7f99fc1c5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 0x7f99fc1c5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 -- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 msgr2=0x7f99fc1c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 0x7f99fc1c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 -- 172.21.15.19:0/1983388450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009a70 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a022e6700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 0x7f99fc1c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a02ae7700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f99f4014040 tx=0x7f99f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4012430 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f4020070 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0a0190 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4004280 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.553+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc06d4c0 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.554+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f99f40043e0 con 0x7f99fc09f650 2023-10-03T10:19:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.554+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc06d6b0 con 0x7f99fc09f650 2023-10-03T10:19:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.558+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f99f4022070 con 0x7f99fc09f650 2023-10-03T10:19:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.561+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f99f4012e40 con 0x7f99fc09f650 2023-10-03T10:19:06.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.766+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f99fc074ea0 con 0x7f99fc09f650 2023-10-03T10:19:06.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.767+0000 7f99f2ffd700 1 -- 172.21.15.19:0/1983388450 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f99f401a380 con 0x7f99fc09f650 2023-10-03T10:19:06.768 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 msgr2=0x7f99fc1c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f99f4014040 tx=0x7f99f4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 shutdown_connections 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f99fc09f650 0x7f99fc1c7f90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f99fc09e930 0x7f99fc1c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 --2- 172.21.15.19:0/1983388450 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f99fc09f240 0x7f99fc1c5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 >> 172.21.15.19:0/1983388450 conn(0x7f99fc0a4210 msgr2=0x7f99fc0a2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 shutdown_connections 2023-10-03T10:19:06.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.769+0000 7f9a0454a700 1 -- 172.21.15.19:0/1983388450 wait complete. 2023-10-03T10:19:06.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:06.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:06.943 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:06.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.978+0000 7fb587b50700 1 Processor -- start 2023-10-03T10:19:06.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.978+0000 7fb587b50700 1 -- start start 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb587b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5800a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb587b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb587b50700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800a2a70 con 0x7fb580133930 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb587b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800a01d0 con 0x7fb58009d630 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb587b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb58009e2b0 con 0x7fb5800a0a30 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5850eb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5850eb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:32994/0 (socket says 172.21.15.19:32994) 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5850eb700 1 -- 172.21.15.19:0/573000668 learned_addr learned my addr 172.21.15.19:0/573000668 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:06.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5858ec700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5800a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5848ea700 1 -- 172.21.15.19:0/573000668 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421373166 0 0) 0x7fb5800a2a70 con 0x7fb580133930 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5858ec700 1 -- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 msgr2=0x7fb5800a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5858ec700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5858ec700 1 -- 172.21.15.19:0/573000668 >> v1:172.21.15.19:6789/0 conn(0x7fb580133930 legacy=0x7fb580133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5858ec700 1 -- 172.21.15.19:0/573000668 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58009dc50 con 0x7fb5800a0a30 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.979+0000 7fb5850eb700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb5858ec700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5800a0e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009870 tx=0x7fb57c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fac504654e4b09d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb5848ea700 1 -- 172.21.15.19:0/573000668 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c011830 con 0x7fb5800a0a30 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb5848ea700 1 -- 172.21.15.19:0/573000668 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c011990 con 0x7fb5800a0a30 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb5848ea700 1 -- 172.21.15.19:0/573000668 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c011d20 con 0x7fb5800a0a30 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb587b50700 1 -- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 msgr2=0x7fb5800a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.980+0000 7fb587b50700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5800a0e00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fb57c009870 tx=0x7fb57c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 -- 172.21.15.19:0/573000668 shutdown_connections 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5800a0e00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 --2- 172.21.15.19:0/573000668 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5800a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 -- 172.21.15.19:0/573000668 >> 172.21.15.19:0/573000668 conn(0x7fb5800a3050 msgr2=0x7fb5800a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 -- 172.21.15.19:0/573000668 shutdown_connections 2023-10-03T10:19:06.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.981+0000 7fb587b50700 1 -- 172.21.15.19:0/573000668 wait complete. 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.982+0000 7fb587b50700 1 Processor -- start 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.982+0000 7fb587b50700 1 -- start start 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5801c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb580133930 0x7fb5801c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580121190 con 0x7fb580133930 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800a5360 con 0x7fb58009d630 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb587b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb580120630 con 0x7fb5800a0a30 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb5858ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb5858ec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33010/0 (socket says 172.21.15.19:33010) 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb5858ec700 1 -- 172.21.15.19:0/3878475835 learned_addr learned my addr 172.21.15.19:0/3878475835 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb5850eb700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5801c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.983+0000 7fb5860ed700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb580133930 0x7fb5801c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 -- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 msgr2=0x7fb5801c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5801c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 -- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb580133930 msgr2=0x7fb5801c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb580133930 0x7fb5801c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 -- 172.21.15.19:0/3878475835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570009550 con 0x7fb58009d630 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5858ec700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0090b0 tx=0x7fb57c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c004510 con 0x7fb58009d630 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57c027070 con 0x7fb58009d630 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c0094a0 con 0x7fb58009d630 2023-10-03T10:19:06.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57c0038e0 con 0x7fb58009d630 2023-10-03T10:19:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.984+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb580122190 con 0x7fb58009d630 2023-10-03T10:19:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.985+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb57c003a40 con 0x7fb58009d630 2023-10-03T10:19:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.985+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5800747f0 con 0x7fb58009d630 2023-10-03T10:19:06.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.986+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb57c029070 con 0x7fb58009d630 2023-10-03T10:19:06.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:06.995+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb57c015030 con 0x7fb58009d630 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.087+0000 7f6ffe048700 1 Processor -- start 2023-10-03T10:19:07.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.087+0000 7f6ffe048700 1 -- start start 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ffe048700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ffe048700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ff8136fe0 0x7f6ff81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ffe048700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff8070940 con 0x7f6ff809e930 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ffe048700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff806fd60 con 0x7f6ff8136fe0 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ffe048700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff806fa80 con 0x7f6ff809f410 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ff6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ff6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33012/0 (socket says 172.21.15.19:33012) 2023-10-03T10:19:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ff6ffd700 1 -- 172.21.15.19:0/2831127226 learned_addr learned my addr 172.21.15.19:0/2831127226 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.088+0000 7f6ff7fff700 1 --2- 172.21.15.19:0/2831127226 >> v2:172.21.15.19:3300/0 conn(0x7f6ff8136fe0 0x7f6ff81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff6ffd700 1 -- 172.21.15.19:0/2831127226 >> v2:172.21.15.19:3300/0 conn(0x7f6ff8136fe0 msgr2=0x7f6ff81393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff6ffd700 1 --2- 172.21.15.19:0/2831127226 >> v2:172.21.15.19:3300/0 conn(0x7f6ff8136fe0 0x7f6ff81393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff6ffd700 1 -- 172.21.15.19:0/2831127226 >> v1:172.21.15.19:6789/0 conn(0x7f6ff809e930 legacy=0x7f6ff809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff6ffd700 1 -- 172.21.15.19:0/2831127226 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff809fb60 con 0x7f6ff809f410 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff6ffd700 1 --2- 172.21.15.19:0/2831127226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0098f0 tx=0x7f6fec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de48bf4e7aefecb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff67fc700 1 -- 172.21.15.19:0/2831127226 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011830 con 0x7f6ff809f410 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff67fc700 1 -- 172.21.15.19:0/2831127226 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec011990 con 0x7f6ff809f410 2023-10-03T10:19:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.089+0000 7f6ff67fc700 1 -- 172.21.15.19:0/2831127226 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec011d20 con 0x7f6ff809f410 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 -- 172.21.15.19:0/2831127226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 msgr2=0x7f6ff8136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 --2- 172.21.15.19:0/2831127226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6fec0098f0 tx=0x7f6fec009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 -- 172.21.15.19:0/2831127226 shutdown_connections 2023-10-03T10:19:07.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 --2- 172.21.15.19:0/2831127226 >> v2:172.21.15.19:3300/0 conn(0x7f6ff8136fe0 0x7f6ff81393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 --2- 172.21.15.19:0/2831127226 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809f410 0x7f6ff8136aa0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 -- 172.21.15.19:0/2831127226 >> 172.21.15.19:0/2831127226 conn(0x7f6ff80a4210 msgr2=0x7f6ff80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 -- 172.21.15.19:0/2831127226 shutdown_connections 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.090+0000 7f6ffe048700 1 -- 172.21.15.19:0/2831127226 wait complete. 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.091+0000 7f6ffe048700 1 Processor -- start 2023-10-03T10:19:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 -- start start 2023-10-03T10:19:07.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ff809f410 0x7f6ff806c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 0x7f6ff81c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff806bd80 con 0x7f6ff8136fe0 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff81321b0 con 0x7f6ff809e930 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ffe048700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff8071d20 con 0x7f6ff809f410 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ff77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ff77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33024/0 (socket says 172.21.15.19:33024) 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ff77fe700 1 -- 172.21.15.19:0/950864582 learned_addr learned my addr 172.21.15.19:0/950864582 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ff6ffd700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ff809f410 0x7f6ff806c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.092+0000 7f6ff7fff700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 0x7f6ff81c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 -- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ff809f410 msgr2=0x7f6ff806c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ff809f410 0x7f6ff806c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 -- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 msgr2=0x7f6ff81c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 0x7f6ff81c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 -- 172.21.15.19:0/950864582 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009550 con 0x7f6ff809e930 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff7fff700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 0x7f6ff81c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ff77fe700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8001ed0 tx=0x7f6fe80021e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe8003c00 con 0x7f6ff809e930 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe8003d60 con 0x7f6ff809e930 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe800ab40 con 0x7f6ff809e930 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff8122450 con 0x7f6ff809e930 2023-10-03T10:19:07.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.093+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff8121db0 con 0x7f6ff809e930 2023-10-03T10:19:07.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.094+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6fe800aca0 con 0x7f6ff809e930 2023-10-03T10:19:07.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.095+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6fe803f6b0 con 0x7f6ff809e930 2023-10-03T10:19:07.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.095+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff806d520 con 0x7f6ff809e930 2023-10-03T10:19:07.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.100+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6fe80198f0 con 0x7f6ff809e930 2023-10-03T10:19:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 Processor -- start 2023-10-03T10:19:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 -- start start 2023-10-03T10:19:07.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 0x7f9f84130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f840716a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8409a390 con 0x7f9f84130e50 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.119+0000 7f9f8987b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84071290 con 0x7f9f84130540 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f827fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f837fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9f8406fb20 0x7f9f84137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47002/0 (socket says 172.21.15.19:47002) 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f837fe700 1 -- 172.21.15.19:0/598115806 learned_addr learned my addr 172.21.15.19:0/598115806 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f827fc700 1 --2- 172.21.15.19:0/598115806 >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55380/0 (socket says 172.21.15.19:55380) 2023-10-03T10:19:07.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/598115806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 0x7f9f84130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f81ffb700 1 -- 172.21.15.19:0/598115806 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470861358 0 0) 0x7f9f840716a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f81ffb700 1 -- 172.21.15.19:0/598115806 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f6c0035b0 con 0x7f9f8406fb20 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 -- 172.21.15.19:0/598115806 >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 msgr2=0x7f9f8406f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/598115806 >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 -- 172.21.15.19:0/598115806 >> v1:172.21.15.19:6789/0 conn(0x7f9f8406fb20 legacy=0x7f9f84137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 -- 172.21.15.19:0/598115806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84130340 con 0x7f9f84130540 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f827fc700 1 --2- 172.21.15.19:0/598115806 >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/598115806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 0x7f9f84130910 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009870 tx=0x7f9f74009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e5b731fd2596a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f81ffb700 1 -- 172.21.15.19:0/598115806 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74011830 con 0x7f9f84130540 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f81ffb700 1 -- 172.21.15.19:0/598115806 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f74011990 con 0x7f9f84130540 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.120+0000 7f9f81ffb700 1 -- 172.21.15.19:0/598115806 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74011d20 con 0x7f9f84130540 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 -- 172.21.15.19:0/598115806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 msgr2=0x7f9f84130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 --2- 172.21.15.19:0/598115806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 0x7f9f84130910 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009870 tx=0x7f9f74009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 -- 172.21.15.19:0/598115806 shutdown_connections 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 --2- 172.21.15.19:0/598115806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f84130540 0x7f9f84130910 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 --2- 172.21.15.19:0/598115806 >> v2:172.21.15.19:3300/0 conn(0x7f9f84130e50 0x7f9f8406f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 -- 172.21.15.19:0/598115806 >> 172.21.15.19:0/598115806 conn(0x7f9f840a2aa0 msgr2=0x7f9f840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 -- 172.21.15.19:0/598115806 shutdown_connections 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.121+0000 7f9f8987b700 1 -- 172.21.15.19:0/598115806 wait complete. 2023-10-03T10:19:07.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.122+0000 7f9f8987b700 1 Processor -- start 2023-10-03T10:19:07.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.122+0000 7f9f8987b700 1 -- start start 2023-10-03T10:19:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84130540 0x7f9f8411f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f84130e50 0x7f9f8411f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84121de0 con 0x7f9f84130e50 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840a0730 con 0x7f9f84130540 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f8987b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f840718e0 con 0x7f9f8406fb20 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52906/0 (socket says 172.21.15.19:52906) 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1554987496 learned_addr learned my addr 172.21.15.19:0/1554987496 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f837fe700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f84130e50 0x7f9f8411f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f827fc700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84130540 0x7f9f8411f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84130540 msgr2=0x7f9f8411f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84130540 0x7f9f8411f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f84130e50 msgr2=0x7f9f8411f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f84130e50 0x7f9f8411f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.123+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1554987496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780094a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f82ffd700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9f74000c00 tx=0x7f9f74004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740036a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7401f070 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f740094a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f74003a20 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.124+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f84120800 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.125+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f74003b80 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.125+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f74021070 con 0x7f9f8406fb20 2023-10-03T10:19:07.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.125+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84074ea0 con 0x7f9f8406fb20 2023-10-03T10:19:07.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.130+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f74015020 con 0x7f9f8406fb20 2023-10-03T10:19:07.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.215+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb580133350 con 0x7fb58009d630 2023-10-03T10:19:07.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.215+0000 7fb5767fc700 1 -- 172.21.15.19:0/3878475835 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb57c045020 con 0x7fb58009d630 2023-10-03T10:19:07.217 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 msgr2=0x7fb5801c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb57c0090b0 tx=0x7fb57c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 shutdown_connections 2023-10-03T10:19:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb580133930 0x7fb5801c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb58009d630 0x7fb5801c7d80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 --2- 172.21.15.19:0/3878475835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb5800a0a30 0x7fb5801c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 >> 172.21.15.19:0/3878475835 conn(0x7fb5800a3050 msgr2=0x7fb5801bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 shutdown_connections 2023-10-03T10:19:07.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.218+0000 7fb587b50700 1 -- 172.21.15.19:0/3878475835 wait complete. 2023-10-03T10:19:07.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:07.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.310+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6ff8074ea0 con 0x7f6ff809e930 2023-10-03T10:19:07.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.310+0000 7f6fdffff700 1 -- 172.21.15.19:0/950864582 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6fe8029090 con 0x7f6ff809e930 2023-10-03T10:19:07.311 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:07.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 msgr2=0x7f6ff806c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8001ed0 tx=0x7f6fe80021e0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 shutdown_connections 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ff8136fe0 0x7f6ff81c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ff809e930 0x7f6ff806c370 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 --2- 172.21.15.19:0/950864582 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ff809f410 0x7f6ff806c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 >> 172.21.15.19:0/950864582 conn(0x7f6ff80a4210 msgr2=0x7f6ff80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 shutdown_connections 2023-10-03T10:19:07.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.312+0000 7f6ffe048700 1 -- 172.21.15.19:0/950864582 wait complete. 2023-10-03T10:19:07.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:07.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.347+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f840a22a0 con 0x7f9f8406fb20 2023-10-03T10:19:07.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.347+0000 7f9f6bfff700 1 -- 172.21.15.19:0/1554987496 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f74003e30 con 0x7f9f8406fb20 2023-10-03T10:19:07.348 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:07.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.349+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 msgr2=0x7f9f8411ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.349+0000 7f9f8987b700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9f74000c00 tx=0x7f9f74004750 comp rx=0 tx=0).stop 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 shutdown_connections 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f84130e50 0x7f9f8411f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406fb20 0x7f9f8411ebe0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 --2- 172.21.15.19:0/1554987496 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84130540 0x7f9f8411f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 >> 172.21.15.19:0/1554987496 conn(0x7f9f840a2aa0 msgr2=0x7f9f8412d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 shutdown_connections 2023-10-03T10:19:07.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.350+0000 7f9f8987b700 1 -- 172.21.15.19:0/1554987496 wait complete. 2023-10-03T10:19:07.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:07.784 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 Processor -- start 2023-10-03T10:19:07.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 -- start start 2023-10-03T10:19:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 0x7f46a809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a809b120 con 0x7f46a809e410 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a806b460 con 0x7f46a809e000 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.929+0000 7f46ae7c9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46a809a7e0 con 0x7f46a809d6f0 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 0x7f46a809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46acd66700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f46a809e410 0x7f46a8133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47012/0 (socket says 172.21.15.19:47012) 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46acd66700 1 -- 172.21.15.19:0/2131084194 learned_addr learned my addr 172.21.15.19:0/2131084194 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a6ffd700 1 -- 172.21.15.19:0/2131084194 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794521584 0 0) 0x7f46a809b120 con 0x7f46a809e410 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a6ffd700 1 -- 172.21.15.19:0/2131084194 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46900035b0 con 0x7f46a809e410 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 -- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 msgr2=0x7f46a809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 0x7f46a809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 -- 172.21.15.19:0/2131084194 >> v1:172.21.15.19:6789/0 conn(0x7f46a809e410 legacy=0x7f46a8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 -- 172.21.15.19:0/2131084194 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a809a500 con 0x7f46a809e000 2023-10-03T10:19:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a7fff700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 0x7f46a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a77fe700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a81339f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de3fe5e8f12e73f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a6ffd700 1 -- 172.21.15.19:0/2131084194 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c011830 con 0x7f46a809e000 2023-10-03T10:19:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a6ffd700 1 -- 172.21.15.19:0/2131084194 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469c011990 con 0x7f46a809e000 2023-10-03T10:19:07.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.930+0000 7f46a6ffd700 1 -- 172.21.15.19:0/2131084194 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469c011d20 con 0x7f46a809e000 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 -- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 msgr2=0x7f46a81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a81339f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f469c009870 tx=0x7f469c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 -- 172.21.15.19:0/2131084194 shutdown_connections 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809d6f0 0x7f46a809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/2131084194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a81339f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 -- 172.21.15.19:0/2131084194 >> 172.21.15.19:0/2131084194 conn(0x7f46a8066f50 msgr2=0x7f46a809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 -- 172.21.15.19:0/2131084194 shutdown_connections 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.931+0000 7f46ae7c9700 1 -- 172.21.15.19:0/2131084194 wait complete. 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.932+0000 7f46ae7c9700 1 Processor -- start 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.932+0000 7f46ae7c9700 1 -- start start 2023-10-03T10:19:07.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a8122840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 0x7f46a8122d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a81336d0 con 0x7f46a809d6f0 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8123760 con 0x7f46a809e000 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46ae7c9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8124da0 con 0x7f46a809e410 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46acd66700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 0x7f46a8122d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55394/0 (socket says 172.21.15.19:55394) 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 -- 172.21.15.19:0/3266112291 learned_addr learned my addr 172.21.15.19:0/3266112291 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a77fe700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a8122840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 -- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 msgr2=0x7f46a8122d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 0x7f46a8122d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 -- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 msgr2=0x7f46a8122840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a8122840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 -- 172.21.15.19:0/3266112291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46980094a0 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a77fe700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a8122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46acd66700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 0x7f46a8122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.933+0000 7f46a7fff700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f469800ec10 tx=0x7f469800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800c850 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800c9b0 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0094a0 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800cd20 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a80720b0 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.934+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4698013470 con 0x7f46a809d6f0 2023-10-03T10:19:07.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.935+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f469803fc00 con 0x7f46a809d6f0 2023-10-03T10:19:07.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.935+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a8074ea0 con 0x7f46a809d6f0 2023-10-03T10:19:07.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:07.940+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4698021020 con 0x7f46a809d6f0 2023-10-03T10:19:08.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.142+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f46a806c360 con 0x7f46a809d6f0 2023-10-03T10:19:08.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.143+0000 7f46a4ff9700 1 -- 172.21.15.19:0/3266112291 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f469801b3b0 con 0x7f46a809d6f0 2023-10-03T10:19:08.144 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 msgr2=0x7f46a8122300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f469800ec10 tx=0x7f469800ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:08.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 shutdown_connections 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46a809e410 0x7f46a8122d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46a809d6f0 0x7f46a8122300 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 --2- 172.21.15.19:0/3266112291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46a809e000 0x7f46a8122840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 >> 172.21.15.19:0/3266112291 conn(0x7f46a8066f50 msgr2=0x7f46a80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 shutdown_connections 2023-10-03T10:19:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.145+0000 7f46ae7c9700 1 -- 172.21.15.19:0/3266112291 wait complete. 2023-10-03T10:19:08.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:08.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:08.328 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:08.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.378+0000 7fd27c552700 1 Processor -- start 2023-10-03T10:19:08.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 -- start start 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd274131810 0x7fd274131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 0x7fd274139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2741313c0 con 0x7fd274099a40 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27406e8c0 con 0x7fd27409a580 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd27c552700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd274071d20 con 0x7fd274131810 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.379+0000 7fd279aed700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd274099a40 0x7fd274099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47028/0 (socket says 172.21.15.19:47028) 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd279aed700 1 -- 172.21.15.19:0/1555678467 learned_addr learned my addr 172.21.15.19:0/1555678467 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27a2ee700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd274131810 0x7fd274131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 0x7fd274139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 -- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd274131810 msgr2=0x7fd274131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd274131810 0x7fd274131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd2792ec700 1 -- 172.21.15.19:0/1555678467 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256094044 0 0) 0x7fd2741313c0 con 0x7fd274099a40 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 -- 172.21.15.19:0/1555678467 >> v1:172.21.15.19:6789/0 conn(0x7fd274099a40 legacy=0x7fd274099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 -- 172.21.15.19:0/1555678467 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740721a0 con 0x7fd27409a580 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd27aaef700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 0x7fd274139660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009dc0 tx=0x7fd26c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eef6ec296e43f2a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd2792ec700 1 -- 172.21.15.19:0/1555678467 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00e070 con 0x7fd27409a580 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd2792ec700 1 -- 172.21.15.19:0/1555678467 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00bb20 con 0x7fd27409a580 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.380+0000 7fd2792ec700 1 -- 172.21.15.19:0/1555678467 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c012430 con 0x7fd27409a580 2023-10-03T10:19:08.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 -- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 msgr2=0x7fd274139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 0x7fd274139660 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd26c009dc0 tx=0x7fd26c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 -- 172.21.15.19:0/1555678467 shutdown_connections 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd27409a580 0x7fd274139660 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 --2- 172.21.15.19:0/1555678467 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd274131810 0x7fd274131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 -- 172.21.15.19:0/1555678467 >> 172.21.15.19:0/1555678467 conn(0x7fd2740a2aa0 msgr2=0x7fd2740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 -- 172.21.15.19:0/1555678467 shutdown_connections 2023-10-03T10:19:08.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.381+0000 7fd27c552700 1 -- 172.21.15.19:0/1555678467 wait complete. 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 Processor -- start 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 -- start start 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27409a580 0x7fd27406fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd274131810 0x7fd274070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27411f010 con 0x7fd274131810 2023-10-03T10:19:08.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27411f210 con 0x7fd274099a40 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27c552700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd27411e100 con 0x7fd27409a580 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27a2ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd279aed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27409a580 0x7fd27406fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27a2ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33080/0 (socket says 172.21.15.19:33080) 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.383+0000 7fd27a2ee700 1 -- 172.21.15.19:0/1623021826 learned_addr learned my addr 172.21.15.19:0/1623021826 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:08.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27aaef700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd274131810 0x7fd274070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 -- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27409a580 msgr2=0x7fd27406fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27409a580 0x7fd27406fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 -- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd274131810 msgr2=0x7fd274070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd274131810 0x7fd274070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 -- 172.21.15.19:0/1623021826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009a70 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27a2ee700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd27000e9e0 tx=0x7fd27000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd270009710 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27000ee80 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2740a1a20 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27000ca50 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.384+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27412cb80 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.385+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd27000cbb0 con 0x7fd274099a40 2023-10-03T10:19:08.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.386+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd27003fa90 con 0x7fd274099a40 2023-10-03T10:19:08.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.386+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd274074ea0 con 0x7fd274099a40 2023-10-03T10:19:08.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.392+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd270021080 con 0x7fd274099a40 2023-10-03T10:19:08.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.471+0000 7f343f761700 1 Processor -- start 2023-10-03T10:19:08.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 -- start start 2023-10-03T10:19:08.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f34380a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f343813bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343809edd0 con 0x7f34380a1340 2023-10-03T10:19:08.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343809e1f0 con 0x7f34380a0a30 2023-10-03T10:19:08.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343f761700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f343809dc50 con 0x7f3438134170 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343d4fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f34380a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343ccfc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f34380a1340 0x7f3438133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47042/0 (socket says 172.21.15.19:47042) 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.472+0000 7f343ccfc700 1 -- 172.21.15.19:0/9394639 learned_addr learned my addr 172.21.15.19:0/9394639 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343dcfe700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f343813bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343d4fd700 1 -- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 msgr2=0x7f343813bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343d4fd700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f343813bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343d4fd700 1 -- 172.21.15.19:0/9394639 >> v1:172.21.15.19:6789/0 conn(0x7f34380a1340 legacy=0x7f3438133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343d4fd700 1 -- 172.21.15.19:0/9394639 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34380a1fe0 con 0x7f34380a0a30 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f342ffff700 1 -- 172.21.15.19:0/9394639 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041152246 0 0) 0x7f343809edd0 con 0x7f34380a1340 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f343d4fd700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f34380a0e00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3434009870 tx=0x7f3434009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7163a31ec69850 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f342ffff700 1 -- 172.21.15.19:0/9394639 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011830 con 0x7f34380a0a30 2023-10-03T10:19:08.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f342ffff700 1 -- 172.21.15.19:0/9394639 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434011990 con 0x7f34380a0a30 2023-10-03T10:19:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.473+0000 7f342ffff700 1 -- 172.21.15.19:0/9394639 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011d20 con 0x7f34380a0a30 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 -- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 msgr2=0x7f34380a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f34380a0e00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3434009870 tx=0x7f3434009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 -- 172.21.15.19:0/9394639 shutdown_connections 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f343813bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 --2- 172.21.15.19:0/9394639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f34380a0e00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 -- 172.21.15.19:0/9394639 >> 172.21.15.19:0/9394639 conn(0x7f34380a6550 msgr2=0x7f34380a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 -- 172.21.15.19:0/9394639 shutdown_connections 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.474+0000 7f343f761700 1 -- 172.21.15.19:0/9394639 wait complete. 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.475+0000 7f343f761700 1 Processor -- start 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.475+0000 7f343f761700 1 -- start start 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f3438122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f3438123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3438124350 con 0x7f34380a1340 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3438125cc0 con 0x7f34380a0a30 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343f761700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3438126340 con 0x7f3438134170 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55412/0 (socket says 172.21.15.19:55412) 2023-10-03T10:19:08.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 -- 172.21.15.19:0/3066720740 learned_addr learned my addr 172.21.15.19:0/3066720740 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343d4fd700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f3438122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343dcfe700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f3438123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 -- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 msgr2=0x7f3438123210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f3438123210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 -- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 msgr2=0x7f3438122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f3438122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.476+0000 7f343ccfc700 1 -- 172.21.15.19:0/3066720740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34340094a0 con 0x7f34380a1340 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f343ccfc700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f342800c520 tx=0x7f342800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428004c80 con 0x7f34380a1340 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34380a25e0 con 0x7f34380a1340 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3428004de0 con 0x7f34380a1340 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428007310 con 0x7f34380a1340 2023-10-03T10:19:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.477+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3438133690 con 0x7f34380a1340 2023-10-03T10:19:08.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.478+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3428007470 con 0x7f34380a1340 2023-10-03T10:19:08.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.478+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3438125ee0 con 0x7f34380a1340 2023-10-03T10:19:08.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.478+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f342802cfb0 con 0x7f34380a1340 2023-10-03T10:19:08.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.483+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3428044060 con 0x7f34380a1340 2023-10-03T10:19:08.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.512+0000 7fc80a855700 1 Processor -- start 2023-10-03T10:19:08.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 -- start start 2023-10-03T10:19:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8040a1340 0x7fc804133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80409edd0 con 0x7fc8040a1340 2023-10-03T10:19:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80409e1f0 con 0x7fc804133fa0 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc80a855700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc80409dc50 con 0x7fc8040a0a30 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc8037fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8040a1340 0x7fc804133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc803fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc8037fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8040a1340 0x7fc804133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55418/0 (socket says 172.21.15.19:55418) 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc8037fe700 1 -- 172.21.15.19:0/3817977863 learned_addr learned my addr 172.21.15.19:0/3817977863 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.513+0000 7fc808df2700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 -- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 msgr2=0x7fc8040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 -- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 msgr2=0x7fc804134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:08.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 -- 172.21.15.19:0/3817977863 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8040a1fe0 con 0x7fc8040a1340 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc8037fe700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804133a60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80098f0 tx=0x7fc7f8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f281cdac85e32fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc802ffd700 1 -- 172.21.15.19:0/3817977863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011830 con 0x7fc8040a1340 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc802ffd700 1 -- 172.21.15.19:0/3817977863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f8011990 con 0x7fc8040a1340 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.514+0000 7fc802ffd700 1 -- 172.21.15.19:0/3817977863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8011d20 con 0x7fc8040a1340 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.515+0000 7fc80a855700 1 -- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 msgr2=0x7fc804133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.515+0000 7fc80a855700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804133a60 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80098f0 tx=0x7fc7f8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.515+0000 7fc80a855700 1 -- 172.21.15.19:0/3817977863 shutdown_connections 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 --2- 172.21.15.19:0/3817977863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804133a60 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 -- 172.21.15.19:0/3817977863 >> 172.21.15.19:0/3817977863 conn(0x7fc8040a6550 msgr2=0x7fc8040a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 -- 172.21.15.19:0/3817977863 shutdown_connections 2023-10-03T10:19:08.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.516+0000 7fc80a855700 1 -- 172.21.15.19:0/3817977863 wait complete. 2023-10-03T10:19:08.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.517+0000 7fc80a855700 1 Processor -- start 2023-10-03T10:19:08.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.517+0000 7fc80a855700 1 -- start start 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8041200e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804120620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8041245c0 con 0x7fc8040a1340 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc804123c00 con 0x7fc804133fa0 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc80a855700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc804122f40 con 0x7fc8040a0a30 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc808df2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc808df2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33122/0 (socket says 172.21.15.19:33122) 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc808df2700 1 -- 172.21.15.19:0/4281998403 learned_addr learned my addr 172.21.15.19:0/4281998403 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:08.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc803fff700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8041200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.518+0000 7fc8037fe700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804120620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 -- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 msgr2=0x7fc8041200e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8041200e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 -- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 msgr2=0x7fc804120620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804120620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 -- 172.21.15.19:0/4281998403 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009550 con 0x7fc804133fa0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc808df2700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009dd0 tx=0x7fc7fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc009c40 con 0x7fc804133fa0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8040a34a0 con 0x7fc804133fa0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00f040 con 0x7fc804133fa0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00ceb0 con 0x7fc804133fa0 2023-10-03T10:19:08.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.519+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc804121cf0 con 0x7fc804133fa0 2023-10-03T10:19:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.520+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc7fc014480 con 0x7fc804133fa0 2023-10-03T10:19:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.520+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8041237a0 con 0x7fc804133fa0 2023-10-03T10:19:08.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.520+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc7fc03ff70 con 0x7fc804133fa0 2023-10-03T10:19:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.526+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc7fc071750 con 0x7fc804133fa0 2023-10-03T10:19:08.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.611+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd27406b9e0 con 0x7fd274099a40 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.612+0000 7fd26affd700 1 -- 172.21.15.19:0/1623021826 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd270017020 con 0x7fd274099a40 2023-10-03T10:19:08.613 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 msgr2=0x7fd27406f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd27000e9e0 tx=0x7fd27000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 shutdown_connections 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd274131810 0x7fd274070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd274099a40 0x7fd27406f610 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 --2- 172.21.15.19:0/1623021826 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd27409a580 0x7fd27406fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 >> 172.21.15.19:0/1623021826 conn(0x7fd2740a2aa0 msgr2=0x7fd27412e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 shutdown_connections 2023-10-03T10:19:08.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.615+0000 7fd27c552700 1 -- 172.21.15.19:0/1623021826 wait complete. 2023-10-03T10:19:08.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.703+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3438074ea0 con 0x7f34380a1340 2023-10-03T10:19:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.704+0000 7f342dffb700 1 -- 172.21.15.19:0/3066720740 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3428044030 con 0x7f34380a1340 2023-10-03T10:19:08.705 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:08.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 msgr2=0x7f3438122cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f342800c520 tx=0x7f342800c830 comp rx=0 tx=0).stop 2023-10-03T10:19:08.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 shutdown_connections 2023-10-03T10:19:08.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3438134170 0x7f3438123210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f34380a0a30 0x7f3438122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 --2- 172.21.15.19:0/3066720740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f34380a1340 0x7f3438122cd0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 >> 172.21.15.19:0/3066720740 conn(0x7f34380a6550 msgr2=0x7f343809edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 shutdown_connections 2023-10-03T10:19:08.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.706+0000 7f343f761700 1 -- 172.21.15.19:0/3066720740 wait complete. 2023-10-03T10:19:08.721 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:08.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.736+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc804074ea0 con 0x7fc804133fa0 2023-10-03T10:19:08.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.736+0000 7fc800ff9700 1 -- 172.21.15.19:0/4281998403 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc7fc0133e0 con 0x7fc804133fa0 2023-10-03T10:19:08.737 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 msgr2=0x7fc804120b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:08.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009dd0 tx=0x7fc7fc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 shutdown_connections 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc804133fa0 0x7fc804120b60 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc8040a0a30 0x7fc8041200e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 --2- 172.21.15.19:0/4281998403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8040a1340 0x7fc804120620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 >> 172.21.15.19:0/4281998403 conn(0x7fc8040a6550 msgr2=0x7fc8041bb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 shutdown_connections 2023-10-03T10:19:08.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:08.738+0000 7fc80a855700 1 -- 172.21.15.19:0/4281998403 wait complete. 2023-10-03T10:19:08.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:09.161 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.305+0000 7f90b3192700 1 Processor -- start 2023-10-03T10:19:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.305+0000 7f90b3192700 1 -- start start 2023-10-03T10:19:09.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac070940 con 0x7f90ac09e930 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac06fd60 con 0x7f90ac09f650 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b3192700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac06fa80 con 0x7f90ac09f240 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b0f2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90abfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b0f2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55432/0 (socket says 172.21.15.19:55432) 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90abfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52992/0 (socket says 172.21.15.19:52992) 2023-10-03T10:19:09.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b0f2e700 1 -- 172.21.15.19:0/2118370185 learned_addr learned my addr 172.21.15.19:0/2118370185 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 -- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 msgr2=0x7f90ac1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 -- 172.21.15.19:0/2118370185 >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 msgr2=0x7f90ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 --2- 172.21.15.19:0/2118370185 >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 -- 172.21.15.19:0/2118370185 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac09fb60 con 0x7f90ac09f650 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b0f2e700 1 --2- 172.21.15.19:0/2118370185 >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90abfff700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90b172f700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac131d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=483dad1c716af070 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.306+0000 7f90ab7fe700 1 -- 172.21.15.19:0/2118370185 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a400e070 con 0x7f90ac09f650 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90ab7fe700 1 -- 172.21.15.19:0/2118370185 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400bb20 con 0x7f90ac09f650 2023-10-03T10:19:09.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90ab7fe700 1 -- 172.21.15.19:0/2118370185 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4012430 con 0x7f90ac09f650 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 -- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 msgr2=0x7f90ac131d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac131d30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009d90 tx=0x7f90a400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 -- 172.21.15.19:0/2118370185 shutdown_connections 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac131d30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 --2- 172.21.15.19:0/2118370185 >> v2:172.21.15.19:3300/0 conn(0x7f90ac09e930 0x7f90ac09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 --2- 172.21.15.19:0/2118370185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 -- 172.21.15.19:0/2118370185 >> 172.21.15.19:0/2118370185 conn(0x7f90ac0a4210 msgr2=0x7f90ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 -- 172.21.15.19:0/2118370185 shutdown_connections 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.307+0000 7f90b3192700 1 -- 172.21.15.19:0/2118370185 wait complete. 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.308+0000 7f90b3192700 1 Processor -- start 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.308+0000 7f90b3192700 1 -- start start 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac06d4c0 con 0x7f90ac09e930 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac1a92b0 con 0x7f90ac09f650 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b3192700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac06cd10 con 0x7f90ac09f240 2023-10-03T10:19:09.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b0f2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b0f2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55442/0 (socket says 172.21.15.19:55442) 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b0f2e700 1 -- 172.21.15.19:0/1308298418 learned_addr learned my addr 172.21.15.19:0/1308298418 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b172f700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 -- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 msgr2=0x7f90ac06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 -- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 msgr2=0x7f90ac06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90abfff700 1 -- 172.21.15.19:0/1308298418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a0009550 con 0x7f90ac09f240 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.309+0000 7f90b0f2e700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90abfff700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac06bdf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f909800e9b0 tx=0x7f909800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800ee50 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800c850 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800cc00 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90980094a0 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.310+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a4009a70 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.311+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9098013470 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.311+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac1a0b30 con 0x7f90ac09f240 2023-10-03T10:19:09.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.311+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f909803fa10 con 0x7f90ac09f240 2023-10-03T10:19:09.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.316+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9098013720 con 0x7f90ac09f240 2023-10-03T10:19:09.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.522+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f90ac1a8fe0 con 0x7f90ac09f240 2023-10-03T10:19:09.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.522+0000 7f90a97fa700 1 -- 172.21.15.19:0/1308298418 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9098021070 con 0x7f90ac09f240 2023-10-03T10:19:09.523 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:09.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.524+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 msgr2=0x7f90ac06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.524+0000 7f90b3192700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac06bdf0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f909800e9b0 tx=0x7f909800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 shutdown_connections 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f90ac09f650 0x7f90ac06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f90ac09e930 0x7f90ac06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 --2- 172.21.15.19:0/1308298418 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f90ac09f240 0x7f90ac06bdf0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 >> 172.21.15.19:0/1308298418 conn(0x7f90ac0a4210 msgr2=0x7f90ac1b8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 shutdown_connections 2023-10-03T10:19:09.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.525+0000 7f90b3192700 1 -- 172.21.15.19:0/1308298418 wait complete. 2023-10-03T10:19:09.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:09.636 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:09.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:09.754 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.779+0000 7fb4cda09700 1 Processor -- start 2023-10-03T10:19:09.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 -- start start 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4c8133420 0x7fb4c81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c812ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4c806b990 con 0x7fb4c8134260 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4c80a0590 con 0x7fb4c8133420 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4cda09700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c809fb80 con 0x7fb4c8133e30 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4c6ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb4c8133420 0x7fb4c81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4c77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb4c8134260 0x7fb4c81304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47052/0 (socket says 172.21.15.19:47052) 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4c77fe700 1 -- 172.21.15.19:0/2228184594 learned_addr learned my addr 172.21.15.19:0/2228184594 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.780+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/2228184594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c812ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c5ffb700 1 -- 172.21.15.19:0/2228184594 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178860646 0 0) 0x7fb4c806b990 con 0x7fb4c8134260 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c5ffb700 1 -- 172.21.15.19:0/2228184594 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4b00035b0 con 0x7fb4c8134260 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c67fc700 1 -- 172.21.15.19:0/2228184594 >> v2:172.21.15.19:3300/0 conn(0x7fb4c8133420 msgr2=0x7fb4c81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/2228184594 >> v2:172.21.15.19:3300/0 conn(0x7fb4c8133420 0x7fb4c81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c67fc700 1 -- 172.21.15.19:0/2228184594 >> v1:172.21.15.19:6789/0 conn(0x7fb4c8134260 legacy=0x7fb4c81304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c67fc700 1 -- 172.21.15.19:0/2228184594 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80a0030 con 0x7fb4c8133e30 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/2228184594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c812ff90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009840 tx=0x7fb4bc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b0a4565727c5369 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c5ffb700 1 -- 172.21.15.19:0/2228184594 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011830 con 0x7fb4c8133e30 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c5ffb700 1 -- 172.21.15.19:0/2228184594 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc011990 con 0x7fb4c8133e30 2023-10-03T10:19:09.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.781+0000 7fb4c5ffb700 1 -- 172.21.15.19:0/2228184594 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011d20 con 0x7fb4c8133e30 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 -- 172.21.15.19:0/2228184594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 msgr2=0x7fb4c812ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 --2- 172.21.15.19:0/2228184594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c812ff90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009840 tx=0x7fb4bc009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 -- 172.21.15.19:0/2228184594 shutdown_connections 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 --2- 172.21.15.19:0/2228184594 >> v2:172.21.15.19:3300/0 conn(0x7fb4c8133420 0x7fb4c81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 --2- 172.21.15.19:0/2228184594 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c812ff90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 -- 172.21.15.19:0/2228184594 >> 172.21.15.19:0/2228184594 conn(0x7fb4c80a4210 msgr2=0x7fb4c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 -- 172.21.15.19:0/2228184594 shutdown_connections 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.782+0000 7fb4cda09700 1 -- 172.21.15.19:0/2228184594 wait complete. 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.783+0000 7fb4cda09700 1 Processor -- start 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 -- start start 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c8134260 0x7fb4c809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c811fce0 con 0x7fb4c8133420 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c812d850 con 0x7fb4c8133e30 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4cda09700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c811fa20 con 0x7fb4c8134260 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4c6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4c67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4c6ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55466/0 (socket says 172.21.15.19:55466) 2023-10-03T10:19:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4c6ffd700 1 -- 172.21.15.19:0/1032735172 learned_addr learned my addr 172.21.15.19:0/1032735172 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.784+0000 7fb4c77fe700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c8134260 0x7fb4c809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 -- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c8134260 msgr2=0x7fb4c809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c8134260 0x7fb4c809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 -- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 msgr2=0x7fb4c809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 -- 172.21.15.19:0/1032735172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc0094a0 con 0x7fb4c8133e30 2023-10-03T10:19:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c6ffd700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4c67fc700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c809c9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc016000 tx=0x7fb4bc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc004380 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc01f070 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c811ee60 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0036a0 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.785+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c8120840 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.786+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb4bc021030 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.786+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c81200a0 con 0x7fb4c8133e30 2023-10-03T10:19:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.786+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb4bc0407d0 con 0x7fb4c8133e30 2023-10-03T10:19:09.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.791+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb4bc0239c0 con 0x7fb4c8133e30 2023-10-03T10:19:09.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.889+0000 7f4999e95700 1 Processor -- start 2023-10-03T10:19:09.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.889+0000 7f4999e95700 1 -- start start 2023-10-03T10:19:09.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4999e95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 0x7f4994133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4999e95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4999e95700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499406f720 con 0x7f499409e390 2023-10-03T10:19:09.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4999e95700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4994070c80 con 0x7f49941341d0 2023-10-03T10:19:09.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4999e95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499406fce0 con 0x7f49941338c0 2023-10-03T10:19:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f49937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 0x7f4994133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4993fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f499409e390 0x7f499413a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47056/0 (socket says 172.21.15.19:47056) 2023-10-03T10:19:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4993fff700 1 -- 172.21.15.19:0/66652748 learned_addr learned my addr 172.21.15.19:0/66652748 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.890+0000 7f4992ffd700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49927fc700 1 -- 172.21.15.19:0/66652748 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623775403 0 0) 0x7f499406f720 con 0x7f499409e390 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49927fc700 1 -- 172.21.15.19:0/66652748 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f497c0035b0 con 0x7f499409e390 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f4992ffd700 1 -- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 msgr2=0x7f4994133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f4992ffd700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 0x7f4994133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f4992ffd700 1 -- 172.21.15.19:0/66652748 >> v1:172.21.15.19:6789/0 conn(0x7f499409e390 legacy=0x7f499413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f4992ffd700 1 -- 172.21.15.19:0/66652748 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49941336a0 con 0x7f49941341d0 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49937fe700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 0x7f4994133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f4992ffd700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499409de50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f4988009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dadbf7bbd379701 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49927fc700 1 -- 172.21.15.19:0/66652748 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988011830 con 0x7f49941341d0 2023-10-03T10:19:09.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49927fc700 1 -- 172.21.15.19:0/66652748 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4988011990 con 0x7f49941341d0 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.891+0000 7f49927fc700 1 -- 172.21.15.19:0/66652748 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988011d20 con 0x7f49941341d0 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 -- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 msgr2=0x7f499409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499409de50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f4988009870 tx=0x7f4988009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 -- 172.21.15.19:0/66652748 shutdown_connections 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f49941338c0 0x7f4994133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 --2- 172.21.15.19:0/66652748 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499409de50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 -- 172.21.15.19:0/66652748 >> 172.21.15.19:0/66652748 conn(0x7f49940a2aa0 msgr2=0x7f49940a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 -- 172.21.15.19:0/66652748 shutdown_connections 2023-10-03T10:19:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.892+0000 7f4999e95700 1 -- 172.21.15.19:0/66652748 wait complete. 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.894+0000 7f4999e95700 1 Processor -- start 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.894+0000 7f4999e95700 1 -- start start 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 0x7f49941195c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499411a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499411d0e0 con 0x7f49941338c0 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499411c4b0 con 0x7f49941341d0 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4999e95700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f499412fe40 con 0x7f499409e390 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 0x7f49941195c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4992ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55474/0 (socket says 172.21.15.19:55474) 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4992ffd700 1 -- 172.21.15.19:0/1275803773 learned_addr learned my addr 172.21.15.19:0/1275803773 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4993fff700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499411a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 -- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 msgr2=0x7f499411a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499411a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 -- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 msgr2=0x7f4994119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f49937fe700 1 -- 172.21.15.19:0/1275803773 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49840094a0 con 0x7f499409e390 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.895+0000 7f4992ffd700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f49937fe700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 0x7f49941195c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f498400e9b0 tx=0x7f498400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498400ee50 con 0x7f499409e390 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498400c850 con 0x7f499409e390 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49880094a0 con 0x7f499409e390 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498400cc00 con 0x7f499409e390 2023-10-03T10:19:09.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.896+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499411b1d0 con 0x7f499409e390 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.897+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4984013470 con 0x7f499409e390 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.897+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f498403fa70 con 0x7f499409e390 2023-10-03T10:19:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.897+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499411cc60 con 0x7f499409e390 2023-10-03T10:19:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.902+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f499411cc60 con 0x7f499409e390 2023-10-03T10:19:09.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.909+0000 7f21b9e9e700 1 Processor -- start 2023-10-03T10:19:09.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.909+0000 7f21b9e9e700 1 -- start start 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b9e9e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21b4131730 0x7f21b4131b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b9e9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b9e9e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b406f5d0 con 0x7f21b409a3d0 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b9e9e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b406f9a0 con 0x7f21b4131730 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b9e9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41312e0 con 0x7f21b4099a40 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33170/0 (socket says 172.21.15.19:33170) 2023-10-03T10:19:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b2ffd700 1 -- 172.21.15.19:0/309694948 learned_addr learned my addr 172.21.15.19:0/309694948 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f21b409a3d0 0x7f21b4138570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47072/0 (socket says 172.21.15.19:47072) 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.910+0000 7f21b37fe700 1 --2- 172.21.15.19:0/309694948 >> v2:172.21.15.19:3300/0 conn(0x7f21b4131730 0x7f21b4131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b2ffd700 1 -- 172.21.15.19:0/309694948 >> v2:172.21.15.19:3300/0 conn(0x7f21b4131730 msgr2=0x7f21b4131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b2ffd700 1 --2- 172.21.15.19:0/309694948 >> v2:172.21.15.19:3300/0 conn(0x7f21b4131730 0x7f21b4131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b2ffd700 1 -- 172.21.15.19:0/309694948 >> v1:172.21.15.19:6789/0 conn(0x7f21b409a3d0 legacy=0x7f21b4138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b2ffd700 1 -- 172.21.15.19:0/309694948 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b409b630 con 0x7f21b4099a40 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b2ffd700 1 --2- 172.21.15.19:0/309694948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098f0 tx=0x7f21a8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a96951485d0c536c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b27fc700 1 -- 172.21.15.19:0/309694948 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011830 con 0x7f21b4099a40 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b27fc700 1 -- 172.21.15.19:0/309694948 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8011990 con 0x7f21b4099a40 2023-10-03T10:19:09.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.911+0000 7f21b27fc700 1 -- 172.21.15.19:0/309694948 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8011d20 con 0x7f21b4099a40 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 -- 172.21.15.19:0/309694948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 msgr2=0x7f21b4099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/309694948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098f0 tx=0x7f21a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 -- 172.21.15.19:0/309694948 shutdown_connections 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/309694948 >> v2:172.21.15.19:3300/0 conn(0x7f21b4131730 0x7f21b4131b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/309694948 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4099a40 0x7f21b4099e90 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 -- 172.21.15.19:0/309694948 >> 172.21.15.19:0/309694948 conn(0x7f21b40a27f0 msgr2=0x7f21b40a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 -- 172.21.15.19:0/309694948 shutdown_connections 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.912+0000 7f21b9e9e700 1 -- 172.21.15.19:0/309694948 wait complete. 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.913+0000 7f21b9e9e700 1 Processor -- start 2023-10-03T10:19:09.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.913+0000 7f21b9e9e700 1 -- start start 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.913+0000 7f21b9e9e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.913+0000 7f21b9e9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21b409a3d0 0x7f21b4070650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.913+0000 7f21b9e9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 0x7f21b4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b9e9e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b41211a0 con 0x7f21b4099a40 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b9e9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b4121380 con 0x7f21b4131730 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b9e9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21b412ec40 con 0x7f21b409a3d0 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55496/0 (socket says 172.21.15.19:55496) 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b37fe700 1 -- 172.21.15.19:0/879739964 learned_addr learned my addr 172.21.15.19:0/879739964 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:09.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 0x7f21b4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 -- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21b409a3d0 msgr2=0x7f21b4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21b409a3d0 0x7f21b4070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 -- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 msgr2=0x7f21b4070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 -- 172.21.15.19:0/879739964 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8009550 con 0x7f21b4131730 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b37fe700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b3fff700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 0x7f21b4070b90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00cb40 tx=0x7f21ac00ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac00aa60 con 0x7f21b4131730 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac00abc0 con 0x7f21b4131730 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac007070 con 0x7f21b4131730 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.914+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b40a1ee0 con 0x7f21b4131730 2023-10-03T10:19:09.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.915+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b411fbf0 con 0x7f21b4131730 2023-10-03T10:19:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.915+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21ac0071d0 con 0x7f21b4131730 2023-10-03T10:19:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.915+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21ac03f390 con 0x7f21b4131730 2023-10-03T10:19:09.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.916+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b404f2a0 con 0x7f21b4131730 2023-10-03T10:19:09.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:09.921+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21ac017020 con 0x7f21b4131730 2023-10-03T10:19:10.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.037+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb4c8074ea0 con 0x7fb4c8133e30 2023-10-03T10:19:10.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.038+0000 7fb4affff700 1 -- 172.21.15.19:0/1032735172 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb4bc01b430 con 0x7fb4c8133e30 2023-10-03T10:19:10.039 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 msgr2=0x7fb4c809c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c809c9c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc016000 tx=0x7fb4bc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 shutdown_connections 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb4c8134260 0x7fb4c809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb4c8133420 0x7fb4c809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 --2- 172.21.15.19:0/1032735172 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb4c8133e30 0x7fb4c809c9c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 >> 172.21.15.19:0/1032735172 conn(0x7fb4c80a4210 msgr2=0x7fb4c80a0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 shutdown_connections 2023-10-03T10:19:10.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.040+0000 7fb4cda09700 1 -- 172.21.15.19:0/1032735172 wait complete. 2023-10-03T10:19:10.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:10.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.123+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f499411cc60 con 0x7f499409e390 2023-10-03T10:19:10.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.124+0000 7f497bfff700 1 -- 172.21.15.19:0/1275803773 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f499411cc60 con 0x7f499409e390 2023-10-03T10:19:10.125 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:10.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 msgr2=0x7f49941195c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 0x7f49941195c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f498400e9b0 tx=0x7f498400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 shutdown_connections 2023-10-03T10:19:10.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f49941341d0 0x7f499411a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f499409e390 0x7f49941195c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 --2- 172.21.15.19:0/1275803773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49941338c0 0x7f4994119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 >> 172.21.15.19:0/1275803773 conn(0x7f49940a2aa0 msgr2=0x7f499412f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 shutdown_connections 2023-10-03T10:19:10.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.126+0000 7f4999e95700 1 -- 172.21.15.19:0/1275803773 wait complete. 2023-10-03T10:19:10.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:10.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.152+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f21b4121000 con 0x7f21b4131730 2023-10-03T10:19:10.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.152+0000 7f219bfff700 1 -- 172.21.15.19:0/879739964 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b4121000 con 0x7f21b4131730 2023-10-03T10:19:10.153 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 msgr2=0x7f21b4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 0x7f21b4070b90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f21ac00cb40 tx=0x7f21ac00ce50 comp rx=0 tx=0).stop 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 shutdown_connections 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21b4131730 0x7f21b4070b90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21b4099a40 0x7f21b4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 --2- 172.21.15.19:0/879739964 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21b409a3d0 0x7f21b4070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 >> 172.21.15.19:0/879739964 conn(0x7f21b40a27f0 msgr2=0x7f21b41b8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 shutdown_connections 2023-10-03T10:19:10.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.155+0000 7f21b9e9e700 1 -- 172.21.15.19:0/879739964 wait complete. 2023-10-03T10:19:10.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:10.540 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.684+0000 7f570221e700 1 Processor -- start 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.684+0000 7f570221e700 1 -- start start 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f570221e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f570221e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56fc09f240 0x7f56fc1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f570221e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56fc070940 con 0x7f56fc09f650 2023-10-03T10:19:10.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f570221e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56fc06fd60 con 0x7f56fc09f240 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f570221e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc06fa80 con 0x7f56fc09e930 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56faffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56fc09f240 0x7f56fc1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56fb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56fbfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56fc09f650 0x7f56fc131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47088/0 (socket says 172.21.15.19:47088) 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56fbfff700 1 -- 172.21.15.19:0/3583693826 learned_addr learned my addr 172.21.15.19:0/3583693826 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56faffd700 1 -- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 msgr2=0x7f56fc09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56faffd700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56faffd700 1 -- 172.21.15.19:0/3583693826 >> v1:172.21.15.19:6789/0 conn(0x7f56fc09f650 legacy=0x7f56fc131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.685+0000 7f56fa7fc700 1 -- 172.21.15.19:0/3583693826 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575296293 0 0) 0x7f56fc070940 con 0x7f56fc09f650 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56faffd700 1 -- 172.21.15.19:0/3583693826 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56fc09fb60 con 0x7f56fc09f240 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56fb7fe700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56faffd700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1317f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009840 tx=0x7f56e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353f9a8af0788719 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56fa7fc700 1 -- 172.21.15.19:0/3583693826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011830 con 0x7f56fc09f240 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56fa7fc700 1 -- 172.21.15.19:0/3583693826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4011990 con 0x7f56fc09f240 2023-10-03T10:19:10.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f56fa7fc700 1 -- 172.21.15.19:0/3583693826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4011d20 con 0x7f56fc09f240 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 -- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 msgr2=0x7f56fc1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1317f0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009840 tx=0x7f56e4009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 -- 172.21.15.19:0/3583693826 shutdown_connections 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 --2- 172.21.15.19:0/3583693826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1317f0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.686+0000 7f570221e700 1 -- 172.21.15.19:0/3583693826 >> 172.21.15.19:0/3583693826 conn(0x7f56fc0a4210 msgr2=0x7f56fc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.687+0000 7f570221e700 1 -- 172.21.15.19:0/3583693826 shutdown_connections 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.687+0000 7f570221e700 1 -- 172.21.15.19:0/3583693826 wait complete. 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.687+0000 7f570221e700 1 Processor -- start 2023-10-03T10:19:10.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 -- start start 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56fc09f650 0x7f56fc1a4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1a5f20 con 0x7f56fc09f240 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc1a6be0 con 0x7f56fc09e930 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f570221e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56fc0a32f0 con 0x7f56fc09f650 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f56fb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f56fb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33200/0 (socket says 172.21.15.19:33200) 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f56faffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f56fb7fe700 1 -- 172.21.15.19:0/1142183644 learned_addr learned my addr 172.21.15.19:0/1142183644 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.688+0000 7f56fbfff700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56fc09f650 0x7f56fc1a4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:10.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 -- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56fc09f650 msgr2=0x7f56fc1a4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56fc09f650 0x7f56fc1a4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 -- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 msgr2=0x7f56fc1a4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1a4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 -- 172.21.15.19:0/1142183644 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec0094a0 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56fb7fe700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ebe0 tx=0x7f56ec00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00c850 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ec00c9b0 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e40094a0 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00cd40 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.689+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56fc0a0190 con 0x7f56fc09e930 2023-10-03T10:19:10.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.690+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56ec013470 con 0x7f56fc09e930 2023-10-03T10:19:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.690+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56ec03fb30 con 0x7f56fc09e930 2023-10-03T10:19:10.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.690+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56fc1a0b30 con 0x7f56fc09e930 2023-10-03T10:19:10.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.695+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56ec013720 con 0x7f56fc09e930 2023-10-03T10:19:10.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.898+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f56fc074ea0 con 0x7f56fc09e930 2023-10-03T10:19:10.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.899+0000 7f56f3fff700 1 -- 172.21.15.19:0/1142183644 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56ec021030 con 0x7f56fc09e930 2023-10-03T10:19:10.900 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 msgr2=0x7f56fc1a3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00ebe0 tx=0x7f56ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 shutdown_connections 2023-10-03T10:19:10.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56fc09f650 0x7f56fc1a4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56fc09e930 0x7f56fc1a3cf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 --2- 172.21.15.19:0/1142183644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56fc09f240 0x7f56fc1a4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 >> 172.21.15.19:0/1142183644 conn(0x7f56fc0a4210 msgr2=0x7f56fc1b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 shutdown_connections 2023-10-03T10:19:10.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:10.901+0000 7f570221e700 1 -- 172.21.15.19:0/1142183644 wait complete. 2023-10-03T10:19:10.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:11.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:11.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:11.169 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:11.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.205+0000 7f75d6467700 1 Processor -- start 2023-10-03T10:19:11.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.205+0000 7f75d6467700 1 -- start start 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75d6467700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 0x7f75d009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75d6467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75d6467700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d009f130 con 0x7f75d009e410 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75d6467700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d009f520 con 0x7f75d009d6f0 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75d6467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d009e930 con 0x7f75d009e000 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75cffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 0x7f75d009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53040/0 (socket says 172.21.15.19:53040) 2023-10-03T10:19:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.206+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3537583620 learned_addr learned my addr 172.21.15.19:0/3537583620 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3537583620 >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 msgr2=0x7f75d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3537583620 >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 0x7f75d009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3537583620 >> v1:172.21.15.19:6789/0 conn(0x7f75d009e410 legacy=0x7f75d0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3537583620 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d009b2d0 con 0x7f75d009e000 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cffff700 1 --2- 172.21.15.19:0/3537583620 >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 0x7f75d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3537583620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f75c40098f0 tx=0x7f75c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded2f529dc72d131 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75ceffd700 1 -- 172.21.15.19:0/3537583620 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400e890 con 0x7f75d009e000 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75ceffd700 1 -- 172.21.15.19:0/3537583620 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400e9f0 con 0x7f75d009e000 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.207+0000 7f75ceffd700 1 -- 172.21.15.19:0/3537583620 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c400ed80 con 0x7f75d009e000 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 -- 172.21.15.19:0/3537583620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 msgr2=0x7f75d0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 --2- 172.21.15.19:0/3537583620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f75c40098f0 tx=0x7f75c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 -- 172.21.15.19:0/3537583620 shutdown_connections 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 --2- 172.21.15.19:0/3537583620 >> v2:172.21.15.19:3300/0 conn(0x7f75d009d6f0 0x7f75d009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 --2- 172.21.15.19:0/3537583620 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009e000 0x7f75d0130660 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 -- 172.21.15.19:0/3537583620 >> 172.21.15.19:0/3537583620 conn(0x7f75d0066f50 msgr2=0x7f75d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 -- 172.21.15.19:0/3537583620 shutdown_connections 2023-10-03T10:19:11.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.208+0000 7f75d6467700 1 -- 172.21.15.19:0/3537583620 wait complete. 2023-10-03T10:19:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.210+0000 7f75d6467700 1 Processor -- start 2023-10-03T10:19:11.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.210+0000 7f75d6467700 1 -- start start 2023-10-03T10:19:11.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.210+0000 7f75d6467700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 0x7f75d011df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.210+0000 7f75d6467700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 0x7f75d011e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d6467700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 0x7f75d011e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d6467700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d01302a0 con 0x7f75d009e000 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d6467700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d011f3b0 con 0x7f75d009e410 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d6467700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0120d20 con 0x7f75d009d6f0 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 0x7f75d011df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 0x7f75d011df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53058/0 (socket says 172.21.15.19:53058) 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cffff700 1 -- 172.21.15.19:0/3538821471 learned_addr learned my addr 172.21.15.19:0/3538821471 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 0x7f75d011e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d4a04700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 0x7f75d011e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 msgr2=0x7f75d011df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 0x7f75d011df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 msgr2=0x7f75d011e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 0x7f75d011e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75cf7fe700 1 -- 172.21.15.19:0/3538821471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00094a0 con 0x7f75d009e000 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.211+0000 7f75d4a04700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 0x7f75d011e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75cf7fe700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 0x7f75d011e490 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f75c4016000 tx=0x7f75c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c401e070 con 0x7f75d009e000 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c400ed70 con 0x7f75d009e000 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c40038e0 con 0x7f75d009e000 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75d6467700 1 -- 172.21.15.19:0/3538821471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c4009550 con 0x7f75d009e000 2023-10-03T10:19:11.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.212+0000 7f75d6467700 1 -- 172.21.15.19:0/3538821471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0121170 con 0x7f75d009e000 2023-10-03T10:19:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.213+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75c4003a40 con 0x7f75d009e000 2023-10-03T10:19:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.213+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75c4040b40 con 0x7f75d009e000 2023-10-03T10:19:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.213+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a80052e0 con 0x7f75d009e000 2023-10-03T10:19:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.219+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75c4003cf0 con 0x7f75d009e000 2023-10-03T10:19:11.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.285+0000 7faeeac26700 1 Processor -- start 2023-10-03T10:19:11.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.285+0000 7faeeac26700 1 -- start start 2023-10-03T10:19:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 0x7faee41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f650 0x7faee4131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee4070940 con 0x7faee409f240 2023-10-03T10:19:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee406fd60 con 0x7faee409e930 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faeeac26700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee406fa80 con 0x7faee409f650 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33218/0 (socket says 172.21.15.19:33218) 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 -- 172.21.15.19:0/4123021324 learned_addr learned my addr 172.21.15.19:0/4123021324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee3fff700 1 --2- 172.21.15.19:0/4123021324 >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 0x7faee41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee91c3700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f650 0x7faee4131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 -- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f650 msgr2=0x7faee4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f650 0x7faee4131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 -- 172.21.15.19:0/4123021324 >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 msgr2=0x7faee41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 --2- 172.21.15.19:0/4123021324 >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 0x7faee41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee89c2700 1 -- 172.21.15.19:0/4123021324 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee409fb60 con 0x7faee409e930 2023-10-03T10:19:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.286+0000 7faee3fff700 1 --2- 172.21.15.19:0/4123021324 >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 0x7faee41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.287+0000 7faee89c2700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faed40098f0 tx=0x7faed4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4874c17eb0c4fafc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.287+0000 7faee37fe700 1 -- 172.21.15.19:0/4123021324 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4011830 con 0x7faee409e930 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.287+0000 7faee37fe700 1 -- 172.21.15.19:0/4123021324 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4011990 con 0x7faee409e930 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.287+0000 7faee37fe700 1 -- 172.21.15.19:0/4123021324 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4011d20 con 0x7faee409e930 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 -- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 msgr2=0x7faee409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faed40098f0 tx=0x7faed4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 -- 172.21.15.19:0/4123021324 shutdown_connections 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee409ed00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 --2- 172.21.15.19:0/4123021324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f650 0x7faee4131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 --2- 172.21.15.19:0/4123021324 >> v2:172.21.15.19:3300/0 conn(0x7faee409f240 0x7faee41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 -- 172.21.15.19:0/4123021324 >> 172.21.15.19:0/4123021324 conn(0x7faee40a4210 msgr2=0x7faee40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 -- 172.21.15.19:0/4123021324 shutdown_connections 2023-10-03T10:19:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.288+0000 7faeeac26700 1 -- 172.21.15.19:0/4123021324 wait complete. 2023-10-03T10:19:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 Processor -- start 2023-10-03T10:19:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 -- start start 2023-10-03T10:19:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 0x7faee41a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faee409f650 0x7faee41a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41a58a0 con 0x7faee409f650 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee41a5230 con 0x7faee409e930 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faeeac26700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faee41a7310 con 0x7faee409f240 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.289+0000 7faee89c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33234/0 (socket says 172.21.15.19:33234) 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 -- 172.21.15.19:0/3588867204 learned_addr learned my addr 172.21.15.19:0/3588867204 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee3fff700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 0x7faee41a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee91c3700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faee409f650 0x7faee41a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 -- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 msgr2=0x7faee41a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 0x7faee41a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 -- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faee409f650 msgr2=0x7faee41a4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faee409f650 0x7faee41a4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 -- 172.21.15.19:0/3588867204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80094a0 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee3fff700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 0x7faee41a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee89c2700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faed4000c00 tx=0x7faed4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4004240 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed401f070 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4009550 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.290+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40045e0 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.291+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee40a0190 con 0x7faee409e930 2023-10-03T10:19:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.292+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faed4021030 con 0x7faee409e930 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.292+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee41a75d0 con 0x7faee409e930 2023-10-03T10:19:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.292+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faed40405b0 con 0x7faee409e930 2023-10-03T10:19:11.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.301+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faed4003e00 con 0x7faee409e930 2023-10-03T10:19:11.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.325+0000 7f23be88c700 1 Processor -- start 2023-10-03T10:19:11.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.325+0000 7f23be88c700 1 -- start start 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 0x7f23b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b809e410 0x7f23b8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b806b460 con 0x7f23b809e410 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b809b120 con 0x7f23b809e000 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23be88c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b809a7e0 con 0x7f23b809d6f0 2023-10-03T10:19:11.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23bce29700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b809e410 0x7f23b8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23b77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23bce29700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f23b809e410 0x7f23b8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55550/0 (socket says 172.21.15.19:55550) 2023-10-03T10:19:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23b77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33242/0 (socket says 172.21.15.19:33242) 2023-10-03T10:19:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23bce29700 1 -- 172.21.15.19:0/1297577437 learned_addr learned my addr 172.21.15.19:0/1297577437 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.326+0000 7f23b7fff700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 0x7f23b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 -- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 msgr2=0x7f23b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 0x7f23b809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 -- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 msgr2=0x7f23b81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 -- 172.21.15.19:0/1297577437 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b809a500 con 0x7f23b809e410 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23b77fe700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23b7fff700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 0x7f23b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23bce29700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e410 0x7f23b8133f30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e50 tx=0x7f23b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74d2c5f5a072fda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23b6ffd700 1 -- 172.21.15.19:0/1297577437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000e070 con 0x7f23b809e410 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23b6ffd700 1 -- 172.21.15.19:0/1297577437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000b910 con 0x7f23b809e410 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.327+0000 7f23b6ffd700 1 -- 172.21.15.19:0/1297577437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000bcc0 con 0x7f23b809e410 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 -- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e410 msgr2=0x7f23b8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e410 0x7f23b8133f30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009e50 tx=0x7f23b000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 -- 172.21.15.19:0/1297577437 shutdown_connections 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e410 0x7f23b8133f30 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809d6f0 0x7f23b809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 --2- 172.21.15.19:0/1297577437 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809e000 0x7f23b81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 -- 172.21.15.19:0/1297577437 >> 172.21.15.19:0/1297577437 conn(0x7f23b8066f50 msgr2=0x7f23b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 -- 172.21.15.19:0/1297577437 shutdown_connections 2023-10-03T10:19:11.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.328+0000 7f23be88c700 1 -- 172.21.15.19:0/1297577437 wait complete. 2023-10-03T10:19:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.329+0000 7f23be88c700 1 Processor -- start 2023-10-03T10:19:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 -- start start 2023-10-03T10:19:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809d6f0 0x7f23b81a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e000 0x7f23b81a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81a5c90 con 0x7f23b809e000 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81b9140 con 0x7f23b809d6f0 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23be88c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81a4d20 con 0x7f23b809e410 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23bce29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23bce29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53098/0 (socket says 172.21.15.19:53098) 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23bce29700 1 -- 172.21.15.19:0/1244174339 learned_addr learned my addr 172.21.15.19:0/1244174339 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.330+0000 7f23b7fff700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809d6f0 0x7f23b81a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23b77fe700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e000 0x7f23b81a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 -- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809d6f0 msgr2=0x7f23b81a5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809d6f0 0x7f23b81a5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 -- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e000 msgr2=0x7f23b81a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e000 0x7f23b81a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 -- 172.21.15.19:0/1244174339 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80094a0 con 0x7f23b809e410 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23bce29700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f23b0003f50 tx=0x7f23b0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0004450 con 0x7f23b809e410 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00045d0 con 0x7f23b809e410 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0094a0 con 0x7f23b809e410 2023-10-03T10:19:11.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00092e0 con 0x7f23b809e410 2023-10-03T10:19:11.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.331+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0009b30 con 0x7f23b809e410 2023-10-03T10:19:11.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.332+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23b001c410 con 0x7f23b809e410 2023-10-03T10:19:11.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.332+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23b00410c0 con 0x7f23b809e410 2023-10-03T10:19:11.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.333+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8074ea0 con 0x7f23b809e410 2023-10-03T10:19:11.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.337+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23b0029070 con 0x7f23b809e410 2023-10-03T10:19:11.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.433+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75a8005590 con 0x7f75d009e000 2023-10-03T10:19:11.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.433+0000 7f75ccff9700 1 -- 172.21.15.19:0/3538821471 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75c402c3b0 con 0x7f75d009e000 2023-10-03T10:19:11.434 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:11.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 msgr2=0x7f75d011e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 0x7f75d011e490 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f75c4016000 tx=0x7f75c4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 shutdown_connections 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d009e410 0x7f75d011e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d009d6f0 0x7f75d011df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 --2- 172.21.15.19:0/3538821471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d009e000 0x7f75d011e490 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 >> 172.21.15.19:0/3538821471 conn(0x7f75d0066f50 msgr2=0x7f75d0130ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.435+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 shutdown_connections 2023-10-03T10:19:11.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.436+0000 7f75b67fc700 1 -- 172.21.15.19:0/3538821471 wait complete. 2023-10-03T10:19:11.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:11.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.510+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faee41a0b30 con 0x7faee409e930 2023-10-03T10:19:11.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.510+0000 7faee17fa700 1 -- 172.21.15.19:0/3588867204 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faed4015030 con 0x7faee409e930 2023-10-03T10:19:11.511 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 msgr2=0x7faee41a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7faed4000c00 tx=0x7faed4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 shutdown_connections 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faee409f650 0x7faee41a4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faee409e930 0x7faee41a3d80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 --2- 172.21.15.19:0/3588867204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faee409f240 0x7faee41a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 >> 172.21.15.19:0/3588867204 conn(0x7faee40a4210 msgr2=0x7faee41b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 shutdown_connections 2023-10-03T10:19:11.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.512+0000 7faeeac26700 1 -- 172.21.15.19:0/3588867204 wait complete. 2023-10-03T10:19:11.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:11.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.544+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f23b81a7030 con 0x7f23b809e410 2023-10-03T10:19:11.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.545+0000 7f23b4ff9700 1 -- 172.21.15.19:0/1244174339 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23b0033090 con 0x7f23b809e410 2023-10-03T10:19:11.546 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 msgr2=0x7f23b81c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f23b0003f50 tx=0x7f23b0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 shutdown_connections 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b809e410 0x7f23b81c8020 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b809d6f0 0x7f23b81a5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 --2- 172.21.15.19:0/1244174339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b809e000 0x7f23b81a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 >> 172.21.15.19:0/1244174339 conn(0x7f23b8066f50 msgr2=0x7f23b81bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 shutdown_connections 2023-10-03T10:19:11.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:11.547+0000 7f23be88c700 1 -- 172.21.15.19:0/1244174339 wait complete. 2023-10-03T10:19:11.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:11.916 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:12.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.061+0000 7fb198150700 1 Processor -- start 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.061+0000 7fb198150700 1 -- start start 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb198150700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19009e1d0 0x7fb190138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb198150700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 0x7fb19013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb198150700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19009d2f0 con 0x7fb19009d6f0 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb198150700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19009b0f0 con 0x7fb19009e1d0 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb198150700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb19009a810 con 0x7fb190139170 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19009e1d0 0x7fb190138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1966ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 0x7fb19013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb195eec700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb19009d6f0 0x7fb19009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47118/0 (socket says 172.21.15.19:47118) 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1966ed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 0x7fb19013b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53106/0 (socket says 172.21.15.19:53106) 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb19009e1d0 0x7fb190138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55572/0 (socket says 172.21.15.19:55572) 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb195eec700 1 -- 172.21.15.19:0/505607359 learned_addr learned my addr 172.21.15.19:0/505607359 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 -- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 msgr2=0x7fb19013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 --2- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 0x7fb19013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 -- 172.21.15.19:0/505607359 >> v1:172.21.15.19:6789/0 conn(0x7fb19009d6f0 legacy=0x7fb19009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb194eea700 1 -- 172.21.15.19:0/505607359 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215475976 0 0) 0x7fb19009d2f0 con 0x7fb19009d6f0 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.062+0000 7fb1956eb700 1 -- 172.21.15.19:0/505607359 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19009a470 con 0x7fb19009e1d0 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb1956eb700 1 --2- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19009e1d0 0x7fb190138c30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb180009840 tx=0x7fb180009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5160eed62074437 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb194eea700 1 -- 172.21.15.19:0/505607359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180011830 con 0x7fb19009e1d0 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb194eea700 1 -- 172.21.15.19:0/505607359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb180011990 con 0x7fb19009e1d0 2023-10-03T10:19:12.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb194eea700 1 -- 172.21.15.19:0/505607359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180011d20 con 0x7fb19009e1d0 2023-10-03T10:19:12.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 -- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19009e1d0 msgr2=0x7fb190138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 --2- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19009e1d0 0x7fb190138c30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb180009840 tx=0x7fb180009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:12.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 -- 172.21.15.19:0/505607359 shutdown_connections 2023-10-03T10:19:12.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 --2- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb190139170 0x7fb19013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 --2- 172.21.15.19:0/505607359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb19009e1d0 0x7fb190138c30 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.063+0000 7fb198150700 1 -- 172.21.15.19:0/505607359 >> 172.21.15.19:0/505607359 conn(0x7fb190066f50 msgr2=0x7fb19009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.064+0000 7fb198150700 1 -- 172.21.15.19:0/505607359 shutdown_connections 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.064+0000 7fb198150700 1 -- 172.21.15.19:0/505607359 wait complete. 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.064+0000 7fb198150700 1 Processor -- start 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 -- start start 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb19009e1d0 0x7fb190121a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19009bfb0 con 0x7fb190139170 2023-10-03T10:19:12.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19009c640 con 0x7fb19009d6f0 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb198150700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb190124db0 con 0x7fb19009e1d0 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb1966ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33266/0 (socket says 172.21.15.19:33266) 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb1966ed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55586/0 (socket says 172.21.15.19:55586) 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 -- 172.21.15.19:0/1338630114 learned_addr learned my addr 172.21.15.19:0/1338630114 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb1956eb700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb19009e1d0 0x7fb190121a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 -- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb19009e1d0 msgr2=0x7fb190121a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb19009e1d0 0x7fb190121a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 -- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 msgr2=0x7fb190121fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb195eec700 1 -- 172.21.15.19:0/1338630114 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800094a0 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.065+0000 7fb1966ed700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb195eec700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c520 tx=0x7fb18c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c004c80 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18c004de0 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c007310 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1901243d0 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.066+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1901257b0 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.067+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb18c007470 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.067+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb18c03f260 con 0x7fb19009d6f0 2023-10-03T10:19:12.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.067+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb190074ea0 con 0x7fb19009d6f0 2023-10-03T10:19:12.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.072+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb18c0123b0 con 0x7fb19009d6f0 2023-10-03T10:19:12.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.275+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb19006c360 con 0x7fb19009d6f0 2023-10-03T10:19:12.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.276+0000 7fb1867fc700 1 -- 172.21.15.19:0/1338630114 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb18c011360 con 0x7fb19009d6f0 2023-10-03T10:19:12.277 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 msgr2=0x7fb190121540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00c520 tx=0x7fb18c00c830 comp rx=0 tx=0).stop 2023-10-03T10:19:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 shutdown_connections 2023-10-03T10:19:12.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb190139170 0x7fb190121fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb19009d6f0 0x7fb190121540 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 --2- 172.21.15.19:0/1338630114 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb19009e1d0 0x7fb190121a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 >> 172.21.15.19:0/1338630114 conn(0x7fb190066f50 msgr2=0x7fb1900a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 shutdown_connections 2023-10-03T10:19:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.278+0000 7fb198150700 1 -- 172.21.15.19:0/1338630114 wait complete. 2023-10-03T10:19:12.293 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:12.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:12.528 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:12.562 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.605+0000 7f80e7c9e700 1 Processor -- start 2023-10-03T10:19:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.606+0000 7f80e7c9e700 1 -- start start 2023-10-03T10:19:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.606+0000 7f80e7c9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.606+0000 7f80e7c9e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f80e009e000 0x7f80e01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.606+0000 7f80e7c9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e7c9e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e006b460 con 0x7f80e009e000 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e7c9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e009b120 con 0x7f80e009d6f0 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e7c9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80e009a7e0 con 0x7f80e009e410 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33274/0 (socket says 172.21.15.19:33274) 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 -- 172.21.15.19:0/451246388 learned_addr learned my addr 172.21.15.19:0/451246388 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e623b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5239700 1 --2- 172.21.15.19:0/451246388 >> v2:172.21.15.19:3300/0 conn(0x7f80e009e000 0x7f80e01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 -- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 msgr2=0x7f80e0133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e0133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 -- 172.21.15.19:0/451246388 >> v2:172.21.15.19:3300/0 conn(0x7f80e009e000 msgr2=0x7f80e01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/451246388 >> v2:172.21.15.19:3300/0 conn(0x7f80e009e000 0x7f80e01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 -- 172.21.15.19:0/451246388 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e009a500 con 0x7f80e009d6f0 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009920 tx=0x7f80dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c46ba975df3794 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.607+0000 7f80e4a38700 1 -- 172.21.15.19:0/451246388 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc011830 con 0x7f80e009d6f0 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e4a38700 1 -- 172.21.15.19:0/451246388 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc011990 con 0x7f80e009d6f0 2023-10-03T10:19:12.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e4a38700 1 -- 172.21.15.19:0/451246388 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc011d20 con 0x7f80e009d6f0 2023-10-03T10:19:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 -- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 msgr2=0x7f80e009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009920 tx=0x7f80dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 -- 172.21.15.19:0/451246388 shutdown_connections 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e009dac0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/451246388 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e0133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/451246388 >> v2:172.21.15.19:3300/0 conn(0x7f80e009e000 0x7f80e01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 -- 172.21.15.19:0/451246388 >> 172.21.15.19:0/451246388 conn(0x7f80e0066f50 msgr2=0x7f80e009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.608+0000 7f80e7c9e700 1 -- 172.21.15.19:0/451246388 shutdown_connections 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.609+0000 7f80e7c9e700 1 -- 172.21.15.19:0/451246388 wait complete. 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.609+0000 7f80e7c9e700 1 Processor -- start 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 -- start start 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e009e000 0x7f80e01a6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e01a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01aa250 con 0x7f80e009e000 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01a7980 con 0x7f80e009d6f0 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e7c9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80e01a8bd0 con 0x7f80e009e410 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e5a3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e5a3a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33284/0 (socket says 172.21.15.19:33284) 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e5a3a700 1 -- 172.21.15.19:0/3898993797 learned_addr learned my addr 172.21.15.19:0/3898993797 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e5239700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e009e000 0x7f80e01a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e623b700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e01a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.610+0000 7f80e5a3a700 1 -- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 msgr2=0x7f80e01a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e01a6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e5a3a700 1 -- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e009e000 msgr2=0x7f80e01a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e009e000 0x7f80e01a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e5a3a700 1 -- 172.21.15.19:0/3898993797 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc009550 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e5a3a700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c70 tx=0x7f80dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc004240 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc01f070 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0045c0 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e01a7f70 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.611+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e009c710 con 0x7f80e009d6f0 2023-10-03T10:19:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.612+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f80dc021030 con 0x7f80e009d6f0 2023-10-03T10:19:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.612+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f80dc040810 con 0x7f80e009d6f0 2023-10-03T10:19:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.612+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e0074ea0 con 0x7f80e009d6f0 2023-10-03T10:19:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.617+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f80dc015080 con 0x7f80e009d6f0 2023-10-03T10:19:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 Processor -- start 2023-10-03T10:19:12.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 -- start start 2023-10-03T10:19:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a4136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8a4136fe0 0x7fe8a41393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8a4070940 con 0x7fe8a409e930 2023-10-03T10:19:12.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8a406fd60 con 0x7fe8a4136fe0 2023-10-03T10:19:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a9bd0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a406fa80 con 0x7fe8a409f410 2023-10-03T10:19:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8a409e930 0x7fe8a409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47126/0 (socket says 172.21.15.19:47126) 2023-10-03T10:19:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a37fe700 1 -- 172.21.15.19:0/1944704273 learned_addr learned my addr 172.21.15.19:0/1944704273 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a3fff700 1 --2- 172.21.15.19:0/1944704273 >> v2:172.21.15.19:3300/0 conn(0x7fe8a4136fe0 0x7fe8a41393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.679+0000 7fe8a2ffd700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a4136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a3fff700 1 -- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 msgr2=0x7fe8a4136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a3fff700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a4136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a3fff700 1 -- 172.21.15.19:0/1944704273 >> v1:172.21.15.19:6789/0 conn(0x7fe8a409e930 legacy=0x7fe8a409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a3fff700 1 -- 172.21.15.19:0/1944704273 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a409fb60 con 0x7fe8a4136fe0 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a27fc700 1 -- 172.21.15.19:0/1944704273 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800097882 0 0) 0x7fe8a4070940 con 0x7fe8a409e930 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a3fff700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a41393c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009d90 tx=0x7fe89c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6a080a56c72831 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a27fc700 1 -- 172.21.15.19:0/1944704273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c00e070 con 0x7fe8a4136fe0 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a27fc700 1 -- 172.21.15.19:0/1944704273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89c00bb20 con 0x7fe8a4136fe0 2023-10-03T10:19:12.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.680+0000 7fe8a27fc700 1 -- 172.21.15.19:0/1944704273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89c012430 con 0x7fe8a4136fe0 2023-10-03T10:19:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 msgr2=0x7fe8a41393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a41393c0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fe89c009d90 tx=0x7fe89c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:12.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/1944704273 shutdown_connections 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a41393c0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/1944704273 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a4136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/1944704273 >> 172.21.15.19:0/1944704273 conn(0x7fe8a40a4210 msgr2=0x7fe8a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/1944704273 shutdown_connections 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.681+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/1944704273 wait complete. 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.682+0000 7fe8a9bd0700 1 Processor -- start 2023-10-03T10:19:12.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 -- start start 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a411ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a4071db0 con 0x7fe8a4136fe0 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a411e100 con 0x7fe8a409e930 2023-10-03T10:19:12.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a9bd0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a411fc20 con 0x7fe8a409f410 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33288/0 (socket says 172.21.15.19:33288) 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a37fe700 1 -- 172.21.15.19:0/2664148727 learned_addr learned my addr 172.21.15.19:0/2664148727 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53136/0 (socket says 172.21.15.19:53136) 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.683+0000 7fe8a3fff700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a411ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 -- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 msgr2=0x7fe8a411c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 -- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 msgr2=0x7fe8a411ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a411ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 -- 172.21.15.19:0/2664148727 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c009a70 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a3fff700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a411ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a2ffd700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a37fe700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c550 tx=0x7fe89400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894004c80 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894004e00 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894007310 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a409ddf0 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.684+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a4120690 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.685+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe894007470 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.685+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a4074ea0 con 0x7fe8a409e930 2023-10-03T10:19:12.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.685+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe89403f490 con 0x7fe8a409e930 2023-10-03T10:19:12.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.690+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8940123b0 con 0x7fe8a409e930 2023-10-03T10:19:12.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 Processor -- start 2023-10-03T10:19:12.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 -- start start 2023-10-03T10:19:12.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 0x7fd80c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd80c139250 0x7fd80c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c09edd0 con 0x7fd80c0a0a30 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0a18e0 con 0x7fd80c139250 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.714+0000 7fd81225d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c09e1f0 con 0x7fd80c0a1510 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 0x7fd80c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd80c0a0a30 0x7fd80c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47136/0 (socket says 172.21.15.19:47136) 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80b7fe700 1 -- 172.21.15.19:0/1677888463 learned_addr learned my addr 172.21.15.19:0/1677888463 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80bfff700 1 --2- 172.21.15.19:0/1677888463 >> v2:172.21.15.19:3300/0 conn(0x7fd80c139250 0x7fd80c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 -- 172.21.15.19:0/1677888463 >> v2:172.21.15.19:3300/0 conn(0x7fd80c139250 msgr2=0x7fd80c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:12.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 --2- 172.21.15.19:0/1677888463 >> v2:172.21.15.19:3300/0 conn(0x7fd80c139250 0x7fd80c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80a7fc700 1 -- 172.21.15.19:0/1677888463 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711714406 0 0) 0x7fd80c09edd0 con 0x7fd80c0a0a30 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 -- 172.21.15.19:0/1677888463 >> v1:172.21.15.19:6789/0 conn(0x7fd80c0a0a30 legacy=0x7fd80c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 -- 172.21.15.19:0/1677888463 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c09dc50 con 0x7fd80c0a1510 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80affd700 1 --2- 172.21.15.19:0/1677888463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 0x7fd80c138d10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd800009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c250993969b7cd48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80a7fc700 1 -- 172.21.15.19:0/1677888463 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800011830 con 0x7fd80c0a1510 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80a7fc700 1 -- 172.21.15.19:0/1677888463 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800011990 con 0x7fd80c0a1510 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.715+0000 7fd80a7fc700 1 -- 172.21.15.19:0/1677888463 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800011d20 con 0x7fd80c0a1510 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 -- 172.21.15.19:0/1677888463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 msgr2=0x7fd80c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 --2- 172.21.15.19:0/1677888463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 0x7fd80c138d10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd800009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 -- 172.21.15.19:0/1677888463 shutdown_connections 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 --2- 172.21.15.19:0/1677888463 >> v2:172.21.15.19:3300/0 conn(0x7fd80c139250 0x7fd80c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 --2- 172.21.15.19:0/1677888463 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c0a1510 0x7fd80c138d10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.716+0000 7fd81225d700 1 -- 172.21.15.19:0/1677888463 >> 172.21.15.19:0/1677888463 conn(0x7fd80c0a6550 msgr2=0x7fd80c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.717+0000 7fd81225d700 1 -- 172.21.15.19:0/1677888463 shutdown_connections 2023-10-03T10:19:12.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.717+0000 7fd81225d700 1 -- 172.21.15.19:0/1677888463 wait complete. 2023-10-03T10:19:12.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.718+0000 7fd81225d700 1 Processor -- start 2023-10-03T10:19:12.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.718+0000 7fd81225d700 1 -- start start 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 0x7fd80c122750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c139250 0x7fd80c1231d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1381f0 con 0x7fd80c0a1510 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c125c40 con 0x7fd80c139250 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd81225d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1243e0 con 0x7fd80c0a0a30 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55636/0 (socket says 172.21.15.19:55636) 2023-10-03T10:19:12.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 -- 172.21.15.19:0/3845259187 learned_addr learned my addr 172.21.15.19:0/3845259187 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80b7fe700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 0x7fd80c122750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 -- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 msgr2=0x7fd80c122750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 0x7fd80c122750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 -- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c139250 msgr2=0x7fd80c1231d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.719+0000 7fd80affd700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c139250 0x7fd80c1231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd80affd700 1 -- 172.21.15.19:0/3845259187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8000094a0 con 0x7fd80c0a1510 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd80b7fe700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 0x7fd80c122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd80affd700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd800004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8000036a0 con 0x7fd80c0a1510 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80001f070 con 0x7fd80c0a1510 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003a00 con 0x7fd80c0a1510 2023-10-03T10:19:12.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c138590 con 0x7fd80c0a1510 2023-10-03T10:19:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.720+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c125fb0 con 0x7fd80c0a1510 2023-10-03T10:19:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.721+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd800003b60 con 0x7fd80c0a1510 2023-10-03T10:19:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.721+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c074ea0 con 0x7fd80c0a1510 2023-10-03T10:19:12.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.721+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd800021070 con 0x7fd80c0a1510 2023-10-03T10:19:12.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.727+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd80001a430 con 0x7fd80c0a1510 2023-10-03T10:19:12.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.829+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f80e006c360 con 0x7f80e009d6f0 2023-10-03T10:19:12.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.830+0000 7f80d67fc700 1 -- 172.21.15.19:0/3898993797 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f80dc01a450 con 0x7f80e009d6f0 2023-10-03T10:19:12.831 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:12.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 msgr2=0x7f80e01a5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009c70 tx=0x7f80dc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:12.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 shutdown_connections 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f80e009e410 0x7f80e01a6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f80e009d6f0 0x7f80e01a5e00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 --2- 172.21.15.19:0/3898993797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80e009e000 0x7f80e01a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 >> 172.21.15.19:0/3898993797 conn(0x7f80e0066f50 msgr2=0x7f80e01bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 shutdown_connections 2023-10-03T10:19:12.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.832+0000 7f80e7c9e700 1 -- 172.21.15.19:0/3898993797 wait complete. 2023-10-03T10:19:12.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.901+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe8a406b250 con 0x7fe8a409e930 2023-10-03T10:19:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.901+0000 7fe88bfff700 1 -- 172.21.15.19:0/2664148727 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe894011360 con 0x7fe8a409e930 2023-10-03T10:19:12.902 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 msgr2=0x7fe8a411c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c550 tx=0x7fe89400c860 comp rx=0 tx=0).stop 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 shutdown_connections 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8a4136fe0 0x7fe8a411ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8a409e930 0x7fe8a411c3e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 --2- 172.21.15.19:0/2664148727 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8a409f410 0x7fe8a411c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 >> 172.21.15.19:0/2664148727 conn(0x7fe8a40a4210 msgr2=0x7fe8a4134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 shutdown_connections 2023-10-03T10:19:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.905+0000 7fe8a9bd0700 1 -- 172.21.15.19:0/2664148727 wait complete. 2023-10-03T10:19:12.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:12.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.932+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd80c125930 con 0x7fd80c0a1510 2023-10-03T10:19:12.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.933+0000 7fd7f3fff700 1 -- 172.21.15.19:0/3845259187 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd80002b030 con 0x7fd80c0a1510 2023-10-03T10:19:12.934 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 msgr2=0x7fd80c122c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd800000c00 tx=0x7fd800004750 comp rx=0 tx=0).stop 2023-10-03T10:19:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 shutdown_connections 2023-10-03T10:19:12.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd80c139250 0x7fd80c1231d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd80c0a0a30 0x7fd80c122750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 --2- 172.21.15.19:0/3845259187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd80c0a1510 0x7fd80c122c90 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 >> 172.21.15.19:0/3845259187 conn(0x7fd80c0a6550 msgr2=0x7fd80c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 shutdown_connections 2023-10-03T10:19:12.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:12.935+0000 7fd81225d700 1 -- 172.21.15.19:0/3845259187 wait complete. 2023-10-03T10:19:12.950 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:13.293 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.438+0000 7ff4bcb5f700 1 Processor -- start 2023-10-03T10:19:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.438+0000 7ff4bcb5f700 1 -- start start 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4bcb5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4bcb5f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 0x7ff4b8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4bcb5f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b809f130 con 0x7ff4b809e410 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4bcb5f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b809f520 con 0x7ff4b809e000 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4bcb5f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b809e930 con 0x7ff4b809d6f0 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 0x7ff4b8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff4b809e410 0x7ff4b8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47138/0 (socket says 172.21.15.19:47138) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b6d9d700 1 -- 172.21.15.19:0/3706618132 learned_addr learned my addr 172.21.15.19:0/3706618132 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b659c700 1 -- 172.21.15.19:0/3706618132 >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 msgr2=0x7ff4b8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b659c700 1 --2- 172.21.15.19:0/3706618132 >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 0x7ff4b8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b659c700 1 -- 172.21.15.19:0/3706618132 >> v1:172.21.15.19:6789/0 conn(0x7ff4b809e410 legacy=0x7ff4b8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b659c700 1 -- 172.21.15.19:0/3706618132 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b809b2d0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.439+0000 7ff4b5d9b700 1 --2- 172.21.15.19:0/3706618132 >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 0x7ff4b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4b659c700 1 --2- 172.21.15.19:0/3706618132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b809dac0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009840 tx=0x7ff4a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edab9600815f6392 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4b559a700 1 -- 172.21.15.19:0/3706618132 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8011830 con 0x7ff4b809d6f0 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4b559a700 1 -- 172.21.15.19:0/3706618132 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a8011990 con 0x7ff4b809d6f0 2023-10-03T10:19:13.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4b559a700 1 -- 172.21.15.19:0/3706618132 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8011d20 con 0x7ff4b809d6f0 2023-10-03T10:19:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/3706618132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 msgr2=0x7ff4b809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/3706618132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b809dac0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009840 tx=0x7ff4a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.440+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/3706618132 shutdown_connections 2023-10-03T10:19:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.441+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/3706618132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b809dac0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.441+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/3706618132 >> v2:172.21.15.19:3300/0 conn(0x7ff4b809e000 0x7ff4b8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.441+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/3706618132 >> 172.21.15.19:0/3706618132 conn(0x7ff4b8066f50 msgr2=0x7ff4b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.441+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/3706618132 shutdown_connections 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.441+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/3706618132 wait complete. 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 Processor -- start 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 -- start start 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 0x7ff4b81207f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 0x7ff4b8120d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8123c80 con 0x7ff4b809e000 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8121680 con 0x7ff4b809d6f0 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4bcb5f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80a1f10 con 0x7ff4b809e410 2023-10-03T10:19:13.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4b659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4b5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 0x7ff4b81207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4b6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 0x7ff4b8120d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4b659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33308/0 (socket says 172.21.15.19:33308) 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.442+0000 7ff4b659c700 1 -- 172.21.15.19:0/1801673555 learned_addr learned my addr 172.21.15.19:0/1801673555 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 -- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 msgr2=0x7ff4b8120d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 0x7ff4b8120d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 -- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 msgr2=0x7ff4b81207f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 0x7ff4b81207f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 -- 172.21.15.19:0/1801673555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a00094a0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b5d9b700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 0x7ff4b81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b6d9d700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 0x7ff4b8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:13.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4b659c700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009fd0 tx=0x7ff4a8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80036a0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a801e070 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a80094a0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8003a40 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.443+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b81300a0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.444+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff4a8003ba0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.444+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff4a8040550 con 0x7ff4b809d6f0 2023-10-03T10:19:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.444+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b8123820 con 0x7ff4b809d6f0 2023-10-03T10:19:13.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.450+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff4a8015020 con 0x7ff4b809d6f0 2023-10-03T10:19:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.657+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff4b8074ea0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.658+0000 7ff4aeffd700 1 -- 172.21.15.19:0/1801673555 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff4a802d7d0 con 0x7ff4b809d6f0 2023-10-03T10:19:13.659 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 msgr2=0x7ff4b81202b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009fd0 tx=0x7ff4a8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:13.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 shutdown_connections 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff4b809e410 0x7ff4b8120d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff4b809d6f0 0x7ff4b81202b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 --2- 172.21.15.19:0/1801673555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4b809e000 0x7ff4b81207f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 >> 172.21.15.19:0/1801673555 conn(0x7ff4b8066f50 msgr2=0x7ff4b806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 shutdown_connections 2023-10-03T10:19:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:13.660+0000 7ff4bcb5f700 1 -- 172.21.15.19:0/1801673555 wait complete. 2023-10-03T10:19:13.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:13.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:13.919 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:13.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:14.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.001+0000 7f032f574700 1 Processor -- start 2023-10-03T10:19:14.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.001+0000 7f032f574700 1 -- start start 2023-10-03T10:19:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032f574700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03281338a0 0x7f0328133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032f574700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 0x7f032813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032f574700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032806ef30 con 0x7f032809de50 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032f574700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f032806fef0 con 0x7f03281338a0 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032f574700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03281334b0 con 0x7f032809e930 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032d310700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03281338a0 0x7f0328133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032cb0f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f032809de50 0x7f032809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47144/0 (socket says 172.21.15.19:47144) 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032cb0f700 1 -- 172.21.15.19:0/1387814515 learned_addr learned my addr 172.21.15.19:0/1387814515 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032db11700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 0x7f032813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f031ffff700 1 -- 172.21.15.19:0/1387814515 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752588811 0 0) 0x7f032806ef30 con 0x7f032809de50 2023-10-03T10:19:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f031ffff700 1 -- 172.21.15.19:0/1387814515 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03140035b0 con 0x7f032809de50 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032d310700 1 -- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 msgr2=0x7f032813b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032d310700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 0x7f032813b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032d310700 1 -- 172.21.15.19:0/1387814515 >> v1:172.21.15.19:6789/0 conn(0x7f032809de50 legacy=0x7f032809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032d310700 1 -- 172.21.15.19:0/1387814515 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032806fc30 con 0x7f03281338a0 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.002+0000 7f032db11700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 0x7f032813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.003+0000 7f032d310700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03281338a0 0x7f0328133c70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f0324009840 tx=0x7f0324009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963dc4f409a6302f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.003+0000 7f031ffff700 1 -- 172.21.15.19:0/1387814515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011830 con 0x7f03281338a0 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.003+0000 7f031ffff700 1 -- 172.21.15.19:0/1387814515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0324011990 con 0x7f03281338a0 2023-10-03T10:19:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.003+0000 7f031ffff700 1 -- 172.21.15.19:0/1387814515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324011d20 con 0x7f03281338a0 2023-10-03T10:19:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 -- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03281338a0 msgr2=0x7f0328133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03281338a0 0x7f0328133c70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f0324009840 tx=0x7f0324009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 -- 172.21.15.19:0/1387814515 shutdown_connections 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f032809e930 0x7f032813b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 --2- 172.21.15.19:0/1387814515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03281338a0 0x7f0328133c70 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 -- 172.21.15.19:0/1387814515 >> 172.21.15.19:0/1387814515 conn(0x7f03280a2aa0 msgr2=0x7f03280a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 -- 172.21.15.19:0/1387814515 shutdown_connections 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.004+0000 7f032f574700 1 -- 172.21.15.19:0/1387814515 wait complete. 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.005+0000 7f032f574700 1 Processor -- start 2023-10-03T10:19:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.005+0000 7f032f574700 1 -- start start 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f032809e930 0x7f032811a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03281338a0 0x7f032811ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280a0eb0 con 0x7f032809de50 2023-10-03T10:19:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032811dae0 con 0x7f03281338a0 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032f574700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032811c2f0 con 0x7f032809e930 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032d310700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032d310700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55674/0 (socket says 172.21.15.19:55674) 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032d310700 1 -- 172.21.15.19:0/722885677 learned_addr learned my addr 172.21.15.19:0/722885677 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032cb0f700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f032809e930 0x7f032811a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.006+0000 7f032db11700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03281338a0 0x7f032811ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 -- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f032809e930 msgr2=0x7f032811a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f032809e930 0x7f032811a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 -- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03281338a0 msgr2=0x7f032811ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03281338a0 0x7f032811ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 -- 172.21.15.19:0/722885677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0320009a70 con 0x7f032809de50 2023-10-03T10:19:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032d310700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f03240090b0 tx=0x7f0324004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240036a0 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032401f070 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03240094a0 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324003a60 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.007+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032811dda0 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.008+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0324003bc0 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.008+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0324021070 con 0x7f032809de50 2023-10-03T10:19:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.009+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0328074ea0 con 0x7f032809de50 2023-10-03T10:19:14.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.019+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0324015020 con 0x7f032809de50 2023-10-03T10:19:14.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 Processor -- start 2023-10-03T10:19:14.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 -- start start 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0a8009d6f0 0x7f0a8009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8009b120 con 0x7f0a8009e410 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8006b460 con 0x7f0a8009d6f0 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.072+0000 7f0a84cf3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8009a7e0 con 0x7f0a8009e000 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0a8009e410 0x7f0a80133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47150/0 (socket says 172.21.15.19:47150) 2023-10-03T10:19:14.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7ed9d700 1 -- 172.21.15.19:0/2119933708 learned_addr learned my addr 172.21.15.19:0/2119933708 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7e59c700 1 --2- 172.21.15.19:0/2119933708 >> v2:172.21.15.19:3300/0 conn(0x7f0a8009d6f0 0x7f0a8009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 -- 172.21.15.19:0/2119933708 >> v2:172.21.15.19:3300/0 conn(0x7f0a8009d6f0 msgr2=0x7f0a8009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7d59a700 1 -- 172.21.15.19:0/2119933708 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558482153 0 0) 0x7f0a8009b120 con 0x7f0a8009e410 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 --2- 172.21.15.19:0/2119933708 >> v2:172.21.15.19:3300/0 conn(0x7f0a8009d6f0 0x7f0a8009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 -- 172.21.15.19:0/2119933708 >> v1:172.21.15.19:6789/0 conn(0x7f0a8009e410 legacy=0x7f0a80133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 -- 172.21.15.19:0/2119933708 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8009a500 con 0x7f0a8009e000 2023-10-03T10:19:14.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7dd9b700 1 --2- 172.21.15.19:0/2119933708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801339f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a74009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cdd77e02c5dee40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7d59a700 1 -- 172.21.15.19:0/2119933708 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011830 con 0x7f0a8009e000 2023-10-03T10:19:14.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.073+0000 7f0a7d59a700 1 -- 172.21.15.19:0/2119933708 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a74011990 con 0x7f0a8009e000 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a7d59a700 1 -- 172.21.15.19:0/2119933708 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011d20 con 0x7f0a8009e000 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 -- 172.21.15.19:0/2119933708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 msgr2=0x7f0a801339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/2119933708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801339f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009870 tx=0x7f0a74009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 -- 172.21.15.19:0/2119933708 shutdown_connections 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/2119933708 >> v2:172.21.15.19:3300/0 conn(0x7f0a8009d6f0 0x7f0a8009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/2119933708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801339f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 -- 172.21.15.19:0/2119933708 >> 172.21.15.19:0/2119933708 conn(0x7f0a80066f50 msgr2=0x7f0a8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 -- 172.21.15.19:0/2119933708 shutdown_connections 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.074+0000 7f0a84cf3700 1 -- 172.21.15.19:0/2119933708 wait complete. 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.075+0000 7f0a84cf3700 1 Processor -- start 2023-10-03T10:19:14.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 -- start start 2023-10-03T10:19:14.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 0x7f0a801a3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801a5250 con 0x7f0a8009e410 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801b8200 con 0x7f0a8009d6f0 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a84cf3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801a5b20 con 0x7f0a8009e000 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a7e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a7e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33340/0 (socket says 172.21.15.19:33340) 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a7e59c700 1 -- 172.21.15.19:0/531838530 learned_addr learned my addr 172.21.15.19:0/531838530 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a7ed9d700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 0x7f0a801a3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.076+0000 7f0a7dd9b700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 -- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 msgr2=0x7f0a801c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 -- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 msgr2=0x7f0a801a3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 0x7f0a801a3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 -- 172.21.15.19:0/531838530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a740094a0 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7ed9d700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 0x7f0a801a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a7e59c700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e9e0 tx=0x7f0a7000ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70009710 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7000ee80 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a801a7160 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.077+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000ca50 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.078+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0a7000cbb0 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.078+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a801a6e80 con 0x7f0a8009d6f0 2023-10-03T10:19:14.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.078+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0a70011e20 con 0x7f0a8009d6f0 2023-10-03T10:19:14.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.079+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a80074ea0 con 0x7f0a8009d6f0 2023-10-03T10:19:14.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.085+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0a70017070 con 0x7f0a8009d6f0 2023-10-03T10:19:14.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.104+0000 7f4c75ae4700 1 Processor -- start 2023-10-03T10:19:14.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.104+0000 7f4c75ae4700 1 -- start start 2023-10-03T10:19:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c75ae4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 0x7f4c7009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c75ae4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c7013bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c75ae4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7009f960 con 0x7f4c7009f160 2023-10-03T10:19:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c75ae4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7009ae60 con 0x7f4c70134300 2023-10-03T10:19:14.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c75ae4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7006cb10 con 0x7f4c7009e850 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c6effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4c7009f160 0x7f4c70133bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47162/0 (socket says 172.21.15.19:47162) 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.105+0000 7f4c6effd700 1 -- 172.21.15.19:0/1567913232 learned_addr learned my addr 172.21.15.19:0/1567913232 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6f7fe700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 0x7f4c7009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c7013bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6e7fc700 1 -- 172.21.15.19:0/1567913232 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895605427 0 0) 0x7f4c7009f960 con 0x7f4c7009f160 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6e7fc700 1 -- 172.21.15.19:0/1567913232 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c580035b0 con 0x7f4c7009f160 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 -- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 msgr2=0x7f4c7009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 0x7f4c7009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 -- 172.21.15.19:0/1567913232 >> v1:172.21.15.19:6789/0 conn(0x7f4c7009f160 legacy=0x7f4c70133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 -- 172.21.15.19:0/1567913232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7006b990 con 0x7f4c70134300 2023-10-03T10:19:14.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6f7fe700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 0x7f4c7009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6ffff700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c7013bec0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009dc0 tx=0x7f4c6800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9e474dd83dae294 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6e7fc700 1 -- 172.21.15.19:0/1567913232 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6800e070 con 0x7f4c70134300 2023-10-03T10:19:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6e7fc700 1 -- 172.21.15.19:0/1567913232 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6800bb20 con 0x7f4c70134300 2023-10-03T10:19:14.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.106+0000 7f4c6e7fc700 1 -- 172.21.15.19:0/1567913232 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c68012430 con 0x7f4c70134300 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 -- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 msgr2=0x7f4c7013bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c7013bec0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4c68009dc0 tx=0x7f4c6800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 -- 172.21.15.19:0/1567913232 shutdown_connections 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c7013bec0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/1567913232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009e850 0x7f4c7009ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 -- 172.21.15.19:0/1567913232 >> 172.21.15.19:0/1567913232 conn(0x7f4c700a3f70 msgr2=0x7f4c700a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 -- 172.21.15.19:0/1567913232 shutdown_connections 2023-10-03T10:19:14.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.107+0000 7f4c75ae4700 1 -- 172.21.15.19:0/1567913232 wait complete. 2023-10-03T10:19:14.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.109+0000 7f4c75ae4700 1 Processor -- start 2023-10-03T10:19:14.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.109+0000 7f4c75ae4700 1 -- start start 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009f160 0x7f4c70122e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c701233c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70124500 con 0x7f4c7009e850 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70133480 con 0x7f4c70134300 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c75ae4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70125e70 con 0x7f4c7009f160 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009f160 0x7f4c70122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55704/0 (socket says 172.21.15.19:55704) 2023-10-03T10:19:14.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 -- 172.21.15.19:0/2707421491 learned_addr learned my addr 172.21.15.19:0/2707421491 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6ffff700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c701233c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 -- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009f160 msgr2=0x7f4c70122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009f160 0x7f4c70122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 -- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 msgr2=0x7f4c701233c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c701233c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 -- 172.21.15.19:0/2707421491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600094a0 con 0x7f4c7009e850 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6ffff700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c701233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.110+0000 7f4c6f7fe700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ec10 tx=0x7f4c6000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.111+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000c850 con 0x7f4c7009e850 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.111+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6000c9b0 con 0x7f4c7009e850 2023-10-03T10:19:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.111+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c68009a70 con 0x7f4c7009e850 2023-10-03T10:19:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.111+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c6000cd40 con 0x7f4c7009e850 2023-10-03T10:19:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.111+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c700a1830 con 0x7f4c7009e850 2023-10-03T10:19:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.112+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4c60013470 con 0x7f4c7009e850 2023-10-03T10:19:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.112+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4c6003f7a0 con 0x7f4c7009e850 2023-10-03T10:19:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.112+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c700747f0 con 0x7f4c7009e850 2023-10-03T10:19:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.121+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4c60021080 con 0x7f4c7009e850 2023-10-03T10:19:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.234+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f032811e0e0 con 0x7f032809de50 2023-10-03T10:19:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.235+0000 7f031dffb700 1 -- 172.21.15.19:0/722885677 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f032401a430 con 0x7f032809de50 2023-10-03T10:19:14.236 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 msgr2=0x7f032812d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f03240090b0 tx=0x7f0324004750 comp rx=0 tx=0).stop 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 shutdown_connections 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03281338a0 0x7f032811ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f032809de50 0x7f032812d950 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 --2- 172.21.15.19:0/722885677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f032809e930 0x7f032811a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.237+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 >> 172.21.15.19:0/722885677 conn(0x7f03280a2aa0 msgr2=0x7f0328130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.238+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 shutdown_connections 2023-10-03T10:19:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.238+0000 7f032f574700 1 -- 172.21.15.19:0/722885677 wait complete. 2023-10-03T10:19:14.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.297+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0a8006c360 con 0x7f0a8009d6f0 2023-10-03T10:19:14.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.298+0000 7f0a6effd700 1 -- 172.21.15.19:0/531838530 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0a700102b0 con 0x7f0a8009d6f0 2023-10-03T10:19:14.299 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 msgr2=0x7f0a801c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000e9e0 tx=0x7f0a7000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 shutdown_connections 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0a8009e410 0x7f0a801a3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0a8009d6f0 0x7f0a801c82e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 --2- 172.21.15.19:0/531838530 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0a8009e000 0x7f0a801c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 >> 172.21.15.19:0/531838530 conn(0x7f0a80066f50 msgr2=0x7f0a801bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 shutdown_connections 2023-10-03T10:19:14.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.300+0000 7f0a84cf3700 1 -- 172.21.15.19:0/531838530 wait complete. 2023-10-03T10:19:14.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.333+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4c7006bbb0 con 0x7f4c7009e850 2023-10-03T10:19:14.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.333+0000 7f4c57fff700 1 -- 172.21.15.19:0/2707421491 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c60013720 con 0x7f4c7009e850 2023-10-03T10:19:14.333 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 msgr2=0x7f4c70122940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000ec10 tx=0x7f4c6000ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 shutdown_connections 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4c70134300 0x7f4c701233c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4c7009e850 0x7f4c70122940 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 --2- 172.21.15.19:0/2707421491 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4c7009f160 0x7f4c70122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 >> 172.21.15.19:0/2707421491 conn(0x7f4c700a3f70 msgr2=0x7f4c70070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 shutdown_connections 2023-10-03T10:19:14.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.335+0000 7f4c75ae4700 1 -- 172.21.15.19:0/2707421491 wait complete. 2023-10-03T10:19:14.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:14.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:14.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.822+0000 7f0c65a09700 1 Processor -- start 2023-10-03T10:19:14.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.822+0000 7f0c65a09700 1 -- start start 2023-10-03T10:19:14.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.822+0000 7f0c65a09700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.822+0000 7f0c65a09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.822+0000 7f0c65a09700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c600a2a70 con 0x7f0c60133930 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c65a09700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600a01d0 con 0x7f0c6009d630 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c65a09700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6009e2b0 con 0x7f0c600a0a30 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53230/0 (socket says 172.21.15.19:53230) 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5e7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33366/0 (socket says 172.21.15.19:33366) 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 -- 172.21.15.19:0/1990274136 learned_addr learned my addr 172.21.15.19:0/1990274136 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c60133930 0x7f0c60133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47170/0 (socket says 172.21.15.19:47170) 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5dffb700 1 -- 172.21.15.19:0/1990274136 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922181130 0 0) 0x7f0c600a2a70 con 0x7f0c60133930 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5dffb700 1 -- 172.21.15.19:0/1990274136 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c4c0035b0 con 0x7f0c60133930 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 -- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 msgr2=0x7f0c600a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:14.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 -- 172.21.15.19:0/1990274136 >> v1:172.21.15.19:6789/0 conn(0x7f0c60133930 legacy=0x7f0c60133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 -- 172.21.15.19:0/1990274136 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6009dc50 con 0x7f0c600a0a30 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5e7fc700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5effd700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009920 tx=0x7f0c50009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f7bdf613d1f41b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5dffb700 1 -- 172.21.15.19:0/1990274136 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011830 con 0x7f0c600a0a30 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.823+0000 7f0c5dffb700 1 -- 172.21.15.19:0/1990274136 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50011990 con 0x7f0c600a0a30 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c5dffb700 1 -- 172.21.15.19:0/1990274136 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50011d20 con 0x7f0c600a0a30 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 -- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 msgr2=0x7f0c600a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c50009920 tx=0x7f0c50009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 -- 172.21.15.19:0/1990274136 shutdown_connections 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c600a0a30 0x7f0c600a0e00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 --2- 172.21.15.19:0/1990274136 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c6009d630 0x7f0c600a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 -- 172.21.15.19:0/1990274136 >> 172.21.15.19:0/1990274136 conn(0x7f0c600a3050 msgr2=0x7f0c600a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 -- 172.21.15.19:0/1990274136 shutdown_connections 2023-10-03T10:19:14.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.824+0000 7f0c65a09700 1 -- 172.21.15.19:0/1990274136 wait complete. 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.825+0000 7f0c65a09700 1 Processor -- start 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.825+0000 7f0c65a09700 1 -- start start 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c6009d630 0x7f0c601211f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c60132510 0x7f0c60121c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60122d30 con 0x7f0c60133930 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600a0410 con 0x7f0c60132510 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c65a09700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c601246a0 con 0x7f0c6009d630 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c6009d630 0x7f0c601211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c60132510 0x7f0c60121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55706/0 (socket says 172.21.15.19:55706) 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 -- 172.21.15.19:0/499651070 learned_addr learned my addr 172.21.15.19:0/499651070 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 -- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c6009d630 msgr2=0x7f0c601211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c6009d630 0x7f0c601211f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 -- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c60132510 msgr2=0x7f0c60121c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c60132510 0x7f0c60121c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 -- 172.21.15.19:0/499651070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c480094a0 con 0x7f0c60133930 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.826+0000 7f0c5e7fc700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800ebb0 tx=0x7f0c4800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800c850 con 0x7f0c60133930 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4800c9b0 con 0x7f0c60133930 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c50009550 con 0x7f0c60133930 2023-10-03T10:19:14.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4800cd40 con 0x7f0c60133930 2023-10-03T10:19:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c60124cd0 con 0x7f0c60133930 2023-10-03T10:19:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.827+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c48013470 con 0x7f0c60133930 2023-10-03T10:19:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.828+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6011df60 con 0x7f0c60133930 2023-10-03T10:19:14.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.828+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c4803f860 con 0x7f0c60133930 2023-10-03T10:19:14.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:14.832+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c48017020 con 0x7f0c60133930 2023-10-03T10:19:15.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.037+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0c600747f0 con 0x7f0c60133930 2023-10-03T10:19:15.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.038+0000 7f0c57fff700 1 -- 172.21.15.19:0/499651070 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c480232f0 con 0x7f0c60133930 2023-10-03T10:19:15.038 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 msgr2=0x7f0c60121730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0c4800ebb0 tx=0x7f0c4800eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 shutdown_connections 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c60132510 0x7f0c60121c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c6009d630 0x7f0c601211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 --2- 172.21.15.19:0/499651070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c60133930 0x7f0c60121730 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 >> 172.21.15.19:0/499651070 conn(0x7f0c600a3050 msgr2=0x7f0c601331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 shutdown_connections 2023-10-03T10:19:15.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.040+0000 7f0c65a09700 1 -- 172.21.15.19:0/499651070 wait complete. 2023-10-03T10:19:15.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:15.253 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:15.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:15.350 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:15.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.405+0000 7f925481d700 1 Processor -- start 2023-10-03T10:19:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.405+0000 7f925481d700 1 -- start start 2023-10-03T10:19:15.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009d6f0 0x7f925009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 0x7f9250133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925006b460 con 0x7f925009e000 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925009b120 con 0x7f925009d6f0 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f925481d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f925009a7e0 con 0x7f925009e410 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55718/0 (socket says 172.21.15.19:55718) 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924dd9b700 1 -- 172.21.15.19:0/1432703267 learned_addr learned my addr 172.21.15.19:0/1432703267 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 0x7f9250133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924e59c700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009d6f0 0x7f925009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 -- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009d6f0 msgr2=0x7f925009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009d6f0 0x7f925009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 -- 172.21.15.19:0/1432703267 >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 msgr2=0x7f92501339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 --2- 172.21.15.19:0/1432703267 >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 -- 172.21.15.19:0/1432703267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925009a500 con 0x7f925009e410 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924dd9b700 1 --2- 172.21.15.19:0/1432703267 >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.406+0000 7f924ed9d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 0x7f9250133f30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9248009dc0 tx=0x7f924800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d686684ccaaabc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f924d59a700 1 -- 172.21.15.19:0/1432703267 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800e070 con 0x7f925009e410 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f924d59a700 1 -- 172.21.15.19:0/1432703267 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800bae0 con 0x7f925009e410 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f924d59a700 1 -- 172.21.15.19:0/1432703267 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800be90 con 0x7f925009e410 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 -- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 msgr2=0x7f9250133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 0x7f9250133f30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9248009dc0 tx=0x7f924800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:15.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 -- 172.21.15.19:0/1432703267 shutdown_connections 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009d6f0 0x7f925009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 --2- 172.21.15.19:0/1432703267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009e410 0x7f9250133f30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 --2- 172.21.15.19:0/1432703267 >> v2:172.21.15.19:3300/0 conn(0x7f925009e000 0x7f92501339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 -- 172.21.15.19:0/1432703267 >> 172.21.15.19:0/1432703267 conn(0x7f9250066f50 msgr2=0x7f925009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.407+0000 7f925481d700 1 -- 172.21.15.19:0/1432703267 shutdown_connections 2023-10-03T10:19:15.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.408+0000 7f925481d700 1 -- 172.21.15.19:0/1432703267 wait complete. 2023-10-03T10:19:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.409+0000 7f925481d700 1 Processor -- start 2023-10-03T10:19:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.409+0000 7f925481d700 1 -- start start 2023-10-03T10:19:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 0x7f92501c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925009e410 0x7f92501c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92501a8170 con 0x7f925009e410 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92501a6460 con 0x7f925009e000 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f925481d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92500a2000 con 0x7f925009d6f0 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f924e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f924e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53254/0 (socket says 172.21.15.19:53254) 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f924e59c700 1 -- 172.21.15.19:0/344029194 learned_addr learned my addr 172.21.15.19:0/344029194 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f924dd9b700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 0x7f92501c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.410+0000 7f924ed9d700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925009e410 0x7f92501c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 -- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 msgr2=0x7f92501c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 0x7f92501c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 -- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925009e410 msgr2=0x7f92501c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925009e410 0x7f92501c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 -- 172.21.15.19:0/344029194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009550 con 0x7f925009d6f0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924dd9b700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 0x7f92501c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f924e59c700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f924000e9b0 tx=0x7f924000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240009710 con 0x7f925009d6f0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000c850 con 0x7f925009d6f0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9248009a70 con 0x7f925009d6f0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000cbc0 con 0x7f925009d6f0 2023-10-03T10:19:15.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.411+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925009c760 con 0x7f925009d6f0 2023-10-03T10:19:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.412+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f924000cd20 con 0x7f925009d6f0 2023-10-03T10:19:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.412+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f924003fb60 con 0x7f925009d6f0 2023-10-03T10:19:15.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.413+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92501a8bc0 con 0x7f925009d6f0 2023-10-03T10:19:15.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.418+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9240017080 con 0x7f925009d6f0 2023-10-03T10:19:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.463+0000 7fce63028700 1 Processor -- start 2023-10-03T10:19:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.463+0000 7fce63028700 1 -- start start 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce63028700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 0x7fce5c12f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce63028700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 0x7fce5c12fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce63028700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5c09a510 con 0x7fce5c12cff0 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce63028700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce5c12c7d0 con 0x7fce5c12c2f0 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce63028700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c09c190 con 0x7fce5c12cc20 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce5bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 0x7fce5c12fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce615c5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce5c12cff0 0x7fce5c136cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47182/0 (socket says 172.21.15.19:47182) 2023-10-03T10:19:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce615c5700 1 -- 172.21.15.19:0/1723667158 learned_addr learned my addr 172.21.15.19:0/1723667158 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.464+0000 7fce60dc4700 1 --2- 172.21.15.19:0/1723667158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 0x7fce5c12f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce60dc4700 1 -- 172.21.15.19:0/1723667158 >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 msgr2=0x7fce5c12fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce60dc4700 1 --2- 172.21.15.19:0/1723667158 >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 0x7fce5c12fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce60dc4700 1 -- 172.21.15.19:0/1723667158 >> v1:172.21.15.19:6789/0 conn(0x7fce5c12cff0 legacy=0x7fce5c136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce5b7fe700 1 -- 172.21.15.19:0/1723667158 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969016574 0 0) 0x7fce5c09a510 con 0x7fce5c12cff0 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce60dc4700 1 -- 172.21.15.19:0/1723667158 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce5c09b540 con 0x7fce5c12cc20 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce5bfff700 1 --2- 172.21.15.19:0/1723667158 >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 0x7fce5c12fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce60dc4700 1 --2- 172.21.15.19:0/1723667158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 0x7fce5c12f930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009840 tx=0x7fce4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef04907aed447bdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce5b7fe700 1 -- 172.21.15.19:0/1723667158 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c011830 con 0x7fce5c12cc20 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce5b7fe700 1 -- 172.21.15.19:0/1723667158 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c011990 con 0x7fce5c12cc20 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.465+0000 7fce5b7fe700 1 -- 172.21.15.19:0/1723667158 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c011d20 con 0x7fce5c12cc20 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 -- 172.21.15.19:0/1723667158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 msgr2=0x7fce5c12f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 --2- 172.21.15.19:0/1723667158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 0x7fce5c12f930 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009840 tx=0x7fce4c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 -- 172.21.15.19:0/1723667158 shutdown_connections 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 --2- 172.21.15.19:0/1723667158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12cc20 0x7fce5c12f930 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 --2- 172.21.15.19:0/1723667158 >> v2:172.21.15.19:3300/0 conn(0x7fce5c12c2f0 0x7fce5c12fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 -- 172.21.15.19:0/1723667158 >> 172.21.15.19:0/1723667158 conn(0x7fce5c09f470 msgr2=0x7fce5c0a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 -- 172.21.15.19:0/1723667158 shutdown_connections 2023-10-03T10:19:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.466+0000 7fce63028700 1 -- 172.21.15.19:0/1723667158 wait complete. 2023-10-03T10:19:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.467+0000 7fce63028700 1 Processor -- start 2023-10-03T10:19:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.467+0000 7fce63028700 1 -- start start 2023-10-03T10:19:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 0x7fce5c1c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 0x7fce5c1c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0724b0 con 0x7fce5c12cc20 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c1283c0 con 0x7fce5c12c2f0 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce63028700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c08baa0 con 0x7fce5c12cff0 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55758/0 (socket says 172.21.15.19:55758) 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 -- 172.21.15.19:0/3745115523 learned_addr learned my addr 172.21.15.19:0/3745115523 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce615c5700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 0x7fce5c1c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce60dc4700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 0x7fce5c1c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 -- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 msgr2=0x7fce5c1c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 0x7fce5c1c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 -- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 msgr2=0x7fce5c1c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 0x7fce5c1c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 -- 172.21.15.19:0/3745115523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440094a0 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce60dc4700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 0x7fce5c1c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce615c5700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 0x7fce5c1c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.468+0000 7fce5bfff700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fce4400ebb0 tx=0x7fce4400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.469+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4400c850 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.469+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4400c9b0 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.469+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4400cd40 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.469+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c0094a0 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.469+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c129f10 con 0x7fce5c12cc20 2023-10-03T10:19:15.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.470+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce44013470 con 0x7fce5c12cc20 2023-10-03T10:19:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.470+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce4403fbe0 con 0x7fce5c12cc20 2023-10-03T10:19:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.470+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c08bc60 con 0x7fce5c12cc20 2023-10-03T10:19:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.475+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce4401b3b0 con 0x7fce5c12cc20 2023-10-03T10:19:15.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.503+0000 7f782490c700 1 Processor -- start 2023-10-03T10:19:15.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.503+0000 7f782490c700 1 -- start start 2023-10-03T10:19:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f782490c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78200a0a30 0x7f78200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f782490c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f78200a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f782490c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78200a2a70 con 0x7f7820133930 2023-10-03T10:19:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f782490c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78200a01d0 con 0x7f78200a0a30 2023-10-03T10:19:15.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f782490c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782009e2b0 con 0x7f782009d630 2023-10-03T10:19:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f781e59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f78200a0a30 0x7f78200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f781ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7820133930 0x7f7820133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47184/0 (socket says 172.21.15.19:47184) 2023-10-03T10:19:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f781ed9d700 1 -- 172.21.15.19:0/3836427293 learned_addr learned my addr 172.21.15.19:0/3836427293 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:15.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.504+0000 7f781dd9b700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f78200a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781e59c700 1 -- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 msgr2=0x7f78200a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781e59c700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f78200a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781e59c700 1 -- 172.21.15.19:0/3836427293 >> v1:172.21.15.19:6789/0 conn(0x7f7820133930 legacy=0x7f7820133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781e59c700 1 -- 172.21.15.19:0/3836427293 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782009dc50 con 0x7f78200a0a30 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781e59c700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f78200a0e00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7810009d90 tx=0x7f781000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5206c80f2e56dc12 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781d59a700 1 -- 172.21.15.19:0/3836427293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781000e070 con 0x7f78200a0a30 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781d59a700 1 -- 172.21.15.19:0/3836427293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781000bb20 con 0x7f78200a0a30 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.505+0000 7f781d59a700 1 -- 172.21.15.19:0/3836427293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810012430 con 0x7f78200a0a30 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 -- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 msgr2=0x7f78200a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f78200a0e00 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7810009d90 tx=0x7f781000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 -- 172.21.15.19:0/3836427293 shutdown_connections 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f78200a0e00 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 --2- 172.21.15.19:0/3836427293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f78200a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 -- 172.21.15.19:0/3836427293 >> 172.21.15.19:0/3836427293 conn(0x7f78200a3050 msgr2=0x7f78200a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 -- 172.21.15.19:0/3836427293 shutdown_connections 2023-10-03T10:19:15.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.506+0000 7f782490c700 1 -- 172.21.15.19:0/3836427293 wait complete. 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.507+0000 7f782490c700 1 Processor -- start 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.507+0000 7f782490c700 1 -- start start 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f782011f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7820133930 0x7f78201c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820120560 con 0x7f78200a0a30 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78201332e0 con 0x7f7820133930 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f782490c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78200a4030 con 0x7f782009d630 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781dd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f782011f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:53296/0 (socket says 172.21.15.19:53296) 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 -- 172.21.15.19:0/3731940638 learned_addr learned my addr 172.21.15.19:0/3731940638 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781ed9d700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7820133930 0x7f78201c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 -- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7820133930 msgr2=0x7f78201c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7820133930 0x7f78201c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 -- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 msgr2=0x7f782011f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f782011f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 -- 172.21.15.19:0/3731940638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810009a70 con 0x7f782009d630 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781dd9b700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f782011f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.508+0000 7f781e59c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f78200a2c00 tx=0x7f7810004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.509+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810012430 con 0x7f782009d630 2023-10-03T10:19:15.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.509+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810020070 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.509+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810004280 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.509+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78200a0410 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.509+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78201211d0 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.510+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78100043e0 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.510+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7810022070 con 0x7f782009d630 2023-10-03T10:19:15.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.510+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78200747f0 con 0x7f782009d630 2023-10-03T10:19:15.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.515+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f781002c080 con 0x7f782009d630 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.633+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9250074ea0 con 0x7f925009d6f0 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.633+0000 7f923effd700 1 -- 172.21.15.19:0/344029194 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9240021020 con 0x7f925009d6f0 2023-10-03T10:19:15.633 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 msgr2=0x7f92501c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f924000e9b0 tx=0x7f924000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 shutdown_connections 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f925009e410 0x7f92501c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f925009d6f0 0x7f92501c80b0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 --2- 172.21.15.19:0/344029194 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f925009e000 0x7f92501c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 >> 172.21.15.19:0/344029194 conn(0x7f9250066f50 msgr2=0x7f925006f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 shutdown_connections 2023-10-03T10:19:15.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.636+0000 7f925481d700 1 -- 172.21.15.19:0/344029194 wait complete. 2023-10-03T10:19:15.650 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:15.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.686+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fce5c129c60 con 0x7fce5c12cc20 2023-10-03T10:19:15.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.686+0000 7fce597fa700 1 -- 172.21.15.19:0/3745115523 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fce44017020 con 0x7fce5c12cc20 2023-10-03T10:19:15.686 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 msgr2=0x7fce5c1c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fce4400ebb0 tx=0x7fce4400eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 shutdown_connections 2023-10-03T10:19:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce5c12cff0 0x7fce5c1c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce5c12c2f0 0x7fce5c1c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 --2- 172.21.15.19:0/3745115523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce5c12cc20 0x7fce5c1c8600 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 >> 172.21.15.19:0/3745115523 conn(0x7fce5c09f470 msgr2=0x7fce5c0a0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 shutdown_connections 2023-10-03T10:19:15.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.689+0000 7fce63028700 1 -- 172.21.15.19:0/3745115523 wait complete. 2023-10-03T10:19:15.702 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:15.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.724+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7820121fe0 con 0x7f782009d630 2023-10-03T10:19:15.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.725+0000 7f7816ffd700 1 -- 172.21.15.19:0/3731940638 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f781001c400 con 0x7f782009d630 2023-10-03T10:19:15.725 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 msgr2=0x7f782011f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f78200a2c00 tx=0x7f7810004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 shutdown_connections 2023-10-03T10:19:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7820133930 0x7f78201c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009d630 0x7f782011f290 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 --2- 172.21.15.19:0/3731940638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f78200a0a30 0x7f782011f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 >> 172.21.15.19:0/3731940638 conn(0x7f78200a3050 msgr2=0x7f78201bbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 shutdown_connections 2023-10-03T10:19:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:15.727+0000 7f782490c700 1 -- 172.21.15.19:0/3731940638 wait complete. 2023-10-03T10:19:15.740 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:16.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.200+0000 7f0128c83700 1 Processor -- start 2023-10-03T10:19:16.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.200+0000 7f0128c83700 1 -- start start 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.200+0000 7f0128c83700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0128c83700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0128c83700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012406bc00 con 0x7f0124130870 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0128c83700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012406c570 con 0x7f0124133a80 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0128c83700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01240a0040 con 0x7f012412ff20 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f012259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0122d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0124130870 0x7f012413a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:47196/0 (socket says 172.21.15.19:47196) 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0122d9d700 1 -- 172.21.15.19:0/4001016158 learned_addr learned my addr 172.21.15.19:0/4001016158 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f012259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55770/0 (socket says 172.21.15.19:55770) 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33438/0 (socket says 172.21.15.19:33438) 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 -- 172.21.15.19:0/4001016158 >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 msgr2=0x7f0124133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 --2- 172.21.15.19:0/4001016158 >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 -- 172.21.15.19:0/4001016158 >> v1:172.21.15.19:6789/0 conn(0x7f0124130870 legacy=0x7f012413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 -- 172.21.15.19:0/4001016158 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124133860 con 0x7f012412ff20 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f012259c700 1 --2- 172.21.15.19:0/4001016158 >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f011bfff700 1 --2- 172.21.15.19:0/4001016158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f010c009840 tx=0x7f010c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e9af136225012b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0121d9b700 1 -- 172.21.15.19:0/4001016158 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011830 con 0x7f012412ff20 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.201+0000 7f0121d9b700 1 -- 172.21.15.19:0/4001016158 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c011990 con 0x7f012412ff20 2023-10-03T10:19:16.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0121d9b700 1 -- 172.21.15.19:0/4001016158 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c011d20 con 0x7f012412ff20 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 -- 172.21.15.19:0/4001016158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 msgr2=0x7f0124130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 --2- 172.21.15.19:0/4001016158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f010c009840 tx=0x7f010c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 -- 172.21.15.19:0/4001016158 shutdown_connections 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 --2- 172.21.15.19:0/4001016158 >> v2:172.21.15.19:3300/0 conn(0x7f0124133a80 0x7f0124133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 --2- 172.21.15.19:0/4001016158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012412ff20 0x7f0124130330 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 -- 172.21.15.19:0/4001016158 >> 172.21.15.19:0/4001016158 conn(0x7f01240a4210 msgr2=0x7f01240a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 -- 172.21.15.19:0/4001016158 shutdown_connections 2023-10-03T10:19:16.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.202+0000 7f0128c83700 1 -- 172.21.15.19:0/4001016158 wait complete. 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.203+0000 7f0128c83700 1 Processor -- start 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.203+0000 7f0128c83700 1 -- start start 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 0x7f012409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012409e4a0 con 0x7f012412ff20 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0124120060 con 0x7f0124130870 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0128c83700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f012412db00 con 0x7f0124133a80 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f012259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:33444/0 (socket says 172.21.15.19:33444) 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f012259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55776/0 (socket says 172.21.15.19:55776) 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 -- 172.21.15.19:0/3997466576 learned_addr learned my addr 172.21.15.19:0/3997466576 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0122d9d700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 0x7f012409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 -- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 msgr2=0x7f012409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 0x7f012409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 -- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 msgr2=0x7f012409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f011bfff700 1 -- 172.21.15.19:0/3997466576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01140094a0 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f012259c700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.204+0000 7f0122d9d700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 0x7f012409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f011bfff700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f010c009fd0 tx=0x7f010c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c0036a0 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c01f070 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c0094a0 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010c003a60 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0124120340 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.205+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f010c003bc0 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.206+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f010c021070 con 0x7f0124130870 2023-10-03T10:19:16.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.206+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0124074ea0 con 0x7f0124130870 2023-10-03T10:19:16.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.211+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f010c015020 con 0x7f0124130870 2023-10-03T10:19:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.417+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f012406b250 con 0x7f0124130870 2023-10-03T10:19:16.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.417+0000 7f011affd700 1 -- 172.21.15.19:0/3997466576 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f010c01a430 con 0x7f0124130870 2023-10-03T10:19:16.417 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 msgr2=0x7f012409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f010c009fd0 tx=0x7f010c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 shutdown_connections 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0124133a80 0x7f012409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012412ff20 0x7f012409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 --2- 172.21.15.19:0/3997466576 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0124130870 0x7f012409c9c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 >> 172.21.15.19:0/3997466576 conn(0x7f01240a4210 msgr2=0x7f012409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 shutdown_connections 2023-10-03T10:19:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.420+0000 7f0128c83700 1 -- 172.21.15.19:0/3997466576 wait complete. 2023-10-03T10:19:16.433 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:16.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:16.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:16.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:16.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.801+0000 7fca3fa4b700 1 Processor -- start 2023-10-03T10:19:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.801+0000 7fca3fa4b700 1 -- start start 2023-10-03T10:19:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3fa4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca38136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3fa4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca381393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3fa4b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca38070940 con 0x7fca3809e930 2023-10-03T10:19:16.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3fa4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3806fd60 con 0x7fca3809f410 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3fa4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca3806fa80 con 0x7fca38136fe0 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3d7e7700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fca3809e930 0x7fca3809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43656/0 (socket says 172.21.15.19:43656) 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3d7e7700 1 -- 172.21.15.19:0/1235899223 learned_addr learned my addr 172.21.15.19:0/1235899223 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3cfe6700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca38136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3dfe8700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca381393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3dfe8700 1 -- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 msgr2=0x7fca38136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3dfe8700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca38136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca2ffff700 1 -- 172.21.15.19:0/1235899223 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027486479 0 0) 0x7fca38070940 con 0x7fca3809e930 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3dfe8700 1 -- 172.21.15.19:0/1235899223 >> v1:172.21.15.19:6789/0 conn(0x7fca3809e930 legacy=0x7fca3809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3dfe8700 1 -- 172.21.15.19:0/1235899223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3809fb60 con 0x7fca38136fe0 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.802+0000 7fca3cfe6700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca38136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca3dfe8700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca381393c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fca30009dc0 tx=0x7fca3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc064ec23423ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca2ffff700 1 -- 172.21.15.19:0/1235899223 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000e070 con 0x7fca38136fe0 2023-10-03T10:19:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca2ffff700 1 -- 172.21.15.19:0/1235899223 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000bb20 con 0x7fca38136fe0 2023-10-03T10:19:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca2ffff700 1 -- 172.21.15.19:0/1235899223 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca30012430 con 0x7fca38136fe0 2023-10-03T10:19:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca3fa4b700 1 -- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 msgr2=0x7fca381393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.803+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca381393c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fca30009dc0 tx=0x7fca3000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:16.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 -- 172.21.15.19:0/1235899223 shutdown_connections 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca381393c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/1235899223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca38136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 -- 172.21.15.19:0/1235899223 >> 172.21.15.19:0/1235899223 conn(0x7fca380a4210 msgr2=0x7fca380a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 -- 172.21.15.19:0/1235899223 shutdown_connections 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.804+0000 7fca3fa4b700 1 -- 172.21.15.19:0/1235899223 wait complete. 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 Processor -- start 2023-10-03T10:19:16.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 -- start start 2023-10-03T10:19:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 0x7fca3811e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca3811eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38120200 con 0x7fca3809e930 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca38121980 con 0x7fca3809f410 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3fa4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca38120600 con 0x7fca38136fe0 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3cfe6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3cfe6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55588/0 (socket says 172.21.15.19:55588) 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3cfe6700 1 -- 172.21.15.19:0/2184058970 learned_addr learned my addr 172.21.15.19:0/2184058970 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3d7e7700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 0x7fca3811e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.805+0000 7fca3dfe8700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca3811eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 -- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 msgr2=0x7fca3811eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca3811eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 -- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 msgr2=0x7fca3811e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 0x7fca3811e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 -- 172.21.15.19:0/2184058970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280094a0 con 0x7fca3809f410 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3d7e7700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 0x7fca3811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3dfe8700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca3811eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3cfe6700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca2800ebe0 tx=0x7fca2800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800c850 con 0x7fca3809f410 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800c9b0 con 0x7fca3809f410 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.806+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca30009a70 con 0x7fca3809f410 2023-10-03T10:19:16.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.807+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca381226b0 con 0x7fca3809f410 2023-10-03T10:19:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.808+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800cd40 con 0x7fca3809f410 2023-10-03T10:19:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.808+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca28013470 con 0x7fca3809f410 2023-10-03T10:19:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.808+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca2803f960 con 0x7fca3809f410 2023-10-03T10:19:16.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.809+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca38121ac0 con 0x7fca3809f410 2023-10-03T10:19:16.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.818+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca280232f0 con 0x7fca3809f410 2023-10-03T10:19:16.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.850+0000 7fbe0a334700 1 Processor -- start 2023-10-03T10:19:16.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.850+0000 7fbe0a334700 1 -- start start 2023-10-03T10:19:16.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe0a334700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe040a0a30 0x7fbe040a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe0a334700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe0413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe0a334700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe040a2a70 con 0x7fbe0409d630 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe0a334700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe040a01d0 con 0x7fbe04138d80 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe0a334700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0409e2b0 con 0x7fbe040a0a30 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe088d1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe0413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe037fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbe0409d630 0x7fbe040a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43664/0 (socket says 172.21.15.19:43664) 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe037fe700 1 -- 172.21.15.19:0/689508476 learned_addr learned my addr 172.21.15.19:0/689508476 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:16.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe03fff700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe040a0a30 0x7fbe040a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe02ffd700 1 -- 172.21.15.19:0/689508476 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510962424 0 0) 0x7fbe040a2a70 con 0x7fbe0409d630 2023-10-03T10:19:16.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe088d1700 1 -- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe040a0a30 msgr2=0x7fbe040a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe088d1700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe040a0a30 0x7fbe040a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe088d1700 1 -- 172.21.15.19:0/689508476 >> v1:172.21.15.19:6789/0 conn(0x7fbe0409d630 legacy=0x7fbe040a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.851+0000 7fbe088d1700 1 -- 172.21.15.19:0/689508476 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0409dc50 con 0x7fbe04138d80 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe088d1700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe0413b160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009dc0 tx=0x7fbdfc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fbfd5f2f7f0ec1d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe02ffd700 1 -- 172.21.15.19:0/689508476 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc00e070 con 0x7fbe04138d80 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe02ffd700 1 -- 172.21.15.19:0/689508476 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00bb20 con 0x7fbe04138d80 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe02ffd700 1 -- 172.21.15.19:0/689508476 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc012430 con 0x7fbe04138d80 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 -- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 msgr2=0x7fbe0413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe0413b160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009dc0 tx=0x7fbdfc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 -- 172.21.15.19:0/689508476 shutdown_connections 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe0413b160 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 --2- 172.21.15.19:0/689508476 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe040a0a30 0x7fbe040a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.852+0000 7fbe0a334700 1 -- 172.21.15.19:0/689508476 >> 172.21.15.19:0/689508476 conn(0x7fbe040a3050 msgr2=0x7fbe040a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.853+0000 7fbe0a334700 1 -- 172.21.15.19:0/689508476 shutdown_connections 2023-10-03T10:19:16.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.853+0000 7fbe0a334700 1 -- 172.21.15.19:0/689508476 wait complete. 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 Processor -- start 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 -- start start 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe04134140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04136e70 con 0x7fbe040a0a30 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04135aa0 con 0x7fbe04138d80 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe0a334700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04137150 con 0x7fbe0409d630 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe037fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe03fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.854+0000 7fbe037fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33828/0 (socket says 172.21.15.19:33828) 2023-10-03T10:19:16.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59510/0 (socket says 172.21.15.19:59510) 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe037fe700 1 -- 172.21.15.19:0/432555445 learned_addr learned my addr 172.21.15.19:0/432555445 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe088d1700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe04134140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 -- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 msgr2=0x7fbe04134140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe04134140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 -- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 msgr2=0x7fbe04133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 -- 172.21.15.19:0/432555445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc009a70 con 0x7fbe0409d630 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe088d1700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe04134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe037fe700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:16.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe03fff700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e900 tx=0x7fbdf400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4013680 con 0x7fbe0409d630 2023-10-03T10:19:16.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf40137e0 con 0x7fbe0409d630 2023-10-03T10:19:16.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe040a0410 con 0x7fbe0409d630 2023-10-03T10:19:16.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.855+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4013b50 con 0x7fbe0409d630 2023-10-03T10:19:16.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.856+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04136490 con 0x7fbe0409d630 2023-10-03T10:19:16.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.857+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe040747f0 con 0x7fbe0409d630 2023-10-03T10:19:16.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.857+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdf4013cb0 con 0x7fbe0409d630 2023-10-03T10:19:16.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.857+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbdf403f650 con 0x7fbe0409d630 2023-10-03T10:19:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.866+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdf401bc10 con 0x7fbe0409d630 2023-10-03T10:19:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.899+0000 7f7825996700 1 Processor -- start 2023-10-03T10:19:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.899+0000 7f7825996700 1 -- start start 2023-10-03T10:19:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f7825996700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7820133870 0x7f7820133c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f7825996700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009e560 0x7f782013b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f7825996700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78201334b0 con 0x7f7820134180 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f7825996700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782009fa40 con 0x7f7820133870 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f7825996700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782006f250 con 0x7f782009e560 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7820133870 0x7f7820133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009e560 0x7f782013b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f78167fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7820134180 0x7f782009de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43666/0 (socket says 172.21.15.19:43666) 2023-10-03T10:19:16.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f78167fc700 1 -- 172.21.15.19:0/110325212 learned_addr learned my addr 172.21.15.19:0/110325212 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 -- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009e560 msgr2=0x7f782013b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 --2- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009e560 0x7f782013b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 -- 172.21.15.19:0/110325212 >> v1:172.21.15.19:6789/0 conn(0x7f7820134180 legacy=0x7f782009de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 -- 172.21.15.19:0/110325212 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782006fb20 con 0x7f7820133870 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781e7fc700 1 -- 172.21.15.19:0/110325212 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973310709 0 0) 0x7f78201334b0 con 0x7f7820134180 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.900+0000 7f781effd700 1 --2- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820133870 0x7f7820133c40 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f7810009840 tx=0x7f7810009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7099617b097286a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f781e7fc700 1 -- 172.21.15.19:0/110325212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011830 con 0x7f7820133870 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f781e7fc700 1 -- 172.21.15.19:0/110325212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810011990 con 0x7f7820133870 2023-10-03T10:19:16.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f781e7fc700 1 -- 172.21.15.19:0/110325212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011d20 con 0x7f7820133870 2023-10-03T10:19:16.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 -- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820133870 msgr2=0x7f7820133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 --2- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820133870 0x7f7820133c40 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f7810009840 tx=0x7f7810009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:16.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 -- 172.21.15.19:0/110325212 shutdown_connections 2023-10-03T10:19:16.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 --2- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f782009e560 0x7f782013b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 --2- 172.21.15.19:0/110325212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820133870 0x7f7820133c40 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 -- 172.21.15.19:0/110325212 >> 172.21.15.19:0/110325212 conn(0x7f78200a2610 msgr2=0x7f78200a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 -- 172.21.15.19:0/110325212 shutdown_connections 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.901+0000 7f7825996700 1 -- 172.21.15.19:0/110325212 wait complete. 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.902+0000 7f7825996700 1 Processor -- start 2023-10-03T10:19:16.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 -- start start 2023-10-03T10:19:16.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f782009e560 0x7f78201c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 0x7f78201c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782011c8e0 con 0x7f7820134180 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78201c58a0 con 0x7f782009e560 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f7825996700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782011c250 con 0x7f7820133870 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f78167fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f78167fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59526/0 (socket says 172.21.15.19:59526) 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f78167fc700 1 -- 172.21.15.19:0/3872862480 learned_addr learned my addr 172.21.15.19:0/3872862480 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.903+0000 7f781effd700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f782009e560 0x7f78201c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f781f7fe700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 0x7f78201c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 -- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f782009e560 msgr2=0x7f78201c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f782009e560 0x7f78201c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 -- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 msgr2=0x7f78201c7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 0x7f78201c7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 -- 172.21.15.19:0/3872862480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100094a0 con 0x7f7820133870 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f781f7fe700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 0x7f78201c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f78167fc700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f780800c520 tx=0x7f780800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004c80 con 0x7f7820133870 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808004de0 con 0x7f7820133870 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782011bbe0 con 0x7f7820133870 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808007310 con 0x7f7820133870 2023-10-03T10:19:16.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.904+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782011ce80 con 0x7f7820133870 2023-10-03T10:19:16.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.905+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78200747f0 con 0x7f7820133870 2023-10-03T10:19:16.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.905+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7808007470 con 0x7f7820133870 2023-10-03T10:19:16.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.906+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7808013df0 con 0x7f7820133870 2023-10-03T10:19:16.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:16.915+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7808044060 con 0x7f7820133870 2023-10-03T10:19:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.027+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca38074ea0 con 0x7fca3809f410 2023-10-03T10:19:17.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.027+0000 7fca2dffb700 1 -- 172.21.15.19:0/2184058970 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca28017030 con 0x7fca3809f410 2023-10-03T10:19:17.027 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 msgr2=0x7fca3811e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca2800ebe0 tx=0x7fca2800eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 shutdown_connections 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca38136fe0 0x7fca3811eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca3809e930 0x7fca3811e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 --2- 172.21.15.19:0/2184058970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca3809f410 0x7fca3811e9b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 >> 172.21.15.19:0/2184058970 conn(0x7fca380a4210 msgr2=0x7fca380a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 shutdown_connections 2023-10-03T10:19:17.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.030+0000 7fca3fa4b700 1 -- 172.21.15.19:0/2184058970 wait complete. 2023-10-03T10:19:17.044 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:17.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.081+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbe04072980 con 0x7fbe0409d630 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.081+0000 7fbe00ff9700 1 -- 172.21.15.19:0/432555445 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdf4021020 con 0x7fbe0409d630 2023-10-03T10:19:17.081 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 msgr2=0x7fbe041336c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400e900 tx=0x7fbdf400ec10 comp rx=0 tx=0).stop 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 shutdown_connections 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe04138d80 0x7fbe04134140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe0409d630 0x7fbe041336c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 --2- 172.21.15.19:0/432555445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe040a0a30 0x7fbe04133c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 >> 172.21.15.19:0/432555445 conn(0x7fbe040a3050 msgr2=0x7fbe0409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 shutdown_connections 2023-10-03T10:19:17.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.084+0000 7fbe0a334700 1 -- 172.21.15.19:0/432555445 wait complete. 2023-10-03T10:19:17.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:17.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.124+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f782006ba90 con 0x7f7820133870 2023-10-03T10:19:17.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.124+0000 7f781cff9700 1 -- 172.21.15.19:0/3872862480 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7808044030 con 0x7f7820133870 2023-10-03T10:19:17.124 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:17.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 msgr2=0x7f78201c5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f780800c520 tx=0x7f780800c830 comp rx=0 tx=0).stop 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 shutdown_connections 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820134180 0x7f78201c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f782009e560 0x7f78201c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 --2- 172.21.15.19:0/3872862480 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7820133870 0x7f78201c5360 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 >> 172.21.15.19:0/3872862480 conn(0x7f78200a2610 msgr2=0x7f782012f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.126+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 shutdown_connections 2023-10-03T10:19:17.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.127+0000 7f7825996700 1 -- 172.21.15.19:0/3872862480 wait complete. 2023-10-03T10:19:17.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:17.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:17.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.581+0000 7f725d273700 1 Processor -- start 2023-10-03T10:19:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 -- start start 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 0x7f72580a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580a2a70 con 0x7f7258133930 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580a01d0 con 0x7f72580a0a30 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f725d273700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f725809e2b0 con 0x7f725809d630 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f72567fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 0x7f72580a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f72577fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f72577fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33854/0 (socket says 172.21.15.19:33854) 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f72567fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 0x7f72580a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59540/0 (socket says 172.21.15.19:59540) 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55612/0 (socket says 172.21.15.19:55612) 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.582+0000 7f72577fe700 1 -- 172.21.15.19:0/2390060907 learned_addr learned my addr 172.21.15.19:0/2390060907 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 -- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 msgr2=0x7f72580a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 0x7f72580a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 -- 172.21.15.19:0/2390060907 >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 msgr2=0x7f7258133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2390060907 >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 -- 172.21.15.19:0/2390060907 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725809dc50 con 0x7f72580a0a30 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f72577fe700 1 --2- 172.21.15.19:0/2390060907 >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7248009840 tx=0x7f7248009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30494d9ef7e981ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7255ffb700 1 -- 172.21.15.19:0/2390060907 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248011830 con 0x7f72580a0a30 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7255ffb700 1 -- 172.21.15.19:0/2390060907 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7248011990 con 0x7f72580a0a30 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f7255ffb700 1 -- 172.21.15.19:0/2390060907 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248011d20 con 0x7f72580a0a30 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f725d273700 1 -- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 msgr2=0x7f72580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.583+0000 7f725d273700 1 --2- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7248009840 tx=0x7f7248009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 -- 172.21.15.19:0/2390060907 shutdown_connections 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 --2- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f72580a0e00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 --2- 172.21.15.19:0/2390060907 >> v2:172.21.15.19:3300/0 conn(0x7f7258133930 0x7f7258133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 --2- 172.21.15.19:0/2390060907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f725809d630 0x7f72580a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 -- 172.21.15.19:0/2390060907 >> 172.21.15.19:0/2390060907 conn(0x7f72580a3050 msgr2=0x7f72580a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 -- 172.21.15.19:0/2390060907 shutdown_connections 2023-10-03T10:19:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.584+0000 7f725d273700 1 -- 172.21.15.19:0/2390060907 wait complete. 2023-10-03T10:19:17.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 Processor -- start 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 -- start start 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f725811f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72581204f0 con 0x7f725809d630 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725811fde0 con 0x7f72580a0a30 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f725d273700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7258133270 con 0x7f7258133930 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f72577fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f72567fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f725811f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f7256ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33866/0 (socket says 172.21.15.19:33866) 2023-10-03T10:19:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f72577fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59542/0 (socket says 172.21.15.19:59542) 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.585+0000 7f7256ffd700 1 -- 172.21.15.19:0/2455508241 learned_addr learned my addr 172.21.15.19:0/2455508241 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 -- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 msgr2=0x7f72581c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 -- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 msgr2=0x7f725811f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f725811f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 -- 172.21.15.19:0/2455508241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009b30 con 0x7f725809d630 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f72577fe700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f72567fc700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f725811f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f7256ffd700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f7248004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248004240 con 0x7f725809d630 2023-10-03T10:19:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724801f070 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480036a0 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480094a0 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.586+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7258122120 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.587+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7248021030 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.587+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7248040530 con 0x7f725809d630 2023-10-03T10:19:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.587+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580747f0 con 0x7f725809d630 2023-10-03T10:19:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.592+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72480199a0 con 0x7f725809d630 2023-10-03T10:19:17.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.798+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7258121ef0 con 0x7f725809d630 2023-10-03T10:19:17.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.799+0000 7f724f7fe700 1 -- 172.21.15.19:0/2455508241 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7248015020 con 0x7f725809d630 2023-10-03T10:19:17.799 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:17.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 msgr2=0x7f725811f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:17.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f7248004750 comp rx=0 tx=0).stop 2023-10-03T10:19:17.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 shutdown_connections 2023-10-03T10:19:17.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7258133930 0x7f72581c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f725809d630 0x7f725811f360 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 --2- 172.21.15.19:0/2455508241 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72580a0a30 0x7f725811f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:17.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 >> 172.21.15.19:0/2455508241 conn(0x7f72580a3050 msgr2=0x7f725809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:17.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 shutdown_connections 2023-10-03T10:19:17.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:17.801+0000 7f725d273700 1 -- 172.21.15.19:0/2455508241 wait complete. 2023-10-03T10:19:17.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:18.044 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:18.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:18.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:18.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.198+0000 7f477f796700 1 Processor -- start 2023-10-03T10:19:18.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 -- start start 2023-10-03T10:19:18.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 0x7f4778138210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4778130260 con 0x7f4778130670 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477809a350 con 0x7f4778135e30 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.199+0000 7f477f796700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4778071ff0 con 0x7f4778133510 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59554/0 (socket says 172.21.15.19:59554) 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477d532700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4778130670 0x7f4778130a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43668/0 (socket says 172.21.15.19:43668) 2023-10-03T10:19:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 -- 172.21.15.19:0/2422751729 learned_addr learned my addr 172.21.15.19:0/2422751729 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477dd33700 1 --2- 172.21.15.19:0/2422751729 >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 0x7f4778138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f476ffff700 1 -- 172.21.15.19:0/2422751729 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409903363 0 0) 0x7f4778130260 con 0x7f4778130670 2023-10-03T10:19:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f476ffff700 1 -- 172.21.15.19:0/2422751729 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47640035b0 con 0x7f4778130670 2023-10-03T10:19:18.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 -- 172.21.15.19:0/2422751729 >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 msgr2=0x7f4778138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 --2- 172.21.15.19:0/2422751729 >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 0x7f4778138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 -- 172.21.15.19:0/2422751729 >> v1:172.21.15.19:6789/0 conn(0x7f4778130670 legacy=0x7f4778130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 -- 172.21.15.19:0/2422751729 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477809ecf0 con 0x7f4778133510 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477dd33700 1 --2- 172.21.15.19:0/2422751729 >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 0x7f4778138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f477cd31700 1 --2- 172.21.15.19:0/2422751729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4768009920 tx=0x7f4768009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f59ea2e1ad388969 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.200+0000 7f476ffff700 1 -- 172.21.15.19:0/2422751729 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768011830 con 0x7f4778133510 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f476ffff700 1 -- 172.21.15.19:0/2422751729 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4768011990 con 0x7f4778133510 2023-10-03T10:19:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f476ffff700 1 -- 172.21.15.19:0/2422751729 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4768011d00 con 0x7f4778133510 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 -- 172.21.15.19:0/2422751729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 msgr2=0x7f47781358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 --2- 172.21.15.19:0/2422751729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4768009920 tx=0x7f4768009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 -- 172.21.15.19:0/2422751729 shutdown_connections 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 --2- 172.21.15.19:0/2422751729 >> v2:172.21.15.19:3300/0 conn(0x7f4778135e30 0x7f4778138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 --2- 172.21.15.19:0/2422751729 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778133510 0x7f47781358f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 -- 172.21.15.19:0/2422751729 >> 172.21.15.19:0/2422751729 conn(0x7f47780a2aa0 msgr2=0x7f47780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 -- 172.21.15.19:0/2422751729 shutdown_connections 2023-10-03T10:19:18.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.201+0000 7f477f796700 1 -- 172.21.15.19:0/2422751729 wait complete. 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.202+0000 7f477f796700 1 Processor -- start 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 -- start start 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4778133510 0x7f47781c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 0x7f47781c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477811d780 con 0x7f4778135e30 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477809e5e0 con 0x7f4778133510 2023-10-03T10:19:18.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477f796700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f477811eac0 con 0x7f4778130670 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477d532700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477d532700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59570/0 (socket says 172.21.15.19:59570) 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477dd33700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 0x7f47781c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.203+0000 7f477d532700 1 -- 172.21.15.19:0/453428970 learned_addr learned my addr 172.21.15.19:0/453428970 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 -- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 msgr2=0x7f47781c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 -- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4778133510 msgr2=0x7f47781c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4778133510 0x7f47781c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 -- 172.21.15.19:0/453428970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700099e0 con 0x7f4778135e30 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477d532700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477dd33700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 0x7f47781c8d50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f477809f150 tx=0x7f477000e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000ee20 con 0x7f4778135e30 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000fec0 con 0x7f4778135e30 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4768009550 con 0x7f4778135e30 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770003c40 con 0x7f4778135e30 2023-10-03T10:19:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.204+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4778071880 con 0x7f4778135e30 2023-10-03T10:19:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.205+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4770004030 con 0x7f4778135e30 2023-10-03T10:19:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.205+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477811f5f0 con 0x7f4778135e30 2023-10-03T10:19:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.205+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f47700419f0 con 0x7f4778135e30 2023-10-03T10:19:18.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.210+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4770045060 con 0x7f4778135e30 2023-10-03T10:19:18.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.265+0000 7faec94d6700 1 Processor -- start 2023-10-03T10:19:18.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.265+0000 7faec94d6700 1 -- start start 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec409f520 con 0x7faec409e410 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec409f130 con 0x7faec409d6f0 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec94d6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec409e930 con 0x7faec409e000 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59586/0 (socket says 172.21.15.19:59586) 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33890/0 (socket says 172.21.15.19:33890) 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faeba7fc700 1 -- 172.21.15.19:0/4053634504 learned_addr learned my addr 172.21.15.19:0/4053634504 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec2ffd700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 -- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 msgr2=0x7faec4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 -- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 msgr2=0x7faec409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec37fe700 1 -- 172.21.15.19:0/4053634504 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec409b2d0 con 0x7faec409e410 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.266+0000 7faec2ffd700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec37fe700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec4130ba0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d90 tx=0x7faebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad01236217721efa server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec27fc700 1 -- 172.21.15.19:0/4053634504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc00e070 con 0x7faec409e410 2023-10-03T10:19:18.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec27fc700 1 -- 172.21.15.19:0/4053634504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faebc00bb20 con 0x7faec409e410 2023-10-03T10:19:18.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec27fc700 1 -- 172.21.15.19:0/4053634504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faebc012430 con 0x7faec409e410 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec94d6700 1 -- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 msgr2=0x7faec4130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec94d6700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec4130ba0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7faebc009d90 tx=0x7faebc00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.267+0000 7faec94d6700 1 -- 172.21.15.19:0/4053634504 shutdown_connections 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec4130ba0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 --2- 172.21.15.19:0/4053634504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 -- 172.21.15.19:0/4053634504 >> 172.21.15.19:0/4053634504 conn(0x7faec4066f50 msgr2=0x7faec409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 -- 172.21.15.19:0/4053634504 shutdown_connections 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.268+0000 7faec94d6700 1 -- 172.21.15.19:0/4053634504 wait complete. 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 Processor -- start 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 -- start start 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec411de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec411e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec4121960 con 0x7faec409e410 2023-10-03T10:19:18.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec4120d30 con 0x7faec409d6f0 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec94d6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faec40a15d0 con 0x7faec409e000 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faeba7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59598/0 (socket says 172.21.15.19:59598) 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faeba7fc700 1 -- 172.21.15.19:0/2553374689 learned_addr learned my addr 172.21.15.19:0/2553374689 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.269+0000 7faec2ffd700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec411de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec37fe700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec411e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 -- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 msgr2=0x7faec411e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 -- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 msgr2=0x7faec411e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec411e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 -- 172.21.15.19:0/2553374689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40094a0 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faeba7fc700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec2ffd700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec411de90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009fa0 tx=0x7faeb400ec60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4013980 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4013ae0 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc009a70 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4013e70 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.270+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec411fa50 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.271+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faeb4004030 con 0x7faec409d6f0 2023-10-03T10:19:18.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.271+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faeb40434d0 con 0x7faec409d6f0 2023-10-03T10:19:18.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.272+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec4074ea0 con 0x7faec409d6f0 2023-10-03T10:19:18.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.277+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faeb40044c0 con 0x7faec409d6f0 2023-10-03T10:19:18.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 Processor -- start 2023-10-03T10:19:18.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 -- start start 2023-10-03T10:19:18.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 0x7f40c412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 0x7f40c41304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c406b990 con 0x7f40c4133e30 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40a0590 con 0x7f40c4133420 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40ca71f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c409fb80 con 0x7f40c4134260 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.288+0000 7f40c3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55674/0 (socket says 172.21.15.19:55674) 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 -- 172.21.15.19:0/1978520921 learned_addr learned my addr 172.21.15.19:0/1978520921 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40bbfff700 1 --2- 172.21.15.19:0/1978520921 >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 0x7f40c412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c8cbc700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 0x7f40c41304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 -- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 msgr2=0x7f40c41304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 0x7f40c41304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 -- 172.21.15.19:0/1978520921 >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 msgr2=0x7f40c412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1978520921 >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 0x7f40c412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 -- 172.21.15.19:0/1978520921 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c40a0030 con 0x7f40c4133420 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c8cbc700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 0x7f40c41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40bbfff700 1 --2- 172.21.15.19:0/1978520921 >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 0x7f40c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098f0 tx=0x7f40b4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=418d832cdd08fa33 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c37fe700 1 -- 172.21.15.19:0/1978520921 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011830 con 0x7f40c4133420 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c37fe700 1 -- 172.21.15.19:0/1978520921 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4011990 con 0x7f40c4133420 2023-10-03T10:19:18.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.289+0000 7f40c37fe700 1 -- 172.21.15.19:0/1978520921 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4011d20 con 0x7f40c4133420 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 -- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 msgr2=0x7f40c41337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f40b40098f0 tx=0x7f40b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 -- 172.21.15.19:0/1978520921 shutdown_connections 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4133420 0x7f40c41337f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1978520921 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4134260 0x7f40c41304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1978520921 >> v2:172.21.15.19:3300/0 conn(0x7f40c4133e30 0x7f40c412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 -- 172.21.15.19:0/1978520921 >> 172.21.15.19:0/1978520921 conn(0x7f40c40a4210 msgr2=0x7f40c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 -- 172.21.15.19:0/1978520921 shutdown_connections 2023-10-03T10:19:18.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.290+0000 7f40ca71f700 1 -- 172.21.15.19:0/1978520921 wait complete. 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.291+0000 7f40ca71f700 1 Processor -- start 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.291+0000 7f40ca71f700 1 -- start start 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 0x7f40c409c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 0x7f40c409cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c412dbb0 con 0x7f40c4133420 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c4131400 con 0x7f40c4134260 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40ca71f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40c411b9a0 con 0x7f40c4133e30 2023-10-03T10:19:18.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33922/0 (socket says 172.21.15.19:33922) 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 -- 172.21.15.19:0/1010623500 learned_addr learned my addr 172.21.15.19:0/1010623500 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c8cbc700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 0x7f40c409cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40bbfff700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 0x7f40c409c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 -- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 msgr2=0x7f40c409c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 0x7f40c409c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 -- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 msgr2=0x7f40c409cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 0x7f40c409cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c3fff700 1 -- 172.21.15.19:0/1010623500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac00fcd0 con 0x7f40c4133420 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40bbfff700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 0x7f40c409c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:18.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.292+0000 7f40c8cbc700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 0x7f40c409cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40c3fff700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f40b4000c00 tx=0x7f40b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004590 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40036a0 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4009550 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4003a50 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.293+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c411aea0 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.294+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f40b4021070 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.294+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c411b800 con 0x7f40c4133420 2023-10-03T10:19:18.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.294+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f40b40409c0 con 0x7f40c4133420 2023-10-03T10:19:18.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.299+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f40c411b800 con 0x7f40c4133420 2023-10-03T10:19:18.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.445+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4778074ea0 con 0x7f4778135e30 2023-10-03T10:19:18.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.446+0000 7f476dffb700 1 -- 172.21.15.19:0/453428970 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4770045030 con 0x7f4778135e30 2023-10-03T10:19:18.446 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 msgr2=0x7f47781c8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 0x7f47781c8d50 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f477809f150 tx=0x7f477000e430 comp rx=0 tx=0).stop 2023-10-03T10:19:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 shutdown_connections 2023-10-03T10:19:18.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4778135e30 0x7f47781c8d50 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4778130670 0x7f47781c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 --2- 172.21.15.19:0/453428970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4778133510 0x7f47781c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 >> 172.21.15.19:0/453428970 conn(0x7f47780a2aa0 msgr2=0x7f477812e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 shutdown_connections 2023-10-03T10:19:18.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.448+0000 7f477f796700 1 -- 172.21.15.19:0/453428970 wait complete. 2023-10-03T10:19:18.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:18.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.484+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faec41211b0 con 0x7faec409d6f0 2023-10-03T10:19:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.485+0000 7faebbfff700 1 -- 172.21.15.19:0/2553374689 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faeb4023360 con 0x7faec409d6f0 2023-10-03T10:19:18.485 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:18.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 msgr2=0x7faec411de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec411de90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7faeb4009fa0 tx=0x7faeb400ec60 comp rx=0 tx=0).stop 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 shutdown_connections 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faec409e410 0x7faec411e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faec409d6f0 0x7faec411de90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 --2- 172.21.15.19:0/2553374689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faec409e000 0x7faec411e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 >> 172.21.15.19:0/2553374689 conn(0x7faec4066f50 msgr2=0x7faec4070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 shutdown_connections 2023-10-03T10:19:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.487+0000 7faec94d6700 1 -- 172.21.15.19:0/2553374689 wait complete. 2023-10-03T10:19:18.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.506+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f40c411b800 con 0x7f40c4133420 2023-10-03T10:19:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.506+0000 7f40c17fa700 1 -- 172.21.15.19:0/1010623500 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f40c411b800 con 0x7f40c4133420 2023-10-03T10:19:18.506 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 msgr2=0x7f40c409c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f40b4000c00 tx=0x7f40b4004750 comp rx=0 tx=0).stop 2023-10-03T10:19:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 shutdown_connections 2023-10-03T10:19:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f40c4134260 0x7f40c409cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40c4133420 0x7f40c409c160 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 --2- 172.21.15.19:0/1010623500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f40c4133e30 0x7f40c409c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 >> 172.21.15.19:0/1010623500 conn(0x7f40c40a4210 msgr2=0x7f40c4130150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 shutdown_connections 2023-10-03T10:19:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.508+0000 7f40ca71f700 1 -- 172.21.15.19:0/1010623500 wait complete. 2023-10-03T10:19:18.523 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:18.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:18.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 Processor -- start 2023-10-03T10:19:18.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 -- start start 2023-10-03T10:19:18.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45412d330 con 0x7fa45412cf60 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45412cd90 con 0x7fa454130260 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.962+0000 7fa45ac1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541306d0 con 0x7fa45412f8b0 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa453fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4589bb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55696/0 (socket says 172.21.15.19:55696) 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa453fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59620/0 (socket says 172.21.15.19:59620) 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4589bb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33924/0 (socket says 172.21.15.19:33924) 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 -- 172.21.15.19:0/1045526332 learned_addr learned my addr 172.21.15.19:0/1045526332 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 -- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 msgr2=0x7fa45412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 -- 172.21.15.19:0/1045526332 >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 msgr2=0x7fa45406f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 --2- 172.21.15.19:0/1045526332 >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 -- 172.21.15.19:0/1045526332 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa454071780 con 0x7fa454130260 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa453fff700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4589bb700 1 --2- 172.21.15.19:0/1045526332 >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4591bc700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009e80 tx=0x7fa44c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7392e74994d3368a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4537fe700 1 -- 172.21.15.19:0/1045526332 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00e070 con 0x7fa454130260 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4537fe700 1 -- 172.21.15.19:0/1045526332 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c00b8d0 con 0x7fa454130260 2023-10-03T10:19:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.963+0000 7fa4537fe700 1 -- 172.21.15.19:0/1045526332 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c00bc80 con 0x7fa454130260 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 -- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 msgr2=0x7fa454136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa44c009e80 tx=0x7fa44c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 -- 172.21.15.19:0/1045526332 shutdown_connections 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454136c20 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/1045526332 >> v2:172.21.15.19:3300/0 conn(0x7fa45412cf60 0x7fa45406f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/1045526332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412f8b0 0x7fa45412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 -- 172.21.15.19:0/1045526332 >> 172.21.15.19:0/1045526332 conn(0x7fa4540a2aa0 msgr2=0x7fa4540a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 -- 172.21.15.19:0/1045526332 shutdown_connections 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.964+0000 7fa45ac1f700 1 -- 172.21.15.19:0/1045526332 wait complete. 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.965+0000 7fa45ac1f700 1 Processor -- start 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.965+0000 7fa45ac1f700 1 -- start start 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 0x7fa4541c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 0x7fa4541c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa454135bf0 con 0x7fa45412f8b0 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4541c8610 con 0x7fa454130260 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa45ac1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa454129fa0 con 0x7fa45412cf60 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4589bb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 0x7fa4541c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55708/0 (socket says 172.21.15.19:55708) 2023-10-03T10:19:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 -- 172.21.15.19:0/2477773902 learned_addr learned my addr 172.21.15.19:0/2477773902 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa453fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 0x7fa4541c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 -- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 msgr2=0x7fa4541c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 0x7fa4541c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 -- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 msgr2=0x7fa4541c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 0x7fa4541c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 -- 172.21.15.19:0/2477773902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480094a0 con 0x7fa454130260 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4589bb700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 0x7fa4541c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa453fff700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 0x7fa4541c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.966+0000 7fa4591bc700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa44c012000 tx=0x7fa44c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c004450 con 0x7fa454130260 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44c0045b0 con 0x7fa454130260 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44c004960 con 0x7fa454130260 2023-10-03T10:19:18.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4400094a0 con 0x7fa454130260 2023-10-03T10:19:18.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa44c009b30 con 0x7fa454130260 2023-10-03T10:19:18.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.967+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa44c01c410 con 0x7fa454130260 2023-10-03T10:19:18.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.968+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa44c041000 con 0x7fa454130260 2023-10-03T10:19:18.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.968+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa454071af0 con 0x7fa454130260 2023-10-03T10:19:18.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:18.973+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa44c01c6c0 con 0x7fa454130260 2023-10-03T10:19:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.176+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa454135870 con 0x7fa454130260 2023-10-03T10:19:19.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.176+0000 7fa4517fa700 1 -- 172.21.15.19:0/2477773902 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa454135870 con 0x7fa454130260 2023-10-03T10:19:19.176 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 msgr2=0x7fa454138270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa44c012000 tx=0x7fa44c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 shutdown_connections 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa454130260 0x7fa454138270 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa45412cf60 0x7fa4541c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 --2- 172.21.15.19:0/2477773902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa45412f8b0 0x7fa4541c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 >> 172.21.15.19:0/2477773902 conn(0x7fa4540a2aa0 msgr2=0x7fa45406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 shutdown_connections 2023-10-03T10:19:19.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.178+0000 7fa45ac1f700 1 -- 172.21.15.19:0/2477773902 wait complete. 2023-10-03T10:19:19.192 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:19.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:19.502 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:19.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:19.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 Processor -- start 2023-10-03T10:19:19.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 -- start start 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a80a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33a809d5c0 0x7f33a80a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a80a1810 con 0x7f33a8133920 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a809ea10 con 0x7f33a809d5c0 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33ae65f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a809e210 con 0x7f33a80a09c0 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33a77fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f33a809d5c0 0x7f33a80a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33acbfc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f33a8133920 0x7f33a8133da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43682/0 (socket says 172.21.15.19:43682) 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.627+0000 7f33acbfc700 1 -- 172.21.15.19:0/474395983 learned_addr learned my addr 172.21.15.19:0/474395983 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 --2- 172.21.15.19:0/474395983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a80a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 -- 172.21.15.19:0/474395983 >> v2:172.21.15.19:3300/0 conn(0x7f33a809d5c0 msgr2=0x7f33a80a12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 --2- 172.21.15.19:0/474395983 >> v2:172.21.15.19:3300/0 conn(0x7f33a809d5c0 0x7f33a80a12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 -- 172.21.15.19:0/474395983 >> v1:172.21.15.19:6789/0 conn(0x7f33a8133920 legacy=0x7f33a8133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a6ffd700 1 -- 172.21.15.19:0/474395983 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128250512 0 0) 0x7f33a80a1810 con 0x7f33a8133920 2023-10-03T10:19:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 -- 172.21.15.19:0/474395983 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80a26f0 con 0x7f33a80a09c0 2023-10-03T10:19:19.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a7fff700 1 --2- 172.21.15.19:0/474395983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a80a0d90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3398009840 tx=0x7f3398009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1feb8faec49e77fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a6ffd700 1 -- 172.21.15.19:0/474395983 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011830 con 0x7f33a80a09c0 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a6ffd700 1 -- 172.21.15.19:0/474395983 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3398011990 con 0x7f33a80a09c0 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.628+0000 7f33a6ffd700 1 -- 172.21.15.19:0/474395983 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398011d20 con 0x7f33a80a09c0 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 -- 172.21.15.19:0/474395983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 msgr2=0x7f33a80a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 --2- 172.21.15.19:0/474395983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a80a0d90 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3398009840 tx=0x7f3398009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 -- 172.21.15.19:0/474395983 shutdown_connections 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 --2- 172.21.15.19:0/474395983 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a80a0d90 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 --2- 172.21.15.19:0/474395983 >> v2:172.21.15.19:3300/0 conn(0x7f33a809d5c0 0x7f33a80a12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 -- 172.21.15.19:0/474395983 >> 172.21.15.19:0/474395983 conn(0x7f33a80a2fe0 msgr2=0x7f33a80a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 -- 172.21.15.19:0/474395983 shutdown_connections 2023-10-03T10:19:19.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.629+0000 7f33ae65f700 1 -- 172.21.15.19:0/474395983 wait complete. 2023-10-03T10:19:19.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.630+0000 7f33ae65f700 1 Processor -- start 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.630+0000 7f33ae65f700 1 -- start start 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 0x7f33a81c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33a8133920 0x7f33a81c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a809cec0 con 0x7f33a809d5c0 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8120700 con 0x7f33a8133920 2023-10-03T10:19:19.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33ae65f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33a81334b0 con 0x7f33a80a09c0 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33a77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33a77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59640/0 (socket says 172.21.15.19:59640) 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33a77fe700 1 -- 172.21.15.19:0/2301101451 learned_addr learned my addr 172.21.15.19:0/2301101451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33a7fff700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 0x7f33a81c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.631+0000 7f33acbfc700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33a8133920 0x7f33a81c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 -- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 msgr2=0x7f33a81c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 -- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33a8133920 msgr2=0x7f33a81c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33a8133920 0x7f33a81c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 -- 172.21.15.19:0/2301101451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33980094a0 con 0x7f33a809d5c0 2023-10-03T10:19:19.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a77fe700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a7fff700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 0x7f33a81c7f70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f3398016000 tx=0x7f3398004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33980036a0 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339801f070 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a8121ef0 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3398003a20 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.632+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a8122c20 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.633+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3398003b80 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.633+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3398021070 con 0x7f33a809d5c0 2023-10-03T10:19:19.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.635+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a80747f0 con 0x7f33a809d5c0 2023-10-03T10:19:19.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.640+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f339802b020 con 0x7f33a809d5c0 2023-10-03T10:19:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.658+0000 7f1e45d1f700 1 Processor -- start 2023-10-03T10:19:19.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.658+0000 7f1e45d1f700 1 -- start start 2023-10-03T10:19:19.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e45d1f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e4009e1d0 0x7f1e40135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e45d1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 0x7f1e40138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e45d1f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e4009f130 con 0x7f1e4009d6f0 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e45d1f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e4009f520 con 0x7f1e4009e1d0 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e45d1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4009e930 con 0x7f1e40135e50 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e4009e1d0 0x7f1e40135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1e4009e1d0 0x7f1e40135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33960/0 (socket says 172.21.15.19:33960) 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1e4009d6f0 0x7f1e4009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43688/0 (socket says 172.21.15.19:43688) 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 -- 172.21.15.19:0/2120581457 learned_addr learned my addr 172.21.15.19:0/2120581457 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 0x7f1e40138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 -- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 msgr2=0x7f1e40138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 0x7f1e40138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 -- 172.21.15.19:0/2120581457 >> v1:172.21.15.19:6789/0 conn(0x7f1e4009d6f0 legacy=0x7f1e4009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3effd700 1 -- 172.21.15.19:0/2120581457 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4009b2d0 con 0x7f1e4009e1d0 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3e7fc700 1 -- 172.21.15.19:0/2120581457 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740132362 0 0) 0x7f1e4009f130 con 0x7f1e4009d6f0 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.659+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 0x7f1e40138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e3effd700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e4009e1d0 0x7f1e40135910 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098f0 tx=0x7f1e28009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a17243a0264605 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e3e7fc700 1 -- 172.21.15.19:0/2120581457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011830 con 0x7f1e4009e1d0 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e3e7fc700 1 -- 172.21.15.19:0/2120581457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e28011990 con 0x7f1e4009e1d0 2023-10-03T10:19:19.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e3e7fc700 1 -- 172.21.15.19:0/2120581457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28011d20 con 0x7f1e4009e1d0 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 -- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e4009e1d0 msgr2=0x7f1e40135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e4009e1d0 0x7f1e40135910 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f1e280098f0 tx=0x7f1e28009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 -- 172.21.15.19:0/2120581457 shutdown_connections 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e40135e50 0x7f1e40138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/2120581457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e4009e1d0 0x7f1e40135910 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.660+0000 7f1e45d1f700 1 -- 172.21.15.19:0/2120581457 >> 172.21.15.19:0/2120581457 conn(0x7f1e40066f50 msgr2=0x7f1e4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.661+0000 7f1e45d1f700 1 -- 172.21.15.19:0/2120581457 shutdown_connections 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.661+0000 7f1e45d1f700 1 -- 172.21.15.19:0/2120581457 wait complete. 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.661+0000 7f1e45d1f700 1 Processor -- start 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 -- start start 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 0x7f1e40119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 0x7f1e401199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 0x7f1e40119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4011c540 con 0x7f1e40135e50 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4012fd20 con 0x7f1e4009e1d0 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e45d1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4011af10 con 0x7f1e4009d6f0 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 0x7f1e40119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e3f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 0x7f1e40119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59662/0 (socket says 172.21.15.19:59662) 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e3f7fe700 1 -- 172.21.15.19:0/3223898624 learned_addr learned my addr 172.21.15.19:0/3223898624 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 0x7f1e40119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.662+0000 7f1e3effd700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 0x7f1e401199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 -- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 msgr2=0x7f1e40119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 0x7f1e40119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 -- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 msgr2=0x7f1e401199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 0x7f1e401199c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 -- 172.21.15.19:0/3223898624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e380094a0 con 0x7f1e40135e50 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3effd700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 0x7f1e401199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e3ffff700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 0x7f1e40119f00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e910 tx=0x7f1e3800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38004020 con 0x7f1e40135e50 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e380041a0 con 0x7f1e40135e50 2023-10-03T10:19:19.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e28009550 con 0x7f1e40135e50 2023-10-03T10:19:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38004550 con 0x7f1e40135e50 2023-10-03T10:19:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.663+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4009c700 con 0x7f1e40135e50 2023-10-03T10:19:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.664+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e380036a0 con 0x7f1e40135e50 2023-10-03T10:19:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.664+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e3803f3b0 con 0x7f1e40135e50 2023-10-03T10:19:19.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.664+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e40074ea0 con 0x7f1e40135e50 2023-10-03T10:19:19.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.669+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e38020020 con 0x7f1e40135e50 2023-10-03T10:19:19.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 Processor -- start 2023-10-03T10:19:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 -- start start 2023-10-03T10:19:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb0c133a80 0x7fdb0c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c130a70 0x7fdb0c13b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c06bc00 con 0x7fdb0c12ff20 2023-10-03T10:19:19.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c06c570 con 0x7fdb0c133a80 2023-10-03T10:19:19.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.723+0000 7fdb10977700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0a0040 con 0x7fdb0c130a70 2023-10-03T10:19:19.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb0c133a80 0x7fdb0c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb0c133a80 0x7fdb0c133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33988/0 (socket says 172.21.15.19:33988) 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb09d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb0c12ff20 0x7fdb0c130360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43698/0 (socket says 172.21.15.19:43698) 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 -- 172.21.15.19:0/3112584588 learned_addr learned my addr 172.21.15.19:0/3112584588 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c130a70 0x7fdb0c13b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 -- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c130a70 msgr2=0x7fdb0c13b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 --2- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c130a70 0x7fdb0c13b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 -- 172.21.15.19:0/3112584588 >> v1:172.21.15.19:6789/0 conn(0x7fdb0c12ff20 legacy=0x7fdb0c130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 -- 172.21.15.19:0/3112584588 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c133860 con 0x7fdb0c133a80 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0959a700 1 -- 172.21.15.19:0/3112584588 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211146336 0 0) 0x7fdb0c06bc00 con 0x7fdb0c12ff20 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.724+0000 7fdb0a59c700 1 --2- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c133a80 0x7fdb0c133e50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0098f0 tx=0x7fdafc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd6ed71b1a41351 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb0959a700 1 -- 172.21.15.19:0/3112584588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011830 con 0x7fdb0c133a80 2023-10-03T10:19:19.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb0959a700 1 -- 172.21.15.19:0/3112584588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc011990 con 0x7fdb0c133a80 2023-10-03T10:19:19.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb0959a700 1 -- 172.21.15.19:0/3112584588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc011d20 con 0x7fdb0c133a80 2023-10-03T10:19:19.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 -- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c133a80 msgr2=0x7fdb0c133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 --2- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c133a80 0x7fdb0c133e50 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0098f0 tx=0x7fdafc009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 -- 172.21.15.19:0/3112584588 shutdown_connections 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 --2- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c130a70 0x7fdb0c13b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 --2- 172.21.15.19:0/3112584588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c133a80 0x7fdb0c133e50 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.725+0000 7fdb10977700 1 -- 172.21.15.19:0/3112584588 >> 172.21.15.19:0/3112584588 conn(0x7fdb0c0a4210 msgr2=0x7fdb0c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.726+0000 7fdb10977700 1 -- 172.21.15.19:0/3112584588 shutdown_connections 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.726+0000 7fdb10977700 1 -- 172.21.15.19:0/3112584588 wait complete. 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 Processor -- start 2023-10-03T10:19:19.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 -- start start 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb0c12ff20 0x7fdb0c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c133a80 0x7fdb0c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c09e360 con 0x7fdb0c130a70 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c120630 con 0x7fdb0c133a80 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb10977700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c11fe50 con 0x7fdb0c12ff20 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33990/0 (socket says 172.21.15.19:33990) 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb09d9b700 1 -- 172.21.15.19:0/3119463676 learned_addr learned my addr 172.21.15.19:0/3119463676 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.727+0000 7fdb0ad9d700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c133a80 0x7fdb0c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb0a59c700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb0c12ff20 0x7fdb0c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 -- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb0c12ff20 msgr2=0x7fdb0c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb0c12ff20 0x7fdb0c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 -- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c133a80 msgr2=0x7fdb0c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c133a80 0x7fdb0c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 -- 172.21.15.19:0/3119463676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009550 con 0x7fdb0c130a70 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb09d9b700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c520 tx=0x7fdb0000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00004c80 con 0x7fdb0c130a70 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb00004e00 con 0x7fdb0c130a70 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c11eb70 con 0x7fdb0c130a70 2023-10-03T10:19:19.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00007310 con 0x7fdb0c130a70 2023-10-03T10:19:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.728+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c120130 con 0x7fdb0c130a70 2023-10-03T10:19:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.729+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb00007470 con 0x7fdb0c130a70 2023-10-03T10:19:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.729+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb0003f300 con 0x7fdb0c130a70 2023-10-03T10:19:19.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.730+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c134310 con 0x7fdb0c130a70 2023-10-03T10:19:19.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.735+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb000123b0 con 0x7fdb0c130a70 2023-10-03T10:19:19.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.872+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33a81223f0 con 0x7f33a809d5c0 2023-10-03T10:19:19.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.872+0000 7f33a4ff9700 1 -- 172.21.15.19:0/2301101451 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3398015070 con 0x7f33a809d5c0 2023-10-03T10:19:19.872 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 msgr2=0x7f33a81c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 0x7f33a81c7f70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f3398016000 tx=0x7f3398004750 comp rx=0 tx=0).stop 2023-10-03T10:19:19.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 shutdown_connections 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33a8133920 0x7f33a81c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33a809d5c0 0x7f33a81c7f70 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 --2- 172.21.15.19:0/2301101451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33a80a09c0 0x7f33a81c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 >> 172.21.15.19:0/2301101451 conn(0x7f33a80a2fe0 msgr2=0x7f33a809ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 shutdown_connections 2023-10-03T10:19:19.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.874+0000 7f33ae65f700 1 -- 172.21.15.19:0/2301101451 wait complete. 2023-10-03T10:19:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.881+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e401300c0 con 0x7f1e40135e50 2023-10-03T10:19:19.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.882+0000 7f1e37fff700 1 -- 172.21.15.19:0/3223898624 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e38017070 con 0x7f1e40135e50 2023-10-03T10:19:19.882 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:19.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 msgr2=0x7f1e40119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 0x7f1e40119f00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e910 tx=0x7f1e3800ec20 comp rx=0 tx=0).stop 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 shutdown_connections 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e40135e50 0x7f1e40119f00 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e4009d6f0 0x7f1e40119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 --2- 172.21.15.19:0/3223898624 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e4009e1d0 0x7f1e401199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 >> 172.21.15.19:0/3223898624 conn(0x7f1e40066f50 msgr2=0x7f1e400a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 shutdown_connections 2023-10-03T10:19:19.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.884+0000 7f1e45d1f700 1 -- 172.21.15.19:0/3223898624 wait complete. 2023-10-03T10:19:19.889 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:19.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:19.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.940+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb0c074ea0 con 0x7fdb0c130a70 2023-10-03T10:19:19.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.940+0000 7fdafaffd700 1 -- 172.21.15.19:0/3119463676 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb00011360 con 0x7fdb0c130a70 2023-10-03T10:19:19.940 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 msgr2=0x7fdb0c09c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000c520 tx=0x7fdb0000c830 comp rx=0 tx=0).stop 2023-10-03T10:19:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 shutdown_connections 2023-10-03T10:19:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb0c133a80 0x7fdb0c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb0c12ff20 0x7fdb0c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 --2- 172.21.15.19:0/3119463676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb0c130a70 0x7fdb0c09c9c0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:19.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 >> 172.21.15.19:0/3119463676 conn(0x7fdb0c0a4210 msgr2=0x7fdb0c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:19.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 shutdown_connections 2023-10-03T10:19:19.944 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:19.943+0000 7fdb10977700 1 -- 172.21.15.19:0/3119463676 wait complete. 2023-10-03T10:19:19.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:20.193 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:20.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 Processor -- start 2023-10-03T10:19:20.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 -- start start 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1409f130 con 0x7efc1409e000 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1409f520 con 0x7efc1409d6f0 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1c3e0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc1409e930 con 0x7efc1409e410 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1a17c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.338+0000 7efc1a97d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55746/0 (socket says 172.21.15.19:55746) 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 -- 172.21.15.19:0/1286828466 learned_addr learned my addr 172.21.15.19:0/1286828466 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a97d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59676/0 (socket says 172.21.15.19:59676) 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 -- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 msgr2=0x7efc14130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 -- 172.21.15.19:0/1286828466 >> v1:172.21.15.19:6789/0 conn(0x7efc1409e000 legacy=0x7efc14130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1917a700 1 -- 172.21.15.19:0/1286828466 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980078575 0 0) 0x7efc1409f130 con 0x7efc1409e000 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 -- 172.21.15.19:0/1286828466 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1409b2d0 con 0x7efc1409d6f0 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a97d700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1a17c700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc10009920 tx=0x7efc10009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fb84778d7d8ec59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1917a700 1 -- 172.21.15.19:0/1286828466 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000f8a0 con 0x7efc1409d6f0 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1917a700 1 -- 172.21.15.19:0/1286828466 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1000fa00 con 0x7efc1409d6f0 2023-10-03T10:19:20.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.339+0000 7efc1917a700 1 -- 172.21.15.19:0/1286828466 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1000fd90 con 0x7efc1409d6f0 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 -- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 msgr2=0x7efc1409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7efc10009920 tx=0x7efc10009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 -- 172.21.15.19:0/1286828466 shutdown_connections 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e410 0x7efc14130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/1286828466 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc1409dac0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 -- 172.21.15.19:0/1286828466 >> 172.21.15.19:0/1286828466 conn(0x7efc14066f50 msgr2=0x7efc1409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 -- 172.21.15.19:0/1286828466 shutdown_connections 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.340+0000 7efc1c3e0700 1 -- 172.21.15.19:0/1286828466 wait complete. 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 Processor -- start 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 -- start start 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 0x7efc14122cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 0x7efc141231f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc14125900 con 0x7efc1409e410 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc141242f0 con 0x7efc1409d6f0 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.341+0000 7efc1c3e0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc14125cf0 con 0x7efc1409e000 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a17c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 0x7efc141231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a17c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55750/0 (socket says 172.21.15.19:55750) 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1997b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 0x7efc14122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a17c700 1 -- 172.21.15.19:0/3996944810 learned_addr learned my addr 172.21.15.19:0/3996944810 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 -- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 msgr2=0x7efc14122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 0x7efc14122cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 -- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 msgr2=0x7efc14122770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 -- 172.21.15.19:0/3996944810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c009a70 con 0x7efc1409e410 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a17c700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1997b700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 0x7efc14122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1a97d700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 0x7efc141231f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009e50 tx=0x7efc0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00ca90 con 0x7efc1409e410 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c00f040 con 0x7efc1409e410 2023-10-03T10:19:20.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc10009550 con 0x7efc1409e410 2023-10-03T10:19:20.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00ce50 con 0x7efc1409e410 2023-10-03T10:19:20.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.342+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1409c700 con 0x7efc1409e410 2023-10-03T10:19:20.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.343+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efc0c014480 con 0x7efc1409e410 2023-10-03T10:19:20.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.343+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc14130690 con 0x7efc1409e410 2023-10-03T10:19:20.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.343+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efc0c03fc90 con 0x7efc1409e410 2023-10-03T10:19:20.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.348+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efc0c012910 con 0x7efc1409e410 2023-10-03T10:19:20.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.553+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efc14074ea0 con 0x7efc1409e410 2023-10-03T10:19:20.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.554+0000 7efc0affd700 1 -- 172.21.15.19:0/3996944810 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efc0c012340 con 0x7efc1409e410 2023-10-03T10:19:20.553 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 msgr2=0x7efc141231f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 0x7efc141231f0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7efc0c009e50 tx=0x7efc0c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 shutdown_connections 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efc1409e410 0x7efc141231f0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efc1409d6f0 0x7efc14122770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 --2- 172.21.15.19:0/3996944810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efc1409e000 0x7efc14122cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 >> 172.21.15.19:0/3996944810 conn(0x7efc14066f50 msgr2=0x7efc14070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 shutdown_connections 2023-10-03T10:19:20.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:20.556+0000 7efc1c3e0700 1 -- 172.21.15.19:0/3996944810 wait complete. 2023-10-03T10:19:20.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:20.890 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:20.899 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:20.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.049+0000 7f23b86c1700 1 Processor -- start 2023-10-03T10:19:21.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.049+0000 7f23b86c1700 1 -- start start 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b86c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b0133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b86c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 0x7f23b0130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b86c1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b006bc00 con 0x7f23b0130870 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b86c1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b006c570 con 0x7f23b012ff20 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b86c1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00a0040 con 0x7f23b0133a80 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b5c5c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 0x7f23b0130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b6c5e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f23b0130870 0x7f23b013a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43722/0 (socket says 172.21.15.19:43722) 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b6c5e700 1 -- 172.21.15.19:0/2026638583 learned_addr learned my addr 172.21.15.19:0/2026638583 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b645d700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b0133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b545b700 1 -- 172.21.15.19:0/2026638583 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767520176 0 0) 0x7f23b006bc00 con 0x7f23b0130870 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b545b700 1 -- 172.21.15.19:0/2026638583 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239c0035b0 con 0x7f23b0130870 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b645d700 1 -- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 msgr2=0x7f23b0130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b645d700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 0x7f23b0130330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b645d700 1 -- 172.21.15.19:0/2026638583 >> v1:172.21.15.19:6789/0 conn(0x7f23b0130870 legacy=0x7f23b013a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b645d700 1 -- 172.21.15.19:0/2026638583 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0133860 con 0x7f23b0133a80 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.050+0000 7f23b5c5c700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 0x7f23b0130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.051+0000 7f23b645d700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b0133e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009870 tx=0x7f23ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d1547614bc2ed6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.051+0000 7f23b545b700 1 -- 172.21.15.19:0/2026638583 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011830 con 0x7f23b0133a80 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.051+0000 7f23b545b700 1 -- 172.21.15.19:0/2026638583 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac011990 con 0x7f23b0133a80 2023-10-03T10:19:21.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.051+0000 7f23b545b700 1 -- 172.21.15.19:0/2026638583 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac011d20 con 0x7f23b0133a80 2023-10-03T10:19:21.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 -- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 msgr2=0x7f23b0133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b0133e50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f23ac009870 tx=0x7f23ac009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 -- 172.21.15.19:0/2026638583 shutdown_connections 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b0133e50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2026638583 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b012ff20 0x7f23b0130330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 -- 172.21.15.19:0/2026638583 >> 172.21.15.19:0/2026638583 conn(0x7f23b00a4210 msgr2=0x7f23b00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 -- 172.21.15.19:0/2026638583 shutdown_connections 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.052+0000 7f23b86c1700 1 -- 172.21.15.19:0/2026638583 wait complete. 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 Processor -- start 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 -- start start 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b0130870 0x7f23b009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b009d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0120ef0 con 0x7f23b012ff20 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01200e0 con 0x7f23b0130870 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b86c1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23b012db10 con 0x7f23b0133a80 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b645d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.053+0000 7f23b645d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34016/0 (socket says 172.21.15.19:34016) 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b645d700 1 -- 172.21.15.19:0/2558433280 learned_addr learned my addr 172.21.15.19:0/2558433280 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b5c5c700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b0130870 0x7f23b009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b009d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 -- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b0130870 msgr2=0x7f23b009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b0130870 0x7f23b009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 -- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 msgr2=0x7f23b009c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 -- 172.21.15.19:0/2558433280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00094a0 con 0x7f23b0133a80 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b645d700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b6c5e700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b009d160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f23a800cab0 tx=0x7f23a800cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800a9a0 con 0x7f23b0133a80 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800ab00 con 0x7f23b0133a80 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800ae70 con 0x7f23b0133a80 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0094a0 con 0x7f23b0133a80 2023-10-03T10:19:21.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.054+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b009e1b0 con 0x7f23b0133a80 2023-10-03T10:19:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.055+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f23a801b3b0 con 0x7f23b0133a80 2023-10-03T10:19:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.056+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f23a803f1e0 con 0x7f23b0133a80 2023-10-03T10:19:21.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.056+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b006c2d0 con 0x7f23b0133a80 2023-10-03T10:19:21.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.061+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f23a80192c0 con 0x7f23b0133a80 2023-10-03T10:19:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.079+0000 7f28f7368700 1 Processor -- start 2023-10-03T10:19:21.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.079+0000 7f28f7368700 1 -- start start 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 0x7f28f009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 0x7f28f01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28f009e410 0x7f28f0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f006b460 con 0x7f28f009e410 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f009b120 con 0x7f28f009e000 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f7368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28f009a7e0 con 0x7f28f009d6f0 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28f009e410 0x7f28f0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f28f009e410 0x7f28f0133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34022/0 (socket says 172.21.15.19:34022) 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 -- 172.21.15.19:0/1119901034 learned_addr learned my addr 172.21.15.19:0/1119901034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5104700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 0x7f28f009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f4903700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 0x7f28f01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 -- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 msgr2=0x7f28f009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 0x7f28f009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 -- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 msgr2=0x7f28f01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 0x7f28f01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5905700 1 -- 172.21.15.19:0/1119901034 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f009a500 con 0x7f28f009e410 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.080+0000 7f28f5104700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 0x7f28f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.081+0000 7f28f4903700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 0x7f28f01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.081+0000 7f28f5905700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f0133f30 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009e50 tx=0x7f28e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a64c4cc71d74e67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.081+0000 7f28e7fff700 1 -- 172.21.15.19:0/1119901034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800e070 con 0x7f28f009e410 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.081+0000 7f28e7fff700 1 -- 172.21.15.19:0/1119901034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800b910 con 0x7f28f009e410 2023-10-03T10:19:21.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.081+0000 7f28e7fff700 1 -- 172.21.15.19:0/1119901034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800bcc0 con 0x7f28f009e410 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 -- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 msgr2=0x7f28f0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f0133f30 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009e50 tx=0x7f28e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 -- 172.21.15.19:0/1119901034 shutdown_connections 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f0133f30 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009d6f0 0x7f28f009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 --2- 172.21.15.19:0/1119901034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009e000 0x7f28f01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 -- 172.21.15.19:0/1119901034 >> 172.21.15.19:0/1119901034 conn(0x7f28f0066f50 msgr2=0x7f28f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 -- 172.21.15.19:0/1119901034 shutdown_connections 2023-10-03T10:19:21.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.082+0000 7f28f7368700 1 -- 172.21.15.19:0/1119901034 wait complete. 2023-10-03T10:19:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.083+0000 7f28f7368700 1 Processor -- start 2023-10-03T10:19:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.083+0000 7f28f7368700 1 -- start start 2023-10-03T10:19:21.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 0x7f28f01a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f01a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f01a9680 con 0x7f28f009e410 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f009c710 con 0x7f28f009d6f0 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f7368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28f01a79a0 con 0x7f28f009e000 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55786/0 (socket says 172.21.15.19:55786) 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f4903700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 0x7f28f01a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 -- 172.21.15.19:0/2433609460 learned_addr learned my addr 172.21.15.19:0/2433609460 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5905700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f01a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 -- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 msgr2=0x7f28f01a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 0x7f28f01a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 -- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 msgr2=0x7f28f01a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f01a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 -- 172.21.15.19:0/2433609460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0094a0 con 0x7f28f009d6f0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f4903700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 0x7f28f01a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.084+0000 7f28f5104700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00ebe0 tx=0x7f28ec00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.085+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00c850 con 0x7f28f009d6f0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.085+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00c9b0 con 0x7f28f009d6f0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.085+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e00094a0 con 0x7f28f009d6f0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.085+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00cd40 con 0x7f28f009d6f0 2023-10-03T10:19:21.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.085+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e8009b30 con 0x7f28f009d6f0 2023-10-03T10:19:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.086+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f0074ea0 con 0x7f28f009d6f0 2023-10-03T10:19:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.086+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f28ec013470 con 0x7f28f009d6f0 2023-10-03T10:19:21.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.087+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f28ec03f870 con 0x7f28f009d6f0 2023-10-03T10:19:21.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.091+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f28ec013720 con 0x7f28f009d6f0 2023-10-03T10:19:21.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.129+0000 7f5abc647700 1 Processor -- start 2023-10-03T10:19:21.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.129+0000 7f5abc647700 1 -- start start 2023-10-03T10:19:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5abc647700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ab40a0a30 0x7f5ab40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5abc647700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 0x7f5ab4133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5abc647700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab409edd0 con 0x7f5ab4133fa0 2023-10-03T10:19:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5abc647700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab409e1f0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5abc647700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab409dc50 con 0x7f5ab40a1340 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5aba3e3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ab40a0a30 0x7f5ab40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5ababe4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5ab4133fa0 0x7f5ab413ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43728/0 (socket says 172.21.15.19:43728) 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5ababe4700 1 -- 172.21.15.19:0/2566498843 learned_addr learned my addr 172.21.15.19:0/2566498843 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.130+0000 7f5ab9be2700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 0x7f5ab4133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab93e1700 1 -- 172.21.15.19:0/2566498843 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019818251 0 0) 0x7f5ab409edd0 con 0x7f5ab4133fa0 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab93e1700 1 -- 172.21.15.19:0/2566498843 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa00035b0 con 0x7f5ab4133fa0 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5aba3e3700 1 -- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 msgr2=0x7f5ab4133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5aba3e3700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 0x7f5ab4133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5aba3e3700 1 -- 172.21.15.19:0/2566498843 >> v1:172.21.15.19:6789/0 conn(0x7f5ab4133fa0 legacy=0x7f5ab413ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5aba3e3700 1 -- 172.21.15.19:0/2566498843 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40a1fe0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab9be2700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 0x7f5ab4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5aba3e3700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab40a0e00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009840 tx=0x7f5ab0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ec19f23589bcbe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab93e1700 1 -- 172.21.15.19:0/2566498843 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0011830 con 0x7f5ab40a0a30 2023-10-03T10:19:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab93e1700 1 -- 172.21.15.19:0/2566498843 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0011990 con 0x7f5ab40a0a30 2023-10-03T10:19:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.131+0000 7f5ab93e1700 1 -- 172.21.15.19:0/2566498843 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0011d20 con 0x7f5ab40a0a30 2023-10-03T10:19:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 -- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 msgr2=0x7f5ab40a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab40a0e00 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009840 tx=0x7f5ab0009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 -- 172.21.15.19:0/2566498843 shutdown_connections 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab40a0e00 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 --2- 172.21.15.19:0/2566498843 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab40a1340 0x7f5ab4133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 -- 172.21.15.19:0/2566498843 >> 172.21.15.19:0/2566498843 conn(0x7f5ab40a6550 msgr2=0x7f5ab40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 -- 172.21.15.19:0/2566498843 shutdown_connections 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.132+0000 7f5abc647700 1 -- 172.21.15.19:0/2566498843 wait complete. 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.133+0000 7f5abc647700 1 Processor -- start 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.133+0000 7f5abc647700 1 -- start start 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 0x7f5ab4122e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 0x7f5ab41233b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab41244b0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4124d80 con 0x7f5ab4133fa0 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5abc647700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab41263c0 con 0x7f5ab40a1340 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5aba3e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5aba3e3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34058/0 (socket says 172.21.15.19:34058) 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5aba3e3700 1 -- 172.21.15.19:0/4183077591 learned_addr learned my addr 172.21.15.19:0/4183077591 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5ab9be2700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 0x7f5ab4122e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.134+0000 7f5ababe4700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 0x7f5ab41233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 -- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 msgr2=0x7f5ab4122e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 0x7f5ab4122e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 -- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 msgr2=0x7f5ab41233b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 0x7f5ab41233b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 -- 172.21.15.19:0/4183077591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40094a0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5ab9be2700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 0x7f5ab4122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5ababe4700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 0x7f5ab41233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aba3e3700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00090b0 tx=0x7f5ab0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0004380 con 0x7f5ab40a0a30 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab001f070 con 0x7f5ab40a0a30 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab00094a0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab00036a0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.135+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab40a0220 con 0x7f5ab40a0a30 2023-10-03T10:19:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.136+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ab0021030 con 0x7f5ab40a0a30 2023-10-03T10:19:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.136+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab40a1d40 con 0x7f5ab40a0a30 2023-10-03T10:19:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.136+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ab0040840 con 0x7f5ab40a0a30 2023-10-03T10:19:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.141+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ab0015020 con 0x7f5ab40a0a30 2023-10-03T10:19:21.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.278+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23b0074ea0 con 0x7f23b0133a80 2023-10-03T10:19:21.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.278+0000 7f23a6ffd700 1 -- 172.21.15.19:0/2558433280 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f23a8017020 con 0x7f23b0133a80 2023-10-03T10:19:21.278 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:21.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 msgr2=0x7f23b009d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b009d160 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f23a800cab0 tx=0x7f23a800cdc0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 shutdown_connections 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f23b0133a80 0x7f23b009d160 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23b012ff20 0x7f23b009c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.280+0000 7f23b86c1700 1 --2- 172.21.15.19:0/2558433280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f23b0130870 0x7f23b009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.281+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 >> 172.21.15.19:0/2558433280 conn(0x7f23b00a4210 msgr2=0x7f23b00a0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.281+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 shutdown_connections 2023-10-03T10:19:21.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.281+0000 7f23b86c1700 1 -- 172.21.15.19:0/2558433280 wait complete. 2023-10-03T10:19:21.294 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.300+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f28f01a80b0 con 0x7f28f009d6f0 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.301+0000 7f28e5ffb700 1 -- 172.21.15.19:0/2433609460 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f28ec021030 con 0x7f28f009d6f0 2023-10-03T10:19:21.300 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 msgr2=0x7f28f01a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00ebe0 tx=0x7f28ec00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 shutdown_connections 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f28f009e410 0x7f28f01a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28f009d6f0 0x7f28f01a5de0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 --2- 172.21.15.19:0/2433609460 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f28f009e000 0x7f28f01a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 >> 172.21.15.19:0/2433609460 conn(0x7f28f0066f50 msgr2=0x7f28f01badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 shutdown_connections 2023-10-03T10:19:21.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.304+0000 7f28f7368700 1 -- 172.21.15.19:0/2433609460 wait complete. 2023-10-03T10:19:21.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.359+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ab4074ea0 con 0x7f5ab40a0a30 2023-10-03T10:19:21.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.359+0000 7f5aaaffd700 1 -- 172.21.15.19:0/4183077591 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ab0019770 con 0x7f5ab40a0a30 2023-10-03T10:19:21.359 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 msgr2=0x7f5ab4122930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5ab00090b0 tx=0x7f5ab0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:21.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 shutdown_connections 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ab4133fa0 0x7f5ab41233b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ab40a0a30 0x7f5ab4122930 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 --2- 172.21.15.19:0/4183077591 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ab40a1340 0x7f5ab4122e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 >> 172.21.15.19:0/4183077591 conn(0x7f5ab40a6550 msgr2=0x7f5ab411c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 shutdown_connections 2023-10-03T10:19:21.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.361+0000 7f5abc647700 1 -- 172.21.15.19:0/4183077591 wait complete. 2023-10-03T10:19:21.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:21.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:21.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 Processor -- start 2023-10-03T10:19:21.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 -- start start 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 0x7ff738130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff73809f520 con 0x7ff73809e000 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73809f130 con 0x7ff73809e410 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff73e749700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff73809e930 con 0x7ff73809d6f0 2023-10-03T10:19:21.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff737fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff7377fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff7377fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34068/0 (socket says 172.21.15.19:34068) 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.716+0000 7ff737fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59748/0 (socket says 172.21.15.19:59748) 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff7377fe700 1 -- 172.21.15.19:0/3396475335 learned_addr learned my addr 172.21.15.19:0/3396475335 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 0x7ff738130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 -- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 msgr2=0x7ff73809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 -- 172.21.15.19:0/3396475335 >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 msgr2=0x7ff738130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3396475335 >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 -- 172.21.15.19:0/3396475335 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73809b2d0 con 0x7ff73809e410 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff7377fe700 1 --2- 172.21.15.19:0/3396475335 >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff737fff700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 0x7ff738130ba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff73000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=136d4cc38be09097 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff736ffd700 1 -- 172.21.15.19:0/3396475335 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73000e070 con 0x7ff73809e410 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff736ffd700 1 -- 172.21.15.19:0/3396475335 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73000bb20 con 0x7ff73809e410 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.717+0000 7ff736ffd700 1 -- 172.21.15.19:0/3396475335 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730012430 con 0x7ff73809e410 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 -- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 msgr2=0x7ff738130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 0x7ff738130ba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff73000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 -- 172.21.15.19:0/3396475335 shutdown_connections 2023-10-03T10:19:21.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809e410 0x7ff738130ba0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 --2- 172.21.15.19:0/3396475335 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809d6f0 0x7ff73809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 --2- 172.21.15.19:0/3396475335 >> v2:172.21.15.19:3300/0 conn(0x7ff73809e000 0x7ff738130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 -- 172.21.15.19:0/3396475335 >> 172.21.15.19:0/3396475335 conn(0x7ff738066f50 msgr2=0x7ff73809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 -- 172.21.15.19:0/3396475335 shutdown_connections 2023-10-03T10:19:21.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.718+0000 7ff73e749700 1 -- 172.21.15.19:0/3396475335 wait complete. 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 Processor -- start 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 -- start start 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 0x7ff738122710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:21.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381243b0 con 0x7ff73809e410 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73809c700 con 0x7ff73809d6f0 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.719+0000 7ff73e749700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380a1600 con 0x7ff73809e000 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff737fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff737fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55822/0 (socket says 172.21.15.19:55822) 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff737fff700 1 -- 172.21.15.19:0/3737637877 learned_addr learned my addr 172.21.15.19:0/3737637877 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34080/0 (socket says 172.21.15.19:34080) 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff7377fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 0x7ff738122710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 -- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 msgr2=0x7ff738122710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 0x7ff738122710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 -- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 msgr2=0x7ff7381221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 -- 172.21.15.19:0/3737637877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0094a0 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff737fff700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff7377fe700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 0x7ff738122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73cce6700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff730004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff730004880 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff730020070 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300276c0 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72800b7f0 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.720+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff730009a70 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.721+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff730012430 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.721+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff730022070 con 0x7ff73809e410 2023-10-03T10:19:21.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.721+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff738125660 con 0x7ff73809e410 2023-10-03T10:19:21.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.726+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff738125660 con 0x7ff73809e410 2023-10-03T10:19:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.933+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff738125660 con 0x7ff73809e410 2023-10-03T10:19:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.933+0000 7ff734ff9700 1 -- 172.21.15.19:0/3737637877 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff738125660 con 0x7ff73809e410 2023-10-03T10:19:21.934 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 msgr2=0x7ff738122c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7ff730009d90 tx=0x7ff730004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 shutdown_connections 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff73809e410 0x7ff738122c50 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff73809d6f0 0x7ff7381221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 --2- 172.21.15.19:0/3737637877 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff73809e000 0x7ff738122710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 >> 172.21.15.19:0/3737637877 conn(0x7ff738066f50 msgr2=0x7ff738130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 shutdown_connections 2023-10-03T10:19:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:21.936+0000 7ff73e749700 1 -- 172.21.15.19:0/3737637877 wait complete. 2023-10-03T10:19:21.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:22.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:22.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:22.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:22.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.447+0000 7effae23c700 1 Processor -- start 2023-10-03T10:19:22.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.447+0000 7effae23c700 1 -- start start 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effae23c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 0x7effa81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effae23c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 0x7effa81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effae23c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa806b990 con 0x7effa8133e30 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effae23c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80a0590 con 0x7effa8134260 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effae23c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effa809fb80 con 0x7effa8133420 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 0x7effa81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7eff9effd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7effa8133e30 0x7effa812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43730/0 (socket says 172.21.15.19:43730) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 0x7effa81306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34088/0 (socket says 172.21.15.19:34088) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7eff9effd700 1 -- 172.21.15.19:0/744985395 learned_addr learned my addr 172.21.15.19:0/744985395 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:22.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 0x7effa81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa6ffd700 1 -- 172.21.15.19:0/744985395 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527019956 0 0) 0x7effa806b990 con 0x7effa8133e30 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa6ffd700 1 -- 172.21.15.19:0/744985395 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff940035b0 con 0x7effa8133e30 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa77fe700 1 -- 172.21.15.19:0/744985395 >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 msgr2=0x7effa81306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa77fe700 1 --2- 172.21.15.19:0/744985395 >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 0x7effa81306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa77fe700 1 -- 172.21.15.19:0/744985395 >> v1:172.21.15.19:6789/0 conn(0x7effa8133e30 legacy=0x7effa812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.448+0000 7effa77fe700 1 -- 172.21.15.19:0/744985395 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80a0030 con 0x7effa8133420 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.449+0000 7effa77fe700 1 --2- 172.21.15.19:0/744985395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 0x7effa81337f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7eff98009840 tx=0x7eff98009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187c5851b523d879 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.449+0000 7effa6ffd700 1 -- 172.21.15.19:0/744985395 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98011830 con 0x7effa8133420 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.449+0000 7effa6ffd700 1 -- 172.21.15.19:0/744985395 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff98011990 con 0x7effa8133420 2023-10-03T10:19:22.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.449+0000 7effa6ffd700 1 -- 172.21.15.19:0/744985395 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98011d00 con 0x7effa8133420 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 -- 172.21.15.19:0/744985395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 msgr2=0x7effa81337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 --2- 172.21.15.19:0/744985395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 0x7effa81337f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7eff98009840 tx=0x7eff98009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 -- 172.21.15.19:0/744985395 shutdown_connections 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 --2- 172.21.15.19:0/744985395 >> v2:172.21.15.19:3300/0 conn(0x7effa8134260 0x7effa81306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 --2- 172.21.15.19:0/744985395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8133420 0x7effa81337f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 -- 172.21.15.19:0/744985395 >> 172.21.15.19:0/744985395 conn(0x7effa80a4210 msgr2=0x7effa80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 -- 172.21.15.19:0/744985395 shutdown_connections 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.450+0000 7effae23c700 1 -- 172.21.15.19:0/744985395 wait complete. 2023-10-03T10:19:22.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 Processor -- start 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 -- start start 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 0x7effa809c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 0x7effa809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa811ef40 con 0x7effa8133420 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa8131670 con 0x7effa8133e30 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.451+0000 7effae23c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effa8120590 con 0x7effa8134260 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55834/0 (socket says 172.21.15.19:55834) 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 -- 172.21.15.19:0/1854386232 learned_addr learned my addr 172.21.15.19:0/1854386232 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7effa77fe700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 0x7effa809c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7effa7fff700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 0x7effa809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 -- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 msgr2=0x7effa809cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 0x7effa809cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 -- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 msgr2=0x7effa809c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 0x7effa809c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 -- 172.21.15.19:0/1854386232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980094a0 con 0x7effa8133e30 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7effa77fe700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 0x7effa809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7effa7fff700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 0x7effa809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7eff9effd700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff90005910 tx=0x7eff9000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.452+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90005d70 con 0x7effa8133e30 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.453+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff900070d0 con 0x7effa8133e30 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.453+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa811faf0 con 0x7effa8133e30 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.453+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90007460 con 0x7effa8133e30 2023-10-03T10:19:22.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.453+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa812dad0 con 0x7effa8133e30 2023-10-03T10:19:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.454+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa8074ea0 con 0x7effa8133e30 2023-10-03T10:19:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.454+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7eff900075c0 con 0x7effa8133e30 2023-10-03T10:19:22.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.455+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7eff9003efa0 con 0x7effa8133e30 2023-10-03T10:19:22.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.459+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7eff9001bb10 con 0x7effa8133e30 2023-10-03T10:19:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.485+0000 7f7bf8193700 1 Processor -- start 2023-10-03T10:19:22.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 -- start start 2023-10-03T10:19:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bf00a0a30 0x7f7bf00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf00a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf0133db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bf00a2a70 con 0x7f7bf00a0a30 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00a01d0 con 0x7f7bf009d630 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf8193700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf009e2b0 con 0x7f7bf0133930 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf5f2f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bf00a0a30 0x7f7bf00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf6730700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf0133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf5f2f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7bf00a0a30 0x7f7bf00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34104/0 (socket says 172.21.15.19:34104) 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/3604741573 learned_addr learned my addr 172.21.15.19:0/3604741573 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.486+0000 7f7bf572e700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf00a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 msgr2=0x7f7bf0133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf0133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 msgr2=0x7f7bf00a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf00a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/3604741573 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf009dc50 con 0x7f7bf00a0a30 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf6730700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf572e700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf00a0e00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098f0 tx=0x7f7be0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e00be886db84391 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf4f2d700 1 -- 172.21.15.19:0/3604741573 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0011830 con 0x7f7bf00a0a30 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf4f2d700 1 -- 172.21.15.19:0/3604741573 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be0011990 con 0x7f7bf00a0a30 2023-10-03T10:19:22.489 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.487+0000 7f7bf4f2d700 1 -- 172.21.15.19:0/3604741573 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0011d20 con 0x7f7bf00a0a30 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 -- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 msgr2=0x7f7bf00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf00a0e00 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f7be00098f0 tx=0x7f7be0009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 -- 172.21.15.19:0/3604741573 shutdown_connections 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf0133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf00a0e00 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 --2- 172.21.15.19:0/3604741573 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf00a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 -- 172.21.15.19:0/3604741573 >> 172.21.15.19:0/3604741573 conn(0x7f7bf00a3050 msgr2=0x7f7bf00a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 -- 172.21.15.19:0/3604741573 shutdown_connections 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.488+0000 7f7bf8193700 1 -- 172.21.15.19:0/3604741573 wait complete. 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 Processor -- start 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 -- start start 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf011f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf01c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0122390 con 0x7f7bf00a0a30 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0122570 con 0x7f7bf009d630 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.490+0000 7f7bf8193700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf01333e0 con 0x7f7bf0133930 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf572e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf011f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf572e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf011f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34120/0 (socket says 172.21.15.19:34120) 2023-10-03T10:19:22.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55846/0 (socket says 172.21.15.19:55846) 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf572e700 1 -- 172.21.15.19:0/1399414835 learned_addr learned my addr 172.21.15.19:0/1399414835 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf6730700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf01c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 msgr2=0x7f7bf01c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf01c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 msgr2=0x7f7bf011f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf011f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 -- 172.21.15.19:0/1399414835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40094a0 con 0x7f7bf009d630 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf5f2f700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7be0016000 tx=0x7f7be0004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be0004240 con 0x7f7bf009d630 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be001f070 con 0x7f7bf009d630 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be8009a70 con 0x7f7bf009d630 2023-10-03T10:19:22.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be00036a0 con 0x7f7bf009d630 2023-10-03T10:19:22.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.491+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0009550 con 0x7f7bf009d630 2023-10-03T10:19:22.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.492+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7be0021030 con 0x7f7bf009d630 2023-10-03T10:19:22.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.493+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7be0040640 con 0x7f7bf009d630 2023-10-03T10:19:22.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.493+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf00a0410 con 0x7f7bf009d630 2023-10-03T10:19:22.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.498+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7be00199a0 con 0x7f7bf009d630 2023-10-03T10:19:22.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 Processor -- start 2023-10-03T10:19:22.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 -- start start 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514c09f240 0x7f514c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c070940 con 0x7f514c09f240 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c06fd60 con 0x7f514c09e930 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.546+0000 7f51517fc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514c06fa80 con 0x7f514c09f650 2023-10-03T10:19:22.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514c09f240 0x7f514c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f514c09f240 0x7f514c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34124/0 (socket says 172.21.15.19:34124) 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55856/0 (socket says 172.21.15.19:55856) 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 -- 172.21.15.19:0/978399863 learned_addr learned my addr 172.21.15.19:0/978399863 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514b7fe700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 -- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 msgr2=0x7f514c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 -- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 msgr2=0x7f514c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 -- 172.21.15.19:0/978399863 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c09fb60 con 0x7f514c09f240 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f514a7fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1317f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f51400098f0 tx=0x7f5140009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d1a5d59276590f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.547+0000 7f5149ffb700 1 -- 172.21.15.19:0/978399863 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011830 con 0x7f514c09f240 2023-10-03T10:19:22.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f5149ffb700 1 -- 172.21.15.19:0/978399863 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5140011990 con 0x7f514c09f240 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f5149ffb700 1 -- 172.21.15.19:0/978399863 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140011d20 con 0x7f514c09f240 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 -- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 msgr2=0x7f514c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1317f0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f51400098f0 tx=0x7f5140009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 -- 172.21.15.19:0/978399863 shutdown_connections 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 --2- 172.21.15.19:0/978399863 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1317f0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 -- 172.21.15.19:0/978399863 >> 172.21.15.19:0/978399863 conn(0x7f514c0a4210 msgr2=0x7f514c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 -- 172.21.15.19:0/978399863 shutdown_connections 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.548+0000 7f51517fc700 1 -- 172.21.15.19:0/978399863 wait complete. 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 Processor -- start 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 -- start start 2023-10-03T10:19:22.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c1a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1a4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1a8160 con 0x7f514c09f240 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1a77a0 con 0x7f514c09e930 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f51517fc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1a6ae0 con 0x7f514c09f650 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f514affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c1a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f514affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c1a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55866/0 (socket says 172.21.15.19:55866) 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f514affd700 1 -- 172.21.15.19:0/2066064058 learned_addr learned my addr 172.21.15.19:0/2066064058 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f514a7fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1a4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.550+0000 7f514b7fe700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 -- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 msgr2=0x7f514c1a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c1a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 -- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 msgr2=0x7f514c1a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c1a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 -- 172.21.15.19:0/2066064058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140009550 con 0x7f514c09f240 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f514a7fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1a4250 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5140016000 tx=0x7f5140004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5140004450 con 0x7f514c09f240 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514001f070 con 0x7f514c09f240 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c0a0190 con 0x7f514c09f240 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51400038e0 con 0x7f514c09f240 2023-10-03T10:19:22.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.551+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c1a5890 con 0x7f514c09f240 2023-10-03T10:19:22.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.552+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5140003a40 con 0x7f514c09f240 2023-10-03T10:19:22.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.552+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5140021070 con 0x7f514c09f240 2023-10-03T10:19:22.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.552+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c1a0b30 con 0x7f514c09f240 2023-10-03T10:19:22.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.562+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5140015070 con 0x7f514c09f240 2023-10-03T10:19:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.697+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7effa806b250 con 0x7effa8133e30 2023-10-03T10:19:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.698+0000 7effa4ff9700 1 -- 172.21.15.19:0/1854386232 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7eff900192c0 con 0x7effa8133e30 2023-10-03T10:19:22.698 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 msgr2=0x7effa809c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff90005910 tx=0x7eff9000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 shutdown_connections 2023-10-03T10:19:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7effa8134260 0x7effa809cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7effa8133420 0x7effa809c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 --2- 172.21.15.19:0/1854386232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7effa8133e30 0x7effa809c700 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 >> 172.21.15.19:0/1854386232 conn(0x7effa80a4210 msgr2=0x7effa80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 shutdown_connections 2023-10-03T10:19:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.700+0000 7effae23c700 1 -- 172.21.15.19:0/1854386232 wait complete. 2023-10-03T10:19:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.705+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7bf00747f0 con 0x7f7bf009d630 2023-10-03T10:19:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.706+0000 7f7bee7fc700 1 -- 172.21.15.19:0/1399414835 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7be0015020 con 0x7f7bf009d630 2023-10-03T10:19:22.706 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 msgr2=0x7f7bf011f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7be0016000 tx=0x7f7be0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 shutdown_connections 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bf0133930 0x7f7bf01c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bf009d630 0x7f7bf011f420 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 --2- 172.21.15.19:0/1399414835 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bf00a0a30 0x7f7bf011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 >> 172.21.15.19:0/1399414835 conn(0x7f7bf00a3050 msgr2=0x7f7bf01bbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 shutdown_connections 2023-10-03T10:19:22.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.708+0000 7f7bf8193700 1 -- 172.21.15.19:0/1399414835 wait complete. 2023-10-03T10:19:22.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:22.723 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:22.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.771+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f514c074ea0 con 0x7f514c09f240 2023-10-03T10:19:22.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.771+0000 7f51337fe700 1 -- 172.21.15.19:0/2066064058 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5140003cf0 con 0x7f514c09f240 2023-10-03T10:19:22.771 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 msgr2=0x7f514c1a4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:22.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1a4250 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f5140016000 tx=0x7f5140004750 comp rx=0 tx=0).stop 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 shutdown_connections 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f514c09f650 0x7f514c1a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f514c09e930 0x7f514c1a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 --2- 172.21.15.19:0/2066064058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f514c09f240 0x7f514c1a4250 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 >> 172.21.15.19:0/2066064058 conn(0x7f514c0a4210 msgr2=0x7f514c1b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 shutdown_connections 2023-10-03T10:19:22.774 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:22.773+0000 7f51517fc700 1 -- 172.21.15.19:0/2066064058 wait complete. 2023-10-03T10:19:22.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:22.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.095+0000 7f215a272700 1 Processor -- start 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.095+0000 7f215a272700 1 -- start start 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215a272700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 0x7f2154136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215a272700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215a272700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2154070940 con 0x7f215409e930 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215a272700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215406fd60 con 0x7f215409f410 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215a272700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215406fa80 con 0x7f2154136fe0 2023-10-03T10:19:23.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f21537fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 0x7f2154136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f2153fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f215409e930 0x7f215409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43746/0 (socket says 172.21.15.19:43746) 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55876/0 (socket says 172.21.15.19:55876) 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f2153fff700 1 -- 172.21.15.19:0/3329181561 learned_addr learned my addr 172.21.15.19:0/3329181561 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f2152ffd700 1 -- 172.21.15.19:0/3329181561 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932442 0 0) 0x7f2154070940 con 0x7f215409e930 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 -- 172.21.15.19:0/3329181561 >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 msgr2=0x7f2154136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 --2- 172.21.15.19:0/3329181561 >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 0x7f2154136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 -- 172.21.15.19:0/3329181561 >> v1:172.21.15.19:6789/0 conn(0x7f215409e930 legacy=0x7f215409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.096+0000 7f215880f700 1 -- 172.21.15.19:0/3329181561 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215409fb60 con 0x7f2154136fe0 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f21537fe700 1 --2- 172.21.15.19:0/3329181561 >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 0x7f2154136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215880f700 1 --2- 172.21.15.19:0/3329181561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d90 tx=0x7f214c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39611873c5952bb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f2152ffd700 1 -- 172.21.15.19:0/3329181561 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00e070 con 0x7f2154136fe0 2023-10-03T10:19:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f2152ffd700 1 -- 172.21.15.19:0/3329181561 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00bb20 con 0x7f2154136fe0 2023-10-03T10:19:23.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f2152ffd700 1 -- 172.21.15.19:0/3329181561 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c012430 con 0x7f2154136fe0 2023-10-03T10:19:23.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 -- 172.21.15.19:0/3329181561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 msgr2=0x7f21541393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 --2- 172.21.15.19:0/3329181561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f214c009d90 tx=0x7f214c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 -- 172.21.15.19:0/3329181561 shutdown_connections 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 --2- 172.21.15.19:0/3329181561 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f21541393c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 --2- 172.21.15.19:0/3329181561 >> v2:172.21.15.19:3300/0 conn(0x7f215409f410 0x7f2154136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.097+0000 7f215a272700 1 -- 172.21.15.19:0/3329181561 >> 172.21.15.19:0/3329181561 conn(0x7f21540a4210 msgr2=0x7f21540a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.098+0000 7f215a272700 1 -- 172.21.15.19:0/3329181561 shutdown_connections 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.098+0000 7f215a272700 1 -- 172.21.15.19:0/3329181561 wait complete. 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.099+0000 7f215a272700 1 Processor -- start 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.099+0000 7f215a272700 1 -- start start 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215409f410 0x7f215411e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f215411ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215411ffc0 con 0x7f215409e930 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2154121210 con 0x7f2154136fe0 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215a272700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21540a3260 con 0x7f215409f410 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34158/0 (socket says 172.21.15.19:34158) 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 -- 172.21.15.19:0/2216135810 learned_addr learned my addr 172.21.15.19:0/2216135810 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f215880f700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f215411ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f21537fe700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215409f410 0x7f215411e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 -- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215409f410 msgr2=0x7f215411e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215409f410 0x7f215411e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 -- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 msgr2=0x7f215411ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f215411ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 -- 172.21.15.19:0/2216135810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480094a0 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.100+0000 7f2153fff700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f214400c520 tx=0x7f214400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144004c80 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144004e00 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c009a70 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144007310 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2154121660 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.101+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2144007470 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.102+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f214403f2d0 con 0x7f215409e930 2023-10-03T10:19:23.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.102+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2154074ea0 con 0x7f215409e930 2023-10-03T10:19:23.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.107+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21440123b0 con 0x7f215409e930 2023-10-03T10:19:23.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.315+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f215406b250 con 0x7f215409e930 2023-10-03T10:19:23.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.315+0000 7f2150ff9700 1 -- 172.21.15.19:0/2216135810 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2144011360 con 0x7f215409e930 2023-10-03T10:19:23.315 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:23.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 msgr2=0x7f215411e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f214400c520 tx=0x7f214400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:23.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 shutdown_connections 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2154136fe0 0x7f215411ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f215409e930 0x7f215411e3b0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 --2- 172.21.15.19:0/2216135810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f215409f410 0x7f215411e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 >> 172.21.15.19:0/2216135810 conn(0x7f21540a4210 msgr2=0x7f2154134890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 shutdown_connections 2023-10-03T10:19:23.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.317+0000 7f215a272700 1 -- 172.21.15.19:0/2216135810 wait complete. 2023-10-03T10:19:23.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:23.716 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:23.724 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:23.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:23.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.866+0000 7f1e7bf89700 1 Processor -- start 2023-10-03T10:19:23.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 -- start start 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74139030 0x7f1e7413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7406ef30 con 0x7f1e741338a0 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7406fef0 con 0x7f1e74136710 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7bf89700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e741334b0 con 0x7f1e74139030 2023-10-03T10:19:23.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e79524700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e79d25700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1e741338a0 0x7f1e74133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43748/0 (socket says 172.21.15.19:43748) 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e79524700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55906/0 (socket says 172.21.15.19:55906) 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e79d25700 1 -- 172.21.15.19:0/3628662171 learned_addr learned my addr 172.21.15.19:0/3628662171 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.867+0000 7f1e7a526700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74139030 0x7f1e7413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e79524700 1 -- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74139030 msgr2=0x7f1e7413b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e79524700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74139030 0x7f1e7413b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e79524700 1 -- 172.21.15.19:0/3628662171 >> v1:172.21.15.19:6789/0 conn(0x7f1e741338a0 legacy=0x7f1e74133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e79524700 1 -- 172.21.15.19:0/3628662171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7406fc30 con 0x7f1e74136710 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e79524700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009870 tx=0x7f1e64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a169c1d7c84a00 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e78d23700 1 -- 172.21.15.19:0/3628662171 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64004230 con 0x7f1e74136710 2023-10-03T10:19:23.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e78d23700 1 -- 172.21.15.19:0/3628662171 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e64004390 con 0x7f1e74136710 2023-10-03T10:19:23.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.868+0000 7f1e78d23700 1 -- 172.21.15.19:0/3628662171 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640036a0 con 0x7f1e74136710 2023-10-03T10:19:23.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 msgr2=0x7f1e74138af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009870 tx=0x7f1e64009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:23.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3628662171 shutdown_connections 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74139030 0x7f1e7413b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3628662171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e74136710 0x7f1e74138af0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3628662171 >> 172.21.15.19:0/3628662171 conn(0x7f1e740a2aa0 msgr2=0x7f1e740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3628662171 shutdown_connections 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.869+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3628662171 wait complete. 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.870+0000 7f1e7bf89700 1 Processor -- start 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 -- start start 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e741338a0 0x7f1e7412ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e74139030 0x7f1e74119f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74138bc0 con 0x7f1e74139030 2023-10-03T10:19:23.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7411e280 con 0x7f1e741338a0 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e7bf89700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7406f640 con 0x7f1e74136710 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e79524700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e79524700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59840/0 (socket says 172.21.15.19:59840) 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e79524700 1 -- 172.21.15.19:0/3266975298 learned_addr learned my addr 172.21.15.19:0/3266975298 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.871+0000 7f1e79d25700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e741338a0 0x7f1e7412ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e7a526700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e74139030 0x7f1e74119f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 -- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e741338a0 msgr2=0x7f1e7412ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e741338a0 0x7f1e7412ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 -- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e74139030 msgr2=0x7f1e74119f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e74139030 0x7f1e74119f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 -- 172.21.15.19:0/3266975298 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640094a0 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e79524700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1e74066c30 tx=0x7f1e64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e64011630 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6401f070 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7411d330 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640119f0 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.872+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7412f690 con 0x7f1e74136710 2023-10-03T10:19:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.873+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1e64011b50 con 0x7f1e74136710 2023-10-03T10:19:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.873+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74074ea0 con 0x7f1e74136710 2023-10-03T10:19:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.874+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1e64021070 con 0x7f1e74136710 2023-10-03T10:19:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.883+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1e64010380 con 0x7f1e74136710 2023-10-03T10:19:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.906+0000 7f4daf14f700 1 Processor -- start 2023-10-03T10:19:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.906+0000 7f4daf14f700 1 -- start start 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daf14f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daf14f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daf14f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da809f130 con 0x7f4da809e410 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daf14f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da809f520 con 0x7f4da809e000 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daf14f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da809e930 con 0x7f4da809d6f0 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daceeb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daceeb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55922/0 (socket says 172.21.15.19:55922) 2023-10-03T10:19:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4daceeb700 1 -- 172.21.15.19:0/3212495135 learned_addr learned my addr 172.21.15.19:0/3212495135 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.907+0000 7f4da7fff700 1 --2- 172.21.15.19:0/3212495135 >> v2:172.21.15.19:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4daceeb700 1 -- 172.21.15.19:0/3212495135 >> v2:172.21.15.19:3300/0 conn(0x7f4da809e000 msgr2=0x7f4da8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4daceeb700 1 --2- 172.21.15.19:0/3212495135 >> v2:172.21.15.19:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4daceeb700 1 -- 172.21.15.19:0/3212495135 >> v1:172.21.15.19:6789/0 conn(0x7f4da809e410 legacy=0x7f4da8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4daceeb700 1 -- 172.21.15.19:0/3212495135 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da809b2d0 con 0x7f4da809d6f0 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4daceeb700 1 --2- 172.21.15.19:0/3212495135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0098f0 tx=0x7f4d9c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95225dbfb1eabe05 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4da77fe700 1 -- 172.21.15.19:0/3212495135 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c004230 con 0x7f4da809d6f0 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4da77fe700 1 -- 172.21.15.19:0/3212495135 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c004390 con 0x7f4da809d6f0 2023-10-03T10:19:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.908+0000 7f4da77fe700 1 -- 172.21.15.19:0/3212495135 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c0036a0 con 0x7f4da809d6f0 2023-10-03T10:19:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 -- 172.21.15.19:0/3212495135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 msgr2=0x7f4da809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3212495135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0098f0 tx=0x7f4d9c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 -- 172.21.15.19:0/3212495135 shutdown_connections 2023-10-03T10:19:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3212495135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809d6f0 0x7f4da809dac0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3212495135 >> v2:172.21.15.19:3300/0 conn(0x7f4da809e000 0x7f4da8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 -- 172.21.15.19:0/3212495135 >> 172.21.15.19:0/3212495135 conn(0x7f4da8066f50 msgr2=0x7f4da809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 -- 172.21.15.19:0/3212495135 shutdown_connections 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.909+0000 7f4daf14f700 1 -- 172.21.15.19:0/3212495135 wait complete. 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.910+0000 7f4daf14f700 1 Processor -- start 2023-10-03T10:19:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.910+0000 7f4daf14f700 1 -- start start 2023-10-03T10:19:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4da809d6f0 0x7f4da812dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 0x7f4da812e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8131d10 con 0x7f4da809d6f0 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da812f940 con 0x7f4da809e410 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4daf14f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8131670 con 0x7f4da809e000 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.911+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59846/0 (socket says 172.21.15.19:59846) 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 -- 172.21.15.19:0/3241047774 learned_addr learned my addr 172.21.15.19:0/3241047774 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4dad6ec700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 0x7f4da812e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4daceeb700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4da809d6f0 0x7f4da812dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 -- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 msgr2=0x7f4da812e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 0x7f4da812e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 -- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4da809d6f0 msgr2=0x7f4da812dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4da809d6f0 0x7f4da812dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 -- 172.21.15.19:0/3241047774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c009550 con 0x7f4da809e000 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4dad6ec700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 0x7f4da812e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da7fff700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e980 tx=0x7f4d9400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94009710 con 0x7f4da809e000 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9400c690 con 0x7f4da809e000 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.912+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9400ca20 con 0x7f4da809e000 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.913+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da81393f0 con 0x7f4da809e000 2023-10-03T10:19:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.913+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da81323a0 con 0x7f4da809e000 2023-10-03T10:19:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.913+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4d9400cb80 con 0x7f4da809e000 2023-10-03T10:19:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.914+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4d9403f6b0 con 0x7f4da809e000 2023-10-03T10:19:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.914+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da8131b50 con 0x7f4da809e000 2023-10-03T10:19:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.919+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4da8131b50 con 0x7f4da809e000 2023-10-03T10:19:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.950+0000 7f0130277700 1 Processor -- start 2023-10-03T10:19:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.950+0000 7f0130277700 1 -- start start 2023-10-03T10:19:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f0130277700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f0130277700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 0x7f01281317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f0130277700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0128070940 con 0x7f012809f650 2023-10-03T10:19:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f0130277700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012806fd60 con 0x7f012809f240 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f0130277700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f012806fa80 con 0x7f012809e930 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f012e013700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f012e013700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59862/0 (socket says 172.21.15.19:59862) 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f012e013700 1 -- 172.21.15.19:0/2246243171 learned_addr learned my addr 172.21.15.19:0/2246243171 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f012e814700 1 --1- 172.21.15.19:0/2246243171 >> v1:172.21.15.19:6789/0 conn(0x7f012809f650 0x7f0128131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43768/0 (socket says 172.21.15.19:43768) 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.951+0000 7f012d812700 1 --2- 172.21.15.19:0/2246243171 >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 0x7f01281317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012d011700 1 -- 172.21.15.19:0/2246243171 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458778949 0 0) 0x7f0128070940 con 0x7f012809f650 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012e013700 1 -- 172.21.15.19:0/2246243171 >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 msgr2=0x7f01281317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012e013700 1 --2- 172.21.15.19:0/2246243171 >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 0x7f01281317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012e013700 1 -- 172.21.15.19:0/2246243171 >> v1:172.21.15.19:6789/0 conn(0x7f012809f650 legacy=0x7f0128131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012e013700 1 -- 172.21.15.19:0/2246243171 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012809fb60 con 0x7f012809e930 2023-10-03T10:19:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012d812700 1 --2- 172.21.15.19:0/2246243171 >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 0x7f01281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012e013700 1 --2- 172.21.15.19:0/2246243171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f01240098f0 tx=0x7f0124009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee40f77e9d710c97 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012d011700 1 -- 172.21.15.19:0/2246243171 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124011830 con 0x7f012809e930 2023-10-03T10:19:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012d011700 1 -- 172.21.15.19:0/2246243171 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0124011990 con 0x7f012809e930 2023-10-03T10:19:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.952+0000 7f012d011700 1 -- 172.21.15.19:0/2246243171 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124011d20 con 0x7f012809e930 2023-10-03T10:19:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 -- 172.21.15.19:0/2246243171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 msgr2=0x7f012809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 --2- 172.21.15.19:0/2246243171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f01240098f0 tx=0x7f0124009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 -- 172.21.15.19:0/2246243171 shutdown_connections 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 --2- 172.21.15.19:0/2246243171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809e930 0x7f012809ed00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 --2- 172.21.15.19:0/2246243171 >> v2:172.21.15.19:3300/0 conn(0x7f012809f240 0x7f01281317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 -- 172.21.15.19:0/2246243171 >> 172.21.15.19:0/2246243171 conn(0x7f01280a4210 msgr2=0x7f01280a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 -- 172.21.15.19:0/2246243171 shutdown_connections 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.953+0000 7f0130277700 1 -- 172.21.15.19:0/2246243171 wait complete. 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.954+0000 7f0130277700 1 Processor -- start 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.954+0000 7f0130277700 1 -- start start 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 0x7f01281c2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 0x7f01281c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281a7410 con 0x7f012809f240 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01281a6950 con 0x7f012809e930 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f0130277700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f01281c38a0 con 0x7f012809f650 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012d812700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012d812700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34192/0 (socket says 172.21.15.19:34192) 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012d812700 1 -- 172.21.15.19:0/3570429642 learned_addr learned my addr 172.21.15.19:0/3570429642 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 0x7f01281c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e013700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 0x7f01281c2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 -- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 msgr2=0x7f01281c2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 0x7f01281c2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 -- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 msgr2=0x7f01281c3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 -- 172.21.15.19:0/3570429642 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01180094a0 con 0x7f012809f650 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e013700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 0x7f01281c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012d812700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.955+0000 7f012e814700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 0x7f01281c5e40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f012000cc10 tx=0x7f012000cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.956+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000ab10 con 0x7f012809f650 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.956+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012000ac70 con 0x7f012809f650 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.956+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200070d0 con 0x7f012809f650 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.956+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0124009550 con 0x7f012809f650 2023-10-03T10:19:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.956+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01280a0190 con 0x7f012809f650 2023-10-03T10:19:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.957+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0120007230 con 0x7f012809f650 2023-10-03T10:19:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.957+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f012003f170 con 0x7f012809f650 2023-10-03T10:19:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.957+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01280a3260 con 0x7f012809f650 2023-10-03T10:19:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:23.962+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0120018030 con 0x7f012809f650 2023-10-03T10:19:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.093+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1e74074ea0 con 0x7f1e74136710 2023-10-03T10:19:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.094+0000 7f1e6a7fc700 1 -- 172.21.15.19:0/3266975298 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1e6402b030 con 0x7f1e74136710 2023-10-03T10:19:24.093 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 msgr2=0x7f1e7412f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1e74066c30 tx=0x7f1e64004750 comp rx=0 tx=0).stop 2023-10-03T10:19:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 shutdown_connections 2023-10-03T10:19:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e74139030 0x7f1e74119f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1e741338a0 0x7f1e7412ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 --2- 172.21.15.19:0/3266975298 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1e74136710 0x7f1e7412f150 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 >> 172.21.15.19:0/3266975298 conn(0x7f1e740a2aa0 msgr2=0x7f1e74130050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 shutdown_connections 2023-10-03T10:19:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.096+0000 7f1e7bf89700 1 -- 172.21.15.19:0/3266975298 wait complete. 2023-10-03T10:19:24.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.128+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4da8131b50 con 0x7f4da809e000 2023-10-03T10:19:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.128+0000 7f4da57fa700 1 -- 172.21.15.19:0/3241047774 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4da8131b50 con 0x7f4da809e000 2023-10-03T10:19:24.128 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.130+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 msgr2=0x7f4da812e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.130+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400e980 tx=0x7f4d9400ec90 comp rx=0 tx=0).stop 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 shutdown_connections 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4da809e410 0x7f4da812e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4da809d6f0 0x7f4da812dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 --2- 172.21.15.19:0/3241047774 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4da809e000 0x7f4da812e2b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 >> 172.21.15.19:0/3241047774 conn(0x7f4da8066f50 msgr2=0x7f4da806a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 shutdown_connections 2023-10-03T10:19:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.131+0000 7f4daf14f700 1 -- 172.21.15.19:0/3241047774 wait complete. 2023-10-03T10:19:24.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.170+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0128074ea0 con 0x7f012809f650 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.171+0000 7f011effd700 1 -- 172.21.15.19:0/3570429642 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f01200074e0 con 0x7f012809f650 2023-10-03T10:19:24.171 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 msgr2=0x7f01281c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 0x7f01281c5e40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f012000cc10 tx=0x7f012000cf20 comp rx=0 tx=0).stop 2023-10-03T10:19:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 shutdown_connections 2023-10-03T10:19:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f012809f650 0x7f01281c5e40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f012809e930 0x7f01281c2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 --2- 172.21.15.19:0/3570429642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f012809f240 0x7f01281c3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 >> 172.21.15.19:0/3570429642 conn(0x7f01280a4210 msgr2=0x7f01281b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 shutdown_connections 2023-10-03T10:19:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.173+0000 7f0130277700 1 -- 172.21.15.19:0/3570429642 wait complete. 2023-10-03T10:19:24.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:24.332 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.475+0000 7f8326bd8700 1 Processor -- start 2023-10-03T10:19:24.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.475+0000 7f8326bd8700 1 -- start start 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.475+0000 7f8326bd8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8326bd8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8326bd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009e410 0x7f8320130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8326bd8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832009f520 con 0x7f832009d6f0 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8326bd8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832009f130 con 0x7f832009e000 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8326bd8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f832009e930 con 0x7f832009e410 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8324974700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8325175700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009e410 0x7f8320130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8324974700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34194/0 (socket says 172.21.15.19:34194) 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55940/0 (socket says 172.21.15.19:55940) 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8324974700 1 -- 172.21.15.19:0/4148710634 learned_addr learned my addr 172.21.15.19:0/4148710634 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 -- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009e410 msgr2=0x7f8320130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 --2- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009e410 0x7f8320130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 -- 172.21.15.19:0/4148710634 >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 msgr2=0x7f832009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 --2- 172.21.15.19:0/4148710634 >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 -- 172.21.15.19:0/4148710634 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832009b2d0 con 0x7f832009e000 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f8324974700 1 --2- 172.21.15.19:0/4148710634 >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831ffff700 1 --2- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f830c009840 tx=0x7f830c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a63f0d72522f60d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831f7fe700 1 -- 172.21.15.19:0/4148710634 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011830 con 0x7f832009e000 2023-10-03T10:19:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831f7fe700 1 -- 172.21.15.19:0/4148710634 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c011990 con 0x7f832009e000 2023-10-03T10:19:24.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.476+0000 7f831f7fe700 1 -- 172.21.15.19:0/4148710634 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c011d20 con 0x7f832009e000 2023-10-03T10:19:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 -- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 msgr2=0x7f8320130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 --2- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f830c009840 tx=0x7f830c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 -- 172.21.15.19:0/4148710634 shutdown_connections 2023-10-03T10:19:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 --2- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009e410 0x7f8320130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 --2- 172.21.15.19:0/4148710634 >> v2:172.21.15.19:3300/0 conn(0x7f832009d6f0 0x7f832009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 --2- 172.21.15.19:0/4148710634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e000 0x7f8320130660 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 -- 172.21.15.19:0/4148710634 >> 172.21.15.19:0/4148710634 conn(0x7f8320066f50 msgr2=0x7f832009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 -- 172.21.15.19:0/4148710634 shutdown_connections 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.477+0000 7f8326bd8700 1 -- 172.21.15.19:0/4148710634 wait complete. 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.478+0000 7f8326bd8700 1 Processor -- start 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.478+0000 7f8326bd8700 1 -- start start 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 0x7f83201c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 0x7f83201c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:24.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320120060 con 0x7f832009e000 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8320125ae0 con 0x7f832009e410 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8326bd8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8320125770 con 0x7f832009d6f0 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8324974700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 0x7f83201c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34204/0 (socket says 172.21.15.19:34204) 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8324974700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 0x7f83201c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:59878/0 (socket says 172.21.15.19:59878) 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8325175700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 0x7f83201c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 -- 172.21.15.19:0/65959113 learned_addr learned my addr 172.21.15.19:0/65959113 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:24.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 -- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 msgr2=0x7f83201c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 0x7f83201c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 -- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 msgr2=0x7f83201c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 0x7f83201c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f831ffff700 1 -- 172.21.15.19:0/65959113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314009550 con 0x7f832009e000 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.479+0000 7f8325175700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 0x7f83201c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f831ffff700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f830c009fd0 tx=0x7f830c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c004450 con 0x7f832009e000 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c01f070 con 0x7f832009e000 2023-10-03T10:19:24.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830c0094a0 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c0038e0 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.480+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832006a9e0 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.481+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f830c003a40 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.481+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8320074ea0 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.481+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f830c021070 con 0x7f832009e000 2023-10-03T10:19:24.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.486+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f830c015030 con 0x7f832009e000 2023-10-03T10:19:24.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.695+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8320120240 con 0x7f832009e000 2023-10-03T10:19:24.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.696+0000 7f831d7fa700 1 -- 172.21.15.19:0/65959113 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f830c026480 con 0x7f832009e000 2023-10-03T10:19:24.696 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:24.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 msgr2=0x7f83201c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:24.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f830c009fd0 tx=0x7f830c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:24.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 shutdown_connections 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f832009e410 0x7f83201c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f832009d6f0 0x7f83201c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 --2- 172.21.15.19:0/65959113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f832009e000 0x7f83201c89c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 >> 172.21.15.19:0/65959113 conn(0x7f8320066f50 msgr2=0x7f8320119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 shutdown_connections 2023-10-03T10:19:24.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:24.698+0000 7f8326bd8700 1 -- 172.21.15.19:0/65959113 wait complete. 2023-10-03T10:19:24.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:25.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:25.145 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:25.187 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:25.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.269+0000 7fe183281700 1 Processor -- start 2023-10-03T10:19:25.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.269+0000 7fe183281700 1 -- start start 2023-10-03T10:19:25.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe183281700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 0x7fe17c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe183281700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 0x7fe17c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe183281700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0a2a70 con 0x7fe17c09d630 2023-10-03T10:19:25.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe183281700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0a01d0 con 0x7fe17c138d80 2023-10-03T10:19:25.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe183281700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c09e2b0 con 0x7fe17c0a0a30 2023-10-03T10:19:25.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe18101d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 0x7fe17c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe18081c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe17c09d630 0x7fe17c0a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43784/0 (socket says 172.21.15.19:43784) 2023-10-03T10:19:25.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe18081c700 1 -- 172.21.15.19:0/547295981 learned_addr learned my addr 172.21.15.19:0/547295981 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:25.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.270+0000 7fe18181e700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 0x7fe17c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18101d700 1 -- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 msgr2=0x7fe17c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18101d700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 0x7fe17c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18101d700 1 -- 172.21.15.19:0/547295981 >> v1:172.21.15.19:6789/0 conn(0x7fe17c09d630 legacy=0x7fe17c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18101d700 1 -- 172.21.15.19:0/547295981 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c09dc50 con 0x7fe17c0a0a30 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18181e700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 0x7fe17c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe18101d700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 0x7fe17c0a0e00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe178009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341254e56ebeb38d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe173fff700 1 -- 172.21.15.19:0/547295981 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178004230 con 0x7fe17c0a0a30 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe173fff700 1 -- 172.21.15.19:0/547295981 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178004390 con 0x7fe17c0a0a30 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.271+0000 7fe173fff700 1 -- 172.21.15.19:0/547295981 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1780036a0 con 0x7fe17c0a0a30 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 -- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 msgr2=0x7fe17c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 0x7fe17c0a0e00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe178009870 tx=0x7fe178009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 -- 172.21.15.19:0/547295981 shutdown_connections 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c138d80 0x7fe17c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 --2- 172.21.15.19:0/547295981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c0a0a30 0x7fe17c0a0e00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 -- 172.21.15.19:0/547295981 >> 172.21.15.19:0/547295981 conn(0x7fe17c0a3050 msgr2=0x7fe17c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 -- 172.21.15.19:0/547295981 shutdown_connections 2023-10-03T10:19:25.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.272+0000 7fe183281700 1 -- 172.21.15.19:0/547295981 wait complete. 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 Processor -- start 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 -- start start 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c0a0a30 0x7fe17c11d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 0x7fe17c11df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1202c0 con 0x7fe17c09d630 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c11e8e0 con 0x7fe17c0a0a30 2023-10-03T10:19:25.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.274+0000 7fe183281700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c11f860 con 0x7fe17c138d80 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34218/0 (socket says 172.21.15.19:34218) 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 -- 172.21.15.19:0/3228738585 learned_addr learned my addr 172.21.15.19:0/3228738585 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18181e700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 0x7fe17c11df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18081c700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c0a0a30 0x7fe17c11d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 -- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 msgr2=0x7fe17c11df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 0x7fe17c11df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 -- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c0a0a30 msgr2=0x7fe17c11d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c0a0a30 0x7fe17c11d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 -- 172.21.15.19:0/3228738585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009a70 con 0x7fe17c09d630 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18181e700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 0x7fe17c11df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe18101d700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0a0360 tx=0x7fe178004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.275+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178003cd0 con 0x7fe17c09d630 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.276+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17801f070 con 0x7fe17c09d630 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.276+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780094a0 con 0x7fe17c09d630 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.276+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178011870 con 0x7fe17c09d630 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.276+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c0a0410 con 0x7fe17c09d630 2023-10-03T10:19:25.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.277+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe178021030 con 0x7fe17c09d630 2023-10-03T10:19:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.277+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe1780407d0 con 0x7fe17c09d630 2023-10-03T10:19:25.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.277+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c0747f0 con 0x7fe17c09d630 2023-10-03T10:19:25.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.282+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe1780119d0 con 0x7fe17c09d630 2023-10-03T10:19:25.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.307+0000 7fa7362de700 1 Processor -- start 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.307+0000 7fa7362de700 1 -- start start 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa7362de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa7362de700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa7362de700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73009a810 con 0x7fa73006a770 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa7362de700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73006ab40 con 0x7fa73013d1f0 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa7362de700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73009ebc0 con 0x7fa73009de00 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa72f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa72ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa73006a770 0x7fa73009d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43786/0 (socket says 172.21.15.19:43786) 2023-10-03T10:19:25.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa72ffff700 1 -- 172.21.15.19:0/2046139097 learned_addr learned my addr 172.21.15.19:0/2046139097 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:25.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa73487b700 1 --2- 172.21.15.19:0/2046139097 >> v2:172.21.15.19:3300/0 conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.308+0000 7fa72f7fe700 1 -- 172.21.15.19:0/2046139097 >> v2:172.21.15.19:3300/0 conn(0x7fa73013d1f0 msgr2=0x7fa73013f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72f7fe700 1 --2- 172.21.15.19:0/2046139097 >> v2:172.21.15.19:3300/0 conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72f7fe700 1 -- 172.21.15.19:0/2046139097 >> v1:172.21.15.19:6789/0 conn(0x7fa73006a770 legacy=0x7fa73009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72f7fe700 1 -- 172.21.15.19:0/2046139097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73009e920 con 0x7fa73009de00 2023-10-03T10:19:25.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72f7fe700 1 --2- 172.21.15.19:0/2046139097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 0x7fa73009e250 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa724009840 tx=0x7fa724009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39d6eb9c32b1ef5e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72effd700 1 -- 172.21.15.19:0/2046139097 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724011830 con 0x7fa73009de00 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72effd700 1 -- 172.21.15.19:0/2046139097 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa724011990 con 0x7fa73009de00 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.309+0000 7fa72effd700 1 -- 172.21.15.19:0/2046139097 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa724011d20 con 0x7fa73009de00 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 -- 172.21.15.19:0/2046139097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 msgr2=0x7fa73009e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 --2- 172.21.15.19:0/2046139097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 0x7fa73009e250 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa724009840 tx=0x7fa724009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 -- 172.21.15.19:0/2046139097 shutdown_connections 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 --2- 172.21.15.19:0/2046139097 >> v2:172.21.15.19:3300/0 conn(0x7fa73013d1f0 0x7fa73013f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 --2- 172.21.15.19:0/2046139097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73009de00 0x7fa73009e250 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 -- 172.21.15.19:0/2046139097 >> 172.21.15.19:0/2046139097 conn(0x7fa730066f50 msgr2=0x7fa73009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 -- 172.21.15.19:0/2046139097 shutdown_connections 2023-10-03T10:19:25.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.310+0000 7fa7362de700 1 -- 172.21.15.19:0/2046139097 wait complete. 2023-10-03T10:19:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.311+0000 7fa7362de700 1 Processor -- start 2023-10-03T10:19:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.311+0000 7fa7362de700 1 -- start start 2023-10-03T10:19:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 0x7fa73013b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73009de00 0x7fa73013bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 0x7fa73013c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730135ee0 con 0x7fa73006a770 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73011f110 con 0x7fa73013d1f0 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa7362de700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa73011e8a0 con 0x7fa73009de00 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa72ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 0x7fa73013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 0x7fa73013c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa72ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 0x7fa73013b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34234/0 (socket says 172.21.15.19:34234) 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa72ffff700 1 -- 172.21.15.19:0/167958968 learned_addr learned my addr 172.21.15.19:0/167958968 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa72f7fe700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73009de00 0x7fa73013bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 -- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73009de00 msgr2=0x7fa73013bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73009de00 0x7fa73013bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 -- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 msgr2=0x7fa73013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 0x7fa73013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 -- 172.21.15.19:0/167958968 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240094a0 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa73487b700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 0x7fa73013c200 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d90 tx=0x7fa72800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.312+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728009c00 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.313+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72800f040 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.313+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73009f1a0 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.313+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa728014480 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.313+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73011e450 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.313+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa7280145e0 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.314+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa7280401d0 con 0x7fa73013d1f0 2023-10-03T10:19:25.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.314+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa73013d060 con 0x7fa73013d1f0 2023-10-03T10:19:25.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.319+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa728007900 con 0x7fa73013d1f0 2023-10-03T10:19:25.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.361+0000 7fb79f16b700 1 Processor -- start 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 -- start start 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 0x7fb798135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 0x7fb798138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb79809f130 con 0x7fb79809d6f0 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79809f520 con 0x7fb798135e50 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79f16b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79809e930 con 0x7fb79809e1d0 2023-10-03T10:19:25.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb797fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 0x7fb798135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79cf07700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb79809d6f0 0x7fb79809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43800/0 (socket says 172.21.15.19:43800) 2023-10-03T10:19:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79cf07700 1 -- 172.21.15.19:0/2014604545 learned_addr learned my addr 172.21.15.19:0/2014604545 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:25.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.362+0000 7fb79d708700 1 --2- 172.21.15.19:0/2014604545 >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 0x7fb798138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb797fff700 1 -- 172.21.15.19:0/2014604545 >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 msgr2=0x7fb798138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb797fff700 1 --2- 172.21.15.19:0/2014604545 >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 0x7fb798138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb797fff700 1 -- 172.21.15.19:0/2014604545 >> v1:172.21.15.19:6789/0 conn(0x7fb79809d6f0 legacy=0x7fb79809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb797fff700 1 -- 172.21.15.19:0/2014604545 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79809b2d0 con 0x7fb79809e1d0 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb79d708700 1 --2- 172.21.15.19:0/2014604545 >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 0x7fb798138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb797fff700 1 --2- 172.21.15.19:0/2014604545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 0x7fb798135910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb78400bb10 tx=0x7fb78400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783b6e0eaa8140e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb7977fe700 1 -- 172.21.15.19:0/2014604545 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400dc30 con 0x7fb79809e1d0 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb7977fe700 1 -- 172.21.15.19:0/2014604545 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78400dd90 con 0x7fb79809e1d0 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.363+0000 7fb7977fe700 1 -- 172.21.15.19:0/2014604545 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb784010690 con 0x7fb79809e1d0 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 -- 172.21.15.19:0/2014604545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 msgr2=0x7fb798135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 --2- 172.21.15.19:0/2014604545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 0x7fb798135910 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb78400bb10 tx=0x7fb78400be20 comp rx=0 tx=0).stop 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 -- 172.21.15.19:0/2014604545 shutdown_connections 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 --2- 172.21.15.19:0/2014604545 >> v2:172.21.15.19:3300/0 conn(0x7fb798135e50 0x7fb798138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 --2- 172.21.15.19:0/2014604545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809e1d0 0x7fb798135910 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 -- 172.21.15.19:0/2014604545 >> 172.21.15.19:0/2014604545 conn(0x7fb798066f50 msgr2=0x7fb79809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 -- 172.21.15.19:0/2014604545 shutdown_connections 2023-10-03T10:19:25.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.364+0000 7fb79f16b700 1 -- 172.21.15.19:0/2014604545 wait complete. 2023-10-03T10:19:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 Processor -- start 2023-10-03T10:19:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 -- start start 2023-10-03T10:19:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 0x7fb79811e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79809e1d0 0x7fb79811e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 0x7fb7981c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798121250 con 0x7fb79809e1d0 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb798130380 con 0x7fb79809d6f0 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.365+0000 7fb79f16b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7980a1d00 con 0x7fb798135e50 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79cf07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 0x7fb79811e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 0x7fb7981c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79cf07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 0x7fb79811e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:56022/0 (socket says 172.21.15.19:56022) 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79cf07700 1 -- 172.21.15.19:0/66713868 learned_addr learned my addr 172.21.15.19:0/66713868 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb797fff700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79809e1d0 0x7fb79811e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 -- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 msgr2=0x7fb79811e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 0x7fb79811e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 -- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79809e1d0 msgr2=0x7fb79811e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79809e1d0 0x7fb79811e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 -- 172.21.15.19:0/66713868 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb790009a70 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79d708700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 0x7fb7981c8460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb79000ef90 tx=0x7fb79000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79000cc90 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000f040 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.366+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78400b740 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.367+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790014480 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.367+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb79811ee90 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.367+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb790014600 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.367+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb79003fe90 con 0x7fb798135e50 2023-10-03T10:19:25.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.368+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb798121390 con 0x7fb798135e50 2023-10-03T10:19:25.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.373+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb79006b750 con 0x7fb798135e50 2023-10-03T10:19:25.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.499+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe17c0747f0 con 0x7fe17c09d630 2023-10-03T10:19:25.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.499+0000 7fe171ffb700 1 -- 172.21.15.19:0/3228738585 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe17801b440 con 0x7fe17c09d630 2023-10-03T10:19:25.499 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.501+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 msgr2=0x7fe17c11d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.501+0000 7fe183281700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0a0360 tx=0x7fe178004750 comp rx=0 tx=0).stop 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 shutdown_connections 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe17c138d80 0x7fe17c11df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe17c09d630 0x7fe17c11d480 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 --2- 172.21.15.19:0/3228738585 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe17c0a0a30 0x7fe17c11d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 >> 172.21.15.19:0/3228738585 conn(0x7fe17c0a3050 msgr2=0x7fe17c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 shutdown_connections 2023-10-03T10:19:25.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.502+0000 7fe183281700 1 -- 172.21.15.19:0/3228738585 wait complete. 2023-10-03T10:19:25.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.543+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa730074ea0 con 0x7fa73013d1f0 2023-10-03T10:19:25.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.544+0000 7fa72cff9700 1 -- 172.21.15.19:0/167958968 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa72802c090 con 0x7fa73013d1f0 2023-10-03T10:19:25.544 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:25.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 msgr2=0x7fa73013c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 0x7fa73013c200 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa728009d90 tx=0x7fa72800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 shutdown_connections 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa73013d1f0 0x7fa73013c200 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa73006a770 0x7fa73013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 --2- 172.21.15.19:0/167958968 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa73009de00 0x7fa73013bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.546+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 >> 172.21.15.19:0/167958968 conn(0x7fa730066f50 msgr2=0x7fa73009b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.547+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 shutdown_connections 2023-10-03T10:19:25.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.547+0000 7fa7362de700 1 -- 172.21.15.19:0/167958968 wait complete. 2023-10-03T10:19:25.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:25.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.579+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb79804ea50 con 0x7fb798135e50 2023-10-03T10:19:25.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.579+0000 7fb7957fa700 1 -- 172.21.15.19:0/66713868 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb798121390 con 0x7fb798135e50 2023-10-03T10:19:25.579 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.582+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 msgr2=0x7fb7981c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.582+0000 7fb79f16b700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 0x7fb7981c8460 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb79000ef90 tx=0x7fb79000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 shutdown_connections 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb798135e50 0x7fb7981c8460 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb79809d6f0 0x7fb79811e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 --2- 172.21.15.19:0/66713868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb79809e1d0 0x7fb79811e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 >> 172.21.15.19:0/66713868 conn(0x7fb798066f50 msgr2=0x7fb7980a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 shutdown_connections 2023-10-03T10:19:25.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.583+0000 7fb79f16b700 1 -- 172.21.15.19:0/66713868 wait complete. 2023-10-03T10:19:25.596 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:25.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:25.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.901+0000 7f5bc2c6d700 1 Processor -- start 2023-10-03T10:19:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.901+0000 7f5bc2c6d700 1 -- start start 2023-10-03T10:19:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc2c6d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc2c6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc2c6d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc09b120 con 0x7f5bbc09e410 2023-10-03T10:19:25.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc2c6d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc06b460 con 0x7f5bbc09d6f0 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc2c6d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc09a7e0 con 0x7f5bbc09e000 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc0a09700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc120a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5bbc09e410 0x7f5bbc133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:43812/0 (socket says 172.21.15.19:43812) 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bc120a700 1 -- 172.21.15.19:0/1081894690 learned_addr learned my addr 172.21.15.19:0/1081894690 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:25.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bbbfff700 1 -- 172.21.15.19:0/1081894690 >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 msgr2=0x7f5bbc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.902+0000 7f5bbbfff700 1 --2- 172.21.15.19:0/1081894690 >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbbfff700 1 -- 172.21.15.19:0/1081894690 >> v1:172.21.15.19:6789/0 conn(0x7f5bbc09e410 legacy=0x7f5bbc133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbbfff700 1 -- 172.21.15.19:0/1081894690 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc09a500 con 0x7f5bbc09e000 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc0a09700 1 --2- 172.21.15.19:0/1081894690 >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbbfff700 1 --2- 172.21.15.19:0/1081894690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009870 tx=0x7f5ba4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e08c7ff2ce19cc10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbb7fe700 1 -- 172.21.15.19:0/1081894690 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4011830 con 0x7f5bbc09e000 2023-10-03T10:19:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbb7fe700 1 -- 172.21.15.19:0/1081894690 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba4011990 con 0x7f5bbc09e000 2023-10-03T10:19:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bbb7fe700 1 -- 172.21.15.19:0/1081894690 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4011d20 con 0x7f5bbc09e000 2023-10-03T10:19:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/1081894690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 msgr2=0x7f5bbc1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/1081894690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4009870 tx=0x7f5ba4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:25.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/1081894690 shutdown_connections 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/1081894690 >> v2:172.21.15.19:3300/0 conn(0x7f5bbc09d6f0 0x7f5bbc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/1081894690 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09e000 0x7f5bbc1339f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/1081894690 >> 172.21.15.19:0/1081894690 conn(0x7f5bbc066f50 msgr2=0x7f5bbc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.903+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/1081894690 shutdown_connections 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.904+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/1081894690 wait complete. 2023-10-03T10:19:25.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.904+0000 7f5bc2c6d700 1 Processor -- start 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 -- start start 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 0x7f5bbc1a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1a7490 con 0x7f5bbc09e410 2023-10-03T10:19:25.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1a7ba0 con 0x7f5bbc09e000 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc2c6d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1a8df0 con 0x7f5bbc09d6f0 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc120a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bbbfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 0x7f5bbc1a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc120a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34284/0 (socket says 172.21.15.19:34284) 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc120a700 1 -- 172.21.15.19:0/3358435750 learned_addr learned my addr 172.21.15.19:0/3358435750 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:25.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.905+0000 7f5bc0a09700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 -- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09d6f0 msgr2=0x7f5bbc1a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 -- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 msgr2=0x7f5bbc1a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 0x7f5bbc1a6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:25.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 -- 172.21.15.19:0/3358435750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0094a0 con 0x7f5bbc09e410 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bbbfff700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 0x7f5bbc1a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc120a700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400cbf0 tx=0x7f5bb400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400aa60 con 0x7f5bbc09e410 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb400abc0 con 0x7f5bbc09e410 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba40094a0 con 0x7f5bbc09e410 2023-10-03T10:19:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4012400 con 0x7f5bbc09e410 2023-10-03T10:19:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.906+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc0a31b0 con 0x7f5bbc09e410 2023-10-03T10:19:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.907+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5bb401b3b0 con 0x7f5bbc09e410 2023-10-03T10:19:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.907+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc074ea0 con 0x7f5bbc09e410 2023-10-03T10:19:25.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.907+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5bb403f210 con 0x7f5bbc09e410 2023-10-03T10:19:25.919 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:25.912+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5bb40192c0 con 0x7f5bbc09e410 2023-10-03T10:19:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.118+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5bbc09c6d0 con 0x7f5bbc09e410 2023-10-03T10:19:26.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.118+0000 7f5bb97fa700 1 -- 172.21.15.19:0/3358435750 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5bb4017030 con 0x7f5bbc09e410 2023-10-03T10:19:26.118 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 msgr2=0x7f5bbc1a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400cbf0 tx=0x7f5bb400cf00 comp rx=0 tx=0).stop 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 shutdown_connections 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5bbc09e410 0x7f5bbc1a6a60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5bbc09d6f0 0x7f5bbc1a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 --2- 172.21.15.19:0/3358435750 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5bbc09e000 0x7f5bbc1a6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 >> 172.21.15.19:0/3358435750 conn(0x7f5bbc066f50 msgr2=0x7f5bbc1baf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 shutdown_connections 2023-10-03T10:19:26.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.121+0000 7f5bc2c6d700 1 -- 172.21.15.19:0/3358435750 wait complete. 2023-10-03T10:19:26.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:26.517 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:26.560 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:26.597 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:26.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.671+0000 7fbf45e2e700 1 Processor -- start 2023-10-03T10:19:26.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.671+0000 7fbf45e2e700 1 -- start start 2023-10-03T10:19:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf45e2e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf45e2e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbf40139170 0x7fbf4013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf45e2e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4009b120 con 0x7fbf4009d6f0 2023-10-03T10:19:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf45e2e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4006b460 con 0x7fbf40139170 2023-10-03T10:19:26.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf45e2e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4009a7e0 con 0x7fbf4009e1d0 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45774/0 (socket says 172.21.15.19:45774) 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 -- 172.21.15.19:0/3967256395 learned_addr learned my addr 172.21.15.19:0/3967256395 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3ffff700 1 --2- 172.21.15.19:0/3967256395 >> v2:172.21.15.19:3300/0 conn(0x7fbf40139170 0x7fbf4013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 -- 172.21.15.19:0/3967256395 >> v2:172.21.15.19:3300/0 conn(0x7fbf40139170 msgr2=0x7fbf4013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 --2- 172.21.15.19:0/3967256395 >> v2:172.21.15.19:3300/0 conn(0x7fbf40139170 0x7fbf4013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 -- 172.21.15.19:0/3967256395 >> v1:172.21.15.19:6789/0 conn(0x7fbf4009d6f0 legacy=0x7fbf4009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.672+0000 7fbf3effd700 1 -- 172.21.15.19:0/3967256395 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4009a500 con 0x7fbf4009e1d0 2023-10-03T10:19:26.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf3effd700 1 --2- 172.21.15.19:0/3967256395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009920 tx=0x7fbf34009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b13c3a2b0d3b604 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf3e7fc700 1 -- 172.21.15.19:0/3967256395 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011830 con 0x7fbf4009e1d0 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf3e7fc700 1 -- 172.21.15.19:0/3967256395 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34011990 con 0x7fbf4009e1d0 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf3e7fc700 1 -- 172.21.15.19:0/3967256395 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34011d20 con 0x7fbf4009e1d0 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 -- 172.21.15.19:0/3967256395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 msgr2=0x7fbf40138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/3967256395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009920 tx=0x7fbf34009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 -- 172.21.15.19:0/3967256395 shutdown_connections 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/3967256395 >> v2:172.21.15.19:3300/0 conn(0x7fbf40139170 0x7fbf4013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/3967256395 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf4009e1d0 0x7fbf40138c30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.673+0000 7fbf45e2e700 1 -- 172.21.15.19:0/3967256395 >> 172.21.15.19:0/3967256395 conn(0x7fbf40066f50 msgr2=0x7fbf4009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.674+0000 7fbf45e2e700 1 -- 172.21.15.19:0/3967256395 shutdown_connections 2023-10-03T10:19:26.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.674+0000 7fbf45e2e700 1 -- 172.21.15.19:0/3967256395 wait complete. 2023-10-03T10:19:26.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 Processor -- start 2023-10-03T10:19:26.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 -- start start 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 0x7fbf4011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf40139170 0x7fbf4011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401220a0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40120580 con 0x7fbf4009e1d0 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf45e2e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf400a20b0 con 0x7fbf40139170 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.675+0000 7fbf3f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 0x7fbf4011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43352/0 (socket says 172.21.15.19:43352) 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/1764311443 learned_addr learned my addr 172.21.15.19:0/1764311443 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3ffff700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf40139170 0x7fbf4011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf40139170 msgr2=0x7fbf4011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf40139170 0x7fbf4011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 msgr2=0x7fbf4011eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 0x7fbf4011eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 -- 172.21.15.19:0/1764311443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34009550 con 0x7fbf4009d6f0 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3effd700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 0x7fbf4011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf3f7fe700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c4e0 tx=0x7fbf3000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300052d0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30005430 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4009c710 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.676+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300038c0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.677+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf401347a0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.677+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf30003a20 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.677+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf3003ea60 con 0x7fbf4009d6f0 2023-10-03T10:19:26.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.678+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40074ea0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.683+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf30017080 con 0x7fbf4009d6f0 2023-10-03T10:19:26.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 Processor -- start 2023-10-03T10:19:26.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 -- start start 2023-10-03T10:19:26.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409d6f0 0x7f605409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f605409e000 0x7f6054130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 0x7f6054130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605409f520 con 0x7f605409e000 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605409f130 con 0x7f605409e410 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.708+0000 7f605b235700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605409e930 con 0x7f605409d6f0 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f605409e000 0x7f6054130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f60597d2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 0x7f6054130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f605409e000 0x7f6054130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43364/0 (socket says 172.21.15.19:43364) 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 -- 172.21.15.19:0/1882503847 learned_addr learned my addr 172.21.15.19:0/1882503847 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6058fd1700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409d6f0 0x7f605409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 -- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409d6f0 msgr2=0x7f605409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409d6f0 0x7f605409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 -- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 msgr2=0x7f6054130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 0x7f6054130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 -- 172.21.15.19:0/1882503847 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605409b2d0 con 0x7f605409e000 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f60597d2700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 0x7f6054130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f6053fff700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f6054130660 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f6040009920 tx=0x7f6040009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4967cb1ad4f0970d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.709+0000 7f60537fe700 1 -- 172.21.15.19:0/1882503847 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011830 con 0x7f605409e000 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f60537fe700 1 -- 172.21.15.19:0/1882503847 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040011990 con 0x7f605409e000 2023-10-03T10:19:26.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f60537fe700 1 -- 172.21.15.19:0/1882503847 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011d20 con 0x7f605409e000 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 -- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 msgr2=0x7f6054130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f6054130660 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f6040009920 tx=0x7f6040009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 -- 172.21.15.19:0/1882503847 shutdown_connections 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409e410 0x7f6054130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409d6f0 0x7f605409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 --2- 172.21.15.19:0/1882503847 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f6054130660 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 -- 172.21.15.19:0/1882503847 >> 172.21.15.19:0/1882503847 conn(0x7f6054066f50 msgr2=0x7f605409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 -- 172.21.15.19:0/1882503847 shutdown_connections 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.710+0000 7f605b235700 1 -- 172.21.15.19:0/1882503847 wait complete. 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.711+0000 7f605b235700 1 Processor -- start 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.711+0000 7f605b235700 1 -- start start 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 0x7f605411e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409e410 0x7f605411eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6054121a10 con 0x7f605409e000 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6054120120 con 0x7f605409d6f0 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f605b235700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60541211a0 con 0x7f605409e410 2023-10-03T10:19:26.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f6053fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f6053fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43368/0 (socket says 172.21.15.19:43368) 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f6058fd1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 0x7f605411e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f6053fff700 1 -- 172.21.15.19:0/3294596383 learned_addr learned my addr 172.21.15.19:0/3294596383 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.712+0000 7f60597d2700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409e410 0x7f605411eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 -- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409e410 msgr2=0x7f605411eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409e410 0x7f605411eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 -- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 msgr2=0x7f605411e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 0x7f605411e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 -- 172.21.15.19:0/3294596383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604c009a70 con 0x7f605409e000 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6058fd1700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 0x7f605411e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f6053fff700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f6040004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040004240 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604001f070 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400036a0 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6040009550 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.713+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605409c750 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.715+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60541213d0 con 0x7f605409e000 2023-10-03T10:19:26.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.715+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6040021030 con 0x7f605409e000 2023-10-03T10:19:26.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.715+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f60400409e0 con 0x7f605409e000 2023-10-03T10:19:26.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.720+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f60400237e0 con 0x7f605409e000 2023-10-03T10:19:26.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.749+0000 7f571a4cc700 1 Processor -- start 2023-10-03T10:19:26.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.749+0000 7f571a4cc700 1 -- start start 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57140a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57140a1340 0x7f5714133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 0x7f5714134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571409edd0 con 0x7f57140a1340 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571409e1f0 con 0x7f57140a0a30 2023-10-03T10:19:26.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f571a4cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f571409dc50 con 0x7f5714133fa0 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f57137fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57140a1340 0x7f5714133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f5718a69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 0x7f5714134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f57137fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57140a1340 0x7f5714133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43376/0 (socket says 172.21.15.19:43376) 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f57137fe700 1 -- 172.21.15.19:0/216527686 learned_addr learned my addr 172.21.15.19:0/216527686 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.750+0000 7f5713fff700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57140a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 -- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 msgr2=0x7f5714134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 0x7f5714134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 -- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 msgr2=0x7f57140a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57140a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 -- 172.21.15.19:0/216527686 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57140a1fe0 con 0x7f57140a1340 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f5718a69700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 0x7f5714134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f5713fff700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:26.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f57137fe700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57140a1340 0x7f5714133a60 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f57080098f0 tx=0x7f5708009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c29de6d90f3e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f5712ffd700 1 -- 172.21.15.19:0/216527686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708011830 con 0x7f57140a1340 2023-10-03T10:19:26.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f5712ffd700 1 -- 172.21.15.19:0/216527686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708011990 con 0x7f57140a1340 2023-10-03T10:19:26.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.751+0000 7f5712ffd700 1 -- 172.21.15.19:0/216527686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708011d20 con 0x7f57140a1340 2023-10-03T10:19:26.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 -- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57140a1340 msgr2=0x7f5714133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57140a1340 0x7f5714133a60 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f57080098f0 tx=0x7f5708009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 -- 172.21.15.19:0/216527686 shutdown_connections 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57140a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5714133fa0 0x7f5714134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 --2- 172.21.15.19:0/216527686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57140a1340 0x7f5714133a60 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 -- 172.21.15.19:0/216527686 >> 172.21.15.19:0/216527686 conn(0x7f57140a6550 msgr2=0x7f57140a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 -- 172.21.15.19:0/216527686 shutdown_connections 2023-10-03T10:19:26.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.752+0000 7f571a4cc700 1 -- 172.21.15.19:0/216527686 wait complete. 2023-10-03T10:19:26.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.753+0000 7f571a4cc700 1 Processor -- start 2023-10-03T10:19:26.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 -- start start 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 0x7f57141217f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5714133fa0 0x7f5714121d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714124d80 con 0x7f5714133fa0 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5714124870 con 0x7f57140a0a30 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f571a4cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5714123d00 con 0x7f57140a1340 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.754+0000 7f5713fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45486/0 (socket says 172.21.15.19:45486) 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f57137fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 0x7f57141217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 -- 172.21.15.19:0/785335803 learned_addr learned my addr 172.21.15.19:0/785335803 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5718a69700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5714133fa0 0x7f5714121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 -- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 msgr2=0x7f57141217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 0x7f57141217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 -- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5714133fa0 msgr2=0x7f5714121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5714133fa0 0x7f5714121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 -- 172.21.15.19:0/785335803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f570c009a70 con 0x7f57140a0a30 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f57137fe700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 0x7f57141217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5713fff700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f570400c750 tx=0x7f570400ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704011800 con 0x7f57140a0a30 2023-10-03T10:19:26.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704011960 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5708009550 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704011cd0 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.755+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57140a36e0 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.756+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5704021350 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.757+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f570403f5b0 con 0x7f57140a0a30 2023-10-03T10:19:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.757+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5714074ea0 con 0x7f57140a0a30 2023-10-03T10:19:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.762+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5704018db0 con 0x7f57140a0a30 2023-10-03T10:19:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.893+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf401223e0 con 0x7fbf4009d6f0 2023-10-03T10:19:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.893+0000 7fbf27fff700 1 -- 172.21.15.19:0/1764311443 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf30019e60 con 0x7fbf4009d6f0 2023-10-03T10:19:26.893 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 msgr2=0x7fbf4011e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000c4e0 tx=0x7fbf3000c7f0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 shutdown_connections 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf40139170 0x7fbf4011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf4009d6f0 0x7fbf4011e860 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 --2- 172.21.15.19:0/1764311443 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf4009e1d0 0x7fbf4011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 >> 172.21.15.19:0/1764311443 conn(0x7fbf40066f50 msgr2=0x7fbf40136c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.895+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 shutdown_connections 2023-10-03T10:19:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.896+0000 7fbf45e2e700 1 -- 172.21.15.19:0/1764311443 wait complete. 2023-10-03T10:19:26.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:26.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.928+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f60541213d0 con 0x7f605409e000 2023-10-03T10:19:26.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.929+0000 7f60517fa700 1 -- 172.21.15.19:0/3294596383 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f60541213d0 con 0x7f605409e000 2023-10-03T10:19:26.929 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 msgr2=0x7f605411e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f6040004750 comp rx=0 tx=0).stop 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 shutdown_connections 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605409e410 0x7f605411eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605409d6f0 0x7f605411e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 --2- 172.21.15.19:0/3294596383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605409e000 0x7f605411e560 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 >> 172.21.15.19:0/3294596383 conn(0x7f6054066f50 msgr2=0x7f6054070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 shutdown_connections 2023-10-03T10:19:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.932+0000 7f605b235700 1 -- 172.21.15.19:0/3294596383 wait complete. 2023-10-03T10:19:26.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.979+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5714132630 con 0x7f57140a0a30 2023-10-03T10:19:26.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.979+0000 7f5710ff9700 1 -- 172.21.15.19:0/785335803 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5704018350 con 0x7f57140a0a30 2023-10-03T10:19:26.979 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 msgr2=0x7f57141212b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f570400c750 tx=0x7f570400ca60 comp rx=0 tx=0).stop 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 shutdown_connections 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5714133fa0 0x7f5714121d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57140a0a30 0x7f57141212b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 --2- 172.21.15.19:0/785335803 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57140a1340 0x7f57141217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 >> 172.21.15.19:0/785335803 conn(0x7f57140a6550 msgr2=0x7f57140a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 shutdown_connections 2023-10-03T10:19:26.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:26.982+0000 7f571a4cc700 1 -- 172.21.15.19:0/785335803 wait complete. 2023-10-03T10:19:26.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:27.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:27.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.281+0000 7f5422da0700 1 Processor -- start 2023-10-03T10:19:27.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.281+0000 7f5422da0700 1 -- start start 2023-10-03T10:19:27.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5422da0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5422da0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f541c09d9f0 0x7f541c06a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5422da0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541c09e130 con 0x7f541c06acb0 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5422da0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541c1312b0 con 0x7f541c09d9f0 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5422da0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541c09f6e0 con 0x7f541c1316c0 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5420b3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5420b3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45830/0 (socket says 172.21.15.19:45830) 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f541c09d9f0 0x7f541c06a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5420b3c700 1 -- 172.21.15.19:0/2215779016 learned_addr learned my addr 172.21.15.19:0/2215779016 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 -- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 msgr2=0x7f541c131a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 -- 172.21.15.19:0/2215779016 >> v1:172.21.15.19:6789/0 conn(0x7f541c06acb0 legacy=0x7f541c138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 -- 172.21.15.19:0/2215779016 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c09e760 con 0x7f541c09d9f0 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541b7fe700 1 -- 172.21.15.19:0/2215779016 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328711353 0 0) 0x7f5414001490 con 0x7f541c06acb0 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f5420b3c700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.282+0000 7f541bfff700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c09d9f0 0x7f541c06a770 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f5410009840 tx=0x7f5410009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5694ea5d3b6d15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f541b7fe700 1 -- 172.21.15.19:0/2215779016 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011830 con 0x7f541c09d9f0 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f541b7fe700 1 -- 172.21.15.19:0/2215779016 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5410011990 con 0x7f541c09d9f0 2023-10-03T10:19:27.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f541b7fe700 1 -- 172.21.15.19:0/2215779016 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5410011d20 con 0x7f541c09d9f0 2023-10-03T10:19:27.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 -- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c09d9f0 msgr2=0x7f541c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c09d9f0 0x7f541c06a770 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f5410009840 tx=0x7f5410009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 -- 172.21.15.19:0/2215779016 shutdown_connections 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c131a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 --2- 172.21.15.19:0/2215779016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c09d9f0 0x7f541c06a770 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 -- 172.21.15.19:0/2215779016 >> 172.21.15.19:0/2215779016 conn(0x7f541c066f50 msgr2=0x7f541c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 -- 172.21.15.19:0/2215779016 shutdown_connections 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.283+0000 7f5422da0700 1 -- 172.21.15.19:0/2215779016 wait complete. 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.284+0000 7f5422da0700 1 Processor -- start 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.284+0000 7f5422da0700 1 -- start start 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:27.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 0x7f541c070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c0713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f541c11a800 con 0x7f541c06acb0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541c0a36d0 con 0x7f541c09d9f0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5422da0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f541c119680 con 0x7f541c1316c0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43394/0 (socket says 172.21.15.19:43394) 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 -- 172.21.15.19:0/1688916522 learned_addr learned my addr 172.21.15.19:0/1688916522 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f541bfff700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 0x7f541c070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f542133d700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c0713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 -- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 msgr2=0x7f541c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c0713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 -- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 msgr2=0x7f541c070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 0x7f541c070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f5420b3c700 1 -- 172.21.15.19:0/1688916522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c009550 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f541bfff700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 0x7f541c070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.285+0000 7f542133d700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f5420b3c700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f540c00ec10 tx=0x7f540c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00c850 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00c9b0 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c00cd40 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54100094a0 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.286+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f541c119be0 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.287+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f540c013470 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.287+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541c11aa20 con 0x7f541c06acb0 2023-10-03T10:19:27.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.287+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f540c03fc00 con 0x7f541c06acb0 2023-10-03T10:19:27.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.292+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f540c021070 con 0x7f541c06acb0 2023-10-03T10:19:27.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.494+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f541c06c360 con 0x7f541c06acb0 2023-10-03T10:19:27.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.494+0000 7f54197fa700 1 -- 172.21.15.19:0/1688916522 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f540c02a090 con 0x7f541c06acb0 2023-10-03T10:19:27.494 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:27.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.496+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 msgr2=0x7f541c070960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.496+0000 7f5422da0700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f540c00ec10 tx=0x7f540c00ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 shutdown_connections 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f541c1316c0 0x7f541c0713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f541c06acb0 0x7f541c070960 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 --2- 172.21.15.19:0/1688916522 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f541c09d9f0 0x7f541c070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 >> 172.21.15.19:0/1688916522 conn(0x7f541c066f50 msgr2=0x7f541c0a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 shutdown_connections 2023-10-03T10:19:27.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:27.497+0000 7f5422da0700 1 -- 172.21.15.19:0/1688916522 wait complete. 2023-10-03T10:19:27.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:27.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:27.952 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:27.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.061+0000 7fdaaea6b700 1 Processor -- start 2023-10-03T10:19:28.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.061+0000 7fdaaea6b700 1 -- start start 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.061+0000 7fdaaea6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaaea6b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdaa8131d10 0x7fdaa8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaaea6b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa809ece0 con 0x7fdaa806b080 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaaea6b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa809e760 con 0x7fdaa8131d10 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaaea6b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa809e040 con 0x7fdaa806a770 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaac807700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdaa8131d10 0x7fdaa8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaac807700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45500/0 (socket says 172.21.15.19:45500) 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaac807700 1 -- 172.21.15.19:0/163380217 learned_addr learned my addr 172.21.15.19:0/163380217 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaa77fe700 1 -- 172.21.15.19:0/163380217 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145952798 0 0) 0x7fdaa809ece0 con 0x7fdaa806b080 2023-10-03T10:19:28.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaa77fe700 1 -- 172.21.15.19:0/163380217 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda980035b0 con 0x7fdaa806b080 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 -- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 msgr2=0x7fdaa806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 -- 172.21.15.19:0/163380217 >> v1:172.21.15.19:6789/0 conn(0x7fdaa806b080 legacy=0x7fdaa8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 -- 172.21.15.19:0/163380217 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa809f630 con 0x7fdaa8131d10 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaac807700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.062+0000 7fdaad008700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8139860 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009d90 tx=0x7fdaa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1777f316aa116360 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaa77fe700 1 -- 172.21.15.19:0/163380217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa000e070 con 0x7fdaa8131d10 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaa77fe700 1 -- 172.21.15.19:0/163380217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa000bb20 con 0x7fdaa8131d10 2023-10-03T10:19:28.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaa77fe700 1 -- 172.21.15.19:0/163380217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0012430 con 0x7fdaa8131d10 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 -- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 msgr2=0x7fdaa8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8139860 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0009d90 tx=0x7fdaa000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 -- 172.21.15.19:0/163380217 shutdown_connections 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8139860 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/163380217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806a770 0x7fdaa806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 -- 172.21.15.19:0/163380217 >> 172.21.15.19:0/163380217 conn(0x7fdaa8066f50 msgr2=0x7fdaa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 -- 172.21.15.19:0/163380217 shutdown_connections 2023-10-03T10:19:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.063+0000 7fdaaea6b700 1 -- 172.21.15.19:0/163380217 wait complete. 2023-10-03T10:19:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.065+0000 7fdaaea6b700 1 Processor -- start 2023-10-03T10:19:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.065+0000 7fdaaea6b700 1 -- start start 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 0x7fdaa8120420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8120ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8124b20 con 0x7fdaa8131d10 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8071ed0 con 0x7fdaa806b080 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaaea6b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa81239a0 con 0x7fdaa806a770 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45516/0 (socket says 172.21.15.19:45516) 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaa7fff700 1 -- 172.21.15.19:0/4285021885 learned_addr learned my addr 172.21.15.19:0/4285021885 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8120ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaac807700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 0x7fdaa8120420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 -- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 msgr2=0x7fdaa8120420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 0x7fdaa8120420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 -- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 msgr2=0x7fdaa8120960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaad008700 1 -- 172.21.15.19:0/4285021885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009550 con 0x7fdaa8131d10 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaa7fff700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.066+0000 7fdaac807700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 0x7fdaa8120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaad008700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8120ea0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0016000 tx=0x7fdaa0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0012430 con 0x7fdaa8131d10 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa0020070 con 0x7fdaa8131d10 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0009a70 con 0x7fdaa8131d10 2023-10-03T10:19:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa00098f0 con 0x7fdaa8131d10 2023-10-03T10:19:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.067+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa8122130 con 0x7fdaa8131d10 2023-10-03T10:19:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.068+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdaa0004040 con 0x7fdaa8131d10 2023-10-03T10:19:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.068+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa8074ea0 con 0x7fdaa8131d10 2023-10-03T10:19:28.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.068+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdaa0022070 con 0x7fdaa8131d10 2023-10-03T10:19:28.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.073+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdaa0072750 con 0x7fdaa8131d10 2023-10-03T10:19:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.100+0000 7f72bb91d700 1 Processor -- start 2023-10-03T10:19:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.100+0000 7f72bb91d700 1 -- start start 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72bb91d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 0x7f72b4138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72bb91d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f72b4139250 0x7f72b413b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72bb91d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b409edd0 con 0x7f72b40a0a30 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72bb91d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b40a18e0 con 0x7f72b4139250 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72bb91d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b409e1f0 con 0x7f72b40a1510 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b96b9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f72b40a0a30 0x7f72b40a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50200/0 (socket says 172.21.15.19:50200) 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b96b9700 1 -- 172.21.15.19:0/3779465699 learned_addr learned my addr 172.21.15.19:0/3779465699 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b8eb8700 1 --2- 172.21.15.19:0/3779465699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 0x7f72b4138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b9eba700 1 --2- 172.21.15.19:0/3779465699 >> v2:172.21.15.19:3300/0 conn(0x7f72b4139250 0x7f72b413b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72abfff700 1 -- 172.21.15.19:0/3779465699 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093888813 0 0) 0x7f72b409edd0 con 0x7f72b40a0a30 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72abfff700 1 -- 172.21.15.19:0/3779465699 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a00035b0 con 0x7f72b40a0a30 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b8eb8700 1 -- 172.21.15.19:0/3779465699 >> v2:172.21.15.19:3300/0 conn(0x7f72b4139250 msgr2=0x7f72b413b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b8eb8700 1 --2- 172.21.15.19:0/3779465699 >> v2:172.21.15.19:3300/0 conn(0x7f72b4139250 0x7f72b413b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b8eb8700 1 -- 172.21.15.19:0/3779465699 >> v1:172.21.15.19:6789/0 conn(0x7f72b40a0a30 legacy=0x7f72b40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.101+0000 7f72b8eb8700 1 -- 172.21.15.19:0/3779465699 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b409dc50 con 0x7f72b40a1510 2023-10-03T10:19:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.102+0000 7f72b8eb8700 1 --2- 172.21.15.19:0/3779465699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 0x7f72b4138d10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009870 tx=0x7f72a4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c20208b11f99fc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.102+0000 7f72abfff700 1 -- 172.21.15.19:0/3779465699 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011830 con 0x7f72b40a1510 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.102+0000 7f72abfff700 1 -- 172.21.15.19:0/3779465699 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a4011990 con 0x7f72b40a1510 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.102+0000 7f72abfff700 1 -- 172.21.15.19:0/3779465699 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4011d20 con 0x7f72b40a1510 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 -- 172.21.15.19:0/3779465699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 msgr2=0x7f72b4138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 --2- 172.21.15.19:0/3779465699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 0x7f72b4138d10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009870 tx=0x7f72a4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 -- 172.21.15.19:0/3779465699 shutdown_connections 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 --2- 172.21.15.19:0/3779465699 >> v2:172.21.15.19:3300/0 conn(0x7f72b4139250 0x7f72b413b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 --2- 172.21.15.19:0/3779465699 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b40a1510 0x7f72b4138d10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 -- 172.21.15.19:0/3779465699 >> 172.21.15.19:0/3779465699 conn(0x7f72b40a6550 msgr2=0x7f72b40a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 -- 172.21.15.19:0/3779465699 shutdown_connections 2023-10-03T10:19:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.103+0000 7f72bb91d700 1 -- 172.21.15.19:0/3779465699 wait complete. 2023-10-03T10:19:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.104+0000 7f72bb91d700 1 Processor -- start 2023-10-03T10:19:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.104+0000 7f72bb91d700 1 -- start start 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72b40a1510 0x7f72b4122cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 0x7f72b4123210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b41386f0 con 0x7f72b40a1510 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4126350 con 0x7f72b4139250 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72bb91d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4124bc0 con 0x7f72b40a0a30 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72b96b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72b9eba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 0x7f72b4123210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72b96b9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45862/0 (socket says 172.21.15.19:45862) 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72b96b9700 1 -- 172.21.15.19:0/1373309266 learned_addr learned my addr 172.21.15.19:0/1373309266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.105+0000 7f72b8eb8700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72b40a1510 0x7f72b4122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 -- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 msgr2=0x7f72b4122790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 -- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72b40a1510 msgr2=0x7f72b4122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72b40a1510 0x7f72b4122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 -- 172.21.15.19:0/1373309266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40094a0 con 0x7f72b4139250 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b96b9700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72b9eba700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 0x7f72b4123210 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f72b40a23f0 tx=0x7f72ac00eb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac013680 con 0x7f72b4139250 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac0137e0 con 0x7f72b4139250 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b4125a60 con 0x7f72b4139250 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac013b90 con 0x7f72b4139250 2023-10-03T10:19:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.106+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40a0280 con 0x7f72b4139250 2023-10-03T10:19:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.108+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4074ea0 con 0x7f72b4139250 2023-10-03T10:19:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.108+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72ac013cf0 con 0x7f72b4139250 2023-10-03T10:19:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.108+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f72ac03fe80 con 0x7f72b4139250 2023-10-03T10:19:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.113+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f72ac01ada0 con 0x7f72b4139250 2023-10-03T10:19:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.142+0000 7f7a0d5f9700 1 Processor -- start 2023-10-03T10:19:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.142+0000 7f7a0d5f9700 1 -- start start 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a0d5f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a0d5f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0813d1f0 0x7f7a0813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a0d5f9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0809a810 con 0x7f7a0806a770 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a0d5f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806ab40 con 0x7f7a0809de00 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a0d5f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0809ebc0 con 0x7f7a0813d1f0 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a067fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a067fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45530/0 (socket says 172.21.15.19:45530) 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a067fc700 1 -- 172.21.15.19:0/2164086809 learned_addr learned my addr 172.21.15.19:0/2164086809 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.143+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0813d1f0 0x7f7a0813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a067fc700 1 -- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0813d1f0 msgr2=0x7f7a0813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a067fc700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0813d1f0 0x7f7a0813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a067fc700 1 -- 172.21.15.19:0/2164086809 >> v1:172.21.15.19:6789/0 conn(0x7f7a0806a770 legacy=0x7f7a0809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a067fc700 1 -- 172.21.15.19:0/2164086809 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0809e920 con 0x7f7a0809de00 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a067fc700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009920 tx=0x7f79fc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bfdae49878886f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a05ffb700 1 -- 172.21.15.19:0/2164086809 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00ba60 con 0x7f7a0809de00 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a05ffb700 1 -- 172.21.15.19:0/2164086809 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc00bbc0 con 0x7f7a0809de00 2023-10-03T10:19:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.144+0000 7f7a05ffb700 1 -- 172.21.15.19:0/2164086809 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc009e70 con 0x7f7a0809de00 2023-10-03T10:19:28.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 msgr2=0x7f7a0809e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009920 tx=0x7f79fc009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:28.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2164086809 shutdown_connections 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0813d1f0 0x7f7a0813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2164086809 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0809de00 0x7f7a0809e250 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2164086809 >> 172.21.15.19:0/2164086809 conn(0x7f7a08066f50 msgr2=0x7f7a0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2164086809 shutdown_connections 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.145+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2164086809 wait complete. 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 Processor -- start 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 -- start start 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0806a770 0x7f7a0811a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809de00 0x7f7a0811a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08072820 con 0x7f7a0813d1f0 2023-10-03T10:19:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806eef0 con 0x7f7a0806a770 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.146+0000 7f7a0d5f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0811c810 con 0x7f7a0809de00 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43434/0 (socket says 172.21.15.19:43434) 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 -- 172.21.15.19:0/2134581185 learned_addr learned my addr 172.21.15.19:0/2134581185 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a067fc700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809de00 0x7f7a0811a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a06ffd700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0806a770 0x7f7a0811a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 -- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809de00 msgr2=0x7f7a0811a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809de00 0x7f7a0811a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 -- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0806a770 msgr2=0x7f7a0811a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0806a770 0x7f7a0811a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 -- 172.21.15.19:0/2134581185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc009550 con 0x7f7a0813d1f0 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f7a077fe700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7a00007e40 tx=0x7f7a0000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.147+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0000ed30 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.148+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00014420 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.148+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000147d0 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.148+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0806f920 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.148+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0806ea00 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.148+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7a00014930 con 0x7f7a0813d1f0 2023-10-03T10:19:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.149+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7a0003fd80 con 0x7f7a0813d1f0 2023-10-03T10:19:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.149+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a080a38f0 con 0x7f7a0813d1f0 2023-10-03T10:19:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.158+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7a00014be0 con 0x7f7a0813d1f0 2023-10-03T10:19:28.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.290+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdaa8124730 con 0x7fdaa8131d10 2023-10-03T10:19:28.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.290+0000 7fdaa57fa700 1 -- 172.21.15.19:0/4285021885 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdaa001c400 con 0x7fdaa8131d10 2023-10-03T10:19:28.290 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 msgr2=0x7fdaa8120ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8120ea0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0016000 tx=0x7fdaa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 shutdown_connections 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdaa8131d10 0x7fdaa8120ea0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdaa806a770 0x7fdaa8120420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 --2- 172.21.15.19:0/4285021885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdaa806b080 0x7fdaa8120960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 >> 172.21.15.19:0/4285021885 conn(0x7fdaa8066f50 msgr2=0x7fdaa8070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 shutdown_connections 2023-10-03T10:19:28.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.293+0000 7fdaaea6b700 1 -- 172.21.15.19:0/4285021885 wait complete. 2023-10-03T10:19:28.307 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:28.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.324+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f72b40a28e0 con 0x7f72b4139250 2023-10-03T10:19:28.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.324+0000 7f72a9ffb700 1 -- 172.21.15.19:0/1373309266 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f72ac021020 con 0x7f72b4139250 2023-10-03T10:19:28.324 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.326+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 msgr2=0x7f72b4123210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.326+0000 7f72bb91d700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 0x7f72b4123210 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f72b40a23f0 tx=0x7f72ac00eb30 comp rx=0 tx=0).stop 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 shutdown_connections 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72b4139250 0x7f72b4123210 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f72b40a0a30 0x7f72b4122790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 --2- 172.21.15.19:0/1373309266 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72b40a1510 0x7f72b4122cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 >> 172.21.15.19:0/1373309266 conn(0x7f72b40a6550 msgr2=0x7f72b409a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 shutdown_connections 2023-10-03T10:19:28.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.327+0000 7f72bb91d700 1 -- 172.21.15.19:0/1373309266 wait complete. 2023-10-03T10:19:28.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.366+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7a0806ec20 con 0x7f7a0813d1f0 2023-10-03T10:19:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.367+0000 7f79ef7fe700 1 -- 172.21.15.19:0/2134581185 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7a0001b310 con 0x7f7a0813d1f0 2023-10-03T10:19:28.366 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 msgr2=0x7f7a0811ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f7a00007e40 tx=0x7f7a0000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 shutdown_connections 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a0813d1f0 0x7f7a0811ae90 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7a0806a770 0x7f7a0811a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 --2- 172.21.15.19:0/2134581185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7a0809de00 0x7f7a0811a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 >> 172.21.15.19:0/2134581185 conn(0x7f7a08066f50 msgr2=0x7f7a080a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 shutdown_connections 2023-10-03T10:19:28.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.369+0000 7f7a0d5f9700 1 -- 172.21.15.19:0/2134581185 wait complete. 2023-10-03T10:19:28.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:28.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:28.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.654+0000 7fdd232c3700 1 Processor -- start 2023-10-03T10:19:28.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 -- start start 2023-10-03T10:19:28.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c138d80 0x7fdd1c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c0a2a70 con 0x7fdd1c09d630 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0a01d0 con 0x7fdd1c138d80 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd232c3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c09e2b0 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd2105f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd2105f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45896/0 (socket says 172.21.15.19:45896) 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd2105f700 1 -- 172.21.15.19:0/1640500332 learned_addr learned my addr 172.21.15.19:0/1640500332 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.655+0000 7fdd21860700 1 --2- 172.21.15.19:0/1640500332 >> v2:172.21.15.19:3300/0 conn(0x7fdd1c138d80 0x7fdd1c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd2105f700 1 -- 172.21.15.19:0/1640500332 >> v2:172.21.15.19:3300/0 conn(0x7fdd1c138d80 msgr2=0x7fdd1c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd2105f700 1 --2- 172.21.15.19:0/1640500332 >> v2:172.21.15.19:3300/0 conn(0x7fdd1c138d80 0x7fdd1c13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd2105f700 1 -- 172.21.15.19:0/1640500332 >> v1:172.21.15.19:6789/0 conn(0x7fdd1c09d630 legacy=0x7fdd1c0a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd2105f700 1 -- 172.21.15.19:0/1640500332 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c09dc50 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd2105f700 1 --2- 172.21.15.19:0/1640500332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdd180098f0 tx=0x7fdd18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c7f86cb3ed8e146 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd13fff700 1 -- 172.21.15.19:0/1640500332 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18011830 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd13fff700 1 -- 172.21.15.19:0/1640500332 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18011990 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.656+0000 7fdd13fff700 1 -- 172.21.15.19:0/1640500332 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18011d20 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 -- 172.21.15.19:0/1640500332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 msgr2=0x7fdd1c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 --2- 172.21.15.19:0/1640500332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fdd180098f0 tx=0x7fdd18009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 -- 172.21.15.19:0/1640500332 shutdown_connections 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 --2- 172.21.15.19:0/1640500332 >> v2:172.21.15.19:3300/0 conn(0x7fdd1c138d80 0x7fdd1c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 --2- 172.21.15.19:0/1640500332 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c0a0e00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 -- 172.21.15.19:0/1640500332 >> 172.21.15.19:0/1640500332 conn(0x7fdd1c0a3050 msgr2=0x7fdd1c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 -- 172.21.15.19:0/1640500332 shutdown_connections 2023-10-03T10:19:28.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.657+0000 7fdd232c3700 1 -- 172.21.15.19:0/1640500332 wait complete. 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 Processor -- start 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 -- start start 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c138d80 0x7fdd1c11def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c120a90 con 0x7fdd1c09d630 2023-10-03T10:19:28.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c0a0410 con 0x7fdd1c138d80 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd232c3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c11f5e0 con 0x7fdd1c0a0a30 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd2105f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd2085e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd2085e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45910/0 (socket says 172.21.15.19:45910) 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd2105f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43452/0 (socket says 172.21.15.19:43452) 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd2085e700 1 -- 172.21.15.19:0/2885025034 learned_addr learned my addr 172.21.15.19:0/2885025034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.658+0000 7fdd21860700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c138d80 0x7fdd1c11def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 -- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 msgr2=0x7fdd1c11d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 -- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c138d80 msgr2=0x7fdd1c11def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c138d80 0x7fdd1c11def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 -- 172.21.15.19:0/2885025034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18009550 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2085e700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd2105f700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fdd18016000 tx=0x7fdd18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18004400 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1801f070 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c13b010 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180038e0 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.659+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c120c70 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.660+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd18021030 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.660+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd18040b20 con 0x7fdd1c09d630 2023-10-03T10:19:28.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.660+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0747f0 con 0x7fdd1c09d630 2023-10-03T10:19:28.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.665+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd18023980 con 0x7fdd1c09d630 2023-10-03T10:19:28.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.872+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd1c11f830 con 0x7fdd1c09d630 2023-10-03T10:19:28.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.872+0000 7fdd11ffb700 1 -- 172.21.15.19:0/2885025034 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd18023750 con 0x7fdd1c09d630 2023-10-03T10:19:28.872 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.874+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 msgr2=0x7fdd1c11d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.874+0000 7fdd232c3700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fdd18016000 tx=0x7fdd18004750 comp rx=0 tx=0).stop 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 shutdown_connections 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c138d80 0x7fdd1c11def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c09d630 0x7fdd1c11d470 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 --2- 172.21.15.19:0/2885025034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c0a0a30 0x7fdd1c11d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 >> 172.21.15.19:0/2885025034 conn(0x7fdd1c0a3050 msgr2=0x7fdd1c09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 shutdown_connections 2023-10-03T10:19:28.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:28.875+0000 7fdd232c3700 1 -- 172.21.15.19:0/2885025034 wait complete. 2023-10-03T10:19:28.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:29.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:29.341 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:29.383 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.472+0000 7fb713f2c700 1 Processor -- start 2023-10-03T10:19:29.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.472+0000 7fb713f2c700 1 -- start start 2023-10-03T10:19:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb713f2c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb713f2c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e000 0x7fb70c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb713f2c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb70c09b120 con 0x7fb70c09e410 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb713f2c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c06b460 con 0x7fb70c09d6f0 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb713f2c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c09a7e0 con 0x7fb70c09e000 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb7124c9700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb70c09e410 0x7fb70c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50232/0 (socket says 172.21.15.19:50232) 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45566/0 (socket says 172.21.15.19:45566) 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb7124c9700 1 -- 172.21.15.19:0/4220626123 learned_addr learned my addr 172.21.15.19:0/4220626123 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb7114c7700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e000 0x7fb70c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 -- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e000 msgr2=0x7fb70c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e000 0x7fb70c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 -- 172.21.15.19:0/4220626123 >> v1:172.21.15.19:6789/0 conn(0x7fb70c09e410 legacy=0x7fb70c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb710cc6700 1 -- 172.21.15.19:0/4220626123 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437819198 0 0) 0x7fb70c09b120 con 0x7fb70c09e410 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.473+0000 7fb711cc8700 1 -- 172.21.15.19:0/4220626123 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb70c09a500 con 0x7fb70c09d6f0 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb711cc8700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb708009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e80ea95d14eb4c0d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb710cc6700 1 -- 172.21.15.19:0/4220626123 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011830 con 0x7fb70c09d6f0 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb710cc6700 1 -- 172.21.15.19:0/4220626123 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708011990 con 0x7fb70c09d6f0 2023-10-03T10:19:29.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb710cc6700 1 -- 172.21.15.19:0/4220626123 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708011d20 con 0x7fb70c09d6f0 2023-10-03T10:19:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb713f2c700 1 -- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 msgr2=0x7fb70c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.474+0000 7fb713f2c700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fb708009870 tx=0x7fb708009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 -- 172.21.15.19:0/4220626123 shutdown_connections 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09d6f0 0x7fb70c09dac0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 --2- 172.21.15.19:0/4220626123 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e000 0x7fb70c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 -- 172.21.15.19:0/4220626123 >> 172.21.15.19:0/4220626123 conn(0x7fb70c066f50 msgr2=0x7fb70c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 -- 172.21.15.19:0/4220626123 shutdown_connections 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.475+0000 7fb713f2c700 1 -- 172.21.15.19:0/4220626123 wait complete. 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 Processor -- start 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 -- start start 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 0x7fb70c122900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 0x7fb70c122e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c1336f0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c123820 con 0x7fb70c09e000 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb713f2c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c124dc0 con 0x7fb70c09e410 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb711cc8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb711cc8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43456/0 (socket says 172.21.15.19:43456) 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb711cc8700 1 -- 172.21.15.19:0/3088524807 learned_addr learned my addr 172.21.15.19:0/3088524807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.476+0000 7fb7114c7700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 0x7fb70c122900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7124c9700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 0x7fb70c122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 -- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 msgr2=0x7fb70c122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 0x7fb70c122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 -- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 msgr2=0x7fb70c122900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 0x7fb70c122900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 -- 172.21.15.19:0/3088524807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7080094a0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7114c7700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 0x7fb70c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7124c9700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 0x7fb70c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb711cc8700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb708009f80 tx=0x7fb708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708004590 con 0x7fb70c09d6f0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70801f070 con 0x7fb70c09d6f0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c1258a0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080038e0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.477+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c09c710 con 0x7fb70c09d6f0 2023-10-03T10:19:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.478+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb708003a40 con 0x7fb70c09d6f0 2023-10-03T10:19:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.478+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c074ea0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.479+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb708021070 con 0x7fb70c09d6f0 2023-10-03T10:19:29.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.483+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb70800bdf0 con 0x7fb70c09d6f0 2023-10-03T10:19:29.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.505+0000 7f68adb91700 1 Processor -- start 2023-10-03T10:19:29.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 -- start start 2023-10-03T10:19:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 0x7f68a80a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a8138d80 0x7f68a813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a80a2a70 con 0x7f68a80a0a30 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80a01d0 con 0x7f68a8138d80 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68adb91700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68a809e2b0 con 0x7f68a809d630 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f689effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 0x7f68a80a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68a77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f68a80a0a30 0x7f68a80a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50246/0 (socket says 172.21.15.19:50246) 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68a7fff700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a8138d80 0x7f68a813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.506+0000 7f68a77fe700 1 -- 172.21.15.19:0/3537693695 learned_addr learned my addr 172.21.15.19:0/3537693695 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f689effd700 1 -- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a8138d80 msgr2=0x7f68a813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f689effd700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a8138d80 0x7f68a813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f689effd700 1 -- 172.21.15.19:0/3537693695 >> v1:172.21.15.19:6789/0 conn(0x7f68a80a0a30 legacy=0x7f68a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f689effd700 1 -- 172.21.15.19:0/3537693695 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a809dc50 con 0x7f68a809d630 2023-10-03T10:19:29.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f689effd700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 0x7f68a80a1510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6890009870 tx=0x7f6890009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1279604573e84e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f68a6ffd700 1 -- 172.21.15.19:0/3537693695 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011830 con 0x7f68a809d630 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f68a6ffd700 1 -- 172.21.15.19:0/3537693695 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6890011990 con 0x7f68a809d630 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.507+0000 7f68a6ffd700 1 -- 172.21.15.19:0/3537693695 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890011d20 con 0x7f68a809d630 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 -- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 msgr2=0x7f68a80a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 0x7f68a80a1510 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f6890009870 tx=0x7f6890009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 -- 172.21.15.19:0/3537693695 shutdown_connections 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a8138d80 0x7f68a813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 --2- 172.21.15.19:0/3537693695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a809d630 0x7f68a80a1510 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 -- 172.21.15.19:0/3537693695 >> 172.21.15.19:0/3537693695 conn(0x7f68a80a3050 msgr2=0x7f68a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 -- 172.21.15.19:0/3537693695 shutdown_connections 2023-10-03T10:19:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.508+0000 7f68adb91700 1 -- 172.21.15.19:0/3537693695 wait complete. 2023-10-03T10:19:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.509+0000 7f68adb91700 1 Processor -- start 2023-10-03T10:19:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.509+0000 7f68adb91700 1 -- start start 2023-10-03T10:19:29.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 0x7f68a8120930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 0x7f68a8120e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 0x7f68a81213b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a81229d0 con 0x7f68a80a0a30 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a813af90 con 0x7f68a809d630 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68adb91700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80a0410 con 0x7f68a8138d80 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68a7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 0x7f68a81213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 0x7f68a8120e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68a7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 0x7f68a81213b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45942/0 (socket says 172.21.15.19:45942) 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68a7fff700 1 -- 172.21.15.19:0/3611550783 learned_addr learned my addr 172.21.15.19:0/3611550783 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68a77fe700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 0x7f68a8120930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 -- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 msgr2=0x7f68a81213b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 0x7f68a81213b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 -- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 msgr2=0x7f68a8120930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 0x7f68a8120930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f689effd700 1 -- 172.21.15.19:0/3611550783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900094a0 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.510+0000 7f68a77fe700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 0x7f68a8120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f689effd700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 0x7f68a8120e70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6890016000 tx=0x7f6890004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6890004240 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689001f070 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68900036a0 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a8123ab0 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.511+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a8122c00 con 0x7f68a80a0a30 2023-10-03T10:19:29.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.512+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6890021030 con 0x7f68a80a0a30 2023-10-03T10:19:29.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.512+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f68900406d0 con 0x7f68a80a0a30 2023-10-03T10:19:29.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.512+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a8123ca0 con 0x7f68a80a0a30 2023-10-03T10:19:29.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.517+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f68900239c0 con 0x7f68a80a0a30 2023-10-03T10:19:29.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.541+0000 7f5e9079c700 1 Processor -- start 2023-10-03T10:19:29.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.541+0000 7f5e9079c700 1 -- start start 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e9079c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e9079c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e880a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e9079c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e880a2a70 con 0x7f5e88133930 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e9079c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e880a01d0 con 0x7f5e880a0a30 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e9079c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8809e2b0 con 0x7f5e8809d630 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e8ed39700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5e88133930 0x7f5e88133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50250/0 (socket says 172.21.15.19:50250) 2023-10-03T10:19:29.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e8ed39700 1 -- 172.21.15.19:0/4197108143 learned_addr learned my addr 172.21.15.19:0/4197108143 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:29.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e8e538700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.542+0000 7f5e8dd37700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e880a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8d536700 1 -- 172.21.15.19:0/4197108143 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744348484 0 0) 0x7f5e880a2a70 con 0x7f5e88133930 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8dd37700 1 -- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 msgr2=0x7f5e880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8dd37700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8dd37700 1 -- 172.21.15.19:0/4197108143 >> v1:172.21.15.19:6789/0 conn(0x7f5e88133930 legacy=0x7f5e88133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8dd37700 1 -- 172.21.15.19:0/4197108143 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8809dc50 con 0x7f5e8809d630 2023-10-03T10:19:29.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8e538700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8dd37700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e880a1340 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009870 tx=0x7f5e78009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=223743d02badb085 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8d536700 1 -- 172.21.15.19:0/4197108143 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78011830 con 0x7f5e8809d630 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8d536700 1 -- 172.21.15.19:0/4197108143 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78011990 con 0x7f5e8809d630 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.543+0000 7f5e8d536700 1 -- 172.21.15.19:0/4197108143 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78011d20 con 0x7f5e8809d630 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 -- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 msgr2=0x7f5e880a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e880a1340 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5e78009870 tx=0x7f5e78009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 -- 172.21.15.19:0/4197108143 shutdown_connections 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 --2- 172.21.15.19:0/4197108143 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e880a1340 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 -- 172.21.15.19:0/4197108143 >> 172.21.15.19:0/4197108143 conn(0x7f5e880a3050 msgr2=0x7f5e880a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 -- 172.21.15.19:0/4197108143 shutdown_connections 2023-10-03T10:19:29.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.544+0000 7f5e9079c700 1 -- 172.21.15.19:0/4197108143 wait complete. 2023-10-03T10:19:29.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 Processor -- start 2023-10-03T10:19:29.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 -- start start 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e8811f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e88133930 0x7f5e881c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8811ed60 con 0x7f5e88133930 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e881224a0 con 0x7f5e880a0a30 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.545+0000 7f5e9079c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e88120490 con 0x7f5e8809d630 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8dd37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e8811f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45968/0 (socket says 172.21.15.19:45968) 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 -- 172.21.15.19:0/3460989293 learned_addr learned my addr 172.21.15.19:0/3460989293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8dd37700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e8811f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45604/0 (socket says 172.21.15.19:45604) 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8ed39700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e88133930 0x7f5e881c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:29.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 -- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 msgr2=0x7f5e8811f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e8811f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 -- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e88133930 msgr2=0x7f5e881c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e88133930 0x7f5e881c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 -- 172.21.15.19:0/3460989293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009a70 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e8e538700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400efc0 tx=0x7f5e8400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400cdd0 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400f040 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e840146a0 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.546+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e780094a0 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.547+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e880a0410 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.547+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e84014800 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.548+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e84040490 con 0x7f5e8809d630 2023-10-03T10:19:29.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.548+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8811fd60 con 0x7f5e8809d630 2023-10-03T10:19:29.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.553+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e8401d400 con 0x7f5e8809d630 2023-10-03T10:19:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.695+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb70c125a30 con 0x7fb70c09d6f0 2023-10-03T10:19:29.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.695+0000 7fb7027fc700 1 -- 172.21.15.19:0/3088524807 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb70802b070 con 0x7fb70c09d6f0 2023-10-03T10:19:29.695 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 msgr2=0x7fb70c1223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb708009f80 tx=0x7fb708004750 comp rx=0 tx=0).stop 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 shutdown_connections 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb70c09e410 0x7fb70c122e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb70c09d6f0 0x7fb70c1223c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 --2- 172.21.15.19:0/3088524807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb70c09e000 0x7fb70c122900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.697+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 >> 172.21.15.19:0/3088524807 conn(0x7fb70c066f50 msgr2=0x7fb70c0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.698+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 shutdown_connections 2023-10-03T10:19:29.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.698+0000 7fb713f2c700 1 -- 172.21.15.19:0/3088524807 wait complete. 2023-10-03T10:19:29.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:29.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.726+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f68a80747f0 con 0x7f68a80a0a30 2023-10-03T10:19:29.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.726+0000 7f68a4ff9700 1 -- 172.21.15.19:0/3611550783 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f689001b430 con 0x7f68a80a0a30 2023-10-03T10:19:29.726 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:29.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 msgr2=0x7f68a8120e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 0x7f68a8120e70 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6890016000 tx=0x7f6890004750 comp rx=0 tx=0).stop 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 shutdown_connections 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f68a8138d80 0x7f68a81213b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f68a809d630 0x7f68a8120930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 --2- 172.21.15.19:0/3611550783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68a80a0a30 0x7f68a8120e70 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.728+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 >> 172.21.15.19:0/3611550783 conn(0x7f68a80a3050 msgr2=0x7f68a809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.729+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 shutdown_connections 2023-10-03T10:19:29.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.729+0000 7f68adb91700 1 -- 172.21.15.19:0/3611550783 wait complete. 2023-10-03T10:19:29.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:29.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.762+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e881222e0 con 0x7f5e8809d630 2023-10-03T10:19:29.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.762+0000 7f5e7effd700 1 -- 172.21.15.19:0/3460989293 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e881222e0 con 0x7f5e8809d630 2023-10-03T10:19:29.762 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 msgr2=0x7f5e8811f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400efc0 tx=0x7f5e8400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 shutdown_connections 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e88133930 0x7f5e881c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e8809d630 0x7f5e8811f2e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 --2- 172.21.15.19:0/3460989293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e880a0a30 0x7f5e8811f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 >> 172.21.15.19:0/3460989293 conn(0x7f5e880a3050 msgr2=0x7f5e881bbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 shutdown_connections 2023-10-03T10:19:29.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:29.765+0000 7f5e9079c700 1 -- 172.21.15.19:0/3460989293 wait complete. 2023-10-03T10:19:29.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:29.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:30.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.031+0000 7f17a9ebd700 1 Processor -- start 2023-10-03T10:19:30.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.031+0000 7f17a9ebd700 1 -- start start 2023-10-03T10:19:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a9ebd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 0x7f17a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a9ebd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a9ebd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a409b120 con 0x7f17a409e410 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a9ebd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a406b460 con 0x7f17a409d6f0 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a9ebd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17a409a7e0 con 0x7f17a409e000 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 0x7f17a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f17a409e410 0x7f17a4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50264/0 (socket says 172.21.15.19:50264) 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a3fff700 1 -- 172.21.15.19:0/1258751430 learned_addr learned my addr 172.21.15.19:0/1258751430 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a2ffd700 1 -- 172.21.15.19:0/1258751430 >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 msgr2=0x7f17a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a2ffd700 1 --2- 172.21.15.19:0/1258751430 >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 0x7f17a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a2ffd700 1 -- 172.21.15.19:0/1258751430 >> v1:172.21.15.19:6789/0 conn(0x7f17a409e410 legacy=0x7f17a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a2ffd700 1 -- 172.21.15.19:0/1258751430 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a409a500 con 0x7f17a409e000 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a27fc700 1 -- 172.21.15.19:0/1258751430 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785693534 0 0) 0x7f17a409b120 con 0x7f17a409e410 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.032+0000 7f17a37fe700 1 --2- 172.21.15.19:0/1258751430 >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 0x7f17a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a2ffd700 1 --2- 172.21.15.19:0/1258751430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41339f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f178c009870 tx=0x7f178c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f86fb803fb790e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a27fc700 1 -- 172.21.15.19:0/1258751430 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011830 con 0x7f17a409e000 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a27fc700 1 -- 172.21.15.19:0/1258751430 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c011990 con 0x7f17a409e000 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a27fc700 1 -- 172.21.15.19:0/1258751430 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011d20 con 0x7f17a409e000 2023-10-03T10:19:30.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 -- 172.21.15.19:0/1258751430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 msgr2=0x7f17a41339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/1258751430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41339f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f178c009870 tx=0x7f178c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 -- 172.21.15.19:0/1258751430 shutdown_connections 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/1258751430 >> v2:172.21.15.19:3300/0 conn(0x7f17a409d6f0 0x7f17a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/1258751430 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41339f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 -- 172.21.15.19:0/1258751430 >> 172.21.15.19:0/1258751430 conn(0x7f17a4066f50 msgr2=0x7f17a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 -- 172.21.15.19:0/1258751430 shutdown_connections 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.033+0000 7f17a9ebd700 1 -- 172.21.15.19:0/1258751430 wait complete. 2023-10-03T10:19:30.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.034+0000 7f17a9ebd700 1 Processor -- start 2023-10-03T10:19:30.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 -- start start 2023-10-03T10:19:30.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f17a409d6f0 0x7f17a41b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a409e410 0x7f17a41a35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a409c780 con 0x7f17a409e410 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40a2d30 con 0x7f17a409d6f0 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a9ebd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41a5790 con 0x7f17a409e000 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a409e410 0x7f17a41a35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f17a409d6f0 0x7f17a41b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45978/0 (socket says 172.21.15.19:45978) 2023-10-03T10:19:30.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.035+0000 7f17a2ffd700 1 -- 172.21.15.19:0/3353924615 learned_addr learned my addr 172.21.15.19:0/3353924615 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 -- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f17a409d6f0 msgr2=0x7f17a41b7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f17a409d6f0 0x7f17a41b7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 -- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a409e410 msgr2=0x7f17a41a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a409e410 0x7f17a41a35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 -- 172.21.15.19:0/3353924615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940094a0 con 0x7f17a409e000 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a2ffd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c0036a0 con 0x7f17a409e000 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c01f070 con 0x7f17a409e000 2023-10-03T10:19:30.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0094a0 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c003a20 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.036+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a41a6e00 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.037+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f178c003b80 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.037+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a4074ea0 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.037+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f178c021070 con 0x7f17a409e000 2023-10-03T10:19:30.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.042+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f178c01a430 con 0x7f17a409e000 2023-10-03T10:19:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.248+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f17a41a59c0 con 0x7f17a409e000 2023-10-03T10:19:30.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.249+0000 7f179bfff700 1 -- 172.21.15.19:0/3353924615 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f178c02b030 con 0x7f17a409e000 2023-10-03T10:19:30.249 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 msgr2=0x7f17a41b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 shutdown_connections 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17a409e410 0x7f17a41a35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f17a409d6f0 0x7f17a41b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 --2- 172.21.15.19:0/3353924615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f17a409e000 0x7f17a41b7950 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 >> 172.21.15.19:0/3353924615 conn(0x7f17a4066f50 msgr2=0x7f17a41bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 shutdown_connections 2023-10-03T10:19:30.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.251+0000 7f17a9ebd700 1 -- 172.21.15.19:0/3353924615 wait complete. 2023-10-03T10:19:30.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:30.712 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:30.743 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:30.779 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.870+0000 7f030fa73700 1 Processor -- start 2023-10-03T10:19:30.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.870+0000 7f030fa73700 1 -- start start 2023-10-03T10:19:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030fa73700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030fa73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030fa73700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f030809b120 con 0x7f030809d6f0 2023-10-03T10:19:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030fa73700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030806b460 con 0x7f030809e1d0 2023-10-03T10:19:30.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030fa73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030809a7e0 con 0x7f0308139170 2023-10-03T10:19:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030e010700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.871+0000 7f030d00e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45626/0 (socket says 172.21.15.19:45626) 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030d80f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f030809d6f0 0x7f030809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50280/0 (socket says 172.21.15.19:50280) 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030d00e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43496/0 (socket says 172.21.15.19:43496) 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 -- 172.21.15.19:0/2935300396 learned_addr learned my addr 172.21.15.19:0/2935300396 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 -- 172.21.15.19:0/2935300396 >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 msgr2=0x7f0308138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 --2- 172.21.15.19:0/2935300396 >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 -- 172.21.15.19:0/2935300396 >> v1:172.21.15.19:6789/0 conn(0x7f030809d6f0 legacy=0x7f030809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 -- 172.21.15.19:0/2935300396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030809a500 con 0x7f0308139170 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030c80d700 1 -- 172.21.15.19:0/2935300396 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81621345 0 0) 0x7f030809b120 con 0x7f030809d6f0 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030d00e700 1 --2- 172.21.15.19:0/2935300396 >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030e010700 1 --2- 172.21.15.19:0/2935300396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0300009e80 tx=0x7f030000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da540f44a0202963 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030c80d700 1 -- 172.21.15.19:0/2935300396 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030000e070 con 0x7f0308139170 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030c80d700 1 -- 172.21.15.19:0/2935300396 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030000b8d0 con 0x7f0308139170 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.872+0000 7f030c80d700 1 -- 172.21.15.19:0/2935300396 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030000bc80 con 0x7f0308139170 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 -- 172.21.15.19:0/2935300396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 msgr2=0x7f030813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 --2- 172.21.15.19:0/2935300396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0300009e80 tx=0x7f030000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 -- 172.21.15.19:0/2935300396 shutdown_connections 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 --2- 172.21.15.19:0/2935300396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0308139170 0x7f030813b550 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 --2- 172.21.15.19:0/2935300396 >> v2:172.21.15.19:3300/0 conn(0x7f030809e1d0 0x7f0308138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 -- 172.21.15.19:0/2935300396 >> 172.21.15.19:0/2935300396 conn(0x7f0308066f50 msgr2=0x7f030809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 -- 172.21.15.19:0/2935300396 shutdown_connections 2023-10-03T10:19:30.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.873+0000 7f030fa73700 1 -- 172.21.15.19:0/2935300396 wait complete. 2023-10-03T10:19:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.874+0000 7f030fa73700 1 Processor -- start 2023-10-03T10:19:30.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.874+0000 7f030fa73700 1 -- start start 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 0x7f0308121c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0308139170 0x7f0308122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03081375b0 con 0x7f0308139170 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03081251e0 con 0x7f030809d6f0 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030fa73700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0308123af0 con 0x7f030809e1d0 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030d00e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 0x7f0308121c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030d80f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030d80f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45642/0 (socket says 172.21.15.19:45642) 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030d00e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 0x7f0308121c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:45988/0 (socket says 172.21.15.19:45988) 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030d80f700 1 -- 172.21.15.19:0/2463443084 learned_addr learned my addr 172.21.15.19:0/2463443084 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.875+0000 7f030e010700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0308139170 0x7f0308122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 -- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 msgr2=0x7f0308121c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 0x7f0308121c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 -- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0308139170 msgr2=0x7f0308122140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0308139170 0x7f0308122140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 -- 172.21.15.19:0/2463443084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80094a0 con 0x7f030809d6f0 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030d80f700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f030400c520 tx=0x7f030400c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304004c80 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0304004e00 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0300009b30 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304007310 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.876+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030809c710 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.878+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0308074ea0 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.878+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0304007470 con 0x7f030809d6f0 2023-10-03T10:19:30.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.879+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f030403f8f0 con 0x7f030809d6f0 2023-10-03T10:19:30.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.887+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03040133c0 con 0x7f030809d6f0 2023-10-03T10:19:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.903+0000 7fb1bd748700 1 Processor -- start 2023-10-03T10:19:30.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.903+0000 7fb1bd748700 1 -- start start 2023-10-03T10:19:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1bd748700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 0x7fb1b8138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1bd748700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b809b120 con 0x7fb1b809d6f0 2023-10-03T10:19:30.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1bd748700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b806b460 con 0x7fb1b809e1d0 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1bd748700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b809a7e0 con 0x7fb1b8139170 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 0x7fb1b8138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b67fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 0x7fb1b8138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43502/0 (socket says 172.21.15.19:43502) 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b67fc700 1 -- 172.21.15.19:0/733354631 learned_addr learned my addr 172.21.15.19:0/733354631 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b6ffd700 1 --1- 172.21.15.19:0/733354631 >> v1:172.21.15.19:6789/0 conn(0x7fb1b809d6f0 0x7fb1b809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50290/0 (socket says 172.21.15.19:50290) 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b77fe700 1 -- 172.21.15.19:0/733354631 >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 msgr2=0x7fb1b8138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b77fe700 1 --2- 172.21.15.19:0/733354631 >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 0x7fb1b8138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b77fe700 1 -- 172.21.15.19:0/733354631 >> v1:172.21.15.19:6789/0 conn(0x7fb1b809d6f0 legacy=0x7fb1b809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b77fe700 1 -- 172.21.15.19:0/733354631 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b809a500 con 0x7fb1b8139170 2023-10-03T10:19:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.904+0000 7fb1b5ffb700 1 -- 172.21.15.19:0/733354631 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149716660 0 0) 0x7fb1b809b120 con 0x7fb1b809d6f0 2023-10-03T10:19:30.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.905+0000 7fb1b77fe700 1 --2- 172.21.15.19:0/733354631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b813b550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009dc0 tx=0x7fb1b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de0ec1aabd61f0b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.905+0000 7fb1b5ffb700 1 -- 172.21.15.19:0/733354631 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000e070 con 0x7fb1b8139170 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.905+0000 7fb1b5ffb700 1 -- 172.21.15.19:0/733354631 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b000bae0 con 0x7fb1b8139170 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.905+0000 7fb1b5ffb700 1 -- 172.21.15.19:0/733354631 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000be90 con 0x7fb1b8139170 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 -- 172.21.15.19:0/733354631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 msgr2=0x7fb1b813b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 --2- 172.21.15.19:0/733354631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b813b550 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0009dc0 tx=0x7fb1b000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 -- 172.21.15.19:0/733354631 shutdown_connections 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 --2- 172.21.15.19:0/733354631 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b813b550 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 --2- 172.21.15.19:0/733354631 >> v2:172.21.15.19:3300/0 conn(0x7fb1b809e1d0 0x7fb1b8138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 -- 172.21.15.19:0/733354631 >> 172.21.15.19:0/733354631 conn(0x7fb1b8066f50 msgr2=0x7fb1b809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 -- 172.21.15.19:0/733354631 shutdown_connections 2023-10-03T10:19:30.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.906+0000 7fb1bd748700 1 -- 172.21.15.19:0/733354631 wait complete. 2023-10-03T10:19:30.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.908+0000 7fb1bd748700 1 Processor -- start 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.908+0000 7fb1bd748700 1 -- start start 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.908+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 0x7fb1b8121900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.908+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1bd748700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b8122380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1bd748700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8125140 con 0x7fb1b809e1d0 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1bd748700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b809c710 con 0x7fb1b8139170 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1bd748700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b8123620 con 0x7fb1b809d6f0 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b67fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b67fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43508/0 (socket says 172.21.15.19:43508) 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b67fc700 1 -- 172.21.15.19:0/3132839011 learned_addr learned my addr 172.21.15.19:0/3132839011 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 0x7fb1b8121900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b77fe700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b8122380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 -- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 msgr2=0x7fb1b8122380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b8122380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 -- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 msgr2=0x7fb1b8121e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 -- 172.21.15.19:0/3132839011 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0009a70 con 0x7fb1b809d6f0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b67fc700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb1b6ffd700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 0x7fb1b8121900 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c4a0 tx=0x7fb1a800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.909+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8004c80 con 0x7fb1b809d6f0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.910+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a8004de0 con 0x7fb1b809d6f0 2023-10-03T10:19:30.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.910+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b8071eb0 con 0x7fb1b809d6f0 2023-10-03T10:19:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.910+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8007310 con 0x7fb1b809d6f0 2023-10-03T10:19:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.910+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b8137840 con 0x7fb1b809d6f0 2023-10-03T10:19:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.911+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb1a8007470 con 0x7fb1b809d6f0 2023-10-03T10:19:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.911+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb1a803f240 con 0x7fb1b809d6f0 2023-10-03T10:19:30.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.911+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b8125280 con 0x7fb1b809d6f0 2023-10-03T10:19:30.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.920+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb1b8125280 con 0x7fb1b809d6f0 2023-10-03T10:19:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.949+0000 7f2e7c6dc700 1 Processor -- start 2023-10-03T10:19:30.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 -- start start 2023-10-03T10:19:30.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 0x7f2e7413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740a2a70 con 0x7f2e740a0a30 2023-10-03T10:19:30.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740a01d0 con 0x7f2e74138d80 2023-10-03T10:19:30.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7c6dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7409e2b0 con 0x7f2e7409d630 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.950+0000 7f2e7ac79700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 0x7f2e7413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45664/0 (socket says 172.21.15.19:45664) 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e7ac79700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 0x7f2e7413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43518/0 (socket says 172.21.15.19:43518) 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 -- 172.21.15.19:0/3446687926 learned_addr learned my addr 172.21.15.19:0/3446687926 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79476700 1 -- 172.21.15.19:0/3446687926 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731907589 0 0) 0x7f2e740a2a70 con 0x7f2e740a0a30 2023-10-03T10:19:30.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 -- 172.21.15.19:0/3446687926 >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 msgr2=0x7f2e7413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 --2- 172.21.15.19:0/3446687926 >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 0x7f2e7413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 -- 172.21.15.19:0/3446687926 >> v1:172.21.15.19:6789/0 conn(0x7f2e740a0a30 legacy=0x7f2e740a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 -- 172.21.15.19:0/3446687926 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7409dc50 con 0x7f2e7409d630 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79c77700 1 --2- 172.21.15.19:0/3446687926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2e640098f0 tx=0x7f2e64009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=887934c0790a18ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79476700 1 -- 172.21.15.19:0/3446687926 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64011830 con 0x7f2e7409d630 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79476700 1 -- 172.21.15.19:0/3446687926 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64011990 con 0x7f2e7409d630 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.951+0000 7f2e79476700 1 -- 172.21.15.19:0/3446687926 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64011d20 con 0x7f2e7409d630 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/3446687926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 msgr2=0x7f2e740a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/3446687926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2e640098f0 tx=0x7f2e64009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/3446687926 shutdown_connections 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/3446687926 >> v2:172.21.15.19:3300/0 conn(0x7f2e74138d80 0x7f2e7413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/3446687926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409d630 0x7f2e740a1510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/3446687926 >> 172.21.15.19:0/3446687926 conn(0x7f2e740a3050 msgr2=0x7f2e740a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/3446687926 shutdown_connections 2023-10-03T10:19:30.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.952+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/3446687926 wait complete. 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.953+0000 7f2e7c6dc700 1 Processor -- start 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.953+0000 7f2e7c6dc700 1 -- start start 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d630 0x7f2e741336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 0x7f2e74134120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74137130 con 0x7f2e74138d80 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74136020 con 0x7f2e740a0a30 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7c6dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7413ac80 con 0x7f2e7409d630 2023-10-03T10:19:30.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e79c77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e79c77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45668/0 (socket says 172.21.15.19:45668) 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e79c77700 1 -- 172.21.15.19:0/1163342544 learned_addr learned my addr 172.21.15.19:0/1163342544 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 0x7f2e74134120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7a478700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d630 0x7f2e741336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 -- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d630 msgr2=0x7f2e741336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d630 0x7f2e741336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 -- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 msgr2=0x7f2e74133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e7ac79700 1 -- 172.21.15.19:0/1163342544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009550 con 0x7f2e74138d80 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.954+0000 7f2e79c77700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e7ac79700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 0x7f2e74134120 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00ef90 tx=0x7f2e6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:30.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00cd40 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00f040 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0146c0 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e740a0410 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.955+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e74134a70 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.956+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e6c014820 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.956+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e6c040360 con 0x7f2e74138d80 2023-10-03T10:19:30.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.956+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740747f0 con 0x7f2e74138d80 2023-10-03T10:19:30.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:30.961+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e6c009e60 con 0x7f2e74138d80 2023-10-03T10:19:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.100+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f030809f420 con 0x7f030809d6f0 2023-10-03T10:19:31.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.100+0000 7f02fe7fc700 1 -- 172.21.15.19:0/2463443084 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0304011360 con 0x7f030809d6f0 2023-10-03T10:19:31.101 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 msgr2=0x7f03081216c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f030400c520 tx=0x7f030400c830 comp rx=0 tx=0).stop 2023-10-03T10:19:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 shutdown_connections 2023-10-03T10:19:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0308139170 0x7f0308122140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f030809d6f0 0x7f03081216c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 --2- 172.21.15.19:0/2463443084 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f030809e1d0 0x7f0308121c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 >> 172.21.15.19:0/2463443084 conn(0x7f0308066f50 msgr2=0x7f0308070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 shutdown_connections 2023-10-03T10:19:31.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.103+0000 7f030fa73700 1 -- 172.21.15.19:0/2463443084 wait complete. 2023-10-03T10:19:31.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:31.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.133+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb1b8125280 con 0x7fb1b809d6f0 2023-10-03T10:19:31.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.133+0000 7fb19f7fe700 1 -- 172.21.15.19:0/3132839011 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb1b8125280 con 0x7fb1b809d6f0 2023-10-03T10:19:31.133 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 msgr2=0x7fb1b8121900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 0x7fb1b8121900 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fb1a800c4a0 tx=0x7fb1a800c7b0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 shutdown_connections 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb1b8139170 0x7fb1b8122380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb1b809d6f0 0x7fb1b8121900 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 --2- 172.21.15.19:0/3132839011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb1b809e1d0 0x7fb1b8121e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 >> 172.21.15.19:0/3132839011 conn(0x7fb1b8066f50 msgr2=0x7fb1b8070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 shutdown_connections 2023-10-03T10:19:31.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.136+0000 7fb1bd748700 1 -- 172.21.15.19:0/3132839011 wait complete. 2023-10-03T10:19:31.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.168+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2e74072980 con 0x7f2e74138d80 2023-10-03T10:19:31.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.169+0000 7f2e6affd700 1 -- 172.21.15.19:0/1163342544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e6c012340 con 0x7f2e74138d80 2023-10-03T10:19:31.169 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 msgr2=0x7f2e74134120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 0x7f2e74134120 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c00ef90 tx=0x7f2e6c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 shutdown_connections 2023-10-03T10:19:31.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e74138d80 0x7f2e74134120 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d630 0x7f2e741336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 --2- 172.21.15.19:0/1163342544 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e740a0a30 0x7f2e74133be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 >> 172.21.15.19:0/1163342544 conn(0x7f2e740a3050 msgr2=0x7f2e740a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 shutdown_connections 2023-10-03T10:19:31.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.171+0000 7f2e7c6dc700 1 -- 172.21.15.19:0/1163342544 wait complete. 2023-10-03T10:19:31.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:31.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:31.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 Processor -- start 2023-10-03T10:19:31.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 -- start start 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e000 0x7fc0dc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc06b460 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc09b120 con 0x7fc0dc09e000 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.408+0000 7fc0e20cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc09a7e0 con 0x7fc0dc09e410 2023-10-03T10:19:31.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0db7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0daffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e000 0x7fc0dc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0db7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43540/0 (socket says 172.21.15.19:43540) 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46014/0 (socket says 172.21.15.19:46014) 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0db7fe700 1 -- 172.21.15.19:0/3777650723 learned_addr learned my addr 172.21.15.19:0/3777650723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 -- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e000 msgr2=0x7fc0dc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 --2- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e000 0x7fc0dc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 -- 172.21.15.19:0/3777650723 >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 msgr2=0x7fc0dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 --2- 172.21.15.19:0/3777650723 >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 -- 172.21.15.19:0/3777650723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc09a500 con 0x7fc0dc09e410 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0db7fe700 1 --2- 172.21.15.19:0/3777650723 >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0dbfff700 1 --2- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009dc0 tx=0x7fc0d400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b2270c4d7b0a19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0da7fc700 1 -- 172.21.15.19:0/3777650723 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400e070 con 0x7fc0dc09e410 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0da7fc700 1 -- 172.21.15.19:0/3777650723 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d400bae0 con 0x7fc0dc09e410 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.409+0000 7fc0da7fc700 1 -- 172.21.15.19:0/3777650723 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400be90 con 0x7fc0dc09e410 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 -- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 msgr2=0x7fc0dc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009dc0 tx=0x7fc0d400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 -- 172.21.15.19:0/3777650723 shutdown_connections 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e410 0x7fc0dc133f30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/3777650723 >> v2:172.21.15.19:3300/0 conn(0x7fc0dc09d6f0 0x7fc0dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/3777650723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e000 0x7fc0dc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 -- 172.21.15.19:0/3777650723 >> 172.21.15.19:0/3777650723 conn(0x7fc0dc066f50 msgr2=0x7fc0dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 -- 172.21.15.19:0/3777650723 shutdown_connections 2023-10-03T10:19:31.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.410+0000 7fc0e20cc700 1 -- 172.21.15.19:0/3777650723 wait complete. 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.411+0000 7fc0e20cc700 1 Processor -- start 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.411+0000 7fc0e20cc700 1 -- start start 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e000 0x7fc0dc1a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 0x7fc0dc1c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1a6a00 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1b9360 con 0x7fc0dc09e410 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0e20cc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc1a7e30 con 0x7fc0dc09e000 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43554/0 (socket says 172.21.15.19:43554) 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 -- 172.21.15.19:0/1611131990 learned_addr learned my addr 172.21.15.19:0/1611131990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:31.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0daffd700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e000 0x7fc0dc1a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0dbfff700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 0x7fc0dc1c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 -- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e000 msgr2=0x7fc0dc1a5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e000 0x7fc0dc1a5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 -- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 msgr2=0x7fc0dc1c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 0x7fc0dc1c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 -- 172.21.15.19:0/1611131990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc009550 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0dbfff700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 0x7fc0dc1c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.412+0000 7fc0db7fe700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00ebe0 tx=0x7fc0cc00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.413+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00c850 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.413+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc00c9b0 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.413+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d4009a70 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.413+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc00cd40 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.413+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc1a8b60 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.414+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc074ea0 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.414+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0cc013470 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.414+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0cc03fc00 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.419+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0cc01b3b0 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.621+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0dc06c360 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.621+0000 7fc0c3fff700 1 -- 172.21.15.19:0/1611131990 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0cc024350 con 0x7fc0dc09d6f0 2023-10-03T10:19:31.621 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 msgr2=0x7fc0dc1a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc00ebe0 tx=0x7fc0cc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 shutdown_connections 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0dc09e410 0x7fc0dc1c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0dc09d6f0 0x7fc0dc1a5230 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 --2- 172.21.15.19:0/1611131990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0dc09e000 0x7fc0dc1a5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 >> 172.21.15.19:0/1611131990 conn(0x7fc0dc066f50 msgr2=0x7fc0dc0a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 shutdown_connections 2023-10-03T10:19:31.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:31.624+0000 7fc0e20cc700 1 -- 172.21.15.19:0/1611131990 wait complete. 2023-10-03T10:19:31.637 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:32.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:32.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:32.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.272+0000 7f2262d21700 1 Processor -- start 2023-10-03T10:19:32.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.272+0000 7f2262d21700 1 -- start start 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2262d21700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2262d21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2262d21700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c09edd0 con 0x7f225c0a1340 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2262d21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c09e1f0 con 0x7f225c134170 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2262d21700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f225c09dc50 con 0x7f225c0a0a30 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f225bfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f225c0a1340 0x7f225c133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50312/0 (socket says 172.21.15.19:50312) 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f225bfff700 1 -- 172.21.15.19:0/4201282839 learned_addr learned my addr 172.21.15.19:0/4201282839 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2260abd700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f22612be700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f225b7fe700 1 -- 172.21.15.19:0/4201282839 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335226456 0 0) 0x7f225c09edd0 con 0x7f225c0a1340 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f225b7fe700 1 -- 172.21.15.19:0/4201282839 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f224c0035b0 con 0x7f225c0a1340 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2260abd700 1 -- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 msgr2=0x7f225c13bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2260abd700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c13bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2260abd700 1 -- 172.21.15.19:0/4201282839 >> v1:172.21.15.19:6789/0 conn(0x7f225c0a1340 legacy=0x7f225c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.273+0000 7f2260abd700 1 -- 172.21.15.19:0/4201282839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0a1fe0 con 0x7f225c0a0a30 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.274+0000 7f22612be700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.274+0000 7f2260abd700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c0a0e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2250009870 tx=0x7f2250009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=232df793b0fab285 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.274+0000 7f225b7fe700 1 -- 172.21.15.19:0/4201282839 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250011830 con 0x7f225c0a0a30 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.274+0000 7f225b7fe700 1 -- 172.21.15.19:0/4201282839 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2250011990 con 0x7f225c0a0a30 2023-10-03T10:19:32.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.274+0000 7f225b7fe700 1 -- 172.21.15.19:0/4201282839 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250011d20 con 0x7f225c0a0a30 2023-10-03T10:19:32.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 -- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 msgr2=0x7f225c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c0a0e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f2250009870 tx=0x7f2250009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 -- 172.21.15.19:0/4201282839 shutdown_connections 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c13bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 --2- 172.21.15.19:0/4201282839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c0a0e00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 -- 172.21.15.19:0/4201282839 >> 172.21.15.19:0/4201282839 conn(0x7f225c0a6550 msgr2=0x7f225c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 -- 172.21.15.19:0/4201282839 shutdown_connections 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.275+0000 7f2262d21700 1 -- 172.21.15.19:0/4201282839 wait complete. 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 Processor -- start 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 -- start start 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c1228c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c126f30 con 0x7f225c0a1340 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c124c60 con 0x7f225c134170 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.276+0000 7f2262d21700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0a0220 con 0x7f225c0a0a30 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f225bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46034/0 (socket says 172.21.15.19:46034) 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 -- 172.21.15.19:0/2421921426 learned_addr learned my addr 172.21.15.19:0/2421921426 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f225bfff700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43562/0 (socket says 172.21.15.19:43562) 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f22612be700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c1228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 -- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 msgr2=0x7f225c1228c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c1228c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 -- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 msgr2=0x7f225c1c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 -- 172.21.15.19:0/2421921426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254009a70 con 0x7f225c0a0a30 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f225bfff700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f2260abd700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f22500090b0 tx=0x7f2250004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2250004450 con 0x7f225c0a0a30 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.277+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225001f070 con 0x7f225c0a0a30 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.278+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22500094a0 con 0x7f225c0a0a30 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.278+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22500038e0 con 0x7f225c0a0a30 2023-10-03T10:19:32.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.278+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0a25e0 con 0x7f225c0a0a30 2023-10-03T10:19:32.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.279+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2250003a40 con 0x7f225c0a0a30 2023-10-03T10:19:32.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.278+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c074ea0 con 0x7f225c0a0a30 2023-10-03T10:19:32.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.279+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2250021070 con 0x7f225c0a0a30 2023-10-03T10:19:32.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.288+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22500253e0 con 0x7f225c0a0a30 2023-10-03T10:19:32.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.312+0000 7ff984705700 1 Processor -- start 2023-10-03T10:19:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.312+0000 7ff984705700 1 -- start start 2023-10-03T10:19:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.312+0000 7ff984705700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 0x7ff97c136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff984705700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff97c136fe0 0x7ff97c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff984705700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff97c070940 con 0x7ff97c09e930 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff984705700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97c06fd60 con 0x7ff97c136fe0 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff984705700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c06fa80 con 0x7ff97c09f410 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff97c136fe0 0x7ff97c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff981ca0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 0x7ff97c136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff97c136fe0 0x7ff97c1393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43564/0 (socket says 172.21.15.19:43564) 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 -- 172.21.15.19:0/1390397215 learned_addr learned my addr 172.21.15.19:0/1390397215 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff9824a1700 1 --1- 172.21.15.19:0/1390397215 >> v1:172.21.15.19:6789/0 conn(0x7ff97c09e930 0x7ff97c09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50314/0 (socket says 172.21.15.19:50314) 2023-10-03T10:19:32.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 -- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 msgr2=0x7ff97c136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 0x7ff97c136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 -- 172.21.15.19:0/1390397215 >> v1:172.21.15.19:6789/0 conn(0x7ff97c09e930 legacy=0x7ff97c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff98149f700 1 -- 172.21.15.19:0/1390397215 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169962003 0 0) 0x7ff97c070940 con 0x7ff97c09e930 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 -- 172.21.15.19:0/1390397215 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c09fb60 con 0x7ff97c136fe0 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff981ca0700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 0x7ff97c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.313+0000 7ff982ca2700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c136fe0 0x7ff97c1393c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e50 tx=0x7ff97400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207790d991afcff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.314+0000 7ff98149f700 1 -- 172.21.15.19:0/1390397215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400e070 con 0x7ff97c136fe0 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.314+0000 7ff98149f700 1 -- 172.21.15.19:0/1390397215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97400b910 con 0x7ff97c136fe0 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.314+0000 7ff98149f700 1 -- 172.21.15.19:0/1390397215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97400bcc0 con 0x7ff97c136fe0 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.314+0000 7ff984705700 1 -- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c136fe0 msgr2=0x7ff97c1393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.314+0000 7ff984705700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c136fe0 0x7ff97c1393c0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff974009e50 tx=0x7ff97400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:32.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 -- 172.21.15.19:0/1390397215 shutdown_connections 2023-10-03T10:19:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c136fe0 0x7ff97c1393c0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 --2- 172.21.15.19:0/1390397215 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c09f410 0x7ff97c136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 -- 172.21.15.19:0/1390397215 >> 172.21.15.19:0/1390397215 conn(0x7ff97c0a4210 msgr2=0x7ff97c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 -- 172.21.15.19:0/1390397215 shutdown_connections 2023-10-03T10:19:32.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.315+0000 7ff984705700 1 -- 172.21.15.19:0/1390397215 wait complete. 2023-10-03T10:19:32.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 Processor -- start 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 -- start start 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff97c09f410 0x7ff97c1c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c136fe0 0x7ff97c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c132560 con 0x7ff97c09e930 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c06d640 con 0x7ff97c09f410 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff984705700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c120a50 con 0x7ff97c136fe0 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff9824a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff9824a1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43580/0 (socket says 172.21.15.19:43580) 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff9824a1700 1 -- 172.21.15.19:0/2379285705 learned_addr learned my addr 172.21.15.19:0/2379285705 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.316+0000 7ff982ca2700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c136fe0 0x7ff97c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 -- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c136fe0 msgr2=0x7ff97c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c136fe0 0x7ff97c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 -- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff97c09f410 msgr2=0x7ff97c1c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff97c09f410 0x7ff97c1c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 -- 172.21.15.19:0/2379285705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c0094a0 con 0x7ff97c09e930 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff9824a1700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c550 tx=0x7ff97800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978004c80 con 0x7ff97c09e930 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff978004e00 con 0x7ff97c09e930 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff978007310 con 0x7ff97c09e930 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff974009b30 con 0x7ff97c09e930 2023-10-03T10:19:32.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.317+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff97c1c8fa0 con 0x7ff97c09e930 2023-10-03T10:19:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.318+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff978007470 con 0x7ff97c09e930 2023-10-03T10:19:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.318+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97c09de50 con 0x7ff97c09e930 2023-10-03T10:19:32.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.319+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff97803f3a0 con 0x7ff97c09e930 2023-10-03T10:19:32.323 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.323+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9780106d0 con 0x7ff97c09e930 2023-10-03T10:19:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 Processor -- start 2023-10-03T10:19:32.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 -- start start 2023-10-03T10:19:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f4c133a80 0x7f8f4c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4c06bc00 con 0x7f8f4c130870 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f4c06c570 con 0x7f8f4c133a80 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.354+0000 7f8f50c22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c0a0040 con 0x7f8f4c12ff20 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4a59c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8f4c133a80 0x7f8f4c133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4ad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8f4c130870 0x7f8f4c13a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50330/0 (socket says 172.21.15.19:50330) 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45722/0 (socket says 172.21.15.19:45722) 2023-10-03T10:19:32.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4ad9d700 1 -- 172.21.15.19:0/3915503537 learned_addr learned my addr 172.21.15.19:0/3915503537 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:32.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 -- 172.21.15.19:0/3915503537 >> v2:172.21.15.19:3300/0 conn(0x7f8f4c133a80 msgr2=0x7f8f4c133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 --2- 172.21.15.19:0/3915503537 >> v2:172.21.15.19:3300/0 conn(0x7f8f4c133a80 0x7f8f4c133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 -- 172.21.15.19:0/3915503537 >> v1:172.21.15.19:6789/0 conn(0x7f8f4c130870 legacy=0x7f8f4c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 -- 172.21.15.19:0/3915503537 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c133860 con 0x7f8f4c12ff20 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f49d9b700 1 --2- 172.21.15.19:0/3915503537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009840 tx=0x7f8f40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=830447110f9c8fd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4959a700 1 -- 172.21.15.19:0/3915503537 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40011830 con 0x7f8f4c12ff20 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4959a700 1 -- 172.21.15.19:0/3915503537 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f40011990 con 0x7f8f4c12ff20 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.355+0000 7f8f4959a700 1 -- 172.21.15.19:0/3915503537 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f40011d20 con 0x7f8f4c12ff20 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 -- 172.21.15.19:0/3915503537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 msgr2=0x7f8f4c130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 --2- 172.21.15.19:0/3915503537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009840 tx=0x7f8f40009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 -- 172.21.15.19:0/3915503537 shutdown_connections 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 --2- 172.21.15.19:0/3915503537 >> v2:172.21.15.19:3300/0 conn(0x7f8f4c133a80 0x7f8f4c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 --2- 172.21.15.19:0/3915503537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c12ff20 0x7f8f4c130330 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 -- 172.21.15.19:0/3915503537 >> 172.21.15.19:0/3915503537 conn(0x7f8f4c0a4210 msgr2=0x7f8f4c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 -- 172.21.15.19:0/3915503537 shutdown_connections 2023-10-03T10:19:32.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.356+0000 7f8f50c22700 1 -- 172.21.15.19:0/3915503537 wait complete. 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.357+0000 7f8f50c22700 1 Processor -- start 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.357+0000 7f8f50c22700 1 -- start start 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 0x7f8f4c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c133a80 0x7f8f4c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c09e4a0 con 0x7f8f4c130870 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c120060 con 0x7f8f4c133a80 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f50c22700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c12db00 con 0x7f8f4c12ff20 2023-10-03T10:19:32.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46052/0 (socket says 172.21.15.19:46052) 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 -- 172.21.15.19:0/1836776414 learned_addr learned my addr 172.21.15.19:0/1836776414 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4ad9d700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c133a80 0x7f8f4c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f49d9b700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 0x7f8f4c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 -- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c133a80 msgr2=0x7f8f4c09cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c133a80 0x7f8f4c09cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 -- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 msgr2=0x7f8f4c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 0x7f8f4c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.358+0000 7f8f4a59c700 1 -- 172.21.15.19:0/1836776414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400094a0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f49d9b700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 0x7f8f4c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f4a59c700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e9b0 tx=0x7f8f3c00ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c009710 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c00ee50 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c120ad0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c00ca50 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.359+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c09def0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.360+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f3c00cbb0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.360+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f3c03f720 con 0x7f8f4c12ff20 2023-10-03T10:19:32.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.360+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4c074ea0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.370+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f3c0232f0 con 0x7f8f4c12ff20 2023-10-03T10:19:32.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.498+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f225c0a28e0 con 0x7f225c0a0a30 2023-10-03T10:19:32.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.499+0000 7f22597fa700 1 -- 172.21.15.19:0/2421921426 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2250015020 con 0x7f225c0a0a30 2023-10-03T10:19:32.499 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:32.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 msgr2=0x7f225c1c8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f22500090b0 tx=0x7f2250004750 comp rx=0 tx=0).stop 2023-10-03T10:19:32.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 shutdown_connections 2023-10-03T10:19:32.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f225c134170 0x7f225c1228c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f225c0a0a30 0x7f225c1c8780 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 --2- 172.21.15.19:0/2421921426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f225c0a1340 0x7f225c1c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 >> 172.21.15.19:0/2421921426 conn(0x7f225c0a6550 msgr2=0x7f225c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 shutdown_connections 2023-10-03T10:19:32.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.502+0000 7f2262d21700 1 -- 172.21.15.19:0/2421921426 wait complete. 2023-10-03T10:19:32.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:32.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.550+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff97c071d20 con 0x7ff97c09e930 2023-10-03T10:19:32.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.550+0000 7ff972ffd700 1 -- 172.21.15.19:0/2379285705 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff978011360 con 0x7ff97c09e930 2023-10-03T10:19:32.550 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 msgr2=0x7ff97c1c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff97800c550 tx=0x7ff97800c860 comp rx=0 tx=0).stop 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 shutdown_connections 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff97c136fe0 0x7ff97c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff97c09e930 0x7ff97c1c8520 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 --2- 172.21.15.19:0/2379285705 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff97c09f410 0x7ff97c1c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 >> 172.21.15.19:0/2379285705 conn(0x7ff97c0a4210 msgr2=0x7ff97c134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 shutdown_connections 2023-10-03T10:19:32.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.553+0000 7ff984705700 1 -- 172.21.15.19:0/2379285705 wait complete. 2023-10-03T10:19:32.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.576+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f4c06b250 con 0x7f8f4c12ff20 2023-10-03T10:19:32.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.576+0000 7f8f3affd700 1 -- 172.21.15.19:0/1836776414 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f3c017020 con 0x7f8f4c12ff20 2023-10-03T10:19:32.576 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 msgr2=0x7f8f4c09c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c00e9b0 tx=0x7f8f3c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 shutdown_connections 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f4c133a80 0x7f8f4c09cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f4c12ff20 0x7f8f4c09c480 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 --2- 172.21.15.19:0/1836776414 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f4c130870 0x7f8f4c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 >> 172.21.15.19:0/1836776414 conn(0x7f8f4c0a4210 msgr2=0x7f8f4c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 shutdown_connections 2023-10-03T10:19:32.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.579+0000 7f8f50c22700 1 -- 172.21.15.19:0/1836776414 wait complete. 2023-10-03T10:19:32.593 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:32.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.778+0000 7fa1f3ac7700 1 Processor -- start 2023-10-03T10:19:32.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.778+0000 7fa1f3ac7700 1 -- start start 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.778+0000 7fa1f3ac7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f3ac7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1ec09f650 0x7fa1ec131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f3ac7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1ec070940 con 0x7fa1ec09f240 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f3ac7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1ec06fd60 con 0x7fa1ec09f650 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f3ac7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec06fa80 con 0x7fa1ec09e930 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f1863700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f1863700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45728/0 (socket says 172.21.15.19:45728) 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1ec09f650 0x7fa1ec131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f1863700 1 -- 172.21.15.19:0/927937206 learned_addr learned my addr 172.21.15.19:0/927937206 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f1062700 1 --1- 172.21.15.19:0/927937206 >> v1:172.21.15.19:6789/0 conn(0x7fa1ec09f240 0x7fa1ec1317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50346/0 (socket says 172.21.15.19:50346) 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 -- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 msgr2=0x7fa1ec09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 -- 172.21.15.19:0/927937206 >> v1:172.21.15.19:6789/0 conn(0x7fa1ec09f240 legacy=0x7fa1ec1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 -- 172.21.15.19:0/927937206 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec09fb60 con 0x7fa1ec09f650 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f1863700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f2064700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09f650 0x7fa1ec131f00 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009d90 tx=0x7fa1e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5eace225d84cea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f0861700 1 -- 172.21.15.19:0/927937206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e400e070 con 0x7fa1ec09f650 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f0861700 1 -- 172.21.15.19:0/927937206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e400bb20 con 0x7fa1ec09f650 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.779+0000 7fa1f0861700 1 -- 172.21.15.19:0/927937206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4012430 con 0x7fa1ec09f650 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09f650 msgr2=0x7fa1ec131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09f650 0x7fa1ec131f00 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009d90 tx=0x7fa1e400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/927937206 shutdown_connections 2023-10-03T10:19:32.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09f650 0x7fa1ec131f00 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/927937206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09e930 0x7fa1ec09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/927937206 >> 172.21.15.19:0/927937206 conn(0x7fa1ec0a4210 msgr2=0x7fa1ec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/927937206 shutdown_connections 2023-10-03T10:19:32.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.780+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/927937206 wait complete. 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.781+0000 7fa1f3ac7700 1 Processor -- start 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.781+0000 7fa1f3ac7700 1 -- start start 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1ec09f240 0x7fa1ec06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09f650 0x7fa1ec06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1a8920 con 0x7fa1ec09e930 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1a9960 con 0x7fa1ec09f650 2023-10-03T10:19:32.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f3ac7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ec1a9450 con 0x7fa1ec09f240 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43608/0 (socket says 172.21.15.19:43608) 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 -- 172.21.15.19:0/2576593276 learned_addr learned my addr 172.21.15.19:0/2576593276 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1062700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1ec09f240 0x7fa1ec06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f2064700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09f650 0x7fa1ec06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 -- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1ec09f240 msgr2=0x7fa1ec06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1ec09f240 0x7fa1ec06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 -- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09f650 msgr2=0x7fa1ec06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09f650 0x7fa1ec06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 -- 172.21.15.19:0/2576593276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009550 con 0x7fa1ec09e930 2023-10-03T10:19:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1f1863700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800ec10 tx=0x7fa1e800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.782+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800c850 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.783+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e800c9b0 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.783+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1e4009a70 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.783+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e800cd40 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.783+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ec0a0190 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.783+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1e8013470 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.784+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa1e803f9a0 con 0x7fa1ec09e930 2023-10-03T10:19:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.784+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ec1a8d30 con 0x7fa1ec09e930 2023-10-03T10:19:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.788+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa1e8013720 con 0x7fa1ec09e930 2023-10-03T10:19:32.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.994+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa1ec1a0b30 con 0x7fa1ec09e930 2023-10-03T10:19:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.994+0000 7fa1e27fc700 1 -- 172.21.15.19:0/2576593276 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa1e802a090 con 0x7fa1ec09e930 2023-10-03T10:19:32.994 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:32.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 msgr2=0x7fa1ec06b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800ec10 tx=0x7fa1e800ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 shutdown_connections 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa1ec09f650 0x7fa1ec06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1ec09e930 0x7fa1ec06b8b0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 --2- 172.21.15.19:0/2576593276 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1ec09f240 0x7fa1ec06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 >> 172.21.15.19:0/2576593276 conn(0x7fa1ec0a4210 msgr2=0x7fa1ec1b8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 shutdown_connections 2023-10-03T10:19:32.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:32.996+0000 7fa1f3ac7700 1 -- 172.21.15.19:0/2576593276 wait complete. 2023-10-03T10:19:33.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:33.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:33.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:33.593 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.681+0000 7f50cfee4700 1 Processor -- start 2023-10-03T10:19:33.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.681+0000 7f50cfee4700 1 -- start start 2023-10-03T10:19:33.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cfee4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50c809e1d0 0x7f50c8135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cfee4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 0x7f50c8138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cfee4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c809f130 con 0x7f50c809d6f0 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cfee4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c809f520 con 0x7f50c809e1d0 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cfee4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50c809e930 con 0x7f50c8135e50 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cd47f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50c809e1d0 0x7f50c8135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50ce481700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 0x7f50c8138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cdc80700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f50c809d6f0 0x7f50c809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50352/0 (socket says 172.21.15.19:50352) 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.682+0000 7f50cdc80700 1 -- 172.21.15.19:0/66502118 learned_addr learned my addr 172.21.15.19:0/66502118 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50cd47f700 1 -- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 msgr2=0x7f50c8138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50cd47f700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 0x7f50c8138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50cd47f700 1 -- 172.21.15.19:0/66502118 >> v1:172.21.15.19:6789/0 conn(0x7f50c809d6f0 legacy=0x7f50c809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50cd47f700 1 -- 172.21.15.19:0/66502118 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c809b2d0 con 0x7f50c809e1d0 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50ccc7e700 1 -- 172.21.15.19:0/66502118 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934511350 0 0) 0x7f50c809f130 con 0x7f50c809d6f0 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50ce481700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 0x7f50c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50cd47f700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c8135910 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b8f0 tx=0x7f50b800bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7a2ee6d5553878 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50ccc7e700 1 -- 172.21.15.19:0/66502118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800c9f0 con 0x7f50c809e1d0 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50ccc7e700 1 -- 172.21.15.19:0/66502118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b800cb50 con 0x7f50c809e1d0 2023-10-03T10:19:33.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.683+0000 7f50ccc7e700 1 -- 172.21.15.19:0/66502118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800f460 con 0x7f50c809e1d0 2023-10-03T10:19:33.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 -- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 msgr2=0x7f50c8135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c8135910 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b8f0 tx=0x7f50b800bc00 comp rx=0 tx=0).stop 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 -- 172.21.15.19:0/66502118 shutdown_connections 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c8135e50 0x7f50c8138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 --2- 172.21.15.19:0/66502118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c8135910 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 -- 172.21.15.19:0/66502118 >> 172.21.15.19:0/66502118 conn(0x7f50c8066f50 msgr2=0x7f50c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 -- 172.21.15.19:0/66502118 shutdown_connections 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.684+0000 7f50cfee4700 1 -- 172.21.15.19:0/66502118 wait complete. 2023-10-03T10:19:33.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 Processor -- start 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 -- start start 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c81c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50c8135e50 0x7f50c81196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c811ce40 con 0x7f50c809e1d0 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c811b6a0 con 0x7f50c8135e50 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.686+0000 7f50cfee4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50c811b0c0 con 0x7f50c809d6f0 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46080/0 (socket says 172.21.15.19:46080) 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 -- 172.21.15.19:0/3789042027 learned_addr learned my addr 172.21.15.19:0/3789042027 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cd47f700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c81c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50ce481700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50c8135e50 0x7f50c81196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 -- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50c8135e50 msgr2=0x7f50c81196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50c8135e50 0x7f50c81196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 -- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 msgr2=0x7f50c81c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c81c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 -- 172.21.15.19:0/3789042027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c000f050 con 0x7f50c809d6f0 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cd47f700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c81c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cdc80700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c550 tx=0x7f50c400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4004c80 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c4004de0 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b800b550 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.687+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4007310 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.688+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c811d7d0 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.688+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f50c4007470 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.688+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f50c403f1d0 con 0x7f50c809d6f0 2023-10-03T10:19:33.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.689+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c80a2a60 con 0x7f50c809d6f0 2023-10-03T10:19:33.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.694+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f50c40123b0 con 0x7f50c809d6f0 2023-10-03T10:19:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.728+0000 7fe2c704b700 1 Processor -- start 2023-10-03T10:19:33.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.728+0000 7fe2c704b700 1 -- start start 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c704b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe2c00a0a30 0x7fe2c00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c704b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c704b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c009edd0 con 0x7fe2c00a1340 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c704b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c009e1f0 con 0x7fe2c00a0a30 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c704b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c009dc50 con 0x7fe2c0134170 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45752/0 (socket says 172.21.15.19:45752) 2023-10-03T10:19:33.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 -- 172.21.15.19:0/693397803 learned_addr learned my addr 172.21.15.19:0/693397803 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2bffff700 1 --1- 172.21.15.19:0/693397803 >> v1:172.21.15.19:6789/0 conn(0x7fe2c00a1340 0x7fe2c0133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50362/0 (socket says 172.21.15.19:50362) 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c4de7700 1 --2- 172.21.15.19:0/693397803 >> v2:172.21.15.19:3300/0 conn(0x7fe2c00a0a30 0x7fe2c00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 -- 172.21.15.19:0/693397803 >> v2:172.21.15.19:3300/0 conn(0x7fe2c00a0a30 msgr2=0x7fe2c00a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 --2- 172.21.15.19:0/693397803 >> v2:172.21.15.19:3300/0 conn(0x7fe2c00a0a30 0x7fe2c00a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 -- 172.21.15.19:0/693397803 >> v1:172.21.15.19:6789/0 conn(0x7fe2c00a1340 legacy=0x7fe2c0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 -- 172.21.15.19:0/693397803 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00a1fe0 con 0x7fe2c0134170 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.729+0000 7fe2c55e8700 1 --2- 172.21.15.19:0/693397803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009e50 tx=0x7fe2b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a8e10039f5b878 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2bf7fe700 1 -- 172.21.15.19:0/693397803 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800e070 con 0x7fe2c0134170 2023-10-03T10:19:33.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2bf7fe700 1 -- 172.21.15.19:0/693397803 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800b910 con 0x7fe2c0134170 2023-10-03T10:19:33.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2bf7fe700 1 -- 172.21.15.19:0/693397803 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800bcc0 con 0x7fe2c0134170 2023-10-03T10:19:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 -- 172.21.15.19:0/693397803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 msgr2=0x7fe2c013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 --2- 172.21.15.19:0/693397803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009e50 tx=0x7fe2b800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 -- 172.21.15.19:0/693397803 shutdown_connections 2023-10-03T10:19:33.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 --2- 172.21.15.19:0/693397803 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c013bd30 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 --2- 172.21.15.19:0/693397803 >> v2:172.21.15.19:3300/0 conn(0x7fe2c00a0a30 0x7fe2c00a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.730+0000 7fe2c704b700 1 -- 172.21.15.19:0/693397803 >> 172.21.15.19:0/693397803 conn(0x7fe2c00a6550 msgr2=0x7fe2c00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.731+0000 7fe2c704b700 1 -- 172.21.15.19:0/693397803 shutdown_connections 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.731+0000 7fe2c704b700 1 -- 172.21.15.19:0/693397803 wait complete. 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.732+0000 7fe2c704b700 1 Processor -- start 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.732+0000 7fe2c704b700 1 -- start start 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 0x7fe2c01232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c01c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0122f60 con 0x7fe2c00a1340 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00a4f40 con 0x7fe2c0134170 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c704b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c0126200 con 0x7fe2c00a0a30 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2bffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43652/0 (socket says 172.21.15.19:43652) 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c4de7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 0x7fe2c01232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2bffff700 1 -- 172.21.15.19:0/1694557782 learned_addr learned my addr 172.21.15.19:0/1694557782 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2c55e8700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c01c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.733+0000 7fe2bffff700 1 -- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 msgr2=0x7fe2c01232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bffff700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 0x7fe2c01232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bffff700 1 -- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 msgr2=0x7fe2c01c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bffff700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c01c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bffff700 1 -- 172.21.15.19:0/1694557782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8009b30 con 0x7fe2c00a1340 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2c4de7700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 0x7fe2c01232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2c55e8700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c01c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bffff700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c520 tx=0x7fe2ac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac005cb0 con 0x7fe2c00a1340 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac005e10 con 0x7fe2c00a1340 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00a25e0 con 0x7fe2c00a1340 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0072d0 con 0x7fe2c00a1340 2023-10-03T10:19:33.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.734+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c0124dc0 con 0x7fe2c00a1340 2023-10-03T10:19:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.735+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2ac007430 con 0x7fe2c00a1340 2023-10-03T10:19:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.735+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe2ac03eaa0 con 0x7fe2c00a1340 2023-10-03T10:19:33.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.735+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c0074ea0 con 0x7fe2c00a1340 2023-10-03T10:19:33.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.740+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe2ac017020 con 0x7fe2c00a1340 2023-10-03T10:19:33.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.758+0000 7f56f6b1d700 1 Processor -- start 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.758+0000 7f56f6b1d700 1 -- start start 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f6b1d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f56f006a770 0x7f56f009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f6b1d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f6b1d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f009a810 con 0x7f56f009dc30 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f6b1d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f006ab40 con 0x7f56f006a770 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f6b1d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f009ebc0 con 0x7f56f013d1f0 2023-10-03T10:19:33.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56effff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f56f009dc30 0x7f56f009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50370/0 (socket says 172.21.15.19:50370) 2023-10-03T10:19:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56effff700 1 -- 172.21.15.19:0/1237126745 learned_addr learned my addr 172.21.15.19:0/1237126745 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f50ba700 1 --2- 172.21.15.19:0/1237126745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f48b9700 1 --2- 172.21.15.19:0/1237126745 >> v2:172.21.15.19:3300/0 conn(0x7f56f006a770 0x7f56f009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.761 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f50ba700 1 -- 172.21.15.19:0/1237126745 >> v2:172.21.15.19:3300/0 conn(0x7f56f006a770 msgr2=0x7f56f009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f50ba700 1 --2- 172.21.15.19:0/1237126745 >> v2:172.21.15.19:3300/0 conn(0x7f56f006a770 0x7f56f009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f50ba700 1 -- 172.21.15.19:0/1237126745 >> v1:172.21.15.19:6789/0 conn(0x7f56f009dc30 legacy=0x7f56f009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.759+0000 7f56f50ba700 1 -- 172.21.15.19:0/1237126745 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f009e920 con 0x7f56f013d1f0 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.760+0000 7f56f50ba700 1 --2- 172.21.15.19:0/1237126745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f013f5d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009d90 tx=0x7f56e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4ae4cc36bb2643 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.760+0000 7f56ef7fe700 1 -- 172.21.15.19:0/1237126745 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e800e070 con 0x7f56f013d1f0 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.760+0000 7f56ef7fe700 1 -- 172.21.15.19:0/1237126745 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e800bb20 con 0x7f56f013d1f0 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.760+0000 7f56ef7fe700 1 -- 172.21.15.19:0/1237126745 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8012430 con 0x7f56f013d1f0 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 -- 172.21.15.19:0/1237126745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 msgr2=0x7f56f013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/1237126745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f013f5d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f56e8009d90 tx=0x7f56e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 -- 172.21.15.19:0/1237126745 shutdown_connections 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/1237126745 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f013f5d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/1237126745 >> v2:172.21.15.19:3300/0 conn(0x7f56f006a770 0x7f56f009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 -- 172.21.15.19:0/1237126745 >> 172.21.15.19:0/1237126745 conn(0x7f56f0066f50 msgr2=0x7f56f009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 -- 172.21.15.19:0/1237126745 shutdown_connections 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.761+0000 7f56f6b1d700 1 -- 172.21.15.19:0/1237126745 wait complete. 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.762+0000 7f56f6b1d700 1 Processor -- start 2023-10-03T10:19:33.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.762+0000 7f56f6b1d700 1 -- start start 2023-10-03T10:19:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 0x7f56f01260a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f0126b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f0128590 con 0x7f56f006a770 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00a3760 con 0x7f56f009dc30 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f6b1d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f01281e0 con 0x7f56f013d1f0 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45774/0 (socket says 172.21.15.19:45774) 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 -- 172.21.15.19:0/3140867619 learned_addr learned my addr 172.21.15.19:0/3140867619 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f50ba700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f0126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f48b9700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 0x7f56f01260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:33.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 -- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 msgr2=0x7f56f0126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f0126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 -- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 msgr2=0x7f56f01260a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 0x7f56f01260a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 -- 172.21.15.19:0/3140867619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e8009a70 con 0x7f56f009dc30 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56f48b9700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 0x7f56f01260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.763+0000 7f56effff700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c520 tx=0x7f56dc00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.764+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc005d70 con 0x7f56f009dc30 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.764+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc0070d0 con 0x7f56f009dc30 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.764+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f0128770 con 0x7f56f009dc30 2023-10-03T10:19:33.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.764+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc007440 con 0x7f56f009dc30 2023-10-03T10:19:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.764+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f0071aa0 con 0x7f56f009dc30 2023-10-03T10:19:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.765+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f56dc0075a0 con 0x7f56f009dc30 2023-10-03T10:19:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.765+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f56dc03eaf0 con 0x7f56f009dc30 2023-10-03T10:19:33.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.765+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f0128900 con 0x7f56f009dc30 2023-10-03T10:19:33.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.770+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f56dc017030 con 0x7f56f009dc30 2023-10-03T10:19:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.902+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f50c8074ea0 con 0x7f50c809d6f0 2023-10-03T10:19:33.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.902+0000 7f50be7fc700 1 -- 172.21.15.19:0/3789042027 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f50c4011360 con 0x7f50c809d6f0 2023-10-03T10:19:33.902 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 msgr2=0x7f50c81c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f50c400c550 tx=0x7f50c400c860 comp rx=0 tx=0).stop 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 shutdown_connections 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50c8135e50 0x7f50c81196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50c809d6f0 0x7f50c81c4230 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 --2- 172.21.15.19:0/3789042027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c809e1d0 0x7f50c81c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 >> 172.21.15.19:0/3789042027 conn(0x7f50c8066f50 msgr2=0x7f50c81327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 shutdown_connections 2023-10-03T10:19:33.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.905+0000 7f50cfee4700 1 -- 172.21.15.19:0/3789042027 wait complete. 2023-10-03T10:19:33.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:33.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.950+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe2c00a28e0 con 0x7fe2c00a1340 2023-10-03T10:19:33.951 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.951+0000 7fe2bd7fa700 1 -- 172.21.15.19:0/1694557782 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe2ac01b3b0 con 0x7fe2c00a1340 2023-10-03T10:19:33.951 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 msgr2=0x7fe2c0123820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00c520 tx=0x7fe2ac00c830 comp rx=0 tx=0).stop 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 shutdown_connections 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe2c0134170 0x7fe2c01c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe2c00a0a30 0x7fe2c01232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 --2- 172.21.15.19:0/1694557782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe2c00a1340 0x7fe2c0123820 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 >> 172.21.15.19:0/1694557782 conn(0x7fe2c00a6550 msgr2=0x7fe2c009ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 shutdown_connections 2023-10-03T10:19:33.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.953+0000 7fe2c704b700 1 -- 172.21.15.19:0/1694557782 wait complete. 2023-10-03T10:19:33.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.977+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f56f0127d90 con 0x7f56f009dc30 2023-10-03T10:19:33.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.978+0000 7f56ed7fa700 1 -- 172.21.15.19:0/3140867619 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f56dc011d70 con 0x7f56f009dc30 2023-10-03T10:19:33.977 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 msgr2=0x7f56f01265e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c520 tx=0x7f56dc00c830 comp rx=0 tx=0).stop 2023-10-03T10:19:33.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 shutdown_connections 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f56f013d1f0 0x7f56f0126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f56f006a770 0x7f56f01260a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 --2- 172.21.15.19:0/3140867619 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f56f009dc30 0x7f56f01265e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 >> 172.21.15.19:0/3140867619 conn(0x7f56f0066f50 msgr2=0x7f56f00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 shutdown_connections 2023-10-03T10:19:33.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:33.980+0000 7f56f6b1d700 1 -- 172.21.15.19:0/3140867619 wait complete. 2023-10-03T10:19:33.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:34.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:34.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 Processor -- start 2023-10-03T10:19:34.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 -- start start 2023-10-03T10:19:34.175 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 0x7fa9d4138d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d413b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d409ea10 con 0x7fa9d40a09c0 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d409e210 con 0x7fa9d409d5c0 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d96ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40a26f0 con 0x7fa9d40a14a0 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9d40a09c0 0x7fa9d40a0d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50380/0 (socket says 172.21.15.19:50380) 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d413b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d2ffd700 1 -- 172.21.15.19:0/884652044 learned_addr learned my addr 172.21.15.19:0/884652044 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.174+0000 7fa9d27fc700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 0x7fa9d4138d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d27fc700 1 -- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 msgr2=0x7fa9d413b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d27fc700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d413b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.176 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d27fc700 1 -- 172.21.15.19:0/884652044 >> v1:172.21.15.19:6789/0 conn(0x7fa9d40a09c0 legacy=0x7fa9d40a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d1ffb700 1 -- 172.21.15.19:0/884652044 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743651528 0 0) 0x7fa9d409ea10 con 0x7fa9d40a09c0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d27fc700 1 -- 172.21.15.19:0/884652044 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d409db70 con 0x7fa9d409d5c0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d37fe700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d413b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d27fc700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 0x7fa9d4138d70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009870 tx=0x7fa9c4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d08e774f3052cd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d1ffb700 1 -- 172.21.15.19:0/884652044 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011830 con 0x7fa9d409d5c0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d1ffb700 1 -- 172.21.15.19:0/884652044 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c4011990 con 0x7fa9d409d5c0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.175+0000 7fa9d1ffb700 1 -- 172.21.15.19:0/884652044 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c4011d20 con 0x7fa9d409d5c0 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 -- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 msgr2=0x7fa9d4138d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 0x7fa9d4138d70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4009870 tx=0x7fa9c4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 -- 172.21.15.19:0/884652044 shutdown_connections 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d413b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/884652044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d409d5c0 0x7fa9d4138d70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 -- 172.21.15.19:0/884652044 >> 172.21.15.19:0/884652044 conn(0x7fa9d40a2fe0 msgr2=0x7fa9d40a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 -- 172.21.15.19:0/884652044 shutdown_connections 2023-10-03T10:19:34.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.176+0000 7fa9d96ce700 1 -- 172.21.15.19:0/884652044 wait complete. 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 Processor -- start 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 -- start start 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d409d5c0 0x7fa9d411c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 0x7fa9d411ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d411d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d411fbe0 con 0x7fa9d409d5c0 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d411ead0 con 0x7fa9d40a09c0 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d96ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d411dd70 con 0x7fa9d40a14a0 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 0x7fa9d411ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d409d5c0 0x7fa9d411c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.177+0000 7fa9d37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d411d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 0x7fa9d411ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45794/0 (socket says 172.21.15.19:45794) 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d27fc700 1 -- 172.21.15.19:0/3061143815 learned_addr learned my addr 172.21.15.19:0/3061143815 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 -- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 msgr2=0x7fa9d411ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 0x7fa9d411ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 -- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d409d5c0 msgr2=0x7fa9d411c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d409d5c0 0x7fa9d411c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 -- 172.21.15.19:0/3061143815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc009a70 con 0x7fa9d40a14a0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d37fe700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d411d230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00efc0 tx=0x7fa9cc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00ca90 con 0x7fa9d40a14a0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00f040 con 0x7fa9d40a14a0 2023-10-03T10:19:34.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c40094a0 con 0x7fa9d40a14a0 2023-10-03T10:19:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00ce30 con 0x7fa9d40a14a0 2023-10-03T10:19:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.178+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d411efe0 con 0x7fa9d40a14a0 2023-10-03T10:19:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.179+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9cc014480 con 0x7fa9d40a14a0 2023-10-03T10:19:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.179+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9cc03fcb0 con 0x7fa9d40a14a0 2023-10-03T10:19:34.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.179+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d411f840 con 0x7fa9d40a14a0 2023-10-03T10:19:34.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.184+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9d411f840 con 0x7fa9d40a14a0 2023-10-03T10:19:34.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.390+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa9d411f840 con 0x7fa9d40a14a0 2023-10-03T10:19:34.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.391+0000 7fa9bb7fe700 1 -- 172.21.15.19:0/3061143815 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9d411f840 con 0x7fa9d40a14a0 2023-10-03T10:19:34.391 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:34.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 msgr2=0x7fa9d411d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:34.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d411d230 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00efc0 tx=0x7fa9cc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 shutdown_connections 2023-10-03T10:19:34.393 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9d40a14a0 0x7fa9d411d230 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9d409d5c0 0x7fa9d411c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 --2- 172.21.15.19:0/3061143815 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9d40a09c0 0x7fa9d411ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:34.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 >> 172.21.15.19:0/3061143815 conn(0x7fa9d40a2fe0 msgr2=0x7fa9d4136d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:34.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 shutdown_connections 2023-10-03T10:19:34.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:34.393+0000 7fa9d96ce700 1 -- 172.21.15.19:0/3061143815 wait complete. 2023-10-03T10:19:34.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:34.920 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:34.968 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:34.995 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:35.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.070+0000 7f9767a41700 1 Processor -- start 2023-10-03T10:19:35.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 -- start start 2023-10-03T10:19:35.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f97600a1340 0x7f9760133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f976009edd0 con 0x7f9760133fa0 2023-10-03T10:19:35.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f976009e1f0 con 0x7f97600a1340 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9767a41700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f976009dc50 con 0x7f97600a0a30 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f97657dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f97657dd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46122/0 (socket says 172.21.15.19:46122) 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f97657dd700 1 -- 172.21.15.19:0/395613934 learned_addr learned my addr 172.21.15.19:0/395613934 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.071+0000 7f9764fdc700 1 --2- 172.21.15.19:0/395613934 >> v2:172.21.15.19:3300/0 conn(0x7f97600a1340 0x7f9760133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f97657dd700 1 -- 172.21.15.19:0/395613934 >> v2:172.21.15.19:3300/0 conn(0x7f97600a1340 msgr2=0x7f9760133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f97657dd700 1 --2- 172.21.15.19:0/395613934 >> v2:172.21.15.19:3300/0 conn(0x7f97600a1340 0x7f9760133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f97657dd700 1 -- 172.21.15.19:0/395613934 >> v1:172.21.15.19:6789/0 conn(0x7f9760133fa0 legacy=0x7f976013ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f97657dd700 1 -- 172.21.15.19:0/395613934 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600a1fe0 con 0x7f97600a0a30 2023-10-03T10:19:35.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f97657dd700 1 --2- 172.21.15.19:0/395613934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e50 tx=0x7f975c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71be4dd242d6f344 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f9757fff700 1 -- 172.21.15.19:0/395613934 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00e070 con 0x7f97600a0a30 2023-10-03T10:19:35.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f9757fff700 1 -- 172.21.15.19:0/395613934 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00b910 con 0x7f97600a0a30 2023-10-03T10:19:35.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.072+0000 7f9757fff700 1 -- 172.21.15.19:0/395613934 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00bcc0 con 0x7f97600a0a30 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 -- 172.21.15.19:0/395613934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 msgr2=0x7f97600a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 --2- 172.21.15.19:0/395613934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f975c009e50 tx=0x7f975c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 -- 172.21.15.19:0/395613934 shutdown_connections 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 --2- 172.21.15.19:0/395613934 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97600a0a30 0x7f97600a0e00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 --2- 172.21.15.19:0/395613934 >> v2:172.21.15.19:3300/0 conn(0x7f97600a1340 0x7f9760133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 -- 172.21.15.19:0/395613934 >> 172.21.15.19:0/395613934 conn(0x7f97600a6550 msgr2=0x7f97600a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 -- 172.21.15.19:0/395613934 shutdown_connections 2023-10-03T10:19:35.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.073+0000 7f9767a41700 1 -- 172.21.15.19:0/395613934 wait complete. 2023-10-03T10:19:35.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.075+0000 7f9767a41700 1 Processor -- start 2023-10-03T10:19:35.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.075+0000 7f9767a41700 1 -- start start 2023-10-03T10:19:35.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.075+0000 7f9767a41700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9767a41700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 0x7f976011eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9767a41700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9760133fa0 0x7f976011f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9767a41700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600a0290 con 0x7f97600a1340 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9767a41700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97601209e0 con 0x7f97600a0a30 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9767a41700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9760122010 con 0x7f9760133fa0 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45810/0 (socket says 172.21.15.19:45810) 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 -- 172.21.15.19:0/3240255171 learned_addr learned my addr 172.21.15.19:0/3240255171 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9764fdc700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 0x7f976011eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9765fde700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9760133fa0 0x7f976011f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 -- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9760133fa0 msgr2=0x7f976011f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9760133fa0 0x7f976011f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 -- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 msgr2=0x7f976011eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 0x7f976011eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 -- 172.21.15.19:0/3240255171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009b30 con 0x7f97600a0a30 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f9764fdc700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 0x7f976011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.076+0000 7f97657dd700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b370 tx=0x7f975c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.077+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c004800 con 0x7f97600a0a30 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.077+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c0092e0 con 0x7f97600a0a30 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.077+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760120560 con 0x7f97600a0a30 2023-10-03T10:19:35.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.077+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c01c680 con 0x7f97600a0a30 2023-10-03T10:19:35.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.077+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97600a38a0 con 0x7f97600a0a30 2023-10-03T10:19:35.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.078+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f975c01c7e0 con 0x7f97600a0a30 2023-10-03T10:19:35.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.078+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f975c040ff0 con 0x7f97600a0a30 2023-10-03T10:19:35.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.079+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9760133760 con 0x7f97600a0a30 2023-10-03T10:19:35.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.088+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f975c0123f0 con 0x7f97600a0a30 2023-10-03T10:19:35.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 Processor -- start 2023-10-03T10:19:35.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 -- start start 2023-10-03T10:19:35.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f46d8139250 0x7f46d813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46d809edd0 con 0x7f46d80a0a30 2023-10-03T10:19:35.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46d80a18e0 con 0x7f46d8139250 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.117+0000 7f46df8e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d809e1f0 con 0x7f46d80a1510 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46144/0 (socket says 172.21.15.19:46144) 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 -- 172.21.15.19:0/1603764837 learned_addr learned my addr 172.21.15.19:0/1603764837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dde7e700 1 --2- 172.21.15.19:0/1603764837 >> v2:172.21.15.19:3300/0 conn(0x7f46d8139250 0x7f46d813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 -- 172.21.15.19:0/1603764837 >> v2:172.21.15.19:3300/0 conn(0x7f46d8139250 msgr2=0x7f46d813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 --2- 172.21.15.19:0/1603764837 >> v2:172.21.15.19:3300/0 conn(0x7f46d8139250 0x7f46d813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 -- 172.21.15.19:0/1603764837 >> v1:172.21.15.19:6789/0 conn(0x7f46d80a0a30 legacy=0x7f46d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 -- 172.21.15.19:0/1603764837 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d809dc50 con 0x7f46d80a1510 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46dce7c700 1 --2- 172.21.15.19:0/1603764837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009920 tx=0x7f46c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1448181cc22496 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.118+0000 7f46cffff700 1 -- 172.21.15.19:0/1603764837 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8011830 con 0x7f46d80a1510 2023-10-03T10:19:35.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46cffff700 1 -- 172.21.15.19:0/1603764837 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c8011990 con 0x7f46d80a1510 2023-10-03T10:19:35.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46cffff700 1 -- 172.21.15.19:0/1603764837 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c8011d20 con 0x7f46d80a1510 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 -- 172.21.15.19:0/1603764837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 msgr2=0x7f46d8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1603764837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f46c8009920 tx=0x7f46c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 -- 172.21.15.19:0/1603764837 shutdown_connections 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1603764837 >> v2:172.21.15.19:3300/0 conn(0x7f46d8139250 0x7f46d813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1603764837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a1510 0x7f46d8138d10 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 -- 172.21.15.19:0/1603764837 >> 172.21.15.19:0/1603764837 conn(0x7f46d80a6550 msgr2=0x7f46d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 -- 172.21.15.19:0/1603764837 shutdown_connections 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.119+0000 7f46df8e1700 1 -- 172.21.15.19:0/1603764837 wait complete. 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.120+0000 7f46df8e1700 1 Processor -- start 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.120+0000 7f46df8e1700 1 -- start start 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 0x7f46d81c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8124ef0 con 0x7f46d8139250 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d8138bd0 con 0x7f46d80a1510 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46df8e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46d80a0220 con 0x7f46d80a0a30 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dd67d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dce7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dd67d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46152/0 (socket says 172.21.15.19:46152) 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dd67d700 1 -- 172.21.15.19:0/1451182083 learned_addr learned my addr 172.21.15.19:0/1451182083 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dce7c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45814/0 (socket says 172.21.15.19:45814) 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.121+0000 7f46dde7e700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 0x7f46d81c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 -- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 msgr2=0x7f46d8123320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 -- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 msgr2=0x7f46d8123860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 -- 172.21.15.19:0/1451182083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c8009550 con 0x7f46d8139250 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dce7c700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dd67d700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46dde7e700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 0x7f46d81c8540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f46d000ef90 tx=0x7f46d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000cc90 con 0x7f46d8139250 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000f040 con 0x7f46d8139250 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d00146c0 con 0x7f46d8139250 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d8124730 con 0x7f46d8139250 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.122+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46d8126d30 con 0x7f46d8139250 2023-10-03T10:19:35.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.123+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f46d0014820 con 0x7f46d8139250 2023-10-03T10:19:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.123+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f46d0040180 con 0x7f46d8139250 2023-10-03T10:19:35.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.124+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46d8126190 con 0x7f46d8139250 2023-10-03T10:19:35.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.129+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f46d001d400 con 0x7f46d8139250 2023-10-03T10:19:35.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.158+0000 7fc2ae4c3700 1 Processor -- start 2023-10-03T10:19:35.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.158+0000 7fc2ae4c3700 1 -- start start 2023-10-03T10:19:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2ae4c3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 0x7fc2a80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2ae4c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2ae4c3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80a2a70 con 0x7fc2a8133930 2023-10-03T10:19:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2ae4c3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80a01d0 con 0x7fc2a80a0a30 2023-10-03T10:19:35.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2ae4c3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a809e2b0 con 0x7fc2a809d630 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2a7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 0x7fc2a80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2a7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 0x7fc2a80a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43712/0 (socket says 172.21.15.19:43712) 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45824/0 (socket says 172.21.15.19:45824) 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2aca60700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc2a8133930 0x7fc2a8133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:50398/0 (socket says 172.21.15.19:50398) 2023-10-03T10:19:35.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.159+0000 7fc2a7fff700 1 -- 172.21.15.19:0/1723443818 learned_addr learned my addr 172.21.15.19:0/1723443818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a77fe700 1 -- 172.21.15.19:0/1723443818 >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 msgr2=0x7fc2a80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a77fe700 1 --2- 172.21.15.19:0/1723443818 >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 0x7fc2a80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a77fe700 1 -- 172.21.15.19:0/1723443818 >> v1:172.21.15.19:6789/0 conn(0x7fc2a8133930 legacy=0x7fc2a8133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a77fe700 1 -- 172.21.15.19:0/1723443818 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a809dc50 con 0x7fc2a809d630 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a77fe700 1 --2- 172.21.15.19:0/1723443818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009840 tx=0x7fc29c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a942e30da7884536 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a6ffd700 1 -- 172.21.15.19:0/1723443818 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011830 con 0x7fc2a809d630 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a6ffd700 1 -- 172.21.15.19:0/1723443818 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc29c011990 con 0x7fc2a809d630 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.160+0000 7fc2a6ffd700 1 -- 172.21.15.19:0/1723443818 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c011d20 con 0x7fc2a809d630 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/1723443818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 msgr2=0x7fc2a80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/1723443818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc29c009840 tx=0x7fc29c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/1723443818 shutdown_connections 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/1723443818 >> v2:172.21.15.19:3300/0 conn(0x7fc2a80a0a30 0x7fc2a80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/1723443818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a809d630 0x7fc2a80a1340 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/1723443818 >> 172.21.15.19:0/1723443818 conn(0x7fc2a80a3050 msgr2=0x7fc2a80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/1723443818 shutdown_connections 2023-10-03T10:19:35.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.161+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/1723443818 wait complete. 2023-10-03T10:19:35.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.162+0000 7fc2ae4c3700 1 Processor -- start 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 -- start start 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a80a0a30 0x7fc2a81c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 0x7fc2a81c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8133530 con 0x7fc2a80a0a30 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8120710 con 0x7fc2a8133930 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.163+0000 7fc2ae4c3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8121f00 con 0x7fc2a809d630 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46164/0 (socket says 172.21.15.19:46164) 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a7fff700 1 -- 172.21.15.19:0/205494764 learned_addr learned my addr 172.21.15.19:0/205494764 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 0x7fc2a81c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a77fe700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a80a0a30 0x7fc2a81c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 -- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 msgr2=0x7fc2a81c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 -- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a80a0a30 msgr2=0x7fc2a81c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a80a0a30 0x7fc2a81c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 -- 172.21.15.19:0/205494764 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0094a0 con 0x7fc2a8133930 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a7fff700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2aca60700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 0x7fc2a81c8c10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000cb10 tx=0x7fc2a000ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000a9e0 con 0x7fc2a8133930 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000ab40 con 0x7fc2a8133930 2023-10-03T10:19:35.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80a0410 con 0x7fc2a8133930 2023-10-03T10:19:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.164+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0007070 con 0x7fc2a8133930 2023-10-03T10:19:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.165+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a8122c30 con 0x7fc2a8133930 2023-10-03T10:19:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.165+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc2a00071d0 con 0x7fc2a8133930 2023-10-03T10:19:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.166+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc2a003f2b0 con 0x7fc2a8133930 2023-10-03T10:19:35.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.166+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a8122400 con 0x7fc2a8133930 2023-10-03T10:19:35.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.171+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc2a0017020 con 0x7fc2a8133930 2023-10-03T10:19:35.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.297+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9760074ea0 con 0x7f97600a0a30 2023-10-03T10:19:35.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.298+0000 7f9755ffb700 1 -- 172.21.15.19:0/3240255171 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f975c033090 con 0x7f97600a0a30 2023-10-03T10:19:35.298 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:35.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 msgr2=0x7f976011e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f975c00b370 tx=0x7f975c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 shutdown_connections 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9760133fa0 0x7f976011f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97600a0a30 0x7f976011e860 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 --2- 172.21.15.19:0/3240255171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97600a1340 0x7f976011eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 >> 172.21.15.19:0/3240255171 conn(0x7f97600a6550 msgr2=0x7f976009a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 shutdown_connections 2023-10-03T10:19:35.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.300+0000 7f9767a41700 1 -- 172.21.15.19:0/3240255171 wait complete. 2023-10-03T10:19:35.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:35.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.339+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f46d8125f60 con 0x7f46d8139250 2023-10-03T10:19:35.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.340+0000 7f46cdffb700 1 -- 172.21.15.19:0/1451182083 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f46d0012340 con 0x7f46d8139250 2023-10-03T10:19:35.340 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:35.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 msgr2=0x7f46d81c8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 0x7f46d81c8540 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f46d000ef90 tx=0x7f46d000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 shutdown_connections 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f46d8139250 0x7f46d81c8540 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f46d80a0a30 0x7f46d8123320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 --2- 172.21.15.19:0/1451182083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f46d80a1510 0x7f46d8123860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 >> 172.21.15.19:0/1451182083 conn(0x7f46d80a6550 msgr2=0x7f46d80a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 shutdown_connections 2023-10-03T10:19:35.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.342+0000 7f46df8e1700 1 -- 172.21.15.19:0/1451182083 wait complete. 2023-10-03T10:19:35.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:35.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.376+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc2a8074770 con 0x7fc2a8133930 2023-10-03T10:19:35.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.377+0000 7fc2a4ff9700 1 -- 172.21.15.19:0/205494764 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc2a001b3b0 con 0x7fc2a8133930 2023-10-03T10:19:35.377 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 msgr2=0x7fc2a81c8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 0x7fc2a81c8c10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000cb10 tx=0x7fc2a000ce20 comp rx=0 tx=0).stop 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 shutdown_connections 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc2a8133930 0x7fc2a81c8c10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc2a809d630 0x7fc2a81c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 --2- 172.21.15.19:0/205494764 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a80a0a30 0x7fc2a81c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 >> 172.21.15.19:0/205494764 conn(0x7fc2a80a3050 msgr2=0x7fc2a81bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 shutdown_connections 2023-10-03T10:19:35.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.379+0000 7fc2ae4c3700 1 -- 172.21.15.19:0/205494764 wait complete. 2023-10-03T10:19:35.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:35.408 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.572+0000 7f0938cc9700 1 Processor -- start 2023-10-03T10:19:35.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.572+0000 7f0938cc9700 1 -- start start 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934134260 0x7f09341304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093406b990 con 0x7f0934133420 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340a0590 con 0x7f0934133e30 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0938cc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f093409fb80 con 0x7f0934134260 2023-10-03T10:19:35.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f093259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0932d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934134260 0x7f09341304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45848/0 (socket says 172.21.15.19:45848) 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f093259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43742/0 (socket says 172.21.15.19:43742) 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 -- 172.21.15.19:0/1189507369 learned_addr learned my addr 172.21.15.19:0/1189507369 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 -- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934134260 msgr2=0x7f09341304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 --2- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934134260 0x7f09341304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 -- 172.21.15.19:0/1189507369 >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 msgr2=0x7f09341337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 --2- 172.21.15.19:0/1189507369 >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 -- 172.21.15.19:0/1189507369 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340a0030 con 0x7f0934133e30 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f093259c700 1 --2- 172.21.15.19:0/1189507369 >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f0931d9b700 1 --2- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f09280098f0 tx=0x7f0928009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f3d16028a05485 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.573+0000 7f093159a700 1 -- 172.21.15.19:0/1189507369 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011830 con 0x7f0934133e30 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f093159a700 1 -- 172.21.15.19:0/1189507369 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0928011990 con 0x7f0934133e30 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f093159a700 1 -- 172.21.15.19:0/1189507369 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928011d20 con 0x7f0934133e30 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 -- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 msgr2=0x7f093412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 --2- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f09280098f0 tx=0x7f0928009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 -- 172.21.15.19:0/1189507369 shutdown_connections 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 --2- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934134260 0x7f09341304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 --2- 172.21.15.19:0/1189507369 >> v2:172.21.15.19:3300/0 conn(0x7f0934133420 0x7f09341337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 --2- 172.21.15.19:0/1189507369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133e30 0x7f093412ff90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 -- 172.21.15.19:0/1189507369 >> 172.21.15.19:0/1189507369 conn(0x7f09340a4210 msgr2=0x7f09340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 -- 172.21.15.19:0/1189507369 shutdown_connections 2023-10-03T10:19:35.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.574+0000 7f0938cc9700 1 -- 172.21.15.19:0/1189507369 wait complete. 2023-10-03T10:19:35.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.575+0000 7f0938cc9700 1 Processor -- start 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.575+0000 7f0938cc9700 1 -- start start 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 0x7f093409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093412dc80 con 0x7f0934134260 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093412da20 con 0x7f0934133420 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0938cc9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0934120400 con 0x7f0934133e30 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f093259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0932d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 0x7f093409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f093259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45850/0 (socket says 172.21.15.19:45850) 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f093259c700 1 -- 172.21.15.19:0/3162237208 learned_addr learned my addr 172.21.15.19:0/3162237208 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0932d9d700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43754/0 (socket says 172.21.15.19:43754) 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 -- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 msgr2=0x7f093409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 -- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 msgr2=0x7f093409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0931d9b700 1 -- 172.21.15.19:0/3162237208 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240094a0 con 0x7f0934133e30 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f093259c700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.576+0000 7f0932d9d700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0931d9b700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 0x7f093409c9c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0928016000 tx=0x7f0928004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:35.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928004450 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09280045b0 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09280038c0 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0928009550 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.577+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093409ddc0 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.578+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0928021070 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.578+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0928040b20 con 0x7f0934133e30 2023-10-03T10:19:35.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.578+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0934074ea0 con 0x7f0934133e30 2023-10-03T10:19:35.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.583+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0928015080 con 0x7f0934133e30 2023-10-03T10:19:35.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.793+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f093406b250 con 0x7f0934133e30 2023-10-03T10:19:35.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.793+0000 7f0922ffd700 1 -- 172.21.15.19:0/3162237208 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0928029020 con 0x7f0934133e30 2023-10-03T10:19:35.793 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.795+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 msgr2=0x7f093409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.795+0000 7f0938cc9700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 0x7f093409c9c0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f0928016000 tx=0x7f0928004750 comp rx=0 tx=0).stop 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 shutdown_connections 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0934134260 0x7f093409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0934133420 0x7f093409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 --2- 172.21.15.19:0/3162237208 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0934133e30 0x7f093409c9c0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 >> 172.21.15.19:0/3162237208 conn(0x7f09340a4210 msgr2=0x7f09340a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 shutdown_connections 2023-10-03T10:19:35.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:35.796+0000 7f0938cc9700 1 -- 172.21.15.19:0/3162237208 wait complete. 2023-10-03T10:19:35.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:36.315 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:36.358 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:36.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:36.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.464+0000 7fa7b6f00700 1 Processor -- start 2023-10-03T10:19:36.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.464+0000 7fa7b6f00700 1 -- start start 2023-10-03T10:19:36.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.464+0000 7fa7b6f00700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7b01338a0 0x7fa7b0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b6f00700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b009de50 0x7fa7b009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b6f00700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009e760 0x7fa7b013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b6f00700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b006fef0 con 0x7fa7b01338a0 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b6f00700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b006ef30 con 0x7fa7b009de50 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b6f00700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01334b0 con 0x7fa7b009e760 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7b01338a0 0x7fa7b0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa7b01338a0 0x7fa7b0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53936/0 (socket says 172.21.15.19:53936) 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 -- 172.21.15.19:0/1196511380 learned_addr learned my addr 172.21.15.19:0/1196511380 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b549d700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009e760 0x7fa7b013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7affff700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b009de50 0x7fa7b009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 -- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009e760 msgr2=0x7fa7b013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009e760 0x7fa7b013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 -- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b009de50 msgr2=0x7fa7b009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b009de50 0x7fa7b009e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 -- 172.21.15.19:0/1196511380 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b006fc30 con 0x7fa7b01338a0 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.465+0000 7fa7b4c9c700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b01338a0 0x7fa7b0133c70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40098f0 tx=0x7fa7a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ceafbdf3ad09cd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7af7fe700 1 -- 172.21.15.19:0/1196511380 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4011830 con 0x7fa7b01338a0 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7af7fe700 1 -- 172.21.15.19:0/1196511380 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4011990 con 0x7fa7b01338a0 2023-10-03T10:19:36.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7af7fe700 1 -- 172.21.15.19:0/1196511380 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4011d00 con 0x7fa7b01338a0 2023-10-03T10:19:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 -- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b01338a0 msgr2=0x7fa7b0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b01338a0 0x7fa7b0133c70 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fa7a40098f0 tx=0x7fa7a4009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 -- 172.21.15.19:0/1196511380 shutdown_connections 2023-10-03T10:19:36.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009e760 0x7fa7b013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b01338a0 0x7fa7b0133c70 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/1196511380 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b009de50 0x7fa7b009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 -- 172.21.15.19:0/1196511380 >> 172.21.15.19:0/1196511380 conn(0x7fa7b00a2aa0 msgr2=0x7fa7b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 -- 172.21.15.19:0/1196511380 shutdown_connections 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.466+0000 7fa7b6f00700 1 -- 172.21.15.19:0/1196511380 wait complete. 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.467+0000 7fa7b6f00700 1 Processor -- start 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 -- start start 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009de50 0x7fa7b011b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 0x7fa7b011c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b011cbe0 con 0x7fa7b009e760 2023-10-03T10:19:36.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b011d2f0 con 0x7fa7b01338a0 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b6f00700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b011d910 con 0x7fa7b009de50 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7affff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b4c9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009de50 0x7fa7b011b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7affff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53942/0 (socket says 172.21.15.19:53942) 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7affff700 1 -- 172.21.15.19:0/2612305044 learned_addr learned my addr 172.21.15.19:0/2612305044 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.468+0000 7fa7b549d700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 0x7fa7b011c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 -- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009de50 msgr2=0x7fa7b011b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009de50 0x7fa7b011b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 -- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 msgr2=0x7fa7b011c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 0x7fa7b011c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 -- 172.21.15.19:0/2612305044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a4009550 con 0x7fa7b009e760 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7b549d700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 0x7fa7b011c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7affff700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00d830 tx=0x7fa79c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0125f0 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c012750 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b011ef20 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c012b00 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.469+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b006f640 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.470+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa79c012c60 con 0x7fa7b009e760 2023-10-03T10:19:36.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.470+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b0074ea0 con 0x7fa7b009e760 2023-10-03T10:19:36.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.471+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa79c03f670 con 0x7fa7b009e760 2023-10-03T10:19:36.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.475+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa79c00f710 con 0x7fa7b009e760 2023-10-03T10:19:36.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.503+0000 7fa512e48700 1 Processor -- start 2023-10-03T10:19:36.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.503+0000 7fa512e48700 1 -- start start 2023-10-03T10:19:36.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa512e48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa512e48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa512e48700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c1313c0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa512e48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c09b580 con 0x7fa50c131810 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa512e48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c06e8c0 con 0x7fa50c099a40 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46664/0 (socket says 172.21.15.19:46664) 2023-10-03T10:19:36.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 -- 172.21.15.19:0/4209136319 learned_addr learned my addr 172.21.15.19:0/4209136319 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa5113e5700 1 --1- 172.21.15.19:0/4209136319 >> v1:172.21.15.19:6789/0 conn(0x7fa50c09a3b0 0x7fa50c138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33458/0 (socket says 172.21.15.19:33458) 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa510be4700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 -- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 msgr2=0x7fa50c131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 -- 172.21.15.19:0/4209136319 >> v1:172.21.15.19:6789/0 conn(0x7fa50c09a3b0 legacy=0x7fa50c138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.504+0000 7fa50bfff700 1 -- 172.21.15.19:0/4209136319 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c09a820 con 0x7fa50c099a40 2023-10-03T10:19:36.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa50bfff700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009920 tx=0x7fa4f8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60cce62d55053b8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa50b7fe700 1 -- 172.21.15.19:0/4209136319 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011830 con 0x7fa50c099a40 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa50b7fe700 1 -- 172.21.15.19:0/4209136319 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8011990 con 0x7fa50c099a40 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa50b7fe700 1 -- 172.21.15.19:0/4209136319 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011d00 con 0x7fa50c099a40 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa512e48700 1 -- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 msgr2=0x7fa50c099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.505+0000 7fa512e48700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8009920 tx=0x7fa4f8009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 -- 172.21.15.19:0/4209136319 shutdown_connections 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 --2- 172.21.15.19:0/4209136319 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c099a40 0x7fa50c099e70 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 -- 172.21.15.19:0/4209136319 >> 172.21.15.19:0/4209136319 conn(0x7fa50c0a2aa0 msgr2=0x7fa50c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 -- 172.21.15.19:0/4209136319 shutdown_connections 2023-10-03T10:19:36.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.506+0000 7fa512e48700 1 -- 172.21.15.19:0/4209136319 wait complete. 2023-10-03T10:19:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 Processor -- start 2023-10-03T10:19:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 -- start start 2023-10-03T10:19:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa50c099a40 0x7fa50c11b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c11f380 con 0x7fa50c099a40 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c11da90 con 0x7fa50c131810 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.507+0000 7fa512e48700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c11eb10 con 0x7fa50c09a3b0 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46678/0 (socket says 172.21.15.19:46678) 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 -- 172.21.15.19:0/984384754 learned_addr learned my addr 172.21.15.19:0/984384754 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa510be4700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa50c099a40 0x7fa50c11b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa5113e5700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 -- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 msgr2=0x7fa50c11c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c11c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 -- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa50c099a40 msgr2=0x7fa50c11b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa50c099a40 0x7fa50c11b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 -- 172.21.15.19:0/984384754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f8009550 con 0x7fa50c09a3b0 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa50bfff700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800a010 tx=0x7fa4f8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8004240 con 0x7fa50c09a3b0 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f801f070 con 0x7fa50c09a3b0 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c06eb00 con 0x7fa50c09a3b0 2023-10-03T10:19:36.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.508+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80036a0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.509+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c11e6c0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.509+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa4f8021030 con 0x7fa50c09a3b0 2023-10-03T10:19:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.509+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c074ea0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.510+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa4f80406a0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.514+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa4f8024480 con 0x7fa50c09a3b0 2023-10-03T10:19:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.544+0000 7f28a301b700 1 Processor -- start 2023-10-03T10:19:36.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.544+0000 7f28a301b700 1 -- start start 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a301b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 0x7f289c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a301b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a301b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c09edd0 con 0x7f289c0a1340 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a301b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c09e1f0 con 0x7f289c0a0a30 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a301b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289c09dc50 con 0x7f289c134170 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a0db7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 0x7f289c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46694/0 (socket says 172.21.15.19:46694) 2023-10-03T10:19:36.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a0db7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 0x7f289c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48548/0 (socket says 172.21.15.19:48548) 2023-10-03T10:19:36.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 -- 172.21.15.19:0/428342223 learned_addr learned my addr 172.21.15.19:0/428342223 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 -- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 msgr2=0x7f289c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 --2- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 0x7f289c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f289b7fe700 1 -- 172.21.15.19:0/428342223 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58227325 0 0) 0x7f289c09edd0 con 0x7f289c0a1340 2023-10-03T10:19:36.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 -- 172.21.15.19:0/428342223 >> v1:172.21.15.19:6789/0 conn(0x7f289c0a1340 legacy=0x7f289c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.545+0000 7f28a15b8700 1 -- 172.21.15.19:0/428342223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c0a1fe0 con 0x7f289c134170 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f28a15b8700 1 --2- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2894009e80 tx=0x7f289400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6afc580c8e018f19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f289b7fe700 1 -- 172.21.15.19:0/428342223 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400e070 con 0x7f289c134170 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f289b7fe700 1 -- 172.21.15.19:0/428342223 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400b910 con 0x7f289c134170 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f289b7fe700 1 -- 172.21.15.19:0/428342223 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400bcc0 con 0x7f289c134170 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f28a301b700 1 -- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 msgr2=0x7f289c13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.546+0000 7f28a301b700 1 --2- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f2894009e80 tx=0x7f289400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 -- 172.21.15.19:0/428342223 shutdown_connections 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 --2- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c134170 0x7f289c13bd30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 --2- 172.21.15.19:0/428342223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c0a0a30 0x7f289c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 -- 172.21.15.19:0/428342223 >> 172.21.15.19:0/428342223 conn(0x7f289c0a6550 msgr2=0x7f289c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 -- 172.21.15.19:0/428342223 shutdown_connections 2023-10-03T10:19:36.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.547+0000 7f28a301b700 1 -- 172.21.15.19:0/428342223 wait complete. 2023-10-03T10:19:36.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 Processor -- start 2023-10-03T10:19:36.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 -- start start 2023-10-03T10:19:36.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289c0a0a30 0x7f289c122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c0a1340 0x7f289c122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0a4ec0 con 0x7f289c0a0a30 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c1336b0 con 0x7f289c134170 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a301b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f289c124410 con 0x7f289c0a1340 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a15b8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.548+0000 7f28a15b8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48556/0 (socket says 172.21.15.19:48556) 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 -- 172.21.15.19:0/4002047422 learned_addr learned my addr 172.21.15.19:0/4002047422 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f289bfff700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c0a1340 0x7f289c122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a0db7700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289c0a0a30 0x7f289c122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 -- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c0a1340 msgr2=0x7f289c122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c0a1340 0x7f289c122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 -- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289c0a0a30 msgr2=0x7f289c122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289c0a0a30 0x7f289c122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 -- 172.21.15.19:0/4002047422 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2894009b30 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a15b8700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f289400b680 tx=0x7f2894004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894004240 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28940043a0 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0a25e0 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894004730 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.549+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c1331f0 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.550+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f289401c410 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.551+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2894040d70 con 0x7f289c134170 2023-10-03T10:19:36.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.551+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c074ea0 con 0x7f289c134170 2023-10-03T10:19:36.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.556+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f289402a080 con 0x7f289c134170 2023-10-03T10:19:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.688+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7b006b9e0 con 0x7fa7b009e760 2023-10-03T10:19:36.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.688+0000 7fa7ad7fa700 1 -- 172.21.15.19:0/2612305044 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa79c00f300 con 0x7fa7b009e760 2023-10-03T10:19:36.688 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 msgr2=0x7fa7b011bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00d830 tx=0x7fa79c00db40 comp rx=0 tx=0).stop 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 shutdown_connections 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7b01338a0 0x7fa7b011c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7b009de50 0x7fa7b011b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 --2- 172.21.15.19:0/2612305044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7b009e760 0x7fa7b011bc70 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 >> 172.21.15.19:0/2612305044 conn(0x7fa7b00a2aa0 msgr2=0x7fa7b01306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 shutdown_connections 2023-10-03T10:19:36.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.691+0000 7fa7b6f00700 1 -- 172.21.15.19:0/2612305044 wait complete. 2023-10-03T10:19:36.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:36.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.764+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa50c06b9e0 con 0x7fa50c09a3b0 2023-10-03T10:19:36.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.764+0000 7fa5097fa700 1 -- 172.21.15.19:0/984384754 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa4f8015030 con 0x7fa50c09a3b0 2023-10-03T10:19:36.764 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 msgr2=0x7fa50c11bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800a010 tx=0x7fa4f8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 shutdown_connections 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa50c131810 0x7fa50c11c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa50c099a40 0x7fa50c11b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 --2- 172.21.15.19:0/984384754 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa50c09a3b0 0x7fa50c11bda0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 >> 172.21.15.19:0/984384754 conn(0x7fa50c0a2aa0 msgr2=0x7fa50c12f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 shutdown_connections 2023-10-03T10:19:36.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.766+0000 7fa512e48700 1 -- 172.21.15.19:0/984384754 wait complete. 2023-10-03T10:19:36.780 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:36.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.804+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f289c0a28e0 con 0x7f289c134170 2023-10-03T10:19:36.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.804+0000 7f28997fa700 1 -- 172.21.15.19:0/4002047422 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f289401c6c0 con 0x7f289c134170 2023-10-03T10:19:36.804 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:36.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 msgr2=0x7f289c123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f289400b680 tx=0x7f2894004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 shutdown_connections 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f289c134170 0x7f289c123200 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f289c0a0a30 0x7f289c122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 --2- 172.21.15.19:0/4002047422 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f289c0a1340 0x7f289c122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 >> 172.21.15.19:0/4002047422 conn(0x7f289c0a6550 msgr2=0x7f289c09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 shutdown_connections 2023-10-03T10:19:36.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.806+0000 7f28a301b700 1 -- 172.21.15.19:0/4002047422 wait complete. 2023-10-03T10:19:36.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:36.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:36.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.947+0000 7f4b875c4700 1 Processor -- start 2023-10-03T10:19:36.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 -- start start 2023-10-03T10:19:36.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 0x7f4b80131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b8009ece0 con 0x7f4b80131b40 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8009e760 con 0x7f4b8006b080 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b875c4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8009e040 con 0x7f4b8006a770 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b84b5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 0x7f4b80131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b85360700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b85b61700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4b80131b40 0x7f4b80138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33484/0 (socket says 172.21.15.19:33484) 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.948+0000 7f4b85b61700 1 -- 172.21.15.19:0/3930649340 learned_addr learned my addr 172.21.15.19:0/3930649340 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b85360700 1 -- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 msgr2=0x7f4b80131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b85360700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 0x7f4b80131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b73fff700 1 -- 172.21.15.19:0/3930649340 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450389364 0 0) 0x7f4b8009ece0 con 0x7f4b80131b40 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b85360700 1 -- 172.21.15.19:0/3930649340 >> v1:172.21.15.19:6789/0 conn(0x7f4b80131b40 legacy=0x7f4b80138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b85360700 1 -- 172.21.15.19:0/3930649340 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8009f630 con 0x7f4b8006a770 2023-10-03T10:19:36.949 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b84b5f700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 0x7f4b80131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:36.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b85360700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8006ab40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85d01c3e2c9e38b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b73fff700 1 -- 172.21.15.19:0/3930649340 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c011830 con 0x7f4b8006a770 2023-10-03T10:19:36.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b73fff700 1 -- 172.21.15.19:0/3930649340 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c011990 con 0x7f4b8006a770 2023-10-03T10:19:36.952 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.949+0000 7f4b73fff700 1 -- 172.21.15.19:0/3930649340 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c011d20 con 0x7f4b8006a770 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 -- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 msgr2=0x7f4b8006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8006ab40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c009870 tx=0x7f4b7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 -- 172.21.15.19:0/3930649340 shutdown_connections 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8006ab40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 --2- 172.21.15.19:0/3930649340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b8006b080 0x7f4b80131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 -- 172.21.15.19:0/3930649340 >> 172.21.15.19:0/3930649340 conn(0x7f4b80066f50 msgr2=0x7f4b8009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 -- 172.21.15.19:0/3930649340 shutdown_connections 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.950+0000 7f4b875c4700 1 -- 172.21.15.19:0/3930649340 wait complete. 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 Processor -- start 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 -- start start 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.953 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b8006b080 0x7f4b8011c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b80131b40 0x7f4b8011cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8011de90 con 0x7f4b8006b080 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8011fac0 con 0x7f4b80131b40 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b875c4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8011f5a0 con 0x7f4b8006a770 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b85360700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b85360700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46714/0 (socket says 172.21.15.19:46714) 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b85360700 1 -- 172.21.15.19:0/1925669102 learned_addr learned my addr 172.21.15.19:0/1925669102 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b85b61700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b80131b40 0x7f4b8011cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.951+0000 7f4b84b5f700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b8006b080 0x7f4b8011c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 -- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b80131b40 msgr2=0x7f4b8011cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b80131b40 0x7f4b8011cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 -- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b8006b080 msgr2=0x7f4b8011c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b8006b080 0x7f4b8011c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 -- 172.21.15.19:0/1925669102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740094a0 con 0x7f4b8006a770 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b85360700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4b8009e180 tx=0x7f4b7c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c004510 con 0x7f4b8006a770 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7c01f070 con 0x7f4b8006a770 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c0094a0 con 0x7f4b8006a770 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c0038e0 con 0x7f4b8006a770 2023-10-03T10:19:36.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.952+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80120480 con 0x7f4b8006a770 2023-10-03T10:19:36.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.953+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b7c003a40 con 0x7f4b8006a770 2023-10-03T10:19:36.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.953+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b7c021070 con 0x7f4b8006a770 2023-10-03T10:19:36.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.954+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b801311f0 con 0x7f4b8006a770 2023-10-03T10:19:36.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:36.958+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b7c015080 con 0x7f4b8006a770 2023-10-03T10:19:37.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.163+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4b80074ea0 con 0x7f4b8006a770 2023-10-03T10:19:37.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.164+0000 7f4b71ffb700 1 -- 172.21.15.19:0/1925669102 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b7c02b020 con 0x7f4b8006a770 2023-10-03T10:19:37.164 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 msgr2=0x7f4b8011c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4b8009e180 tx=0x7f4b7c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 shutdown_connections 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b80131b40 0x7f4b8011cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b8006a770 0x7f4b8011c280 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 --2- 172.21.15.19:0/1925669102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b8006b080 0x7f4b8011c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 >> 172.21.15.19:0/1925669102 conn(0x7f4b80066f50 msgr2=0x7f4b8006ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 shutdown_connections 2023-10-03T10:19:37.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.166+0000 7f4b875c4700 1 -- 172.21.15.19:0/1925669102 wait complete. 2023-10-03T10:19:37.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:37.706 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:37.781 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:37.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:37.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.855+0000 7f7617b97700 1 Processor -- start 2023-10-03T10:19:37.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.855+0000 7f7617b97700 1 -- start start 2023-10-03T10:19:37.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7617b97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 0x7f761009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7617b97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7617b97700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f761009b120 con 0x7f761009e000 2023-10-03T10:19:37.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7617b97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f761006b460 con 0x7f761009d6f0 2023-10-03T10:19:37.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7617b97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f761009a7e0 con 0x7f761009e410 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7615132700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f761009e000 0x7f76101339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33488/0 (socket says 172.21.15.19:33488) 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7615132700 1 -- 172.21.15.19:0/60998204 learned_addr learned my addr 172.21.15.19:0/60998204 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7615933700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 0x7f761009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.856+0000 7f7616134700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7615933700 1 -- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 msgr2=0x7f7610134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7615933700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7614931700 1 -- 172.21.15.19:0/60998204 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188031771 0 0) 0x7f761009b120 con 0x7f761009e000 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7615933700 1 -- 172.21.15.19:0/60998204 >> v1:172.21.15.19:6789/0 conn(0x7f761009e000 legacy=0x7f76101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7615933700 1 -- 172.21.15.19:0/60998204 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761009a500 con 0x7f761009d6f0 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7615933700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 0x7f761009dac0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49b70c6d7a46f25d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7614931700 1 -- 172.21.15.19:0/60998204 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011830 con 0x7f761009d6f0 2023-10-03T10:19:37.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7614931700 1 -- 172.21.15.19:0/60998204 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c011990 con 0x7f761009d6f0 2023-10-03T10:19:37.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.857+0000 7f7614931700 1 -- 172.21.15.19:0/60998204 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c011d20 con 0x7f761009d6f0 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 -- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 msgr2=0x7f761009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 0x7f761009dac0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 -- 172.21.15.19:0/60998204 shutdown_connections 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 --2- 172.21.15.19:0/60998204 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009d6f0 0x7f761009dac0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 -- 172.21.15.19:0/60998204 >> 172.21.15.19:0/60998204 conn(0x7f7610066f50 msgr2=0x7f761009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 -- 172.21.15.19:0/60998204 shutdown_connections 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.858+0000 7f7617b97700 1 -- 172.21.15.19:0/60998204 wait complete. 2023-10-03T10:19:37.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.860+0000 7f7617b97700 1 Processor -- start 2023-10-03T10:19:37.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.860+0000 7f7617b97700 1 -- start start 2023-10-03T10:19:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009e000 0x7f7610122a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610122f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7610125f20 con 0x7f761009d6f0 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7610124ea0 con 0x7f761009e000 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7617b97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f76101337d0 con 0x7f761009e410 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7615933700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7615933700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53972/0 (socket says 172.21.15.19:53972) 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7615933700 1 -- 172.21.15.19:0/65895855 learned_addr learned my addr 172.21.15.19:0/65895855 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610122f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7615132700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009e000 0x7f7610122a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 -- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009e000 msgr2=0x7f7610122a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009e000 0x7f7610122a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 -- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 msgr2=0x7f76101224e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 -- 172.21.15.19:0/65895855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0094a0 con 0x7f761009e410 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7615933700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.861+0000 7f7616134700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610122f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7608009d90 tx=0x7f760800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.862+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608009c00 con 0x7f761009e410 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.862+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800f040 con 0x7f761009e410 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.862+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76100a1aa0 con 0x7f761009e410 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.862+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7608014480 con 0x7f761009e410 2023-10-03T10:19:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.862+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761009c760 con 0x7f761009e410 2023-10-03T10:19:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.863+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f76080145e0 con 0x7f761009e410 2023-10-03T10:19:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.863+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f76080402f0 con 0x7f761009e410 2023-10-03T10:19:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.863+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610074ea0 con 0x7f761009e410 2023-10-03T10:19:37.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.868+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7608012520 con 0x7f761009e410 2023-10-03T10:19:37.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.933+0000 7f91be4c0700 1 Processor -- start 2023-10-03T10:19:37.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.933+0000 7f91be4c0700 1 -- start start 2023-10-03T10:19:37.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.933+0000 7f91be4c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 0x7f91b809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.933+0000 7f91be4c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 0x7f91b813bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91be4c0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b809f960 con 0x7f91b809f160 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91be4c0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b809ae60 con 0x7f91b8134300 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91be4c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b806cb10 con 0x7f91b809e850 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f91b809f160 0x7f91b8133bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33496/0 (socket says 172.21.15.19:33496) 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b77fe700 1 -- 172.21.15.19:0/608142245 learned_addr learned my addr 172.21.15.19:0/608142245 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 --2- 172.21.15.19:0/608142245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 0x7f91b809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91bca5d700 1 --2- 172.21.15.19:0/608142245 >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 0x7f91b813bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 -- 172.21.15.19:0/608142245 >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 msgr2=0x7f91b813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 --2- 172.21.15.19:0/608142245 >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 0x7f91b813bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 -- 172.21.15.19:0/608142245 >> v1:172.21.15.19:6789/0 conn(0x7f91b809f160 legacy=0x7f91b8133bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 -- 172.21.15.19:0/608142245 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b806b990 con 0x7f91b809e850 2023-10-03T10:19:37.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91bca5d700 1 --2- 172.21.15.19:0/608142245 >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 0x7f91b813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.934+0000 7f91b7fff700 1 --2- 172.21.15.19:0/608142245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 0x7f91b809ec20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009840 tx=0x7f91a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f3d4c4d85c46aa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.935+0000 7f91b6ffd700 1 -- 172.21.15.19:0/608142245 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011830 con 0x7f91b809e850 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.935+0000 7f91b6ffd700 1 -- 172.21.15.19:0/608142245 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a8011990 con 0x7f91b809e850 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.935+0000 7f91b6ffd700 1 -- 172.21.15.19:0/608142245 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a8011d20 con 0x7f91b809e850 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 -- 172.21.15.19:0/608142245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 msgr2=0x7f91b809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 --2- 172.21.15.19:0/608142245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 0x7f91b809ec20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f91a8009840 tx=0x7f91a8009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 -- 172.21.15.19:0/608142245 shutdown_connections 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 --2- 172.21.15.19:0/608142245 >> v2:172.21.15.19:3300/0 conn(0x7f91b8134300 0x7f91b813bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 --2- 172.21.15.19:0/608142245 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b809e850 0x7f91b809ec20 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 -- 172.21.15.19:0/608142245 >> 172.21.15.19:0/608142245 conn(0x7f91b80a3f70 msgr2=0x7f91b80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 -- 172.21.15.19:0/608142245 shutdown_connections 2023-10-03T10:19:37.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.936+0000 7f91be4c0700 1 -- 172.21.15.19:0/608142245 wait complete. 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.937+0000 7f91be4c0700 1 Processor -- start 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.937+0000 7f91be4c0700 1 -- start start 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 0x7f91b8122a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 0x7f91b8122fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8123f20 con 0x7f91b809f160 2023-10-03T10:19:37.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8124790 con 0x7f91b8134300 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91be4c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91b8124c30 con 0x7f91b809e850 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91b7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 0x7f91b8122a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48602/0 (socket says 172.21.15.19:48602) 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 -- 172.21.15.19:0/3665367771 learned_addr learned my addr 172.21.15.19:0/3665367771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91b77fe700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 0x7f91b8122fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 -- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 msgr2=0x7f91b8122a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 0x7f91b8122a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 -- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 msgr2=0x7f91b8122fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 0x7f91b8122fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91bca5d700 1 -- 172.21.15.19:0/3665367771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0009a70 con 0x7f91b8134300 2023-10-03T10:19:37.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91b77fe700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 0x7f91b8122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.938+0000 7f91b7fff700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 0x7f91b8122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91bca5d700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f91b000efc0 tx=0x7f91b000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000ca90 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000f040 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000ce10 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a80094a0 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.939+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b81262b0 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.940+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f91b0014480 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.940+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b8124ed0 con 0x7f91b8134300 2023-10-03T10:19:37.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.940+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f91b003fe70 con 0x7f91b8134300 2023-10-03T10:19:37.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.945+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f91b0012930 con 0x7f91b8134300 2023-10-03T10:19:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.968+0000 7f2430368700 1 Processor -- start 2023-10-03T10:19:37.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.968+0000 7f2430368700 1 -- start start 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f2430368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 0x7f24280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f2430368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2428138d80 0x7f242813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f2430368700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24280a2a70 con 0x7f242809d630 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f2430368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280a01d0 con 0x7f24280a0a30 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f2430368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f242809e2b0 con 0x7f2428138d80 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f242d903700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f242809d630 0x7f24280a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33500/0 (socket says 172.21.15.19:33500) 2023-10-03T10:19:37.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f242d903700 1 -- 172.21.15.19:0/3755419500 learned_addr learned my addr 172.21.15.19:0/3755419500 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f242e104700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 0x7f24280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.969+0000 7f242e905700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2428138d80 0x7f242813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242d102700 1 -- 172.21.15.19:0/3755419500 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655625692 0 0) 0x7f24280a2a70 con 0x7f242809d630 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242e104700 1 -- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2428138d80 msgr2=0x7f242813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242e104700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2428138d80 0x7f242813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242e104700 1 -- 172.21.15.19:0/3755419500 >> v1:172.21.15.19:6789/0 conn(0x7f242809d630 legacy=0x7f24280a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242e104700 1 -- 172.21.15.19:0/3755419500 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242809dc50 con 0x7f24280a0a30 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242e104700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 0x7f24280a0e00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2424009870 tx=0x7f2424009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1318b24b28603feb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242d102700 1 -- 172.21.15.19:0/3755419500 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011830 con 0x7f24280a0a30 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242d102700 1 -- 172.21.15.19:0/3755419500 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424011990 con 0x7f24280a0a30 2023-10-03T10:19:37.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.970+0000 7f242d102700 1 -- 172.21.15.19:0/3755419500 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011d20 con 0x7f24280a0a30 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 -- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 msgr2=0x7f24280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 0x7f24280a0e00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2424009870 tx=0x7f2424009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 -- 172.21.15.19:0/3755419500 shutdown_connections 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2428138d80 0x7f242813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 --2- 172.21.15.19:0/3755419500 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f24280a0a30 0x7f24280a0e00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 -- 172.21.15.19:0/3755419500 >> 172.21.15.19:0/3755419500 conn(0x7f24280a3050 msgr2=0x7f24280a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:37.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 -- 172.21.15.19:0/3755419500 shutdown_connections 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.971+0000 7f2430368700 1 -- 172.21.15.19:0/3755419500 wait complete. 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.972+0000 7f2430368700 1 Processor -- start 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.972+0000 7f2430368700 1 -- start start 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 0x7f2428133700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 0x7f2428134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2428137d30 con 0x7f242809d630 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24280a4bf0 con 0x7f2428138d80 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f2430368700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f24280a0410 con 0x7f24280a0a30 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242d903700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242d903700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46760/0 (socket says 172.21.15.19:46760) 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242d903700 1 -- 172.21.15.19:0/3643283479 learned_addr learned my addr 172.21.15.19:0/3643283479 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242e905700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 0x7f2428134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242e104700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 0x7f2428133700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242d903700 1 -- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 msgr2=0x7f2428134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.973+0000 7f242d903700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 0x7f2428134180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242d903700 1 -- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 msgr2=0x7f2428133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242d903700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 0x7f2428133700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242d903700 1 -- 172.21.15.19:0/3643283479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240094a0 con 0x7f24280a0a30 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242e905700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 0x7f2428134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242e104700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 0x7f2428133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f242d903700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f241800c520 tx=0x7f241800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:37.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418004c80 con 0x7f24280a0a30 2023-10-03T10:19:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2418004de0 con 0x7f24280a0a30 2023-10-03T10:19:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2428136500 con 0x7f24280a0a30 2023-10-03T10:19:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418007310 con 0x7f24280a0a30 2023-10-03T10:19:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.974+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2428136e70 con 0x7f24280a0a30 2023-10-03T10:19:37.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.975+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2418007470 con 0x7f24280a0a30 2023-10-03T10:19:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.975+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24280747f0 con 0x7f24280a0a30 2023-10-03T10:19:37.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.975+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f241803f380 con 0x7f24280a0a30 2023-10-03T10:19:37.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:37.980+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f24180123b0 con 0x7f24280a0a30 2023-10-03T10:19:38.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.097+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f76101257d0 con 0x7f761009e410 2023-10-03T10:19:38.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.098+0000 7f76067fc700 1 -- 172.21.15.19:0/65895855 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f760802c090 con 0x7f761009e410 2023-10-03T10:19:38.098 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:38.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 msgr2=0x7f7610122f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610122f60 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7608009d90 tx=0x7f760800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 shutdown_connections 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f761009e410 0x7f7610122f60 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f761009d6f0 0x7f76101224e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 --2- 172.21.15.19:0/65895855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f761009e000 0x7f7610122a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 >> 172.21.15.19:0/65895855 conn(0x7f7610066f50 msgr2=0x7f7610071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 shutdown_connections 2023-10-03T10:19:38.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.101+0000 7f7617b97700 1 -- 172.21.15.19:0/65895855 wait complete. 2023-10-03T10:19:38.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:38.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.164+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f91b80747f0 con 0x7f91b8134300 2023-10-03T10:19:38.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.164+0000 7f91b4ff9700 1 -- 172.21.15.19:0/3665367771 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f91b001c3b0 con 0x7f91b8134300 2023-10-03T10:19:38.164 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 msgr2=0x7f91b81234f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f91b000efc0 tx=0x7f91b000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 shutdown_connections 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f91b8134300 0x7f91b81234f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f91b809e850 0x7f91b8122a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 --2- 172.21.15.19:0/3665367771 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91b809f160 0x7f91b8122fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 >> 172.21.15.19:0/3665367771 conn(0x7f91b80a3f70 msgr2=0x7f91b809d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 shutdown_connections 2023-10-03T10:19:38.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.167+0000 7f91be4c0700 1 -- 172.21.15.19:0/3665367771 wait complete. 2023-10-03T10:19:38.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:38.180 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:38.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.199+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2428072980 con 0x7f24280a0a30 2023-10-03T10:19:38.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.199+0000 7f241effd700 1 -- 172.21.15.19:0/3643283479 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f24180102c0 con 0x7f24280a0a30 2023-10-03T10:19:38.199 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 msgr2=0x7f2428133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f241800c520 tx=0x7f241800c830 comp rx=0 tx=0).stop 2023-10-03T10:19:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 shutdown_connections 2023-10-03T10:19:38.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2428138d80 0x7f2428134180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f242809d630 0x7f2428133700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 --2- 172.21.15.19:0/3643283479 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f24280a0a30 0x7f2428133c40 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 >> 172.21.15.19:0/3643283479 conn(0x7f24280a3050 msgr2=0x7f242813add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 shutdown_connections 2023-10-03T10:19:38.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.201+0000 7f2430368700 1 -- 172.21.15.19:0/3643283479 wait complete. 2023-10-03T10:19:38.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:38.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.319+0000 7f838aa8a700 1 Processor -- start 2023-10-03T10:19:38.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.319+0000 7f838aa8a700 1 -- start start 2023-10-03T10:19:38.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.319+0000 7f838aa8a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838409e1d0 0x7f8384135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f838aa8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f8384138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f838aa8a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838409f130 con 0x7f838409d6f0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f838aa8a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838409f520 con 0x7f838409e1d0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f838aa8a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838409e930 con 0x7f8384135e50 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8388826700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f838409d6f0 0x7f838409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33510/0 (socket says 172.21.15.19:33510) 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8388826700 1 -- 172.21.15.19:0/3872137577 learned_addr learned my addr 172.21.15.19:0/3872137577 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 --2- 172.21.15.19:0/3872137577 >> v2:172.21.15.19:3300/0 conn(0x7f838409e1d0 0x7f8384135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8389027700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f8384138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f83837fe700 1 -- 172.21.15.19:0/3872137577 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874612497 0 0) 0x7f838409f130 con 0x7f838409d6f0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f83837fe700 1 -- 172.21.15.19:0/3872137577 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f836c0035b0 con 0x7f838409d6f0 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 -- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 msgr2=0x7f8384138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f8384138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.321 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 -- 172.21.15.19:0/3872137577 >> v1:172.21.15.19:6789/0 conn(0x7f838409d6f0 legacy=0x7f838409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 -- 172.21.15.19:0/3872137577 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838409b2d0 con 0x7f838409e1d0 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8389027700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f8384138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f8383fff700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f8384135910 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8378009840 tx=0x7f8378009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5848e5cc52ab73c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f83837fe700 1 -- 172.21.15.19:0/3872137577 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800f8a0 con 0x7f838409e1d0 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f83837fe700 1 -- 172.21.15.19:0/3872137577 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837800fa00 con 0x7f838409e1d0 2023-10-03T10:19:38.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.320+0000 7f83837fe700 1 -- 172.21.15.19:0/3872137577 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837800fd70 con 0x7f838409e1d0 2023-10-03T10:19:38.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 -- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 msgr2=0x7f8384135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f8384135910 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f8378009840 tx=0x7f8378009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:38.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 -- 172.21.15.19:0/3872137577 shutdown_connections 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f8384138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 --2- 172.21.15.19:0/3872137577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f8384135910 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 -- 172.21.15.19:0/3872137577 >> 172.21.15.19:0/3872137577 conn(0x7f8384066f50 msgr2=0x7f838409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 -- 172.21.15.19:0/3872137577 shutdown_connections 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.321+0000 7f838aa8a700 1 -- 172.21.15.19:0/3872137577 wait complete. 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.322+0000 7f838aa8a700 1 Processor -- start 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.322+0000 7f838aa8a700 1 -- start start 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f838411cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:38.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838409c700 con 0x7f838409e1d0 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840a3bc0 con 0x7f838409d6f0 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f838aa8a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f838411d6d0 con 0x7f8384135e50 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8388826700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8388826700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48626/0 (socket says 172.21.15.19:48626) 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54030/0 (socket says 172.21.15.19:54030) 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8388826700 1 -- 172.21.15.19:0/2546409478 learned_addr learned my addr 172.21.15.19:0/2546409478 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8389027700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f838411cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 -- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 msgr2=0x7f838411cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f838411cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 -- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 msgr2=0x7f838411c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 -- 172.21.15.19:0/2546409478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009a70 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8388826700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.323+0000 7f8383fff700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8378018000 tx=0x7f8378004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.324+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83780038a0 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.324+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8378003a00 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.324+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83780094a0 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.324+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8378003db0 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.324+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838411fa80 con 0x7f838409e1d0 2023-10-03T10:19:38.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.325+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838411f6d0 con 0x7f838409e1d0 2023-10-03T10:19:38.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.325+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f837802c440 con 0x7f838409e1d0 2023-10-03T10:19:38.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.325+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f83780408e0 con 0x7f838409e1d0 2023-10-03T10:19:38.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.330+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f837802a750 con 0x7f838409e1d0 2023-10-03T10:19:38.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.534+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8384074ea0 con 0x7f838409e1d0 2023-10-03T10:19:38.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.535+0000 7f83817fa700 1 -- 172.21.15.19:0/2546409478 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f837800e3c0 con 0x7f838409e1d0 2023-10-03T10:19:38.535 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:38.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 msgr2=0x7f838411c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:38.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f8378018000 tx=0x7f8378004750 comp rx=0 tx=0).stop 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 shutdown_connections 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8384135e50 0x7f838411cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f838411c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 --2- 172.21.15.19:0/2546409478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e1d0 0x7f838411c820 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 >> 172.21.15.19:0/2546409478 conn(0x7f8384066f50 msgr2=0x7f83840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 shutdown_connections 2023-10-03T10:19:38.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:38.537+0000 7f838aa8a700 1 -- 172.21.15.19:0/2546409478 wait complete. 2023-10-03T10:19:38.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:39.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:39.181 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:39.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.270+0000 7f688c165700 1 Processor -- start 2023-10-03T10:19:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.270+0000 7f688c165700 1 -- start start 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.270+0000 7f688c165700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 0x7f688406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688c165700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 0x7f688406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688c165700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6884070ee0 con 0x7f6884134610 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688c165700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6884071480 con 0x7f688406e570 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688c165700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688406f3c0 con 0x7f688409eca0 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 0x7f688406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688a702700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6884134610 0x7f6884134a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33520/0 (socket says 172.21.15.19:33520) 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f688a702700 1 -- 172.21.15.19:0/2203979960 learned_addr learned my addr 172.21.15.19:0/2203979960 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:39.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889f01700 1 --2- 172.21.15.19:0/2203979960 >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 0x7f688406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 -- 172.21.15.19:0/2203979960 >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 msgr2=0x7f688406e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 --2- 172.21.15.19:0/2203979960 >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 0x7f688406e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 -- 172.21.15.19:0/2203979960 >> v1:172.21.15.19:6789/0 conn(0x7f6884134610 legacy=0x7f6884134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 -- 172.21.15.19:0/2203979960 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6884071b90 con 0x7f688409eca0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889f01700 1 --2- 172.21.15.19:0/2203979960 >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 0x7f688406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.271+0000 7f6889700700 1 --2- 172.21.15.19:0/2203979960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 0x7f688406ee80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6874009840 tx=0x7f6874009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a398fbae13057f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f6888eff700 1 -- 172.21.15.19:0/2203979960 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011830 con 0x7f688409eca0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f6888eff700 1 -- 172.21.15.19:0/2203979960 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6874011990 con 0x7f688409eca0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f6888eff700 1 -- 172.21.15.19:0/2203979960 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874011d20 con 0x7f688409eca0 2023-10-03T10:19:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 -- 172.21.15.19:0/2203979960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 msgr2=0x7f688406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 --2- 172.21.15.19:0/2203979960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 0x7f688406ee80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6874009840 tx=0x7f6874009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 -- 172.21.15.19:0/2203979960 shutdown_connections 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 --2- 172.21.15.19:0/2203979960 >> v2:172.21.15.19:3300/0 conn(0x7f688406e570 0x7f688406e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 --2- 172.21.15.19:0/2203979960 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f688409eca0 0x7f688406ee80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.272+0000 7f688c165700 1 -- 172.21.15.19:0/2203979960 >> 172.21.15.19:0/2203979960 conn(0x7f68840a2aa0 msgr2=0x7f68840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.273+0000 7f688c165700 1 -- 172.21.15.19:0/2203979960 shutdown_connections 2023-10-03T10:19:39.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.273+0000 7f688c165700 1 -- 172.21.15.19:0/2203979960 wait complete. 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.274+0000 7f688c165700 1 Processor -- start 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.274+0000 7f688c165700 1 -- start start 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 0x7f6884123250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 0x7f6884123790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6884123cd0 0x7f68841d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6884126740 con 0x7f688406e570 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6884126ce0 con 0x7f6884134610 2023-10-03T10:19:39.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688c165700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6884124e70 con 0x7f6884123cd0 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889f01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 0x7f6884123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889f01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 0x7f6884123250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54044/0 (socket says 172.21.15.19:54044) 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889f01700 1 -- 172.21.15.19:0/1117508569 learned_addr learned my addr 172.21.15.19:0/1117508569 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 0x7f6884123790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f688a702700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6884123cd0 0x7f68841d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 -- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6884123cd0 msgr2=0x7f68841d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6884123cd0 0x7f68841d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 -- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 msgr2=0x7f6884123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 0x7f6884123250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.275+0000 7f6889700700 1 -- 172.21.15.19:0/1117508569 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800094a0 con 0x7f6884134610 2023-10-03T10:19:39.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f6889700700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 0x7f6884123790 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6874016000 tx=0x7f6874004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68740036a0 con 0x7f6884134610 2023-10-03T10:19:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687401f070 con 0x7f6884134610 2023-10-03T10:19:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68740094a0 con 0x7f6884134610 2023-10-03T10:19:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6874003a60 con 0x7f6884134610 2023-10-03T10:19:39.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.276+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68840a2370 con 0x7f6884134610 2023-10-03T10:19:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.277+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6874003bc0 con 0x7f6884134610 2023-10-03T10:19:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.277+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6874021070 con 0x7f6884134610 2023-10-03T10:19:39.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.277+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6884074ea0 con 0x7f6884134610 2023-10-03T10:19:39.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.282+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6874015020 con 0x7f6884134610 2023-10-03T10:19:39.324 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.325+0000 7f283dcb3700 1 Processor -- start 2023-10-03T10:19:39.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.325+0000 7f283dcb3700 1 -- start start 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f283dcb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f283dcb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 0x7f283813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f283dcb3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28380a2a70 con 0x7f28380a0a30 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f283dcb3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28380a01d0 con 0x7f2838138d80 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f283dcb3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f283809e2b0 con 0x7f283809d630 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f28377fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f28380a0a30 0x7f28380a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33526/0 (socket says 172.21.15.19:33526) 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46772/0 (socket says 172.21.15.19:46772) 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f28377fe700 1 -- 172.21.15.19:0/3708274374 learned_addr learned my addr 172.21.15.19:0/3708274374 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2837fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 0x7f283813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 -- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 msgr2=0x7f283813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 0x7f283813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 -- 172.21.15.19:0/3708274374 >> v1:172.21.15.19:6789/0 conn(0x7f28380a0a30 legacy=0x7f28380a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 -- 172.21.15.19:0/3708274374 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283809dc50 con 0x7f283809d630 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f28367fc700 1 -- 172.21.15.19:0/3708274374 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040421872 0 0) 0x7f28380a2a70 con 0x7f28380a0a30 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2837fff700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 0x7f283813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.326+0000 7f2836ffd700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f282c009870 tx=0x7f282c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24b00d7931c978e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.327+0000 7f28367fc700 1 -- 172.21.15.19:0/3708274374 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c011830 con 0x7f283809d630 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.327+0000 7f28367fc700 1 -- 172.21.15.19:0/3708274374 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c011990 con 0x7f283809d630 2023-10-03T10:19:39.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.327+0000 7f28367fc700 1 -- 172.21.15.19:0/3708274374 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c011d20 con 0x7f283809d630 2023-10-03T10:19:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 -- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 msgr2=0x7f28380a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f282c009870 tx=0x7f282c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 -- 172.21.15.19:0/3708274374 shutdown_connections 2023-10-03T10:19:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2838138d80 0x7f283813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 --2- 172.21.15.19:0/3708274374 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f283809d630 0x7f28380a1510 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 -- 172.21.15.19:0/3708274374 >> 172.21.15.19:0/3708274374 conn(0x7f28380a3050 msgr2=0x7f28380a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 -- 172.21.15.19:0/3708274374 shutdown_connections 2023-10-03T10:19:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.328+0000 7f283dcb3700 1 -- 172.21.15.19:0/3708274374 wait complete. 2023-10-03T10:19:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.329+0000 7f283dcb3700 1 Processor -- start 2023-10-03T10:19:39.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.329+0000 7f283dcb3700 1 -- start start 2023-10-03T10:19:39.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 0x7f28381337c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 0x7f2838133d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 0x7f2838134240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2838134c90 con 0x7f283809d630 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2838137310 con 0x7f28380a0a30 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f283dcb3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2838136c60 con 0x7f2838138d80 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f28377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 0x7f28381337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 0x7f2838133d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f28377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 0x7f28381337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54060/0 (socket says 172.21.15.19:54060) 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f28377fe700 1 -- 172.21.15.19:0/878566385 learned_addr learned my addr 172.21.15.19:0/878566385 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2837fff700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 0x7f2838134240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 -- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 msgr2=0x7f2838134240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 0x7f2838134240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 -- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 msgr2=0x7f28381337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 0x7f28381337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2836ffd700 1 -- 172.21.15.19:0/878566385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2830009a70 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.330+0000 7f2837fff700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 0x7f2838134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f2836ffd700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 0x7f2838133d00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f282c016000 tx=0x7f282c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0042c0 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c01f070 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282c0094a0 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0036a0 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.331+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2838136f20 con 0x7f28380a0a30 2023-10-03T10:19:39.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.332+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f282c021030 con 0x7f28380a0a30 2023-10-03T10:19:39.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.332+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f282c040650 con 0x7f28380a0a30 2023-10-03T10:19:39.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.333+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28380747f0 con 0x7f28380a0a30 2023-10-03T10:19:39.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.338+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f282c015080 con 0x7f28380a0a30 2023-10-03T10:19:39.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.367+0000 7f4438d23700 1 Processor -- start 2023-10-03T10:19:39.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 -- start start 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f44341337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443406b990 con 0x7f4434134260 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44340a0590 con 0x7f4434133420 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4438d23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f443409fb80 con 0x7f4434133e30 2023-10-03T10:19:39.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4432d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4434134260 0x7f44341304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33534/0 (socket says 172.21.15.19:33534) 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4432d9d700 1 -- 172.21.15.19:0/3455472957 learned_addr learned my addr 172.21.15.19:0/3455472957 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.368+0000 7f4431d9b700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f44341337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443159a700 1 -- 172.21.15.19:0/3455472957 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141906629 0 0) 0x7f443406b990 con 0x7f4434134260 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443159a700 1 -- 172.21.15.19:0/3455472957 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f441c0035b0 con 0x7f4434134260 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 -- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 msgr2=0x7f443412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443412ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 -- 172.21.15.19:0/3455472957 >> v1:172.21.15.19:6789/0 conn(0x7f4434134260 legacy=0x7f44341304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 -- 172.21.15.19:0/3455472957 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340a0030 con 0x7f4434133420 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f4431d9b700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443259c700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f44341337f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4424009870 tx=0x7f4424009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=309b46a6820a54c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443159a700 1 -- 172.21.15.19:0/3455472957 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011830 con 0x7f4434133420 2023-10-03T10:19:39.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443159a700 1 -- 172.21.15.19:0/3455472957 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424011990 con 0x7f4434133420 2023-10-03T10:19:39.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.369+0000 7f443159a700 1 -- 172.21.15.19:0/3455472957 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424011d00 con 0x7f4434133420 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 -- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 msgr2=0x7f44341337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f44341337f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4424009870 tx=0x7f4424009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 -- 172.21.15.19:0/3455472957 shutdown_connections 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f44341337f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 --2- 172.21.15.19:0/3455472957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443412ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 -- 172.21.15.19:0/3455472957 >> 172.21.15.19:0/3455472957 conn(0x7f44340a4210 msgr2=0x7f44340a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 -- 172.21.15.19:0/3455472957 shutdown_connections 2023-10-03T10:19:39.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.370+0000 7f4438d23700 1 -- 172.21.15.19:0/3455472957 wait complete. 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.371+0000 7f4438d23700 1 Processor -- start 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 -- start start 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f443409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4434134260 0x7f443409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443409d850 con 0x7f4434134260 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443411ff70 con 0x7f4434133420 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4438d23700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4434120370 con 0x7f4434133e30 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4431d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4431d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46806/0 (socket says 172.21.15.19:46806) 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4431d9b700 1 -- 172.21.15.19:0/1451976757 learned_addr learned my addr 172.21.15.19:0/1451976757 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:39.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f443259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f443409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.372+0000 7f4432d9d700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4434134260 0x7f443409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 -- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 msgr2=0x7f443409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f443409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 -- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4434134260 msgr2=0x7f443409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4434134260 0x7f443409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 -- 172.21.15.19:0/1451976757 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44280094a0 con 0x7f4434133e30 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f443259c700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f443409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4431d9b700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f442800ebb0 tx=0x7f442800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800c850 con 0x7f4434133e30 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800c9b0 con 0x7f4434133e30 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44240094a0 con 0x7f4434133e30 2023-10-03T10:19:39.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800cd40 con 0x7f4434133e30 2023-10-03T10:19:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.373+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443409e2e0 con 0x7f4434133e30 2023-10-03T10:19:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.374+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4428013470 con 0x7f4434133e30 2023-10-03T10:19:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.374+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4434074ea0 con 0x7f4434133e30 2023-10-03T10:19:39.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.374+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f442803f750 con 0x7f4434133e30 2023-10-03T10:19:39.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.379+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f44280232f0 con 0x7f4434133e30 2023-10-03T10:19:39.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.492+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6884071100 con 0x7f6884134610 2023-10-03T10:19:39.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.492+0000 7f687a7fc700 1 -- 172.21.15.19:0/1117508569 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6874026480 con 0x7f6884134610 2023-10-03T10:19:39.492 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 msgr2=0x7f6884123790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 0x7f6884123790 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6874016000 tx=0x7f6874004750 comp rx=0 tx=0).stop 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 shutdown_connections 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6884123cd0 0x7f68841d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f688406e570 0x7f6884123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 --2- 172.21.15.19:0/1117508569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6884134610 0x7f6884123790 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.494+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 >> 172.21.15.19:0/1117508569 conn(0x7f68840a2aa0 msgr2=0x7f68840a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.495+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 shutdown_connections 2023-10-03T10:19:39.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.495+0000 7f688c165700 1 -- 172.21.15.19:0/1117508569 wait complete. 2023-10-03T10:19:39.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:39.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.546+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2838135ae0 con 0x7f28380a0a30 2023-10-03T10:19:39.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.546+0000 7f281ffff700 1 -- 172.21.15.19:0/878566385 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f282c0239c0 con 0x7f28380a0a30 2023-10-03T10:19:39.546 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 msgr2=0x7f2838133d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 0x7f2838133d00 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f282c016000 tx=0x7f282c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 shutdown_connections 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2838138d80 0x7f2838134240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f283809d630 0x7f28381337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 --2- 172.21.15.19:0/878566385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f28380a0a30 0x7f2838133d00 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.548+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 >> 172.21.15.19:0/878566385 conn(0x7f28380a3050 msgr2=0x7f283809ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.549+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 shutdown_connections 2023-10-03T10:19:39.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.549+0000 7f283dcb3700 1 -- 172.21.15.19:0/878566385 wait complete. 2023-10-03T10:19:39.552 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:39.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:39.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.589+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f443406b250 con 0x7f4434133e30 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.589+0000 7f4422ffd700 1 -- 172.21.15.19:0/1451976757 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4428021070 con 0x7f4434133e30 2023-10-03T10:19:39.589 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 msgr2=0x7f443409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f442800ebb0 tx=0x7f442800eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 shutdown_connections 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4434134260 0x7f443409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4434133420 0x7f443409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 --2- 172.21.15.19:0/1451976757 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4434133e30 0x7f443409c9c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 >> 172.21.15.19:0/1451976757 conn(0x7f44340a4210 msgr2=0x7f44340a3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 shutdown_connections 2023-10-03T10:19:39.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.591+0000 7f4438d23700 1 -- 172.21.15.19:0/1451976757 wait complete. 2023-10-03T10:19:39.606 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:39.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.690+0000 7f4961553700 1 Processor -- start 2023-10-03T10:19:39.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.690+0000 7f4961553700 1 -- start start 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f4961553700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f4961553700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f4961553700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f495c070940 con 0x7f495c09f650 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f4961553700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f495c06fd60 con 0x7f495c09f240 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f4961553700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f495c06fa80 con 0x7f495c09e930 2023-10-03T10:19:39.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f495c09f650 0x7f495c131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33540/0 (socket says 172.21.15.19:33540) 2023-10-03T10:19:39.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495a7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54084/0 (socket says 172.21.15.19:54084) 2023-10-03T10:19:39.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495b7fe700 1 -- 172.21.15.19:0/1601499771 learned_addr learned my addr 172.21.15.19:0/1601499771 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:39.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.691+0000 7f495affd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46818/0 (socket says 172.21.15.19:46818) 2023-10-03T10:19:39.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495affd700 1 -- 172.21.15.19:0/1601499771 >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 msgr2=0x7f495c1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:39.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495affd700 1 --2- 172.21.15.19:0/1601499771 >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495affd700 1 -- 172.21.15.19:0/1601499771 >> v1:172.21.15.19:6789/0 conn(0x7f495c09f650 legacy=0x7f495c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495affd700 1 -- 172.21.15.19:0/1601499771 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c09fb60 con 0x7f495c09e930 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f4959ffb700 1 -- 172.21.15.19:0/1601499771 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827910124 0 0) 0x7f495c070940 con 0x7f495c09f650 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495a7fc700 1 --2- 172.21.15.19:0/1601499771 >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f495affd700 1 --2- 172.21.15.19:0/1601499771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f494c009840 tx=0x7f494c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a1ba0004ee085a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f4959ffb700 1 -- 172.21.15.19:0/1601499771 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c011830 con 0x7f495c09e930 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f4959ffb700 1 -- 172.21.15.19:0/1601499771 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c011990 con 0x7f495c09e930 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.692+0000 7f4959ffb700 1 -- 172.21.15.19:0/1601499771 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c011d20 con 0x7f495c09e930 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 -- 172.21.15.19:0/1601499771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 msgr2=0x7f495c09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 --2- 172.21.15.19:0/1601499771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f494c009840 tx=0x7f494c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 -- 172.21.15.19:0/1601499771 shutdown_connections 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 --2- 172.21.15.19:0/1601499771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09e930 0x7f495c09ed00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 --2- 172.21.15.19:0/1601499771 >> v2:172.21.15.19:3300/0 conn(0x7f495c09f240 0x7f495c1317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 -- 172.21.15.19:0/1601499771 >> 172.21.15.19:0/1601499771 conn(0x7f495c0a4210 msgr2=0x7f495c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 -- 172.21.15.19:0/1601499771 shutdown_connections 2023-10-03T10:19:39.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.693+0000 7f4961553700 1 -- 172.21.15.19:0/1601499771 wait complete. 2023-10-03T10:19:39.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 Processor -- start 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 -- start start 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 0x7f495c06c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 0x7f495c1c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495c06be60 con 0x7f495c09f650 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f495c0a30b0 con 0x7f495c09e930 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.694+0000 7f4961553700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f495c071d20 con 0x7f495c09f240 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 0x7f495c06c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495a7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46834/0 (socket says 172.21.15.19:46834) 2023-10-03T10:19:39.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495a7fc700 1 -- 172.21.15.19:0/3663868270 learned_addr learned my addr 172.21.15.19:0/3663868270 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495b7fe700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 0x7f495c1c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 -- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 msgr2=0x7f495c06c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 -- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 msgr2=0x7f495c1c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 0x7f495c1c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 -- 172.21.15.19:0/3663868270 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49440094a0 con 0x7f495c09e930 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495a7fc700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495b7fe700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 0x7f495c1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f495affd700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 0x7f495c06c270 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f494c016000 tx=0x7f494c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c0036a0 con 0x7f495c09e930 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c01f070 con 0x7f495c09e930 2023-10-03T10:19:39.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0094a0 con 0x7f495c09e930 2023-10-03T10:19:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c003a20 con 0x7f495c09e930 2023-10-03T10:19:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.695+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f495c0a0190 con 0x7f495c09e930 2023-10-03T10:19:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.696+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f494c003b80 con 0x7f495c09e930 2023-10-03T10:19:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.696+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f494c021070 con 0x7f495c09e930 2023-10-03T10:19:39.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.696+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495c1a7e50 con 0x7f495c09e930 2023-10-03T10:19:39.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.701+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f495c1a7e50 con 0x7f495c09e930 2023-10-03T10:19:39.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.905+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f495c1a7e50 con 0x7f495c09e930 2023-10-03T10:19:39.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.906+0000 7f49537fe700 1 -- 172.21.15.19:0/3663868270 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f495c1a7e50 con 0x7f495c09e930 2023-10-03T10:19:39.906 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 msgr2=0x7f495c06c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 0x7f495c06c270 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f494c016000 tx=0x7f494c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 shutdown_connections 2023-10-03T10:19:39.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f495c09f650 0x7f495c1c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f495c09e930 0x7f495c06c270 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 --2- 172.21.15.19:0/3663868270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f495c09f240 0x7f495c06c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 >> 172.21.15.19:0/3663868270 conn(0x7f495c0a4210 msgr2=0x7f495c09bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 shutdown_connections 2023-10-03T10:19:39.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:39.908+0000 7f4961553700 1 -- 172.21.15.19:0/3663868270 wait complete. 2023-10-03T10:19:39.922 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:40.509 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:40.563 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:40.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.661+0000 7f194cd1a700 1 Processor -- start 2023-10-03T10:19:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.661+0000 7f194cd1a700 1 -- start start 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194cd1a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194cd1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194cd1a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194806bc00 con 0x7f194812ff20 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194cd1a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194806c570 con 0x7f1948133a80 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194cd1a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19480a0040 con 0x7f1948130a70 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f1946d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.662 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54096/0 (socket says 172.21.15.19:54096) 2023-10-03T10:19:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f194659c700 1 -- 172.21.15.19:0/524492451 learned_addr learned my addr 172.21.15.19:0/524492451 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:40.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f1946d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46850/0 (socket says 172.21.15.19:46850) 2023-10-03T10:19:40.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.662+0000 7f1946d9d700 1 -- 172.21.15.19:0/524492451 >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 msgr2=0x7f1948133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f1946d9d700 1 --2- 172.21.15.19:0/524492451 >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f1946d9d700 1 -- 172.21.15.19:0/524492451 >> v1:172.21.15.19:6789/0 conn(0x7f194812ff20 legacy=0x7f1948130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f1946d9d700 1 -- 172.21.15.19:0/524492451 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948133860 con 0x7f1948130a70 2023-10-03T10:19:40.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f194659c700 1 --2- 172.21.15.19:0/524492451 >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f1946d9d700 1 --2- 172.21.15.19:0/524492451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adec9693d7740260 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f194559a700 1 -- 172.21.15.19:0/524492451 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000e070 con 0x7f1948130a70 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f194559a700 1 -- 172.21.15.19:0/524492451 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000bb20 con 0x7f1948130a70 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.663+0000 7f194559a700 1 -- 172.21.15.19:0/524492451 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940012430 con 0x7f1948130a70 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 -- 172.21.15.19:0/524492451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 msgr2=0x7f194813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 --2- 172.21.15.19:0/524492451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1940009d90 tx=0x7f194000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 -- 172.21.15.19:0/524492451 shutdown_connections 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 --2- 172.21.15.19:0/524492451 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1948130a70 0x7f194813b850 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 --2- 172.21.15.19:0/524492451 >> v2:172.21.15.19:3300/0 conn(0x7f1948133a80 0x7f1948133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 -- 172.21.15.19:0/524492451 >> 172.21.15.19:0/524492451 conn(0x7f19480a4210 msgr2=0x7f19480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 -- 172.21.15.19:0/524492451 shutdown_connections 2023-10-03T10:19:40.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.664+0000 7f194cd1a700 1 -- 172.21.15.19:0/524492451 wait complete. 2023-10-03T10:19:40.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.665+0000 7f194cd1a700 1 Processor -- start 2023-10-03T10:19:40.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.665+0000 7f194cd1a700 1 -- start start 2023-10-03T10:19:40.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 0x7f194809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 0x7f194809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1948133a80 0x7f194809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194812d690 con 0x7f1948130a70 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194812d2d0 con 0x7f1948133a80 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194cd1a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19480a2030 con 0x7f194812ff20 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f1945d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 0x7f194809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 0x7f194809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f1945d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 0x7f194809c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54104/0 (socket says 172.21.15.19:54104) 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f1945d9b700 1 -- 172.21.15.19:0/508595957 learned_addr learned my addr 172.21.15.19:0/508595957 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f1946d9d700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1948133a80 0x7f194809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 -- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1948133a80 msgr2=0x7f194809cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1948133a80 0x7f194809cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 -- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 msgr2=0x7f194809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 0x7f194809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.666+0000 7f194659c700 1 -- 172.21.15.19:0/508595957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1938009550 con 0x7f194812ff20 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f194659c700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 0x7f194809c480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f193800e9d0 tx=0x7f193800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800ee70 con 0x7f194812ff20 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938004030 con 0x7f194812ff20 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1940009a70 con 0x7f194812ff20 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380043c0 con 0x7f194812ff20 2023-10-03T10:19:40.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.667+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194812dae0 con 0x7f194812ff20 2023-10-03T10:19:40.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.668+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1948134310 con 0x7f194812ff20 2023-10-03T10:19:40.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.669+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f193800c850 con 0x7f194812ff20 2023-10-03T10:19:40.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.669+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f193803fca0 con 0x7f194812ff20 2023-10-03T10:19:40.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.673+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1938023350 con 0x7f194812ff20 2023-10-03T10:19:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.712+0000 7fa3ab475700 1 Processor -- start 2023-10-03T10:19:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.712+0000 7fa3ab475700 1 -- start start 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e000 0x7fa3a41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 0x7fa3a4133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a406b460 con 0x7fa3a409e410 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a409b120 con 0x7fa3a409e000 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3ab475700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a409a7e0 con 0x7fa3a409d6f0 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3a9211700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3a9211700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46876/0 (socket says 172.21.15.19:46876) 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3a9211700 1 -- 172.21.15.19:0/631837110 learned_addr learned my addr 172.21.15.19:0/631837110 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3a8a10700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e000 0x7fa3a41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.713+0000 7fa3a9a12700 1 --2- 172.21.15.19:0/631837110 >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 0x7fa3a4133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 -- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e000 msgr2=0x7fa3a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e000 0x7fa3a41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 -- 172.21.15.19:0/631837110 >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 msgr2=0x7fa3a4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 --2- 172.21.15.19:0/631837110 >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 0x7fa3a4133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 -- 172.21.15.19:0/631837110 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a409a500 con 0x7fa3a409d6f0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9a12700 1 --2- 172.21.15.19:0/631837110 >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 0x7fa3a4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa3a9211700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009920 tx=0x7fa3a0009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a67b652d4473fdf7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa39bfff700 1 -- 172.21.15.19:0/631837110 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011830 con 0x7fa3a409d6f0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa39bfff700 1 -- 172.21.15.19:0/631837110 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0011990 con 0x7fa3a409d6f0 2023-10-03T10:19:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.714+0000 7fa39bfff700 1 -- 172.21.15.19:0/631837110 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0011d20 con 0x7fa3a409d6f0 2023-10-03T10:19:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 -- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 msgr2=0x7fa3a409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009920 tx=0x7fa3a0009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 -- 172.21.15.19:0/631837110 shutdown_connections 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 --2- 172.21.15.19:0/631837110 >> v2:172.21.15.19:3300/0 conn(0x7fa3a409e410 0x7fa3a4133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409d6f0 0x7fa3a409dac0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 --2- 172.21.15.19:0/631837110 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e000 0x7fa3a41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 -- 172.21.15.19:0/631837110 >> 172.21.15.19:0/631837110 conn(0x7fa3a4066f50 msgr2=0x7fa3a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 -- 172.21.15.19:0/631837110 shutdown_connections 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.715+0000 7fa3ab475700 1 -- 172.21.15.19:0/631837110 wait complete. 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.716+0000 7fa3ab475700 1 Processor -- start 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.716+0000 7fa3ab475700 1 -- start start 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.716+0000 7fa3ab475700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409d6f0 0x7fa3a41c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3ab475700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3ab475700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 0x7fa3a41c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3ab475700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41a5590 con 0x7fa3a409d6f0 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3ab475700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a41a53a0 con 0x7fa3a409e410 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3ab475700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40a30c0 con 0x7fa3a409e000 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46886/0 (socket says 172.21.15.19:46886) 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 -- 172.21.15.19:0/1165432337 learned_addr learned my addr 172.21.15.19:0/1165432337 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a9a12700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 0x7fa3a41c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a9211700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409d6f0 0x7fa3a41c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 -- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 msgr2=0x7fa3a41c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 0x7fa3a41c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 -- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409d6f0 msgr2=0x7fa3a41c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409d6f0 0x7fa3a41c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 -- 172.21.15.19:0/1165432337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009a70 con 0x7fa3a409e000 2023-10-03T10:19:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a9a12700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 0x7fa3a41c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.717+0000 7fa3a8a10700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa39400e980 tx=0x7fa39400ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.718+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394009710 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.718+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400c690 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.718+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0009550 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.718+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400ca20 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.718+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a41a7320 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.719+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa39400cb80 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.719+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a4074ea0 con 0x7fa3a409e000 2023-10-03T10:19:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.719+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa39403f6b0 con 0x7fa3a409e000 2023-10-03T10:19:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.724+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa3940232f0 con 0x7fa3a409e000 2023-10-03T10:19:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 Processor -- start 2023-10-03T10:19:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 -- start start 2023-10-03T10:19:40.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d700a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d700a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d700a1810 con 0x7f0d70133920 2023-10-03T10:19:40.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7009ea10 con 0x7f0d700a09c0 2023-10-03T10:19:40.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d759e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7009e210 con 0x7f0d7009d5c0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d6e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d700a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d6f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0d70133920 0x7f0d70133d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33554/0 (socket says 172.21.15.19:33554) 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.751+0000 7f0d6f7fe700 1 -- 172.21.15.19:0/1763324124 learned_addr learned my addr 172.21.15.19:0/1763324124 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6effd700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d700a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6dffb700 1 -- 172.21.15.19:0/1763324124 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981218928 0 0) 0x7f0d700a1810 con 0x7f0d70133920 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6dffb700 1 -- 172.21.15.19:0/1763324124 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d580035b0 con 0x7f0d70133920 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6e7fc700 1 -- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 msgr2=0x7f0d700a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6e7fc700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d700a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6e7fc700 1 -- 172.21.15.19:0/1763324124 >> v1:172.21.15.19:6789/0 conn(0x7f0d70133920 legacy=0x7f0d70133d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6e7fc700 1 -- 172.21.15.19:0/1763324124 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700a26f0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6e7fc700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d700a12d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d64009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b64bbf4874ca2ca3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6dffb700 1 -- 172.21.15.19:0/1763324124 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011830 con 0x7f0d7009d5c0 2023-10-03T10:19:40.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6dffb700 1 -- 172.21.15.19:0/1763324124 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64011990 con 0x7f0d7009d5c0 2023-10-03T10:19:40.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.752+0000 7f0d6dffb700 1 -- 172.21.15.19:0/1763324124 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011d00 con 0x7f0d7009d5c0 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 -- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 msgr2=0x7f0d700a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d700a12d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f0d64009870 tx=0x7f0d64009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 -- 172.21.15.19:0/1763324124 shutdown_connections 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d700a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1763324124 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d700a12d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 -- 172.21.15.19:0/1763324124 >> 172.21.15.19:0/1763324124 conn(0x7f0d700a2fe0 msgr2=0x7f0d700a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 -- 172.21.15.19:0/1763324124 shutdown_connections 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.753+0000 7f0d759e1700 1 -- 172.21.15.19:0/1763324124 wait complete. 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.754+0000 7f0d759e1700 1 Processor -- start 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.754+0000 7f0d759e1700 1 -- start start 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d7011f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d70133920 0x7f0d701c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70122390 con 0x7f0d70133920 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d70122570 con 0x7f0d700a09c0 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d759e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0d701333e0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46916/0 (socket says 172.21.15.19:46916) 2023-10-03T10:19:40.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 -- 172.21.15.19:0/1202714262 learned_addr learned my addr 172.21.15.19:0/1202714262 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6f7fe700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d70133920 0x7f0d701c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6e7fc700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d7011f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 -- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 msgr2=0x7f0d7011f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d7011f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 -- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d70133920 msgr2=0x7f0d701c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d70133920 0x7f0d701c7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.755+0000 7f0d6effd700 1 -- 172.21.15.19:0/1202714262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094a0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d6effd700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000e9e0 tx=0x7f0d6000ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60009710 con 0x7f0d7009d5c0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6000ee80 con 0x7f0d7009d5c0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000ca50 con 0x7f0d7009d5c0 2023-10-03T10:19:40.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d7011fea0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.756+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d700a58a0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.757+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0d6000cbb0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.757+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d700747f0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.757+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0d6003f6b0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.762 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.762+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0d600232f0 con 0x7f0d7009d5c0 2023-10-03T10:19:40.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.907+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f194811fea0 con 0x7f194812ff20 2023-10-03T10:19:40.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.907+0000 7f1936ffd700 1 -- 172.21.15.19:0/508595957 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1938012bc0 con 0x7f194812ff20 2023-10-03T10:19:40.907 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:40.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 msgr2=0x7f194809c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 0x7f194809c480 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f193800e9d0 tx=0x7f193800ece0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 shutdown_connections 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1948133a80 0x7f194809cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f194812ff20 0x7f194809c480 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 --2- 172.21.15.19:0/508595957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1948130a70 0x7f194809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 >> 172.21.15.19:0/508595957 conn(0x7f19480a4210 msgr2=0x7f194809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.909+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 shutdown_connections 2023-10-03T10:19:40.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.910+0000 7f194cd1a700 1 -- 172.21.15.19:0/508595957 wait complete. 2023-10-03T10:19:40.922 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:40.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:40.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.954+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa3a41b8550 con 0x7fa3a409e000 2023-10-03T10:19:40.955 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:40.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.955+0000 7fa399ffb700 1 -- 172.21.15.19:0/1165432337 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa394021020 con 0x7fa3a409e000 2023-10-03T10:19:40.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 msgr2=0x7fa3a41c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa39400e980 tx=0x7fa39400ec90 comp rx=0 tx=0).stop 2023-10-03T10:19:40.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 shutdown_connections 2023-10-03T10:19:40.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa3a409e410 0x7fa3a41c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3a409d6f0 0x7fa3a41c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 --2- 172.21.15.19:0/1165432337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa3a409e000 0x7fa3a41c86d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 >> 172.21.15.19:0/1165432337 conn(0x7fa3a4066f50 msgr2=0x7fa3a41bbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 shutdown_connections 2023-10-03T10:19:40.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.957+0000 7fa3ab475700 1 -- 172.21.15.19:0/1165432337 wait complete. 2023-10-03T10:19:40.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.974+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0d70120660 con 0x7f0d7009d5c0 2023-10-03T10:19:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.975+0000 7f0d57fff700 1 -- 172.21.15.19:0/1202714262 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0d60021030 con 0x7f0d7009d5c0 2023-10-03T10:19:40.974 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 msgr2=0x7f0d7011f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000e9e0 tx=0x7f0d6000ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 shutdown_connections 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d70133920 0x7f0d701c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0d7009d5c0 0x7f0d7011f420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 --2- 172.21.15.19:0/1202714262 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0d700a09c0 0x7f0d7011f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 >> 172.21.15.19:0/1202714262 conn(0x7f0d700a2fe0 msgr2=0x7f0d701bba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 shutdown_connections 2023-10-03T10:19:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:40.977+0000 7f0d759e1700 1 -- 172.21.15.19:0/1202714262 wait complete. 2023-10-03T10:19:40.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:41.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.092+0000 7fca3417f700 1 Processor -- start 2023-10-03T10:19:41.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.092+0000 7fca3417f700 1 -- start start 2023-10-03T10:19:41.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 0x7fca2c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2c09b0f0 con 0x7fca2c09e000 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c09d2f0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3417f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c09a810 con 0x7fca2c133f30 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3171a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca31f1b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 0x7fca2c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3171a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54144/0 (socket says 172.21.15.19:54144) 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3171a700 1 -- 172.21.15.19:0/1491540487 learned_addr learned my addr 172.21.15.19:0/1491540487 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 -- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 msgr2=0x7fca2c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 0x7fca2c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 -- 172.21.15.19:0/1491540487 >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 msgr2=0x7fca2c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 --2- 172.21.15.19:0/1491540487 >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3271c700 1 -- 172.21.15.19:0/1491540487 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c09a470 con 0x7fca2c133f30 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca31f1b700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 0x7fca2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.093+0000 7fca3171a700 1 --2- 172.21.15.19:0/1491540487 >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3271c700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1343b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fca24009d90 tx=0x7fca2400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a8696e0ea1e1315 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca30f19700 1 -- 172.21.15.19:0/1491540487 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2400e070 con 0x7fca2c133f30 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca30f19700 1 -- 172.21.15.19:0/1491540487 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2400bb20 con 0x7fca2c133f30 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca30f19700 1 -- 172.21.15.19:0/1491540487 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24012430 con 0x7fca2c133f30 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 -- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 msgr2=0x7fca2c1343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1343b0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fca24009d90 tx=0x7fca2400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 -- 172.21.15.19:0/1491540487 shutdown_connections 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09d6f0 0x7fca2c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 --2- 172.21.15.19:0/1491540487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1343b0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 --2- 172.21.15.19:0/1491540487 >> v2:172.21.15.19:3300/0 conn(0x7fca2c09e000 0x7fca2c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 -- 172.21.15.19:0/1491540487 >> 172.21.15.19:0/1491540487 conn(0x7fca2c066f50 msgr2=0x7fca2c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.094+0000 7fca3417f700 1 -- 172.21.15.19:0/1491540487 shutdown_connections 2023-10-03T10:19:41.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.095+0000 7fca3417f700 1 -- 172.21.15.19:0/1491540487 wait complete. 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.095+0000 7fca3417f700 1 Processor -- start 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 -- start start 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 0x7fca2c1c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:41.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c132600 con 0x7fca2c09d6f0 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c121560 con 0x7fca2c09e000 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3417f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c11e380 con 0x7fca2c133f30 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54152/0 (socket says 172.21.15.19:54152) 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3271c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 -- 172.21.15.19:0/1531026639 learned_addr learned my addr 172.21.15.19:0/1531026639 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3171a700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 0x7fca2c1c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 -- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 msgr2=0x7fca2c1c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 -- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 msgr2=0x7fca2c1c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 0x7fca2c1c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca31f1b700 1 -- 172.21.15.19:0/1531026639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280094a0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.096+0000 7fca3171a700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 0x7fca2c1c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:41.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca31f1b700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fca2800ebe0 tx=0x7fca2800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800c850 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800c9b0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800cd40 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca20009550 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.097+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca24009a70 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.098+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fca28013470 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.098+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2c11f6d0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.098+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fca2803f7a0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.103+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fca28013720 con 0x7fca2c09d6f0 2023-10-03T10:19:41.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.305+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fca2c074ea0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.306+0000 7fca1e7fc700 1 -- 172.21.15.19:0/1531026639 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fca2801b3b0 con 0x7fca2c09d6f0 2023-10-03T10:19:41.306 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 msgr2=0x7fca2c11e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fca2800ebe0 tx=0x7fca2800eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 shutdown_connections 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fca2c133f30 0x7fca2c1c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca2c09d6f0 0x7fca2c11e730 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 --2- 172.21.15.19:0/1531026639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fca2c09e000 0x7fca2c1c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 >> 172.21.15.19:0/1531026639 conn(0x7fca2c066f50 msgr2=0x7fca2c132ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 shutdown_connections 2023-10-03T10:19:41.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:41.308+0000 7fca3417f700 1 -- 172.21.15.19:0/1531026639 wait complete. 2023-10-03T10:19:41.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:41.924 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:41.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:41.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.078+0000 7f9d5b102700 1 Processor -- start 2023-10-03T10:19:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.078+0000 7f9d5b102700 1 -- start start 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5b102700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5b102700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 0x7f9d541339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5b102700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5409b120 con 0x7f9d5409e410 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5b102700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5406b460 con 0x7f9d5409e000 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5b102700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5409a7e0 con 0x7f9d5409d6f0 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d53fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 0x7f9d541339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5969f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9d5409e410 0x7f9d54133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33566/0 (socket says 172.21.15.19:33566) 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d5969f700 1 -- 172.21.15.19:0/3279943492 learned_addr learned my addr 172.21.15.19:0/3279943492 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d58e9e700 1 --2- 172.21.15.19:0/3279943492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d537fe700 1 -- 172.21.15.19:0/3279943492 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833626427 0 0) 0x7f9d5409b120 con 0x7f9d5409e410 2023-10-03T10:19:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d537fe700 1 -- 172.21.15.19:0/3279943492 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d440035b0 con 0x7f9d5409e410 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d58e9e700 1 -- 172.21.15.19:0/3279943492 >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 msgr2=0x7f9d541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d58e9e700 1 --2- 172.21.15.19:0/3279943492 >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 0x7f9d541339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d58e9e700 1 -- 172.21.15.19:0/3279943492 >> v1:172.21.15.19:6789/0 conn(0x7f9d5409e410 legacy=0x7f9d54133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.079+0000 7f9d58e9e700 1 -- 172.21.15.19:0/3279943492 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5409a500 con 0x7f9d5409d6f0 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.080+0000 7f9d53fff700 1 --2- 172.21.15.19:0/3279943492 >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 0x7f9d541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.080+0000 7f9d58e9e700 1 --2- 172.21.15.19:0/3279943492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d5409dac0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d48009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc02106b67039635 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.080+0000 7f9d537fe700 1 -- 172.21.15.19:0/3279943492 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011830 con 0x7f9d5409d6f0 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.080+0000 7f9d537fe700 1 -- 172.21.15.19:0/3279943492 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d48011990 con 0x7f9d5409d6f0 2023-10-03T10:19:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.080+0000 7f9d537fe700 1 -- 172.21.15.19:0/3279943492 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d48011d20 con 0x7f9d5409d6f0 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 -- 172.21.15.19:0/3279943492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 msgr2=0x7f9d5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 --2- 172.21.15.19:0/3279943492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d5409dac0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009870 tx=0x7f9d48009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 -- 172.21.15.19:0/3279943492 shutdown_connections 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 --2- 172.21.15.19:0/3279943492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d5409dac0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 --2- 172.21.15.19:0/3279943492 >> v2:172.21.15.19:3300/0 conn(0x7f9d5409e000 0x7f9d541339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 -- 172.21.15.19:0/3279943492 >> 172.21.15.19:0/3279943492 conn(0x7f9d54066f50 msgr2=0x7f9d5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 -- 172.21.15.19:0/3279943492 shutdown_connections 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.081+0000 7f9d5b102700 1 -- 172.21.15.19:0/3279943492 wait complete. 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.082+0000 7f9d5b102700 1 Processor -- start 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.082+0000 7f9d5b102700 1 -- start start 2023-10-03T10:19:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d541c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d5409e410 0x7f9d541c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541a6470 con 0x7f9d5409e000 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d541a7cd0 con 0x7f9d5409e410 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5b102700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5409c710 con 0x7f9d5409d6f0 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54164/0 (socket says 172.21.15.19:54164) 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 -- 172.21.15.19:0/68163505 learned_addr learned my addr 172.21.15.19:0/68163505 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d5969f700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d5409e410 0x7f9d541c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d58e9e700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d541c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 -- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 msgr2=0x7f9d541c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d541c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 -- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d5409e410 msgr2=0x7f9d541c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d5409e410 0x7f9d541c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 -- 172.21.15.19:0/68163505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d400094a0 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.083+0000 7f9d53fff700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000ebb0 tx=0x7f9d4000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.084+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000c850 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.084+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d480094a0 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.084+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4000c9b0 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.084+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4000cd20 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.084+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d541b9200 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.085+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d40013470 con 0x7f9d5409e000 2023-10-03T10:19:42.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.085+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d4003f880 con 0x7f9d5409e000 2023-10-03T10:19:42.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.085+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d54074ea0 con 0x7f9d5409e000 2023-10-03T10:19:42.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.090+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d40017080 con 0x7f9d5409e000 2023-10-03T10:19:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.121+0000 7fd873ee7700 1 Processor -- start 2023-10-03T10:19:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.121+0000 7fd873ee7700 1 -- start start 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd86c09e410 0x7fd86c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd86c06b460 con 0x7fd86c09e410 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c09b120 con 0x7fd86c09e000 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd873ee7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c09a7e0 con 0x7fd86c09d6f0 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871c83700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48808/0 (socket says 172.21.15.19:48808) 2023-10-03T10:19:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 -- 172.21.15.19:0/1035561924 learned_addr learned my addr 172.21.15.19:0/1035561924 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd872484700 1 --2- 172.21.15.19:0/1035561924 >> v2:172.21.15.19:3300/0 conn(0x7fd86c09e410 0x7fd86c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 -- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 msgr2=0x7fd86c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 -- 172.21.15.19:0/1035561924 >> v2:172.21.15.19:3300/0 conn(0x7fd86c09e410 msgr2=0x7fd86c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 --2- 172.21.15.19:0/1035561924 >> v2:172.21.15.19:3300/0 conn(0x7fd86c09e410 0x7fd86c133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871482700 1 -- 172.21.15.19:0/1035561924 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c09a500 con 0x7fd86c09e000 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.122+0000 7fd871c83700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.123+0000 7fd871482700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009920 tx=0x7fd85c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3ed29783ef2637 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.123+0000 7fd870c81700 1 -- 172.21.15.19:0/1035561924 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011830 con 0x7fd86c09e000 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.123+0000 7fd870c81700 1 -- 172.21.15.19:0/1035561924 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c011990 con 0x7fd86c09e000 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.123+0000 7fd870c81700 1 -- 172.21.15.19:0/1035561924 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c011d20 con 0x7fd86c09e000 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 -- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 msgr2=0x7fd86c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fd85c009920 tx=0x7fd85c009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 -- 172.21.15.19:0/1035561924 shutdown_connections 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 --2- 172.21.15.19:0/1035561924 >> v2:172.21.15.19:3300/0 conn(0x7fd86c09e410 0x7fd86c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 --2- 172.21.15.19:0/1035561924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1339f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 -- 172.21.15.19:0/1035561924 >> 172.21.15.19:0/1035561924 conn(0x7fd86c066f50 msgr2=0x7fd86c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 -- 172.21.15.19:0/1035561924 shutdown_connections 2023-10-03T10:19:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.124+0000 7fd873ee7700 1 -- 172.21.15.19:0/1035561924 wait complete. 2023-10-03T10:19:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 Processor -- start 2023-10-03T10:19:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 -- start start 2023-10-03T10:19:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c1a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 0x7fd86c1a25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1a3c80 con 0x7fd86c09e410 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1a4d40 con 0x7fd86c09e000 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd873ee7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c09c710 con 0x7fd86c09d6f0 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd871c83700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c1a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd871c83700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c1a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46954/0 (socket says 172.21.15.19:46954) 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd871c83700 1 -- 172.21.15.19:0/195503405 learned_addr learned my addr 172.21.15.19:0/195503405 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd871482700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.125+0000 7fd872484700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 0x7fd86c1a25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 -- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 msgr2=0x7fd86c1a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c1a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 -- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 msgr2=0x7fd86c1a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 -- 172.21.15.19:0/195503405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680094a0 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd871482700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd872484700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 0x7fd86c1a25a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd864003fd0 tx=0x7fd8640045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864019040 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8640110d0 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c009550 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd864011480 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.126+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c1a36a0 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.127+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c074ea0 con 0x7fd86c09e410 2023-10-03T10:19:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.127+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8640115e0 con 0x7fd86c09e410 2023-10-03T10:19:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.128+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd8640481d0 con 0x7fd86c09e410 2023-10-03T10:19:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.132+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd864011890 con 0x7fd86c09e410 2023-10-03T10:19:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 Processor -- start 2023-10-03T10:19:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 -- start start 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48f809e850 0x7f48f809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 0x7f48f8131790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f809b560 con 0x7f48f8131cd0 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f80a0040 con 0x7f48f809e850 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.159+0000 7f48fd4e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80a02e0 con 0x7f48f809f160 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 0x7f48f8131790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f67fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 0x7f48f8131790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46962/0 (socket says 172.21.15.19:46962) 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f67fc700 1 -- 172.21.15.19:0/3296920836 learned_addr learned my addr 172.21.15.19:0/3296920836 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 --2- 172.21.15.19:0/3296920836 >> v2:172.21.15.19:3300/0 conn(0x7f48f809e850 0x7f48f809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 -- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 msgr2=0x7f48f8131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 --2- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 0x7f48f8131790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 -- 172.21.15.19:0/3296920836 >> v1:172.21.15.19:6789/0 conn(0x7f48f8131cd0 legacy=0x7f48f8138bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 -- 172.21.15.19:0/3296920836 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f809fab0 con 0x7f48f809e850 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.160+0000 7f48f6ffd700 1 --2- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809e850 0x7f48f809ec20 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3309e51d511b0aae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48f5ffb700 1 -- 172.21.15.19:0/3296920836 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e800e070 con 0x7f48f809e850 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48f5ffb700 1 -- 172.21.15.19:0/3296920836 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e800bb20 con 0x7f48f809e850 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48f5ffb700 1 -- 172.21.15.19:0/3296920836 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8012430 con 0x7f48f809e850 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 -- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809e850 msgr2=0x7f48f809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809e850 0x7f48f809ec20 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009d90 tx=0x7f48e800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 -- 172.21.15.19:0/3296920836 shutdown_connections 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809e850 0x7f48f809ec20 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/3296920836 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809f160 0x7f48f8131790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 -- 172.21.15.19:0/3296920836 >> 172.21.15.19:0/3296920836 conn(0x7f48f80a3f70 msgr2=0x7f48f80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 -- 172.21.15.19:0/3296920836 shutdown_connections 2023-10-03T10:19:42.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.161+0000 7f48fd4e5700 1 -- 172.21.15.19:0/3296920836 wait complete. 2023-10-03T10:19:42.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.163+0000 7f48fd4e5700 1 Processor -- start 2023-10-03T10:19:42.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.163+0000 7f48fd4e5700 1 -- start start 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 0x7f48f81208f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f8131cd0 0x7f48f8120e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8123bf0 con 0x7f48f809f160 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8121f30 con 0x7f48f8131cd0 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48fd4e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8123e40 con 0x7f48f809e850 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46974/0 (socket says 172.21.15.19:46974) 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f6ffd700 1 -- 172.21.15.19:0/4206542067 learned_addr learned my addr 172.21.15.19:0/4206542067 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 0x7f48f81208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f77fe700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f8131cd0 0x7f48f8120e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 -- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 msgr2=0x7f48f81203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 -- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f8131cd0 msgr2=0x7f48f8120e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f8131cd0 0x7f48f8120e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f67fc700 1 -- 172.21.15.19:0/4206542067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e8009a70 con 0x7f48f809f160 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.164+0000 7f48f6ffd700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48f67fc700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 0x7f48f81208f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e8e0 tx=0x7f48ec00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec013680 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec0137e0 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f8131720 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f81238a0 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.165+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec013b70 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.166+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48ec013cd0 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.166+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48d80052e0 con 0x7f48f809f160 2023-10-03T10:19:42.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.166+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f48ec03f500 con 0x7f48f809f160 2023-10-03T10:19:42.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.171+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48ec017080 con 0x7f48f809f160 2023-10-03T10:19:42.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.301+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9d5409ace0 con 0x7f9d5409e000 2023-10-03T10:19:42.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.302+0000 7f9d517fa700 1 -- 172.21.15.19:0/68163505 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9d40021020 con 0x7f9d5409e000 2023-10-03T10:19:42.302 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 msgr2=0x7f9d541c8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f9d4000ebb0 tx=0x7f9d4000eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 shutdown_connections 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d5409e410 0x7f9d541c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d5409d6f0 0x7f9d541c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 --2- 172.21.15.19:0/68163505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d5409e000 0x7f9d541c8480 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 >> 172.21.15.19:0/68163505 conn(0x7f9d54066f50 msgr2=0x7f9d541bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 shutdown_connections 2023-10-03T10:19:42.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.304+0000 7f9d5b102700 1 -- 172.21.15.19:0/68163505 wait complete. 2023-10-03T10:19:42.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:42.322 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:42.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.342+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd86c1a48f0 con 0x7fd86c09e410 2023-10-03T10:19:42.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.343+0000 7fd8627fc700 1 -- 172.21.15.19:0/195503405 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd864024b00 con 0x7fd86c09e410 2023-10-03T10:19:42.343 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:42.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 msgr2=0x7fd86c1a25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 0x7fd86c1a25a0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd864003fd0 tx=0x7fd8640045a0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 shutdown_connections 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd86c09e410 0x7fd86c1a25a0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd86c09d6f0 0x7fd86c1a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 --2- 172.21.15.19:0/195503405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd86c09e000 0x7fd86c1a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 >> 172.21.15.19:0/195503405 conn(0x7fd86c066f50 msgr2=0x7fd86c1b6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.345+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 shutdown_connections 2023-10-03T10:19:42.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.346+0000 7fd873ee7700 1 -- 172.21.15.19:0/195503405 wait complete. 2023-10-03T10:19:42.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:42.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.377+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f48d8005590 con 0x7f48f809f160 2023-10-03T10:19:42.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.377+0000 7f48df7fe700 1 -- 172.21.15.19:0/4206542067 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48ec0123d0 con 0x7f48f809f160 2023-10-03T10:19:42.377 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:42.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 msgr2=0x7f48f81208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 0x7f48f81208f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00e8e0 tx=0x7f48ec00ebf0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 shutdown_connections 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f8131cd0 0x7f48f8120e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f809e850 0x7f48f81203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 --2- 172.21.15.19:0/4206542067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f809f160 0x7f48f81208f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.379+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 >> 172.21.15.19:0/4206542067 conn(0x7f48f80a3f70 msgr2=0x7f48f80a1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.380+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 shutdown_connections 2023-10-03T10:19:42.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.380+0000 7f48fd4e5700 1 -- 172.21.15.19:0/4206542067 wait complete. 2023-10-03T10:19:42.393 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:42.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.461+0000 7fd0e2bcd700 1 Processor -- start 2023-10-03T10:19:42.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.461+0000 7fd0e2bcd700 1 -- start start 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0dc09e000 0x7fd0dc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 0x7fd0dc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc09f520 con 0x7fd0dc09e000 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09f130 con 0x7fd0dc09e410 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e2bcd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc09e930 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e0969700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0dc09e000 0x7fd0dc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e116a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 0x7fd0dc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e0969700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46990/0 (socket says 172.21.15.19:46990) 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0dc09e000 0x7fd0dc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54212/0 (socket says 172.21.15.19:54212) 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e0969700 1 -- 172.21.15.19:0/3818491906 learned_addr learned my addr 172.21.15.19:0/3818491906 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 -- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 msgr2=0x7fd0dc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 -- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 msgr2=0x7fd0dc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 0x7fd0dc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0dbfff700 1 -- 172.21.15.19:0/3818491906 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc09b2d0 con 0x7fd0dc09e000 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e0969700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.462+0000 7fd0e116a700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 0x7fd0dc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:42.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0dbfff700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc130660 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009870 tx=0x7fd0d0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6908b45250cbc9af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0db7fe700 1 -- 172.21.15.19:0/3818491906 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011830 con 0x7fd0dc09e000 2023-10-03T10:19:42.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0db7fe700 1 -- 172.21.15.19:0/3818491906 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d0011990 con 0x7fd0dc09e000 2023-10-03T10:19:42.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0db7fe700 1 -- 172.21.15.19:0/3818491906 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d0011d20 con 0x7fd0dc09e000 2023-10-03T10:19:42.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 msgr2=0x7fd0dc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc130660 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009870 tx=0x7fd0d0009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:42.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/3818491906 shutdown_connections 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09e410 0x7fd0dc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09d6f0 0x7fd0dc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/3818491906 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc130660 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/3818491906 >> 172.21.15.19:0/3818491906 conn(0x7fd0dc066f50 msgr2=0x7fd0dc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.463+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/3818491906 shutdown_connections 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.464+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/3818491906 wait complete. 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.464+0000 7fd0e2bcd700 1 Processor -- start 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.464+0000 7fd0e2bcd700 1 -- start start 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 0x7fd0dc11dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc11e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 0x7fd0dc11e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:42.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc121a00 con 0x7fd0dc09e000 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc120110 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e2bcd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc121190 con 0x7fd0dc09e410 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc11e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e116a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 0x7fd0dc11e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e0969700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 0x7fd0dc11dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0dbfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc11e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54224/0 (socket says 172.21.15.19:54224) 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0dbfff700 1 -- 172.21.15.19:0/203490799 learned_addr learned my addr 172.21.15.19:0/203490799 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.465+0000 7fd0e116a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 0x7fd0dc11e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:46998/0 (socket says 172.21.15.19:46998) 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 -- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 msgr2=0x7fd0dc11e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 0x7fd0dc11e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 -- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 msgr2=0x7fd0dc11e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc11e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 -- 172.21.15.19:0/203490799 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d400bd40 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e0969700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 0x7fd0dc11dee0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4010f30 tx=0x7fd0d400d390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4012040 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400d9a0 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400dd30 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc0094a0 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.466+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d00094a0 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.467+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0d4009600 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.467+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0d4041660 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.467+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc074ea0 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.472+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0d4017460 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.678+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0dc1302c0 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.679+0000 7fd0d97fa700 1 -- 172.21.15.19:0/203490799 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0d401c020 con 0x7fd0dc09d6f0 2023-10-03T10:19:42.679 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:42.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 msgr2=0x7fd0dc11dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:42.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 0x7fd0dc11dee0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4010f30 tx=0x7fd0d400d390 comp rx=0 tx=0).stop 2023-10-03T10:19:42.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 shutdown_connections 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0dc09e410 0x7fd0dc11e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0dc09d6f0 0x7fd0dc11dee0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 --2- 172.21.15.19:0/203490799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0dc09e000 0x7fd0dc11e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 >> 172.21.15.19:0/203490799 conn(0x7fd0dc066f50 msgr2=0x7fd0dc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 shutdown_connections 2023-10-03T10:19:42.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:42.681+0000 7fd0e2bcd700 1 -- 172.21.15.19:0/203490799 wait complete. 2023-10-03T10:19:42.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:43.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:43.362 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:43.394 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.468+0000 7f5278c12700 1 Processor -- start 2023-10-03T10:19:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.468+0000 7f5278c12700 1 -- start start 2023-10-03T10:19:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5278c12700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 0x7f5274136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5278c12700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5274136fe0 0x7f52741393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5278c12700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5274070940 con 0x7f527409e930 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5278c12700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527406fd60 con 0x7f5274136fe0 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5278c12700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f527406fa80 con 0x7f527409f410 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5271d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 0x7f5274136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f527259c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f527409e930 0x7f527409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33576/0 (socket says 172.21.15.19:33576) 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f527259c700 1 -- 172.21.15.19:0/1372851308 learned_addr learned my addr 172.21.15.19:0/1372851308 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.469+0000 7f5272d9d700 1 --2- 172.21.15.19:0/1372851308 >> v2:172.21.15.19:3300/0 conn(0x7f5274136fe0 0x7f52741393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f527159a700 1 -- 172.21.15.19:0/1372851308 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912387921 0 0) 0x7f5274070940 con 0x7f527409e930 2023-10-03T10:19:43.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f527159a700 1 -- 172.21.15.19:0/1372851308 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f525c0035b0 con 0x7f527409e930 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5272d9d700 1 -- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 msgr2=0x7f5274136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5272d9d700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 0x7f5274136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5272d9d700 1 -- 172.21.15.19:0/1372851308 >> v1:172.21.15.19:6789/0 conn(0x7f527409e930 legacy=0x7f527409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5272d9d700 1 -- 172.21.15.19:0/1372851308 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527409fb60 con 0x7f5274136fe0 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5271d9b700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 0x7f5274136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f5272d9d700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5274136fe0 0x7f52741393c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f526c009840 tx=0x7f526c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8edbf5405a17443a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f527159a700 1 -- 172.21.15.19:0/1372851308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011830 con 0x7f5274136fe0 2023-10-03T10:19:43.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f527159a700 1 -- 172.21.15.19:0/1372851308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c011990 con 0x7f5274136fe0 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.470+0000 7f527159a700 1 -- 172.21.15.19:0/1372851308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c011d20 con 0x7f5274136fe0 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 -- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5274136fe0 msgr2=0x7f52741393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5274136fe0 0x7f52741393c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f526c009840 tx=0x7f526c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 -- 172.21.15.19:0/1372851308 shutdown_connections 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5274136fe0 0x7f52741393c0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 --2- 172.21.15.19:0/1372851308 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f527409f410 0x7f5274136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 -- 172.21.15.19:0/1372851308 >> 172.21.15.19:0/1372851308 conn(0x7f52740a4210 msgr2=0x7f52740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 -- 172.21.15.19:0/1372851308 shutdown_connections 2023-10-03T10:19:43.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.471+0000 7f5278c12700 1 -- 172.21.15.19:0/1372851308 wait complete. 2023-10-03T10:19:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.472+0000 7f5278c12700 1 Processor -- start 2023-10-03T10:19:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.472+0000 7f5278c12700 1 -- start start 2023-10-03T10:19:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 0x7f527411c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5274136fe0 0x7f527411d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527411f8d0 con 0x7f527409f410 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527411fe80 con 0x7f527409e930 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5278c12700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f527411e250 con 0x7f5274136fe0 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5271d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f527259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 0x7f527411c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5271d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54248/0 (socket says 172.21.15.19:54248) 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5271d9b700 1 -- 172.21.15.19:0/1375241722 learned_addr learned my addr 172.21.15.19:0/1375241722 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f5272d9d700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5274136fe0 0x7f527411d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f527259c700 1 -- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5274136fe0 msgr2=0x7f527411d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f527259c700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5274136fe0 0x7f527411d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.473+0000 7f527259c700 1 -- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 msgr2=0x7f527411cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f527259c700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f527259c700 1 -- 172.21.15.19:0/1375241722 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680094a0 con 0x7f527409e930 2023-10-03T10:19:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5271d9b700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f527259c700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 0x7f527411c640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f526400cbc0 tx=0x7f526400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400a9e0 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400ab40 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264011560 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c0094a0 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.474+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527411fbc0 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.475+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5264017070 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.475+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274074ea0 con 0x7f527409e930 2023-10-03T10:19:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.475+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f52640436e0 con 0x7f527409e930 2023-10-03T10:19:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.480+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5264022760 con 0x7f527409e930 2023-10-03T10:19:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.512+0000 7f0cf24f8700 1 Processor -- start 2023-10-03T10:19:43.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.512+0000 7f0cf24f8700 1 -- start start 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf24f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 0x7f0cec136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf24f8700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 0x7f0cec1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf24f8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec070940 con 0x7f0cec09e930 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf24f8700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec06fd60 con 0x7f0cec136fe0 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf24f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec06fa80 con 0x7f0cec09f410 2023-10-03T10:19:43.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 0x7f0cec136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cebfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0cec09e930 0x7f0cec09ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33580/0 (socket says 172.21.15.19:33580) 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cebfff700 1 -- 172.21.15.19:0/2489613309 learned_addr learned my addr 172.21.15.19:0/2489613309 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf0a95700 1 --2- 172.21.15.19:0/2489613309 >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 0x7f0cec1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/2489613309 >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 msgr2=0x7f0cec1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0ceb7fe700 1 --2- 172.21.15.19:0/2489613309 >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 0x7f0cec1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/2489613309 >> v1:172.21.15.19:6789/0 conn(0x7f0cec09e930 legacy=0x7f0cec09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/2489613309 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec09fb60 con 0x7f0cec09f410 2023-10-03T10:19:43.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.513+0000 7f0cf0a95700 1 --2- 172.21.15.19:0/2489613309 >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 0x7f0cec1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.514+0000 7f0ceb7fe700 1 --2- 172.21.15.19:0/2489613309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 0x7f0cec136aa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009840 tx=0x7f0ce0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f893b5f6f0d3cf83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.514+0000 7f0ceaffd700 1 -- 172.21.15.19:0/2489613309 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011830 con 0x7f0cec09f410 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.514+0000 7f0ceaffd700 1 -- 172.21.15.19:0/2489613309 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0011990 con 0x7f0cec09f410 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.514+0000 7f0ceaffd700 1 -- 172.21.15.19:0/2489613309 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0011d20 con 0x7f0cec09f410 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 -- 172.21.15.19:0/2489613309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 msgr2=0x7f0cec136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/2489613309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 0x7f0cec136aa0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009840 tx=0x7f0ce0009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 -- 172.21.15.19:0/2489613309 shutdown_connections 2023-10-03T10:19:43.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/2489613309 >> v2:172.21.15.19:3300/0 conn(0x7f0cec136fe0 0x7f0cec1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/2489613309 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec09f410 0x7f0cec136aa0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 -- 172.21.15.19:0/2489613309 >> 172.21.15.19:0/2489613309 conn(0x7f0cec0a4210 msgr2=0x7f0cec0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 -- 172.21.15.19:0/2489613309 shutdown_connections 2023-10-03T10:19:43.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.515+0000 7f0cf24f8700 1 -- 172.21.15.19:0/2489613309 wait complete. 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.516+0000 7f0cf24f8700 1 Processor -- start 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.516+0000 7f0cf24f8700 1 -- start start 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cec09e930 0x7f0cec11c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec136fe0 0x7f0cec11d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec11fe50 con 0x7f0cec09e930 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0a2f40 con 0x7f0cec136fe0 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cf24f8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec11f8a0 con 0x7f0cec09f410 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0cebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cec09e930 0x7f0cec11c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0ceb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47014/0 (socket says 172.21.15.19:47014) 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.517+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/474962940 learned_addr learned my addr 172.21.15.19:0/474962940 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0cf0a95700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec136fe0 0x7f0cec11d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec136fe0 msgr2=0x7f0cec11d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec136fe0 0x7f0cec11d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cec09e930 msgr2=0x7f0cec11c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cec09e930 0x7f0cec11c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 -- 172.21.15.19:0/474962940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4009a70 con 0x7f0cec09f410 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ceb7fe700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009fd0 tx=0x7f0ce0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00036a0 con 0x7f0cec09f410 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce001f070 con 0x7f0cec09f410 2023-10-03T10:19:43.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0003a40 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce00094a0 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.518+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec11e330 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.519+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0ce0003ba0 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.520+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0ce0021070 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.520+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec132500 con 0x7f0cec09f410 2023-10-03T10:19:43.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.525+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0ce002b020 con 0x7f0cec09f410 2023-10-03T10:19:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 Processor -- start 2023-10-03T10:19:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 -- start start 2023-10-03T10:19:43.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 0x7f988406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9884131b40 0x7f9884131fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988409ece0 con 0x7f9884131b40 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988409e760 con 0x7f988406a770 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f988a89a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f988409e040 con 0x7f988406b080 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.562+0000 7f98837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f98837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47030/0 (socket says 172.21.15.19:47030) 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9884131b40 0x7f9884131fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f98837fe700 1 -- 172.21.15.19:0/3478163429 learned_addr learned my addr 172.21.15.19:0/3478163429 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9883fff700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 0x7f988406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 -- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 msgr2=0x7f9884131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 -- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 msgr2=0x7f988406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 0x7f988406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 -- 172.21.15.19:0/3478163429 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988409f630 con 0x7f9884131b40 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f98837fe700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9883fff700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 0x7f988406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9888e37700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9884131b40 0x7f9884131fe0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f987c009d90 tx=0x7f987c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a2368c78d04fd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9882ffd700 1 -- 172.21.15.19:0/3478163429 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00e070 con 0x7f9884131b40 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9882ffd700 1 -- 172.21.15.19:0/3478163429 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c00bb20 con 0x7f9884131b40 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.563+0000 7f9882ffd700 1 -- 172.21.15.19:0/3478163429 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c012430 con 0x7f9884131b40 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 -- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9884131b40 msgr2=0x7f9884131fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9884131b40 0x7f9884131fe0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f987c009d90 tx=0x7f987c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 -- 172.21.15.19:0/3478163429 shutdown_connections 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406a770 0x7f988406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9884131b40 0x7f9884131fe0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 --2- 172.21.15.19:0/3478163429 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f988406b080 0x7f9884131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 -- 172.21.15.19:0/3478163429 >> 172.21.15.19:0/3478163429 conn(0x7f9884066f50 msgr2=0x7f988409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 -- 172.21.15.19:0/3478163429 shutdown_connections 2023-10-03T10:19:43.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.564+0000 7f988a89a700 1 -- 172.21.15.19:0/3478163429 wait complete. 2023-10-03T10:19:43.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.565+0000 7f988a89a700 1 Processor -- start 2023-10-03T10:19:43.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.565+0000 7f988a89a700 1 -- start start 2023-10-03T10:19:43.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406b080 0x7f988411b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9884131b40 0x7f988411bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988411d4a0 con 0x7f988406a770 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988411df30 con 0x7f988406b080 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f988a89a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98840a3ad0 con 0x7f9884131b40 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54292/0 (socket says 172.21.15.19:54292) 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 -- 172.21.15.19:0/177053042 learned_addr learned my addr 172.21.15.19:0/177053042 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f98837fe700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406b080 0x7f988411b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9888e37700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9884131b40 0x7f988411bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 -- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9884131b40 msgr2=0x7f988411bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9884131b40 0x7f988411bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 -- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406b080 msgr2=0x7f988411b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406b080 0x7f988411b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.566+0000 7f9883fff700 1 -- 172.21.15.19:0/177053042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987400d940 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f9883fff700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f9874012fc0 tx=0x7f98740103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987401bbc0 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874013040 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9878009550 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400d280 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.567+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f987c009a70 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.568+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9874010900 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.568+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9874047b20 con 0x7f988406a770 2023-10-03T10:19:43.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.568+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988409aad0 con 0x7f988406a770 2023-10-03T10:19:43.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.574+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9874021670 con 0x7f988406a770 2023-10-03T10:19:43.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:43.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.698+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f52740a3310 con 0x7f527409e930 2023-10-03T10:19:43.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.699+0000 7f5262ffd700 1 -- 172.21.15.19:0/1375241722 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f526401f020 con 0x7f527409e930 2023-10-03T10:19:43.699 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 msgr2=0x7f527411c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 0x7f527411c640 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f526400cbc0 tx=0x7f526400ced0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 shutdown_connections 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5274136fe0 0x7f527411d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f527409e930 0x7f527411c640 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 --2- 172.21.15.19:0/1375241722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f527409f410 0x7f527411cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 >> 172.21.15.19:0/1375241722 conn(0x7f52740a4210 msgr2=0x7f5274134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 shutdown_connections 2023-10-03T10:19:43.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.701+0000 7f5278c12700 1 -- 172.21.15.19:0/1375241722 wait complete. 2023-10-03T10:19:43.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.769+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0cec074ea0 con 0x7f0cec09f410 2023-10-03T10:19:43.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.769+0000 7f0ce8ff9700 1 -- 172.21.15.19:0/474962940 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0ce002b020 con 0x7f0cec09f410 2023-10-03T10:19:43.769 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:43.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 msgr2=0x7f0cec11cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009fd0 tx=0x7f0ce0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 shutdown_connections 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0cec136fe0 0x7f0cec11d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0cec09e930 0x7f0cec11c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.771+0000 7f0cf24f8700 1 --2- 172.21.15.19:0/474962940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0cec09f410 0x7f0cec11cba0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.772+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 >> 172.21.15.19:0/474962940 conn(0x7f0cec0a4210 msgr2=0x7f0cec0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.772+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 shutdown_connections 2023-10-03T10:19:43.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.772+0000 7f0cf24f8700 1 -- 172.21.15.19:0/474962940 wait complete. 2023-10-03T10:19:43.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.803+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9884074ea0 con 0x7f988406a770 2023-10-03T10:19:43.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.804+0000 7f9880ff9700 1 -- 172.21.15.19:0/177053042 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9874033090 con 0x7f988406a770 2023-10-03T10:19:43.803 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:43.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 msgr2=0x7f988411b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f9874012fc0 tx=0x7f98740103a0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 shutdown_connections 2023-10-03T10:19:43.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9884131b40 0x7f988411bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f988406a770 0x7f988411b060 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 --2- 172.21.15.19:0/177053042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f988406b080 0x7f988411b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 >> 172.21.15.19:0/177053042 conn(0x7f9884066f50 msgr2=0x7f9884130ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 shutdown_connections 2023-10-03T10:19:43.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.806+0000 7f988a89a700 1 -- 172.21.15.19:0/177053042 wait complete. 2023-10-03T10:19:43.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 Processor -- start 2023-10-03T10:19:43.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 -- start start 2023-10-03T10:19:43.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a409ea10 con 0x7f93a409d5c0 2023-10-03T10:19:43.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a409e210 con 0x7f93a40a09c0 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.841+0000 7f93a92e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40a26f0 con 0x7f93a40a12d0 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48932/0 (socket says 172.21.15.19:48932) 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a2ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54298/0 (socket says 172.21.15.19:54298) 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 -- 172.21.15.19:0/1535839757 learned_addr learned my addr 172.21.15.19:0/1535839757 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 -- 172.21.15.19:0/1535839757 >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 msgr2=0x7f93a40a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 --2- 172.21.15.19:0/1535839757 >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 -- 172.21.15.19:0/1535839757 >> v1:172.21.15.19:6789/0 conn(0x7f93a409d5c0 legacy=0x7f93a4133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 -- 172.21.15.19:0/1535839757 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a409db70 con 0x7f93a40a12d0 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a2ffd700 1 --2- 172.21.15.19:0/1535839757 >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a1ffb700 1 -- 172.21.15.19:0/1535839757 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056201606 0 0) 0x7f93a409ea10 con 0x7f93a409d5c0 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a37fe700 1 --2- 172.21.15.19:0/1535839757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f939c009e50 tx=0x7f939c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43ca6547aa56294d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a1ffb700 1 -- 172.21.15.19:0/1535839757 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00e070 con 0x7f93a40a12d0 2023-10-03T10:19:43.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a1ffb700 1 -- 172.21.15.19:0/1535839757 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00b910 con 0x7f93a40a12d0 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.842+0000 7f93a1ffb700 1 -- 172.21.15.19:0/1535839757 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00bcc0 con 0x7f93a40a12d0 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 -- 172.21.15.19:0/1535839757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 msgr2=0x7f93a4134030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 --2- 172.21.15.19:0/1535839757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f939c009e50 tx=0x7f939c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 -- 172.21.15.19:0/1535839757 shutdown_connections 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 --2- 172.21.15.19:0/1535839757 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a12d0 0x7f93a4134030 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 --2- 172.21.15.19:0/1535839757 >> v2:172.21.15.19:3300/0 conn(0x7f93a40a09c0 0x7f93a40a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 -- 172.21.15.19:0/1535839757 >> 172.21.15.19:0/1535839757 conn(0x7f93a40a2fe0 msgr2=0x7f93a40a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 -- 172.21.15.19:0/1535839757 shutdown_connections 2023-10-03T10:19:43.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.843+0000 7f93a92e1700 1 -- 172.21.15.19:0/1535839757 wait complete. 2023-10-03T10:19:43.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.844+0000 7f93a92e1700 1 Processor -- start 2023-10-03T10:19:43.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.844+0000 7f93a92e1700 1 -- start start 2023-10-03T10:19:43.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a09c0 0x7f93a41234c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a40a12d0 0x7f93a4123a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4124450 con 0x7f93a40a12d0 2023-10-03T10:19:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4134810 con 0x7f93a40a09c0 2023-10-03T10:19:43.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a92e1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93a4126aa0 con 0x7f93a409d5c0 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a09c0 0x7f93a41234c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a40a12d0 0x7f93a4123a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47038/0 (socket says 172.21.15.19:47038) 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 -- 172.21.15.19:0/345982324 learned_addr learned my addr 172.21.15.19:0/345982324 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:43.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 -- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a09c0 msgr2=0x7f93a41234c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a09c0 0x7f93a41234c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 -- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a40a12d0 msgr2=0x7f93a4123a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a40a12d0 0x7f93a4123a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 -- 172.21.15.19:0/345982324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940094a0 con 0x7f93a409d5c0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.845+0000 7f93a2ffd700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f939400ebe0 tx=0x7f939400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939400c850 con 0x7f93a409d5c0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939400c9b0 con 0x7f93a409d5c0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c009b30 con 0x7f93a409d5c0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939400cd40 con 0x7f93a409d5c0 2023-10-03T10:19:43.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a409cec0 con 0x7f93a409d5c0 2023-10-03T10:19:43.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.846+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9394013470 con 0x7f93a409d5c0 2023-10-03T10:19:43.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.847+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f939403f770 con 0x7f93a409d5c0 2023-10-03T10:19:43.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.847+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a40747f0 con 0x7f93a409d5c0 2023-10-03T10:19:43.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:43.852+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9394021020 con 0x7f93a409d5c0 2023-10-03T10:19:44.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.053+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93a4126720 con 0x7f93a409d5c0 2023-10-03T10:19:44.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.054+0000 7f939b7fe700 1 -- 172.21.15.19:0/345982324 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93a4126720 con 0x7f93a409d5c0 2023-10-03T10:19:44.054 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:44.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 msgr2=0x7f93a4122f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f939400ebe0 tx=0x7f939400eef0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 shutdown_connections 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a40a12d0 0x7f93a4123a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93a409d5c0 0x7f93a4122f80 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 --2- 172.21.15.19:0/345982324 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93a40a09c0 0x7f93a41234c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 >> 172.21.15.19:0/345982324 conn(0x7f93a40a2fe0 msgr2=0x7f93a40a4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 shutdown_connections 2023-10-03T10:19:44.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.056+0000 7f93a92e1700 1 -- 172.21.15.19:0/345982324 wait complete. 2023-10-03T10:19:44.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:44.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:44.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:44.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:44.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.866+0000 7fb9fbd91700 1 Processor -- start 2023-10-03T10:19:44.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.866+0000 7fb9fbd91700 1 -- start start 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fbd91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4133540 0x7fb9f4135920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fbd91700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9f4135e60 0x7fb9f4138240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fbd91700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f40716a0 con 0x7fb9f4130540 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fbd91700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f4071290 con 0x7fb9f4135e60 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fbd91700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4130340 con 0x7fb9f4133540 2023-10-03T10:19:44.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fa32e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb9f4135e60 0x7fb9f4138240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9f932c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4133540 0x7fb9f4135920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9f9b2d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb9f4130540 0x7fb9f4130910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33604/0 (socket says 172.21.15.19:33604) 2023-10-03T10:19:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9f9b2d700 1 -- 172.21.15.19:0/2477911775 learned_addr learned my addr 172.21.15.19:0/2477911775 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:44.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.867+0000 7fb9fa32e700 1 --2- 172.21.15.19:0/2477911775 >> v2:172.21.15.19:3300/0 conn(0x7fb9f4135e60 0x7fb9f4138240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54312/0 (socket says 172.21.15.19:54312) 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9fa32e700 1 -- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4133540 msgr2=0x7fb9f4135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9fa32e700 1 --2- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4133540 0x7fb9f4135920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9fa32e700 1 -- 172.21.15.19:0/2477911775 >> v1:172.21.15.19:6789/0 conn(0x7fb9f4130540 legacy=0x7fb9f4130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9fa32e700 1 -- 172.21.15.19:0/2477911775 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4070b80 con 0x7fb9f4135e60 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9fa32e700 1 --2- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4135e60 0x7fb9f4138240 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009d90 tx=0x7fb9ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50413b9f145ef1e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9f8b2b700 1 -- 172.21.15.19:0/2477911775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec00bd20 con 0x7fb9f4135e60 2023-10-03T10:19:44.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9f8b2b700 1 -- 172.21.15.19:0/2477911775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec00be80 con 0x7fb9f4135e60 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.868+0000 7fb9f8b2b700 1 -- 172.21.15.19:0/2477911775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0116a0 con 0x7fb9f4135e60 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 -- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4135e60 msgr2=0x7fb9f4138240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4135e60 0x7fb9f4138240 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec009d90 tx=0x7fb9ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 -- 172.21.15.19:0/2477911775 shutdown_connections 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4135e60 0x7fb9f4138240 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/2477911775 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4133540 0x7fb9f4135920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 -- 172.21.15.19:0/2477911775 >> 172.21.15.19:0/2477911775 conn(0x7fb9f40a2aa0 msgr2=0x7fb9f40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 -- 172.21.15.19:0/2477911775 shutdown_connections 2023-10-03T10:19:44.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.869+0000 7fb9fbd91700 1 -- 172.21.15.19:0/2477911775 wait complete. 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.870+0000 7fb9fbd91700 1 Processor -- start 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.870+0000 7fb9fbd91700 1 -- start start 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 0x7fb9f409cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4135e60 0x7fb9f409d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f409e330 con 0x7fb9f4130540 2023-10-03T10:19:44.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f411a840 con 0x7fb9f4133540 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fbd91700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f4119bf0 con 0x7fb9f4135e60 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f932c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 0x7fb9f409cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54318/0 (socket says 172.21.15.19:54318) 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 -- 172.21.15.19:0/3882828981 learned_addr learned my addr 172.21.15.19:0/3882828981 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9fa32e700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4135e60 0x7fb9f409d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 -- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4135e60 msgr2=0x7fb9f409d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4135e60 0x7fb9f409d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 -- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 msgr2=0x7fb9f409cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 0x7fb9f409cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f9b2d700 1 -- 172.21.15.19:0/3882828981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009a70 con 0x7fb9f4130540 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.871+0000 7fb9f932c700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 0x7fb9f409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9f9b2d700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c520 tx=0x7fb9f000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0005d70 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f00070d0 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0007440 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f40a2330 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.872+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f411a560 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.873+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb9f00075a0 con 0x7fb9f4130540 2023-10-03T10:19:44.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.873+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f4074ea0 con 0x7fb9f4130540 2023-10-03T10:19:44.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.873+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb9f003ea60 con 0x7fb9f4130540 2023-10-03T10:19:44.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.882+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb9f0019b40 con 0x7fb9f4130540 2023-10-03T10:19:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.930+0000 7fe97539b700 1 Processor -- start 2023-10-03T10:19:44.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.930+0000 7fe97539b700 1 -- start start 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe97539b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe970133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe97539b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe97539b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97006bc00 con 0x7fe97012ff20 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe97539b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97006c570 con 0x7fe970133a80 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe97539b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700a0040 con 0x7fe970130a40 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96effd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe970133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47066/0 (socket says 172.21.15.19:47066) 2023-10-03T10:19:44.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96e7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe97012ff20 0x7fe970130330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33606/0 (socket says 172.21.15.19:33606) 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96f7fe700 1 -- 172.21.15.19:0/395533454 learned_addr learned my addr 172.21.15.19:0/395533454 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96effd700 1 -- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 msgr2=0x7fe97013b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96effd700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96effd700 1 -- 172.21.15.19:0/395533454 >> v1:172.21.15.19:6789/0 conn(0x7fe97012ff20 legacy=0x7fe970130330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96effd700 1 -- 172.21.15.19:0/395533454 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970133860 con 0x7fe970133a80 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.931+0000 7fe96f7fe700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe96effd700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe970133e50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe960009870 tx=0x7fe960009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c8eedf6a537c2e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe96dffb700 1 -- 172.21.15.19:0/395533454 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011830 con 0x7fe970133a80 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe96dffb700 1 -- 172.21.15.19:0/395533454 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960011990 con 0x7fe970133a80 2023-10-03T10:19:44.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe96dffb700 1 -- 172.21.15.19:0/395533454 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960011d20 con 0x7fe970133a80 2023-10-03T10:19:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe97539b700 1 -- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 msgr2=0x7fe970133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.932+0000 7fe97539b700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe970133e50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe960009870 tx=0x7fe960009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 -- 172.21.15.19:0/395533454 shutdown_connections 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97013b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 --2- 172.21.15.19:0/395533454 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe970133e50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 -- 172.21.15.19:0/395533454 >> 172.21.15.19:0/395533454 conn(0x7fe9700a4210 msgr2=0x7fe9700a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 -- 172.21.15.19:0/395533454 shutdown_connections 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.933+0000 7fe97539b700 1 -- 172.21.15.19:0/395533454 wait complete. 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.934+0000 7fe97539b700 1 Processor -- start 2023-10-03T10:19:44.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.934+0000 7fe97539b700 1 -- start start 2023-10-03T10:19:44.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 0x7fe97009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97009d830 con 0x7fe97012ff20 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700a21c0 con 0x7fe970133a80 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe97539b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe97011fda0 con 0x7fe970130a40 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe96effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 0x7fe97009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe96f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:48974/0 (socket says 172.21.15.19:48974) 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe96f7fe700 1 -- 172.21.15.19:0/4139998714 learned_addr learned my addr 172.21.15.19:0/4139998714 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.935+0000 7fe96e7fc700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 -- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 msgr2=0x7fe97009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 -- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 msgr2=0x7fe97009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 0x7fe97009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 -- 172.21.15.19:0/4139998714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe968009b30 con 0x7fe970133a80 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96effd700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 0x7fe97009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe96f7fe700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe96800efc0 tx=0x7fe96800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968018070 con 0x7fe970133a80 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800f040 con 0x7fe970133a80 2023-10-03T10:19:44.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9600094a0 con 0x7fe970133a80 2023-10-03T10:19:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968003c20 con 0x7fe970133a80 2023-10-03T10:19:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.936+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701203b0 con 0x7fe970133a80 2023-10-03T10:19:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.937+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe96800c880 con 0x7fe970133a80 2023-10-03T10:19:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.937+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe96803f7f0 con 0x7fe970133a80 2023-10-03T10:19:44.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.937+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97011ffc0 con 0x7fe970133a80 2023-10-03T10:19:44.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.942+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe968014480 con 0x7fe970133a80 2023-10-03T10:19:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.974+0000 7f1412806700 1 Processor -- start 2023-10-03T10:19:44.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.974+0000 7f1412806700 1 -- start start 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f140c0a0a30 0x7f140c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c0a1340 0x7f140c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 0x7f140c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c09edd0 con 0x7f140c0a0a30 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c09e1f0 con 0x7f140c133fa0 2023-10-03T10:19:44.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1412806700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f140c09dc50 con 0x7f140c0a1340 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f140bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f140c0a0a30 0x7f140c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f140bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f140c0a0a30 0x7f140c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54344/0 (socket says 172.21.15.19:54344) 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f140bfff700 1 -- 172.21.15.19:0/29442959 learned_addr learned my addr 172.21.15.19:0/29442959 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f1410da3700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 0x7f140c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.975+0000 7f140b7fe700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c0a1340 0x7f140c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 -- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c0a1340 msgr2=0x7f140c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c0a1340 0x7f140c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 -- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 msgr2=0x7f140c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 0x7f140c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 -- 172.21.15.19:0/29442959 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c0a1fe0 con 0x7f140c0a0a30 2023-10-03T10:19:44.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f1410da3700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 0x7f140c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140bfff700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c0a0e00 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0098f0 tx=0x7f13fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d40d1419fd3afed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140affd700 1 -- 172.21.15.19:0/29442959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011830 con 0x7f140c0a0a30 2023-10-03T10:19:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140affd700 1 -- 172.21.15.19:0/29442959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc011990 con 0x7f140c0a0a30 2023-10-03T10:19:44.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.976+0000 7f140affd700 1 -- 172.21.15.19:0/29442959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc011d20 con 0x7f140c0a0a30 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 -- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 msgr2=0x7f140c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c0a0e00 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f13fc0098f0 tx=0x7f13fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 -- 172.21.15.19:0/29442959 shutdown_connections 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c133fa0 0x7f140c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c0a0e00 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 --2- 172.21.15.19:0/29442959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c0a1340 0x7f140c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 -- 172.21.15.19:0/29442959 >> 172.21.15.19:0/29442959 conn(0x7f140c0a6550 msgr2=0x7f140c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 -- 172.21.15.19:0/29442959 shutdown_connections 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.977+0000 7f1412806700 1 -- 172.21.15.19:0/29442959 wait complete. 2023-10-03T10:19:44.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 Processor -- start 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 -- start start 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 0x7f140c121810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c133fa0 0x7f140c121d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c1326a0 con 0x7f140c0a0a30 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c123d70 con 0x7f140c0a1340 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.978+0000 7f1412806700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f140c124850 con 0x7f140c133fa0 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 0x7f140c121810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:44.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54358/0 (socket says 172.21.15.19:54358) 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 -- 172.21.15.19:0/1644896955 learned_addr learned my addr 172.21.15.19:0/1644896955 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 -- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c133fa0 msgr2=0x7f140c121d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c133fa0 0x7f140c121d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 -- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 msgr2=0x7f140c121810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 0x7f140c121810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 -- 172.21.15.19:0/1644896955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009a70 con 0x7f140c0a0a30 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140b7fe700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 0x7f140c121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f140bfff700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f13fc011db0 tx=0x7f13fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc004240 con 0x7f140c0a0a30 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc01f070 con 0x7f140c0a0a30 2023-10-03T10:19:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc009550 con 0x7f140c0a0a30 2023-10-03T10:19:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc0045a0 con 0x7f140c0a0a30 2023-10-03T10:19:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.979+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c124b70 con 0x7f140c0a0a30 2023-10-03T10:19:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.980+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f13fc021030 con 0x7f140c0a0a30 2023-10-03T10:19:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.980+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c0a0280 con 0x7f140c0a0a30 2023-10-03T10:19:44.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.981+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f13fc0408d0 con 0x7f140c0a0a30 2023-10-03T10:19:44.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:44.990+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f13fc0036a0 con 0x7f140c0a0a30 2023-10-03T10:19:45.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:45.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.098+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb9f406b9e0 con 0x7fb9f4130540 2023-10-03T10:19:45.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.098+0000 7fb9ea7fc700 1 -- 172.21.15.19:0/3882828981 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb9f0017070 con 0x7fb9f4130540 2023-10-03T10:19:45.098 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.101+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 msgr2=0x7fb9f409c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.101+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fb9f000c520 tx=0x7fb9f000c830 comp rx=0 tx=0).stop 2023-10-03T10:19:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 shutdown_connections 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb9f4135e60 0x7fb9f409d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb9f4130540 0x7fb9f409c720 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 --2- 172.21.15.19:0/3882828981 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb9f4133540 0x7fb9f409cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 >> 172.21.15.19:0/3882828981 conn(0x7fb9f40a2aa0 msgr2=0x7fb9f406e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 shutdown_connections 2023-10-03T10:19:45.102 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.102+0000 7fb9fbd91700 1 -- 172.21.15.19:0/3882828981 wait complete. 2023-10-03T10:19:45.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:45.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.156+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe970074ea0 con 0x7fe970133a80 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.156+0000 7fe9577fe700 1 -- 172.21.15.19:0/4139998714 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe96801cbb0 con 0x7fe970133a80 2023-10-03T10:19:45.156 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 msgr2=0x7fe97009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe96800efc0 tx=0x7fe96800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 shutdown_connections 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe970133a80 0x7fe97009cf00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe97012ff20 0x7fe97009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 --2- 172.21.15.19:0/4139998714 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe970130a40 0x7fe97009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 >> 172.21.15.19:0/4139998714 conn(0x7fe9700a4210 msgr2=0x7fe97009e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 shutdown_connections 2023-10-03T10:19:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.159+0000 7fe97539b700 1 -- 172.21.15.19:0/4139998714 wait complete. 2023-10-03T10:19:45.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:45.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.200+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f140c124990 con 0x7f140c0a0a30 2023-10-03T10:19:45.200 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.200+0000 7f1408ff9700 1 -- 172.21.15.19:0/1644896955 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13fc015070 con 0x7f140c0a0a30 2023-10-03T10:19:45.200 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:45.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 msgr2=0x7f140c1212d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f13fc011db0 tx=0x7f13fc004750 comp rx=0 tx=0).stop 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 shutdown_connections 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f140c133fa0 0x7f140c121d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f140c0a0a30 0x7f140c1212d0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 --2- 172.21.15.19:0/1644896955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f140c0a1340 0x7f140c121810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 >> 172.21.15.19:0/1644896955 conn(0x7f140c0a6550 msgr2=0x7f140c0a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 shutdown_connections 2023-10-03T10:19:45.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.203+0000 7f1412806700 1 -- 172.21.15.19:0/1644896955 wait complete. 2023-10-03T10:19:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.211+0000 7f5a5f222700 1 Processor -- start 2023-10-03T10:19:45.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 -- start start 2023-10-03T10:19:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5806b990 con 0x7f5a58133420 2023-10-03T10:19:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809b0e0 con 0x7f5a58138dc0 2023-10-03T10:19:45.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5f222700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58133c20 con 0x7f5a581337f0 2023-10-03T10:19:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a57fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a5d7bf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a57fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47094/0 (socket says 172.21.15.19:47094) 2023-10-03T10:19:45.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.212+0000 7f5a57fff700 1 -- 172.21.15.19:0/3942283744 learned_addr learned my addr 172.21.15.19:0/3942283744 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a57fff700 1 -- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 msgr2=0x7f5a5813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a57fff700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a57fff700 1 -- 172.21.15.19:0/3942283744 >> v1:172.21.15.19:6789/0 conn(0x7f5a58133420 legacy=0x7f5a58133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a577fe700 1 -- 172.21.15.19:0/3942283744 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609231570 0 0) 0x7f5a5806b990 con 0x7f5a58133420 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a57fff700 1 -- 172.21.15.19:0/3942283744 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580a0590 con 0x7f5a581337f0 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a5d7bf700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a57fff700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009920 tx=0x7f5a44009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9538d6c138894a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a577fe700 1 -- 172.21.15.19:0/3942283744 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44011830 con 0x7f5a581337f0 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a577fe700 1 -- 172.21.15.19:0/3942283744 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44011990 con 0x7f5a581337f0 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.213+0000 7f5a577fe700 1 -- 172.21.15.19:0/3942283744 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44011d20 con 0x7f5a581337f0 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 -- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 msgr2=0x7f5a58138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5a44009920 tx=0x7f5a44009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 -- 172.21.15.19:0/3942283744 shutdown_connections 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a58138dc0 0x7f5a5813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 --2- 172.21.15.19:0/3942283744 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a581337f0 0x7f5a58138880 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 -- 172.21.15.19:0/3942283744 >> 172.21.15.19:0/3942283744 conn(0x7f5a580a4210 msgr2=0x7f5a580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 -- 172.21.15.19:0/3942283744 shutdown_connections 2023-10-03T10:19:45.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.214+0000 7f5a5f222700 1 -- 172.21.15.19:0/3942283744 wait complete. 2023-10-03T10:19:45.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 Processor -- start 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 -- start start 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a58133420 0x7f5a58070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a581337f0 0x7f5a580710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809c7a0 con 0x7f5a58133420 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5809ca90 con 0x7f5a581337f0 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.216+0000 7f5a5f222700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5a581388a0 con 0x7f5a58138dc0 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47096/0 (socket says 172.21.15.19:47096) 2023-10-03T10:19:45.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 -- 172.21.15.19:0/601563083 learned_addr learned my addr 172.21.15.19:0/601563083 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5cfbe700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a58133420 0x7f5a58070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a57fff700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a581337f0 0x7f5a580710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 -- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a581337f0 msgr2=0x7f5a580710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a581337f0 0x7f5a580710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 -- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a58133420 msgr2=0x7f5a58070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a58133420 0x7f5a58070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 -- 172.21.15.19:0/601563083 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50009a70 con 0x7f5a58138dc0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5d7bf700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efb0 tx=0x7f5a5000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000cc90 con 0x7f5a58138dc0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x7f5a58138dc0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a44009550 con 0x7f5a58138dc0 2023-10-03T10:19:45.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50014480 con 0x7f5a58138dc0 2023-10-03T10:19:45.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:45.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.217+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5809dc70 con 0x7f5a58138dc0 2023-10-03T10:19:45.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.218+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5a500145e0 con 0x7f5a58138dc0 2023-10-03T10:19:45.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.218+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a58132e70 con 0x7f5a58138dc0 2023-10-03T10:19:45.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.219+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5a50040380 con 0x7f5a58138dc0 2023-10-03T10:19:45.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.223+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5a500076f0 con 0x7f5a58138dc0 2023-10-03T10:19:45.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.426+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a5809cc50 con 0x7f5a58138dc0 2023-10-03T10:19:45.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.426+0000 7f5a557fa700 1 -- 172.21.15.19:0/601563083 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5a50018020 con 0x7f5a58138dc0 2023-10-03T10:19:45.427 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 msgr2=0x7f5a58071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f5a5000efb0 tx=0x7f5a5000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 shutdown_connections 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5a58138dc0 0x7f5a58071620 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a58133420 0x7f5a58070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 --2- 172.21.15.19:0/601563083 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5a581337f0 0x7f5a580710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:45.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 >> 172.21.15.19:0/601563083 conn(0x7f5a580a4210 msgr2=0x7f5a58131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 shutdown_connections 2023-10-03T10:19:45.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:45.429+0000 7f5a5f222700 1 -- 172.21.15.19:0/601563083 wait complete. 2023-10-03T10:19:45.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:46.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:46.174 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:46.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:46.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.267+0000 7fe8b12b7700 1 Processor -- start 2023-10-03T10:19:46.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 -- start start 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 0x7fe8ac139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ac09b4f0 con 0x7fe8ac131810 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1313c0 con 0x7fe8ac136f50 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8b12b7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac06e8c0 con 0x7fe8ac134630 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8aaffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe8ac131810 0x7fe8ac131be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:33620/0 (socket says 172.21.15.19:33620) 2023-10-03T10:19:46.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8aaffd700 1 -- 172.21.15.19:0/308883962 learned_addr learned my addr 172.21.15.19:0/308883962 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8aa7fc700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.268+0000 7fe8ab7fe700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 0x7fe8ac139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8aa7fc700 1 -- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 msgr2=0x7fe8ac139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8aa7fc700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 0x7fe8ac139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8aa7fc700 1 -- 172.21.15.19:0/308883962 >> v1:172.21.15.19:6789/0 conn(0x7fe8ac131810 legacy=0x7fe8ac131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8a9ffb700 1 -- 172.21.15.19:0/308883962 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453938391 0 0) 0x7fe8ac09b4f0 con 0x7fe8ac131810 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8aa7fc700 1 -- 172.21.15.19:0/308883962 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ac071d20 con 0x7fe8ac134630 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8ab7fe700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 0x7fe8ac139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8aa7fc700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac136a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009870 tx=0x7fe8a0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9740b69fd665ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8a9ffb700 1 -- 172.21.15.19:0/308883962 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0011830 con 0x7fe8ac134630 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8a9ffb700 1 -- 172.21.15.19:0/308883962 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a0011990 con 0x7fe8ac134630 2023-10-03T10:19:46.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.269+0000 7fe8a9ffb700 1 -- 172.21.15.19:0/308883962 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0011d20 con 0x7fe8ac134630 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 -- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 msgr2=0x7fe8ac136a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac136a10 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe8a0009870 tx=0x7fe8a0009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 -- 172.21.15.19:0/308883962 shutdown_connections 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac136f50 0x7fe8ac139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/308883962 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac136a10 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 -- 172.21.15.19:0/308883962 >> 172.21.15.19:0/308883962 conn(0x7fe8ac0a2aa0 msgr2=0x7fe8ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 -- 172.21.15.19:0/308883962 shutdown_connections 2023-10-03T10:19:46.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.270+0000 7fe8b12b7700 1 -- 172.21.15.19:0/308883962 wait complete. 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.271+0000 7fe8b12b7700 1 Processor -- start 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.271+0000 7fe8b12b7700 1 -- start start 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac1c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1bc030 con 0x7fe8ac136f50 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac11cbc0 con 0x7fe8ac131810 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8b12b7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac1c7010 con 0x7fe8ac134630 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8aaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54364/0 (socket says 172.21.15.19:54364) 2023-10-03T10:19:46.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8aaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49012/0 (socket says 172.21.15.19:49012) 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 -- 172.21.15.19:0/3876249250 learned_addr learned my addr 172.21.15.19:0/3876249250 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8aa7fc700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac1c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 -- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 msgr2=0x7fe8ac1c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac1c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 -- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 msgr2=0x7fe8ac1c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8ab7fe700 1 -- 172.21.15.19:0/3876249250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a4009a70 con 0x7fe8ac136f50 2023-10-03T10:19:46.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.272+0000 7fe8aaffd700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8ab7fe700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400df80 tx=0x7fe8a400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4003a20 con 0x7fe8ac136f50 2023-10-03T10:19:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a400f040 con 0x7fe8ac136f50 2023-10-03T10:19:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a00094a0 con 0x7fe8ac136f50 2023-10-03T10:19:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4003de0 con 0x7fe8ac136f50 2023-10-03T10:19:46.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.273+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac11aac0 con 0x7fe8ac136f50 2023-10-03T10:19:46.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.274+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8a400ba20 con 0x7fe8ac136f50 2023-10-03T10:19:46.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.274+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8a403fbf0 con 0x7fe8ac136f50 2023-10-03T10:19:46.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.274+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac11c340 con 0x7fe8ac136f50 2023-10-03T10:19:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.279+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8a401a360 con 0x7fe8ac136f50 2023-10-03T10:19:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.326+0000 7fed01456700 1 Processor -- start 2023-10-03T10:19:46.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.326+0000 7fed01456700 1 -- start start 2023-10-03T10:19:46.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 0x7fecfc134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecfc09edd0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc09e1f0 con 0x7fecfc0a1340 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.327+0000 7fed01456700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc09dc50 con 0x7fecfc133fa0 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfaffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54380/0 (socket says 172.21.15.19:54380) 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49014/0 (socket says 172.21.15.19:49014) 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfaffd700 1 -- 172.21.15.19:0/3920290080 learned_addr learned my addr 172.21.15.19:0/3920290080 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfb7fe700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 0x7fecfc134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 -- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 msgr2=0x7fecfc134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 0x7fecfc134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 -- 172.21.15.19:0/3920290080 >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 msgr2=0x7fecfc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 --2- 172.21.15.19:0/3920290080 >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 -- 172.21.15.19:0/3920290080 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0a1fe0 con 0x7fecfc0a1340 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfaffd700 1 --2- 172.21.15.19:0/3920290080 >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfb7fe700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 0x7fecfc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecfa7fc700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009870 tx=0x7fecf0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc944aa00510d496 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecf9ffb700 1 -- 172.21.15.19:0/3920290080 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011830 con 0x7fecfc0a1340 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecf9ffb700 1 -- 172.21.15.19:0/3920290080 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf0011990 con 0x7fecfc0a1340 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.328+0000 7fecf9ffb700 1 -- 172.21.15.19:0/3920290080 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0011d20 con 0x7fecfc0a1340 2023-10-03T10:19:46.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 -- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 msgr2=0x7fecfc133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fecf0009870 tx=0x7fecf0009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 -- 172.21.15.19:0/3920290080 shutdown_connections 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc133fa0 0x7fecfc134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 --2- 172.21.15.19:0/3920290080 >> v2:172.21.15.19:3300/0 conn(0x7fecfc0a0a30 0x7fecfc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 --2- 172.21.15.19:0/3920290080 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a1340 0x7fecfc133a60 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 -- 172.21.15.19:0/3920290080 >> 172.21.15.19:0/3920290080 conn(0x7fecfc0a6550 msgr2=0x7fecfc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 -- 172.21.15.19:0/3920290080 shutdown_connections 2023-10-03T10:19:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.329+0000 7fed01456700 1 -- 172.21.15.19:0/3920290080 wait complete. 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 Processor -- start 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 -- start start 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc0a1340 0x7fecfc120630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 0x7fecfc120b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc124580 con 0x7fecfc133fa0 2023-10-03T10:19:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc1238e0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fed01456700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0a3630 con 0x7fecfc0a1340 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fecfaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fecfaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:49016/0 (socket says 172.21.15.19:49016) 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fecfaffd700 1 -- 172.21.15.19:0/4094623039 learned_addr learned my addr 172.21.15.19:0/4094623039 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fecfb7fe700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 0x7fecfc120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.331+0000 7fecfa7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc0a1340 0x7fecfc120630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 -- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc0a1340 msgr2=0x7fecfc120630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc0a1340 0x7fecfc120630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 -- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 msgr2=0x7fecfc120b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 0x7fecfc120b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 -- 172.21.15.19:0/4094623039 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec009550 con 0x7fecfc0a0a30 2023-10-03T10:19:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfb7fe700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 0x7fecfc120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fecfaffd700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fecec00ec10 tx=0x7fecec00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00c850 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec00c9b0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf4009a70 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec00cd20 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.332+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf00094a0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.333+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fecec013470 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.333+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fecec03f8b0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.333+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc074ea0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.342+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fecec013720 con 0x7fecfc0a0a30 2023-10-03T10:19:46.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.367+0000 7f472417c700 1 Processor -- start 2023-10-03T10:19:46.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.367+0000 7f472417c700 1 -- start start 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f472417c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f472417c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c0a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f472417c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471c0a2a70 con 0x7f471c133930 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f472417c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c0a01d0 con 0x7f471c0a0a30 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f472417c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f471c09e2b0 con 0x7f471c09d630 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721f18700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4722719700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f471c133930 0x7f471c133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48566/0 (socket says 172.21.15.19:48566) 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4722719700 1 -- 172.21.15.19:0/1594732068 learned_addr learned my addr 172.21.15.19:0/1594732068 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:46.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721717700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c0a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4720f16700 1 -- 172.21.15.19:0/1594732068 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808514862 0 0) 0x7f471c0a2a70 con 0x7f471c133930 2023-10-03T10:19:46.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4720f16700 1 -- 172.21.15.19:0/1594732068 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47040035b0 con 0x7f471c133930 2023-10-03T10:19:46.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721717700 1 -- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 msgr2=0x7f471c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721717700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721717700 1 -- 172.21.15.19:0/1594732068 >> v1:172.21.15.19:6789/0 conn(0x7f471c133930 legacy=0x7f471c133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721717700 1 -- 172.21.15.19:0/1594732068 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c09dc50 con 0x7f471c09d630 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.368+0000 7f4721f18700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f4721717700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c0a1340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4710009870 tx=0x7f4710009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10ad05515be69f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f4720f16700 1 -- 172.21.15.19:0/1594732068 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710004230 con 0x7f471c09d630 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f4720f16700 1 -- 172.21.15.19:0/1594732068 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4710004390 con 0x7f471c09d630 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f4720f16700 1 -- 172.21.15.19:0/1594732068 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47100036a0 con 0x7f471c09d630 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 -- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 msgr2=0x7f471c0a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c0a1340 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4710009870 tx=0x7f4710009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 -- 172.21.15.19:0/1594732068 shutdown_connections 2023-10-03T10:19:46.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 --2- 172.21.15.19:0/1594732068 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c0a1340 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.369+0000 7f472417c700 1 -- 172.21.15.19:0/1594732068 >> 172.21.15.19:0/1594732068 conn(0x7f471c0a3050 msgr2=0x7f471c0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.370+0000 7f472417c700 1 -- 172.21.15.19:0/1594732068 shutdown_connections 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.370+0000 7f472417c700 1 -- 172.21.15.19:0/1594732068 wait complete. 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 Processor -- start 2023-10-03T10:19:46.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 -- start start 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f471c133930 0x7f471c1c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471c121750 con 0x7f471c133930 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471c1336e0 con 0x7f471c0a0a30 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f472417c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f471c122140 con 0x7f471c09d630 2023-10-03T10:19:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f4721717700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f4721717700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38858/0 (socket says 172.21.15.19:38858) 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f4721717700 1 -- 172.21.15.19:0/3269027833 learned_addr learned my addr 172.21.15.19:0/3269027833 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f4722719700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f471c133930 0x7f471c1c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.371+0000 7f4721f18700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 -- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 msgr2=0x7f471c1c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c1c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 -- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f471c133930 msgr2=0x7f471c1c8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f471c133930 0x7f471c1c8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 -- 172.21.15.19:0/3269027833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c009a70 con 0x7f471c0a0a30 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f4721717700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f4710004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710003c30 con 0x7f471c0a0a30 2023-10-03T10:19:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471001e070 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47100094a0 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4710011630 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.372+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471c122e70 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.373+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f47100117b0 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.373+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4710040560 con 0x7f471c0a0a30 2023-10-03T10:19:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.373+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f471c0008d0 con 0x7f471c0a0a30 2023-10-03T10:19:46.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.378+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4710010970 con 0x7f471c0a0a30 2023-10-03T10:19:46.443 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:46.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.519+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8ac0721a0 con 0x7fe8ac136f50 2023-10-03T10:19:46.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.519+0000 7fe8937fe700 1 -- 172.21.15.19:0/3876249250 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8a402b090 con 0x7fe8ac136f50 2023-10-03T10:19:46.519 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 msgr2=0x7fe8ac118f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fe8a400df80 tx=0x7fe8a400b390 comp rx=0 tx=0).stop 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 shutdown_connections 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8ac136f50 0x7fe8ac118f30 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8ac131810 0x7fe8ac1c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 --2- 172.21.15.19:0/3876249250 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8ac134630 0x7fe8ac1c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 >> 172.21.15.19:0/3876249250 conn(0x7fe8ac0a2aa0 msgr2=0x7fe8ac133d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 shutdown_connections 2023-10-03T10:19:46.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.523+0000 7fe8b12b7700 1 -- 172.21.15.19:0/3876249250 wait complete. 2023-10-03T10:19:46.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:46.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.577+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fecfc0a28e0 con 0x7fecfc0a0a30 2023-10-03T10:19:46.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.577+0000 7fece37fe700 1 -- 172.21.15.19:0/4094623039 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fecec01ae80 con 0x7fecfc0a0a30 2023-10-03T10:19:46.577 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 msgr2=0x7fecfc1200f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fecec00ec10 tx=0x7fecec00ef20 comp rx=0 tx=0).stop 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 shutdown_connections 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecfc133fa0 0x7fecfc120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fecfc0a0a30 0x7fecfc1200f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 --2- 172.21.15.19:0/4094623039 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fecfc0a1340 0x7fecfc120630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 >> 172.21.15.19:0/4094623039 conn(0x7fecfc0a6550 msgr2=0x7fecfc1bb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 shutdown_connections 2023-10-03T10:19:46.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.580+0000 7fed01456700 1 -- 172.21.15.19:0/4094623039 wait complete. 2023-10-03T10:19:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.588+0000 7f90a373f700 1 Processor -- start 2023-10-03T10:19:46.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.588+0000 7f90a373f700 1 -- start start 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a373f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06a770 0x7f909c06ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a373f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f909c06b080 0x7f909c131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a373f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909c09ece0 con 0x7f909c131b40 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a373f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909c09e760 con 0x7f909c06b080 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a373f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c09e040 con 0x7f909c06a770 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a0cda700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f909c06b080 0x7f909c131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a1cdc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f909c131b40 0x7f909c138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48576/0 (socket says 172.21.15.19:48576) 2023-10-03T10:19:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a1cdc700 1 -- 172.21.15.19:0/2206514108 learned_addr learned my addr 172.21.15.19:0/2206514108 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a14db700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06a770 0x7f909c06ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a0cda700 1 -- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06a770 msgr2=0x7f909c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a0cda700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06a770 0x7f909c06ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a0cda700 1 -- 172.21.15.19:0/2206514108 >> v1:172.21.15.19:6789/0 conn(0x7f909c131b40 legacy=0x7f909c138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f90a0cda700 1 -- 172.21.15.19:0/2206514108 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c09f630 con 0x7f909c06b080 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.589+0000 7f9093fff700 1 -- 172.21.15.19:0/2206514108 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317978210 0 0) 0x7f909c09ece0 con 0x7f909c131b40 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.590+0000 7f90a0cda700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06b080 0x7f909c131600 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f908c009840 tx=0x7f908c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73ed7c580982eed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.590+0000 7f9093fff700 1 -- 172.21.15.19:0/2206514108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c011830 con 0x7f909c06b080 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.590+0000 7f9093fff700 1 -- 172.21.15.19:0/2206514108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c011990 con 0x7f909c06b080 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.590+0000 7f9093fff700 1 -- 172.21.15.19:0/2206514108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c011d20 con 0x7f909c06b080 2023-10-03T10:19:46.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 -- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06b080 msgr2=0x7f909c131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06b080 0x7f909c131600 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f908c009840 tx=0x7f908c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 -- 172.21.15.19:0/2206514108 shutdown_connections 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06a770 0x7f909c06ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 --2- 172.21.15.19:0/2206514108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06b080 0x7f909c131600 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 -- 172.21.15.19:0/2206514108 >> 172.21.15.19:0/2206514108 conn(0x7f909c066f50 msgr2=0x7f909c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 -- 172.21.15.19:0/2206514108 shutdown_connections 2023-10-03T10:19:46.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.591+0000 7f90a373f700 1 -- 172.21.15.19:0/2206514108 wait complete. 2023-10-03T10:19:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.592+0000 7f90a373f700 1 Processor -- start 2023-10-03T10:19:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.592+0000 7f90a373f700 1 -- start start 2023-10-03T10:19:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 0x7f909c1204d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909c131b40 0x7f909c120f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909c124bd0 con 0x7f909c06a770 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909c06ecb0 con 0x7f909c06b080 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a373f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f909c071e60 con 0x7f909c131b40 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a0cda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a14db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 0x7f909c1204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a0cda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38872/0 (socket says 172.21.15.19:38872) 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a14db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 0x7f909c1204d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38104/0 (socket says 172.21.15.19:38104) 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a0cda700 1 -- 172.21.15.19:0/2607021717 learned_addr learned my addr 172.21.15.19:0/2607021717 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:46.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.593+0000 7f90a1cdc700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909c131b40 0x7f909c120f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 -- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909c131b40 msgr2=0x7f909c120f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909c131b40 0x7f909c120f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 -- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 msgr2=0x7f909c1204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 0x7f909c1204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 -- 172.21.15.19:0/2607021717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c0094a0 con 0x7f909c06b080 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a0cda700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f908c0090b0 tx=0x7f908c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c0036a0 con 0x7f909c06b080 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c01f070 con 0x7f909c06b080 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c003a60 con 0x7f909c06b080 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.594+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909c123a50 con 0x7f909c06b080 2023-10-03T10:19:46.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.595+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909c130fd0 con 0x7f909c06b080 2023-10-03T10:19:46.597 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.596+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f908c003bc0 con 0x7f909c06b080 2023-10-03T10:19:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.596+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f909c123f20 con 0x7f909c06b080 2023-10-03T10:19:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.596+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f908c021070 con 0x7f909c06b080 2023-10-03T10:19:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.601+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f908c015080 con 0x7f909c06b080 2023-10-03T10:19:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.603+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f471c072980 con 0x7f471c0a0a30 2023-10-03T10:19:46.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.603+0000 7f471a7fc700 1 -- 172.21.15.19:0/3269027833 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4710010380 con 0x7f471c0a0a30 2023-10-03T10:19:46.603 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:46.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 msgr2=0x7f471c1c85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4710000c00 tx=0x7f4710004750 comp rx=0 tx=0).stop 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 shutdown_connections 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f471c133930 0x7f471c1c8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f471c09d630 0x7f471c1c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 --2- 172.21.15.19:0/3269027833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f471c0a0a30 0x7f471c1c85d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 >> 172.21.15.19:0/3269027833 conn(0x7f471c0a3050 msgr2=0x7f471c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 shutdown_connections 2023-10-03T10:19:46.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.605+0000 7f472417c700 1 -- 172.21.15.19:0/3269027833 wait complete. 2023-10-03T10:19:46.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:46.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.805+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f909c074ea0 con 0x7f909c06b080 2023-10-03T10:19:46.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.805+0000 7f9091ffb700 1 -- 172.21.15.19:0/2607021717 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f908c010380 con 0x7f909c06b080 2023-10-03T10:19:46.806 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.807+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 msgr2=0x7f909c120a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.807+0000 7f90a373f700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f908c0090b0 tx=0x7f908c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 shutdown_connections 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f909c131b40 0x7f909c120f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f909c06a770 0x7f909c1204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 --2- 172.21.15.19:0/2607021717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f909c06b080 0x7f909c120a10 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 >> 172.21.15.19:0/2607021717 conn(0x7f909c066f50 msgr2=0x7f909c070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 shutdown_connections 2023-10-03T10:19:46.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:46.808+0000 7f90a373f700 1 -- 172.21.15.19:0/2607021717 wait complete. 2023-10-03T10:19:46.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:47.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:47.598 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:47.621 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.697+0000 7f001dde5700 1 Processor -- start 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.697+0000 7f001dde5700 1 -- start start 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f001dde5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f001dde5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f001dde5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00180716a0 con 0x7f0018130e50 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f001dde5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001809a390 con 0x7f001806fcf0 2023-10-03T10:19:47.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f001dde5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0018071290 con 0x7f0018130540 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f0017fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f00177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f0017fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38120/0 (socket says 172.21.15.19:38120) 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f00177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58168/0 (socket says 172.21.15.19:58168) 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f0017fff700 1 -- 172.21.15.19:0/3175317357 learned_addr learned my addr 172.21.15.19:0/3175317357 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f0016ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0018130e50 0x7f001806f5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48580/0 (socket says 172.21.15.19:48580) 2023-10-03T10:19:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f00177fe700 1 -- 172.21.15.19:0/3175317357 >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 msgr2=0x7f0018138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.698+0000 7f00177fe700 1 --2- 172.21.15.19:0/3175317357 >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00177fe700 1 -- 172.21.15.19:0/3175317357 >> v1:172.21.15.19:6789/0 conn(0x7f0018130e50 legacy=0x7f001806f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00177fe700 1 -- 172.21.15.19:0/3175317357 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0018130340 con 0x7f0018130540 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f0017fff700 1 --2- 172.21.15.19:0/3175317357 >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00177fe700 1 --2- 172.21.15.19:0/3175317357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0008009870 tx=0x7f0008009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb8059ac6101057a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00167fc700 1 -- 172.21.15.19:0/3175317357 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008011830 con 0x7f0018130540 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00167fc700 1 -- 172.21.15.19:0/3175317357 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008011990 con 0x7f0018130540 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.699+0000 7f00167fc700 1 -- 172.21.15.19:0/3175317357 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008011d20 con 0x7f0018130540 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 -- 172.21.15.19:0/3175317357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 msgr2=0x7f0018130910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 --2- 172.21.15.19:0/3175317357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f0008009870 tx=0x7f0008009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:47.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 -- 172.21.15.19:0/3175317357 shutdown_connections 2023-10-03T10:19:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 --2- 172.21.15.19:0/3175317357 >> v2:172.21.15.19:3300/0 conn(0x7f001806fcf0 0x7f0018138570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 --2- 172.21.15.19:0/3175317357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f0018130910 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 -- 172.21.15.19:0/3175317357 >> 172.21.15.19:0/3175317357 conn(0x7f00180a2aa0 msgr2=0x7f00180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 -- 172.21.15.19:0/3175317357 shutdown_connections 2023-10-03T10:19:47.702 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.700+0000 7f001dde5700 1 -- 172.21.15.19:0/3175317357 wait complete. 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.701+0000 7f001dde5700 1 Processor -- start 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 -- start start 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f00181c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0018130e50 0x7f0018128420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001812b9f0 con 0x7f0018130e50 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00181c6e70 con 0x7f001806fcf0 2023-10-03T10:19:47.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f001dde5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f001812a210 con 0x7f0018130540 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f00177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f00177fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38880/0 (socket says 172.21.15.19:38880) 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f00177fe700 1 -- 172.21.15.19:0/62259492 learned_addr learned my addr 172.21.15.19:0/62259492 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.702+0000 7f0016ffd700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f00181c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f0017fff700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0018130e50 0x7f0018128420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 -- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 msgr2=0x7f00181c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f00181c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 -- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0018130e50 msgr2=0x7f0018128420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0018130e50 0x7f0018128420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 -- 172.21.15.19:0/62259492 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010009b30 con 0x7f001806fcf0 2023-10-03T10:19:47.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f00177fe700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0008000c00 tx=0x7f0008004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008004480 con 0x7f001806fcf0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000801f070 con 0x7f001806fcf0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080038a0 con 0x7f001806fcf0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.703+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00080094a0 con 0x7f001806fcf0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.704+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001812ad30 con 0x7f001806fcf0 2023-10-03T10:19:47.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.705+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0008021030 con 0x7f001806fcf0 2023-10-03T10:19:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.705+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f00080407c0 con 0x7f001806fcf0 2023-10-03T10:19:47.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.705+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0018129e30 con 0x7f001806fcf0 2023-10-03T10:19:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.714+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0008015080 con 0x7f001806fcf0 2023-10-03T10:19:47.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.744+0000 7fad683d2700 1 Processor -- start 2023-10-03T10:19:47.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.744+0000 7fad683d2700 1 -- start start 2023-10-03T10:19:47.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad683d2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 0x7fad60131b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad683d2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6009d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad683d2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6009f0c0 con 0x7fad601320a0 2023-10-03T10:19:47.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad683d2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6009d580 con 0x7fad6009cbc0 2023-10-03T10:19:47.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad683d2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad6009ff00 con 0x7fad60131790 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad6596d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fad601320a0 0x7fad6009c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48592/0 (socket says 172.21.15.19:48592) 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad6596d700 1 -- 172.21.15.19:0/1665651946 learned_addr learned my addr 172.21.15.19:0/1665651946 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad6616e700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 0x7fad60131b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.745+0000 7fad6696f700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6009d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6516c700 1 -- 172.21.15.19:0/1665651946 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551416075 0 0) 0x7fad6009f0c0 con 0x7fad601320a0 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6516c700 1 -- 172.21.15.19:0/1665651946 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad4c0035b0 con 0x7fad601320a0 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6616e700 1 -- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 msgr2=0x7fad6009d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6616e700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6009d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6616e700 1 -- 172.21.15.19:0/1665651946 >> v1:172.21.15.19:6789/0 conn(0x7fad601320a0 legacy=0x7fad6009c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6616e700 1 -- 172.21.15.19:0/1665651946 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600a0530 con 0x7fad60131790 2023-10-03T10:19:47.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6616e700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 0x7fad60131b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009870 tx=0x7fad5c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6e4aac741a34e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6516c700 1 -- 172.21.15.19:0/1665651946 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011830 con 0x7fad60131790 2023-10-03T10:19:47.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6516c700 1 -- 172.21.15.19:0/1665651946 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c011990 con 0x7fad60131790 2023-10-03T10:19:47.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.746+0000 7fad6516c700 1 -- 172.21.15.19:0/1665651946 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c011d20 con 0x7fad60131790 2023-10-03T10:19:47.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 -- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 msgr2=0x7fad60131b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 0x7fad60131b60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009870 tx=0x7fad5c009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 -- 172.21.15.19:0/1665651946 shutdown_connections 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6009d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 --2- 172.21.15.19:0/1665651946 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad60131790 0x7fad60131b60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 -- 172.21.15.19:0/1665651946 >> 172.21.15.19:0/1665651946 conn(0x7fad600a0970 msgr2=0x7fad600a0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 -- 172.21.15.19:0/1665651946 shutdown_connections 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.747+0000 7fad683d2700 1 -- 172.21.15.19:0/1665651946 wait complete. 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.748+0000 7fad683d2700 1 Processor -- start 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.748+0000 7fad683d2700 1 -- start start 2023-10-03T10:19:47.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6011bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 0x7fad6011c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6011f0f0 con 0x7fad60131790 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6011da10 con 0x7fad6009cbc0 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad683d2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad6011ebc0 con 0x7fad601320a0 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad6596d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad6596d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38132/0 (socket says 172.21.15.19:38132) 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad6596d700 1 -- 172.21.15.19:0/1651662117 learned_addr learned my addr 172.21.15.19:0/1651662117 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.749+0000 7fad6696f700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 0x7fad6011c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6616e700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6011bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 -- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 msgr2=0x7fad6011bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6011bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 -- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 msgr2=0x7fad6011c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 -- 172.21.15.19:0/1651662117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c0094a0 con 0x7fad601320a0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6596d700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad6696f700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 0x7fad6011c830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fad580123f0 tx=0x7fad58012700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800d0d0 con 0x7fad601320a0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad58013040 con 0x7fad601320a0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6011f5a0 con 0x7fad601320a0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5800d490 con 0x7fad601320a0 2023-10-03T10:19:47.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.750+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6009d800 con 0x7fad601320a0 2023-10-03T10:19:47.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.751+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6004f2a0 con 0x7fad601320a0 2023-10-03T10:19:47.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.752+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fad5800b740 con 0x7fad601320a0 2023-10-03T10:19:47.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.752+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fad58044c20 con 0x7fad601320a0 2023-10-03T10:19:47.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.757+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fad5800bbd0 con 0x7fad601320a0 2023-10-03T10:19:47.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.789+0000 7f667378b700 1 Processor -- start 2023-10-03T10:19:47.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.789+0000 7f667378b700 1 -- start start 2023-10-03T10:19:47.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c0a1340 0x7f666c133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 0x7f666c134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c09edd0 con 0x7f666c133fa0 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c09e1f0 con 0x7f666c0a0a30 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f667378b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f666c09dc50 con 0x7f666c0a1340 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38910/0 (socket says 172.21.15.19:38910) 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 -- 172.21.15.19:0/568434144 learned_addr learned my addr 172.21.15.19:0/568434144 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6670d26700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c0a1340 0x7f666c133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671d28700 1 --2- 172.21.15.19:0/568434144 >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 0x7f666c134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 -- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c0a1340 msgr2=0x7f666c133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c0a1340 0x7f666c133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 -- 172.21.15.19:0/568434144 >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 msgr2=0x7f666c134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 --2- 172.21.15.19:0/568434144 >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 0x7f666c134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 -- 172.21.15.19:0/568434144 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0a1fe0 con 0x7f666c0a0a30 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671d28700 1 --2- 172.21.15.19:0/568434144 >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 0x7f666c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.790+0000 7f6671527700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f66680098f0 tx=0x7f6668009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2dbfdb7666f5443 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.791+0000 7f6663fff700 1 -- 172.21.15.19:0/568434144 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011830 con 0x7f666c0a0a30 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.791+0000 7f6663fff700 1 -- 172.21.15.19:0/568434144 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668011990 con 0x7f666c0a0a30 2023-10-03T10:19:47.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.791+0000 7f6663fff700 1 -- 172.21.15.19:0/568434144 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668011d20 con 0x7f666c0a0a30 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 -- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 msgr2=0x7f666c0a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f66680098f0 tx=0x7f6668009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 -- 172.21.15.19:0/568434144 shutdown_connections 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c0a0e00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 --2- 172.21.15.19:0/568434144 >> v2:172.21.15.19:3300/0 conn(0x7f666c133fa0 0x7f666c134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 --2- 172.21.15.19:0/568434144 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c0a1340 0x7f666c133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 -- 172.21.15.19:0/568434144 >> 172.21.15.19:0/568434144 conn(0x7f666c0a6550 msgr2=0x7f666c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 -- 172.21.15.19:0/568434144 shutdown_connections 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.792+0000 7f667378b700 1 -- 172.21.15.19:0/568434144 wait complete. 2023-10-03T10:19:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.793+0000 7f667378b700 1 Processor -- start 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.793+0000 7f667378b700 1 -- start start 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 0x7f666c120670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 0x7f666c120bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c121d40 con 0x7f666c0a1340 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c122f90 con 0x7f666c0a0a30 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f667378b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f666c122330 con 0x7f666c133fa0 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38914/0 (socket says 172.21.15.19:38914) 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 -- 172.21.15.19:0/3652673675 learned_addr learned my addr 172.21.15.19:0/3652673675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6670d26700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 0x7f666c120670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671d28700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 0x7f666c120bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 -- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 msgr2=0x7f666c120bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 0x7f666c120bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 -- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 msgr2=0x7f666c120670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 0x7f666c120670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671527700 1 -- 172.21.15.19:0/3652673675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6664009a70 con 0x7f666c0a0a30 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6671d28700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 0x7f666c120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.794+0000 7f6670d26700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 0x7f666c120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f6671527700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c40 tx=0x7f6668004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668004240 con 0x7f666c0a0a30 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f667378b700 1 -- 172.21.15.19:0/3652673675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6668009550 con 0x7f666c0a0a30 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666801f070 con 0x7f666c0a0a30 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680045c0 con 0x7f666c0a0a30 2023-10-03T10:19:47.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.795+0000 7f667378b700 1 -- 172.21.15.19:0/3652673675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c123440 con 0x7f666c0a0a30 2023-10-03T10:19:47.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.796+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6668021030 con 0x7f666c0a0a30 2023-10-03T10:19:47.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.796+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6668040760 con 0x7f666c0a0a30 2023-10-03T10:19:47.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.796+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66440052e0 con 0x7f666c0a0a30 2023-10-03T10:19:47.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.801+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6668015080 con 0x7f666c0a0a30 2023-10-03T10:19:47.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:47.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.959+0000 7fa892642700 1 Processor -- start 2023-10-03T10:19:47.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.959+0000 7fa892642700 1 -- start start 2023-10-03T10:19:47.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa892642700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c1337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa892642700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 0x7fa88c1306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa892642700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88c06b990 con 0x7fa88c133e30 2023-10-03T10:19:47.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa892642700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c0a0590 con 0x7fa88c133420 2023-10-03T10:19:47.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa892642700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c09fb80 con 0x7fa88c134260 2023-10-03T10:19:47.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa88b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa88c133e30 0x7fa88c12ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48598/0 (socket says 172.21.15.19:48598) 2023-10-03T10:19:47.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa88b7fe700 1 -- 172.21.15.19:0/1599171615 learned_addr learned my addr 172.21.15.19:0/1599171615 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.960+0000 7fa890bdf700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 0x7fa88c1306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88bfff700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c1337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88affd700 1 -- 172.21.15.19:0/1599171615 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192237284 0 0) 0x7fa88c06b990 con 0x7fa88c133e30 2023-10-03T10:19:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88affd700 1 -- 172.21.15.19:0/1599171615 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8740035b0 con 0x7fa88c133e30 2023-10-03T10:19:47.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa890bdf700 1 -- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 msgr2=0x7fa88c1337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa890bdf700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c1337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa890bdf700 1 -- 172.21.15.19:0/1599171615 >> v1:172.21.15.19:6789/0 conn(0x7fa88c133e30 legacy=0x7fa88c12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa890bdf700 1 -- 172.21.15.19:0/1599171615 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c0a0030 con 0x7fa88c134260 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa890bdf700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 0x7fa88c1306a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa884009dc0 tx=0x7fa88400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bfb24d83a74e571 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88affd700 1 -- 172.21.15.19:0/1599171615 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400e070 con 0x7fa88c134260 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88affd700 1 -- 172.21.15.19:0/1599171615 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88400bae0 con 0x7fa88c134260 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.961+0000 7fa88affd700 1 -- 172.21.15.19:0/1599171615 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88400be90 con 0x7fa88c134260 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 -- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 msgr2=0x7fa88c1306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 0x7fa88c1306a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa884009dc0 tx=0x7fa88400b330 comp rx=0 tx=0).stop 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 -- 172.21.15.19:0/1599171615 shutdown_connections 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c134260 0x7fa88c1306a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 --2- 172.21.15.19:0/1599171615 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c1337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 -- 172.21.15.19:0/1599171615 >> 172.21.15.19:0/1599171615 conn(0x7fa88c0a4210 msgr2=0x7fa88c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 -- 172.21.15.19:0/1599171615 shutdown_connections 2023-10-03T10:19:47.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.962+0000 7fa892642700 1 -- 172.21.15.19:0/1599171615 wait complete. 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.964+0000 7fa892642700 1 Processor -- start 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.964+0000 7fa892642700 1 -- start start 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.964+0000 7fa892642700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c09c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.964+0000 7fa892642700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 0x7fa88c09c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa892642700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa892642700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c11fdb0 con 0x7fa88c134260 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa892642700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c09db60 con 0x7fa88c133420 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa892642700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c131690 con 0x7fa88c133e30 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa88b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 0x7fa88c09c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.965 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa88bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c09c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38156/0 (socket says 172.21.15.19:38156) 2023-10-03T10:19:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa88b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 0x7fa88c09c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58216/0 (socket says 172.21.15.19:58216) 2023-10-03T10:19:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 -- 172.21.15.19:0/2331239720 learned_addr learned my addr 172.21.15.19:0/2331239720 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:47.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa88bfff700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c09c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38934/0 (socket says 172.21.15.19:38934) 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 -- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 msgr2=0x7fa88c09c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 0x7fa88c09c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 -- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 msgr2=0x7fa88c09c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c09c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 -- 172.21.15.19:0/2331239720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884009a70 con 0x7fa88c134260 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.965+0000 7fa890bdf700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa884004000 tx=0x7fa884004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.966+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884004540 con 0x7fa88c134260 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.966+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840046c0 con 0x7fa88c134260 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.966+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88c11ed10 con 0x7fa88c134260 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.966+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884012430 con 0x7fa88c134260 2023-10-03T10:19:47.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.966+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa88c12db60 con 0x7fa88c134260 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.967+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa884012590 con 0x7fa88c134260 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.967+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa884041a30 con 0x7fa88c134260 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.967+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88c11fbf0 con 0x7fa88c134260 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.969+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad6009b550 con 0x7fad601320a0 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.970+0000 7fad56ffd700 1 -- 172.21.15.19:0/1651662117 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad5802f090 con 0x7fad601320a0 2023-10-03T10:19:47.969 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:47.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 msgr2=0x7fad6011c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 0x7fad6011c830 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fad580123f0 tx=0x7fad58012700 comp rx=0 tx=0).stop 2023-10-03T10:19:47.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 shutdown_connections 2023-10-03T10:19:47.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fad601320a0 0x7fad6011c830 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fad6009cbc0 0x7fad6011bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 --2- 172.21.15.19:0/1651662117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fad60131790 0x7fad6011c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 >> 172.21.15.19:0/1651662117 conn(0x7fad600a0970 msgr2=0x7fad60130d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 shutdown_connections 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fad683d2700 1 -- 172.21.15.19:0/1651662117 wait complete. 2023-10-03T10:19:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.972+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa88402d980 con 0x7fa88c134260 2023-10-03T10:19:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.986+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0018074ea0 con 0x7f001806fcf0 2023-10-03T10:19:47.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.986+0000 7efffffff700 1 -- 172.21.15.19:0/62259492 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0008003a00 con 0x7f001806fcf0 2023-10-03T10:19:47.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:47.987 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:47.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 msgr2=0x7f00181c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:47.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f0008000c00 tx=0x7f0008004750 comp rx=0 tx=0).stop 2023-10-03T10:19:47.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 shutdown_connections 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0018130e50 0x7f0018128420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f001806fcf0 0x7f00181c63f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 --2- 172.21.15.19:0/62259492 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0018130540 0x7f00181c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 >> 172.21.15.19:0/62259492 conn(0x7f00180a2aa0 msgr2=0x7f00181270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 shutdown_connections 2023-10-03T10:19:47.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:47.990+0000 7f001dde5700 1 -- 172.21.15.19:0/62259492 wait complete. 2023-10-03T10:19:48.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:48.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.072+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6644005590 con 0x7f666c0a0a30 2023-10-03T10:19:48.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.072+0000 7f6661ffb700 1 -- 172.21.15.19:0/3652673675 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f66680197f0 con 0x7f666c0a0a30 2023-10-03T10:19:48.072 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 msgr2=0x7f666c120130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6668009c40 tx=0x7f6668004750 comp rx=0 tx=0).stop 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 shutdown_connections 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f666c133fa0 0x7f666c120bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f666c0a0a30 0x7f666c120130 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 --2- 172.21.15.19:0/3652673675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f666c0a1340 0x7f666c120670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 >> 172.21.15.19:0/3652673675 conn(0x7f666c0a6550 msgr2=0x7f666c1bb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 shutdown_connections 2023-10-03T10:19:48.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.074+0000 7f66577fe700 1 -- 172.21.15.19:0/3652673675 wait complete. 2023-10-03T10:19:48.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.181+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa88c11f380 con 0x7fa88c134260 2023-10-03T10:19:48.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.181+0000 7fa888ff9700 1 -- 172.21.15.19:0/2331239720 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa88401c3b0 con 0x7fa88c134260 2023-10-03T10:19:48.181 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:48.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 msgr2=0x7fa88c09cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa884004000 tx=0x7fa884004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 shutdown_connections 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa88c134260 0x7fa88c09cf00 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa88c133420 0x7fa88c09c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 --2- 172.21.15.19:0/2331239720 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa88c133e30 0x7fa88c09c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.183+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 >> 172.21.15.19:0/2331239720 conn(0x7fa88c0a4210 msgr2=0x7fa88c0a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.184+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 shutdown_connections 2023-10-03T10:19:48.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:48.184+0000 7fa892642700 1 -- 172.21.15.19:0/2331239720 wait complete. 2023-10-03T10:19:48.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:48.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:49.008 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:49.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.142+0000 7f6774afa700 1 Processor -- start 2023-10-03T10:19:49.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.142+0000 7f6774afa700 1 -- start start 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f6774afa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f677009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f6774afa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 0x7f67701339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f6774afa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677009b120 con 0x7f677009e410 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f6774afa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677006b460 con 0x7f677009e000 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f6774afa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f677009a7e0 con 0x7f677009d6f0 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f676e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f677009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f676ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f677009e410 0x7f6770133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48600/0 (socket says 172.21.15.19:48600) 2023-10-03T10:19:49.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f676ed9d700 1 -- 172.21.15.19:0/2980430048 learned_addr learned my addr 172.21.15.19:0/2980430048 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.143+0000 7f676dd9b700 1 --2- 172.21.15.19:0/2980430048 >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 0x7f67701339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676d59a700 1 -- 172.21.15.19:0/2980430048 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552612334 0 0) 0x7f677009b120 con 0x7f677009e410 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676e59c700 1 -- 172.21.15.19:0/2980430048 >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 msgr2=0x7f67701339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676e59c700 1 --2- 172.21.15.19:0/2980430048 >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 0x7f67701339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676e59c700 1 -- 172.21.15.19:0/2980430048 >> v1:172.21.15.19:6789/0 conn(0x7f677009e410 legacy=0x7f6770133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676e59c700 1 -- 172.21.15.19:0/2980430048 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677009a500 con 0x7f677009d6f0 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676dd9b700 1 --2- 172.21.15.19:0/2980430048 >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 0x7f67701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676e59c700 1 --2- 172.21.15.19:0/2980430048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f677009dac0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6760009870 tx=0x7f6760009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fb6c2d05099750 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676d59a700 1 -- 172.21.15.19:0/2980430048 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011830 con 0x7f677009d6f0 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676d59a700 1 -- 172.21.15.19:0/2980430048 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6760011990 con 0x7f677009d6f0 2023-10-03T10:19:49.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.144+0000 7f676d59a700 1 -- 172.21.15.19:0/2980430048 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760011d20 con 0x7f677009d6f0 2023-10-03T10:19:49.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 -- 172.21.15.19:0/2980430048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 msgr2=0x7f677009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 --2- 172.21.15.19:0/2980430048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f677009dac0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6760009870 tx=0x7f6760009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 -- 172.21.15.19:0/2980430048 shutdown_connections 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 --2- 172.21.15.19:0/2980430048 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f677009dac0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 --2- 172.21.15.19:0/2980430048 >> v2:172.21.15.19:3300/0 conn(0x7f677009e000 0x7f67701339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 -- 172.21.15.19:0/2980430048 >> 172.21.15.19:0/2980430048 conn(0x7f6770066f50 msgr2=0x7f677009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 -- 172.21.15.19:0/2980430048 shutdown_connections 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.145+0000 7f6774afa700 1 -- 172.21.15.19:0/2980430048 wait complete. 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 Processor -- start 2023-10-03T10:19:49.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 -- start start 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f67701c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f677009e410 0x7f67701c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677009c710 con 0x7f677009e410 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a80e0 con 0x7f677009e000 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.147+0000 7f6774afa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67701a63d0 con 0x7f677009d6f0 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38942/0 (socket says 172.21.15.19:38942) 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 -- 172.21.15.19:0/3252229953 learned_addr learned my addr 172.21.15.19:0/3252229953 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676ed9d700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f677009e410 0x7f67701c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676e59c700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f67701c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 -- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 msgr2=0x7f67701c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f67701c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 -- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f677009e410 msgr2=0x7f67701c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f677009e410 0x7f67701c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 -- 172.21.15.19:0/3252229953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67640094a0 con 0x7f677009e000 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f676dd9b700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f676400ebb0 tx=0x7f676400eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.148+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676400c850 con 0x7f677009e000 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.149+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676400c9b0 con 0x7f677009e000 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.149+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67600094a0 con 0x7f677009e000 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.149+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676400cd40 con 0x7f677009e000 2023-10-03T10:19:49.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.149+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67701a6bc0 con 0x7f677009e000 2023-10-03T10:19:49.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.150+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6764013470 con 0x7f677009e000 2023-10-03T10:19:49.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.150+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f676403f740 con 0x7f677009e000 2023-10-03T10:19:49.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.150+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67701a70a0 con 0x7f677009e000 2023-10-03T10:19:49.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.159+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f67640232f0 con 0x7f677009e000 2023-10-03T10:19:49.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.182+0000 7f82fe9a2700 1 Processor -- start 2023-10-03T10:19:49.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.182+0000 7f82fe9a2700 1 -- start start 2023-10-03T10:19:49.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82fe9a2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 0x7f82f81337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82fe9a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f81306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82fe9a2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f806b990 con 0x7f82f8133e30 2023-10-03T10:19:49.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82fe9a2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80a0590 con 0x7f82f8133420 2023-10-03T10:19:49.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82fe9a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f809fb80 con 0x7f82f8134260 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82f7fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 0x7f82f81337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82f77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f82f8133e30 0x7f82f812ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48614/0 (socket says 172.21.15.19:48614) 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.183+0000 7f82f77fe700 1 -- 172.21.15.19:0/696064259 learned_addr learned my addr 172.21.15.19:0/696064259 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/696064259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f81306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f6ffd700 1 -- 172.21.15.19:0/696064259 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031262202 0 0) 0x7f82f806b990 con 0x7f82f8133e30 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f6ffd700 1 -- 172.21.15.19:0/696064259 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e00035b0 con 0x7f82f8133e30 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 -- 172.21.15.19:0/696064259 >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 msgr2=0x7f82f81337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/696064259 >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 0x7f82f81337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 -- 172.21.15.19:0/696064259 >> v1:172.21.15.19:6789/0 conn(0x7f82f8133e30 legacy=0x7f82f812ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 -- 172.21.15.19:0/696064259 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80a0030 con 0x7f82f8134260 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f7fff700 1 --2- 172.21.15.19:0/696064259 >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 0x7f82f81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/696064259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f81306a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c81601f2195ec3ae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f6ffd700 1 -- 172.21.15.19:0/696064259 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f000e070 con 0x7f82f8134260 2023-10-03T10:19:49.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f6ffd700 1 -- 172.21.15.19:0/696064259 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f000bb20 con 0x7f82f8134260 2023-10-03T10:19:49.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.184+0000 7f82f6ffd700 1 -- 172.21.15.19:0/696064259 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0012430 con 0x7f82f8134260 2023-10-03T10:19:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 -- 172.21.15.19:0/696064259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 msgr2=0x7f82f81306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/696064259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f81306a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009d90 tx=0x7f82f000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 -- 172.21.15.19:0/696064259 shutdown_connections 2023-10-03T10:19:49.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/696064259 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f81306a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/696064259 >> v2:172.21.15.19:3300/0 conn(0x7f82f8133420 0x7f82f81337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 -- 172.21.15.19:0/696064259 >> 172.21.15.19:0/696064259 conn(0x7f82f80a4210 msgr2=0x7f82f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 -- 172.21.15.19:0/696064259 shutdown_connections 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.185+0000 7f82fe9a2700 1 -- 172.21.15.19:0/696064259 wait complete. 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.186+0000 7f82fe9a2700 1 Processor -- start 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.186+0000 7f82fe9a2700 1 -- start start 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 0x7f82f809c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82f8133e30 0x7f82f809c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f811f420 con 0x7f82f8133420 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f809e380 con 0x7f82f8133e30 2023-10-03T10:19:49.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fe9a2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82f81206c0 con 0x7f82f8134260 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58264/0 (socket says 172.21.15.19:58264) 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 -- 172.21.15.19:0/2960270807 learned_addr learned my addr 172.21.15.19:0/2960270807 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82f7fff700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 0x7f82f809c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82f77fe700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82f8133e30 0x7f82f809c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 -- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82f8133e30 msgr2=0x7f82f809c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82f8133e30 0x7f82f809c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 -- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 msgr2=0x7f82f809c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 0x7f82f809c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82fcf3f700 1 -- 172.21.15.19:0/2960270807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e80094a0 con 0x7f82f8134260 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.187+0000 7f82f7fff700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 0x7f82f809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82fcf3f700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f82f0013000 tx=0x7f82f0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0012a90 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f0020070 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0009a70 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0012e50 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.188+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f8120020 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.189+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f82f0004040 con 0x7f82f8134260 2023-10-03T10:19:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.189+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f82f0022070 con 0x7f82f8134260 2023-10-03T10:19:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.189+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f811fe50 con 0x7f82f8134260 2023-10-03T10:19:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.194+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f82f001a970 con 0x7f82f8134260 2023-10-03T10:19:49.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 Processor -- start 2023-10-03T10:19:49.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 -- start start 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cb00a0a30 0x7f8cb00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb0133fa0 0x7f8cb0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.236+0000 7f8cb5e57700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb009edd0 con 0x7f8cb00a0a30 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8cb5e57700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb009e1f0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8cb5e57700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb009dc50 con 0x7f8cb00a1340 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cb00a0a30 0x7f8cb00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8cb00a0a30 0x7f8cb00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38186/0 (socket says 172.21.15.19:38186) 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caeffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58280/0 (socket says 172.21.15.19:58280) 2023-10-03T10:19:49.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 -- 172.21.15.19:0/2936810158 learned_addr learned my addr 172.21.15.19:0/2936810158 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:49.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caffff700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb0133fa0 0x7f8cb0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 -- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 msgr2=0x7f8cb0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 -- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb0133fa0 msgr2=0x7f8cb0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb0133fa0 0x7f8cb0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caf7fe700 1 -- 172.21.15.19:0/2936810158 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb00a1fe0 con 0x7f8cb00a0a30 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.237+0000 7f8caeffd700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.239 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.238+0000 7f8caf7fe700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a0a30 0x7f8cb00a0e00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00098f0 tx=0x7f8ca0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8726aa48da52a8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.238+0000 7f8cae7fc700 1 -- 172.21.15.19:0/2936810158 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0011830 con 0x7f8cb00a0a30 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.238+0000 7f8cae7fc700 1 -- 172.21.15.19:0/2936810158 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca0011990 con 0x7f8cb00a0a30 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.238+0000 7f8cae7fc700 1 -- 172.21.15.19:0/2936810158 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0011d20 con 0x7f8cb00a0a30 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a0a30 msgr2=0x7f8cb00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a0a30 0x7f8cb00a0e00 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f8ca00098f0 tx=0x7f8ca0009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2936810158 shutdown_connections 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb0133fa0 0x7f8cb0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a0a30 0x7f8cb00a0e00 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2936810158 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb00a1340 0x7f8cb0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2936810158 >> 172.21.15.19:0/2936810158 conn(0x7f8cb00a6550 msgr2=0x7f8cb00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2936810158 shutdown_connections 2023-10-03T10:19:49.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.239+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2936810158 wait complete. 2023-10-03T10:19:49.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.240+0000 7f8cb5e57700 1 Processor -- start 2023-10-03T10:19:49.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.240+0000 7f8cb5e57700 1 -- start start 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.240+0000 7f8cb5e57700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8cb5e57700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a1340 0x7f8cb011cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8cb5e57700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 0x7f8cb011d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8cb5e57700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb011fca0 con 0x7f8cb00a1340 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8cb5e57700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb011f780 con 0x7f8cb00a0a30 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8cb5e57700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb00a3430 con 0x7f8cb0133fa0 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38964/0 (socket says 172.21.15.19:38964) 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caf7fe700 1 -- 172.21.15.19:0/2325213548 learned_addr learned my addr 172.21.15.19:0/2325213548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 0x7f8cb011d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caeffd700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a1340 0x7f8cb011cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 -- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 msgr2=0x7f8cb011c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 -- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a1340 msgr2=0x7f8cb011cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a1340 0x7f8cb011cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 -- 172.21.15.19:0/2325213548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca40094a0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caf7fe700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.241+0000 7f8caffff700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 0x7f8cb011d220 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007d90 tx=0x7f8ca800e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.242+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8018070 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.242+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800eb30 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.242+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8003a20 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.242+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca0009550 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.242+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb011dae0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.243+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8ca8014420 con 0x7f8cb0133fa0 2023-10-03T10:19:49.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.243+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8ca803f5b0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.243+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb011eca0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.253+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8ca80146d0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.349+0000 7f049ea93700 1 Processor -- start 2023-10-03T10:19:49.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.349+0000 7f049ea93700 1 -- start start 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049ea93700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04980a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049ea93700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 0x7f04980a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049ea93700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04980a2a70 con 0x7f0498133930 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049ea93700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980a01d0 con 0x7f04980a0a30 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049ea93700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049809e2b0 con 0x7f049809d630 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049c82f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04980a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049d030700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0498133930 0x7f0498133dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48616/0 (socket says 172.21.15.19:48616) 2023-10-03T10:19:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f049d030700 1 -- 172.21.15.19:0/2428058301 learned_addr learned my addr 172.21.15.19:0/2428058301 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f0497fff700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 0x7f04980a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f04977fe700 1 -- 172.21.15.19:0/2428058301 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504896285 0 0) 0x7f04980a2a70 con 0x7f0498133930 2023-10-03T10:19:49.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f04977fe700 1 -- 172.21.15.19:0/2428058301 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04880035b0 con 0x7f0498133930 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f0497fff700 1 -- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 msgr2=0x7f04980a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f0497fff700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04980a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f0497fff700 1 -- 172.21.15.19:0/2428058301 >> v1:172.21.15.19:6789/0 conn(0x7f0498133930 legacy=0x7f0498133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.350+0000 7f0497fff700 1 -- 172.21.15.19:0/2428058301 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049809dc50 con 0x7f049809d630 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f0497fff700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 0x7f04980a1340 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0484009870 tx=0x7f0484009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db3f931968aa0341 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f04977fe700 1 -- 172.21.15.19:0/2428058301 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484011830 con 0x7f049809d630 2023-10-03T10:19:49.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f04977fe700 1 -- 172.21.15.19:0/2428058301 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484011990 con 0x7f049809d630 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f04977fe700 1 -- 172.21.15.19:0/2428058301 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484011d20 con 0x7f049809d630 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f049ea93700 1 -- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 msgr2=0x7f04980a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.351+0000 7f049ea93700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 0x7f04980a1340 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f0484009870 tx=0x7f0484009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 -- 172.21.15.19:0/2428058301 shutdown_connections 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04980a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 --2- 172.21.15.19:0/2428058301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f049809d630 0x7f04980a1340 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 -- 172.21.15.19:0/2428058301 >> 172.21.15.19:0/2428058301 conn(0x7f04980a3050 msgr2=0x7f04980a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 -- 172.21.15.19:0/2428058301 shutdown_connections 2023-10-03T10:19:49.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.352+0000 7f049ea93700 1 -- 172.21.15.19:0/2428058301 wait complete. 2023-10-03T10:19:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 Processor -- start 2023-10-03T10:19:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 -- start start 2023-10-03T10:19:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04981d51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 0x7f04981d5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049811ea80 con 0x7f049809d630 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049811e890 con 0x7f04980a0a30 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049ea93700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f049811f8c0 con 0x7f0498133930 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.353+0000 7f049c82f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38206/0 (socket says 172.21.15.19:38206) 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 -- 172.21.15.19:0/599956996 learned_addr learned my addr 172.21.15.19:0/599956996 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049d030700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 0x7f04981d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f0497fff700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04981d51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 -- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 msgr2=0x7f04981d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 0x7f04981d5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 -- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 msgr2=0x7f04981d51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04981d51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 -- 172.21.15.19:0/599956996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04840094a0 con 0x7f049809d630 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049d030700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 0x7f04981d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f0497fff700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04981d51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.354+0000 7f049c82f700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e9b0 tx=0x7f048c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.355+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c009710 con 0x7f049809d630 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.355+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c00ee50 con 0x7f049809d630 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.355+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c00ca50 con 0x7f049809d630 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.355+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04981207a0 con 0x7f049809d630 2023-10-03T10:19:49.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.355+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04980a0410 con 0x7f049809d630 2023-10-03T10:19:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.356+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f048c00cbb0 con 0x7f049809d630 2023-10-03T10:19:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.356+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0498120320 con 0x7f049809d630 2023-10-03T10:19:49.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.357+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f048c03f690 con 0x7f049809d630 2023-10-03T10:19:49.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.361+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0498120320 con 0x7f049809d630 2023-10-03T10:19:49.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.381+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6770074ea0 con 0x7f677009e000 2023-10-03T10:19:49.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.381+0000 7f675effd700 1 -- 172.21.15.19:0/3252229953 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6764021030 con 0x7f677009e000 2023-10-03T10:19:49.381 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 msgr2=0x7f67701c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f676400ebb0 tx=0x7f676400eec0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 shutdown_connections 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f677009e410 0x7f67701c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f677009d6f0 0x7f67701c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 --2- 172.21.15.19:0/3252229953 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f677009e000 0x7f67701c8560 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 >> 172.21.15.19:0/3252229953 conn(0x7f6770066f50 msgr2=0x7f67701bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 shutdown_connections 2023-10-03T10:19:49.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.385+0000 7f6774afa700 1 -- 172.21.15.19:0/3252229953 wait complete. 2023-10-03T10:19:49.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:49.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.431+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f82f8074ea0 con 0x7f82f8134260 2023-10-03T10:19:49.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.431+0000 7f82f4ff9700 1 -- 172.21.15.19:0/2960270807 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f82f001a380 con 0x7f82f8134260 2023-10-03T10:19:49.431 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 msgr2=0x7f82f809cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f82f0013000 tx=0x7f82f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 shutdown_connections 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f82f8134260 0x7f82f809cf00 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82f8133420 0x7f82f809c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 --2- 172.21.15.19:0/2960270807 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f82f8133e30 0x7f82f809c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 >> 172.21.15.19:0/2960270807 conn(0x7f82f80a4210 msgr2=0x7f82f81303f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 shutdown_connections 2023-10-03T10:19:49.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.434+0000 7f82fe9a2700 1 -- 172.21.15.19:0/2960270807 wait complete. 2023-10-03T10:19:49.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:49.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.465+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8cb0074ea0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.466+0000 7f8c97fff700 1 -- 172.21.15.19:0/2325213548 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8ca80122e0 con 0x7f8cb0133fa0 2023-10-03T10:19:49.466 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 msgr2=0x7f8cb011d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 0x7f8cb011d220 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8007d90 tx=0x7f8ca800e3c0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 shutdown_connections 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8cb0133fa0 0x7f8cb011d220 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8cb00a0a30 0x7f8cb011c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 --2- 172.21.15.19:0/2325213548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cb00a1340 0x7f8cb011cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 >> 172.21.15.19:0/2325213548 conn(0x7f8cb00a6550 msgr2=0x7f8cb01baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 shutdown_connections 2023-10-03T10:19:49.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.468+0000 7f8cb5e57700 1 -- 172.21.15.19:0/2325213548 wait complete. 2023-10-03T10:19:49.482 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.569+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0498120320 con 0x7f049809d630 2023-10-03T10:19:49.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.570+0000 7f04957fa700 1 -- 172.21.15.19:0/599956996 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0498120320 con 0x7f049809d630 2023-10-03T10:19:49.570 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 msgr2=0x7f04981d4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f048c00e9b0 tx=0x7f048c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 shutdown_connections 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0498133930 0x7f04981d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f049809d630 0x7f04981d4c90 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 --2- 172.21.15.19:0/599956996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04980a0a30 0x7f04981d51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:49.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 >> 172.21.15.19:0/599956996 conn(0x7f04980a3050 msgr2=0x7f0498132bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 shutdown_connections 2023-10-03T10:19:49.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:49.572+0000 7f049ea93700 1 -- 172.21.15.19:0/599956996 wait complete. 2023-10-03T10:19:49.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:50.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:50.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:50.482 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.557+0000 7fdb6bb04700 1 Processor -- start 2023-10-03T10:19:50.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.558+0000 7fdb6bb04700 1 -- start start 2023-10-03T10:19:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.558+0000 7fdb6bb04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.558+0000 7fdb6bb04700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb64139170 0x7fdb6413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6bb04700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6409b120 con 0x7fdb6409d6f0 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6bb04700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6406b460 con 0x7fdb64139170 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6bb04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6409a7e0 con 0x7fdb6409e1d0 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdb64139170 0x7fdb6413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6909f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb698a0700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdb6409d6f0 0x7fdb6409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48628/0 (socket says 172.21.15.19:48628) 2023-10-03T10:19:50.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb698a0700 1 -- 172.21.15.19:0/1978050332 learned_addr learned my addr 172.21.15.19:0/1978050332 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:50.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 -- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 msgr2=0x7fdb64138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:50.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6889e700 1 -- 172.21.15.19:0/1978050332 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107174007 0 0) 0x7fdb6409b120 con 0x7fdb6409d6f0 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 -- 172.21.15.19:0/1978050332 >> v1:172.21.15.19:6789/0 conn(0x7fdb6409d6f0 legacy=0x7fdb6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 -- 172.21.15.19:0/1978050332 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6409a500 con 0x7fdb64139170 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6909f700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.559+0000 7fdb6a0a1700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb6413b550 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009d90 tx=0x7fdb5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19934394c02723f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6889e700 1 -- 172.21.15.19:0/1978050332 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c00e070 con 0x7fdb64139170 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6889e700 1 -- 172.21.15.19:0/1978050332 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00bb20 con 0x7fdb64139170 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6889e700 1 -- 172.21.15.19:0/1978050332 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c012430 con 0x7fdb64139170 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 msgr2=0x7fdb6413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb6413b550 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009d90 tx=0x7fdb5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1978050332 shutdown_connections 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb6413b550 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1978050332 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1978050332 >> 172.21.15.19:0/1978050332 conn(0x7fdb64066f50 msgr2=0x7fdb6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1978050332 shutdown_connections 2023-10-03T10:19:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.560+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1978050332 wait complete. 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.561+0000 7fdb6bb04700 1 Processor -- start 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.561+0000 7fdb6bb04700 1 -- start start 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb6409d6f0 0x7fdb641218a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb64122320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64124f00 con 0x7fdb64139170 2023-10-03T10:19:50.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641250e0 con 0x7fdb6409e1d0 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6bb04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6409c710 con 0x7fdb6409d6f0 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:38994/0 (socket says 172.21.15.19:38994) 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 -- 172.21.15.19:0/1874322071 learned_addr learned my addr 172.21.15.19:0/1874322071 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6a0a1700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb64122320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 -- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb6409d6f0 msgr2=0x7fdb641218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb6409d6f0 0x7fdb641218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 -- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 msgr2=0x7fdb64122320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb64122320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6909f700 1 -- 172.21.15.19:0/1874322071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540094a0 con 0x7fdb6409e1d0 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.562+0000 7fdb6a0a1700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb64122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:50.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb6909f700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400ec40 tx=0x7fdb5400ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400c910 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5400ca70 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5c009a70 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5400ce00 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.563+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64072150 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.564+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb54013470 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.564+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb64125220 con 0x7fdb6409e1d0 2023-10-03T10:19:50.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.564+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb5403fbe0 con 0x7fdb6409e1d0 2023-10-03T10:19:50.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.569+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb64125220 con 0x7fdb6409e1d0 2023-10-03T10:19:50.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:50.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.605+0000 7f098576f700 1 Processor -- start 2023-10-03T10:19:50.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.605+0000 7f098576f700 1 -- start start 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f098576f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 0x7f0980135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f098576f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 0x7f0980138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f098576f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098009f130 con 0x7f098009d6f0 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f098576f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098009f520 con 0x7f0980135e50 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f098576f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098009e930 con 0x7f098009e1d0 2023-10-03T10:19:50.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 0x7f0980135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 0x7f0980138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 0x7f0980135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58320/0 (socket says 172.21.15.19:58320) 2023-10-03T10:19:50.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097e7fc700 1 -- 172.21.15.19:0/2784375790 learned_addr learned my addr 172.21.15.19:0/2784375790 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097f7fe700 1 -- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 msgr2=0x7f0980135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:50.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097f7fe700 1 --2- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 0x7f0980135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.606+0000 7f097f7fe700 1 -- 172.21.15.19:0/2784375790 >> v1:172.21.15.19:6789/0 conn(0x7f098009d6f0 legacy=0x7f098009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.607+0000 7f097f7fe700 1 -- 172.21.15.19:0/2784375790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098009b2d0 con 0x7f0980135e50 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.607+0000 7f097f7fe700 1 --2- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 0x7f0980138230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f097800f3a0 tx=0x7f097800f6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f0067bd8b6cb10 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.607+0000 7f097dffb700 1 -- 172.21.15.19:0/2784375790 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978012070 con 0x7f0980135e50 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.607+0000 7f097dffb700 1 -- 172.21.15.19:0/2784375790 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800d0d0 con 0x7f0980135e50 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.607+0000 7f097dffb700 1 -- 172.21.15.19:0/2784375790 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800fea0 con 0x7f0980135e50 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 -- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 msgr2=0x7f0980138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 --2- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 0x7f0980138230 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f097800f3a0 tx=0x7f097800f6b0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 -- 172.21.15.19:0/2784375790 shutdown_connections 2023-10-03T10:19:50.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 --2- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0980135e50 0x7f0980138230 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 --2- 172.21.15.19:0/2784375790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f098009e1d0 0x7f0980135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 -- 172.21.15.19:0/2784375790 >> 172.21.15.19:0/2784375790 conn(0x7f0980066f50 msgr2=0x7f098009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 -- 172.21.15.19:0/2784375790 shutdown_connections 2023-10-03T10:19:50.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.608+0000 7f098576f700 1 -- 172.21.15.19:0/2784375790 wait complete. 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.609+0000 7f098576f700 1 Processor -- start 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.609+0000 7f098576f700 1 -- start start 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f098009e1d0 0x7f09801199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0980135e50 0x7f0980119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098009c700 con 0x7f098009d6f0 2023-10-03T10:19:50.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098011b090 con 0x7f098009e1d0 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f098576f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f098011cbb0 con 0x7f0980135e50 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f097effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f097f7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0980135e50 0x7f0980119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f097effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38230/0 (socket says 172.21.15.19:38230) 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f097effd700 1 -- 172.21.15.19:0/4016132872 learned_addr learned my addr 172.21.15.19:0/4016132872 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.610+0000 7f097e7fc700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f098009e1d0 0x7f09801199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 -- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0980135e50 msgr2=0x7f0980119f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0980135e50 0x7f0980119f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 -- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f098009e1d0 msgr2=0x7f09801199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.613 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f098009e1d0 0x7f09801199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 -- 172.21.15.19:0/4016132872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097800f050 con 0x7f098009d6f0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f097effd700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f097000c450 tx=0x7f097000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700052d0 con 0x7f098009d6f0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970005430 con 0x7f098009d6f0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800a1d00 con 0x7f098009d6f0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098011b820 con 0x7f098009d6f0 2023-10-03T10:19:50.614 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.611+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700038c0 con 0x7f098009d6f0 2023-10-03T10:19:50.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.612+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0970003a20 con 0x7f098009d6f0 2023-10-03T10:19:50.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.613+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f097003eae0 con 0x7f098009d6f0 2023-10-03T10:19:50.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.613+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09600052e0 con 0x7f098009d6f0 2023-10-03T10:19:50.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.618+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0970017070 con 0x7f098009d6f0 2023-10-03T10:19:50.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 Processor -- start 2023-10-03T10:19:50.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 -- start start 2023-10-03T10:19:50.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe6809dc30 0x7fbe6809e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6809a810 con 0x7fbe6813c1e0 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6806ab40 con 0x7fbe6809dc30 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.641+0000 7fbe6d1e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6809ebc0 con 0x7fbe6806a770 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe6809dc30 0x7fbe6809e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe6809dc30 0x7fbe6809e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38240/0 (socket says 172.21.15.19:38240) 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 -- 172.21.15.19:0/1241427595 learned_addr learned my addr 172.21.15.19:0/1241427595 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe66d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe65d9b700 1 -- 172.21.15.19:0/1241427595 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372175001 0 0) 0x7fbe6809a810 con 0x7fbe6813c1e0 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe65d9b700 1 -- 172.21.15.19:0/1241427595 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe500035b0 con 0x7fbe6813c1e0 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 -- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 msgr2=0x7fbe6809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 --2- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6809d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 -- 172.21.15.19:0/1241427595 >> v1:172.21.15.19:6789/0 conn(0x7fbe6813c1e0 legacy=0x7fbe6813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.642+0000 7fbe6659c700 1 -- 172.21.15.19:0/1241427595 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6809e920 con 0x7fbe6809dc30 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe6659c700 1 --2- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6809e080 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009920 tx=0x7fbe5c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d897f6e15f463058 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe65d9b700 1 -- 172.21.15.19:0/1241427595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011830 con 0x7fbe6809dc30 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe65d9b700 1 -- 172.21.15.19:0/1241427595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5c011990 con 0x7fbe6809dc30 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe65d9b700 1 -- 172.21.15.19:0/1241427595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c011d20 con 0x7fbe6809dc30 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 msgr2=0x7fbe6809e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.643+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6809e080 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009920 tx=0x7fbe5c009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1241427595 shutdown_connections 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6809d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1241427595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6809e080 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1241427595 >> 172.21.15.19:0/1241427595 conn(0x7fbe68066f50 msgr2=0x7fbe6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1241427595 shutdown_connections 2023-10-03T10:19:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.644+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1241427595 wait complete. 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.645+0000 7fbe6d1e0700 1 Processor -- start 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.645+0000 7fbe6d1e0700 1 -- start start 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6813a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe6813c1e0 0x7fbe6813a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6811dbe0 con 0x7fbe6809dc30 2023-10-03T10:19:50.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe68134b90 con 0x7fbe6806a770 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6d1e0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6811ddc0 con 0x7fbe6813c1e0 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39042/0 (socket says 172.21.15.19:39042) 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 -- 172.21.15.19:0/1267276651 learned_addr learned my addr 172.21.15.19:0/1267276651 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6659c700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6813a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe6759e700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe6813c1e0 0x7fbe6813a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 -- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe6813c1e0 msgr2=0x7fbe6813a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe6813c1e0 0x7fbe6813a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 -- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 msgr2=0x7fbe6813a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6813a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.646+0000 7fbe66d9d700 1 -- 172.21.15.19:0/1267276651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c009550 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe66d9d700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800e9e0 tx=0x7fbe5800ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58009710 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800ee80 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6813bc30 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800ca50 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.647+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe6811bc00 con 0x7fbe6806a770 2023-10-03T10:19:50.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.648+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe5800cbb0 con 0x7fbe6806a770 2023-10-03T10:19:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.648+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe5803f6b0 con 0x7fbe6806a770 2023-10-03T10:19:50.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.648+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe68074ea0 con 0x7fbe6806a770 2023-10-03T10:19:50.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.657+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe58021080 con 0x7fbe6806a770 2023-10-03T10:19:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.737+0000 7f12ed183700 1 Processor -- start 2023-10-03T10:19:50.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.737+0000 7f12ed183700 1 -- start start 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 0x7f12e80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80a2a70 con 0x7f12e8133930 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80a01d0 con 0x7f12e809d630 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12ed183700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e809e2b0 con 0x7f12e80a0a30 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39054/0 (socket says 172.21.15.19:39054) 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 -- 172.21.15.19:0/2447465349 learned_addr learned my addr 172.21.15.19:0/2447465349 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e759e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38248/0 (socket says 172.21.15.19:38248) 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e6d9d700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 0x7f12e80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 -- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 msgr2=0x7f12e80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 0x7f12e80a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 -- 172.21.15.19:0/2447465349 >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 msgr2=0x7f12e8133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 --2- 172.21.15.19:0/2447465349 >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e659c700 1 -- 172.21.15.19:0/2447465349 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e809dc50 con 0x7f12e809d630 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e6d9d700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 0x7f12e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.738+0000 7f12e759e700 1 --2- 172.21.15.19:0/2447465349 >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12e659c700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098f0 tx=0x7f12dc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=165f46ae38b6128b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12e5d9b700 1 -- 172.21.15.19:0/2447465349 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc011830 con 0x7f12e809d630 2023-10-03T10:19:50.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12e5d9b700 1 -- 172.21.15.19:0/2447465349 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc011990 con 0x7f12e809d630 2023-10-03T10:19:50.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12e5d9b700 1 -- 172.21.15.19:0/2447465349 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc011d20 con 0x7f12e809d630 2023-10-03T10:19:50.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12ed183700 1 -- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 msgr2=0x7f12e80a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.739+0000 7f12ed183700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098f0 tx=0x7f12dc009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 -- 172.21.15.19:0/2447465349 shutdown_connections 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 --2- 172.21.15.19:0/2447465349 >> v2:172.21.15.19:3300/0 conn(0x7f12e8133930 0x7f12e8133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e80a0a30 0x7f12e80a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 --2- 172.21.15.19:0/2447465349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e809d630 0x7f12e80a1340 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 -- 172.21.15.19:0/2447465349 >> 172.21.15.19:0/2447465349 conn(0x7f12e80a3050 msgr2=0x7f12e80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 -- 172.21.15.19:0/2447465349 shutdown_connections 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.740+0000 7f12ed183700 1 -- 172.21.15.19:0/2447465349 wait complete. 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 Processor -- start 2023-10-03T10:19:50.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 -- start start 2023-10-03T10:19:50.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 0x7f12e811f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e8133930 0x7f12e81c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:50.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8120630 con 0x7f12e809d630 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e8120c80 con 0x7f12e80a0a30 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.742+0000 7f12ed183700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f12e811fe90 con 0x7f12e8133930 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38258/0 (socket says 172.21.15.19:38258) 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 -- 172.21.15.19:0/174190558 learned_addr learned my addr 172.21.15.19:0/174190558 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e759e700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e8133930 0x7f12e81c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e659c700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 0x7f12e811f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 -- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e8133930 msgr2=0x7f12e81c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e8133930 0x7f12e81c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 -- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 msgr2=0x7f12e811f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 0x7f12e811f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 -- 172.21.15.19:0/174190558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e0009a70 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e659c700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 0x7f12e811f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12e6d9d700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f12d800e810 tx=0x7f12d800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8013610 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.743+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d8013770 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.744+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d8013b20 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.744+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc009550 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.744+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e8122260 con 0x7f12e809d630 2023-10-03T10:19:50.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.745+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f12d8013c80 con 0x7f12e809d630 2023-10-03T10:19:50.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.745+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f12d803f300 con 0x7f12e809d630 2023-10-03T10:19:50.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.745+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e80747f0 con 0x7f12e809d630 2023-10-03T10:19:50.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.754+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f12d8012370 con 0x7f12e809d630 2023-10-03T10:19:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.801+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdb64125220 con 0x7fdb6409e1d0 2023-10-03T10:19:50.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.801+0000 7fdb5a7fc700 1 -- 172.21.15.19:0/1874322071 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb64125220 con 0x7fdb6409e1d0 2023-10-03T10:19:50.801 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 msgr2=0x7fdb64121de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fdb5400ec40 tx=0x7fdb5400ef50 comp rx=0 tx=0).stop 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 shutdown_connections 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb64139170 0x7fdb64122320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb6409d6f0 0x7fdb641218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 --2- 172.21.15.19:0/1874322071 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb6409e1d0 0x7fdb64121de0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 >> 172.21.15.19:0/1874322071 conn(0x7fdb64066f50 msgr2=0x7fdb64070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 shutdown_connections 2023-10-03T10:19:50.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.804+0000 7fdb6bb04700 1 -- 172.21.15.19:0/1874322071 wait complete. 2023-10-03T10:19:50.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:50.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.831+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0960005150 con 0x7f098009d6f0 2023-10-03T10:19:50.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.831+0000 7f09677fe700 1 -- 172.21.15.19:0/4016132872 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0970011590 con 0x7f098009d6f0 2023-10-03T10:19:50.831 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:50.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 msgr2=0x7f09801194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f097000c450 tx=0x7f097000c760 comp rx=0 tx=0).stop 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 shutdown_connections 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0980135e50 0x7f0980119f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f098009d6f0 0x7f09801194b0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 --2- 172.21.15.19:0/4016132872 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f098009e1d0 0x7f09801199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.833+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 >> 172.21.15.19:0/4016132872 conn(0x7f0980066f50 msgr2=0x7f0980130800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.834+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 shutdown_connections 2023-10-03T10:19:50.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.834+0000 7f098576f700 1 -- 172.21.15.19:0/4016132872 wait complete. 2023-10-03T10:19:50.847 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:50.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.874+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe6806c360 con 0x7fbe6806a770 2023-10-03T10:19:50.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.875+0000 7fbe4f7fe700 1 -- 172.21.15.19:0/1267276651 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe580232f0 con 0x7fbe6806a770 2023-10-03T10:19:50.875 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 msgr2=0x7fbe6811b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800e9e0 tx=0x7fbe5800ecf0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 shutdown_connections 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe6813c1e0 0x7fbe6813a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe6806a770 0x7fbe6811b050 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 --2- 172.21.15.19:0/1267276651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe6809dc30 0x7fbe6813a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 >> 172.21.15.19:0/1267276651 conn(0x7fbe68066f50 msgr2=0x7fbe68072180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 shutdown_connections 2023-10-03T10:19:50.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.877+0000 7fbe6d1e0700 1 -- 172.21.15.19:0/1267276651 wait complete. 2023-10-03T10:19:50.891 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.966+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f12e8120e20 con 0x7f12e809d630 2023-10-03T10:19:50.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.966+0000 7f12cf7fe700 1 -- 172.21.15.19:0/174190558 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f12d8021020 con 0x7f12e809d630 2023-10-03T10:19:50.966 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:50.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 msgr2=0x7f12e811f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f12d800e810 tx=0x7f12d800ebd0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 shutdown_connections 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f12e8133930 0x7f12e81c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f12e809d630 0x7f12e811f410 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 --2- 172.21.15.19:0/174190558 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f12e80a0a30 0x7f12e811f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 >> 172.21.15.19:0/174190558 conn(0x7f12e80a3050 msgr2=0x7f12e809ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 shutdown_connections 2023-10-03T10:19:50.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:50.968+0000 7f12ed183700 1 -- 172.21.15.19:0/174190558 wait complete. 2023-10-03T10:19:50.982 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:51.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:51.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:51.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:51.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.968+0000 7f112717a700 1 Processor -- start 2023-10-03T10:19:51.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 -- start start 2023-10-03T10:19:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112009edd0 con 0x7f11200a1340 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112009e1f0 con 0x7f1120133fa0 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f112717a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f112009dc50 con 0x7f11200a0a30 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f111ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f111ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38272/0 (socket says 172.21.15.19:38272) 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f111ffff700 1 -- 172.21.15.19:0/3712523792 learned_addr learned my addr 172.21.15.19:0/3712523792 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.969+0000 7f1125717700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f1124f16700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 -- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 msgr2=0x7f11200a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 -- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 msgr2=0x7f1120134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 -- 172.21.15.19:0/3712523792 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200a1fe0 con 0x7f11200a1340 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111ffff700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a1340 0x7f1120133a60 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f110c0098f0 tx=0x7f110c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69835856362d3f55 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111f7fe700 1 -- 172.21.15.19:0/3712523792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c011830 con 0x7f11200a1340 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111f7fe700 1 -- 172.21.15.19:0/3712523792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c011990 con 0x7f11200a1340 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.970+0000 7f111f7fe700 1 -- 172.21.15.19:0/3712523792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c011d20 con 0x7f11200a1340 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 -- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a1340 msgr2=0x7f1120133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a1340 0x7f1120133a60 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f110c0098f0 tx=0x7f110c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 -- 172.21.15.19:0/3712523792 shutdown_connections 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a0a30 0x7f11200a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 --2- 172.21.15.19:0/3712523792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a1340 0x7f1120133a60 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 -- 172.21.15.19:0/3712523792 >> 172.21.15.19:0/3712523792 conn(0x7f11200a6550 msgr2=0x7f11200a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 -- 172.21.15.19:0/3712523792 shutdown_connections 2023-10-03T10:19:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.971+0000 7f112717a700 1 -- 172.21.15.19:0/3712523792 wait complete. 2023-10-03T10:19:51.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.972+0000 7f112717a700 1 Processor -- start 2023-10-03T10:19:51.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.972+0000 7f112717a700 1 -- start start 2023-10-03T10:19:51.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a1340 0x7f11201205c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120120b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120121d30 con 0x7f11200a0a30 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11201238c0 con 0x7f1120133fa0 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.973+0000 7f112717a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11200a34a0 con 0x7f11200a1340 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f111ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a1340 0x7f11201205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38280/0 (socket says 172.21.15.19:38280) 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 -- 172.21.15.19:0/3600914950 learned_addr learned my addr 172.21.15.19:0/3600914950 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1125717700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120120b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 -- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a1340 msgr2=0x7f11201205c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a1340 0x7f11201205c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 -- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 msgr2=0x7f1120120b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120120b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 -- 172.21.15.19:0/3600914950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009550 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f1124f16700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f111400e810 tx=0x7f111400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111400c070 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114013610 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11200a0220 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.974+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11140139c0 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.975+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1120123ba0 con 0x7f11200a0a30 2023-10-03T10:19:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.975+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1114013b20 con 0x7f11200a0a30 2023-10-03T10:19:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.975+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f111403f100 con 0x7f11200a0a30 2023-10-03T10:19:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.976+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120074ea0 con 0x7f11200a0a30 2023-10-03T10:19:51.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:51.981+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f111401b3b0 con 0x7f11200a0a30 2023-10-03T10:19:51.983 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:52.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.009+0000 7f714caef700 1 Processor -- start 2023-10-03T10:19:52.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.009+0000 7f714caef700 1 -- start start 2023-10-03T10:19:52.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714caef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714806a770 0x7f714806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714caef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f7148131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714caef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714809ece0 con 0x7f7148131b40 2023-10-03T10:19:52.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714caef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714809e760 con 0x7f714806a770 2023-10-03T10:19:52.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714caef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f714809e040 con 0x7f714806b080 2023-10-03T10:19:52.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714806a770 0x7f714806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f714806a770 0x7f714806ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38288/0 (socket says 172.21.15.19:38288) 2023-10-03T10:19:52.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f714659c700 1 -- 172.21.15.19:0/4016328249 learned_addr learned my addr 172.21.15.19:0/4016328249 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.010+0000 7f7146d9d700 1 --1- 172.21.15.19:0/4016328249 >> v1:172.21.15.19:6789/0 conn(0x7f7148131b40 0x7f7148138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48658/0 (socket says 172.21.15.19:48658) 2023-10-03T10:19:52.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714659c700 1 -- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 msgr2=0x7f7148131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:52.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714659c700 1 --2- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f7148131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714659c700 1 -- 172.21.15.19:0/4016328249 >> v1:172.21.15.19:6789/0 conn(0x7f7148131b40 legacy=0x7f7148138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714559a700 1 -- 172.21.15.19:0/4016328249 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523381104 0 0) 0x7f714809ece0 con 0x7f7148131b40 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714659c700 1 -- 172.21.15.19:0/4016328249 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714809f630 con 0x7f714806a770 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714659c700 1 --2- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714806ab40 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f71380098f0 tx=0x7f7138009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7680ca04289c749a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714559a700 1 -- 172.21.15.19:0/4016328249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138010a90 con 0x7f714806a770 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714559a700 1 -- 172.21.15.19:0/4016328249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138010bf0 con 0x7f714806a770 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.011+0000 7f714559a700 1 -- 172.21.15.19:0/4016328249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138018440 con 0x7f714806a770 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 -- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 msgr2=0x7f714806ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 --2- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714806ab40 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f71380098f0 tx=0x7f7138009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:52.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 -- 172.21.15.19:0/4016328249 shutdown_connections 2023-10-03T10:19:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 --2- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714806ab40 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 --2- 172.21.15.19:0/4016328249 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f7148131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 -- 172.21.15.19:0/4016328249 >> 172.21.15.19:0/4016328249 conn(0x7f7148066f50 msgr2=0x7f714809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 -- 172.21.15.19:0/4016328249 shutdown_connections 2023-10-03T10:19:52.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.012+0000 7f714caef700 1 -- 172.21.15.19:0/4016328249 wait complete. 2023-10-03T10:19:52.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 Processor -- start 2023-10-03T10:19:52.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 -- start start 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714811e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f714811ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7148131b40 0x7f714811ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7148120310 con 0x7f714806a770 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714809a6f0 con 0x7f7148131b40 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.014+0000 7f714caef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7148071e60 con 0x7f714806b080 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f714811ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f7145d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f714811ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58394/0 (socket says 172.21.15.19:58394) 2023-10-03T10:19:52.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f7145d9b700 1 -- 172.21.15.19:0/772756265 learned_addr learned my addr 172.21.15.19:0/772756265 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714811e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 -- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 msgr2=0x7f714811ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f714811ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 -- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7148131b40 msgr2=0x7f714811ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7148131b40 0x7f714811ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 -- 172.21.15.19:0/772756265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009550 con 0x7f714806a770 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.015+0000 7f714659c700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714811e4c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f713801a000 tx=0x7f7138004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.016+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138003b70 con 0x7f714806a770 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.016+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7148121a40 con 0x7f714806a770 2023-10-03T10:19:52.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.016+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7148122050 con 0x7f714806a770 2023-10-03T10:19:52.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.016+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138003cd0 con 0x7f714806a770 2023-10-03T10:19:52.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.016+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138018640 con 0x7f714806a770 2023-10-03T10:19:52.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.017+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f713801f040 con 0x7f714806a770 2023-10-03T10:19:52.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.017+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7138044f70 con 0x7f714806a770 2023-10-03T10:19:52.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.017+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c0052e0 con 0x7f714806a770 2023-10-03T10:19:52.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.022+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f713801d020 con 0x7f714806a770 2023-10-03T10:19:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.085+0000 7f7e0f6ce700 1 Processor -- start 2023-10-03T10:19:52.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.086+0000 7f7e0f6ce700 1 -- start start 2023-10-03T10:19:52.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809d6f0 0x7f7e0809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 0x7f7e08130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 0x7f7e08130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0809f520 con 0x7f7e0809e000 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0809f130 con 0x7f7e0809d6f0 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0f6ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0809e930 con 0x7f7e0809e410 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0cc69700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 0x7f7e08130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0cc69700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 0x7f7e08130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38308/0 (socket says 172.21.15.19:38308) 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 0x7f7e08130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0cc69700 1 -- 172.21.15.19:0/3304111506 learned_addr learned my addr 172.21.15.19:0/3304111506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0d46a700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809d6f0 0x7f7e0809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809d6f0 msgr2=0x7f7e0809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809d6f0 0x7f7e0809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/3304111506 >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 msgr2=0x7f7e08130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/3304111506 >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 0x7f7e08130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.087+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/3304111506 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0809b2d0 con 0x7f7e0809e410 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 0x7f7e08130ba0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000f3a0 tx=0x7f7e0000f6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680469675337dfb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7dfffff700 1 -- 172.21.15.19:0/3304111506 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00012070 con 0x7f7e0809e410 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7dfffff700 1 -- 172.21.15.19:0/3304111506 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0000fe60 con 0x7f7e0809e410 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7dfffff700 1 -- 172.21.15.19:0/3304111506 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000d310 con 0x7f7e0809e410 2023-10-03T10:19:52.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 msgr2=0x7f7e08130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.088+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 0x7f7e08130ba0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7e0000f3a0 tx=0x7f7e0000f6b0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/3304111506 shutdown_connections 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809d6f0 0x7f7e0809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/3304111506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809e410 0x7f7e08130ba0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/3304111506 >> v2:172.21.15.19:3300/0 conn(0x7f7e0809e000 0x7f7e08130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/3304111506 >> 172.21.15.19:0/3304111506 conn(0x7f7e08066f50 msgr2=0x7f7e0809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/3304111506 shutdown_connections 2023-10-03T10:19:52.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.089+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/3304111506 wait complete. 2023-10-03T10:19:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.090+0000 7f7e0f6ce700 1 Processor -- start 2023-10-03T10:19:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.090+0000 7f7e0f6ce700 1 -- start start 2023-10-03T10:19:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809d6f0 0x7f7e0811ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 0x7f7e0811e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 0x7f7e0811e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0811fa90 con 0x7f7e0809e000 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08120ce0 con 0x7f7e0809e410 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0f6ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08120080 con 0x7f7e0809d6f0 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0cc69700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 0x7f7e0811e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0cc69700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 0x7f7e0811e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38322/0 (socket says 172.21.15.19:38322) 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0cc69700 1 -- 172.21.15.19:0/1702161033 learned_addr learned my addr 172.21.15.19:0/1702161033 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 0x7f7e0811e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.091+0000 7f7e0d46a700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809d6f0 0x7f7e0811ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809d6f0 msgr2=0x7f7e0811ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809d6f0 0x7f7e0811ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 msgr2=0x7f7e0811e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 0x7f7e0811e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 -- 172.21.15.19:0/1702161033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0000f050 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7e0dc6b700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 0x7f7e0811e950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7e00019000 tx=0x7f7e00004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00003a20 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e00003ba0 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.092+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00004050 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.093+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e08121130 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.093+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0809c700 con 0x7f7e0809e410 2023-10-03T10:19:52.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.094+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e000041b0 con 0x7f7e0809e410 2023-10-03T10:19:52.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.094+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e081217e0 con 0x7f7e0809e410 2023-10-03T10:19:52.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.094+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e00045490 con 0x7f7e0809e410 2023-10-03T10:19:52.099 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.099+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e00004460 con 0x7f7e0809e410 2023-10-03T10:19:52.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 Processor -- start 2023-10-03T10:19:52.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 -- start start 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f84d809e070 0x7f84d8133a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d806b0a0 con 0x7f84d8133f60 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d806b6d0 con 0x7f84d809e070 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.127+0000 7f84dd91a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809b1c0 con 0x7f84d809d760 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58406/0 (socket says 172.21.15.19:58406) 2023-10-03T10:19:52.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2516681064 learned_addr learned my addr 172.21.15.19:0/2516681064 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d67fc700 1 --2- 172.21.15.19:0/2516681064 >> v2:172.21.15.19:3300/0 conn(0x7f84d809e070 0x7f84d8133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2516681064 >> v2:172.21.15.19:3300/0 conn(0x7f84d809e070 msgr2=0x7f84d8133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:52.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 --2- 172.21.15.19:0/2516681064 >> v2:172.21.15.19:3300/0 conn(0x7f84d809e070 0x7f84d8133a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2516681064 >> v1:172.21.15.19:6789/0 conn(0x7f84d8133f60 legacy=0x7f84d813ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2516681064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d806b490 con 0x7f84d809d760 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.128+0000 7f84d6ffd700 1 --2- 172.21.15.19:0/2516681064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f84c80098f0 tx=0x7f84c8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdbe639546022021 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84d5ffb700 1 -- 172.21.15.19:0/2516681064 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8011830 con 0x7f84d809d760 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84d5ffb700 1 -- 172.21.15.19:0/2516681064 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c8011990 con 0x7f84d809d760 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84d5ffb700 1 -- 172.21.15.19:0/2516681064 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8011d20 con 0x7f84d809d760 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 -- 172.21.15.19:0/2516681064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 msgr2=0x7f84d809db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 --2- 172.21.15.19:0/2516681064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f84c80098f0 tx=0x7f84c8009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 -- 172.21.15.19:0/2516681064 shutdown_connections 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 --2- 172.21.15.19:0/2516681064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d809db30 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 --2- 172.21.15.19:0/2516681064 >> v2:172.21.15.19:3300/0 conn(0x7f84d809e070 0x7f84d8133a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 -- 172.21.15.19:0/2516681064 >> 172.21.15.19:0/2516681064 conn(0x7f84d8066f50 msgr2=0x7f84d80a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.129+0000 7f84dd91a700 1 -- 172.21.15.19:0/2516681064 shutdown_connections 2023-10-03T10:19:52.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.130+0000 7f84dd91a700 1 -- 172.21.15.19:0/2516681064 wait complete. 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 Processor -- start 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 -- start start 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809e070 0x7f84d8127aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d8133f60 0x7f84d8127fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d812ab80 con 0x7f84d809e070 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d809c6f0 con 0x7f84d8133f60 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.131+0000 7f84dd91a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f84d812a8c0 con 0x7f84d809d760 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58416/0 (socket says 172.21.15.19:58416) 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2011379975 learned_addr learned my addr 172.21.15.19:0/2011379975 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d67fc700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809e070 0x7f84d8127aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d8133f60 msgr2=0x7f84d8127fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d8133f60 0x7f84d8127fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809e070 msgr2=0x7f84d8127aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809e070 0x7f84d8127aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 -- 172.21.15.19:0/2011379975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c8009550 con 0x7f84d809d760 2023-10-03T10:19:52.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84d6ffd700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009c40 tx=0x7f84c8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8004480 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c801f070 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84dd91a700 1 -- 172.21.15.19:0/2011379975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d809a620 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c80038c0 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.132+0000 7f84dd91a700 1 -- 172.21.15.19:0/2011379975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d8129bc0 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.134+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b00052e0 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.134+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f84c8021030 con 0x7f84d809d760 2023-10-03T10:19:52.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.134+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f84c8040e90 con 0x7f84d809d760 2023-10-03T10:19:52.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.139+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f84c80199a0 con 0x7f84d809d760 2023-10-03T10:19:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.233+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f11200a28e0 con 0x7f11200a0a30 2023-10-03T10:19:52.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.234+0000 7f111d7fa700 1 -- 172.21.15.19:0/3600914950 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f111402a090 con 0x7f11200a0a30 2023-10-03T10:19:52.233 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 msgr2=0x7f1120120080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f111400e810 tx=0x7f111400eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 shutdown_connections 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1120133fa0 0x7f1120120b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f11200a0a30 0x7f1120120080 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 --2- 172.21.15.19:0/3600914950 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f11200a1340 0x7f11201205c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 >> 172.21.15.19:0/3600914950 conn(0x7f11200a6550 msgr2=0x7f11201baf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 shutdown_connections 2023-10-03T10:19:52.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.236+0000 7f112717a700 1 -- 172.21.15.19:0/3600914950 wait complete. 2023-10-03T10:19:52.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:52.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.287+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f712c005590 con 0x7f714806a770 2023-10-03T10:19:52.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.288+0000 7f7136ffd700 1 -- 172.21.15.19:0/772756265 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7138031070 con 0x7f714806a770 2023-10-03T10:19:52.287 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 msgr2=0x7f714811e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714811e4c0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f713801a000 tx=0x7f7138004750 comp rx=0 tx=0).stop 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 shutdown_connections 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7148131b40 0x7f714811ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f714806a770 0x7f714811e4c0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 --2- 172.21.15.19:0/772756265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f714806b080 0x7f714811ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 >> 172.21.15.19:0/772756265 conn(0x7f7148066f50 msgr2=0x7f71480a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 shutdown_connections 2023-10-03T10:19:52.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.290+0000 7f714caef700 1 -- 172.21.15.19:0/772756265 wait complete. 2023-10-03T10:19:52.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:52.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.345+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f84b0005860 con 0x7f84d809d760 2023-10-03T10:19:52.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.345+0000 7f84bffff700 1 -- 172.21.15.19:0/2011379975 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f84c801b430 con 0x7f84d809d760 2023-10-03T10:19:52.345 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 msgr2=0x7f84d8127560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009c40 tx=0x7f84c8004750 comp rx=0 tx=0).stop 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 shutdown_connections 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f84d8133f60 0x7f84d8127fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f84d809d760 0x7f84d8127560 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 --2- 172.21.15.19:0/2011379975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f84d809e070 0x7f84d8127aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 >> 172.21.15.19:0/2011379975 conn(0x7f84d8066f50 msgr2=0x7f84d80a0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 shutdown_connections 2023-10-03T10:19:52.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.348+0000 7f84bdffb700 1 -- 172.21.15.19:0/2011379975 wait complete. 2023-10-03T10:19:52.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.351+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e08074ea0 con 0x7f7e0809e410 2023-10-03T10:19:52.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.352+0000 7f7dfdffb700 1 -- 172.21.15.19:0/1702161033 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e000163f0 con 0x7f7e0809e410 2023-10-03T10:19:52.352 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 msgr2=0x7f7e0811e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 0x7f7e0811e950 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7e00019000 tx=0x7f7e00004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 shutdown_connections 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0809e410 0x7f7e0811e950 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0809d6f0 0x7f7e0811ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 --2- 172.21.15.19:0/1702161033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0809e000 0x7f7e0811e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 >> 172.21.15.19:0/1702161033 conn(0x7f7e08066f50 msgr2=0x7f7e08070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 shutdown_connections 2023-10-03T10:19:52.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:52.354+0000 7f7e0f6ce700 1 -- 172.21.15.19:0/1702161033 wait complete. 2023-10-03T10:19:52.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:52.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:53.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:53.305 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:53.363 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:53.369 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:53.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.399+0000 7ff9aba53700 1 Processor -- start 2023-10-03T10:19:53.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 -- start start 2023-10-03T10:19:53.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9a4133420 0x7ff9a41337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a406b990 con 0x7ff9a4133e30 2023-10-03T10:19:53.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a40a0590 con 0x7ff9a4133420 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9aba53700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a409fb80 con 0x7ff9a4134260 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9a9ff0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9a97ef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9a4133420 0x7ff9a41337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9a9ff0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58428/0 (socket says 172.21.15.19:58428) 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.400+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/3533715789 learned_addr learned my addr 172.21.15.19:0/3533715789 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/3533715789 >> v2:172.21.15.19:3300/0 conn(0x7ff9a4133420 msgr2=0x7ff9a41337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff9a9ff0700 1 --2- 172.21.15.19:0/3533715789 >> v2:172.21.15.19:3300/0 conn(0x7ff9a4133420 0x7ff9a41337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/3533715789 >> v1:172.21.15.19:6789/0 conn(0x7ff9a4133e30 legacy=0x7ff9a412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/3533715789 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40a0030 con 0x7ff9a4134260 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff9a9ff0700 1 --2- 172.21.15.19:0/3533715789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009e50 tx=0x7ff99c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241abd859eb6c16c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff99bfff700 1 -- 172.21.15.19:0/3533715789 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00e070 con 0x7ff9a4134260 2023-10-03T10:19:53.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff99bfff700 1 -- 172.21.15.19:0/3533715789 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00b910 con 0x7ff9a4134260 2023-10-03T10:19:53.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.401+0000 7ff99bfff700 1 -- 172.21.15.19:0/3533715789 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00bcc0 con 0x7ff9a4134260 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 -- 172.21.15.19:0/3533715789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 msgr2=0x7ff9a41306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 --2- 172.21.15.19:0/3533715789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009e50 tx=0x7ff99c00b330 comp rx=0 tx=0).stop 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 -- 172.21.15.19:0/3533715789 shutdown_connections 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 --2- 172.21.15.19:0/3533715789 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4134260 0x7ff9a41306a0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 --2- 172.21.15.19:0/3533715789 >> v2:172.21.15.19:3300/0 conn(0x7ff9a4133420 0x7ff9a41337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 -- 172.21.15.19:0/3533715789 >> 172.21.15.19:0/3533715789 conn(0x7ff9a40a4210 msgr2=0x7ff9a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 -- 172.21.15.19:0/3533715789 shutdown_connections 2023-10-03T10:19:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.402+0000 7ff9aba53700 1 -- 172.21.15.19:0/3533715789 wait complete. 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.403+0000 7ff9aba53700 1 Processor -- start 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.403+0000 7ff9aba53700 1 -- start start 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 0x7ff9a409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 0x7ff9a409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a411fc20 con 0x7ff9a4133e30 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a411fee0 con 0x7ff9a4134260 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9aba53700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a411f910 con 0x7ff9a4133420 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9a9ff0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9a97ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 0x7ff9a409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9a9ff0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39108/0 (socket says 172.21.15.19:39108) 2023-10-03T10:19:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/2107459944 learned_addr learned my addr 172.21.15.19:0/2107459944 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.404+0000 7ff9a8fee700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 0x7ff9a409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 msgr2=0x7ff9a409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 0x7ff9a409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 msgr2=0x7ff9a409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 0x7ff9a409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 -- 172.21.15.19:0/2107459944 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c009b30 con 0x7ff9a4134260 2023-10-03T10:19:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a97ef700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 0x7ff9a409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a8fee700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 0x7ff9a409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9a9ff0700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff99c012000 tx=0x7ff99c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c004800 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c004960 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c01c680 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.405+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a4120950 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.406+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a412dab0 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.407+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff99c01c7e0 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.407+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff99c040e70 con 0x7ff9a4134260 2023-10-03T10:19:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.407+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a412dc70 con 0x7ff9a4134260 2023-10-03T10:19:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.413+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff99c0123f0 con 0x7ff9a4134260 2023-10-03T10:19:53.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.452+0000 7f726e09e700 1 Processor -- start 2023-10-03T10:19:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 -- start start 2023-10-03T10:19:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f726806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726809e130 con 0x7f726806acb0 2023-10-03T10:19:53.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72681312b0 con 0x7f72681316c0 2023-10-03T10:19:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f726e09e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726809f6e0 con 0x7f726809d9f0 2023-10-03T10:19:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f7267fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f726806acb0 0x7f7268138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48684/0 (socket says 172.21.15.19:48684) 2023-10-03T10:19:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f72677fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f7267fff700 1 -- 172.21.15.19:0/2527961849 learned_addr learned my addr 172.21.15.19:0/2527961849 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:53.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.453+0000 7f7266ffd700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f726806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72677fe700 1 -- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 msgr2=0x7f726806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72677fe700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f726806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72667fc700 1 -- 172.21.15.19:0/2527961849 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707880070 0 0) 0x7f7260001490 con 0x7f726806acb0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72677fe700 1 -- 172.21.15.19:0/2527961849 >> v1:172.21.15.19:6789/0 conn(0x7f726806acb0 legacy=0x7f7268138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72677fe700 1 -- 172.21.15.19:0/2527961849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726809e760 con 0x7f72681316c0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72677fe700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268131a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f7258009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80deb3f536a48d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72667fc700 1 -- 172.21.15.19:0/2527961849 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011830 con 0x7f72681316c0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72667fc700 1 -- 172.21.15.19:0/2527961849 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258011990 con 0x7f72681316c0 2023-10-03T10:19:53.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.454+0000 7f72667fc700 1 -- 172.21.15.19:0/2527961849 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258011d20 con 0x7f72681316c0 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 -- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 msgr2=0x7f7268131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268131a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f7258009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 -- 172.21.15.19:0/2527961849 shutdown_connections 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268131a90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 --2- 172.21.15.19:0/2527961849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f726806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 -- 172.21.15.19:0/2527961849 >> 172.21.15.19:0/2527961849 conn(0x7f7268066f50 msgr2=0x7f726809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.455+0000 7f726e09e700 1 -- 172.21.15.19:0/2527961849 shutdown_connections 2023-10-03T10:19:53.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.456+0000 7f726e09e700 1 -- 172.21.15.19:0/2527961849 wait complete. 2023-10-03T10:19:53.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.457+0000 7f726e09e700 1 Processor -- start 2023-10-03T10:19:53.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.457+0000 7f726e09e700 1 -- start start 2023-10-03T10:19:53.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f7268070f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726809c040 con 0x7f726806acb0 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7268130ac0 con 0x7f72681316c0 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f726e09e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f726812b900 con 0x7f726809d9f0 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f72677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f72677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38356/0 (socket says 172.21.15.19:38356) 2023-10-03T10:19:53.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f72677fe700 1 -- 172.21.15.19:0/1834689160 learned_addr learned my addr 172.21.15.19:0/1834689160 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f7267fff700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.458+0000 7f7266ffd700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f7268070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 -- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 msgr2=0x7f7268070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f7268070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 -- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 msgr2=0x7f7268071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 -- 172.21.15.19:0/1834689160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580094a0 con 0x7f726806acb0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f72677fe700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258026070 con 0x7f726806acb0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258011dd0 con 0x7f726806acb0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726811dff0 con 0x7f726806acb0 2023-10-03T10:19:53.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258004280 con 0x7f726806acb0 2023-10-03T10:19:53.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.459+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7268072620 con 0x7f726806acb0 2023-10-03T10:19:53.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.460+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f72580043e0 con 0x7f726806acb0 2023-10-03T10:19:53.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.461+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7268074ea0 con 0x7f726806acb0 2023-10-03T10:19:53.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.461+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7258010dd0 con 0x7f726806acb0 2023-10-03T10:19:53.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.466+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7258030020 con 0x7f726806acb0 2023-10-03T10:19:53.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 Processor -- start 2023-10-03T10:19:53.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 -- start start 2023-10-03T10:19:53.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d7413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d7409b120 con 0x7f3d7409d6f0 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7406b460 con 0x7f3d7409e1d0 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d7a9bb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7409a7e0 con 0x7f3d74139170 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.511+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39144/0 (socket says 172.21.15.19:39144) 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 -- 172.21.15.19:0/2347278910 learned_addr learned my addr 172.21.15.19:0/2347278910 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d73fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3d7409d6f0 0x7f3d7409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48696/0 (socket says 172.21.15.19:48696) 2023-10-03T10:19:53.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d78f58700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d7413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 -- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 msgr2=0x7f3d7413b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d7413b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 -- 172.21.15.19:0/2347278910 >> v1:172.21.15.19:6789/0 conn(0x7f3d7409d6f0 legacy=0x7f3d7409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 -- 172.21.15.19:0/2347278910 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7409a500 con 0x7f3d7409e1d0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d72ffd700 1 -- 172.21.15.19:0/2347278910 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528191916 0 0) 0x7f3d7409b120 con 0x7f3d7409d6f0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d78f58700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d7413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.512+0000 7f3d737fe700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009920 tx=0x7f3d68009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4adf8a3c088d3a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d72ffd700 1 -- 172.21.15.19:0/2347278910 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68011830 con 0x7f3d7409e1d0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d72ffd700 1 -- 172.21.15.19:0/2347278910 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68011990 con 0x7f3d7409e1d0 2023-10-03T10:19:53.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d72ffd700 1 -- 172.21.15.19:0/2347278910 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68011d20 con 0x7f3d7409e1d0 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 msgr2=0x7f3d74138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009920 tx=0x7f3d68009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/2347278910 shutdown_connections 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d7413b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/2347278910 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409e1d0 0x7f3d74138c30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/2347278910 >> 172.21.15.19:0/2347278910 conn(0x7f3d74066f50 msgr2=0x7f3d7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.513+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/2347278910 shutdown_connections 2023-10-03T10:19:53.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.514+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/2347278910 wait complete. 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.515+0000 7f3d7a9bb700 1 Processor -- start 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.515+0000 7f3d7a9bb700 1 -- start start 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409d6f0 0x7f3d741206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d74121170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741361d0 con 0x7f3d7409e1d0 2023-10-03T10:19:53.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74123c20 con 0x7f3d7409d6f0 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d7a9bb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741223c0 con 0x7f3d74139170 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38366/0 (socket says 172.21.15.19:38366) 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d737fe700 1 -- 172.21.15.19:0/3255806788 learned_addr learned my addr 172.21.15.19:0/3255806788 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d73fff700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409d6f0 0x7f3d741206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.516+0000 7f3d78f58700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d74121170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 -- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 msgr2=0x7f3d74121170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d74121170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 -- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409d6f0 msgr2=0x7f3d741206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409d6f0 0x7f3d741206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 -- 172.21.15.19:0/3255806788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c009a70 con 0x7f3d7409e1d0 2023-10-03T10:19:53.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d737fe700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009c70 tx=0x7f3d68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68004240 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6801f070 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d68009550 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d680045a0 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.517+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d74123ee0 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.518+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d74123940 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.519+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3d68021030 con 0x7f3d7409e1d0 2023-10-03T10:19:53.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.519+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3d68003930 con 0x7f3d7409e1d0 2023-10-03T10:19:53.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.528+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3d6801a450 con 0x7f3d7409e1d0 2023-10-03T10:19:53.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.559+0000 7f838c11b700 1 Processor -- start 2023-10-03T10:19:53.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.559+0000 7f838c11b700 1 -- start start 2023-10-03T10:19:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f838c11b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 0x7f838409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f838c11b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 0x7f8384130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f838c11b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838409f130 con 0x7f838409e410 2023-10-03T10:19:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f838c11b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838409f520 con 0x7f838409d6f0 2023-10-03T10:19:53.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f838c11b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838409e930 con 0x7f838409e000 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f8389eb7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 0x7f838409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f83896b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 0x7f8384130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f8389eb7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 0x7f838409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38372/0 (socket says 172.21.15.19:38372) 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f8389eb7700 1 -- 172.21.15.19:0/2850448993 learned_addr learned my addr 172.21.15.19:0/2850448993 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f83896b6700 1 -- 172.21.15.19:0/2850448993 >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 msgr2=0x7f838409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f83896b6700 1 --2- 172.21.15.19:0/2850448993 >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 0x7f838409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f83896b6700 1 -- 172.21.15.19:0/2850448993 >> v1:172.21.15.19:6789/0 conn(0x7f838409e410 legacy=0x7f8384130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.560+0000 7f83896b6700 1 -- 172.21.15.19:0/2850448993 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838409b2d0 con 0x7f838409e000 2023-10-03T10:19:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.561+0000 7f83896b6700 1 --2- 172.21.15.19:0/2850448993 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 0x7f8384130660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8374009840 tx=0x7f8374009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75adca9cf2eca956 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.561+0000 7f8388eb5700 1 -- 172.21.15.19:0/2850448993 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374011830 con 0x7f838409e000 2023-10-03T10:19:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.561+0000 7f8388eb5700 1 -- 172.21.15.19:0/2850448993 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8374011990 con 0x7f838409e000 2023-10-03T10:19:53.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.561+0000 7f8388eb5700 1 -- 172.21.15.19:0/2850448993 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374011d20 con 0x7f838409e000 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 -- 172.21.15.19:0/2850448993 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 msgr2=0x7f8384130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 --2- 172.21.15.19:0/2850448993 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 0x7f8384130660 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8374009840 tx=0x7f8374009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 -- 172.21.15.19:0/2850448993 shutdown_connections 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 --2- 172.21.15.19:0/2850448993 >> v2:172.21.15.19:3300/0 conn(0x7f838409d6f0 0x7f838409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 --2- 172.21.15.19:0/2850448993 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409e000 0x7f8384130660 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 -- 172.21.15.19:0/2850448993 >> 172.21.15.19:0/2850448993 conn(0x7f8384066f50 msgr2=0x7f838409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 -- 172.21.15.19:0/2850448993 shutdown_connections 2023-10-03T10:19:53.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.562+0000 7f838c11b700 1 -- 172.21.15.19:0/2850448993 wait complete. 2023-10-03T10:19:53.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 Processor -- start 2023-10-03T10:19:53.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 -- start start 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838409e000 0x7f83841c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e410 0x7f83841c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841364e0 con 0x7f838409e410 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83841367b0 con 0x7f838409d6f0 2023-10-03T10:19:53.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f838c11b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f83840725a0 con 0x7f838409e000 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.564+0000 7f8389eb7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39170/0 (socket says 172.21.15.19:39170) 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 -- 172.21.15.19:0/1358038073 learned_addr learned my addr 172.21.15.19:0/1358038073 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f838a6b8700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e410 0x7f83841c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f83896b6700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838409e000 0x7f83841c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 -- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838409e000 msgr2=0x7f83841c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838409e000 0x7f83841c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 -- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e410 msgr2=0x7f83841c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e410 0x7f83841c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 -- 172.21.15.19:0/1358038073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740094a0 con 0x7f838409d6f0 2023-10-03T10:19:53.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f8389eb7700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f838000e910 tx=0x7f838000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:53.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800096a0 con 0x7f838409d6f0 2023-10-03T10:19:53.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838000c850 con 0x7f838409d6f0 2023-10-03T10:19:53.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.565+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000cc00 con 0x7f838409d6f0 2023-10-03T10:19:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.566+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838413b720 con 0x7f838409d6f0 2023-10-03T10:19:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.566+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8384137910 con 0x7f838409d6f0 2023-10-03T10:19:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.567+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f838000cd60 con 0x7f838409d6f0 2023-10-03T10:19:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.567+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f838003fc20 con 0x7f838409d6f0 2023-10-03T10:19:53.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.567+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8384131290 con 0x7f838409d6f0 2023-10-03T10:19:53.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.573+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8384131290 con 0x7f838409d6f0 2023-10-03T10:19:53.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.668+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9a4074ea0 con 0x7ff9a4134260 2023-10-03T10:19:53.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.668+0000 7ff999ffb700 1 -- 172.21.15.19:0/2107459944 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff99c033090 con 0x7ff9a4134260 2023-10-03T10:19:53.668 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 msgr2=0x7ff9a409cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff99c012000 tx=0x7ff99c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 shutdown_connections 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9a4134260 0x7ff9a409cf00 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9a4133420 0x7ff9a409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 --2- 172.21.15.19:0/2107459944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9a4133e30 0x7ff9a409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.670+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 >> 172.21.15.19:0/2107459944 conn(0x7ff9a40a4210 msgr2=0x7ff9a40a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.671+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 shutdown_connections 2023-10-03T10:19:53.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.671+0000 7ff9aba53700 1 -- 172.21.15.19:0/2107459944 wait complete. 2023-10-03T10:19:53.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:53.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.687+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f726806c360 con 0x7f726806acb0 2023-10-03T10:19:53.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.687+0000 7f724ffff700 1 -- 172.21.15.19:0/1834689160 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7258015070 con 0x7f726806acb0 2023-10-03T10:19:53.687 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.689+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 msgr2=0x7f7268070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.689+0000 7f726e09e700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f7258009840 tx=0x7f7258004750 comp rx=0 tx=0).stop 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 shutdown_connections 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f72681316c0 0x7f7268071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f726806acb0 0x7f7268070a10 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 --2- 172.21.15.19:0/1834689160 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f726809d9f0 0x7f7268070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 >> 172.21.15.19:0/1834689160 conn(0x7f7268066f50 msgr2=0x7f72680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 shutdown_connections 2023-10-03T10:19:53.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.690+0000 7f726e09e700 1 -- 172.21.15.19:0/1834689160 wait complete. 2023-10-03T10:19:53.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.751+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3d7406c360 con 0x7f3d7409e1d0 2023-10-03T10:19:53.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.751+0000 7f3d70ff9700 1 -- 172.21.15.19:0/3255806788 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3d680233d0 con 0x7f3d7409e1d0 2023-10-03T10:19:53.751 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 msgr2=0x7f3d74120c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009c70 tx=0x7f3d68004750 comp rx=0 tx=0).stop 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 shutdown_connections 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3d74139170 0x7f3d74121170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3d7409d6f0 0x7f3d741206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 --2- 172.21.15.19:0/3255806788 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3d7409e1d0 0x7f3d74120c30 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 >> 172.21.15.19:0/3255806788 conn(0x7f3d74066f50 msgr2=0x7f3d74136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 shutdown_connections 2023-10-03T10:19:53.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.754+0000 7f3d7a9bb700 1 -- 172.21.15.19:0/3255806788 wait complete. 2023-10-03T10:19:53.767 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:53.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.819+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8384131290 con 0x7f838409d6f0 2023-10-03T10:19:53.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.819+0000 7f837a7fc700 1 -- 172.21.15.19:0/1358038073 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8384131290 con 0x7f838409d6f0 2023-10-03T10:19:53.819 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 msgr2=0x7f83841c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f838000e910 tx=0x7f838000ecd0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 shutdown_connections 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f838409e410 0x7f83841c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f838409d6f0 0x7f83841c88e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 --2- 172.21.15.19:0/1358038073 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f838409e000 0x7f83841c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.821+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 >> 172.21.15.19:0/1358038073 conn(0x7f8384066f50 msgr2=0x7f83840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.822+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 shutdown_connections 2023-10-03T10:19:53.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:53.822+0000 7f838c11b700 1 -- 172.21.15.19:0/1358038073 wait complete. 2023-10-03T10:19:53.834 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:54.686 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:54.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:54.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:54.835 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.836+0000 7fd2683fe700 1 Processor -- start 2023-10-03T10:19:54.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.836+0000 7fd2683fe700 1 -- start start 2023-10-03T10:19:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd2683fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd26009d6f0 0x7fd26009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd2683fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd2683fe700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26009b120 con 0x7fd26009e410 2023-10-03T10:19:54.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd2683fe700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26006b460 con 0x7fd26009d6f0 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd2683fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd26009a7e0 con 0x7fd26009e000 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd26619a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd26009d6f0 0x7fd26009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd26699b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd26009e410 0x7fd260133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48710/0 (socket says 172.21.15.19:48710) 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.837+0000 7fd26699b700 1 -- 172.21.15.19:0/3063334840 learned_addr learned my addr 172.21.15.19:0/3063334840 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265999700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265198700 1 -- 172.21.15.19:0/3063334840 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877737910 0 0) 0x7fd26009b120 con 0x7fd26009e410 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265198700 1 -- 172.21.15.19:0/3063334840 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd24c0035b0 con 0x7fd26009e410 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd26619a700 1 -- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 msgr2=0x7fd2601339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd26619a700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd26619a700 1 -- 172.21.15.19:0/3063334840 >> v1:172.21.15.19:6789/0 conn(0x7fd26009e410 legacy=0x7fd260133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd26619a700 1 -- 172.21.15.19:0/3063334840 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26009a500 con 0x7fd26009d6f0 2023-10-03T10:19:54.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265999700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd26619a700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009d6f0 0x7fd26009dac0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009840 tx=0x7fd25c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9db1cc5f91302c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265198700 1 -- 172.21.15.19:0/3063334840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c011830 con 0x7fd26009d6f0 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265198700 1 -- 172.21.15.19:0/3063334840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25c011990 con 0x7fd26009d6f0 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.838+0000 7fd265198700 1 -- 172.21.15.19:0/3063334840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25c011d00 con 0x7fd26009d6f0 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 -- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009d6f0 msgr2=0x7fd26009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009d6f0 0x7fd26009dac0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009840 tx=0x7fd25c009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 -- 172.21.15.19:0/3063334840 shutdown_connections 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009d6f0 0x7fd26009dac0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3063334840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 -- 172.21.15.19:0/3063334840 >> 172.21.15.19:0/3063334840 conn(0x7fd260066f50 msgr2=0x7fd26009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 -- 172.21.15.19:0/3063334840 shutdown_connections 2023-10-03T10:19:54.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.839+0000 7fd2683fe700 1 -- 172.21.15.19:0/3063334840 wait complete. 2023-10-03T10:19:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.840+0000 7fd2683fe700 1 Processor -- start 2023-10-03T10:19:54.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.840+0000 7fd2683fe700 1 -- start start 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd26009d6f0 0x7fd2601a52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 0x7fd2601c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601a5d20 con 0x7fd26009e410 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601a4db0 con 0x7fd26009e000 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd2683fe700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd2601a83e0 con 0x7fd26009d6f0 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd265999700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd265999700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39174/0 (socket says 172.21.15.19:39174) 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd265999700 1 -- 172.21.15.19:0/3178776818 learned_addr learned my addr 172.21.15.19:0/3178776818 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd26699b700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 0x7fd2601c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.841+0000 7fd26699b700 1 -- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd26009d6f0 msgr2=0x7fd2601a52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd26699b700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd26009d6f0 0x7fd2601a52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd26699b700 1 -- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 msgr2=0x7fd2601a57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd26699b700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd26699b700 1 -- 172.21.15.19:0/3178776818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2500094a0 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd265999700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd26699b700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 0x7fd2601c7f40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd25800ca80 tx=0x7fd25800cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25800a9e0 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25800ab40 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25c0094a0 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd258012400 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.842+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2600a2db0 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.843+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd25801b3b0 con 0x7fd26009e410 2023-10-03T10:19:54.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.843+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260074ea0 con 0x7fd26009e410 2023-10-03T10:19:54.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.843+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd25803f2b0 con 0x7fd26009e410 2023-10-03T10:19:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.853+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd2580192c0 con 0x7fd26009e410 2023-10-03T10:19:54.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.878+0000 7f7daaeba700 1 Processor -- start 2023-10-03T10:19:54.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.878+0000 7f7daaeba700 1 -- start start 2023-10-03T10:19:54.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7daaeba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7da406b250 0x7f7da4136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7daaeba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 0x7f7da4139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7daaeba700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da409ece0 con 0x7f7da406a770 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7daaeba700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da409e760 con 0x7f7da406b250 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7daaeba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da409e040 con 0x7f7da4136d80 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da9457700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 0x7f7da4139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da9457700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 0x7f7da4139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39184/0 (socket says 172.21.15.19:39184) 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da9457700 1 -- 172.21.15.19:0/3403200130 learned_addr learned my addr 172.21.15.19:0/3403200130 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da3fff700 1 --2- 172.21.15.19:0/3403200130 >> v2:172.21.15.19:3300/0 conn(0x7f7da406b250 0x7f7da4136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da3fff700 1 -- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 msgr2=0x7f7da4139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da3fff700 1 --2- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 0x7f7da4139160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da3fff700 1 -- 172.21.15.19:0/3403200130 >> v1:172.21.15.19:6789/0 conn(0x7f7da406a770 legacy=0x7f7da406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.879+0000 7f7da3fff700 1 -- 172.21.15.19:0/3403200130 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da409f630 con 0x7f7da406b250 2023-10-03T10:19:54.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.880+0000 7f7da3fff700 1 --2- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406b250 0x7f7da4136840 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009840 tx=0x7f7d90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbe3edf892ded9c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.881+0000 7f7da37fe700 1 -- 172.21.15.19:0/3403200130 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011830 con 0x7f7da406b250 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.881+0000 7f7da37fe700 1 -- 172.21.15.19:0/3403200130 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d90011990 con 0x7f7da406b250 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.881+0000 7f7da37fe700 1 -- 172.21.15.19:0/3403200130 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d90011d20 con 0x7f7da406b250 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.881+0000 7f7daaeba700 1 -- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406b250 msgr2=0x7f7da4136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.881+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406b250 0x7f7da4136840 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f7d90009840 tx=0x7f7d90009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 -- 172.21.15.19:0/3403200130 shutdown_connections 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da4136d80 0x7f7da4139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3403200130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406b250 0x7f7da4136840 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 -- 172.21.15.19:0/3403200130 >> 172.21.15.19:0/3403200130 conn(0x7f7da4066f50 msgr2=0x7f7da409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 -- 172.21.15.19:0/3403200130 shutdown_connections 2023-10-03T10:19:54.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.882+0000 7f7daaeba700 1 -- 172.21.15.19:0/3403200130 wait complete. 2023-10-03T10:19:54.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.883+0000 7f7daaeba700 1 Processor -- start 2023-10-03T10:19:54.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.883+0000 7f7daaeba700 1 -- start start 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 0x7f7da411cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 0x7f7da411d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da411cb50 con 0x7f7da406a770 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da406e8e0 con 0x7f7da406b250 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7daaeba700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7da411fad0 con 0x7f7da4136d80 2023-10-03T10:19:54.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7da9457700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7da9457700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58494/0 (socket says 172.21.15.19:58494) 2023-10-03T10:19:54.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7da9457700 1 -- 172.21.15.19:0/3555298989 learned_addr learned my addr 172.21.15.19:0/3555298989 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.884+0000 7f7da8c56700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 0x7f7da411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da3fff700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 0x7f7da411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 -- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 msgr2=0x7f7da411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 0x7f7da411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 -- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 msgr2=0x7f7da411cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 0x7f7da411cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 -- 172.21.15.19:0/3555298989 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d900094a0 con 0x7f7da4136d80 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da8c56700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 0x7f7da411cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da3fff700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 0x7f7da411d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da9457700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00efc0 tx=0x7f7d9c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c003c20 con 0x7f7da4136d80 2023-10-03T10:19:54.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da411d9b0 con 0x7f7da4136d80 2023-10-03T10:19:54.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9c00f040 con 0x7f7da4136d80 2023-10-03T10:19:54.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00c930 con 0x7f7da4136d80 2023-10-03T10:19:54.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.885+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da4071eb0 con 0x7f7da4136d80 2023-10-03T10:19:54.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.887+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d9c00ca90 con 0x7f7da4136d80 2023-10-03T10:19:54.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.887+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da4074ea0 con 0x7f7da4136d80 2023-10-03T10:19:54.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.887+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d9c03fcb0 con 0x7f7da4136d80 2023-10-03T10:19:54.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.892+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d9c014440 con 0x7f7da4136d80 2023-10-03T10:19:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.954+0000 7fa7a59c9700 1 Processor -- start 2023-10-03T10:19:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.954+0000 7fa7a59c9700 1 -- start start 2023-10-03T10:19:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa7a59c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009d6f0 0x7fa7a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa7a59c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa7a59c9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a009f130 con 0x7fa7a009e410 2023-10-03T10:19:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa7a59c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a009f520 con 0x7fa7a009d6f0 2023-10-03T10:19:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa7a59c9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a009e930 con 0x7fa7a009e000 2023-10-03T10:19:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa79e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa79e7fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58508/0 (socket says 172.21.15.19:58508) 2023-10-03T10:19:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa79e7fc700 1 -- 172.21.15.19:0/165432605 learned_addr learned my addr 172.21.15.19:0/165432605 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.955+0000 7fa79effd700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009d6f0 0x7fa7a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79e7fc700 1 -- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009d6f0 msgr2=0x7fa7a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79e7fc700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009d6f0 0x7fa7a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79e7fc700 1 -- 172.21.15.19:0/165432605 >> v1:172.21.15.19:6789/0 conn(0x7fa7a009e410 legacy=0x7fa7a0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79e7fc700 1 -- 172.21.15.19:0/165432605 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a009b2d0 con 0x7fa7a009e000 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79e7fc700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa794009950 tx=0x7fa794009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2198fe930081828 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79dffb700 1 -- 172.21.15.19:0/165432605 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011830 con 0x7fa7a009e000 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79dffb700 1 -- 172.21.15.19:0/165432605 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa794011990 con 0x7fa7a009e000 2023-10-03T10:19:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.956+0000 7fa79dffb700 1 -- 172.21.15.19:0/165432605 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794011d40 con 0x7fa7a009e000 2023-10-03T10:19:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 -- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 msgr2=0x7fa7a0130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa794009950 tx=0x7fa794009c60 comp rx=0 tx=0).stop 2023-10-03T10:19:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 -- 172.21.15.19:0/165432605 shutdown_connections 2023-10-03T10:19:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009d6f0 0x7fa7a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/165432605 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a0130660 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 -- 172.21.15.19:0/165432605 >> 172.21.15.19:0/165432605 conn(0x7fa7a0066f50 msgr2=0x7fa7a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 -- 172.21.15.19:0/165432605 shutdown_connections 2023-10-03T10:19:54.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.957+0000 7fa7a59c9700 1 -- 172.21.15.19:0/165432605 wait complete. 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.959+0000 7fa7a59c9700 1 Processor -- start 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.959+0000 7fa7a59c9700 1 -- start start 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a00706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 0x7fa7a0070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.960 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0125fa0 con 0x7fa7a009d6f0 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a0071d90 con 0x7fa7a009e410 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa7a59c9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a006e840 con 0x7fa7a009e000 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa79effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa79effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38450/0 (socket says 172.21.15.19:38450) 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa79effd700 1 -- 172.21.15.19:0/4033434157 learned_addr learned my addr 172.21.15.19:0/4033434157 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.961 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa79f7fe700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 0x7fa7a0070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.960+0000 7fa79e7fc700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a00706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 -- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 msgr2=0x7fa7a00706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.962 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a00706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 -- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 msgr2=0x7fa7a0070180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 -- 172.21.15.19:0/4033434157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009550 con 0x7fa7a009e410 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79effd700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79e7fc700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a00706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa79f7fe700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 0x7fa7a0070c00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa79800cb90 tx=0x7fa79800cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa798003c00 con 0x7fa7a009e410 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa798003d60 con 0x7fa7a009e410 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a009c700 con 0x7fa7a009e410 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79800aaa0 con 0x7fa7a009e410 2023-10-03T10:19:54.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.961+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a0124880 con 0x7fa7a009e410 2023-10-03T10:19:54.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.962+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa79800ac00 con 0x7fa7a009e410 2023-10-03T10:19:54.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.963+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa79803f640 con 0x7fa7a009e410 2023-10-03T10:19:54.964 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.963+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a0125940 con 0x7fa7a009e410 2023-10-03T10:19:54.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.973+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa7a0125940 con 0x7fa7a009e410 2023-10-03T10:19:54.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.985+0000 7faa005fa700 1 Processor -- start 2023-10-03T10:19:54.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.986+0000 7faa005fa700 1 -- start start 2023-10-03T10:19:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7faa005fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809e930 0x7fa9f809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7faa005fa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7faa005fa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f8070940 con 0x7fa9f809f240 2023-10-03T10:19:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7faa005fa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f806fd60 con 0x7fa9f809f650 2023-10-03T10:19:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7faa005fa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f806fa80 con 0x7fa9f809e930 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39220/0 (socket says 172.21.15.19:39220) 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 -- 172.21.15.19:0/1971366515 learned_addr learned my addr 172.21.15.19:0/1971366515 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9fe396700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809e930 0x7fa9f809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 -- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809e930 msgr2=0x7fa9f809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809e930 0x7fa9f809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 -- 172.21.15.19:0/1971366515 >> v1:172.21.15.19:6789/0 conn(0x7fa9f809f240 legacy=0x7fa9f81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 -- 172.21.15.19:0/1971366515 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f809fb60 con 0x7fa9f809f650 2023-10-03T10:19:54.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.987+0000 7fa9feb97700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e80 tx=0x7fa9f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=382448c5cbbb181f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7fa9fd394700 1 -- 172.21.15.19:0/1971366515 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000e070 con 0x7fa9f809f650 2023-10-03T10:19:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7fa9fd394700 1 -- 172.21.15.19:0/1971366515 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f000b910 con 0x7fa9f809f650 2023-10-03T10:19:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7fa9fd394700 1 -- 172.21.15.19:0/1971366515 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f000bc80 con 0x7fa9f809f650 2023-10-03T10:19:54.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 -- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 msgr2=0x7fa9f8131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e80 tx=0x7fa9f000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 -- 172.21.15.19:0/1971366515 shutdown_connections 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809f650 0x7fa9f8131f00 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 --2- 172.21.15.19:0/1971366515 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809e930 0x7fa9f809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.988+0000 7faa005fa700 1 -- 172.21.15.19:0/1971366515 >> 172.21.15.19:0/1971366515 conn(0x7fa9f80a4210 msgr2=0x7fa9f80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.989+0000 7faa005fa700 1 -- 172.21.15.19:0/1971366515 shutdown_connections 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.989+0000 7faa005fa700 1 -- 172.21.15.19:0/1971366515 wait complete. 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 Processor -- start 2023-10-03T10:19:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 -- start start 2023-10-03T10:19:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809e930 0x7fa9f806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9f809f240 0x7fa9f806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a9a70 con 0x7fa9f809f240 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a8a10 con 0x7fa9f809e930 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7faa005fa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a9200 con 0x7fa9f809f650 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7fa9feb97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7fa9fdb95700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9f809f240 0x7fa9f806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7fa9feb97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:58528/0 (socket says 172.21.15.19:58528) 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7fa9feb97700 1 -- 172.21.15.19:0/996988265 learned_addr learned my addr 172.21.15.19:0/996988265 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.990+0000 7fa9fe396700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809e930 0x7fa9f806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 -- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809e930 msgr2=0x7fa9f806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809e930 0x7fa9f806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 -- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9f809f240 msgr2=0x7fa9f806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9f809f240 0x7fa9f806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 -- 172.21.15.19:0/996988265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f0009b30 con 0x7fa9f809f650 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9feb97700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e50 tx=0x7fa9f0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0004450 con 0x7fa9f809f650 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f00045b0 con 0x7fa9f809f650 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0004960 con 0x7fa9f809f650 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f80a0190 con 0x7fa9f809f650 2023-10-03T10:19:54.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.991+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f8071d20 con 0x7fa9f809f650 2023-10-03T10:19:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.992+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9f001c410 con 0x7fa9f809f650 2023-10-03T10:19:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.993+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9f0041180 con 0x7fa9f809f650 2023-10-03T10:19:54.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.993+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f81a0b30 con 0x7fa9f809f650 2023-10-03T10:19:54.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:54.998+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9f001c6c0 con 0x7fa9f809f650 2023-10-03T10:19:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.103+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7da406c360 con 0x7f7da4136d80 2023-10-03T10:19:55.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.104+0000 7f7da17fa700 1 -- 172.21.15.19:0/3555298989 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d9c0073f0 con 0x7f7da4136d80 2023-10-03T10:19:55.104 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 msgr2=0x7f7da41c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00efc0 tx=0x7f7d9c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 shutdown_connections 2023-10-03T10:19:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7da4136d80 0x7f7da41c5f70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7da406a770 0x7f7da411cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 --2- 172.21.15.19:0/3555298989 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7da406b250 0x7f7da411d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 >> 172.21.15.19:0/3555298989 conn(0x7f7da4066f50 msgr2=0x7f7da4135da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:55.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 shutdown_connections 2023-10-03T10:19:55.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.107+0000 7f7daaeba700 1 -- 172.21.15.19:0/3555298989 wait complete. 2023-10-03T10:19:55.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:55.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.166+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd26006c360 con 0x7fd26009e410 2023-10-03T10:19:55.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.167+0000 7fd256ffd700 1 -- 172.21.15.19:0/3178776818 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd258010af0 con 0x7fd26009e410 2023-10-03T10:19:55.167 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:55.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 msgr2=0x7fd2601c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:55.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 0x7fd2601c7f40 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fd25800ca80 tx=0x7fd25800cd90 comp rx=0 tx=0).stop 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 shutdown_connections 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd26009e410 0x7fd2601c7f40 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd26009d6f0 0x7fd2601a52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 --2- 172.21.15.19:0/3178776818 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd26009e000 0x7fd2601a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 >> 172.21.15.19:0/3178776818 conn(0x7fd260066f50 msgr2=0x7fd2600a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 shutdown_connections 2023-10-03T10:19:55.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.170+0000 7fd2683fe700 1 -- 172.21.15.19:0/3178776818 wait complete. 2023-10-03T10:19:55.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:55.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.213+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa9f8074ea0 con 0x7fa9f809f650 2023-10-03T10:19:55.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.214+0000 7fa9eeffd700 1 -- 172.21.15.19:0/996988265 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9f002a020 con 0x7fa9f809f650 2023-10-03T10:19:55.214 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:55.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 msgr2=0x7fa9f806c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:55.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0009e50 tx=0x7fa9f0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 shutdown_connections 2023-10-03T10:19:55.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9f809f650 0x7fa9f806c330 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9f809e930 0x7fa9f806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 --2- 172.21.15.19:0/996988265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9f809f240 0x7fa9f806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 >> 172.21.15.19:0/996988265 conn(0x7fa9f80a4210 msgr2=0x7fa9f81b8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:55.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 shutdown_connections 2023-10-03T10:19:55.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.216+0000 7faa005fa700 1 -- 172.21.15.19:0/996988265 wait complete. 2023-10-03T10:19:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.223+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa7a0125940 con 0x7fa7a009e410 2023-10-03T10:19:55.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.224+0000 7fa787fff700 1 -- 172.21.15.19:0/4033434157 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa7a0125940 con 0x7fa7a009e410 2023-10-03T10:19:55.224 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 msgr2=0x7fa7a0070c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:55.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 0x7fa7a0070c00 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa79800cb90 tx=0x7fa79800cea0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 shutdown_connections 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa7a009e410 0x7fa7a0070c00 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa7a009d6f0 0x7fa7a0070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 --2- 172.21.15.19:0/4033434157 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa7a009e000 0x7fa7a00706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 >> 172.21.15.19:0/4033434157 conn(0x7fa7a0066f50 msgr2=0x7fa7a006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 shutdown_connections 2023-10-03T10:19:55.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:55.226+0000 7fa7a59c9700 1 -- 172.21.15.19:0/4033434157 wait complete. 2023-10-03T10:19:55.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:55.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:56.127 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:56.190 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:56.230 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:56.241 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 Processor -- start 2023-10-03T10:19:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 -- start start 2023-10-03T10:19:56.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff678133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67813b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67806ef30 con 0x7ff67809de50 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67806fef0 con 0x7ff67809e930 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.277+0000 7ff67f3ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6781334b0 con 0x7ff6781338a0 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67813b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67c985700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff67809de50 0x7ff67809e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:48748/0 (socket says 172.21.15.19:48748) 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67c985700 1 -- 172.21.15.19:0/2218794821 learned_addr learned my addr 172.21.15.19:0/2218794821 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d186700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff678133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 -- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 msgr2=0x7ff678133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff678133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 -- 172.21.15.19:0/2218794821 >> v1:172.21.15.19:6789/0 conn(0x7ff67809de50 legacy=0x7ff67809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 -- 172.21.15.19:0/2218794821 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67806fc30 con 0x7ff67809e930 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff67d987700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67813b740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff670009dc0 tx=0x7ff67000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74194ae980a6e354 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff66ffff700 1 -- 172.21.15.19:0/2218794821 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000e070 con 0x7ff67809e930 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.278+0000 7ff66ffff700 1 -- 172.21.15.19:0/2218794821 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000bb20 con 0x7ff67809e930 2023-10-03T10:19:56.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff66ffff700 1 -- 172.21.15.19:0/2218794821 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff670012430 con 0x7ff67809e930 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 msgr2=0x7ff67813b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67813b740 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff670009dc0 tx=0x7ff67000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2218794821 shutdown_connections 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67813b740 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2218794821 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff678133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.279+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2218794821 >> 172.21.15.19:0/2218794821 conn(0x7ff6780a2aa0 msgr2=0x7ff6780a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.280+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2218794821 shutdown_connections 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.280+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2218794821 wait complete. 2023-10-03T10:19:56.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 Processor -- start 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 -- start start 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67811abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff67811b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67811c2c0 con 0x7ff67809de50 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67811d510 con 0x7ff67809e930 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67f3ea700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff67811c8b0 con 0x7ff6781338a0 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67d186700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67d186700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38470/0 (socket says 172.21.15.19:38470) 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67d186700 1 -- 172.21.15.19:0/2368811990 learned_addr learned my addr 172.21.15.19:0/2368811990 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.281+0000 7ff67d987700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff67811b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 -- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 msgr2=0x7ff67811b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff67811b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 -- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 msgr2=0x7ff67811abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67811abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 -- 172.21.15.19:0/2368811990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff670009a70 con 0x7ff67809de50 2023-10-03T10:19:56.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67d186700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff67400e9b0 tx=0x7ff67400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff674009710 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67400c850 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67811d960 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.282+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67400cbc0 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.283+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6780a1080 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.283+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff67400cd20 con 0x7ff67809de50 2023-10-03T10:19:56.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.284+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff67403fb70 con 0x7ff67809de50 2023-10-03T10:19:56.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.284+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67811e010 con 0x7ff67809de50 2023-10-03T10:19:56.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.293+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff67401b3b0 con 0x7ff67809de50 2023-10-03T10:19:56.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.342+0000 7fbbe32a4700 1 Processor -- start 2023-10-03T10:19:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.342+0000 7fbbe32a4700 1 -- start start 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbbdc12f8b0 0x7fbbdc12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc12d330 con 0x7fbbdc12f8b0 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc12cd90 con 0x7fbbdc12cf60 2023-10-03T10:19:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe32a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1306d0 con 0x7fbbdc130260 2023-10-03T10:19:56.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe1841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe1841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57436/0 (socket says 172.21.15.19:57436) 2023-10-03T10:19:56.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe1841700 1 -- 172.21.15.19:0/3419125459 learned_addr learned my addr 172.21.15.19:0/3419125459 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe083f700 1 --2- 172.21.15.19:0/3419125459 >> v2:172.21.15.19:3300/0 conn(0x7fbbdc12f8b0 0x7fbbdc12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.343+0000 7fbbe1040700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 -- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 msgr2=0x7fbbdc06f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc06f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 -- 172.21.15.19:0/3419125459 >> v2:172.21.15.19:3300/0 conn(0x7fbbdc12f8b0 msgr2=0x7fbbdc12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 --2- 172.21.15.19:0/3419125459 >> v2:172.21.15.19:3300/0 conn(0x7fbbdc12f8b0 0x7fbbdc12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 -- 172.21.15.19:0/3419125459 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc071780 con 0x7fbbdc130260 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbe1841700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400bf20 tx=0x7fbbd400a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d228db87a8c6ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbd3fff700 1 -- 172.21.15.19:0/3419125459 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd400a2e0 con 0x7fbbdc130260 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbd3fff700 1 -- 172.21.15.19:0/3419125459 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400cb10 con 0x7fbbdc130260 2023-10-03T10:19:56.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.344+0000 7fbbd3fff700 1 -- 172.21.15.19:0/3419125459 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4014480 con 0x7fbbdc130260 2023-10-03T10:19:56.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 -- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 msgr2=0x7fbbdc136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400bf20 tx=0x7fbbd400a4c0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 -- 172.21.15.19:0/3419125459 shutdown_connections 2023-10-03T10:19:56.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc06f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/3419125459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc136c20 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/3419125459 >> v2:172.21.15.19:3300/0 conn(0x7fbbdc12f8b0 0x7fbbdc12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 -- 172.21.15.19:0/3419125459 >> 172.21.15.19:0/3419125459 conn(0x7fbbdc0a2aa0 msgr2=0x7fbbdc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.345+0000 7fbbe32a4700 1 -- 172.21.15.19:0/3419125459 shutdown_connections 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.346+0000 7fbbe32a4700 1 -- 172.21.15.19:0/3419125459 wait complete. 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.346+0000 7fbbe32a4700 1 Processor -- start 2023-10-03T10:19:56.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 -- start start 2023-10-03T10:19:56.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc09b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbdc12f8b0 0x7fbbdc09b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc09e5f0 con 0x7fbbdc12f8b0 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc12da40 con 0x7fbbdc12cf60 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe32a4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc09d4e0 con 0x7fbbdc130260 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe1841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe1841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57446/0 (socket says 172.21.15.19:57446) 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe1841700 1 -- 172.21.15.19:0/2111514839 learned_addr learned my addr 172.21.15.19:0/2111514839 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe083f700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbdc12f8b0 0x7fbbdc09b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.347+0000 7fbbe1040700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc09b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 -- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 msgr2=0x7fbbdc09b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc09b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 -- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbdc12f8b0 msgr2=0x7fbbdc09b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbdc12f8b0 0x7fbbdc09b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 -- 172.21.15.19:0/2111514839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd400bb50 con 0x7fbbdc130260 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1040700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc09b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe1841700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400bfd0 tx=0x7fbbd4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40070c0 con 0x7fbbdc130260 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400c910 con 0x7fbbdc130260 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc129fa0 con 0x7fbbdc130260 2023-10-03T10:19:56.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4003c60 con 0x7fbbdc130260 2023-10-03T10:19:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.348+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc09bed0 con 0x7fbbdc130260 2023-10-03T10:19:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.349+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbdc09e810 con 0x7fbbdc130260 2023-10-03T10:19:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.350+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbbd401b070 con 0x7fbbdc130260 2023-10-03T10:19:56.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.350+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbbd4041130 con 0x7fbbdc130260 2023-10-03T10:19:56.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.355+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbbd40148d0 con 0x7fbbdc130260 2023-10-03T10:19:56.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.381+0000 7f37ed1a7700 1 Processor -- start 2023-10-03T10:19:56.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.381+0000 7f37ed1a7700 1 -- start start 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e8131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e8070940 con 0x7f37e809e930 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e806fd60 con 0x7f37e809f650 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37ed1a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e806fa80 con 0x7f37e809f240 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37e6d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57456/0 (socket says 172.21.15.19:57456) 2023-10-03T10:19:56.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37e6d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57542/0 (socket says 172.21.15.19:57542) 2023-10-03T10:19:56.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 -- 172.21.15.19:0/2383252036 learned_addr learned my addr 172.21.15.19:0/2383252036 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37e759e700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e8131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 -- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 msgr2=0x7f37e8131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e8131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 -- 172.21.15.19:0/2383252036 >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 msgr2=0x7f37e809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 --2- 172.21.15.19:0/2383252036 >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37de59c700 1 -- 172.21.15.19:0/2383252036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e809fb60 con 0x7f37e809f240 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37e759e700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.382+0000 7f37e6d9d700 1 --2- 172.21.15.19:0/2383252036 >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.383+0000 7f37de59c700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f37d000dd10 tx=0x7f37d000f330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da6e9a663cfe85ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.383+0000 7f37e659c700 1 -- 172.21.15.19:0/2383252036 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0012070 con 0x7f37e809f240 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.383+0000 7f37e659c700 1 -- 172.21.15.19:0/2383252036 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d000d2e0 con 0x7f37e809f240 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.383+0000 7f37e659c700 1 -- 172.21.15.19:0/2383252036 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d000fb10 con 0x7f37e809f240 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 msgr2=0x7f37e81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f37d000dd10 tx=0x7f37d000f330 comp rx=0 tx=0).stop 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2383252036 shutdown_connections 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e8131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2383252036 >> v2:172.21.15.19:3300/0 conn(0x7f37e809e930 0x7f37e809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2383252036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809f240 0x7f37e81317f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2383252036 >> 172.21.15.19:0/2383252036 conn(0x7f37e80a4210 msgr2=0x7f37e80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2383252036 shutdown_connections 2023-10-03T10:19:56.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.384+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2383252036 wait complete. 2023-10-03T10:19:56.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.386+0000 7f37ed1a7700 1 Processor -- start 2023-10-03T10:19:56.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.386+0000 7f37ed1a7700 1 -- start start 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809e930 0x7f37e81a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e81a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a6050 con 0x7f37e809f240 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a3780 con 0x7f37e809f650 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37ed1a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81a3da0 con 0x7f37e809e930 2023-10-03T10:19:56.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37de59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37de59c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57546/0 (socket says 172.21.15.19:57546) 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37de59c700 1 -- 172.21.15.19:0/2051436192 learned_addr learned my addr 172.21.15.19:0/2051436192 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37e759e700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e81a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.387+0000 7f37e6d9d700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809e930 0x7f37e81a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 -- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809e930 msgr2=0x7f37e81a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809e930 0x7f37e81a1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 -- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 msgr2=0x7f37e81a2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e81a2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 -- 172.21.15.19:0/2051436192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d80094a0 con 0x7f37e809f240 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37de59c700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f37e806fbc0 tx=0x7f37d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0010ee0 con 0x7f37e809f240 2023-10-03T10:19:56.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00036a0 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0003a30 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37d000d9f0 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.388+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e80a0190 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.389+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e81a3090 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.390+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f37d0003b90 con 0x7f37e809f240 2023-10-03T10:19:56.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.390+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f37d00450a0 con 0x7f37e809f240 2023-10-03T10:19:56.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.395+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f37d0003e40 con 0x7f37e809f240 2023-10-03T10:19:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 Processor -- start 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 -- start start 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f983c12cf60 0x7f983c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12f8b0 0x7f983c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c12cd90 con 0x7f983c130260 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c12d330 con 0x7f983c12cf60 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f984247f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1306d0 con 0x7f983c12f8b0 2023-10-03T10:19:56.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f983bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f983c12cf60 0x7f983c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f983bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f983c12cf60 0x7f983c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57554/0 (socket says 172.21.15.19:57554) 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.451+0000 7f983bfff700 1 -- 172.21.15.19:0/153572636 learned_addr learned my addr 172.21.15.19:0/153572636 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983b7fe700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12f8b0 0x7f983c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983bfff700 1 -- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12f8b0 msgr2=0x7f983c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983bfff700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12f8b0 0x7f983c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983bfff700 1 -- 172.21.15.19:0/153572636 >> v1:172.21.15.19:6789/0 conn(0x7f983c130260 legacy=0x7f983c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983bfff700 1 -- 172.21.15.19:0/153572636 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c071780 con 0x7f983c12cf60 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983bfff700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c12cf60 0x7f983c06f5d0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f982c0098f0 tx=0x7f982c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33428586db8f65e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983affd700 1 -- 172.21.15.19:0/153572636 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00c900 con 0x7f983c12cf60 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983affd700 1 -- 172.21.15.19:0/153572636 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00ca60 con 0x7f983c12cf60 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.452+0000 7f983affd700 1 -- 172.21.15.19:0/153572636 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00cdf0 con 0x7f983c12cf60 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 -- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c12cf60 msgr2=0x7f983c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c12cf60 0x7f983c06f5d0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f982c0098f0 tx=0x7f982c009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 -- 172.21.15.19:0/153572636 shutdown_connections 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c12cf60 0x7f983c06f5d0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 --2- 172.21.15.19:0/153572636 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12f8b0 0x7f983c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 -- 172.21.15.19:0/153572636 >> 172.21.15.19:0/153572636 conn(0x7f983c0a2aa0 msgr2=0x7f983c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 -- 172.21.15.19:0/153572636 shutdown_connections 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.453+0000 7f984247f700 1 -- 172.21.15.19:0/153572636 wait complete. 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.454+0000 7f984247f700 1 Processor -- start 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 -- start start 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f983c12f8b0 0x7f983c09a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c130260 0x7f983c09a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1202e0 con 0x7f983c130260 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c11ec70 con 0x7f983c12f8b0 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f984247f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f983c11fdd0 con 0x7f983c12cf60 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.455+0000 7f983bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57492/0 (socket says 172.21.15.19:57492) 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 -- 172.21.15.19:0/1275411840 learned_addr learned my addr 172.21.15.19:0/1275411840 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f9840a1c700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c130260 0x7f983c09a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983b7fe700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f983c12f8b0 0x7f983c09a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 -- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f983c12f8b0 msgr2=0x7f983c09a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f983c12f8b0 0x7f983c09a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 -- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c130260 msgr2=0x7f983c09a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c130260 0x7f983c09a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 -- 172.21.15.19:0/1275411840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c009550 con 0x7f983c12cf60 2023-10-03T10:19:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f983bfff700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f982c009c40 tx=0x7f982c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.456+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c0038a0 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.457+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c003a00 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.457+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c11fa70 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.457+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c003db0 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.457+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c12f520 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.458+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f982c018400 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.458+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c074ea0 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.458+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f982c0408c0 con 0x7f983c12cf60 2023-10-03T10:19:56.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.463+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f982c0103f0 con 0x7f983c12cf60 2023-10-03T10:19:56.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.515+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff678074ea0 con 0x7ff67809de50 2023-10-03T10:19:56.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.516+0000 7ff66dffb700 1 -- 172.21.15.19:0/2368811990 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff674021020 con 0x7ff67809de50 2023-10-03T10:19:56.516 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:56.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 msgr2=0x7ff67811a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff67400e9b0 tx=0x7ff67400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 shutdown_connections 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff6781338a0 0x7ff67811b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff67809de50 0x7ff67811a6b0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 --2- 172.21.15.19:0/2368811990 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff67809e930 0x7ff67811abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 >> 172.21.15.19:0/2368811990 conn(0x7ff6780a2aa0 msgr2=0x7ff6781b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 shutdown_connections 2023-10-03T10:19:56.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.518+0000 7ff67f3ea700 1 -- 172.21.15.19:0/2368811990 wait complete. 2023-10-03T10:19:56.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:56.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.605+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbbdc074ea0 con 0x7fbbdc130260 2023-10-03T10:19:56.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.605+0000 7fbbd1ffb700 1 -- 172.21.15.19:0/2111514839 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbbd402c030 con 0x7fbbdc130260 2023-10-03T10:19:56.605 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:56.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.606+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f37e81a3090 con 0x7f37e809f240 2023-10-03T10:19:56.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.607+0000 7f37dffff700 1 -- 172.21.15.19:0/2051436192 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f37e81a3090 con 0x7f37e809f240 2023-10-03T10:19:56.607 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 msgr2=0x7fbbdc1c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400bfd0 tx=0x7fbbd4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 shutdown_connections 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbbdc130260 0x7fbbdc1c3db0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbbdc12cf60 0x7fbbdc09b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 --2- 172.21.15.19:0/2111514839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbbdc12f8b0 0x7fbbdc09b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 >> 172.21.15.19:0/2111514839 conn(0x7fbbdc0a2aa0 msgr2=0x7fbbdc12a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 shutdown_connections 2023-10-03T10:19:56.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7fbbe32a4700 1 -- 172.21.15.19:0/2111514839 wait complete. 2023-10-03T10:19:56.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 msgr2=0x7f37e81a2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.609+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f37e806fbc0 tx=0x7f37d0004750 comp rx=0 tx=0).stop 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 shutdown_connections 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f37e809f650 0x7f37e81a2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f37e809e930 0x7f37e81a1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 --2- 172.21.15.19:0/2051436192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37e809f240 0x7f37e81a2100 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 >> 172.21.15.19:0/2051436192 conn(0x7f37e80a4210 msgr2=0x7f37e81b6b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 shutdown_connections 2023-10-03T10:19:56.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.610+0000 7f37ed1a7700 1 -- 172.21.15.19:0/2051436192 wait complete. 2023-10-03T10:19:56.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:56.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:56.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.677+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f983c0713a0 con 0x7f983c12cf60 2023-10-03T10:19:56.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.678+0000 7f9838ff9700 1 -- 172.21.15.19:0/1275411840 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f982c026070 con 0x7f983c12cf60 2023-10-03T10:19:56.678 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:56.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 msgr2=0x7f983c099d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f982c009c40 tx=0x7f982c004750 comp rx=0 tx=0).stop 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 shutdown_connections 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f983c130260 0x7f983c09a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f983c12cf60 0x7f983c099d80 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 --2- 172.21.15.19:0/1275411840 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f983c12f8b0 0x7f983c09a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.680+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 >> 172.21.15.19:0/1275411840 conn(0x7f983c0a2aa0 msgr2=0x7f983c09e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.681+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 shutdown_connections 2023-10-03T10:19:56.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:56.681+0000 7f984247f700 1 -- 172.21.15.19:0/1275411840 wait complete. 2023-10-03T10:19:56.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:57.534 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:57.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:57.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 Processor -- start 2023-10-03T10:19:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 -- start start 2023-10-03T10:19:57.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf201337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20133e30 0x7fcf2012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2006b990 con 0x7fcf20134260 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf200a0590 con 0x7fcf20133e30 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf26c79700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2009fb80 con 0x7fcf20133420 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.683+0000 7fcf25216700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf201337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf25216700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57560/0 (socket says 172.21.15.19:57560) 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf25216700 1 -- 172.21.15.19:0/2156143162 learned_addr learned my addr 172.21.15.19:0/2156143162 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf1ffff700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20133e30 0x7fcf2012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 -- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20133e30 msgr2=0x7fcf2012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20133e30 0x7fcf2012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 -- 172.21.15.19:0/2156143162 >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 msgr2=0x7fcf201304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2156143162 >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 -- 172.21.15.19:0/2156143162 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200a0030 con 0x7fcf20133420 2023-10-03T10:19:57.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf25216700 1 --2- 172.21.15.19:0/2156143162 >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf201337f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009840 tx=0x7fcf14009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49605751828943ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf1f7fe700 1 -- 172.21.15.19:0/2156143162 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011830 con 0x7fcf20133420 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf1f7fe700 1 -- 172.21.15.19:0/2156143162 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14011990 con 0x7fcf20133420 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.684+0000 7fcf1f7fe700 1 -- 172.21.15.19:0/2156143162 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011d20 con 0x7fcf20133420 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 -- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 msgr2=0x7fcf201337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf201337f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcf14009840 tx=0x7fcf14009b50 comp rx=0 tx=0).stop 2023-10-03T10:19:57.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 -- 172.21.15.19:0/2156143162 shutdown_connections 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2156143162 >> v2:172.21.15.19:3300/0 conn(0x7fcf20134260 0x7fcf201304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf201337f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2156143162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20133e30 0x7fcf2012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 -- 172.21.15.19:0/2156143162 >> 172.21.15.19:0/2156143162 conn(0x7fcf200a4210 msgr2=0x7fcf200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 -- 172.21.15.19:0/2156143162 shutdown_connections 2023-10-03T10:19:57.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.685+0000 7fcf26c79700 1 -- 172.21.15.19:0/2156143162 wait complete. 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.687+0000 7fcf26c79700 1 Processor -- start 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.687+0000 7fcf26c79700 1 -- start start 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf20133e30 0x7fcf2009c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20134260 0x7fcf2009cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf201202e0 con 0x7fcf20133e30 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2009dd90 con 0x7fcf20134260 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf26c79700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2011fc40 con 0x7fcf20133420 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf1ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf20133e30 0x7fcf2009c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57516/0 (socket says 172.21.15.19:57516) 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 -- 172.21.15.19:0/2813137405 learned_addr learned my addr 172.21.15.19:0/2813137405 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf25216700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20134260 0x7fcf2009cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 -- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20134260 msgr2=0x7fcf2009cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20134260 0x7fcf2009cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 -- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf20133e30 msgr2=0x7fcf2009c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf20133e30 0x7fcf2009c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 -- 172.21.15.19:0/2813137405 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009b30 con 0x7fcf20133420 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.688+0000 7fcf24a15700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcf140090b0 tx=0x7fcf14004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.689+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14004240 con 0x7fcf20133420 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.689+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1401f070 con 0x7fcf20133420 2023-10-03T10:19:57.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.689+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf140094a0 con 0x7fcf20133420 2023-10-03T10:19:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.689+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140045c0 con 0x7fcf20133420 2023-10-03T10:19:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.689+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2011f950 con 0x7fcf20133420 2023-10-03T10:19:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.690+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf20074ea0 con 0x7fcf20133420 2023-10-03T10:19:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.690+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcf14021030 con 0x7fcf20133420 2023-10-03T10:19:57.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.690+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcf14040b20 con 0x7fcf20133420 2023-10-03T10:19:57.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:57.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.695+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcf14003e00 con 0x7fcf20133420 2023-10-03T10:19:57.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.773+0000 7fbd524c5700 1 Processor -- start 2023-10-03T10:19:57.773 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.773+0000 7fbd524c5700 1 -- start start 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd524c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd524c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c0a0d90 0x7fbd4c0a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd524c5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0a2a20 con 0x7fbd4c1338a0 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd524c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c09e690 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd524c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0a1cc0 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.775 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39102/0 (socket says 172.21.15.19:39102) 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.774+0000 7fbd4bfff700 1 -- 172.21.15.19:0/1232645206 learned_addr learned my addr 172.21.15.19:0/1232645206 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4bfff700 1 -- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c0a0d90 msgr2=0x7fbd4c0a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4bfff700 1 --2- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c0a0d90 0x7fbd4c0a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4bfff700 1 -- 172.21.15.19:0/1232645206 >> v1:172.21.15.19:6789/0 conn(0x7fbd4c1338a0 legacy=0x7fbd4c133d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4bfff700 1 -- 172.21.15.19:0/1232645206 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0a1f40 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4bfff700 1 --2- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009920 tx=0x7fbd3c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c1a39108ac95557 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4affd700 1 -- 172.21.15.19:0/1232645206 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00ba60 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4affd700 1 -- 172.21.15.19:0/1232645206 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00bbc0 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.775+0000 7fbd4affd700 1 -- 172.21.15.19:0/1232645206 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c009e70 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 -- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 msgr2=0x7fbd4c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 --2- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c009920 tx=0x7fbd3c009c30 comp rx=0 tx=0).stop 2023-10-03T10:19:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 -- 172.21.15.19:0/1232645206 shutdown_connections 2023-10-03T10:19:57.777 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 --2- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c06c5d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 --2- 172.21.15.19:0/1232645206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c0a0d90 0x7fbd4c0a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 -- 172.21.15.19:0/1232645206 >> 172.21.15.19:0/1232645206 conn(0x7fbd4c0a60c0 msgr2=0x7fbd4c0a64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 -- 172.21.15.19:0/1232645206 shutdown_connections 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.776+0000 7fbd524c5700 1 -- 172.21.15.19:0/1232645206 wait complete. 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.777+0000 7fbd524c5700 1 Processor -- start 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.777+0000 7fbd524c5700 1 -- start start 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c125e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.778 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c1338a0 0x7fbd4c126890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c127250 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.779 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c132d80 con 0x7fbd4c0a09c0 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd524c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c127f60 con 0x7fbd4c1338a0 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c125e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c125e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39110/0 (socket says 172.21.15.19:39110) 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57582/0 (socket says 172.21.15.19:57582) 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4bfff700 1 -- 172.21.15.19:0/3169127272 learned_addr learned my addr 172.21.15.19:0/3169127272 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd50a62700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c1338a0 0x7fbd4c126890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 -- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c1338a0 msgr2=0x7fbd4c126890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c1338a0 0x7fbd4c126890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 -- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 msgr2=0x7fbd4c125e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c125e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.778+0000 7fbd4b7fe700 1 -- 172.21.15.19:0/3169127272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c009550 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd4b7fe700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000b450 tx=0x7fbd4000b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40011830 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd40011990 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c09cea0 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7ff63c999700 1 Processor -- start 2023-10-03T10:19:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd40011d40 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.779+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c1290c0 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.780+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c04f2a0 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbd4001a400 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbd4003f5e0 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.780+0000 7ff63c999700 1 -- start start 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63c999700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 0x7ff638135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63c999700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff638138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63c999700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63809f130 con 0x7ff63809d6f0 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63c999700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63809f520 con 0x7ff638135e50 2023-10-03T10:19:57.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63c999700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff63809e930 con 0x7ff63809e1d0 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff63809d6f0 0x7ff63809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36328/0 (socket says 172.21.15.19:36328) 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff63659c700 1 -- 172.21.15.19:0/2948037862 learned_addr learned my addr 172.21.15.19:0/2948037862 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff635d9b700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 0x7ff638135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff636d9d700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff638138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff636d9d700 1 -- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 msgr2=0x7ff638135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff636d9d700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 0x7ff638135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff636d9d700 1 -- 172.21.15.19:0/2948037862 >> v1:172.21.15.19:6789/0 conn(0x7ff63809d6f0 legacy=0x7ff63809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff636d9d700 1 -- 172.21.15.19:0/2948037862 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63809b2d0 con 0x7ff638135e50 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.781+0000 7ff635d9b700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 0x7ff638135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.782+0000 7ff636d9d700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff638138230 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff630009dc0 tx=0x7ff63000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2436dfce8c9bab6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.782+0000 7ff63559a700 1 -- 172.21.15.19:0/2948037862 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63000e070 con 0x7ff638135e50 2023-10-03T10:19:57.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.782+0000 7ff63559a700 1 -- 172.21.15.19:0/2948037862 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63000bb20 con 0x7ff638135e50 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.782+0000 7ff63559a700 1 -- 172.21.15.19:0/2948037862 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff630012430 con 0x7ff638135e50 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 -- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 msgr2=0x7ff638138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff638138230 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff630009dc0 tx=0x7ff63000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 -- 172.21.15.19:0/2948037862 shutdown_connections 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff638138230 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 --2- 172.21.15.19:0/2948037862 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809e1d0 0x7ff638135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 -- 172.21.15.19:0/2948037862 >> 172.21.15.19:0/2948037862 conn(0x7ff638066f50 msgr2=0x7ff63809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 -- 172.21.15.19:0/2948037862 shutdown_connections 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.783+0000 7ff63c999700 1 -- 172.21.15.19:0/2948037862 wait complete. 2023-10-03T10:19:57.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.784+0000 7ff63c999700 1 Processor -- start 2023-10-03T10:19:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.784+0000 7ff63c999700 1 -- start start 2023-10-03T10:19:57.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.784+0000 7ff63c999700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809d6f0 0x7ff63811d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.784+0000 7ff63c999700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.784+0000 7ff63c999700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff6381c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff63c999700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63811a850 con 0x7ff63809e1d0 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff63c999700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63811ce50 con 0x7ff638135e50 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff63c999700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381c9fa0 con 0x7ff63809d6f0 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57588/0 (socket says 172.21.15.19:57588) 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 -- 172.21.15.19:0/2155243977 learned_addr learned my addr 172.21.15.19:0/2155243977 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff636d9d700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff6381c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff63659c700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809d6f0 0x7ff63811d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 -- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809d6f0 msgr2=0x7ff63811d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809d6f0 0x7ff63811d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 -- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 msgr2=0x7ff6381c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff6381c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 -- 172.21.15.19:0/2155243977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0094a0 con 0x7ff63809e1d0 2023-10-03T10:19:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.785+0000 7ff635d9b700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00ec40 tx=0x7ff62c00ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.789+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbd40009280 con 0x7fbd4c0a0d90 2023-10-03T10:19:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.790+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00c850 con 0x7ff63809e1d0 2023-10-03T10:19:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.790+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c00c9b0 con 0x7ff63809e1d0 2023-10-03T10:19:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.790+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff630009a70 con 0x7ff63809e1d0 2023-10-03T10:19:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.790+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c00cd20 con 0x7ff63809e1d0 2023-10-03T10:19:57.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.790+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63811bcb0 con 0x7ff63809e1d0 2023-10-03T10:19:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.791+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63811b000 con 0x7ff63809e1d0 2023-10-03T10:19:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.792+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff62c013470 con 0x7ff63809e1d0 2023-10-03T10:19:57.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.792+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff62c03f7b0 con 0x7ff63809e1d0 2023-10-03T10:19:57.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.801+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff62c013720 con 0x7ff63809e1d0 2023-10-03T10:19:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.846+0000 7f060a1f0700 1 Processor -- start 2023-10-03T10:19:57.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.846+0000 7f060a1f0700 1 -- start start 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f06041339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 0x7f0604133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060406b460 con 0x7f060409e410 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060409b120 con 0x7f060409e000 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f060a1f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f060409a7e0 con 0x7f060409d6f0 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f0603fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 0x7f0604133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f0603fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 0x7f0604133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57596/0 (socket says 172.21.15.19:57596) 2023-10-03T10:19:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57570/0 (socket says 172.21.15.19:57570) 2023-10-03T10:19:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f0603fff700 1 -- 172.21.15.19:0/581719191 learned_addr learned my addr 172.21.15.19:0/581719191 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f05fbfff700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f06041339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 -- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 msgr2=0x7f06041339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f06041339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 -- 172.21.15.19:0/581719191 >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 msgr2=0x7f0604133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 --2- 172.21.15.19:0/581719191 >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 0x7f0604133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.847+0000 7f06037fe700 1 -- 172.21.15.19:0/581719191 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060409a500 con 0x7f060409d6f0 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.848+0000 7f06037fe700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009870 tx=0x7f05f4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c02357aca017f2f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.848+0000 7f0602ffd700 1 -- 172.21.15.19:0/581719191 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011830 con 0x7f060409d6f0 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.848+0000 7f0602ffd700 1 -- 172.21.15.19:0/581719191 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4011990 con 0x7f060409d6f0 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.848+0000 7f0602ffd700 1 -- 172.21.15.19:0/581719191 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4011d20 con 0x7f060409d6f0 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 -- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 msgr2=0x7f060409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f05f4009870 tx=0x7f05f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 -- 172.21.15.19:0/581719191 shutdown_connections 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 --2- 172.21.15.19:0/581719191 >> v2:172.21.15.19:3300/0 conn(0x7f060409e410 0x7f0604133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409d6f0 0x7f060409dac0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 --2- 172.21.15.19:0/581719191 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e000 0x7f06041339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 -- 172.21.15.19:0/581719191 >> 172.21.15.19:0/581719191 conn(0x7f0604066f50 msgr2=0x7f060409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 -- 172.21.15.19:0/581719191 shutdown_connections 2023-10-03T10:19:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.849+0000 7f060a1f0700 1 -- 172.21.15.19:0/581719191 wait complete. 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.850+0000 7f060a1f0700 1 Processor -- start 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.850+0000 7f060a1f0700 1 -- start start 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.850+0000 7f060a1f0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f06041a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.850+0000 7f060a1f0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f06041a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f060a1f0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f060a1f0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041a8600 con 0x7f060409d6f0 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f060a1f0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06040a31a0 con 0x7f060409e410 2023-10-03T10:19:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f060a1f0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06041a6ae0 con 0x7f060409e000 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f06037fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f06041a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39146/0 (socket says 172.21.15.19:39146) 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 -- 172.21.15.19:0/496881394 learned_addr learned my addr 172.21.15.19:0/496881394 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f05fbfff700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f06041a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 -- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 msgr2=0x7f06041a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f06041a5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 -- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 msgr2=0x7f06041a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f06041a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 -- 172.21.15.19:0/496881394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f40094a0 con 0x7f060409e410 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.851+0000 7f0603fff700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d60 tx=0x7f05fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.852+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc003c20 con 0x7f060409e410 2023-10-03T10:19:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.852+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00f040 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.852+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060409c710 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.852+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00c880 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.852+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06041a88e0 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.853+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f05fc00c9e0 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.853+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06041a8740 con 0x7f060409e410 2023-10-03T10:19:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.853+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f05fc03f860 con 0x7f060409e410 2023-10-03T10:19:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.858+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06041a8740 con 0x7f060409e410 2023-10-03T10:19:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.963+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcf2012daf0 con 0x7fcf20133420 2023-10-03T10:19:57.963 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.963+0000 7fcf1d7fa700 1 -- 172.21.15.19:0/2813137405 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcf14015030 con 0x7fcf20133420 2023-10-03T10:19:57.963 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 msgr2=0x7fcf2009c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fcf140090b0 tx=0x7fcf14004750 comp rx=0 tx=0).stop 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 shutdown_connections 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcf20134260 0x7fcf2009cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcf20133420 0x7fcf2009c300 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 --2- 172.21.15.19:0/2813137405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcf20133e30 0x7fcf2009c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 >> 172.21.15.19:0/2813137405 conn(0x7fcf200a4210 msgr2=0x7fcf200a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 shutdown_connections 2023-10-03T10:19:57.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:57.967+0000 7fcf26c79700 1 -- 172.21.15.19:0/2813137405 wait complete. 2023-10-03T10:19:57.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:58.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.002+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbd4c09dd50 con 0x7fbd4c0a0d90 2023-10-03T10:19:58.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.002+0000 7fbd48ff9700 1 -- 172.21.15.19:0/3169127272 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbd40021af0 con 0x7fbd4c0a0d90 2023-10-03T10:19:58.002 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 msgr2=0x7fbd4c126350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000b450 tx=0x7fbd4000b760 comp rx=0 tx=0).stop 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 shutdown_connections 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbd4c1338a0 0x7fbd4c126890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbd4c0a09c0 0x7fbd4c125e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 --2- 172.21.15.19:0/3169127272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbd4c0a0d90 0x7fbd4c126350 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 >> 172.21.15.19:0/3169127272 conn(0x7fbd4c0a60c0 msgr2=0x7fbd4c09ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 shutdown_connections 2023-10-03T10:19:58.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.005+0000 7fbd524c5700 1 -- 172.21.15.19:0/3169127272 wait complete. 2023-10-03T10:19:58.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:58.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.057+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff638074ea0 con 0x7ff63809e1d0 2023-10-03T10:19:58.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.058+0000 7ff626ffd700 1 -- 172.21.15.19:0/2155243977 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff62c01ae80 con 0x7ff63809e1d0 2023-10-03T10:19:58.058 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 msgr2=0x7ff6381c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00ec40 tx=0x7ff62c00ef50 comp rx=0 tx=0).stop 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 shutdown_connections 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff638135e50 0x7ff6381c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff63809d6f0 0x7ff63811d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 --2- 172.21.15.19:0/2155243977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff63809e1d0 0x7ff6381c9520 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 >> 172.21.15.19:0/2155243977 conn(0x7ff638066f50 msgr2=0x7ff6380a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:58.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 shutdown_connections 2023-10-03T10:19:58.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.060+0000 7ff63c999700 1 -- 172.21.15.19:0/2155243977 wait complete. 2023-10-03T10:19:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.066+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f06041a8740 con 0x7f060409e410 2023-10-03T10:19:58.066 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.066+0000 7f0600ff9700 1 -- 172.21.15.19:0/496881394 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f06041a8740 con 0x7f060409e410 2023-10-03T10:19:58.066 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 msgr2=0x7f06041a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009d60 tx=0x7f05fc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 shutdown_connections 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f060409e410 0x7f06041a5950 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060409d6f0 0x7f06041a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 --2- 172.21.15.19:0/496881394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f060409e000 0x7f06041a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 >> 172.21.15.19:0/496881394 conn(0x7f0604066f50 msgr2=0x7f06041b9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 shutdown_connections 2023-10-03T10:19:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:58.070+0000 7f060a1f0700 1 -- 172.21.15.19:0/496881394 wait complete. 2023-10-03T10:19:58.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:58.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:19:58.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:19:59.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:19:59.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:19:59.087 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:19:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.144+0000 7ffb4cfed700 1 Processor -- start 2023-10-03T10:19:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.144+0000 7ffb4cfed700 1 -- start start 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb48133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 0x7ffb4809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4809e390 0x7ffb4809e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb48070c80 con 0x7ffb4809e390 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4806f720 con 0x7ffb481338c0 2023-10-03T10:19:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4cfed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4806fce0 con 0x7ffb481341d0 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb46d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4809e390 0x7ffb4809e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb4659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb48133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb46d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4809e390 0x7ffb4809e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57614/0 (socket says 172.21.15.19:57614) 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.145+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2832040396 learned_addr learned my addr 172.21.15.19:0/2832040396 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb45d9b700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 0x7ffb4809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 msgr2=0x7ffb4809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 0x7ffb4809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 msgr2=0x7ffb48133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb48133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2832040396 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb481336a0 con 0x7ffb4809e390 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb4659c700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb48133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb45d9b700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 0x7ffb4809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4809e390 0x7ffb4809e800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009e50 tx=0x7ffb4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501abb6f55a5957f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb4559a700 1 -- 172.21.15.19:0/2832040396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000e070 con 0x7ffb4809e390 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb4559a700 1 -- 172.21.15.19:0/2832040396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000b910 con 0x7ffb4809e390 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.146+0000 7ffb4559a700 1 -- 172.21.15.19:0/2832040396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000bcc0 con 0x7ffb4809e390 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4809e390 msgr2=0x7ffb4809e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4809e390 0x7ffb4809e800 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009e50 tx=0x7ffb4000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2832040396 shutdown_connections 2023-10-03T10:19:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb48133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4809e390 0x7ffb4809e800 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2832040396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb481341d0 0x7ffb4809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2832040396 >> 172.21.15.19:0/2832040396 conn(0x7ffb480a2aa0 msgr2=0x7ffb480a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2832040396 shutdown_connections 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.147+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2832040396 wait complete. 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.149+0000 7ffb4cfed700 1 Processor -- start 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.149+0000 7ffb4cfed700 1 -- start start 2023-10-03T10:19:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb4811eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 0x7ffb4811f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4811fc30 con 0x7ffb481341d0 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4812fb30 con 0x7ffb481338c0 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4cfed700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb48121200 con 0x7ffb4809e390 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57606/0 (socket says 172.21.15.19:57606) 2023-10-03T10:19:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb4659c700 1 -- 172.21.15.19:0/2958628694 learned_addr learned my addr 172.21.15.19:0/2958628694 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 0x7ffb4811f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.150+0000 7ffb45d9b700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb4811eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 msgr2=0x7ffb4811e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 msgr2=0x7ffb4811eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb4811eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 -- 172.21.15.19:0/2958628694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094a0 con 0x7ffb481341d0 2023-10-03T10:19:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb4659c700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb46d9d700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 0x7ffb4811f1e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ffb480a3690 tx=0x7ffb40004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb400092e0 con 0x7ffb481341d0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40004250 con 0x7ffb481341d0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.151+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb40009b30 con 0x7ffb481341d0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.152+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40004600 con 0x7ffb481341d0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.152+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb48132020 con 0x7ffb481341d0 2023-10-03T10:19:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.153+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb40004760 con 0x7ffb481341d0 2023-10-03T10:19:59.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.153+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb40040c10 con 0x7ffb481341d0 2023-10-03T10:19:59.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.154+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb48121c40 con 0x7ffb481341d0 2023-10-03T10:19:59.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.159+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb40011b40 con 0x7ffb481341d0 2023-10-03T10:19:59.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.188+0000 7fa81ecc6700 1 Processor -- start 2023-10-03T10:19:59.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.188+0000 7fa81ecc6700 1 -- start start 2023-10-03T10:19:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81ecc6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa81809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81ecc6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa81809e410 0x7fa818134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81ecc6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa81809b120 con 0x7fa81809e000 2023-10-03T10:19:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81ecc6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81806b460 con 0x7fa81809e410 2023-10-03T10:19:59.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81ecc6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa81809a7e0 con 0x7fa81809d6f0 2023-10-03T10:19:59.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81d263700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa81809e410 0x7fa818134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81d263700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa81809e410 0x7fa818134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57632/0 (socket says 172.21.15.19:57632) 2023-10-03T10:19:59.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.189+0000 7fa81d263700 1 -- 172.21.15.19:0/1070176021 learned_addr learned my addr 172.21.15.19:0/1070176021 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81ca62700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa81809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81d263700 1 -- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 msgr2=0x7fa81809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81d263700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa81809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81d263700 1 -- 172.21.15.19:0/1070176021 >> v1:172.21.15.19:6789/0 conn(0x7fa81809e000 legacy=0x7fa8181339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa8177fe700 1 -- 172.21.15.19:0/1070176021 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013351081 0 0) 0x7fa81809b120 con 0x7fa81809e000 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81d263700 1 -- 172.21.15.19:0/1070176021 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81809a500 con 0x7fa81809e410 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81ca62700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa81809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa81d263700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e410 0x7fa818134100 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fa810009e50 tx=0x7fa81000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0dfcb6a25f2098 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa8177fe700 1 -- 172.21.15.19:0/1070176021 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000e070 con 0x7fa81809e410 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa8177fe700 1 -- 172.21.15.19:0/1070176021 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81000b9c0 con 0x7fa81809e410 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.190+0000 7fa8177fe700 1 -- 172.21.15.19:0/1070176021 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81000bd70 con 0x7fa81809e410 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e410 msgr2=0x7fa818134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e410 0x7fa818134100 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fa810009e50 tx=0x7fa81000b330 comp rx=0 tx=0).stop 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1070176021 shutdown_connections 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e410 0x7fa818134100 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1070176021 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa81809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1070176021 >> 172.21.15.19:0/1070176021 conn(0x7fa818066f50 msgr2=0x7fa81809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1070176021 shutdown_connections 2023-10-03T10:19:59.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.191+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1070176021 wait complete. 2023-10-03T10:19:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.193+0000 7fa81ecc6700 1 Processor -- start 2023-10-03T10:19:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.193+0000 7fa81ecc6700 1 -- start start 2023-10-03T10:19:59.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e000 0x7fa8181a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa81809e410 0x7fa8181c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181a9e80 con 0x7fa81809e000 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181a8620 con 0x7fa81809e410 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ecc6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181aa500 con 0x7fa81809d6f0 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ca62700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ca62700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57624/0 (socket says 172.21.15.19:57624) 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ca62700 1 -- 172.21.15.19:0/1986948992 learned_addr learned my addr 172.21.15.19:0/1986948992 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa817fff700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e000 0x7fa8181a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81d263700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa81809e410 0x7fa8181c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.194+0000 7fa81ca62700 1 -- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa81809e410 msgr2=0x7fa8181c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ca62700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa81809e410 0x7fa8181c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ca62700 1 -- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e000 msgr2=0x7fa8181a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ca62700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e000 0x7fa8181a7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ca62700 1 -- 172.21.15.19:0/1986948992 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa810009b30 con 0x7fa81809d6f0 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ca62700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c750 tx=0x7fa80c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011800 con 0x7fa81809d6f0 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c011960 con 0x7fa81809d6f0 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c011cd0 con 0x7fa81809d6f0 2023-10-03T10:19:59.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8180a2e20 con 0x7fa81809d6f0 2023-10-03T10:19:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.195+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8181a7d80 con 0x7fa81809d6f0 2023-10-03T10:19:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.197+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8181a7040 con 0x7fa81809d6f0 2023-10-03T10:19:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.197+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa80c023480 con 0x7fa81809d6f0 2023-10-03T10:19:59.199 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.198+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa80c03f9e0 con 0x7fa81809d6f0 2023-10-03T10:19:59.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.206+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa80c011e30 con 0x7fa81809d6f0 2023-10-03T10:19:59.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.250+0000 7f10aa993700 1 Processor -- start 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.250+0000 7f10aa993700 1 -- start start 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10aa993700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10aa993700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10a409f240 0x7f10a41317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10aa993700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a4070940 con 0x7f10a409f650 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10aa993700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a406fd60 con 0x7f10a409f240 2023-10-03T10:19:59.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10aa993700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a406fa80 con 0x7f10a409e930 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f10a409f240 0x7f10a41317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39178/0 (socket says 172.21.15.19:39178) 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 -- 172.21.15.19:0/3993554295 learned_addr learned my addr 172.21.15.19:0/3993554295 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 -- 172.21.15.19:0/3993554295 >> v2:172.21.15.19:3300/0 conn(0x7f10a409f240 msgr2=0x7f10a41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 --2- 172.21.15.19:0/3993554295 >> v2:172.21.15.19:3300/0 conn(0x7f10a409f240 0x7f10a41317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 -- 172.21.15.19:0/3993554295 >> v1:172.21.15.19:6789/0 conn(0x7f10a409f650 legacy=0x7f10a4131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.251+0000 7f10a3fff700 1 -- 172.21.15.19:0/3993554295 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a409fb60 con 0x7f10a409e930 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.252+0000 7f10a3fff700 1 --2- 172.21.15.19:0/3993554295 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f10940098f0 tx=0x7f1094009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9e444ab8b236e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.252+0000 7f10a2ffd700 1 -- 172.21.15.19:0/3993554295 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094011830 con 0x7f10a409e930 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.252+0000 7f10a2ffd700 1 -- 172.21.15.19:0/3993554295 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1094011990 con 0x7f10a409e930 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.252+0000 7f10a2ffd700 1 -- 172.21.15.19:0/3993554295 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094011d20 con 0x7f10a409e930 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 -- 172.21.15.19:0/3993554295 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 msgr2=0x7f10a409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 --2- 172.21.15.19:0/3993554295 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f10940098f0 tx=0x7f1094009c00 comp rx=0 tx=0).stop 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 -- 172.21.15.19:0/3993554295 shutdown_connections 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 --2- 172.21.15.19:0/3993554295 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409e930 0x7f10a409ed00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 --2- 172.21.15.19:0/3993554295 >> v2:172.21.15.19:3300/0 conn(0x7f10a409f240 0x7f10a41317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 -- 172.21.15.19:0/3993554295 >> 172.21.15.19:0/3993554295 conn(0x7f10a40a4210 msgr2=0x7f10a40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 -- 172.21.15.19:0/3993554295 shutdown_connections 2023-10-03T10:19:59.255 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.253+0000 7f10aa993700 1 -- 172.21.15.19:0/3993554295 wait complete. 2023-10-03T10:19:59.257 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.254+0000 7f10aa993700 1 Processor -- start 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.254+0000 7f10aa993700 1 -- start start 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10a409f240 0x7f10a406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 0x7f10a406c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41b72d0 con 0x7f10a409e930 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a9480 con 0x7f10a409f650 2023-10-03T10:19:59.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10aa993700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a89a0 con 0x7f10a409f240 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57664/0 (socket says 172.21.15.19:57664) 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 -- 172.21.15.19:0/1095254899 learned_addr learned my addr 172.21.15.19:0/1095254899 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a8f30700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 0x7f10a406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 -- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10a409f240 msgr2=0x7f10a406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10a409f240 0x7f10a406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 -- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 msgr2=0x7f10a406c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 0x7f10a406c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a3fff700 1 -- 172.21.15.19:0/1095254899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1094009550 con 0x7f10a409e930 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.255+0000 7f10a8f30700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 0x7f10a406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10a3fff700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1094009c40 tx=0x7f1094004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094004530 con 0x7f10a409e930 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109401f070 con 0x7f10a409e930 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10aa993700 1 -- 172.21.15.19:0/1095254899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a40a0190 con 0x7f10a409e930 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10940038c0 con 0x7f10a409e930 2023-10-03T10:19:59.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.256+0000 7f10aa993700 1 -- 172.21.15.19:0/1095254899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41a9790 con 0x7f10a409e930 2023-10-03T10:19:59.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.257+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1094021030 con 0x7f10a409e930 2023-10-03T10:19:59.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.257+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1094040a70 con 0x7f10a409e930 2023-10-03T10:19:59.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.257+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107c0052e0 con 0x7f10a409e930 2023-10-03T10:19:59.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.262+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1094015080 con 0x7f10a409e930 2023-10-03T10:19:59.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.301+0000 7f9986fd7700 1 Processor -- start 2023-10-03T10:19:59.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 -- start start 2023-10-03T10:19:59.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009dc30 0x7f998009e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 0x7f998013e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998006ab40 con 0x7f998006a770 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998009ebc0 con 0x7f998009dc30 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9986fd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998009a810 con 0x7f998013c1e0 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9984d73700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9984d73700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57680/0 (socket says 172.21.15.19:57680) 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9984d73700 1 -- 172.21.15.19:0/2494377722 learned_addr learned my addr 172.21.15.19:0/2494377722 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.302+0000 7f9985574700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 0x7f998013e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f997ffff700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009dc30 0x7f998009e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 -- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009dc30 msgr2=0x7f998009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009dc30 0x7f998009e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 -- 172.21.15.19:0/2494377722 >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 msgr2=0x7f998009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 --2- 172.21.15.19:0/2494377722 >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 -- 172.21.15.19:0/2494377722 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998009e920 con 0x7f998013c1e0 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9984d73700 1 --2- 172.21.15.19:0/2494377722 >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f9985574700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 0x7f998013e5c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9978009dc0 tx=0x7f997800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42654e3b089027b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f997f7fe700 1 -- 172.21.15.19:0/2494377722 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800e070 con 0x7f998013c1e0 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f997f7fe700 1 -- 172.21.15.19:0/2494377722 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997800bae0 con 0x7f998013c1e0 2023-10-03T10:19:59.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.303+0000 7f997f7fe700 1 -- 172.21.15.19:0/2494377722 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997800be90 con 0x7f998013c1e0 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 -- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 msgr2=0x7f998013e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 0x7f998013e5c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9978009dc0 tx=0x7f997800b330 comp rx=0 tx=0).stop 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 -- 172.21.15.19:0/2494377722 shutdown_connections 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998013c1e0 0x7f998013e5c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 --2- 172.21.15.19:0/2494377722 >> v2:172.21.15.19:3300/0 conn(0x7f998006a770 0x7f998009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 --2- 172.21.15.19:0/2494377722 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998009dc30 0x7f998009e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 -- 172.21.15.19:0/2494377722 >> 172.21.15.19:0/2494377722 conn(0x7f9980066f50 msgr2=0x7f998009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 -- 172.21.15.19:0/2494377722 shutdown_connections 2023-10-03T10:19:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.304+0000 7f9986fd7700 1 -- 172.21.15.19:0/2494377722 wait complete. 2023-10-03T10:19:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.305+0000 7f9986fd7700 1 Processor -- start 2023-10-03T10:19:59.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.305+0000 7f9986fd7700 1 -- start start 2023-10-03T10:19:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998006a770 0x7f9980072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998013c1e0 0x7f998012e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998012fff0 con 0x7f998009dc30 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9980131110 con 0x7f998013c1e0 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9986fd7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99801317c0 con 0x7f998006a770 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9984d73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998006a770 0x7f9980072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57696/0 (socket says 172.21.15.19:57696) 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 -- 172.21.15.19:0/3858410462 learned_addr learned my addr 172.21.15.19:0/3858410462 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f9985574700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998013c1e0 0x7f998012e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 -- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998006a770 msgr2=0x7f9980072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998006a770 0x7f9980072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 -- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998013c1e0 msgr2=0x7f998012e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.306+0000 7f997ffff700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998013c1e0 0x7f998012e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f997ffff700 1 -- 172.21.15.19:0/3858410462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009550 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f997ffff700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f996c00e810 tx=0x7f996c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00c070 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c013610 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9978009a70 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0139c0 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.307+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998009f1f0 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.308+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998011cc30 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.309+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f996c013b20 con 0x7f998009dc30 2023-10-03T10:19:59.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.309+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f996c042520 con 0x7f998009dc30 2023-10-03T10:19:59.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.314+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f996c010900 con 0x7f998009dc30 2023-10-03T10:19:59.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.387+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffb48074ea0 con 0x7ffb481341d0 2023-10-03T10:19:59.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.387+0000 7ffb36ffd700 1 -- 172.21.15.19:0/2958628694 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb40011b40 con 0x7ffb481341d0 2023-10-03T10:19:59.387 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 msgr2=0x7ffb4811f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 0x7ffb4811f1e0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ffb480a3690 tx=0x7ffb40004ad0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 shutdown_connections 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb481341d0 0x7ffb4811f1e0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4809e390 0x7ffb4811e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 --2- 172.21.15.19:0/2958628694 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb481338c0 0x7ffb4811eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.391+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 >> 172.21.15.19:0/2958628694 conn(0x7ffb480a2aa0 msgr2=0x7ffb48130730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.392+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 shutdown_connections 2023-10-03T10:19:59.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.392+0000 7ffb4cfed700 1 -- 172.21.15.19:0/2958628694 wait complete. 2023-10-03T10:19:59.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:19:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.458+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa818074ea0 con 0x7fa81809d6f0 2023-10-03T10:19:59.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.459+0000 7fa8157fa700 1 -- 172.21.15.19:0/1986948992 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa80c028090 con 0x7fa81809d6f0 2023-10-03T10:19:59.459 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:19:59.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 msgr2=0x7fa8181a7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c750 tx=0x7fa80c00ca60 comp rx=0 tx=0).stop 2023-10-03T10:19:59.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 shutdown_connections 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa81809e410 0x7fa8181c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa81809d6f0 0x7fa8181a7300 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 --2- 172.21.15.19:0/1986948992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa81809e000 0x7fa8181a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 >> 172.21.15.19:0/1986948992 conn(0x7fa818066f50 msgr2=0x7fa8181bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 shutdown_connections 2023-10-03T10:19:59.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.461+0000 7fa81ecc6700 1 -- 172.21.15.19:0/1986948992 wait complete. 2023-10-03T10:19:59.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.472+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f107c005590 con 0x7f10a409e930 2023-10-03T10:19:59.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.473+0000 7f10a0ff9700 1 -- 172.21.15.19:0/1095254899 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10940199a0 con 0x7f10a409e930 2023-10-03T10:19:59.473 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:19:59.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 msgr2=0x7f10a406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f1094009c40 tx=0x7f1094004750 comp rx=0 tx=0).stop 2023-10-03T10:19:59.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 shutdown_connections 2023-10-03T10:19:59.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f10a409f650 0x7f10a406c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a409e930 0x7f10a406b8b0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 --2- 172.21.15.19:0/1095254899 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f10a409f240 0x7f10a406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 >> 172.21.15.19:0/1095254899 conn(0x7f10a40a4210 msgr2=0x7f10a41b8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:19:59.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 shutdown_connections 2023-10-03T10:19:59.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.475+0000 7f108a7fc700 1 -- 172.21.15.19:0/1095254899 wait complete. 2023-10-03T10:19:59.489 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:19:59.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.533+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9980131980 con 0x7f998009dc30 2023-10-03T10:19:59.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.533+0000 7f997d7fa700 1 -- 172.21.15.19:0/3858410462 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f996c010310 con 0x7f998009dc30 2023-10-03T10:19:59.533 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 msgr2=0x7f998012dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f996c00e810 tx=0x7f996c00eb20 comp rx=0 tx=0).stop 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 shutdown_connections 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f998013c1e0 0x7f998012e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f998006a770 0x7f9980072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 --2- 172.21.15.19:0/3858410462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f998009dc30 0x7f998012dc10 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:19:59.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 >> 172.21.15.19:0/3858410462 conn(0x7f9980066f50 msgr2=0x7f998013e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:19:59.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 shutdown_connections 2023-10-03T10:19:59.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:19:59.536+0000 7f9986fd7700 1 -- 172.21.15.19:0/3858410462 wait complete. 2023-10-03T10:19:59.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:00.411 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:00.478 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:00.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:00.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:00.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.561+0000 7f905cd20700 1 Processor -- start 2023-10-03T10:20:00.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.561+0000 7f905cd20700 1 -- start start 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905cd20700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9058130750 0x7f9058130b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905cd20700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 0x7f905809db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905cd20700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f905809c190 con 0x7f905809e080 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905cd20700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905809b090 con 0x7f9058130750 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905cd20700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f905809a6c0 con 0x7f905809d6f0 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9058130750 0x7f9058130b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9056d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f905809e080 0x7f90581374b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36360/0 (socket says 172.21.15.19:36360) 2023-10-03T10:20:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9056d9d700 1 -- 172.21.15.19:0/1886308951 learned_addr learned my addr 172.21.15.19:0/1886308951 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:00.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9055d9b700 1 --2- 172.21.15.19:0/1886308951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 0x7f905809db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f905559a700 1 -- 172.21.15.19:0/1886308951 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186540839 0 0) 0x7f905809c190 con 0x7f905809e080 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9055d9b700 1 -- 172.21.15.19:0/1886308951 >> v2:172.21.15.19:3300/0 conn(0x7f9058130750 msgr2=0x7f9058130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9055d9b700 1 --2- 172.21.15.19:0/1886308951 >> v2:172.21.15.19:3300/0 conn(0x7f9058130750 0x7f9058130b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9055d9b700 1 -- 172.21.15.19:0/1886308951 >> v1:172.21.15.19:6789/0 conn(0x7f905809e080 legacy=0x7f90581374b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.562+0000 7f9055d9b700 1 -- 172.21.15.19:0/1886308951 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905809e500 con 0x7f905809d6f0 2023-10-03T10:20:00.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.563+0000 7f9055d9b700 1 --2- 172.21.15.19:0/1886308951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 0x7f905809db40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f904c009840 tx=0x7f904c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323fa79a992b3900 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.563+0000 7f905559a700 1 -- 172.21.15.19:0/1886308951 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011830 con 0x7f905809d6f0 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.563+0000 7f905559a700 1 -- 172.21.15.19:0/1886308951 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c011990 con 0x7f905809d6f0 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.563+0000 7f905559a700 1 -- 172.21.15.19:0/1886308951 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011d20 con 0x7f905809d6f0 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 -- 172.21.15.19:0/1886308951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 msgr2=0x7f905809db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 --2- 172.21.15.19:0/1886308951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 0x7f905809db40 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f904c009840 tx=0x7f904c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 -- 172.21.15.19:0/1886308951 shutdown_connections 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 --2- 172.21.15.19:0/1886308951 >> v2:172.21.15.19:3300/0 conn(0x7f9058130750 0x7f9058130b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 --2- 172.21.15.19:0/1886308951 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f905809d6f0 0x7f905809db40 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 -- 172.21.15.19:0/1886308951 >> 172.21.15.19:0/1886308951 conn(0x7f905809f470 msgr2=0x7f90580a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 -- 172.21.15.19:0/1886308951 shutdown_connections 2023-10-03T10:20:00.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.564+0000 7f905cd20700 1 -- 172.21.15.19:0/1886308951 wait complete. 2023-10-03T10:20:00.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.565+0000 7f905cd20700 1 Processor -- start 2023-10-03T10:20:00.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.565+0000 7f905cd20700 1 -- start start 2023-10-03T10:20:00.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f905809d6f0 0x7f905808e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905808c200 con 0x7f905809e080 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f905809b2b0 con 0x7f905809d6f0 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905cd20700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f905808cf60 con 0x7f9058130750 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9056d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57672/0 (socket says 172.21.15.19:57672) 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9056d9d700 1 -- 172.21.15.19:0/2937911405 learned_addr learned my addr 172.21.15.19:0/2937911405 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57716/0 (socket says 172.21.15.19:57716) 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f905659c700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f905809d6f0 0x7f905808e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 -- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 msgr2=0x7f9058097bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 -- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f905809d6f0 msgr2=0x7f905808e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f905809d6f0 0x7f905808e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9055d9b700 1 -- 172.21.15.19:0/2937911405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0094a0 con 0x7f905809e080 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.566+0000 7f9056d9d700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f9055d9b700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f904c016000 tx=0x7f904c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c004550 con 0x7f905809e080 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c01f070 con 0x7f905809e080 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0038e0 con 0x7f905809e080 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f905808bc60 con 0x7f905809e080 2023-10-03T10:20:00.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.567+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f905808ee20 con 0x7f905809e080 2023-10-03T10:20:00.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.568+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f904c003a40 con 0x7f905809e080 2023-10-03T10:20:00.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.568+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f904c021070 con 0x7f905809e080 2023-10-03T10:20:00.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.568+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90580747f0 con 0x7f905809e080 2023-10-03T10:20:00.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.578+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f904c02b020 con 0x7f905809e080 2023-10-03T10:20:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.629+0000 7fb6a7dda700 1 Processor -- start 2023-10-03T10:20:00.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 -- start start 2023-10-03T10:20:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb6a0139170 0x7fb6a013b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a009b120 con 0x7fb6a009d6f0 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a006b460 con 0x7fb6a0139170 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a7dda700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a009a7e0 con 0x7fb6a009e1d0 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a5375700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a5375700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39234/0 (socket says 172.21.15.19:39234) 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.630+0000 7fb6a5375700 1 -- 172.21.15.19:0/614050679 learned_addr learned my addr 172.21.15.19:0/614050679 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a6377700 1 --2- 172.21.15.19:0/614050679 >> v2:172.21.15.19:3300/0 conn(0x7fb6a0139170 0x7fb6a013b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a5375700 1 -- 172.21.15.19:0/614050679 >> v2:172.21.15.19:3300/0 conn(0x7fb6a0139170 msgr2=0x7fb6a013b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a5375700 1 --2- 172.21.15.19:0/614050679 >> v2:172.21.15.19:3300/0 conn(0x7fb6a0139170 0x7fb6a013b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a5375700 1 -- 172.21.15.19:0/614050679 >> v1:172.21.15.19:6789/0 conn(0x7fb6a009d6f0 legacy=0x7fb6a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a5375700 1 -- 172.21.15.19:0/614050679 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a009a500 con 0x7fb6a009e1d0 2023-10-03T10:20:00.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a5375700 1 --2- 172.21.15.19:0/614050679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb690009920 tx=0x7fb690009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc1bf39eadc29db3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a4b74700 1 -- 172.21.15.19:0/614050679 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690011830 con 0x7fb6a009e1d0 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a4b74700 1 -- 172.21.15.19:0/614050679 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb690011990 con 0x7fb6a009e1d0 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.631+0000 7fb6a4b74700 1 -- 172.21.15.19:0/614050679 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690011d20 con 0x7fb6a009e1d0 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 -- 172.21.15.19:0/614050679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 msgr2=0x7fb6a0138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/614050679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb690009920 tx=0x7fb690009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 -- 172.21.15.19:0/614050679 shutdown_connections 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/614050679 >> v2:172.21.15.19:3300/0 conn(0x7fb6a0139170 0x7fb6a013b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/614050679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009e1d0 0x7fb6a0138c30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 -- 172.21.15.19:0/614050679 >> 172.21.15.19:0/614050679 conn(0x7fb6a0066f50 msgr2=0x7fb6a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 -- 172.21.15.19:0/614050679 shutdown_connections 2023-10-03T10:20:00.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.632+0000 7fb6a7dda700 1 -- 172.21.15.19:0/614050679 wait complete. 2023-10-03T10:20:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.633+0000 7fb6a7dda700 1 Processor -- start 2023-10-03T10:20:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 -- start start 2023-10-03T10:20:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 0x7fb6a011ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb6a0139170 0x7fb6a011f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a01220a0 con 0x7fb6a009e1d0 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a009c710 con 0x7fb6a009d6f0 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a7dda700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a0120580 con 0x7fb6a0139170 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a5b76700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a5b76700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39238/0 (socket says 172.21.15.19:39238) 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a5b76700 1 -- 172.21.15.19:0/1751904471 learned_addr learned my addr 172.21.15.19:0/1751904471 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.634+0000 7fb6a6377700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb6a0139170 0x7fb6a011f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 -- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb6a0139170 msgr2=0x7fb6a011f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb6a0139170 0x7fb6a011f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5375700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 0x7fb6a011ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 -- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 msgr2=0x7fb6a011ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 0x7fb6a011ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 -- 172.21.15.19:0/1751904471 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009550 con 0x7fb6a009d6f0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5375700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 0x7fb6a011ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a5b76700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c4e0 tx=0x7fb69c00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0052d0 con 0x7fb6a009d6f0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c005430 con 0x7fb6a009d6f0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0038c0 con 0x7fb6a009d6f0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a00a2950 con 0x7fb6a009d6f0 2023-10-03T10:20:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.635+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a0122b10 con 0x7fb6a009d6f0 2023-10-03T10:20:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.636+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a0121d40 con 0x7fb6a009d6f0 2023-10-03T10:20:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.637+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb69c003a20 con 0x7fb6a009d6f0 2023-10-03T10:20:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.638+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb69c03ef80 con 0x7fb6a009d6f0 2023-10-03T10:20:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.642+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb69c018260 con 0x7fb6a009d6f0 2023-10-03T10:20:00.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.685+0000 7f796b673700 1 Processor -- start 2023-10-03T10:20:00.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.686+0000 7f796b673700 1 -- start start 2023-10-03T10:20:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.686+0000 7f796b673700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 0x7f796409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796b673700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 0x7f7964130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796b673700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796409f130 con 0x7f796409e000 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796b673700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796409f520 con 0x7f796409d6f0 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796b673700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f796409e930 con 0x7f796409e410 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796940f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 0x7f796409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796940f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 0x7f796409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57742/0 (socket says 172.21.15.19:57742) 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f796940f700 1 -- 172.21.15.19:0/3166162837 learned_addr learned my addr 172.21.15.19:0/3166162837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f7969c10700 1 --2- 172.21.15.19:0/3166162837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 0x7f7964130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f795bfff700 1 -- 172.21.15.19:0/3166162837 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663813312 0 0) 0x7f796409f130 con 0x7f796409e000 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f795bfff700 1 -- 172.21.15.19:0/3166162837 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79500035b0 con 0x7f796409e000 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f7969c10700 1 -- 172.21.15.19:0/3166162837 >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 msgr2=0x7f796409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f7969c10700 1 --2- 172.21.15.19:0/3166162837 >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 0x7f796409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f7969c10700 1 -- 172.21.15.19:0/3166162837 >> v1:172.21.15.19:6789/0 conn(0x7f796409e000 legacy=0x7f7964130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.687+0000 7f7969c10700 1 -- 172.21.15.19:0/3166162837 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796409b2d0 con 0x7f796409e410 2023-10-03T10:20:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.688+0000 7f7969c10700 1 --2- 172.21.15.19:0/3166162837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 0x7f7964130d70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f795c009d90 tx=0x7f795c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a95c4d1c30265901 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.688+0000 7f795bfff700 1 -- 172.21.15.19:0/3166162837 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00bd20 con 0x7f796409e410 2023-10-03T10:20:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.688+0000 7f795bfff700 1 -- 172.21.15.19:0/3166162837 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c00be80 con 0x7f796409e410 2023-10-03T10:20:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.688+0000 7f795bfff700 1 -- 172.21.15.19:0/3166162837 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c010710 con 0x7f796409e410 2023-10-03T10:20:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 -- 172.21.15.19:0/3166162837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 msgr2=0x7f7964130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 --2- 172.21.15.19:0/3166162837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 0x7f7964130d70 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f795c009d90 tx=0x7f795c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 -- 172.21.15.19:0/3166162837 shutdown_connections 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 --2- 172.21.15.19:0/3166162837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e410 0x7f7964130d70 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 --2- 172.21.15.19:0/3166162837 >> v2:172.21.15.19:3300/0 conn(0x7f796409d6f0 0x7f796409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 -- 172.21.15.19:0/3166162837 >> 172.21.15.19:0/3166162837 conn(0x7f7964066f50 msgr2=0x7f796409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 -- 172.21.15.19:0/3166162837 shutdown_connections 2023-10-03T10:20:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.689+0000 7f796b673700 1 -- 172.21.15.19:0/3166162837 wait complete. 2023-10-03T10:20:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.690+0000 7f796b673700 1 Processor -- start 2023-10-03T10:20:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 -- start start 2023-10-03T10:20:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f796409d6f0 0x7f796411df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 0x7f796411e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796411f400 con 0x7f796409e410 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7964121a50 con 0x7f796409d6f0 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.691+0000 7f796b673700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7964120e20 con 0x7f796409e000 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7968c0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 0x7f796411e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7968c0e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57696/0 (socket says 172.21.15.19:57696) 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7968c0e700 1 -- 172.21.15.19:0/2661259751 learned_addr learned my addr 172.21.15.19:0/2661259751 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f796940f700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f796409d6f0 0x7f796411df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.693 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 -- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 msgr2=0x7f796411e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 -- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f796409d6f0 msgr2=0x7f796411df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f796409d6f0 0x7f796411df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 -- 172.21.15.19:0/2661259751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009a70 con 0x7f796409e410 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7968c0e700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7969c10700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 0x7f796411e9b0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7964072a80 tx=0x7f795c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.692+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c004800 con 0x7f796409e410 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.693+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c003e30 con 0x7f796409e410 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.693+0000 7f796b673700 1 -- 172.21.15.19:0/2661259751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79641211e0 con 0x7f796409e410 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.693+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c010710 con 0x7f796409e410 2023-10-03T10:20:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.693+0000 7f796b673700 1 -- 172.21.15.19:0/2661259751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796409c700 con 0x7f796409e410 2023-10-03T10:20:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.694+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793c0052e0 con 0x7f796409e410 2023-10-03T10:20:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.695+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f795c010870 con 0x7f796409e410 2023-10-03T10:20:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.695+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f795c045130 con 0x7f796409e410 2023-10-03T10:20:00.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.704+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f795c016520 con 0x7f796409e410 2023-10-03T10:20:00.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.719+0000 7f21c5a77700 1 Processor -- start 2023-10-03T10:20:00.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.719+0000 7f21c5a77700 1 -- start start 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c01338a0 0x7f21c0133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c009de50 0x7f21c009e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c013a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c006fef0 con 0x7f21c01338a0 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c006ef30 con 0x7f21c009e760 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21c5a77700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01334b0 con 0x7f21c009de50 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c01338a0 0x7f21c0133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c01338a0 0x7f21c0133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57750/0 (socket says 172.21.15.19:57750) 2023-10-03T10:20:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 -- 172.21.15.19:0/1361808589 learned_addr learned my addr 172.21.15.19:0/1361808589 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bffff700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c013a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 -- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c009de50 msgr2=0x7f21c009e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c009de50 0x7f21c009e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 -- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 msgr2=0x7f21c013a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c013a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 -- 172.21.15.19:0/1361808589 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c006fc30 con 0x7f21c01338a0 2023-10-03T10:20:00.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.720+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c01338a0 0x7f21c0133c70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098f0 tx=0x7f21b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ee1e38e84df6a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21be7fc700 1 -- 172.21.15.19:0/1361808589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0011830 con 0x7f21c01338a0 2023-10-03T10:20:00.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21be7fc700 1 -- 172.21.15.19:0/1361808589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0011990 con 0x7f21c01338a0 2023-10-03T10:20:00.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21be7fc700 1 -- 172.21.15.19:0/1361808589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0011d20 con 0x7f21c01338a0 2023-10-03T10:20:00.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 -- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c01338a0 msgr2=0x7f21c0133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c01338a0 0x7f21c0133c70 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f21b00098f0 tx=0x7f21b0009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 -- 172.21.15.19:0/1361808589 shutdown_connections 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c013a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c01338a0 0x7f21c0133c70 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 --2- 172.21.15.19:0/1361808589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c009de50 0x7f21c009e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.721+0000 7f21c5a77700 1 -- 172.21.15.19:0/1361808589 >> 172.21.15.19:0/1361808589 conn(0x7f21c00a2aa0 msgr2=0x7f21c00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.722+0000 7f21c5a77700 1 -- 172.21.15.19:0/1361808589 shutdown_connections 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.722+0000 7f21c5a77700 1 -- 172.21.15.19:0/1361808589 wait complete. 2023-10-03T10:20:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 Processor -- start 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 -- start start 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c011f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c01338a0 0x7f21c011f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0120830 con 0x7f21c009de50 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c006f640 con 0x7f21c009e760 2023-10-03T10:20:00.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21c5a77700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0122090 con 0x7f21c01338a0 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21bf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.723+0000 7f21beffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c011f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57756/0 (socket says 172.21.15.19:57756) 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21beffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c011f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39270/0 (socket says 172.21.15.19:39270) 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 -- 172.21.15.19:0/2942205776 learned_addr learned my addr 172.21.15.19:0/2942205776 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bffff700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c01338a0 0x7f21c011f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 -- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c01338a0 msgr2=0x7f21c011f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c01338a0 0x7f21c011f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 -- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 msgr2=0x7f21c011f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c011f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 -- 172.21.15.19:0/2942205776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009550 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21bf7fe700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0004300 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b001f070 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c012f630 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.724+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b00036a0 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.725+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0122dc0 con 0x7f21c009de50 2023-10-03T10:20:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.726+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21b0021030 con 0x7f21c009de50 2023-10-03T10:20:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.726+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0134130 con 0x7f21c009de50 2023-10-03T10:20:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.726+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21b0044270 con 0x7f21c009de50 2023-10-03T10:20:00.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.731+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21b000b9d0 con 0x7f21c009de50 2023-10-03T10:20:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.797+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f905806b250 con 0x7f905809e080 2023-10-03T10:20:00.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.798+0000 7f9046ffd700 1 -- 172.21.15.19:0/2937911405 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f904c015070 con 0x7f905809e080 2023-10-03T10:20:00.798 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:00.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.800+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 msgr2=0x7f905808e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.800+0000 7f905cd20700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f904c016000 tx=0x7f904c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:00.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 shutdown_connections 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9058130750 0x7f9058097bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f905809d6f0 0x7f905808e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 --2- 172.21.15.19:0/2937911405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f905809e080 0x7f905808e8e0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 >> 172.21.15.19:0/2937911405 conn(0x7f905809f470 msgr2=0x7f90581b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 shutdown_connections 2023-10-03T10:20:00.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.801+0000 7f905cd20700 1 -- 172.21.15.19:0/2937911405 wait complete. 2023-10-03T10:20:00.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:00.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.862+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb6a0074ea0 con 0x7fb6a009d6f0 2023-10-03T10:20:00.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.862+0000 7fb6967fc700 1 -- 172.21.15.19:0/1751904471 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb69c017030 con 0x7fb6a009d6f0 2023-10-03T10:20:00.862 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 msgr2=0x7fb6a011e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c4e0 tx=0x7fb69c00c7f0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 shutdown_connections 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb6a0139170 0x7fb6a011f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb6a009d6f0 0x7fb6a011e900 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 --2- 172.21.15.19:0/1751904471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb6a009e1d0 0x7fb6a011ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.864+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 >> 172.21.15.19:0/1751904471 conn(0x7fb6a0066f50 msgr2=0x7fb6a00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.865+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 shutdown_connections 2023-10-03T10:20:00.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.865+0000 7fb6a7dda700 1 -- 172.21.15.19:0/1751904471 wait complete. 2023-10-03T10:20:00.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:00.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.913+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f793c005590 con 0x7f796409e410 2023-10-03T10:20:00.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.913+0000 7f7959ffb700 1 -- 172.21.15.19:0/2661259751 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f795c026020 con 0x7f796409e410 2023-10-03T10:20:00.913 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 msgr2=0x7f796411e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 0x7f796411e9b0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f7964072a80 tx=0x7f795c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 shutdown_connections 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f796409e410 0x7f796411e9b0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f796409d6f0 0x7f796411df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 --2- 172.21.15.19:0/2661259751 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f796409e000 0x7f796411e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 >> 172.21.15.19:0/2661259751 conn(0x7f7964066f50 msgr2=0x7f7964130970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 shutdown_connections 2023-10-03T10:20:00.917 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.916+0000 7f794f7fe700 1 -- 172.21.15.19:0/2661259751 wait complete. 2023-10-03T10:20:00.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.939+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21c0074ea0 con 0x7f21c009de50 2023-10-03T10:20:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.940+0000 7f21a7fff700 1 -- 172.21.15.19:0/2942205776 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21b0015070 con 0x7f21c009de50 2023-10-03T10:20:00.940 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 msgr2=0x7f21c011ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f21b0000c00 tx=0x7f21b0004750 comp rx=0 tx=0).stop 2023-10-03T10:20:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 shutdown_connections 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c01338a0 0x7f21c011f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c009de50 0x7f21c011ec70 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 --2- 172.21.15.19:0/2942205776 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c009e760 0x7f21c011f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 >> 172.21.15.19:0/2942205776 conn(0x7f21c00a2aa0 msgr2=0x7f21c009ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 shutdown_connections 2023-10-03T10:20:00.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:00.942+0000 7f21c5a77700 1 -- 172.21.15.19:0/2942205776 wait complete. 2023-10-03T10:20:00.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:01.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:01.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:01.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:01.956 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.969+0000 7f1b1762d700 1 Processor -- start 2023-10-03T10:20:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 -- start start 2023-10-03T10:20:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1009b120 con 0x7f1b1009e410 2023-10-03T10:20:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1006b460 con 0x7f1b1009e000 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b1762d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1009a7e0 con 0x7f1b1009d6f0 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b15bca700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b1009e410 0x7f1b10133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36382/0 (socket says 172.21.15.19:36382) 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b15bca700 1 -- 172.21.15.19:0/1845648523 learned_addr learned my addr 172.21.15.19:0/1845648523 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.970+0000 7f1b153c9700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b14bc8700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b153c9700 1 -- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 msgr2=0x7f1b101339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b153c9700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b153c9700 1 -- 172.21.15.19:0/1845648523 >> v1:172.21.15.19:6789/0 conn(0x7f1b1009e410 legacy=0x7f1b10133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b153c9700 1 -- 172.21.15.19:0/1845648523 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1009a500 con 0x7f1b1009d6f0 2023-10-03T10:20:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b14bc8700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:01.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b153c9700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 0x7f1b1009dac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0098a0 tx=0x7f1b0c009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8e49dbc6ef58b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:01.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b07fff700 1 -- 172.21.15.19:0/1845648523 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011830 con 0x7f1b1009d6f0 2023-10-03T10:20:01.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b07fff700 1 -- 172.21.15.19:0/1845648523 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c011990 con 0x7f1b1009d6f0 2023-10-03T10:20:01.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.971+0000 7f1b07fff700 1 -- 172.21.15.19:0/1845648523 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c011d20 con 0x7f1b1009d6f0 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 -- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 msgr2=0x7f1b1009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 0x7f1b1009dac0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c0098a0 tx=0x7f1b0c009bb0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 -- 172.21.15.19:0/1845648523 shutdown_connections 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009d6f0 0x7f1b1009dac0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 --2- 172.21.15.19:0/1845648523 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 -- 172.21.15.19:0/1845648523 >> 172.21.15.19:0/1845648523 conn(0x7f1b10066f50 msgr2=0x7f1b1009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 -- 172.21.15.19:0/1845648523 shutdown_connections 2023-10-03T10:20:01.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.972+0000 7f1b1762d700 1 -- 172.21.15.19:0/1845648523 wait complete. 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.973+0000 7f1b1762d700 1 Processor -- start 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 -- start start 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 0x7f1b101a5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101a73b0 con 0x7f1b1009d6f0 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101a7a80 con 0x7f1b1009e000 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b1762d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b101a8cd0 con 0x7f1b1009e410 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b15bca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b15bca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57730/0 (socket says 172.21.15.19:57730) 2023-10-03T10:20:01.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b15bca700 1 -- 172.21.15.19:0/2843588275 learned_addr learned my addr 172.21.15.19:0/2843588275 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.974+0000 7f1b14bc8700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 -- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 msgr2=0x7f1b101a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101a6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 -- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 msgr2=0x7f1b101a5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b153c9700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 0x7f1b101a5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 0x7f1b101a5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 -- 172.21.15.19:0/2843588275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000094a0 con 0x7f1b1009e410 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b153c9700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 0x7f1b101a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:01.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b15bca700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800cb20 tx=0x7f1b0800ce30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0800aa60 con 0x7f1b1009e410 2023-10-03T10:20:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800abc0 con 0x7f1b1009e410 2023-10-03T10:20:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c0094a0 con 0x7f1b1009e410 2023-10-03T10:20:01.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.975+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08012400 con 0x7f1b1009e410 2023-10-03T10:20:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.976+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b100a3170 con 0x7f1b1009e410 2023-10-03T10:20:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.976+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b0801b3b0 con 0x7f1b1009e410 2023-10-03T10:20:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.977+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1009c710 con 0x7f1b1009e410 2023-10-03T10:20:01.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.977+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b0801a360 con 0x7f1b1009e410 2023-10-03T10:20:01.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:01.983+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b08017030 con 0x7f1b1009e410 2023-10-03T10:20:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.028+0000 7fd0d8d3f700 1 Processor -- start 2023-10-03T10:20:02.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.028+0000 7fd0d8d3f700 1 -- start start 2023-10-03T10:20:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd0d41338c0 0x7fd0d4133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.030 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d409e390 0x7fd0d409e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d4070c80 con 0x7fd0d41338c0 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d409ed20 con 0x7fd0d409e390 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.029+0000 7fd0d8d3f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d406f720 con 0x7fd0d41341d0 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57742/0 (socket says 172.21.15.19:57742) 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 -- 172.21.15.19:0/3154315330 learned_addr learned my addr 172.21.15.19:0/3154315330 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d2d9d700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d409e390 0x7fd0d409e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d259c700 1 --2- 172.21.15.19:0/3154315330 >> v2:172.21.15.19:3300/0 conn(0x7fd0d41338c0 0x7fd0d4133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 -- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d409e390 msgr2=0x7fd0d409e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d409e390 0x7fd0d409e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 -- 172.21.15.19:0/3154315330 >> v2:172.21.15.19:3300/0 conn(0x7fd0d41338c0 msgr2=0x7fd0d4133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 --2- 172.21.15.19:0/3154315330 >> v2:172.21.15.19:3300/0 conn(0x7fd0d41338c0 0x7fd0d4133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 -- 172.21.15.19:0/3154315330 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d406fce0 con 0x7fd0d41341d0 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d1d9b700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009920 tx=0x7fd0c8009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c39218984aec580 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.030+0000 7fd0d159a700 1 -- 172.21.15.19:0/3154315330 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8011830 con 0x7fd0d41341d0 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.031+0000 7fd0d159a700 1 -- 172.21.15.19:0/3154315330 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c8011990 con 0x7fd0d41341d0 2023-10-03T10:20:02.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.031+0000 7fd0d159a700 1 -- 172.21.15.19:0/3154315330 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8011d20 con 0x7fd0d41341d0 2023-10-03T10:20:02.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 msgr2=0x7fd0d409de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009920 tx=0x7fd0c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/3154315330 shutdown_connections 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d409e390 0x7fd0d409e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/3154315330 >> v2:172.21.15.19:3300/0 conn(0x7fd0d41338c0 0x7fd0d4133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/3154315330 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41341d0 0x7fd0d409de50 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/3154315330 >> 172.21.15.19:0/3154315330 conn(0x7fd0d40a2aa0 msgr2=0x7fd0d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/3154315330 shutdown_connections 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.032+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/3154315330 wait complete. 2023-10-03T10:20:02.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.033+0000 7fd0d8d3f700 1 Processor -- start 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.033+0000 7fd0d8d3f700 1 -- start start 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 0x7fd0d411ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 0x7fd0d411d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41202d0 con 0x7fd0d409e390 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d406f960 con 0x7fd0d41341d0 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d8d3f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d411e8d0 con 0x7fd0d41338c0 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 0x7fd0d411ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57788/0 (socket says 172.21.15.19:57788) 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d1d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 0x7fd0d411ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57744/0 (socket says 172.21.15.19:57744) 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d259c700 1 -- 172.21.15.19:0/1776273152 learned_addr learned my addr 172.21.15.19:0/1776273152 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.034+0000 7fd0d2d9d700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 0x7fd0d411d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 -- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 msgr2=0x7fd0d411ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 0x7fd0d411ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 -- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 msgr2=0x7fd0d411c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 -- 172.21.15.19:0/1776273152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009550 con 0x7fd0d41341d0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d259c700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d2d9d700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 0x7fd0d411d200 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007cf0 tx=0x7fd0cc00e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc018070 con 0x7fd0d41341d0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0cc003a20 con 0x7fd0d41341d0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d4130d00 con 0x7fd0d41341d0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0cc003db0 con 0x7fd0d41341d0 2023-10-03T10:20:02.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.035+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d411ff50 con 0x7fd0d41341d0 2023-10-03T10:20:02.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.036+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd0cc00e970 con 0x7fd0d41341d0 2023-10-03T10:20:02.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.036+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d411fba0 con 0x7fd0d41341d0 2023-10-03T10:20:02.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.037+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd0cc03f530 con 0x7fd0d41341d0 2023-10-03T10:20:02.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.046+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd0cc00ec20 con 0x7fd0d41341d0 2023-10-03T10:20:02.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.076+0000 7f2593ec0700 1 Processor -- start 2023-10-03T10:20:02.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 -- start start 2023-10-03T10:20:02.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258c12c9a0 0x7f258c12cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c12fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 0x7f258c136c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c09a420 con 0x7f258c12c9a0 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c09a870 con 0x7f258c1301b0 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2593ec0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258c09b890 con 0x7f258c12f880 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.077+0000 7f2591c5c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258c12c9a0 0x7f258c12cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f258c12c9a0 0x7f258c12cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57798/0 (socket says 172.21.15.19:57798) 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 -- 172.21.15.19:0/1879750017 learned_addr learned my addr 172.21.15.19:0/1879750017 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f259245d700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 0x7f258c136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f259145b700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c12fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 -- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 msgr2=0x7f258c12fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c12fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 -- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 msgr2=0x7f258c136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 0x7f258c136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 -- 172.21.15.19:0/1879750017 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c09b2f0 con 0x7f258c12c9a0 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f259245d700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 0x7f258c136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2591c5c700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c12c9a0 0x7f258c12cd70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f25880098f0 tx=0x7f2588009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e50a167c60c4f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2590c5a700 1 -- 172.21.15.19:0/1879750017 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800c8a0 con 0x7f258c12c9a0 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2590c5a700 1 -- 172.21.15.19:0/1879750017 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f258800ca00 con 0x7f258c12c9a0 2023-10-03T10:20:02.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.078+0000 7f2590c5a700 1 -- 172.21.15.19:0/1879750017 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258800cd90 con 0x7f258c12c9a0 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 -- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c12c9a0 msgr2=0x7f258c12cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c12c9a0 0x7f258c12cd70 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f25880098f0 tx=0x7f2588009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 -- 172.21.15.19:0/1879750017 shutdown_connections 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c1301b0 0x7f258c136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c12c9a0 0x7f258c12cd70 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 --2- 172.21.15.19:0/1879750017 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c12fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 -- 172.21.15.19:0/1879750017 >> 172.21.15.19:0/1879750017 conn(0x7f258c0a2360 msgr2=0x7f258c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 -- 172.21.15.19:0/1879750017 shutdown_connections 2023-10-03T10:20:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.079+0000 7f2593ec0700 1 -- 172.21.15.19:0/1879750017 wait complete. 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.080+0000 7f2593ec0700 1 Processor -- start 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.080+0000 7f2593ec0700 1 -- start start 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c1c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 0x7f258c1c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c08b9b0 con 0x7f258c1301b0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c070cd0 con 0x7f258c12c9a0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2593ec0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f258c08bc00 con 0x7f258c12f880 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2591c5c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2591c5c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39326/0 (socket says 172.21.15.19:39326) 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f2591c5c700 1 -- 172.21.15.19:0/3416774413 learned_addr learned my addr 172.21.15.19:0/3416774413 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f259245d700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 0x7f258c1c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.081+0000 7f259145b700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c1c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 -- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 msgr2=0x7f258c1c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c1c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 -- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 msgr2=0x7f258c1c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 0x7f258c1c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 -- 172.21.15.19:0/3416774413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2584009a70 con 0x7f258c12c9a0 2023-10-03T10:20:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f259145b700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c1c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f259245d700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 0x7f258c1c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2591c5c700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258801e070 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2588004250 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25880045e0 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2588009550 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.082+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c09c5f0 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.083+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25880036a0 con 0x7f258c12c9a0 2023-10-03T10:20:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.083+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2588040230 con 0x7f258c12c9a0 2023-10-03T10:20:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.084+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258c074ea0 con 0x7f258c12c9a0 2023-10-03T10:20:02.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.093+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2588027080 con 0x7f258c12c9a0 2023-10-03T10:20:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.135+0000 7f02c5a88700 1 Processor -- start 2023-10-03T10:20:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.135+0000 7f02c5a88700 1 -- start start 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02c5a88700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02c009e850 0x7f02c009ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02c5a88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02c013be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02c5a88700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c006bc50 con 0x7f02c009f160 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02c5a88700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c009ae60 con 0x7f02c009e850 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02c5a88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006b990 con 0x7f02c0134290 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02beffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f02c009f160 0x7f02c0133b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36392/0 (socket says 172.21.15.19:36392) 2023-10-03T10:20:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02beffd700 1 -- 172.21.15.19:0/266482410 learned_addr learned my addr 172.21.15.19:0/266482410 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02bf7fe700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02c009e850 0x7f02c009ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100544528 0 0) 0x7f02c006bc50 con 0x7f02c009f160 2023-10-03T10:20:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02bffff700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02c013be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.136+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a80035b0 con 0x7f02c009f160 2023-10-03T10:20:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397892569 0 0) 0x7f02a80035b0 con 0x7f02c009f160 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 msgr2=0x7f02c013be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02c013be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02c009e850 msgr2=0x7f02c009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02c009e850 0x7f02c009ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c006cb10 con 0x7f02c009f160 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f02b4001670 con 0x7f02c009f160 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 >> v1:172.21.15.19:6789/0 conn(0x7f02c009f160 legacy=0x7f02c0133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8003a00 0x7f02a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 0x7f02a8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006b990 con 0x7f02a8004d90 2023-10-03T10:20:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800ba10 con 0x7f02a8003a00 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02a800bb50 con 0x7f02c0134290 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 0x7f02a8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02beffd700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bf7fe700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8003a00 0x7f02a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 -- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 msgr2=0x7f02a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 -- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8003a00 msgr2=0x7f02a8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8003a00 0x7f02a8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.137+0000 7f02bffff700 1 -- 172.21.15.19:0/266482410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80035b0 con 0x7f02a8004d90 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02bffff700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 0x7f02a8005200 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fc0 tx=0x7f02a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54fd50c3318ec0ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800ec30 con 0x7f02a8004d90 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800f040 con 0x7f02a8004d90 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02be7fc700 1 -- 172.21.15.19:0/266482410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8014480 con 0x7f02a8004d90 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02c5a88700 1 -- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 msgr2=0x7f02a8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.138+0000 7f02c5a88700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 0x7f02a8005200 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009fc0 tx=0x7f02a8005880 comp rx=0 tx=0).stop 2023-10-03T10:20:02.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 -- 172.21.15.19:0/266482410 shutdown_connections 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8004d90 0x7f02a8005200 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c0134290 0x7f02a8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 --2- 172.21.15.19:0/266482410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8003a00 0x7f02a8003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 -- 172.21.15.19:0/266482410 >> 172.21.15.19:0/266482410 conn(0x7f02c00a3f70 msgr2=0x7f02c00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 -- 172.21.15.19:0/266482410 shutdown_connections 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.139+0000 7f02c5a88700 1 -- 172.21.15.19:0/266482410 wait complete. 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 Processor -- start 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 -- start start 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8003a00 0x7f02c0122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 0x7f02c0122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 0x7f02c01232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0125a70 con 0x7f02a8003a00 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0124460 con 0x7f02a8004d90 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.140+0000 7f02c5a88700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f02c0126370 con 0x7f02c009f160 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02bffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 0x7f02c01232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 0x7f02c0122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02bffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 0x7f02c01232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57798/0 (socket says 172.21.15.19:57798) 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02bffff700 1 -- 172.21.15.19:0/1479368070 learned_addr learned my addr 172.21.15.19:0/1479368070 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02bf7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8003a00 0x7f02c0122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 -- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 msgr2=0x7f02c01232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 0x7f02c01232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 -- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8003a00 msgr2=0x7f02c0122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8003a00 0x7f02c0122850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 -- 172.21.15.19:0/1479368070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00a16e0 con 0x7f02a8004d90 2023-10-03T10:20:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.141+0000 7f02beffd700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 0x7f02c0122d90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f02b4000c00 tx=0x7f02b400ea60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.142+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4010510 con 0x7f02a8004d90 2023-10-03T10:20:02.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.142+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b4010670 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.142+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b4010a20 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.142+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c006cd30 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.142+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c0126b00 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.143+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f02b4010b80 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.143+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f02b403ef00 con 0x7f02a8004d90 2023-10-03T10:20:02.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.143+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c0125e80 con 0x7f02a8004d90 2023-10-03T10:20:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.152+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f02b4019070 con 0x7f02a8004d90 2023-10-03T10:20:02.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.202+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b10074ea0 con 0x7f1b1009e410 2023-10-03T10:20:02.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.203+0000 7f1b05ffb700 1 -- 172.21.15.19:0/2843588275 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b08024070 con 0x7f1b1009e410 2023-10-03T10:20:02.203 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:02.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 msgr2=0x7f1b101a6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800cb20 tx=0x7f1b0800ce30 comp rx=0 tx=0).stop 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 shutdown_connections 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b1009e410 0x7f1b101a6980 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b1009d6f0 0x7f1b101a5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.205+0000 7f1b1762d700 1 --2- 172.21.15.19:0/2843588275 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b1009e000 0x7f1b101a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.206+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 >> 172.21.15.19:0/2843588275 conn(0x7f1b10066f50 msgr2=0x7f1b101badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.206+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 shutdown_connections 2023-10-03T10:20:02.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.206+0000 7f1b1762d700 1 -- 172.21.15.19:0/2843588275 wait complete. 2023-10-03T10:20:02.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.264+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd0d4074ea0 con 0x7fd0d41341d0 2023-10-03T10:20:02.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.264+0000 7fd0c2ffd700 1 -- 172.21.15.19:0/1776273152 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd0cc01cb20 con 0x7fd0d41341d0 2023-10-03T10:20:02.264 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:02.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 msgr2=0x7fd0d411d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 0x7fd0d411d200 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007cf0 tx=0x7fd0cc00e0e0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 shutdown_connections 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd0d41341d0 0x7fd0d411d200 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd0d409e390 0x7fd0d411c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 --2- 172.21.15.19:0/1776273152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd0d41338c0 0x7fd0d411ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.267+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 >> 172.21.15.19:0/1776273152 conn(0x7fd0d40a2aa0 msgr2=0x7fd0d4132290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.268+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 shutdown_connections 2023-10-03T10:20:02.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.268+0000 7fd0d8d3f700 1 -- 172.21.15.19:0/1776273152 wait complete. 2023-10-03T10:20:02.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.337+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f258c072450 con 0x7f258c12c9a0 2023-10-03T10:20:02.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.338+0000 7f25827fc700 1 -- 172.21.15.19:0/3416774413 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2588014020 con 0x7f258c12c9a0 2023-10-03T10:20:02.338 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 msgr2=0x7f258c1c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588004750 comp rx=0 tx=0).stop 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 shutdown_connections 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f258c1301b0 0x7f258c1c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f258c12c9a0 0x7f258c1c8160 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 --2- 172.21.15.19:0/3416774413 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f258c12f880 0x7f258c1c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 >> 172.21.15.19:0/3416774413 conn(0x7f258c0a2360 msgr2=0x7f258c1b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 shutdown_connections 2023-10-03T10:20:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.340+0000 7f2593ec0700 1 -- 172.21.15.19:0/3416774413 wait complete. 2023-10-03T10:20:02.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:02.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.375+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f02c00747f0 con 0x7f02a8004d90 2023-10-03T10:20:02.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.375+0000 7f02a7fff700 1 -- 172.21.15.19:0/1479368070 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02b4010e30 con 0x7f02a8004d90 2023-10-03T10:20:02.375 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:02.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 msgr2=0x7f02c0122d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 0x7f02c0122d90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f02b4000c00 tx=0x7f02b400ea60 comp rx=0 tx=0).stop 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 shutdown_connections 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f02c009f160 0x7f02c01232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02a8003a00 0x7f02c0122850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 --2- 172.21.15.19:0/1479368070 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f02a8004d90 0x7f02c0122d90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.377+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 >> 172.21.15.19:0/1479368070 conn(0x7f02c00a3f70 msgr2=0x7f02c0070e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.378+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 shutdown_connections 2023-10-03T10:20:02.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:02.378+0000 7f02c5a88700 1 -- 172.21.15.19:0/1479368070 wait complete. 2023-10-03T10:20:02.391 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:03.221 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:03.282 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:03.355 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:03.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.367+0000 7f68177dc700 1 Processor -- start 2023-10-03T10:20:03.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.367+0000 7f68177dc700 1 -- start start 2023-10-03T10:20:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f68177dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 0x7f681009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f68177dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 0x7f68101339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f68177dc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681009b120 con 0x7f681009e410 2023-10-03T10:20:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f68177dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681006b460 con 0x7f681009d6f0 2023-10-03T10:20:03.368 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f68177dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f681009a7e0 con 0x7f681009e000 2023-10-03T10:20:03.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f6815d79700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f681009e410 0x7f6810133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36406/0 (socket says 172.21.15.19:36406) 2023-10-03T10:20:03.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f6815578700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 0x7f681009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f6815d79700 1 -- 172.21.15.19:0/3718644637 learned_addr learned my addr 172.21.15.19:0/3718644637 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:03.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.368+0000 7f6814d77700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 0x7f68101339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6814d77700 1 -- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 msgr2=0x7f681009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:03.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6814d77700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 0x7f681009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6814d77700 1 -- 172.21.15.19:0/3718644637 >> v1:172.21.15.19:6789/0 conn(0x7f681009e410 legacy=0x7f6810133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6814d77700 1 -- 172.21.15.19:0/3718644637 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681009a500 con 0x7f681009e000 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6815578700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 0x7f681009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6814d77700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 0x7f68101339f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f68000098a0 tx=0x7f6800009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a97585269f1deba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6807fff700 1 -- 172.21.15.19:0/3718644637 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011830 con 0x7f681009e000 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6807fff700 1 -- 172.21.15.19:0/3718644637 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800011990 con 0x7f681009e000 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.369+0000 7f6807fff700 1 -- 172.21.15.19:0/3718644637 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011d20 con 0x7f681009e000 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 -- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 msgr2=0x7f68101339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 0x7f68101339f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f68000098a0 tx=0x7f6800009bb0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 -- 172.21.15.19:0/3718644637 shutdown_connections 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009d6f0 0x7f681009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 --2- 172.21.15.19:0/3718644637 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e000 0x7f68101339f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 -- 172.21.15.19:0/3718644637 >> 172.21.15.19:0/3718644637 conn(0x7f6810066f50 msgr2=0x7f681009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 -- 172.21.15.19:0/3718644637 shutdown_connections 2023-10-03T10:20:03.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.370+0000 7f68177dc700 1 -- 172.21.15.19:0/3718644637 wait complete. 2023-10-03T10:20:03.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.371+0000 7f68177dc700 1 Processor -- start 2023-10-03T10:20:03.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.371+0000 7f68177dc700 1 -- start start 2023-10-03T10:20:03.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 0x7f68101a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e410 0x7f68101a6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68101a7460 con 0x7f681009d6f0 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68101a7b90 con 0x7f681009e000 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f68177dc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f68101a81b0 con 0x7f681009e410 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f6814d77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f6815578700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 0x7f68101a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f6815d79700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e410 0x7f68101a6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f6814d77700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39368/0 (socket says 172.21.15.19:39368) 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.372+0000 7f6814d77700 1 -- 172.21.15.19:0/3538608602 learned_addr learned my addr 172.21.15.19:0/3538608602 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 -- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e410 msgr2=0x7f68101a6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e410 0x7f68101a6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 -- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 msgr2=0x7f68101a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 0x7f68101a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 -- 172.21.15.19:0/3538608602 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0094a0 con 0x7f681009e000 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6815578700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 0x7f68101a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6814d77700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6800013000 tx=0x7f6800004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800004550 con 0x7f681009e000 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680001f070 con 0x7f681009e000 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68000094a0 con 0x7f681009e000 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000038e0 con 0x7f681009e000 2023-10-03T10:20:03.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.373+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68100a3250 con 0x7f681009e000 2023-10-03T10:20:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.374+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6800003a40 con 0x7f681009e000 2023-10-03T10:20:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.374+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681009c770 con 0x7f681009e000 2023-10-03T10:20:03.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.374+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6800021070 con 0x7f681009e000 2023-10-03T10:20:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.380+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6800015070 con 0x7f681009e000 2023-10-03T10:20:03.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:03.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.430+0000 7f05513da700 1 Processor -- start 2023-10-03T10:20:03.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.431+0000 7f05513da700 1 -- start start 2023-10-03T10:20:03.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.431+0000 7f05513da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1338c0 0x7f054c133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.431+0000 7f05513da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 0x7f054c09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f05513da700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f054c06f720 con 0x7f054c09e390 2023-10-03T10:20:03.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f05513da700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c070c80 con 0x7f054c1341d0 2023-10-03T10:20:03.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f05513da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054c06fce0 con 0x7f054c1338c0 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f054c09e390 0x7f054c13a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36410/0 (socket says 172.21.15.19:36410) 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054b7fe700 1 -- 172.21.15.19:0/1457934002 learned_addr learned my addr 172.21.15.19:0/1457934002 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054a7fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 0x7f054c09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054affd700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1338c0 0x7f054c133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054a7fc700 1 -- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1338c0 msgr2=0x7f054c133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1338c0 0x7f054c133c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f0549ffb700 1 -- 172.21.15.19:0/1457934002 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267892697 0 0) 0x7f054c06f720 con 0x7f054c09e390 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054a7fc700 1 -- 172.21.15.19:0/1457934002 >> v1:172.21.15.19:6789/0 conn(0x7f054c09e390 legacy=0x7f054c13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.432+0000 7f054a7fc700 1 -- 172.21.15.19:0/1457934002 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c1336a0 con 0x7f054c1341d0 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.433+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 0x7f054c09de50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0540009870 tx=0x7f0540009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af93526aa3c51392 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.433+0000 7f0549ffb700 1 -- 172.21.15.19:0/1457934002 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011830 con 0x7f054c1341d0 2023-10-03T10:20:03.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.433+0000 7f0549ffb700 1 -- 172.21.15.19:0/1457934002 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0540011990 con 0x7f054c1341d0 2023-10-03T10:20:03.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.433+0000 7f0549ffb700 1 -- 172.21.15.19:0/1457934002 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540011d20 con 0x7f054c1341d0 2023-10-03T10:20:03.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 -- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 msgr2=0x7f054c09de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 0x7f054c09de50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0540009870 tx=0x7f0540009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:03.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 -- 172.21.15.19:0/1457934002 shutdown_connections 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1338c0 0x7f054c133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 --2- 172.21.15.19:0/1457934002 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1341d0 0x7f054c09de50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 -- 172.21.15.19:0/1457934002 >> 172.21.15.19:0/1457934002 conn(0x7f054c0a2aa0 msgr2=0x7f054c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 -- 172.21.15.19:0/1457934002 shutdown_connections 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.434+0000 7f05513da700 1 -- 172.21.15.19:0/1457934002 wait complete. 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.435+0000 7f05513da700 1 Processor -- start 2023-10-03T10:20:03.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.435+0000 7f05513da700 1 -- start start 2023-10-03T10:20:03.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 0x7f054c11cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 0x7f054c11d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1341d0 0x7f054c11d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054c06f9d0 con 0x7f054c09e390 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c11fb90 con 0x7f054c1338c0 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f05513da700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f054c120a30 con 0x7f054c1341d0 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f054affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 0x7f054c11cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.436+0000 7f054affd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 0x7f054c11cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57836/0 (socket says 172.21.15.19:57836) 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054affd700 1 -- 172.21.15.19:0/1689365873 learned_addr learned my addr 172.21.15.19:0/1689365873 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:03.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 0x7f054c11d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054b7fe700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1341d0 0x7f054c11d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 -- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1341d0 msgr2=0x7f054c11d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1341d0 0x7f054c11d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 -- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 msgr2=0x7f054c11cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 0x7f054c11cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 -- 172.21.15.19:0/1689365873 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400094a0 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f054a7fc700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 0x7f054c11d040 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f054c0a3690 tx=0x7f0540004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.437+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540004510 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.438+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05400036a0 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.438+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054c11fec0 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.438+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540003a30 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.438+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054c120400 con 0x7f054c1338c0 2023-10-03T10:20:03.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.439+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0540003b90 con 0x7f054c1338c0 2023-10-03T10:20:03.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.439+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f05400409c0 con 0x7f054c1338c0 2023-10-03T10:20:03.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.440+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054c074ea0 con 0x7f054c1338c0 2023-10-03T10:20:03.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.449+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0540003e40 con 0x7f054c1338c0 2023-10-03T10:20:03.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.520+0000 7f31fc8d8700 1 Processor -- start 2023-10-03T10:20:03.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.520+0000 7f31fc8d8700 1 -- start start 2023-10-03T10:20:03.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31fc8d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31fc8d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 0x7f31f8139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31fc8d8700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f81313c0 con 0x7f31f8099a40 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31fc8d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f806e8c0 con 0x7f31f809a580 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31fc8d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8071d20 con 0x7f31f8131810 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f31f8099a40 0x7f31f8099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36422/0 (socket says 172.21.15.19:36422) 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f5d9b700 1 -- 172.21.15.19:0/1975939725 learned_addr learned my addr 172.21.15.19:0/1975939725 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f6d9d700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 0x7f31f8139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f659c700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f6d9d700 1 -- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 msgr2=0x7f31f8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:03.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f6d9d700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f559a700 1 -- 172.21.15.19:0/1975939725 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298615727 0 0) 0x7f31f81313c0 con 0x7f31f8099a40 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f6d9d700 1 -- 172.21.15.19:0/1975939725 >> v1:172.21.15.19:6789/0 conn(0x7f31f8099a40 legacy=0x7f31f8099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f6d9d700 1 -- 172.21.15.19:0/1975939725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80721a0 con 0x7f31f809a580 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.521+0000 7f31f659c700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31f6d9d700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 0x7f31f8139660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009dc0 tx=0x7f31f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb55c619ab64d36 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31f559a700 1 -- 172.21.15.19:0/1975939725 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000e070 con 0x7f31f809a580 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31f559a700 1 -- 172.21.15.19:0/1975939725 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000bb20 con 0x7f31f809a580 2023-10-03T10:20:03.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31f559a700 1 -- 172.21.15.19:0/1975939725 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0012430 con 0x7f31f809a580 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31fc8d8700 1 -- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 msgr2=0x7f31f8139660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.522+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 0x7f31f8139660 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009dc0 tx=0x7f31f000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 -- 172.21.15.19:0/1975939725 shutdown_connections 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f809a580 0x7f31f8139660 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/1975939725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 -- 172.21.15.19:0/1975939725 >> 172.21.15.19:0/1975939725 conn(0x7f31f80a2aa0 msgr2=0x7f31f80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 -- 172.21.15.19:0/1975939725 shutdown_connections 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.523+0000 7f31fc8d8700 1 -- 172.21.15.19:0/1975939725 wait complete. 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 Processor -- start 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 -- start start 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f8099a40 0x7f31f806f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f811f010 con 0x7f31f809a580 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f811f210 con 0x7f31f8099a40 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.524+0000 7f31fc8d8700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f31f811e100 con 0x7f31f8131810 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57848/0 (socket says 172.21.15.19:57848) 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f6d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57840/0 (socket says 172.21.15.19:57840) 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 -- 172.21.15.19:0/600810931 learned_addr learned my addr 172.21.15.19:0/600810931 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f659c700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f8099a40 0x7f31f806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 -- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 msgr2=0x7f31f8070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 -- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f8099a40 msgr2=0x7f31f806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f8099a40 0x7f31f806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 -- 172.21.15.19:0/600810931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e80094a0 con 0x7f31f809a580 2023-10-03T10:20:03.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.525+0000 7f31f5d9b700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f31ec001c40 tx=0x7f31ec014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.526+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec017070 con 0x7f31f809a580 2023-10-03T10:20:03.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.526+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec001d30 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.526+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f0009a70 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.526+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec014d40 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.526+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f806eb00 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.527+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f8074ea0 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.527+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f31ec004870 con 0x7f31f809a580 2023-10-03T10:20:03.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.527+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f31ec0471d0 con 0x7f31f809a580 2023-10-03T10:20:03.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.532+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f31ec004b20 con 0x7f31f809a580 2023-10-03T10:20:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.546+0000 7f92f960f700 1 Processor -- start 2023-10-03T10:20:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.546+0000 7f92f960f700 1 -- start start 2023-10-03T10:20:03.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f40a0a30 0x7f92f40a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f92f409d630 0x7f92f40a1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f40a2a70 con 0x7f92f409d630 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f40a01d0 con 0x7f92f40a0a30 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f960f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f409e2b0 con 0x7f92f4133930 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57844/0 (socket says 172.21.15.19:57844) 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.547+0000 7f92f37fe700 1 -- 172.21.15.19:0/1079335367 learned_addr learned my addr 172.21.15.19:0/1079335367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f27fc700 1 --2- 172.21.15.19:0/1079335367 >> v2:172.21.15.19:3300/0 conn(0x7f92f409d630 0x7f92f40a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 -- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f40a0a30 msgr2=0x7f92f40a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:03.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 --2- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f40a0a30 0x7f92f40a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 -- 172.21.15.19:0/1079335367 >> v2:172.21.15.19:3300/0 conn(0x7f92f409d630 msgr2=0x7f92f40a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:03.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 --2- 172.21.15.19:0/1079335367 >> v2:172.21.15.19:3300/0 conn(0x7f92f409d630 0x7f92f40a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 -- 172.21.15.19:0/1079335367 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f409dc50 con 0x7f92f4133930 2023-10-03T10:20:03.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f37fe700 1 --2- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f25c4325450b6414 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f1ffb700 1 -- 172.21.15.19:0/1079335367 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00e070 con 0x7f92f4133930 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f1ffb700 1 -- 172.21.15.19:0/1079335367 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec00b9c0 con 0x7f92f4133930 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.548+0000 7f92f1ffb700 1 -- 172.21.15.19:0/1079335367 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec00bd70 con 0x7f92f4133930 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 -- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 msgr2=0x7f92f4133dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 --2- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009e50 tx=0x7f92ec00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 -- 172.21.15.19:0/1079335367 shutdown_connections 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 --2- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f40a0a30 0x7f92f40a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 --2- 172.21.15.19:0/1079335367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f4133930 0x7f92f4133dd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 --2- 172.21.15.19:0/1079335367 >> v2:172.21.15.19:3300/0 conn(0x7f92f409d630 0x7f92f40a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 -- 172.21.15.19:0/1079335367 >> 172.21.15.19:0/1079335367 conn(0x7f92f40a3050 msgr2=0x7f92f40a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 -- 172.21.15.19:0/1079335367 shutdown_connections 2023-10-03T10:20:03.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.549+0000 7f92f960f700 1 -- 172.21.15.19:0/1079335367 wait complete. 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 Processor -- start 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 -- start start 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f40a0a30 0x7f92f41c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f4133930 0x7f92f41c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f4120e10 con 0x7f92f409d630 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f41206a0 con 0x7f92f4133930 2023-10-03T10:20:03.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.551+0000 7f92f960f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92f4121200 con 0x7f92f40a0a30 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57874/0 (socket says 172.21.15.19:57874) 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 -- 172.21.15.19:0/1012996972 learned_addr learned my addr 172.21.15.19:0/1012996972 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f27fc700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f40a0a30 0x7f92f41c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f37fe700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f4133930 0x7f92f41c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 -- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f40a0a30 msgr2=0x7f92f41c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f40a0a30 0x7f92f41c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 -- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f4133930 msgr2=0x7f92f41c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f4133930 0x7f92f41c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 -- 172.21.15.19:0/1012996972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec009b30 con 0x7f92f409d630 2023-10-03T10:20:03.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.552+0000 7f92f2ffd700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f92e400b560 tx=0x7f92e400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:03.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.553+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011830 con 0x7f92f409d630 2023-10-03T10:20:03.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.553+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40119b0 con 0x7f92f409d630 2023-10-03T10:20:03.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.553+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4011d60 con 0x7f92f409d630 2023-10-03T10:20:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.553+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f40a40c0 con 0x7f92f409d630 2023-10-03T10:20:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.553+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f41333c0 con 0x7f92f409d630 2023-10-03T10:20:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.554+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f92e401a400 con 0x7f92f409d630 2023-10-03T10:20:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.554+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f92e403f660 con 0x7f92f409d630 2023-10-03T10:20:03.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.554+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f4122070 con 0x7f92f409d630 2023-10-03T10:20:03.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.559+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92e4015020 con 0x7f92f409d630 2023-10-03T10:20:03.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.627+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6810074ea0 con 0x7f681009e000 2023-10-03T10:20:03.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.627+0000 7f6805ffb700 1 -- 172.21.15.19:0/3538608602 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f68000193b0 con 0x7f681009e000 2023-10-03T10:20:03.628 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:03.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 msgr2=0x7f68101a6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f6800013000 tx=0x7f6800004750 comp rx=0 tx=0).stop 2023-10-03T10:20:03.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 shutdown_connections 2023-10-03T10:20:03.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f681009e410 0x7f68101a6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f681009d6f0 0x7f68101a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 --2- 172.21.15.19:0/3538608602 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f681009e000 0x7f68101a6510 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 >> 172.21.15.19:0/3538608602 conn(0x7f6810066f50 msgr2=0x7f68101baef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 shutdown_connections 2023-10-03T10:20:03.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.630+0000 7f68177dc700 1 -- 172.21.15.19:0/3538608602 wait complete. 2023-10-03T10:20:03.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:03.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.681+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f054c06b9e0 con 0x7f054c1338c0 2023-10-03T10:20:03.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.682+0000 7f05337fe700 1 -- 172.21.15.19:0/1689365873 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0540015020 con 0x7f054c1338c0 2023-10-03T10:20:03.682 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:03.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 msgr2=0x7f054c11d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 0x7f054c11d040 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f054c0a3690 tx=0x7f0540004750 comp rx=0 tx=0).stop 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 shutdown_connections 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f054c1341d0 0x7f054c11d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f054c09e390 0x7f054c11cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 --2- 172.21.15.19:0/1689365873 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f054c1338c0 0x7f054c11d040 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.685+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 >> 172.21.15.19:0/1689365873 conn(0x7f054c0a2aa0 msgr2=0x7f054c0a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.686+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 shutdown_connections 2023-10-03T10:20:03.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.686+0000 7f05513da700 1 -- 172.21.15.19:0/1689365873 wait complete. 2023-10-03T10:20:03.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:03.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.742+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31f806b9e0 con 0x7f31f809a580 2023-10-03T10:20:03.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.742+0000 7f31e6ffd700 1 -- 172.21.15.19:0/600810931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f31ec01bb20 con 0x7f31f809a580 2023-10-03T10:20:03.743 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 msgr2=0x7f31f806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f31ec001c40 tx=0x7f31ec014330 comp rx=0 tx=0).stop 2023-10-03T10:20:03.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 shutdown_connections 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f31f8131810 0x7f31f8070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f31f8099a40 0x7f31f806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 --2- 172.21.15.19:0/600810931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f31f809a580 0x7f31f806fb50 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.744+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 >> 172.21.15.19:0/600810931 conn(0x7f31f80a2aa0 msgr2=0x7f31f812e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.745+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 shutdown_connections 2023-10-03T10:20:03.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.745+0000 7f31fc8d8700 1 -- 172.21.15.19:0/600810931 wait complete. 2023-10-03T10:20:03.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:03.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.792+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92f40747f0 con 0x7f92f409d630 2023-10-03T10:20:03.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.792+0000 7f92db7fe700 1 -- 172.21.15.19:0/1012996972 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92e4029090 con 0x7f92f409d630 2023-10-03T10:20:03.792 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 msgr2=0x7f92f41c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f92e400b560 tx=0x7f92e400b870 comp rx=0 tx=0).stop 2023-10-03T10:20:03.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 shutdown_connections 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f92f4133930 0x7f92f41c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f92f409d630 0x7f92f41c8100 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 --2- 172.21.15.19:0/1012996972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f92f40a0a30 0x7f92f41c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 >> 172.21.15.19:0/1012996972 conn(0x7f92f40a3050 msgr2=0x7f92f409ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 shutdown_connections 2023-10-03T10:20:03.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:03.795+0000 7f92f960f700 1 -- 172.21.15.19:0/1012996972 wait complete. 2023-10-03T10:20:03.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:04.646 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:04.700 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:04.759 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.797+0000 7f3adb5ef700 1 Processor -- start 2023-10-03T10:20:04.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 -- start start 2023-10-03T10:20:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ad4137030 0x7f3ad4139410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad4131510 con 0x7f3ad41316d0 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad4099e70 con 0x7f3ad4137030 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.798+0000 7f3adb5ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4066680 con 0x7f3ad4134710 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad8b8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ad4137030 0x7f3ad4139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad8b8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57858/0 (socket says 172.21.15.19:57858) 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ad4137030 0x7f3ad4139410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57880/0 (socket says 172.21.15.19:57880) 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad938b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3ad41316d0 0x7f3ad4131aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36432/0 (socket says 172.21.15.19:36432) 2023-10-03T10:20:04.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad8b8a700 1 -- 172.21.15.19:0/454092246 learned_addr learned my addr 172.21.15.19:0/454092246 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 -- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 msgr2=0x7f3ad4136af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 -- 172.21.15.19:0/454092246 >> v1:172.21.15.19:6789/0 conn(0x7f3ad41316d0 legacy=0x7f3ad4131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 -- 172.21.15.19:0/454092246 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad409ee00 con 0x7f3ad4137030 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad8b8a700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3ad9b8c700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad4137030 0x7f3ad4139410 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009d90 tx=0x7f3acc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547229f6d47e7ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3acbfff700 1 -- 172.21.15.19:0/454092246 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00e070 con 0x7f3ad4137030 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3acbfff700 1 -- 172.21.15.19:0/454092246 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3acc00bb20 con 0x7f3ad4137030 2023-10-03T10:20:04.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.799+0000 7f3acbfff700 1 -- 172.21.15.19:0/454092246 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc012430 con 0x7f3ad4137030 2023-10-03T10:20:04.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 -- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad4137030 msgr2=0x7f3ad4139410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad4137030 0x7f3ad4139410 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f3acc009d90 tx=0x7f3acc00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 -- 172.21.15.19:0/454092246 shutdown_connections 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad4137030 0x7f3ad4139410 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/454092246 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad4136af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.800+0000 7f3adb5ef700 1 -- 172.21.15.19:0/454092246 >> 172.21.15.19:0/454092246 conn(0x7f3ad40a2aa0 msgr2=0x7f3ad40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.801+0000 7f3adb5ef700 1 -- 172.21.15.19:0/454092246 shutdown_connections 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.801+0000 7f3adb5ef700 1 -- 172.21.15.19:0/454092246 wait complete. 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.802+0000 7f3adb5ef700 1 Processor -- start 2023-10-03T10:20:04.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.802+0000 7f3adb5ef700 1 -- start start 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad41316d0 0x7f3ad41c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 0x7f3ad406f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad4071520 con 0x7f3ad41316d0 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad411e300 con 0x7f3ad4137030 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3adb5ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad409a0b0 con 0x7f3ad4134710 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57860/0 (socket says 172.21.15.19:57860) 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 -- 172.21.15.19:0/620715267 learned_addr learned my addr 172.21.15.19:0/620715267 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad9b8c700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 0x7f3ad406f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad938b700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad41316d0 0x7f3ad41c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 -- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 msgr2=0x7f3ad406f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 0x7f3ad406f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 -- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad41316d0 msgr2=0x7f3ad41c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad41316d0 0x7f3ad41c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad8b8a700 1 -- 172.21.15.19:0/620715267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac4009550 con 0x7f3ad4134710 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.803+0000 7f3ad9b8c700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 0x7f3ad406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3ad8b8a700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ebe0 tx=0x7f3ac400eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400c850 con 0x7f3ad4134710 2023-10-03T10:20:04.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400c9b0 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc009a70 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400cd60 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.804+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad41c8ff0 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.805+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ac4013470 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.806+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad4074ea0 con 0x7f3ad4134710 2023-10-03T10:20:04.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.806+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ac403f7a0 con 0x7f3ad4134710 2023-10-03T10:20:04.809 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:04.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.815+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ac4021080 con 0x7f3ad4134710 2023-10-03T10:20:04.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 Processor -- start 2023-10-03T10:20:04.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 -- start start 2023-10-03T10:20:04.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 0x7f1494138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149406b990 con 0x7f1494133420 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149409b0e0 con 0x7f14941337f0 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.849+0000 7f149afa5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1494133c20 con 0x7f1494138dc0 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1498d41700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1494133420 0x7f1494133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:36446/0 (socket says 172.21.15.19:36446) 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1498d41700 1 -- 172.21.15.19:0/731917537 learned_addr learned my addr 172.21.15.19:0/731917537 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:04.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1499542700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f14937fe700 1 -- 172.21.15.19:0/731917537 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070089577 0 0) 0x7f149406b990 con 0x7f1494133420 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f14937fe700 1 -- 172.21.15.19:0/731917537 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14840035b0 con 0x7f1494133420 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1493fff700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 0x7f1494138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1499542700 1 -- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 msgr2=0x7f1494138880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1499542700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 0x7f1494138880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1499542700 1 -- 172.21.15.19:0/731917537 >> v1:172.21.15.19:6789/0 conn(0x7f1494133420 legacy=0x7f1494133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1499542700 1 -- 172.21.15.19:0/731917537 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940a0590 con 0x7f1494138dc0 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.850+0000 7f1493fff700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 0x7f1494138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.851+0000 7f1499542700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149413b1a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f148c009dc0 tx=0x7f148c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80d23838cf8b7983 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.851+0000 7f14937fe700 1 -- 172.21.15.19:0/731917537 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c00e070 con 0x7f1494138dc0 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.851+0000 7f14937fe700 1 -- 172.21.15.19:0/731917537 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c00bb20 con 0x7f1494138dc0 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.851+0000 7f14937fe700 1 -- 172.21.15.19:0/731917537 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c012430 con 0x7f1494138dc0 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 -- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 msgr2=0x7f149413b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149413b1a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f148c009dc0 tx=0x7f148c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 -- 172.21.15.19:0/731917537 shutdown_connections 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149413b1a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 --2- 172.21.15.19:0/731917537 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f14941337f0 0x7f1494138880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 -- 172.21.15.19:0/731917537 >> 172.21.15.19:0/731917537 conn(0x7f14940a4210 msgr2=0x7f14940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:04.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 -- 172.21.15.19:0/731917537 shutdown_connections 2023-10-03T10:20:04.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.852+0000 7f149afa5700 1 -- 172.21.15.19:0/731917537 wait complete. 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.853+0000 7f149afa5700 1 Processor -- start 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.854+0000 7f149afa5700 1 -- start start 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.854+0000 7f149afa5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.854+0000 7f149afa5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14941337f0 0x7f149409cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f149afa5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149409d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f149afa5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14941388a0 con 0x7f14941337f0 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f149afa5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149412f350 con 0x7f1494133420 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f149afa5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1494130570 con 0x7f1494138dc0 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1499542700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149409d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39446/0 (socket says 172.21.15.19:39446) 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1499542700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149409d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57874/0 (socket says 172.21.15.19:57874) 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 -- 172.21.15.19:0/1875476459 learned_addr learned my addr 172.21.15.19:0/1875476459 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1493fff700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14941337f0 0x7f149409cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 -- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 msgr2=0x7f149409d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149409d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 -- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14941337f0 msgr2=0x7f149409cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14941337f0 0x7f149409cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 -- 172.21.15.19:0/1875476459 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c009a70 con 0x7f1494133420 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.855+0000 7f1498d41700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f148800c700 tx=0x7f148800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.856+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488005d70 con 0x7f1494133420 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.856+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1494130a00 con 0x7f1494133420 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.856+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14880070d0 con 0x7f1494133420 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.856+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488007460 con 0x7f1494133420 2023-10-03T10:20:04.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.856+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149412f100 con 0x7f1494133420 2023-10-03T10:20:04.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.857+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f14880075c0 con 0x7f1494133420 2023-10-03T10:20:04.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.857+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1494132690 con 0x7f1494133420 2023-10-03T10:20:04.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.859+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1488011360 con 0x7f1494133420 2023-10-03T10:20:04.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.867+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1488044060 con 0x7f1494133420 2023-10-03T10:20:04.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.918+0000 7ff3a74ac700 1 Processor -- start 2023-10-03T10:20:04.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.918+0000 7ff3a74ac700 1 -- start start 2023-10-03T10:20:04.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 0x7ff3a0133570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.920 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a0133ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a0099ef0 con 0x7ff3a0130960 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0099500 con 0x7ff3a0130d50 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a74ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0099c10 con 0x7ff3a0071b40 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a5248700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a5248700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57882/0 (socket says 172.21.15.19:57882) 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a5248700 1 -- 172.21.15.19:0/1476700155 learned_addr learned my addr 172.21.15.19:0/1476700155 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.919+0000 7ff3a4a47700 1 --2- 172.21.15.19:0/1476700155 >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 0x7ff3a0133570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5a49700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a0133ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 -- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 msgr2=0x7ff3a0133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a0133ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 -- 172.21.15.19:0/1476700155 >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 msgr2=0x7ff3a0133570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 --2- 172.21.15.19:0/1476700155 >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 0x7ff3a0133570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 -- 172.21.15.19:0/1476700155 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a009e370 con 0x7ff3a0071b40 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a4a47700 1 --2- 172.21.15.19:0/1476700155 >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 0x7ff3a0133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff3a5248700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098f0 tx=0x7ff39c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=558d99c0b09d9325 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff397fff700 1 -- 172.21.15.19:0/1476700155 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c011830 con 0x7ff3a0071b40 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff397fff700 1 -- 172.21.15.19:0/1476700155 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c011990 con 0x7ff3a0071b40 2023-10-03T10:20:04.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.920+0000 7ff397fff700 1 -- 172.21.15.19:0/1476700155 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c011d20 con 0x7ff3a0071b40 2023-10-03T10:20:04.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 msgr2=0x7ff3a0130420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0098f0 tx=0x7ff39c009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:04.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1476700155 shutdown_connections 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a0133ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1476700155 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a0130420 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1476700155 >> v2:172.21.15.19:3300/0 conn(0x7ff3a0130960 0x7ff3a0133570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1476700155 >> 172.21.15.19:0/1476700155 conn(0x7ff3a009e7e0 msgr2=0x7ff3a009ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1476700155 shutdown_connections 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.921+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1476700155 wait complete. 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.923+0000 7ff3a74ac700 1 Processor -- start 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.923+0000 7ff3a74ac700 1 -- start start 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a012cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 0x7ff3a012d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a008b730 con 0x7ff3a0130960 2023-10-03T10:20:04.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a009fbe0 con 0x7ff3a0130d50 2023-10-03T10:20:04.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a74ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a009c150 con 0x7ff3a0071b40 2023-10-03T10:20:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a4a47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 0x7ff3a012d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39462/0 (socket says 172.21.15.19:39462) 2023-10-03T10:20:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a4a47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 0x7ff3a012d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57906/0 (socket says 172.21.15.19:57906) 2023-10-03T10:20:04.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 -- 172.21.15.19:0/1156111572 learned_addr learned my addr 172.21.15.19:0/1156111572 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5248700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a012cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 -- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 msgr2=0x7ff3a012cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a012cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 -- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 msgr2=0x7ff3a012d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 0x7ff3a012d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.924+0000 7ff3a5a49700 1 -- 172.21.15.19:0/1156111572 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900094a0 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff3a5a49700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff39800efc0 tx=0x7ff39800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398009ea0 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39c009550 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a012e880 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800f040 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.925+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800ce90 con 0x7ff3a0130d50 2023-10-03T10:20:04.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.926+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3800052e0 con 0x7ff3a0130d50 2023-10-03T10:20:04.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.927+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff398027480 con 0x7ff3a0130d50 2023-10-03T10:20:04.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.927+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff3980406d0 con 0x7ff3a0130d50 2023-10-03T10:20:04.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.936+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff3980263e0 con 0x7ff3a0130d50 2023-10-03T10:20:04.966 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 Processor -- start 2023-10-03T10:20:04.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 -- start start 2023-10-03T10:20:04.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.967 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99409b120 con 0x7fa99409d6f0 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99406b460 con 0x7fa99409e1d0 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.967+0000 7fa999622700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa99409a7e0 con 0x7fa994139170 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9927fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9927fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57922/0 (socket says 172.21.15.19:57922) 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57898/0 (socket says 172.21.15.19:57898) 2023-10-03T10:20:04.968 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9927fc700 1 -- 172.21.15.19:0/4125999067 learned_addr learned my addr 172.21.15.19:0/4125999067 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.969 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 -- 172.21.15.19:0/4125999067 >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 msgr2=0x7fa994138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 --2- 172.21.15.19:0/4125999067 >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 -- 172.21.15.19:0/4125999067 >> v1:172.21.15.19:6789/0 conn(0x7fa99409d6f0 legacy=0x7fa99409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 -- 172.21.15.19:0/4125999067 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99409a500 con 0x7fa994139170 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9927fc700 1 --2- 172.21.15.19:0/4125999067 >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa9937fe700 1 --2- 172.21.15.19:0/4125999067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009dc0 tx=0x7fa98c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846e1b959ff3cd19 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa991ffb700 1 -- 172.21.15.19:0/4125999067 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00e070 con 0x7fa994139170 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.968+0000 7fa991ffb700 1 -- 172.21.15.19:0/4125999067 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c00bae0 con 0x7fa994139170 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa991ffb700 1 -- 172.21.15.19:0/4125999067 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c00be90 con 0x7fa994139170 2023-10-03T10:20:04.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 -- 172.21.15.19:0/4125999067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 msgr2=0x7fa99413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 --2- 172.21.15.19:0/4125999067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fa98c009dc0 tx=0x7fa98c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 -- 172.21.15.19:0/4125999067 shutdown_connections 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 --2- 172.21.15.19:0/4125999067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa994139170 0x7fa99413b550 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 --2- 172.21.15.19:0/4125999067 >> v2:172.21.15.19:3300/0 conn(0x7fa99409e1d0 0x7fa994138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 -- 172.21.15.19:0/4125999067 >> 172.21.15.19:0/4125999067 conn(0x7fa994066f50 msgr2=0x7fa99409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 -- 172.21.15.19:0/4125999067 shutdown_connections 2023-10-03T10:20:04.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.969+0000 7fa999622700 1 -- 172.21.15.19:0/4125999067 wait complete. 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 Processor -- start 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 -- start start 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99409d6f0 0x7fa99411e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa994139170 0x7fa99411f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa994121e70 con 0x7fa99409d6f0 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa994122050 con 0x7fa994139170 2023-10-03T10:20:04.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa999622700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa99409c710 con 0x7fa99409e1d0 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa9927fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa9927fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57906/0 (socket says 172.21.15.19:57906) 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa9927fc700 1 -- 172.21.15.19:0/2282478036 learned_addr learned my addr 172.21.15.19:0/2282478036 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.971+0000 7fa992ffd700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99409d6f0 0x7fa99411e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9937fe700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa994139170 0x7fa99411f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 -- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa994139170 msgr2=0x7fa99411f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa994139170 0x7fa99411f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 -- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99409d6f0 msgr2=0x7fa99411e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99409d6f0 0x7fa99411e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 -- 172.21.15.19:0/2282478036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009550 con 0x7fa99409e1d0 2023-10-03T10:20:04.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa9927fc700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa98800ec10 tx=0x7fa98800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800c850 con 0x7fa99409e1d0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800c9b0 con 0x7fa99409e1d0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800cd40 con 0x7fa99409e1d0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.972+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c009a70 con 0x7fa99409e1d0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.973+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa994120530 con 0x7fa99409e1d0 2023-10-03T10:20:04.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.974+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa988013470 con 0x7fa99409e1d0 2023-10-03T10:20:04.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.974+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa994074ea0 con 0x7fa99409e1d0 2023-10-03T10:20:04.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.974+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa98803fbe0 con 0x7fa99409e1d0 2023-10-03T10:20:04.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:04.979+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa988013720 con 0x7fa99409e1d0 2023-10-03T10:20:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.083+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3ad411e800 con 0x7f3ad4134710 2023-10-03T10:20:05.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.083+0000 7f3ac9ffb700 1 -- 172.21.15.19:0/620715267 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ac4017020 con 0x7f3ad4134710 2023-10-03T10:20:05.083 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 msgr2=0x7f3ad41c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400ebe0 tx=0x7f3ac400eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 shutdown_connections 2023-10-03T10:20:05.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ad4137030 0x7f3ad406f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ad41316d0 0x7f3ad41c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 --2- 172.21.15.19:0/620715267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ad4134710 0x7f3ad41c8ab0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 >> 172.21.15.19:0/620715267 conn(0x7f3ad40a2aa0 msgr2=0x7f3ad40a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 shutdown_connections 2023-10-03T10:20:05.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.086+0000 7f3adb5ef700 1 -- 172.21.15.19:0/620715267 wait complete. 2023-10-03T10:20:05.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:05.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.135+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f149413b660 con 0x7f1494133420 2023-10-03T10:20:05.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.135+0000 7f14917fa700 1 -- 172.21.15.19:0/1875476459 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1488018260 con 0x7f1494133420 2023-10-03T10:20:05.135 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 msgr2=0x7f149409c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:05.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f148800c700 tx=0x7f148800ca10 comp rx=0 tx=0).stop 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 shutdown_connections 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1494138dc0 0x7f149409d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1494133420 0x7f149409c6e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 --2- 172.21.15.19:0/1875476459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f14941337f0 0x7f149409cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 >> 172.21.15.19:0/1875476459 conn(0x7f14940a4210 msgr2=0x7f149413a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.137+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 shutdown_connections 2023-10-03T10:20:05.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.138+0000 7f149afa5700 1 -- 172.21.15.19:0/1875476459 wait complete. 2023-10-03T10:20:05.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.203+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff380005150 con 0x7ff3a0130d50 2023-10-03T10:20:05.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.203+0000 7ff395ffb700 1 -- 172.21.15.19:0/1156111572 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff39801cc90 con 0x7ff3a0130d50 2023-10-03T10:20:05.203 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 msgr2=0x7ff3a012d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff39800efc0 tx=0x7ff39800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 shutdown_connections 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff3a0130d50 0x7ff3a012d6d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff3a0071b40 0x7ff3a012cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 --2- 172.21.15.19:0/1156111572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff3a0130960 0x7ff3a012d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 >> 172.21.15.19:0/1156111572 conn(0x7ff3a009e7e0 msgr2=0x7ff3a0126e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:05.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 shutdown_connections 2023-10-03T10:20:05.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.206+0000 7ff3a74ac700 1 -- 172.21.15.19:0/1156111572 wait complete. 2023-10-03T10:20:05.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:05.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.234+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa994122190 con 0x7fa99409e1d0 2023-10-03T10:20:05.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.234+0000 7fa97b7fe700 1 -- 172.21.15.19:0/2282478036 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa994122190 con 0x7fa99409e1d0 2023-10-03T10:20:05.234 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 msgr2=0x7fa99411eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fa98800ec10 tx=0x7fa98800ef20 comp rx=0 tx=0).stop 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 shutdown_connections 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa994139170 0x7fa99411f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa99409d6f0 0x7fa99411e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 --2- 172.21.15.19:0/2282478036 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa99409e1d0 0x7fa99411eda0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.236+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 >> 172.21.15.19:0/2282478036 conn(0x7fa994066f50 msgr2=0x7fa994136c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.237+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 shutdown_connections 2023-10-03T10:20:05.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:05.237+0000 7fa999622700 1 -- 172.21.15.19:0/2282478036 wait complete. 2023-10-03T10:20:05.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:06.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:06.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:06.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:06.251 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.259+0000 7f6a1c89a700 1 Processor -- start 2023-10-03T10:20:06.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.259+0000 7f6a1c89a700 1 -- start start 2023-10-03T10:20:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1c89a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1c89a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 0x7f6a1809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1c89a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1806f720 con 0x7f6a1809e390 2023-10-03T10:20:06.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1c89a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a18070c80 con 0x7f6a181341d0 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1c89a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1806fce0 con 0x7f6a181338c0 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a15d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 0x7f6a1809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57912/0 (socket says 172.21.15.19:57912) 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.260+0000 7f6a1659c700 1 -- 172.21.15.19:0/1063611271 learned_addr learned my addr 172.21.15.19:0/1063611271 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1659c700 1 -- 172.21.15.19:0/1063611271 >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 msgr2=0x7f6a1809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1659c700 1 --2- 172.21.15.19:0/1063611271 >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 0x7f6a1809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1659c700 1 -- 172.21.15.19:0/1063611271 >> v1:172.21.15.19:6789/0 conn(0x7f6a1809e390 legacy=0x7f6a1813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1659c700 1 -- 172.21.15.19:0/1063611271 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a181336a0 con 0x7f6a181338c0 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a15d9b700 1 --2- 172.21.15.19:0/1063611271 >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 0x7f6a1809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1659c700 1 --2- 172.21.15.19:0/1063611271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098f0 tx=0x7f6a08009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0c522c079d4a56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1559a700 1 -- 172.21.15.19:0/1063611271 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a08004230 con 0x7f6a181338c0 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1559a700 1 -- 172.21.15.19:0/1063611271 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a08004390 con 0x7f6a181338c0 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.261+0000 7f6a1559a700 1 -- 172.21.15.19:0/1063611271 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a080036a0 con 0x7f6a181338c0 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1063611271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 msgr2=0x7f6a18133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1063611271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6a080098f0 tx=0x7f6a08009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1063611271 shutdown_connections 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1063611271 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a181338c0 0x7f6a18133c90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1063611271 >> v2:172.21.15.19:3300/0 conn(0x7f6a181341d0 0x7f6a1809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1063611271 >> 172.21.15.19:0/1063611271 conn(0x7f6a180a2aa0 msgr2=0x7f6a180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.262+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1063611271 shutdown_connections 2023-10-03T10:20:06.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.263+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1063611271 wait complete. 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.264+0000 7f6a1c89a700 1 Processor -- start 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.264+0000 7f6a1c89a700 1 -- start start 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 0x7f6a1811f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 0x7f6a1811fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 0x7f6a181203a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18130e70 con 0x7f6a181341d0 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a181223c0 con 0x7f6a181338c0 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1c89a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a18122780 con 0x7f6a1809e390 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 0x7f6a1811f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a15d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 0x7f6a1811fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 0x7f6a1811f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:57918/0 (socket says 172.21.15.19:57918) 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.265+0000 7f6a1659c700 1 -- 172.21.15.19:0/1246811556 learned_addr learned my addr 172.21.15.19:0/1246811556 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a16d9d700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 0x7f6a181203a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 -- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 msgr2=0x7f6a1811f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 0x7f6a1811f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 -- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 msgr2=0x7f6a181203a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 0x7f6a181203a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 -- 172.21.15.19:0/1246811556 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0094a0 con 0x7f6a181338c0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a16d9d700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 0x7f6a181203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a15d9b700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 0x7f6a1811fe60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e980 tx=0x7f6a0c00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00eed0 con 0x7f6a181338c0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c00c850 con 0x7f6a181338c0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c00cbe0 con 0x7f6a181338c0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.266+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a08009550 con 0x7f6a181338c0 2023-10-03T10:20:06.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.267+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a18122ea0 con 0x7f6a181338c0 2023-10-03T10:20:06.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.268+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a18074ea0 con 0x7f6a181338c0 2023-10-03T10:20:06.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.268+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a0c00cd40 con 0x7f6a181338c0 2023-10-03T10:20:06.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.269+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a0c03f7d0 con 0x7f6a181338c0 2023-10-03T10:20:06.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.274+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a0c0232f0 con 0x7f6a181338c0 2023-10-03T10:20:06.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 Processor -- start 2023-10-03T10:20:06.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 -- start start 2023-10-03T10:20:06.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135e50 0x7f3134138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313409f130 con 0x7f313409d6f0 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313409f520 con 0x7f313409e1d0 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f313a0f5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f313409e930 con 0x7f3134135e50 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.309+0000 7f3132ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39496/0 (socket says 172.21.15.19:39496) 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 -- 172.21.15.19:0/413260203 learned_addr learned my addr 172.21.15.19:0/413260203 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3133fff700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135e50 0x7f3134138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 -- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135e50 msgr2=0x7f3134138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135e50 0x7f3134138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 -- 172.21.15.19:0/413260203 >> v1:172.21.15.19:6789/0 conn(0x7f313409d6f0 legacy=0x7f313409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f31327fc700 1 -- 172.21.15.19:0/413260203 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2858044501 0 0) 0x7f313409f130 con 0x7f313409d6f0 2023-10-03T10:20:06.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 -- 172.21.15.19:0/413260203 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313409b2d0 con 0x7f313409e1d0 2023-10-03T10:20:06.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f3132ffd700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3128009920 tx=0x7f3128009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd619a80b04a8255 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.310+0000 7f31327fc700 1 -- 172.21.15.19:0/413260203 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312800ba60 con 0x7f313409e1d0 2023-10-03T10:20:06.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f31327fc700 1 -- 172.21.15.19:0/413260203 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312800bbc0 con 0x7f313409e1d0 2023-10-03T10:20:06.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f31327fc700 1 -- 172.21.15.19:0/413260203 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128009e70 con 0x7f313409e1d0 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 -- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 msgr2=0x7f3134135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3128009920 tx=0x7f3128009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 -- 172.21.15.19:0/413260203 shutdown_connections 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3134135e50 0x7f3134138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 --2- 172.21.15.19:0/413260203 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409e1d0 0x7f3134135910 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 -- 172.21.15.19:0/413260203 >> 172.21.15.19:0/413260203 conn(0x7f3134066f50 msgr2=0x7f313409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 -- 172.21.15.19:0/413260203 shutdown_connections 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.311+0000 7f313a0f5700 1 -- 172.21.15.19:0/413260203 wait complete. 2023-10-03T10:20:06.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.313+0000 7f313a0f5700 1 Processor -- start 2023-10-03T10:20:06.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.313+0000 7f313a0f5700 1 -- start start 2023-10-03T10:20:06.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f313409e1d0 0x7f313411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 0x7f31341c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134120fd0 con 0x7f3134135e50 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31341211b0 con 0x7f313409d6f0 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f313a0f5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3134130230 con 0x7f313409e1d0 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f31337fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f31337fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:39502/0 (socket says 172.21.15.19:39502) 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.314+0000 7f31337fe700 1 -- 172.21.15.19:0/2753388896 learned_addr learned my addr 172.21.15.19:0/2753388896 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f3132ffd700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f313409e1d0 0x7f313411e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f3133fff700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 0x7f31341c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.316 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 -- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f313409e1d0 msgr2=0x7f313411e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f313409e1d0 0x7f313411e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 -- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 msgr2=0x7f31341c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 0x7f31341c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 -- 172.21.15.19:0/2753388896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128009550 con 0x7f313409d6f0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f31337fe700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f312400c450 tx=0x7f312400c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f3133fff700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 0x7f31341c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240054e0 con 0x7f313409d6f0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124003680 con 0x7f313409d6f0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313411dd50 con 0x7f313409d6f0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124003a30 con 0x7f313409d6f0 2023-10-03T10:20:06.317 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.315+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313411f2a0 con 0x7f313409d6f0 2023-10-03T10:20:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.317+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313409c700 con 0x7f313409d6f0 2023-10-03T10:20:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.317+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3124003b90 con 0x7f313409d6f0 2023-10-03T10:20:06.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.317+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f312403ea80 con 0x7f313409d6f0 2023-10-03T10:20:06.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.322+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3124012400 con 0x7f313409d6f0 2023-10-03T10:20:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.377+0000 7f4b8eed0700 1 Processor -- start 2023-10-03T10:20:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.377+0000 7f4b8eed0700 1 -- start start 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a0a30 0x7f4b880a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 0x7f4b88133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b88133fa0 0x7f4b88134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b8809edd0 con 0x7f4b88133fa0 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8809e1f0 con 0x7f4b880a1340 2023-10-03T10:20:06.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8eed0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8809dc50 con 0x7f4b880a0a30 2023-10-03T10:20:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b87fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 0x7f4b88133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b8d46d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b88133fa0 0x7f4b88134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.378+0000 7f4b87fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 0x7f4b88133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41144/0 (socket says 172.21.15.19:41144) 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b87fff700 1 -- 172.21.15.19:0/800136913 learned_addr learned my addr 172.21.15.19:0/800136913 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8cc6c700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a0a30 0x7f4b880a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 -- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a0a30 msgr2=0x7f4b880a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a0a30 0x7f4b880a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 -- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 msgr2=0x7f4b88133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 0x7f4b88133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 -- 172.21.15.19:0/800136913 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880a1fe0 con 0x7f4b88133fa0 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88134410 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f6d97f92a9e94c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b877fe700 1 -- 172.21.15.19:0/800136913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8000e070 con 0x7f4b88133fa0 2023-10-03T10:20:06.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b877fe700 1 -- 172.21.15.19:0/800136913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8000bb20 con 0x7f4b88133fa0 2023-10-03T10:20:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.379+0000 7f4b877fe700 1 -- 172.21.15.19:0/800136913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80012430 con 0x7f4b88133fa0 2023-10-03T10:20:06.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.380+0000 7f4b8eed0700 1 -- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 msgr2=0x7f4b88134410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.380+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88134410 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f4b80009d90 tx=0x7f4b8000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.380+0000 7f4b8eed0700 1 -- 172.21.15.19:0/800136913 shutdown_connections 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.380+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88134410 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.380+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a0a30 0x7f4b880a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.381+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/800136913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a1340 0x7f4b88133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.381+0000 7f4b8eed0700 1 -- 172.21.15.19:0/800136913 >> 172.21.15.19:0/800136913 conn(0x7f4b880a6550 msgr2=0x7f4b880a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.381+0000 7f4b8eed0700 1 -- 172.21.15.19:0/800136913 shutdown_connections 2023-10-03T10:20:06.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.381+0000 7f4b8eed0700 1 -- 172.21.15.19:0/800136913 wait complete. 2023-10-03T10:20:06.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.382+0000 7f4b8eed0700 1 Processor -- start 2023-10-03T10:20:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.382+0000 7f4b8eed0700 1 -- start start 2023-10-03T10:20:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a0a30 0x7f4b88120140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a1340 0x7f4b88120680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88123630 con 0x7f4b88133fa0 2023-10-03T10:20:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b881238f0 con 0x7f4b880a0a30 2023-10-03T10:20:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8eed0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88121dd0 con 0x7f4b880a1340 2023-10-03T10:20:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8d46d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8d46d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44234/0 (socket says 172.21.15.19:44234) 2023-10-03T10:20:06.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.383+0000 7f4b8d46d700 1 -- 172.21.15.19:0/1641830926 learned_addr learned my addr 172.21.15.19:0/1641830926 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 -- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a1340 msgr2=0x7f4b88120680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:06.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a1340 0x7f4b88120680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 -- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a0a30 msgr2=0x7f4b88120140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a0a30 0x7f4b88120140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 -- 172.21.15.19:0/1641830926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b80009a70 con 0x7f4b88133fa0 2023-10-03T10:20:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8d46d700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4b8809ef10 tx=0x7f4b80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004550 con 0x7f4b88133fa0 2023-10-03T10:20:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b80020070 con 0x7f4b88133fa0 2023-10-03T10:20:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88122f10 con 0x7f4b88133fa0 2023-10-03T10:20:06.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.384+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b80004910 con 0x7f4b88133fa0 2023-10-03T10:20:06.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.385+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b88123bd0 con 0x7f4b88133fa0 2023-10-03T10:20:06.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.385+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b80012430 con 0x7f4b88133fa0 2023-10-03T10:20:06.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.386+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b80022070 con 0x7f4b88133fa0 2023-10-03T10:20:06.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.386+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88123a30 con 0x7f4b88133fa0 2023-10-03T10:20:06.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.391+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b88123a30 con 0x7f4b88133fa0 2023-10-03T10:20:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 Processor -- start 2023-10-03T10:20:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 -- start start 2023-10-03T10:20:06.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 0x7fe85c09d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c13f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85c09a810 con 0x7fe85c09dc30 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85c06ab40 con 0x7fe85c06a770 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.422+0000 7fe86259e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c09ebc0 con 0x7fe85c13d1f0 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe85c09dc30 0x7fe85c09e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44052/0 (socket says 172.21.15.19:44052) 2023-10-03T10:20:06.425 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85b7fe700 1 -- 172.21.15.19:0/151847060 learned_addr learned my addr 172.21.15.19:0/151847060 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:06.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 --2- 172.21.15.19:0/151847060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c13f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85bfff700 1 --2- 172.21.15.19:0/151847060 >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 0x7fe85c09d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85affd700 1 -- 172.21.15.19:0/151847060 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782626280 0 0) 0x7fe85c09a810 con 0x7fe85c09dc30 2023-10-03T10:20:06.426 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85affd700 1 -- 172.21.15.19:0/151847060 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8440035b0 con 0x7fe85c09dc30 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 -- 172.21.15.19:0/151847060 >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 msgr2=0x7fe85c09d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 --2- 172.21.15.19:0/151847060 >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 0x7fe85c09d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 -- 172.21.15.19:0/151847060 >> v1:172.21.15.19:6789/0 conn(0x7fe85c09dc30 legacy=0x7fe85c09e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 -- 172.21.15.19:0/151847060 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c09e920 con 0x7fe85c13d1f0 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe85bfff700 1 --2- 172.21.15.19:0/151847060 >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 0x7fe85c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:06.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.423+0000 7fe860b3b700 1 --2- 172.21.15.19:0/151847060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c13f5d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a2fcffa49400ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.424+0000 7fe85affd700 1 -- 172.21.15.19:0/151847060 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400e070 con 0x7fe85c13d1f0 2023-10-03T10:20:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.424+0000 7fe85affd700 1 -- 172.21.15.19:0/151847060 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400bb20 con 0x7fe85c13d1f0 2023-10-03T10:20:06.428 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.424+0000 7fe85affd700 1 -- 172.21.15.19:0/151847060 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400be90 con 0x7fe85c13d1f0 2023-10-03T10:20:06.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 -- 172.21.15.19:0/151847060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 msgr2=0x7fe85c13f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 --2- 172.21.15.19:0/151847060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c13f5d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:06.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 -- 172.21.15.19:0/151847060 shutdown_connections 2023-10-03T10:20:06.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 --2- 172.21.15.19:0/151847060 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c13f5d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 --2- 172.21.15.19:0/151847060 >> v2:172.21.15.19:3300/0 conn(0x7fe85c06a770 0x7fe85c09d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 -- 172.21.15.19:0/151847060 >> 172.21.15.19:0/151847060 conn(0x7fe85c066f50 msgr2=0x7fe85c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 -- 172.21.15.19:0/151847060 shutdown_connections 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.425+0000 7fe86259e700 1 -- 172.21.15.19:0/151847060 wait complete. 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.426+0000 7fe86259e700 1 Processor -- start 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 -- start start 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 0x7fe85c11b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c11c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c0a3860 con 0x7fe85c06a770 2023-10-03T10:20:06.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c09f1a0 con 0x7fe85c09dc30 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe86259e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe85c119d50 con 0x7fe85c13d1f0 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe85b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe85b7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41158/0 (socket says 172.21.15.19:41158) 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.427+0000 7fe85bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 0x7fe85c11b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85b7fe700 1 -- 172.21.15.19:0/4118104695 learned_addr learned my addr 172.21.15.19:0/4118104695 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe860b3b700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c11c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 -- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 msgr2=0x7fe85c11c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c11c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 -- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 msgr2=0x7fe85c11bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 -- 172.21.15.19:0/4118104695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0094a0 con 0x7fe85c06a770 2023-10-03T10:20:06.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85b7fe700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe85bfff700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 0x7fe85c11b5f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e9b0 tx=0x7fe84c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00ee50 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c00c850 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe854009a70 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.428+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c00cbe0 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.429+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85c11aab0 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.430+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe84c00cd40 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.430+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe84c0421c0 con 0x7fe85c06a770 2023-10-03T10:20:06.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.430+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85c13ab80 con 0x7fe85c06a770 2023-10-03T10:20:06.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.439+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe84c017070 con 0x7fe85c06a770 2023-10-03T10:20:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.498+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a1806b9e0 con 0x7f6a181338c0 2023-10-03T10:20:06.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.499+0000 7f6a06ffd700 1 -- 172.21.15.19:0/1246811556 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a0c01bba0 con 0x7f6a181338c0 2023-10-03T10:20:06.499 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 msgr2=0x7f6a1811fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 0x7f6a1811fe60 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00e980 tx=0x7f6a0c00ec90 comp rx=0 tx=0).stop 2023-10-03T10:20:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 shutdown_connections 2023-10-03T10:20:06.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a181341d0 0x7f6a181203a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a1809e390 0x7f6a1811f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 --2- 172.21.15.19:0/1246811556 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a181338c0 0x7f6a1811fe60 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.502+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 >> 172.21.15.19:0/1246811556 conn(0x7f6a180a2aa0 msgr2=0x7f6a1809ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.503+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 shutdown_connections 2023-10-03T10:20:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.503+0000 7f6a1c89a700 1 -- 172.21.15.19:0/1246811556 wait complete. 2023-10-03T10:20:06.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:06.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.538+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3134074ea0 con 0x7f313409d6f0 2023-10-03T10:20:06.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.538+0000 7f311bfff700 1 -- 172.21.15.19:0/2753388896 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3124017020 con 0x7f313409d6f0 2023-10-03T10:20:06.538 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:06.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.540+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 msgr2=0x7f313411e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.540 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.540+0000 7f313a0f5700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f312400c450 tx=0x7f312400c760 comp rx=0 tx=0).stop 2023-10-03T10:20:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 shutdown_connections 2023-10-03T10:20:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3134135e50 0x7f31341c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f313409d6f0 0x7f313411e0c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.541 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 --2- 172.21.15.19:0/2753388896 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f313409e1d0 0x7f313411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 >> 172.21.15.19:0/2753388896 conn(0x7f3134066f50 msgr2=0x7f31340a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 shutdown_connections 2023-10-03T10:20:06.542 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.541+0000 7f313a0f5700 1 -- 172.21.15.19:0/2753388896 wait complete. 2023-10-03T10:20:06.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.618+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b88123a30 con 0x7f4b88133fa0 2023-10-03T10:20:06.618 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.618+0000 7f4b857fa700 1 -- 172.21.15.19:0/1641830926 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b88123a30 con 0x7f4b88133fa0 2023-10-03T10:20:06.618 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 msgr2=0x7f4b88120bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f4b8809ef10 tx=0x7f4b80004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 shutdown_connections 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b88133fa0 0x7f4b88120bc0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b880a0a30 0x7f4b88120140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 --2- 172.21.15.19:0/1641830926 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b880a1340 0x7f4b88120680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 >> 172.21.15.19:0/1641830926 conn(0x7f4b880a6550 msgr2=0x7f4b881baf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 shutdown_connections 2023-10-03T10:20:06.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.621+0000 7f4b8eed0700 1 -- 172.21.15.19:0/1641830926 wait complete. 2023-10-03T10:20:06.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:06.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.649+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe85c074ea0 con 0x7fe85c06a770 2023-10-03T10:20:06.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.649+0000 7fe858ff9700 1 -- 172.21.15.19:0/4118104695 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe84c017020 con 0x7fe85c06a770 2023-10-03T10:20:06.649 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:06.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 msgr2=0x7fe85c11b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 0x7fe85c11b5f0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00e9b0 tx=0x7fe84c00ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 shutdown_connections 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85c13d1f0 0x7fe85c11c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe85c06a770 0x7fe85c11b5f0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 --2- 172.21.15.19:0/4118104695 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85c09dc30 0x7fe85c11bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:06.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 >> 172.21.15.19:0/4118104695 conn(0x7fe85c066f50 msgr2=0x7fe85c13cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:06.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 shutdown_connections 2023-10-03T10:20:06.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:06.651+0000 7fe86259e700 1 -- 172.21.15.19:0/4118104695 wait complete. 2023-10-03T10:20:06.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:07.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:07.558 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:07.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:07.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.680+0000 7f51b0185700 1 Processor -- start 2023-10-03T10:20:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 -- start start 2023-10-03T10:20:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a8131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51a8099a40 0x7f51a8099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8138650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a81313c0 con 0x7f51a8099a40 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a806e8c0 con 0x7f51a8131810 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51b0185700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a809a820 con 0x7f51a809a3b0 2023-10-03T10:20:07.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51ad720700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51a8099a40 0x7f51a8099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51ad720700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51a8099a40 0x7f51a8099e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44266/0 (socket says 172.21.15.19:44266) 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51ad720700 1 -- 172.21.15.19:0/3879644929 learned_addr learned my addr 172.21.15.19:0/3879644929 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.681+0000 7f51adf21700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a8131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ae722700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8138650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 -- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 msgr2=0x7f51a8138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8138650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 -- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 msgr2=0x7f51a8131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a8131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 -- 172.21.15.19:0/3879644929 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a8071d20 con 0x7f51a8099a40 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51adf21700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ae722700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51ad720700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a8099e70 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f51980098f0 tx=0x7f5198009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=137e60fcce29d5c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.682+0000 7f51acf1f700 1 -- 172.21.15.19:0/3879644929 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011830 con 0x7f51a8099a40 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51acf1f700 1 -- 172.21.15.19:0/3879644929 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5198011990 con 0x7f51a8099a40 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51acf1f700 1 -- 172.21.15.19:0/3879644929 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5198011d20 con 0x7f51a8099a40 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 -- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 msgr2=0x7f51a8099e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a8099e70 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f51980098f0 tx=0x7f5198009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 -- 172.21.15.19:0/3879644929 shutdown_connections 2023-10-03T10:20:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a8131be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8138650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 --2- 172.21.15.19:0/3879644929 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a8099e70 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.683+0000 7f51b0185700 1 -- 172.21.15.19:0/3879644929 >> 172.21.15.19:0/3879644929 conn(0x7f51a80a2aa0 msgr2=0x7f51a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.684+0000 7f51b0185700 1 -- 172.21.15.19:0/3879644929 shutdown_connections 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.684+0000 7f51b0185700 1 -- 172.21.15.19:0/3879644929 wait complete. 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.685+0000 7f51b0185700 1 Processor -- start 2023-10-03T10:20:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.685+0000 7f51b0185700 1 -- start start 2023-10-03T10:20:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8119b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a811a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a811dad0 con 0x7f51a8099a40 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a811d110 con 0x7f51a8131810 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51b0185700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80a1dc0 con 0x7f51a809a3b0 2023-10-03T10:20:07.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51adf21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51adf21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44270/0 (socket says 172.21.15.19:44270) 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51adf21700 1 -- 172.21.15.19:0/2770542871 learned_addr learned my addr 172.21.15.19:0/2770542871 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51ad720700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8119b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.686+0000 7f51ae722700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a811a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 -- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 msgr2=0x7f51a8119b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8119b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 -- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 msgr2=0x7f51a811a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a811a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 -- 172.21.15.19:0/2770542871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a40094a0 con 0x7f51a8099a40 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51ad720700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8119b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51adf21700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f51a400ebe0 tx=0x7f51a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.697 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400c850 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a400c9b0 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5198009550 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a400cd40 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.687+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a811b200 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.688+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51a4013470 con 0x7f51a8099a40 2023-10-03T10:20:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.688+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a8074ea0 con 0x7f51a8099a40 2023-10-03T10:20:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.688+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51a403fa50 con 0x7f51a8099a40 2023-10-03T10:20:07.699 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.697+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51a4013720 con 0x7f51a8099a40 2023-10-03T10:20:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.732+0000 7f9929bd9700 1 Processor -- start 2023-10-03T10:20:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.732+0000 7f9929bd9700 1 -- start start 2023-10-03T10:20:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f992406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f992406b080 0x7f9924131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992409ece0 con 0x7f992406b080 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992409e760 con 0x7f992406a770 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9929bd9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992409e040 con 0x7f9924131b40 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f992406b080 0x7f9924131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f99237fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f992406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f992406b080 0x7f9924131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44274/0 (socket says 172.21.15.19:44274) 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 -- 172.21.15.19:0/3890214178 learned_addr learned my addr 172.21.15.19:0/3890214178 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9923fff700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 -- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 msgr2=0x7f9924131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 -- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 msgr2=0x7f992406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f992406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.733+0000 7f9922ffd700 1 -- 172.21.15.19:0/3890214178 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992409f630 con 0x7f992406b080 2023-10-03T10:20:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.734+0000 7f9922ffd700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f9924131600 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f99180098f0 tx=0x7f9918009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77155de7db3c9f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.734+0000 7f99227fc700 1 -- 172.21.15.19:0/3890214178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011830 con 0x7f992406b080 2023-10-03T10:20:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.734+0000 7f99227fc700 1 -- 172.21.15.19:0/3890214178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9918011990 con 0x7f992406b080 2023-10-03T10:20:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.734+0000 7f99227fc700 1 -- 172.21.15.19:0/3890214178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9918011d20 con 0x7f992406b080 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 -- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 msgr2=0x7f9924131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f9924131600 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f99180098f0 tx=0x7f9918009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 -- 172.21.15.19:0/3890214178 shutdown_connections 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f992406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924131fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 --2- 172.21.15.19:0/3890214178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f9924131600 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 -- 172.21.15.19:0/3890214178 >> 172.21.15.19:0/3890214178 conn(0x7f9924066f50 msgr2=0x7f992409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 -- 172.21.15.19:0/3890214178 shutdown_connections 2023-10-03T10:20:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.735+0000 7f9929bd9700 1 -- 172.21.15.19:0/3890214178 wait complete. 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.736+0000 7f9929bd9700 1 Processor -- start 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 -- start start 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f99241199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99241380f0 con 0x7f992406b080 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992411ba20 con 0x7f992406a770 2023-10-03T10:20:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f9929bd9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f992411b040 con 0x7f9924131b40 2023-10-03T10:20:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.737+0000 7f99237fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41220/0 (socket says 172.21.15.19:41220) 2023-10-03T10:20:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 -- 172.21.15.19:0/184982285 learned_addr learned my addr 172.21.15.19:0/184982285 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f9923fff700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 -- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 msgr2=0x7f9924119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 -- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 msgr2=0x7f99241199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f99241199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 -- 172.21.15.19:0/184982285 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9918009550 con 0x7f992406a770 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f99237fe700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9b0 tx=0x7f991400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914009710 con 0x7f992406a770 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.739+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99240a35f0 con 0x7f992406a770 2023-10-03T10:20:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.738+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991400c850 con 0x7f992406a770 2023-10-03T10:20:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.739+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991400cbc0 con 0x7f992406a770 2023-10-03T10:20:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.739+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992411bd00 con 0x7f992406a770 2023-10-03T10:20:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.740+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f991400cd20 con 0x7f992406a770 2023-10-03T10:20:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.740+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9924074ea0 con 0x7f992406a770 2023-10-03T10:20:07.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.740+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f991403fbe0 con 0x7f992406a770 2023-10-03T10:20:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.749+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9914017080 con 0x7f992406a770 2023-10-03T10:20:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.788+0000 7f70c3093700 1 Processor -- start 2023-10-03T10:20:07.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.788+0000 7f70c3093700 1 -- start start 2023-10-03T10:20:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c3093700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c3093700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c3093700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70bc09b120 con 0x7f70bc09d6f0 2023-10-03T10:20:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c3093700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc06b460 con 0x7f70bc139170 2023-10-03T10:20:07.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c3093700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc09a7e0 con 0x7f70bc09e1d0 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c1630700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c0e2f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f70bc09d6f0 0x7f70bc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44056/0 (socket says 172.21.15.19:44056) 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70c0e2f700 1 -- 172.21.15.19:0/2146049665 learned_addr learned my addr 172.21.15.19:0/2146049665 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.789+0000 7f70bbfff700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70c1630700 1 -- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 msgr2=0x7f70bc138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70c1630700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70c1630700 1 -- 172.21.15.19:0/2146049665 >> v1:172.21.15.19:6789/0 conn(0x7f70bc09d6f0 legacy=0x7f70bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70c1630700 1 -- 172.21.15.19:0/2146049665 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70bc09a500 con 0x7f70bc139170 2023-10-03T10:20:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70c1630700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc13b550 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009dc0 tx=0x7f70b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=179d7e3f6b2156bb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70bb7fe700 1 -- 172.21.15.19:0/2146049665 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400e070 con 0x7f70bc139170 2023-10-03T10:20:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70bb7fe700 1 -- 172.21.15.19:0/2146049665 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b400bb20 con 0x7f70bc139170 2023-10-03T10:20:07.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.790+0000 7f70bb7fe700 1 -- 172.21.15.19:0/2146049665 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4012430 con 0x7f70bc139170 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 -- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 msgr2=0x7f70bc13b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc13b550 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f70b4009dc0 tx=0x7f70b400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 -- 172.21.15.19:0/2146049665 shutdown_connections 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc13b550 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 --2- 172.21.15.19:0/2146049665 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 -- 172.21.15.19:0/2146049665 >> 172.21.15.19:0/2146049665 conn(0x7f70bc066f50 msgr2=0x7f70bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 -- 172.21.15.19:0/2146049665 shutdown_connections 2023-10-03T10:20:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.791+0000 7f70c3093700 1 -- 172.21.15.19:0/2146049665 wait complete. 2023-10-03T10:20:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.792+0000 7f70c3093700 1 Processor -- start 2023-10-03T10:20:07.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.792+0000 7f70c3093700 1 -- start start 2023-10-03T10:20:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc1c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc1219e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1237e0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1235f0 con 0x7f70bc139170 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c3093700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc1c9210 con 0x7f70bc09e1d0 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c0e2f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c0e2f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44292/0 (socket says 172.21.15.19:44292) 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70c0e2f700 1 -- 172.21.15.19:0/75669145 learned_addr learned my addr 172.21.15.19:0/75669145 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.793+0000 7f70bbfff700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc1c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 -- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 msgr2=0x7f70bc1c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc1c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 -- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 msgr2=0x7f70bc1219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc1219e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 -- 172.21.15.19:0/75669145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b4009a70 con 0x7f70bc09d6f0 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70bbfff700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c0e2f700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f70b000c550 tx=0x7f70b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0005d70 con 0x7f70bc09d6f0 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b00070d0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc123bd0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.794+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc123de0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.795+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0007440 con 0x7f70bc09d6f0 2023-10-03T10:20:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.796+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f70b00075a0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.796+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c0052e0 con 0x7f70bc09d6f0 2023-10-03T10:20:07.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.796+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f70b003ea50 con 0x7f70bc09d6f0 2023-10-03T10:20:07.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.805+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f70b0011d70 con 0x7f70bc09d6f0 2023-10-03T10:20:07.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.841+0000 7f71e47fd700 1 Processor -- start 2023-10-03T10:20:07.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.841+0000 7f71e47fd700 1 -- start start 2023-10-03T10:20:07.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e47fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e47fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 0x7f71dc131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e47fd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71dc070940 con 0x7f71dc09f240 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e47fd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71dc06fd60 con 0x7f71dc09f650 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e47fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc06fa80 con 0x7f71dc09e930 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e2599700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e2d9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 0x7f71dc131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e2d9a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 0x7f71dc131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44306/0 (socket says 172.21.15.19:44306) 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e2d9a700 1 -- 172.21.15.19:0/1479675740 learned_addr learned my addr 172.21.15.19:0/1479675740 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.842+0000 7f71e2599700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34860/0 (socket says 172.21.15.19:34860) 2023-10-03T10:20:07.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e2599700 1 -- 172.21.15.19:0/1479675740 >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 msgr2=0x7f71dc131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:07.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e2599700 1 --2- 172.21.15.19:0/1479675740 >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 0x7f71dc131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e2599700 1 -- 172.21.15.19:0/1479675740 >> v1:172.21.15.19:6789/0 conn(0x7f71dc09f240 legacy=0x7f71dc1317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e1597700 1 -- 172.21.15.19:0/1479675740 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279257187 0 0) 0x7f71dc070940 con 0x7f71dc09f240 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e2599700 1 -- 172.21.15.19:0/1479675740 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71dc09fb60 con 0x7f71dc09e930 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e2599700 1 --2- 172.21.15.19:0/1479675740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009840 tx=0x7f71d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1d9fc93554a930 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e1597700 1 -- 172.21.15.19:0/1479675740 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8010a90 con 0x7f71dc09e930 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e1597700 1 -- 172.21.15.19:0/1479675740 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d8010bf0 con 0x7f71dc09e930 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.843+0000 7f71e1597700 1 -- 172.21.15.19:0/1479675740 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d8018440 con 0x7f71dc09e930 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 -- 172.21.15.19:0/1479675740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 msgr2=0x7f71dc09ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1479675740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f71d8009840 tx=0x7f71d8009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 -- 172.21.15.19:0/1479675740 shutdown_connections 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1479675740 >> v2:172.21.15.19:3300/0 conn(0x7f71dc09f650 0x7f71dc131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1479675740 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09e930 0x7f71dc09ed00 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 -- 172.21.15.19:0/1479675740 >> 172.21.15.19:0/1479675740 conn(0x7f71dc0a4210 msgr2=0x7f71dc0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 -- 172.21.15.19:0/1479675740 shutdown_connections 2023-10-03T10:20:07.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.844+0000 7f71e47fd700 1 -- 172.21.15.19:0/1479675740 wait complete. 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.845+0000 7f71e47fd700 1 Processor -- start 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.845+0000 7f71e47fd700 1 -- start start 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71dc09e930 0x7f71dc11e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09f650 0x7f71dc11eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc121830 con 0x7f71dc09f240 2023-10-03T10:20:07.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc11fd10 con 0x7f71dc09e930 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e47fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc0a2f40 con 0x7f71dc09f650 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44316/0 (socket says 172.21.15.19:44316) 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 -- 172.21.15.19:0/1526476473 learned_addr learned my addr 172.21.15.19:0/1526476473 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e2d9a700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09f650 0x7f71dc11eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 -- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09f650 msgr2=0x7f71dc11eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09f650 0x7f71dc11eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 -- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71dc09e930 msgr2=0x7f71dc11e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71dc09e930 0x7f71dc11e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.846+0000 7f71e1d98700 1 -- 172.21.15.19:0/1526476473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d80094a0 con 0x7f71dc09f240 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71e1d98700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c550 tx=0x7f71cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:07.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc0054e0 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc003680 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc0a0190 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc003a30 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.847+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc120e50 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.848+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71cc003b90 con 0x7f71dc09f240 2023-10-03T10:20:07.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.848+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71cc03eb80 con 0x7f71dc09f240 2023-10-03T10:20:07.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.848+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc121970 con 0x7f71dc09f240 2023-10-03T10:20:07.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.857+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71cc03ee60 con 0x7f71dc09f240 2023-10-03T10:20:07.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.917+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f51a811cc00 con 0x7f51a8099a40 2023-10-03T10:20:07.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.918+0000 7f519e7fc700 1 -- 172.21.15.19:0/2770542871 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51a4021070 con 0x7f51a8099a40 2023-10-03T10:20:07.918 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 msgr2=0x7f51a81195f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f51a400ebe0 tx=0x7f51a400eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 shutdown_connections 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51a8131810 0x7f51a811a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51a8099a40 0x7f51a81195f0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 --2- 172.21.15.19:0/2770542871 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51a809a3b0 0x7f51a8119b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.920+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 >> 172.21.15.19:0/2770542871 conn(0x7f51a80a2aa0 msgr2=0x7f51a812e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.921+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 shutdown_connections 2023-10-03T10:20:07.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.921+0000 7f51b0185700 1 -- 172.21.15.19:0/2770542871 wait complete. 2023-10-03T10:20:07.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:07.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.974+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f992406c360 con 0x7f992406a770 2023-10-03T10:20:07.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.974+0000 7f990bfff700 1 -- 172.21.15.19:0/184982285 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9914021030 con 0x7f992406a770 2023-10-03T10:20:07.974 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 msgr2=0x7f9924119480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9b0 tx=0x7f991400ed70 comp rx=0 tx=0).stop 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 shutdown_connections 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9924131b40 0x7f9924119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f992406a770 0x7f9924119480 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 --2- 172.21.15.19:0/184982285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f992406b080 0x7f99241199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 >> 172.21.15.19:0/184982285 conn(0x7f9924066f50 msgr2=0x7f99240a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:07.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 shutdown_connections 2023-10-03T10:20:07.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:07.978+0000 7f9929bd9700 1 -- 172.21.15.19:0/184982285 wait complete. 2023-10-03T10:20:07.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:08.031 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.031+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f709c005590 con 0x7f70bc09d6f0 2023-10-03T10:20:08.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.032+0000 7f70b97fa700 1 -- 172.21.15.19:0/75669145 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70b000f260 con 0x7f70bc09d6f0 2023-10-03T10:20:08.032 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:08.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 msgr2=0x7f70bc1c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f70b000c550 tx=0x7f70b000c860 comp rx=0 tx=0).stop 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 shutdown_connections 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f70bc139170 0x7f70bc1219e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70bc09d6f0 0x7f70bc1c8790 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 --2- 172.21.15.19:0/75669145 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f70bc09e1d0 0x7f70bc1c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 >> 172.21.15.19:0/75669145 conn(0x7f70bc066f50 msgr2=0x7f70bc070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 shutdown_connections 2023-10-03T10:20:08.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.034+0000 7f70c3093700 1 -- 172.21.15.19:0/75669145 wait complete. 2023-10-03T10:20:08.048 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.075+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f71dc09ffe0 con 0x7f71dc09f240 2023-10-03T10:20:08.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.075+0000 7f71d2ffd700 1 -- 172.21.15.19:0/1526476473 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71dc121970 con 0x7f71dc09f240 2023-10-03T10:20:08.075 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.077+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 msgr2=0x7f71dc11e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.077+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00c550 tx=0x7f71cc00c860 comp rx=0 tx=0).stop 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 shutdown_connections 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71dc09f650 0x7f71dc11eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71dc09e930 0x7f71dc11e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 --2- 172.21.15.19:0/1526476473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71dc09f240 0x7f71dc11e580 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 >> 172.21.15.19:0/1526476473 conn(0x7f71dc0a4210 msgr2=0x7f71dc131c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 shutdown_connections 2023-10-03T10:20:08.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:08.078+0000 7f71e47fd700 1 -- 172.21.15.19:0/1526476473 wait complete. 2023-10-03T10:20:08.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:08.936 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:08.997 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:09.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:09.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.089+0000 7f3cb9f73700 1 Processor -- start 2023-10-03T10:20:09.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.089+0000 7f3cb9f73700 1 -- start start 2023-10-03T10:20:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.090+0000 7f3cb9f73700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb409d6f0 0x7f3cb409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.090+0000 7f3cb9f73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409e000 0x7f3cb41339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.090+0000 7f3cb9f73700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb409b120 con 0x7f3cb409e410 2023-10-03T10:20:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.090+0000 7f3cb9f73700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb406b460 con 0x7f3cb409d6f0 2023-10-03T10:20:09.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.090+0000 7f3cb9f73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb409a7e0 con 0x7f3cb409e000 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb409d6f0 0x7f3cb409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3cb409d6f0 0x7f3cb409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44330/0 (socket says 172.21.15.19:44330) 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3cb409e410 0x7f3cb4133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44076/0 (socket says 172.21.15.19:44076) 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 -- 172.21.15.19:0/841318875 learned_addr learned my addr 172.21.15.19:0/841318875 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb2ffd700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409e000 0x7f3cb41339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 -- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409e000 msgr2=0x7f3cb41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409e000 0x7f3cb41339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 -- 172.21.15.19:0/841318875 >> v1:172.21.15.19:6789/0 conn(0x7f3cb409e410 legacy=0x7f3cb4133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 -- 172.21.15.19:0/841318875 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb409a500 con 0x7f3cb409d6f0 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb27fc700 1 -- 172.21.15.19:0/841318875 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730236258 0 0) 0x7f3cb409b120 con 0x7f3cb409e410 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb37fe700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409d6f0 0x7f3cb409dac0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40098f0 tx=0x7f3ca4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ab063f53a3b9b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb27fc700 1 -- 172.21.15.19:0/841318875 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011830 con 0x7f3cb409d6f0 2023-10-03T10:20:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb27fc700 1 -- 172.21.15.19:0/841318875 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca4011990 con 0x7f3cb409d6f0 2023-10-03T10:20:09.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.091+0000 7f3cb27fc700 1 -- 172.21.15.19:0/841318875 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4011d20 con 0x7f3cb409d6f0 2023-10-03T10:20:09.093 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 -- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409d6f0 msgr2=0x7f3cb409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409d6f0 0x7f3cb409dac0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f3ca40098f0 tx=0x7f3ca4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 -- 172.21.15.19:0/841318875 shutdown_connections 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409d6f0 0x7f3cb409dac0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/841318875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409e000 0x7f3cb41339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 -- 172.21.15.19:0/841318875 >> 172.21.15.19:0/841318875 conn(0x7f3cb4066f50 msgr2=0x7f3cb409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 -- 172.21.15.19:0/841318875 shutdown_connections 2023-10-03T10:20:09.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.092+0000 7f3cb9f73700 1 -- 172.21.15.19:0/841318875 wait complete. 2023-10-03T10:20:09.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.094+0000 7f3cb9f73700 1 Processor -- start 2023-10-03T10:20:09.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.094+0000 7f3cb9f73700 1 -- start start 2023-10-03T10:20:09.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409d6f0 0x7f3cb41a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3cb409e410 0x7f3cb41c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb409c710 con 0x7f3cb409e000 2023-10-03T10:20:09.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41b9210 con 0x7f3cb409d6f0 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb9f73700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb41a7e00 con 0x7f3cb409e410 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb37fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409d6f0 0x7f3cb41a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44346/0 (socket says 172.21.15.19:44346) 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 -- 172.21.15.19:0/3844572765 learned_addr learned my addr 172.21.15.19:0/3844572765 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 -- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3cb409e410 msgr2=0x7f3cb41c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3cb409e410 0x7f3cb41c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 -- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409d6f0 msgr2=0x7f3cb41a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409d6f0 0x7f3cb41a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.095+0000 7f3cb2ffd700 1 -- 172.21.15.19:0/3844572765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4009550 con 0x7f3cb409e000 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3cb2ffd700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e9b0 tx=0x7f3ca800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca8009710 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca800c850 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb41a80c0 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca800cbc0 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.096+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb41a5c50 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.097+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ca800cd20 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.097+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ca803f7a0 con 0x7f3cb409e000 2023-10-03T10:20:09.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.097+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4074ea0 con 0x7f3cb409e000 2023-10-03T10:20:09.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.103+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ca8021080 con 0x7f3cb409e000 2023-10-03T10:20:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.153+0000 7f0c8ef1a700 1 Processor -- start 2023-10-03T10:20:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.153+0000 7f0c8ef1a700 1 -- start start 2023-10-03T10:20:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ef1a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0c8809d6f0 0x7f0c8809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ef1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c88134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ef1a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8809b120 con 0x7f0c8809e000 2023-10-03T10:20:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ef1a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8806b460 con 0x7f0c8809d6f0 2023-10-03T10:20:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ef1a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8809a7e0 con 0x7f0c8809e440 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c87fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c8809e000 0x7f0c881339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44090/0 (socket says 172.21.15.19:44090) 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c87fff700 1 -- 172.21.15.19:0/1612955575 learned_addr learned my addr 172.21.15.19:0/1612955575 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.154+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/1612955575 >> v2:172.21.15.19:3300/0 conn(0x7f0c8809d6f0 0x7f0c8809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8d4b7700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c88134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 msgr2=0x7f0c88134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c88134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/1612955575 >> v1:172.21.15.19:6789/0 conn(0x7f0c8809e000 legacy=0x7f0c881339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/1612955575 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8809a500 con 0x7f0c8809d6f0 2023-10-03T10:20:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8d4b7700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c88134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809d6f0 0x7f0c8809dac0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dae41d0a011e6d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c877fe700 1 -- 172.21.15.19:0/1612955575 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c004230 con 0x7f0c8809d6f0 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.155+0000 7f0c877fe700 1 -- 172.21.15.19:0/1612955575 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c004390 con 0x7f0c8809d6f0 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c877fe700 1 -- 172.21.15.19:0/1612955575 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0036a0 con 0x7f0c8809d6f0 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809d6f0 msgr2=0x7f0c8809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809d6f0 0x7f0c8809dac0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009870 tx=0x7f0c7c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/1612955575 shutdown_connections 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c88134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/1612955575 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809d6f0 0x7f0c8809dac0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/1612955575 >> 172.21.15.19:0/1612955575 conn(0x7f0c88066f50 msgr2=0x7f0c8809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/1612955575 shutdown_connections 2023-10-03T10:20:09.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.156+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/1612955575 wait complete. 2023-10-03T10:20:09.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.158+0000 7f0c8ef1a700 1 Processor -- start 2023-10-03T10:20:09.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.158+0000 7f0c8ef1a700 1 -- start start 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809e000 0x7f0c881a6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c881a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a7390 con 0x7f0c8809e000 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a7af0 con 0x7f0c8809d6f0 2023-10-03T10:20:09.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ef1a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c881a8d40 con 0x7f0c8809e440 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ccb6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8d4b7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c881a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ccb6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41274/0 (socket says 172.21.15.19:41274) 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/908255538 learned_addr learned my addr 172.21.15.19:0/908255538 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.159+0000 7f0c87fff700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809e000 0x7f0c881a6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 msgr2=0x7f0c881a6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c881a6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809e000 msgr2=0x7f0c881a6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809e000 0x7f0c881a6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 -- 172.21.15.19:0/908255538 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c80009a70 con 0x7f0c8809d6f0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8d4b7700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c881a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ccb6700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c000c00 tx=0x7f0c7c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0045d0 con 0x7f0c8809d6f0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c01e070 con 0x7f0c8809d6f0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c0094a0 con 0x7f0c8809d6f0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c011850 con 0x7f0c8809d6f0 2023-10-03T10:20:09.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.160+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c881a9770 con 0x7f0c8809d6f0 2023-10-03T10:20:09.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.161+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8809c710 con 0x7f0c8809d6f0 2023-10-03T10:20:09.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.162+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c7c0119b0 con 0x7f0c8809d6f0 2023-10-03T10:20:09.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.162+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c7c040b30 con 0x7f0c8809d6f0 2023-10-03T10:20:09.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.172+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c7c02c760 con 0x7f0c8809d6f0 2023-10-03T10:20:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.202+0000 7ff2dea17700 1 Processor -- start 2023-10-03T10:20:09.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.202+0000 7ff2dea17700 1 -- start start 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dea17700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff2d809d6f0 0x7ff2d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dea17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dea17700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d809f130 con 0x7ff2d809e410 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dea17700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d809f520 con 0x7ff2d809d6f0 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dea17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d809e930 con 0x7ff2d809e000 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2d77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dcfb4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff2d809e410 0x7ff2d8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44096/0 (socket says 172.21.15.19:44096) 2023-10-03T10:20:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2dcfb4700 1 -- 172.21.15.19:0/1003697766 learned_addr learned my addr 172.21.15.19:0/1003697766 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:09.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.203+0000 7ff2d7fff700 1 --2- 172.21.15.19:0/1003697766 >> v2:172.21.15.19:3300/0 conn(0x7ff2d809d6f0 0x7ff2d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d77fe700 1 -- 172.21.15.19:0/1003697766 >> v2:172.21.15.19:3300/0 conn(0x7ff2d809d6f0 msgr2=0x7ff2d809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d77fe700 1 --2- 172.21.15.19:0/1003697766 >> v2:172.21.15.19:3300/0 conn(0x7ff2d809d6f0 0x7ff2d809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d77fe700 1 -- 172.21.15.19:0/1003697766 >> v1:172.21.15.19:6789/0 conn(0x7ff2d809e410 legacy=0x7ff2d8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d77fe700 1 -- 172.21.15.19:0/1003697766 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d809b2d0 con 0x7ff2d809e000 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d77fe700 1 --2- 172.21.15.19:0/1003697766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d8130660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00bae0 tx=0x7ff2cc00bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25b90ef41a25d886 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d6ffd700 1 -- 172.21.15.19:0/1003697766 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00dc70 con 0x7ff2d809e000 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d6ffd700 1 -- 172.21.15.19:0/1003697766 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00ddd0 con 0x7ff2d809e000 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.204+0000 7ff2d6ffd700 1 -- 172.21.15.19:0/1003697766 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc012990 con 0x7ff2d809e000 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 -- 172.21.15.19:0/1003697766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 msgr2=0x7ff2d8130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 --2- 172.21.15.19:0/1003697766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d8130660 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00bae0 tx=0x7ff2cc00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 -- 172.21.15.19:0/1003697766 shutdown_connections 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 --2- 172.21.15.19:0/1003697766 >> v2:172.21.15.19:3300/0 conn(0x7ff2d809d6f0 0x7ff2d809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 --2- 172.21.15.19:0/1003697766 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d8130660 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 -- 172.21.15.19:0/1003697766 >> 172.21.15.19:0/1003697766 conn(0x7ff2d8066f50 msgr2=0x7ff2d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 -- 172.21.15.19:0/1003697766 shutdown_connections 2023-10-03T10:20:09.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.205+0000 7ff2dea17700 1 -- 172.21.15.19:0/1003697766 wait complete. 2023-10-03T10:20:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.206+0000 7ff2dea17700 1 Processor -- start 2023-10-03T10:20:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.206+0000 7ff2dea17700 1 -- start start 2023-10-03T10:20:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2d809d6f0 0x7ff2d811e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 0x7ff2d811eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8121930 con 0x7ff2d809d6f0 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d809c700 con 0x7ff2d809e410 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dea17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8130390 con 0x7ff2d809e000 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2d77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2d77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34914/0 (socket says 172.21.15.19:34914) 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2d77fe700 1 -- 172.21.15.19:0/90185475 learned_addr learned my addr 172.21.15.19:0/90185475 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 0x7ff2d811eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2d7fff700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2d809d6f0 0x7ff2d811e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 -- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 msgr2=0x7ff2d811e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 -- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2d809d6f0 msgr2=0x7ff2d811e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2d809d6f0 0x7ff2d811e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2dcfb4700 1 -- 172.21.15.19:0/90185475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc00b740 con 0x7ff2d809e410 2023-10-03T10:20:09.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.207+0000 7ff2d77fe700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2dcfb4700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 0x7ff2d811eb10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000caa0 tx=0x7ff2d000cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000a9a0 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d000ab00 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d8121b30 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d000ae70 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.208+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81222c0 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.209+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d8074ea0 con 0x7ff2d809e410 2023-10-03T10:20:09.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.209+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff2d0012400 con 0x7ff2d809e410 2023-10-03T10:20:09.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.218+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff2d0007470 con 0x7ff2d809e410 2023-10-03T10:20:09.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.219+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff2d0044060 con 0x7ff2d809e410 2023-10-03T10:20:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 Processor -- start 2023-10-03T10:20:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 -- start start 2023-10-03T10:20:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc0a409d6f0 0x7fc0a409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 0x7fc0a4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a409b120 con 0x7fc0a409e000 2023-10-03T10:20:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a406b460 con 0x7fc0a409d6f0 2023-10-03T10:20:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a9f39700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a409a7e0 con 0x7fc0a409e440 2023-10-03T10:20:09.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a2ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc0a409e000 0x7fc0a41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44106/0 (socket says 172.21.15.19:44106) 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a2ffd700 1 -- 172.21.15.19:0/1024937860 learned_addr learned my addr 172.21.15.19:0/1024937860 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.242+0000 7fc0a37fe700 1 --2- 172.21.15.19:0/1024937860 >> v2:172.21.15.19:3300/0 conn(0x7fc0a409d6f0 0x7fc0a409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 --2- 172.21.15.19:0/1024937860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 0x7fc0a4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 -- 172.21.15.19:0/1024937860 >> v2:172.21.15.19:3300/0 conn(0x7fc0a409d6f0 msgr2=0x7fc0a409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 --2- 172.21.15.19:0/1024937860 >> v2:172.21.15.19:3300/0 conn(0x7fc0a409d6f0 0x7fc0a409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 -- 172.21.15.19:0/1024937860 >> v1:172.21.15.19:6789/0 conn(0x7fc0a409e000 legacy=0x7fc0a41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 -- 172.21.15.19:0/1024937860 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a409a500 con 0x7fc0a409e440 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a3fff700 1 --2- 172.21.15.19:0/1024937860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 0x7fc0a4134100 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009dc0 tx=0x7fc09c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6b16c3579c68ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.243+0000 7fc0a27fc700 1 -- 172.21.15.19:0/1024937860 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00e070 con 0x7fc0a409e440 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.244+0000 7fc0a27fc700 1 -- 172.21.15.19:0/1024937860 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c00bae0 con 0x7fc0a409e440 2023-10-03T10:20:09.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.244+0000 7fc0a27fc700 1 -- 172.21.15.19:0/1024937860 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c00be70 con 0x7fc0a409e440 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.244+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1024937860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 msgr2=0x7fc0a4134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.244+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1024937860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 0x7fc0a4134100 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009dc0 tx=0x7fc09c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1024937860 shutdown_connections 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1024937860 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409e440 0x7fc0a4134100 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1024937860 >> v2:172.21.15.19:3300/0 conn(0x7fc0a409d6f0 0x7fc0a409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1024937860 >> 172.21.15.19:0/1024937860 conn(0x7fc0a4066f50 msgr2=0x7fc0a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1024937860 shutdown_connections 2023-10-03T10:20:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.245+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1024937860 wait complete. 2023-10-03T10:20:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.246+0000 7fc0a9f39700 1 Processor -- start 2023-10-03T10:20:09.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.246+0000 7fc0a9f39700 1 -- start start 2023-10-03T10:20:09.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0a409e000 0x7fc0a41a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0a409e440 0x7fc0a41a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41a81f0 con 0x7fc0a409e440 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41a6b10 con 0x7fc0a409e000 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a9f39700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a41a86a0 con 0x7fc0a409d6f0 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34932/0 (socket says 172.21.15.19:34932) 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a37fe700 1 -- 172.21.15.19:0/1307328106 learned_addr learned my addr 172.21.15.19:0/1307328106 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.247+0000 7fc0a2ffd700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0a409e000 0x7fc0a41a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 -- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0a409e000 msgr2=0x7fc0a41a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0a409e000 0x7fc0a41a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 -- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0a409e440 msgr2=0x7fc0a41a58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0a409e440 0x7fc0a41a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 -- 172.21.15.19:0/1307328106 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c009a70 con 0x7fc0a409d6f0 2023-10-03T10:20:09.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a37fe700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e9b0 tx=0x7fc09400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc094009710 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09400c850 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09400cbc0 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a40a1fb0 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.248+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a409c760 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.249+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4074ea0 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.249+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc09400cd20 con 0x7fc0a409d6f0 2023-10-03T10:20:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.250+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc09403fb40 con 0x7fc0a409d6f0 2023-10-03T10:20:09.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.259+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc09401b3b0 con 0x7fc0a409d6f0 2023-10-03T10:20:09.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.334+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3cb406c360 con 0x7f3cb409e000 2023-10-03T10:20:09.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.334+0000 7f3c9bfff700 1 -- 172.21.15.19:0/3844572765 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ca8017020 con 0x7f3cb409e000 2023-10-03T10:20:09.334 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 msgr2=0x7f3cb41a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3ca800e9b0 tx=0x7f3ca800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 shutdown_connections 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3cb409e410 0x7f3cb41c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3cb409d6f0 0x7f3cb41a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 --2- 172.21.15.19:0/3844572765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3cb409e000 0x7f3cb41a5710 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 >> 172.21.15.19:0/3844572765 conn(0x7f3cb4066f50 msgr2=0x7f3cb41bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 shutdown_connections 2023-10-03T10:20:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.338+0000 7f3cb9f73700 1 -- 172.21.15.19:0/3844572765 wait complete. 2023-10-03T10:20:09.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:09.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.384+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0c881a9770 con 0x7f0c8809d6f0 2023-10-03T10:20:09.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.384+0000 7f0c857fa700 1 -- 172.21.15.19:0/908255538 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0c881a9770 con 0x7f0c8809d6f0 2023-10-03T10:20:09.384 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 msgr2=0x7f0c881a5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c000c00 tx=0x7f0c7c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 shutdown_connections 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c8809e440 0x7f0c881a6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c8809d6f0 0x7f0c881a5ee0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 --2- 172.21.15.19:0/908255538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c8809e000 0x7f0c881a6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 >> 172.21.15.19:0/908255538 conn(0x7f0c88066f50 msgr2=0x7f0c881baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 shutdown_connections 2023-10-03T10:20:09.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.387+0000 7f0c8ef1a700 1 -- 172.21.15.19:0/908255538 wait complete. 2023-10-03T10:20:09.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:09.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.435+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff2d806c360 con 0x7ff2d809e410 2023-10-03T10:20:09.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.435+0000 7ff2d4ff9700 1 -- 172.21.15.19:0/90185475 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff2d0044030 con 0x7ff2d809e410 2023-10-03T10:20:09.435 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:09.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.437+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 msgr2=0x7ff2d811eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.437+0000 7ff2dea17700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 0x7ff2d811eb10 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff2d000caa0 tx=0x7ff2d000cdb0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 shutdown_connections 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff2d809e410 0x7ff2d811eb10 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff2d809d6f0 0x7ff2d811e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 --2- 172.21.15.19:0/90185475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff2d809e000 0x7ff2d811e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 >> 172.21.15.19:0/90185475 conn(0x7ff2d8066f50 msgr2=0x7ff2d806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 shutdown_connections 2023-10-03T10:20:09.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.438+0000 7ff2dea17700 1 -- 172.21.15.19:0/90185475 wait complete. 2023-10-03T10:20:09.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:09.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.468+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc0a409f420 con 0x7fc0a409d6f0 2023-10-03T10:20:09.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.468+0000 7fc08bfff700 1 -- 172.21.15.19:0/1307328106 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc094017030 con 0x7fc0a409d6f0 2023-10-03T10:20:09.468 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 msgr2=0x7fc0a41a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc09400e9b0 tx=0x7fc09400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 shutdown_connections 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc0a409e440 0x7fc0a41a58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc0a409d6f0 0x7fc0a41a4e60 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 --2- 172.21.15.19:0/1307328106 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc0a409e000 0x7fc0a41a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 >> 172.21.15.19:0/1307328106 conn(0x7fc0a4066f50 msgr2=0x7fc0a41b9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:09.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 shutdown_connections 2023-10-03T10:20:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:09.471+0000 7fc0a9f39700 1 -- 172.21.15.19:0/1307328106 wait complete. 2023-10-03T10:20:09.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:10.353 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:10.401 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:10.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:10.485 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:10.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.502+0000 7fe0d8baa700 1 Processor -- start 2023-10-03T10:20:10.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.502+0000 7fe0d8baa700 1 -- start start 2023-10-03T10:20:10.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d8baa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0d41338a0 0x7fe0d4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d8baa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d409e930 0x7fe0d413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d8baa700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d406ef30 con 0x7fe0d409de50 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d8baa700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d406fef0 con 0x7fe0d41338a0 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d8baa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41334b0 con 0x7fe0d409e930 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0d41338a0 0x7fe0d4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe0d41338a0 0x7fe0d4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44408/0 (socket says 172.21.15.19:44408) 2023-10-03T10:20:10.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d259c700 1 -- 172.21.15.19:0/4142770632 learned_addr learned my addr 172.21.15.19:0/4142770632 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.503+0000 7fe0d2d9d700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d409e930 0x7fe0d413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d259c700 1 -- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d409e930 msgr2=0x7fe0d413b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d259c700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d409e930 0x7fe0d413b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d259c700 1 -- 172.21.15.19:0/4142770632 >> v1:172.21.15.19:6789/0 conn(0x7fe0d409de50 legacy=0x7fe0d409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d259c700 1 -- 172.21.15.19:0/4142770632 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d406fc30 con 0x7fe0d41338a0 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d259c700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d41338a0 0x7fe0d4133c70 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098f0 tx=0x7fe0c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8125e73fba869b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d159a700 1 -- 172.21.15.19:0/4142770632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011830 con 0x7fe0d41338a0 2023-10-03T10:20:10.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d159a700 1 -- 172.21.15.19:0/4142770632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c4011990 con 0x7fe0d41338a0 2023-10-03T10:20:10.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.504+0000 7fe0d159a700 1 -- 172.21.15.19:0/4142770632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011d20 con 0x7fe0d41338a0 2023-10-03T10:20:10.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 -- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d41338a0 msgr2=0x7fe0d4133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d41338a0 0x7fe0d4133c70 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fe0c40098f0 tx=0x7fe0c4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 -- 172.21.15.19:0/4142770632 shutdown_connections 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d409e930 0x7fe0d413b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/4142770632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d41338a0 0x7fe0d4133c70 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.505+0000 7fe0d8baa700 1 -- 172.21.15.19:0/4142770632 >> 172.21.15.19:0/4142770632 conn(0x7fe0d40a2aa0 msgr2=0x7fe0d40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.506+0000 7fe0d8baa700 1 -- 172.21.15.19:0/4142770632 shutdown_connections 2023-10-03T10:20:10.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.506+0000 7fe0d8baa700 1 -- 172.21.15.19:0/4142770632 wait complete. 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.507+0000 7fe0d8baa700 1 Processor -- start 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.507+0000 7fe0d8baa700 1 -- start start 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d409e930 0x7fe0d411f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d41338a0 0x7fe0d411f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4121cd0 con 0x7fe0d409de50 2023-10-03T10:20:10.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d412f6a0 con 0x7fe0d409e930 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d8baa700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d41206e0 con 0x7fe0d41338a0 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44414/0 (socket says 172.21.15.19:44414) 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d259c700 1 -- 172.21.15.19:0/2325287299 learned_addr learned my addr 172.21.15.19:0/2325287299 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d1d9b700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d409e930 0x7fe0d411f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.508+0000 7fe0d2d9d700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d41338a0 0x7fe0d411f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 -- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d41338a0 msgr2=0x7fe0d411f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d41338a0 0x7fe0d411f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 -- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d409e930 msgr2=0x7fe0d411f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d409e930 0x7fe0d411f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 -- 172.21.15.19:0/2325287299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4009550 con 0x7fe0d409de50 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d259c700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4004480 con 0x7fe0d409de50 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c401f070 con 0x7fe0d409de50 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d41225f0 con 0x7fe0d409de50 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4122310 con 0x7fe0d409de50 2023-10-03T10:20:10.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.509+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40038c0 con 0x7fe0d409de50 2023-10-03T10:20:10.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.510+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0c4021030 con 0x7fe0d409de50 2023-10-03T10:20:10.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.511+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe0c4040a30 con 0x7fe0d409de50 2023-10-03T10:20:10.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.511+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4074ea0 con 0x7fe0d409de50 2023-10-03T10:20:10.517 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.517+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0c4015080 con 0x7fe0d409de50 2023-10-03T10:20:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.559+0000 7fc86e608700 1 Processor -- start 2023-10-03T10:20:10.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.559+0000 7fc86e608700 1 -- start start 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86e608700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc8681338a0 0x7fc868133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86e608700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 0x7fc86809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86e608700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86806ef30 con 0x7fc86809e760 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86e608700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc86806fef0 con 0x7fc8681338a0 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86e608700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8681334b0 con 0x7fc86809de50 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86cba5700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc86809e760 0x7fc86813a730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44116/0 (socket says 172.21.15.19:44116) 2023-10-03T10:20:10.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc86cba5700 1 -- 172.21.15.19:0/1350813046 learned_addr learned my addr 172.21.15.19:0/1350813046 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc8677fe700 1 --2- 172.21.15.19:0/1350813046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 0x7fc86809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc867fff700 1 --2- 172.21.15.19:0/1350813046 >> v2:172.21.15.19:3300/0 conn(0x7fc8681338a0 0x7fc868133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc8677fe700 1 -- 172.21.15.19:0/1350813046 >> v2:172.21.15.19:3300/0 conn(0x7fc8681338a0 msgr2=0x7fc868133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc8677fe700 1 --2- 172.21.15.19:0/1350813046 >> v2:172.21.15.19:3300/0 conn(0x7fc8681338a0 0x7fc868133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc8677fe700 1 -- 172.21.15.19:0/1350813046 >> v1:172.21.15.19:6789/0 conn(0x7fc86809e760 legacy=0x7fc86813a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.560+0000 7fc8677fe700 1 -- 172.21.15.19:0/1350813046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86806fc30 con 0x7fc86809de50 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.561+0000 7fc8677fe700 1 --2- 172.21.15.19:0/1350813046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 0x7fc86809e220 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009840 tx=0x7fc85c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ef5d822e0ab1696 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.561+0000 7fc866ffd700 1 -- 172.21.15.19:0/1350813046 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c011830 con 0x7fc86809de50 2023-10-03T10:20:10.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.561+0000 7fc866ffd700 1 -- 172.21.15.19:0/1350813046 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c011990 con 0x7fc86809de50 2023-10-03T10:20:10.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.561+0000 7fc866ffd700 1 -- 172.21.15.19:0/1350813046 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c011d20 con 0x7fc86809de50 2023-10-03T10:20:10.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 -- 172.21.15.19:0/1350813046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 msgr2=0x7fc86809e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 --2- 172.21.15.19:0/1350813046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 0x7fc86809e220 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009840 tx=0x7fc85c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:10.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 -- 172.21.15.19:0/1350813046 shutdown_connections 2023-10-03T10:20:10.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 --2- 172.21.15.19:0/1350813046 >> v2:172.21.15.19:3300/0 conn(0x7fc8681338a0 0x7fc868133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 --2- 172.21.15.19:0/1350813046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc86809de50 0x7fc86809e220 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 -- 172.21.15.19:0/1350813046 >> 172.21.15.19:0/1350813046 conn(0x7fc8680a2aa0 msgr2=0x7fc8680a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 -- 172.21.15.19:0/1350813046 shutdown_connections 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.562+0000 7fc86e608700 1 -- 172.21.15.19:0/1350813046 wait complete. 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.563+0000 7fc86e608700 1 Processor -- start 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.563+0000 7fc86e608700 1 -- start start 2023-10-03T10:20:10.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc86809de50 0x7fc86811ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc86809e760 0x7fc86811efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86806f640 con 0x7fc86809de50 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8681222b0 con 0x7fc8681338a0 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86e608700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc868120790 con 0x7fc86809e760 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41330/0 (socket says 172.21.15.19:41330) 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 -- 172.21.15.19:0/675281196 learned_addr learned my addr 172.21.15.19:0/675281196 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc867fff700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc86809de50 0x7fc86811ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 -- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc86809e760 msgr2=0x7fc86811efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc86809e760 0x7fc86811efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 -- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc86809de50 msgr2=0x7fc86811ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc86809de50 0x7fc86811ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.564+0000 7fc86cba5700 1 -- 172.21.15.19:0/675281196 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c0094a0 con 0x7fc8681338a0 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc86cba5700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc86000cbf0 tx=0x7fc86000cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000ab10 con 0x7fc8681338a0 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000ac70 con 0x7fc8681338a0 2023-10-03T10:20:10.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8680a1000 con 0x7fc8681338a0 2023-10-03T10:20:10.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860012400 con 0x7fc8681338a0 2023-10-03T10:20:10.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.565+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868122d20 con 0x7fc8681338a0 2023-10-03T10:20:10.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.566+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc86001b3b0 con 0x7fc8681338a0 2023-10-03T10:20:10.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.566+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc86003f470 con 0x7fc8681338a0 2023-10-03T10:20:10.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.567+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8681223f0 con 0x7fc8681338a0 2023-10-03T10:20:10.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.573+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc8681223f0 con 0x7fc8681338a0 2023-10-03T10:20:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.628+0000 7fd1c5038700 1 Processor -- start 2023-10-03T10:20:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.628+0000 7fd1c5038700 1 -- start start 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1c5038700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1c5038700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd1c009e410 0x7fd1c0130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1c5038700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c009f130 con 0x7fd1c009e000 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1c5038700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c009f520 con 0x7fd1c009e410 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1c5038700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c009e930 con 0x7fd1c009d6f0 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41334/0 (socket says 172.21.15.19:41334) 2023-10-03T10:20:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 -- 172.21.15.19:0/4164533147 learned_addr learned my addr 172.21.15.19:0/4164533147 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bf59e700 1 --2- 172.21.15.19:0/4164533147 >> v2:172.21.15.19:3300/0 conn(0x7fd1c009e410 0x7fd1c0130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 -- 172.21.15.19:0/4164533147 >> v2:172.21.15.19:3300/0 conn(0x7fd1c009e410 msgr2=0x7fd1c0130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 --2- 172.21.15.19:0/4164533147 >> v2:172.21.15.19:3300/0 conn(0x7fd1c009e410 0x7fd1c0130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 -- 172.21.15.19:0/4164533147 >> v1:172.21.15.19:6789/0 conn(0x7fd1c009e000 legacy=0x7fd1c0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 -- 172.21.15.19:0/4164533147 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c009b2d0 con 0x7fd1c009d6f0 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.629+0000 7fd1bed9d700 1 --2- 172.21.15.19:0/4164533147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000b9a0 tx=0x7fd1b000bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=343d72878b5f2a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1bdd9b700 1 -- 172.21.15.19:0/4164533147 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000caa0 con 0x7fd1c009d6f0 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1bdd9b700 1 -- 172.21.15.19:0/4164533147 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b000cc00 con 0x7fd1c009d6f0 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1bdd9b700 1 -- 172.21.15.19:0/4164533147 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b000f460 con 0x7fd1c009d6f0 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 -- 172.21.15.19:0/4164533147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 msgr2=0x7fd1c009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 --2- 172.21.15.19:0/4164533147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd1b000b9a0 tx=0x7fd1b000bcb0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 -- 172.21.15.19:0/4164533147 shutdown_connections 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 --2- 172.21.15.19:0/4164533147 >> v2:172.21.15.19:3300/0 conn(0x7fd1c009e410 0x7fd1c0130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 --2- 172.21.15.19:0/4164533147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009d6f0 0x7fd1c009dac0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.630+0000 7fd1c5038700 1 -- 172.21.15.19:0/4164533147 >> 172.21.15.19:0/4164533147 conn(0x7fd1c0066f50 msgr2=0x7fd1c009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.631+0000 7fd1c5038700 1 -- 172.21.15.19:0/4164533147 shutdown_connections 2023-10-03T10:20:10.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.631+0000 7fd1c5038700 1 -- 172.21.15.19:0/4164533147 wait complete. 2023-10-03T10:20:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.632+0000 7fd1c5038700 1 Processor -- start 2023-10-03T10:20:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.632+0000 7fd1c5038700 1 -- start start 2023-10-03T10:20:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 0x7fd1c011e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 0x7fd1c011e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c011f490 con 0x7fd1c009e000 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00a1e20 con 0x7fd1c009e410 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1c5038700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c009c700 con 0x7fd1c009d6f0 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41342/0 (socket says 172.21.15.19:41342) 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.633+0000 7fd1bf59e700 1 -- 172.21.15.19:0/41171848 learned_addr learned my addr 172.21.15.19:0/41171848 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1be59c700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 0x7fd1c011e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bed9d700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 0x7fd1c011e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 -- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 msgr2=0x7fd1c011e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 0x7fd1c011e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 -- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 msgr2=0x7fd1c011e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 0x7fd1c011e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 -- 172.21.15.19:0/41171848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b000b600 con 0x7fd1c009e410 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bed9d700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 0x7fd1c011e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1be59c700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 0x7fd1c011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1bf59e700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80123f0 tx=0x7fd1b80127b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800d2d0 con 0x7fd1c009e410 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8013040 con 0x7fd1c009e410 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b800b740 con 0x7fd1c009e410 2023-10-03T10:20:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0121570 con 0x7fd1c009e410 2023-10-03T10:20:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.634+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c01303d0 con 0x7fd1c009e410 2023-10-03T10:20:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.635+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd1b800b8a0 con 0x7fd1c009e410 2023-10-03T10:20:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.635+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd1b8044400 con 0x7fd1c009e410 2023-10-03T10:20:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.637+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c0074ea0 con 0x7fd1c009e410 2023-10-03T10:20:10.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.642+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd1b8016340 con 0x7fd1c009e410 2023-10-03T10:20:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.646+0000 7f2e7c6c6700 1 Processor -- start 2023-10-03T10:20:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.646+0000 7f2e7c6c6700 1 -- start start 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2e7409e000 0x7f2e741339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 0x7f2e74133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7406b460 con 0x7f2e7409e000 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7409b120 con 0x7f2e7409e410 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7c6c6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7409a7e0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7a462700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7a462700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:34994/0 (socket says 172.21.15.19:34994) 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7a462700 1 -- 172.21.15.19:0/1632389198 learned_addr learned my addr 172.21.15.19:0/1632389198 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e7ac63700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 0x7f2e74133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.647+0000 7f2e79c61700 1 --2- 172.21.15.19:0/1632389198 >> v2:172.21.15.19:3300/0 conn(0x7f2e7409e000 0x7f2e741339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 -- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 msgr2=0x7f2e74133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 0x7f2e74133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 -- 172.21.15.19:0/1632389198 >> v2:172.21.15.19:3300/0 conn(0x7f2e7409e000 msgr2=0x7f2e741339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 --2- 172.21.15.19:0/1632389198 >> v2:172.21.15.19:3300/0 conn(0x7f2e7409e000 0x7f2e741339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 -- 172.21.15.19:0/1632389198 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7409a500 con 0x7f2e7409d6f0 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7ac63700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 0x7f2e74133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:10.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e7a462700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009e80 tx=0x7f2e7000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7005b1e94bec1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e79460700 1 -- 172.21.15.19:0/1632389198 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000e070 con 0x7f2e7409d6f0 2023-10-03T10:20:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e79460700 1 -- 172.21.15.19:0/1632389198 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000b8d0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.648+0000 7f2e79460700 1 -- 172.21.15.19:0/1632389198 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000bc80 con 0x7f2e7409d6f0 2023-10-03T10:20:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 msgr2=0x7f2e7409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009e80 tx=0x7f2e7000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/1632389198 shutdown_connections 2023-10-03T10:20:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e410 0x7f2e74133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/1632389198 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409d6f0 0x7f2e7409dac0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/1632389198 >> v2:172.21.15.19:3300/0 conn(0x7f2e7409e000 0x7f2e741339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/1632389198 >> 172.21.15.19:0/1632389198 conn(0x7f2e74066f50 msgr2=0x7f2e7409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/1632389198 shutdown_connections 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.649+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/1632389198 wait complete. 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.650+0000 7f2e7c6c6700 1 Processor -- start 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.650+0000 7f2e7c6c6700 1 -- start start 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 0x7f2e741a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409e410 0x7f2e741a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741aa280 con 0x7f2e7409d6f0 2023-10-03T10:20:10.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741a79b0 con 0x7f2e7409e000 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7c6c6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741a8c00 con 0x7f2e7409e410 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7a462700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7a462700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44476/0 (socket says 172.21.15.19:44476) 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7a462700 1 -- 172.21.15.19:0/3416267121 learned_addr learned my addr 172.21.15.19:0/3416267121 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e79c61700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 0x7f2e741a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.651+0000 7f2e7ac63700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409e410 0x7f2e741a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 -- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409e410 msgr2=0x7f2e741a6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409e410 0x7f2e741a6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 -- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 msgr2=0x7f2e741a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 0x7f2e741a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 -- 172.21.15.19:0/3416267121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c0094a0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e79c61700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 0x7f2e741a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7a462700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2e7409a970 tx=0x7f2e70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70004450 con 0x7f2e7409d6f0 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e70003e90 con 0x7f2e7409d6f0 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e70009b30 con 0x7f2e7409d6f0 2023-10-03T10:20:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70004810 con 0x7f2e7409d6f0 2023-10-03T10:20:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.652+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e741a90a0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.653+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2e7001c440 con 0x7f2e7409d6f0 2023-10-03T10:20:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.653+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7409c770 con 0x7f2e7409d6f0 2023-10-03T10:20:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.653+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2e70040ca0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.658 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.658+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2e70024590 con 0x7f2e7409d6f0 2023-10-03T10:20:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.734+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe0d40a1110 con 0x7fe0d409de50 2023-10-03T10:20:10.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.735+0000 7fe0c2ffd700 1 -- 172.21.15.19:0/2325287299 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0c4003a20 con 0x7fe0d409de50 2023-10-03T10:20:10.734 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 msgr2=0x7fe0d411eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004750 comp rx=0 tx=0).stop 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 shutdown_connections 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d41338a0 0x7fe0d411f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d409de50 0x7fe0d411eb10 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 --2- 172.21.15.19:0/2325287299 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d409e930 0x7fe0d411f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 >> 172.21.15.19:0/2325287299 conn(0x7fe0d40a2aa0 msgr2=0x7fe0d409ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 shutdown_connections 2023-10-03T10:20:10.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.738+0000 7fe0d8baa700 1 -- 172.21.15.19:0/2325287299 wait complete. 2023-10-03T10:20:10.753 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:10.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.844+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc8681223f0 con 0x7fc8681338a0 2023-10-03T10:20:10.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.844+0000 7fc864ff9700 1 -- 172.21.15.19:0/675281196 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc8681223f0 con 0x7fc8681338a0 2023-10-03T10:20:10.844 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 msgr2=0x7fc86811f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc86000cbf0 tx=0x7fc86000cf00 comp rx=0 tx=0).stop 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 shutdown_connections 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc8681338a0 0x7fc86811f4f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc86809de50 0x7fc86811ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 --2- 172.21.15.19:0/675281196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc86809e760 0x7fc86811efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 >> 172.21.15.19:0/675281196 conn(0x7fc8680a2aa0 msgr2=0x7fc86809ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 shutdown_connections 2023-10-03T10:20:10.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.847+0000 7fc86e608700 1 -- 172.21.15.19:0/675281196 wait complete. 2023-10-03T10:20:10.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.865+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2e74074ea0 con 0x7f2e7409d6f0 2023-10-03T10:20:10.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.866+0000 7f2e6affd700 1 -- 172.21.15.19:0/3416267121 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2e70011390 con 0x7f2e7409d6f0 2023-10-03T10:20:10.866 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 msgr2=0x7f2e741a5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2e7409a970 tx=0x7f2e70004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 shutdown_connections 2023-10-03T10:20:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2e7409e410 0x7f2e741a6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e7409d6f0 0x7f2e741a5da0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 --2- 172.21.15.19:0/3416267121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2e7409e000 0x7f2e741a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 >> 172.21.15.19:0/3416267121 conn(0x7f2e74066f50 msgr2=0x7f2e741bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 shutdown_connections 2023-10-03T10:20:10.869 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.868+0000 7f2e7c6c6700 1 -- 172.21.15.19:0/3416267121 wait complete. 2023-10-03T10:20:10.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:10.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.891+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd1c0120e50 con 0x7fd1c009e410 2023-10-03T10:20:10.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.891+0000 7fd1a77fe700 1 -- 172.21.15.19:0/41171848 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd1b8020b00 con 0x7fd1c009e410 2023-10-03T10:20:10.891 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:10.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 msgr2=0x7fd1c011eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd1b80123f0 tx=0x7fd1b80127b0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 shutdown_connections 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd1c009e410 0x7fd1c011eab0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd1c009d6f0 0x7fd1c011e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 --2- 172.21.15.19:0/41171848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd1c009e000 0x7fd1c011e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.893+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 >> 172.21.15.19:0/41171848 conn(0x7fd1c0066f50 msgr2=0x7fd1c006f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.894+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 shutdown_connections 2023-10-03T10:20:10.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:10.894+0000 7fd1c5038700 1 -- 172.21.15.19:0/41171848 wait complete. 2023-10-03T10:20:10.907 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:11.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:11.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:11.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.905+0000 7fd83abdb700 1 Processor -- start 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.905+0000 7fd83abdb700 1 -- start start 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd83abdb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd834138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd83abdb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd834139030 0x7fd83413b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd83abdb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83406ef30 con 0x7fd8341338a0 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd83abdb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83406fef0 con 0x7fd834139030 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd83abdb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341334b0 con 0x7fd834136710 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd834139030 0x7fd83413b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd833fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd834138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:11.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd838977700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd8341338a0 0x7fd834133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44132/0 (socket says 172.21.15.19:44132) 2023-10-03T10:20:11.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd838977700 1 -- 172.21.15.19:0/1766373903 learned_addr learned my addr 172.21.15.19:0/1766373903 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 -- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 msgr2=0x7fd834138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 --2- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd834138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 -- 172.21.15.19:0/1766373903 >> v1:172.21.15.19:6789/0 conn(0x7fd8341338a0 legacy=0x7fd834133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 -- 172.21.15.19:0/1766373903 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83406fc30 con 0x7fd834139030 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd839178700 1 --2- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd834139030 0x7fd83413b410 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009d90 tx=0x7fd82c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1eec2729c8d764 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.906+0000 7fd8337fe700 1 -- 172.21.15.19:0/1766373903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00e070 con 0x7fd834139030 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd8337fe700 1 -- 172.21.15.19:0/1766373903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00bb20 con 0x7fd834139030 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd8337fe700 1 -- 172.21.15.19:0/1766373903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c012430 con 0x7fd834139030 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 -- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd834139030 msgr2=0x7fd83413b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:11.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 --2- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd834139030 0x7fd83413b410 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009d90 tx=0x7fd82c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 -- 172.21.15.19:0/1766373903 shutdown_connections 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 --2- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd834139030 0x7fd83413b410 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 --2- 172.21.15.19:0/1766373903 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd834138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 -- 172.21.15.19:0/1766373903 >> 172.21.15.19:0/1766373903 conn(0x7fd8340a2aa0 msgr2=0x7fd8340a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 -- 172.21.15.19:0/1766373903 shutdown_connections 2023-10-03T10:20:11.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.907+0000 7fd83abdb700 1 -- 172.21.15.19:0/1766373903 wait complete. 2023-10-03T10:20:11.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.909+0000 7fd83abdb700 1 Processor -- start 2023-10-03T10:20:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.909+0000 7fd83abdb700 1 -- start start 2023-10-03T10:20:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd8341301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:11.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 0x7fd8341c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83411d350 con 0x7fd8341338a0 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83411cc40 con 0x7fd834136710 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd83abdb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340a23b0 con 0x7fd834139030 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44492/0 (socket says 172.21.15.19:44492) 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 -- 172.21.15.19:0/3825859859 learned_addr learned my addr 172.21.15.19:0/3825859859 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd839178700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 0x7fd8341c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd833fff700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd8341301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 -- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 msgr2=0x7fd8341c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 0x7fd8341c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 -- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 msgr2=0x7fd8341301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd8341301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:11.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 -- 172.21.15.19:0/3825859859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009a70 con 0x7fd8341338a0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd839178700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 0x7fd8341c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.910+0000 7fd838977700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c520 tx=0x7fd82800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.911+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828005d70 con 0x7fd8341338a0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.911+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8280070d0 con 0x7fd8341338a0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.911+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83406f640 con 0x7fd8341338a0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.911+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd828007440 con 0x7fd8341338a0 2023-10-03T10:20:11.913 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.911+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83411e6f0 con 0x7fd8341338a0 2023-10-03T10:20:11.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.912+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd8280075a0 con 0x7fd8341338a0 2023-10-03T10:20:11.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.912+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd82803ea60 con 0x7fd8341338a0 2023-10-03T10:20:11.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.913+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd834074ea0 con 0x7fd8341338a0 2023-10-03T10:20:11.918 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:11.918+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd828019b40 con 0x7fd8341338a0 2023-10-03T10:20:12.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.020+0000 7fc47ea0c700 1 Processor -- start 2023-10-03T10:20:12.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.020+0000 7fc47ea0c700 1 -- start start 2023-10-03T10:20:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc47ea0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc47ea0c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc478139250 0x7fc47813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc47ea0c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc47809edd0 con 0x7fc4780a0a30 2023-10-03T10:20:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc47ea0c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780a18e0 con 0x7fc4780a1510 2023-10-03T10:20:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc47ea0c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc47809e1f0 con 0x7fc478139250 2023-10-03T10:20:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc4777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc4777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41390/0 (socket says 172.21.15.19:41390) 2023-10-03T10:20:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.021+0000 7fc4777fe700 1 -- 172.21.15.19:0/2420087853 learned_addr learned my addr 172.21.15.19:0/2420087853 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc47cfa9700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc478139250 0x7fc47813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc4777fe700 1 -- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc478139250 msgr2=0x7fc47813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc4777fe700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc478139250 0x7fc47813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc4777fe700 1 -- 172.21.15.19:0/2420087853 >> v1:172.21.15.19:6789/0 conn(0x7fc4780a0a30 legacy=0x7fc4780a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc4777fe700 1 -- 172.21.15.19:0/2420087853 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47809dc50 con 0x7fc4780a1510 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc4777fe700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009920 tx=0x7fc46c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92da32bc9b0b822a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc476ffd700 1 -- 172.21.15.19:0/2420087853 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011830 con 0x7fc4780a1510 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc476ffd700 1 -- 172.21.15.19:0/2420087853 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c011990 con 0x7fc4780a1510 2023-10-03T10:20:12.023 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.022+0000 7fc476ffd700 1 -- 172.21.15.19:0/2420087853 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011d20 con 0x7fc4780a1510 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.023+0000 7fc47ea0c700 1 -- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 msgr2=0x7fc478138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.023+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc46c009920 tx=0x7fc46c009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 -- 172.21.15.19:0/2420087853 shutdown_connections 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc478139250 0x7fc47813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/2420087853 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a1510 0x7fc478138d10 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 -- 172.21.15.19:0/2420087853 >> 172.21.15.19:0/2420087853 conn(0x7fc4780a6550 msgr2=0x7fc4780a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 -- 172.21.15.19:0/2420087853 shutdown_connections 2023-10-03T10:20:12.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.024+0000 7fc47ea0c700 1 -- 172.21.15.19:0/2420087853 wait complete. 2023-10-03T10:20:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.025+0000 7fc47ea0c700 1 Processor -- start 2023-10-03T10:20:12.025 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 -- start start 2023-10-03T10:20:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4780a1510 0x7fc478127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 0x7fc4781cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4781299e0 con 0x7fc478139250 2023-10-03T10:20:12.026 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc478138720 con 0x7fc4780a0a30 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47ea0c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc478127330 con 0x7fc4780a1510 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc477fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc477fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41392/0 (socket says 172.21.15.19:41392) 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc477fff700 1 -- 172.21.15.19:0/848557909 learned_addr learned my addr 172.21.15.19:0/848557909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.026+0000 7fc47cfa9700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 0x7fc4781cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.027 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc4777fe700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4780a1510 0x7fc478127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 -- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4780a1510 msgr2=0x7fc478127c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4780a1510 0x7fc478127c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 -- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 msgr2=0x7fc478127720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 -- 172.21.15.19:0/848557909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c009550 con 0x7fc478139250 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc477fff700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47cfa9700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 0x7fc4781cc800 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc470009d90 tx=0x7fc47000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470009c00 con 0x7fc478139250 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000f040 con 0x7fc478139250 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4780a0220 con 0x7fc478139250 2023-10-03T10:20:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.027+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470014480 con 0x7fc478139250 2023-10-03T10:20:12.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.028+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47812b070 con 0x7fc478139250 2023-10-03T10:20:12.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.029+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4580052e0 con 0x7fc478139250 2023-10-03T10:20:12.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.029+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc4700145e0 con 0x7fc478139250 2023-10-03T10:20:12.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.030+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc470040890 con 0x7fc478139250 2023-10-03T10:20:12.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.034+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc470012930 con 0x7fc478139250 2023-10-03T10:20:12.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.051+0000 7f57538ac700 1 Processor -- start 2023-10-03T10:20:12.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 -- start start 2023-10-03T10:20:12.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 0x7f574c06e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f574c06ee80 0x7f574c134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c070ee0 con 0x7f574c09eca0 2023-10-03T10:20:12.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c071480 con 0x7f574c06ee80 2023-10-03T10:20:12.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f57538ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c071b90 con 0x7f574c06e570 2023-10-03T10:20:12.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f5751e49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f574c06ee80 0x7f574c134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f574c06ee80 0x7f574c134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44504/0 (socket says 172.21.15.19:44504) 2023-10-03T10:20:12.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 -- 172.21.15.19:0/3214487778 learned_addr learned my addr 172.21.15.19:0/3214487778 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:12.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.052+0000 7f5751648700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 0x7f574c06e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 -- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 msgr2=0x7f574c06e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:12.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 0x7f574c06e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 -- 172.21.15.19:0/3214487778 >> v1:172.21.15.19:6789/0 conn(0x7f574c09eca0 legacy=0x7f574c134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 -- 172.21.15.19:0/3214487778 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0711a0 con 0x7f574c06ee80 2023-10-03T10:20:12.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5743fff700 1 -- 172.21.15.19:0/3214487778 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788696861 0 0) 0x7f574c070ee0 con 0x7f574c09eca0 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751648700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 0x7f574c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5751e49700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134d20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f5744009e50 tx=0x7f574400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e71630a128ea3d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5743fff700 1 -- 172.21.15.19:0/3214487778 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574400e070 con 0x7f574c06ee80 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5743fff700 1 -- 172.21.15.19:0/3214487778 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574400b910 con 0x7f574c06ee80 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.053+0000 7f5743fff700 1 -- 172.21.15.19:0/3214487778 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574400bcc0 con 0x7f574c06ee80 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 -- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 msgr2=0x7f574c134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134d20 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f5744009e50 tx=0x7f574400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 -- 172.21.15.19:0/3214487778 shutdown_connections 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134d20 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 --2- 172.21.15.19:0/3214487778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c06e570 0x7f574c06e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 -- 172.21.15.19:0/3214487778 >> 172.21.15.19:0/3214487778 conn(0x7f574c0a2aa0 msgr2=0x7f574c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 -- 172.21.15.19:0/3214487778 shutdown_connections 2023-10-03T10:20:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.054+0000 7f57538ac700 1 -- 172.21.15.19:0/3214487778 wait complete. 2023-10-03T10:20:12.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.055+0000 7f57538ac700 1 Processor -- start 2023-10-03T10:20:12.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.055+0000 7f57538ac700 1 -- start start 2023-10-03T10:20:12.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f574c06e570 0x7f574c134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 0x7f574c133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1350f0 con 0x7f574c06ee80 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c13b3e0 con 0x7f574c133310 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f57538ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f574c1355e0 con 0x7f574c06e570 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44520/0 (socket says 172.21.15.19:44520) 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 -- 172.21.15.19:0/1833106238 learned_addr learned my addr 172.21.15.19:0/1833106238 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5751e49700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 0x7f574c133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 -- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f574c06e570 msgr2=0x7f574c134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f574c06e570 0x7f574c134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 -- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 msgr2=0x7f574c133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 0x7f574c133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5750e47700 1 -- 172.21.15.19:0/1833106238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57480094a0 con 0x7f574c06ee80 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.056+0000 7f5751e49700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 0x7f574c133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f5750e47700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c4a0 tx=0x7f573c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0054e0 con 0x7f574c06ee80 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c003680 con 0x7f574c06ee80 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c003a30 con 0x7f574c06ee80 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5744009b30 con 0x7f574c06ee80 2023-10-03T10:20:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.057+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c070610 con 0x7f574c06ee80 2023-10-03T10:20:12.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.058+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f573c003b90 con 0x7f574c06ee80 2023-10-03T10:20:12.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.058+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f573c03eb70 con 0x7f574c06ee80 2023-10-03T10:20:12.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.058+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c074ea0 con 0x7f574c06ee80 2023-10-03T10:20:12.063 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.063+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f573c017030 con 0x7f574c06ee80 2023-10-03T10:20:12.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.077+0000 7ff0a40c5700 1 Processor -- start 2023-10-03T10:20:12.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.077+0000 7ff0a40c5700 1 -- start start 2023-10-03T10:20:12.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a40c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 0x7ff09c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a40c5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff09c09e000 0x7ff09c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a40c5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c09b120 con 0x7ff09c09e410 2023-10-03T10:20:12.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a40c5700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c06b460 con 0x7ff09c09e000 2023-10-03T10:20:12.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a40c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09a7e0 con 0x7ff09c09d6f0 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a1660700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff09c09e000 0x7ff09c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a2662700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff09c09e410 0x7ff09c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44160/0 (socket says 172.21.15.19:44160) 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a1660700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff09c09e000 0x7ff09c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44532/0 (socket says 172.21.15.19:44532) 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a2662700 1 -- 172.21.15.19:0/1903763086 learned_addr learned my addr 172.21.15.19:0/1903763086 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.078+0000 7ff0a1e61700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 0x7ff09c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1660700 1 -- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 msgr2=0x7ff09c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:12.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1660700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 0x7ff09c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1660700 1 -- 172.21.15.19:0/1903763086 >> v1:172.21.15.19:6789/0 conn(0x7ff09c09e410 legacy=0x7ff09c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1660700 1 -- 172.21.15.19:0/1903763086 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c09a500 con 0x7ff09c09e000 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1e61700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 0x7ff09c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a1660700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09e000 0x7ff09c1339f0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009840 tx=0x7ff08c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d746b23b67ad4af server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a0e5f700 1 -- 172.21.15.19:0/1903763086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011830 con 0x7ff09c09e000 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a0e5f700 1 -- 172.21.15.19:0/1903763086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c011990 con 0x7ff09c09e000 2023-10-03T10:20:12.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.079+0000 7ff0a0e5f700 1 -- 172.21.15.19:0/1903763086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c011d20 con 0x7ff09c09e000 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 -- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09e000 msgr2=0x7ff09c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09e000 0x7ff09c1339f0 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009840 tx=0x7ff08c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 -- 172.21.15.19:0/1903763086 shutdown_connections 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09d6f0 0x7ff09c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/1903763086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09e000 0x7ff09c1339f0 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 -- 172.21.15.19:0/1903763086 >> 172.21.15.19:0/1903763086 conn(0x7ff09c066f50 msgr2=0x7ff09c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 -- 172.21.15.19:0/1903763086 shutdown_connections 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.080+0000 7ff0a40c5700 1 -- 172.21.15.19:0/1903763086 wait complete. 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.081+0000 7ff0a40c5700 1 Processor -- start 2023-10-03T10:20:12.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.081+0000 7ff0a40c5700 1 -- start start 2023-10-03T10:20:12.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09d6f0 0x7ff09c1a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09e410 0x7ff09c1a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1a93e0 con 0x7ff09c09d6f0 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c1a7b80 con 0x7ff09c09e000 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a40c5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09c710 con 0x7ff09c09e410 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41424/0 (socket says 172.21.15.19:41424) 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 -- 172.21.15.19:0/3679122222 learned_addr learned my addr 172.21.15.19:0/3679122222 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1e61700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09d6f0 0x7ff09c1a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a2662700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09e410 0x7ff09c1a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 -- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09e410 msgr2=0x7ff09c1a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09e410 0x7ff09c1a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 -- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09d6f0 msgr2=0x7ff09c1a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09d6f0 0x7ff09c1a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.082+0000 7ff0a1660700 1 -- 172.21.15.19:0/3679122222 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0980094a0 con 0x7ff09c09e000 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0a1660700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009fd0 tx=0x7ff08c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0036a0 con 0x7ff09c09e000 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c027070 con 0x7ff09c09e000 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c003a20 con 0x7ff09c09e000 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c0094a0 con 0x7ff09c09e000 2023-10-03T10:20:12.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.083+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c1a8870 con 0x7ff09c09e000 2023-10-03T10:20:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.084+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c074ea0 con 0x7ff09c09e000 2023-10-03T10:20:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.085+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff08c003b80 con 0x7ff09c09e000 2023-10-03T10:20:12.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.085+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff08c029070 con 0x7ff09c09e000 2023-10-03T10:20:12.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.094+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff08c003e30 con 0x7ff09c09e000 2023-10-03T10:20:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.139+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd83411e4a0 con 0x7fd8341338a0 2023-10-03T10:20:12.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.139+0000 7fd8317fa700 1 -- 172.21.15.19:0/3825859859 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd828017030 con 0x7fd8341338a0 2023-10-03T10:20:12.139 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 msgr2=0x7fd83412fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fd82800c520 tx=0x7fd82800c830 comp rx=0 tx=0).stop 2023-10-03T10:20:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 shutdown_connections 2023-10-03T10:20:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd834139030 0x7fd8341c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8341338a0 0x7fd83412fca0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 --2- 172.21.15.19:0/3825859859 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd834136710 0x7fd8341301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 >> 172.21.15.19:0/3825859859 conn(0x7fd8340a2aa0 msgr2=0x7fd8341344f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 shutdown_connections 2023-10-03T10:20:12.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.142+0000 7fd83abdb700 1 -- 172.21.15.19:0/3825859859 wait complete. 2023-10-03T10:20:12.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:12.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.266+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc458005860 con 0x7fc478139250 2023-10-03T10:20:12.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.266+0000 7fc474ff9700 1 -- 172.21.15.19:0/848557909 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc47002a070 con 0x7fc478139250 2023-10-03T10:20:12.266 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:12.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 msgr2=0x7fc4781cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 0x7fc4781cc800 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc470009d90 tx=0x7fc47000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 shutdown_connections 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc478139250 0x7fc4781cc800 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4780a0a30 0x7fc478127720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 --2- 172.21.15.19:0/848557909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4780a1510 0x7fc478127c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.268+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 >> 172.21.15.19:0/848557909 conn(0x7fc4780a6550 msgr2=0x7fc4780a4030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.269+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 shutdown_connections 2023-10-03T10:20:12.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.269+0000 7fc47ea0c700 1 -- 172.21.15.19:0/848557909 wait complete. 2023-10-03T10:20:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.274+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f574c06b9e0 con 0x7f574c06ee80 2023-10-03T10:20:12.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.275+0000 7f5741ffb700 1 -- 172.21.15.19:0/1833106238 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f573c003e40 con 0x7f574c06ee80 2023-10-03T10:20:12.275 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.277+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 msgr2=0x7f574c134bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.277+0000 7f57538ac700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f573c00c4a0 tx=0x7f573c00c7b0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 shutdown_connections 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f574c133310 0x7f574c133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f574c06e570 0x7f574c134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 --2- 172.21.15.19:0/1833106238 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f574c06ee80 0x7f574c134bb0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 >> 172.21.15.19:0/1833106238 conn(0x7f574c0a2aa0 msgr2=0x7f574c0a1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 shutdown_connections 2023-10-03T10:20:12.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.278+0000 7f57538ac700 1 -- 172.21.15.19:0/1833106238 wait complete. 2023-10-03T10:20:12.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:12.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.301+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff09c1a99e0 con 0x7ff09c09e000 2023-10-03T10:20:12.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.302+0000 7ff0927fc700 1 -- 172.21.15.19:0/3679122222 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff08c033070 con 0x7ff09c09e000 2023-10-03T10:20:12.301 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 msgr2=0x7ff09c1a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009fd0 tx=0x7ff08c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 shutdown_connections 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff09c09e410 0x7ff09c1a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff09c09d6f0 0x7ff09c1a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 --2- 172.21.15.19:0/3679122222 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff09c09e000 0x7ff09c1a6430 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:12.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 >> 172.21.15.19:0/3679122222 conn(0x7ff09c066f50 msgr2=0x7ff09c1baf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 shutdown_connections 2023-10-03T10:20:12.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:12.304+0000 7ff0a40c5700 1 -- 172.21.15.19:0/3679122222 wait complete. 2023-10-03T10:20:12.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:13.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:13.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:13.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.305+0000 7f4b6df33700 1 Processor -- start 2023-10-03T10:20:13.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.305+0000 7f4b6df33700 1 -- start start 2023-10-03T10:20:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b6df33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b6df33700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 0x7f4b68138930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b6df33700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6809b8e0 con 0x7f4b6809e000 2023-10-03T10:20:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b6df33700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6809b420 con 0x7f4b68130d70 2023-10-03T10:20:13.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b6df33700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6809a850 con 0x7f4b6809d6f0 2023-10-03T10:20:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b67fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 0x7f4b68138930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35072/0 (socket says 172.21.15.19:35072) 2023-10-03T10:20:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.306+0000 7f4b677fe700 1 -- 172.21.15.19:0/2974101185 learned_addr learned my addr 172.21.15.19:0/2974101185 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b677fe700 1 -- 172.21.15.19:0/2974101185 >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 msgr2=0x7f4b68138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b677fe700 1 --2- 172.21.15.19:0/2974101185 >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 0x7f4b68138930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b677fe700 1 -- 172.21.15.19:0/2974101185 >> v1:172.21.15.19:6789/0 conn(0x7f4b6809e000 legacy=0x7f4b68130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b677fe700 1 -- 172.21.15.19:0/2974101185 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6809aa40 con 0x7f4b6809d6f0 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b67fff700 1 --2- 172.21.15.19:0/2974101185 >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 0x7f4b68138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b667fc700 1 -- 172.21.15.19:0/2974101185 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886137458 0 0) 0x7f4b6809b8e0 con 0x7f4b6809e000 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b677fe700 1 --2- 172.21.15.19:0/2974101185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800bbc0 tx=0x7f4b5800bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dc08f17a2e3051c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b667fc700 1 -- 172.21.15.19:0/2974101185 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800dcf0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b667fc700 1 -- 172.21.15.19:0/2974101185 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5800de50 con 0x7f4b6809d6f0 2023-10-03T10:20:13.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.307+0000 7f4b667fc700 1 -- 172.21.15.19:0/2974101185 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58010690 con 0x7f4b6809d6f0 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 -- 172.21.15.19:0/2974101185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 msgr2=0x7f4b6809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 --2- 172.21.15.19:0/2974101185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800bbc0 tx=0x7f4b5800bed0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 -- 172.21.15.19:0/2974101185 shutdown_connections 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 --2- 172.21.15.19:0/2974101185 >> v2:172.21.15.19:3300/0 conn(0x7f4b68130d70 0x7f4b68138930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 --2- 172.21.15.19:0/2974101185 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b6809d6f0 0x7f4b6809dac0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.308+0000 7f4b6df33700 1 -- 172.21.15.19:0/2974101185 >> 172.21.15.19:0/2974101185 conn(0x7f4b68066f50 msgr2=0x7f4b6809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.309+0000 7f4b6df33700 1 -- 172.21.15.19:0/2974101185 shutdown_connections 2023-10-03T10:20:13.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.309+0000 7f4b6df33700 1 -- 172.21.15.19:0/2974101185 wait complete. 2023-10-03T10:20:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.310+0000 7f4b6df33700 1 Processor -- start 2023-10-03T10:20:13.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.310+0000 7f4b6df33700 1 -- start start 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b6809e000 0x7f4b6811e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b68130d70 0x7f4b6811ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6811ff70 con 0x7f4b6809d6f0 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68121a90 con 0x7f4b6809e000 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b6df33700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68120410 con 0x7f4b68130d70 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b6809e000 0x7f4b6811e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44560/0 (socket says 172.21.15.19:44560) 2023-10-03T10:20:13.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 -- 172.21.15.19:0/831802357 learned_addr learned my addr 172.21.15.19:0/831802357 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b67fff700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b68130d70 0x7f4b6811ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 -- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b68130d70 msgr2=0x7f4b6811ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b68130d70 0x7f4b6811ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 -- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b6809e000 msgr2=0x7f4b6811e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b6809e000 0x7f4b6811e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 -- 172.21.15.19:0/831802357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009a70 con 0x7f4b6809d6f0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.311+0000 7f4b677fe700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b340 tx=0x7f4b58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.312+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58010e60 con 0x7f4b6809d6f0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.312+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b580214d0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.312+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5800b7f0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.312+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58021860 con 0x7f4b6809d6f0 2023-10-03T10:20:13.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.312+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6809c6e0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.313+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b580219c0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.313+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b680747f0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.313+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b58044de0 con 0x7f4b6809d6f0 2023-10-03T10:20:13.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:13.319 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.318+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b5800e950 con 0x7f4b6809d6f0 2023-10-03T10:20:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.431+0000 7f168983b700 1 Processor -- start 2023-10-03T10:20:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.431+0000 7f168983b700 1 -- start start 2023-10-03T10:20:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f168983b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 0x7f16841337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f168983b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f168983b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168406b990 con 0x7f1684133e30 2023-10-03T10:20:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f168983b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16840a0590 con 0x7f1684133420 2023-10-03T10:20:13.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f168983b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f168409fb80 con 0x7f1684134260 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f16837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f1682ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 0x7f16841337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f16837fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35086/0 (socket says 172.21.15.19:35086) 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f16837fe700 1 -- 172.21.15.19:0/2907051065 learned_addr learned my addr 172.21.15.19:0/2907051065 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f1681ffb700 1 -- 172.21.15.19:0/2907051065 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929037075 0 0) 0x7f168406b990 con 0x7f1684133e30 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.432+0000 7f1681ffb700 1 -- 172.21.15.19:0/2907051065 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f166c0035b0 con 0x7f1684133e30 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f16837fe700 1 -- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 msgr2=0x7f16841337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f16837fe700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 0x7f16841337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f16837fe700 1 -- 172.21.15.19:0/2907051065 >> v1:172.21.15.19:6789/0 conn(0x7f1684133e30 legacy=0x7f168412ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f16837fe700 1 -- 172.21.15.19:0/2907051065 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840a0030 con 0x7f1684134260 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f1682ffd700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 0x7f16841337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f16837fe700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f167c009e80 tx=0x7f167c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4afb87a463207b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f1681ffb700 1 -- 172.21.15.19:0/2907051065 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00e070 con 0x7f1684134260 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f1681ffb700 1 -- 172.21.15.19:0/2907051065 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c00b910 con 0x7f1684134260 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.433+0000 7f1681ffb700 1 -- 172.21.15.19:0/2907051065 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c00bcc0 con 0x7f1684134260 2023-10-03T10:20:13.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 -- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 msgr2=0x7f16841306a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f167c009e80 tx=0x7f167c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 -- 172.21.15.19:0/2907051065 shutdown_connections 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684134260 0x7f16841306a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 --2- 172.21.15.19:0/2907051065 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684133420 0x7f16841337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 -- 172.21.15.19:0/2907051065 >> 172.21.15.19:0/2907051065 conn(0x7f16840a4210 msgr2=0x7f16840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 -- 172.21.15.19:0/2907051065 shutdown_connections 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.434+0000 7f168983b700 1 -- 172.21.15.19:0/2907051065 wait complete. 2023-10-03T10:20:13.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.436+0000 7f168983b700 1 Processor -- start 2023-10-03T10:20:13.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.436+0000 7f168983b700 1 -- start start 2023-10-03T10:20:13.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 0x7f168409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684134260 0x7f168409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168411f060 con 0x7f1684133420 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168411fbd0 con 0x7f1684134260 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f168983b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f168411f3b0 con 0x7f1684133e30 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f1682ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f1682ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44562/0 (socket says 172.21.15.19:44562) 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f1682ffd700 1 -- 172.21.15.19:0/2208182223 learned_addr learned my addr 172.21.15.19:0/2208182223 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.437+0000 7f16827fc700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 0x7f168409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16837fe700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684134260 0x7f168409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 -- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684134260 msgr2=0x7f168409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684134260 0x7f168409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 -- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 msgr2=0x7f168409c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 -- 172.21.15.19:0/2208182223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c009b30 con 0x7f1684133e30 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f1682ffd700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f16827fc700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 0x7f168409c9c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f167800c420 tx=0x7f167800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780052d0 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1678005430 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.438+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168411fdb0 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.439+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16780038c0 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.439+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1684120090 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.440+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1678003a20 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.440+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1684074ea0 con 0x7f1684133e30 2023-10-03T10:20:13.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.440+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16780409b0 con 0x7f1684133e30 2023-10-03T10:20:13.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.448+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1678044060 con 0x7f1684133e30 2023-10-03T10:20:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.462+0000 7fee7e02b700 1 Processor -- start 2023-10-03T10:20:13.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.462+0000 7fee7e02b700 1 -- start start 2023-10-03T10:20:13.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee7e02b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee7e02b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 0x7fee78131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee7e02b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee78070940 con 0x7fee7809f240 2023-10-03T10:20:13.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee7e02b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee7806fd60 con 0x7fee7809e930 2023-10-03T10:20:13.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee7e02b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7806fa80 con 0x7fee7809f650 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee777fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee76ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fee7809f240 0x7fee781317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44198/0 (socket says 172.21.15.19:44198) 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee76ffd700 1 -- 172.21.15.19:0/1619856899 learned_addr learned my addr 172.21.15.19:0/1619856899 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee777fe700 1 --2- 172.21.15.19:0/1619856899 >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44566/0 (socket says 172.21.15.19:44566) 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.463+0000 7fee77fff700 1 --2- 172.21.15.19:0/1619856899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 0x7fee78131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee77fff700 1 -- 172.21.15.19:0/1619856899 >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 msgr2=0x7fee7809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:13.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee77fff700 1 --2- 172.21.15.19:0/1619856899 >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee77fff700 1 -- 172.21.15.19:0/1619856899 >> v1:172.21.15.19:6789/0 conn(0x7fee7809f240 legacy=0x7fee781317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee77fff700 1 -- 172.21.15.19:0/1619856899 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee7809fb60 con 0x7fee7809f650 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee777fe700 1 --2- 172.21.15.19:0/1619856899 >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee77fff700 1 --2- 172.21.15.19:0/1619856899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 0x7fee78131f00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ffe3239d330a26c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee767fc700 1 -- 172.21.15.19:0/1619856899 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee7000e070 con 0x7fee7809f650 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee767fc700 1 -- 172.21.15.19:0/1619856899 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee7000bb20 con 0x7fee7809f650 2023-10-03T10:20:13.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.464+0000 7fee767fc700 1 -- 172.21.15.19:0/1619856899 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee70012430 con 0x7fee7809f650 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 -- 172.21.15.19:0/1619856899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 msgr2=0x7fee78131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 --2- 172.21.15.19:0/1619856899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 0x7fee78131f00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fee70009d90 tx=0x7fee7000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 -- 172.21.15.19:0/1619856899 shutdown_connections 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 --2- 172.21.15.19:0/1619856899 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809f650 0x7fee78131f00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 --2- 172.21.15.19:0/1619856899 >> v2:172.21.15.19:3300/0 conn(0x7fee7809e930 0x7fee7809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 -- 172.21.15.19:0/1619856899 >> 172.21.15.19:0/1619856899 conn(0x7fee780a4210 msgr2=0x7fee780a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 -- 172.21.15.19:0/1619856899 shutdown_connections 2023-10-03T10:20:13.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.465+0000 7fee7e02b700 1 -- 172.21.15.19:0/1619856899 wait complete. 2023-10-03T10:20:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.467+0000 7fee7e02b700 1 Processor -- start 2023-10-03T10:20:13.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.467+0000 7fee7e02b700 1 -- start start 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 0x7fee781c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 0x7fee781c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee7809f650 0x7fee781c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee781a7420 con 0x7fee7809f650 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee781a6960 con 0x7fee7809e930 2023-10-03T10:20:13.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee7e02b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fee781c3980 con 0x7fee7809f240 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 0x7fee781c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee777fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 0x7fee781c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41476/0 (socket says 172.21.15.19:41476) 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee777fe700 1 -- 172.21.15.19:0/4051592545 learned_addr learned my addr 172.21.15.19:0/4051592545 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee76ffd700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 0x7fee781c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee77fff700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee7809f650 0x7fee781c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee76ffd700 1 -- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 msgr2=0x7fee781c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.468+0000 7fee76ffd700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 0x7fee781c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.469+0000 7fee76ffd700 1 -- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee7809f650 msgr2=0x7fee781c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.469+0000 7fee76ffd700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee7809f650 0x7fee781c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.469+0000 7fee76ffd700 1 -- 172.21.15.19:0/4051592545 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680094a0 con 0x7fee7809f240 2023-10-03T10:20:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.469+0000 7fee76ffd700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 0x7fee781c3440 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0016f0 tx=0x7fee6c001a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.470+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c00c070 con 0x7fee7809f240 2023-10-03T10:20:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.470+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6c012070 con 0x7fee7809f240 2023-10-03T10:20:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.470+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee70009a70 con 0x7fee7809f240 2023-10-03T10:20:13.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.470+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6c005b70 con 0x7fee7809f240 2023-10-03T10:20:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.470+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee780a0190 con 0x7fee7809f240 2023-10-03T10:20:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.471+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fee6c005cd0 con 0x7fee7809f240 2023-10-03T10:20:13.471 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.471+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fee6c04fc40 con 0x7fee7809f240 2023-10-03T10:20:13.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.472+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee780a3630 con 0x7fee7809f240 2023-10-03T10:20:13.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.472+0000 7f7f01348700 1 Processor -- start 2023-10-03T10:20:13.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.472+0000 7f7f01348700 1 -- start start 2023-10-03T10:20:13.472 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7efc09e000 0x7f7efc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc09f520 con 0x7f7efc09e000 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc09f130 con 0x7f7efc09d6f0 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7f01348700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc09e930 con 0x7f7efc09e410 2023-10-03T10:20:13.473 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41480/0 (socket says 172.21.15.19:41480) 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 -- 172.21.15.19:0/2611301112 learned_addr learned my addr 172.21.15.19:0/2611301112 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 -- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 msgr2=0x7f7efc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 --2- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 -- 172.21.15.19:0/2611301112 >> v2:172.21.15.19:3300/0 conn(0x7f7efc09e000 msgr2=0x7f7efc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 --2- 172.21.15.19:0/2611301112 >> v2:172.21.15.19:3300/0 conn(0x7f7efc09e000 0x7f7efc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.474 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.473+0000 7f7efaffd700 1 -- 172.21.15.19:0/2611301112 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc09b2d0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.474+0000 7f7efaffd700 1 --2- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098f0 tx=0x7f7eec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c37e622832c041 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.474+0000 7f7ef9ffb700 1 -- 172.21.15.19:0/2611301112 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00b8a0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.474+0000 7f7ef9ffb700 1 -- 172.21.15.19:0/2611301112 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00ba00 con 0x7f7efc09d6f0 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.474+0000 7f7ef9ffb700 1 -- 172.21.15.19:0/2611301112 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00bd90 con 0x7f7efc09d6f0 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 -- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 msgr2=0x7f7efc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 --2- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0098f0 tx=0x7f7eec009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 -- 172.21.15.19:0/2611301112 shutdown_connections 2023-10-03T10:20:13.475 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 --2- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc09dac0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 --2- 172.21.15.19:0/2611301112 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 --2- 172.21.15.19:0/2611301112 >> v2:172.21.15.19:3300/0 conn(0x7f7efc09e000 0x7f7efc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 -- 172.21.15.19:0/2611301112 >> 172.21.15.19:0/2611301112 conn(0x7f7efc066f50 msgr2=0x7f7efc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 -- 172.21.15.19:0/2611301112 shutdown_connections 2023-10-03T10:20:13.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.475+0000 7f7f01348700 1 -- 172.21.15.19:0/2611301112 wait complete. 2023-10-03T10:20:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.476+0000 7f7f01348700 1 Processor -- start 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.476+0000 7f7f01348700 1 -- start start 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.476+0000 7f7f01348700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.476+0000 7f7f01348700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 0x7f7efc1c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.476+0000 7f7f01348700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc1c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7f01348700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc0724e0 con 0x7f7efc09e000 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7f01348700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc11a0d0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7f01348700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc137b90 con 0x7f7efc09e410 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41494/0 (socket says 172.21.15.19:41494) 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 -- 172.21.15.19:0/3226667283 learned_addr learned my addr 172.21.15.19:0/3226667283 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efa7fc700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 0x7f7efc1c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.478 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efb7fe700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc1c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 -- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 msgr2=0x7f7efc1c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc1c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 -- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 msgr2=0x7f7efc1c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 0x7f7efc1c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 -- 172.21.15.19:0/3226667283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009550 con 0x7f7efc09d6f0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efb7fe700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efa7fc700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 0x7f7efc1c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7efaffd700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00b0e0 tx=0x7f7eec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.477+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0036a0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.478+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec003800 con 0x7f7efc09d6f0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.478+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc1c5c80 con 0x7f7efc09d6f0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.478+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec003b90 con 0x7f7efc09d6f0 2023-10-03T10:20:13.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.478+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc138b20 con 0x7f7efc09d6f0 2023-10-03T10:20:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.478+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7eec003cf0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.479+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7eec040ae0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.479+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc074ea0 con 0x7f7efc09d6f0 2023-10-03T10:20:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.479+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fee6c02f8f0 con 0x7fee7809f240 2023-10-03T10:20:13.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.484+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7eec02b360 con 0x7f7efc09d6f0 2023-10-03T10:20:13.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.564+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b6809b560 con 0x7f4b6809d6f0 2023-10-03T10:20:13.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.564+0000 7f4b4ffff700 1 -- 172.21.15.19:0/831802357 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b5802f030 con 0x7f4b6809d6f0 2023-10-03T10:20:13.565 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 msgr2=0x7f4b6811e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800b340 tx=0x7f4b58004750 comp rx=0 tx=0).stop 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 shutdown_connections 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b68130d70 0x7f4b6811ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b6809d6f0 0x7f4b6811e250 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 --2- 172.21.15.19:0/831802357 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b6809e000 0x7f4b6811e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 >> 172.21.15.19:0/831802357 conn(0x7f4b68066f50 msgr2=0x7f4b680a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 shutdown_connections 2023-10-03T10:20:13.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.567+0000 7f4b6df33700 1 -- 172.21.15.19:0/831802357 wait complete. 2023-10-03T10:20:13.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.664+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f168406b250 con 0x7f1684133e30 2023-10-03T10:20:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.664+0000 7f166bfff700 1 -- 172.21.15.19:0/2208182223 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1678017030 con 0x7f1684133e30 2023-10-03T10:20:13.664 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 msgr2=0x7f168409c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 0x7f168409c9c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f167800c420 tx=0x7f167800c730 comp rx=0 tx=0).stop 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 shutdown_connections 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1684134260 0x7f168409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1684133420 0x7f168409c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 --2- 172.21.15.19:0/2208182223 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1684133e30 0x7f168409c9c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 >> 172.21.15.19:0/2208182223 conn(0x7f16840a4210 msgr2=0x7f16840a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.666+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 shutdown_connections 2023-10-03T10:20:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.667+0000 7f168983b700 1 -- 172.21.15.19:0/2208182223 wait complete. 2023-10-03T10:20:13.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:13.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.692+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fee78074ea0 con 0x7fee7809f240 2023-10-03T10:20:13.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.692+0000 7fee5ffff700 1 -- 172.21.15.19:0/4051592545 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fee6c037090 con 0x7fee7809f240 2023-10-03T10:20:13.692 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 msgr2=0x7fee781c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 0x7fee781c3440 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fee6c0016f0 tx=0x7fee6c001a00 comp rx=0 tx=0).stop 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 shutdown_connections 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fee7809f650 0x7fee781c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fee7809e930 0x7fee781c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 --2- 172.21.15.19:0/4051592545 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fee7809f240 0x7fee781c3440 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 >> 172.21.15.19:0/4051592545 conn(0x7fee780a4210 msgr2=0x7fee781b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 shutdown_connections 2023-10-03T10:20:13.695 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.695+0000 7fee7e02b700 1 -- 172.21.15.19:0/4051592545 wait complete. 2023-10-03T10:20:13.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:13.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.714+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7efc138330 con 0x7f7efc09d6f0 2023-10-03T10:20:13.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.715+0000 7f7ee37fe700 1 -- 172.21.15.19:0/3226667283 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7eec028020 con 0x7f7efc09d6f0 2023-10-03T10:20:13.714 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 msgr2=0x7f7efc1c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00b0e0 tx=0x7f7eec004750 comp rx=0 tx=0).stop 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 shutdown_connections 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7efc09e410 0x7f7efc1c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7efc09d6f0 0x7f7efc1c5200 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 --2- 172.21.15.19:0/3226667283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7efc09e000 0x7f7efc1c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:13.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 >> 172.21.15.19:0/3226667283 conn(0x7f7efc066f50 msgr2=0x7f7efc06a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 shutdown_connections 2023-10-03T10:20:13.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:13.717+0000 7f7f01348700 1 -- 172.21.15.19:0/3226667283 wait complete. 2023-10-03T10:20:13.730 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:14.582 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:14.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:14.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.730+0000 7f7aca03a700 1 Processor -- start 2023-10-03T10:20:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.730+0000 7f7aca03a700 1 -- start start 2023-10-03T10:20:14.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.730+0000 7f7aca03a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 0x7f7ac4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7aca03a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 0x7f7ac413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7aca03a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac409b120 con 0x7f7ac409d6f0 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7aca03a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac406b460 con 0x7f7ac409e1d0 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7aca03a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac409a7e0 con 0x7f7ac4139170 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7ac409d6f0 0x7f7ac409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44202/0 (socket says 172.21.15.19:44202) 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac37fe700 1 -- 172.21.15.19:0/3105374497 learned_addr learned my addr 172.21.15.19:0/3105374497 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 0x7f7ac413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac2ffd700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 0x7f7ac4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 -- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 msgr2=0x7f7ac4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 0x7f7ac4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 -- 172.21.15.19:0/3105374497 >> v1:172.21.15.19:6789/0 conn(0x7f7ac409d6f0 legacy=0x7f7ac409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac27fc700 1 -- 172.21.15.19:0/3105374497 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358472439 0 0) 0x7f7ac409b120 con 0x7f7ac409d6f0 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 -- 172.21.15.19:0/3105374497 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac409a500 con 0x7f7ac4139170 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac2ffd700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 0x7f7ac4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.731+0000 7f7ac3fff700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 0x7f7ac413b550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009df0 tx=0x7f7abc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19cf1b48734dd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.732+0000 7f7ac27fc700 1 -- 172.21.15.19:0/3105374497 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00e070 con 0x7f7ac4139170 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.732+0000 7f7ac27fc700 1 -- 172.21.15.19:0/3105374497 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc00bae0 con 0x7f7ac4139170 2023-10-03T10:20:14.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.732+0000 7f7ac27fc700 1 -- 172.21.15.19:0/3105374497 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00be90 con 0x7f7ac4139170 2023-10-03T10:20:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 -- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 msgr2=0x7f7ac413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 0x7f7ac413b550 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f7abc009df0 tx=0x7f7abc00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 -- 172.21.15.19:0/3105374497 shutdown_connections 2023-10-03T10:20:14.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac4139170 0x7f7ac413b550 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 --2- 172.21.15.19:0/3105374497 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac409e1d0 0x7f7ac4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 -- 172.21.15.19:0/3105374497 >> 172.21.15.19:0/3105374497 conn(0x7f7ac4066f50 msgr2=0x7f7ac409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 -- 172.21.15.19:0/3105374497 shutdown_connections 2023-10-03T10:20:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.733+0000 7f7aca03a700 1 -- 172.21.15.19:0/3105374497 wait complete. 2023-10-03T10:20:14.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.734+0000 7f7aca03a700 1 Processor -- start 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 -- start start 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac409e1d0 0x7f7ac4120c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac4139170 0x7f7ac4121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac41242c0 con 0x7f7ac409d6f0 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac409c710 con 0x7f7ac4139170 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7aca03a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac4136030 con 0x7f7ac409e1d0 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7ac37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7ac37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44606/0 (socket says 172.21.15.19:44606) 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7ac37fe700 1 -- 172.21.15.19:0/589828675 learned_addr learned my addr 172.21.15.19:0/589828675 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7ac2ffd700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac409e1d0 0x7f7ac4120c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.735+0000 7f7ac3fff700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac4139170 0x7f7ac4121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 -- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac409e1d0 msgr2=0x7f7ac4120c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac409e1d0 0x7f7ac4120c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 -- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac4139170 msgr2=0x7f7ac4121180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac4139170 0x7f7ac4121180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 -- 172.21.15.19:0/589828675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab80094a0 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7ac37fe700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001c70 tx=0x7f7ab4014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4017070 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4001d60 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4014d20 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc009a70 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.736+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41239b0 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.737+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ab4012110 con 0x7f7ac409d6f0 2023-10-03T10:20:14.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.737+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ab4046fa0 con 0x7f7ac409d6f0 2023-10-03T10:20:14.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.738+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac4123ba0 con 0x7f7ac409d6f0 2023-10-03T10:20:14.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.747+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ab4022070 con 0x7f7ac409d6f0 2023-10-03T10:20:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.872+0000 7feec2bb2700 1 Processor -- start 2023-10-03T10:20:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.872+0000 7feec2bb2700 1 -- start start 2023-10-03T10:20:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.872+0000 7f2f4a327700 1 Processor -- start 2023-10-03T10:20:14.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.872+0000 7f2f4a327700 1 -- start start 2023-10-03T10:20:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7feebc1338c0 0x7feebc133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 0x7feebc09de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc070c80 con 0x7feebc1338c0 2023-10-03T10:20:14.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc09ed20 con 0x7feebc1341d0 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec2bb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feebc06f720 con 0x7feebc09e390 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec114f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec114f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35158/0 (socket says 172.21.15.19:35158) 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feec114f700 1 -- 172.21.15.19:0/1216657739 learned_addr learned my addr 172.21.15.19:0/1216657739 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7feebbfff700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 0x7feebc09de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7f2f4a327700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409d6f0 0x7f2f4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7f2f4a327700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7f2f4a327700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4409b120 con 0x7f2f4409e000 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7f2f4a327700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4406b460 con 0x7f2f4409e410 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.873+0000 7f2f4a327700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4409a7e0 con 0x7f2f4409d6f0 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41538/0 (socket says 172.21.15.19:41538) 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 -- 172.21.15.19:0/2278130875 learned_addr learned my addr 172.21.15.19:0/2278130875 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 -- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 msgr2=0x7feebc09de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 0x7feebc09de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 -- 172.21.15.19:0/1216657739 >> v2:172.21.15.19:3300/0 conn(0x7feebc1338c0 msgr2=0x7feebc133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 --2- 172.21.15.19:0/1216657739 >> v2:172.21.15.19:3300/0 conn(0x7feebc1338c0 0x7feebc133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 -- 172.21.15.19:0/1216657739 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc06fce0 con 0x7feebc09e390 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feebbfff700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 0x7feebc09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f43fff700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409d6f0 0x7f2f4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 -- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409d6f0 msgr2=0x7f2f4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409d6f0 0x7f2f4409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 -- 172.21.15.19:0/2278130875 >> v1:172.21.15.19:6789/0 conn(0x7f2f4409e000 legacy=0x7f2f441339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 -- 172.21.15.19:0/2278130875 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4409a500 con 0x7f2f4409e410 2023-10-03T10:20:14.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7feec114f700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009e80 tx=0x7feeb400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b55f357425f3005 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.874+0000 7f2f488c4700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e80 tx=0x7f2f3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b23252ed4323743 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.875+0000 7feebb7fe700 1 -- 172.21.15.19:0/1216657739 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400e070 con 0x7feebc09e390 2023-10-03T10:20:14.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.875+0000 7feebb7fe700 1 -- 172.21.15.19:0/1216657739 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb400b8d0 con 0x7feebc09e390 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.875+0000 7feebb7fe700 1 -- 172.21.15.19:0/1216657739 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb400bc80 con 0x7feebc09e390 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.875+0000 7feec2bb2700 1 -- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 msgr2=0x7feebc09e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.875+0000 7feec2bb2700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009e80 tx=0x7feeb400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 -- 172.21.15.19:0/1216657739 shutdown_connections 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc09e390 0x7feebc09e7e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 --2- 172.21.15.19:0/1216657739 >> v2:172.21.15.19:3300/0 conn(0x7feebc1338c0 0x7feebc133c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 --2- 172.21.15.19:0/1216657739 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc1341d0 0x7feebc09de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 -- 172.21.15.19:0/1216657739 >> 172.21.15.19:0/1216657739 conn(0x7feebc0a2aa0 msgr2=0x7feebc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:14.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7f2f42ffd700 1 -- 172.21.15.19:0/2278130875 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00e070 con 0x7f2f4409e410 2023-10-03T10:20:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 -- 172.21.15.19:0/1216657739 shutdown_connections 2023-10-03T10:20:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7f2f42ffd700 1 -- 172.21.15.19:0/2278130875 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c003a20 con 0x7f2f4409e410 2023-10-03T10:20:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7f2f42ffd700 1 -- 172.21.15.19:0/2278130875 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c003dd0 con 0x7f2f4409e410 2023-10-03T10:20:14.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.876+0000 7feec2bb2700 1 -- 172.21.15.19:0/1216657739 wait complete. 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 -- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 msgr2=0x7f2f44134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e80 tx=0x7f2f3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 -- 172.21.15.19:0/2278130875 shutdown_connections 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409e410 0x7f2f44134100 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 --2- 172.21.15.19:0/2278130875 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409d6f0 0x7f2f4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 -- 172.21.15.19:0/2278130875 >> 172.21.15.19:0/2278130875 conn(0x7f2f44066f50 msgr2=0x7f2f4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 -- 172.21.15.19:0/2278130875 shutdown_connections 2023-10-03T10:20:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7f2f4a327700 1 -- 172.21.15.19:0/2278130875 wait complete. 2023-10-03T10:20:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7feec2bb2700 1 Processor -- start 2023-10-03T10:20:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.877+0000 7feec2bb2700 1 -- start start 2023-10-03T10:20:14.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7f2f4a327700 1 Processor -- start 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc09e390 0x7feebc1362e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feebc1338c0 0x7feebc136820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc137e60 con 0x7feebc1338c0 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc1390b0 con 0x7feebc09e390 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec2bb2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feebc06f960 con 0x7feebc1341d0 2023-10-03T10:20:14.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7f2f4a327700 1 -- start start 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec114f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec114f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35180/0 (socket says 172.21.15.19:35180) 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec114f700 1 -- 172.21.15.19:0/2266253369 learned_addr learned my addr 172.21.15.19:0/2266253369 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.878+0000 7feec094e700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc09e390 0x7feebc1362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 -- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc09e390 msgr2=0x7feebc1362e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc09e390 0x7feebc1362e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 -- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feebc1338c0 msgr2=0x7feebc136820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:14.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feebc1338c0 0x7feebc136820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 -- 172.21.15.19:0/2266253369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80094a0 con 0x7feebc1341d0 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409e000 0x7f2f44122a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 0x7f2f44122f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44124f20 con 0x7f2f4409e410 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4409c710 con 0x7f2f4409d6f0 2023-10-03T10:20:14.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f4a327700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44125fa0 con 0x7f2f4409e000 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f43fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f43fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41554/0 (socket says 172.21.15.19:41554) 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f43fff700 1 -- 172.21.15.19:0/1160745793 learned_addr learned my addr 172.21.15.19:0/1160745793 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7f2f437fe700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409e000 0x7f2f44122a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.879+0000 7feec114f700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feeb400b680 tx=0x7feeb4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f488c4700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 0x7f2f44122f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 -- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409e000 msgr2=0x7f2f44122a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409e000 0x7f2f44122a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 -- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 msgr2=0x7f2f44122f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 0x7f2f44122f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 -- 172.21.15.19:0/1160745793 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009b30 con 0x7f2f4409d6f0 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f488c4700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 0x7f2f44122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:14.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004450 con 0x7feebc1341d0 2023-10-03T10:20:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f43fff700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e810 tx=0x7f2f3400eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40045b0 con 0x7feebc1341d0 2023-10-03T10:20:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004940 con 0x7feebc1341d0 2023-10-03T10:20:14.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34013610 con 0x7f2f4409d6f0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb4009b30 con 0x7feebc1341d0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34013770 con 0x7f2f4409d6f0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.880+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34013b00 con 0x7f2f4409d6f0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.881+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f44133850 con 0x7f2f4409d6f0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.881+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f440a1d60 con 0x7f2f4409d6f0 2023-10-03T10:20:14.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.881+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc1386c0 con 0x7feebc1341d0 2023-10-03T10:20:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f44125b20 con 0x7f2f4409d6f0 2023-10-03T10:20:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7feeb401b430 con 0x7feebc1341d0 2023-10-03T10:20:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc139560 con 0x7feebc1341d0 2023-10-03T10:20:14.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7feeb4040b70 con 0x7feebc1341d0 2023-10-03T10:20:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f34013c60 con 0x7f2f4409d6f0 2023-10-03T10:20:14.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.882+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f3403f500 con 0x7f2f4409d6f0 2023-10-03T10:20:14.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.883+0000 7f1d5cc6f700 1 Processor -- start 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.883+0000 7f1d5cc6f700 1 -- start start 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d5809d6f0 0x7f1d5809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e000 0x7f1d581339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809e410 0x7f1d58133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5806b460 con 0x7f1d5809d6f0 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5809b120 con 0x7f1d5809e000 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5cc6f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5809a7e0 con 0x7f1d5809e410 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d5809d6f0 0x7f1d5809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f1d5809d6f0 0x7f1d5809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44624/0 (socket says 172.21.15.19:44624) 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.884+0000 7f1d5659c700 1 -- 172.21.15.19:0/162969050 learned_addr learned my addr 172.21.15.19:0/162969050 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 -- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809e410 msgr2=0x7f1d58133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809e410 0x7f1d58133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 -- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e000 msgr2=0x7f1d581339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e000 0x7f1d581339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 -- 172.21.15.19:0/162969050 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5809a500 con 0x7f1d5809d6f0 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5659c700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809d6f0 0x7f1d5809dac0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f1d480098f0 tx=0x7f1d48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ae97d15e2982e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5559a700 1 -- 172.21.15.19:0/162969050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800b8a0 con 0x7f1d5809d6f0 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5559a700 1 -- 172.21.15.19:0/162969050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800ba00 con 0x7f1d5809d6f0 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.885+0000 7f1d5559a700 1 -- 172.21.15.19:0/162969050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800bd90 con 0x7f1d5809d6f0 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809d6f0 msgr2=0x7f1d5809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809d6f0 0x7f1d5809dac0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f1d480098f0 tx=0x7f1d48009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/162969050 shutdown_connections 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809e410 0x7f1d58133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809d6f0 0x7f1d5809dac0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/162969050 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e000 0x7f1d581339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/162969050 >> 172.21.15.19:0/162969050 conn(0x7f1d58066f50 msgr2=0x7f1d5809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/162969050 shutdown_connections 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.886+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/162969050 wait complete. 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.887+0000 7f1d5cc6f700 1 Processor -- start 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.887+0000 7f1d5cc6f700 1 -- start start 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 0x7f1d581a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e410 0x7f1d581a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580a2120 con 0x7f1d5809e000 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d581a92a0 con 0x7f1d5809e410 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5cc6f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d581a7a40 con 0x7f1d5809d6f0 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 0x7f1d581a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 0x7f1d581a5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35200/0 (socket says 172.21.15.19:35200) 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44630/0 (socket says 172.21.15.19:44630) 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d5659c700 1 -- 172.21.15.19:0/1669589424 learned_addr learned my addr 172.21.15.19:0/1669589424 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 -- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 msgr2=0x7f1d581a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 0x7f1d581a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 -- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e410 msgr2=0x7f1d581a67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e410 0x7f1d581a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.888+0000 7f1d55d9b700 1 -- 172.21.15.19:0/1669589424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d48009550 con 0x7f1d5809e000 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d55d9b700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00b450 tx=0x7f1d4c00b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c011830 con 0x7f1d5809e000 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c011990 con 0x7f1d5809e000 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5809c710 con 0x7f1d5809e000 2023-10-03T10:20:14.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c011d40 con 0x7f1d5809e000 2023-10-03T10:20:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.889+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d581a9840 con 0x7f1d5809e000 2023-10-03T10:20:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.890+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f44125b20 con 0x7f2f4409d6f0 2023-10-03T10:20:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.890+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1d4c01a400 con 0x7f1d5809e000 2023-10-03T10:20:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.890+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1d4c03f5e0 con 0x7f1d5809e000 2023-10-03T10:20:14.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.891+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d581a93e0 con 0x7f1d5809e000 2023-10-03T10:20:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.892+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7feebc139560 con 0x7feebc1341d0 2023-10-03T10:20:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:14.896+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1d4c015080 con 0x7f1d5809e000 2023-10-03T10:20:15.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.015+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7ac4074ea0 con 0x7f7ac409d6f0 2023-10-03T10:20:15.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.016+0000 7f7aabfff700 1 -- 172.21.15.19:0/589828675 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ab4004870 con 0x7f7ac409d6f0 2023-10-03T10:20:15.016 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:15.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 msgr2=0x7f7ac4120700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4001c70 tx=0x7f7ab4014330 comp rx=0 tx=0).stop 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 shutdown_connections 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7ac4139170 0x7f7ac4121180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ac409d6f0 0x7f7ac4120700 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 --2- 172.21.15.19:0/589828675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7ac409e1d0 0x7f7ac4120c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.018+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 >> 172.21.15.19:0/589828675 conn(0x7f7ac4066f50 msgr2=0x7f7ac4136a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.019+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 shutdown_connections 2023-10-03T10:20:15.019 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.019+0000 7f7aca03a700 1 -- 172.21.15.19:0/589828675 wait complete. 2023-10-03T10:20:15.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.103+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f1d58074ea0 con 0x7f1d5809e000 2023-10-03T10:20:15.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.104+0000 7f1d46ffd700 1 -- 172.21.15.19:0/1669589424 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1d4c00f8d0 con 0x7f1d5809e000 2023-10-03T10:20:15.104 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 msgr2=0x7f1d581a6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c00b450 tx=0x7f1d4c00b760 comp rx=0 tx=0).stop 2023-10-03T10:20:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 shutdown_connections 2023-10-03T10:20:15.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1d5809e410 0x7f1d581a67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1d5809d6f0 0x7f1d581a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 --2- 172.21.15.19:0/1669589424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d5809e000 0x7f1d581a6260 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 >> 172.21.15.19:0/1669589424 conn(0x7f1d58066f50 msgr2=0x7f1d581bacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 shutdown_connections 2023-10-03T10:20:15.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.106+0000 7f1d5cc6f700 1 -- 172.21.15.19:0/1669589424 wait complete. 2023-10-03T10:20:15.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:15.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.161+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2f44125b20 con 0x7f2f4409d6f0 2023-10-03T10:20:15.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.161+0000 7f2f40ff9700 1 -- 172.21.15.19:0/1160745793 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f44125b20 con 0x7f2f4409d6f0 2023-10-03T10:20:15.161 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.163+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 msgr2=0x7f2f441224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400e810 tx=0x7f2f3400eb20 comp rx=0 tx=0).stop 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 shutdown_connections 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f4409e410 0x7f2f44122f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f4409d6f0 0x7f2f441224d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 --2- 172.21.15.19:0/1160745793 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f4409e000 0x7f2f44122a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 >> 172.21.15.19:0/1160745793 conn(0x7f2f44066f50 msgr2=0x7f2f44070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 shutdown_connections 2023-10-03T10:20:15.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.164+0000 7f2f4a327700 1 -- 172.21.15.19:0/1160745793 wait complete. 2023-10-03T10:20:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.166+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feebc139560 con 0x7feebc1341d0 2023-10-03T10:20:15.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.167+0000 7feeb97fa700 1 -- 172.21.15.19:0/2266253369 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feebc139560 con 0x7feebc1341d0 2023-10-03T10:20:15.166 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 msgr2=0x7feebc136d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7feeb400b680 tx=0x7feeb4004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 shutdown_connections 2023-10-03T10:20:15.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7feebc1341d0 0x7feebc136d60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7feebc09e390 0x7feebc1362e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 --2- 172.21.15.19:0/2266253369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feebc1338c0 0x7feebc136820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 >> 172.21.15.19:0/2266253369 conn(0x7feebc0a2aa0 msgr2=0x7feebc09f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 shutdown_connections 2023-10-03T10:20:15.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:15.169+0000 7feec2bb2700 1 -- 172.21.15.19:0/2266253369 wait complete. 2023-10-03T10:20:15.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:15.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:16.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:16.121 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:16.179 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.181+0000 7f6ad4151700 1 Processor -- start 2023-10-03T10:20:16.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.181+0000 7f6ad4151700 1 -- start start 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad4151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc09e1d0 0x7f6acc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad4151700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6acc135e50 0x7f6acc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad4151700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc09f130 con 0x7f6acc09d6f0 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad4151700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc09f520 con 0x7f6acc135e50 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad4151700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc09e930 con 0x7f6acc09e1d0 2023-10-03T10:20:16.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad1eed700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6acc09d6f0 0x7f6acc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44222/0 (socket says 172.21.15.19:44222) 2023-10-03T10:20:16.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad1eed700 1 -- 172.21.15.19:0/3741734040 learned_addr learned my addr 172.21.15.19:0/3741734040 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:16.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad16ec700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc09e1d0 0x7f6acc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.182+0000 7f6ad26ee700 1 --2- 172.21.15.19:0/3741734040 >> v2:172.21.15.19:3300/0 conn(0x7f6acc135e50 0x7f6acc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad0eeb700 1 -- 172.21.15.19:0/3741734040 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473673784 0 0) 0x7f6acc09f130 con 0x7f6acc09d6f0 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad0eeb700 1 -- 172.21.15.19:0/3741734040 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab80035b0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad26ee700 1 -- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc09e1d0 msgr2=0x7f6acc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad26ee700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc09e1d0 0x7f6acc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad26ee700 1 -- 172.21.15.19:0/3741734040 >> v1:172.21.15.19:6789/0 conn(0x7f6acc09d6f0 legacy=0x7f6acc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad26ee700 1 -- 172.21.15.19:0/3741734040 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc09b2d0 con 0x7f6acc135e50 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad26ee700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc135e50 0x7f6acc138230 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009dc0 tx=0x7f6ac400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28873906e945bde5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad0eeb700 1 -- 172.21.15.19:0/3741734040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400e070 con 0x7f6acc135e50 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad0eeb700 1 -- 172.21.15.19:0/3741734040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400bae0 con 0x7f6acc135e50 2023-10-03T10:20:16.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.183+0000 7f6ad0eeb700 1 -- 172.21.15.19:0/3741734040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400be90 con 0x7f6acc135e50 2023-10-03T10:20:16.185 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 -- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc135e50 msgr2=0x7f6acc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc135e50 0x7f6acc138230 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4009dc0 tx=0x7f6ac400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 -- 172.21.15.19:0/3741734040 shutdown_connections 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc135e50 0x7f6acc138230 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3741734040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc09e1d0 0x7f6acc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.184+0000 7f6ad4151700 1 -- 172.21.15.19:0/3741734040 >> 172.21.15.19:0/3741734040 conn(0x7f6acc066f50 msgr2=0x7f6acc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.185+0000 7f6ad4151700 1 -- 172.21.15.19:0/3741734040 shutdown_connections 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.185+0000 7f6ad4151700 1 -- 172.21.15.19:0/3741734040 wait complete. 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 Processor -- start 2023-10-03T10:20:16.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 -- start start 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6acc09e1d0 0x7f6acc11d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc135e50 0x7f6acc11de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc06b3c0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc11e580 con 0x7f6acc135e50 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.186+0000 7f6ad4151700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc09c770 con 0x7f6acc09e1d0 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44644/0 (socket says 172.21.15.19:44644) 2023-10-03T10:20:16.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 -- 172.21.15.19:0/3281877959 learned_addr learned my addr 172.21.15.19:0/3281877959 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad26ee700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc135e50 0x7f6acc11de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad16ec700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6acc09e1d0 0x7f6acc11d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 -- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6acc09e1d0 msgr2=0x7f6acc11d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6acc09e1d0 0x7f6acc11d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 -- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc135e50 msgr2=0x7f6acc11de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc135e50 0x7f6acc11de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 -- 172.21.15.19:0/3281877959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009a70 con 0x7f6acc09d6f0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.187+0000 7f6ad1eed700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c730 tx=0x7f6ac800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.188+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8005d70 con 0x7f6acc09d6f0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.188+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80070d0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.188+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8007440 con 0x7f6acc09d6f0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.188+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc130ce0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.188+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc06ebf0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.189+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ac80075a0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.189+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ac803ecb0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.189+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc06b800 con 0x7f6acc09d6f0 2023-10-03T10:20:16.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.195+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ac8017020 con 0x7f6acc09d6f0 2023-10-03T10:20:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.269+0000 7ffbcbf3c700 1 Processor -- start 2023-10-03T10:20:16.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.269+0000 7ffbcbf3c700 1 -- start start 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 0x7ffbc4133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbc409de50 0x7ffbc409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc409e760 0x7ffbc413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc406fef0 con 0x7ffbc409de50 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc406ef30 con 0x7ffbc409e760 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbcbf3c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc41334b0 con 0x7ffbc41338a0 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbc94d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbc409de50 0x7ffbc409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbc9cd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 0x7ffbc4133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbc94d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffbc409de50 0x7ffbc409e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44658/0 (socket says 172.21.15.19:44658) 2023-10-03T10:20:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbc94d7700 1 -- 172.21.15.19:0/268828949 learned_addr learned my addr 172.21.15.19:0/268828949 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbc9cd8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 0x7ffbc4133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35218/0 (socket says 172.21.15.19:35218) 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.270+0000 7ffbca4d9700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc409e760 0x7ffbc413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 -- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 msgr2=0x7ffbc4133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 0x7ffbc4133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 -- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc409e760 msgr2=0x7ffbc413a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc409e760 0x7ffbc413a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 -- 172.21.15.19:0/268828949 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc406fc30 con 0x7ffbc409de50 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc94d7700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc409e220 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098f0 tx=0x7ffbb4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2c1e9102666f15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc8cd6700 1 -- 172.21.15.19:0/268828949 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4011830 con 0x7ffbc409de50 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc8cd6700 1 -- 172.21.15.19:0/268828949 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb4011990 con 0x7ffbc409de50 2023-10-03T10:20:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.271+0000 7ffbc8cd6700 1 -- 172.21.15.19:0/268828949 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4011d20 con 0x7ffbc409de50 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 msgr2=0x7ffbc409e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc409e220 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098f0 tx=0x7ffbb4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/268828949 shutdown_connections 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc409e760 0x7ffbc413a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc41338a0 0x7ffbc4133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/268828949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc409e220 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/268828949 >> 172.21.15.19:0/268828949 conn(0x7ffbc40a2aa0 msgr2=0x7ffbc40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/268828949 shutdown_connections 2023-10-03T10:20:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.272+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/268828949 wait complete. 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.273+0000 7ffbcbf3c700 1 Processor -- start 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.273+0000 7ffbcbf3c700 1 -- start start 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc409e760 0x7ffbc411dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 0x7ffbc411e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4120fe0 con 0x7ffbc409de50 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc411f330 con 0x7ffbc41338a0 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbcbf3c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc411f930 con 0x7ffbc409e760 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44674/0 (socket says 172.21.15.19:44674) 2023-10-03T10:20:16.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 -- 172.21.15.19:0/195131593 learned_addr learned my addr 172.21.15.19:0/195131593 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbca4d9700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 0x7ffbc411e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc94d7700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc409e760 0x7ffbc411dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 -- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc409e760 msgr2=0x7ffbc411dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc409e760 0x7ffbc411dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 -- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 msgr2=0x7ffbc411e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 0x7ffbc411e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 -- 172.21.15.19:0/195131593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009550 con 0x7ffbc409de50 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbca4d9700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 0x7ffbc411e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.274+0000 7ffbc9cd8700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000e9e0 tx=0x7ffbc000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.275+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0009710 con 0x7ffbc409de50 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.275+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc000c850 con 0x7ffbc409de50 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.275+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc000cbc0 con 0x7ffbc409de50 2023-10-03T10:20:16.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.275+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4120560 con 0x7ffbc409de50 2023-10-03T10:20:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.275+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc406f640 con 0x7ffbc409de50 2023-10-03T10:20:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.276+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc411a470 con 0x7ffbc409de50 2023-10-03T10:20:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.276+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffbc000cd20 con 0x7ffbc409de50 2023-10-03T10:20:16.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.277+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffbc0012dc0 con 0x7ffbc409de50 2023-10-03T10:20:16.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.281+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffbc00102b0 con 0x7ffbc409de50 2023-10-03T10:20:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.326+0000 7fa9b9fbb700 1 Processor -- start 2023-10-03T10:20:16.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 -- start start 2023-10-03T10:20:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9b409d6f0 0x7fa9b409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b409f130 con 0x7fa9b409e410 2023-10-03T10:20:16.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b409f520 con 0x7fa9b409d6f0 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b9fbb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b409e930 con 0x7fa9b409e000 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41622/0 (socket says 172.21.15.19:41622) 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b2ffd700 1 -- 172.21.15.19:0/3374983970 learned_addr learned my addr 172.21.15.19:0/3374983970 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b3fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9b409e410 0x7fa9b4130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:44238/0 (socket says 172.21.15.19:44238) 2023-10-03T10:20:16.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.327+0000 7fa9b37fe700 1 --2- 172.21.15.19:0/3374983970 >> v2:172.21.15.19:3300/0 conn(0x7fa9b409d6f0 0x7fa9b409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b2ffd700 1 -- 172.21.15.19:0/3374983970 >> v2:172.21.15.19:3300/0 conn(0x7fa9b409d6f0 msgr2=0x7fa9b409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b2ffd700 1 --2- 172.21.15.19:0/3374983970 >> v2:172.21.15.19:3300/0 conn(0x7fa9b409d6f0 0x7fa9b409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b2ffd700 1 -- 172.21.15.19:0/3374983970 >> v1:172.21.15.19:6789/0 conn(0x7fa9b409e410 legacy=0x7fa9b4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b2ffd700 1 -- 172.21.15.19:0/3374983970 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b409b2d0 con 0x7fa9b409e000 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b2ffd700 1 --2- 172.21.15.19:0/3374983970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800bb90 tx=0x7fa9a800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a705b8883519b51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b27fc700 1 -- 172.21.15.19:0/3374983970 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800dd30 con 0x7fa9b409e000 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b27fc700 1 -- 172.21.15.19:0/3374983970 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a800de90 con 0x7fa9b409e000 2023-10-03T10:20:16.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.328+0000 7fa9b27fc700 1 -- 172.21.15.19:0/3374983970 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8010690 con 0x7fa9b409e000 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3374983970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 msgr2=0x7fa9b4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3374983970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800bb90 tx=0x7fa9a800bea0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3374983970 shutdown_connections 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3374983970 >> v2:172.21.15.19:3300/0 conn(0x7fa9b409d6f0 0x7fa9b409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3374983970 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409e000 0x7fa9b4130660 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3374983970 >> 172.21.15.19:0/3374983970 conn(0x7fa9b4066f50 msgr2=0x7fa9b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3374983970 shutdown_connections 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.329+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3374983970 wait complete. 2023-10-03T10:20:16.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.330+0000 7fa9b9fbb700 1 Processor -- start 2023-10-03T10:20:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.331+0000 7fa9b9fbb700 1 -- start start 2023-10-03T10:20:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.331+0000 7f2d62c96700 1 Processor -- start 2023-10-03T10:20:16.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.331+0000 7f2d62c96700 1 -- start start 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 0x7fa9b411e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 0x7fa9b411eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4121930 con 0x7fa9b409e000 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b409c700 con 0x7fa9b409d6f0 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b9fbb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4130390 con 0x7fa9b409e410 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b2ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44690/0 (socket says 172.21.15.19:44690) 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b2ffd700 1 -- 172.21.15.19:0/3218796963 learned_addr learned my addr 172.21.15.19:0/3218796963 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 0x7fa9b411eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d5c09e410 0x7f2d5c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c09f520 con 0x7f2d5c09e410 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c09f130 con 0x7f2d5c09e000 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d62c96700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c09e930 con 0x7f2d5c09d6f0 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:41644/0 (socket says 172.21.15.19:41644) 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d5bfff700 1 -- 172.21.15.19:0/1643395105 learned_addr learned my addr 172.21.15.19:0/1643395105 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7f2d61233700 1 --2- 172.21.15.19:0/1643395105 >> v2:172.21.15.19:3300/0 conn(0x7f2d5c09e410 0x7f2d5c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 -- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 msgr2=0x7fa9b411e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b37fe700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 0x7fa9b411e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 0x7fa9b411e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 -- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 msgr2=0x7fa9b411e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b3fff700 1 -- 172.21.15.19:0/3218796963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a800b7f0 con 0x7fa9b409e410 2023-10-03T10:20:16.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b37fe700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 0x7fa9b411e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.332+0000 7fa9b2ffd700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d60a32700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa9b3fff700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 0x7fa9b411eb10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00cb40 tx=0x7fa9ac00ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 -- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 msgr2=0x7f2d5c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 -- 172.21.15.19:0/1643395105 >> v2:172.21.15.19:3300/0 conn(0x7f2d5c09e410 msgr2=0x7f2d5c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 --2- 172.21.15.19:0/1643395105 >> v2:172.21.15.19:3300/0 conn(0x7f2d5c09e410 0x7f2d5c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 -- 172.21.15.19:0/1643395105 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c09b2d0 con 0x7f2d5c09e000 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5bfff700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009920 tx=0x7f2d48009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d692832cff91e28 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00aa60 con 0x7fa9b409e410 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac00abc0 con 0x7fa9b409e410 2023-10-03T10:20:16.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac007070 con 0x7fa9b409e410 2023-10-03T10:20:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5b7fe700 1 -- 172.21.15.19:0/1643395105 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011830 con 0x7f2d5c09e000 2023-10-03T10:20:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7f2d5b7fe700 1 -- 172.21.15.19:0/1643395105 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d48011990 con 0x7f2d5c09e000 2023-10-03T10:20:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.334+0000 7f2d5b7fe700 1 -- 172.21.15.19:0/1643395105 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48011d20 con 0x7f2d5c09e000 2023-10-03T10:20:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b4121b30 con 0x7fa9b409e410 2023-10-03T10:20:16.337 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.333+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b41222c0 con 0x7fa9b409e410 2023-10-03T10:20:16.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.334+0000 7f2d62c96700 1 -- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 msgr2=0x7f2d5c130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009920 tx=0x7f2d48009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:16.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9ac0071d0 con 0x7fa9b409e410 2023-10-03T10:20:16.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 -- 172.21.15.19:0/1643395105 shutdown_connections 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 --2- 172.21.15.19:0/1643395105 >> v2:172.21.15.19:3300/0 conn(0x7f2d5c09e410 0x7f2d5c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 --2- 172.21.15.19:0/1643395105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e000 0x7f2d5c130660 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 -- 172.21.15.19:0/1643395105 >> 172.21.15.19:0/1643395105 conn(0x7f2d5c066f50 msgr2=0x7f2d5c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 -- 172.21.15.19:0/1643395105 shutdown_connections 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7f2d62c96700 1 -- 172.21.15.19:0/1643395105 wait complete. 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9ac03f380 con 0x7fa9b409e410 2023-10-03T10:20:16.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.335+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b4074ea0 con 0x7fa9b409e410 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.336+0000 7f2d62c96700 1 Processor -- start 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.336+0000 7f2d62c96700 1 -- start start 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c1305f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 0x7f2d5c1362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c139df0 con 0x7f2d5c09e000 2023-10-03T10:20:16.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c139850 con 0x7f2d5c09e410 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.337+0000 7f2d62c96700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c137ee0 con 0x7f2d5c09d6f0 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d5bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55264/0 (socket says 172.21.15.19:55264) 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d5bfff700 1 -- 172.21.15.19:0/2783256539 learned_addr learned my addr 172.21.15.19:0/2783256539 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 0x7f2d5c1362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d60a32700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c1305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 -- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 msgr2=0x7f2d5c1305f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c1305f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 -- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 msgr2=0x7f2d5c130b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 -- 172.21.15.19:0/2783256539 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009550 con 0x7f2d5c09e410 2023-10-03T10:20:16.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d5bfff700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d61233700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 0x7f2d5c1362d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400efc0 tx=0x7f2d5400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5400cd40 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5400f040 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5c13d7e0 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.338+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d540146c0 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.339+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c13a580 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.339+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c131070 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.340+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d54014820 con 0x7f2d5c09e410 2023-10-03T10:20:16.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.340+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d540403f0 con 0x7f2d5c09e410 2023-10-03T10:20:16.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.345+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9ac017020 con 0x7fa9b409e410 2023-10-03T10:20:16.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.349+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d54007920 con 0x7f2d5c09e410 2023-10-03T10:20:16.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.419+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6acc11e7b0 con 0x7f6acc09d6f0 2023-10-03T10:20:16.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.420+0000 7f6ac27fc700 1 -- 172.21.15.19:0/3281877959 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ac8024070 con 0x7f6acc09d6f0 2023-10-03T10:20:16.420 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 msgr2=0x7f6acc11d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c730 tx=0x7f6ac800ca40 comp rx=0 tx=0).stop 2023-10-03T10:20:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 shutdown_connections 2023-10-03T10:20:16.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6acc135e50 0x7f6acc11de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6acc09d6f0 0x7f6acc11d3e0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 --2- 172.21.15.19:0/3281877959 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6acc09e1d0 0x7f6acc11d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 >> 172.21.15.19:0/3281877959 conn(0x7f6acc066f50 msgr2=0x7f6acc133790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 shutdown_connections 2023-10-03T10:20:16.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.422+0000 7f6ad4151700 1 -- 172.21.15.19:0/3281877959 wait complete. 2023-10-03T10:20:16.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.496+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffbc4074ea0 con 0x7ffbc409de50 2023-10-03T10:20:16.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.497+0000 7ffbba7fc700 1 -- 172.21.15.19:0/195131593 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffbc0017070 con 0x7ffbc409de50 2023-10-03T10:20:16.496 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 msgr2=0x7ffbc411d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7ffbc000e9e0 tx=0x7ffbc000eda0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 shutdown_connections 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffbc41338a0 0x7ffbc411e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffbc409de50 0x7ffbc411d800 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 --2- 172.21.15.19:0/195131593 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffbc409e760 0x7ffbc411dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 >> 172.21.15.19:0/195131593 conn(0x7ffbc40a2aa0 msgr2=0x7ffbc41bae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 shutdown_connections 2023-10-03T10:20:16.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.499+0000 7ffbcbf3c700 1 -- 172.21.15.19:0/195131593 wait complete. 2023-10-03T10:20:16.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.553+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9b40a1d00 con 0x7fa9b409e410 2023-10-03T10:20:16.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.553+0000 7fa99bfff700 1 -- 172.21.15.19:0/3218796963 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9ac01b3b0 con 0x7fa9b409e410 2023-10-03T10:20:16.554 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:16.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 msgr2=0x7fa9b411eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 0x7fa9b411eb10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00cb40 tx=0x7fa9ac00ce50 comp rx=0 tx=0).stop 2023-10-03T10:20:16.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2d5c074ea0 con 0x7f2d5c09e410 2023-10-03T10:20:16.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 shutdown_connections 2023-10-03T10:20:16.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9b409e410 0x7fa9b411eb10 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9b409d6f0 0x7fa9b411e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 --2- 172.21.15.19:0/3218796963 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9b409e000 0x7fa9b411e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 >> 172.21.15.19:0/3218796963 conn(0x7fa9b4066f50 msgr2=0x7fa9b406f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 shutdown_connections 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7fa9b9fbb700 1 -- 172.21.15.19:0/3218796963 wait complete. 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.556+0000 7f2d597fa700 1 -- 172.21.15.19:0/2783256539 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d54018070 con 0x7f2d5c09e410 2023-10-03T10:20:16.557 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:16.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 msgr2=0x7f2d5c1362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:16.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 0x7f2d5c1362d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2d5400efc0 tx=0x7f2d5400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 shutdown_connections 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d5c09e410 0x7f2d5c1362d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d5c09d6f0 0x7f2d5c1305f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 --2- 172.21.15.19:0/2783256539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d5c09e000 0x7f2d5c130b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.558+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 >> 172.21.15.19:0/2783256539 conn(0x7f2d5c066f50 msgr2=0x7f2d5c0a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.559+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 shutdown_connections 2023-10-03T10:20:16.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:16.559+0000 7f2d62c96700 1 -- 172.21.15.19:0/2783256539 wait complete. 2023-10-03T10:20:16.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:16.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:17.437 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:17.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:17.572 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:17.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:17.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.587+0000 7fe8c0048700 1 Processor -- start 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.587+0000 7fe8c0048700 1 -- start start 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8c0048700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 0x7fe8b806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8c0048700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8c0048700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b8070ee0 con 0x7fe8b809eca0 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8c0048700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b8071480 con 0x7fe8b806e570 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8c0048700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8071b90 con 0x7fe8b806ee80 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8be5e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8be5e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39856/0 (socket says 172.21.15.19:39856) 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8be5e5700 1 -- 172.21.15.19:0/2294785320 learned_addr learned my addr 172.21.15.19:0/2294785320 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.588+0000 7fe8bdde4700 1 --2- 172.21.15.19:0/2294785320 >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 0x7fe8b806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8be5e5700 1 -- 172.21.15.19:0/2294785320 >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 msgr2=0x7fe8b806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/2294785320 >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 0x7fe8b806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8be5e5700 1 -- 172.21.15.19:0/2294785320 >> v1:172.21.15.19:6789/0 conn(0x7fe8b809eca0 legacy=0x7fe8b8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8be5e5700 1 -- 172.21.15.19:0/2294785320 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80711a0 con 0x7fe8b806ee80 2023-10-03T10:20:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8bdde4700 1 --2- 172.21.15.19:0/2294785320 >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 0x7fe8b806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/2294785320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e50 tx=0x7fe8b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bf67596f36c0a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8bcde2700 1 -- 172.21.15.19:0/2294785320 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000e070 con 0x7fe8b806ee80 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8bcde2700 1 -- 172.21.15.19:0/2294785320 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b000b9c0 con 0x7fe8b806ee80 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.589+0000 7fe8bcde2700 1 -- 172.21.15.19:0/2294785320 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000bd70 con 0x7fe8b806ee80 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.590+0000 7fe8c0048700 1 -- 172.21.15.19:0/2294785320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 msgr2=0x7fe8b8134d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.590+0000 7fe8c0048700 1 --2- 172.21.15.19:0/2294785320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0009e50 tx=0x7fe8b000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 -- 172.21.15.19:0/2294785320 shutdown_connections 2023-10-03T10:20:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 --2- 172.21.15.19:0/2294785320 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806ee80 0x7fe8b8134d20 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 --2- 172.21.15.19:0/2294785320 >> v2:172.21.15.19:3300/0 conn(0x7fe8b806e570 0x7fe8b806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 -- 172.21.15.19:0/2294785320 >> 172.21.15.19:0/2294785320 conn(0x7fe8b80a2aa0 msgr2=0x7fe8b80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 -- 172.21.15.19:0/2294785320 shutdown_connections 2023-10-03T10:20:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.591+0000 7fe8c0048700 1 -- 172.21.15.19:0/2294785320 wait complete. 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.592+0000 7fe8c0048700 1 Processor -- start 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.592+0000 7fe8c0048700 1 -- start start 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 0x7fe8b81389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 0x7fe8b8138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8139a90 con 0x7fe8b809e170 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b81350d0 con 0x7fe8b806ee80 2023-10-03T10:20:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8c0048700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b8139fd0 con 0x7fe8b806e570 2023-10-03T10:20:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8bdde4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8bd5e3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 0x7fe8b81389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8bdde4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39866/0 (socket says 172.21.15.19:39866) 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8bdde4700 1 -- 172.21.15.19:0/3335902168 learned_addr learned my addr 172.21.15.19:0/3335902168 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.593+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 0x7fe8b8138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 -- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 msgr2=0x7fe8b8134b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 -- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 msgr2=0x7fe8b81389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 0x7fe8b81389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 -- 172.21.15.19:0/3335902168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009b30 con 0x7fe8b809e170 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8bd5e3700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 0x7fe8b81389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8bdde4700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8be5e5700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 0x7fe8b8138f30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0015000 tx=0x7fe8b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00099b0 con 0x7fe8b809e170 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0004250 con 0x7fe8b809e170 2023-10-03T10:20:17.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.594+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00045e0 con 0x7fe8b809e170 2023-10-03T10:20:17.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.595+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b8135920 con 0x7fe8b809e170 2023-10-03T10:20:17.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.595+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b8070610 con 0x7fe8b809e170 2023-10-03T10:20:17.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.596+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8b0004740 con 0x7fe8b809e170 2023-10-03T10:20:17.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.596+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8b0040b10 con 0x7fe8b809e170 2023-10-03T10:20:17.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.597+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b8135210 con 0x7fe8b809e170 2023-10-03T10:20:17.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.605+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8b001a740 con 0x7fe8b809e170 2023-10-03T10:20:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.670+0000 7f400ca40700 1 Processor -- start 2023-10-03T10:20:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.671+0000 7f400ca40700 1 -- start start 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 0x7f400809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809e000 0x7f40081339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400806b460 con 0x7f400809d6f0 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400809b120 con 0x7f400809e410 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400ca40700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f400809a7e0 con 0x7f400809e000 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55296/0 (socket says 172.21.15.19:55296) 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 -- 172.21.15.19:0/2905456719 learned_addr learned my addr 172.21.15.19:0/2905456719 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4005d9b700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809e000 0x7f40081339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400659c700 1 --2- 172.21.15.19:0/2905456719 >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 0x7f400809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 -- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809e000 msgr2=0x7f40081339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809e000 0x7f40081339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 -- 172.21.15.19:0/2905456719 >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 msgr2=0x7f400809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 --2- 172.21.15.19:0/2905456719 >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 0x7f400809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f4006d9d700 1 -- 172.21.15.19:0/2905456719 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400809a500 con 0x7f400809e410 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.672+0000 7f400659c700 1 --2- 172.21.15.19:0/2905456719 >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 0x7f400809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.673+0000 7f4006d9d700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4000009e80 tx=0x7f400000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc7c2e1aa7b7eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.673+0000 7f400559a700 1 -- 172.21.15.19:0/2905456719 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000e070 con 0x7f400809e410 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.673+0000 7f400559a700 1 -- 172.21.15.19:0/2905456719 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000b8d0 con 0x7f400809e410 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.673+0000 7f400559a700 1 -- 172.21.15.19:0/2905456719 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000bc80 con 0x7f400809e410 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 -- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 msgr2=0x7f4008133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4000009e80 tx=0x7f400000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 -- 172.21.15.19:0/2905456719 shutdown_connections 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f4008133f30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 --2- 172.21.15.19:0/2905456719 >> v2:172.21.15.19:3300/0 conn(0x7f400809d6f0 0x7f400809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 --2- 172.21.15.19:0/2905456719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809e000 0x7f40081339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 -- 172.21.15.19:0/2905456719 >> 172.21.15.19:0/2905456719 conn(0x7f4008066f50 msgr2=0x7f400809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 -- 172.21.15.19:0/2905456719 shutdown_connections 2023-10-03T10:20:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.674+0000 7f400ca40700 1 -- 172.21.15.19:0/2905456719 wait complete. 2023-10-03T10:20:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 Processor -- start 2023-10-03T10:20:17.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 -- start start 2023-10-03T10:20:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 0x7f40081a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 0x7f40081a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.676+0000 7f400ca40700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40081a9450 con 0x7f400809e000 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f400ca40700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40081a8930 con 0x7f400809e410 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f400ca40700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f40081a9190 con 0x7f400809d6f0 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55298/0 (socket says 172.21.15.19:55298) 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 -- 172.21.15.19:0/4283117188 learned_addr learned my addr 172.21.15.19:0/4283117188 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4005d9b700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 0x7f40081a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 -- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 msgr2=0x7f40081a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f400659c700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 0x7f40081a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 0x7f40081a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 -- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 msgr2=0x7f40081a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 0x7f40081a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 -- 172.21.15.19:0/4283117188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4000009b30 con 0x7f400809e410 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f400659c700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 0x7f40081a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4005d9b700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 0x7f40081a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.677+0000 7f4006d9d700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f400809b3c0 tx=0x7f4000004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.678+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000004450 con 0x7f400809e410 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.678+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40000045f0 con 0x7f400809e410 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.678+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40081a6120 con 0x7f400809e410 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.678+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000025460 con 0x7f400809e410 2023-10-03T10:20:17.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.678+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40081a7000 con 0x7f400809e410 2023-10-03T10:20:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.679+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40081a8ea0 con 0x7f400809e410 2023-10-03T10:20:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.680+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f400001c410 con 0x7f400809e410 2023-10-03T10:20:17.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.680+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4000041310 con 0x7f400809e410 2023-10-03T10:20:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.685+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4000023360 con 0x7f400809e410 2023-10-03T10:20:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 Processor -- start 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 -- start start 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc9409f410 0x7fdc94136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc94136fe0 0x7fdc941393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc94070940 con 0x7fdc9409e930 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9406fd60 con 0x7fdc94136fe0 2023-10-03T10:20:17.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.721+0000 7fdc99fee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9406fa80 con 0x7fdc9409f410 2023-10-03T10:20:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc94136fe0 0x7fdc941393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdc94136fe0 0x7fdc941393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55314/0 (socket says 172.21.15.19:55314) 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 -- 172.21.15.19:0/3697596994 learned_addr learned my addr 172.21.15.19:0/3697596994 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc92ffd700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc9409f410 0x7fdc94136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 -- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc9409f410 msgr2=0x7fdc94136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc9409f410 0x7fdc94136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 -- 172.21.15.19:0/3697596994 >> v1:172.21.15.19:6789/0 conn(0x7fdc9409e930 legacy=0x7fdc9409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 -- 172.21.15.19:0/3697596994 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9409fb60 con 0x7fdc94136fe0 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc93fff700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc94136fe0 0x7fdc941393c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e50 tx=0x7fdc8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420b32a3d227981a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc927fc700 1 -- 172.21.15.19:0/3697596994 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00e070 con 0x7fdc94136fe0 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc927fc700 1 -- 172.21.15.19:0/3697596994 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c003a20 con 0x7fdc94136fe0 2023-10-03T10:20:17.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.722+0000 7fdc927fc700 1 -- 172.21.15.19:0/3697596994 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c003dd0 con 0x7fdc94136fe0 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 -- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc94136fe0 msgr2=0x7fdc941393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc94136fe0 0x7fdc941393c0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009e50 tx=0x7fdc8c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 -- 172.21.15.19:0/3697596994 shutdown_connections 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc94136fe0 0x7fdc941393c0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3697596994 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc9409f410 0x7fdc94136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 -- 172.21.15.19:0/3697596994 >> 172.21.15.19:0/3697596994 conn(0x7fdc940a4210 msgr2=0x7fdc940a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 -- 172.21.15.19:0/3697596994 shutdown_connections 2023-10-03T10:20:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.723+0000 7fdc99fee700 1 -- 172.21.15.19:0/3697596994 wait complete. 2023-10-03T10:20:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.724+0000 7fdc99fee700 1 Processor -- start 2023-10-03T10:20:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 -- start start 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc9409f410 0x7fdc941c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc94136fe0 0x7fdc941c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc94071d20 con 0x7fdc9409e930 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9406d560 con 0x7fdc9409f410 2023-10-03T10:20:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc99fee700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdc940a2f40 con 0x7fdc94136fe0 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55326/0 (socket says 172.21.15.19:55326) 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc937fe700 1 -- 172.21.15.19:0/3098181373 learned_addr learned my addr 172.21.15.19:0/3098181373 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.725+0000 7fdc92ffd700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc9409f410 0x7fdc941c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 -- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc94136fe0 msgr2=0x7fdc941c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc94136fe0 0x7fdc941c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 -- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc9409f410 msgr2=0x7fdc941c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc9409f410 0x7fdc941c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 -- 172.21.15.19:0/3098181373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009b30 con 0x7fdc9409e930 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc937fe700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c750 tx=0x7fdc8400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84005480 con 0x7fdc9409e930 2023-10-03T10:20:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc84003680 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc84003a30 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc94121e10 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.726+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94121110 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.727+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdc84003b90 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.727+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc94122030 con 0x7fdc9409e930 2023-10-03T10:20:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.728+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdc8403f260 con 0x7fdc9409e930 2023-10-03T10:20:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.732+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdc84003e40 con 0x7fdc9409e930 2023-10-03T10:20:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.734+0000 7f3edcba1700 1 Processor -- start 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.734+0000 7f3edcba1700 1 -- start start 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3edcba1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ed80a0a30 0x7f3ed80a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3edcba1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 0x7f3ed813b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3edcba1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed80a2a70 con 0x7f3ed809d630 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3edcba1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80a01d0 con 0x7f3ed80a0a30 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3edcba1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed809e2b0 con 0x7f3ed8138d80 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3ed659c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3ed80a0a30 0x7f3ed80a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3ed5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f3ed809d630 0x7f3ed80a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59124/0 (socket says 172.21.15.19:59124) 2023-10-03T10:20:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3ed5d9b700 1 -- 172.21.15.19:0/1029817848 learned_addr learned my addr 172.21.15.19:0/1029817848 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3ed6d9d700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 0x7f3ed813b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.735+0000 7f3ed559a700 1 -- 172.21.15.19:0/1029817848 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419633262 0 0) 0x7f3ed80a2a70 con 0x7f3ed809d630 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed659c700 1 -- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 msgr2=0x7f3ed813b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed659c700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 0x7f3ed813b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed659c700 1 -- 172.21.15.19:0/1029817848 >> v1:172.21.15.19:6789/0 conn(0x7f3ed809d630 legacy=0x7f3ed80a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed659c700 1 -- 172.21.15.19:0/1029817848 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed809dc50 con 0x7f3ed80a0a30 2023-10-03T10:20:17.736 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed6d9d700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 0x7f3ed813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed659c700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed80a0a30 0x7f3ed80a0e00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009840 tx=0x7f3ec8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63112b54ec2471c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed559a700 1 -- 172.21.15.19:0/1029817848 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8011830 con 0x7f3ed80a0a30 2023-10-03T10:20:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed559a700 1 -- 172.21.15.19:0/1029817848 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec8011990 con 0x7f3ed80a0a30 2023-10-03T10:20:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.736+0000 7f3ed559a700 1 -- 172.21.15.19:0/1029817848 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec8011d20 con 0x7f3ed80a0a30 2023-10-03T10:20:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 -- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed80a0a30 msgr2=0x7f3ed80a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed80a0a30 0x7f3ed80a0e00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f3ec8009840 tx=0x7f3ec8009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 -- 172.21.15.19:0/1029817848 shutdown_connections 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed8138d80 0x7f3ed813b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 --2- 172.21.15.19:0/1029817848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed80a0a30 0x7f3ed80a0e00 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 -- 172.21.15.19:0/1029817848 >> 172.21.15.19:0/1029817848 conn(0x7f3ed80a3050 msgr2=0x7f3ed80a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 -- 172.21.15.19:0/1029817848 shutdown_connections 2023-10-03T10:20:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.737+0000 7f3edcba1700 1 -- 172.21.15.19:0/1029817848 wait complete. 2023-10-03T10:20:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.738+0000 7f3edcba1700 1 Processor -- start 2023-10-03T10:20:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.738+0000 7f3edcba1700 1 -- start start 2023-10-03T10:20:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed809d630 0x7f3ed8133760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 0x7f3ed8133ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 0x7f3ed81341e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8136fa0 con 0x7f3ed8138d80 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8136630 con 0x7f3ed809d630 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3edcba1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80a4b50 con 0x7f3ed80a0a30 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 0x7f3ed81341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed6d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 0x7f3ed81341e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55350/0 (socket says 172.21.15.19:55350) 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed6d9d700 1 -- 172.21.15.19:0/2805910349 learned_addr learned my addr 172.21.15.19:0/2805910349 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 0x7f3ed8133ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed659c700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed809d630 0x7f3ed8133760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 -- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed809d630 msgr2=0x7f3ed8133760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed809d630 0x7f3ed8133760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 -- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 msgr2=0x7f3ed81341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.740 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 0x7f3ed81341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.739+0000 7f3ed5d9b700 1 -- 172.21.15.19:0/2805910349 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009a70 con 0x7f3ed80a0a30 2023-10-03T10:20:17.741 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.740+0000 7f3ed5d9b700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 0x7f3ed8133ca0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c470 tx=0x7f3ecc00c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.740+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc004c80 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.740+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ecc004de0 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.740+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ecc007310 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.741+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80094a0 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.741+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed8137a10 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.741+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ecc007470 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.742+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed8137e60 con 0x7f3ed80a0a30 2023-10-03T10:20:17.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.742+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ecc03f120 con 0x7f3ed80a0a30 2023-10-03T10:20:17.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.746+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ecc007720 con 0x7f3ed80a0a30 2023-10-03T10:20:17.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.859+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8b8137ab0 con 0x7fe8b809e170 2023-10-03T10:20:17.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.859+0000 7fe8ae7fc700 1 -- 172.21.15.19:0/3335902168 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8b0020020 con 0x7fe8b809e170 2023-10-03T10:20:17.859 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:17.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.861+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 msgr2=0x7fe8b8138f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 0x7fe8b8138f30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0015000 tx=0x7fe8b0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 shutdown_connections 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8b809e170 0x7fe8b8138f30 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8b806e570 0x7fe8b8134b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 --2- 172.21.15.19:0/3335902168 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8b806ee80 0x7fe8b81389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 >> 172.21.15.19:0/3335902168 conn(0x7fe8b80a2aa0 msgr2=0x7fe8b80a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 shutdown_connections 2023-10-03T10:20:17.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.862+0000 7fe8c0048700 1 -- 172.21.15.19:0/3335902168 wait complete. 2023-10-03T10:20:17.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:17.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.899+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4008074ea0 con 0x7f400809e410 2023-10-03T10:20:17.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.900+0000 7f3ff6ffd700 1 -- 172.21.15.19:0/4283117188 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f400002a020 con 0x7f400809e410 2023-10-03T10:20:17.899 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 msgr2=0x7f40081c7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f400809b3c0 tx=0x7f4000004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 shutdown_connections 2023-10-03T10:20:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f400809e410 0x7f40081c7ef0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f400809d6f0 0x7f40081a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 --2- 172.21.15.19:0/4283117188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f400809e000 0x7f40081a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 >> 172.21.15.19:0/4283117188 conn(0x7f4008066f50 msgr2=0x7f40081bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 shutdown_connections 2023-10-03T10:20:17.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.902+0000 7f400ca40700 1 -- 172.21.15.19:0/4283117188 wait complete. 2023-10-03T10:20:17.916 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:17.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.956+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3ed8136c40 con 0x7f3ed80a0a30 2023-10-03T10:20:17.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.957+0000 7f3ec6ffd700 1 -- 172.21.15.19:0/2805910349 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ecc011e80 con 0x7f3ed80a0a30 2023-10-03T10:20:17.956 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 msgr2=0x7f3ed8133ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 0x7f3ed8133ca0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc00c470 tx=0x7f3ecc00c780 comp rx=0 tx=0).stop 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 shutdown_connections 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3ed8138d80 0x7f3ed81341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3ed809d630 0x7f3ed8133760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 --2- 172.21.15.19:0/2805910349 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3ed80a0a30 0x7f3ed8133ca0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 >> 172.21.15.19:0/2805910349 conn(0x7f3ed80a3050 msgr2=0x7f3ed813ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 shutdown_connections 2023-10-03T10:20:17.959 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.959+0000 7f3edcba1700 1 -- 172.21.15.19:0/2805910349 wait complete. 2023-10-03T10:20:17.972 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:17.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.981+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdc94074ea0 con 0x7fdc9409e930 2023-10-03T10:20:17.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.981+0000 7fdc7bfff700 1 -- 172.21.15.19:0/3098181373 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdc84019300 con 0x7fdc9409e930 2023-10-03T10:20:17.981 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.983+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 msgr2=0x7fdc941c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.983+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fdc8400c750 tx=0x7fdc8400ca60 comp rx=0 tx=0).stop 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.983+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 shutdown_connections 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.983+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdc94136fe0 0x7fdc941c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.984+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdc9409e930 0x7fdc941c8260 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.984+0000 7fdc99fee700 1 --2- 172.21.15.19:0/3098181373 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdc9409f410 0x7fdc941c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.984+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 >> 172.21.15.19:0/3098181373 conn(0x7fdc940a4210 msgr2=0x7fdc94136020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:17.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.984+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 shutdown_connections 2023-10-03T10:20:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:17.984+0000 7fdc99fee700 1 -- 172.21.15.19:0/3098181373 wait complete. 2023-10-03T10:20:17.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:18.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:18.917 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:18.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:18.998 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.035+0000 7f22e7555700 1 Processor -- start 2023-10-03T10:20:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.035+0000 7f22e7555700 1 -- start start 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e7555700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e012ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e7555700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 0x7f22e0138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e7555700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e006fa40 con 0x7f22e012cf60 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e7555700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e012cd90 con 0x7f22e006f5d0 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e7555700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0071780 con 0x7f22e0135c20 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e52f1700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f22e012cf60 0x7f22e012f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59138/0 (socket says 172.21.15.19:59138) 2023-10-03T10:20:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e52f1700 1 -- 172.21.15.19:0/2324781908 learned_addr learned my addr 172.21.15.19:0/2324781908 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.036+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 0x7f22e0138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e4af0700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e012ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e5af2700 1 -- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 msgr2=0x7f22e012ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e012ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e5af2700 1 -- 172.21.15.19:0/2324781908 >> v1:172.21.15.19:6789/0 conn(0x7f22e012cf60 legacy=0x7f22e012f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e5af2700 1 -- 172.21.15.19:0/2324781908 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0071a40 con 0x7f22e0135c20 2023-10-03T10:20:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 0x7f22e0138000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009df0 tx=0x7f22d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c4427f44c7bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22d7fff700 1 -- 172.21.15.19:0/2324781908 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800bce0 con 0x7f22e0135c20 2023-10-03T10:20:19.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.037+0000 7f22d7fff700 1 -- 172.21.15.19:0/2324781908 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d800be40 con 0x7f22e0135c20 2023-10-03T10:20:19.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.038+0000 7f22d7fff700 1 -- 172.21.15.19:0/2324781908 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d80106c0 con 0x7f22e0135c20 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 -- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 msgr2=0x7f22e0138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 0x7f22e0138000 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009df0 tx=0x7f22d800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 -- 172.21.15.19:0/2324781908 shutdown_connections 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e0135c20 0x7f22e0138000 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 --2- 172.21.15.19:0/2324781908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e012ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 -- 172.21.15.19:0/2324781908 >> 172.21.15.19:0/2324781908 conn(0x7f22e00a2aa0 msgr2=0x7f22e00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 -- 172.21.15.19:0/2324781908 shutdown_connections 2023-10-03T10:20:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.039+0000 7f22e7555700 1 -- 172.21.15.19:0/2324781908 wait complete. 2023-10-03T10:20:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.040+0000 7f22e7555700 1 Processor -- start 2023-10-03T10:20:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.040+0000 7f22e7555700 1 -- start start 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e0133160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 0x7f22e01336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 0x7f22e0133be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0135720 con 0x7f22e0135c20 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0134cf0 con 0x7f22e006f5d0 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e7555700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22e009ecb0 con 0x7f22e012cf60 2023-10-03T10:20:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e4af0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 0x7f22e01336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e4af0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 0x7f22e01336a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39922/0 (socket says 172.21.15.19:39922) 2023-10-03T10:20:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e4af0700 1 -- 172.21.15.19:0/2389397756 learned_addr learned my addr 172.21.15.19:0/2389397756 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e52f1700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e0133160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.041+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 0x7f22e0133be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 -- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 msgr2=0x7f22e01336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 0x7f22e01336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 -- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 msgr2=0x7f22e0133160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e0133160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 -- 172.21.15.19:0/2389397756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8009a70 con 0x7f22e0135c20 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e5af2700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 0x7f22e0133be0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f22d8018000 tx=0x7f22d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8003c20 con 0x7f22e0135c20 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d8003d80 con 0x7f22e0135c20 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e0119070 con 0x7f22e0135c20 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.042+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004250 con 0x7f22e0135c20 2023-10-03T10:20:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.043+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e0135070 con 0x7f22e0135c20 2023-10-03T10:20:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.044+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f22d80043b0 con 0x7f22e0135c20 2023-10-03T10:20:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.044+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22d800e070 con 0x7f22e0135c20 2023-10-03T10:20:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.044+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0118cd0 con 0x7f22e0135c20 2023-10-03T10:20:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.049+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f22d8021d60 con 0x7f22e0135c20 2023-10-03T10:20:19.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.078+0000 7fde4fce6700 1 Processor -- start 2023-10-03T10:20:19.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.078+0000 7fde4fce6700 1 -- start start 2023-10-03T10:20:19.078 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4fce6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 0x7fde4809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4fce6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4fce6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4809b120 con 0x7fde4809e410 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4fce6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4806b460 con 0x7fde4809d6f0 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4fce6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde4809a7e0 con 0x7fde4809e000 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4da82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 0x7fde4809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4d281700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4da82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 0x7fde4809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55338/0 (socket says 172.21.15.19:55338) 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4da82700 1 -- 172.21.15.19:0/119396824 learned_addr learned my addr 172.21.15.19:0/119396824 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4e283700 1 --1- 172.21.15.19:0/119396824 >> v1:172.21.15.19:6789/0 conn(0x7fde4809e410 0x7fde48133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59144/0 (socket says 172.21.15.19:59144) 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4d281700 1 -- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 msgr2=0x7fde4809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4d281700 1 --2- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 0x7fde4809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4ca80700 1 -- 172.21.15.19:0/119396824 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011459857 0 0) 0x7fde4809b120 con 0x7fde4809e410 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4d281700 1 -- 172.21.15.19:0/119396824 >> v1:172.21.15.19:6789/0 conn(0x7fde4809e410 legacy=0x7fde48133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.079+0000 7fde4d281700 1 -- 172.21.15.19:0/119396824 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4809a500 con 0x7fde4809e000 2023-10-03T10:20:19.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.080+0000 7fde4d281700 1 --2- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481339f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fde380098a0 tx=0x7fde38009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed3420233d86f890 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.080+0000 7fde4ca80700 1 -- 172.21.15.19:0/119396824 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011830 con 0x7fde4809e000 2023-10-03T10:20:19.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.080+0000 7fde4ca80700 1 -- 172.21.15.19:0/119396824 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde38011990 con 0x7fde4809e000 2023-10-03T10:20:19.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.080+0000 7fde4ca80700 1 -- 172.21.15.19:0/119396824 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde38011d20 con 0x7fde4809e000 2023-10-03T10:20:19.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 -- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 msgr2=0x7fde481339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 --2- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481339f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fde380098a0 tx=0x7fde38009bb0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 -- 172.21.15.19:0/119396824 shutdown_connections 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 --2- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809d6f0 0x7fde4809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 --2- 172.21.15.19:0/119396824 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481339f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 -- 172.21.15.19:0/119396824 >> 172.21.15.19:0/119396824 conn(0x7fde48066f50 msgr2=0x7fde4809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 -- 172.21.15.19:0/119396824 shutdown_connections 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.081+0000 7fde4fce6700 1 -- 172.21.15.19:0/119396824 wait complete. 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 Processor -- start 2023-10-03T10:20:19.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 -- start start 2023-10-03T10:20:19.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 0x7fde481a5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809e410 0x7fde481c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde481a4f70 con 0x7fde4809d6f0 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde481b93f0 con 0x7fde4809e410 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.083+0000 7fde4fce6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fde4809c710 con 0x7fde4809e000 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4da82700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 0x7fde481a5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4da82700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 0x7fde481a5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55366/0 (socket says 172.21.15.19:55366) 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4da82700 1 -- 172.21.15.19:0/1910309265 learned_addr learned my addr 172.21.15.19:0/1910309265 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4e283700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809e410 0x7fde481c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 -- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809e410 msgr2=0x7fde481c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809e410 0x7fde481c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 -- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 msgr2=0x7fde481a5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 0x7fde481a5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 -- 172.21.15.19:0/1910309265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde380094a0 con 0x7fde4809e000 2023-10-03T10:20:19.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.084+0000 7fde4d281700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481a5870 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde38016000 tx=0x7fde38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.085+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380044d0 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.085+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3801f070 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.085+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde480a2e80 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.085+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde380038e0 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.085+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde481a8d10 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.086+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fde38003a40 con 0x7fde4809e000 2023-10-03T10:20:19.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.086+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde481a76e0 con 0x7fde4809e000 2023-10-03T10:20:19.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.086+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fde38021070 con 0x7fde4809e000 2023-10-03T10:20:19.095 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.095+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fde38015030 con 0x7fde4809e000 2023-10-03T10:20:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.127+0000 7f26b0ee6700 1 Processor -- start 2023-10-03T10:20:19.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.127+0000 7f26b0ee6700 1 -- start start 2023-10-03T10:20:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26b0ee6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f26ac09d6f0 0x7f26ac09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26b0ee6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26b0ee6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ac09d2f0 con 0x7f26ac133f30 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26b0ee6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26ac09a810 con 0x7f26ac09d6f0 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26b0ee6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac09a470 con 0x7f26ac09e000 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26a9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26a9d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55358/0 (socket says 172.21.15.19:55358) 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26aad9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f26ac133f30 0x7f26ac13ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59150/0 (socket says 172.21.15.19:59150) 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26a9d9b700 1 -- 172.21.15.19:0/461367243 learned_addr learned my addr 172.21.15.19:0/461367243 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.128+0000 7f26aa59c700 1 --2- 172.21.15.19:0/461367243 >> v2:172.21.15.19:3300/0 conn(0x7f26ac09d6f0 0x7f26ac09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a9d9b700 1 -- 172.21.15.19:0/461367243 >> v2:172.21.15.19:3300/0 conn(0x7f26ac09d6f0 msgr2=0x7f26ac09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a9d9b700 1 --2- 172.21.15.19:0/461367243 >> v2:172.21.15.19:3300/0 conn(0x7f26ac09d6f0 0x7f26ac09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a9d9b700 1 -- 172.21.15.19:0/461367243 >> v1:172.21.15.19:6789/0 conn(0x7f26ac133f30 legacy=0x7f26ac13ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a9d9b700 1 -- 172.21.15.19:0/461367243 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac09ec40 con 0x7f26ac09e000 2023-10-03T10:20:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a9d9b700 1 --2- 172.21.15.19:0/461367243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f26a00098f0 tx=0x7f26a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a32717c82b5048 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a959a700 1 -- 172.21.15.19:0/461367243 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0011830 con 0x7f26ac09e000 2023-10-03T10:20:19.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a959a700 1 -- 172.21.15.19:0/461367243 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a0011990 con 0x7f26ac09e000 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.129+0000 7f26a959a700 1 -- 172.21.15.19:0/461367243 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0011d20 con 0x7f26ac09e000 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 -- 172.21.15.19:0/461367243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 msgr2=0x7f26ac1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/461367243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f26a00098f0 tx=0x7f26a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 -- 172.21.15.19:0/461367243 shutdown_connections 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/461367243 >> v2:172.21.15.19:3300/0 conn(0x7f26ac09d6f0 0x7f26ac09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/461367243 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09e000 0x7f26ac1339f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 -- 172.21.15.19:0/461367243 >> 172.21.15.19:0/461367243 conn(0x7f26ac066f50 msgr2=0x7f26ac09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 -- 172.21.15.19:0/461367243 shutdown_connections 2023-10-03T10:20:19.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.130+0000 7f26b0ee6700 1 -- 172.21.15.19:0/461367243 wait complete. 2023-10-03T10:20:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 Processor -- start 2023-10-03T10:20:19.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 -- start start 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09d6f0 0x7f26ac1c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ac133f30 0x7f26ac1228a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac125e20 con 0x7f26ac133f30 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac1264c0 con 0x7f26ac09d6f0 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.132+0000 7f26b0ee6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f26ac0a3220 con 0x7f26ac09e000 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39952/0 (socket says 172.21.15.19:39952) 2023-10-03T10:20:19.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 -- 172.21.15.19:0/902038689 learned_addr learned my addr 172.21.15.19:0/902038689 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26aad9d700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ac133f30 0x7f26ac1228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26aa59c700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09d6f0 0x7f26ac1c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 -- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09d6f0 msgr2=0x7f26ac1c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09d6f0 0x7f26ac1c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 -- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ac133f30 msgr2=0x7f26ac1228a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ac133f30 0x7f26ac1228a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 -- 172.21.15.19:0/902038689 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0009550 con 0x7f26ac09e000 2023-10-03T10:20:19.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.133+0000 7f26a9d9b700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000c00 tx=0x7f26a0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00036a0 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a0003800 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a0003bb0 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ac09c640 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ac126b50 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.134+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f26a0021070 con 0x7f26ac09e000 2023-10-03T10:20:19.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.135+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f26a0040b30 con 0x7f26ac09e000 2023-10-03T10:20:19.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.135+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ac074ea0 con 0x7f26ac09e000 2023-10-03T10:20:19.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.140+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f26a0024470 con 0x7f26ac09e000 2023-10-03T10:20:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.207+0000 7f51cdf7e700 1 Processor -- start 2023-10-03T10:20:19.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.207+0000 7f51cdf7e700 1 -- start start 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f51c8134ec0 0x7f51c81379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8137f20 0x7f51c81383c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c806c4b0 con 0x7f51c8134ec0 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80a09c0 con 0x7f51c8137f20 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51cdf7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8134980 con 0x7f51c806c0e0 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8137f20 0x7f51c81383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39960/0 (socket says 172.21.15.19:39960) 2023-10-03T10:20:19.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 -- 172.21.15.19:0/2057266267 learned_addr learned my addr 172.21.15.19:0/2057266267 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c6ffd700 1 --2- 172.21.15.19:0/2057266267 >> v2:172.21.15.19:3300/0 conn(0x7f51c8134ec0 0x7f51c81379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 -- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8137f20 msgr2=0x7f51c81383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8137f20 0x7f51c81383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 -- 172.21.15.19:0/2057266267 >> v2:172.21.15.19:3300/0 conn(0x7f51c8134ec0 msgr2=0x7f51c81379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2057266267 >> v2:172.21.15.19:3300/0 conn(0x7f51c8134ec0 0x7f51c81379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.208+0000 7f51c77fe700 1 -- 172.21.15.19:0/2057266267 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80a0600 con 0x7f51c806c0e0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.209+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3b54640b55d5de9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.209+0000 7f51c67fc700 1 -- 172.21.15.19:0/2057266267 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011830 con 0x7f51c806c0e0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.209+0000 7f51c67fc700 1 -- 172.21.15.19:0/2057266267 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b8011990 con 0x7f51c806c0e0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.209+0000 7f51c67fc700 1 -- 172.21.15.19:0/2057266267 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8011d20 con 0x7f51c806c0e0 2023-10-03T10:20:19.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 msgr2=0x7f51c809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51b80098f0 tx=0x7f51b8009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2057266267 shutdown_connections 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8137f20 0x7f51c81383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2057266267 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c806c0e0 0x7f51c809ac90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2057266267 >> v2:172.21.15.19:3300/0 conn(0x7f51c8134ec0 0x7f51c81379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2057266267 >> 172.21.15.19:0/2057266267 conn(0x7f51c80a4210 msgr2=0x7f51c80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2057266267 shutdown_connections 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.210+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2057266267 wait complete. 2023-10-03T10:20:19.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.211+0000 7f51cdf7e700 1 Processor -- start 2023-10-03T10:20:19.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 -- start start 2023-10-03T10:20:19.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8134ec0 0x7f51c811ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c8137f20 0x7f51c811b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c811e020 con 0x7f51c806c0e0 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c811dbd0 con 0x7f51c8134ec0 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.212+0000 7f51cdf7e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f51c811bfd0 con 0x7f51c8137f20 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8134ec0 0x7f51c811ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c7fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c8137f20 0x7f51c811b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55406/0 (socket says 172.21.15.19:55406) 2023-10-03T10:20:19.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 -- 172.21.15.19:0/2637691885 learned_addr learned my addr 172.21.15.19:0/2637691885 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 -- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c8137f20 msgr2=0x7f51c811b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c8137f20 0x7f51c811b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 -- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8134ec0 msgr2=0x7f51c811ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8134ec0 0x7f51c811ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 -- 172.21.15.19:0/2637691885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8009550 con 0x7f51c806c0e0 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51c77fe700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009c40 tx=0x7f51b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:19.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.213+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b8004450 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.214+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b801e070 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.214+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c811d970 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.214+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b80038e0 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.214+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c811b8b0 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.215+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f51b8003a40 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.215+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f51b8040330 con 0x7f51c806c0e0 2023-10-03T10:20:19.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.215+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c8074ea0 con 0x7f51c806c0e0 2023-10-03T10:20:19.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.224+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f51b8015020 con 0x7f51c806c0e0 2023-10-03T10:20:19.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.269+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f22e0118ed0 con 0x7f22e0135c20 2023-10-03T10:20:19.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.270+0000 7f22d5ffb700 1 -- 172.21.15.19:0/2389397756 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f22e0118ed0 con 0x7f22e0135c20 2023-10-03T10:20:19.270 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:19.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 msgr2=0x7f22e0133be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 0x7f22e0133be0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f22d8018000 tx=0x7f22d8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 shutdown_connections 2023-10-03T10:20:19.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f22e0135c20 0x7f22e0133be0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f22e006f5d0 0x7f22e0133160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 --2- 172.21.15.19:0/2389397756 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f22e012cf60 0x7f22e01336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 >> 172.21.15.19:0/2389397756 conn(0x7f22e00a2aa0 msgr2=0x7f22e006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 shutdown_connections 2023-10-03T10:20:19.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.272+0000 7f22e7555700 1 -- 172.21.15.19:0/2389397756 wait complete. 2023-10-03T10:20:19.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:19.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.350+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f26ac06c360 con 0x7f26ac09e000 2023-10-03T10:20:19.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.350+0000 7f269affd700 1 -- 172.21.15.19:0/902038689 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f26a0019ba0 con 0x7f26ac09e000 2023-10-03T10:20:19.350 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 msgr2=0x7f26ac1c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f26a0000c00 tx=0x7f26a0004750 comp rx=0 tx=0).stop 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 shutdown_connections 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f26ac133f30 0x7f26ac1228a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f26ac09d6f0 0x7f26ac1c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 --2- 172.21.15.19:0/902038689 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f26ac09e000 0x7f26ac1c89e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 >> 172.21.15.19:0/902038689 conn(0x7f26ac066f50 msgr2=0x7f26ac070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 shutdown_connections 2023-10-03T10:20:19.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.353+0000 7f26b0ee6700 1 -- 172.21.15.19:0/902038689 wait complete. 2023-10-03T10:20:19.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.359+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fde48074ea0 con 0x7fde4809e000 2023-10-03T10:20:19.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.359+0000 7fde3e7fc700 1 -- 172.21.15.19:0/1910309265 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde38019ba0 con 0x7fde4809e000 2023-10-03T10:20:19.359 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 msgr2=0x7fde481a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481a5870 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fde38016000 tx=0x7fde38004750 comp rx=0 tx=0).stop 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 shutdown_connections 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fde4809e410 0x7fde481c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde4809d6f0 0x7fde481a5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 --2- 172.21.15.19:0/1910309265 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fde4809e000 0x7fde481a5870 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 >> 172.21.15.19:0/1910309265 conn(0x7fde48066f50 msgr2=0x7fde4806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 shutdown_connections 2023-10-03T10:20:19.363 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.362+0000 7fde4fce6700 1 -- 172.21.15.19:0/1910309265 wait complete. 2023-10-03T10:20:19.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:19.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.432+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f51c806b250 con 0x7f51c806c0e0 2023-10-03T10:20:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.432+0000 7f51affff700 1 -- 172.21.15.19:0/2637691885 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f51b802d7d0 con 0x7f51c806c0e0 2023-10-03T10:20:19.432 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 msgr2=0x7f51c811a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009c40 tx=0x7f51b8004750 comp rx=0 tx=0).stop 2023-10-03T10:20:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 shutdown_connections 2023-10-03T10:20:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f51c8137f20 0x7f51c811b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51c806c0e0 0x7f51c811a8f0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 --2- 172.21.15.19:0/2637691885 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f51c8134ec0 0x7f51c811ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 >> 172.21.15.19:0/2637691885 conn(0x7f51c80a4210 msgr2=0x7f51c8099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 shutdown_connections 2023-10-03T10:20:19.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:19.434+0000 7f51cdf7e700 1 -- 172.21.15.19:0/2637691885 wait complete. 2023-10-03T10:20:19.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:20.287 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:20.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:20.376 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:20.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 Processor -- start 2023-10-03T10:20:20.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 -- start start 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f922809d6f0 0x7f922809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f9228133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922806b460 con 0x7f922809d6f0 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922809b120 con 0x7f922809e000 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f922d12c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f922809a7e0 con 0x7f922809e410 2023-10-03T10:20:20.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.444+0000 7f9226d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f922809d6f0 0x7f922809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f922809d6f0 0x7f922809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55408/0 (socket says 172.21.15.19:55408) 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 -- 172.21.15.19:0/388313358 learned_addr learned my addr 172.21.15.19:0/388313358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f922759e700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f9228133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 -- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 msgr2=0x7f9228133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f9228133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 -- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 msgr2=0x7f92281339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f922659c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 -- 172.21.15.19:0/388313358 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922809a500 con 0x7f922809d6f0 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f922659c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9226d9d700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f922809dac0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f92180098f0 tx=0x7f9218009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84c69291fea10db server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9225d9b700 1 -- 172.21.15.19:0/388313358 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011830 con 0x7f922809d6f0 2023-10-03T10:20:20.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9225d9b700 1 -- 172.21.15.19:0/388313358 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9218011990 con 0x7f922809d6f0 2023-10-03T10:20:20.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.445+0000 7f9225d9b700 1 -- 172.21.15.19:0/388313358 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218011d20 con 0x7f922809d6f0 2023-10-03T10:20:20.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 -- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 msgr2=0x7f922809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f922809dac0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f92180098f0 tx=0x7f9218009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:20.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 -- 172.21.15.19:0/388313358 shutdown_connections 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f9228133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f922809dac0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 --2- 172.21.15.19:0/388313358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 -- 172.21.15.19:0/388313358 >> 172.21.15.19:0/388313358 conn(0x7f9228066f50 msgr2=0x7f922809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 -- 172.21.15.19:0/388313358 shutdown_connections 2023-10-03T10:20:20.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.446+0000 7f922d12c700 1 -- 172.21.15.19:0/388313358 wait complete. 2023-10-03T10:20:20.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:20.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.448+0000 7f922d12c700 1 Processor -- start 2023-10-03T10:20:20.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.448+0000 7f922d12c700 1 -- start start 2023-10-03T10:20:20.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f92281c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92280a1fd0 con 0x7f922809d6f0 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922809c710 con 0x7f922809e000 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922d12c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92281a4d70 con 0x7f922809e410 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f9226d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f9226d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55412/0 (socket says 172.21.15.19:55412) 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f9226d9d700 1 -- 172.21.15.19:0/3115125504 learned_addr learned my addr 172.21.15.19:0/3115125504 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.449+0000 7f922759e700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f92281c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 -- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 msgr2=0x7f92281c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f92281c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 -- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 msgr2=0x7f92281a5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281a5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 -- 172.21.15.19:0/3115125504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218009550 con 0x7f922809d6f0 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f922659c700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f9226d9d700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f9218009c40 tx=0x7f9218004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218004240 con 0x7f922809d6f0 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921801f070 con 0x7f922809d6f0 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92281a7d70 con 0x7f922809d6f0 2023-10-03T10:20:20.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92180045c0 con 0x7f922809d6f0 2023-10-03T10:20:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.450+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92281a6390 con 0x7f922809d6f0 2023-10-03T10:20:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.451+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9218021030 con 0x7f922809d6f0 2023-10-03T10:20:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.451+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9218040730 con 0x7f922809d6f0 2023-10-03T10:20:20.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.452+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92281a5000 con 0x7f922809d6f0 2023-10-03T10:20:20.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.461+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9218015080 con 0x7f922809d6f0 2023-10-03T10:20:20.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.521+0000 7f6e8aacf700 1 Processor -- start 2023-10-03T10:20:20.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.521+0000 7f6e8aacf700 1 -- start start 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8aacf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409d6f0 0x7f6e8409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8aacf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e8409e000 0x7f6e84130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8aacf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8409f130 con 0x7f6e8409e410 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8aacf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8409f520 con 0x7f6e8409e000 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8aacf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8409e930 con 0x7f6e8409d6f0 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8906c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6e8409e410 0x7f6e84130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59152/0 (socket says 172.21.15.19:59152) 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8906c700 1 -- 172.21.15.19:0/1470577412 learned_addr learned my addr 172.21.15.19:0/1470577412 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e83fff700 1 --2- 172.21.15.19:0/1470577412 >> v2:172.21.15.19:3300/0 conn(0x7f6e8409e000 0x7f6e84130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e8886b700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409d6f0 0x7f6e8409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e83fff700 1 -- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409d6f0 msgr2=0x7f6e8409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e83fff700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409d6f0 0x7f6e8409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e83fff700 1 -- 172.21.15.19:0/1470577412 >> v1:172.21.15.19:6789/0 conn(0x7f6e8409e410 legacy=0x7f6e84130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.522+0000 7f6e83fff700 1 -- 172.21.15.19:0/1470577412 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8409b2d0 con 0x7f6e8409e000 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.523+0000 7f6e83fff700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e84130660 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009840 tx=0x7f6e70009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8d44be21067a34 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.523+0000 7f6e837fe700 1 -- 172.21.15.19:0/1470577412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000f8a0 con 0x7f6e8409e000 2023-10-03T10:20:20.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.523+0000 7f6e837fe700 1 -- 172.21.15.19:0/1470577412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000fa00 con 0x7f6e8409e000 2023-10-03T10:20:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.523+0000 7f6e837fe700 1 -- 172.21.15.19:0/1470577412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000fd90 con 0x7f6e8409e000 2023-10-03T10:20:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 -- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 msgr2=0x7f6e84130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e84130660 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009840 tx=0x7f6e70009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 -- 172.21.15.19:0/1470577412 shutdown_connections 2023-10-03T10:20:20.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409d6f0 0x7f6e8409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/1470577412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e84130660 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 -- 172.21.15.19:0/1470577412 >> 172.21.15.19:0/1470577412 conn(0x7f6e84066f50 msgr2=0x7f6e8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 -- 172.21.15.19:0/1470577412 shutdown_connections 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.524+0000 7f6e8aacf700 1 -- 172.21.15.19:0/1470577412 wait complete. 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.526+0000 7f6e8aacf700 1 Processor -- start 2023-10-03T10:20:20.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.526+0000 7f6e8aacf700 1 -- start start 2023-10-03T10:20:20.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e841228f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409e410 0x7f6e84122e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84123fc0 con 0x7f6e8409e000 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841245e0 con 0x7f6e8409e410 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8aacf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8409c770 con 0x7f6e8409d6f0 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8886b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8886b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:39990/0 (socket says 172.21.15.19:39990) 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8886b700 1 -- 172.21.15.19:0/4118360109 learned_addr learned my addr 172.21.15.19:0/4118360109 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e83fff700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e841228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.527+0000 7f6e8906c700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409e410 0x7f6e84122e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 -- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409e410 msgr2=0x7f6e84122e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409e410 0x7f6e84122e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 -- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 msgr2=0x7f6e841228f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e841228f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 -- 172.21.15.19:0/4118360109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700094a0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8886b700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9b0 tx=0x7f6e7800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78009710 con 0x7f6e8409d6f0 2023-10-03T10:20:20.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800ee50 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e841302d0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800ca50 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.528+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e84125bf0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.529+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84074ea0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.530+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e7800cbb0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.530+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e7803ff50 con 0x7f6e8409d6f0 2023-10-03T10:20:20.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.539+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e78011350 con 0x7f6e8409d6f0 2023-10-03T10:20:20.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.571+0000 7f0b42f9e700 1 Processor -- start 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.571+0000 7f0b42f9e700 1 -- start start 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b42f9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 0x7f0b3c134c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b42f9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b42f9e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c09ebc0 con 0x7f0b3c09da70 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b42f9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c095cb0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b42f9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c09e980 con 0x7f0b3c09d100 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b41f9c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 0x7f0b3c134c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b41f9c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 0x7f0b3c134c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55444/0 (socket says 172.21.15.19:55444) 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b41f9c700 1 -- 172.21.15.19:0/3276420881 learned_addr learned my addr 172.21.15.19:0/3276420881 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b4179b700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b40f9a700 1 -- 172.21.15.19:0/3276420881 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704683371 0 0) 0x7f0b3c09ebc0 con 0x7f0b3c09da70 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.572+0000 7f0b40f9a700 1 -- 172.21.15.19:0/3276420881 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b280035b0 con 0x7f0b3c09da70 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b4179b700 1 -- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 msgr2=0x7f0b3c134c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b4179b700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 0x7f0b3c134c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b4179b700 1 -- 172.21.15.19:0/3276420881 >> v1:172.21.15.19:6789/0 conn(0x7f0b3c09da70 legacy=0x7f0b3c13ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b4179b700 1 -- 172.21.15.19:0/3276420881 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c094ec0 con 0x7f0b3c09d100 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b4179b700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c09d530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13f5ba58838e0ee server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b40f9a700 1 -- 172.21.15.19:0/3276420881 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c011830 con 0x7f0b3c09d100 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b40f9a700 1 -- 172.21.15.19:0/3276420881 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c011990 con 0x7f0b3c09d100 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.573+0000 7f0b40f9a700 1 -- 172.21.15.19:0/3276420881 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c011d00 con 0x7f0b3c09d100 2023-10-03T10:20:20.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 -- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 msgr2=0x7f0b3c09d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c09d530 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009870 tx=0x7f0b2c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 -- 172.21.15.19:0/3276420881 shutdown_connections 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c1348a0 0x7f0b3c134c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/3276420881 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c09d530 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 -- 172.21.15.19:0/3276420881 >> 172.21.15.19:0/3276420881 conn(0x7f0b3c0a2540 msgr2=0x7f0b3c0a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 -- 172.21.15.19:0/3276420881 shutdown_connections 2023-10-03T10:20:20.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.574+0000 7f0b42f9e700 1 -- 172.21.15.19:0/3276420881 wait complete. 2023-10-03T10:20:20.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.575+0000 7f0b42f9e700 1 Processor -- start 2023-10-03T10:20:20.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.575+0000 7f0b42f9e700 1 -- start start 2023-10-03T10:20:20.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c09da70 0x7f0b3c133ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c071190 con 0x7f0b3c1348a0 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c06f440 con 0x7f0b3c09da70 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b42f9e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c071830 con 0x7f0b3c09d100 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55426/0 (socket says 172.21.15.19:55426) 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 -- 172.21.15.19:0/653653572 learned_addr learned my addr 172.21.15.19:0/653653572 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b41f9c700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c133980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4179b700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c09da70 0x7f0b3c133ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 -- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 msgr2=0x7f0b3c133980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c133980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 -- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c09da70 msgr2=0x7f0b3c133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c09da70 0x7f0b3c133ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.576+0000 7f0b4279d700 1 -- 172.21.15.19:0/653653572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c0094a0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b4279d700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400cc50 tx=0x7f0b3400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34003c00 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34003d60 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c0940e0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3400ab80 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.577+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c070da0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.578+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c04f2a0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.579+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0b3400ace0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.579+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0b34040290 con 0x7f0b3c1348a0 2023-10-03T10:20:20.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.583+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0b340050d0 con 0x7f0b3c1348a0 2023-10-03T10:20:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.594+0000 7f071e59d700 1 Processor -- start 2023-10-03T10:20:20.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.594+0000 7f071e59d700 1 -- start start 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071e59d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 0x7f0718138880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071e59d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0718138dc0 0x7f071813b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071e59d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071806b990 con 0x7f0718133420 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071e59d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071809b0e0 con 0x7f07181337f0 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071e59d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0718133c20 con 0x7f0718138dc0 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f0717fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0718133420 0x7f0718133e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59178/0 (socket says 172.21.15.19:59178) 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f0717fff700 1 -- 172.21.15.19:0/4276091979 learned_addr learned my addr 172.21.15.19:0/4276091979 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f07177fe700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 0x7f0718138880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.595+0000 7f071cb3a700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0718138dc0 0x7f071813b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f07177fe700 1 -- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0718138dc0 msgr2=0x7f071813b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f07177fe700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0718138dc0 0x7f071813b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f07177fe700 1 -- 172.21.15.19:0/4276091979 >> v1:172.21.15.19:6789/0 conn(0x7f0718133420 legacy=0x7f0718133e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f07177fe700 1 -- 172.21.15.19:0/4276091979 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07180a0590 con 0x7f07181337f0 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f07177fe700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 0x7f0718138880 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b15094597d3ddab server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f0716ffd700 1 -- 172.21.15.19:0/4276091979 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c011830 con 0x7f07181337f0 2023-10-03T10:20:20.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f0716ffd700 1 -- 172.21.15.19:0/4276091979 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c011990 con 0x7f07181337f0 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.596+0000 7f0716ffd700 1 -- 172.21.15.19:0/4276091979 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c011d20 con 0x7f07181337f0 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 -- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 msgr2=0x7f0718138880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 0x7f0718138880 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 -- 172.21.15.19:0/4276091979 shutdown_connections 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0718138dc0 0x7f071813b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 --2- 172.21.15.19:0/4276091979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07181337f0 0x7f0718138880 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 -- 172.21.15.19:0/4276091979 >> 172.21.15.19:0/4276091979 conn(0x7f07180a4210 msgr2=0x7f07180a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.597+0000 7f071e59d700 1 -- 172.21.15.19:0/4276091979 shutdown_connections 2023-10-03T10:20:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.598+0000 7f071e59d700 1 -- 172.21.15.19:0/4276091979 wait complete. 2023-10-03T10:20:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.598+0000 7f071e59d700 1 Processor -- start 2023-10-03T10:20:20.598 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 -- start start 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 0x7f071812f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 0x7f071812ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07181388a0 con 0x7f0718138dc0 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071809b740 con 0x7f0718133420 2023-10-03T10:20:20.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f071e59d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f071809cc20 con 0x7f07181337f0 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.599+0000 7f07177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f071cb3a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 0x7f071812ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40024/0 (socket says 172.21.15.19:40024) 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 -- 172.21.15.19:0/3088526247 learned_addr learned my addr 172.21.15.19:0/3088526247 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f0717fff700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 0x7f071812f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 -- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 msgr2=0x7f071812f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 0x7f071812f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 -- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 msgr2=0x7f071812ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 0x7f071812ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 -- 172.21.15.19:0/3088526247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c0094a0 con 0x7f07181337f0 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f071cb3a700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 0x7f071812ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:20.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f0717fff700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 0x7f071812f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f07177fe700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f070c0090b0 tx=0x7f070c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c004590 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c01f070 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.600+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071809baa0 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.601+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0038c0 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.601+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071809b4f0 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.602+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f070c003a20 con 0x7f07181337f0 2023-10-03T10:20:20.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.602+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0718074ea0 con 0x7f07181337f0 2023-10-03T10:20:20.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.602+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f070c021070 con 0x7f07181337f0 2023-10-03T10:20:20.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.611+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f070c026480 con 0x7f07181337f0 2023-10-03T10:20:20.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.686+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9228074ea0 con 0x7f922809d6f0 2023-10-03T10:20:20.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.687+0000 7f920f7fe700 1 -- 172.21.15.19:0/3115125504 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f921801a450 con 0x7f922809d6f0 2023-10-03T10:20:20.686 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 msgr2=0x7f92281a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f9218009c40 tx=0x7f9218004750 comp rx=0 tx=0).stop 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 shutdown_connections 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f922809e410 0x7f92281c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922809d6f0 0x7f92281a5430 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 --2- 172.21.15.19:0/3115125504 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f922809e000 0x7f92281a5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 >> 172.21.15.19:0/3115125504 conn(0x7f9228066f50 msgr2=0x7f922809bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 shutdown_connections 2023-10-03T10:20:20.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.689+0000 7f922d12c700 1 -- 172.21.15.19:0/3115125504 wait complete. 2023-10-03T10:20:20.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:20.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.755+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e84125de0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.756+0000 7f6e817fa700 1 -- 172.21.15.19:0/4118360109 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e84125de0 con 0x7f6e8409d6f0 2023-10-03T10:20:20.756 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 msgr2=0x7f6e841223b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800e9b0 tx=0x7f6e7800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 shutdown_connections 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e8409e410 0x7f6e84122e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e8409d6f0 0x7f6e841223b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 --2- 172.21.15.19:0/4118360109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e8409e000 0x7f6e841228f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 >> 172.21.15.19:0/4118360109 conn(0x7f6e84066f50 msgr2=0x7f6e840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 shutdown_connections 2023-10-03T10:20:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.758+0000 7f6e8aacf700 1 -- 172.21.15.19:0/4118360109 wait complete. 2023-10-03T10:20:20.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.795+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0b3c134400 con 0x7f0b3c1348a0 2023-10-03T10:20:20.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.796+0000 7f0b327fc700 1 -- 172.21.15.19:0/653653572 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0b34011380 con 0x7f0b3c1348a0 2023-10-03T10:20:20.795 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 msgr2=0x7f0b3c06df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400cc50 tx=0x7f0b3400cf60 comp rx=0 tx=0).stop 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 shutdown_connections 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0b3c1348a0 0x7f0b3c06df70 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0b3c09d100 0x7f0b3c133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 --2- 172.21.15.19:0/653653572 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0b3c09da70 0x7f0b3c133ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 >> 172.21.15.19:0/653653572 conn(0x7f0b3c0a2540 msgr2=0x7f0b3c09ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 shutdown_connections 2023-10-03T10:20:20.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.798+0000 7f0b42f9e700 1 -- 172.21.15.19:0/653653572 wait complete. 2023-10-03T10:20:20.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:20.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.821+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0718132e80 con 0x7f07181337f0 2023-10-03T10:20:20.821 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.821+0000 7f0714ff9700 1 -- 172.21.15.19:0/3088526247 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f070c019ba0 con 0x7f07181337f0 2023-10-03T10:20:20.821 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:20.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 msgr2=0x7f071812fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:20.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f070c0090b0 tx=0x7f070c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:20.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 shutdown_connections 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0718138dc0 0x7f071812ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0718133420 0x7f071812f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 --2- 172.21.15.19:0/3088526247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07181337f0 0x7f071812fa00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 >> 172.21.15.19:0/3088526247 conn(0x7f07180a4210 msgr2=0x7f0718131400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 shutdown_connections 2023-10-03T10:20:20.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:20.823+0000 7f071e59d700 1 -- 172.21.15.19:0/3088526247 wait complete. 2023-10-03T10:20:20.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:21.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:21.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:21.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:21.837 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:21.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.853+0000 7fc3b51f3700 1 Processor -- start 2023-10-03T10:20:21.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.853+0000 7fc3b51f3700 1 -- start start 2023-10-03T10:20:21.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3b51f3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3b012cf60 0x7fc3b006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3b51f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b0130430 0x7fc3b0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3b51f3700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3b012cd90 con 0x7fc3b012f8b0 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3b51f3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3b012d330 con 0x7fc3b012cf60 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3b51f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b0071780 con 0x7fc3b0130430 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3ae59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc3b012f8b0 0x7fc3b012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59184/0 (socket says 172.21.15.19:59184) 2023-10-03T10:20:21.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3aed9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc3b012cf60 0x7fc3b006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.854+0000 7fc3ae59c700 1 -- 172.21.15.19:0/2126686643 learned_addr learned my addr 172.21.15.19:0/2126686643 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3af59e700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b0130430 0x7fc3b0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3aed9d700 1 -- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b0130430 msgr2=0x7fc3b0137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3aed9d700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b0130430 0x7fc3b0137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3aed9d700 1 -- 172.21.15.19:0/2126686643 >> v1:172.21.15.19:6789/0 conn(0x7fc3b012f8b0 legacy=0x7fc3b012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3aed9d700 1 -- 172.21.15.19:0/2126686643 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0071a40 con 0x7fc3b012cf60 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3aed9d700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b006f5d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009840 tx=0x7fc3a0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360238eebfc77cc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3add9b700 1 -- 172.21.15.19:0/2126686643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0011830 con 0x7fc3b012cf60 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3add9b700 1 -- 172.21.15.19:0/2126686643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a0011990 con 0x7fc3b012cf60 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.855+0000 7fc3add9b700 1 -- 172.21.15.19:0/2126686643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0011d20 con 0x7fc3b012cf60 2023-10-03T10:20:21.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 -- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 msgr2=0x7fc3b006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b006f5d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009840 tx=0x7fc3a0009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 -- 172.21.15.19:0/2126686643 shutdown_connections 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b0130430 0x7fc3b0137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/2126686643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b006f5d0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 -- 172.21.15.19:0/2126686643 >> 172.21.15.19:0/2126686643 conn(0x7fc3b00a2aa0 msgr2=0x7fc3b00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 -- 172.21.15.19:0/2126686643 shutdown_connections 2023-10-03T10:20:21.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.856+0000 7fc3b51f3700 1 -- 172.21.15.19:0/2126686643 wait complete. 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.858+0000 7fc3b51f3700 1 Processor -- start 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.858+0000 7fc3b51f3700 1 -- start start 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 0x7fc3b0130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3b0130430 0x7fc3b0131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b013b400 con 0x7fc3b012cf60 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b009ea70 con 0x7fc3b012f8b0 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3b51f3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b012d960 con 0x7fc3b0130430 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3aed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3aed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55448/0 (socket says 172.21.15.19:55448) 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3aed9d700 1 -- 172.21.15.19:0/3871164307 learned_addr learned my addr 172.21.15.19:0/3871164307 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:21.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.859+0000 7fc3ae59c700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 0x7fc3b0130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 -- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3b0130430 msgr2=0x7fc3b0131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3b0130430 0x7fc3b0131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 -- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 msgr2=0x7fc3b01309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 -- 172.21.15.19:0/3871164307 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00094a0 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3aed9d700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3ae59c700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 0x7fc3b0130f20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c500 tx=0x7fc3a400c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4005d70 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a40070d0 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a4007440 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b0129fa0 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.860+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b009e120 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.861+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3a40075a0 con 0x7fc3b012f8b0 2023-10-03T10:20:21.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.862+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3a403ea00 con 0x7fc3b012f8b0 2023-10-03T10:20:21.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.862+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b0074ea0 con 0x7fc3b012f8b0 2023-10-03T10:20:21.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.871+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3a4019d20 con 0x7fc3b012f8b0 2023-10-03T10:20:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.928+0000 7f6e50bae700 1 Processor -- start 2023-10-03T10:20:21.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.928+0000 7f6e50bae700 1 -- start start 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e50bae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e50bae700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e4c09e410 0x7f6e4c134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e50bae700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4c09b120 con 0x7f6e4c09e000 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e50bae700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c06b460 con 0x7f6e4c09e410 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e50bae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c09a7e0 con 0x7f6e4c09d6f0 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e4c09e410 0x7f6e4c134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e49d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6e4c09e000 0x7f6e4c1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59190/0 (socket says 172.21.15.19:59190) 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6e4c09e410 0x7f6e4c134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55464/0 (socket says 172.21.15.19:55464) 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e49d9b700 1 -- 172.21.15.19:0/2987099292 learned_addr learned my addr 172.21.15.19:0/2987099292 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:21.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4a59c700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 -- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 msgr2=0x7f6e4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 -- 172.21.15.19:0/2987099292 >> v1:172.21.15.19:6789/0 conn(0x7f6e4c09e000 legacy=0x7f6e4c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4959a700 1 -- 172.21.15.19:0/2987099292 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863158913 0 0) 0x7f6e4c09b120 con 0x7f6e4c09e000 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.929+0000 7f6e4ad9d700 1 -- 172.21.15.19:0/2987099292 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c09a500 con 0x7f6e4c09e410 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.930+0000 7f6e4ad9d700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e410 0x7f6e4c134100 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009d90 tx=0x7f6e4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61acefb0baa646f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.930+0000 7f6e4959a700 1 -- 172.21.15.19:0/2987099292 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4400e070 con 0x7f6e4c09e410 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.930+0000 7f6e4959a700 1 -- 172.21.15.19:0/2987099292 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400bb20 con 0x7f6e4c09e410 2023-10-03T10:20:21.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.930+0000 7f6e4959a700 1 -- 172.21.15.19:0/2987099292 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44012430 con 0x7f6e4c09e410 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 -- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e410 msgr2=0x7f6e4c134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e410 0x7f6e4c134100 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009d90 tx=0x7f6e4400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 -- 172.21.15.19:0/2987099292 shutdown_connections 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e410 0x7f6e4c134100 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2987099292 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 -- 172.21.15.19:0/2987099292 >> 172.21.15.19:0/2987099292 conn(0x7f6e4c066f50 msgr2=0x7f6e4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 -- 172.21.15.19:0/2987099292 shutdown_connections 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.931+0000 7f6e50bae700 1 -- 172.21.15.19:0/2987099292 wait complete. 2023-10-03T10:20:21.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.933+0000 7f6e50bae700 1 Processor -- start 2023-10-03T10:20:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.933+0000 7f6e50bae700 1 -- start start 2023-10-03T10:20:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.933+0000 7f6e50bae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c1a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.933+0000 7f6e50bae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.933+0000 7f6e50bae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e4c09e410 0x7f6e4c1c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e50bae700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a8120 con 0x7f6e4c09e000 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e50bae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1a8300 con 0x7f6e4c09e410 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e50bae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c1b9170 con 0x7f6e4c09d6f0 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55470/0 (socket says 172.21.15.19:55470) 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e4ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e4c09e410 0x7f6e4c1c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 -- 172.21.15.19:0/2030050506 learned_addr learned my addr 172.21.15.19:0/2030050506 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e4a59c700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c1a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 -- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 msgr2=0x7f6e4c1a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c1a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 -- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e4c09e410 msgr2=0x7f6e4c1c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e4c09e410 0x7f6e4c1c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 -- 172.21.15.19:0/2030050506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009a70 con 0x7f6e4c09e000 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.934+0000 7f6e49d9b700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c520 tx=0x7f6e4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.935+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40004c80 con 0x7f6e4c09e000 2023-10-03T10:20:21.935 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.935+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e40004de0 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.935+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c1a4ca0 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.935+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40007310 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.935+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c1a7b00 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.936+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6e40007470 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.936+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6e4003f410 con 0x7f6e4c09e000 2023-10-03T10:20:21.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.936+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c1a5cc0 con 0x7f6e4c09e000 2023-10-03T10:20:21.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.941+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6e400123b0 con 0x7f6e4c09e000 2023-10-03T10:20:21.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.983+0000 7fba5e0db700 1 Processor -- start 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.983+0000 7fba5e0db700 1 -- start start 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba5e0db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba580700d0 0x7fba5812c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba5e0db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba58137b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba5e0db700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba58130090 con 0x7fba581302b0 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba5e0db700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5809a210 con 0x7fba580700d0 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba5e0db700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba58099c70 con 0x7fba5812ceb0 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba577fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fba581302b0 0x7fba5812c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59202/0 (socket says 172.21.15.19:59202) 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba577fe700 1 -- 172.21.15.19:0/535149943 learned_addr learned my addr 172.21.15.19:0/535149943 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba56ffd700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba580700d0 0x7fba5812c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.984+0000 7fba57fff700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba58137b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba567fc700 1 -- 172.21.15.19:0/535149943 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1878628357 0 0) 0x7fba58130090 con 0x7fba581302b0 2023-10-03T10:20:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba567fc700 1 -- 172.21.15.19:0/535149943 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba400057c0 con 0x7fba581302b0 2023-10-03T10:20:21.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba57fff700 1 -- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba580700d0 msgr2=0x7fba5812c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba57fff700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba580700d0 0x7fba5812c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba57fff700 1 -- 172.21.15.19:0/535149943 >> v1:172.21.15.19:6789/0 conn(0x7fba581302b0 legacy=0x7fba5812c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba57fff700 1 -- 172.21.15.19:0/535149943 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba58099f30 con 0x7fba5812ceb0 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba57fff700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba58137b70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fba5000aed0 tx=0x7fba5000c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452ef28105ab69da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba567fc700 1 -- 172.21.15.19:0/535149943 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000a2d0 con 0x7fba5812ceb0 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba567fc700 1 -- 172.21.15.19:0/535149943 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000c910 con 0x7fba5812ceb0 2023-10-03T10:20:21.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.985+0000 7fba567fc700 1 -- 172.21.15.19:0/535149943 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5000ccc0 con 0x7fba5812ceb0 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 -- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 msgr2=0x7fba58137b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba58137b70 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fba5000aed0 tx=0x7fba5000c330 comp rx=0 tx=0).stop 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 -- 172.21.15.19:0/535149943 shutdown_connections 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba58137b70 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 --2- 172.21.15.19:0/535149943 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba580700d0 0x7fba5812c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 -- 172.21.15.19:0/535149943 >> 172.21.15.19:0/535149943 conn(0x7fba580a27f0 msgr2=0x7fba580a2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 -- 172.21.15.19:0/535149943 shutdown_connections 2023-10-03T10:20:21.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.986+0000 7fba5e0db700 1 -- 172.21.15.19:0/535149943 wait complete. 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.987+0000 7fba5e0db700 1 Processor -- start 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 -- start start 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba580700d0 0x7fba58121470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba581219b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:21.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58123860 con 0x7fba580700d0 2023-10-03T10:20:21.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba58123ab0 con 0x7fba581302b0 2023-10-03T10:20:21.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.988+0000 7fba5e0db700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba58123fb0 con 0x7fba5812ceb0 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55504/0 (socket says 172.21.15.19:55504) 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 -- 172.21.15.19:0/1223070827 learned_addr learned my addr 172.21.15.19:0/1223070827 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba577fe700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba580700d0 0x7fba58121470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba56ffd700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba581219b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 -- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 msgr2=0x7fba581219b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba581219b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 -- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba580700d0 msgr2=0x7fba58121470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba580700d0 0x7fba58121470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:21.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 -- 172.21.15.19:0/1223070827 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5000ab80 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba56ffd700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba581219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.989+0000 7fba57fff700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fba50016040 tx=0x7fba50004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.990+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5001e850 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.990+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5001e9d0 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.990+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba581227a0 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.990+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5001ed80 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.990+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba58122430 con 0x7fba581302b0 2023-10-03T10:20:21.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.991+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fba5001a040 con 0x7fba581302b0 2023-10-03T10:20:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.991+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fba500406d0 con 0x7fba581302b0 2023-10-03T10:20:21.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:21.991+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5804f2a0 con 0x7fba581302b0 2023-10-03T10:20:22.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.001+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fba50013420 con 0x7fba581302b0 2023-10-03T10:20:22.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.006+0000 7f8b06c97700 1 Processor -- start 2023-10-03T10:20:22.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.006+0000 7f8b06c97700 1 -- start start 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 0x7f8b001337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133e30 0x7f8b0012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0006b990 con 0x7f8b00133420 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000a0590 con 0x7f8b00134260 2023-10-03T10:20:22.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b06c97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0009fb80 con 0x7f8b00133e30 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b05234700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b05234700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55518/0 (socket says 172.21.15.19:55518) 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.007+0000 7f8b05234700 1 -- 172.21.15.19:0/1836427365 learned_addr learned my addr 172.21.15.19:0/1836427365 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b04a33700 1 --2- 172.21.15.19:0/1836427365 >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 0x7f8b001337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8afffff700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133e30 0x7f8b0012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 -- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133e30 msgr2=0x7f8b0012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133e30 0x7f8b0012ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 -- 172.21.15.19:0/1836427365 >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 msgr2=0x7f8b001337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 --2- 172.21.15.19:0/1836427365 >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 0x7f8b001337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 -- 172.21.15.19:0/1836427365 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b000a0030 con 0x7f8b00134260 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b04a33700 1 --2- 172.21.15.19:0/1836427365 >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 0x7f8b001337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8b05234700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009e50 tx=0x7f8af800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e63216bc2c20849a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8aff7fe700 1 -- 172.21.15.19:0/1836427365 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800e070 con 0x7f8b00134260 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8aff7fe700 1 -- 172.21.15.19:0/1836427365 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800b9c0 con 0x7f8b00134260 2023-10-03T10:20:22.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.008+0000 7f8aff7fe700 1 -- 172.21.15.19:0/1836427365 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800bd70 con 0x7f8b00134260 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 -- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 msgr2=0x7f8b001304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009e50 tx=0x7f8af800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 -- 172.21.15.19:0/1836427365 shutdown_connections 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00134260 0x7f8b001304d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1836427365 >> v2:172.21.15.19:3300/0 conn(0x7f8b00133420 0x7f8b001337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1836427365 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133e30 0x7f8b0012ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 -- 172.21.15.19:0/1836427365 >> 172.21.15.19:0/1836427365 conn(0x7f8b000a4210 msgr2=0x7f8b000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:22.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 -- 172.21.15.19:0/1836427365 shutdown_connections 2023-10-03T10:20:22.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.009+0000 7f8b06c97700 1 -- 172.21.15.19:0/1836427365 wait complete. 2023-10-03T10:20:22.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.011+0000 7f8b06c97700 1 Processor -- start 2023-10-03T10:20:22.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.011+0000 7f8b06c97700 1 -- start start 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00133e30 0x7f8b0009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b00134260 0x7f8b0009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b00120730 con 0x7f8b00134260 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0009dda0 con 0x7f8b00133e30 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b06c97700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0011fb60 con 0x7f8b00133420 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40088/0 (socket says 172.21.15.19:40088) 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 -- 172.21.15.19:0/1040501043 learned_addr learned my addr 172.21.15.19:0/1040501043 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b05234700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b00134260 0x7f8b0009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8afffff700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00133e30 0x7f8b0009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 -- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00133e30 msgr2=0x7f8b0009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00133e30 0x7f8b0009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 -- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b00134260 msgr2=0x7f8b0009cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b00134260 0x7f8b0009cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.012+0000 7f8b04a33700 1 -- 172.21.15.19:0/1040501043 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8009b30 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.013+0000 7f8b04a33700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8af400e810 tx=0x7f8af400eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.013+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4013610 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.013+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b00133100 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.013+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b00120170 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.014+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4013770 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.014+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af4013b20 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.014+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b00074ea0 con 0x7f8b00133420 2023-10-03T10:20:22.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.014+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8af4013c80 con 0x7f8b00133420 2023-10-03T10:20:22.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.015+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8af403f450 con 0x7f8b00133420 2023-10-03T10:20:22.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.024+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8af4012370 con 0x7f8b00133420 2023-10-03T10:20:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.097+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc3b0067ce0 con 0x7fc3b012f8b0 2023-10-03T10:20:22.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.097+0000 7fc3977fe700 1 -- 172.21.15.19:0/3871164307 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3a4017020 con 0x7fc3b012f8b0 2023-10-03T10:20:22.097 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.099+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 msgr2=0x7fc3b0130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.099+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 0x7fc3b0130f20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc3a400c500 tx=0x7fc3a400c810 comp rx=0 tx=0).stop 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 shutdown_connections 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc3b0130430 0x7fc3b0131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc3b012cf60 0x7fc3b01309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 --2- 172.21.15.19:0/3871164307 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc3b012f8b0 0x7fc3b0130f20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 >> 172.21.15.19:0/3871164307 conn(0x7fc3b00a2aa0 msgr2=0x7fc3b012a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 shutdown_connections 2023-10-03T10:20:22.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.100+0000 7fc3b51f3700 1 -- 172.21.15.19:0/3871164307 wait complete. 2023-10-03T10:20:22.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:22.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.214+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba5806b9a0 con 0x7fba581302b0 2023-10-03T10:20:22.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.214+0000 7fba3ffff700 1 -- 172.21.15.19:0/1223070827 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fba50022030 con 0x7fba581302b0 2023-10-03T10:20:22.214 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 msgr2=0x7fba58121ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fba50016040 tx=0x7fba50004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 shutdown_connections 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fba581302b0 0x7fba58121ef0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba580700d0 0x7fba58121470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 --2- 172.21.15.19:0/1223070827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fba5812ceb0 0x7fba581219b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 >> 172.21.15.19:0/1223070827 conn(0x7fba580a27f0 msgr2=0x7fba580a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 shutdown_connections 2023-10-03T10:20:22.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.217+0000 7fba5e0db700 1 -- 172.21.15.19:0/1223070827 wait complete. 2023-10-03T10:20:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.218+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6e4c074ea0 con 0x7f6e4c09e000 2023-10-03T10:20:22.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.218+0000 7f6e3affd700 1 -- 172.21.15.19:0/2030050506 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6e40011360 con 0x7f6e4c09e000 2023-10-03T10:20:22.218 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:22.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 msgr2=0x7f6e4c1a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000c520 tx=0x7f6e4000c830 comp rx=0 tx=0).stop 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 shutdown_connections 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6e4c09e410 0x7f6e4c1c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6e4c09d6f0 0x7f6e4c1a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 --2- 172.21.15.19:0/2030050506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e4c09e000 0x7f6e4c1a5780 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 >> 172.21.15.19:0/2030050506 conn(0x7f6e4c066f50 msgr2=0x7f6e4c06f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 shutdown_connections 2023-10-03T10:20:22.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.222+0000 7f6e50bae700 1 -- 172.21.15.19:0/2030050506 wait complete. 2023-10-03T10:20:22.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:22.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:22.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.271+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8b0006b250 con 0x7f8b00133420 2023-10-03T10:20:22.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.271+0000 7f8afd7fa700 1 -- 172.21.15.19:0/1040501043 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8af401b3b0 con 0x7f8b00133420 2023-10-03T10:20:22.271 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.273+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 msgr2=0x7f8b0009c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.273+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f8af400e810 tx=0x7f8af400eb20 comp rx=0 tx=0).stop 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 shutdown_connections 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8b00134260 0x7f8b0009cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8b00133420 0x7f8b0009c480 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 --2- 172.21.15.19:0/1040501043 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8b00133e30 0x7f8b0009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 >> 172.21.15.19:0/1040501043 conn(0x7f8b000a4210 msgr2=0x7f8b001302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 shutdown_connections 2023-10-03T10:20:22.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:22.274+0000 7f8b06c97700 1 -- 172.21.15.19:0/1040501043 wait complete. 2023-10-03T10:20:22.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:23.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:23.236 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:23.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:23.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.263+0000 7f2fc4d29700 1 Processor -- start 2023-10-03T10:20:23.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.263+0000 7f2fc4d29700 1 -- start start 2023-10-03T10:20:23.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.263+0000 7f2fc4d29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 0x7f2fc01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fc4d29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 0x7f2fc012ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fc4d29700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc006b990 con 0x7f2fc0134260 2023-10-03T10:20:23.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fc4d29700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00a0590 con 0x7f2fc0133e30 2023-10-03T10:20:23.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fc4d29700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc009fb80 con 0x7f2fc0133420 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2fc0134260 0x7f2fc01304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59212/0 (socket says 172.21.15.19:59212) 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbe59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 0x7f2fc01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbed9d700 1 -- 172.21.15.19:0/3925357806 learned_addr learned my addr 172.21.15.19:0/3925357806 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 0x7f2fc012ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 -- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 msgr2=0x7f2fc01337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 0x7f2fc01337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 -- 172.21.15.19:0/3925357806 >> v1:172.21.15.19:6789/0 conn(0x7f2fc0134260 legacy=0x7f2fc01304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 -- 172.21.15.19:0/3925357806 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00a0030 con 0x7f2fc0133e30 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbd59a700 1 -- 172.21.15.19:0/3925357806 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583377292 0 0) 0x7f2fc006b990 con 0x7f2fc0134260 2023-10-03T10:20:23.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbe59c700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 0x7f2fc01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:23.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.264+0000 7f2fbdd9b700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 0x7f2fc012ff90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75ff7bffd879660 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fbd59a700 1 -- 172.21.15.19:0/3925357806 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011830 con 0x7f2fc0133e30 2023-10-03T10:20:23.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fbd59a700 1 -- 172.21.15.19:0/3925357806 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4011990 con 0x7f2fc0133e30 2023-10-03T10:20:23.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fbd59a700 1 -- 172.21.15.19:0/3925357806 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011d20 con 0x7f2fc0133e30 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 -- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 msgr2=0x7f2fc012ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 0x7f2fc012ff90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009870 tx=0x7f2fb4009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 -- 172.21.15.19:0/3925357806 shutdown_connections 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0133420 0x7f2fc01337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/3925357806 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133e30 0x7f2fc012ff90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.265+0000 7f2fc4d29700 1 -- 172.21.15.19:0/3925357806 >> 172.21.15.19:0/3925357806 conn(0x7f2fc00a4210 msgr2=0x7f2fc00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.266+0000 7f2fc4d29700 1 -- 172.21.15.19:0/3925357806 shutdown_connections 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.266+0000 7f2fc4d29700 1 -- 172.21.15.19:0/3925357806 wait complete. 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.267+0000 7f2fc4d29700 1 Processor -- start 2023-10-03T10:20:23.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.267+0000 7f2fc4d29700 1 -- start start 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 0x7f2fc009cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc012dab0 con 0x7f2fc0133e30 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc011fff0 con 0x7f2fc0133420 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fc4d29700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc0120420 con 0x7f2fc0134260 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbe59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbdd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbe59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55552/0 (socket says 172.21.15.19:55552) 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbdd9b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55510/0 (socket says 172.21.15.19:55510) 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbe59c700 1 -- 172.21.15.19:0/905723122 learned_addr learned my addr 172.21.15.19:0/905723122 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 0x7f2fc009cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 -- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 msgr2=0x7f2fc009c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 -- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 msgr2=0x7f2fc009c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbed9d700 1 -- 172.21.15.19:0/905723122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00094a0 con 0x7f2fc0134260 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbdd9b700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.268+0000 7f2fbe59c700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2fbed9d700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 0x7f2fc009cf00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cbe0 tx=0x7f2fb800cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb800aa40 con 0x7f2fc0134260 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb800abc0 con 0x7f2fc0134260 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb40094a0 con 0x7f2fc0134260 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80070d0 con 0x7f2fc0134260 2023-10-03T10:20:23.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.269+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc011fd30 con 0x7f2fc0134260 2023-10-03T10:20:23.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.270+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2fb8007230 con 0x7f2fc0134260 2023-10-03T10:20:23.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.270+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2fb803f070 con 0x7f2fc0134260 2023-10-03T10:20:23.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.270+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc006d160 con 0x7f2fc0134260 2023-10-03T10:20:23.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.276+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2fb8019680 con 0x7f2fc0134260 2023-10-03T10:20:23.288 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:23.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 Processor -- start 2023-10-03T10:20:23.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 -- start start 2023-10-03T10:20:23.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809d6f0 0x7f9fa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 0x7f9fa81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fa809e410 0x7f9fa8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa806b460 con 0x7f9fa809e410 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa809b120 con 0x7f9fa809d6f0 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.383+0000 7f9faf3a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa809a7e0 con 0x7f9fa809e000 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fa809e410 0x7f9fa8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fac942700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 0x7f9fa81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fa809e410 0x7f9fa8133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55520/0 (socket says 172.21.15.19:55520) 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 -- 172.21.15.19:0/3246350224 learned_addr learned my addr 172.21.15.19:0/3246350224 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad143700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809d6f0 0x7f9fa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 -- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 msgr2=0x7f9fa81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 0x7f9fa81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 -- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809d6f0 msgr2=0x7f9fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809d6f0 0x7f9fa809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 -- 172.21.15.19:0/3246350224 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa809a500 con 0x7f9fa809e410 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fac942700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 0x7f9fa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.384+0000 7f9fad944700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809e410 0x7f9fa8133f30 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f25e8fbe730bba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9f9ffff700 1 -- 172.21.15.19:0/3246350224 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000e070 con 0x7f9fa809e410 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9f9ffff700 1 -- 172.21.15.19:0/3246350224 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa000b910 con 0x7f9fa809e410 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9f9ffff700 1 -- 172.21.15.19:0/3246350224 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa000bcc0 con 0x7f9fa809e410 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 -- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809e410 msgr2=0x7f9fa8133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809e410 0x7f9fa8133f30 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009e50 tx=0x7f9fa000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 -- 172.21.15.19:0/3246350224 shutdown_connections 2023-10-03T10:20:23.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809d6f0 0x7f9fa809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809e410 0x7f9fa8133f30 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/3246350224 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e000 0x7f9fa81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.385+0000 7f9faf3a7700 1 -- 172.21.15.19:0/3246350224 >> 172.21.15.19:0/3246350224 conn(0x7f9fa8066f50 msgr2=0x7f9fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.386+0000 7f9faf3a7700 1 -- 172.21.15.19:0/3246350224 shutdown_connections 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.386+0000 7f9faf3a7700 1 -- 172.21.15.19:0/3246350224 wait complete. 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.387+0000 7f9faf3a7700 1 Processor -- start 2023-10-03T10:20:23.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.387+0000 7f9faf3a7700 1 -- start start 2023-10-03T10:20:23.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809d6f0 0x7f9fa81a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809e000 0x7f9fa81a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81a8100 con 0x7f9fa809d6f0 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa81a8dc0 con 0x7f9fa809e000 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9faf3a7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80a2090 con 0x7f9fa809e410 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9fad944700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9fad944700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40108/0 (socket says 172.21.15.19:40108) 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.388+0000 7f9fad944700 1 -- 172.21.15.19:0/1447835700 learned_addr learned my addr 172.21.15.19:0/1447835700 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 -- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809e000 msgr2=0x7f9fa81a6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809e000 0x7f9fa81a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 -- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809d6f0 msgr2=0x7f9fa81a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809d6f0 0x7f9fa81a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 -- 172.21.15.19:0/1447835700 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980094a0 con 0x7f9fa809e410 2023-10-03T10:20:23.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9fad944700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000b680 tx=0x7f9fa0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0004450 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa00045b0 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0009b30 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.389+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0004940 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.390+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa809c710 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.391+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9fa0025460 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.391+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9fa0041290 con 0x7f9fa809e410 2023-10-03T10:20:23.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.391+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa8074ea0 con 0x7f9fa809e410 2023-10-03T10:20:23.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.396+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9fa0025710 con 0x7f9fa809e410 2023-10-03T10:20:23.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.409+0000 7fdf8a09d700 1 Processor -- start 2023-10-03T10:20:23.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.409+0000 7fdf8a09d700 1 -- start start 2023-10-03T10:20:23.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf8a09d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf841338a0 0x7fdf84133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf8a09d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 0x7fdf8413b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf8a09d700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8406ef30 con 0x7fdf8409de50 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf8a09d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8406fef0 con 0x7fdf8409e930 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf8a09d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf841334b0 con 0x7fdf841338a0 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf82ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdf8409de50 0x7fdf8409e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59226/0 (socket says 172.21.15.19:59226) 2023-10-03T10:20:23.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf82ffd700 1 -- 172.21.15.19:0/2302453306 learned_addr learned my addr 172.21.15.19:0/2302453306 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf837fe700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf841338a0 0x7fdf84133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf83fff700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 0x7fdf8413b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf827fc700 1 -- 172.21.15.19:0/2302453306 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112992986 0 0) 0x7fdf8406ef30 con 0x7fdf8409de50 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf83fff700 1 -- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf841338a0 msgr2=0x7fdf84133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.410+0000 7fdf83fff700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf841338a0 0x7fdf84133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf83fff700 1 -- 172.21.15.19:0/2302453306 >> v1:172.21.15.19:6789/0 conn(0x7fdf8409de50 legacy=0x7fdf8409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf83fff700 1 -- 172.21.15.19:0/2302453306 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8406fc30 con 0x7fdf8409e930 2023-10-03T10:20:23.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf83fff700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 0x7fdf8413b740 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009dc0 tx=0x7fdf7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6a809ce29c50ca server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf827fc700 1 -- 172.21.15.19:0/2302453306 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00e070 con 0x7fdf8409e930 2023-10-03T10:20:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf827fc700 1 -- 172.21.15.19:0/2302453306 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00bb20 con 0x7fdf8409e930 2023-10-03T10:20:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.411+0000 7fdf827fc700 1 -- 172.21.15.19:0/2302453306 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c012430 con 0x7fdf8409e930 2023-10-03T10:20:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 -- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 msgr2=0x7fdf8413b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 0x7fdf8413b740 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c009dc0 tx=0x7fdf7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 -- 172.21.15.19:0/2302453306 shutdown_connections 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf8409e930 0x7fdf8413b740 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/2302453306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf841338a0 0x7fdf84133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 -- 172.21.15.19:0/2302453306 >> 172.21.15.19:0/2302453306 conn(0x7fdf840a2aa0 msgr2=0x7fdf840a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 -- 172.21.15.19:0/2302453306 shutdown_connections 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.412+0000 7fdf8a09d700 1 -- 172.21.15.19:0/2302453306 wait complete. 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.413+0000 7fdf8a09d700 1 Processor -- start 2023-10-03T10:20:23.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.414+0000 7fdf8a09d700 1 -- start start 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.414+0000 7fdf8a09d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf8409de50 0x7fdf8411d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf8a09d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 0x7fdf8411dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf8a09d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 0x7fdf8411e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf8a09d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf840a0d20 con 0x7fdf8409de50 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf8a09d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8406f640 con 0x7fdf841338a0 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf8a09d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8411f3d0 con 0x7fdf8409e930 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf82ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 0x7fdf8411dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf82ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 0x7fdf8411dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40132/0 (socket says 172.21.15.19:40132) 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf82ffd700 1 -- 172.21.15.19:0/3977855838 learned_addr learned my addr 172.21.15.19:0/3977855838 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 0x7fdf8411e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf837fe700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf8409de50 0x7fdf8411d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 -- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 msgr2=0x7fdf8411dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 0x7fdf8411dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 -- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf8409de50 msgr2=0x7fdf8411d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf8409de50 0x7fdf8411d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.415+0000 7fdf83fff700 1 -- 172.21.15.19:0/3977855838 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c009a70 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf83fff700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 0x7fdf8411e240 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c016000 tx=0x7fdf7c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c004880 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c020070 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8411fa50 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0276c0 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.416+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf841211d0 con 0x7fdf841338a0 2023-10-03T10:20:23.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.417+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdf7c027820 con 0x7fdf841338a0 2023-10-03T10:20:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.417+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdf7c022070 con 0x7fdf841338a0 2023-10-03T10:20:23.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.417+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8411a470 con 0x7fdf841338a0 2023-10-03T10:20:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.428+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdf7c011390 con 0x7fdf841338a0 2023-10-03T10:20:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.434+0000 7f881bc43700 1 Processor -- start 2023-10-03T10:20:23.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.434+0000 7f881bc43700 1 -- start start 2023-10-03T10:20:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 0x7f88141337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 0x7f881412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 0x7f88141304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881406b990 con 0x7f8814133420 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140a0590 con 0x7f8814134260 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881bc43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881409fb80 con 0x7f8814133e30 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881a1e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 0x7f88141304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881a1e0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 0x7f88141304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55614/0 (socket says 172.21.15.19:55614) 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f881a1e0700 1 -- 172.21.15.19:0/3814655489 learned_addr learned my addr 172.21.15.19:0/3814655489 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f88191de700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 0x7f881412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.435+0000 7f88199df700 1 --2- 172.21.15.19:0/3814655489 >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 0x7f88141337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 -- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 msgr2=0x7f88141304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 0x7f88141304d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 -- 172.21.15.19:0/3814655489 >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 msgr2=0x7f88141337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 --2- 172.21.15.19:0/3814655489 >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 0x7f88141337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 -- 172.21.15.19:0/3814655489 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140a0030 con 0x7f8814133e30 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88199df700 1 --2- 172.21.15.19:0/3814655489 >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 0x7f88141337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88191de700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 0x7f881412ff90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8804009840 tx=0x7f8804009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f65b89d68e026a57 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88189dd700 1 -- 172.21.15.19:0/3814655489 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804011830 con 0x7f8814133e30 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88189dd700 1 -- 172.21.15.19:0/3814655489 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804011990 con 0x7f8814133e30 2023-10-03T10:20:23.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.436+0000 7f88189dd700 1 -- 172.21.15.19:0/3814655489 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804011d20 con 0x7f8814133e30 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 -- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 msgr2=0x7f881412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 0x7f881412ff90 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f8804009840 tx=0x7f8804009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 -- 172.21.15.19:0/3814655489 shutdown_connections 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814134260 0x7f88141304d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 --2- 172.21.15.19:0/3814655489 >> v2:172.21.15.19:3300/0 conn(0x7f8814133420 0x7f88141337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 --2- 172.21.15.19:0/3814655489 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814133e30 0x7f881412ff90 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 -- 172.21.15.19:0/3814655489 >> 172.21.15.19:0/3814655489 conn(0x7f88140a4210 msgr2=0x7f88140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 -- 172.21.15.19:0/3814655489 shutdown_connections 2023-10-03T10:20:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.437+0000 7f881bc43700 1 -- 172.21.15.19:0/3814655489 wait complete. 2023-10-03T10:20:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.438+0000 7f881bc43700 1 Processor -- start 2023-10-03T10:20:23.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.438+0000 7f881bc43700 1 -- start start 2023-10-03T10:20:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814133e30 0x7f881409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814134260 0x7f881409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881409de30 con 0x7f8814133420 2023-10-03T10:20:23.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881411edf0 con 0x7f8814133e30 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881bc43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f881411faf0 con 0x7f8814134260 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55570/0 (socket says 172.21.15.19:55570) 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 -- 172.21.15.19:0/3306394196 learned_addr learned my addr 172.21.15.19:0/3306394196 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88191de700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814133e30 0x7f881409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f881a1e0700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814134260 0x7f881409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 -- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814134260 msgr2=0x7f881409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814134260 0x7f881409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 -- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814133e30 msgr2=0x7f881409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814133e30 0x7f881409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.439+0000 7f88199df700 1 -- 172.21.15.19:0/3306394196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094a0 con 0x7f8814133420 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f88199df700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f881000ebe0 tx=0x7f881000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:23.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000c850 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000c9b0 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040094a0 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000cd40 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.440+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881411fdb0 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.441+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8814074ea0 con 0x7f8814133420 2023-10-03T10:20:23.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.441+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8810013470 con 0x7f8814133420 2023-10-03T10:20:23.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.445+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f88100123d0 con 0x7f8814133420 2023-10-03T10:20:23.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.446+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8810013720 con 0x7f8814133420 2023-10-03T10:20:23.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.512+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2fc0120230 con 0x7f2fc0134260 2023-10-03T10:20:23.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.513+0000 7f2faeffd700 1 -- 172.21.15.19:0/905723122 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2fb8010300 con 0x7f2fc0134260 2023-10-03T10:20:23.512 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 msgr2=0x7f2fc009cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 0x7f2fc009cf00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800cbe0 tx=0x7f2fb800cef0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 shutdown_connections 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2fc0134260 0x7f2fc009cf00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2fc0133420 0x7f2fc009c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 --2- 172.21.15.19:0/905723122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fc0133e30 0x7f2fc009c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.515+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 >> 172.21.15.19:0/905723122 conn(0x7f2fc00a4210 msgr2=0x7f2fc00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.516+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 shutdown_connections 2023-10-03T10:20:23.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.516+0000 7f2fc4d29700 1 -- 172.21.15.19:0/905723122 wait complete. 2023-10-03T10:20:23.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.617+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9fa80723d0 con 0x7f9fa809e410 2023-10-03T10:20:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.617+0000 7f9f9dffb700 1 -- 172.21.15.19:0/1447835700 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9fa0034090 con 0x7f9fa809e410 2023-10-03T10:20:23.617 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 msgr2=0x7f9fa81a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9fa000b680 tx=0x7f9fa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 shutdown_connections 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa809e410 0x7f9fa81a6950 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa809d6f0 0x7f9fa81a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 --2- 172.21.15.19:0/1447835700 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa809e000 0x7f9fa81a6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.620+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 >> 172.21.15.19:0/1447835700 conn(0x7f9fa8066f50 msgr2=0x7f9fa81bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.621+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 shutdown_connections 2023-10-03T10:20:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.621+0000 7f9faf3a7700 1 -- 172.21.15.19:0/1447835700 wait complete. 2023-10-03T10:20:23.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.656+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdf84074ea0 con 0x7fdf841338a0 2023-10-03T10:20:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.656+0000 7fdf6bfff700 1 -- 172.21.15.19:0/3977855838 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdf7c02fb80 con 0x7fdf841338a0 2023-10-03T10:20:23.656 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 msgr2=0x7fdf8411e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 0x7fdf8411e240 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c016000 tx=0x7fdf7c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 shutdown_connections 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdf841338a0 0x7fdf8411e240 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdf8409de50 0x7fdf8411d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 --2- 172.21.15.19:0/3977855838 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdf8409e930 0x7fdf8411dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 >> 172.21.15.19:0/3977855838 conn(0x7fdf840a2aa0 msgr2=0x7fdf841bad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 shutdown_connections 2023-10-03T10:20:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.659+0000 7fdf8a09d700 1 -- 172.21.15.19:0/3977855838 wait complete. 2023-10-03T10:20:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.661+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8814120880 con 0x7f8814133420 2023-10-03T10:20:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.661+0000 7f880a7fc700 1 -- 172.21.15.19:0/3306394196 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8810021070 con 0x7f8814133420 2023-10-03T10:20:23.661 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 msgr2=0x7f881409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f881000ebe0 tx=0x7f881000eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 shutdown_connections 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8814134260 0x7f881409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8814133420 0x7f881409c480 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 --2- 172.21.15.19:0/3306394196 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8814133e30 0x7f881409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 >> 172.21.15.19:0/3306394196 conn(0x7f88140a4210 msgr2=0x7f88141301c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 shutdown_connections 2023-10-03T10:20:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:23.663+0000 7f881bc43700 1 -- 172.21.15.19:0/3306394196 wait complete. 2023-10-03T10:20:23.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:23.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:24.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:24.635 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:24.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:24.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.677+0000 7f8c04382700 1 Processor -- start 2023-10-03T10:20:24.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.677+0000 7f8c04382700 1 -- start start 2023-10-03T10:20:24.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c04382700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09d6f0 0x7f8bfc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c04382700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.678 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:24.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c04382700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc09f130 con 0x7f8bfc09e410 2023-10-03T10:20:24.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c04382700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc09f520 con 0x7f8bfc09d6f0 2023-10-03T10:20:24.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c04382700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc09e930 con 0x7f8bfc09e000 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c0291f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8bfc09e410 0x7f8bfc130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59236/0 (socket says 172.21.15.19:59236) 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c0291f700 1 -- 172.21.15.19:0/1446269831 learned_addr learned my addr 172.21.15.19:0/1446269831 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c0191d700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.678+0000 7f8c0211e700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09d6f0 0x7f8bfc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0191d700 1 -- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09d6f0 msgr2=0x7f8bfc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0191d700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09d6f0 0x7f8bfc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0191d700 1 -- 172.21.15.19:0/1446269831 >> v1:172.21.15.19:6789/0 conn(0x7f8bfc09e410 legacy=0x7f8bfc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0191d700 1 -- 172.21.15.19:0/1446269831 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc09b2d0 con 0x7f8bfc09e000 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0191d700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc130660 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b950 tx=0x7f8bec00bc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0d926879d7f2bd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0111c700 1 -- 172.21.15.19:0/1446269831 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec004230 con 0x7f8bfc09e000 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0111c700 1 -- 172.21.15.19:0/1446269831 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec004390 con 0x7f8bfc09e000 2023-10-03T10:20:24.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.679+0000 7f8c0111c700 1 -- 172.21.15.19:0/1446269831 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00c770 con 0x7f8bfc09e000 2023-10-03T10:20:24.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 -- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 msgr2=0x7f8bfc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc130660 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00b950 tx=0x7f8bec00bc60 comp rx=0 tx=0).stop 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 -- 172.21.15.19:0/1446269831 shutdown_connections 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09d6f0 0x7f8bfc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 --2- 172.21.15.19:0/1446269831 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc130660 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 -- 172.21.15.19:0/1446269831 >> 172.21.15.19:0/1446269831 conn(0x7f8bfc066f50 msgr2=0x7f8bfc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 -- 172.21.15.19:0/1446269831 shutdown_connections 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.680+0000 7f8c04382700 1 -- 172.21.15.19:0/1446269831 wait complete. 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.681+0000 7f8c04382700 1 Processor -- start 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.681+0000 7f8c04382700 1 -- start start 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 0x7f8bfc11dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc11e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc120220 con 0x7f8bfc09d6f0 2023-10-03T10:20:24.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc121b10 con 0x7f8bfc09e410 2023-10-03T10:20:24.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c04382700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc09c700 con 0x7f8bfc09e000 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c0291f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c0291f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55652/0 (socket says 172.21.15.19:55652) 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c0291f700 1 -- 172.21.15.19:0/739752293 learned_addr learned my addr 172.21.15.19:0/739752293 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c0191d700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc11e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.682+0000 7f8c0211e700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 0x7f8bfc11dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 -- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 msgr2=0x7f8bfc11e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc11e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 -- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 msgr2=0x7f8bfc11dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 0x7f8bfc11dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 -- 172.21.15.19:0/739752293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec00b550 con 0x7f8bfc09e410 2023-10-03T10:20:24.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0191d700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc11e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0211e700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 0x7f8bfc11dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c0291f700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8002000 tx=0x7f8bf800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf800ac90 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf800adf0 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc0a1d90 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8007310 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.683+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc1212a0 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.684+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8bf8007470 con 0x7f8bfc09e410 2023-10-03T10:20:24.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.684+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8bf803f510 con 0x7f8bfc09e410 2023-10-03T10:20:24.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.685+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc121680 con 0x7f8bfc09e410 2023-10-03T10:20:24.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.692+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8bf8018080 con 0x7f8bfc09e410 2023-10-03T10:20:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.780+0000 7f7c7a9ef700 1 Processor -- start 2023-10-03T10:20:24.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.780+0000 7f7c7a9ef700 1 -- start start 2023-10-03T10:20:24.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c7a9ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 0x7f7c74130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c7a9ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406f680 0x7f7c7406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c7a9ef700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c74130260 con 0x7f7c7406ffd0 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c7a9ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7409a350 con 0x7f7c74130670 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c7a9ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74071ff0 con 0x7f7c7406f680 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c73fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 0x7f7c74130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c78f8c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7c7406ffd0 0x7f7c74137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59244/0 (socket says 172.21.15.19:59244) 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c78f8c700 1 -- 172.21.15.19:0/3941306113 learned_addr learned my addr 172.21.15.19:0/3941306113 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.781+0000 7f7c737fe700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406f680 0x7f7c7406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c72ffd700 1 -- 172.21.15.19:0/3941306113 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122304473 0 0) 0x7f7c74130260 con 0x7f7c7406ffd0 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c72ffd700 1 -- 172.21.15.19:0/3941306113 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c5c0035b0 con 0x7f7c7406ffd0 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c73fff700 1 -- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406f680 msgr2=0x7f7c7406fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:24.782 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c73fff700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406f680 0x7f7c7406fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c73fff700 1 -- 172.21.15.19:0/3941306113 >> v1:172.21.15.19:6789/0 conn(0x7f7c7406ffd0 legacy=0x7f7c74137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c73fff700 1 -- 172.21.15.19:0/3941306113 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74070470 con 0x7f7c74130670 2023-10-03T10:20:24.783 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c73fff700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 0x7f7c74130a40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009870 tx=0x7f7c64009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa9dacb1212d73d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c72ffd700 1 -- 172.21.15.19:0/3941306113 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64011830 con 0x7f7c74130670 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c72ffd700 1 -- 172.21.15.19:0/3941306113 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64011990 con 0x7f7c74130670 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.782+0000 7f7c72ffd700 1 -- 172.21.15.19:0/3941306113 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64011d00 con 0x7f7c74130670 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 msgr2=0x7f7c74130a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 0x7f7c74130a40 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009870 tx=0x7f7c64009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/3941306113 shutdown_connections 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c74130670 0x7f7c74130a40 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/3941306113 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406f680 0x7f7c7406fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/3941306113 >> 172.21.15.19:0/3941306113 conn(0x7f7c740a2aa0 msgr2=0x7f7c740a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:24.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.783+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/3941306113 shutdown_connections 2023-10-03T10:20:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.784+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/3941306113 wait complete. 2023-10-03T10:20:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.785+0000 7f7c7a9ef700 1 Processor -- start 2023-10-03T10:20:24.785 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.785+0000 7f7c7a9ef700 1 -- start start 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 0x7f7c7411eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74130670 0x7f7c7411f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74071820 con 0x7f7c74130670 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74120720 con 0x7f7c7406f680 2023-10-03T10:20:24.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c7a9ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74122240 con 0x7f7c7406ffd0 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 0x7f7c7411eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c73fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c737fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 0x7f7c7411eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40182/0 (socket says 172.21.15.19:40182) 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c73fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55662/0 (socket says 172.21.15.19:55662) 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c737fe700 1 -- 172.21.15.19:0/629070734 learned_addr learned my addr 172.21.15.19:0/629070734 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:24.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.786+0000 7f7c78f8c700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74130670 0x7f7c7411f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 -- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 msgr2=0x7f7c7411eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 0x7f7c7411eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 -- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74130670 msgr2=0x7f7c7411f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74130670 0x7f7c7411f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 -- 172.21.15.19:0/629070734 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640094a0 con 0x7f7c7406f680 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c73fff700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009870 tx=0x7f7c64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64004550 con 0x7f7c7406f680 2023-10-03T10:20:24.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c640036a0 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c74122520 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003a50 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.787+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74122a20 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.789+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74074ea0 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.789+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7c64003bb0 con 0x7f7c7406f680 2023-10-03T10:20:24.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.789+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7c64041ad0 con 0x7f7c7406f680 2023-10-03T10:20:24.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.794+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7c6402c350 con 0x7f7c7406f680 2023-10-03T10:20:24.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 Processor -- start 2023-10-03T10:20:24.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 Processor -- start 2023-10-03T10:20:24.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 -- start start 2023-10-03T10:20:24.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 -- start start 2023-10-03T10:20:24.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 0x7f5ebc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 0x7f5ebc13b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0a2a70 con 0x7f5ebc0a0a30 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0a01d0 con 0x7f5ebc138d80 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f5ec3503700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc09e2b0 con 0x7f5ebc09d630 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 0x7f50880a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f50880a12d0 0x7f5088134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508809ea10 con 0x7f508809d5c0 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508809e210 con 0x7f50880a12d0 2023-10-03T10:20:24.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.824+0000 7f508cb71700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50880a26f0 con 0x7f50880a09c0 2023-10-03T10:20:24.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec1aa0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 0x7f5ebc13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec1aa0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 0x7f5ebc13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55586/0 (socket says 172.21.15.19:55586) 2023-10-03T10:20:24.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec1aa0700 1 -- 172.21.15.19:0/152210940 learned_addr learned my addr 172.21.15.19:0/152210940 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:24.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec0a9e700 1 --2- 172.21.15.19:0/152210940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 0x7f5ebc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.827 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5085d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f508809d5c0 0x7f5088133920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59252/0 (socket says 172.21.15.19:59252) 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5085d9b700 1 -- 172.21.15.19:0/388026402 learned_addr learned my addr 172.21.15.19:0/388026402 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f508659c700 1 --2- 172.21.15.19:0/388026402 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 0x7f50880a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec0a9e700 1 -- 172.21.15.19:0/152210940 >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 msgr2=0x7f5ebc13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec0a9e700 1 --2- 172.21.15.19:0/152210940 >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 0x7f5ebc13b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec0a9e700 1 -- 172.21.15.19:0/152210940 >> v1:172.21.15.19:6789/0 conn(0x7f5ebc0a0a30 legacy=0x7f5ebc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5ec0a9e700 1 -- 172.21.15.19:0/152210940 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc09dc50 con 0x7f5ebc09d630 2023-10-03T10:20:24.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f5086d9d700 1 --2- 172.21.15.19:0/388026402 >> v2:172.21.15.19:3300/0 conn(0x7f50880a12d0 0x7f5088134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f508659c700 1 -- 172.21.15.19:0/388026402 >> v2:172.21.15.19:3300/0 conn(0x7f50880a12d0 msgr2=0x7f5088134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f508659c700 1 --2- 172.21.15.19:0/388026402 >> v2:172.21.15.19:3300/0 conn(0x7f50880a12d0 0x7f5088134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f508659c700 1 -- 172.21.15.19:0/388026402 >> v1:172.21.15.19:6789/0 conn(0x7f508809d5c0 legacy=0x7f5088133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.825+0000 7f508659c700 1 -- 172.21.15.19:0/388026402 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508809db70 con 0x7f50880a09c0 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f5ec0a9e700 1 --2- 172.21.15.19:0/152210940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 0x7f5ebc0a1510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009840 tx=0x7f5eac009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e004f78d4c206dae server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.829 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f508659c700 1 --2- 172.21.15.19:0/388026402 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 0x7f50880a0d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5078009840 tx=0x7f5078009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dedeef7200fc020d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f5eb3fff700 1 -- 172.21.15.19:0/152210940 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011830 con 0x7f5ebc09d630 2023-10-03T10:20:24.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f5eb3fff700 1 -- 172.21.15.19:0/152210940 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eac011990 con 0x7f5ebc09d630 2023-10-03T10:20:24.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f508559a700 1 -- 172.21.15.19:0/388026402 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078011830 con 0x7f50880a09c0 2023-10-03T10:20:24.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f5eb3fff700 1 -- 172.21.15.19:0/152210940 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eac011d20 con 0x7f5ebc09d630 2023-10-03T10:20:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f508559a700 1 -- 172.21.15.19:0/388026402 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5078011990 con 0x7f50880a09c0 2023-10-03T10:20:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.826+0000 7f508559a700 1 -- 172.21.15.19:0/388026402 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078011d20 con 0x7f50880a09c0 2023-10-03T10:20:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 -- 172.21.15.19:0/388026402 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 msgr2=0x7f50880a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 --2- 172.21.15.19:0/388026402 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 0x7f50880a0d90 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5078009840 tx=0x7f5078009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:24.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 -- 172.21.15.19:0/388026402 shutdown_connections 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 --2- 172.21.15.19:0/388026402 >> v2:172.21.15.19:3300/0 conn(0x7f50880a12d0 0x7f5088134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 --2- 172.21.15.19:0/388026402 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a09c0 0x7f50880a0d90 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 -- 172.21.15.19:0/388026402 >> 172.21.15.19:0/388026402 conn(0x7f50880a2fe0 msgr2=0x7f50880a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 -- 172.21.15.19:0/388026402 shutdown_connections 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f508cb71700 1 -- 172.21.15.19:0/388026402 wait complete. 2023-10-03T10:20:24.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 -- 172.21.15.19:0/152210940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 msgr2=0x7f5ebc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 --2- 172.21.15.19:0/152210940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 0x7f5ebc0a1510 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009840 tx=0x7f5eac009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 -- 172.21.15.19:0/152210940 shutdown_connections 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 --2- 172.21.15.19:0/152210940 >> v2:172.21.15.19:3300/0 conn(0x7f5ebc138d80 0x7f5ebc13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 --2- 172.21.15.19:0/152210940 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc09d630 0x7f5ebc0a1510 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 -- 172.21.15.19:0/152210940 >> 172.21.15.19:0/152210940 conn(0x7f5ebc0a3050 msgr2=0x7f5ebc0a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 -- 172.21.15.19:0/152210940 shutdown_connections 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.827+0000 7f5ec3503700 1 -- 172.21.15.19:0/152210940 wait complete. 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.828+0000 7f508cb71700 1 Processor -- start 2023-10-03T10:20:24.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.828+0000 7f508cb71700 1 -- start start 2023-10-03T10:20:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5ec3503700 1 Processor -- start 2023-10-03T10:20:24.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5ec3503700 1 -- start start 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f508809d5c0 0x7f5088133f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50880a09c0 0x7f508813b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5088139070 con 0x7f508809d5c0 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508813a720 con 0x7f50880a09c0 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f508cb71700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5088138780 con 0x7f50880a12d0 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40216/0 (socket says 172.21.15.19:40216) 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 -- 172.21.15.19:0/1557704922 learned_addr learned my addr 172.21.15.19:0/1557704922 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:24.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 -- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50880a09c0 msgr2=0x7f508813b270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50880a09c0 0x7f508813b270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5ec3503700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ebc09d630 0x7f5ebc133a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 -- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f508809d5c0 msgr2=0x7f5088133f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f508809d5c0 0x7f5088133f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5086d9d700 1 -- 172.21.15.19:0/1557704922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780094a0 con 0x7f50880a12d0 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.829+0000 7f5ec3503700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ebc0a0a30 0x7f5ebc133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec3503700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec3503700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc137290 con 0x7f5ebc09d630 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec3503700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc138110 con 0x7f5ebc0a0a30 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec3503700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc134e60 con 0x7f5ebc138d80 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5086d9d700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5080007e70 tx=0x7f508000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40222/0 (socket says 172.21.15.19:40222) 2023-10-03T10:20:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 -- 172.21.15.19:0/3446074639 learned_addr learned my addr 172.21.15.19:0/3446074639 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000ee50 con 0x7f50880a12d0 2023-10-03T10:20:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5080014420 con 0x7f50880a12d0 2023-10-03T10:20:24.838 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50800147b0 con 0x7f50880a12d0 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 -- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ebc0a0a30 msgr2=0x7f5ebc133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ebc0a0a30 0x7f5ebc133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 -- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ebc09d630 msgr2=0x7f5ebc133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ebc09d630 0x7f5ebc133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f5ec1aa0700 1 -- 172.21.15.19:0/3446074639 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac0094a0 con 0x7f5ebc138d80 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508809cd10 con 0x7f50880a12d0 2023-10-03T10:20:24.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.830+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508809cec0 con 0x7f50880a12d0 2023-10-03T10:20:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.831+0000 7f5ec1aa0700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009d60 tx=0x7f5eb400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.832+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508813c680 con 0x7f50880a12d0 2023-10-03T10:20:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.832+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5080014910 con 0x7f50880a12d0 2023-10-03T10:20:24.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.832+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f508003fe60 con 0x7f50880a12d0 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.836+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4003c20 con 0x7f5ebc138d80 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.836+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc1374f0 con 0x7f5ebc138d80 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.836+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc0a0410 con 0x7f5ebc138d80 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.837+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc0747f0 con 0x7f5ebc138d80 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.837+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400f040 con 0x7f5ebc138d80 2023-10-03T10:20:24.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.837+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400c930 con 0x7f5ebc138d80 2023-10-03T10:20:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.837+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f508813c680 con 0x7f50880a12d0 2023-10-03T10:20:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.838+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5eb400ca90 con 0x7f5ebc138d80 2023-10-03T10:20:24.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.838+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5eb40408c0 con 0x7f5ebc138d80 2023-10-03T10:20:24.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.847+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5eb40137f0 con 0x7f5ebc138d80 2023-10-03T10:20:24.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.911+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8bfc074ea0 con 0x7f8bfc09e410 2023-10-03T10:20:24.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.911+0000 7f8bf2ffd700 1 -- 172.21.15.19:0/739752293 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8bf801c3b0 con 0x7f8bfc09e410 2023-10-03T10:20:24.911 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:24.914 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.914+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 msgr2=0x7f8bfc11ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8002000 tx=0x7f8bf800a340 comp rx=0 tx=0).stop 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 shutdown_connections 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8bfc09e410 0x7f8bfc11ea70 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bfc09d6f0 0x7f8bfc11dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 --2- 172.21.15.19:0/739752293 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8bfc09e000 0x7f8bfc11e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 >> 172.21.15.19:0/739752293 conn(0x7f8bfc066f50 msgr2=0x7f8bfc06f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 shutdown_connections 2023-10-03T10:20:24.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:24.915+0000 7f8c04382700 1 -- 172.21.15.19:0/739752293 wait complete. 2023-10-03T10:20:24.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:25.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.008+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c74072210 con 0x7f7c7406f680 2023-10-03T10:20:25.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.008+0000 7f7c70ff9700 1 -- 172.21.15.19:0/629070734 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c64015070 con 0x7f7c7406f680 2023-10-03T10:20:25.008 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:25.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 msgr2=0x7f7c7411eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:25.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009870 tx=0x7f7c64004750 comp rx=0 tx=0).stop 2023-10-03T10:20:25.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 shutdown_connections 2023-10-03T10:20:25.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74130670 0x7f7c7411f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7c7406f680 0x7f7c7411eab0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 --2- 172.21.15.19:0/629070734 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7c7406ffd0 0x7f7c7411eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 >> 172.21.15.19:0/629070734 conn(0x7f7c740a2aa0 msgr2=0x7f7c7412d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:25.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 shutdown_connections 2023-10-03T10:20:25.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.010+0000 7f7c7a9ef700 1 -- 172.21.15.19:0/629070734 wait complete. 2023-10-03T10:20:25.024 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.050+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f508813c680 con 0x7f50880a12d0 2023-10-03T10:20:25.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.051+0000 7f5076ffd700 1 -- 172.21.15.19:0/1557704922 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f508813c680 con 0x7f50880a12d0 2023-10-03T10:20:25.050 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 msgr2=0x7f508813b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f5080007e70 tx=0x7f508000e3c0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 shutdown_connections 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f50880a12d0 0x7f508813b7b0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f508809d5c0 0x7f5088133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 --2- 172.21.15.19:0/1557704922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f50880a09c0 0x7f508813b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 >> 172.21.15.19:0/1557704922 conn(0x7f50880a2fe0 msgr2=0x7f508809b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 shutdown_connections 2023-10-03T10:20:25.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.053+0000 7f508cb71700 1 -- 172.21.15.19:0/1557704922 wait complete. 2023-10-03T10:20:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.065+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5ebc072980 con 0x7f5ebc138d80 2023-10-03T10:20:25.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.066+0000 7f5eb1ffb700 1 -- 172.21.15.19:0/3446074639 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5eb402c090 con 0x7f5ebc138d80 2023-10-03T10:20:25.066 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:25.066 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 msgr2=0x7f5ebc134480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5eb4009d60 tx=0x7f5eb400c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 shutdown_connections 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ebc138d80 0x7f5ebc134480 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ebc09d630 0x7f5ebc133a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 --2- 172.21.15.19:0/3446074639 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ebc0a0a30 0x7f5ebc133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 >> 172.21.15.19:0/3446074639 conn(0x7f5ebc0a3050 msgr2=0x7f5ebc09ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 shutdown_connections 2023-10-03T10:20:25.069 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:25.068+0000 7f5ec3503700 1 -- 172.21.15.19:0/3446074639 wait complete. 2023-10-03T10:20:25.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:25.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:26.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:26.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.081+0000 7f25fb317700 1 Processor -- start 2023-10-03T10:20:26.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 -- start start 2023-10-03T10:20:26.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f25f409e000 0x7f25f4130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f4130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f409f520 con 0x7f25f409e000 2023-10-03T10:20:26.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f409f130 con 0x7f25f409d6f0 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25fb317700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f409e930 con 0x7f25f409e410 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25f88b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f25f409e000 0x7f25f4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25f88b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f25f409e000 0x7f25f4130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55606/0 (socket says 172.21.15.19:55606) 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25f88b2700 1 -- 172.21.15.19:0/1840978973 learned_addr learned my addr 172.21.15.19:0/1840978973 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.082+0000 7f25f90b3700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f98b4700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f4130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 -- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 msgr2=0x7f25f4130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f4130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 -- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 msgr2=0x7f25f409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 -- 172.21.15.19:0/1840978973 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f409b2d0 con 0x7f25f409e000 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25f88b2700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f4130660 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b9d0 tx=0x7f25e400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92380a4cf1abbdb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25ebfff700 1 -- 172.21.15.19:0/1840978973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400cc20 con 0x7f25f409e000 2023-10-03T10:20:26.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25ebfff700 1 -- 172.21.15.19:0/1840978973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e400cd80 con 0x7f25f409e000 2023-10-03T10:20:26.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.083+0000 7f25ebfff700 1 -- 172.21.15.19:0/1840978973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e400f680 con 0x7f25f409e000 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 -- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 msgr2=0x7f25f4130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f4130660 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b9d0 tx=0x7f25e400bce0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 -- 172.21.15.19:0/1840978973 shutdown_connections 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f4130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 --2- 172.21.15.19:0/1840978973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f4130660 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 -- 172.21.15.19:0/1840978973 >> 172.21.15.19:0/1840978973 conn(0x7f25f4066f50 msgr2=0x7f25f409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 -- 172.21.15.19:0/1840978973 shutdown_connections 2023-10-03T10:20:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.084+0000 7f25fb317700 1 -- 172.21.15.19:0/1840978973 wait complete. 2023-10-03T10:20:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 Processor -- start 2023-10-03T10:20:26.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 -- start start 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f411e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f411eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4121c80 con 0x7f25f409e000 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f41205a0 con 0x7f25f409d6f0 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.086+0000 7f25fb317700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f25f4120280 con 0x7f25f409e410 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55690/0 (socket says 172.21.15.19:55690) 2023-10-03T10:20:26.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 -- 172.21.15.19:0/3155666804 learned_addr learned my addr 172.21.15.19:0/3155666804 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f98b4700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f411eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 -- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 msgr2=0x7f25f411eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f411eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 -- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 msgr2=0x7f25f411e600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f411e600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 -- 172.21.15.19:0/3155666804 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e400b600 con 0x7f25f409d6f0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.087+0000 7f25f90b3700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f25f0012ed0 tx=0x7f25f0012f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.088+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0014040 con 0x7f25f409d6f0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.088+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f000f910 con 0x7f25f409d6f0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.088+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f40a1b50 con 0x7f25f409d6f0 2023-10-03T10:20:26.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.088+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f000dbb0 con 0x7f25f409d6f0 2023-10-03T10:20:26.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.088+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4121900 con 0x7f25f409d6f0 2023-10-03T10:20:26.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.089+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4121550 con 0x7f25f409d6f0 2023-10-03T10:20:26.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.089+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f25f000fc80 con 0x7f25f409d6f0 2023-10-03T10:20:26.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.089+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25f0043230 con 0x7f25f409d6f0 2023-10-03T10:20:26.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.094+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f25f000b450 con 0x7f25f409d6f0 2023-10-03T10:20:26.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.179+0000 7fdee3bca700 1 Processor -- start 2023-10-03T10:20:26.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.179+0000 7fdee3bca700 1 -- start start 2023-10-03T10:20:26.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee3bca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09e1d0 0x7fdedc135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee3bca700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdedc135e50 0x7fdedc138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee3bca700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc09f130 con 0x7fdedc09d6f0 2023-10-03T10:20:26.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee3bca700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc09f520 con 0x7fdedc135e50 2023-10-03T10:20:26.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee3bca700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc09e930 con 0x7fdedc09e1d0 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee1966700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdedc09d6f0 0x7fdedc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:59258/0 (socket says 172.21.15.19:59258) 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee1966700 1 -- 172.21.15.19:0/1302706854 learned_addr learned my addr 172.21.15.19:0/1302706854 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.180+0000 7fdee2167700 1 --2- 172.21.15.19:0/1302706854 >> v2:172.21.15.19:3300/0 conn(0x7fdedc135e50 0x7fdedc138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee1165700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09e1d0 0x7fdedc135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee2167700 1 -- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09e1d0 msgr2=0x7fdedc135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee2167700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09e1d0 0x7fdedc135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee2167700 1 -- 172.21.15.19:0/1302706854 >> v1:172.21.15.19:6789/0 conn(0x7fdedc09d6f0 legacy=0x7fdedc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee0964700 1 -- 172.21.15.19:0/1302706854 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370690013 0 0) 0x7fdedc09f130 con 0x7fdedc09d6f0 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee2167700 1 -- 172.21.15.19:0/1302706854 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc09b2d0 con 0x7fdedc135e50 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee2167700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc135e50 0x7fdedc138230 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fded4009dc0 tx=0x7fded400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99cc34dff44bdd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee0964700 1 -- 172.21.15.19:0/1302706854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400e070 con 0x7fdedc135e50 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee0964700 1 -- 172.21.15.19:0/1302706854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400bae0 con 0x7fdedc135e50 2023-10-03T10:20:26.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.181+0000 7fdee0964700 1 -- 172.21.15.19:0/1302706854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400be90 con 0x7fdedc135e50 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.182+0000 7fdee3bca700 1 -- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc135e50 msgr2=0x7fdedc138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.182+0000 7fdee3bca700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc135e50 0x7fdedc138230 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fded4009dc0 tx=0x7fded400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 -- 172.21.15.19:0/1302706854 shutdown_connections 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc135e50 0x7fdedc138230 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 --2- 172.21.15.19:0/1302706854 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09e1d0 0x7fdedc135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 -- 172.21.15.19:0/1302706854 >> 172.21.15.19:0/1302706854 conn(0x7fdedc066f50 msgr2=0x7fdedc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 -- 172.21.15.19:0/1302706854 shutdown_connections 2023-10-03T10:20:26.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.183+0000 7fdee3bca700 1 -- 172.21.15.19:0/1302706854 wait complete. 2023-10-03T10:20:26.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.184+0000 7fdee3bca700 1 Processor -- start 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.184+0000 7fdee3bca700 1 -- start start 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 0x7fdedc11b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc09e1d0 0x7fdedc11b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 0x7fdedc11bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc127dd0 con 0x7fdedc09e1d0 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc11ceb0 con 0x7fdedc135e50 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee3bca700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc11d350 con 0x7fdedc09d6f0 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee2167700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 0x7fdedc11bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee2167700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 0x7fdedc11bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55696/0 (socket says 172.21.15.19:55696) 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 0x7fdedc11b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee2167700 1 -- 172.21.15.19:0/3358392995 learned_addr learned my addr 172.21.15.19:0/3358392995 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1165700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc09e1d0 0x7fdedc11b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 -- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 msgr2=0x7fdedc11bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 0x7fdedc11bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 -- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc09e1d0 msgr2=0x7fdedc11b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc09e1d0 0x7fdedc11b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.185+0000 7fdee1966700 1 -- 172.21.15.19:0/3358392995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded4009a70 con 0x7fdedc09d6f0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fdee1966700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 0x7fdedc11b1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fded800c470 tx=0x7fded800c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8004c80 con 0x7fdedc09d6f0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8004de0 con 0x7fdedc09d6f0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0a20b0 con 0x7fdedc09d6f0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8007310 con 0x7fdedc09d6f0 2023-10-03T10:20:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.186+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc11d590 con 0x7fdedc09d6f0 2023-10-03T10:20:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.187+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc074ea0 con 0x7fdedc09d6f0 2023-10-03T10:20:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.188+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fded8007470 con 0x7fdedc09d6f0 2023-10-03T10:20:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.188+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fded8040bc0 con 0x7fdedc09d6f0 2023-10-03T10:20:26.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.197+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fded8044060 con 0x7fdedc09d6f0 2023-10-03T10:20:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 Processor -- start 2023-10-03T10:20:26.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 -- start start 2023-10-03T10:20:26.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f04480a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04480a1340 0x7f0448133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044809edd0 con 0x7f04480a1340 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044809e1f0 con 0x7f04480a0a30 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.219+0000 7f045025b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f044809dc50 con 0x7f0448133fa0 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04480a1340 0x7f0448133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044e7f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f04480a1340 0x7f0448133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55640/0 (socket says 172.21.15.19:55640) 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044e7f8700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40256/0 (socket says 172.21.15.19:40256) 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 -- 172.21.15.19:0/1925239574 learned_addr learned my addr 172.21.15.19:0/1925239574 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044dff7700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f04480a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 -- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 msgr2=0x7f0448134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 -- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 msgr2=0x7f04480a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f04480a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 -- 172.21.15.19:0/1925239574 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480a1fe0 con 0x7f04480a1340 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044e7f8700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.220+0000 7f044d7f6700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04480a1340 0x7f0448133a60 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f04380098f0 tx=0x7f0438009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=429840d729320e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f044cff5700 1 -- 172.21.15.19:0/1925239574 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011830 con 0x7f04480a1340 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f044cff5700 1 -- 172.21.15.19:0/1925239574 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438011990 con 0x7f04480a1340 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f044cff5700 1 -- 172.21.15.19:0/1925239574 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011d20 con 0x7f04480a1340 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 -- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04480a1340 msgr2=0x7f0448133a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04480a1340 0x7f0448133a60 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f04380098f0 tx=0x7f0438009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 -- 172.21.15.19:0/1925239574 shutdown_connections 2023-10-03T10:20:26.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f04480a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0448133fa0 0x7f0448134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.221+0000 7f045025b700 1 --2- 172.21.15.19:0/1925239574 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f04480a1340 0x7f0448133a60 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.222+0000 7f045025b700 1 -- 172.21.15.19:0/1925239574 >> 172.21.15.19:0/1925239574 conn(0x7f04480a6550 msgr2=0x7f04480a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.222+0000 7f045025b700 1 -- 172.21.15.19:0/1925239574 shutdown_connections 2023-10-03T10:20:26.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.222+0000 7f045025b700 1 -- 172.21.15.19:0/1925239574 wait complete. 2023-10-03T10:20:26.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.223+0000 7f045025b700 1 Processor -- start 2023-10-03T10:20:26.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.223+0000 7f045025b700 1 -- start start 2023-10-03T10:20:26.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f044811df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 0x7f044811e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04481223e0 con 0x7f0448133fa0 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044811fb10 con 0x7f04480a0a30 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f045025b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0448120130 con 0x7f04480a1340 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:40266/0 (socket says 172.21.15.19:40266) 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 -- 172.21.15.19:0/2225703611 learned_addr learned my addr 172.21.15.19:0/2225703611 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044dff7700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f044811df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044e7f8700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 0x7f044811e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 -- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 msgr2=0x7f044811df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f044811df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 -- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 msgr2=0x7f044811e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 0x7f044811e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044d7f6700 1 -- 172.21.15.19:0/2225703611 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0438009550 con 0x7f04480a1340 2023-10-03T10:20:26.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.224+0000 7f044e7f8700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 0x7f044811e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:26.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.225+0000 7f044d7f6700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0438009f50 tx=0x7f0438004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.226+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438004300 con 0x7f04480a1340 2023-10-03T10:20:26.226 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.226+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043801f070 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.226+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044811f340 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.226+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380036a0 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.226+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04481211b0 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.227+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0438021030 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.227+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f04380408a0 con 0x7f04480a1340 2023-10-03T10:20:26.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.227+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04480a3690 con 0x7f04480a1340 2023-10-03T10:20:26.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.235+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0438015080 con 0x7f04480a1340 2023-10-03T10:20:26.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.241+0000 7faed67d1700 1 Processor -- start 2023-10-03T10:20:26.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.241+0000 7faed67d1700 1 -- start start 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.241+0000 7faed67d1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.241+0000 7faed67d1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7faed0131d10 0x7faed0139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.241+0000 7faed67d1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed009ece0 con 0x7faed006b080 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faed67d1700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed009e760 con 0x7faed0131d10 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faed67d1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed009e040 con 0x7faed006a770 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:55730/0 (socket says 172.21.15.19:55730) 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 -- 172.21.15.19:0/1296334107 learned_addr learned my addr 172.21.15.19:0/1296334107 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faed4d6e700 1 --2- 172.21.15.19:0/1296334107 >> v2:172.21.15.19:3300/0 conn(0x7faed0131d10 0x7faed0139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 -- 172.21.15.19:0/1296334107 >> v2:172.21.15.19:3300/0 conn(0x7faed0131d10 msgr2=0x7faed0139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 --2- 172.21.15.19:0/1296334107 >> v2:172.21.15.19:3300/0 conn(0x7faed0131d10 0x7faed0139860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 -- 172.21.15.19:0/1296334107 >> v1:172.21.15.19:6789/0 conn(0x7faed006b080 legacy=0x7faed0131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.242+0000 7faecffff700 1 -- 172.21.15.19:0/1296334107 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed009f630 con 0x7faed006a770 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.243+0000 7faecffff700 1 --2- 172.21.15.19:0/1296334107 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faec00098f0 tx=0x7faec0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1b60fbec8d698a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.243+0000 7faeceffd700 1 -- 172.21.15.19:0/1296334107 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011830 con 0x7faed006a770 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.243+0000 7faeceffd700 1 -- 172.21.15.19:0/1296334107 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0011990 con 0x7faed006a770 2023-10-03T10:20:26.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.243+0000 7faeceffd700 1 -- 172.21.15.19:0/1296334107 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0011d20 con 0x7faed006a770 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 -- 172.21.15.19:0/1296334107 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 msgr2=0x7faed006ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 --2- 172.21.15.19:0/1296334107 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7faec00098f0 tx=0x7faec0009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 -- 172.21.15.19:0/1296334107 shutdown_connections 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 --2- 172.21.15.19:0/1296334107 >> v2:172.21.15.19:3300/0 conn(0x7faed0131d10 0x7faed0139860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 --2- 172.21.15.19:0/1296334107 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006a770 0x7faed006ab40 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 -- 172.21.15.19:0/1296334107 >> 172.21.15.19:0/1296334107 conn(0x7faed0066f50 msgr2=0x7faed009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 -- 172.21.15.19:0/1296334107 shutdown_connections 2023-10-03T10:20:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.244+0000 7faed67d1700 1 -- 172.21.15.19:0/1296334107 wait complete. 2023-10-03T10:20:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.245+0000 7faed67d1700 1 Processor -- start 2023-10-03T10:20:26.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 -- start start 2023-10-03T10:20:26.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faed006a770 0x7faed011c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006b080 0x7faed011c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed011fbc0 con 0x7faed0131d10 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed011e030 con 0x7faed006b080 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.246+0000 7faed67d1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faed011f900 con 0x7faed006a770 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55662/0 (socket says 172.21.15.19:55662) 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 -- 172.21.15.19:0/1652008692 learned_addr learned my addr 172.21.15.19:0/1652008692 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faecffff700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faed006a770 0x7faed011c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faecf7fe700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006b080 0x7faed011c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 -- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faed006a770 msgr2=0x7faed011c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faed006a770 0x7faed011c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 -- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006b080 msgr2=0x7faed011c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006b080 0x7faed011c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 -- 172.21.15.19:0/1652008692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009550 con 0x7faed0131d10 2023-10-03T10:20:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed4d6e700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faec800efc0 tx=0x7faec800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:26.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8009ea0 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed01312f0 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800f040 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8014480 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.247+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0130e30 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.249+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed011fe00 con 0x7faed0131d10 2023-10-03T10:20:26.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.250+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faec80145e0 con 0x7faed0131d10 2023-10-03T10:20:26.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.250+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faec8040000 con 0x7faed0131d10 2023-10-03T10:20:26.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.259+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faec801a8b0 con 0x7faed0131d10 2023-10-03T10:20:26.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.345+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f25f4074ea0 con 0x7f25f409d6f0 2023-10-03T10:20:26.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.345+0000 7f25e9ffb700 1 -- 172.21.15.19:0/3155666804 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f25f0020370 con 0x7f25f409d6f0 2023-10-03T10:20:26.345 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:26.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.348+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 msgr2=0x7f25f411e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.348+0000 7f25fb317700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f25f0012ed0 tx=0x7f25f0012f00 comp rx=0 tx=0).stop 2023-10-03T10:20:26.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.349+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 shutdown_connections 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.349+0000 7f25fb317700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f25f409e410 0x7f25f411eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.349+0000 7f25fb317700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f25f409d6f0 0x7f25f411e0c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.349+0000 7f25fb317700 1 --2- 172.21.15.19:0/3155666804 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25f409e000 0x7f25f411e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.349+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 >> 172.21.15.19:0/3155666804 conn(0x7f25f4066f50 msgr2=0x7f25f406a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.350+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 shutdown_connections 2023-10-03T10:20:26.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.350+0000 7f25fb317700 1 -- 172.21.15.19:0/3155666804 wait complete. 2023-10-03T10:20:26.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:26.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.409+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdedc06c360 con 0x7fdedc09d6f0 2023-10-03T10:20:26.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.409+0000 7fded27fc700 1 -- 172.21.15.19:0/3358392995 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fded802e090 con 0x7fdedc09d6f0 2023-10-03T10:20:26.409 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.411+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 msgr2=0x7fdedc11b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.411+0000 7fdee3bca700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 0x7fdedc11b1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fded800c470 tx=0x7fded800c780 comp rx=0 tx=0).stop 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 shutdown_connections 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdedc135e50 0x7fdedc11bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdedc09d6f0 0x7fdedc11b1e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 --2- 172.21.15.19:0/3358392995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdedc09e1d0 0x7fdedc11b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 >> 172.21.15.19:0/3358392995 conn(0x7fdedc066f50 msgr2=0x7fdedc132680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 shutdown_connections 2023-10-03T10:20:26.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.412+0000 7fdee3bca700 1 -- 172.21.15.19:0/3358392995 wait complete. 2023-10-03T10:20:26.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.455+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f04480a0220 con 0x7f04480a1340 2023-10-03T10:20:26.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.455+0000 7f043e7fc700 1 -- 172.21.15.19:0/2225703611 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0438006d80 con 0x7f04480a1340 2023-10-03T10:20:26.455 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 msgr2=0x7f044811e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0438009f50 tx=0x7f0438004750 comp rx=0 tx=0).stop 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 shutdown_connections 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0448133fa0 0x7f044811e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f04480a0a30 0x7f044811df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 --2- 172.21.15.19:0/2225703611 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f04480a1340 0x7f044811e440 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 >> 172.21.15.19:0/2225703611 conn(0x7f04480a6550 msgr2=0x7f0448132fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 shutdown_connections 2023-10-03T10:20:26.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.458+0000 7f045025b700 1 -- 172.21.15.19:0/2225703611 wait complete. 2023-10-03T10:20:26.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:26.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.485+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7faed0074ea0 con 0x7faed0131d10 2023-10-03T10:20:26.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.485+0000 7faeccff9700 1 -- 172.21.15.19:0/1652008692 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faec8018030 con 0x7faed0131d10 2023-10-03T10:20:26.485 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 msgr2=0x7faed011ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faec800efc0 tx=0x7faec800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 shutdown_connections 2023-10-03T10:20:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faed0131d10 0x7faed011ce00 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faed006a770 0x7faed011c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 --2- 172.21.15.19:0/1652008692 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faed006b080 0x7faed011c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 >> 172.21.15.19:0/1652008692 conn(0x7faed0066f50 msgr2=0x7faed00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 shutdown_connections 2023-10-03T10:20:26.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:26.487+0000 7faed67d1700 1 -- 172.21.15.19:0/1652008692 wait complete. 2023-10-03T10:20:26.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:27.365 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:27.426 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:27.472 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:27.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:27.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 Processor -- start 2023-10-03T10:20:27.518 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 -- start start 2023-10-03T10:20:27.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 0x7f95a009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.519 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a0133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a006b460 con 0x7f95a009e000 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a009b120 con 0x7f95a009d6f0 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.519+0000 7f95a7e6d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a009a7e0 con 0x7f95a009e410 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5c09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 0x7f95a009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5408700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5c09700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 0x7f95a009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52588/0 (socket says 172.21.15.19:52588) 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5408700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47974/0 (socket says 172.21.15.19:47974) 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5c09700 1 -- 172.21.15.19:0/2706788850 learned_addr learned my addr 172.21.15.19:0/2706788850 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.520 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a0133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 -- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 msgr2=0x7f95a009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:27.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 0x7f95a009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.521 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 -- 172.21.15.19:0/2706788850 >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 msgr2=0x7f95a01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 --2- 172.21.15.19:0/2706788850 >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 -- 172.21.15.19:0/2706788850 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a009a500 con 0x7f95a009e410 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a5408700 1 --2- 172.21.15.19:0/2706788850 >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.520+0000 7f95a640a700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a0133f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9598009dc0 tx=0x7f959800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cba3ccf72f3f05c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.521+0000 7f95a4c07700 1 -- 172.21.15.19:0/2706788850 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800e070 con 0x7f95a009e410 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.521+0000 7f95a4c07700 1 -- 172.21.15.19:0/2706788850 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959800bae0 con 0x7f95a009e410 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.521+0000 7f95a4c07700 1 -- 172.21.15.19:0/2706788850 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959800be90 con 0x7f95a009e410 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.521+0000 7f95a7e6d700 1 -- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 msgr2=0x7f95a0133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.521+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a0133f30 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f9598009dc0 tx=0x7f959800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 -- 172.21.15.19:0/2706788850 shutdown_connections 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009d6f0 0x7f95a009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.522 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/2706788850 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a0133f30 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/2706788850 >> v2:172.21.15.19:3300/0 conn(0x7f95a009e000 0x7f95a01339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 -- 172.21.15.19:0/2706788850 >> 172.21.15.19:0/2706788850 conn(0x7f95a0066f50 msgr2=0x7f95a009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 -- 172.21.15.19:0/2706788850 shutdown_connections 2023-10-03T10:20:27.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.522+0000 7f95a7e6d700 1 -- 172.21.15.19:0/2706788850 wait complete. 2023-10-03T10:20:27.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.523+0000 7f95a7e6d700 1 Processor -- start 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.523+0000 7f95a7e6d700 1 -- start start 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.523+0000 7f95a7e6d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.523+0000 7f95a7e6d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009e000 0x7f95a01a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a7e6d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a01a6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a7e6d700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01a9870 con 0x7f95a009d6f0 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a7e6d700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01aa210 con 0x7f95a009e000 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a7e6d700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01a9000 con 0x7f95a009e410 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a5c09700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a5c09700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47990/0 (socket says 172.21.15.19:47990) 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a5c09700 1 -- 172.21.15.19:0/1303442737 learned_addr learned my addr 172.21.15.19:0/1303442737 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a01a6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 -- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009e000 msgr2=0x7f95a01a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009e000 0x7f95a01a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.525 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 -- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 msgr2=0x7f95a01a5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 -- 172.21.15.19:0/1303442737 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0094a0 con 0x7f95a009e410 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a5c09700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.524+0000 7f95a640a700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a01a6820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.525+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95980045d0 con 0x7f95a009e410 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.525+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9598020070 con 0x7f95a009e410 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.525+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9598009a70 con 0x7f95a009e410 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.525+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9598027480 con 0x7f95a009e410 2023-10-03T10:20:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.525+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a009c710 con 0x7f95a009e410 2023-10-03T10:20:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.526+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f95980275e0 con 0x7f95a009e410 2023-10-03T10:20:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.526+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a01a79c0 con 0x7f95a009e410 2023-10-03T10:20:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.526+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9598022070 con 0x7f95a009e410 2023-10-03T10:20:27.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.536+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9598046060 con 0x7f95a009e410 2023-10-03T10:20:27.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.575+0000 7f5ac67f4700 1 Processor -- start 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 -- start start 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 0x7f5ac006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 0x7f5ac0137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac012cd90 con 0x7f5ac012f8b0 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac012d330 con 0x7f5ac012cf60 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac67f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0071780 con 0x7f5ac0130430 2023-10-03T10:20:27.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5abf7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f5ac012f8b0 0x7f5ac012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54362/0 (socket says 172.21.15.19:54362) 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5abf7fe700 1 -- 172.21.15.19:0/3551678913 learned_addr learned my addr 172.21.15.19:0/3551678913 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.576+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 0x7f5ac0137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abffff700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 0x7f5ac006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5ac4d91700 1 -- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 msgr2=0x7f5ac006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abeffd700 1 -- 172.21.15.19:0/3551678913 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945796503 0 0) 0x7f5ac012cd90 con 0x7f5ac012f8b0 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 0x7f5ac006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5ac4d91700 1 -- 172.21.15.19:0/3551678913 >> v1:172.21.15.19:6789/0 conn(0x7f5ac012f8b0 legacy=0x7f5ac012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5ac4d91700 1 -- 172.21.15.19:0/3551678913 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0071a40 con 0x7f5ac0130430 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abffff700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 0x7f5ac006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 0x7f5ac0137c30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800ae30 tx=0x7f5ab800b320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c1e63ce8ddcd9de server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abeffd700 1 -- 172.21.15.19:0/3551678913 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8003c20 con 0x7f5ac0130430 2023-10-03T10:20:27.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abeffd700 1 -- 172.21.15.19:0/3551678913 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8003d80 con 0x7f5ac0130430 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.577+0000 7f5abeffd700 1 -- 172.21.15.19:0/3551678913 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800bb20 con 0x7f5ac0130430 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 -- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 msgr2=0x7f5ac0137c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 0x7f5ac0137c30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f5ab800ae30 tx=0x7f5ab800b320 comp rx=0 tx=0).stop 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 -- 172.21.15.19:0/3551678913 shutdown_connections 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac0130430 0x7f5ac0137c30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/3551678913 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012cf60 0x7f5ac006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.578+0000 7f5ac67f4700 1 -- 172.21.15.19:0/3551678913 >> 172.21.15.19:0/3551678913 conn(0x7f5ac00a2aa0 msgr2=0x7f5ac00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.579+0000 7f5ac67f4700 1 -- 172.21.15.19:0/3551678913 shutdown_connections 2023-10-03T10:20:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.579+0000 7f5ac67f4700 1 -- 172.21.15.19:0/3551678913 wait complete. 2023-10-03T10:20:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.580+0000 7f5ac67f4700 1 Processor -- start 2023-10-03T10:20:27.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.580+0000 7f5ac67f4700 1 -- start start 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac012cf60 0x7f5ac009af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac009d390 con 0x7f5ac0130430 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac009cc40 con 0x7f5ac012f8b0 2023-10-03T10:20:27.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac67f4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac0129fa0 con 0x7f5ac012cf60 2023-10-03T10:20:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5abf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac4d91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5abf7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52626/0 (socket says 172.21.15.19:52626) 2023-10-03T10:20:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5ac4d91700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47994/0 (socket says 172.21.15.19:47994) 2023-10-03T10:20:27.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5abf7fe700 1 -- 172.21.15.19:0/2365309647 learned_addr learned my addr 172.21.15.19:0/2365309647 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.581+0000 7f5abffff700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac012cf60 0x7f5ac009af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 -- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac012cf60 msgr2=0x7f5ac009af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac012cf60 0x7f5ac009af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 -- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 msgr2=0x7f5ac009b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 -- 172.21.15.19:0/2365309647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab000f610 con 0x7f5ac0130430 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5abf7fe700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac4d91700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8013000 tx=0x7f5ab8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab800a2e0 con 0x7f5ac0130430 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab800a8a0 con 0x7f5ac0130430 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011480 con 0x7f5ac0130430 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab800aa90 con 0x7f5ac0130430 2023-10-03T10:20:27.583 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.582+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac0129790 con 0x7f5ac0130430 2023-10-03T10:20:27.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.583+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5ab8018070 con 0x7f5ac0130430 2023-10-03T10:20:27.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.584+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5ab8040b50 con 0x7f5ac0130430 2023-10-03T10:20:27.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.584+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac00705f0 con 0x7f5ac0130430 2023-10-03T10:20:27.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.589+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5ab801f070 con 0x7f5ac0130430 2023-10-03T10:20:27.623 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.624+0000 7f71bae8a700 1 Processor -- start 2023-10-03T10:20:27.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.624+0000 7f71bae8a700 1 -- start start 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71bae8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71bae8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b406b080 0x7f71b4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71bae8a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b409ece0 con 0x7f71b4131b40 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71bae8a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b409e760 con 0x7f71b406a770 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71bae8a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71b409e040 con 0x7f71b406b080 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52638/0 (socket says 172.21.15.19:52638) 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 -- 172.21.15.19:0/2974959832 learned_addr learned my addr 172.21.15.19:0/2974959832 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b3fff700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b406b080 0x7f71b4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 -- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b406b080 msgr2=0x7f71b4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b406b080 0x7f71b4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 -- 172.21.15.19:0/2974959832 >> v1:172.21.15.19:6789/0 conn(0x7f71b4131b40 legacy=0x7f71b4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 -- 172.21.15.19:0/2974959832 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b409f630 con 0x7f71b406a770 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.625+0000 7f71b8c26700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009920 tx=0x7f71a8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=135a767d62c8ce48 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.626+0000 7f71b37fe700 1 -- 172.21.15.19:0/2974959832 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800ba60 con 0x7f71b406a770 2023-10-03T10:20:27.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.626+0000 7f71b37fe700 1 -- 172.21.15.19:0/2974959832 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800bbc0 con 0x7f71b406a770 2023-10-03T10:20:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.626+0000 7f71b37fe700 1 -- 172.21.15.19:0/2974959832 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8009e70 con 0x7f71b406a770 2023-10-03T10:20:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 -- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 msgr2=0x7f71b406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009920 tx=0x7f71a8009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:27.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 -- 172.21.15.19:0/2974959832 shutdown_connections 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406a770 0x7f71b406ab40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 --2- 172.21.15.19:0/2974959832 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b406b080 0x7f71b4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 -- 172.21.15.19:0/2974959832 >> 172.21.15.19:0/2974959832 conn(0x7f71b4066f50 msgr2=0x7f71b409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 -- 172.21.15.19:0/2974959832 shutdown_connections 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.627+0000 7f71bae8a700 1 -- 172.21.15.19:0/2974959832 wait complete. 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.628+0000 7f71bae8a700 1 Processor -- start 2023-10-03T10:20:27.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.629+0000 7f71bae8a700 1 -- start start 2023-10-03T10:20:27.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.629+0000 7f71bae8a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.629+0000 7f71bae8a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406b080 0x7f71b41c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.629+0000 7f71bae8a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b4131b40 0x7f71b41c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71bae8a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4120490 con 0x7f71b406a770 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71bae8a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4120fb0 con 0x7f71b406b080 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71bae8a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71b4120260 con 0x7f71b4131b40 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48004/0 (socket says 172.21.15.19:48004) 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 -- 172.21.15.19:0/3907536979 learned_addr learned my addr 172.21.15.19:0/3907536979 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b9427700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b4131b40 0x7f71b41c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b3fff700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406b080 0x7f71b41c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 -- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b4131b40 msgr2=0x7f71b41c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b4131b40 0x7f71b41c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 -- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406b080 msgr2=0x7f71b41c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406b080 0x7f71b41c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 -- 172.21.15.19:0/3907536979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009550 con 0x7f71b406a770 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.630+0000 7f71b8c26700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f71a801b040 tx=0x7f71a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.631+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80038a0 con 0x7f71b406a770 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.631+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8003a20 con 0x7f71b406a770 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.631+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b4071e60 con 0x7f71b406a770 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.631+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8003dd0 con 0x7f71b406a770 2023-10-03T10:20:27.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.631+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b4131170 con 0x7f71b406a770 2023-10-03T10:20:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.632+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f71a801f070 con 0x7f71b406a770 2023-10-03T10:20:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.632+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b4121c80 con 0x7f71b406a770 2023-10-03T10:20:27.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.632+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f71a8018600 con 0x7f71b406a770 2023-10-03T10:20:27.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.641+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71a804a060 con 0x7f71b406a770 2023-10-03T10:20:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.668+0000 7f2f78edc700 1 Processor -- start 2023-10-03T10:20:27.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.668+0000 7f2f78edc700 1 -- start start 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f78edc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 0x7f2f74133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f78edc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f78edc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7406bc00 con 0x7f2f74130870 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f78edc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7406c570 con 0x7f2f74133a80 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f78edc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740a0040 con 0x7f2f7412ff20 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f71d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35656/0 (socket says 172.21.15.19:35656) 2023-10-03T10:20:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f71d9b700 1 -- 172.21.15.19:0/83859806 learned_addr learned my addr 172.21.15.19:0/83859806 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.669+0000 7f2f7259c700 1 --2- 172.21.15.19:0/83859806 >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 0x7f2f74133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7159a700 1 -- 172.21.15.19:0/83859806 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104675849 0 0) 0x7f2f7406bc00 con 0x7f2f74130870 2023-10-03T10:20:27.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7159a700 1 -- 172.21.15.19:0/83859806 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f5c0035b0 con 0x7f2f74130870 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f71d9b700 1 -- 172.21.15.19:0/83859806 >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 msgr2=0x7f2f74133e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f71d9b700 1 --2- 172.21.15.19:0/83859806 >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 0x7f2f74133e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f71d9b700 1 -- 172.21.15.19:0/83859806 >> v1:172.21.15.19:6789/0 conn(0x7f2f74130870 legacy=0x7f2f7413a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f71d9b700 1 -- 172.21.15.19:0/83859806 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74133860 con 0x7f2f7412ff20 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f71d9b700 1 --2- 172.21.15.19:0/83859806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2f680098f0 tx=0x7f2f68009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed7093733e3e815 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7259c700 1 --2- 172.21.15.19:0/83859806 >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 0x7f2f74133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7159a700 1 -- 172.21.15.19:0/83859806 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68011830 con 0x7f2f7412ff20 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7159a700 1 -- 172.21.15.19:0/83859806 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68011990 con 0x7f2f7412ff20 2023-10-03T10:20:27.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.670+0000 7f2f7159a700 1 -- 172.21.15.19:0/83859806 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68011d00 con 0x7f2f7412ff20 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 -- 172.21.15.19:0/83859806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 msgr2=0x7f2f74130330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 --2- 172.21.15.19:0/83859806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2f680098f0 tx=0x7f2f68009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 -- 172.21.15.19:0/83859806 shutdown_connections 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 --2- 172.21.15.19:0/83859806 >> v2:172.21.15.19:3300/0 conn(0x7f2f74133a80 0x7f2f74133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 --2- 172.21.15.19:0/83859806 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f7412ff20 0x7f2f74130330 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 -- 172.21.15.19:0/83859806 >> 172.21.15.19:0/83859806 conn(0x7f2f740a4210 msgr2=0x7f2f740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 -- 172.21.15.19:0/83859806 shutdown_connections 2023-10-03T10:20:27.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.671+0000 7f2f78edc700 1 -- 172.21.15.19:0/83859806 wait complete. 2023-10-03T10:20:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 Processor -- start 2023-10-03T10:20:27.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 -- start start 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f74130870 0x7f2f7409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 0x7f2f7409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7411ff00 con 0x7f2f74133a80 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7409ddb0 con 0x7f2f7412ff20 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f78edc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2f740a20a0 con 0x7f2f74130870 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f7259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f7259c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52656/0 (socket says 172.21.15.19:52656) 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f7259c700 1 -- 172.21.15.19:0/377505642 learned_addr learned my addr 172.21.15.19:0/377505642 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.673+0000 7f2f72d9d700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 0x7f2f7409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f71d9b700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f74130870 0x7f2f7409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 -- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f74130870 msgr2=0x7f2f7409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f74130870 0x7f2f7409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 -- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 msgr2=0x7f2f7409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 0x7f2f7409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 -- 172.21.15.19:0/377505642 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f640094a0 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f72d9d700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 0x7f2f7409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f7259c700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400ebe0 tx=0x7f2f6400eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.674+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400c850 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.675+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6400c9b0 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.675+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6400cd40 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.675+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f68009550 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.675+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7411eb70 con 0x7f2f7412ff20 2023-10-03T10:20:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.676+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2f64013470 con 0x7f2f7412ff20 2023-10-03T10:20:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.676+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7411fd40 con 0x7f2f7412ff20 2023-10-03T10:20:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.676+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2f6403f8b0 con 0x7f2f7412ff20 2023-10-03T10:20:27.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.685+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2f64013720 con 0x7f2f7412ff20 2023-10-03T10:20:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.767+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f95a0074ea0 con 0x7f95a009e410 2023-10-03T10:20:27.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.767+0000 7f95967fc700 1 -- 172.21.15.19:0/1303442737 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f959801a970 con 0x7f95a009e410 2023-10-03T10:20:27.767 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.770+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 msgr2=0x7f95a01a6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.770+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a01a6820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f9598016000 tx=0x7f9598004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.772+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 shutdown_connections 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.772+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f95a009e410 0x7f95a01a6820 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.772+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95a009d6f0 0x7f95a01a5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.772+0000 7f95a7e6d700 1 --2- 172.21.15.19:0/1303442737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f95a009e000 0x7f95a01a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.772+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 >> 172.21.15.19:0/1303442737 conn(0x7f95a0066f50 msgr2=0x7f95a01babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.773+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 shutdown_connections 2023-10-03T10:20:27.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.773+0000 7f95a7e6d700 1 -- 172.21.15.19:0/1303442737 wait complete. 2023-10-03T10:20:27.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.820+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ac0074ea0 con 0x7f5ac0130430 2023-10-03T10:20:27.820 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.820+0000 7f5abcff9700 1 -- 172.21.15.19:0/2365309647 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5ab8029030 con 0x7f5ac0130430 2023-10-03T10:20:27.820 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.822+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 msgr2=0x7f5ac009b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8013000 tx=0x7f5ab8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 shutdown_connections 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ac0130430 0x7f5ac009b9a0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5ac012cf60 0x7f5ac009af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 --2- 172.21.15.19:0/2365309647 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5ac012f8b0 0x7f5ac009b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.823+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 >> 172.21.15.19:0/2365309647 conn(0x7f5ac00a2aa0 msgr2=0x7f5ac01b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.824+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 shutdown_connections 2023-10-03T10:20:27.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.824+0000 7f5ac67f4700 1 -- 172.21.15.19:0/2365309647 wait complete. 2023-10-03T10:20:27.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.855+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71b4074ea0 con 0x7f71b406a770 2023-10-03T10:20:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.855+0000 7f71b17fa700 1 -- 172.21.15.19:0/3907536979 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71a8022990 con 0x7f71b406a770 2023-10-03T10:20:27.855 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 msgr2=0x7f71b41c3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f71a801b040 tx=0x7f71a8004750 comp rx=0 tx=0).stop 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 shutdown_connections 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f71b4131b40 0x7f71b41c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71b406a770 0x7f71b41c3ea0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 --2- 172.21.15.19:0/3907536979 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f71b406b080 0x7f71b41c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 >> 172.21.15.19:0/3907536979 conn(0x7f71b4066f50 msgr2=0x7f71b40a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 shutdown_connections 2023-10-03T10:20:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.858+0000 7f71bae8a700 1 -- 172.21.15.19:0/3907536979 wait complete. 2023-10-03T10:20:27.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.894+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f2f74074ea0 con 0x7f2f7412ff20 2023-10-03T10:20:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.894+0000 7f2f62ffd700 1 -- 172.21.15.19:0/377505642 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2f6401b3b0 con 0x7f2f7412ff20 2023-10-03T10:20:27.894 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 msgr2=0x7f2f7409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400ebe0 tx=0x7f2f6400eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 shutdown_connections 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f74133a80 0x7f2f7409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2f7412ff20 0x7f2f7409c480 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 --2- 172.21.15.19:0/377505642 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2f74130870 0x7f2f7409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:27.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 >> 172.21.15.19:0/377505642 conn(0x7f2f740a4210 msgr2=0x7f2f7412f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:27.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 shutdown_connections 2023-10-03T10:20:27.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:27.897+0000 7f2f78edc700 1 -- 172.21.15.19:0/377505642 wait complete. 2023-10-03T10:20:27.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:28.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:28.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:28.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:28.911 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:28.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.938+0000 7f971fdeb700 1 Processor -- start 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.938+0000 7f971fdeb700 1 -- start start 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971fdeb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971fdeb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f971812f8b0 0x7f971812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971fdeb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971812cd90 con 0x7f9718130260 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971fdeb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971812d330 con 0x7f971812f8b0 2023-10-03T10:20:28.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971fdeb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97181306e0 con 0x7f971812cf60 2023-10-03T10:20:28.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971db87700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971d386700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f971812f8b0 0x7f971812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971d386700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f971812f8b0 0x7f971812fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48022/0 (socket says 172.21.15.19:48022) 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971d386700 1 -- 172.21.15.19:0/734897353 learned_addr learned my addr 172.21.15.19:0/734897353 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.939+0000 7f971db87700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52664/0 (socket says 172.21.15.19:52664) 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971cb85700 1 -- 172.21.15.19:0/734897353 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213570675 0 0) 0x7f971812cd90 con 0x7f9718130260 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971cb85700 1 -- 172.21.15.19:0/734897353 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97040035b0 con 0x7f9718130260 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971d386700 1 -- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 msgr2=0x7f971806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971d386700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971d386700 1 -- 172.21.15.19:0/734897353 >> v1:172.21.15.19:6789/0 conn(0x7f9718130260 legacy=0x7f9718136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971d386700 1 -- 172.21.15.19:0/734897353 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718071780 con 0x7f971812f8b0 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971db87700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:28.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971d386700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f971812fd20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f970800a330 tx=0x7f970800ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ba524e4dfa033fb server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971cb85700 1 -- 172.21.15.19:0/734897353 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708009c10 con 0x7f971812f8b0 2023-10-03T10:20:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971cb85700 1 -- 172.21.15.19:0/734897353 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708009d90 con 0x7f971812f8b0 2023-10-03T10:20:28.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.940+0000 7f971cb85700 1 -- 172.21.15.19:0/734897353 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708004270 con 0x7f971812f8b0 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.941+0000 7f971fdeb700 1 -- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 msgr2=0x7f971812fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.941+0000 7f971fdeb700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f971812fd20 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f970800a330 tx=0x7f970800ff00 comp rx=0 tx=0).stop 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 -- 172.21.15.19:0/734897353 shutdown_connections 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f971806f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 --2- 172.21.15.19:0/734897353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f971812fd20 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 -- 172.21.15.19:0/734897353 >> 172.21.15.19:0/734897353 conn(0x7f97180a2aa0 msgr2=0x7f97180a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 -- 172.21.15.19:0/734897353 shutdown_connections 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.942+0000 7f971fdeb700 1 -- 172.21.15.19:0/734897353 wait complete. 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 Processor -- start 2023-10-03T10:20:28.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 -- start start 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f97181c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9718130260 0x7f97181c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718129fa0 con 0x7f971812f8b0 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971809e990 con 0x7f971812cf60 2023-10-03T10:20:28.945 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.943+0000 7f971fdeb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f971809cc80 con 0x7f9718130260 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48034/0 (socket says 172.21.15.19:48034) 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 -- 172.21.15.19:0/941106255 learned_addr learned my addr 172.21.15.19:0/941106255 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971db87700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f97181c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971e388700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9718130260 0x7f97181c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 -- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9718130260 msgr2=0x7f97181c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9718130260 0x7f97181c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 -- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 msgr2=0x7f97181c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f97181c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 -- 172.21.15.19:0/941106255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97140094a0 con 0x7f971812f8b0 2023-10-03T10:20:28.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971db87700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f97181c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.944+0000 7f971d386700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9708019040 tx=0x7f9708004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.945+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708004230 con 0x7f971812f8b0 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.945+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708009c20 con 0x7f971812f8b0 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.945+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970800f880 con 0x7f971812f8b0 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.945+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800e990 con 0x7f971812f8b0 2023-10-03T10:20:28.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.945+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971809d450 con 0x7f971812f8b0 2023-10-03T10:20:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.946+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f970800eaf0 con 0x7f971812f8b0 2023-10-03T10:20:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.946+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f97080450b0 con 0x7f971812f8b0 2023-10-03T10:20:28.948 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.947+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9718074ea0 con 0x7f971812f8b0 2023-10-03T10:20:28.956 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.956+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9708031080 con 0x7f971812f8b0 2023-10-03T10:20:28.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.988+0000 7f5e3b58a700 1 Processor -- start 2023-10-03T10:20:28.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.989+0000 7f5e3b58a700 1 -- start start 2023-10-03T10:20:28.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.989+0000 7f5e3b58a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e3b58a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 0x7f5e34139550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e3b58a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3409e130 con 0x7f5e3409d9f0 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e3b58a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e341312b0 con 0x7f5e3406ae80 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e3b58a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3409f6e0 con 0x7f5e341316c0 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39b27700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 0x7f5e34139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39b27700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 0x7f5e34139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48044/0 (socket says 172.21.15.19:48044) 2023-10-03T10:20:28.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39b27700 1 -- 172.21.15.19:0/2491732337 learned_addr learned my addr 172.21.15.19:0/2491732337 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:28.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 -- 172.21.15.19:0/2491732337 >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 msgr2=0x7f5e34139550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 --2- 172.21.15.19:0/2491732337 >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 0x7f5e34139550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 -- 172.21.15.19:0/2491732337 >> v1:172.21.15.19:6789/0 conn(0x7f5e3409d9f0 legacy=0x7f5e3406a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 -- 172.21.15.19:0/2491732337 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3409e760 con 0x7f5e341316c0 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.990+0000 7f5e39326700 1 --2- 172.21.15.19:0/2491732337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34131a90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009840 tx=0x7f5e30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5c5792818174534 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.991+0000 7f5e2bfff700 1 -- 172.21.15.19:0/2491732337 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30011830 con 0x7f5e341316c0 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.991+0000 7f5e2bfff700 1 -- 172.21.15.19:0/2491732337 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e30011990 con 0x7f5e341316c0 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.991+0000 7f5e2bfff700 1 -- 172.21.15.19:0/2491732337 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30011d20 con 0x7f5e341316c0 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.991+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2491732337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 msgr2=0x7f5e34131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.991+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2491732337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34131a90 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009840 tx=0x7f5e30009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2491732337 shutdown_connections 2023-10-03T10:20:28.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2491732337 >> v2:172.21.15.19:3300/0 conn(0x7f5e3406ae80 0x7f5e34139550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2491732337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34131a90 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2491732337 >> 172.21.15.19:0/2491732337 conn(0x7f5e34066f50 msgr2=0x7f5e3409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2491732337 shutdown_connections 2023-10-03T10:20:28.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.992+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2491732337 wait complete. 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.993+0000 7f5e3b58a700 1 Processor -- start 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.993+0000 7f5e3b58a700 1 -- start start 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e3406ae80 0x7f5e34071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3409d9f0 0x7f5e34071890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34072820 con 0x7f5e3409d9f0 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34134750 con 0x7f5e341316c0 2023-10-03T10:20:28.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e3b58a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e34133640 con 0x7f5e3406ae80 2023-10-03T10:20:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e39b27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e38b25700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3409d9f0 0x7f5e34071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e39b27700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52696/0 (socket says 172.21.15.19:52696) 2023-10-03T10:20:28.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.994+0000 7f5e39b27700 1 -- 172.21.15.19:0/2915112042 learned_addr learned my addr 172.21.15.19:0/2915112042 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 -- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e3406ae80 msgr2=0x7f5e34071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e3406ae80 0x7f5e34071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 -- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3409d9f0 msgr2=0x7f5e34071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3409d9f0 0x7f5e34071890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 -- 172.21.15.19:0/2915112042 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300094a0 con 0x7f5e341316c0 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e39b27700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00efc0 tx=0x7f5e2c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c003c20 con 0x7f5e341316c0 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00f040 con 0x7f5e341316c0 2023-10-03T10:20:28.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.995+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c009e60 con 0x7f5e341316c0 2023-10-03T10:20:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.996+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e341328e0 con 0x7f5e341316c0 2023-10-03T10:20:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.996+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3413a1d0 con 0x7f5e341316c0 2023-10-03T10:20:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.997+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5e2c00c930 con 0x7f5e341316c0 2023-10-03T10:20:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.997+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3409e480 con 0x7f5e341316c0 2023-10-03T10:20:28.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:28.997+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5e2c0433d0 con 0x7f5e341316c0 2023-10-03T10:20:29.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.006+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5e2c01c360 con 0x7f5e341316c0 2023-10-03T10:20:29.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.033+0000 7efcba469700 1 Processor -- start 2023-10-03T10:20:29.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 -- start start 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb412fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb412cd90 con 0x7efcb4130260 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb412d330 con 0x7efcb412cf60 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcba469700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41306d0 con 0x7efcb412f8b0 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52702/0 (socket says 172.21.15.19:52702) 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcb3fff700 1 -- 172.21.15.19:0/627060908 learned_addr learned my addr 172.21.15.19:0/627060908 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.034+0000 7efcb37fe700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb412fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb3fff700 1 -- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 msgr2=0x7efcb412fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb3fff700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb412fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb3fff700 1 -- 172.21.15.19:0/627060908 >> v1:172.21.15.19:6789/0 conn(0x7efcb4130260 legacy=0x7efcb4136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb3fff700 1 -- 172.21.15.19:0/627060908 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb4071780 con 0x7efcb412cf60 2023-10-03T10:20:29.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb37fe700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb3fff700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7efca400bbc0 tx=0x7efca400bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b9c066fd27b568 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb2ffd700 1 -- 172.21.15.19:0/627060908 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca400dc20 con 0x7efcb412cf60 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb2ffd700 1 -- 172.21.15.19:0/627060908 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca400dd80 con 0x7efcb412cf60 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.035+0000 7efcb2ffd700 1 -- 172.21.15.19:0/627060908 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4017630 con 0x7efcb412cf60 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 -- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 msgr2=0x7efcb406f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7efca400bbc0 tx=0x7efca400bed0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 -- 172.21.15.19:0/627060908 shutdown_connections 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb406f5d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 --2- 172.21.15.19:0/627060908 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb412fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 -- 172.21.15.19:0/627060908 >> 172.21.15.19:0/627060908 conn(0x7efcb40a2aa0 msgr2=0x7efcb40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 -- 172.21.15.19:0/627060908 shutdown_connections 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.036+0000 7efcba469700 1 -- 172.21.15.19:0/627060908 wait complete. 2023-10-03T10:20:29.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.037+0000 7efcba469700 1 Processor -- start 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 -- start start 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb409c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb4130260 0x7efcb41c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb409ed40 con 0x7efcb4130260 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb412f710 con 0x7efcb412cf60 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcba469700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efcb409b670 con 0x7efcb412f8b0 2023-10-03T10:20:29.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcb3fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52714/0 (socket says 172.21.15.19:52714) 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcb3fff700 1 -- 172.21.15.19:0/1542649856 learned_addr learned my addr 172.21.15.19:0/1542649856 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.038+0000 7efcb8a06700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb4130260 0x7efcb41c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb37fe700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb409c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 -- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 msgr2=0x7efcb409c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb409c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 -- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb4130260 msgr2=0x7efcb41c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb4130260 0x7efcb41c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 -- 172.21.15.19:0/1542649856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca80094a0 con 0x7efcb412cf60 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb3fff700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efca4019040 tx=0x7efca4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:29.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4009070 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efca400a040 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca400b7f0 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.039+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40044b0 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.040+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb4129a20 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.041+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb4074ea0 con 0x7efcb412cf60 2023-10-03T10:20:29.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.041+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efca4015070 con 0x7efcb412cf60 2023-10-03T10:20:29.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.041+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efca4040900 con 0x7efcb412cf60 2023-10-03T10:20:29.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.050+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efca401e770 con 0x7efcb412cf60 2023-10-03T10:20:29.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.076+0000 7f7bb7b50700 1 Processor -- start 2023-10-03T10:20:29.076 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.076+0000 7f7bb7b50700 1 -- start start 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb7b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb01337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb7b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb01306a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb7b50700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb006b990 con 0x7f7bb0133e30 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb7b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb00a0590 con 0x7f7bb0134260 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb7b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb009fb80 con 0x7f7bb0133420 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb50eb700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7bb0133e30 0x7f7bb012ff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54428/0 (socket says 172.21.15.19:54428) 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb50eb700 1 -- 172.21.15.19:0/194304590 learned_addr learned my addr 172.21.15.19:0/194304590 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:29.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb58ec700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb01337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.077+0000 7f7bb60ed700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb01306a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb58ec700 1 -- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 msgr2=0x7f7bb01306a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb58ec700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb01306a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb58ec700 1 -- 172.21.15.19:0/194304590 >> v1:172.21.15.19:6789/0 conn(0x7f7bb0133e30 legacy=0x7f7bb012ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb58ec700 1 -- 172.21.15.19:0/194304590 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00a0030 con 0x7f7bb0133420 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb58ec700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb01337f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009870 tx=0x7f7bac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9e1405e7f12d68 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb48ea700 1 -- 172.21.15.19:0/194304590 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac011830 con 0x7f7bb0133420 2023-10-03T10:20:29.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb48ea700 1 -- 172.21.15.19:0/194304590 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac011990 con 0x7f7bb0133420 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.078+0000 7f7bb48ea700 1 -- 172.21.15.19:0/194304590 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac011d20 con 0x7f7bb0133420 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 -- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 msgr2=0x7f7bb01337f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb01337f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009870 tx=0x7f7bac009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 -- 172.21.15.19:0/194304590 shutdown_connections 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb01306a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/194304590 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb01337f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 -- 172.21.15.19:0/194304590 >> 172.21.15.19:0/194304590 conn(0x7f7bb00a4210 msgr2=0x7f7bb00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 -- 172.21.15.19:0/194304590 shutdown_connections 2023-10-03T10:20:29.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.079+0000 7f7bb7b50700 1 -- 172.21.15.19:0/194304590 wait complete. 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.080+0000 7f7bb7b50700 1 Processor -- start 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.080+0000 7f7bb7b50700 1 -- start start 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb00709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb0071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb011ee60 con 0x7f7bb0133e30 2023-10-03T10:20:29.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb011fff0 con 0x7f7bb0134260 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb7b50700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0120420 con 0x7f7bb0133420 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48076/0 (socket says 172.21.15.19:48076) 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 -- 172.21.15.19:0/3907804323 learned_addr learned my addr 172.21.15.19:0/3907804323 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb60ed700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb58ec700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb00709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 -- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 msgr2=0x7f7bb00709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb00709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 -- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 msgr2=0x7f7bb0071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb0071420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 -- 172.21.15.19:0/3907804323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac0094a0 con 0x7f7bb0133e30 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb58ec700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb00709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.081+0000 7f7bb50eb700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c530 tx=0x7f7ba000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.082+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0005d70 con 0x7f7bb0133e30 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.082+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba00070d0 con 0x7f7bb0133e30 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.082+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb0072370 con 0x7f7bb0133e30 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.082+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0007440 con 0x7f7bb0133e30 2023-10-03T10:20:29.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.082+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb0131a90 con 0x7f7bb0133e30 2023-10-03T10:20:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.083+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb0074ea0 con 0x7f7bb0133e30 2023-10-03T10:20:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.083+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ba00075a0 con 0x7f7bb0133e30 2023-10-03T10:20:29.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.084+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ba003eb80 con 0x7f7bb0133e30 2023-10-03T10:20:29.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.088+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ba0019b40 con 0x7f7bb0133e30 2023-10-03T10:20:29.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.174+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97180713a0 con 0x7f971812f8b0 2023-10-03T10:20:29.174 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.174+0000 7f970e7fc700 1 -- 172.21.15.19:0/941106255 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97080036a0 con 0x7f971812f8b0 2023-10-03T10:20:29.174 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 msgr2=0x7f97181c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f9708019040 tx=0x7f9708004750 comp rx=0 tx=0).stop 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 shutdown_connections 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9718130260 0x7f97181c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f971812cf60 0x7f97181c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 --2- 172.21.15.19:0/941106255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f971812f8b0 0x7f97181c43d0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 >> 172.21.15.19:0/941106255 conn(0x7f97180a2aa0 msgr2=0x7f97181b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 shutdown_connections 2023-10-03T10:20:29.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.177+0000 7f971fdeb700 1 -- 172.21.15.19:0/941106255 wait complete. 2023-10-03T10:20:29.191 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.220+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5e34074ea0 con 0x7f5e341316c0 2023-10-03T10:20:29.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.221+0000 7f5e29ffb700 1 -- 172.21.15.19:0/2915112042 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5e2c03f020 con 0x7f5e341316c0 2023-10-03T10:20:29.221 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 msgr2=0x7f5e34071dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00efc0 tx=0x7f5e2c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 shutdown_connections 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5e341316c0 0x7f5e34071dd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5e3406ae80 0x7f5e34071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 --2- 172.21.15.19:0/2915112042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e3409d9f0 0x7f5e34071890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 >> 172.21.15.19:0/2915112042 conn(0x7f5e34066f50 msgr2=0x7f5e34130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 shutdown_connections 2023-10-03T10:20:29.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.223+0000 7f5e3b58a700 1 -- 172.21.15.19:0/2915112042 wait complete. 2023-10-03T10:20:29.237 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:29.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.261+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efcb40713a0 con 0x7efcb412cf60 2023-10-03T10:20:29.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.262+0000 7efcb0ff9700 1 -- 172.21.15.19:0/1542649856 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efca40283c0 con 0x7efcb412cf60 2023-10-03T10:20:29.261 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:29.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 msgr2=0x7efcb409bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7efca4019040 tx=0x7efca4004750 comp rx=0 tx=0).stop 2023-10-03T10:20:29.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 shutdown_connections 2023-10-03T10:20:29.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efcb4130260 0x7efcb41c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efcb412cf60 0x7efcb409bb60 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 --2- 172.21.15.19:0/1542649856 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efcb412f8b0 0x7efcb409c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 >> 172.21.15.19:0/1542649856 conn(0x7efcb40a2aa0 msgr2=0x7efcb406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 shutdown_connections 2023-10-03T10:20:29.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.264+0000 7efcba469700 1 -- 172.21.15.19:0/1542649856 wait complete. 2023-10-03T10:20:29.277 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:29.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.296+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7bb006b250 con 0x7f7bb0133e30 2023-10-03T10:20:29.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.296+0000 7f7ba67fc700 1 -- 172.21.15.19:0/3907804323 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ba0017030 con 0x7f7bb0133e30 2023-10-03T10:20:29.296 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 msgr2=0x7f7bb0070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000c530 tx=0x7f7ba000c8f0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 shutdown_connections 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7bb0134260 0x7f7bb0071420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7bb0133420 0x7f7bb00709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 --2- 172.21.15.19:0/3907804323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7bb0133e30 0x7f7bb0070ee0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.298+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 >> 172.21.15.19:0/3907804323 conn(0x7f7bb00a4210 msgr2=0x7f7bb00a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.299+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 shutdown_connections 2023-10-03T10:20:29.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:29.299+0000 7f7bb7b50700 1 -- 172.21.15.19:0/3907804323 wait complete. 2023-10-03T10:20:29.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:30.192 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:30.238 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:30.278 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:30.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:30.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.343+0000 7fd83f462700 1 Processor -- start 2023-10-03T10:20:30.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 -- start start 2023-10-03T10:20:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd838136830 0x7fd838138c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd83813b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83806f720 con 0x7fd8381338c0 2023-10-03T10:20:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd838070c80 con 0x7fd838136830 2023-10-03T10:20:30.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.344+0000 7fd83f462700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83806fce0 con 0x7fd838139150 2023-10-03T10:20:30.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd838136830 0x7fd838138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd838136830 0x7fd838138c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48088/0 (socket says 172.21.15.19:48088) 2023-10-03T10:20:30.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 -- 172.21.15.19:0/2797334144 learned_addr learned my addr 172.21.15.19:0/2797334144 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 -- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 msgr2=0x7fd83813b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 --2- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd83813b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 -- 172.21.15.19:0/2797334144 >> v1:172.21.15.19:6789/0 conn(0x7fd8381338c0 legacy=0x7fd838133c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 -- 172.21.15.19:0/2797334144 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8381336a0 con 0x7fd838136830 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd83c9fd700 1 --2- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd838136830 0x7fd838138c10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fd8280098f0 tx=0x7fd828009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb695824f4a66f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd82ffff700 1 -- 172.21.15.19:0/2797334144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800b8a0 con 0x7fd838136830 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.345+0000 7fd82ffff700 1 -- 172.21.15.19:0/2797334144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82800ba00 con 0x7fd838136830 2023-10-03T10:20:30.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd82ffff700 1 -- 172.21.15.19:0/2797334144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82800bd90 con 0x7fd838136830 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 -- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd838136830 msgr2=0x7fd838138c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 --2- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd838136830 0x7fd838138c10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fd8280098f0 tx=0x7fd828009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 -- 172.21.15.19:0/2797334144 shutdown_connections 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 --2- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd83813b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 --2- 172.21.15.19:0/2797334144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd838136830 0x7fd838138c10 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.346+0000 7fd83f462700 1 -- 172.21.15.19:0/2797334144 >> 172.21.15.19:0/2797334144 conn(0x7fd8380a2aa0 msgr2=0x7fd8380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.347+0000 7fd83f462700 1 -- 172.21.15.19:0/2797334144 shutdown_connections 2023-10-03T10:20:30.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.347+0000 7fd83f462700 1 -- 172.21.15.19:0/2797334144 wait complete. 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 Processor -- start 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 -- start start 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 0x7fd8381c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd838136830 0x7fd8381c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381be340 con 0x7fd8381338c0 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83811c5a0 con 0x7fd838139150 2023-10-03T10:20:30.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83f462700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd83812ebc0 con 0x7fd838136830 2023-10-03T10:20:30.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83d9ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83d9ff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52756/0 (socket says 172.21.15.19:52756) 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83d9ff700 1 -- 172.21.15.19:0/1927305396 learned_addr learned my addr 172.21.15.19:0/1927305396 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83c9fd700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd838136830 0x7fd8381c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.348+0000 7fd83d1fe700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 0x7fd8381c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 -- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd838136830 msgr2=0x7fd8381c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd838136830 0x7fd8381c8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 -- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 msgr2=0x7fd8381c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 0x7fd8381c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 -- 172.21.15.19:0/1927305396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd828009550 con 0x7fd838139150 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d1fe700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 0x7fd8381c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83d9ff700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd83000b9e0 tx=0x7fd83000bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000c930 con 0x7fd838139150 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000cad0 con 0x7fd838139150 2023-10-03T10:20:30.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000ce80 con 0x7fd838139150 2023-10-03T10:20:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.349+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8381362a0 con 0x7fd838139150 2023-10-03T10:20:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.350+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83811cfa0 con 0x7fd838139150 2023-10-03T10:20:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.351+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd830014440 con 0x7fd838139150 2023-10-03T10:20:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.351+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd830006e40 con 0x7fd838139150 2023-10-03T10:20:30.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.351+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83811c1d0 con 0x7fd838139150 2023-10-03T10:20:30.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.361+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd8300133a0 con 0x7fd838139150 2023-10-03T10:20:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.392+0000 7fcee3bda700 1 Processor -- start 2023-10-03T10:20:30.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.392+0000 7fcee3bda700 1 -- start start 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee3bda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee3bda700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc139170 0x7fcedc13b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee3bda700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc09b120 con 0x7fcedc09d6f0 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee3bda700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc06b460 con 0x7fcedc09e1d0 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee3bda700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc09a7e0 con 0x7fcedc139170 2023-10-03T10:20:30.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1976700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcedc09d6f0 0x7fcedc09dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54446/0 (socket says 172.21.15.19:54446) 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1175700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1976700 1 -- 172.21.15.19:0/1929881115 learned_addr learned my addr 172.21.15.19:0/1929881115 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee2177700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc139170 0x7fcedc13b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1175700 1 -- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc139170 msgr2=0x7fcedc13b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1175700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc139170 0x7fcedc13b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee0974700 1 -- 172.21.15.19:0/1929881115 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5677274 0 0) 0x7fcedc09b120 con 0x7fcedc09d6f0 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1175700 1 -- 172.21.15.19:0/1929881115 >> v1:172.21.15.19:6789/0 conn(0x7fcedc09d6f0 legacy=0x7fcedc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.393+0000 7fcee1175700 1 -- 172.21.15.19:0/1929881115 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc09a500 con 0x7fcedc09e1d0 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.394+0000 7fcee1175700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc138c30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009870 tx=0x7fcecc009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf016d429156018c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.394+0000 7fcee0974700 1 -- 172.21.15.19:0/1929881115 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc011830 con 0x7fcedc09e1d0 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.394+0000 7fcee0974700 1 -- 172.21.15.19:0/1929881115 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc011990 con 0x7fcedc09e1d0 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.394+0000 7fcee0974700 1 -- 172.21.15.19:0/1929881115 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc011d20 con 0x7fcedc09e1d0 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 -- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 msgr2=0x7fcedc138c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc138c30 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009870 tx=0x7fcecc009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 -- 172.21.15.19:0/1929881115 shutdown_connections 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc139170 0x7fcedc13b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 --2- 172.21.15.19:0/1929881115 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc138c30 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 -- 172.21.15.19:0/1929881115 >> 172.21.15.19:0/1929881115 conn(0x7fcedc066f50 msgr2=0x7fcedc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 -- 172.21.15.19:0/1929881115 shutdown_connections 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.395+0000 7fcee3bda700 1 -- 172.21.15.19:0/1929881115 wait complete. 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.397+0000 7fcee3bda700 1 Processor -- start 2023-10-03T10:20:30.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.397+0000 7fcee3bda700 1 -- start start 2023-10-03T10:20:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc11ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 0x7fcedc11f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1221d0 con 0x7fcedc139170 2023-10-03T10:20:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1345a0 con 0x7fcedc09e1d0 2023-10-03T10:20:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee3bda700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc09c710 con 0x7fcedc09d6f0 2023-10-03T10:20:30.399 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1175700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc11ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee2177700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 0x7fcedc11f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35736/0 (socket says 172.21.15.19:35736) 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1175700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc11ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52776/0 (socket says 172.21.15.19:52776) 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 -- 172.21.15.19:0/3072767794 learned_addr learned my addr 172.21.15.19:0/3072767794 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 -- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 msgr2=0x7fcedc11ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc11ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 -- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 msgr2=0x7fcedc11f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 0x7fcedc11f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 -- 172.21.15.19:0/3072767794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc0094a0 con 0x7fcedc09d6f0 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee2177700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 0x7fcedc11f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:30.400 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.398+0000 7fcee1976700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fced800c520 tx=0x7fced800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.399+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8004c80 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.399+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8004e00 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.399+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc120360 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.399+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8007310 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.399+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc122960 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.400+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fced8007470 con 0x7fcedc09d6f0 2023-10-03T10:20:30.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.400+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc121e50 con 0x7fcedc09d6f0 2023-10-03T10:20:30.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.400+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fced803f300 con 0x7fcedc09d6f0 2023-10-03T10:20:30.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.410+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fced80133c0 con 0x7fcedc09d6f0 2023-10-03T10:20:30.431 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.430+0000 7fd5bde4f700 1 Processor -- start 2023-10-03T10:20:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.430+0000 7fd5bde4f700 1 -- start start 2023-10-03T10:20:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5bde4f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5bde4f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 0x7fd5b809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.432 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5bde4f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b809ba70 con 0x7fd5b8131970 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5bde4f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b809d4a0 con 0x7fd5b80a0090 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5bde4f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b809e8f0 con 0x7fd5b809c650 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35750/0 (socket says 172.21.15.19:35750) 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 -- 172.21.15.19:0/1201831852 learned_addr learned my addr 172.21.15.19:0/1201831852 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b6ffd700 1 --2- 172.21.15.19:0/1201831852 >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 0x7fd5b809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 -- 172.21.15.19:0/1201831852 >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 msgr2=0x7fd5b809cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 --2- 172.21.15.19:0/1201831852 >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 0x7fd5b809cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 -- 172.21.15.19:0/1201831852 >> v1:172.21.15.19:6789/0 conn(0x7fd5b8131970 legacy=0x7fd5b8131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.431+0000 7fd5b77fe700 1 -- 172.21.15.19:0/1201831852 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80a0760 con 0x7fd5b809c650 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.432+0000 7fd5b6ffd700 1 --2- 172.21.15.19:0/1201831852 >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 0x7fd5b809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:30.433 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.432+0000 7fd5b77fe700 1 --2- 172.21.15.19:0/1201831852 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098f0 tx=0x7fd5a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=788d619c31d310a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.432+0000 7fd5b67fc700 1 -- 172.21.15.19:0/1201831852 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8004230 con 0x7fd5b809c650 2023-10-03T10:20:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.432+0000 7fd5b67fc700 1 -- 172.21.15.19:0/1201831852 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a8004390 con 0x7fd5b809c650 2023-10-03T10:20:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.432+0000 7fd5b67fc700 1 -- 172.21.15.19:0/1201831852 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80036a0 con 0x7fd5b809c650 2023-10-03T10:20:30.434 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 -- 172.21.15.19:0/1201831852 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 msgr2=0x7fd5b809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/1201831852 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80098f0 tx=0x7fd5a8009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 -- 172.21.15.19:0/1201831852 shutdown_connections 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/1201831852 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b809c650 0x7fd5b809ca20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/1201831852 >> v2:172.21.15.19:3300/0 conn(0x7fd5b80a0090 0x7fd5b809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 -- 172.21.15.19:0/1201831852 >> 172.21.15.19:0/1201831852 conn(0x7fd5b80a3f70 msgr2=0x7fd5b80a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 -- 172.21.15.19:0/1201831852 shutdown_connections 2023-10-03T10:20:30.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.433+0000 7fd5bde4f700 1 -- 172.21.15.19:0/1201831852 wait complete. 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.434+0000 7fd5bde4f700 1 Processor -- start 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.434+0000 7fd5bde4f700 1 -- start start 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 0x7fd5b806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b8131970 0x7fd5b806c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b811b850 con 0x7fd5b809c650 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806cd80 con 0x7fd5b8131970 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5bde4f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b8130010 con 0x7fd5b80a0090 2023-10-03T10:20:30.436 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5b77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48116/0 (socket says 172.21.15.19:48116) 2023-10-03T10:20:30.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5b77fe700 1 -- 172.21.15.19:0/4293052104 learned_addr learned my addr 172.21.15.19:0/4293052104 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.435+0000 7fd5b6ffd700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 0x7fd5b806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 -- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 msgr2=0x7fd5b806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 0x7fd5b806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 -- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b8131970 msgr2=0x7fd5b806c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b8131970 0x7fd5b806c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 -- 172.21.15.19:0/4293052104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009550 con 0x7fd5b809c650 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b6ffd700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 0x7fd5b806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5b77fe700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009130 tx=0x7fd5a8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8003d80 con 0x7fd5b809c650 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a801f070 con 0x7fd5b809c650 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b809d980 con 0x7fd5b809c650 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800b8a0 con 0x7fd5b809c650 2023-10-03T10:20:30.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.436+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b806d550 con 0x7fd5b809c650 2023-10-03T10:20:30.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.437+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b80747f0 con 0x7fd5b809c650 2023-10-03T10:20:30.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.438+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd5a8021030 con 0x7fd5b809c650 2023-10-03T10:20:30.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.438+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd5a8040cb0 con 0x7fd5b809c650 2023-10-03T10:20:30.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.447+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd5a80193c0 con 0x7fd5b809c650 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 Processor -- start 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 -- start start 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe340a0a30 0x7efe340a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe340a2a70 con 0x7efe3409d630 2023-10-03T10:20:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340a01d0 con 0x7efe340a0a30 2023-10-03T10:20:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.478+0000 7efe39d8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe3409e2b0 con 0x7efe34138d80 2023-10-03T10:20:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35770/0 (socket says 172.21.15.19:35770) 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 -- 172.21.15.19:0/4151237909 learned_addr learned my addr 172.21.15.19:0/4151237909 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 -- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe340a0a30 msgr2=0x7efe340a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 --2- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe340a0a30 0x7efe340a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 -- 172.21.15.19:0/4151237909 >> v1:172.21.15.19:6789/0 conn(0x7efe3409d630 legacy=0x7efe340a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 -- 172.21.15.19:0/4151237909 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3409dc50 con 0x7efe34138d80 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.479+0000 7efe33fff700 1 --2- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009e80 tx=0x7efe2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55647386162854ec server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.480+0000 7efe327fc700 1 -- 172.21.15.19:0/4151237909 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00e070 con 0x7efe34138d80 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.480+0000 7efe327fc700 1 -- 172.21.15.19:0/4151237909 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00b9c0 con 0x7efe34138d80 2023-10-03T10:20:30.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.480+0000 7efe327fc700 1 -- 172.21.15.19:0/4151237909 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00bd70 con 0x7efe34138d80 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 -- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 msgr2=0x7efe3413b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 --2- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009e80 tx=0x7efe2c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 -- 172.21.15.19:0/4151237909 shutdown_connections 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 --2- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe34138d80 0x7efe3413b160 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 --2- 172.21.15.19:0/4151237909 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe340a0a30 0x7efe340a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 -- 172.21.15.19:0/4151237909 >> 172.21.15.19:0/4151237909 conn(0x7efe340a3050 msgr2=0x7efe340a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 -- 172.21.15.19:0/4151237909 shutdown_connections 2023-10-03T10:20:30.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.481+0000 7efe39d8c700 1 -- 172.21.15.19:0/4151237909 wait complete. 2023-10-03T10:20:30.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.482+0000 7efe39d8c700 1 Processor -- start 2023-10-03T10:20:30.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.482+0000 7efe39d8c700 1 -- start start 2023-10-03T10:20:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe340a0a30 0x7efe34133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe34138d80 0x7efe34134410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:30.484 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34137240 con 0x7efe34138d80 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe34135640 con 0x7efe3409d630 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe39d8c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe34137440 con 0x7efe340a0a30 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe337fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe33fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe34138d80 0x7efe34134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe337fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52802/0 (socket says 172.21.15.19:52802) 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe32ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe340a0a30 0x7efe34133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:30.485 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.483+0000 7efe337fe700 1 -- 172.21.15.19:0/765496375 learned_addr learned my addr 172.21.15.19:0/765496375 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 -- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe340a0a30 msgr2=0x7efe34133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe340a0a30 0x7efe34133ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 -- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe34138d80 msgr2=0x7efe34134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe34138d80 0x7efe34134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 -- 172.21.15.19:0/765496375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009b30 con 0x7efe3409d630 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe337fe700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b560 tx=0x7efe2400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24011830 con 0x7efe3409d630 2023-10-03T10:20:30.486 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24011990 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34138790 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.484+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe24011d40 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.485+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340a0460 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.486+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe340747f0 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.486+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efe2401a400 con 0x7efe3409d630 2023-10-03T10:20:30.487 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.486+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efe2403f5e0 con 0x7efe3409d630 2023-10-03T10:20:30.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.491+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efe2400f8b0 con 0x7efe3409d630 2023-10-03T10:20:30.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.618+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd838134320 con 0x7fd838139150 2023-10-03T10:20:30.619 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.619+0000 7fd82dffb700 1 -- 172.21.15.19:0/1927305396 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd830019020 con 0x7fd838139150 2023-10-03T10:20:30.619 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 msgr2=0x7fd838118d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fd83000b9e0 tx=0x7fd83000bcf0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 shutdown_connections 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd838139150 0x7fd838118d40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd8381338c0 0x7fd8381c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 --2- 172.21.15.19:0/1927305396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd838136830 0x7fd8381c8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 >> 172.21.15.19:0/1927305396 conn(0x7fd8380a2aa0 msgr2=0x7fd83812f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 shutdown_connections 2023-10-03T10:20:30.622 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.621+0000 7fd83f462700 1 -- 172.21.15.19:0/1927305396 wait complete. 2023-10-03T10:20:30.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:30.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.650+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcedc074ea0 con 0x7fcedc09d6f0 2023-10-03T10:20:30.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.650+0000 7fced27fc700 1 -- 172.21.15.19:0/3072767794 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fced8011360 con 0x7fcedc09d6f0 2023-10-03T10:20:30.651 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 msgr2=0x7fcedc11e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fced800c520 tx=0x7fced800c830 comp rx=0 tx=0).stop 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 shutdown_connections 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcedc139170 0x7fcedc11f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcedc09d6f0 0x7fcedc11e6b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 --2- 172.21.15.19:0/3072767794 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcedc09e1d0 0x7fcedc11ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 >> 172.21.15.19:0/3072767794 conn(0x7fcedc066f50 msgr2=0x7fcedc136b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 shutdown_connections 2023-10-03T10:20:30.654 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.653+0000 7fcee3bda700 1 -- 172.21.15.19:0/3072767794 wait complete. 2023-10-03T10:20:30.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.660+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5b80747f0 con 0x7fd5b809c650 2023-10-03T10:20:30.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.661+0000 7fd59ffff700 1 -- 172.21.15.19:0/4293052104 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd5a8023bc0 con 0x7fd5b809c650 2023-10-03T10:20:30.662 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 msgr2=0x7fd5b806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009130 tx=0x7fd5a8004750 comp rx=0 tx=0).stop 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 shutdown_connections 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd5b8131970 0x7fd5b806c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b809c650 0x7fd5b806b880 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 --2- 172.21.15.19:0/4293052104 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd5b80a0090 0x7fd5b806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 >> 172.21.15.19:0/4293052104 conn(0x7fd5b80a3f70 msgr2=0x7fd5b812ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 shutdown_connections 2023-10-03T10:20:30.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.663+0000 7fd5bde4f700 1 -- 172.21.15.19:0/4293052104 wait complete. 2023-10-03T10:20:30.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:30.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:30.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.705+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efe34072980 con 0x7efe3409d630 2023-10-03T10:20:30.706 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.705+0000 7efe1bfff700 1 -- 172.21.15.19:0/765496375 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe24015020 con 0x7efe3409d630 2023-10-03T10:20:30.706 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 msgr2=0x7efe34133990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b560 tx=0x7efe2400b870 comp rx=0 tx=0).stop 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 shutdown_connections 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe34138d80 0x7efe34134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efe3409d630 0x7efe34133990 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 --2- 172.21.15.19:0/765496375 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efe340a0a30 0x7efe34133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 >> 172.21.15.19:0/765496375 conn(0x7efe340a3050 msgr2=0x7efe3409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 shutdown_connections 2023-10-03T10:20:30.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:30.708+0000 7efe39d8c700 1 -- 172.21.15.19:0/765496375 wait complete. 2023-10-03T10:20:30.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:31.638 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:31.669 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:31.681 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:31.723 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.804+0000 7f718f1b6700 1 Processor -- start 2023-10-03T10:20:31.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.804+0000 7f718f1b6700 1 -- start start 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718f1b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 0x7f718809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718f1b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 0x7f71881339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718f1b6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718809b120 con 0x7f718809e410 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718f1b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718806b460 con 0x7f718809e000 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718f1b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f718809a7e0 con 0x7f718809d6f0 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718d753700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f718809e410 0x7f7188133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54468/0 (socket says 172.21.15.19:54468) 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718d753700 1 -- 172.21.15.19:0/3674301958 learned_addr learned my addr 172.21.15.19:0/3674301958 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f7187fff700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 0x7f71881339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f718cf52700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 0x7f718809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f71877fe700 1 -- 172.21.15.19:0/3674301958 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769264632 0 0) 0x7f718809b120 con 0x7f718809e410 2023-10-03T10:20:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.805+0000 7f71877fe700 1 -- 172.21.15.19:0/3674301958 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71780035b0 con 0x7f718809e410 2023-10-03T10:20:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f7187fff700 1 -- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 msgr2=0x7f718809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:31.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f7187fff700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 0x7f718809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f7187fff700 1 -- 172.21.15.19:0/3674301958 >> v1:172.21.15.19:6789/0 conn(0x7f718809e410 legacy=0x7f7188133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f7187fff700 1 -- 172.21.15.19:0/3674301958 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718809a500 con 0x7f718809e000 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f718cf52700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 0x7f718809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f7187fff700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 0x7f71881339f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7174009870 tx=0x7f7174009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d228396b550be99 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f71877fe700 1 -- 172.21.15.19:0/3674301958 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174011830 con 0x7f718809e000 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f71877fe700 1 -- 172.21.15.19:0/3674301958 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174011990 con 0x7f718809e000 2023-10-03T10:20:31.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.806+0000 7f71877fe700 1 -- 172.21.15.19:0/3674301958 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174011d00 con 0x7f718809e000 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 -- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 msgr2=0x7f71881339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 0x7f71881339f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f7174009870 tx=0x7f7174009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 -- 172.21.15.19:0/3674301958 shutdown_connections 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809d6f0 0x7f718809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3674301958 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809e000 0x7f71881339f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 -- 172.21.15.19:0/3674301958 >> 172.21.15.19:0/3674301958 conn(0x7f7188066f50 msgr2=0x7f718809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 -- 172.21.15.19:0/3674301958 shutdown_connections 2023-10-03T10:20:31.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.807+0000 7f718f1b6700 1 -- 172.21.15.19:0/3674301958 wait complete. 2023-10-03T10:20:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.808+0000 7f718f1b6700 1 Processor -- start 2023-10-03T10:20:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.808+0000 7f718f1b6700 1 -- start start 2023-10-03T10:20:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809e000 0x7f71881a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.810 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 0x7f71881c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881a8100 con 0x7f718809e410 2023-10-03T10:20:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71881a6a20 con 0x7f718809d6f0 2023-10-03T10:20:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.809+0000 7f718f1b6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71881a82e0 con 0x7f718809e000 2023-10-03T10:20:31.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52816/0 (socket says 172.21.15.19:52816) 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 -- 172.21.15.19:0/3852607487 learned_addr learned my addr 172.21.15.19:0/3852607487 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718d753700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 0x7f71881c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f7187fff700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809e000 0x7f71881a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 -- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809e000 msgr2=0x7f71881a5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809e000 0x7f71881a5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 -- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 msgr2=0x7f71881c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 0x7f71881c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 -- 172.21.15.19:0/3852607487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0094a0 con 0x7f718809d6f0 2023-10-03T10:20:31.812 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718d753700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 0x7f71881c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.810+0000 7f718cf52700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f717c00ebe0 tx=0x7f717c00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.811+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00c850 con 0x7f718809d6f0 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.811+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c00c9b0 con 0x7f718809d6f0 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.811+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c00cd40 con 0x7f718809d6f0 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.812+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71740094a0 con 0x7f718809d6f0 2023-10-03T10:20:31.813 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.812+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71881a4c70 con 0x7f718809d6f0 2023-10-03T10:20:31.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.813+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f717c013470 con 0x7f718809d6f0 2023-10-03T10:20:31.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.813+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f717c03f7d0 con 0x7f718809d6f0 2023-10-03T10:20:31.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.813+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71881a8420 con 0x7f718809d6f0 2023-10-03T10:20:31.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.819+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f71881a8420 con 0x7f718809d6f0 2023-10-03T10:20:31.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.845+0000 7fa9eb53a700 1 Processor -- start 2023-10-03T10:20:31.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.845+0000 7fa9eb53a700 1 -- start start 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9eb53a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa9e409e1d0 0x7fa9e4138c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9eb53a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e413b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9eb53a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e409b120 con 0x7fa9e409d6f0 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9eb53a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e406b460 con 0x7fa9e409e1d0 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9eb53a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409a7e0 con 0x7fa9e4139170 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9e92d6700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fa9e409d6f0 0x7fa9e409dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54478/0 (socket says 172.21.15.19:54478) 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9e92d6700 1 -- 172.21.15.19:0/463231663 learned_addr learned my addr 172.21.15.19:0/463231663 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9e8ad5700 1 --2- 172.21.15.19:0/463231663 >> v2:172.21.15.19:3300/0 conn(0x7fa9e409e1d0 0x7fa9e4138c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.846+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/463231663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e413b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 Processor -- start 2023-10-03T10:20:31.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 -- start start 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/463231663 >> v2:172.21.15.19:3300/0 conn(0x7fa9e409e1d0 msgr2=0x7fa9e4138c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/463231663 >> v2:172.21.15.19:3300/0 conn(0x7fa9e409e1d0 0x7fa9e4138c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/463231663 >> v1:172.21.15.19:6789/0 conn(0x7fa9e409d6f0 legacy=0x7fa9e409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/463231663 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e409a500 con 0x7fa9e4139170 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/463231663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e413b550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009dc0 tx=0x7fa9dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6546166a23f0777 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9dbfff700 1 -- 172.21.15.19:0/463231663 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc00e070 con 0x7fa9e4139170 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9dbfff700 1 -- 172.21.15.19:0/463231663 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc003a20 con 0x7fa9e4139170 2023-10-03T10:20:31.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7fa9dbfff700 1 -- 172.21.15.19:0/463231663 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc003db0 con 0x7fa9e4139170 2023-10-03T10:20:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f0f7c09e000 0x7f0f7c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c06b460 con 0x7f0f7c09e000 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c09b120 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.847+0000 7f0f8160f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c09a7e0 con 0x7f0f7c09e410 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52832/0 (socket says 172.21.15.19:52832) 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7affd700 1 -- 172.21.15.19:0/53774677 learned_addr learned my addr 172.21.15.19:0/53774677 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/53774677 >> v2:172.21.15.19:3300/0 conn(0x7f0f7c09e000 0x7f0f7c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 -- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 msgr2=0x7f0f7c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 -- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 msgr2=0x7f0f7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 -- 172.21.15.19:0/53774677 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c09a500 con 0x7f0f7c09e000 2023-10-03T10:20:31.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1339f0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa81207bfcf6aaef server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7fa9eb53a700 1 -- 172.21.15.19:0/463231663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 msgr2=0x7fa9e413b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/463231663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e413b550 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc009dc0 tx=0x7fa9dc00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.848+0000 7f0f79ffb700 1 -- 172.21.15.19:0/53774677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7400e070 con 0x7f0f7c09e000 2023-10-03T10:20:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7f0f79ffb700 1 -- 172.21.15.19:0/53774677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7400bb20 con 0x7f0f7c09e000 2023-10-03T10:20:31.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7f0f79ffb700 1 -- 172.21.15.19:0/53774677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74012430 con 0x7f0f7c09e000 2023-10-03T10:20:31.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 -- 172.21.15.19:0/463231663 shutdown_connections 2023-10-03T10:20:31.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/463231663 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e413b550 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/463231663 >> v2:172.21.15.19:3300/0 conn(0x7fa9e409e1d0 0x7fa9e4138c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 -- 172.21.15.19:0/463231663 >> 172.21.15.19:0/463231663 conn(0x7fa9e4066f50 msgr2=0x7fa9e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:31.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 -- 172.21.15.19:0/463231663 shutdown_connections 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7f0f8160f700 1 -- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 msgr2=0x7f0f7c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7f0f8160f700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1339f0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 -- 172.21.15.19:0/53774677 shutdown_connections 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 --2- 172.21.15.19:0/53774677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1339f0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.854 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 -- 172.21.15.19:0/53774677 >> 172.21.15.19:0/53774677 conn(0x7f0f7c066f50 msgr2=0x7f0f7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 -- 172.21.15.19:0/53774677 shutdown_connections 2023-10-03T10:20:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7f0f8160f700 1 -- 172.21.15.19:0/53774677 wait complete. 2023-10-03T10:20:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.849+0000 7fa9eb53a700 1 -- 172.21.15.19:0/463231663 wait complete. 2023-10-03T10:20:31.855 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.850+0000 7fa9eb53a700 1 Processor -- start 2023-10-03T10:20:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.851+0000 7f0f8160f700 1 Processor -- start 2023-10-03T10:20:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.851+0000 7f0f8160f700 1 -- start start 2023-10-03T10:20:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1a6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c1a6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1a75b0 con 0x7f0f7c09e000 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1b9440 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f8160f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1a8eb0 con 0x7f0f7c09e410 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7f0f7affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52842/0 (socket says 172.21.15.19:52842) 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 -- 172.21.15.19:0/2925929790 learned_addr learned my addr 172.21.15.19:0/2925929790 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1a6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7b7fe700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c1a6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 -- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 msgr2=0x7f0f7c1a6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c1a6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 -- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 msgr2=0x7f0f7c1a6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.857 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1a6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 -- 172.21.15.19:0/2925929790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009a70 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.852+0000 7fa9eb53a700 1 -- start start 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 0x7fa9e41194b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 0x7fa9e41199f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e4119f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e411cfd0 con 0x7fa9e409e1d0 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40a20b0 con 0x7fa9e409d6f0 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9eb53a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e409c710 con 0x7fa9e4139170 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9e8ad5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 0x7fa9e41199f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9e8ad5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 0x7fa9e41199f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48170/0 (socket says 172.21.15.19:48170) 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9e8ad5700 1 -- 172.21.15.19:0/893359288 learned_addr learned my addr 172.21.15.19:0/893359288 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e4119f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e92d6700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 0x7fa9e41194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 msgr2=0x7fa9e41194b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 0x7fa9e41194b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 msgr2=0x7fa9e41199f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 0x7fa9e41199f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 -- 172.21.15.19:0/893359288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009a70 con 0x7fa9e4139170 2023-10-03T10:20:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.853+0000 7f0f7affd700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e910 tx=0x7f0f7000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f700096a0 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e92d6700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 0x7fa9e41194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9e9ad7700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e4119f30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc014000 tx=0x7fa9dc004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.860 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7000ee60 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000ca70 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc004540 con 0x7fa9e4139170 2023-10-03T10:20:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f7a7fc700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc0046a0 con 0x7fa9e4139170 2023-10-03T10:20:31.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc012450 con 0x7fa9e4139170 2023-10-03T10:20:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c1a9890 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e411b0c0 con 0x7fa9e4139170 2023-10-03T10:20:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.854+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c0a1f90 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.855+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e41cc620 con 0x7fa9e4139170 2023-10-03T10:20:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.856+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0f7000cbd0 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.856+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0f7003f6c0 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.856+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e4074ea0 con 0x7fa9e4139170 2023-10-03T10:20:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.857+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c09c4d0 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.862+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0f7001bb60 con 0x7f0f7c09d6f0 2023-10-03T10:20:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.862+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa9dc0125b0 con 0x7fa9e4139170 2023-10-03T10:20:31.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.863+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa9dc041740 con 0x7fa9e4139170 2023-10-03T10:20:31.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.866+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa9dc012860 con 0x7fa9e4139170 2023-10-03T10:20:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.887+0000 7f77e4c04700 1 Processor -- start 2023-10-03T10:20:31.888 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.887+0000 7f77e4c04700 1 -- start start 2023-10-03T10:20:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77e4c04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77e4c04700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 0x7f77e013b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77e4c04700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e006bf30 con 0x7f77e009e850 2023-10-03T10:20:31.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77e4c04700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e009ffb0 con 0x7f77e01393e0 2023-10-03T10:20:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77e4c04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006cb10 con 0x7f77e009f330 2023-10-03T10:20:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77ddd9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35858/0 (socket says 172.21.15.19:35858) 2023-10-03T10:20:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.888+0000 7f77ddd9b700 1 -- 172.21.15.19:0/847202286 learned_addr learned my addr 172.21.15.19:0/847202286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ded9d700 1 --2- 172.21.15.19:0/847202286 >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 0x7f77e013b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ddd9b700 1 -- 172.21.15.19:0/847202286 >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 msgr2=0x7f77e013b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ddd9b700 1 --2- 172.21.15.19:0/847202286 >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 0x7f77e013b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ddd9b700 1 -- 172.21.15.19:0/847202286 >> v1:172.21.15.19:6789/0 conn(0x7f77e009e850 legacy=0x7f77e009ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ddd9b700 1 -- 172.21.15.19:0/847202286 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00a0270 con 0x7f77e009f330 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ded9d700 1 --2- 172.21.15.19:0/847202286 >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 0x7f77e013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77ddd9b700 1 --2- 172.21.15.19:0/847202286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f77d40098f0 tx=0x7f77d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e640dbfb3f54c5df server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77dd59a700 1 -- 172.21.15.19:0/847202286 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4011830 con 0x7f77e009f330 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77dd59a700 1 -- 172.21.15.19:0/847202286 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4011990 con 0x7f77e009f330 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.889+0000 7f77dd59a700 1 -- 172.21.15.19:0/847202286 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d4011d20 con 0x7f77e009f330 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 -- 172.21.15.19:0/847202286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 msgr2=0x7f77e0138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 --2- 172.21.15.19:0/847202286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f77d40098f0 tx=0x7f77d4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 -- 172.21.15.19:0/847202286 shutdown_connections 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 --2- 172.21.15.19:0/847202286 >> v2:172.21.15.19:3300/0 conn(0x7f77e01393e0 0x7f77e013b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 --2- 172.21.15.19:0/847202286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e009f330 0x7f77e0138ea0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 -- 172.21.15.19:0/847202286 >> 172.21.15.19:0/847202286 conn(0x7f77e00a3f70 msgr2=0x7f77e00a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 -- 172.21.15.19:0/847202286 shutdown_connections 2023-10-03T10:20:31.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.890+0000 7f77e4c04700 1 -- 172.21.15.19:0/847202286 wait complete. 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.891+0000 7f77e4c04700 1 Processor -- start 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 -- start start 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77e009f330 0x7f77e01c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 0x7f77e011ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e006cd30 con 0x7f77e009f330 2023-10-03T10:20:31.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01be560 con 0x7f77e009e850 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77e4c04700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f77e01c93f0 con 0x7f77e01393e0 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77de59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77ded9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 0x7f77e011ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77de59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52860/0 (socket says 172.21.15.19:52860) 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77de59c700 1 -- 172.21.15.19:0/3171727679 learned_addr learned my addr 172.21.15.19:0/3171727679 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.892+0000 7f77ddd9b700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77e009f330 0x7f77e01c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 -- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 msgr2=0x7f77e01c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 -- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77e009f330 msgr2=0x7f77e01c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77e009f330 0x7f77e01c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 -- 172.21.15.19:0/3171727679 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d8009a70 con 0x7f77e01393e0 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77de59c700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:31.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ded9d700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 0x7f77e011ed10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f77d800ef90 tx=0x7f77d800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800ca90 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800f040 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800ce30 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d4009550 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.893+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e0122da0 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.894+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f77d8014480 con 0x7f77e01393e0 2023-10-03T10:20:31.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.894+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f77d803fbf0 con 0x7f77e01393e0 2023-10-03T10:20:31.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.894+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0122250 con 0x7f77e01393e0 2023-10-03T10:20:31.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:31.899+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f77d8012930 con 0x7f77e01393e0 2023-10-03T10:20:32.064 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.063+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71881a8420 con 0x7f718809d6f0 2023-10-03T10:20:32.065 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.064+0000 7f71857fa700 1 -- 172.21.15.19:0/3852607487 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f71881a8420 con 0x7f718809d6f0 2023-10-03T10:20:32.065 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 msgr2=0x7f71881a52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f717c00ebe0 tx=0x7f717c00eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 shutdown_connections 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f718809e410 0x7f71881c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f718809d6f0 0x7f71881a52c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 --2- 172.21.15.19:0/3852607487 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f718809e000 0x7f71881a5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.066+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 >> 172.21.15.19:0/3852607487 conn(0x7f7188066f50 msgr2=0x7f718806f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:32.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.067+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 shutdown_connections 2023-10-03T10:20:32.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.070+0000 7f718f1b6700 1 -- 172.21.15.19:0/3852607487 wait complete. 2023-10-03T10:20:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.071+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0f7c09c710 con 0x7f0f7c09d6f0 2023-10-03T10:20:32.072 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.072+0000 7f0f637fe700 1 -- 172.21.15.19:0/2925929790 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f70021020 con 0x7f0f7c09d6f0 2023-10-03T10:20:32.072 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 msgr2=0x7f0f7c1a60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000e910 tx=0x7f0f7000ec20 comp rx=0 tx=0).stop 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 shutdown_connections 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0f7c09e410 0x7f0f7c1a6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0f7c09d6f0 0x7f0f7c1a60e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 --2- 172.21.15.19:0/2925929790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f7c09e000 0x7f0f7c1a6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 >> 172.21.15.19:0/2925929790 conn(0x7f0f7c066f50 msgr2=0x7f0f7c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 shutdown_connections 2023-10-03T10:20:32.077 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.076+0000 7f0f8160f700 1 -- 172.21.15.19:0/2925929790 wait complete. 2023-10-03T10:20:32.091 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:32.095 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:32.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.100+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa9e409f420 con 0x7fa9e4139170 2023-10-03T10:20:32.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.100+0000 7fa9d9ffb700 1 -- 172.21.15.19:0/893359288 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa9dc017030 con 0x7fa9e4139170 2023-10-03T10:20:32.101 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:32.103 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 msgr2=0x7fa9e4119f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e4119f30 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc014000 tx=0x7fa9dc004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 shutdown_connections 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa9e4139170 0x7fa9e4119f30 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa9e409d6f0 0x7fa9e41194b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 --2- 172.21.15.19:0/893359288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9e409e1d0 0x7fa9e41199f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.102+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 >> 172.21.15.19:0/893359288 conn(0x7fa9e4066f50 msgr2=0x7fa9e4136cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.103+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 shutdown_connections 2023-10-03T10:20:32.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.103+0000 7fa9eb53a700 1 -- 172.21.15.19:0/893359288 wait complete. 2023-10-03T10:20:32.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.108+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f77e00747f0 con 0x7f77e01393e0 2023-10-03T10:20:32.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.108+0000 7f77ceffd700 1 -- 172.21.15.19:0/3171727679 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77d8009cc0 con 0x7f77e01393e0 2023-10-03T10:20:32.109 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.110+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 msgr2=0x7f77e011ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.110+0000 7f77e4c04700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 0x7f77e011ed10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f77d800ef90 tx=0x7f77d800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 shutdown_connections 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f77e01393e0 0x7f77e011ed10 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f77e009e850 0x7f77e01c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 --2- 172.21.15.19:0/3171727679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f77e009f330 0x7f77e01c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 >> 172.21.15.19:0/3171727679 conn(0x7f77e00a3f70 msgr2=0x7f77e0136e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 shutdown_connections 2023-10-03T10:20:32.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:32.111+0000 7f77e4c04700 1 -- 172.21.15.19:0/3171727679 wait complete. 2023-10-03T10:20:32.118 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:32.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:33.092 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:33.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:33.119 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:33.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.255+0000 7efd68d07700 1 Processor -- start 2023-10-03T10:20:33.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.256+0000 7efd68d07700 1 -- start start 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd6409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e000 0x7efd641339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd6409e410 0x7efd64133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6406b460 con 0x7efd6409e410 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409b120 con 0x7efd6409e000 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd68d07700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd6409a7e0 con 0x7efd6409d6f0 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd6409e410 0x7efd64133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7efd6409e410 0x7efd64133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48176/0 (socket says 172.21.15.19:48176) 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 -- 172.21.15.19:0/4242324281 learned_addr learned my addr 172.21.15.19:0/4242324281 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.258 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd6259c700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd6409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd61d9b700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e000 0x7efd641339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 -- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 msgr2=0x7efd6409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd6409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 -- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e000 msgr2=0x7efd641339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e000 0x7efd641339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 -- 172.21.15.19:0/4242324281 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6409a500 con 0x7efd6409e410 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.257+0000 7efd62d9d700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e410 0x7efd64133f30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e50 tx=0x7efd5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d05586ebfcd0ea server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.258+0000 7efd6159a700 1 -- 172.21.15.19:0/4242324281 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00e070 con 0x7efd6409e410 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.258+0000 7efd6159a700 1 -- 172.21.15.19:0/4242324281 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c00b910 con 0x7efd6409e410 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.258+0000 7efd6159a700 1 -- 172.21.15.19:0/4242324281 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c00bcc0 con 0x7efd6409e410 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 -- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e410 msgr2=0x7efd64133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.260 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e410 0x7efd64133f30 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009e50 tx=0x7efd5c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 -- 172.21.15.19:0/4242324281 shutdown_connections 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e410 0x7efd64133f30 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd6409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 --2- 172.21.15.19:0/4242324281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e000 0x7efd641339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 -- 172.21.15.19:0/4242324281 >> 172.21.15.19:0/4242324281 conn(0x7efd64066f50 msgr2=0x7efd6409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 -- 172.21.15.19:0/4242324281 shutdown_connections 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.259+0000 7efd68d07700 1 -- 172.21.15.19:0/4242324281 wait complete. 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.260+0000 7efd68d07700 1 Processor -- start 2023-10-03T10:20:33.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 -- start start 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd641a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e000 0x7efd641a6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd641a7fe0 con 0x7efd6409e000 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd641a98a0 con 0x7efd6409e410 2023-10-03T10:20:33.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.261+0000 7efd68d07700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd641a8c70 con 0x7efd6409d6f0 2023-10-03T10:20:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd6259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd641a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52886/0 (socket says 172.21.15.19:52886) 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 -- 172.21.15.19:0/2530586988 learned_addr learned my addr 172.21.15.19:0/2530586988 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd61d9b700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e000 0x7efd641a6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 -- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 msgr2=0x7efd641a5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd641a5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 -- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e000 msgr2=0x7efd641a6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e000 0x7efd641a6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 -- 172.21.15.19:0/2530586988 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c009b30 con 0x7efd6409e410 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd6259c700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd641a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.262+0000 7efd62d9d700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efd5c003f50 tx=0x7efd5c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.263+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c004450 con 0x7efd6409e410 2023-10-03T10:20:33.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.263+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5c0045b0 con 0x7efd6409e410 2023-10-03T10:20:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.263+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5c004940 con 0x7efd6409e410 2023-10-03T10:20:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.263+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd641a9030 con 0x7efd6409e410 2023-10-03T10:20:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.263+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6409c710 con 0x7efd6409e410 2023-10-03T10:20:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.264+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd641a79f0 con 0x7efd6409e410 2023-10-03T10:20:33.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.265+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7efd5c025460 con 0x7efd6409e410 2023-10-03T10:20:33.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.265+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7efd5c041220 con 0x7efd6409e410 2023-10-03T10:20:33.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.270+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7efd5c025710 con 0x7efd6409e410 2023-10-03T10:20:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.283+0000 7f2b0840c700 1 Processor -- start 2023-10-03T10:20:33.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.283+0000 7f2b0840c700 1 -- start start 2023-10-03T10:20:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b0840c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b0009f410 0x7f2b00136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b0840c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 0x7f2b001393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b0840c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b00070940 con 0x7f2b0009e930 2023-10-03T10:20:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b0840c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b0006fd60 con 0x7f2b0009f410 2023-10-03T10:20:33.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b0840c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0006fa80 con 0x7f2b00136fe0 2023-10-03T10:20:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b069a9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 0x7f2b001393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b059a7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2b0009f410 0x7f2b00136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.284+0000 7f2b061a8700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f2b0009e930 0x7f2b0009ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54492/0 (socket says 172.21.15.19:54492) 2023-10-03T10:20:33.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b061a8700 1 -- 172.21.15.19:0/2861673763 learned_addr learned my addr 172.21.15.19:0/2861673763 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b059a7700 1 -- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 msgr2=0x7f2b001393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b059a7700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 0x7f2b001393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b059a7700 1 -- 172.21.15.19:0/2861673763 >> v1:172.21.15.19:6789/0 conn(0x7f2b0009e930 legacy=0x7f2b0009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b051a6700 1 -- 172.21.15.19:0/2861673763 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536716702 0 0) 0x7f2b00070940 con 0x7f2b0009e930 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b059a7700 1 -- 172.21.15.19:0/2861673763 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0009fb60 con 0x7f2b0009f410 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b069a9700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 0x7f2b001393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b059a7700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b00136aa0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009840 tx=0x7f2af0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96870c559e5bb729 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b051a6700 1 -- 172.21.15.19:0/2861673763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011830 con 0x7f2b0009f410 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b051a6700 1 -- 172.21.15.19:0/2861673763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0011990 con 0x7f2b0009f410 2023-10-03T10:20:33.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.285+0000 7f2b051a6700 1 -- 172.21.15.19:0/2861673763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0011d20 con 0x7f2b0009f410 2023-10-03T10:20:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 -- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 msgr2=0x7f2b00136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b00136aa0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2af0009840 tx=0x7f2af0009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 -- 172.21.15.19:0/2861673763 shutdown_connections 2023-10-03T10:20:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b00136fe0 0x7f2b001393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 --2- 172.21.15.19:0/2861673763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b00136aa0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 -- 172.21.15.19:0/2861673763 >> 172.21.15.19:0/2861673763 conn(0x7f2b000a4210 msgr2=0x7f2b000a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 -- 172.21.15.19:0/2861673763 shutdown_connections 2023-10-03T10:20:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.286+0000 7f2b0840c700 1 -- 172.21.15.19:0/2861673763 wait complete. 2023-10-03T10:20:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 Processor -- start 2023-10-03T10:20:33.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 -- start start 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b0009e930 0x7f2b001c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b001c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00132240 con 0x7f2b0009f410 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00121eb0 con 0x7f2b00136fe0 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b0840c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b001bc0c0 con 0x7f2b0009e930 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b059a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b001c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b069a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b059a7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b001c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48194/0 (socket says 172.21.15.19:48194) 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b069a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52892/0 (socket says 172.21.15.19:52892) 2023-10-03T10:20:33.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.288+0000 7f2b059a7700 1 -- 172.21.15.19:0/1425597536 learned_addr learned my addr 172.21.15.19:0/1425597536 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 Processor -- start 2023-10-03T10:20:33.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 -- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b0009e930 msgr2=0x7f2b001c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b0009e930 0x7f2b001c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 -- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 msgr2=0x7f2b001c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b001c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 -- 172.21.15.19:0/1425597536 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009a70 con 0x7f2b00136fe0 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b069a9700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800cb40 con 0x7f2b00136fe0 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800f040 con 0x7f2b00136fe0 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800cee0 con 0x7f2b00136fe0 2023-10-03T10:20:33.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af00094a0 con 0x7f2b00136fe0 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 -- start start 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec9809e1d0 0x7fec98135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec98135e50 0x7fec98138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9809f130 con 0x7fec9809d6f0 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9809f520 con 0x7fec9809e1d0 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7fec9e587700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec9809e930 con 0x7fec98135e50 2023-10-03T10:20:33.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.289+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0009dee0 con 0x7f2b00136fe0 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fec9809e1d0 0x7fec98135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec97fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fec9809d6f0 0x7fec9809dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:54504/0 (socket says 172.21.15.19:54504) 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec97fff700 1 -- 172.21.15.19:0/3415091385 learned_addr learned my addr 172.21.15.19:0/3415091385 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 -- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec98135e50 msgr2=0x7fec98138230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 --2- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec98135e50 0x7fec98138230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 -- 172.21.15.19:0/3415091385 >> v1:172.21.15.19:6789/0 conn(0x7fec9809d6f0 legacy=0x7fec9809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec96ffd700 1 -- 172.21.15.19:0/3415091385 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2291177485 0 0) 0x7fec9809f130 con 0x7fec9809d6f0 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 -- 172.21.15.19:0/3415091385 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9809b2d0 con 0x7fec9809e1d0 2023-10-03T10:20:33.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.290+0000 7fec977fe700 1 --2- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9809e1d0 0x7fec98135910 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00bae0 tx=0x7fec8c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba91e4889633f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7fec96ffd700 1 -- 172.21.15.19:0/3415091385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00dd30 con 0x7fec9809e1d0 2023-10-03T10:20:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b00074ea0 con 0x7f2b00136fe0 2023-10-03T10:20:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2af8014480 con 0x7f2b00136fe0 2023-10-03T10:20:33.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2af803fd00 con 0x7f2b00136fe0 2023-10-03T10:20:33.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7fec96ffd700 1 -- 172.21.15.19:0/3415091385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00de90 con 0x7fec9809e1d0 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7fec96ffd700 1 -- 172.21.15.19:0/3415091385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c010690 con 0x7fec9809e1d0 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7fec9e587700 1 -- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9809e1d0 msgr2=0x7fec98135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.291+0000 7fec9e587700 1 --2- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9809e1d0 0x7fec98135910 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00bae0 tx=0x7fec8c00bdf0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 -- 172.21.15.19:0/3415091385 shutdown_connections 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 --2- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec98135e50 0x7fec98138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 --2- 172.21.15.19:0/3415091385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9809e1d0 0x7fec98135910 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 -- 172.21.15.19:0/3415091385 >> 172.21.15.19:0/3415091385 conn(0x7fec98066f50 msgr2=0x7fec9809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 -- 172.21.15.19:0/3415091385 shutdown_connections 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.293+0000 7fec9e587700 1 -- 172.21.15.19:0/3415091385 wait complete. 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 Processor -- start 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 -- start start 2023-10-03T10:20:33.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec9809d6f0 0x7fec98121f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 0x7fec98122440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 0x7fec98122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec98124310 con 0x7fec98135e50 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec981232d0 con 0x7fec9809d6f0 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.294+0000 7fec9e587700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec98125930 con 0x7fec9809e1d0 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 0x7fec98122440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec977fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 0x7fec98122440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35906/0 (socket says 172.21.15.19:35906) 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec977fe700 1 -- 172.21.15.19:0/4245035565 learned_addr learned my addr 172.21.15.19:0/4245035565 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 0x7fec98122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec97fff700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec9809d6f0 0x7fec98121f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 -- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 msgr2=0x7fec98122440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 0x7fec98122440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 -- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec9809d6f0 msgr2=0x7fec98121f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec9809d6f0 0x7fec98121f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 -- 172.21.15.19:0/4245035565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c00b740 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec9cb24700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 0x7fec98122980 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fec9000bdd0 tx=0x7fec90009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9000cc10 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9000cd70 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.295+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90014680 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.296+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec98123ac0 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.296+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9809c700 con 0x7fec98135e50 2023-10-03T10:20:33.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.297+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2af8012930 con 0x7f2b00136fe0 2023-10-03T10:20:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.297+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fec9001d3b0 con 0x7fec98135e50 2023-10-03T10:20:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.297+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fec9003f590 con 0x7fec98135e50 2023-10-03T10:20:33.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.297+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98126180 con 0x7fec98135e50 2023-10-03T10:20:33.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.302+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fec90019070 con 0x7fec98135e50 2023-10-03T10:20:33.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.304+0000 7f790c590700 1 Processor -- start 2023-10-03T10:20:33.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.304+0000 7f790c590700 1 -- start start 2023-10-03T10:20:33.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f790c590700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f790409e930 0x7f790409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f790c590700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f790c590700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7904070940 con 0x7f790409f650 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f790c590700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f790406fd60 con 0x7f790409e930 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f790c590700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f790406fa80 con 0x7f790409f240 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.305+0000 7f7909b2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52912/0 (socket says 172.21.15.19:52912) 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 -- 172.21.15.19:0/105758223 learned_addr learned my addr 172.21.15.19:0/105758223 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 -- 172.21.15.19:0/105758223 >> v2:172.21.15.19:3300/0 conn(0x7f790409e930 msgr2=0x7f790409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 --2- 172.21.15.19:0/105758223 >> v2:172.21.15.19:3300/0 conn(0x7f790409e930 0x7f790409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 -- 172.21.15.19:0/105758223 >> v1:172.21.15.19:6789/0 conn(0x7f790409f650 legacy=0x7f7904131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 -- 172.21.15.19:0/105758223 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f790409fb60 con 0x7f790409f240 2023-10-03T10:20:33.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f7909b2b700 1 --2- 172.21.15.19:0/105758223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f78f40098f0 tx=0x7f78f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb17ccab22c6201 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f790932a700 1 -- 172.21.15.19:0/105758223 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4004230 con 0x7f790409f240 2023-10-03T10:20:33.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f790932a700 1 -- 172.21.15.19:0/105758223 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4004390 con 0x7f790409f240 2023-10-03T10:20:33.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.306+0000 7f790932a700 1 -- 172.21.15.19:0/105758223 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f40036a0 con 0x7f790409f240 2023-10-03T10:20:33.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.307+0000 7f790c590700 1 -- 172.21.15.19:0/105758223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 msgr2=0x7f79041317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.307+0000 7f790c590700 1 --2- 172.21.15.19:0/105758223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f78f40098f0 tx=0x7f78f4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 -- 172.21.15.19:0/105758223 shutdown_connections 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 --2- 172.21.15.19:0/105758223 >> v2:172.21.15.19:3300/0 conn(0x7f790409e930 0x7f790409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 --2- 172.21.15.19:0/105758223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409f240 0x7f79041317f0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 -- 172.21.15.19:0/105758223 >> 172.21.15.19:0/105758223 conn(0x7f79040a4210 msgr2=0x7f79040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 -- 172.21.15.19:0/105758223 shutdown_connections 2023-10-03T10:20:33.309 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.308+0000 7f790c590700 1 -- 172.21.15.19:0/105758223 wait complete. 2023-10-03T10:20:33.310 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.309+0000 7f790c590700 1 Processor -- start 2023-10-03T10:20:33.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.309+0000 7f790c590700 1 -- start start 2023-10-03T10:20:33.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790409f240 0x7f79041a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 0x7f79041a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:33.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79041aa250 con 0x7f790409f650 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79041ab890 con 0x7f790409e930 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790c590700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79041ab380 con 0x7f790409f240 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790a32c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790a32c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52926/0 (socket says 172.21.15.19:52926) 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790a32c700 1 -- 172.21.15.19:0/878500886 learned_addr learned my addr 172.21.15.19:0/878500886 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.310+0000 7f790ab2d700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 0x7f79041a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.312 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f7909b2b700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790409f240 0x7f79041a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 -- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790409f240 msgr2=0x7f79041a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790409f240 0x7f79041a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 -- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 msgr2=0x7f79041a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 -- 172.21.15.19:0/878500886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f4009550 con 0x7f790409f650 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790a32c700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790ab2d700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 0x7f79041a88d0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c7b0 tx=0x7f78fc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc003e10 con 0x7f790409f650 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc0050d0 con 0x7f790409f650 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78fc005480 con 0x7f790409f650 2023-10-03T10:20:33.313 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79040a0190 con 0x7f790409f650 2023-10-03T10:20:33.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.311+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904071d20 con 0x7f790409f650 2023-10-03T10:20:33.314 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.314+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7904074ea0 con 0x7f790409f650 2023-10-03T10:20:33.315 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.314+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f78fc0055e0 con 0x7f790409f650 2023-10-03T10:20:33.318 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.318+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f78fc019930 con 0x7f790409f650 2023-10-03T10:20:33.320 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.319+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f78fc044060 con 0x7f790409f650 2023-10-03T10:20:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.523+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7efd6409f420 con 0x7efd6409e410 2023-10-03T10:20:33.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.523+0000 7efd52ffd700 1 -- 172.21.15.19:0/2530586988 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efd5c02a070 con 0x7efd6409e410 2023-10-03T10:20:33.524 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 msgr2=0x7efd641a6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efd5c003f50 tx=0x7efd5c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 shutdown_connections 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7efd6409e410 0x7efd641a6890 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7efd6409d6f0 0x7efd641a5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 --2- 172.21.15.19:0/2530586988 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd6409e000 0x7efd641a6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.525+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 >> 172.21.15.19:0/2530586988 conn(0x7efd64066f50 msgr2=0x7efd641badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.526+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 shutdown_connections 2023-10-03T10:20:33.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.526+0000 7efd68d07700 1 -- 172.21.15.19:0/2530586988 wait complete. 2023-10-03T10:20:33.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:33.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.558+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f790409ffe0 con 0x7f790409f650 2023-10-03T10:20:33.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.558+0000 7f78faffd700 1 -- 172.21.15.19:0/878500886 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f78fc017020 con 0x7f790409f650 2023-10-03T10:20:33.559 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:33.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.560+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 msgr2=0x7f79041a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.560+0000 7f790c590700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 0x7f79041a88d0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f78fc00c7b0 tx=0x7f78fc00cac0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 shutdown_connections 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f790409f650 0x7f79041a88d0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f790409e930 0x7f79041a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 --2- 172.21.15.19:0/878500886 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f790409f240 0x7f79041a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 >> 172.21.15.19:0/878500886 conn(0x7f79040a4210 msgr2=0x7f790406c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 shutdown_connections 2023-10-03T10:20:33.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.561+0000 7f790c590700 1 -- 172.21.15.19:0/878500886 wait complete. 2023-10-03T10:20:33.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.580+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b001c8fc0 con 0x7f2b00136fe0 2023-10-03T10:20:33.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.581+0000 7f2af6ffd700 1 -- 172.21.15.19:0/1425597536 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2af8012340 con 0x7f2b00136fe0 2023-10-03T10:20:33.582 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:33.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 msgr2=0x7f2b0006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009e50 tx=0x7f2af800c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 shutdown_connections 2023-10-03T10:20:33.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2b00136fe0 0x7f2b0006b8b0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2b0009e930 0x7f2b001c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 --2- 172.21.15.19:0/1425597536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2b0009f410 0x7f2b001c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 >> 172.21.15.19:0/1425597536 conn(0x7f2b000a4210 msgr2=0x7f2b00134990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 shutdown_connections 2023-10-03T10:20:33.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.583+0000 7f2b0840c700 1 -- 172.21.15.19:0/1425597536 wait complete. 2023-10-03T10:20:33.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.587+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec9809dcd0 con 0x7fec98135e50 2023-10-03T10:20:33.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.587+0000 7fec94ff9700 1 -- 172.21.15.19:0/4245035565 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec9001c360 con 0x7fec98135e50 2023-10-03T10:20:33.588 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 msgr2=0x7fec98122980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 0x7fec98122980 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fec9000bdd0 tx=0x7fec90009ed0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 shutdown_connections 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec98135e50 0x7fec98122980 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fec9809d6f0 0x7fec98121f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 --2- 172.21.15.19:0/4245035565 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fec9809e1d0 0x7fec98122440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 >> 172.21.15.19:0/4245035565 conn(0x7fec98066f50 msgr2=0x7fec980a1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 shutdown_connections 2023-10-03T10:20:33.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:33.590+0000 7fec9e587700 1 -- 172.21.15.19:0/4245035565 wait complete. 2023-10-03T10:20:33.598 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:33.605 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:34.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:34.575 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:34.599 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:34.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:34.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.704+0000 7f75dcabd700 1 Processor -- start 2023-10-03T10:20:34.705 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.704+0000 7f75dcabd700 1 -- start start 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.705+0000 7f75dcabd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.705+0000 7f75dcabd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f75d8139250 0x7f75d813b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.705+0000 7f75dcabd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d809edd0 con 0x7f75d80a0a30 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.705+0000 7f75dcabd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80a18e0 con 0x7f75d8139250 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.705+0000 7f75dcabd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d809e1f0 con 0x7f75d80a1510 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52930/0 (socket says 172.21.15.19:52930) 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 -- 172.21.15.19:0/1100801087 learned_addr learned my addr 172.21.15.19:0/1100801087 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d6d9d700 1 --2- 172.21.15.19:0/1100801087 >> v2:172.21.15.19:3300/0 conn(0x7f75d8139250 0x7f75d813b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.707 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 -- 172.21.15.19:0/1100801087 >> v2:172.21.15.19:3300/0 conn(0x7f75d8139250 msgr2=0x7f75d813b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:34.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 --2- 172.21.15.19:0/1100801087 >> v2:172.21.15.19:3300/0 conn(0x7f75d8139250 0x7f75d813b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 -- 172.21.15.19:0/1100801087 >> v1:172.21.15.19:6789/0 conn(0x7f75d80a0a30 legacy=0x7f75d80a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 -- 172.21.15.19:0/1100801087 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d809dc50 con 0x7f75d80a1510 2023-10-03T10:20:34.708 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d5d9b700 1 --2- 172.21.15.19:0/1100801087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009920 tx=0x7f75cc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5aa06e304aeee26 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.706+0000 7f75d559a700 1 -- 172.21.15.19:0/1100801087 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00ba20 con 0x7f75d80a1510 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75d559a700 1 -- 172.21.15.19:0/1100801087 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00bb80 con 0x7f75d80a1510 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75d559a700 1 -- 172.21.15.19:0/1100801087 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc009e70 con 0x7f75d80a1510 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 -- 172.21.15.19:0/1100801087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 msgr2=0x7f75d8138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1100801087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009920 tx=0x7f75cc009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 -- 172.21.15.19:0/1100801087 shutdown_connections 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1100801087 >> v2:172.21.15.19:3300/0 conn(0x7f75d8139250 0x7f75d813b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1100801087 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d80a1510 0x7f75d8138d10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.707+0000 7f75dcabd700 1 -- 172.21.15.19:0/1100801087 >> 172.21.15.19:0/1100801087 conn(0x7f75d80a6550 msgr2=0x7f75d80a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.708+0000 7f75dcabd700 1 -- 172.21.15.19:0/1100801087 shutdown_connections 2023-10-03T10:20:34.709 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.708+0000 7f75dcabd700 1 -- 172.21.15.19:0/1100801087 wait complete. 2023-10-03T10:20:34.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 Processor -- start 2023-10-03T10:20:34.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 -- start start 2023-10-03T10:20:34.710 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d80a1510 0x7f75d81c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d8139250 0x7f75d81c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8123740 con 0x7f75d80a1510 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8123550 con 0x7f75d8139250 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75dcabd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f75d8124250 con 0x7f75d80a0a30 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75d659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.709+0000 7f75d659c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35924/0 (socket says 172.21.15.19:35924) 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 -- 172.21.15.19:0/1607309559 learned_addr learned my addr 172.21.15.19:0/1607309559 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.711 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d6d9d700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d8139250 0x7f75d81c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d5d9b700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d80a1510 0x7f75d81c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 -- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d8139250 msgr2=0x7f75d81c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d8139250 0x7f75d81c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 -- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d80a1510 msgr2=0x7f75d81c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d80a1510 0x7f75d81c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 -- 172.21.15.19:0/1607309559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009550 con 0x7f75d80a0a30 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75d659c700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f75c800c4e0 tx=0x7f75c800c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80052d0 con 0x7f75d80a0a30 2023-10-03T10:20:34.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.710+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8005430 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.711+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8125460 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.711+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80038c0 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.711+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d8125180 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.712+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f75c8003a20 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.713+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f75c803eb80 con 0x7f75d80a0a30 2023-10-03T10:20:34.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.713+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d8124fe0 con 0x7f75d80a0a30 2023-10-03T10:20:34.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.718+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f75d8124fe0 con 0x7f75d80a0a30 2023-10-03T10:20:34.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.742+0000 7f8f7359e700 1 Processor -- start 2023-10-03T10:20:34.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.742+0000 7f8f7359e700 1 -- start start 2023-10-03T10:20:34.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7359e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409d230 0x7f8f7409d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7359e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7409bd10 con 0x7f8f7409dbc0 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7359e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74096630 con 0x7f8f7409d230 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7359e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f740985d0 con 0x7f8f74097cc0 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35928/0 (socket says 172.21.15.19:35928) 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f7259c700 1 -- 172.21.15.19:0/1475203382 learned_addr learned my addr 172.21.15.19:0/1475203382 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.743+0000 7f8f71d9b700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409d230 0x7f8f7409d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7159a700 1 -- 172.21.15.19:0/1475203382 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178323511 0 0) 0x7f8f7409bd10 con 0x7f8f7409dbc0 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7259c700 1 -- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409d230 msgr2=0x7f8f7409d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7259c700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409d230 0x7f8f7409d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7259c700 1 -- 172.21.15.19:0/1475203382 >> v1:172.21.15.19:6789/0 conn(0x7f8f7409dbc0 legacy=0x7f8f74138560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7259c700 1 -- 172.21.15.19:0/1475203382 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7409e690 con 0x7f8f74097cc0 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7259c700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009920 tx=0x7f8f64009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7976530ca8ec0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7159a700 1 -- 172.21.15.19:0/1475203382 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64005e30 con 0x7f8f74097cc0 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7159a700 1 -- 172.21.15.19:0/1475203382 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64004030 con 0x7f8f74097cc0 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.744+0000 7f8f7159a700 1 -- 172.21.15.19:0/1475203382 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640043e0 con 0x7f8f74097cc0 2023-10-03T10:20:34.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 -- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 msgr2=0x7f8f74098090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009920 tx=0x7f8f64009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 -- 172.21.15.19:0/1475203382 shutdown_connections 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f74098090 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 --2- 172.21.15.19:0/1475203382 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409d230 0x7f8f7409d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 -- 172.21.15.19:0/1475203382 >> 172.21.15.19:0/1475203382 conn(0x7f8f740a2540 msgr2=0x7f8f740a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 -- 172.21.15.19:0/1475203382 shutdown_connections 2023-10-03T10:20:34.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.745+0000 7f8f7359e700 1 -- 172.21.15.19:0/1475203382 wait complete. 2023-10-03T10:20:34.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.747+0000 7f8f7359e700 1 Processor -- start 2023-10-03T10:20:34.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.747+0000 7f8f7359e700 1 -- start start 2023-10-03T10:20:34.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7409d230 0x7f8f741b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409dbc0 0x7f8f741b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f74098820 con 0x7f8f7409d230 2023-10-03T10:20:34.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f741b2a90 con 0x7f8f7409dbc0 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7359e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8f741b5520 con 0x7f8f74097cc0 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7259c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35944/0 (socket says 172.21.15.19:35944) 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f7259c700 1 -- 172.21.15.19:0/388347018 learned_addr learned my addr 172.21.15.19:0/388347018 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f72d9d700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409dbc0 0x7f8f741b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.748+0000 7f8f71d9b700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7409d230 0x7f8f741b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 -- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409dbc0 msgr2=0x7f8f741b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409dbc0 0x7f8f741b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 -- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7409d230 msgr2=0x7f8f741b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7409d230 0x7f8f741b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 -- 172.21.15.19:0/388347018 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64009500 con 0x7f8f74097cc0 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7259c700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009c70 tx=0x7f8f64004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64003d20 con 0x7f8f74097cc0 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64003e80 con 0x7f8f74097cc0 2023-10-03T10:20:34.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f741b3210 con 0x7f8f74097cc0 2023-10-03T10:20:34.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011660 con 0x7f8f74097cc0 2023-10-03T10:20:34.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.749+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f741b24a0 con 0x7f8f74097cc0 2023-10-03T10:20:34.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.750+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8f64018070 con 0x7f8f74097cc0 2023-10-03T10:20:34.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.750+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8f64040120 con 0x7f8f74097cc0 2023-10-03T10:20:34.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.750+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f74074740 con 0x7f8f74097cc0 2023-10-03T10:20:34.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.756+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8f640117c0 con 0x7f8f74097cc0 2023-10-03T10:20:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 Processor -- start 2023-10-03T10:20:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 -- start start 2023-10-03T10:20:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7fe047d69700 1 Processor -- start 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d8409e930 0x7f2d8409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d841317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409f650 0x7f2d84131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d84070940 con 0x7f2d8409e930 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.791+0000 7f2d8af4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8406fd60 con 0x7f2d8409f650 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d8af4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8406fa80 con 0x7f2d8409f240 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d8409e930 0x7f2d8409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f2d8409e930 0x7f2d8409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48274/0 (socket says 172.21.15.19:48274) 2023-10-03T10:20:34.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 -- 172.21.15.19:0/3093890088 learned_addr learned my addr 172.21.15.19:0/3093890088 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d83fff700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d841317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 -- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 msgr2=0x7f2d841317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d841317f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 -- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409f650 msgr2=0x7f2d84131d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409f650 0x7f2d84131d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 -- 172.21.15.19:0/3093890088 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d8409fb60 con 0x7f2d8409e930 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 -- start start 2023-10-03T10:20:34.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe04006e570 0x7fe04006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7f2d88ce7700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409e930 0x7f2d8409ed00 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2d780098f0 tx=0x7f2d78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c41abb825f0e59 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040134610 0x7fe040134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe040070ee0 con 0x7fe04006e570 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe040071480 con 0x7fe04009eca0 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.792+0000 7fe047d69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe04006f3c0 con 0x7fe040134610 2023-10-03T10:20:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7f2d837fe700 1 -- 172.21.15.19:0/3093890088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78011830 con 0x7f2d8409e930 2023-10-03T10:20:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe046306700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040134610 0x7fe040134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52956/0 (socket says 172.21.15.19:52956) 2023-10-03T10:20:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 -- 172.21.15.19:0/476726001 learned_addr learned my addr 172.21.15.19:0/476726001 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7f2d837fe700 1 -- 172.21.15.19:0/3093890088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d78011990 con 0x7f2d8409e930 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7f2d837fe700 1 -- 172.21.15.19:0/3093890088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d78011d20 con 0x7f2d8409e930 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409e930 msgr2=0x7f2d8409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409e930 0x7f2d8409ed00 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f2d780098f0 tx=0x7f2d78009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 -- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040134610 msgr2=0x7fe040134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 --2- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040134610 0x7fe040134a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 -- 172.21.15.19:0/476726001 >> v2:172.21.15.19:3300/0 conn(0x7fe04006e570 msgr2=0x7fe04006e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 --2- 172.21.15.19:0/476726001 >> v2:172.21.15.19:3300/0 conn(0x7fe04006e570 0x7fe04006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 -- 172.21.15.19:0/476726001 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040071b90 con 0x7fe04009eca0 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe045304700 1 --2- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0300098f0 tx=0x7fe030009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=336b25ae3141a656 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe044b03700 1 -- 172.21.15.19:0/476726001 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030011830 con 0x7fe04009eca0 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe044b03700 1 -- 172.21.15.19:0/476726001 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030011990 con 0x7fe04009eca0 2023-10-03T10:20:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.793+0000 7fe044b03700 1 -- 172.21.15.19:0/476726001 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030011d20 con 0x7fe04009eca0 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3093890088 shutdown_connections 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409f650 0x7f2d84131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409e930 0x7f2d8409ed00 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3093890088 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d841317f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3093890088 >> 172.21.15.19:0/3093890088 conn(0x7f2d840a4210 msgr2=0x7f2d840a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3093890088 shutdown_connections 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3093890088 wait complete. 2023-10-03T10:20:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7f2d8af4b700 1 Processor -- start 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7fe047d69700 1 -- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 msgr2=0x7fe04006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.794+0000 7fe047d69700 1 --2- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0300098f0 tx=0x7fe030009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 -- 172.21.15.19:0/476726001 shutdown_connections 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 --2- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040134610 0x7fe040134a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 --2- 172.21.15.19:0/476726001 >> v2:172.21.15.19:3300/0 conn(0x7fe04006e570 0x7fe04006e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 --2- 172.21.15.19:0/476726001 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04009eca0 0x7fe04006ee80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 -- 172.21.15.19:0/476726001 >> 172.21.15.19:0/476726001 conn(0x7fe0400a2aa0 msgr2=0x7fe0400a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 -- 172.21.15.19:0/476726001 shutdown_connections 2023-10-03T10:20:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.795+0000 7fe047d69700 1 -- 172.21.15.19:0/476726001 wait complete. 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 -- start start 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409e930 0x7f2d841204d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409f650 0x7f2d84120f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84123c70 con 0x7f2d8409f650 2023-10-03T10:20:34.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84122150 con 0x7f2d8409e930 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d8af4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840a3040 con 0x7f2d8409f240 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d83fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:35968/0 (socket says 172.21.15.19:35968) 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d83fff700 1 -- 172.21.15.19:0/3678598152 learned_addr learned my addr 172.21.15.19:0/3678598152 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7f2d88ce7700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409e930 0x7f2d841204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.796+0000 7fe047d69700 1 Processor -- start 2023-10-03T10:20:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 -- start start 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 -- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409e930 msgr2=0x7f2d841204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409e930 0x7f2d841204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 -- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409f650 msgr2=0x7f2d84120f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409f650 0x7f2d84120f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 -- 172.21.15.19:0/3678598152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009550 con 0x7f2d8409f240 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d83fff700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9b0 tx=0x7f2d7000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d70009710 con 0x7f2d8409f240 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7000c850 con 0x7f2d8409f240 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000cbc0 con 0x7f2d8409f240 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe040134610 0x7fe040121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040121f60 0x7fe0401d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0401228b0 con 0x7fe040134610 2023-10-03T10:20:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe040124880 con 0x7fe04006e570 2023-10-03T10:20:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7fe047d69700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe040123520 con 0x7fe040121f60 2023-10-03T10:20:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.797+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d840a0190 con 0x7f2d8409f240 2023-10-03T10:20:34.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d84130f50 con 0x7f2d8409f240 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045304700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe040134610 0x7fe040121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52972/0 (socket says 172.21.15.19:52972) 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 -- 172.21.15.19:0/1731576469 learned_addr learned my addr 172.21.15.19:0/1731576469 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 -- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040121f60 msgr2=0x7fe0401d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040121f60 0x7fe0401d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 -- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe040134610 msgr2=0x7fe040121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe040134610 0x7fe040121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.798+0000 7fe045b05700 1 -- 172.21.15.19:0/1731576469 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030009550 con 0x7fe04006e570 2023-10-03T10:20:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.799+0000 7fe045b05700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00b530 tx=0x7fe03c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.799+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d841247a0 con 0x7f2d8409f240 2023-10-03T10:20:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.799+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2d7000cd20 con 0x7f2d8409f240 2023-10-03T10:20:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.799+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011830 con 0x7fe04006e570 2023-10-03T10:20:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.800+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2d7003fca0 con 0x7f2d8409f240 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.799+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c011990 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.800+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe040070610 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.800+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0401242f0 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.801+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c011d40 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.801+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0280052e0 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.802+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe03c01a400 con 0x7fe04006e570 2023-10-03T10:20:34.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.802+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe03c03fc40 con 0x7fe04006e570 2023-10-03T10:20:34.809 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.805+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2d7001ad70 con 0x7f2d8409f240 2023-10-03T10:20:34.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.811+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe03c021300 con 0x7fe04006e570 2023-10-03T10:20:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.972+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75d8124fe0 con 0x7f75d80a0a30 2023-10-03T10:20:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.973+0000 7f75c6ffd700 1 -- 172.21.15.19:0/1607309559 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f75d8124fe0 con 0x7f75d80a0a30 2023-10-03T10:20:34.974 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.974+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f741b38e0 con 0x7f8f74097cc0 2023-10-03T10:20:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.974+0000 7f8f62ffd700 1 -- 172.21.15.19:0/388347018 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8f64033090 con 0x7f8f74097cc0 2023-10-03T10:20:34.975 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 msgr2=0x7f75d81c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f75c800c4e0 tx=0x7f75c800c7f0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 shutdown_connections 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f75d8139250 0x7f75d81c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f75d80a0a30 0x7f75d81c8440 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 --2- 172.21.15.19:0/1607309559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d80a1510 0x7f75d81c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 >> 172.21.15.19:0/1607309559 conn(0x7f75d80a6550 msgr2=0x7f75d8137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 shutdown_connections 2023-10-03T10:20:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.975+0000 7f75dcabd700 1 -- 172.21.15.19:0/1607309559 wait complete. 2023-10-03T10:20:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 msgr2=0x7f8f741b4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8f64009c70 tx=0x7f8f64004750 comp rx=0 tx=0).stop 2023-10-03T10:20:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 shutdown_connections 2023-10-03T10:20:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8f7409dbc0 0x7f8f741b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8f74097cc0 0x7f8f741b4390 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 --2- 172.21.15.19:0/388347018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8f7409d230 0x7f8f741b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 >> 172.21.15.19:0/388347018 conn(0x7f8f740a2540 msgr2=0x7f8f741b79f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 shutdown_connections 2023-10-03T10:20:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:34.977+0000 7f8f7359e700 1 -- 172.21.15.19:0/388347018 wait complete. 2023-10-03T10:20:34.992 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:34.993 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:35.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.017+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe028005860 con 0x7fe04006e570 2023-10-03T10:20:35.018 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.017+0000 7fe0367fc700 1 -- 172.21.15.19:0/1731576469 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe03c028070 con 0x7fe04006e570 2023-10-03T10:20:35.018 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:35.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 msgr2=0x7fe0401214e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:35.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe03c00b530 tx=0x7fe03c00b8f0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 shutdown_connections 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe040121f60 0x7fe0401d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe04006e570 0x7fe0401214e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 --2- 172.21.15.19:0/1731576469 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe040134610 0x7fe040121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 >> 172.21.15.19:0/1731576469 conn(0x7fe0400a2aa0 msgr2=0x7fe0401bf240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 shutdown_connections 2023-10-03T10:20:35.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.019+0000 7fe047d69700 1 -- 172.21.15.19:0/1731576469 wait complete. 2023-10-03T10:20:35.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:35.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.045+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2d84074ea0 con 0x7f2d8409f240 2023-10-03T10:20:35.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.045+0000 7f2d817fa700 1 -- 172.21.15.19:0/3678598152 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2d70021020 con 0x7f2d8409f240 2023-10-03T10:20:35.046 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 msgr2=0x7f2d84120a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2d7000e9b0 tx=0x7f2d7000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 shutdown_connections 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d8409f650 0x7f2d84120f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2d8409e930 0x7f2d841204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 --2- 172.21.15.19:0/3678598152 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2d8409f240 0x7f2d84120a10 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.047+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 >> 172.21.15.19:0/3678598152 conn(0x7f2d840a4210 msgr2=0x7f2d8409bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.048+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 shutdown_connections 2023-10-03T10:20:35.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:35.048+0000 7f2d8af4b700 1 -- 172.21.15.19:0/3678598152 wait complete. 2023-10-03T10:20:35.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:35.992 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:35.993 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:36.037 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:36.062 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:36.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.150+0000 7fe21b7ce700 1 Processor -- start 2023-10-03T10:20:36.151 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.150+0000 7fe21b7ce700 1 -- start start 2023-10-03T10:20:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21b7ce700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe21409e930 0x7fe21409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21b7ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21b7ce700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe214070940 con 0x7fe21409f240 2023-10-03T10:20:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21b7ce700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21406fd60 con 0x7fe21409e930 2023-10-03T10:20:36.152 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21b7ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21406fa80 con 0x7fe21409f650 2023-10-03T10:20:36.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe219d6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe219d6b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52980/0 (socket says 172.21.15.19:52980) 2023-10-03T10:20:36.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe219d6b700 1 -- 172.21.15.19:0/4289451848 learned_addr learned my addr 172.21.15.19:0/4289451848 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.151+0000 7fe21956a700 1 --2- 172.21.15.19:0/4289451848 >> v2:172.21.15.19:3300/0 conn(0x7fe21409e930 0x7fe21409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe219d6b700 1 -- 172.21.15.19:0/4289451848 >> v2:172.21.15.19:3300/0 conn(0x7fe21409e930 msgr2=0x7fe21409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe219d6b700 1 --2- 172.21.15.19:0/4289451848 >> v2:172.21.15.19:3300/0 conn(0x7fe21409e930 0x7fe21409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe219d6b700 1 -- 172.21.15.19:0/4289451848 >> v1:172.21.15.19:6789/0 conn(0x7fe21409f240 legacy=0x7fe2141317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe219d6b700 1 -- 172.21.15.19:0/4289451848 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21409fb60 con 0x7fe21409f650 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe219d6b700 1 --2- 172.21.15.19:0/4289451848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009e50 tx=0x7fe20c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77c54c95153a252b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe20bfff700 1 -- 172.21.15.19:0/4289451848 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00e070 con 0x7fe21409f650 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe20bfff700 1 -- 172.21.15.19:0/4289451848 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c00b910 con 0x7fe21409f650 2023-10-03T10:20:36.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.152+0000 7fe20bfff700 1 -- 172.21.15.19:0/4289451848 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00bcc0 con 0x7fe21409f650 2023-10-03T10:20:36.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 -- 172.21.15.19:0/4289451848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 msgr2=0x7fe214131f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/4289451848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009e50 tx=0x7fe20c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 -- 172.21.15.19:0/4289451848 shutdown_connections 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/4289451848 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f650 0x7fe214131f00 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/4289451848 >> v2:172.21.15.19:3300/0 conn(0x7fe21409e930 0x7fe21409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 -- 172.21.15.19:0/4289451848 >> 172.21.15.19:0/4289451848 conn(0x7fe2140a4210 msgr2=0x7fe2140a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 -- 172.21.15.19:0/4289451848 shutdown_connections 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.153+0000 7fe21b7ce700 1 -- 172.21.15.19:0/4289451848 wait complete. 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 Processor -- start 2023-10-03T10:20:36.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 -- start start 2023-10-03T10:20:36.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7f32433d7700 1 Processor -- start 2023-10-03T10:20:36.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 0x7fe214135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21409f650 0x7fe214135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe214136d50 con 0x7fe21409f650 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe214138a80 con 0x7fe21409f240 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.155+0000 7fe21b7ce700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2140a3310 con 0x7fe21409e930 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:52990/0 (socket says 172.21.15.19:52990) 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 -- 172.21.15.19:0/1295529894 learned_addr learned my addr 172.21.15.19:0/1295529894 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe219d6b700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21409f650 0x7fe214135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe21956a700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 0x7fe214135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 -- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 msgr2=0x7fe214135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 0x7fe214135230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 -- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21409f650 msgr2=0x7fe214135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21409f650 0x7fe214135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 -- 172.21.15.19:0/1295529894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c009b30 con 0x7fe21409f240 2023-10-03T10:20:36.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe218d69700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c4e0 tx=0x7fe20400c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.160 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7fe21956a700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 0x7fe214135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 -- start start 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 0x7f323c134cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f323c1378f0 0x7f323c137d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c09e800 con 0x7f323c138260 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323c095a60 con 0x7f323c1378f0 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.156+0000 7f32433d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c094bd0 con 0x7f323c095690 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3241173700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 0x7f323c134cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3241173700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 0x7f323c134cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53006/0 (socket says 172.21.15.19:53006) 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3241173700 1 -- 172.21.15.19:0/2466167232 learned_addr learned my addr 172.21.15.19:0/2466167232 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3240972700 1 --2- 172.21.15.19:0/2466167232 >> v2:172.21.15.19:3300/0 conn(0x7f323c1378f0 0x7f323c137d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040052d0 con 0x7fe21409f240 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204005430 con 0x7fe21409f240 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204003880 con 0x7fe21409f240 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2140a0190 con 0x7fe21409f240 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3240972700 1 -- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 msgr2=0x7f323c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3240972700 1 --2- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 0x7f323c134cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3240972700 1 -- 172.21.15.19:0/2466167232 >> v1:172.21.15.19:6789/0 conn(0x7f323c138260 legacy=0x7f323c13ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7f3240972700 1 -- 172.21.15.19:0/2466167232 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c0940e0 con 0x7f323c1378f0 2023-10-03T10:20:36.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.157+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2141398b0 con 0x7fe21409f240 2023-10-03T10:20:36.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.158+0000 7f3240972700 1 --2- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c1378f0 0x7f323c137d20 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abd5d563980456b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.158+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe2040039e0 con 0x7fe21409f240 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.159+0000 7f3233fff700 1 -- 172.21.15.19:0/2466167232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c004230 con 0x7f323c1378f0 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.159+0000 7f3233fff700 1 -- 172.21.15.19:0/2466167232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c004390 con 0x7f323c1378f0 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.159+0000 7f3233fff700 1 -- 172.21.15.19:0/2466167232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0036a0 con 0x7f323c1378f0 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 -- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c1378f0 msgr2=0x7f323c137d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 --2- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c1378f0 0x7f323c137d20 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 -- 172.21.15.19:0/2466167232 shutdown_connections 2023-10-03T10:20:36.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 --2- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c095690 0x7f323c134cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 --2- 172.21.15.19:0/2466167232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c1378f0 0x7f323c137d20 secure :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f322c009840 tx=0x7f322c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:36.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.160+0000 7f32433d7700 1 -- 172.21.15.19:0/2466167232 >> 172.21.15.19:0/2466167232 conn(0x7f323c0a2360 msgr2=0x7f323c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.159+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe20403ebb0 con 0x7fe21409f240 2023-10-03T10:20:36.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.159+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe214074ea0 con 0x7fe21409f240 2023-10-03T10:20:36.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.164+0000 7f32433d7700 1 -- 172.21.15.19:0/2466167232 shutdown_connections 2023-10-03T10:20:36.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.164+0000 7f32433d7700 1 -- 172.21.15.19:0/2466167232 wait complete. 2023-10-03T10:20:36.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 Processor -- start 2023-10-03T10:20:36.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 -- start start 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f323c095690 0x7f323c06efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c071db0 0x7f323c132930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c070710 con 0x7f323c138260 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.165+0000 7f32433d7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06f9a0 con 0x7f323c071db0 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f32433d7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06f500 con 0x7f323c095690 2023-10-03T10:20:36.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48324/0 (socket says 172.21.15.19:48324) 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 -- 172.21.15.19:0/1262963972 learned_addr learned my addr 172.21.15.19:0/1262963972 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3241974700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c071db0 0x7f323c132930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 -- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f323c095690 msgr2=0x7f323c06efc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f323c095690 0x7f323c06efc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 -- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c071db0 msgr2=0x7f323c132930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c071db0 0x7f323c132930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 -- 172.21.15.19:0/1262963972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c0094a0 con 0x7f323c138260 2023-10-03T10:20:36.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.166+0000 7f3240972700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.167+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c003dc0 con 0x7f323c138260 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.167+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c01f070 con 0x7f323c138260 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.167+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c011870 con 0x7f323c138260 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.167+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c0946d0 con 0x7f323c138260 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.167+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c0715d0 con 0x7f323c138260 2023-10-03T10:20:36.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.168+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe204017070 con 0x7fe21409f240 2023-10-03T10:20:36.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.168+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c095dc0 con 0x7f323c138260 2023-10-03T10:20:36.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.168+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f322c021030 con 0x7f323c138260 2023-10-03T10:20:36.173 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.168+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f322c040820 con 0x7f323c138260 2023-10-03T10:20:36.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.177+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f323c095dc0 con 0x7f323c138260 2023-10-03T10:20:36.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.186+0000 7f9f8a7f9700 1 Processor -- start 2023-10-03T10:20:36.187 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.186+0000 7f9f8a7f9700 1 -- start start 2023-10-03T10:20:36.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.187+0000 7f9f8a7f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 0x7f9f84136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.188 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.187+0000 7f9f8a7f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.187+0000 7f9f8a7f9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8409ece0 con 0x7f9f8406a770 2023-10-03T10:20:36.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.187+0000 7f9f8a7f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8406b640 con 0x7f9f84136d80 2023-10-03T10:20:36.189 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.187+0000 7f9f8a7f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409e760 con 0x7f9f8406b250 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53032/0 (socket says 172.21.15.19:53032) 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 -- 172.21.15.19:0/1970846546 learned_addr learned my addr 172.21.15.19:0/1970846546 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f837fe700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 0x7f9f84136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 -- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 msgr2=0x7f9f84136840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1970846546 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591442943 0 0) 0x7f9f8409ece0 con 0x7f9f8406a770 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 0x7f9f84136840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 -- 172.21.15.19:0/1970846546 >> v1:172.21.15.19:6789/0 conn(0x7f9f8406a770 legacy=0x7f9f8406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 -- 172.21.15.19:0/1970846546 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8409e040 con 0x7f9f84136d80 2023-10-03T10:20:36.190 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f837fe700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 0x7f9f84136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:36.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.188+0000 7f9f88d96700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e80 tx=0x7f9f7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c588e991291c1206 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.189+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1970846546 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00e070 con 0x7f9f84136d80 2023-10-03T10:20:36.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.189+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1970846546 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c00b910 con 0x7f9f84136d80 2023-10-03T10:20:36.191 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.189+0000 7f9f82ffd700 1 -- 172.21.15.19:0/1970846546 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c00bcc0 con 0x7f9f84136d80 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 msgr2=0x7f9f84139160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c009e80 tx=0x7f9f7c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/1970846546 shutdown_connections 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f84139160 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/1970846546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406b250 0x7f9f84136840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/1970846546 >> 172.21.15.19:0/1970846546 conn(0x7f9f84066f50 msgr2=0x7f9f8409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.192 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/1970846546 shutdown_connections 2023-10-03T10:20:36.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.190+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/1970846546 wait complete. 2023-10-03T10:20:36.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.191+0000 7f9f8a7f9700 1 Processor -- start 2023-10-03T10:20:36.193 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.191+0000 7f9f8a7f9700 1 -- start start 2023-10-03T10:20:36.194 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.191+0000 7f9f8a7f9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 0x7f9f84135760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f8a7f9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 0x7f9f84135ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f8a7f9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f841c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f8a7f9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84124510 con 0x7f9f8406b250 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f8a7f9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8409c240 con 0x7f9f84136d80 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f8a7f9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f84071e60 con 0x7f9f8406a770 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 0x7f9f84135760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 0x7f9f84135760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36010/0 (socket says 172.21.15.19:36010) 2023-10-03T10:20:36.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f83fff700 1 -- 172.21.15.19:0/3457880787 learned_addr learned my addr 172.21.15.19:0/3457880787 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 0x7f9f84135ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f88d96700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f841c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 -- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 msgr2=0x7f9f84135760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 0x7f9f84135760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 -- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 msgr2=0x7f9f841c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f841c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 -- 172.21.15.19:0/3457880787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780094a0 con 0x7f9f8406b250 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.192+0000 7f9f837fe700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 0x7f9f84135ca0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e9b0 tx=0x7f9f7800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.193+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800ee50 con 0x7f9f8406b250 2023-10-03T10:20:36.196 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.193+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7800c850 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.193+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800cbe0 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.193+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7c009b30 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.193+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f841361e0 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.195+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f7800cd40 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.195+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f7803f4d0 con 0x7f9f8406b250 2023-10-03T10:20:36.197 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.195+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f84074ea0 con 0x7f9f8406b250 2023-10-03T10:20:36.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.204+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f78017020 con 0x7f9f8406b250 2023-10-03T10:20:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.242+0000 7f17004fb700 1 Processor -- start 2023-10-03T10:20:36.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.242+0000 7f17004fb700 1 -- start start 2023-10-03T10:20:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f16f809e410 0x7f16f8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16f806b460 con 0x7f16f809e410 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809b120 con 0x7f16f809e000 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.243+0000 7f17004fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f809a7e0 con 0x7f16f809d6f0 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fe297700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53038/0 (socket says 172.21.15.19:53038) 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 -- 172.21.15.19:0/2062133121 learned_addr learned my addr 172.21.15.19:0/2062133121 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 -- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 msgr2=0x7f16f809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 -- 172.21.15.19:0/2062133121 >> v2:172.21.15.19:3300/0 conn(0x7f16f809e410 msgr2=0x7f16f8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 --2- 172.21.15.19:0/2062133121 >> v2:172.21.15.19:3300/0 conn(0x7f16f809e410 0x7f16f8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 -- 172.21.15.19:0/2062133121 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f809a500 con 0x7f16f809e000 2023-10-03T10:20:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fe297700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fda96700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009920 tx=0x7f16e8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9983ea2860f6d238 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fd295700 1 -- 172.21.15.19:0/2062133121 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8011830 con 0x7f16f809e000 2023-10-03T10:20:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.244+0000 7f16fd295700 1 -- 172.21.15.19:0/2062133121 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8011990 con 0x7f16f809e000 2023-10-03T10:20:36.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f16fd295700 1 -- 172.21.15.19:0/2062133121 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8011d20 con 0x7f16f809e000 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 -- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 msgr2=0x7f16f81339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009920 tx=0x7f16e8009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 -- 172.21.15.19:0/2062133121 shutdown_connections 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 --2- 172.21.15.19:0/2062133121 >> v2:172.21.15.19:3300/0 conn(0x7f16f809e410 0x7f16f8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 --2- 172.21.15.19:0/2062133121 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e000 0x7f16f81339f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 -- 172.21.15.19:0/2062133121 >> 172.21.15.19:0/2062133121 conn(0x7f16f8066f50 msgr2=0x7f16f809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 -- 172.21.15.19:0/2062133121 shutdown_connections 2023-10-03T10:20:36.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.245+0000 7f17004fb700 1 -- 172.21.15.19:0/2062133121 wait complete. 2023-10-03T10:20:36.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.247+0000 7f17004fb700 1 Processor -- start 2023-10-03T10:20:36.249 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.247+0000 7f17004fb700 1 -- start start 2023-10-03T10:20:36.250 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f8122860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e410 0x7f16f81232e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f80a2ce0 con 0x7f16f809e000 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8126890 con 0x7f16f809e410 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f17004fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16f8125c50 con 0x7f16f809d6f0 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48334/0 (socket says 172.21.15.19:48334) 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 -- 172.21.15.19:0/76103555 learned_addr learned my addr 172.21.15.19:0/76103555 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fea98700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e410 0x7f16f81232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fe297700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f8122860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:36.251 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 -- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 msgr2=0x7f16f8122860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f8122860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 -- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e410 msgr2=0x7f16f81232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e410 0x7f16f81232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 -- 172.21.15.19:0/76103555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40094a0 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.248+0000 7f16fda96700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000c00 tx=0x7f16e8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.249+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8004510 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.249+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e80036a0 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.249+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8003a50 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.249+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e8009550 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.249+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f8125f10 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.250+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f16e8003bb0 con 0x7f16f809e000 2023-10-03T10:20:36.252 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.250+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f16e8040b40 con 0x7f16f809e000 2023-10-03T10:20:36.253 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.250+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f8123cc0 con 0x7f16f809e000 2023-10-03T10:20:36.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.255+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f16e8015080 con 0x7f16f809e000 2023-10-03T10:20:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.412+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe21406b250 con 0x7fe21409f240 2023-10-03T10:20:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.412+0000 7fe209ffb700 1 -- 172.21.15.19:0/1295529894 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe204010930 con 0x7fe21409f240 2023-10-03T10:20:36.413 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 msgr2=0x7fe214135770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe20400c4e0 tx=0x7fe20400c7f0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 shutdown_connections 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe21409f650 0x7fe214135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe21409e930 0x7fe214135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 --2- 172.21.15.19:0/1295529894 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe21409f240 0x7fe214135770 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.415+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 >> 172.21.15.19:0/1295529894 conn(0x7fe2140a4210 msgr2=0x7fe214132c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.416+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 shutdown_connections 2023-10-03T10:20:36.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.416+0000 7fe21b7ce700 1 -- 172.21.15.19:0/1295529894 wait complete. 2023-10-03T10:20:36.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.434+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f323c095dc0 con 0x7f323c138260 2023-10-03T10:20:36.435 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.435+0000 7f3231ffb700 1 -- 172.21.15.19:0/1262963972 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f323c095dc0 con 0x7f323c138260 2023-10-03T10:20:36.436 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:36.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 msgr2=0x7f323c1323f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f322c000c00 tx=0x7f322c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:36.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 shutdown_connections 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f323c071db0 0x7f323c132930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f323c095690 0x7f323c06efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 --2- 172.21.15.19:0/1262963972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f323c138260 0x7f323c1323f0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 >> 172.21.15.19:0/1262963972 conn(0x7f323c0a2360 msgr2=0x7f323c136f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 shutdown_connections 2023-10-03T10:20:36.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.437+0000 7f32433d7700 1 -- 172.21.15.19:0/1262963972 wait complete. 2023-10-03T10:20:36.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.459+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f8409f6b0 con 0x7f9f8406b250 2023-10-03T10:20:36.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.459+0000 7f9f80ff9700 1 -- 172.21.15.19:0/3457880787 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f780102b0 con 0x7f9f8406b250 2023-10-03T10:20:36.460 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 msgr2=0x7f9f84135ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 0x7f9f84135ca0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e9b0 tx=0x7f9f7800ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 shutdown_connections 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9f84136d80 0x7f9f841c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9f8406a770 0x7f9f84135760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 --2- 172.21.15.19:0/3457880787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f8406b250 0x7f9f84135ca0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 >> 172.21.15.19:0/3457880787 conn(0x7f9f84066f50 msgr2=0x7f9f840a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 shutdown_connections 2023-10-03T10:20:36.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.462+0000 7f9f8a7f9700 1 -- 172.21.15.19:0/3457880787 wait complete. 2023-10-03T10:20:36.477 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:36.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.493+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f16f8074ea0 con 0x7f16f809e000 2023-10-03T10:20:36.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.494+0000 7f16eeffd700 1 -- 172.21.15.19:0/76103555 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f16e802b020 con 0x7f16f809e000 2023-10-03T10:20:36.495 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 msgr2=0x7f16f8122da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f16e8000c00 tx=0x7f16e8004750 comp rx=0 tx=0).stop 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 shutdown_connections 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f16f809e410 0x7f16f81232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f16f809d6f0 0x7f16f8122860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 --2- 172.21.15.19:0/76103555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16f809e000 0x7f16f8122da0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 >> 172.21.15.19:0/76103555 conn(0x7f16f8066f50 msgr2=0x7f16f80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 shutdown_connections 2023-10-03T10:20:36.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:36.496+0000 7f17004fb700 1 -- 172.21.15.19:0/76103555 wait complete. 2023-10-03T10:20:36.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:37.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:37.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:37.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:37.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.584+0000 7f21cca8f700 1 Processor -- start 2023-10-03T10:20:37.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.584+0000 7f21cca8f700 1 -- start start 2023-10-03T10:20:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21cca8f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8131a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21cca8f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21cca8f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c809e130 con 0x7f21c806acb0 2023-10-03T10:20:37.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21cca8f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c81312b0 con 0x7f21c809d9f0 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21cca8f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c809f6e0 con 0x7f21c81316c0 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21c5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21c5d9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38362/0 (socket says 172.21.15.19:38362) 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21c6d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f21c806acb0 0x7f21c8138540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35424/0 (socket says 172.21.15.19:35424) 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21c5d9b700 1 -- 172.21.15.19:0/3602545346 learned_addr learned my addr 172.21.15.19:0/3602545346 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.585+0000 7f21c659c700 1 --2- 172.21.15.19:0/3602545346 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8131a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c559a700 1 -- 172.21.15.19:0/3602545346 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2154690845 0 0) 0x7f21c0001490 con 0x7f21c806acb0 2023-10-03T10:20:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c559a700 1 -- 172.21.15.19:0/3602545346 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21b00035b0 con 0x7f21c806acb0 2023-10-03T10:20:37.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c659c700 1 -- 172.21.15.19:0/3602545346 >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 msgr2=0x7f21c806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c659c700 1 --2- 172.21.15.19:0/3602545346 >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c659c700 1 -- 172.21.15.19:0/3602545346 >> v1:172.21.15.19:6789/0 conn(0x7f21c806acb0 legacy=0x7f21c8138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c659c700 1 -- 172.21.15.19:0/3602545346 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c809e760 con 0x7f21c81316c0 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c5d9b700 1 --2- 172.21.15.19:0/3602545346 >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c659c700 1 --2- 172.21.15.19:0/3602545346 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8131a90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b99df9737e530179 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c559a700 1 -- 172.21.15.19:0/3602545346 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011830 con 0x7f21c81316c0 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c559a700 1 -- 172.21.15.19:0/3602545346 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8011990 con 0x7f21c81316c0 2023-10-03T10:20:37.590 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.586+0000 7f21c559a700 1 -- 172.21.15.19:0/3602545346 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8011d00 con 0x7f21c81316c0 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.587+0000 7f21cca8f700 1 -- 172.21.15.19:0/3602545346 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 msgr2=0x7f21c8131a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.587+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3602545346 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8131a90 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009840 tx=0x7f21b8009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 -- 172.21.15.19:0/3602545346 shutdown_connections 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3602545346 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8131a90 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3602545346 >> v2:172.21.15.19:3300/0 conn(0x7f21c809d9f0 0x7f21c806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 -- 172.21.15.19:0/3602545346 >> 172.21.15.19:0/3602545346 conn(0x7f21c8066f50 msgr2=0x7f21c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 -- 172.21.15.19:0/3602545346 shutdown_connections 2023-10-03T10:20:37.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.588+0000 7f21cca8f700 1 -- 172.21.15.19:0/3602545346 wait complete. 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 Processor -- start 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 -- start start 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806acb0 0x7f21c8071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.593 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81196c0 con 0x7f21c806acb0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c8119b60 con 0x7f21c81316c0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.590+0000 7f21cca8f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21c80a3860 con 0x7f21c809d9f0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c659c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806acb0 0x7f21c8071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47914/0 (socket says 172.21.15.19:47914) 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 -- 172.21.15.19:0/3478346895 learned_addr learned my addr 172.21.15.19:0/3478346895 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c6d9d700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 -- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 msgr2=0x7f21c8071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 -- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806acb0 msgr2=0x7f21c8071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806acb0 0x7f21c8071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 -- 172.21.15.19:0/3478346895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc009550 con 0x7f21c809d9f0 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c6d9d700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.591+0000 7f21c5d9b700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006b20 tx=0x7f21bc00b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.592+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc019070 con 0x7f21c809d9f0 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.592+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b80094a0 con 0x7f21c809d9f0 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.592+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c809ead0 con 0x7f21c809d9f0 2023-10-03T10:20:37.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.592+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc00be80 con 0x7f21c809d9f0 2023-10-03T10:20:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.592+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc004230 con 0x7f21c809d9f0 2023-10-03T10:20:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.593+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f21bc004390 con 0x7f21c809d9f0 2023-10-03T10:20:37.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.593+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac0052e0 con 0x7f21c809d9f0 2023-10-03T10:20:37.597 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.593+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f21bc0474d0 con 0x7f21c809d9f0 2023-10-03T10:20:37.604 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.603+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f21bc01a270 con 0x7f21c809d9f0 2023-10-03T10:20:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.630+0000 7f25340de700 1 Processor -- start 2023-10-03T10:20:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.630+0000 7f25340de700 1 -- start start 2023-10-03T10:20:37.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.630+0000 7f7e062e2700 1 Processor -- start 2023-10-03T10:20:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 -- start start 2023-10-03T10:20:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f25340de700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f252c06b250 0x7f252c136840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f25340de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c136d80 0x7f252c139160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f25340de700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f252c09ece0 con 0x7f252c06a770 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f25340de700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f252c09e760 con 0x7f252c06b250 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f25340de700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f252c09e040 con 0x7f252c136d80 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531679700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f252c06b250 0x7f252c136840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531e7a700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f252c06a770 0x7f252c06ab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35438/0 (socket says 172.21.15.19:35438) 2023-10-03T10:20:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531e7a700 1 -- 172.21.15.19:0/3787121609 learned_addr learned my addr 172.21.15.19:0/3787121609 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e0009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e000 0x7f7e00130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e0009f520 con 0x7f7e0009e410 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009f130 con 0x7f7e0009d6f0 2023-10-03T10:20:37.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f7e062e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0009e930 con 0x7f7e0009e000 2023-10-03T10:20:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531679700 1 -- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c136d80 msgr2=0x7f252c139160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531679700 1 --2- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c136d80 0x7f252c139160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531679700 1 -- 172.21.15.19:0/3787121609 >> v1:172.21.15.19:6789/0 conn(0x7f252c06a770 legacy=0x7f252c06ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.631+0000 7f2531679700 1 -- 172.21.15.19:0/3787121609 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c09f630 con 0x7f252c06b250 2023-10-03T10:20:37.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f2531679700 1 --2- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06b250 0x7f252c136840 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f251c009840 tx=0x7f251c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc10d4ccf9fb129 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7e0487f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7e0487f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38390/0 (socket says 172.21.15.19:38390) 2023-10-03T10:20:37.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7e0487f700 1 -- 172.21.15.19:0/2502843389 learned_addr learned my addr 172.21.15.19:0/2502843389 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e0009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f2530e78700 1 -- 172.21.15.19:0/3787121609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c011830 con 0x7f252c06b250 2023-10-03T10:20:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f2530e78700 1 -- 172.21.15.19:0/3787121609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c011990 con 0x7f252c06b250 2023-10-03T10:20:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f2530e78700 1 -- 172.21.15.19:0/3787121609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c011d20 con 0x7f252c06b250 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dff7fe700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e000 0x7f7e00130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 -- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e000 msgr2=0x7f7e00130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e000 0x7f7e00130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 -- 172.21.15.19:0/2502843389 >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 msgr2=0x7f7e00130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 --2- 172.21.15.19:0/2502843389 >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 -- 172.21.15.19:0/2502843389 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0009b2d0 con 0x7f7e0009d6f0 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.632+0000 7f7dfffff700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e0009dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009870 tx=0x7f7df0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe04187e05bb651d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f7dfeffd700 1 -- 172.21.15.19:0/2502843389 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0011830 con 0x7f7e0009d6f0 2023-10-03T10:20:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f7dfeffd700 1 -- 172.21.15.19:0/2502843389 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0011990 con 0x7f7e0009d6f0 2023-10-03T10:20:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f7dfeffd700 1 -- 172.21.15.19:0/2502843389 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0011d20 con 0x7f7e0009d6f0 2023-10-03T10:20:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 -- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06b250 msgr2=0x7f252c136840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 --2- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06b250 0x7f252c136840 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f251c009840 tx=0x7f251c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f7e0487f700 1 --2- 172.21.15.19:0/2502843389 >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 -- 172.21.15.19:0/3787121609 shutdown_connections 2023-10-03T10:20:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 --2- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c136d80 0x7f252c139160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 --2- 172.21.15.19:0/3787121609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06b250 0x7f252c136840 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.633+0000 7f25340de700 1 -- 172.21.15.19:0/3787121609 >> 172.21.15.19:0/3787121609 conn(0x7f252c066f50 msgr2=0x7f252c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 -- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 msgr2=0x7f7e0009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e0009dac0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009870 tx=0x7f7df0009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f25340de700 1 -- 172.21.15.19:0/3787121609 shutdown_connections 2023-10-03T10:20:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 -- 172.21.15.19:0/2502843389 shutdown_connections 2023-10-03T10:20:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f25340de700 1 -- 172.21.15.19:0/3787121609 wait complete. 2023-10-03T10:20:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e0009dac0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2502843389 >> v2:172.21.15.19:3300/0 conn(0x7f7e0009e410 0x7f7e00130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2502843389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e000 0x7f7e00130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.634+0000 7f7e062e2700 1 -- 172.21.15.19:0/2502843389 >> 172.21.15.19:0/2502843389 conn(0x7f7e00066f50 msgr2=0x7f7e0009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.635+0000 7f7e062e2700 1 -- 172.21.15.19:0/2502843389 shutdown_connections 2023-10-03T10:20:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.635+0000 7f7e062e2700 1 -- 172.21.15.19:0/2502843389 wait complete. 2023-10-03T10:20:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.635+0000 7f25340de700 1 Processor -- start 2023-10-03T10:20:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.635+0000 7f25340de700 1 -- start start 2023-10-03T10:20:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f7e062e2700 1 Processor -- start 2023-10-03T10:20:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c06b250 0x7f252c11d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f252c136d80 0x7f252c1c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252c071e60 con 0x7f252c06a770 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252c11fc30 con 0x7f252c136d80 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f25340de700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f252c06e8e0 con 0x7f252c06b250 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38392/0 (socket says 172.21.15.19:38392) 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 -- 172.21.15.19:0/3157944483 learned_addr learned my addr 172.21.15.19:0/3157944483 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f253267b700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f252c136d80 0x7f252c1c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 -- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c06b250 msgr2=0x7f252c11d480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c06b250 0x7f252c11d480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 -- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f252c136d80 msgr2=0x7f252c1c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f252c136d80 0x7f252c1c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 -- 172.21.15.19:0/3157944483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0094a0 con 0x7f252c06a770 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f2531e7a700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f2528001ba0 tx=0x7f2528014330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f7e062e2700 1 -- start start 2023-10-03T10:20:37.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.636+0000 7f7e062e2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e001cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e062e2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e062e2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e410 0x7f7e001cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e062e2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0012f600 con 0x7f7e0009e000 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e062e2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0012de80 con 0x7f7e0009d6f0 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e062e2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e000a2a00 con 0x7f7e0009e410 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38406/0 (socket says 172.21.15.19:38406) 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 -- 172.21.15.19:0/2179640181 learned_addr learned my addr 172.21.15.19:0/2179640181 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7e0487f700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e410 0x7f7e001cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528017070 con 0x7f252c06a770 2023-10-03T10:20:37.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2528014bd0 con 0x7f252c06a770 2023-10-03T10:20:37.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252c120960 con 0x7f252c06a770 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dfffff700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e001cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 -- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e410 msgr2=0x7f7e001cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e410 0x7f7e001cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 -- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 msgr2=0x7f7e001cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e001cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f7dff7fe700 1 -- 172.21.15.19:0/2179640181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009b30 con 0x7f7e0009e000 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.638+0000 7f7dff7fe700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e810 tx=0x7f7df400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2528005940 con 0x7f252c06a770 2023-10-03T10:20:37.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.637+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c11d9c0 con 0x7f252c06a770 2023-10-03T10:20:37.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.638+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df4004230 con 0x7f7e0009e000 2023-10-03T10:20:37.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.638+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df4004390 con 0x7f7e0009e000 2023-10-03T10:20:37.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.638+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40036a0 con 0x7f7e0009e000 2023-10-03T10:20:37.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.638+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252c074ea0 con 0x7f252c06a770 2023-10-03T10:20:37.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.639+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df00094a0 con 0x7f7e0009e000 2023-10-03T10:20:37.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.639+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2528005aa0 con 0x7f252c06a770 2023-10-03T10:20:37.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.639+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0009c760 con 0x7f7e0009e000 2023-10-03T10:20:37.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.639+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f25280472b0 con 0x7f252c06a770 2023-10-03T10:20:37.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.640+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7df4003820 con 0x7f7e0009e000 2023-10-03T10:20:37.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.640+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0011f970 con 0x7f7e0009e000 2023-10-03T10:20:37.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.640+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7df403f200 con 0x7f7e0009e000 2023-10-03T10:20:37.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.645+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2528005d50 con 0x7f252c06a770 2023-10-03T10:20:37.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.649+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7df401b720 con 0x7f7e0009e000 2023-10-03T10:20:37.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.673+0000 7fa15f0a3700 1 Processor -- start 2023-10-03T10:20:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 -- start start 2023-10-03T10:20:37.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa1580a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa158134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15809edd0 con 0x7fa1580a1340 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15809e1f0 con 0x7fa158133fa0 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.674+0000 7fa15f0a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa15809dc50 con 0x7fa1580a0a30 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa157fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa157fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38410/0 (socket says 172.21.15.19:38410) 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa157fff700 1 -- 172.21.15.19:0/676474147 learned_addr learned my addr 172.21.15.19:0/676474147 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa1580a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15d640700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa158134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 -- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 msgr2=0x7fa158134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa158134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 -- 172.21.15.19:0/676474147 >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 msgr2=0x7fa158133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 --2- 172.21.15.19:0/676474147 >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 -- 172.21.15.19:0/676474147 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580a1fe0 con 0x7fa1580a0a30 2023-10-03T10:20:37.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa157fff700 1 --2- 172.21.15.19:0/676474147 >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15d640700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa158134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.675+0000 7fa15ce3f700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa1580a0e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009870 tx=0x7fa14c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d226ed932ad64d8b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa1577fe700 1 -- 172.21.15.19:0/676474147 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011830 con 0x7fa1580a0a30 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa1577fe700 1 -- 172.21.15.19:0/676474147 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c011990 con 0x7fa1580a0a30 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa1577fe700 1 -- 172.21.15.19:0/676474147 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14c011d00 con 0x7fa1580a0a30 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 -- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 msgr2=0x7fa1580a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa1580a0e00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa14c009870 tx=0x7fa14c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 -- 172.21.15.19:0/676474147 shutdown_connections 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa158134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/676474147 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa1580a0e00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/676474147 >> v2:172.21.15.19:3300/0 conn(0x7fa1580a1340 0x7fa158133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 -- 172.21.15.19:0/676474147 >> 172.21.15.19:0/676474147 conn(0x7fa1580a6550 msgr2=0x7fa1580a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 -- 172.21.15.19:0/676474147 shutdown_connections 2023-10-03T10:20:37.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.676+0000 7fa15f0a3700 1 -- 172.21.15.19:0/676474147 wait complete. 2023-10-03T10:20:37.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.677+0000 7fa15f0a3700 1 Processor -- start 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 -- start start 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa15811dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 0x7fa15811e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa15811ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158121370 con 0x7fa1580a1340 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15811fc90 con 0x7fa158133fa0 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15f0a3700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa158121820 con 0x7fa1580a0a30 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15d640700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa15811ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.678+0000 7fa15d640700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa15811ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53246/0 (socket says 172.21.15.19:53246) 2023-10-03T10:20:37.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa15d640700 1 -- 172.21.15.19:0/2099543400 learned_addr learned my addr 172.21.15.19:0/2099543400 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa15ce3f700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa15811dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 0x7fa15811e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 -- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 msgr2=0x7fa15811dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa15811dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 -- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 msgr2=0x7fa15811ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa15811ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 -- 172.21.15.19:0/2099543400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009550 con 0x7fa1580a1340 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa157fff700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 0x7fa15811e520 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa14400e9a0 tx=0x7fa14400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.679+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004030 con 0x7fa1580a1340 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.680+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144004190 con 0x7fa1580a1340 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.680+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14c0094a0 con 0x7fa1580a1340 2023-10-03T10:20:37.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.680+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144004520 con 0x7fa1580a1340 2023-10-03T10:20:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.680+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa158120e40 con 0x7fa1580a1340 2023-10-03T10:20:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.681+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15809b1e0 con 0x7fa1580a1340 2023-10-03T10:20:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.681+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa1440036a0 con 0x7fa1580a1340 2023-10-03T10:20:37.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.681+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa14403f8f0 con 0x7fa1580a1340 2023-10-03T10:20:37.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.686+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa144011db0 con 0x7fa1580a1340 2023-10-03T10:20:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.818+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f21ac005590 con 0x7f21c809d9f0 2023-10-03T10:20:37.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.819+0000 7f21b6ffd700 1 -- 172.21.15.19:0/3478346895 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f21bc022030 con 0x7f21c809d9f0 2023-10-03T10:20:37.820 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 msgr2=0x7f21c8071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006b20 tx=0x7f21bc00b650 comp rx=0 tx=0).stop 2023-10-03T10:20:37.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 shutdown_connections 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21c81316c0 0x7f21c8071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21c806acb0 0x7f21c8071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 --2- 172.21.15.19:0/3478346895 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21c809d9f0 0x7f21c8071670 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 >> 172.21.15.19:0/3478346895 conn(0x7f21c8066f50 msgr2=0x7f21c80a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 shutdown_connections 2023-10-03T10:20:37.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.821+0000 7f21cca8f700 1 -- 172.21.15.19:0/3478346895 wait complete. 2023-10-03T10:20:37.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.857+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f252c06c360 con 0x7f252c06a770 2023-10-03T10:20:37.858 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.858+0000 7f25227fc700 1 -- 172.21.15.19:0/3157944483 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f252802a020 con 0x7f252c06a770 2023-10-03T10:20:37.859 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:37.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7e00074ea0 con 0x7f7e0009e000 2023-10-03T10:20:37.861 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 msgr2=0x7f252c11cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f2528001ba0 tx=0x7f2528014330 comp rx=0 tx=0).stop 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 shutdown_connections 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f252c136d80 0x7f252c1c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f252c06a770 0x7f252c11cf40 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 --2- 172.21.15.19:0/3157944483 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f252c06b250 0x7f252c11d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 >> 172.21.15.19:0/3157944483 conn(0x7f252c066f50 msgr2=0x7f252c0701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 shutdown_connections 2023-10-03T10:20:37.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f25340de700 1 -- 172.21.15.19:0/3157944483 wait complete. 2023-10-03T10:20:37.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.860+0000 7f7dfcff9700 1 -- 172.21.15.19:0/2179640181 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7df401c3c0 con 0x7f7e0009e000 2023-10-03T10:20:37.863 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 msgr2=0x7f7e001ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f7df400e810 tx=0x7f7df400eb20 comp rx=0 tx=0).stop 2023-10-03T10:20:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 shutdown_connections 2023-10-03T10:20:37.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e0009e410 0x7f7e001cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e0009d6f0 0x7f7e001cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 --2- 172.21.15.19:0/2179640181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e0009e000 0x7f7e001ccae0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 >> 172.21.15.19:0/2179640181 conn(0x7f7e00066f50 msgr2=0x7f7e00119480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 shutdown_connections 2023-10-03T10:20:37.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.863+0000 7f7e062e2700 1 -- 172.21.15.19:0/2179640181 wait complete. 2023-10-03T10:20:37.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:37.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.895+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa158074ea0 con 0x7fa1580a1340 2023-10-03T10:20:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.895+0000 7fa1557fa700 1 -- 172.21.15.19:0/2099543400 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa144011350 con 0x7fa1580a1340 2023-10-03T10:20:37.896 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 msgr2=0x7fa15811e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 0x7fa15811e520 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fa14400e9a0 tx=0x7fa14400ecb0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 shutdown_connections 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa158133fa0 0x7fa15811ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa1580a0a30 0x7fa15811dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 --2- 172.21.15.19:0/2099543400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa1580a1340 0x7fa15811e520 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 >> 172.21.15.19:0/2099543400 conn(0x7fa1580a6550 msgr2=0x7fa158133060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.897+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 shutdown_connections 2023-10-03T10:20:37.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:37.898+0000 7fa15f0a3700 1 -- 172.21.15.19:0/2099543400 wait complete. 2023-10-03T10:20:37.912 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:38.838 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:38.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:38.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:38.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:38.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 Processor -- start 2023-10-03T10:20:39.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 -- start start 2023-10-03T10:20:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc1338a0 0x7fbcfc133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcfc09de50 0x7fbcfc09e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc09e760 0x7fbcfc13a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcfc06fef0 con 0x7fbcfc09de50 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc06ef30 con 0x7fbcfc1338a0 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbd013ae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc1334b0 con 0x7fbcfc09e760 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbcfa7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcfc09de50 0x7fbcfc09e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbcfa7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbcfc09de50 0x7fbcfc09e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38418/0 (socket says 172.21.15.19:38418) 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbcfa7fc700 1 -- 172.21.15.19:0/3026269441 learned_addr learned my addr 172.21.15.19:0/3026269441 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:38.999+0000 7fbcfb7fe700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc09e760 0x7fbcfc13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfaffd700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc1338a0 0x7fbcfc133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 -- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc09e760 msgr2=0x7fbcfc13a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:39.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc09e760 0x7fbcfc13a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 -- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc1338a0 msgr2=0x7fbcfc133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc1338a0 0x7fbcfc133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 -- 172.21.15.19:0/3026269441 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc06fc30 con 0x7fbcfc09de50 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcfa7fc700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09de50 0x7fbcfc09e220 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00098f0 tx=0x7fbcf0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce40dd8e50235abf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcf9ffb700 1 -- 172.21.15.19:0/3026269441 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0011830 con 0x7fbcfc09de50 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcf9ffb700 1 -- 172.21.15.19:0/3026269441 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0011990 con 0x7fbcfc09de50 2023-10-03T10:20:39.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.000+0000 7fbcf9ffb700 1 -- 172.21.15.19:0/3026269441 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0011d20 con 0x7fbcfc09de50 2023-10-03T10:20:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 -- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09de50 msgr2=0x7fbcfc09e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09de50 0x7fbcfc09e220 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00098f0 tx=0x7fbcf0009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:39.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 -- 172.21.15.19:0/3026269441 shutdown_connections 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc1338a0 0x7fbcfc133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc09e760 0x7fbcfc13a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 --2- 172.21.15.19:0/3026269441 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09de50 0x7fbcfc09e220 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 -- 172.21.15.19:0/3026269441 >> 172.21.15.19:0/3026269441 conn(0x7fbcfc0a2aa0 msgr2=0x7fbcfc0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 -- 172.21.15.19:0/3026269441 shutdown_connections 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.001+0000 7fbd013ae700 1 -- 172.21.15.19:0/3026269441 wait complete. 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 Processor -- start 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 -- start start 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09e760 0x7fbcfc11ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc120ea0 con 0x7fbcfc09e760 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc11feb0 con 0x7fbcfc09de50 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbd013ae700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcfc120720 con 0x7fbcfc1338a0 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbcfb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbcfaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbcfb7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:47980/0 (socket says 172.21.15.19:47980) 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbcfb7fe700 1 -- 172.21.15.19:0/2631298833 learned_addr learned my addr 172.21.15.19:0/2631298833 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.003+0000 7fbcfaffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53278/0 (socket says 172.21.15.19:53278) 2023-10-03T10:20:39.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfa7fc700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09e760 0x7fbcfc11ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 -- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 msgr2=0x7fbcfc11f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 -- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09e760 msgr2=0x7fbcfc11ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09e760 0x7fbcfc11ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 -- 172.21.15.19:0/2631298833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009550 con 0x7fbcfc09de50 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfb7fe700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbcfaffd700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00e7e0 tx=0x7fbcec00eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.004+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00c070 con 0x7fbcfc09de50 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.005+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec013610 con 0x7fbcfc09de50 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.005+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcfc122240 con 0x7fbcfc09de50 2023-10-03T10:20:39.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.005+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0139a0 con 0x7fbcfc09de50 2023-10-03T10:20:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.005+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcfc12f520 con 0x7fbcfc09de50 2023-10-03T10:20:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.006+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcfc074ea0 con 0x7fbcfc09de50 2023-10-03T10:20:39.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.006+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbcec013b00 con 0x7fbcfc09de50 2023-10-03T10:20:39.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.007+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbcec03f960 con 0x7fbcfc09de50 2023-10-03T10:20:39.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.016+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbcec024940 con 0x7fbcfc09de50 2023-10-03T10:20:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 Processor -- start 2023-10-03T10:20:39.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 -- start start 2023-10-03T10:20:39.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 Processor -- start 2023-10-03T10:20:39.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3af4135c20 0x7f3af4138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af406fa40 con 0x7f3af412cf60 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af412cd90 con 0x7f3af4135c20 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af9453700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4071780 con 0x7f3af406f5d0 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 -- start start 2023-10-03T10:20:39.043 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 0x7f8178135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f8178138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817809f130 con 0x7f817809d6f0 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f817809f520 con 0x7f817809e1d0 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f817eba0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817809e930 con 0x7f8178135e50 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.041+0000 7f3af27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53288/0 (socket says 172.21.15.19:53288) 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 -- 172.21.15.19:0/38854505 learned_addr learned my addr 172.21.15.19:0/38854505 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.044 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af37fe700 1 --2- 172.21.15.19:0/38854505 >> v2:172.21.15.19:3300/0 conn(0x7f3af4135c20 0x7f3af4138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f8177fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 0x7f8178135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f8177fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 0x7f8178135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38448/0 (socket says 172.21.15.19:38448) 2023-10-03T10:20:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f8177fff700 1 -- 172.21.15.19:0/901819940 learned_addr learned my addr 172.21.15.19:0/901819940 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 -- 172.21.15.19:0/38854505 >> v2:172.21.15.19:3300/0 conn(0x7f3af4135c20 msgr2=0x7f3af4138000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:39.045 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 --2- 172.21.15.19:0/38854505 >> v2:172.21.15.19:3300/0 conn(0x7f3af4135c20 0x7f3af4138000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 -- 172.21.15.19:0/38854505 >> v1:172.21.15.19:6789/0 conn(0x7f3af412cf60 legacy=0x7f3af412f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 -- 172.21.15.19:0/38854505 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4071a40 con 0x7f3af406f5d0 2023-10-03T10:20:39.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f817d13d700 1 --2- 172.21.15.19:0/901819940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f8178138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af27fc700 1 --2- 172.21.15.19:0/38854505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800bb90 tx=0x7f3ae800bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fb8b63950c8729 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.042+0000 7f3af1ffb700 1 -- 172.21.15.19:0/38854505 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae800dc20 con 0x7f3af406f5d0 2023-10-03T10:20:39.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f3af1ffb700 1 -- 172.21.15.19:0/38854505 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae800dd80 con 0x7f3af406f5d0 2023-10-03T10:20:39.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f3af1ffb700 1 -- 172.21.15.19:0/38854505 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8017630 con 0x7f3af406f5d0 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f817d13d700 1 -- 172.21.15.19:0/901819940 >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 msgr2=0x7f8178135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f817d13d700 1 --2- 172.21.15.19:0/901819940 >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 0x7f8178135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f817d13d700 1 -- 172.21.15.19:0/901819940 >> v1:172.21.15.19:6789/0 conn(0x7f817809d6f0 legacy=0x7f817809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f817d13d700 1 -- 172.21.15.19:0/901819940 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f817809b2d0 con 0x7f8178135e50 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f817d13d700 1 --2- 172.21.15.19:0/901819940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f8178138230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8170009d90 tx=0x7f817000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5252defc3410c3e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f81777fe700 1 -- 172.21.15.19:0/901819940 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000e070 con 0x7f8178135e50 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f81777fe700 1 -- 172.21.15.19:0/901819940 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000bb20 con 0x7f8178135e50 2023-10-03T10:20:39.048 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f81777fe700 1 -- 172.21.15.19:0/901819940 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170012430 con 0x7f8178135e50 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f3af9453700 1 -- 172.21.15.19:0/38854505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 msgr2=0x7f3af412ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.043+0000 7f3af9453700 1 --2- 172.21.15.19:0/38854505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800bb90 tx=0x7f3ae800bea0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 -- 172.21.15.19:0/38854505 shutdown_connections 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 --2- 172.21.15.19:0/38854505 >> v2:172.21.15.19:3300/0 conn(0x7f3af4135c20 0x7f3af4138000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 --2- 172.21.15.19:0/38854505 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af412ffc0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 -- 172.21.15.19:0/38854505 >> 172.21.15.19:0/38854505 conn(0x7f3af40a2aa0 msgr2=0x7f3af40a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 -- 172.21.15.19:0/38854505 shutdown_connections 2023-10-03T10:20:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f3af9453700 1 -- 172.21.15.19:0/38854505 wait complete. 2023-10-03T10:20:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 -- 172.21.15.19:0/901819940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 msgr2=0x7f8178138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 --2- 172.21.15.19:0/901819940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f8178138230 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f8170009d90 tx=0x7f817000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 -- 172.21.15.19:0/901819940 shutdown_connections 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 --2- 172.21.15.19:0/901819940 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f8178138230 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 --2- 172.21.15.19:0/901819940 >> v2:172.21.15.19:3300/0 conn(0x7f817809e1d0 0x7f8178135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 -- 172.21.15.19:0/901819940 >> 172.21.15.19:0/901819940 conn(0x7f8178066f50 msgr2=0x7f817809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 -- 172.21.15.19:0/901819940 shutdown_connections 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.044+0000 7f817eba0700 1 -- 172.21.15.19:0/901819940 wait complete. 2023-10-03T10:20:39.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 Processor -- start 2023-10-03T10:20:39.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 -- start start 2023-10-03T10:20:39.052 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f817eba0700 1 Processor -- start 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af412cf60 0x7f3af4133d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3af4135c20 0x7f3af41c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af409aa30 con 0x7f3af412cf60 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af41333e0 con 0x7f3af406f5d0 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f3af9453700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3af412c030 con 0x7f3af4135c20 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53300/0 (socket says 172.21.15.19:53300) 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 -- 172.21.15.19:0/457844188 learned_addr learned my addr 172.21.15.19:0/457844188 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 -- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3af4135c20 msgr2=0x7f3af41c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.053 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3af4135c20 0x7f3af41c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 -- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af412cf60 msgr2=0x7f3af4133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af412cf60 0x7f3af4133d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 -- 172.21.15.19:0/457844188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae800b7f0 con 0x7f3af406f5d0 2023-10-03T10:20:39.054 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.045+0000 7f817eba0700 1 -- start start 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f817809d6f0 0x7f81781c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f817809e1d0 0x7f81781c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817811b9d0 con 0x7f817809d6f0 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817811cc00 con 0x7f8178135e50 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817eba0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f817811c090 con 0x7f817809e1d0 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817d13d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817d13d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53308/0 (socket says 172.21.15.19:53308) 2023-10-03T10:20:39.055 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f817d13d700 1 -- 172.21.15.19:0/78100284 learned_addr learned my addr 172.21.15.19:0/78100284 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.046+0000 7f3af2ffd700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c4e0 tx=0x7f3ae400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817c93c700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f817809d6f0 0x7f81781c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 -- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f817809e1d0 msgr2=0x7f81781c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f817809e1d0 0x7f81781c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.056 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 -- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f817809d6f0 msgr2=0x7f81781c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f817809d6f0 0x7f81781c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 -- 172.21.15.19:0/78100284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170009a70 con 0x7f8178135e50 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40052d0 con 0x7f3af406f5d0 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4005430 con 0x7f3af406f5d0 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40038c0 con 0x7f3af406f5d0 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af4129fa0 con 0x7f3af406f5d0 2023-10-03T10:20:39.057 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af4134960 con 0x7f3af406f5d0 2023-10-03T10:20:39.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f817d13d700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8170013000 tx=0x7f8170004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ae4003a20 con 0x7f3af406f5d0 2023-10-03T10:20:39.058 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ae403ead0 con 0x7f3af406f5d0 2023-10-03T10:20:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.047+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170012430 con 0x7f8178135e50 2023-10-03T10:20:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8170020070 con 0x7f8178135e50 2023-10-03T10:20:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170003ea0 con 0x7f8178135e50 2023-10-03T10:20:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f817eba0700 1 -- 172.21.15.19:0/78100284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817811ce00 con 0x7f8178135e50 2023-10-03T10:20:39.060 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.048+0000 7f817eba0700 1 -- 172.21.15.19:0/78100284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817809c700 con 0x7f8178135e50 2023-10-03T10:20:39.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.049+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af4134900 con 0x7f3af406f5d0 2023-10-03T10:20:39.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.049+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81500052e0 con 0x7f8178135e50 2023-10-03T10:20:39.061 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.054+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ae4017070 con 0x7f3af406f5d0 2023-10-03T10:20:39.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.055+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8170004280 con 0x7f8178135e50 2023-10-03T10:20:39.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.055+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8170022070 con 0x7f8178135e50 2023-10-03T10:20:39.062 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.059+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8170004910 con 0x7f8178135e50 2023-10-03T10:20:39.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.078+0000 7f928d4be700 1 Processor -- start 2023-10-03T10:20:39.079 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.078+0000 7f928d4be700 1 -- start start 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f928d4be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f928806f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f928d4be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f928812fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f928d4be700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f928812cd90 con 0x7f9288130260 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f928d4be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928812d330 con 0x7f928812cf60 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f928d4be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92881306d0 con 0x7f928812f8b0 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f92877fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9288130260 0x7f9288136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35460/0 (socket says 172.21.15.19:35460) 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f92877fe700 1 -- 172.21.15.19:0/2192996054 learned_addr learned my addr 172.21.15.19:0/2192996054 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9286ffd700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f928806f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.080 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f92867fc700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f928812fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9286ffd700 1 -- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 msgr2=0x7f928812fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:39.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9286ffd700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f928812fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9285ffb700 1 -- 172.21.15.19:0/2192996054 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085211472 0 0) 0x7f928812cd90 con 0x7f9288130260 2023-10-03T10:20:39.081 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9286ffd700 1 -- 172.21.15.19:0/2192996054 >> v1:172.21.15.19:6789/0 conn(0x7f9288130260 legacy=0x7f9288136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f9286ffd700 1 -- 172.21.15.19:0/2192996054 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288071780 con 0x7f928812cf60 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.079+0000 7f92867fc700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f928812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.080+0000 7f9286ffd700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f928806f5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9278009870 tx=0x7f9278009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6600c760e241b444 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.080+0000 7f9285ffb700 1 -- 172.21.15.19:0/2192996054 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278011830 con 0x7f928812cf60 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.080+0000 7f9285ffb700 1 -- 172.21.15.19:0/2192996054 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9278011990 con 0x7f928812cf60 2023-10-03T10:20:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.080+0000 7f9285ffb700 1 -- 172.21.15.19:0/2192996054 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9278011d20 con 0x7f928812cf60 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 -- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 msgr2=0x7f928806f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f928806f5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9278009870 tx=0x7f9278009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 -- 172.21.15.19:0/2192996054 shutdown_connections 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f928806f5d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 --2- 172.21.15.19:0/2192996054 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f928812fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 -- 172.21.15.19:0/2192996054 >> 172.21.15.19:0/2192996054 conn(0x7f92880a2aa0 msgr2=0x7f92880a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 -- 172.21.15.19:0/2192996054 shutdown_connections 2023-10-03T10:20:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.081+0000 7f928d4be700 1 -- 172.21.15.19:0/2192996054 wait complete. 2023-10-03T10:20:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.082+0000 7f928d4be700 1 Processor -- start 2023-10-03T10:20:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.082+0000 7f928d4be700 1 -- start start 2023-10-03T10:20:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f92881c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 0x7f92881c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928809cc60 con 0x7f9288130260 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f928809e970 con 0x7f928812cf60 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f928d4be700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f928809ce50 con 0x7f928812f8b0 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f92867fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f92877fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 0x7f92881c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f92867fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48026/0 (socket says 172.21.15.19:48026) 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f92867fc700 1 -- 172.21.15.19:0/2987150151 learned_addr learned my addr 172.21.15.19:0/2987150151 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.083+0000 7f9286ffd700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f92881c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 -- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 msgr2=0x7f92881c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f92881c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 -- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 msgr2=0x7f92881c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 0x7f92881c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 -- 172.21.15.19:0/2987150151 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c00d940 con 0x7f928812f8b0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92877fe700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 0x7f92881c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f92867fc700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f927c010f40 tx=0x7f927c00f390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c012070 con 0x7f928812f8b0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f927c00de80 con 0x7f928812f8b0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780094a0 con 0x7f928812f8b0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c00b070 con 0x7f928812f8b0 2023-10-03T10:20:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.084+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928809d450 con 0x7f928812f8b0 2023-10-03T10:20:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.086+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f927c00fa80 con 0x7f928812f8b0 2023-10-03T10:20:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.086+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288074ea0 con 0x7f928812f8b0 2023-10-03T10:20:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.086+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f927c03ef10 con 0x7f928812f8b0 2023-10-03T10:20:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.091+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f927c00d2d0 con 0x7f928812f8b0 2023-10-03T10:20:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.232+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcfc06b9e0 con 0x7fbcfc09de50 2023-10-03T10:20:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.232+0000 7fbce37fe700 1 -- 172.21.15.19:0/2631298833 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbcec02a030 con 0x7fbcfc09de50 2023-10-03T10:20:39.233 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 msgr2=0x7fbcfc11ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbcec00e7e0 tx=0x7fbcec00eaf0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 shutdown_connections 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbcfc1338a0 0x7fbcfc11f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbcfc09de50 0x7fbcfc11ea50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.236 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 --2- 172.21.15.19:0/2631298833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbcfc09e760 0x7fbcfc11ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 >> 172.21.15.19:0/2631298833 conn(0x7fbcfc0a2aa0 msgr2=0x7fbcfc09ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 shutdown_connections 2023-10-03T10:20:39.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.235+0000 7fbd013ae700 1 -- 172.21.15.19:0/2631298833 wait complete. 2023-10-03T10:20:39.250 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:39.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.265+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3af4074ea0 con 0x7f3af406f5d0 2023-10-03T10:20:39.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.266+0000 7f3adb7fe700 1 -- 172.21.15.19:0/457844188 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ae4017030 con 0x7f3af406f5d0 2023-10-03T10:20:39.266 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 msgr2=0x7f3af41337d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3ae400c4e0 tx=0x7f3ae400c8a0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 shutdown_connections 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3af4135c20 0x7f3af41c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3af406f5d0 0x7f3af41337d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 --2- 172.21.15.19:0/457844188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af412cf60 0x7f3af4133d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 >> 172.21.15.19:0/457844188 conn(0x7f3af40a2aa0 msgr2=0x7f3af406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 shutdown_connections 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f3af9453700 1 -- 172.21.15.19:0/457844188 wait complete. 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.268+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8150005860 con 0x7f8178135e50 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.269+0000 7f81757fa700 1 -- 172.21.15.19:0/78100284 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8170035090 con 0x7f8178135e50 2023-10-03T10:20:39.270 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 msgr2=0x7f81781cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8170013000 tx=0x7f8170004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 shutdown_connections 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8178135e50 0x7f81781cc580 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f817809d6f0 0x7f81781c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 --2- 172.21.15.19:0/78100284 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f817809e1d0 0x7f81781c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.271+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 >> 172.21.15.19:0/78100284 conn(0x7f8178066f50 msgr2=0x7f81780a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.272+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 shutdown_connections 2023-10-03T10:20:39.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.272+0000 7f815f7fe700 1 -- 172.21.15.19:0/78100284 wait complete. 2023-10-03T10:20:39.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:39.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:39.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.300+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92880713a0 con 0x7f928812f8b0 2023-10-03T10:20:39.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.300+0000 7f926f7fe700 1 -- 172.21.15.19:0/2987150151 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f927c024020 con 0x7f928812f8b0 2023-10-03T10:20:39.302 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.302+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 msgr2=0x7f92881c4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.302+0000 7f928d4be700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f927c010f40 tx=0x7f927c00f390 comp rx=0 tx=0).stop 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 shutdown_connections 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9288130260 0x7f92881c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f928812cf60 0x7f92881c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 --2- 172.21.15.19:0/2987150151 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f928812f8b0 0x7f92881c4380 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 >> 172.21.15.19:0/2987150151 conn(0x7f92880a2aa0 msgr2=0x7f92880a0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 shutdown_connections 2023-10-03T10:20:39.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:39.303+0000 7f928d4be700 1 -- 172.21.15.19:0/2987150151 wait complete. 2023-10-03T10:20:39.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:40.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:40.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:40.288 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:40.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.414+0000 7fcb79c5f700 1 Processor -- start 2023-10-03T10:20:40.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.414+0000 7fcb79c5f700 1 -- start start 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a1340 0x7fcb74133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcb74133fa0 0x7fcb74134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7409edd0 con 0x7fcb74133fa0 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7409e1f0 con 0x7fcb740a1340 2023-10-03T10:20:40.416 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb79c5f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7409dc50 con 0x7fcb740a0a30 2023-10-03T10:20:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb737fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb737fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48042/0 (socket says 172.21.15.19:48042) 2023-10-03T10:20:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb737fe700 1 -- 172.21.15.19:0/1337385771 learned_addr learned my addr 172.21.15.19:0/1337385771 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb73fff700 1 --2- 172.21.15.19:0/1337385771 >> v2:172.21.15.19:3300/0 conn(0x7fcb74133fa0 0x7fcb74134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.417 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.415+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a1340 0x7fcb74133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 -- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a1340 msgr2=0x7fcb74133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a1340 0x7fcb74133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 -- 172.21.15.19:0/1337385771 >> v2:172.21.15.19:3300/0 conn(0x7fcb74133fa0 msgr2=0x7fcb74134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.418 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 --2- 172.21.15.19:0/1337385771 >> v2:172.21.15.19:3300/0 conn(0x7fcb74133fa0 0x7fcb74134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 -- 172.21.15.19:0/1337385771 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740a1fe0 con 0x7fcb740a0a30 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb737fe700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcb640098f0 tx=0x7fcb64009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947413854f8d58e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb727fc700 1 -- 172.21.15.19:0/1337385771 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64011830 con 0x7fcb740a0a30 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb727fc700 1 -- 172.21.15.19:0/1337385771 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64011990 con 0x7fcb740a0a30 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.416+0000 7fcb727fc700 1 -- 172.21.15.19:0/1337385771 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64011d20 con 0x7fcb740a0a30 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 -- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 msgr2=0x7fcb740a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fcb640098f0 tx=0x7fcb64009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 -- 172.21.15.19:0/1337385771 shutdown_connections 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/1337385771 >> v2:172.21.15.19:3300/0 conn(0x7fcb74133fa0 0x7fcb74134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a0a30 0x7fcb740a0e00 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/1337385771 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a1340 0x7fcb74133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 -- 172.21.15.19:0/1337385771 >> 172.21.15.19:0/1337385771 conn(0x7fcb740a6550 msgr2=0x7fcb740a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.419 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.417+0000 7fcb79c5f700 1 -- 172.21.15.19:0/1337385771 shutdown_connections 2023-10-03T10:20:40.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.418+0000 7fcb79c5f700 1 -- 172.21.15.19:0/1337385771 wait complete. 2023-10-03T10:20:40.420 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.419+0000 7fcb79c5f700 1 Processor -- start 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.419+0000 7fcb79c5f700 1 -- start start 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 0x7fcb74120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a1340 0x7fcb741206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74123c50 con 0x7fcb74133fa0 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb74123020 con 0x7fcb740a0a30 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb79c5f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb740a3410 con 0x7fcb740a1340 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb73fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.421 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb737fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 0x7fcb74120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb73fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38464/0 (socket says 172.21.15.19:38464) 2023-10-03T10:20:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb73fff700 1 -- 172.21.15.19:0/2667908280 learned_addr learned my addr 172.21.15.19:0/2667908280 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.422 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.420+0000 7fcb72ffd700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a1340 0x7fcb741206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 -- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a1340 msgr2=0x7fcb741206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a1340 0x7fcb741206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 -- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 msgr2=0x7fcb74120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 0x7fcb74120180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 -- 172.21.15.19:0/2667908280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009550 con 0x7fcb74133fa0 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb737fe700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 0x7fcb74120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb73fff700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00efc0 tx=0x7fcb6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c009ea0 con 0x7fcb74133fa0 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c00f040 con 0x7fcb74133fa0 2023-10-03T10:20:40.423 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb740a0220 con 0x7fcb74133fa0 2023-10-03T10:20:40.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00c880 con 0x7fcb74133fa0 2023-10-03T10:20:40.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.421+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb741233e0 con 0x7fcb74133fa0 2023-10-03T10:20:40.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.422+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcb6c00c9e0 con 0x7fcb74133fa0 2023-10-03T10:20:40.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.423+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcb6c047dd0 con 0x7fcb74133fa0 2023-10-03T10:20:40.424 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.423+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb74074ea0 con 0x7fcb74133fa0 2023-10-03T10:20:40.429 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.428+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcb6c024070 con 0x7fcb74133fa0 2023-10-03T10:20:40.447 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 Processor -- start 2023-10-03T10:20:40.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 -- start start 2023-10-03T10:20:40.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7f6a4355e700 1 Processor -- start 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 0x7ffb5013f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5009a810 con 0x7ffb5009dc30 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5006ab40 con 0x7ffb5013d1f0 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.447+0000 7ffb54bc1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5009ebc0 con 0x7ffb5006a770 2023-10-03T10:20:40.449 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 -- start start 2023-10-03T10:20:40.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4dd9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb5009dc30 0x7ffb5009e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35468/0 (socket says 172.21.15.19:35468) 2023-10-03T10:20:40.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4dd9b700 1 -- 172.21.15.19:0/3795642005 learned_addr learned my addr 172.21.15.19:0/3795642005 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:40.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 0x7ffb5013f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4e59c700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.450 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 0x7f6a3c130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3c09f520 con 0x7f6a3c09e410 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c09f130 con 0x7f6a3c09e000 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a4355e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c09e930 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a41afb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 0x7f6a3c130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a41afb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 0x7f6a3c130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38478/0 (socket says 172.21.15.19:38478) 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a41afb700 1 -- 172.21.15.19:0/2438264311 learned_addr learned my addr 172.21.15.19:0/2438264311 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7f6a40af9700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.451 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 msgr2=0x7ffb5009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/3795642005 >> v1:172.21.15.19:6789/0 conn(0x7ffb5009dc30 legacy=0x7ffb5009e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.448+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/3795642005 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5009e920 con 0x7ffb5013d1f0 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 0x7ffb5013f5d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009dc0 tx=0x7ffb4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b2ef693e3c16051 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7ffb4d59a700 1 -- 172.21.15.19:0/3795642005 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4800e070 con 0x7ffb5013d1f0 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7ffb4d59a700 1 -- 172.21.15.19:0/3795642005 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4800bbd0 con 0x7ffb5013d1f0 2023-10-03T10:20:40.452 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7ffb4d59a700 1 -- 172.21.15.19:0/3795642005 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48012430 con 0x7ffb5013d1f0 2023-10-03T10:20:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 -- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 msgr2=0x7f6a3c130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 -- 172.21.15.19:0/2438264311 >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 msgr2=0x7f6a3c130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2438264311 >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 0x7f6a3c130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.453 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 -- 172.21.15.19:0/2438264311 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c09b2d0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a40af9700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.449+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c09dac0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800dc90 tx=0x7f6a3800f050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669e1893904846a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7f6a33fff700 1 -- 172.21.15.19:0/2438264311 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a38012070 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7f6a33fff700 1 -- 172.21.15.19:0/2438264311 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3800d2e0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7f6a33fff700 1 -- 172.21.15.19:0/2438264311 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800f8b0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.454 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 -- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 msgr2=0x7ffb5013f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 0x7ffb5013f5d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009dc0 tx=0x7ffb4800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 -- 172.21.15.19:0/3795642005 shutdown_connections 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5013d1f0 0x7ffb5013f5d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/3795642005 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7ffb54bc1700 1 -- 172.21.15.19:0/3795642005 >> 172.21.15.19:0/3795642005 conn(0x7ffb50066f50 msgr2=0x7ffb5009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7f6a4355e700 1 -- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 msgr2=0x7f6a3c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.450+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c09dac0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800dc90 tx=0x7f6a3800f050 comp rx=0 tx=0).stop 2023-10-03T10:20:40.455 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7ffb54bc1700 1 -- 172.21.15.19:0/3795642005 shutdown_connections 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 -- 172.21.15.19:0/2438264311 shutdown_connections 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2438264311 >> v2:172.21.15.19:3300/0 conn(0x7f6a3c09e410 0x7f6a3c130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c09dac0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2438264311 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 -- 172.21.15.19:0/2438264311 >> 172.21.15.19:0/2438264311 conn(0x7f6a3c066f50 msgr2=0x7f6a3c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.456 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7ffb54bc1700 1 -- 172.21.15.19:0/3795642005 wait complete. 2023-10-03T10:20:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 -- 172.21.15.19:0/2438264311 shutdown_connections 2023-10-03T10:20:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.451+0000 7f6a4355e700 1 -- 172.21.15.19:0/2438264311 wait complete. 2023-10-03T10:20:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.452+0000 7f6a4355e700 1 Processor -- start 2023-10-03T10:20:40.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.452+0000 7ffb54bc1700 1 Processor -- start 2023-10-03T10:20:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.452+0000 7f6a4355e700 1 -- start start 2023-10-03T10:20:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.452+0000 7ffb54bc1700 1 -- start start 2023-10-03T10:20:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c11e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c11e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 0x7f6a3c11ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c0a3ab0 con 0x7f6a3c09e410 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c09c700 con 0x7f6a3c09e000 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a4355e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c11f5f0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5011b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 0x7ffb5011bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50119d80 con 0x7ffb5013d1f0 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5011a7f0 con 0x7ffb5009dc30 2023-10-03T10:20:40.459 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb54bc1700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5011c7a0 con 0x7ffb5006a770 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a41afb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 0x7f6a3c11ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 0x7ffb5011bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 0x7ffb5011bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53356/0 (socket says 172.21.15.19:53356) 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4ed9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38486/0 (socket says 172.21.15.19:38486) 2023-10-03T10:20:40.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4dd9b700 1 -- 172.21.15.19:0/172194569 learned_addr learned my addr 172.21.15.19:0/172194569 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a41afb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 0x7f6a3c11ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38492/0 (socket says 172.21.15.19:38492) 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a41afb700 1 -- 172.21.15.19:0/2095355353 learned_addr learned my addr 172.21.15.19:0/2095355353 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c11e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7f6a40af9700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c11e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4e59c700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5011b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 msgr2=0x7ffb5011b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.453+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5011b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 msgr2=0x7ffb5011bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 0x7ffb5011bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb4ed9d700 1 -- 172.21.15.19:0/172194569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb48009a70 con 0x7ffb5013d1f0 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb4e59c700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5011b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 -- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 msgr2=0x7f6a3c11e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c11e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 -- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 msgr2=0x7f6a3c11ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 0x7f6a3c11ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 -- 172.21.15.19:0/2095355353 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c00b880 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a40af9700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c11e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb4ed9d700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffb5006e4a0 tx=0x7ffb48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a412fa700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c11e200 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6a38019000 tx=0x7f6a38004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480048b0 con 0x7ffb5013d1f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48020070 con 0x7ffb5013d1f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480276c0 con 0x7ffb5013d1f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5009f1a0 con 0x7ffb5013d1f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb500a1b10 con 0x7ffb5013d1f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.454+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800f6b0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.455+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3800f810 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.455+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3800fbc0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.455+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb50074ea0 con 0x7ffb5013d1f0 2023-10-03T10:20:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.455+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3800d940 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.456+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c121dc0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.465 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.456+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb48012430 con 0x7ffb5013d1f0 2023-10-03T10:20:40.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.456+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb48022070 con 0x7ffb5013d1f0 2023-10-03T10:20:40.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.457+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6a3800fd20 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.457+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c121690 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.457+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6a38044b50 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.462+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6a38027770 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.466+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb4801c400 con 0x7ffb5013d1f0 2023-10-03T10:20:40.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.496+0000 7fcd210a0700 1 Processor -- start 2023-10-03T10:20:40.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.496+0000 7fcd210a0700 1 -- start start 2023-10-03T10:20:40.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.497+0000 7fcd210a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd1c09d6f0 0x7fcd1c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.497+0000 7fcd210a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 0x7fcd1c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.498 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.497+0000 7fcd210a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c09b120 con 0x7fcd1c09e410 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.497+0000 7fcd210a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c06b460 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.497+0000 7fcd210a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c09a7e0 con 0x7fcd1c09e000 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd1c09d6f0 0x7fcd1c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1b59e700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd1c09e410 0x7fcd1c133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35480/0 (socket says 172.21.15.19:35480) 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1b59e700 1 -- 172.21.15.19:0/2448057820 learned_addr learned my addr 172.21.15.19:0/2448057820 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:40.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1a59c700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 0x7fcd1c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 -- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 msgr2=0x7fcd1c1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 0x7fcd1c1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 -- 172.21.15.19:0/2448057820 >> v1:172.21.15.19:6789/0 conn(0x7fcd1c09e410 legacy=0x7fcd1c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 -- 172.21.15.19:0/2448057820 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c09a500 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1a59c700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 0x7fcd1c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd1ad9d700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09d6f0 0x7fcd1c09dac0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009840 tx=0x7fcd0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09efc6fc924b8ad server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.498+0000 7fcd19d9b700 1 -- 172.21.15.19:0/2448057820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c011830 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd19d9b700 1 -- 172.21.15.19:0/2448057820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c011990 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd19d9b700 1 -- 172.21.15.19:0/2448057820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c011d20 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 -- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09d6f0 msgr2=0x7fcd1c09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09d6f0 0x7fcd1c09dac0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009840 tx=0x7fcd0c009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 -- 172.21.15.19:0/2448057820 shutdown_connections 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09d6f0 0x7fcd1c09dac0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 --2- 172.21.15.19:0/2448057820 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e000 0x7fcd1c1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 -- 172.21.15.19:0/2448057820 >> 172.21.15.19:0/2448057820 conn(0x7fcd1c066f50 msgr2=0x7fcd1c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 -- 172.21.15.19:0/2448057820 shutdown_connections 2023-10-03T10:20:40.501 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.499+0000 7fcd210a0700 1 -- 172.21.15.19:0/2448057820 wait complete. 2023-10-03T10:20:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.501+0000 7fcd210a0700 1 Processor -- start 2023-10-03T10:20:40.502 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.501+0000 7fcd210a0700 1 -- start start 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 0x7fcd1c1a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1a7340 con 0x7fcd1c09e000 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1a7ac0 con 0x7fcd1c09e410 2023-10-03T10:20:40.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd210a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1a80e0 con 0x7fcd1c09d6f0 2023-10-03T10:20:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48098/0 (socket says 172.21.15.19:48098) 2023-10-03T10:20:40.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1b59e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53372/0 (socket says 172.21.15.19:53372) 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1ad9d700 1 -- 172.21.15.19:0/3219273032 learned_addr learned my addr 172.21.15.19:0/3219273032 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.502+0000 7fcd1a59c700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 0x7fcd1c1a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 -- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 msgr2=0x7fcd1c1a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 -- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 msgr2=0x7fcd1c1a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 0x7fcd1c1a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 -- 172.21.15.19:0/3219273032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd100094a0 con 0x7fcd1c09e410 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1ad9d700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1a59c700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 0x7fcd1c1a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd1b59e700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400cb00 tx=0x7fcd1400ce10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400a960 con 0x7fcd1c09e410 2023-10-03T10:20:40.505 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1400aac0 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400ae30 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd0c0094a0 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.503+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c1a9750 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.504+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c09c710 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.505+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd1401b3b0 con 0x7fcd1c09e410 2023-10-03T10:20:40.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.505+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd1403f720 con 0x7fcd1c09e410 2023-10-03T10:20:40.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.510+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd140192c0 con 0x7fcd1c09e410 2023-10-03T10:20:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.656+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb740a28e0 con 0x7fcb74133fa0 2023-10-03T10:20:40.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.656+0000 7fcb5bfff700 1 -- 172.21.15.19:0/2667908280 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcb6c007d70 con 0x7fcb74133fa0 2023-10-03T10:20:40.657 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 msgr2=0x7fcb74120c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00efc0 tx=0x7fcb6c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 shutdown_connections 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcb74133fa0 0x7fcb74120c00 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcb740a0a30 0x7fcb74120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 --2- 172.21.15.19:0/2667908280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcb740a1340 0x7fcb741206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 >> 172.21.15.19:0/2667908280 conn(0x7fcb740a6550 msgr2=0x7fcb741baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.660 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 shutdown_connections 2023-10-03T10:20:40.661 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.659+0000 7fcb79c5f700 1 -- 172.21.15.19:0/2667908280 wait complete. 2023-10-03T10:20:40.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:40.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.675+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6a3c074ea0 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.675+0000 7f6a31ffb700 1 -- 172.21.15.19:0/2095355353 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6a38037090 con 0x7f6a3c09d6f0 2023-10-03T10:20:40.676 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:40.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ffb5011a930 con 0x7ffb5013d1f0 2023-10-03T10:20:40.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7ffb3effd700 1 -- 172.21.15.19:0/172194569 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb5011a930 con 0x7ffb5013d1f0 2023-10-03T10:20:40.678 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 msgr2=0x7f6a3c11e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c11e200 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6a38019000 tx=0x7f6a38004750 comp rx=0 tx=0).stop 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 shutdown_connections 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6a3c09e410 0x7f6a3c11ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6a3c09d6f0 0x7f6a3c11e200 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 --2- 172.21.15.19:0/2095355353 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6a3c09e000 0x7f6a3c11e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.677+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 >> 172.21.15.19:0/2095355353 conn(0x7f6a3c066f50 msgr2=0x7f6a3c130920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.678+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 shutdown_connections 2023-10-03T10:20:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.679+0000 7f6a4355e700 1 -- 172.21.15.19:0/2095355353 wait complete. 2023-10-03T10:20:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.679+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 msgr2=0x7ffb5011c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.680 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.679+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffb5006e4a0 tx=0x7ffb48004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.679+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 shutdown_connections 2023-10-03T10:20:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.680+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb5013d1f0 0x7ffb5011c130 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.680+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb5006a770 0x7ffb5011b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.680+0000 7ffb54bc1700 1 --2- 172.21.15.19:0/172194569 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb5009dc30 0x7ffb5011bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.681 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.680+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 >> 172.21.15.19:0/172194569 conn(0x7ffb50066f50 msgr2=0x7ffb5013ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.684+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 shutdown_connections 2023-10-03T10:20:40.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.684+0000 7ffb54bc1700 1 -- 172.21.15.19:0/172194569 wait complete. 2023-10-03T10:20:40.694 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:40.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.727+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcd1c074ea0 con 0x7fcd1c09e410 2023-10-03T10:20:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.727+0000 7fcd037fe700 1 -- 172.21.15.19:0/3219273032 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd14017030 con 0x7fcd1c09e410 2023-10-03T10:20:40.730 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 msgr2=0x7fcd1c1a6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400cb00 tx=0x7fcd1400ce10 comp rx=0 tx=0).stop 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 shutdown_connections 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd1c09e410 0x7fcd1c1a6930 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd1c09d6f0 0x7fcd1c1a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 --2- 172.21.15.19:0/3219273032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd1c09e000 0x7fcd1c1a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 >> 172.21.15.19:0/3219273032 conn(0x7fcd1c066f50 msgr2=0x7fcd1c1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 shutdown_connections 2023-10-03T10:20:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:40.729+0000 7fcd210a0700 1 -- 172.21.15.19:0/3219273032 wait complete. 2023-10-03T10:20:40.744 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:41.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:41.695 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:41.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:41.745 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.839+0000 7fc519d61700 1 Processor -- start 2023-10-03T10:20:41.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.839+0000 7fc519d61700 1 -- start start 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51409de50 0x7fc51409e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51406fef0 con 0x7fc5141338a0 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51406ef30 con 0x7fc51409de50 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc519d61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc5141334b0 con 0x7fc51409e760 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc5137fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc513fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc5137fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38516/0 (socket says 172.21.15.19:38516) 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc513fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48114/0 (socket says 172.21.15.19:48114) 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc5137fe700 1 -- 172.21.15.19:0/2459340105 learned_addr learned my addr 172.21.15.19:0/2459340105 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc512ffd700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51409de50 0x7fc51409e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.840+0000 7fc513fff700 1 -- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51409de50 msgr2=0x7fc51409e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc513fff700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51409de50 0x7fc51409e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc513fff700 1 -- 172.21.15.19:0/2459340105 >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 msgr2=0x7fc514133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc513fff700 1 --2- 172.21.15.19:0/2459340105 >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc513fff700 1 -- 172.21.15.19:0/2459340105 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51406fc30 con 0x7fc51409e760 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc5137fe700 1 --2- 172.21.15.19:0/2459340105 >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc513fff700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009d90 tx=0x7fc50c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f83669ab97d09b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc5127fc700 1 -- 172.21.15.19:0/2459340105 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00e070 con 0x7fc51409e760 2023-10-03T10:20:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc5127fc700 1 -- 172.21.15.19:0/2459340105 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c00bb20 con 0x7fc51409e760 2023-10-03T10:20:41.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.841+0000 7fc5127fc700 1 -- 172.21.15.19:0/2459340105 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c012430 con 0x7fc51409e760 2023-10-03T10:20:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 -- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 msgr2=0x7fc51413a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009d90 tx=0x7fc50c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 -- 172.21.15.19:0/2459340105 shutdown_connections 2023-10-03T10:20:41.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409e760 0x7fc51413a730 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 --2- 172.21.15.19:0/2459340105 >> v2:172.21.15.19:3300/0 conn(0x7fc5141338a0 0x7fc514133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 --2- 172.21.15.19:0/2459340105 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51409de50 0x7fc51409e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 -- 172.21.15.19:0/2459340105 >> 172.21.15.19:0/2459340105 conn(0x7fc5140a2aa0 msgr2=0x7fc5140a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 -- 172.21.15.19:0/2459340105 shutdown_connections 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.842+0000 7fc519d61700 1 -- 172.21.15.19:0/2459340105 wait complete. 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.843+0000 7fc519d61700 1 Processor -- start 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.843+0000 7fc519d61700 1 -- start start 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51409e760 0x7fc51411de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5141338a0 0x7fc51411e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51411f990 con 0x7fc51409e760 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc514130b40 con 0x7fc5141338a0 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc519d61700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc51406f640 con 0x7fc51409de50 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48118/0 (socket says 172.21.15.19:48118) 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 -- 172.21.15.19:0/244884660 learned_addr learned my addr 172.21.15.19:0/244884660 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc512ffd700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51409e760 0x7fc51411de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc513fff700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5141338a0 0x7fc51411e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 -- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5141338a0 msgr2=0x7fc51411e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5141338a0 0x7fc51411e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 -- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51409e760 msgr2=0x7fc51411de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.844+0000 7fc5137fe700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51409e760 0x7fc51411de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.848 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc5137fe700 1 -- 172.21.15.19:0/244884660 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504009550 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc5137fe700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ec10 tx=0x7fc50400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400c850 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400c9b0 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c009a70 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cd20 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.845+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5141205b0 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.846+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc504013470 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.846+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514074ea0 con 0x7fc51409de50 2023-10-03T10:20:41.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.846+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc50403f7e0 con 0x7fc51409de50 2023-10-03T10:20:41.856 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.855+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc504013720 con 0x7fc51409de50 2023-10-03T10:20:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.874+0000 7f9216926700 1 Processor -- start 2023-10-03T10:20:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 -- start start 2023-10-03T10:20:41.876 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 0x7f9210137c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921012cd90 con 0x7f921012f8b0 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921012d330 con 0x7f9210130430 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.875+0000 7f9216926700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9210071780 con 0x7f921012cf60 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f9214ec3700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 0x7f9210137c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48126/0 (socket says 172.21.15.19:48126) 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f921012f8b0 0x7f921012fd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35496/0 (socket says 172.21.15.19:35496) 2023-10-03T10:20:41.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 -- 172.21.15.19:0/458979957 learned_addr learned my addr 172.21.15.19:0/458979957 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.878 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 -- 172.21.15.19:0/458979957 >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 msgr2=0x7f9210137c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 --2- 172.21.15.19:0/458979957 >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 0x7f9210137c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 -- 172.21.15.19:0/458979957 >> v1:172.21.15.19:6789/0 conn(0x7f921012f8b0 legacy=0x7f921012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 -- 172.21.15.19:0/458979957 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9210071a40 con 0x7f921012cf60 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920effd700 1 -- 172.21.15.19:0/458979957 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996371166 0 0) 0x7f921012cd90 con 0x7f921012f8b0 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f9214ec3700 1 --2- 172.21.15.19:0/458979957 >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 0x7f9210137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920ffff700 1 --2- 172.21.15.19:0/458979957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f920000b9a0 tx=0x7f920000bcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b4ea2aba20bde2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920effd700 1 -- 172.21.15.19:0/458979957 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9200009030 con 0x7f921012cf60 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920effd700 1 -- 172.21.15.19:0/458979957 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920000cba0 con 0x7f921012cf60 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.876+0000 7f920effd700 1 -- 172.21.15.19:0/458979957 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920000d450 con 0x7f921012cf60 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.877+0000 7f9216926700 1 -- 172.21.15.19:0/458979957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 msgr2=0x7f921006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.877+0000 7f9216926700 1 --2- 172.21.15.19:0/458979957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f920000b9a0 tx=0x7f920000bcb0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.879 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 -- 172.21.15.19:0/458979957 shutdown_connections 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 --2- 172.21.15.19:0/458979957 >> v2:172.21.15.19:3300/0 conn(0x7f9210130430 0x7f9210137c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 --2- 172.21.15.19:0/458979957 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f921006f5d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 -- 172.21.15.19:0/458979957 >> 172.21.15.19:0/458979957 conn(0x7f92100a2aa0 msgr2=0x7f92100a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 -- 172.21.15.19:0/458979957 shutdown_connections 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.878+0000 7f9216926700 1 -- 172.21.15.19:0/458979957 wait complete. 2023-10-03T10:20:41.880 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 Processor -- start 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 -- start start 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f9210129650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 0x7f92101244c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921012d9b0 con 0x7f921012f8b0 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9210129fa0 con 0x7f9210130430 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.879+0000 7f9216926700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f921009cd50 con 0x7f921012cf60 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f9214ec3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 0x7f92101244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38546/0 (socket says 172.21.15.19:38546) 2023-10-03T10:20:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 -- 172.21.15.19:0/1051407137 learned_addr learned my addr 172.21.15.19:0/1051407137 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f4b0bfb7700 1 Processor -- start 2023-10-03T10:20:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 -- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 msgr2=0x7f9210129650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f9210129650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 -- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 msgr2=0x7f92101244c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 0x7f92101244c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 -- 172.21.15.19:0/1051407137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920800f050 con 0x7f921012f8b0 2023-10-03T10:20:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f9214ec3700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 0x7f92101244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f920f7fe700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f920400c520 tx=0x7f920400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.880+0000 7f4b0bfb7700 1 -- start start 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0bfb7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409f410 0x7f4b04136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0bfb7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0bfb7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b04070940 con 0x7f4b0409e930 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0bfb7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0406fd60 con 0x7f4b04136fe0 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0bfb7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0406fa80 con 0x7f4b0409f410 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b09d53700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f4b0409e930 0x7f4b0409ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35506/0 (socket says 172.21.15.19:35506) 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b09d53700 1 -- 172.21.15.19:0/1371066410 learned_addr learned my addr 172.21.15.19:0/1371066410 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f4b0a554700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b09552700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409f410 0x7f4b04136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204004c80 con 0x7f921012f8b0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f920000b600 con 0x7f921012f8b0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9204004de0 con 0x7f921012f8b0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204007310 con 0x7f921012f8b0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.881+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921007a330 con 0x7f921012f8b0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b0a554700 1 -- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409f410 msgr2=0x7f4b04136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b0a554700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409f410 0x7f4b04136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b0a554700 1 -- 172.21.15.19:0/1371066410 >> v1:172.21.15.19:6789/0 conn(0x7f4b0409e930 legacy=0x7f4b0409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b0a554700 1 -- 172.21.15.19:0/1371066410 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0409fb60 con 0x7f4b04136fe0 2023-10-03T10:20:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b0a554700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041393c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009dc0 tx=0x7f4afc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c15ce0fe6eb02d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9210074ea0 con 0x7f921012f8b0 2023-10-03T10:20:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b08d51700 1 -- 172.21.15.19:0/1371066410 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00e070 con 0x7f4b04136fe0 2023-10-03T10:20:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b08d51700 1 -- 172.21.15.19:0/1371066410 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4afc00bb20 con 0x7f4b04136fe0 2023-10-03T10:20:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.882+0000 7f4b08d51700 1 -- 172.21.15.19:0/1371066410 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc012430 con 0x7f4b04136fe0 2023-10-03T10:20:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.883+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9204007470 con 0x7f921012f8b0 2023-10-03T10:20:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.883+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f920403f2f0 con 0x7f921012f8b0 2023-10-03T10:20:41.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.883+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 msgr2=0x7f4b041393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.883+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041393c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f4afc009dc0 tx=0x7f4afc00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:41.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/1371066410 shutdown_connections 2023-10-03T10:20:41.889 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041393c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/1371066410 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409f410 0x7f4b04136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/1371066410 >> 172.21.15.19:0/1371066410 conn(0x7f4b040a4210 msgr2=0x7f4b040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/1371066410 shutdown_connections 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.884+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/1371066410 wait complete. 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.885+0000 7f4b0bfb7700 1 Processor -- start 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.885+0000 7f4b0bfb7700 1 -- start start 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b0409f410 0x7f4b04131c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041323b0 con 0x7f4b0409f410 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b0406d6b0 con 0x7f4b04136fe0 2023-10-03T10:20:41.890 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0bfb7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04132140 con 0x7f4b0409e930 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b09d53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0a554700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0a554700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53426/0 (socket says 172.21.15.19:53426) 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b09d53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48156/0 (socket says 172.21.15.19:48156) 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b0a554700 1 -- 172.21.15.19:0/4177297210 learned_addr learned my addr 172.21.15.19:0/4177297210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.886+0000 7f4b09552700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b0409f410 0x7f4b04131c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 -- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 msgr2=0x7f4b041c81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041c81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 -- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b0409f410 msgr2=0x7f4b04131c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b0409f410 0x7f4b04131c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 -- 172.21.15.19:0/4177297210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4afc009a70 con 0x7f4b0409e930 2023-10-03T10:20:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b09d53700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c500 tx=0x7f4b0000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00005d70 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000070d0 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041222f0 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.887+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00007440 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.888+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b000075a0 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.888+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b04071d20 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.889+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b00010300 con 0x7f4b0409e930 2023-10-03T10:20:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.889+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04074ea0 con 0x7f4b0409e930 2023-10-03T10:20:41.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.890+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f92040133c0 con 0x7f921012f8b0 2023-10-03T10:20:41.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.899+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b00017070 con 0x7f4b0409e930 2023-10-03T10:20:41.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 Processor -- start 2023-10-03T10:20:41.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 -- start start 2023-10-03T10:20:41.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 0x7f573c09ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f573c09f650 0x7f573c131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c070940 con 0x7f573c09f650 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c06fd60 con 0x7f573c09e930 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.921+0000 7f57434c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f573c06fa80 con 0x7f573c09f240 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f574125c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 0x7f573c09ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48162/0 (socket says 172.21.15.19:48162) 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f574125c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 0x7f573c09ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53438/0 (socket says 172.21.15.19:53438) 2023-10-03T10:20:41.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 -- 172.21.15.19:0/311650000 learned_addr learned my addr 172.21.15.19:0/311650000 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5741a5d700 1 --2- 172.21.15.19:0/311650000 >> v2:172.21.15.19:3300/0 conn(0x7f573c09f650 0x7f573c131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 -- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 msgr2=0x7f573c09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 --2- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 0x7f573c09ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 -- 172.21.15.19:0/311650000 >> v2:172.21.15.19:3300/0 conn(0x7f573c09f650 msgr2=0x7f573c131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 --2- 172.21.15.19:0/311650000 >> v2:172.21.15.19:3300/0 conn(0x7f573c09f650 0x7f573c131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 -- 172.21.15.19:0/311650000 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c09fb60 con 0x7f573c09f240 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.922+0000 7f5740a5b700 1 --2- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098f0 tx=0x7f572c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4aa513c08cd48a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f5733fff700 1 -- 172.21.15.19:0/311650000 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c010a90 con 0x7f573c09f240 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f5733fff700 1 -- 172.21.15.19:0/311650000 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c010bf0 con 0x7f573c09f240 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f5733fff700 1 -- 172.21.15.19:0/311650000 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c018440 con 0x7f573c09f240 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 -- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 msgr2=0x7f573c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 --2- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f572c0098f0 tx=0x7f572c009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:41.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 -- 172.21.15.19:0/311650000 shutdown_connections 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 --2- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09e930 0x7f573c09ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 --2- 172.21.15.19:0/311650000 >> v2:172.21.15.19:3300/0 conn(0x7f573c09f650 0x7f573c131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 --2- 172.21.15.19:0/311650000 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f240 0x7f573c1317f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.923+0000 7f57434c0700 1 -- 172.21.15.19:0/311650000 >> 172.21.15.19:0/311650000 conn(0x7f573c0a4210 msgr2=0x7f573c0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.924+0000 7f57434c0700 1 -- 172.21.15.19:0/311650000 shutdown_connections 2023-10-03T10:20:41.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.924+0000 7f57434c0700 1 -- 172.21.15.19:0/311650000 wait complete. 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.925+0000 7f57434c0700 1 Processor -- start 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.925+0000 7f57434c0700 1 -- start start 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09f240 0x7f573c11da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 0x7f573c11dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c120780 con 0x7f573c09e930 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0a3060 con 0x7f573c09f240 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f57434c0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f573c071d20 con 0x7f573c09f650 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f5741a5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 0x7f573c11dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f5741a5d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 0x7f573c11dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48164/0 (socket says 172.21.15.19:48164) 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38568/0 (socket says 172.21.15.19:38568) 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f5741a5d700 1 -- 172.21.15.19:0/1898494719 learned_addr learned my addr 172.21.15.19:0/1898494719 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f5740a5b700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09f240 0x7f573c11da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 -- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 msgr2=0x7f573c11dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 0x7f573c11dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 -- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09f240 msgr2=0x7f573c11da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09f240 0x7f573c11da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.926+0000 7f574125c700 1 -- 172.21.15.19:0/1898494719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c009550 con 0x7f573c09e930 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f574125c700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f573800e870 tx=0x7f573800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738013680 con 0x7f573c09e930 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57380137e0 con 0x7f573c09e930 2023-10-03T10:20:41.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573c0a0190 con 0x7f573c09e930 2023-10-03T10:20:41.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738013b50 con 0x7f573c09e930 2023-10-03T10:20:41.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.927+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c130460 con 0x7f573c09e930 2023-10-03T10:20:41.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.928+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5738013cb0 con 0x7f573c09e930 2023-10-03T10:20:41.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.928+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57380421c0 con 0x7f573c09e930 2023-10-03T10:20:41.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.928+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c074ea0 con 0x7f573c09e930 2023-10-03T10:20:41.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:41.933+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5738017080 con 0x7f573c09e930 2023-10-03T10:20:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.112+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b04120bd0 con 0x7f4b0409e930 2023-10-03T10:20:42.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.112+0000 7f4afa7fc700 1 -- 172.21.15.19:0/4177297210 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b00017020 con 0x7f4b0409e930 2023-10-03T10:20:42.113 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 msgr2=0x7f4b041316c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000c500 tx=0x7f4b0000c810 comp rx=0 tx=0).stop 2023-10-03T10:20:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 shutdown_connections 2023-10-03T10:20:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b04136fe0 0x7f4b041c81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b0409e930 0x7f4b041316c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 --2- 172.21.15.19:0/4177297210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b0409f410 0x7f4b04131c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 >> 172.21.15.19:0/4177297210 conn(0x7f4b040a4210 msgr2=0x7f4b040a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 shutdown_connections 2023-10-03T10:20:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.115+0000 7f4b0bfb7700 1 -- 172.21.15.19:0/4177297210 wait complete. 2023-10-03T10:20:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.128+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc51406b9e0 con 0x7fc51409de50 2023-10-03T10:20:42.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.128+0000 7fc4fbfff700 1 -- 172.21.15.19:0/244884660 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc50401b3b0 con 0x7fc51409de50 2023-10-03T10:20:42.129 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:42.130 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 msgr2=0x7fc51411d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fc50400ec10 tx=0x7fc50400ef20 comp rx=0 tx=0).stop 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 shutdown_connections 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc5141338a0 0x7fc51411e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51409de50 0x7fc51411d900 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 --2- 172.21.15.19:0/244884660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51409e760 0x7fc51411de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 >> 172.21.15.19:0/244884660 conn(0x7fc5140a2aa0 msgr2=0x7fc5141b9410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 shutdown_connections 2023-10-03T10:20:42.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.131+0000 7fc519d61700 1 -- 172.21.15.19:0/244884660 wait complete. 2023-10-03T10:20:42.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.140+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f573c071ae0 con 0x7f573c09e930 2023-10-03T10:20:42.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.140+0000 7f5731ffb700 1 -- 172.21.15.19:0/1898494719 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5738044060 con 0x7f573c09e930 2023-10-03T10:20:42.141 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 msgr2=0x7f573c11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f573800e870 tx=0x7f573800eb80 comp rx=0 tx=0).stop 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 shutdown_connections 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f573c09f650 0x7f573c11dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f573c09e930 0x7f573c11d530 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 --2- 172.21.15.19:0/1898494719 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f573c09f240 0x7f573c11da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.142+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 >> 172.21.15.19:0/1898494719 conn(0x7f573c0a4210 msgr2=0x7f573c130b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.143+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 shutdown_connections 2023-10-03T10:20:42.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.143+0000 7f57434c0700 1 -- 172.21.15.19:0/1898494719 wait complete. 2023-10-03T10:20:42.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:42.154 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.153+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92100713a0 con 0x7f921012f8b0 2023-10-03T10:20:42.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.154+0000 7f920cff9700 1 -- 172.21.15.19:0/1051407137 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92040102c0 con 0x7f921012f8b0 2023-10-03T10:20:42.155 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:42.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:42.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 msgr2=0x7f9210123f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:42.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f920400c520 tx=0x7f920400c830 comp rx=0 tx=0).stop 2023-10-03T10:20:42.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 shutdown_connections 2023-10-03T10:20:42.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9210130430 0x7f92101244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f921012cf60 0x7f9210129650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 --2- 172.21.15.19:0/1051407137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f921012f8b0 0x7f9210123f80 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 >> 172.21.15.19:0/1051407137 conn(0x7f92100a2aa0 msgr2=0x7f92101b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.156+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 shutdown_connections 2023-10-03T10:20:42.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:42.157+0000 7f9216926700 1 -- 172.21.15.19:0/1051407137 wait complete. 2023-10-03T10:20:42.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:43.131 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:43.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:43.158 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:43.171 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:43.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.296+0000 7f7cbdb96700 1 Processor -- start 2023-10-03T10:20:43.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.296+0000 7f7cbdb96700 1 -- start start 2023-10-03T10:20:43.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.297+0000 7f7cbdb96700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 0x7f7cb8136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.297+0000 7f7cbdb96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.297+0000 7f7cbdb96700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb8070940 con 0x7f7cb809e930 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.297+0000 7f7cbdb96700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806fd60 con 0x7f7cb809f410 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.297+0000 7f7cbdb96700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb806fa80 con 0x7f7cb8136fe0 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb6ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 0x7f7cb8136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53448/0 (socket says 172.21.15.19:53448) 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f7cb809e930 0x7f7cb809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35510/0 (socket says 172.21.15.19:35510) 2023-10-03T10:20:43.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 -- 172.21.15.19:0/3943860994 learned_addr learned my addr 172.21.15.19:0/3943860994 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 -- 172.21.15.19:0/3943860994 >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 msgr2=0x7f7cb8136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:43.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 --2- 172.21.15.19:0/3943860994 >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 0x7f7cb8136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 -- 172.21.15.19:0/3943860994 >> v1:172.21.15.19:6789/0 conn(0x7f7cb809e930 legacy=0x7f7cb809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 -- 172.21.15.19:0/3943860994 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb809fb60 con 0x7f7cb8136fe0 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb6ffd700 1 --2- 172.21.15.19:0/3943860994 >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 0x7f7cb8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.298+0000 7f7cb7fff700 1 --2- 172.21.15.19:0/3943860994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e50 tx=0x7f7cb000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9e1e92d75a30f39 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cb67fc700 1 -- 172.21.15.19:0/3943860994 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000e070 con 0x7f7cb8136fe0 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cb67fc700 1 -- 172.21.15.19:0/3943860994 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb000b910 con 0x7f7cb8136fe0 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cb67fc700 1 -- 172.21.15.19:0/3943860994 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000bcc0 con 0x7f7cb8136fe0 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 -- 172.21.15.19:0/3943860994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 msgr2=0x7f7cb81393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/3943860994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0009e50 tx=0x7f7cb000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 -- 172.21.15.19:0/3943860994 shutdown_connections 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/3943860994 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb81393c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.301 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/3943860994 >> v2:172.21.15.19:3300/0 conn(0x7f7cb809f410 0x7f7cb8136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.299+0000 7f7cbdb96700 1 -- 172.21.15.19:0/3943860994 >> 172.21.15.19:0/3943860994 conn(0x7f7cb80a4210 msgr2=0x7f7cb80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.300+0000 7f7cbdb96700 1 -- 172.21.15.19:0/3943860994 shutdown_connections 2023-10-03T10:20:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.300+0000 7f7cbdb96700 1 -- 172.21.15.19:0/3943860994 wait complete. 2023-10-03T10:20:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.301+0000 7f7cbdb96700 1 Processor -- start 2023-10-03T10:20:43.302 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.301+0000 7f7cbdb96700 1 -- start start 2023-10-03T10:20:43.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cb809f410 0x7f7cb811abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb811b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.303 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb811bb50 con 0x7f7cb809e930 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb811bf10 con 0x7f7cb8136fe0 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cbdb96700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb811d1f0 con 0x7f7cb809f410 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38584/0 (socket says 172.21.15.19:38584) 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cb77fe700 1 -- 172.21.15.19:0/4239366488 learned_addr learned my addr 172.21.15.19:0/4239366488 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cb7fff700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb811b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.304 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.302+0000 7f7cb6ffd700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cb809f410 0x7f7cb811abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 -- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cb809f410 msgr2=0x7f7cb811abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cb809f410 0x7f7cb811abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 -- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 msgr2=0x7f7cb811b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.305 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb811b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 -- 172.21.15.19:0/4239366488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac00d940 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7cb77fe700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c520 tx=0x7f7ca800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8005cb0 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca8005e10 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.303+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca80072d0 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.304+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb0009b30 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.304+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb806d6f0 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.304+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7ca8007430 con 0x7f7cb809e930 2023-10-03T10:20:43.306 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.305+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7ca803eb10 con 0x7f7cb809e930 2023-10-03T10:20:43.307 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.305+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb811d770 con 0x7f7cb809e930 2023-10-03T10:20:43.311 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.310+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7ca801b3b0 con 0x7f7cb809e930 2023-10-03T10:20:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.326+0000 7f4398edd700 1 Processor -- start 2023-10-03T10:20:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.326+0000 7f4398edd700 1 -- start start 2023-10-03T10:20:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4398edd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 0x7f439409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.327 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4398edd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4398edd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439409b120 con 0x7f439409e410 2023-10-03T10:20:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4398edd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439406b460 con 0x7f439409e000 2023-10-03T10:20:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4398edd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f439409a7e0 con 0x7f439409d6f0 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4392d9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f439409e410 0x7f4394133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35518/0 (socket says 172.21.15.19:35518) 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4392d9d700 1 -- 172.21.15.19:0/2370494154 learned_addr learned my addr 172.21.15.19:0/2370494154 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4391d9b700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f439259c700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 0x7f439409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4391d9b700 1 -- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 msgr2=0x7f439409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.327+0000 7f4391d9b700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 0x7f439409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f4391d9b700 1 -- 172.21.15.19:0/2370494154 >> v1:172.21.15.19:6789/0 conn(0x7f439409e410 legacy=0x7f4394133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f4391d9b700 1 -- 172.21.15.19:0/2370494154 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439409a500 con 0x7f439409e000 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f439159a700 1 -- 172.21.15.19:0/2370494154 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257630424 0 0) 0x7f439409b120 con 0x7f439409e410 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f439259c700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 0x7f439409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:43.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f4391d9b700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941339f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f4388009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d911317c8f1705 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f439159a700 1 -- 172.21.15.19:0/2370494154 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011830 con 0x7f439409e000 2023-10-03T10:20:43.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f439159a700 1 -- 172.21.15.19:0/2370494154 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388011990 con 0x7f439409e000 2023-10-03T10:20:43.330 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.328+0000 7f439159a700 1 -- 172.21.15.19:0/2370494154 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388011d20 con 0x7f439409e000 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 -- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 msgr2=0x7f43941339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941339f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f4388009870 tx=0x7f4388009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 -- 172.21.15.19:0/2370494154 shutdown_connections 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409d6f0 0x7f439409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 --2- 172.21.15.19:0/2370494154 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941339f0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 -- 172.21.15.19:0/2370494154 >> 172.21.15.19:0/2370494154 conn(0x7f4394066f50 msgr2=0x7f439409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 -- 172.21.15.19:0/2370494154 shutdown_connections 2023-10-03T10:20:43.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.329+0000 7f4398edd700 1 -- 172.21.15.19:0/2370494154 wait complete. 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.330+0000 7f4398edd700 1 Processor -- start 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.330+0000 7f4398edd700 1 -- start start 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 0x7f4394122470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941229b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409e410 0x7f4394122ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4394125cb0 con 0x7f439409d6f0 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4394125f90 con 0x7f439409e000 2023-10-03T10:20:43.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4398edd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43940a30d0 con 0x7f439409e410 2023-10-03T10:20:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f439259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 0x7f4394122470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f439259c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 0x7f4394122470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38588/0 (socket says 172.21.15.19:38588) 2023-10-03T10:20:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f439259c700 1 -- 172.21.15.19:0/3137432340 learned_addr learned my addr 172.21.15.19:0/3137432340 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.333 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4392d9d700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409e410 0x7f4394122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 -- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409e410 msgr2=0x7f4394122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409e410 0x7f4394122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 -- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 msgr2=0x7f4394122470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 0x7f4394122470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.331+0000 7f4391d9b700 1 -- 172.21.15.19:0/3137432340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43840094a0 con 0x7f439409e000 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.332+0000 7f4391d9b700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941229b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f439406e510 tx=0x7f4388004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.332+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388024620 con 0x7f439409e000 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.332+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388024780 con 0x7f439409e000 2023-10-03T10:20:43.334 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.332+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388024af0 con 0x7f439409e000 2023-10-03T10:20:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.333+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43880094a0 con 0x7f439409e000 2023-10-03T10:20:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.333+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394124ea0 con 0x7f439409e000 2023-10-03T10:20:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.334+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4388022070 con 0x7f439409e000 2023-10-03T10:20:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.334+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4394125b10 con 0x7f439409e000 2023-10-03T10:20:43.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.334+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43880412f0 con 0x7f439409e000 2023-10-03T10:20:43.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.339+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4394125b10 con 0x7f439409e000 2023-10-03T10:20:43.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.341+0000 7f7e3d3e5700 1 Processor -- start 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.341+0000 7f7e3d3e5700 1 -- start start 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e3d3e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e3d3e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 0x7f7e38138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e3d3e5700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3809f130 con 0x7f7e3809d6f0 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e3d3e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3809f520 con 0x7f7e3809e1d0 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e3d3e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3809e930 con 0x7f7e38135e50 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e367fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e367fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53488/0 (socket says 172.21.15.19:53488) 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 0x7f7e38138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e367fc700 1 -- 172.21.15.19:0/2295494378 learned_addr learned my addr 172.21.15.19:0/2295494378 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e377fe700 1 -- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 msgr2=0x7f7e38135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e377fe700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e377fe700 1 -- 172.21.15.19:0/2295494378 >> v1:172.21.15.19:6789/0 conn(0x7f7e3809d6f0 legacy=0x7f7e3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e377fe700 1 -- 172.21.15.19:0/2295494378 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3809b2d0 con 0x7f7e38135e50 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.342+0000 7f7e367fc700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.343+0000 7f7e377fe700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 0x7f7e38138230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009dc0 tx=0x7f7e3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae623d75addba487 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.343+0000 7f7e35ffb700 1 -- 172.21.15.19:0/2295494378 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000e070 con 0x7f7e38135e50 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.343+0000 7f7e35ffb700 1 -- 172.21.15.19:0/2295494378 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3000bae0 con 0x7f7e38135e50 2023-10-03T10:20:43.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.343+0000 7f7e35ffb700 1 -- 172.21.15.19:0/2295494378 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3000be90 con 0x7f7e38135e50 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 msgr2=0x7f7e38138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 0x7f7e38138230 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f7e30009dc0 tx=0x7f7e3000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/2295494378 shutdown_connections 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e38135e50 0x7f7e38138230 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/2295494378 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/2295494378 >> 172.21.15.19:0/2295494378 conn(0x7f7e38066f50 msgr2=0x7f7e3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/2295494378 shutdown_connections 2023-10-03T10:20:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.344+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/2295494378 wait complete. 2023-10-03T10:20:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.345+0000 7f7e3d3e5700 1 Processor -- start 2023-10-03T10:20:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f7e3d3e5700 1 -- start start 2023-10-03T10:20:43.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f793c374700 1 Processor -- start 2023-10-03T10:20:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f793c374700 1 -- start start 2023-10-03T10:20:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f7e3d3e5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e3809d6f0 0x7f7e381196e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f7e3d3e5700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38119c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.346+0000 7f7e3d3e5700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 0x7f7e3811a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e3d3e5700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3811c9d0 con 0x7f7e38135e50 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e3d3e5700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e380a1d30 con 0x7f7e3809e1d0 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e3d3e5700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3809c730 con 0x7f7e3809d6f0 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 0x7f7e3811a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e377fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 0x7f7e3811a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38592/0 (socket says 172.21.15.19:38592) 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e377fe700 1 -- 172.21.15.19:0/3380926849 learned_addr learned my addr 172.21.15.19:0/3380926849 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38119c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e36ffd700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e3809d6f0 0x7f7e381196e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 -- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e3809d6f0 msgr2=0x7f7e381196e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e3809d6f0 0x7f7e381196e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 -- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 msgr2=0x7f7e3811a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 0x7f7e3811a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f7e367fc700 1 -- 172.21.15.19:0/3380926849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c009550 con 0x7f7e3809e1d0 2023-10-03T10:20:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f793409e000 0x7f79341339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e410 0x7f7934133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f793406b460 con 0x7f793409e000 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f793409b120 con 0x7f793409d6f0 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793c374700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793409a7e0 con 0x7f793409e410 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.347+0000 7f793a110700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53510/0 (socket says 172.21.15.19:53510) 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 -- 172.21.15.19:0/3148054800 learned_addr learned my addr 172.21.15.19:0/3148054800 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 -- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e410 msgr2=0x7f7934133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 --2- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e410 0x7f7934133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 -- 172.21.15.19:0/3148054800 >> v2:172.21.15.19:3300/0 conn(0x7f793409e000 msgr2=0x7f79341339f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 --2- 172.21.15.19:0/3148054800 >> v2:172.21.15.19:3300/0 conn(0x7f793409e000 0x7f79341339f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 -- 172.21.15.19:0/3148054800 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793409a500 con 0x7f793409d6f0 2023-10-03T10:20:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f7e367fc700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38119c20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c012db0 tx=0x7f7e2c00c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f793a110700 1 --2- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7930009920 tx=0x7f7930009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc3d67a095cac9f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.348+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c012440 con 0x7f7e3809e1d0 2023-10-03T10:20:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2c00c990 con 0x7f7e3809e1d0 2023-10-03T10:20:43.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00cd00 con 0x7f7e3809e1d0 2023-10-03T10:20:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f793910e700 1 -- 172.21.15.19:0/3148054800 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793000ba20 con 0x7f793409d6f0 2023-10-03T10:20:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e30009a70 con 0x7f7e3809e1d0 2023-10-03T10:20:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3811b7e0 con 0x7f7e3809e1d0 2023-10-03T10:20:43.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.350+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e38074ea0 con 0x7f7e3809e1d0 2023-10-03T10:20:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f793910e700 1 -- 172.21.15.19:0/3148054800 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793000bb80 con 0x7f793409d6f0 2023-10-03T10:20:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.349+0000 7f793910e700 1 -- 172.21.15.19:0/3148054800 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930009e70 con 0x7f793409d6f0 2023-10-03T10:20:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.350+0000 7f793c374700 1 -- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 msgr2=0x7f793409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.350+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e2c004030 con 0x7f7e3809e1d0 2023-10-03T10:20:43.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.350+0000 7f793c374700 1 --2- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7930009920 tx=0x7f7930009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.351+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e2c0042e0 con 0x7f7e3809e1d0 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.353+0000 7f793c374700 1 -- 172.21.15.19:0/3148054800 shutdown_connections 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.353+0000 7f793c374700 1 --2- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409d6f0 0x7f793409dac0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.353+0000 7f793c374700 1 --2- 172.21.15.19:0/3148054800 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e410 0x7f7934133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.353+0000 7f793c374700 1 --2- 172.21.15.19:0/3148054800 >> v2:172.21.15.19:3300/0 conn(0x7f793409e000 0x7f79341339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.353+0000 7f793c374700 1 -- 172.21.15.19:0/3148054800 >> 172.21.15.19:0/3148054800 conn(0x7f7934066f50 msgr2=0x7f793409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.355+0000 7f793c374700 1 -- 172.21.15.19:0/3148054800 shutdown_connections 2023-10-03T10:20:43.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.355+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e2c00ce60 con 0x7f7e3809e1d0 2023-10-03T10:20:43.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.355+0000 7f793c374700 1 -- 172.21.15.19:0/3148054800 wait complete. 2023-10-03T10:20:43.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.356+0000 7f793c374700 1 Processor -- start 2023-10-03T10:20:43.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.356+0000 7f793c374700 1 -- start start 2023-10-03T10:20:43.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f793409d6f0 0x7f793412d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e000 0x7f793412dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f793413a160 con 0x7f793409d6f0 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7934130170 con 0x7f793409e410 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793c374700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f793409c710 con 0x7f793409e000 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793a911700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793a911700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53512/0 (socket says 172.21.15.19:53512) 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.357+0000 7f793a911700 1 -- 172.21.15.19:0/900224283 learned_addr learned my addr 172.21.15.19:0/900224283 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a110700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f793409d6f0 0x7f793412d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793990f700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e000 0x7f793412dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 -- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e000 msgr2=0x7f793412dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e000 0x7f793412dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 -- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f793409d6f0 msgr2=0x7f793412d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f793409d6f0 0x7f793412d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 -- 172.21.15.19:0/900224283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7930009550 con 0x7f793409e410 2023-10-03T10:20:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.358+0000 7f793a911700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f792c00b9a0 tx=0x7f792c00bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:43.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.359+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00d850 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.359+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c00d9d0 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.359+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00dd80 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.359+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793412eb50 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.359+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7934130710 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.360+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f792c00e420 con 0x7f793409e410 2023-10-03T10:20:43.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.360+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f792c006e40 con 0x7f793409e410 2023-10-03T10:20:43.362 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.360+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7934130330 con 0x7f793409e410 2023-10-03T10:20:43.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.365+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f792c01c080 con 0x7f793409e410 2023-10-03T10:20:43.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.528+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7cb8071d20 con 0x7f7cb809e930 2023-10-03T10:20:43.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.528+0000 7f7c9ffff700 1 -- 172.21.15.19:0/4239366488 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7ca8017030 con 0x7f7cb809e930 2023-10-03T10:20:43.529 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:43.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.530+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 msgr2=0x7f7cb811a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.530+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800c520 tx=0x7f7ca800c830 comp rx=0 tx=0).stop 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 shutdown_connections 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7cb8136fe0 0x7f7cb811b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7cb809e930 0x7f7cb811a680 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 --2- 172.21.15.19:0/4239366488 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7cb809f410 0x7f7cb811abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 >> 172.21.15.19:0/4239366488 conn(0x7f7cb80a4210 msgr2=0x7f7cb80a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 shutdown_connections 2023-10-03T10:20:43.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.531+0000 7f7cbdb96700 1 -- 172.21.15.19:0/4239366488 wait complete. 2023-10-03T10:20:43.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:43.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.548+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4394125b10 con 0x7f439409e000 2023-10-03T10:20:43.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.549+0000 7f4382ffd700 1 -- 172.21.15.19:0/3137432340 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4394125b10 con 0x7f439409e000 2023-10-03T10:20:43.550 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 msgr2=0x7f43941229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941229b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f439406e510 tx=0x7f4388004750 comp rx=0 tx=0).stop 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 shutdown_connections 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f439409e410 0x7f4394122ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f439409d6f0 0x7f4394122470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 --2- 172.21.15.19:0/3137432340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f439409e000 0x7f43941229b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.551+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 >> 172.21.15.19:0/3137432340 conn(0x7f4394066f50 msgr2=0x7f4394070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.552+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 shutdown_connections 2023-10-03T10:20:43.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.552+0000 7f4398edd700 1 -- 172.21.15.19:0/3137432340 wait complete. 2023-10-03T10:20:43.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.583+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e3806c360 con 0x7f7e3809e1d0 2023-10-03T10:20:43.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.583+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3380926849 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e2c010350 con 0x7f7e3809e1d0 2023-10-03T10:20:43.584 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 msgr2=0x7f7e38119c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38119c20 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c012db0 tx=0x7f7e2c00c430 comp rx=0 tx=0).stop 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 shutdown_connections 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e38135e50 0x7f7e3811a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e3809d6f0 0x7f7e381196e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.587 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 --2- 172.21.15.19:0/3380926849 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e3809e1d0 0x7f7e38119c20 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 >> 172.21.15.19:0/3380926849 conn(0x7f7e38066f50 msgr2=0x7f7e3806f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 shutdown_connections 2023-10-03T10:20:43.588 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.586+0000 7f7e3d3e5700 1 -- 172.21.15.19:0/3380926849 wait complete. 2023-10-03T10:20:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.591+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7934074ea0 con 0x7f793409e410 2023-10-03T10:20:43.592 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.591+0000 7f792affd700 1 -- 172.21.15.19:0/900224283 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f792c026090 con 0x7f793409e410 2023-10-03T10:20:43.592 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 msgr2=0x7f793412e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f792c00b9a0 tx=0x7f792c00bcb0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 shutdown_connections 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f793409e410 0x7f793412e2e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f793409d6f0 0x7f793412d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 --2- 172.21.15.19:0/900224283 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f793409e000 0x7f793412dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 >> 172.21.15.19:0/900224283 conn(0x7f7934066f50 msgr2=0x7f7934071150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:43.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 shutdown_connections 2023-10-03T10:20:43.596 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:43.594+0000 7f793c374700 1 -- 172.21.15.19:0/900224283 wait complete. 2023-10-03T10:20:43.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:43.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:44.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:44.567 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:44.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:44.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:44.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.711+0000 7f2c5a3f7700 1 Processor -- start 2023-10-03T10:20:44.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.711+0000 7f2c5a3f7700 1 -- start start 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.711+0000 7f2c5a3f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c5a3f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c5409e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c5a3f7700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5409a810 con 0x7f2c5413c1e0 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c5a3f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5406ab40 con 0x7f2c5409dc30 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c5a3f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5409ebc0 con 0x7f2c5406a770 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48262/0 (socket says 172.21.15.19:48262) 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 -- 172.21.15.19:0/3674979956 learned_addr learned my addr 172.21.15.19:0/3674979956 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 -- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 msgr2=0x7f2c5409e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:44.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 --2- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c5409e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 -- 172.21.15.19:0/3674979956 >> v1:172.21.15.19:6789/0 conn(0x7f2c5413c1e0 legacy=0x7f2c5413e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 -- 172.21.15.19:0/3674979956 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5409e920 con 0x7f2c5406a770 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.712+0000 7f2c53fff700 1 --2- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009950 tx=0x7f2c44009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e49e6471a332d9f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.713+0000 7f2c52ffd700 1 -- 172.21.15.19:0/3674979956 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44009ea0 con 0x7f2c5406a770 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.713+0000 7f2c52ffd700 1 -- 172.21.15.19:0/3674979956 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400ba20 con 0x7f2c5406a770 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.713+0000 7f2c52ffd700 1 -- 172.21.15.19:0/3674979956 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400bdb0 con 0x7f2c5406a770 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.713+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 msgr2=0x7f2c5409d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.713+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009950 tx=0x7f2c44009c60 comp rx=0 tx=0).stop 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/3674979956 shutdown_connections 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5406a770 0x7f2c5409d6f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/3674979956 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c5409e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/3674979956 >> 172.21.15.19:0/3674979956 conn(0x7f2c54066f50 msgr2=0x7f2c5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:44.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/3674979956 shutdown_connections 2023-10-03T10:20:44.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.714+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/3674979956 wait complete. 2023-10-03T10:20:44.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.715+0000 7f2c5a3f7700 1 Processor -- start 2023-10-03T10:20:44.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.715+0000 7f2c5a3f7700 1 -- start start 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 0x7f2c541cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c541cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 0x7f2c541ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5413bdf0 con 0x7f2c5406a770 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54128fd0 con 0x7f2c5409dc30 2023-10-03T10:20:44.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c5a3f7700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5412a7c0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 0x7f2c541cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c53fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 0x7f2c541cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38618/0 (socket says 172.21.15.19:38618) 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c53fff700 1 -- 172.21.15.19:0/2962645248 learned_addr learned my addr 172.21.15.19:0/2962645248 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c58994700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 0x7f2c541ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.716+0000 7f2c537fe700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c541cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 -- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 msgr2=0x7f2c541cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c541cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 -- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 msgr2=0x7f2c541cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 0x7f2c541cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 -- 172.21.15.19:0/2962645248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009550 con 0x7f2c5413c1e0 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c537fe700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c541cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:44.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c58994700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 0x7f2c541ccf60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c002200 tx=0x7f2c4c00ce70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c003a00 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4c003b60 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.717+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c540724d0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.718+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4c00a7b0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.718+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c5409f1f0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.719+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2c4c00a910 con 0x7f2c5413c1e0 2023-10-03T10:20:44.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.719+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2c4c050470 con 0x7f2c5413c1e0 2023-10-03T10:20:44.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.719+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c54074ea0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.725 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.724+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2c4c00abc0 con 0x7f2c5413c1e0 2023-10-03T10:20:44.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.745+0000 7f48f7752700 1 Processor -- start 2023-10-03T10:20:44.746 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 -- start start 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48f00a0a30 0x7f48f00a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f0133fa0 0x7f48f0134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48f009edd0 con 0x7f48f00a0a30 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f009e1f0 con 0x7f48f0133fa0 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f7752700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f009dc50 con 0x7f48f00a1340 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f54ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48f00a0a30 0x7f48f00a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.746+0000 7f48f54ee700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f48f00a0a30 0x7f48f00a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38632/0 (socket says 172.21.15.19:38632) 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 -- 172.21.15.19:0/3901180336 learned_addr learned my addr 172.21.15.19:0/3901180336 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f5cef700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f0133fa0 0x7f48f0134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f4ced700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 -- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 msgr2=0x7f48f0133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 -- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f0133fa0 msgr2=0x7f48f0134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f0133fa0 0x7f48f0134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 -- 172.21.15.19:0/3901180336 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00a1fe0 con 0x7f48f00a0a30 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.747+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f00a0a30 0x7f48f00a0e00 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0098f0 tx=0x7f48ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b648b243e7c5c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48e7fff700 1 -- 172.21.15.19:0/3901180336 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec011830 con 0x7f48f00a0a30 2023-10-03T10:20:44.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48e7fff700 1 -- 172.21.15.19:0/3901180336 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec011990 con 0x7f48f00a0a30 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48e7fff700 1 -- 172.21.15.19:0/3901180336 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec011d20 con 0x7f48f00a0a30 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 -- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f00a0a30 msgr2=0x7f48f00a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f00a0a30 0x7f48f00a0e00 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f48ec0098f0 tx=0x7f48ec009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 -- 172.21.15.19:0/3901180336 shutdown_connections 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f0133fa0 0x7f48f0134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f00a0a30 0x7f48f00a0e00 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 --2- 172.21.15.19:0/3901180336 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.748+0000 7f48f7752700 1 -- 172.21.15.19:0/3901180336 >> 172.21.15.19:0/3901180336 conn(0x7f48f00a6550 msgr2=0x7f48f00a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.749+0000 7f48f7752700 1 -- 172.21.15.19:0/3901180336 shutdown_connections 2023-10-03T10:20:44.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.749+0000 7f48f7752700 1 -- 172.21.15.19:0/3901180336 wait complete. 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.749+0000 7f48f7752700 1 Processor -- start 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 -- start start 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0120650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f0133fa0 0x7f48f0120b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01338b0 con 0x7f48f0133fa0 2023-10-03T10:20:44.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f0121cd0 con 0x7f48f00a0a30 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f7752700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f01238d0 con 0x7f48f00a1340 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f54ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f54ee700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:53550/0 (socket says 172.21.15.19:53550) 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f54ee700 1 -- 172.21.15.19:0/3558260401 learned_addr learned my addr 172.21.15.19:0/3558260401 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.750+0000 7f48f4ced700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0120650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 -- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 msgr2=0x7f48f0120650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0120650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 -- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f0133fa0 msgr2=0x7f48f0120b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f0133fa0 0x7f48f0120b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 -- 172.21.15.19:0/3558260401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec009550 con 0x7f48f00a0a30 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f54ee700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f48ec011db0 tx=0x7f48ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec004240 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec01f070 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48f00a3630 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0045a0 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.751+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f0122420 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.752+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f48ec021030 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.752+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f48ec040920 con 0x7f48f00a0a30 2023-10-03T10:20:44.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.753+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f0074ea0 con 0x7f48f00a0a30 2023-10-03T10:20:44.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.758+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f48ec015080 con 0x7f48f00a0a30 2023-10-03T10:20:44.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.785+0000 7fc10687b700 1 Processor -- start 2023-10-03T10:20:44.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.785+0000 7fc10687b700 1 -- start start 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc10687b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc100135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc10687b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc100135e50 0x7fc100138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc10687b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10009f130 con 0x7fc10009d6f0 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc10687b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10009f520 con 0x7fc100135e50 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc10687b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10009e930 con 0x7fc10009e1d0 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc0fffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc10009d6f0 0x7fc10009dac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35534/0 (socket says 172.21.15.19:35534) 2023-10-03T10:20:44.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc0fffff700 1 -- 172.21.15.19:0/322620362 learned_addr learned my addr 172.21.15.19:0/322620362 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:44.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc0ff7fe700 1 --2- 172.21.15.19:0/322620362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc100135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc0feffd700 1 -- 172.21.15.19:0/322620362 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515820222 0 0) 0x7fc10009f130 con 0x7fc10009d6f0 2023-10-03T10:20:44.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc0feffd700 1 -- 172.21.15.19:0/322620362 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e80035b0 con 0x7fc10009d6f0 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.786+0000 7fc104e18700 1 --2- 172.21.15.19:0/322620362 >> v2:172.21.15.19:3300/0 conn(0x7fc100135e50 0x7fc100138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0ff7fe700 1 -- 172.21.15.19:0/322620362 >> v2:172.21.15.19:3300/0 conn(0x7fc100135e50 msgr2=0x7fc100138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0ff7fe700 1 --2- 172.21.15.19:0/322620362 >> v2:172.21.15.19:3300/0 conn(0x7fc100135e50 0x7fc100138230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0ff7fe700 1 -- 172.21.15.19:0/322620362 >> v1:172.21.15.19:6789/0 conn(0x7fc10009d6f0 legacy=0x7fc10009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0ff7fe700 1 -- 172.21.15.19:0/322620362 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10009b2d0 con 0x7fc10009e1d0 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0ff7fe700 1 --2- 172.21.15.19:0/322620362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc100135910 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009870 tx=0x7fc0f4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=683e4430fee67c56 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0feffd700 1 -- 172.21.15.19:0/322620362 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011830 con 0x7fc10009e1d0 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0feffd700 1 -- 172.21.15.19:0/322620362 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f4011990 con 0x7fc10009e1d0 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.787+0000 7fc0feffd700 1 -- 172.21.15.19:0/322620362 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f4011d20 con 0x7fc10009e1d0 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 -- 172.21.15.19:0/322620362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 msgr2=0x7fc100135910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 --2- 172.21.15.19:0/322620362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc100135910 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009870 tx=0x7fc0f4009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 -- 172.21.15.19:0/322620362 shutdown_connections 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 --2- 172.21.15.19:0/322620362 >> v2:172.21.15.19:3300/0 conn(0x7fc100135e50 0x7fc100138230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 --2- 172.21.15.19:0/322620362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc100135910 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 -- 172.21.15.19:0/322620362 >> 172.21.15.19:0/322620362 conn(0x7fc100066f50 msgr2=0x7fc10009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 -- 172.21.15.19:0/322620362 shutdown_connections 2023-10-03T10:20:44.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.788+0000 7fc10687b700 1 -- 172.21.15.19:0/322620362 wait complete. 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.789+0000 7fc10687b700 1 Processor -- start 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 -- start start 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc10011b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 0x7fc10011bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100130c80 con 0x7fc100135e50 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10011ee90 con 0x7fc10009e1d0 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc10687b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc10011d5a0 con 0x7fc10009d6f0 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc0fffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc0fffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48314/0 (socket says 172.21.15.19:48314) 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.790+0000 7fc0fffff700 1 -- 172.21.15.19:0/3764150291 learned_addr learned my addr 172.21.15.19:0/3764150291 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0ff7fe700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc10011b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc104e18700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 0x7fc10011bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 -- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 msgr2=0x7fc10011b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc10011b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 -- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 msgr2=0x7fc10011bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 0x7fc10011bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 -- 172.21.15.19:0/3764150291 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f40094a0 con 0x7fc10009d6f0 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc104e18700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 0x7fc10011bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fffff700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0001d20 tx=0x7fc0f000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0005d70 con 0x7fc10009d6f0 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f00070d0 con 0x7fc10009d6f0 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0007460 con 0x7fc10009d6f0 2023-10-03T10:20:44.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10011cf80 con 0x7fc10009d6f0 2023-10-03T10:20:44.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.791+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10011e8f0 con 0x7fc10009d6f0 2023-10-03T10:20:44.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.792+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc0f0017020 con 0x7fc10009d6f0 2023-10-03T10:20:44.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.793+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc0f0042c60 con 0x7fc10009d6f0 2023-10-03T10:20:44.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.793+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10011d7d0 con 0x7fc10009d6f0 2023-10-03T10:20:44.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.803+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc0f0018330 con 0x7fc10009d6f0 2023-10-03T10:20:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.827+0000 7fd322259700 1 Processor -- start 2023-10-03T10:20:44.828 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 -- start start 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c139250 0x7fd31c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c09edd0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0a18e0 con 0x7fd31c0a1510 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.828+0000 7fd322259700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c09e1f0 con 0x7fd31c139250 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31b7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fd31c0a0a30 0x7fd31c0a0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35548/0 (socket says 172.21.15.19:35548) 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31b7fe700 1 -- 172.21.15.19:0/1467272067 learned_addr learned my addr 172.21.15.19:0/1467272067 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:44.830 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31bfff700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c139250 0x7fd31c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31a7fc700 1 -- 172.21.15.19:0/1467272067 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733113816 0 0) 0x7fd31c09edd0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31a7fc700 1 -- 172.21.15.19:0/1467272067 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3040035b0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 -- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c139250 msgr2=0x7fd31c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c139250 0x7fd31c13b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 -- 172.21.15.19:0/1467272067 >> v1:172.21.15.19:6789/0 conn(0x7fd31c0a0a30 legacy=0x7fd31c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.831 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 -- 172.21.15.19:0/1467272067 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c09dc50 con 0x7fd31c0a1510 2023-10-03T10:20:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31affd700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c138d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd310009870 tx=0x7fd310009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b743d4ac2f72888a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.829+0000 7fd31a7fc700 1 -- 172.21.15.19:0/1467272067 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310004230 con 0x7fd31c0a1510 2023-10-03T10:20:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd31a7fc700 1 -- 172.21.15.19:0/1467272067 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310004390 con 0x7fd31c0a1510 2023-10-03T10:20:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd31a7fc700 1 -- 172.21.15.19:0/1467272067 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3100036a0 con 0x7fd31c0a1510 2023-10-03T10:20:44.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 -- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 msgr2=0x7fd31c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c138d10 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fd310009870 tx=0x7fd310009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 -- 172.21.15.19:0/1467272067 shutdown_connections 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c139250 0x7fd31c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 --2- 172.21.15.19:0/1467272067 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c138d10 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 -- 172.21.15.19:0/1467272067 >> 172.21.15.19:0/1467272067 conn(0x7fd31c0a6550 msgr2=0x7fd31c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.830+0000 7fd322259700 1 -- 172.21.15.19:0/1467272067 shutdown_connections 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.831+0000 7fd322259700 1 -- 172.21.15.19:0/1467272067 wait complete. 2023-10-03T10:20:44.833 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.831+0000 7fd322259700 1 Processor -- start 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.832+0000 7fd322259700 1 -- start start 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c122d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 0x7fd31c1232d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c126170 con 0x7fd31c139250 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c125ae0 con 0x7fd31c0a1510 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd322259700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c138980 con 0x7fd31c0a0a30 2023-10-03T10:20:44.834 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd31b7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48332/0 (socket says 172.21.15.19:48332) 2023-10-03T10:20:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd31b7fe700 1 -- 172.21.15.19:0/761997795 learned_addr learned my addr 172.21.15.19:0/761997795 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.833+0000 7fd31affd700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c122d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.835 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31bfff700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 0x7fd31c1232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 -- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 msgr2=0x7fd31c122d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c122d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 -- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 msgr2=0x7fd31c1232d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 0x7fd31c1232d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 -- 172.21.15.19:0/761997795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100094a0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31bfff700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 0x7fd31c1232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd31b7fe700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c750 tx=0x7fd30c00ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c004c80 con 0x7fd31c0a0a30 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c004e00 con 0x7fd31c0a0a30 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.834+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007310 con 0x7fd31c0a0a30 2023-10-03T10:20:44.836 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.835+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c124460 con 0x7fd31c0a0a30 2023-10-03T10:20:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.835+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c0a0220 con 0x7fd31c0a0a30 2023-10-03T10:20:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.836+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd30c007470 con 0x7fd31c0a0a30 2023-10-03T10:20:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.836+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c074ea0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.837 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.836+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd30c0135a0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.846+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd30c0123b0 con 0x7fd31c0a0a30 2023-10-03T10:20:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.982+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f48f00a28e0 con 0x7f48f00a0a30 2023-10-03T10:20:44.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.982+0000 7f48e5ffb700 1 -- 172.21.15.19:0/3558260401 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f48ec01a450 con 0x7f48f00a0a30 2023-10-03T10:20:44.983 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 msgr2=0x7f48f0120110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f48ec011db0 tx=0x7f48ec004750 comp rx=0 tx=0).stop 2023-10-03T10:20:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 shutdown_connections 2023-10-03T10:20:44.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f48f0133fa0 0x7f48f0120b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f48f00a0a30 0x7f48f0120110 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 --2- 172.21.15.19:0/3558260401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f48f00a1340 0x7f48f0120650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 >> 172.21.15.19:0/3558260401 conn(0x7f48f00a6550 msgr2=0x7f48f00a4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 shutdown_connections 2023-10-03T10:20:44.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:44.985+0000 7f48f7752700 1 -- 172.21.15.19:0/3558260401 wait complete. 2023-10-03T10:20:45.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:45.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.012+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc100074ea0 con 0x7fc10009d6f0 2023-10-03T10:20:45.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.012+0000 7fc0fcff9700 1 -- 172.21.15.19:0/3764150291 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc0f0021300 con 0x7fc10009d6f0 2023-10-03T10:20:45.013 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 msgr2=0x7fc10011b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0001d20 tx=0x7fc0f000c9e0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 shutdown_connections 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100135e50 0x7fc10011bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc10009d6f0 0x7fc10011b370 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 --2- 172.21.15.19:0/3764150291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc10009e1d0 0x7fc10011b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.014+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 >> 172.21.15.19:0/3764150291 conn(0x7fc100066f50 msgr2=0x7fc100133800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.015+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 shutdown_connections 2023-10-03T10:20:45.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.015+0000 7fc10687b700 1 -- 172.21.15.19:0/3764150291 wait complete. 2023-10-03T10:20:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.016+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2c54129b20 con 0x7f2c5413c1e0 2023-10-03T10:20:45.017 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.016+0000 7f2c50ff9700 1 -- 172.21.15.19:0/2962645248 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2c4c022390 con 0x7f2c5413c1e0 2023-10-03T10:20:45.017 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 msgr2=0x7f2c541ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:45.020 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 0x7f2c541ccf60 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c002200 tx=0x7f2c4c00ce70 comp rx=0 tx=0).stop 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 shutdown_connections 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f2c5413c1e0 0x7f2c541ccf60 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c5406a770 0x7f2c541cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.019+0000 7f2c5a3f7700 1 --2- 172.21.15.19:0/2962645248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2c5409dc30 0x7f2c541cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.020+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 >> 172.21.15.19:0/2962645248 conn(0x7f2c54066f50 msgr2=0x7f2c5409b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.020+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 shutdown_connections 2023-10-03T10:20:45.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.020+0000 7f2c5a3f7700 1 -- 172.21.15.19:0/2962645248 wait complete. 2023-10-03T10:20:45.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:45.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:45.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.096+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd31c124c70 con 0x7fd31c0a0a30 2023-10-03T10:20:45.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.096+0000 7fd303fff700 1 -- 172.21.15.19:0/761997795 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd30c011360 con 0x7fd31c0a0a30 2023-10-03T10:20:45.097 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 msgr2=0x7fd31c122850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00c750 tx=0x7fd30c00ca60 comp rx=0 tx=0).stop 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 shutdown_connections 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd31c139250 0x7fd31c1232d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd31c0a0a30 0x7fd31c122850 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 --2- 172.21.15.19:0/761997795 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd31c0a1510 0x7fd31c122d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:45.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 >> 172.21.15.19:0/761997795 conn(0x7fd31c0a6550 msgr2=0x7fd31c0a48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 shutdown_connections 2023-10-03T10:20:45.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:45.099+0000 7fd322259700 1 -- 172.21.15.19:0/761997795 wait complete. 2023-10-03T10:20:45.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:46.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:46.031 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:46.042 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:46.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:46.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.161+0000 7fdbcfb49700 1 Processor -- start 2023-10-03T10:20:46.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.161+0000 7fdbcfb49700 1 -- start start 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcfb49700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbc809e930 0x7fdbc809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcfb49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 0x7fdbc8131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcfb49700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc8070940 con 0x7fdbc809f240 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcfb49700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc806fd60 con 0x7fdbc809e930 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcfb49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc806fa80 con 0x7fdbc809f650 2023-10-03T10:20:46.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcd0e4700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdbc809f240 0x7fdbc81317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35550/0 (socket says 172.21.15.19:35550) 2023-10-03T10:20:46.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcd0e4700 1 -- 172.21.15.19:0/2294908133 learned_addr learned my addr 172.21.15.19:0/2294908133 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:46.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbcd8e5700 1 --2- 172.21.15.19:0/2294908133 >> v2:172.21.15.19:3300/0 conn(0x7fdbc809e930 0x7fdbc809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.162+0000 7fdbce0e6700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 0x7fdbc8131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcc8e3700 1 -- 172.21.15.19:0/2294908133 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502890145 0 0) 0x7fdbc8070940 con 0x7fdbc809f240 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcc8e3700 1 -- 172.21.15.19:0/2294908133 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb40035b0 con 0x7fdbc809f240 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcd8e5700 1 -- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 msgr2=0x7fdbc8131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcd8e5700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 0x7fdbc8131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcd8e5700 1 -- 172.21.15.19:0/2294908133 >> v1:172.21.15.19:6789/0 conn(0x7fdbc809f240 legacy=0x7fdbc81317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcd8e5700 1 -- 172.21.15.19:0/2294908133 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc809fb60 con 0x7fdbc809e930 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbce0e6700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 0x7fdbc8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcd8e5700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809e930 0x7fdbc809ed00 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009840 tx=0x7fdbc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93cfd8721611f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcc8e3700 1 -- 172.21.15.19:0/2294908133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011830 con 0x7fdbc809e930 2023-10-03T10:20:46.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcc8e3700 1 -- 172.21.15.19:0/2294908133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4011990 con 0x7fdbc809e930 2023-10-03T10:20:46.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.163+0000 7fdbcc8e3700 1 -- 172.21.15.19:0/2294908133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4011d00 con 0x7fdbc809e930 2023-10-03T10:20:46.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 -- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809e930 msgr2=0x7fdbc809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809e930 0x7fdbc809ed00 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4009840 tx=0x7fdbc4009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:46.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 -- 172.21.15.19:0/2294908133 shutdown_connections 2023-10-03T10:20:46.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809f650 0x7fdbc8131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/2294908133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809e930 0x7fdbc809ed00 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.164+0000 7fdbcfb49700 1 -- 172.21.15.19:0/2294908133 >> 172.21.15.19:0/2294908133 conn(0x7fdbc80a4210 msgr2=0x7fdbc80a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.165+0000 7fdbcfb49700 1 -- 172.21.15.19:0/2294908133 shutdown_connections 2023-10-03T10:20:46.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.165+0000 7fdbcfb49700 1 -- 172.21.15.19:0/2294908133 wait complete. 2023-10-03T10:20:46.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.166+0000 7fdbcfb49700 1 Processor -- start 2023-10-03T10:20:46.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.166+0000 7fdbcfb49700 1 -- start start 2023-10-03T10:20:46.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 0x7fdbc81c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbc809f240 0x7fdbc81c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.169 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a2340 con 0x7fdbc809f650 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a2150 con 0x7fdbc809e930 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcfb49700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc81a3df0 con 0x7fdbc809f240 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbce0e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbce0e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38700/0 (socket says 172.21.15.19:38700) 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbce0e6700 1 -- 172.21.15.19:0/1148532907 learned_addr learned my addr 172.21.15.19:0/1148532907 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbcd8e5700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 0x7fdbc81c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.167+0000 7fdbce0e6700 1 -- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbc809f240 msgr2=0x7fdbc81c4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbce0e6700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbc809f240 0x7fdbc81c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbce0e6700 1 -- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 msgr2=0x7fdbc81c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.170 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbce0e6700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 0x7fdbc81c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbce0e6700 1 -- 172.21.15.19:0/1148532907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009a70 con 0x7fdbc809f650 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbcd8e5700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 0x7fdbc81c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbce0e6700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b360 tx=0x7fdbc000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0015070 con 0x7fdbc809f650 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc000be50 con 0x7fdbc809f650 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0009d70 con 0x7fdbc809f650 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc40094a0 con 0x7fdbc809f650 2023-10-03T10:20:46.171 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.168+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80a0190 con 0x7fdbc809f650 2023-10-03T10:20:46.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.169+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbc0019410 con 0x7fdbc809f650 2023-10-03T10:20:46.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.170+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc81a29a0 con 0x7fdbc809f650 2023-10-03T10:20:46.172 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.170+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdbc0043620 con 0x7fdbc809f650 2023-10-03T10:20:46.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.178+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbc0017900 con 0x7fdbc809f650 2023-10-03T10:20:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.201+0000 7fc40eb59700 1 Processor -- start 2023-10-03T10:20:46.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.201+0000 7fc40eb59700 1 -- start start 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc40809c650 0x7fc40809ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 0x7fc40809cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc408131970 0x7fc408131df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40809ba70 con 0x7fc40809c650 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40809d4a0 con 0x7fc408131970 2023-10-03T10:20:46.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40eb59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc40809e8f0 con 0x7fc4080a0090 2023-10-03T10:20:46.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc407fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 0x7fc40809cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40c8f5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc40809c650 0x7fc40809ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40c8f5700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc40809c650 0x7fc40809ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38708/0 (socket says 172.21.15.19:38708) 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc407fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 0x7fc40809cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48360/0 (socket says 172.21.15.19:48360) 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40c8f5700 1 -- 172.21.15.19:0/1533873917 learned_addr learned my addr 172.21.15.19:0/1533873917 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.202+0000 7fc40d0f6700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc408131970 0x7fc408131df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 -- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 msgr2=0x7fc40809cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 0x7fc40809cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 -- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc408131970 msgr2=0x7fc408131df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:46.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc408131970 0x7fc408131df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 -- 172.21.15.19:0/1533873917 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080a0760 con 0x7fc40809c650 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809c650 0x7fc40809ca20 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098f0 tx=0x7fc3fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2225b90d2c99cb15 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc4077fe700 1 -- 172.21.15.19:0/1533873917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011830 con 0x7fc40809c650 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc4077fe700 1 -- 172.21.15.19:0/1533873917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc011990 con 0x7fc40809c650 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.203+0000 7fc4077fe700 1 -- 172.21.15.19:0/1533873917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011d20 con 0x7fc40809c650 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 -- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809c650 msgr2=0x7fc40809ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809c650 0x7fc40809ca20 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0098f0 tx=0x7fc3fc009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 -- 172.21.15.19:0/1533873917 shutdown_connections 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc408131970 0x7fc408131df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc40809c650 0x7fc40809ca20 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 --2- 172.21.15.19:0/1533873917 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc4080a0090 0x7fc40809cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 -- 172.21.15.19:0/1533873917 >> 172.21.15.19:0/1533873917 conn(0x7fc4080a3f70 msgr2=0x7fc4080a4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 -- 172.21.15.19:0/1533873917 shutdown_connections 2023-10-03T10:20:46.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.204+0000 7fc40eb59700 1 -- 172.21.15.19:0/1533873917 wait complete. 2023-10-03T10:20:46.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.205+0000 7fc40eb59700 1 Processor -- start 2023-10-03T10:20:46.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.205+0000 7fc40eb59700 1 -- start start 2023-10-03T10:20:46.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4080a0090 0x7fc40812d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408131970 0x7fc40812dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40812ad60 con 0x7fc408131970 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40812f480 con 0x7fc4080a0090 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.206+0000 7fc40eb59700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc40812fa70 con 0x7fc40809c650 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48372/0 (socket says 172.21.15.19:48372) 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 -- 172.21.15.19:0/4186914747 learned_addr learned my addr 172.21.15.19:0/4186914747 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40d0f6700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408131970 0x7fc40812dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 -- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4080a0090 msgr2=0x7fc40812d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4080a0090 0x7fc40812d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 -- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408131970 msgr2=0x7fc40812dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408131970 0x7fc40812dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 -- 172.21.15.19:0/4186914747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc009550 con 0x7fc40809c650 2023-10-03T10:20:46.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7f33f8449700 1 Processor -- start 2023-10-03T10:20:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40c8f5700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009c40 tx=0x7fc3fc004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc004240 con 0x7fc40809c650 2023-10-03T10:20:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc01f070 con 0x7fc40809c650 2023-10-03T10:20:46.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc0045c0 con 0x7fc40809c650 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40812c800 con 0x7fc40809c650 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40812d270 con 0x7fc40809c650 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc3fc021030 con 0x7fc40809c650 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.207+0000 7f33f8449700 1 -- start start 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7f33f8449700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 0x7f33f006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7f33f8449700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f012f8b0 0x7f33f012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7f33f8449700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f012cd90 con 0x7f33f0130260 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7f33f8449700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f012d330 con 0x7f33f012f8b0 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7f33f8449700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01306d0 con 0x7f33f012cf60 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f69e6700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f33f0130260 0x7f33f0136c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:35566/0 (socket says 172.21.15.19:35566) 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f69e6700 1 -- 172.21.15.19:0/2120683217 learned_addr learned my addr 172.21.15.19:0/2120683217 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.208+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc3fc040720 con 0x7fc40809c650 2023-10-03T10:20:46.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4080747f0 con 0x7fc40809c650 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f61e5700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 0x7f33f006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f51e3700 1 -- 172.21.15.19:0/2120683217 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906493042 0 0) 0x7f33f012cd90 con 0x7f33f0130260 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f51e3700 1 -- 172.21.15.19:0/2120683217 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33dc0035b0 con 0x7f33f0130260 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f61e5700 1 -- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f012f8b0 msgr2=0x7f33f012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f61e5700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f012f8b0 0x7f33f012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f61e5700 1 -- 172.21.15.19:0/2120683217 >> v1:172.21.15.19:6789/0 conn(0x7f33f0130260 legacy=0x7f33f0136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.209+0000 7f33f61e5700 1 -- 172.21.15.19:0/2120683217 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0071780 con 0x7f33f012cf60 2023-10-03T10:20:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.210+0000 7f33f61e5700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 0x7f33f006f5d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009870 tx=0x7f33ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a423c2ebbf3383d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.214+0000 7f33f51e3700 1 -- 172.21.15.19:0/2120683217 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011830 con 0x7f33f012cf60 2023-10-03T10:20:46.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.214+0000 7f33f51e3700 1 -- 172.21.15.19:0/2120683217 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec011990 con 0x7f33f012cf60 2023-10-03T10:20:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.214+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc3fc015080 con 0x7fc40809c650 2023-10-03T10:20:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.214+0000 7f33f51e3700 1 -- 172.21.15.19:0/2120683217 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011d20 con 0x7f33f012cf60 2023-10-03T10:20:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 -- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 msgr2=0x7f33f006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 0x7f33f006f5d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009870 tx=0x7f33ec009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:46.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 -- 172.21.15.19:0/2120683217 shutdown_connections 2023-10-03T10:20:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012cf60 0x7f33f006f5d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 --2- 172.21.15.19:0/2120683217 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f012f8b0 0x7f33f012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.215+0000 7f33f8449700 1 -- 172.21.15.19:0/2120683217 >> 172.21.15.19:0/2120683217 conn(0x7f33f00a2aa0 msgr2=0x7f33f00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.216+0000 7f33f8449700 1 -- 172.21.15.19:0/2120683217 shutdown_connections 2023-10-03T10:20:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.216+0000 7f33f8449700 1 -- 172.21.15.19:0/2120683217 wait complete. 2023-10-03T10:20:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.217+0000 7f33f8449700 1 Processor -- start 2023-10-03T10:20:46.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.217+0000 7f33f8449700 1 -- start start 2023-10-03T10:20:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f012cf60 0x7f33f01309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 0x7f33f0131460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01332c0 con 0x7f33f012cf60 2023-10-03T10:20:46.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01340a0 con 0x7f33f0130260 2023-10-03T10:20:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f8449700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33f01334c0 con 0x7f33f012f8b0 2023-10-03T10:20:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f59e4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f59e4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48394/0 (socket says 172.21.15.19:48394) 2023-10-03T10:20:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f59e4700 1 -- 172.21.15.19:0/4174007969 learned_addr learned my addr 172.21.15.19:0/4174007969 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.218+0000 7f33f69e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 0x7f33f0131460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 -- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 msgr2=0x7f33f0131460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 0x7f33f0131460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 -- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f012cf60 msgr2=0x7f33f01309e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f012cf60 0x7f33f01309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 -- 172.21.15.19:0/4174007969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094a0 con 0x7f33f012f8b0 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f69e6700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 0x7f33f0131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f59e4700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f33e000b530 tx=0x7f33e000b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011830 con 0x7f33f012f8b0 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e00119b0 con 0x7f33f012f8b0 2023-10-03T10:20:46.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011d60 con 0x7f33f012f8b0 2023-10-03T10:20:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f009ea60 con 0x7f33f012f8b0 2023-10-03T10:20:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.219+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0131d30 con 0x7f33f012f8b0 2023-10-03T10:20:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.221+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f33e001a400 con 0x7f33f012f8b0 2023-10-03T10:20:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.221+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f012dee0 con 0x7f33f012f8b0 2023-10-03T10:20:46.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.221+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f33e003f7b0 con 0x7f33f012f8b0 2023-10-03T10:20:46.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.227+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f33e000f8d0 con 0x7f33f012f8b0 2023-10-03T10:20:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.274+0000 7fb640727700 1 Processor -- start 2023-10-03T10:20:46.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.274+0000 7fb640727700 1 -- start start 2023-10-03T10:20:46.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb640727700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 0x7fb63806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb640727700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 0x7fb63806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb640727700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb638070ee0 con 0x7fb638134610 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb640727700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb638071480 con 0x7fb63809eca0 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb640727700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb63806f3c0 con 0x7fb63806e570 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb63e4c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 0x7fb63806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb63e4c3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 0x7fb63806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48410/0 (socket says 172.21.15.19:48410) 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.275+0000 7fb63e4c3700 1 -- 172.21.15.19:0/1329159717 learned_addr learned my addr 172.21.15.19:0/1329159717 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 0x7fb63806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068410172 0 0) 0x7fb638070ee0 con 0x7fb638134610 2023-10-03T10:20:46.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6240035b0 con 0x7fb638134610 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 -- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 msgr2=0x7fb63806e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049563089 0 0) 0x7fb6240035b0 con 0x7fb638134610 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 0x7fb63806e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 -- 172.21.15.19:0/1329159717 >> v1:172.21.15.19:6789/0 conn(0x7fb638134610 legacy=0x7fb638134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 -- 172.21.15.19:0/1329159717 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb638071b90 con 0x7fb63809eca0 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.276+0000 7fb63dcc2700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 0x7fb63806ee80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb628009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316821b29158cb13 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.277+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300019f0 con 0x7fb63809eca0 2023-10-03T10:20:46.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.277+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb628004030 con 0x7fb63809eca0 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.277+0000 7fb63d4c1700 1 -- 172.21.15.19:0/1329159717 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6280043a0 con 0x7fb63809eca0 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 -- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 msgr2=0x7fb63806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 0x7fb63806ee80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fb628009870 tx=0x7fb628009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 -- 172.21.15.19:0/1329159717 shutdown_connections 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb63806e570 0x7fb63806e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 --2- 172.21.15.19:0/1329159717 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb63809eca0 0x7fb63806ee80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 -- 172.21.15.19:0/1329159717 >> 172.21.15.19:0/1329159717 conn(0x7fb6380a2aa0 msgr2=0x7fb6380a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 -- 172.21.15.19:0/1329159717 shutdown_connections 2023-10-03T10:20:46.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.278+0000 7fb640727700 1 -- 172.21.15.19:0/1329159717 wait complete. 2023-10-03T10:20:46.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.279+0000 7fb640727700 1 Processor -- start 2023-10-03T10:20:46.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 -- start start 2023-10-03T10:20:46.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb63806e570 0x7fb6381214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb638134610 0x7fb638121a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:46.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638122be0 con 0x7fb63806e570 2023-10-03T10:20:46.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380a2010 con 0x7fb638134610 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb640727700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb638070610 con 0x7fb638121f60 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.280+0000 7fb63ecc4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:48426/0 (socket says 172.21.15.19:48426) 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63dcc2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb638134610 0x7fb638121a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 -- 172.21.15.19:0/663630922 learned_addr learned my addr 172.21.15.19:0/663630922 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63e4c3700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb63806e570 0x7fb6381214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 -- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb638134610 msgr2=0x7fb638121a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb638134610 0x7fb638121a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 -- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb63806e570 msgr2=0x7fb6381214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb63806e570 0x7fb6381214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 -- 172.21.15.19:0/663630922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280094a0 con 0x7fb638121f60 2023-10-03T10:20:46.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb63ecc4700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c840 tx=0x7fb63000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630003e10 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630005070 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6381245c0 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.281+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630005420 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.282+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6381252f0 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.282+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb630005580 con 0x7fb638121f60 2023-10-03T10:20:46.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.283+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb63003ed90 con 0x7fb638121f60 2023-10-03T10:20:46.285 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.283+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638074ea0 con 0x7fb638121f60 2023-10-03T10:20:46.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.293+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb630017020 con 0x7fb638121f60 2023-10-03T10:20:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.397+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdbc8074ea0 con 0x7fdbc809f650 2023-10-03T10:20:46.398 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.397+0000 7fdbbe7fc700 1 -- 172.21.15.19:0/1148532907 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbc0007330 con 0x7fdbc809f650 2023-10-03T10:20:46.398 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 msgr2=0x7fdbc81c46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000b360 tx=0x7fdbc000b670 comp rx=0 tx=0).stop 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 shutdown_connections 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbc809f650 0x7fdbc81c46a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbc809e930 0x7fdbc81c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 --2- 172.21.15.19:0/1148532907 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbc809f240 0x7fdbc81c4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 >> 172.21.15.19:0/1148532907 conn(0x7fdbc80a4210 msgr2=0x7fdbc81b7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 shutdown_connections 2023-10-03T10:20:46.402 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.400+0000 7fdbcfb49700 1 -- 172.21.15.19:0/1148532907 wait complete. 2023-10-03T10:20:46.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:46.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.426+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc40806b250 con 0x7fc40809c650 2023-10-03T10:20:46.427 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.426+0000 7fc4057fa700 1 -- 172.21.15.19:0/4186914747 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc3fc01a450 con 0x7fc40809c650 2023-10-03T10:20:46.427 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 msgr2=0x7fc408071cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009c40 tx=0x7fc3fc004750 comp rx=0 tx=0).stop 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 shutdown_connections 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc408131970 0x7fc40812dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc40809c650 0x7fc408071cb0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 --2- 172.21.15.19:0/4186914747 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc4080a0090 0x7fc40812d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 >> 172.21.15.19:0/4186914747 conn(0x7fc4080a3f70 msgr2=0x7fc40809eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 shutdown_connections 2023-10-03T10:20:46.430 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.429+0000 7fc40eb59700 1 -- 172.21.15.19:0/4186914747 wait complete. 2023-10-03T10:20:46.443 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:46.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.456+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33f0074ea0 con 0x7f33f012f8b0 2023-10-03T10:20:46.457 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.456+0000 7f33e6ffd700 1 -- 172.21.15.19:0/4174007969 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e0015070 con 0x7f33f012f8b0 2023-10-03T10:20:46.457 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.458+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 msgr2=0x7f33f0130f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.458+0000 7f33f8449700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f33e000b530 tx=0x7f33e000b840 comp rx=0 tx=0).stop 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.458+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 shutdown_connections 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.458+0000 7f33f8449700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f33f0130260 0x7f33f0131460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.458+0000 7f33f8449700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33f012cf60 0x7f33f01309e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.459+0000 7f33f8449700 1 --2- 172.21.15.19:0/4174007969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f33f012f8b0 0x7f33f0130f20 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.459+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 >> 172.21.15.19:0/4174007969 conn(0x7f33f00a2aa0 msgr2=0x7f33f006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.459+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 shutdown_connections 2023-10-03T10:20:46.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.459+0000 7f33f8449700 1 -- 172.21.15.19:0/4174007969 wait complete. 2023-10-03T10:20:46.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.502+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb638071100 con 0x7fb638121f60 2023-10-03T10:20:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.502+0000 7fb62effd700 1 -- 172.21.15.19:0/663630922 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb63003e030 con 0x7fb638121f60 2023-10-03T10:20:46.503 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 msgr2=0x7fb6381ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c840 tx=0x7fb63000cb50 comp rx=0 tx=0).stop 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 shutdown_connections 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb638121f60 0x7fb6381ccc10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb63806e570 0x7fb6381214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 --2- 172.21.15.19:0/663630922 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb638134610 0x7fb638121a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 >> 172.21.15.19:0/663630922 conn(0x7fb6380a2aa0 msgr2=0x7fb6381beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:46.506 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 shutdown_connections 2023-10-03T10:20:46.507 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:46.505+0000 7fb640727700 1 -- 172.21.15.19:0/663630922 wait complete. 2023-10-03T10:20:46.519 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:47.416 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:47.445 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:47.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:47.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:47.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.576+0000 7fdd22655700 1 Processor -- start 2023-10-03T10:20:47.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.576+0000 7fdd22655700 1 -- start start 2023-10-03T10:20:47.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd22655700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c13cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd22655700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c13d520 0x7fdd1c13f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd22655700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c09e800 con 0x7fdd1c095690 2023-10-03T10:20:47.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd22655700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c095a60 con 0x7fdd1c13d520 2023-10-03T10:20:47.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd22655700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c094bd0 con 0x7fdd1c13ac00 2023-10-03T10:20:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c13d520 0x7fdd1c13f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdd1c13d520 0x7fdd1c13f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53864/0 (socket says 172.21.15.19:53864) 2023-10-03T10:20:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 -- 172.21.15.19:0/666664012 learned_addr learned my addr 172.21.15.19:0/666664012 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.579 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd1b7fe700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c13cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 -- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 msgr2=0x7fdd1c13cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c13cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 -- 172.21.15.19:0/666664012 >> v1:172.21.15.19:6789/0 conn(0x7fdd1c095690 legacy=0x7fdd1c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.577+0000 7fdd20bf2700 1 -- 172.21.15.19:0/666664012 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c0940e0 con 0x7fdd1c13d520 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.578+0000 7fdd20bf2700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c13d520 0x7fdd1c13f900 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e80 tx=0x7fdd1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4fe00de2beb143 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.578+0000 7fdd1affd700 1 -- 172.21.15.19:0/666664012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400e070 con 0x7fdd1c13d520 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.578+0000 7fdd1affd700 1 -- 172.21.15.19:0/666664012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400b8d0 con 0x7fdd1c13d520 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.578+0000 7fdd1affd700 1 -- 172.21.15.19:0/666664012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400bc80 con 0x7fdd1c13d520 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 -- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c13d520 msgr2=0x7fdd1c13f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c13d520 0x7fdd1c13f900 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009e80 tx=0x7fdd1400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 -- 172.21.15.19:0/666664012 shutdown_connections 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c13d520 0x7fdd1c13f900 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 --2- 172.21.15.19:0/666664012 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c13cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 -- 172.21.15.19:0/666664012 >> 172.21.15.19:0/666664012 conn(0x7fdd1c0a2360 msgr2=0x7fdd1c0a2760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 -- 172.21.15.19:0/666664012 shutdown_connections 2023-10-03T10:20:47.582 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.579+0000 7fdd22655700 1 -- 172.21.15.19:0/666664012 wait complete. 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.580+0000 7fdd22655700 1 Processor -- start 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.580+0000 7fdd22655700 1 -- start start 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c1ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c13d520 0x7fdd1c1cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c097f60 con 0x7fdd1c095690 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c098ec0 con 0x7fdd1c13ac00 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd22655700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c097ca0 con 0x7fdd1c13d520 2023-10-03T10:20:47.584 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53874/0 (socket says 172.21.15.19:53874) 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 -- 172.21.15.19:0/1629402802 learned_addr learned my addr 172.21.15.19:0/1629402802 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1b7fe700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c1ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 -- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c13d520 msgr2=0x7fdd1c1cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c13d520 0x7fdd1c1cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 -- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 msgr2=0x7fdd1c1ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c1ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 -- 172.21.15.19:0/1629402802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14009b30 con 0x7fdd1c095690 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1b7fe700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c1ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.581+0000 7fdd1bfff700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c450 tx=0x7fdd0c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.585 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.582+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0052d0 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.582+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c005430 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.582+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1c097940 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.582+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0038c0 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.582+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c096330 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.583+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdd0c003a20 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.583+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c095dc0 con 0x7fdd1c095690 2023-10-03T10:20:47.586 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.583+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdd0c03ea30 con 0x7fdd1c095690 2023-10-03T10:20:47.589 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.588+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdd1c095dc0 con 0x7fdd1c095690 2023-10-03T10:20:47.624 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.624+0000 7f081224c700 1 Processor -- start 2023-10-03T10:20:47.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.624+0000 7f081224c700 1 -- start start 2023-10-03T10:20:47.625 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f081224c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f081224c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c139250 0x7f080c13b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f081224c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080c09edd0 con 0x7f080c0a0a30 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f081224c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0a18e0 con 0x7f080c0a1510 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f081224c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f080c09e1f0 con 0x7f080c139250 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45202/0 (socket says 172.21.15.19:45202) 2023-10-03T10:20:47.626 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 -- 172.21.15.19:0/66634768 learned_addr learned my addr 172.21.15.19:0/66634768 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 -- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c139250 msgr2=0x7f080c13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:47.627 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 --2- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c139250 0x7f080c13b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 -- 172.21.15.19:0/66634768 >> v1:172.21.15.19:6789/0 conn(0x7f080c0a0a30 legacy=0x7f080c0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 -- 172.21.15.19:0/66634768 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c09dc50 con 0x7f080c0a1510 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.625+0000 7f080affd700 1 --2- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0800009920 tx=0x7f0800009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd7fee917e12de40 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.626+0000 7f080a7fc700 1 -- 172.21.15.19:0/66634768 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800004230 con 0x7f080c0a1510 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.626+0000 7f080a7fc700 1 -- 172.21.15.19:0/66634768 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0800004390 con 0x7f080c0a1510 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.626+0000 7f080a7fc700 1 -- 172.21.15.19:0/66634768 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800009e70 con 0x7f080c0a1510 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.626+0000 7f081224c700 1 -- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 msgr2=0x7f080c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.626+0000 7f081224c700 1 --2- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0800009920 tx=0x7f0800009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 -- 172.21.15.19:0/66634768 shutdown_connections 2023-10-03T10:20:47.628 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 --2- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c139250 0x7f080c13b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 --2- 172.21.15.19:0/66634768 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c0a1510 0x7f080c138d10 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 -- 172.21.15.19:0/66634768 >> 172.21.15.19:0/66634768 conn(0x7f080c0a6550 msgr2=0x7f080c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 -- 172.21.15.19:0/66634768 shutdown_connections 2023-10-03T10:20:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.627+0000 7f081224c700 1 -- 172.21.15.19:0/66634768 wait complete. 2023-10-03T10:20:47.629 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.628+0000 7f081224c700 1 Processor -- start 2023-10-03T10:20:47.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.628+0000 7f081224c700 1 -- start start 2023-10-03T10:20:47.630 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c0a1510 0x7f080c1c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c121ff0 con 0x7f080c0a0a30 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0a0220 con 0x7f080c139250 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f081224c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f080c124f30 con 0x7f080c0a1510 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f080b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f080bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f080b7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53882/0 (socket says 172.21.15.19:53882) 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f080b7fe700 1 -- 172.21.15.19:0/3887803029 learned_addr learned my addr 172.21.15.19:0/3887803029 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.629+0000 7f080bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45212/0 (socket says 172.21.15.19:45212) 2023-10-03T10:20:47.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 -- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c0a1510 msgr2=0x7f080c1c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c0a1510 0x7f080c1c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 -- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 msgr2=0x7f080c1225e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 -- 172.21.15.19:0/3887803029 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0800009550 con 0x7f080c139250 2023-10-03T10:20:47.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080b7fe700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f080bfff700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f080400be50 tx=0x7f0804009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080400cc10 con 0x7f080c139250 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080400cd90 con 0x7f080c139250 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804014680 con 0x7f080c139250 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c1251f0 con 0x7f080c139250 2023-10-03T10:20:47.633 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.630+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c125c60 con 0x7f080c139250 2023-10-03T10:20:47.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.632+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c125380 con 0x7f080c139250 2023-10-03T10:20:47.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.632+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f080401d3b0 con 0x7f080c139250 2023-10-03T10:20:47.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.633+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0804006e40 con 0x7f080c139250 2023-10-03T10:20:47.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.641+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f080401c360 con 0x7f080c139250 2023-10-03T10:20:47.664 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.663+0000 7f048124f700 1 Processor -- start 2023-10-03T10:20:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.663+0000 7f048124f700 1 -- start start 2023-10-03T10:20:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f048124f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 0x7f047c133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.665 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f048124f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09e930 0x7f047c13b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f048124f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c06ef30 con 0x7f047c09de50 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f048124f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c06fef0 con 0x7f047c09e930 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f048124f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c1334b0 con 0x7f047c1338a0 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 0x7f047c133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f047a59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f047c09de50 0x7f047c09e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41892/0 (socket says 172.21.15.19:41892) 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.664+0000 7f047a59c700 1 -- 172.21.15.19:0/3728188675 learned_addr learned my addr 172.21.15.19:0/3728188675 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:47.666 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047b59e700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09e930 0x7f047c13b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047ad9d700 1 -- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09e930 msgr2=0x7f047c13b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047ad9d700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09e930 0x7f047c13b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047ad9d700 1 -- 172.21.15.19:0/3728188675 >> v1:172.21.15.19:6789/0 conn(0x7f047c09de50 legacy=0x7f047c09e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047ad9d700 1 -- 172.21.15.19:0/3728188675 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c06fc30 con 0x7f047c1338a0 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f047ad9d700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 0x7f047c133c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f046c009870 tx=0x7f046c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b830bceb2ec5e8b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f0479d9b700 1 -- 172.21.15.19:0/3728188675 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011830 con 0x7f047c1338a0 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f0479d9b700 1 -- 172.21.15.19:0/3728188675 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c011990 con 0x7f047c1338a0 2023-10-03T10:20:47.667 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.665+0000 7f0479d9b700 1 -- 172.21.15.19:0/3728188675 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c011d20 con 0x7f047c1338a0 2023-10-03T10:20:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.666+0000 7f048124f700 1 -- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 msgr2=0x7f047c133c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.666+0000 7f048124f700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 0x7f047c133c70 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f046c009870 tx=0x7f046c009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.666+0000 7f048124f700 1 -- 172.21.15.19:0/3728188675 shutdown_connections 2023-10-03T10:20:47.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.666+0000 7f048124f700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09e930 0x7f047c13b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.666+0000 7f048124f700 1 --2- 172.21.15.19:0/3728188675 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c1338a0 0x7f047c133c70 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.667+0000 7f048124f700 1 -- 172.21.15.19:0/3728188675 >> 172.21.15.19:0/3728188675 conn(0x7f047c0a2aa0 msgr2=0x7f047c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.667+0000 7f048124f700 1 -- 172.21.15.19:0/3728188675 shutdown_connections 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.667+0000 7f048124f700 1 -- 172.21.15.19:0/3728188675 wait complete. 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.668+0000 7f048124f700 1 Processor -- start 2023-10-03T10:20:47.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 -- start start 2023-10-03T10:20:47.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c09e930 0x7f047c11bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f047c1338a0 0x7f047c11c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c11e150 con 0x7f047c1338a0 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c0a0f20 con 0x7f047c09de50 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f048124f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f047c06f640 con 0x7f047c09e930 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.669+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c09e930 0x7f047c11bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45230/0 (socket says 172.21.15.19:45230) 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 -- 172.21.15.19:0/2380057955 learned_addr learned my addr 172.21.15.19:0/2380057955 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047b59e700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f047c1338a0 0x7f047c11c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 -- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c09e930 msgr2=0x7f047c11bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c09e930 0x7f047c11bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 -- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f047c1338a0 msgr2=0x7f047c11c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f047c1338a0 0x7f047c11c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 -- 172.21.15.19:0/2380057955 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0094a0 con 0x7f047c09de50 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f047ad9d700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f046c0090b0 tx=0x7f046c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c004510 con 0x7f047c09de50 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.670+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c0036a0 con 0x7f047c09de50 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.671+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c003a30 con 0x7f047c09de50 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.671+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c11d380 con 0x7f047c09de50 2023-10-03T10:20:47.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.671+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c11dad0 con 0x7f047c09de50 2023-10-03T10:20:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.672+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c074ea0 con 0x7f047c09de50 2023-10-03T10:20:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.672+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f046c003b90 con 0x7f047c09de50 2023-10-03T10:20:47.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.672+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f046c040aa0 con 0x7f047c09de50 2023-10-03T10:20:47.682 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.681+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f046c01a420 con 0x7f047c09de50 2023-10-03T10:20:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.711+0000 7f3ef3f65700 1 Processor -- start 2023-10-03T10:20:47.712 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.711+0000 7f3ef3f65700 1 -- start start 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef3f65700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 0x7f3eec136a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef3f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef3f65700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec09b4f0 con 0x7f3eec131810 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef3f65700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec1313c0 con 0x7f3eec134630 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef3f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec06e8c0 con 0x7f3eec136f50 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef2502700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.713 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef2502700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45242/0 (socket says 172.21.15.19:45242) 2023-10-03T10:20:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef2502700 1 -- 172.21.15.19:0/128318291 learned_addr learned my addr 172.21.15.19:0/128318291 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.712+0000 7f3ef1500700 1 --2- 172.21.15.19:0/128318291 >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 0x7f3eec136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef2502700 1 -- 172.21.15.19:0/128318291 >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 msgr2=0x7f3eec136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef2502700 1 --2- 172.21.15.19:0/128318291 >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 0x7f3eec136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef2502700 1 -- 172.21.15.19:0/128318291 >> v1:172.21.15.19:6789/0 conn(0x7f3eec131810 legacy=0x7f3eec131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef2502700 1 -- 172.21.15.19:0/128318291 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec071d20 con 0x7f3eec136f50 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef0cff700 1 -- 172.21.15.19:0/128318291 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240125428 0 0) 0x7f3eec09b4f0 con 0x7f3eec131810 2023-10-03T10:20:47.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef1500700 1 --2- 172.21.15.19:0/128318291 >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 0x7f3eec136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef2502700 1 --2- 172.21.15.19:0/128318291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009e50 tx=0x7f3ee400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81a3f63a60948f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef0cff700 1 -- 172.21.15.19:0/128318291 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400e070 con 0x7f3eec136f50 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef0cff700 1 -- 172.21.15.19:0/128318291 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400b910 con 0x7f3eec136f50 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.713+0000 7f3ef0cff700 1 -- 172.21.15.19:0/128318291 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400bcc0 con 0x7f3eec136f50 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 -- 172.21.15.19:0/128318291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 msgr2=0x7f3eec139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/128318291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009e50 tx=0x7f3ee400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 -- 172.21.15.19:0/128318291 shutdown_connections 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/128318291 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec136f50 0x7f3eec139330 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/128318291 >> v2:172.21.15.19:3300/0 conn(0x7f3eec134630 0x7f3eec136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 -- 172.21.15.19:0/128318291 >> 172.21.15.19:0/128318291 conn(0x7f3eec0a2aa0 msgr2=0x7f3eec0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 -- 172.21.15.19:0/128318291 shutdown_connections 2023-10-03T10:20:47.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.714+0000 7f3ef3f65700 1 -- 172.21.15.19:0/128318291 wait complete. 2023-10-03T10:20:47.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 Processor -- start 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 -- start start 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 0x7f3eec09ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3eec136f50 0x7f3eec09cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec06eb00 con 0x7f3eec131810 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec130d30 con 0x7f3eec134630 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.715+0000 7f3ef3f65700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec119d10 con 0x7f3eec136f50 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53914/0 (socket says 172.21.15.19:53914) 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 -- 172.21.15.19:0/2369448401 learned_addr learned my addr 172.21.15.19:0/2369448401 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:47.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1500700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 0x7f3eec09ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 -- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3eec136f50 msgr2=0x7f3eec09cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3eec136f50 0x7f3eec09cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 -- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 msgr2=0x7f3eec09ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 0x7f3eec09ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 -- 172.21.15.19:0/2369448401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc0094a0 con 0x7f3eec131810 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1500700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 0x7f3eec09ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef1d01700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c450 tx=0x7f3ee800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80054e0 con 0x7f3eec131810 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee8003680 con 0x7f3eec131810 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee4009b30 con 0x7f3eec131810 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.716+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8003a30 con 0x7f3eec131810 2023-10-03T10:20:47.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.717+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec119060 con 0x7f3eec131810 2023-10-03T10:20:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.717+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3ee8003b90 con 0x7f3eec131810 2023-10-03T10:20:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.718+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f3ee803eba0 con 0x7f3eec131810 2023-10-03T10:20:47.721 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.718+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec070cf0 con 0x7f3eec131810 2023-10-03T10:20:47.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.723+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3ee8017070 con 0x7f3eec131810 2023-10-03T10:20:47.814 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.813+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdd1c095dc0 con 0x7fdd1c095690 2023-10-03T10:20:47.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.814+0000 7fdd18ff9700 1 -- 172.21.15.19:0/1629402802 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdd1c095dc0 con 0x7fdd1c095690 2023-10-03T10:20:47.815 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:47.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 msgr2=0x7fdd1c1cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00c450 tx=0x7fdd0c00c760 comp rx=0 tx=0).stop 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 shutdown_connections 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdd1c13d520 0x7fdd1c1cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdd1c095690 0x7fdd1c1cca90 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 --2- 172.21.15.19:0/1629402802 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdd1c13ac00 0x7fdd1c1ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.816+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 >> 172.21.15.19:0/1629402802 conn(0x7fdd1c0a2360 msgr2=0x7fdd1c133510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.817+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 shutdown_connections 2023-10-03T10:20:47.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.817+0000 7fdd22655700 1 -- 172.21.15.19:0/1629402802 wait complete. 2023-10-03T10:20:47.832 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:47.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.858+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f080c074ea0 con 0x7f080c139250 2023-10-03T10:20:47.859 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.859+0000 7f07f3fff700 1 -- 172.21.15.19:0/3887803029 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0804019030 con 0x7f080c139250 2023-10-03T10:20:47.860 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 msgr2=0x7f080c1c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.862 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f080400be50 tx=0x7f0804009ed0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 shutdown_connections 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f080c139250 0x7f080c1c89f0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f080c0a0a30 0x7f080c1225e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 --2- 172.21.15.19:0/3887803029 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f080c0a1510 0x7f080c1c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 >> 172.21.15.19:0/3887803029 conn(0x7f080c0a6550 msgr2=0x7f080c137b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 shutdown_connections 2023-10-03T10:20:47.863 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.861+0000 7f081224c700 1 -- 172.21.15.19:0/3887803029 wait complete. 2023-10-03T10:20:47.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.892+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f047c06b9e0 con 0x7f047c09de50 2023-10-03T10:20:47.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.892+0000 7f04637fe700 1 -- 172.21.15.19:0/2380057955 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f046c015070 con 0x7f047c09de50 2023-10-03T10:20:47.893 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 msgr2=0x7f047c11b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f046c0090b0 tx=0x7f046c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 shutdown_connections 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f047c1338a0 0x7f047c11c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f047c09de50 0x7f047c11b860 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 --2- 172.21.15.19:0/2380057955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f047c09e930 0x7f047c11bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 >> 172.21.15.19:0/2380057955 conn(0x7f047c0a2aa0 msgr2=0x7f047c1306c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 shutdown_connections 2023-10-03T10:20:47.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.895+0000 7f048124f700 1 -- 172.21.15.19:0/2380057955 wait complete. 2023-10-03T10:20:47.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:47.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.929+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3eec074ea0 con 0x7f3eec131810 2023-10-03T10:20:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.929+0000 7f3ee27fc700 1 -- 172.21.15.19:0/2369448401 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3ee8003e40 con 0x7f3eec131810 2023-10-03T10:20:47.930 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:47.932 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 msgr2=0x7f3eec09c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c450 tx=0x7f3ee800c810 comp rx=0 tx=0).stop 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 shutdown_connections 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f3eec136f50 0x7f3eec09cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3eec131810 0x7f3eec09c4f0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 --2- 172.21.15.19:0/2369448401 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f3eec134630 0x7f3eec09ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.931+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 >> 172.21.15.19:0/2369448401 conn(0x7f3eec0a2aa0 msgr2=0x7f3eec130220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.932+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 shutdown_connections 2023-10-03T10:20:47.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:47.932+0000 7f3ef3f65700 1 -- 172.21.15.19:0/2369448401 wait complete. 2023-10-03T10:20:47.945 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:48.832 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:48.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:48.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:48.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.993+0000 7f605677c700 1 Processor -- start 2023-10-03T10:20:48.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.993+0000 7f605677c700 1 -- start start 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f605677c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 0x7f605009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f605677c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f605009f650 0x7f6050131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f605677c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6050070940 con 0x7f605009f240 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f605677c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605006fd60 con 0x7f605009f650 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f605677c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f605006fa80 con 0x7f605009e930 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f604ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 0x7f605009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:48.995 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f604f7fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f605009f240 0x7f60501317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41914/0 (socket says 172.21.15.19:41914) 2023-10-03T10:20:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f604f7fe700 1 -- 172.21.15.19:0/3816936995 learned_addr learned my addr 172.21.15.19:0/3816936995 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:48.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.994+0000 7f6054d19700 1 --2- 172.21.15.19:0/3816936995 >> v2:172.21.15.19:3300/0 conn(0x7f605009f650 0x7f6050131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604effd700 1 -- 172.21.15.19:0/3816936995 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2551281296 0 0) 0x7f6050070940 con 0x7f605009f240 2023-10-03T10:20:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604effd700 1 -- 172.21.15.19:0/3816936995 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60380035b0 con 0x7f605009f240 2023-10-03T10:20:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604ffff700 1 -- 172.21.15.19:0/3816936995 >> v2:172.21.15.19:3300/0 conn(0x7f605009f650 msgr2=0x7f6050131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604ffff700 1 --2- 172.21.15.19:0/3816936995 >> v2:172.21.15.19:3300/0 conn(0x7f605009f650 0x7f6050131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604ffff700 1 -- 172.21.15.19:0/3816936995 >> v1:172.21.15.19:6789/0 conn(0x7f605009f240 legacy=0x7f60501317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604ffff700 1 -- 172.21.15.19:0/3816936995 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605009fb60 con 0x7f605009e930 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604ffff700 1 --2- 172.21.15.19:0/3816936995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 0x7f605009ed00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6040009840 tx=0x7f6040009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d81e6240051294ac server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604effd700 1 -- 172.21.15.19:0/3816936995 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011830 con 0x7f605009e930 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604effd700 1 -- 172.21.15.19:0/3816936995 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6040011990 con 0x7f605009e930 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.995+0000 7f604effd700 1 -- 172.21.15.19:0/3816936995 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040011d20 con 0x7f605009e930 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 -- 172.21.15.19:0/3816936995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 msgr2=0x7f605009ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 --2- 172.21.15.19:0/3816936995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 0x7f605009ed00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f6040009840 tx=0x7f6040009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 -- 172.21.15.19:0/3816936995 shutdown_connections 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 --2- 172.21.15.19:0/3816936995 >> v2:172.21.15.19:3300/0 conn(0x7f605009f650 0x7f6050131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 --2- 172.21.15.19:0/3816936995 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009e930 0x7f605009ed00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 -- 172.21.15.19:0/3816936995 >> 172.21.15.19:0/3816936995 conn(0x7f60500a4210 msgr2=0x7f60500a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 -- 172.21.15.19:0/3816936995 shutdown_connections 2023-10-03T10:20:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.996+0000 7f605677c700 1 -- 172.21.15.19:0/3816936995 wait complete. 2023-10-03T10:20:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.998+0000 7f605677c700 1 Processor -- start 2023-10-03T10:20:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.998+0000 7f605677c700 1 -- start start 2023-10-03T10:20:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 0x7f60501a9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605009f650 0x7f60501a9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501ac6a0 con 0x7f605009e930 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60501aa9d0 con 0x7f605009f650 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f605677c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60501ac340 con 0x7f605009f240 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53932/0 (socket says 172.21.15.19:53932) 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 -- 172.21.15.19:0/3898610053 learned_addr learned my addr 172.21.15.19:0/3898610053 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604f7fe700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 0x7f60501a9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f6054d19700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605009f650 0x7f60501a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 -- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 msgr2=0x7f60501a9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 0x7f60501a9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 -- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605009f650 msgr2=0x7f60501a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:48.999+0000 7f604ffff700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605009f650 0x7f60501a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604ffff700 1 -- 172.21.15.19:0/3898610053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60400094a0 con 0x7f605009e930 2023-10-03T10:20:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604f7fe700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 0x7f60501a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:49.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604ffff700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f6040004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6040004590 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604001f070 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60400038e0 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60500a0190 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.000+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60500a30d0 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.002+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6050071d20 con 0x7f605009e930 2023-10-03T10:20:49.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.002+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6040003a40 con 0x7f605009e930 2023-10-03T10:20:49.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.002+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6040021070 con 0x7f605009e930 2023-10-03T10:20:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.007+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6040010970 con 0x7f605009e930 2023-10-03T10:20:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.032+0000 7fb05e2ac700 1 Processor -- start 2023-10-03T10:20:49.033 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.032+0000 7fb05e2ac700 1 -- start start 2023-10-03T10:20:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb05809d6f0 0x7fb05809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809e000 0x7fb058130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.034 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 0x7fb058130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05809f520 con 0x7fb05809d6f0 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05809f130 con 0x7fb05809e410 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05e2ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb05809e930 con 0x7fb05809e000 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05c849700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 0x7fb058130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb057fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb05809d6f0 0x7fb05809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05c849700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 0x7fb058130ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45274/0 (socket says 172.21.15.19:45274) 2023-10-03T10:20:49.035 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb05c849700 1 -- 172.21.15.19:0/4048527345 learned_addr learned my addr 172.21.15.19:0/4048527345 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb057fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb05809d6f0 0x7fb05809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53940/0 (socket says 172.21.15.19:53940) 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.033+0000 7fb0577fe700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809e000 0x7fb058130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 -- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809e000 msgr2=0x7fb058130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809e000 0x7fb058130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 -- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 msgr2=0x7fb058130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 0x7fb058130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 -- 172.21.15.19:0/4048527345 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05809b2d0 con 0x7fb05809d6f0 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb057fff700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809d6f0 0x7fb05809dac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb048013f10 tx=0x7fb048009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186bfcd6d19975da server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb056ffd700 1 -- 172.21.15.19:0/4048527345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048005d50 con 0x7fb05809d6f0 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb056ffd700 1 -- 172.21.15.19:0/4048527345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0480070d0 con 0x7fb05809d6f0 2023-10-03T10:20:49.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.034+0000 7fb056ffd700 1 -- 172.21.15.19:0/4048527345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048007480 con 0x7fb05809d6f0 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 -- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809d6f0 msgr2=0x7fb05809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809d6f0 0x7fb05809dac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fb048013f10 tx=0x7fb048009870 comp rx=0 tx=0).stop 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 -- 172.21.15.19:0/4048527345 shutdown_connections 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e410 0x7fb058130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809d6f0 0x7fb05809dac0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.037 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/4048527345 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809e000 0x7fb058130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 -- 172.21.15.19:0/4048527345 >> 172.21.15.19:0/4048527345 conn(0x7fb058066f50 msgr2=0x7fb05809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 -- 172.21.15.19:0/4048527345 shutdown_connections 2023-10-03T10:20:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.035+0000 7fb05e2ac700 1 -- 172.21.15.19:0/4048527345 wait complete. 2023-10-03T10:20:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.037+0000 7fb05e2ac700 1 Processor -- start 2023-10-03T10:20:49.038 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.037+0000 7fb05e2ac700 1 -- start start 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809d6f0 0x7fb05811dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809e410 0x7fb05811ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05811f480 con 0x7fb05809e410 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb058130390 con 0x7fb05809e000 2023-10-03T10:20:49.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05e2ac700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0581201e0 con 0x7fb05809d6f0 2023-10-03T10:20:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb0577fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45284/0 (socket says 172.21.15.19:45284) 2023-10-03T10:20:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb0577fe700 1 -- 172.21.15.19:0/1433040490 learned_addr learned my addr 172.21.15.19:0/1433040490 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb057fff700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809d6f0 0x7fb05811dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.038+0000 7fb05c849700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809e410 0x7fb05811ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 -- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809d6f0 msgr2=0x7fb05811dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809d6f0 0x7fb05811dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 -- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809e410 msgr2=0x7fb05811ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809e410 0x7fb05811ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 -- 172.21.15.19:0/1433040490 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb048013b40 con 0x7fb05809e000 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb0577fe700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e930 tx=0x7fb04c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c013680 con 0x7fb05809e000 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0137e0 con 0x7fb05809e000 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb058121260 con 0x7fb05809e000 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c013b70 con 0x7fb05809e000 2023-10-03T10:20:49.041 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.039+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0580a3b30 con 0x7fb05809e000 2023-10-03T10:20:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.040+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb04c013cd0 con 0x7fb05809e000 2023-10-03T10:20:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.041+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0380052e0 con 0x7fb05809e000 2023-10-03T10:20:49.042 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.041+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb04c042180 con 0x7fb05809e000 2023-10-03T10:20:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.046+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb04c044060 con 0x7fb05809e000 2023-10-03T10:20:49.067 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.066+0000 7f533b98b700 1 Processor -- start 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.066+0000 7f533b98b700 1 -- start start 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 0x7f5334130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533409f520 con 0x7f533409e410 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533409f130 con 0x7f533409e000 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f533b98b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f533409e930 con 0x7f533409d6f0 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5338f26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 0x7f5334130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5338f26700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 0x7f5334130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45286/0 (socket says 172.21.15.19:45286) 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5338f26700 1 -- 172.21.15.19:0/708314446 learned_addr learned my addr 172.21.15.19:0/708314446 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.068 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339f28700 1 --2- 172.21.15.19:0/708314446 >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 -- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 msgr2=0x7f5334130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 0x7f5334130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 -- 172.21.15.19:0/708314446 >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 msgr2=0x7f5334130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 --2- 172.21.15.19:0/708314446 >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.067+0000 7f5339727700 1 -- 172.21.15.19:0/708314446 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533409b2d0 con 0x7f533409d6f0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.068+0000 7f5339727700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5330009870 tx=0x7f5330009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f1bc0b931a60a47 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.068+0000 7f532bfff700 1 -- 172.21.15.19:0/708314446 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330011830 con 0x7f533409d6f0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.068+0000 7f532bfff700 1 -- 172.21.15.19:0/708314446 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5330011990 con 0x7f533409d6f0 2023-10-03T10:20:49.070 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.068+0000 7f532bfff700 1 -- 172.21.15.19:0/708314446 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330011d20 con 0x7f533409d6f0 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 -- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 msgr2=0x7f533409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5330009870 tx=0x7f5330009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 -- 172.21.15.19:0/708314446 shutdown_connections 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 --2- 172.21.15.19:0/708314446 >> v2:172.21.15.19:3300/0 conn(0x7f533409e410 0x7f5334130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f533409dac0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 --2- 172.21.15.19:0/708314446 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e000 0x7f5334130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 -- 172.21.15.19:0/708314446 >> 172.21.15.19:0/708314446 conn(0x7f5334066f50 msgr2=0x7f533409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 -- 172.21.15.19:0/708314446 shutdown_connections 2023-10-03T10:20:49.071 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.069+0000 7f533b98b700 1 -- 172.21.15.19:0/708314446 wait complete. 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 Processor -- start 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 -- start start 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f5334136f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 0x7f53341374d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5334119fd0 con 0x7f533409e000 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5334136ba0 con 0x7f533409e410 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.070+0000 7f533b98b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53341398a0 con 0x7f533409d6f0 2023-10-03T10:20:49.073 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5339f28700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 0x7f53341374d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5339f28700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45296/0 (socket says 172.21.15.19:45296) 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5339f28700 1 -- 172.21.15.19:0/1875972837 learned_addr learned my addr 172.21.15.19:0/1875972837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 -- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 msgr2=0x7f5334136f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f5334136f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 -- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 msgr2=0x7f53341c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 -- 172.21.15.19:0/1875972837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300094a0 con 0x7f533409e000 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5339f28700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.071+0000 7f5338f26700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 0x7f53341374d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f532400e840 tx=0x7f532400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.072+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324013680 con 0x7f533409e000 2023-10-03T10:20:49.074 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.072+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53240137e0 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.072+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5324013b50 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.072+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533409c700 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.072+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53341382d0 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.073+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334074ea0 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.074+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5324013cb0 con 0x7f533409e000 2023-10-03T10:20:49.075 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.074+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f532403fb40 con 0x7f533409e000 2023-10-03T10:20:49.084 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.083+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f532401c970 con 0x7f533409e000 2023-10-03T10:20:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.113+0000 7f1134d20700 1 Processor -- start 2023-10-03T10:20:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.113+0000 7f1134d20700 1 -- start start 2023-10-03T10:20:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009e000 0x7f11301339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 0x7f1130133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113006b460 con 0x7f113009e410 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113009b120 con 0x7f113009d6f0 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f1134d20700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f113009a7e0 con 0x7f113009e000 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f112e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f112e59c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45312/0 (socket says 172.21.15.19:45312) 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f112e59c700 1 -- 172.21.15.19:0/587219762 learned_addr learned my addr 172.21.15.19:0/587219762 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f112ed9d700 1 --2- 172.21.15.19:0/587219762 >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 0x7f1130133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.114+0000 7f112dd9b700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009e000 0x7f11301339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 -- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009e000 msgr2=0x7f11301339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009e000 0x7f11301339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 -- 172.21.15.19:0/587219762 >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 msgr2=0x7f1130133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 --2- 172.21.15.19:0/587219762 >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 0x7f1130133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 -- 172.21.15.19:0/587219762 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113009a500 con 0x7f113009d6f0 2023-10-03T10:20:49.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112ed9d700 1 --2- 172.21.15.19:0/587219762 >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 0x7f1130133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112e59c700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1120009920 tx=0x7f1120009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69ae28482af63175 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112d59a700 1 -- 172.21.15.19:0/587219762 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120011830 con 0x7f113009d6f0 2023-10-03T10:20:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112d59a700 1 -- 172.21.15.19:0/587219762 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1120011990 con 0x7f113009d6f0 2023-10-03T10:20:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.115+0000 7f112d59a700 1 -- 172.21.15.19:0/587219762 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120011d20 con 0x7f113009d6f0 2023-10-03T10:20:49.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 -- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 msgr2=0x7f113009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f1120009920 tx=0x7f1120009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 -- 172.21.15.19:0/587219762 shutdown_connections 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009d6f0 0x7f113009dac0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 --2- 172.21.15.19:0/587219762 >> v2:172.21.15.19:3300/0 conn(0x7f113009e410 0x7f1130133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 --2- 172.21.15.19:0/587219762 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009e000 0x7f11301339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 -- 172.21.15.19:0/587219762 >> 172.21.15.19:0/587219762 conn(0x7f1130066f50 msgr2=0x7f113009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 -- 172.21.15.19:0/587219762 shutdown_connections 2023-10-03T10:20:49.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.116+0000 7f1134d20700 1 -- 172.21.15.19:0/587219762 wait complete. 2023-10-03T10:20:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.118+0000 7f1134d20700 1 Processor -- start 2023-10-03T10:20:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.118+0000 7f1134d20700 1 -- start start 2023-10-03T10:20:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 0x7f11301a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 0x7f11301a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301a9c30 con 0x7f113009e410 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301a8340 con 0x7f113009e000 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f1134d20700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11301a9000 con 0x7f113009d6f0 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45324/0 (socket says 172.21.15.19:45324) 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 -- 172.21.15.19:0/4148227159 learned_addr learned my addr 172.21.15.19:0/4148227159 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112ed9d700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 0x7f11301a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112e59c700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 0x7f11301a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 -- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 msgr2=0x7f11301a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 0x7f11301a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 -- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 msgr2=0x7f11301a6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 0x7f11301a6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112dd9b700 1 -- 172.21.15.19:0/4148227159 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128009a70 con 0x7f113009e000 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.119+0000 7f112e59c700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 0x7f11301a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f112ed9d700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 0x7f11301a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f112dd9b700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f112400e980 tx=0x7f112400ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124009710 con 0x7f113009e000 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112400eed0 con 0x7f113009e000 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112400ca70 con 0x7f113009e000 2023-10-03T10:20:49.123 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120009550 con 0x7f113009e000 2023-10-03T10:20:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.120+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11301a9410 con 0x7f113009e000 2023-10-03T10:20:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.121+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f112400cbd0 con 0x7f113009e000 2023-10-03T10:20:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.121+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11301a95f0 con 0x7f113009e000 2023-10-03T10:20:49.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.121+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f112403fc00 con 0x7f113009e000 2023-10-03T10:20:49.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.126+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f11301a95f0 con 0x7f113009e000 2023-10-03T10:20:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.229+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f605009ffe0 con 0x7f605009e930 2023-10-03T10:20:49.230 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.230+0000 7f604cff9700 1 -- 172.21.15.19:0/3898610053 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6040034090 con 0x7f605009e930 2023-10-03T10:20:49.230 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 msgr2=0x7f60501a8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6040000c00 tx=0x7f6040004750 comp rx=0 tx=0).stop 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 shutdown_connections 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f605009f650 0x7f60501a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f605009e930 0x7f60501a8dc0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 --2- 172.21.15.19:0/3898610053 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f605009f240 0x7f60501a9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 >> 172.21.15.19:0/3898610053 conn(0x7f60500a4210 msgr2=0x7f60501b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 shutdown_connections 2023-10-03T10:20:49.235 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.233+0000 7f605677c700 1 -- 172.21.15.19:0/3898610053 wait complete. 2023-10-03T10:20:49.248 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:49.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.258+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb038005150 con 0x7fb05809e000 2023-10-03T10:20:49.259 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.259+0000 7fb054ff9700 1 -- 172.21.15.19:0/1433040490 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb04c03de60 con 0x7fb05809e000 2023-10-03T10:20:49.260 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:49.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 msgr2=0x7fb05811e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e930 tx=0x7fb04c00ec40 comp rx=0 tx=0).stop 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 shutdown_connections 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb05809e410 0x7fb05811ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb05809d6f0 0x7fb05811dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 --2- 172.21.15.19:0/1433040490 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb05809e000 0x7fb05811e4f0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 >> 172.21.15.19:0/1433040490 conn(0x7fb058066f50 msgr2=0x7fb0581309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 shutdown_connections 2023-10-03T10:20:49.263 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.261+0000 7fb05e2ac700 1 -- 172.21.15.19:0/1433040490 wait complete. 2023-10-03T10:20:49.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:49.296 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.296+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f533411a110 con 0x7f533409e000 2023-10-03T10:20:49.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.296+0000 7f5329ffb700 1 -- 172.21.15.19:0/1875972837 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f533411a110 con 0x7f533409e000 2023-10-03T10:20:49.297 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 msgr2=0x7f53341374d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 0x7f53341374d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7f532400e840 tx=0x7f532400eb50 comp rx=0 tx=0).stop 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 shutdown_connections 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f533409e410 0x7f53341c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f533409d6f0 0x7f5334136f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 --2- 172.21.15.19:0/1875972837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f533409e000 0x7f53341374d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.298+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 >> 172.21.15.19:0/1875972837 conn(0x7f5334066f50 msgr2=0x7f53340a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.299+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 shutdown_connections 2023-10-03T10:20:49.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.299+0000 7f533b98b700 1 -- 172.21.15.19:0/1875972837 wait complete. 2023-10-03T10:20:49.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:49.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.334+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f11301a95f0 con 0x7f113009e000 2023-10-03T10:20:49.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.335+0000 7f111effd700 1 -- 172.21.15.19:0/4148227159 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f11301a95f0 con 0x7f113009e000 2023-10-03T10:20:49.336 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:49.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 msgr2=0x7f11301a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f112400e980 tx=0x7f112400ec90 comp rx=0 tx=0).stop 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 shutdown_connections 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f113009e410 0x7f11301a6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f113009d6f0 0x7f11301a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 --2- 172.21.15.19:0/4148227159 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f113009e000 0x7f11301a6730 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 >> 172.21.15.19:0/4148227159 conn(0x7f1130066f50 msgr2=0x7f11301baf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 shutdown_connections 2023-10-03T10:20:49.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:49.337+0000 7f1134d20700 1 -- 172.21.15.19:0/4148227159 wait complete. 2023-10-03T10:20:49.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:50.250 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:50.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:50.314 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:50.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:50.401 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 Processor -- start 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 -- start start 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbe809d6f0 0x7fdbe809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe809f130 con 0x7fdbe809e410 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe809f520 con 0x7fdbe809d6f0 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.401+0000 7fdbf056c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe809e930 con 0x7fdbe809e000 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbe809d6f0 0x7fdbe809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdbe809d6f0 0x7fdbe809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53990/0 (socket says 172.21.15.19:53990) 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbeeb09700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fdbe809e410 0x7fdbe8130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41930/0 (socket says 172.21.15.19:41930) 2023-10-03T10:20:50.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 -- 172.21.15.19:0/2413809019 learned_addr learned my addr 172.21.15.19:0/2413809019 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 -- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 msgr2=0x7fdbe8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 --2- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 -- 172.21.15.19:0/2413809019 >> v1:172.21.15.19:6789/0 conn(0x7fdbe809e410 legacy=0x7fdbe8130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 -- 172.21.15.19:0/2413809019 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe809b2d0 con 0x7fdbe809d6f0 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.402+0000 7fdbee308700 1 --2- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809d6f0 0x7fdbe809dac0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098f0 tx=0x7fdbe4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67891ae79667efdd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.403+0000 7fdbed306700 1 -- 172.21.15.19:0/2413809019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400f8a0 con 0x7fdbe809d6f0 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.403+0000 7fdbed306700 1 -- 172.21.15.19:0/2413809019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe400fa00 con 0x7fdbe809d6f0 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.403+0000 7fdbed306700 1 -- 172.21.15.19:0/2413809019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe400fd90 con 0x7fdbe809d6f0 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.403+0000 7fdbf056c700 1 -- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809d6f0 msgr2=0x7fdbe809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.403+0000 7fdbf056c700 1 --2- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809d6f0 0x7fdbe809dac0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40098f0 tx=0x7fdbe4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 -- 172.21.15.19:0/2413809019 shutdown_connections 2023-10-03T10:20:50.405 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 --2- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809d6f0 0x7fdbe809dac0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 --2- 172.21.15.19:0/2413809019 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 -- 172.21.15.19:0/2413809019 >> 172.21.15.19:0/2413809019 conn(0x7fdbe8066f50 msgr2=0x7fdbe809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 -- 172.21.15.19:0/2413809019 shutdown_connections 2023-10-03T10:20:50.406 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.404+0000 7fdbf056c700 1 -- 172.21.15.19:0/2413809019 wait complete. 2023-10-03T10:20:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 Processor -- start 2023-10-03T10:20:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 -- start start 2023-10-03T10:20:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8122d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.407 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 0x7fdbe8123280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80a1e20 con 0x7fdbe809e410 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe809c700 con 0x7fdbe809d6f0 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.405+0000 7fdbf056c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe8124520 con 0x7fdbe809e000 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbee308700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbee308700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45338/0 (socket says 172.21.15.19:45338) 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbee308700 1 -- 172.21.15.19:0/784982396 learned_addr learned my addr 172.21.15.19:0/784982396 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 0x7fdbe8123280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbedb07700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8122d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 -- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 msgr2=0x7fdbe8122d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8122d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.408 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 -- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 msgr2=0x7fdbe8122800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 -- 172.21.15.19:0/784982396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009550 con 0x7fdbe809e410 2023-10-03T10:20:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbee308700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:50.409 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.406+0000 7fdbeeb09700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 0x7fdbe8123280 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000cb10 tx=0x7fdbe000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.407+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000a9e0 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.407+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe8126040 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.407+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe000ab40 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.407+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0007070 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.407+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8126ab0 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.408+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdbe00071d0 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.408+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe8074ea0 con 0x7fdbe809e410 2023-10-03T10:20:50.410 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.408+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdbe003f490 con 0x7fdbe809e410 2023-10-03T10:20:50.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.414+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdbe0017070 con 0x7fdbe809e410 2023-10-03T10:20:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 Processor -- start 2023-10-03T10:20:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 -- start start 2023-10-03T10:20:50.462 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809e930 0x7f5d5809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d58070940 con 0x7f5d5809f650 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5806fd60 con 0x7f5d5809f240 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.460+0000 7f5d60604700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5806fa80 con 0x7f5d5809e930 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5eba1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5eba1700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54004/0 (socket says 172.21.15.19:54004) 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5eba1700 1 -- 172.21.15.19:0/308688419 learned_addr learned my addr 172.21.15.19:0/308688419 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.463 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5e3a0700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809e930 0x7f5d5809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 -- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809e930 msgr2=0x7f5d5809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809e930 0x7f5d5809ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 -- 172.21.15.19:0/308688419 >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 msgr2=0x7f5d58131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/308688419 >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 -- 172.21.15.19:0/308688419 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5809fb60 con 0x7f5d5809f240 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5eba1700 1 --2- 172.21.15.19:0/308688419 >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.461+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581317f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800dc60 tx=0x7f5d4800df70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a384d4263cf779e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.462+0000 7f5d5d39e700 1 -- 172.21.15.19:0/308688419 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48012070 con 0x7f5d5809f240 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.462+0000 7f5d5d39e700 1 -- 172.21.15.19:0/308688419 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800d2e0 con 0x7f5d5809f240 2023-10-03T10:20:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.462+0000 7f5d5d39e700 1 -- 172.21.15.19:0/308688419 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800f900 con 0x7f5d5809f240 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.462+0000 7f5d60604700 1 -- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 msgr2=0x7f5d581317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.462+0000 7f5d60604700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581317f0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800dc60 tx=0x7f5d4800df70 comp rx=0 tx=0).stop 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 -- 172.21.15.19:0/308688419 shutdown_connections 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 --2- 172.21.15.19:0/308688419 >> v2:172.21.15.19:3300/0 conn(0x7f5d5809f650 0x7f5d58131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809e930 0x7f5d5809ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 --2- 172.21.15.19:0/308688419 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581317f0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 -- 172.21.15.19:0/308688419 >> 172.21.15.19:0/308688419 conn(0x7f5d580a4210 msgr2=0x7f5d580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 -- 172.21.15.19:0/308688419 shutdown_connections 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.463+0000 7f5d60604700 1 -- 172.21.15.19:0/308688419 wait complete. 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.464+0000 7f5d60604700 1 Processor -- start 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.464+0000 7f5d60604700 1 -- start start 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d5809e930 0x7f5d581c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809f650 0x7f5d581c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d581a5000 con 0x7f5d5809e930 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d580a3530 con 0x7f5d5809f240 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d60604700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5d581c1770 con 0x7f5d5809f650 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45360/0 (socket says 172.21.15.19:45360) 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 -- 172.21.15.19:0/15318348 learned_addr learned my addr 172.21.15.19:0/15318348 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5eba1700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809f650 0x7f5d581c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 -- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809f650 msgr2=0x7f5d581c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809f650 0x7f5d581c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 -- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d5809e930 msgr2=0x7f5d581c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d5809e930 0x7f5d581c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 -- 172.21.15.19:0/15318348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d50009b30 con 0x7f5d5809f240 2023-10-03T10:20:50.468 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.465+0000 7f5d5db9f700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5d48016000 tx=0x7f5d48004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.466+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d480036a0 con 0x7f5d5809f240 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.466+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48003800 con 0x7f5d5809f240 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.466+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4800d940 con 0x7f5d5809f240 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.466+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48003bb0 con 0x7f5d5809f240 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.466+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d580a0190 con 0x7f5d5809f240 2023-10-03T10:20:50.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.467+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d58074ea0 con 0x7f5d5809f240 2023-10-03T10:20:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.469+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5d48003d10 con 0x7f5d5809f240 2023-10-03T10:20:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.469+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5d48044f40 con 0x7f5d5809f240 2023-10-03T10:20:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.476+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f5d4801f3a0 con 0x7f5d5809f240 2023-10-03T10:20:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.489+0000 7f9fa4e17700 1 Processor -- start 2023-10-03T10:20:50.490 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.489+0000 7f9fa4e17700 1 -- start start 2023-10-03T10:20:50.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9fa4e17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 0x7f9fa009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9fa4e17700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fa009e000 0x7f9fa0130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9f9e59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 0x7f9fa009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9fa4e17700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa009f130 con 0x7f9fa009e410 2023-10-03T10:20:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9fa4e17700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa009f520 con 0x7f9fa009e000 2023-10-03T10:20:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9fa4e17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa009e930 con 0x7f9fa009d6f0 2023-10-03T10:20:50.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9f9dd9b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9fa009e000 0x7f9fa0130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9f9ed9d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f9fa009e410 0x7f9fa0130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41936/0 (socket says 172.21.15.19:41936) 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.490+0000 7f9f9ed9d700 1 -- 172.21.15.19:0/2536947163 learned_addr learned my addr 172.21.15.19:0/2536947163 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2536947163 >> v2:172.21.15.19:3300/0 conn(0x7f9fa009e000 msgr2=0x7f9fa0130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2536947163 >> v2:172.21.15.19:3300/0 conn(0x7f9fa009e000 0x7f9fa0130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2536947163 >> v1:172.21.15.19:6789/0 conn(0x7f9fa009e410 legacy=0x7f9fa0130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2536947163 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa009b2d0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2536947163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 0x7f9fa009dac0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009840 tx=0x7f9f90009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c618c830f19e4cda server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9d59a700 1 -- 172.21.15.19:0/2536947163 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90011830 con 0x7f9fa009d6f0 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9d59a700 1 -- 172.21.15.19:0/2536947163 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90011990 con 0x7f9fa009d6f0 2023-10-03T10:20:50.493 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.491+0000 7f9f9d59a700 1 -- 172.21.15.19:0/2536947163 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90011d20 con 0x7f9fa009d6f0 2023-10-03T10:20:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.492+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2536947163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 msgr2=0x7f9fa009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.492+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2536947163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 0x7f9fa009dac0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009840 tx=0x7f9f90009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:50.494 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2536947163 shutdown_connections 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2536947163 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009d6f0 0x7f9fa009dac0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2536947163 >> v2:172.21.15.19:3300/0 conn(0x7f9fa009e000 0x7f9fa0130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2536947163 >> 172.21.15.19:0/2536947163 conn(0x7f9fa0066f50 msgr2=0x7f9fa009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2536947163 shutdown_connections 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.493+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2536947163 wait complete. 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 Processor -- start 2023-10-03T10:20:50.495 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 -- start start 2023-10-03T10:20:50.496 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 0x7f9fa01201a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009e000 0x7f9fa01206e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 0x7f9fa0120c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01239e0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0121ec0 con 0x7f9fa009e410 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.495+0000 7f9fa4e17700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa009c700 con 0x7f9fa009e000 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 0x7f9fa0120c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9ed9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 0x7f9fa0120c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45376/0 (socket says 172.21.15.19:45376) 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9ed9d700 1 -- 172.21.15.19:0/2102772688 learned_addr learned my addr 172.21.15.19:0/2102772688 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 0x7f9fa01201a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.497 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9dd9b700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009e000 0x7f9fa01206e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009e000 msgr2=0x7f9fa01206e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009e000 0x7f9fa01206e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 msgr2=0x7f9fa0120c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 0x7f9fa0120c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 -- 172.21.15.19:0/2102772688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f900094a0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.496+0000 7f9f9e59c700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 0x7f9fa01201a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9f90016000 tx=0x7f9f90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.497+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900036a0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.497+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9001e070 con 0x7f9fa009d6f0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.497+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90003a60 con 0x7f9fa009d6f0 2023-10-03T10:20:50.499 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.497+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa006e960 con 0x7f9fa009d6f0 2023-10-03T10:20:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.497+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa0124450 con 0x7f9fa009d6f0 2023-10-03T10:20:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.498+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa0074ea0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.499+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9f90003bc0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.500 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.499+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9f90040bb0 con 0x7f9fa009d6f0 2023-10-03T10:20:50.504 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.503+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9f9002cd70 con 0x7f9fa009d6f0 2023-10-03T10:20:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.544+0000 7f7e2d460700 1 Processor -- start 2023-10-03T10:20:50.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.544+0000 7f7e2d460700 1 -- start start 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e280a1340 0x7f7e28133a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 0x7f7e28134410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2809edd0 con 0x7f7e28133fa0 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2809e1f0 con 0x7f7e280a1340 2023-10-03T10:20:50.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e2d460700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2809dc50 con 0x7f7e280a0a30 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e277fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 0x7f7e28134410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36810/0 (socket says 172.21.15.19:36810) 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e277fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 0x7f7e28134410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54026/0 (socket says 172.21.15.19:54026) 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 -- 172.21.15.19:0/1479542162 learned_addr learned my addr 172.21.15.19:0/1479542162 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e1ffff700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e280a1340 0x7f7e28133a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 -- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e280a1340 msgr2=0x7f7e28133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e280a1340 0x7f7e28133a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 -- 172.21.15.19:0/1479542162 >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 msgr2=0x7f7e28134410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 --2- 172.21.15.19:0/1479542162 >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 0x7f7e28134410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.545+0000 7f7e26ffd700 1 -- 172.21.15.19:0/1479542162 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280a1fe0 con 0x7f7e280a0a30 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.546+0000 7f7e26ffd700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e180098f0 tx=0x7f7e18009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb1044b3c5df79a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.546+0000 7f7e267fc700 1 -- 172.21.15.19:0/1479542162 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011830 con 0x7f7e280a0a30 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.546+0000 7f7e267fc700 1 -- 172.21.15.19:0/1479542162 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18011990 con 0x7f7e280a0a30 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.546+0000 7f7e267fc700 1 -- 172.21.15.19:0/1479542162 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e18011d20 con 0x7f7e280a0a30 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 -- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 msgr2=0x7f7e280a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f7e180098f0 tx=0x7f7e18009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:50.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 -- 172.21.15.19:0/1479542162 shutdown_connections 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 --2- 172.21.15.19:0/1479542162 >> v2:172.21.15.19:3300/0 conn(0x7f7e28133fa0 0x7f7e28134410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a0a30 0x7f7e280a0e00 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 --2- 172.21.15.19:0/1479542162 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e280a1340 0x7f7e28133a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 -- 172.21.15.19:0/1479542162 >> 172.21.15.19:0/1479542162 conn(0x7f7e280a6550 msgr2=0x7f7e280a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 -- 172.21.15.19:0/1479542162 shutdown_connections 2023-10-03T10:20:50.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.547+0000 7f7e2d460700 1 -- 172.21.15.19:0/1479542162 wait complete. 2023-10-03T10:20:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.548+0000 7f7e2d460700 1 Processor -- start 2023-10-03T10:20:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 -- start start 2023-10-03T10:20:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e280a0a30 0x7f7e28120180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e28133fa0 0x7f7e28120c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28123c50 con 0x7f7e280a0a30 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e28123020 con 0x7f7e28133fa0 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.549+0000 7f7e2d460700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280a3410 con 0x7f7e280a1340 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36814/0 (socket says 172.21.15.19:36814) 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 -- 172.21.15.19:0/3190117280 learned_addr learned my addr 172.21.15.19:0/3190117280 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e277fe700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e28133fa0 0x7f7e28120c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 -- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e28133fa0 msgr2=0x7f7e28120c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e28133fa0 0x7f7e28120c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 -- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e280a0a30 msgr2=0x7f7e28120180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e280a0a30 0x7f7e28120180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 -- 172.21.15.19:0/3190117280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009550 con 0x7f7e280a1340 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1ffff700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9b0 tx=0x7f7e1000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.550+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10009710 con 0x7f7e280a1340 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.551+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1000c850 con 0x7f7e280a1340 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.551+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280a0220 con 0x7f7e280a1340 2023-10-03T10:20:50.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.551+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000cbc0 con 0x7f7e280a1340 2023-10-03T10:20:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.551+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e281233e0 con 0x7f7e280a1340 2023-10-03T10:20:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.552+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7e1000cd20 con 0x7f7e280a1340 2023-10-03T10:20:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.552+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e281235d0 con 0x7f7e280a1340 2023-10-03T10:20:50.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.552+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7e1003fb60 con 0x7f7e280a1340 2023-10-03T10:20:50.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.561+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7e1001adc0 con 0x7f7e280a1340 2023-10-03T10:20:50.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.640+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fdbe806c360 con 0x7fdbe809e410 2023-10-03T10:20:50.641 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.641+0000 7fdbdeffd700 1 -- 172.21.15.19:0/784982396 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdbe001b3b0 con 0x7fdbe809e410 2023-10-03T10:20:50.642 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 msgr2=0x7fdbe8123280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 0x7fdbe8123280 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000cb10 tx=0x7fdbe000ce20 comp rx=0 tx=0).stop 2023-10-03T10:20:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 shutdown_connections 2023-10-03T10:20:50.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdbe809e410 0x7fdbe8123280 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdbe809d6f0 0x7fdbe8122800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 --2- 172.21.15.19:0/784982396 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdbe809e000 0x7fdbe8122d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 >> 172.21.15.19:0/784982396 conn(0x7fdbe8066f50 msgr2=0x7fdbe8071110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 shutdown_connections 2023-10-03T10:20:50.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.643+0000 7fdbf056c700 1 -- 172.21.15.19:0/784982396 wait complete. 2023-10-03T10:20:50.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:50.700 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.699+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5d581a3780 con 0x7f5d5809f240 2023-10-03T10:20:50.701 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.700+0000 7f5d4effd700 1 -- 172.21.15.19:0/15318348 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5d48028b70 con 0x7f5d5809f240 2023-10-03T10:20:50.701 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:50.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 msgr2=0x7f5d581c1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.703 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5d48016000 tx=0x7f5d48004750 comp rx=0 tx=0).stop 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 shutdown_connections 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f5d5809f650 0x7f5d581c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d5809e930 0x7f5d581c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 --2- 172.21.15.19:0/15318348 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5d5809f240 0x7f5d581c1230 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 >> 172.21.15.19:0/15318348 conn(0x7f5d580a4210 msgr2=0x7f5d581b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 shutdown_connections 2023-10-03T10:20:50.704 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.702+0000 7f5d60604700 1 -- 172.21.15.19:0/15318348 wait complete. 2023-10-03T10:20:50.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:50.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.729+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9fa006c360 con 0x7f9fa009d6f0 2023-10-03T10:20:50.730 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.729+0000 7f9f8effd700 1 -- 172.21.15.19:0/2102772688 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9f90015070 con 0x7f9fa009d6f0 2023-10-03T10:20:50.730 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 msgr2=0x7f9fa01201a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 0x7f9fa01201a0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9f90016000 tx=0x7f9f90004750 comp rx=0 tx=0).stop 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 shutdown_connections 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9fa009e410 0x7f9fa0120c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9fa009d6f0 0x7f9fa01201a0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 --2- 172.21.15.19:0/2102772688 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9fa009e000 0x7f9fa01206e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.734 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 >> 172.21.15.19:0/2102772688 conn(0x7f9fa0066f50 msgr2=0x7f9fa006a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 shutdown_connections 2023-10-03T10:20:50.735 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.733+0000 7f9fa4e17700 1 -- 172.21.15.19:0/2102772688 wait complete. 2023-10-03T10:20:50.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:50.780 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.780+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7e28074ea0 con 0x7f7e280a1340 2023-10-03T10:20:50.781 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.780+0000 7f7e1f7fe700 1 -- 172.21.15.19:0/3190117280 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7e10017020 con 0x7f7e280a1340 2023-10-03T10:20:50.781 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 msgr2=0x7f7e281206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e9b0 tx=0x7f7e1000ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 shutdown_connections 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7e28133fa0 0x7f7e28120c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e280a0a30 0x7f7e28120180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.782+0000 7f7e2d460700 1 --2- 172.21.15.19:0/3190117280 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7e280a1340 0x7f7e281206c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.783+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 >> 172.21.15.19:0/3190117280 conn(0x7f7e280a6550 msgr2=0x7f7e281baff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.783+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 shutdown_connections 2023-10-03T10:20:50.784 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:50.783+0000 7f7e2d460700 1 -- 172.21.15.19:0/3190117280 wait complete. 2023-10-03T10:20:50.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:51.664 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:51.717 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:51.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:51.797 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:51.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.814+0000 7f07b4130700 1 Processor -- start 2023-10-03T10:20:51.815 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.814+0000 7f07b4130700 1 -- start start 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac130540 0x7f07ac130910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 0x7f07ac06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07ac0704b0 con 0x7f07ac130e50 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac09a390 con 0x7f07ac06fb20 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b4130700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0716a0 con 0x7f07ac130540 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b16cb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.817 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 0x7f07ac06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b16cb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54044/0 (socket says 172.21.15.19:54044) 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b16cb700 1 -- 172.21.15.19:0/520364677 learned_addr learned my addr 172.21.15.19:0/520364677 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 -- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac130540 msgr2=0x7f07ac130910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 --2- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac130540 0x7f07ac130910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 -- 172.21.15.19:0/520364677 >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 msgr2=0x7f07ac06f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 --2- 172.21.15.19:0/520364677 >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b26cd700 1 -- 172.21.15.19:0/520364677 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ac071290 con 0x7f07ac06fb20 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.815+0000 7f07b16cb700 1 --2- 172.21.15.19:0/520364677 >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:51.818 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.816+0000 7f07b26cd700 1 --2- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 0x7f07ac06ff70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009d90 tx=0x7f07a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=403e536ff6b77539 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.816+0000 7f07b0eca700 1 -- 172.21.15.19:0/520364677 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400bd20 con 0x7f07ac06fb20 2023-10-03T10:20:51.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.816+0000 7f07b0eca700 1 -- 172.21.15.19:0/520364677 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400be80 con 0x7f07ac06fb20 2023-10-03T10:20:51.819 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.816+0000 7f07b0eca700 1 -- 172.21.15.19:0/520364677 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a40116a0 con 0x7f07ac06fb20 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 -- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 msgr2=0x7f07ac06ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 --2- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 0x7f07ac06ff70 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009d90 tx=0x7f07a400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 -- 172.21.15.19:0/520364677 shutdown_connections 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 --2- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac06fb20 0x7f07ac06ff70 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 --2- 172.21.15.19:0/520364677 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac130540 0x7f07ac130910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.822 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 --2- 172.21.15.19:0/520364677 >> v2:172.21.15.19:3300/0 conn(0x7f07ac130e50 0x7f07ac06f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 -- 172.21.15.19:0/520364677 >> 172.21.15.19:0/520364677 conn(0x7f07ac0a2aa0 msgr2=0x7f07ac0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 -- 172.21.15.19:0/520364677 shutdown_connections 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.817+0000 7f07b4130700 1 -- 172.21.15.19:0/520364677 wait complete. 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.818+0000 7f07b4130700 1 Processor -- start 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 -- start start 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac130540 0x7f07ac11e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ac130e50 0x7f07ac11e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.823 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0a0ae0 con 0x7f07ac130e50 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac0718e0 con 0x7f07ac130540 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.819+0000 7f07b4130700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07ac11f900 con 0x7f07ac06fb20 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36820/0 (socket says 172.21.15.19:36820) 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 -- 172.21.15.19:0/1910975839 learned_addr learned my addr 172.21.15.19:0/1910975839 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b16cb700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac130540 0x7f07ac11e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b26cd700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ac130e50 0x7f07ac11e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 -- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac130540 msgr2=0x7f07ac11e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.824 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac130540 0x7f07ac11e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 -- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ac130e50 msgr2=0x7f07ac11e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ac130e50 0x7f07ac11e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 -- 172.21.15.19:0/1910975839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c009550 con 0x7f07ac06fb20 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07b1ecc700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07a800b530 tx=0x7f07a800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.820+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8011830 con 0x7f07ac06fb20 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.821+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a8011990 con 0x7f07ac06fb20 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.821+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8011d20 con 0x7f07ac06fb20 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.821+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a4009a70 con 0x7f07ac06fb20 2023-10-03T10:20:51.825 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.821+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07ac1201e0 con 0x7f07ac06fb20 2023-10-03T10:20:51.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.822+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f07a801a400 con 0x7f07ac06fb20 2023-10-03T10:20:51.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.822+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f07a803f6f0 con 0x7f07ac06fb20 2023-10-03T10:20:51.826 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.822+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07ac070b80 con 0x7f07ac06fb20 2023-10-03T10:20:51.832 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.831+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f07a8015080 con 0x7f07ac06fb20 2023-10-03T10:20:51.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.864+0000 7f6ac5703700 1 Processor -- start 2023-10-03T10:20:51.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.864+0000 7f6ac5703700 1 -- start start 2023-10-03T10:20:51.865 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.864+0000 7f6ac5703700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f6ac009d6f0 0x7f6ac009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.866 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.864+0000 7f6ac5703700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac0134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.864+0000 7f6ac5703700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac009b120 con 0x7f6ac009e000 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6ac5703700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac006b460 con 0x7f6ac009d6f0 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6ac5703700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac009a7e0 con 0x7f6ac009e440 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abe7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f6ac009e000 0x7f6ac01339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41948/0 (socket says 172.21.15.19:41948) 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abe7fc700 1 -- 172.21.15.19:0/2109105085 learned_addr learned my addr 172.21.15.19:0/2109105085 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/2109105085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac0134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abeffd700 1 --2- 172.21.15.19:0/2109105085 >> v2:172.21.15.19:3300/0 conn(0x7f6ac009d6f0 0x7f6ac009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abf7fe700 1 -- 172.21.15.19:0/2109105085 >> v2:172.21.15.19:3300/0 conn(0x7f6ac009d6f0 msgr2=0x7f6ac009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:51.867 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abdffb700 1 -- 172.21.15.19:0/2109105085 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842893 0 0) 0x7f6ac009b120 con 0x7f6ac009e000 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/2109105085 >> v2:172.21.15.19:3300/0 conn(0x7f6ac009d6f0 0x7f6ac009dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abf7fe700 1 -- 172.21.15.19:0/2109105085 >> v1:172.21.15.19:6789/0 conn(0x7f6ac009e000 legacy=0x7f6ac01339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.865+0000 7f6abf7fe700 1 -- 172.21.15.19:0/2109105085 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac009a500 con 0x7f6ac009e440 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/2109105085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac0134100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009dc0 tx=0x7f6ab800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e8448ba03759b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6abdffb700 1 -- 172.21.15.19:0/2109105085 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800e070 con 0x7f6ac009e440 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6abdffb700 1 -- 172.21.15.19:0/2109105085 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab800bae0 con 0x7f6ac009e440 2023-10-03T10:20:51.868 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6abdffb700 1 -- 172.21.15.19:0/2109105085 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab800be90 con 0x7f6ac009e440 2023-10-03T10:20:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6ac5703700 1 -- 172.21.15.19:0/2109105085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 msgr2=0x7f6ac0134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.866+0000 7f6ac5703700 1 --2- 172.21.15.19:0/2109105085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac0134100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8009dc0 tx=0x7f6ab800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 -- 172.21.15.19:0/2109105085 shutdown_connections 2023-10-03T10:20:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 --2- 172.21.15.19:0/2109105085 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac0134100 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.870 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 --2- 172.21.15.19:0/2109105085 >> v2:172.21.15.19:3300/0 conn(0x7f6ac009d6f0 0x7f6ac009dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 -- 172.21.15.19:0/2109105085 >> 172.21.15.19:0/2109105085 conn(0x7f6ac0066f50 msgr2=0x7f6ac009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 -- 172.21.15.19:0/2109105085 shutdown_connections 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.867+0000 7f6ac5703700 1 -- 172.21.15.19:0/2109105085 wait complete. 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.868+0000 7f6ac5703700 1 Processor -- start 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.868+0000 7f6ac5703700 1 -- start start 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ac009e000 0x7f6ac01a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac01c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.871 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01a4de0 con 0x7f6ac009d6f0 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac009c710 con 0x7f6ac009e000 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6ac5703700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac01a7db0 con 0x7f6ac009e440 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac01c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abeffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54062/0 (socket says 172.21.15.19:54062) 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abeffd700 1 -- 172.21.15.19:0/4210202064 learned_addr learned my addr 172.21.15.19:0/4210202064 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abe7fc700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ac009e000 0x7f6ac01a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 -- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ac009e000 msgr2=0x7f6ac01a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ac009e000 0x7f6ac01a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 -- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 msgr2=0x7f6ac01a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.872 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 -- 172.21.15.19:0/4210202064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009a70 con 0x7f6ac009e440 2023-10-03T10:20:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abeffd700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:51.873 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.869+0000 7f6abf7fe700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac01c7ea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8016000 tx=0x7f6ab8004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.870+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8027480 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.870+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab8020070 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.870+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac01b92e0 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.870+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8027820 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.870+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac01a8ae0 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.871+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6ab8027980 con 0x7f6ac009e440 2023-10-03T10:20:51.874 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.871+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6ab8022070 con 0x7f6ac009e440 2023-10-03T10:20:51.875 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.871+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac0074ea0 con 0x7f6ac009e440 2023-10-03T10:20:51.877 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.876+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6ab801a380 con 0x7f6ac009e440 2023-10-03T10:20:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.920+0000 7f876f325700 1 Processor -- start 2023-10-03T10:20:51.921 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 -- start start 2023-10-03T10:20:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 0x7f8768131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8768070940 con 0x7f876809f240 2023-10-03T10:20:51.922 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876806fd60 con 0x7f876809f650 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.921+0000 7f876f325700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876806fa80 con 0x7f876809e930 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d8c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 0x7f8768131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d8c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 0x7f8768131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54070/0 (socket says 172.21.15.19:54070) 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45422/0 (socket says 172.21.15.19:45422) 2023-10-03T10:20:51.923 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d8c2700 1 -- 172.21.15.19:0/3535461252 learned_addr learned my addr 172.21.15.19:0/3535461252 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 -- 172.21.15.19:0/3535461252 >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 msgr2=0x7f8768131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 --2- 172.21.15.19:0/3535461252 >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 0x7f8768131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 -- 172.21.15.19:0/3535461252 >> v1:172.21.15.19:6789/0 conn(0x7f876809f240 legacy=0x7f87681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 -- 172.21.15.19:0/3535461252 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876809fb60 con 0x7f876809e930 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f876d0c1700 1 --2- 172.21.15.19:0/3535461252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8764009840 tx=0x7f8764009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76893199780ba4b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f875ffff700 1 -- 172.21.15.19:0/3535461252 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011830 con 0x7f876809e930 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.922+0000 7f875ffff700 1 -- 172.21.15.19:0/3535461252 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764011990 con 0x7f876809e930 2023-10-03T10:20:51.924 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.923+0000 7f875ffff700 1 -- 172.21.15.19:0/3535461252 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764011d20 con 0x7f876809e930 2023-10-03T10:20:51.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.923+0000 7f876f325700 1 -- 172.21.15.19:0/3535461252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 msgr2=0x7f876809ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.923+0000 7f876f325700 1 --2- 172.21.15.19:0/3535461252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f8764009840 tx=0x7f8764009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:51.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 -- 172.21.15.19:0/3535461252 shutdown_connections 2023-10-03T10:20:51.925 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 --2- 172.21.15.19:0/3535461252 >> v2:172.21.15.19:3300/0 conn(0x7f876809f650 0x7f8768131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 --2- 172.21.15.19:0/3535461252 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809e930 0x7f876809ed00 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 -- 172.21.15.19:0/3535461252 >> 172.21.15.19:0/3535461252 conn(0x7f87680a4210 msgr2=0x7f87680a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 -- 172.21.15.19:0/3535461252 shutdown_connections 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.924+0000 7f876f325700 1 -- 172.21.15.19:0/3535461252 wait complete. 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.925+0000 7f876f325700 1 Processor -- start 2023-10-03T10:20:51.926 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.925+0000 7f876f325700 1 -- start start 2023-10-03T10:20:51.927 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876809e930 0x7f87681a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809f240 0x7f87681a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87681a5950 con 0x7f876809e930 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8768071d20 con 0x7f876809f240 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876f325700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f87681a7580 con 0x7f876809f650 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876d8c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876d8c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36848/0 (socket says 172.21.15.19:36848) 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876d8c2700 1 -- 172.21.15.19:0/292655448 learned_addr learned my addr 172.21.15.19:0/292655448 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876d0c1700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876809e930 0x7f87681a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.926+0000 7f876c8c0700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809f240 0x7f87681a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.928 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 -- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809f240 msgr2=0x7f87681a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809f240 0x7f87681a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 -- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876809e930 msgr2=0x7f87681a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876809e930 0x7f87681a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 -- 172.21.15.19:0/292655448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87640094a0 con 0x7f876809f650 2023-10-03T10:20:51.929 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.927+0000 7f876d8c2700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f876000efc0 tx=0x7f876000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.928+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760003c20 con 0x7f876809f650 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.928+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876000f040 con 0x7f876809f650 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.928+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8760009e60 con 0x7f876809f650 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.928+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87680a0190 con 0x7f876809f650 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.928+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87681a6ba0 con 0x7f876809f650 2023-10-03T10:20:51.930 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.929+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f876000c930 con 0x7f876809f650 2023-10-03T10:20:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.929+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f876003f990 con 0x7f876809f650 2023-10-03T10:20:51.931 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.930+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87681a0b30 con 0x7f876809f650 2023-10-03T10:20:51.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.939+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f876001c360 con 0x7f876809f650 2023-10-03T10:20:51.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.969+0000 7f815d5fd700 1 Processor -- start 2023-10-03T10:20:51.970 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.969+0000 7f815d5fd700 1 -- start start 2023-10-03T10:20:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f815d5fd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815809f410 0x7f8158136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f815d5fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f81581393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f815d5fd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8158070940 con 0x7f815809e930 2023-10-03T10:20:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f815d5fd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f815806fd60 con 0x7f815809f410 2023-10-03T10:20:51.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f815d5fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f815806fa80 con 0x7f8158136fe0 2023-10-03T10:20:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f81567fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815809f410 0x7f8158136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f81567fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f815809f410 0x7f8158136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54090/0 (socket says 172.21.15.19:54090) 2023-10-03T10:20:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f81567fc700 1 -- 172.21.15.19:0/3105521975 learned_addr learned my addr 172.21.15.19:0/3105521975 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.970+0000 7f81577fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f81581393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f81567fc700 1 -- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 msgr2=0x7f81581393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f81567fc700 1 --2- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f81581393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f81567fc700 1 -- 172.21.15.19:0/3105521975 >> v1:172.21.15.19:6789/0 conn(0x7f815809e930 legacy=0x7f815809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f81567fc700 1 -- 172.21.15.19:0/3105521975 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815809fb60 con 0x7f815809f410 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f8155ffb700 1 -- 172.21.15.19:0/3105521975 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79265000 0 0) 0x7f8158070940 con 0x7f815809e930 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f81567fc700 1 --2- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f8158136aa0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f814c0098f0 tx=0x7f814c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5d1e6a2f7cbf03 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f8155ffb700 1 -- 172.21.15.19:0/3105521975 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c011830 con 0x7f815809f410 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f8155ffb700 1 -- 172.21.15.19:0/3105521975 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c011990 con 0x7f815809f410 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.971+0000 7f8155ffb700 1 -- 172.21.15.19:0/3105521975 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c011d20 con 0x7f815809f410 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 -- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 msgr2=0x7f8158136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 --2- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f8158136aa0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f814c0098f0 tx=0x7f814c009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 -- 172.21.15.19:0/3105521975 shutdown_connections 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 --2- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f81581393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 --2- 172.21.15.19:0/3105521975 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f8158136aa0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 -- 172.21.15.19:0/3105521975 >> 172.21.15.19:0/3105521975 conn(0x7f81580a4210 msgr2=0x7f81580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 -- 172.21.15.19:0/3105521975 shutdown_connections 2023-10-03T10:20:51.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.972+0000 7f815d5fd700 1 -- 172.21.15.19:0/3105521975 wait complete. 2023-10-03T10:20:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.973+0000 7f815d5fd700 1 Processor -- start 2023-10-03T10:20:51.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.973+0000 7f815d5fd700 1 -- start start 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f815809e930 0x7f815811f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f815811ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8158071d20 con 0x7f815809f410 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81581227a0 con 0x7f815809e930 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f815d5fd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8158122cc0 con 0x7f8158136fe0 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54092/0 (socket says 172.21.15.19:54092) 2023-10-03T10:20:51.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 -- 172.21.15.19:0/412257546 learned_addr learned my addr 172.21.15.19:0/412257546 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81577fe700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f815811ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 -- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 msgr2=0x7f815811ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f815811ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 -- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f815809e930 msgr2=0x7f815811f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f815809e930 0x7f815811f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.974+0000 7f81567fc700 1 -- 172.21.15.19:0/412257546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c009550 con 0x7f815809f410 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f81567fc700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f814c009c40 tx=0x7f814c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c004400 con 0x7f815809f410 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c01f070 con 0x7f815809f410 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0038a0 con 0x7f815809f410 2023-10-03T10:20:51.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815809dec0 con 0x7f815809f410 2023-10-03T10:20:51.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.975+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8158121820 con 0x7f815809f410 2023-10-03T10:20:51.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.976+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f814c021030 con 0x7f815809f410 2023-10-03T10:20:51.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.976+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f814c040c20 con 0x7f815809f410 2023-10-03T10:20:51.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.980+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8158074ea0 con 0x7f815809f410 2023-10-03T10:20:51.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:51.990+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f814c015080 con 0x7f815809f410 2023-10-03T10:20:52.046 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.045+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07ac074ea0 con 0x7f07ac06fb20 2023-10-03T10:20:52.047 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.046+0000 7f07a27fc700 1 -- 172.21.15.19:0/1910975839 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f07a800f8d0 con 0x7f07ac06fb20 2023-10-03T10:20:52.047 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.048+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 msgr2=0x7f07ac11dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:52.049 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f07a800b530 tx=0x7f07a800b840 comp rx=0 tx=0).stop 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 shutdown_connections 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f07ac130e50 0x7f07ac11e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f07ac06fb20 0x7f07ac11dca0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 --2- 172.21.15.19:0/1910975839 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f07ac130540 0x7f07ac11e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.049+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 >> 172.21.15.19:0/1910975839 conn(0x7f07ac0a2aa0 msgr2=0x7f07ac12d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:52.050 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.050+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 shutdown_connections 2023-10-03T10:20:52.051 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.050+0000 7f07b4130700 1 -- 172.21.15.19:0/1910975839 wait complete. 2023-10-03T10:20:52.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:52.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.096+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6ac009f420 con 0x7f6ac009e440 2023-10-03T10:20:52.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.096+0000 7f6aa77fe700 1 -- 172.21.15.19:0/4210202064 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6ab8011b80 con 0x7f6ac009e440 2023-10-03T10:20:52.097 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 msgr2=0x7f6ac01c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac01c7ea0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8016000 tx=0x7f6ab8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 shutdown_connections 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f6ac009e440 0x7f6ac01c7ea0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6ac009d6f0 0x7f6ac01a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.100 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 --2- 172.21.15.19:0/4210202064 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f6ac009e000 0x7f6ac01a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 >> 172.21.15.19:0/4210202064 conn(0x7f6ac0066f50 msgr2=0x7f6ac00a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:52.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 shutdown_connections 2023-10-03T10:20:52.101 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.099+0000 7f6ac5703700 1 -- 172.21.15.19:0/4210202064 wait complete. 2023-10-03T10:20:52.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:52.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.163+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8768074ea0 con 0x7f876809f650 2023-10-03T10:20:52.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.164+0000 7f875dffb700 1 -- 172.21.15.19:0/292655448 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8760014e00 con 0x7f876809f650 2023-10-03T10:20:52.165 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 msgr2=0x7f87681a4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:52.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f876000efc0 tx=0x7f876000c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 shutdown_connections 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f876809f650 0x7f87681a4800 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f876809e930 0x7f87681a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 --2- 172.21.15.19:0/292655448 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f876809f240 0x7f87681a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 >> 172.21.15.19:0/292655448 conn(0x7f87680a4210 msgr2=0x7f87681b8da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 shutdown_connections 2023-10-03T10:20:52.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.166+0000 7f876f325700 1 -- 172.21.15.19:0/292655448 wait complete. 2023-10-03T10:20:52.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.197+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f815809f820 con 0x7f815809f410 2023-10-03T10:20:52.198 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.197+0000 7f813f7fe700 1 -- 172.21.15.19:0/412257546 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f814c004560 con 0x7f815809f410 2023-10-03T10:20:52.198 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:52.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 msgr2=0x7f815811f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:52.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f814c009c40 tx=0x7f814c004750 comp rx=0 tx=0).stop 2023-10-03T10:20:52.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 shutdown_connections 2023-10-03T10:20:52.201 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8158136fe0 0x7f815811ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f815809e930 0x7f815811f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 --2- 172.21.15.19:0/412257546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f815809f410 0x7f815811f9c0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 >> 172.21.15.19:0/412257546 conn(0x7f81580a4210 msgr2=0x7f815809c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 shutdown_connections 2023-10-03T10:20:52.202 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:52.200+0000 7f815d5fd700 1 -- 172.21.15.19:0/412257546 wait complete. 2023-10-03T10:20:52.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:53.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:53.115 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:53.182 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:53.215 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.214+0000 7f57a710f700 1 Processor -- start 2023-10-03T10:20:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.214+0000 7f57a710f700 1 -- start start 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a009ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f57a009f650 0x7f57a0131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a0070940 con 0x7f57a009f650 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006fd60 con 0x7f57a009e930 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a710f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57a006fa80 con 0x7f57a009f240 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36858/0 (socket says 172.21.15.19:36858) 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 -- 172.21.15.19:0/3503191769 learned_addr learned my addr 172.21.15.19:0/3503191769 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a4eab700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a009ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a56ac700 1 --2- 172.21.15.19:0/3503191769 >> v2:172.21.15.19:3300/0 conn(0x7f57a009f650 0x7f57a0131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 -- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 msgr2=0x7f57a009ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a009ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 -- 172.21.15.19:0/3503191769 >> v2:172.21.15.19:3300/0 conn(0x7f57a009f650 msgr2=0x7f57a0131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 --2- 172.21.15.19:0/3503191769 >> v2:172.21.15.19:3300/0 conn(0x7f57a009f650 0x7f57a0131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f579ffff700 1 -- 172.21.15.19:0/3503191769 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a009fb60 con 0x7f57a009f240 2023-10-03T10:20:53.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.215+0000 7f57a4eab700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.216+0000 7f579ffff700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f578c0098f0 tx=0x7f578c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b9d46269699b30 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.216+0000 7f579f7fe700 1 -- 172.21.15.19:0/3503191769 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c011830 con 0x7f57a009f240 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.216+0000 7f579f7fe700 1 -- 172.21.15.19:0/3503191769 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c011990 con 0x7f57a009f240 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.216+0000 7f579f7fe700 1 -- 172.21.15.19:0/3503191769 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c011d20 con 0x7f57a009f240 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 -- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 msgr2=0x7f57a01317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f578c0098f0 tx=0x7f578c009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 -- 172.21.15.19:0/3503191769 shutdown_connections 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a009ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 --2- 172.21.15.19:0/3503191769 >> v2:172.21.15.19:3300/0 conn(0x7f57a009f650 0x7f57a0131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 --2- 172.21.15.19:0/3503191769 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f240 0x7f57a01317f0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 -- 172.21.15.19:0/3503191769 >> 172.21.15.19:0/3503191769 conn(0x7f57a00a4210 msgr2=0x7f57a00a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 -- 172.21.15.19:0/3503191769 shutdown_connections 2023-10-03T10:20:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.217+0000 7f57a710f700 1 -- 172.21.15.19:0/3503191769 wait complete. 2023-10-03T10:20:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.218+0000 7f57a710f700 1 Processor -- start 2023-10-03T10:20:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.218+0000 7f57a710f700 1 -- start start 2023-10-03T10:20:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 0x7f57a01c4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f650 0x7f57a01c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01b5330 con 0x7f57a009f240 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01c4c50 con 0x7f57a009e930 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a710f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57a00a3530 con 0x7f57a009f650 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a4eab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f579ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 0x7f57a01c4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a4eab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45452/0 (socket says 172.21.15.19:45452) 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f579ffff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 0x7f57a01c4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54114/0 (socket says 172.21.15.19:54114) 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a4eab700 1 -- 172.21.15.19:0/3506931371 learned_addr learned my addr 172.21.15.19:0/3506931371 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.219+0000 7f57a56ac700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f650 0x7f57a01c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 -- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f650 msgr2=0x7f57a01c07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f650 0x7f57a01c07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 -- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 msgr2=0x7f57a01c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 0x7f57a01c4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 -- 172.21.15.19:0/3506931371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579400d940 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a4eab700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5794012ed0 tx=0x7f579400f390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794014040 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400faf0 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c009550 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400dea0 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.220+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a00a0190 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.221+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f579400b450 con 0x7f57a009e930 2023-10-03T10:20:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.222+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a0074ea0 con 0x7f57a009e930 2023-10-03T10:20:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.222+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f5794043180 con 0x7f57a009e930 2023-10-03T10:20:53.231 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.231+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f579400fe60 con 0x7f57a009e930 2023-10-03T10:20:53.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.278+0000 7fe8c8a92700 1 Processor -- start 2023-10-03T10:20:53.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.278+0000 7fe8c8a92700 1 -- start start 2023-10-03T10:20:53.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c8a92700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c409e930 0x7fe8c409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c8a92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 0x7fe8c4131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c8a92700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c4070940 con 0x7fe8c409f240 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c8a92700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c406fd60 con 0x7fe8c409e930 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c8a92700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c406fa80 con 0x7fe8c409f650 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c409e930 0x7fe8c409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c259c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe8c409e930 0x7fe8c409ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54116/0 (socket says 172.21.15.19:54116) 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c259c700 1 -- 172.21.15.19:0/857868453 learned_addr learned my addr 172.21.15.19:0/857868453 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.279+0000 7fe8c2d9d700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 0x7fe8c4131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c259c700 1 -- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 msgr2=0x7fe8c4131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c259c700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 0x7fe8c4131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.281 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c259c700 1 -- 172.21.15.19:0/857868453 >> v1:172.21.15.19:6789/0 conn(0x7fe8c409f240 legacy=0x7fe8c41317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c259c700 1 -- 172.21.15.19:0/857868453 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c409fb60 con 0x7fe8c409e930 2023-10-03T10:20:53.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c159a700 1 -- 172.21.15.19:0/857868453 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731099292 0 0) 0x7fe8c4070940 con 0x7fe8c409f240 2023-10-03T10:20:53.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c2d9d700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 0x7fe8c4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.282 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c259c700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409e930 0x7fe8c409ed00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098f0 tx=0x7fe8b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d9518e058d951c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c159a700 1 -- 172.21.15.19:0/857868453 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4011830 con 0x7fe8c409e930 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c159a700 1 -- 172.21.15.19:0/857868453 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4011990 con 0x7fe8c409e930 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.280+0000 7fe8c159a700 1 -- 172.21.15.19:0/857868453 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4011d20 con 0x7fe8c409e930 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 -- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409e930 msgr2=0x7fe8c409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409e930 0x7fe8c409ed00 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098f0 tx=0x7fe8b4009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 -- 172.21.15.19:0/857868453 shutdown_connections 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409f650 0x7fe8c4131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/857868453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409e930 0x7fe8c409ed00 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.283 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 -- 172.21.15.19:0/857868453 >> 172.21.15.19:0/857868453 conn(0x7fe8c40a4210 msgr2=0x7fe8c40a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 -- 172.21.15.19:0/857868453 shutdown_connections 2023-10-03T10:20:53.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.281+0000 7fe8c8a92700 1 -- 172.21.15.19:0/857868453 wait complete. 2023-10-03T10:20:53.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.283+0000 7fe8c8a92700 1 Processor -- start 2023-10-03T10:20:53.284 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.283+0000 7fe8c8a92700 1 -- start start 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 0x7fe8c4139b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 0x7fe8c413a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 0x7fe8c41c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41373c0 con 0x7fe8c409f650 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4071d20 con 0x7fe8c409f240 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c8a92700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4137b70 con 0x7fe8c409e930 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 0x7fe8c413a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.286 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c2d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 0x7fe8c41c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c1d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 0x7fe8c413a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45466/0 (socket says 172.21.15.19:45466) 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c1d9b700 1 -- 172.21.15.19:0/3308805156 learned_addr learned my addr 172.21.15.19:0/3308805156 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c259c700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 0x7fe8c4139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c259c700 1 -- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 msgr2=0x7fe8c413a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.284+0000 7fe8c259c700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 0x7fe8c413a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c259c700 1 -- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 msgr2=0x7fe8c41c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c259c700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 0x7fe8c41c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c259c700 1 -- 172.21.15.19:0/3308805156 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009a70 con 0x7fe8c409e930 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c2d9d700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 0x7fe8c41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c259c700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 0x7fe8c4139b60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4016000 tx=0x7fe8b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.287 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4004340 con 0x7fe8c409e930 2023-10-03T10:20:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b401f070 con 0x7fe8c409e930 2023-10-03T10:20:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b4009550 con 0x7fe8c409e930 2023-10-03T10:20:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.285+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40036a0 con 0x7fe8c409e930 2023-10-03T10:20:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.286+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe8b4021030 con 0x7fe8c409e930 2023-10-03T10:20:53.288 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.286+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c40a0190 con 0x7fe8c409e930 2023-10-03T10:20:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.286+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8b4019570 con 0x7fe8c409e930 2023-10-03T10:20:53.289 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.288+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4074ea0 con 0x7fe8c409e930 2023-10-03T10:20:53.293 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.293+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8b4015030 con 0x7fe8c409e930 2023-10-03T10:20:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.338+0000 7f93c3e7a700 1 Processor -- start 2023-10-03T10:20:53.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.338+0000 7f93c3e7a700 1 -- start start 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09d6f0 0x7f93bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 0x7f93bc1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93bc09e410 0x7f93bc133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93bc06b460 con 0x7f93bc09e410 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc09b120 con 0x7f93bc09d6f0 2023-10-03T10:20:53.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c3e7a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc09a7e0 con 0x7f93bc09e000 2023-10-03T10:20:53.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c2417700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93bc09e410 0x7f93bc133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c2417700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f93bc09e410 0x7f93bc133f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54124/0 (socket says 172.21.15.19:54124) 2023-10-03T10:20:53.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c1415700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 0x7f93bc1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c2417700 1 -- 172.21.15.19:0/2986813562 learned_addr learned my addr 172.21.15.19:0/2986813562 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.341 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.339+0000 7f93c1c16700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09d6f0 0x7f93bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 -- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 msgr2=0x7f93bc1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 0x7f93bc1339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 -- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09d6f0 msgr2=0x7f93bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09d6f0 0x7f93bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 -- 172.21.15.19:0/2986813562 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93bc09a500 con 0x7f93bc09e410 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c1415700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 0x7f93bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c2417700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09e410 0x7f93bc133f30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009e50 tx=0x7f93b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88413f76c693d18 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c0c14700 1 -- 172.21.15.19:0/2986813562 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400e070 con 0x7f93bc09e410 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c0c14700 1 -- 172.21.15.19:0/2986813562 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b400b910 con 0x7f93bc09e410 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.340+0000 7f93c0c14700 1 -- 172.21.15.19:0/2986813562 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b400bcc0 con 0x7f93bc09e410 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 -- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09e410 msgr2=0x7f93bc133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09e410 0x7f93bc133f30 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009e50 tx=0x7f93b400b330 comp rx=0 tx=0).stop 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 -- 172.21.15.19:0/2986813562 shutdown_connections 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09d6f0 0x7f93bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09e410 0x7f93bc133f30 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/2986813562 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e000 0x7f93bc1339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 -- 172.21.15.19:0/2986813562 >> 172.21.15.19:0/2986813562 conn(0x7f93bc066f50 msgr2=0x7f93bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 -- 172.21.15.19:0/2986813562 shutdown_connections 2023-10-03T10:20:53.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.341+0000 7f93c3e7a700 1 -- 172.21.15.19:0/2986813562 wait complete. 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.343+0000 7f93c3e7a700 1 Processor -- start 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.343+0000 7f93c3e7a700 1 -- start start 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09d6f0 0x7f93bc1a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 0x7f93bc1a6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1a8100 con 0x7f93bc09d6f0 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc1a8dc0 con 0x7f93bc09e000 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c3e7a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93bc0a2090 con 0x7f93bc09e410 2023-10-03T10:20:53.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c2417700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c2417700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36890/0 (socket says 172.21.15.19:36890) 2023-10-03T10:20:53.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c2417700 1 -- 172.21.15.19:0/3879777701 learned_addr learned my addr 172.21.15.19:0/3879777701 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 0x7f93bc1a6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1c16700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09d6f0 0x7f93bc1a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 -- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 msgr2=0x7f93bc1a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 -- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09d6f0 msgr2=0x7f93bc1a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09d6f0 0x7f93bc1a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.344+0000 7f93c1415700 1 -- 172.21.15.19:0/3879777701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0094a0 con 0x7f93bc09e000 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93c2417700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93c1415700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 0x7f93bc1a6410 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00e980 tx=0x7f93ac00ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00c690 con 0x7f93bc09e000 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ac00c7f0 con 0x7f93bc09e000 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00cb80 con 0x7f93bc09e000 2023-10-03T10:20:53.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b4009b30 con 0x7f93bc09e000 2023-10-03T10:20:53.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.345+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93bc09c710 con 0x7f93bc09e000 2023-10-03T10:20:53.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.347+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93bc1a7b40 con 0x7f93bc09e000 2023-10-03T10:20:53.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.347+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f93ac00cce0 con 0x7f93bc09e000 2023-10-03T10:20:53.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.347+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f93ac03fae0 con 0x7f93bc09e000 2023-10-03T10:20:53.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.357+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f93ac011db0 con 0x7f93bc09e000 2023-10-03T10:20:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.371+0000 7fa0a3236700 1 Processor -- start 2023-10-03T10:20:53.372 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.371+0000 7fa0a3236700 1 -- start start 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa09c12cf60 0x7fa09c06f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c12f8b0 0x7fa09c12fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c130260 0x7fa09c136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09c12d330 con 0x7fa09c12cf60 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c12cd90 con 0x7fa09c130260 2023-10-03T10:20:53.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a3236700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c1306d0 con 0x7fa09c12f8b0 2023-10-03T10:20:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a0fd2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa09c12cf60 0x7fa09c06f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a0fd2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa09c12cf60 0x7fa09c06f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54128/0 (socket says 172.21.15.19:54128) 2023-10-03T10:20:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2198881220 learned_addr learned my addr 172.21.15.19:0/2198881220 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa0a17d3700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c130260 0x7fa09c136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.372+0000 7fa09bfff700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c12f8b0 0x7fa09c12fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c12f8b0 msgr2=0x7fa09c12fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c12f8b0 0x7fa09c12fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c130260 msgr2=0x7fa09c136c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:53.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c130260 0x7fa09c136c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.375 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2198881220 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c071780 con 0x7fa09c12cf60 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12cf60 0x7fa09c06f5d0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fa090009920 tx=0x7fa090009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3861f2b6eb848b08 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa09b7fe700 1 -- 172.21.15.19:0/2198881220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090010a90 con 0x7fa09c12cf60 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa09b7fe700 1 -- 172.21.15.19:0/2198881220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090010bf0 con 0x7fa09c12cf60 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.373+0000 7fa09b7fe700 1 -- 172.21.15.19:0/2198881220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090018440 con 0x7fa09c12cf60 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 -- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12cf60 msgr2=0x7fa09c06f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12cf60 0x7fa09c06f5d0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fa090009920 tx=0x7fa090009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 -- 172.21.15.19:0/2198881220 shutdown_connections 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c130260 0x7fa09c136c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12cf60 0x7fa09c06f5d0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2198881220 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c12f8b0 0x7fa09c12fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 -- 172.21.15.19:0/2198881220 >> 172.21.15.19:0/2198881220 conn(0x7fa09c0a2aa0 msgr2=0x7fa09c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.374+0000 7fa0a3236700 1 -- 172.21.15.19:0/2198881220 shutdown_connections 2023-10-03T10:20:53.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.375+0000 7fa0a3236700 1 -- 172.21.15.19:0/2198881220 wait complete. 2023-10-03T10:20:53.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 Processor -- start 2023-10-03T10:20:53.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 -- start start 2023-10-03T10:20:53.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 0x7fa09c1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 0x7fa09c1c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c09ec00 con 0x7fa09c12f8b0 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c09d5a0 con 0x7fa09c12cf60 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a3236700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa09c09cde0 con 0x7fa09c130260 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a0fd2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa09bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 0x7fa09c1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a0fd2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45516/0 (socket says 172.21.15.19:45516) 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.376+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2116112653 learned_addr learned my addr 172.21.15.19:0/2116112653 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:53.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a17d3700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 0x7fa09c1c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 msgr2=0x7fa09c1c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 0x7fa09c1c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 msgr2=0x7fa09c1c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 0x7fa09c1c43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 -- 172.21.15.19:0/2116112653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa090009550 con 0x7fa09c12cf60 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a17d3700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 0x7fa09c1c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa09bfff700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 0x7fa09c1c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a0fd2700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa090009c70 tx=0x7fa090004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900038a0 con 0x7fa09c12cf60 2023-10-03T10:20:53.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa090003a00 con 0x7fa09c12cf60 2023-10-03T10:20:53.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.377+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa09c09e5d0 con 0x7fa09c12cf60 2023-10-03T10:20:53.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.378+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa09c1190f0 con 0x7fa09c12cf60 2023-10-03T10:20:53.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.379+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa090003db0 con 0x7fa09c12cf60 2023-10-03T10:20:53.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.379+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa09001f070 con 0x7fa09c12cf60 2023-10-03T10:20:53.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.379+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa09c074ea0 con 0x7fa09c12cf60 2023-10-03T10:20:53.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.379+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa090045040 con 0x7fa09c12cf60 2023-10-03T10:20:53.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.388+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa09002bb50 con 0x7fa09c12cf60 2023-10-03T10:20:53.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.487+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f57a01a3720 con 0x7f57a009e930 2023-10-03T10:20:53.488 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.488+0000 7f579d7fa700 1 -- 172.21.15.19:0/3506931371 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f579401f310 con 0x7f57a009e930 2023-10-03T10:20:53.489 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 msgr2=0x7f57a01c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f5794012ed0 tx=0x7f579400f390 comp rx=0 tx=0).stop 2023-10-03T10:20:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 shutdown_connections 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57a009f650 0x7f57a01c07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57a009e930 0x7f57a01c41d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 --2- 172.21.15.19:0/3506931371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57a009f240 0x7f57a01c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 >> 172.21.15.19:0/3506931371 conn(0x7f57a00a4210 msgr2=0x7f57a01b6a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 shutdown_connections 2023-10-03T10:20:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.490+0000 7f57a710f700 1 -- 172.21.15.19:0/3506931371 wait complete. 2023-10-03T10:20:53.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:53.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.528+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe8c406b250 con 0x7fe8c409e930 2023-10-03T10:20:53.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.528+0000 7fe8b2ffd700 1 -- 172.21.15.19:0/3308805156 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe8b400b9d0 con 0x7fe8c409e930 2023-10-03T10:20:53.529 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.530+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 msgr2=0x7fe8c4139b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.530+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 0x7fe8c4139b60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4016000 tx=0x7fe8b4004750 comp rx=0 tx=0).stop 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 shutdown_connections 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe8c409f650 0x7fe8c41c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe8c409e930 0x7fe8c4139b60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 --2- 172.21.15.19:0/3308805156 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe8c409f240 0x7fe8c413a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 >> 172.21.15.19:0/3308805156 conn(0x7fe8c40a4210 msgr2=0x7fe8c40a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 shutdown_connections 2023-10-03T10:20:53.532 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.531+0000 7fe8c8a92700 1 -- 172.21.15.19:0/3308805156 wait complete. 2023-10-03T10:20:53.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:53.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.571+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f93bc074ea0 con 0x7f93bc09e000 2023-10-03T10:20:53.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.571+0000 7f93b27fc700 1 -- 172.21.15.19:0/3879777701 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f93ac021070 con 0x7f93bc09e000 2023-10-03T10:20:53.572 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 msgr2=0x7f93bc1a6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 0x7f93bc1a6410 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00e980 tx=0x7f93ac00ec90 comp rx=0 tx=0).stop 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 shutdown_connections 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f93bc09e410 0x7f93bc1a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93bc09d6f0 0x7f93bc1a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 --2- 172.21.15.19:0/3879777701 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f93bc09e000 0x7f93bc1a6410 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 >> 172.21.15.19:0/3879777701 conn(0x7f93bc066f50 msgr2=0x7f93bc1bae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 shutdown_connections 2023-10-03T10:20:53.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.574+0000 7f93c3e7a700 1 -- 172.21.15.19:0/3879777701 wait complete. 2023-10-03T10:20:53.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.598+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa09c0713a0 con 0x7fa09c12cf60 2023-10-03T10:20:53.599 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.599+0000 7fa0997fa700 1 -- 172.21.15.19:0/2116112653 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa09001d070 con 0x7fa09c12cf60 2023-10-03T10:20:53.600 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 msgr2=0x7fa09c1c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:53.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa090009c70 tx=0x7fa090004750 comp rx=0 tx=0).stop 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 shutdown_connections 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa09c130260 0x7fa09c1c4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa09c12cf60 0x7fa09c1c3eb0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 --2- 172.21.15.19:0/2116112653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa09c12f8b0 0x7fa09c1c43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 >> 172.21.15.19:0/2116112653 conn(0x7fa09c0a2aa0 msgr2=0x7fa09c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 shutdown_connections 2023-10-03T10:20:53.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:53.601+0000 7fa0a3236700 1 -- 172.21.15.19:0/2116112653 wait complete. 2023-10-03T10:20:53.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:54.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:54.547 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:54.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:54.616 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:54.668 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.668+0000 7f79aca4b700 1 Processor -- start 2023-10-03T10:20:54.669 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.668+0000 7f79aca4b700 1 -- start start 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79aca4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a8138af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79aca4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 0x7f79a813b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79aca4b700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a806ef30 con 0x7f79a81338a0 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79aca4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a806fef0 con 0x7f79a8139030 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79aca4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a81334b0 con 0x7f79a8136710 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79a659c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f79a81338a0 0x7f79a8133c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:41988/0 (socket says 172.21.15.19:41988) 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79a5d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a8138af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.670 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79a659c700 1 -- 172.21.15.19:0/2620940736 learned_addr learned my addr 172.21.15.19:0/2620940736 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:54.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.669+0000 7f79a6d9d700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 0x7f79a813b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a6d9d700 1 -- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 msgr2=0x7f79a8138af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a6d9d700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a8138af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a6d9d700 1 -- 172.21.15.19:0/2620940736 >> v1:172.21.15.19:6789/0 conn(0x7f79a81338a0 legacy=0x7f79a8133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a6d9d700 1 -- 172.21.15.19:0/2620940736 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a806fc30 con 0x7f79a8139030 2023-10-03T10:20:54.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a6d9d700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 0x7f79a813b410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009dc0 tx=0x7f79a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea6ecd28771318f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a559a700 1 -- 172.21.15.19:0/2620940736 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a000e070 con 0x7f79a8139030 2023-10-03T10:20:54.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a559a700 1 -- 172.21.15.19:0/2620940736 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79a000bb20 con 0x7f79a8139030 2023-10-03T10:20:54.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.670+0000 7f79a559a700 1 -- 172.21.15.19:0/2620940736 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0012430 con 0x7f79a8139030 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 -- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 msgr2=0x7f79a813b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 0x7f79a813b410 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009dc0 tx=0x7f79a000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 -- 172.21.15.19:0/2620940736 shutdown_connections 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a8139030 0x7f79a813b410 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 --2- 172.21.15.19:0/2620940736 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a8138af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 -- 172.21.15.19:0/2620940736 >> 172.21.15.19:0/2620940736 conn(0x7f79a80a2aa0 msgr2=0x7f79a80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.671+0000 7f79aca4b700 1 -- 172.21.15.19:0/2620940736 shutdown_connections 2023-10-03T10:20:54.673 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.672+0000 7f79aca4b700 1 -- 172.21.15.19:0/2620940736 wait complete. 2023-10-03T10:20:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.673+0000 7f79aca4b700 1 Processor -- start 2023-10-03T10:20:54.674 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.673+0000 7f79aca4b700 1 -- start start 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a81c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 0x7f79a81c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a811cca0 con 0x7f79a8139030 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a811e1c0 con 0x7f79a81338a0 2023-10-03T10:20:54.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79aca4b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a806f640 con 0x7f79a8136710 2023-10-03T10:20:54.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79a659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79a659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45528/0 (socket says 172.21.15.19:45528) 2023-10-03T10:20:54.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79a659c700 1 -- 172.21.15.19:0/3176768097 learned_addr learned my addr 172.21.15.19:0/3176768097 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79a5d9b700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a81c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.676 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.674+0000 7f79a6d9d700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 0x7f79a81c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 -- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 msgr2=0x7f79a81c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a81c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 -- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 msgr2=0x7f79a81c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 0x7f79a81c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 -- 172.21.15.19:0/3176768097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0009a70 con 0x7f79a81338a0 2023-10-03T10:20:54.677 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a6d9d700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 0x7f79a81c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79a659c700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f799800c520 tx=0x7f799800c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998005d70 con 0x7f79a81338a0 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980070d0 con 0x7f79a81338a0 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a811e490 con 0x7f79a81338a0 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998007440 con 0x7f79a81338a0 2023-10-03T10:20:54.678 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.675+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a811f1c0 con 0x7f79a81338a0 2023-10-03T10:20:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.677+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a811e620 con 0x7f79a81338a0 2023-10-03T10:20:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.677+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f79980075a0 con 0x7f79a81338a0 2023-10-03T10:20:54.679 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.678+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f799803edd0 con 0x7f79a81338a0 2023-10-03T10:20:54.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.682+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f799801b3b0 con 0x7f79a81338a0 2023-10-03T10:20:54.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.713+0000 7faf80bc0700 1 Processor -- start 2023-10-03T10:20:54.714 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.713+0000 7faf80bc0700 1 -- start start 2023-10-03T10:20:54.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.714+0000 7faf80bc0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09d6f0 0x7faf7c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.714+0000 7faf80bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.715 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.714+0000 7faf80bc0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7c09b120 con 0x7faf7c09e410 2023-10-03T10:20:54.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.714+0000 7faf80bc0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c06b460 con 0x7faf7c09e000 2023-10-03T10:20:54.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.714+0000 7faf80bc0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c09a7e0 con 0x7faf7c09d6f0 2023-10-03T10:20:54.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45532/0 (socket says 172.21.15.19:45532) 2023-10-03T10:20:54.716 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 -- 172.21.15.19:0/1002550190 learned_addr learned my addr 172.21.15.19:0/1002550190 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf7a59c700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09d6f0 0x7faf7c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 -- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09d6f0 msgr2=0x7faf7c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09d6f0 0x7faf7c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 -- 172.21.15.19:0/1002550190 >> v1:172.21.15.19:6789/0 conn(0x7faf7c09e410 legacy=0x7faf7c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.715+0000 7faf79d9b700 1 -- 172.21.15.19:0/1002550190 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c09a500 con 0x7faf7c09e000 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.716+0000 7faf79d9b700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faf70009920 tx=0x7faf70009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8fce88ac41cd210 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.716+0000 7faf7959a700 1 -- 172.21.15.19:0/1002550190 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000ba60 con 0x7faf7c09e000 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.716+0000 7faf7959a700 1 -- 172.21.15.19:0/1002550190 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7000bbc0 con 0x7faf7c09e000 2023-10-03T10:20:54.717 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.716+0000 7faf7959a700 1 -- 172.21.15.19:0/1002550190 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70009e70 con 0x7faf7c09e000 2023-10-03T10:20:54.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 -- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 msgr2=0x7faf7c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7faf70009920 tx=0x7faf70009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:54.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 -- 172.21.15.19:0/1002550190 shutdown_connections 2023-10-03T10:20:54.718 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09d6f0 0x7faf7c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1002550190 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09e000 0x7faf7c1339f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 -- 172.21.15.19:0/1002550190 >> 172.21.15.19:0/1002550190 conn(0x7faf7c066f50 msgr2=0x7faf7c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 -- 172.21.15.19:0/1002550190 shutdown_connections 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.717+0000 7faf80bc0700 1 -- 172.21.15.19:0/1002550190 wait complete. 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.718+0000 7faf80bc0700 1 Processor -- start 2023-10-03T10:20:54.719 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 -- start start 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09d6f0 0x7faf7c122640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 0x7faf7c1230c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c09c710 con 0x7faf7c09e410 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c0a2c20 con 0x7faf7c09d6f0 2023-10-03T10:20:54.720 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.719+0000 7faf80bc0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf7c124f40 con 0x7faf7c09e000 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf7ad9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 0x7faf7c1230c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36942/0 (socket says 172.21.15.19:36942) 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 -- 172.21.15.19:0/1761862447 learned_addr learned my addr 172.21.15.19:0/1761862447 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf7a59c700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09d6f0 0x7faf7c122640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 -- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09d6f0 msgr2=0x7faf7c122640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09d6f0 0x7faf7c122640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 -- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 msgr2=0x7faf7c1230c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 0x7faf7c1230c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.722 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf79d9b700 1 -- 172.21.15.19:0/1761862447 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf70009550 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.720+0000 7faf7ad9d700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 0x7faf7c1230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf79d9b700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faf70006d30 tx=0x7faf70004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf70004300 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7001f070 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf700036a0 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf7c1257c0 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.721+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c1267c0 con 0x7faf7c09e000 2023-10-03T10:20:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.722+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7faf70021030 con 0x7faf7c09e000 2023-10-03T10:20:54.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.723+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7c11f030 con 0x7faf7c09e000 2023-10-03T10:20:54.724 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.723+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7faf70040a60 con 0x7faf7c09e000 2023-10-03T10:20:54.733 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.732+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7faf70019970 con 0x7faf7c09e000 2023-10-03T10:20:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.746+0000 7f0726570700 1 Processor -- start 2023-10-03T10:20:54.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.746+0000 7f0726570700 1 -- start start 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f072006c0e0 0x7f072009ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 0x7f0720138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072006c4b0 con 0x7f072006c0e0 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07201388b0 con 0x7f0720134ec0 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0726570700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07200a09c0 con 0x7f0720137f20 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f071ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f072006c0e0 0x7f072009ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45558/0 (socket says 172.21.15.19:45558) 2023-10-03T10:20:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f071f7fe700 1 -- 172.21.15.19:0/4005234289 learned_addr learned my addr 172.21.15.19:0/4005234289 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.747+0000 7f0724b0d700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 0x7f0720138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 -- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 msgr2=0x7f0720138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 0x7f0720138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 -- 172.21.15.19:0/4005234289 >> v2:172.21.15.19:3300/0 conn(0x7f072006c0e0 msgr2=0x7f072009ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 --2- 172.21.15.19:0/4005234289 >> v2:172.21.15.19:3300/0 conn(0x7f072006c0e0 0x7f072009ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 -- 172.21.15.19:0/4005234289 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720134980 con 0x7f0720134ec0 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f0724b0d700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 0x7f0720138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071f7fe700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7a6db24d862c5cd server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071effd700 1 -- 172.21.15.19:0/4005234289 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011830 con 0x7f0720134ec0 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071effd700 1 -- 172.21.15.19:0/4005234289 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714011990 con 0x7f0720134ec0 2023-10-03T10:20:54.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.748+0000 7f071effd700 1 -- 172.21.15.19:0/4005234289 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714011d20 con 0x7f0720134ec0 2023-10-03T10:20:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 -- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 msgr2=0x7f07201379e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f07140098f0 tx=0x7f0714009c00 comp rx=0 tx=0).stop 2023-10-03T10:20:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 -- 172.21.15.19:0/4005234289 shutdown_connections 2023-10-03T10:20:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0720137f20 0x7f0720138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 --2- 172.21.15.19:0/4005234289 >> v2:172.21.15.19:3300/0 conn(0x7f072006c0e0 0x7f072009ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 --2- 172.21.15.19:0/4005234289 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720134ec0 0x7f07201379e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 -- 172.21.15.19:0/4005234289 >> 172.21.15.19:0/4005234289 conn(0x7f07200a4210 msgr2=0x7f07200a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 -- 172.21.15.19:0/4005234289 shutdown_connections 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.749+0000 7f0726570700 1 -- 172.21.15.19:0/4005234289 wait complete. 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.750+0000 7f0726570700 1 Processor -- start 2023-10-03T10:20:54.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 -- start start 2023-10-03T10:20:54.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072006c0e0 0x7f072011a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 0x7f072011b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072011c880 con 0x7f0720134ec0 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072011cd90 con 0x7f0720137f20 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0726570700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f07200a1480 con 0x7f072006c0e0 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f071f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54170/0 (socket says 172.21.15.19:54170) 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f071f7fe700 1 -- 172.21.15.19:0/446579629 learned_addr learned my addr 172.21.15.19:0/446579629 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f0724b0d700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 0x7f072011b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.751+0000 7f071ffff700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072006c0e0 0x7f072011a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 -- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072006c0e0 msgr2=0x7f072011a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072006c0e0 0x7f072011a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 -- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 msgr2=0x7f072011ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 -- 172.21.15.19:0/446579629 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009550 con 0x7f0720137f20 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f071f7fe700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0724b0d700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 0x7f072011b370 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0718007f20 tx=0x7f071800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800dde0 con 0x7f0720137f20 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072011dca0 con 0x7f0720137f20 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071800f040 con 0x7f0720137f20 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718003c60 con 0x7f0720137f20 2023-10-03T10:20:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.752+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072011df10 con 0x7f0720137f20 2023-10-03T10:20:54.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.753+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0718004030 con 0x7f0720137f20 2023-10-03T10:20:54.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.754+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f071801be10 con 0x7f0720137f20 2023-10-03T10:20:54.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.754+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0720074ea0 con 0x7f0720137f20 2023-10-03T10:20:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.759+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0718045060 con 0x7f0720137f20 2023-10-03T10:20:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.797+0000 7fdb4d248700 1 Processor -- start 2023-10-03T10:20:54.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.797+0000 7fdb4d248700 1 -- start start 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb4d248700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb4809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb4d248700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 0x7fdb4813fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb4d248700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb48134980 con 0x7fdb48134ec0 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb4d248700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4806c4b0 con 0x7fdb481380f0 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb4d248700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480a09c0 con 0x7fdb4806c0e0 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb4809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.798+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb4809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36962/0 (socket says 172.21.15.19:36962) 2023-10-03T10:20:54.800 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb46d9d700 1 -- 172.21.15.19:0/4210940358 learned_addr learned my addr 172.21.15.19:0/4210940358 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 0x7fdb4813fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 -- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 msgr2=0x7fdb4809ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb4809ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 -- 172.21.15.19:0/4210940358 >> v1:172.21.15.19:6789/0 conn(0x7fdb48134ec0 legacy=0x7fdb481379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 -- 172.21.15.19:0/4210940358 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480a0600 con 0x7fdb481380f0 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb45d9b700 1 -- 172.21.15.19:0/4210940358 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709722295 0 0) 0x7fdb48134980 con 0x7fdb48134ec0 2023-10-03T10:20:54.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb4759e700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 0x7fdb4813fd20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009dc0 tx=0x7fdb4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54b014be95b5d2f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb45d9b700 1 -- 172.21.15.19:0/4210940358 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000e070 con 0x7fdb481380f0 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb45d9b700 1 -- 172.21.15.19:0/4210940358 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4000bb20 con 0x7fdb481380f0 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.799+0000 7fdb45d9b700 1 -- 172.21.15.19:0/4210940358 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40012430 con 0x7fdb481380f0 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 -- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 msgr2=0x7fdb4813fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 0x7fdb4813fd20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009dc0 tx=0x7fdb4000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:54.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 -- 172.21.15.19:0/4210940358 shutdown_connections 2023-10-03T10:20:54.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb481380f0 0x7fdb4813fd20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 --2- 172.21.15.19:0/4210940358 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb4809ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 -- 172.21.15.19:0/4210940358 >> 172.21.15.19:0/4210940358 conn(0x7fdb480a4210 msgr2=0x7fdb480a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 -- 172.21.15.19:0/4210940358 shutdown_connections 2023-10-03T10:20:54.803 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.800+0000 7fdb4d248700 1 -- 172.21.15.19:0/4210940358 wait complete. 2023-10-03T10:20:54.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.802+0000 7fdb4d248700 1 Processor -- start 2023-10-03T10:20:54.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.802+0000 7fdb4d248700 1 -- start start 2023-10-03T10:20:54.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb481ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb481380f0 0x7fdb4811a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4811de20 con 0x7fdb481380f0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4811d880 con 0x7fdb48134ec0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4d248700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480a1f30 con 0x7fdb4806c0e0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:45580/0 (socket says 172.21.15.19:45580) 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4659c700 1 -- 172.21.15.19:0/3996409969 learned_addr learned my addr 172.21.15.19:0/3996409969 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb46d9d700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb481ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.803+0000 7fdb4759e700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb481380f0 0x7fdb4811a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 -- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 msgr2=0x7fdb481ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.805 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb481ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 -- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb481380f0 msgr2=0x7fdb4811a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb481380f0 0x7fdb4811a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.806 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 -- 172.21.15.19:0/3996409969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb40009a70 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4659c700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c550 tx=0x7fdb3c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0054e0 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3c003680 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4811c730 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003a30 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.804+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4811d5b0 con 0x7fdb48134ec0 2023-10-03T10:20:54.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.805+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb48074ea0 con 0x7fdb48134ec0 2023-10-03T10:20:54.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.806+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdb3c003b90 con 0x7fdb48134ec0 2023-10-03T10:20:54.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.806+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdb3c03ef20 con 0x7fdb48134ec0 2023-10-03T10:20:54.811 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.810+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdb3c003e40 con 0x7fdb48134ec0 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.911+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f79a811e620 con 0x7f79a81338a0 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.911+0000 7f7996ffd700 1 -- 172.21.15.19:0/3176768097 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f79a811e620 con 0x7f79a81338a0 2023-10-03T10:20:54.912 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 msgr2=0x7f79a81c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f799800c520 tx=0x7f799800c830 comp rx=0 tx=0).stop 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 shutdown_connections 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f79a8139030 0x7f79a81c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f79a81338a0 0x7f79a81c8320 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 --2- 172.21.15.19:0/3176768097 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f79a8136710 0x7f79a81c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.915 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.914+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 >> 172.21.15.19:0/3176768097 conn(0x7f79a80a2aa0 msgr2=0x7f79a8137290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.915+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 shutdown_connections 2023-10-03T10:20:54.916 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.915+0000 7f79aca4b700 1 -- 172.21.15.19:0/3176768097 wait complete. 2023-10-03T10:20:54.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:54.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.942+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7faf7c074ea0 con 0x7faf7c09e000 2023-10-03T10:20:54.943 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.943+0000 7faf6affd700 1 -- 172.21.15.19:0/1761862447 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7faf7001b430 con 0x7faf7c09e000 2023-10-03T10:20:54.944 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 msgr2=0x7faf7c122b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faf70006d30 tx=0x7faf70004750 comp rx=0 tx=0).stop 2023-10-03T10:20:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 shutdown_connections 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf7c09e410 0x7faf7c1230c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7faf7c09d6f0 0x7faf7c122640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 --2- 172.21.15.19:0/1761862447 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7faf7c09e000 0x7faf7c122b80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 >> 172.21.15.19:0/1761862447 conn(0x7faf7c066f50 msgr2=0x7faf7c06f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 shutdown_connections 2023-10-03T10:20:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.945+0000 7faf80bc0700 1 -- 172.21.15.19:0/1761862447 wait complete. 2023-10-03T10:20:54.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.986+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f072006b250 con 0x7f0720137f20 2023-10-03T10:20:54.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.986+0000 7f071cff9700 1 -- 172.21.15.19:0/446579629 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f071801e3b0 con 0x7f0720137f20 2023-10-03T10:20:54.987 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.988+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 msgr2=0x7f072011b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.988+0000 7f0726570700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 0x7f072011b370 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f0718007f20 tx=0x7f071800d3b0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.988+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 shutdown_connections 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.988+0000 7f0726570700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0720137f20 0x7f072011b370 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.989+0000 7f0726570700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f072006c0e0 0x7f072011a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.989+0000 7f0726570700 1 --2- 172.21.15.19:0/446579629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0720134ec0 0x7f072011ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.989+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 >> 172.21.15.19:0/446579629 conn(0x7f07200a4210 msgr2=0x7f07200a3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.989+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 shutdown_connections 2023-10-03T10:20:54.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:54.989+0000 7f0726570700 1 -- 172.21.15.19:0/446579629 wait complete. 2023-10-03T10:20:55.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:55.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.020+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdb480008d0 con 0x7fdb48134ec0 2023-10-03T10:20:55.021 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.020+0000 7fdb2f7fe700 1 -- 172.21.15.19:0/3996409969 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdb3c017030 con 0x7fdb48134ec0 2023-10-03T10:20:55.021 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 msgr2=0x7fdb481cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c550 tx=0x7fdb3c00c860 comp rx=0 tx=0).stop 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 shutdown_connections 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb481380f0 0x7fdb4811a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdb4806c0e0 0x7fdb481ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 --2- 172.21.15.19:0/3996409969 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdb48134ec0 0x7fdb481cd290 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 >> 172.21.15.19:0/3996409969 conn(0x7fdb480a4210 msgr2=0x7fdb48071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 shutdown_connections 2023-10-03T10:20:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:55.023+0000 7fdb4d248700 1 -- 172.21.15.19:0/3996409969 wait complete. 2023-10-03T10:20:55.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:55.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:55.961 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:56.004 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:56.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.088+0000 7f226a29f700 1 Processor -- start 2023-10-03T10:20:56.089 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.088+0000 7f226a29f700 1 -- start start 2023-10-03T10:20:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226a29f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2264130670 0x7f2264130a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226a29f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f226406f680 0x7f226406fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226a29f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2264130260 con 0x7f226406ffd0 2023-10-03T10:20:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226a29f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2264071ff0 con 0x7f226406f680 2023-10-03T10:20:56.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226a29f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226409ecf0 con 0x7f2264130670 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f22637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f226406f680 0x7f226406fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226883c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f226406ffd0 0x7f2264137530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42026/0 (socket says 172.21.15.19:42026) 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f226883c700 1 -- 172.21.15.19:0/197169342 learned_addr learned my addr 172.21.15.19:0/197169342 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.089+0000 7f2263fff700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2264130670 0x7f2264130a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f22637fe700 1 -- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2264130670 msgr2=0x7f2264130a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f22637fe700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2264130670 0x7f2264130a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f22637fe700 1 -- 172.21.15.19:0/197169342 >> v1:172.21.15.19:6789/0 conn(0x7f226406ffd0 legacy=0x7f2264137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f22637fe700 1 -- 172.21.15.19:0/197169342 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264070e70 con 0x7f226406f680 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f22637fe700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226406f680 0x7f226406fa90 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2258009840 tx=0x7f2258009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34f41bf23912773 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f2262ffd700 1 -- 172.21.15.19:0/197169342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2258004230 con 0x7f226406f680 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f2262ffd700 1 -- 172.21.15.19:0/197169342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2258004390 con 0x7f226406f680 2023-10-03T10:20:56.092 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.090+0000 7f2262ffd700 1 -- 172.21.15.19:0/197169342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22580036a0 con 0x7f226406f680 2023-10-03T10:20:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 -- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226406f680 msgr2=0x7f226406fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226406f680 0x7f226406fa90 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f2258009840 tx=0x7f2258009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 -- 172.21.15.19:0/197169342 shutdown_connections 2023-10-03T10:20:56.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f2264130670 0x7f2264130a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 --2- 172.21.15.19:0/197169342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f226406f680 0x7f226406fa90 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 -- 172.21.15.19:0/197169342 >> 172.21.15.19:0/197169342 conn(0x7f22640a2aa0 msgr2=0x7f22640a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 -- 172.21.15.19:0/197169342 shutdown_connections 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.091+0000 7f226a29f700 1 -- 172.21.15.19:0/197169342 wait complete. 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.092+0000 7f226a29f700 1 Processor -- start 2023-10-03T10:20:56.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.092+0000 7f226a29f700 1 -- start start 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 0x7f2264133bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2264130670 0x7f22641340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2264135080 con 0x7f2264130670 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2264137130 con 0x7f226406ffd0 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226a29f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2264071820 con 0x7f226406f680 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f2263fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f2263fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:36982/0 (socket says 172.21.15.19:36982) 2023-10-03T10:20:56.096 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f2263fff700 1 -- 172.21.15.19:0/3458346723 learned_addr learned my addr 172.21.15.19:0/3458346723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f226883c700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2264130670 0x7f22641340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.093+0000 7f22637fe700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 0x7f2264133bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 -- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 msgr2=0x7f2264133bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 0x7f2264133bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 -- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2264130670 msgr2=0x7f22641340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2264130670 0x7f22641340f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 -- 172.21.15.19:0/3458346723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22580094a0 con 0x7f226406f680 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f22637fe700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 0x7f2264133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2263fff700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f225400e9b0 tx=0x7f225400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254009710 con 0x7f226406f680 2023-10-03T10:20:56.097 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254013860 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2264136020 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254013bd0 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.094+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2264137720 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.095+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2254013d30 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.095+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f226409dd00 con 0x7f226406f680 2023-10-03T10:20:56.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.096+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f22540434a0 con 0x7f226406f680 2023-10-03T10:20:56.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.104+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2254020080 con 0x7f226406f680 2023-10-03T10:20:56.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.125+0000 7f1ba361f700 1 Processor -- start 2023-10-03T10:20:56.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.125+0000 7f1ba361f700 1 -- start start 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba361f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 0x7f1b9c131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba361f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c09a580 0x7f1b9c139660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba361f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9c1313c0 con 0x7f1b9c099a40 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba361f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c06e8c0 con 0x7f1b9c09a580 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba361f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c071d20 con 0x7f1b9c131810 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba0bba700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f1b9c099a40 0x7f1b9c099e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42040/0 (socket says 172.21.15.19:42040) 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba0bba700 1 -- 172.21.15.19:0/1133659798 learned_addr learned my addr 172.21.15.19:0/1133659798 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:56.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba13bb700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 0x7f1b9c131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1b93fff700 1 -- 172.21.15.19:0/1133659798 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135925203 0 0) 0x7f1b9c1313c0 con 0x7f1b9c099a40 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1b93fff700 1 -- 172.21.15.19:0/1133659798 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b880035b0 con 0x7f1b9c099a40 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba13bb700 1 -- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c09a580 msgr2=0x7f1b9c139660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba13bb700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c09a580 0x7f1b9c139660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.126+0000 7f1ba13bb700 1 -- 172.21.15.19:0/1133659798 >> v1:172.21.15.19:6789/0 conn(0x7f1b9c099a40 legacy=0x7f1b9c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.127+0000 7f1ba13bb700 1 -- 172.21.15.19:0/1133659798 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0721a0 con 0x7f1b9c131810 2023-10-03T10:20:56.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.127+0000 7f1ba13bb700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 0x7f1b9c131be0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b98009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b8738d3872e08f server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.127+0000 7f1b93fff700 1 -- 172.21.15.19:0/1133659798 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011830 con 0x7f1b9c131810 2023-10-03T10:20:56.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.127+0000 7f1b93fff700 1 -- 172.21.15.19:0/1133659798 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98011990 con 0x7f1b9c131810 2023-10-03T10:20:56.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.127+0000 7f1b93fff700 1 -- 172.21.15.19:0/1133659798 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98011d20 con 0x7f1b9c131810 2023-10-03T10:20:56.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 -- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 msgr2=0x7f1b9c131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 0x7f1b9c131be0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b98009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 -- 172.21.15.19:0/1133659798 shutdown_connections 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c09a580 0x7f1b9c139660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 --2- 172.21.15.19:0/1133659798 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c131810 0x7f1b9c131be0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 -- 172.21.15.19:0/1133659798 >> 172.21.15.19:0/1133659798 conn(0x7f1b9c0a2aa0 msgr2=0x7f1b9c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 -- 172.21.15.19:0/1133659798 shutdown_connections 2023-10-03T10:20:56.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.128+0000 7f1ba361f700 1 -- 172.21.15.19:0/1133659798 wait complete. 2023-10-03T10:20:56.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.129+0000 7f1ba361f700 1 Processor -- start 2023-10-03T10:20:56.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 -- start start 2023-10-03T10:20:56.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c099a40 0x7f1b9c1197a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 0x7f1b9c11a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c11d080 con 0x7f1b9c099a40 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c12cb90 con 0x7f1b9c131810 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba361f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9c11c600 con 0x7f1b9c09a580 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba0bba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba0bba700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37012/0 (socket says 172.21.15.19:37012) 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba0bba700 1 -- 172.21.15.19:0/2516294566 learned_addr learned my addr 172.21.15.19:0/2516294566 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.130+0000 7f1ba1bbc700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 0x7f1b9c11a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba13bb700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c099a40 0x7f1b9c1197a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 -- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 msgr2=0x7f1b9c11a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 0x7f1b9c11a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 -- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c099a40 msgr2=0x7f1b9c1197a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c099a40 0x7f1b9c1197a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 -- 172.21.15.19:0/2516294566 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980094a0 con 0x7f1b9c09a580 2023-10-03T10:20:56.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba1bbc700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 0x7f1b9c11a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba0bba700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00c700 tx=0x7f1b8c00ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c005d70 con 0x7f1b9c09a580 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b8c0070d0 con 0x7f1b9c09a580 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8c007460 con 0x7f1b9c09a580 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9c11b990 con 0x7f1b9c09a580 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.131+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9c06eb00 con 0x7f1b9c09a580 2023-10-03T10:20:56.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.133+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9c074ea0 con 0x7f1b9c09a580 2023-10-03T10:20:56.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.133+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f1b8c0075c0 con 0x7f1b9c09a580 2023-10-03T10:20:56.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.133+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f1b8c03ec10 con 0x7f1b9c09a580 2023-10-03T10:20:56.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.142+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f1b8c00f260 con 0x7f1b9c09a580 2023-10-03T10:20:56.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.176+0000 7f975520c700 1 Processor -- start 2023-10-03T10:20:56.177 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.176+0000 7f975520c700 1 -- start start 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f975520c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f97500a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f975520c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 0x7f975013bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f975520c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975009edd0 con 0x7f97500a1340 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f975520c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975009e1f0 con 0x7f9750134170 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f975520c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f975009dc50 con 0x7f97500a0a30 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f974e59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f97500a1340 0x7f9750133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:42054/0 (socket says 172.21.15.19:42054) 2023-10-03T10:20:56.178 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f974e59c700 1 -- 172.21.15.19:0/539231980 learned_addr learned my addr 172.21.15.19:0/539231980 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:56.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f974f59e700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 0x7f975013bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.177+0000 7f974ed9d700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f97500a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.179 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974f59e700 1 -- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 msgr2=0x7f97500a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974f59e700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f97500a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974dd9b700 1 -- 172.21.15.19:0/539231980 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943825956 0 0) 0x7f975009edd0 con 0x7f97500a1340 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974f59e700 1 -- 172.21.15.19:0/539231980 >> v1:172.21.15.19:6789/0 conn(0x7f97500a1340 legacy=0x7f9750133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974f59e700 1 -- 172.21.15.19:0/539231980 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500a1fe0 con 0x7f9750134170 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974f59e700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 0x7f975013bd30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9748009dc0 tx=0x7f974800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc167421dc2630a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974dd9b700 1 -- 172.21.15.19:0/539231980 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800e070 con 0x7f9750134170 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974dd9b700 1 -- 172.21.15.19:0/539231980 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974800bb20 con 0x7f9750134170 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.178+0000 7f974dd9b700 1 -- 172.21.15.19:0/539231980 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9748012430 con 0x7f9750134170 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 -- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 msgr2=0x7f975013bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.180 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 0x7f975013bd30 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f9748009dc0 tx=0x7f974800b330 comp rx=0 tx=0).stop 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 -- 172.21.15.19:0/539231980 shutdown_connections 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9750134170 0x7f975013bd30 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 --2- 172.21.15.19:0/539231980 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f97500a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 -- 172.21.15.19:0/539231980 >> 172.21.15.19:0/539231980 conn(0x7f97500a6550 msgr2=0x7f97500a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 -- 172.21.15.19:0/539231980 shutdown_connections 2023-10-03T10:20:56.181 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.179+0000 7f975520c700 1 -- 172.21.15.19:0/539231980 wait complete. 2023-10-03T10:20:56.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.181+0000 7f975520c700 1 Processor -- start 2023-10-03T10:20:56.182 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.181+0000 7f975520c700 1 -- start start 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f9750122780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 0x7f9750122cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97500a4ec0 con 0x7f9750134170 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97501336b0 con 0x7f97500a1340 2023-10-03T10:20:56.183 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f975520c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9750124410 con 0x7f97500a0a30 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974f59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f9750122780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f9750122780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37032/0 (socket says 172.21.15.19:37032) 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974f59e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54210/0 (socket says 172.21.15.19:54210) 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974ed9d700 1 -- 172.21.15.19:0/2641749337 learned_addr learned my addr 172.21.15.19:0/2641749337 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:56.184 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.182+0000 7f974e59c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 0x7f9750122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 -- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 msgr2=0x7f9750122780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f9750122780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 -- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 msgr2=0x7f9750122cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 0x7f9750122cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 -- 172.21.15.19:0/2641749337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009a70 con 0x7f9750134170 2023-10-03T10:20:56.185 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974e59c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 0x7f9750122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f974f59e700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f975006c3d0 tx=0x7f9748004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480048f0 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9748020070 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97500a25e0 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97480276c0 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.183+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501331f0 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.184+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9748012430 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.184+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9748022070 con 0x7f9750134170 2023-10-03T10:20:56.186 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.184+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300052e0 con 0x7f9750134170 2023-10-03T10:20:56.195 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.194+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f974802c020 con 0x7f9750134170 2023-10-03T10:20:56.215 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.214+0000 7f4e09a53700 1 Processor -- start 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.214+0000 7f4e09a53700 1 -- start start 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.214+0000 7f4e09a53700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409e930 0x7f4e0409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.214+0000 7f4e09a53700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4e0409f240 0x7f4e041317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.214+0000 7f4e09a53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e04131d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e09a53700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e04070940 con 0x7f4e0409f240 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e09a53700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0406fd60 con 0x7f4e0409e930 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e09a53700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0406fa80 con 0x7f4e0409f650 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e04131d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e037fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e04131d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:37034/0 (socket says 172.21.15.19:37034) 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e037fe700 1 -- 172.21.15.19:0/4284934239 learned_addr learned my addr 172.21.15.19:0/4284934239 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:56.216 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 --2- 172.21.15.19:0/4284934239 >> v2:172.21.15.19:3300/0 conn(0x7f4e0409f240 0x7f4e041317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e02ffd700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409e930 0x7f4e0409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 -- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 msgr2=0x7f4e04131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e04131d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 -- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409e930 msgr2=0x7f4e0409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409e930 0x7f4e0409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 -- 172.21.15.19:0/4284934239 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0409fb60 con 0x7f4e0409f240 2023-10-03T10:20:56.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.215+0000 7f4e027fc700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409f240 0x7f4e041317f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009840 tx=0x7f4df8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59560aaada8de01 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e01ffb700 1 -- 172.21.15.19:0/4284934239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8011830 con 0x7f4e0409f240 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e01ffb700 1 -- 172.21.15.19:0/4284934239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df8011990 con 0x7f4e0409f240 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e01ffb700 1 -- 172.21.15.19:0/4284934239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8011d20 con 0x7f4e0409f240 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 -- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409f240 msgr2=0x7f4e041317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409f240 0x7f4e041317f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009840 tx=0x7f4df8009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 -- 172.21.15.19:0/4284934239 shutdown_connections 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409e930 0x7f4e0409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e04131d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 --2- 172.21.15.19:0/4284934239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409f240 0x7f4e041317f0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.216+0000 7f4e09a53700 1 -- 172.21.15.19:0/4284934239 >> 172.21.15.19:0/4284934239 conn(0x7f4e040a4210 msgr2=0x7f4e040a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.217+0000 7f4e09a53700 1 -- 172.21.15.19:0/4284934239 shutdown_connections 2023-10-03T10:20:56.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.217+0000 7f4e09a53700 1 -- 172.21.15.19:0/4284934239 wait complete. 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.218+0000 7f4e09a53700 1 Processor -- start 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.218+0000 7f4e09a53700 1 -- start start 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409f240 0x7f4e041a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e041a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:56.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e041a6f40 con 0x7f4e0409e930 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04071d20 con 0x7f4e0409f240 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e09a53700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4e040a35c0 con 0x7f4e0409f650 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e02ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e02ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54222/0 (socket says 172.21.15.19:54222) 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e02ffd700 1 -- 172.21.15.19:0/3010147676 learned_addr learned my addr 172.21.15.19:0/3010147676 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e037fe700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e041a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.219+0000 7f4e027fc700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409f240 0x7f4e041a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 -- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 msgr2=0x7f4e041a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e041a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 -- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409f240 msgr2=0x7f4e041a4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409f240 0x7f4e041a4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 -- 172.21.15.19:0/3010147676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80094a0 con 0x7f4e0409e930 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e02ffd700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e930 tx=0x7f4df400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4013680 con 0x7f4e0409e930 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df40137e0 con 0x7f4e0409e930 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4013b70 con 0x7f4e0409e930 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e040a0190 con 0x7f4e0409e930 2023-10-03T10:20:56.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.220+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e041a6af0 con 0x7f4e0409e930 2023-10-03T10:20:56.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.222+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4df4013cd0 con 0x7f4e0409e930 2023-10-03T10:20:56.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.222+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e041a7350 con 0x7f4e0409e930 2023-10-03T10:20:56.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.222+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4df403f720 con 0x7f4e0409e930 2023-10-03T10:20:56.227 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.227+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4df400c970 con 0x7f4e0409e930 2023-10-03T10:20:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.334+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2264137720 con 0x7f226406f680 2023-10-03T10:20:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.334+0000 7f2260ff9700 1 -- 172.21.15.19:0/3458346723 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2264137720 con 0x7f226406f680 2023-10-03T10:20:56.335 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.338+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 msgr2=0x7f2264138ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.338+0000 7f226a29f700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f225400e9b0 tx=0x7f225400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.339+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 shutdown_connections 2023-10-03T10:20:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.339+0000 7f226a29f700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2264130670 0x7f22641340f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.339+0000 7f226a29f700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f226406f680 0x7f2264138ef0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.339+0000 7f226a29f700 1 --2- 172.21.15.19:0/3458346723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f226406ffd0 0x7f2264133bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.339+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 >> 172.21.15.19:0/3458346723 conn(0x7f22640a2aa0 msgr2=0x7f22640a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.342+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 shutdown_connections 2023-10-03T10:20:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.342+0000 7f226a29f700 1 -- 172.21.15.19:0/3458346723 wait complete. 2023-10-03T10:20:56.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:56.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.360+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1b9c11cc80 con 0x7f1b9c09a580 2023-10-03T10:20:56.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.360+0000 7f1b91ffb700 1 -- 172.21.15.19:0/2516294566 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1b8c017030 con 0x7f1b9c09a580 2023-10-03T10:20:56.361 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 msgr2=0x7f1b9c119ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1b8c00c700 tx=0x7f1b8c00ca10 comp rx=0 tx=0).stop 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 shutdown_connections 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f1b9c131810 0x7f1b9c11a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1b9c099a40 0x7f1b9c1197a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 --2- 172.21.15.19:0/2516294566 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f1b9c09a580 0x7f1b9c119ce0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 >> 172.21.15.19:0/2516294566 conn(0x7f1b9c0a2aa0 msgr2=0x7f1b9c12e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 shutdown_connections 2023-10-03T10:20:56.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.363+0000 7f1ba361f700 1 -- 172.21.15.19:0/2516294566 wait complete. 2023-10-03T10:20:56.377 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:56.411 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.411+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9730005590 con 0x7f9750134170 2023-10-03T10:20:56.412 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.411+0000 7f97377fe700 1 -- 172.21.15.19:0/2641749337 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9748035090 con 0x7f9750134170 2023-10-03T10:20:56.412 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:56.414 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 msgr2=0x7f9750123200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f975006c3d0 tx=0x7f9748004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 shutdown_connections 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9750134170 0x7f9750123200 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f97500a0a30 0x7f9750122780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 --2- 172.21.15.19:0/2641749337 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f97500a1340 0x7f9750122cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 >> 172.21.15.19:0/2641749337 conn(0x7f97500a6550 msgr2=0x7f975009edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 shutdown_connections 2023-10-03T10:20:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.413+0000 7f975520c700 1 -- 172.21.15.19:0/2641749337 wait complete. 2023-10-03T10:20:56.428 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.439+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e04074ea0 con 0x7f4e0409e930 2023-10-03T10:20:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.439+0000 7f4debfff700 1 -- 172.21.15.19:0/3010147676 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4df4021020 con 0x7f4e0409e930 2023-10-03T10:20:56.440 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 msgr2=0x7f4e041a3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e930 tx=0x7f4df400ec40 comp rx=0 tx=0).stop 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 shutdown_connections 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4e0409f650 0x7f4e041a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e0409e930 0x7f4e041a3d20 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 --2- 172.21.15.19:0/3010147676 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4e0409f240 0x7f4e041a4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 >> 172.21.15.19:0/3010147676 conn(0x7f4e040a4210 msgr2=0x7f4e041b8c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 shutdown_connections 2023-10-03T10:20:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:56.442+0000 7f4e09a53700 1 -- 172.21.15.19:0/3010147676 wait complete. 2023-10-03T10:20:56.456 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:57.359 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:57.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:57.429 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:57.457 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 Processor -- start 2023-10-03T10:20:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 -- start start 2023-10-03T10:20:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f165409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.508 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f165409e410 0x7f1654134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165409b120 con 0x7f165409e000 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165406b460 con 0x7f165409e410 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.507+0000 7f1659ac6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165409a7e0 con 0x7f165409d6f0 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1652ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f165409e000 0x7f16541339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34124/0 (socket says 172.21.15.19:34124) 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1652ffd700 1 -- 172.21.15.19:0/2813345094 learned_addr learned my addr 172.21.15.19:0/2813345094 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f16537fe700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f165409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.509 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 --2- 172.21.15.19:0/2813345094 >> v2:172.21.15.19:3300/0 conn(0x7f165409e410 0x7f1654134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 -- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 msgr2=0x7f165409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:57.510 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f165409dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 -- 172.21.15.19:0/2813345094 >> v1:172.21.15.19:6789/0 conn(0x7f165409e000 legacy=0x7f16541339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 -- 172.21.15.19:0/2813345094 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165409a500 con 0x7f165409e410 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f16527fc700 1 -- 172.21.15.19:0/2813345094 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565589020 0 0) 0x7f165409b120 con 0x7f165409e000 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f1653fff700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e410 0x7f1654134100 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d90 tx=0x7f164c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b5620eeb9cc1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f16527fc700 1 -- 172.21.15.19:0/2813345094 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00e070 con 0x7f165409e410 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f16527fc700 1 -- 172.21.15.19:0/2813345094 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c00bb20 con 0x7f165409e410 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.508+0000 7f16527fc700 1 -- 172.21.15.19:0/2813345094 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c012430 con 0x7f165409e410 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 -- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e410 msgr2=0x7f1654134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e410 0x7f1654134100 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d90 tx=0x7f164c00b330 comp rx=0 tx=0).stop 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 -- 172.21.15.19:0/2813345094 shutdown_connections 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e410 0x7f1654134100 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.511 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 --2- 172.21.15.19:0/2813345094 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f165409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 -- 172.21.15.19:0/2813345094 >> 172.21.15.19:0/2813345094 conn(0x7f1654066f50 msgr2=0x7f165409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 -- 172.21.15.19:0/2813345094 shutdown_connections 2023-10-03T10:20:57.512 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.509+0000 7f1659ac6700 1 -- 172.21.15.19:0/2813345094 wait complete. 2023-10-03T10:20:57.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.510+0000 7f1659ac6700 1 Processor -- start 2023-10-03T10:20:57.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 -- start start 2023-10-03T10:20:57.513 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f16541a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e000 0x7f16541a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16541a8120 con 0x7f165409e000 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16541a8300 con 0x7f165409d6f0 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1659ac6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f16541b9170 con 0x7f165409e410 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.511+0000 7f1653fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:49936/0 (socket says 172.21.15.19:49936) 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 -- 172.21.15.19:0/1854580211 learned_addr learned my addr 172.21.15.19:0/1854580211 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f16537fe700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f16541a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1652ffd700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e000 0x7f16541a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 -- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 msgr2=0x7f16541a5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.514 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f16541a5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 -- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e000 msgr2=0x7f16541a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e000 0x7f16541a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 -- 172.21.15.19:0/1854580211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009a70 con 0x7f165409e410 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f1653fff700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b680 tx=0x7f164c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c01b810 con 0x7f165409e410 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c020070 con 0x7f165409e410 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.512+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c01bb70 con 0x7f165409e410 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.513+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16541a4ca0 con 0x7f165409e410 2023-10-03T10:20:57.515 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.513+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165409c710 con 0x7f165409e410 2023-10-03T10:20:57.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.514+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654074ea0 con 0x7f165409e410 2023-10-03T10:20:57.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.515+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f164c01bcd0 con 0x7f165409e410 2023-10-03T10:20:57.516 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.515+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f164c022070 con 0x7f165409e410 2023-10-03T10:20:57.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.523+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f164c01a380 con 0x7f165409e410 2023-10-03T10:20:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.560+0000 7fb2ea3fc700 1 Processor -- start 2023-10-03T10:20:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.560+0000 7fb2ea3fc700 1 -- start start 2023-10-03T10:20:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2ea3fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2e409d6f0 0x7fb2e409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2ea3fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e440 0x7fb2e4134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2ea3fc700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e409b120 con 0x7fb2e409e000 2023-10-03T10:20:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2ea3fc700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e406b460 con 0x7fb2e409d6f0 2023-10-03T10:20:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2ea3fc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e409a7e0 con 0x7fb2e409e440 2023-10-03T10:20:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2e3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb2e409d6f0 0x7fb2e409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2e37fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb2e409e000 0x7fb2e41339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34136/0 (socket says 172.21.15.19:34136) 2023-10-03T10:20:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.561+0000 7fb2e37fe700 1 -- 172.21.15.19:0/2794599166 learned_addr learned my addr 172.21.15.19:0/2794599166 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e8999700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e440 0x7fb2e4134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e3fff700 1 -- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e440 msgr2=0x7fb2e4134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e3fff700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e440 0x7fb2e4134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e3fff700 1 -- 172.21.15.19:0/2794599166 >> v1:172.21.15.19:6789/0 conn(0x7fb2e409e000 legacy=0x7fb2e41339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e3fff700 1 -- 172.21.15.19:0/2794599166 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e409a500 con 0x7fb2e409d6f0 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e2ffd700 1 -- 172.21.15.19:0/2794599166 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176699088 0 0) 0x7fb2e409b120 con 0x7fb2e409e000 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e3fff700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409d6f0 0x7fb2e409dac0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009870 tx=0x7fb2d4009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ba2344bfdc8fe9 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e2ffd700 1 -- 172.21.15.19:0/2794599166 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011830 con 0x7fb2e409d6f0 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e2ffd700 1 -- 172.21.15.19:0/2794599166 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d4011990 con 0x7fb2e409d6f0 2023-10-03T10:20:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.562+0000 7fb2e2ffd700 1 -- 172.21.15.19:0/2794599166 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d4011d20 con 0x7fb2e409d6f0 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409d6f0 msgr2=0x7fb2e409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409d6f0 0x7fb2e409dac0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4009870 tx=0x7fb2d4009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/2794599166 shutdown_connections 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e440 0x7fb2e4134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/2794599166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409d6f0 0x7fb2e409dac0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/2794599166 >> 172.21.15.19:0/2794599166 conn(0x7fb2e4066f50 msgr2=0x7fb2e409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.565 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/2794599166 shutdown_connections 2023-10-03T10:20:57.566 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.563+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/2794599166 wait complete. 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.565+0000 7fb2ea3fc700 1 Processor -- start 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.565+0000 7fb2ea3fc700 1 -- start start 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2e409d6f0 0x7fb2e41a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e000 0x7fb2e41a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a5000 con 0x7fb2e409e440 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a7ec0 con 0x7fb2e409e000 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2ea3fc700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e41a5e40 con 0x7fb2e409d6f0 2023-10-03T10:20:57.567 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35060/0 (socket says 172.21.15.19:35060) 2023-10-03T10:20:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 -- 172.21.15.19:0/448780828 learned_addr learned my addr 172.21.15.19:0/448780828 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:57.568 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 -- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2e409d6f0 msgr2=0x7fb2e41a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2e409d6f0 0x7fb2e41a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 -- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e000 msgr2=0x7fb2e41a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e000 0x7fb2e41a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.566+0000 7fb2e8999700 1 -- 172.21.15.19:0/448780828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40094a0 con 0x7fb2e409e440 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2e8999700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009dd0 tx=0x7fb2dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00cce0 con 0x7fb2e409e440 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00f040 con 0x7fb2e409e440 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0146c0 con 0x7fb2e409e440 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e41a6db0 con 0x7fb2e409e440 2023-10-03T10:20:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.567+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e409c710 con 0x7fb2e409e440 2023-10-03T10:20:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.568+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e4074ea0 con 0x7fb2e409e440 2023-10-03T10:20:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.569+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb2dc014820 con 0x7fb2e409e440 2023-10-03T10:20:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.569+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb2dc0400e0 con 0x7fb2e409e440 2023-10-03T10:20:57.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.578+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb2dc0118b0 con 0x7fb2e409e440 2023-10-03T10:20:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.601+0000 7fdce4316700 1 Processor -- start 2023-10-03T10:20:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.601+0000 7fdce4316700 1 -- start start 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.601+0000 7fdce4316700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.601+0000 7fdce4316700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.601+0000 7fdce4316700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce4316700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc09f520 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce4316700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc09f130 con 0x7fdcdc09e000 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce4316700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc09e930 con 0x7fdcdc09e410 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce18b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce18b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59556/0 (socket says 172.21.15.19:59556) 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce18b1700 1 -- 172.21.15.19:0/3932189737 learned_addr learned my addr 172.21.15.19:0/3932189737 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce28b3700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 -- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 msgr2=0x7fdcdc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc130ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 -- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 msgr2=0x7fdcdc130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce20b2700 1 -- 172.21.15.19:0/3932189737 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc09b2d0 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.602+0000 7fdce18b1700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.603+0000 7fdce20b2700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009870 tx=0x7fdcd8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bff7eddb5fefed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.603+0000 7fdce10b0700 1 -- 172.21.15.19:0/3932189737 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f8a0 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.603+0000 7fdce10b0700 1 -- 172.21.15.19:0/3932189737 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800fa00 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.605 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.603+0000 7fdce10b0700 1 -- 172.21.15.19:0/3932189737 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800fd90 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 -- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 msgr2=0x7fdcdc09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009870 tx=0x7fdcd8009b80 comp rx=0 tx=0).stop 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 -- 172.21.15.19:0/3932189737 shutdown_connections 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc130ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc09dac0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 --2- 172.21.15.19:0/3932189737 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 -- 172.21.15.19:0/3932189737 >> 172.21.15.19:0/3932189737 conn(0x7fdcdc066f50 msgr2=0x7fdcdc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 -- 172.21.15.19:0/3932189737 shutdown_connections 2023-10-03T10:20:57.606 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.604+0000 7fdce4316700 1 -- 172.21.15.19:0/3932189737 wait complete. 2023-10-03T10:20:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 Processor -- start 2023-10-03T10:20:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 -- start start 2023-10-03T10:20:57.607 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc1c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc1c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc124300 con 0x7fdcdc09d6f0 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc124950 con 0x7fdcdc09e000 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.606+0000 7fdce4316700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc126210 con 0x7fdcdc09e410 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59560/0 (socket says 172.21.15.19:59560) 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 -- 172.21.15.19:0/4061046210 learned_addr learned my addr 172.21.15.19:0/4061046210 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce20b2700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc1c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce28b3700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc1c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 -- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 msgr2=0x7fdcdc1c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc1c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 -- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 msgr2=0x7fdcdc1c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc1c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 -- 172.21.15.19:0/4061046210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc009550 con 0x7fdcdc09e000 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.607+0000 7fdce18b1700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ebe0 tx=0x7fdccc00eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.608+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc004030 con 0x7fdcdc09e000 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.608+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc004190 con 0x7fdcdc09e000 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.608+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc004520 con 0x7fdcdc09e000 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.608+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd80094a0 con 0x7fdcdc09e000 2023-10-03T10:20:57.610 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.608+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc125f30 con 0x7fdcdc09e000 2023-10-03T10:20:57.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.609+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc125bd0 con 0x7fdcdc09e000 2023-10-03T10:20:57.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.609+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fdccc00c850 con 0x7fdcdc09e000 2023-10-03T10:20:57.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.609+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fdccc03f880 con 0x7fdcdc09e000 2023-10-03T10:20:57.615 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.614+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fdcdc125bd0 con 0x7fdcdc09e000 2023-10-03T10:20:57.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.642+0000 7f30c4399700 1 Processor -- start 2023-10-03T10:20:57.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.642+0000 7f30c4399700 1 -- start start 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c4399700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f30bc0a0a30 0x7f30bc0a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c4399700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 0x7f30bc13bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c4399700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30bc09edd0 con 0x7f30bc0a1340 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c4399700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30bc09e1f0 con 0x7f30bc0a0a30 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c4399700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc09dc50 con 0x7f30bc134170 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c1934700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f30bc0a1340 0x7f30bc133a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34144/0 (socket says 172.21.15.19:34144) 2023-10-03T10:20:57.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c1934700 1 -- 172.21.15.19:0/2820481562 learned_addr learned my addr 172.21.15.19:0/2820481562 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:57.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c2936700 1 --2- 172.21.15.19:0/2820481562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 0x7f30bc13bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.643+0000 7f30c2135700 1 --2- 172.21.15.19:0/2820481562 >> v2:172.21.15.19:3300/0 conn(0x7f30bc0a0a30 0x7f30bc0a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c2936700 1 -- 172.21.15.19:0/2820481562 >> v2:172.21.15.19:3300/0 conn(0x7f30bc0a0a30 msgr2=0x7f30bc0a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:57.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c2936700 1 --2- 172.21.15.19:0/2820481562 >> v2:172.21.15.19:3300/0 conn(0x7f30bc0a0a30 0x7f30bc0a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c2936700 1 -- 172.21.15.19:0/2820481562 >> v1:172.21.15.19:6789/0 conn(0x7f30bc0a1340 legacy=0x7f30bc133a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c2936700 1 -- 172.21.15.19:0/2820481562 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc0a1fe0 con 0x7f30bc134170 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c1133700 1 -- 172.21.15.19:0/2820481562 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849090426 0 0) 0x7f30bc09edd0 con 0x7f30bc0a1340 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c2936700 1 --2- 172.21.15.19:0/2820481562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 0x7f30bc13bd30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cb272085bf1181c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c1133700 1 -- 172.21.15.19:0/2820481562 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011830 con 0x7f30bc134170 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c1133700 1 -- 172.21.15.19:0/2820481562 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b4011990 con 0x7f30bc134170 2023-10-03T10:20:57.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.644+0000 7f30c1133700 1 -- 172.21.15.19:0/2820481562 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4011d20 con 0x7f30bc134170 2023-10-03T10:20:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 -- 172.21.15.19:0/2820481562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 msgr2=0x7f30bc13bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 --2- 172.21.15.19:0/2820481562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 0x7f30bc13bd30 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f30b4009840 tx=0x7f30b4009b50 comp rx=0 tx=0).stop 2023-10-03T10:20:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 -- 172.21.15.19:0/2820481562 shutdown_connections 2023-10-03T10:20:57.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 --2- 172.21.15.19:0/2820481562 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc134170 0x7f30bc13bd30 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 --2- 172.21.15.19:0/2820481562 >> v2:172.21.15.19:3300/0 conn(0x7f30bc0a0a30 0x7f30bc0a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 -- 172.21.15.19:0/2820481562 >> 172.21.15.19:0/2820481562 conn(0x7f30bc0a6550 msgr2=0x7f30bc0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 -- 172.21.15.19:0/2820481562 shutdown_connections 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.645+0000 7f30c4399700 1 -- 172.21.15.19:0/2820481562 wait complete. 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.646+0000 7f30c4399700 1 Processor -- start 2023-10-03T10:20:57.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.646+0000 7f30c4399700 1 -- start start 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 0x7f30bc11e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30bc0a1340 0x7f30bc11ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc1217f0 con 0x7f30bc134170 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc1201e0 con 0x7f30bc0a0a30 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c4399700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc120ab0 con 0x7f30bc0a1340 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c2936700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c2936700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35086/0 (socket says 172.21.15.19:35086) 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c2936700 1 -- 172.21.15.19:0/238206046 learned_addr learned my addr 172.21.15.19:0/238206046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c1934700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30bc0a1340 0x7f30bc11ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.647+0000 7f30c2135700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 0x7f30bc11e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 -- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30bc0a1340 msgr2=0x7f30bc11ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30bc0a1340 0x7f30bc11ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 -- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 msgr2=0x7f30bc11e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 0x7f30bc11e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 -- 172.21.15.19:0/238206046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b40094a0 con 0x7f30bc134170 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2135700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 0x7f30bc11e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c2936700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f30bc09dd90 tx=0x7f30b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b40045d0 con 0x7f30bc134170 2023-10-03T10:20:57.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b40036a0 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30bc0a25e0 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.648+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b4003a10 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.649+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f30b4003b70 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.649+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30bc133560 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.650+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30bc074ea0 con 0x7f30bc134170 2023-10-03T10:20:57.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.650+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f30b4003e20 con 0x7f30bc134170 2023-10-03T10:20:57.656 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.655+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f30b4015030 con 0x7f30bc134170 2023-10-03T10:20:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.791+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb2e409f420 con 0x7fb2e409e440 2023-10-03T10:20:57.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.791+0000 7fb2e0ff9700 1 -- 172.21.15.19:0/448780828 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb2dc018020 con 0x7fb2e409e440 2023-10-03T10:20:57.792 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:57.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.793+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 msgr2=0x7fb2e41c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.793+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc009dd0 tx=0x7fb2dc00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 shutdown_connections 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2e409e440 0x7fb2e41c81c0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb2e409d6f0 0x7fb2e41a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 --2- 172.21.15.19:0/448780828 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb2e409e000 0x7fb2e41a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 >> 172.21.15.19:0/448780828 conn(0x7fb2e4066f50 msgr2=0x7fb2e41bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 shutdown_connections 2023-10-03T10:20:57.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.794+0000 7fb2ea3fc700 1 -- 172.21.15.19:0/448780828 wait complete. 2023-10-03T10:20:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.803+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f16541a63f0 con 0x7f165409e410 2023-10-03T10:20:57.804 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.803+0000 7f163bfff700 1 -- 172.21.15.19:0/1854580211 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f164c025b70 con 0x7f165409e410 2023-10-03T10:20:57.804 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 msgr2=0x7f16541c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b680 tx=0x7f164c004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 shutdown_connections 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f165409e410 0x7f16541c8040 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f165409d6f0 0x7f16541a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.807 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 --2- 172.21.15.19:0/1854580211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f165409e000 0x7f16541a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 >> 172.21.15.19:0/1854580211 conn(0x7f1654066f50 msgr2=0x7f165406f070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 shutdown_connections 2023-10-03T10:20:57.808 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.806+0000 7f1659ac6700 1 -- 172.21.15.19:0/1854580211 wait complete. 2023-10-03T10:20:57.809 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:57.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:57.864 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.863+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30bc0a28e0 con 0x7f30bc134170 2023-10-03T10:20:57.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.864+0000 7f30b2ffd700 1 -- 172.21.15.19:0/238206046 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f30b4024d70 con 0x7f30bc134170 2023-10-03T10:20:57.901 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 msgr2=0x7f30bc11f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f30bc09dd90 tx=0x7f30b4004750 comp rx=0 tx=0).stop 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 shutdown_connections 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f30bc134170 0x7f30bc11f130 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f30bc0a0a30 0x7f30bc11e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 --2- 172.21.15.19:0/238206046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f30bc0a1340 0x7f30bc11ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 >> 172.21.15.19:0/238206046 conn(0x7f30bc0a6550 msgr2=0x7f30bc09edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 shutdown_connections 2023-10-03T10:20:57.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.866+0000 7f30c4399700 1 -- 172.21.15.19:0/238206046 wait complete. 2023-10-03T10:20:57.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.880+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdcdc125bb0 con 0x7fdcdc09e000 2023-10-03T10:20:57.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.880+0000 7fdcd2ffd700 1 -- 172.21.15.19:0/4061046210 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdccc0036a0 con 0x7fdcdc09e000 2023-10-03T10:20:57.903 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:57.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 msgr2=0x7fdcdc1c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fdccc00ebe0 tx=0x7fdccc00eef0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 shutdown_connections 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fdcdc09e410 0x7fdcdc1c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcdc09d6f0 0x7fdcdc1c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 --2- 172.21.15.19:0/4061046210 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fdcdc09e000 0x7fdcdc1c8970 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 >> 172.21.15.19:0/4061046210 conn(0x7fdcdc066f50 msgr2=0x7fdcdc070f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 shutdown_connections 2023-10-03T10:20:57.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:57.883+0000 7fdce4316700 1 -- 172.21.15.19:0/4061046210 wait complete. 2023-10-03T10:20:57.905 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:20:58.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:20:58.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:20:58.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:20:58.906 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:20:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.974+0000 7f57d5b9c700 1 Processor -- start 2023-10-03T10:20:58.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.974+0000 7f57d5b9c700 1 -- start start 2023-10-03T10:20:58.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57d5b9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d0135910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:58.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57d5b9c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:58.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57d5b9c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d009f130 con 0x7f57d009d6f0 2023-10-03T10:20:58.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57d5b9c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d009f520 con 0x7f57d0135e50 2023-10-03T10:20:58.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57d5b9c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d009e930 con 0x7f57d009e1d0 2023-10-03T10:20:58.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:58.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59568/0 (socket says 172.21.15.19:59568) 2023-10-03T10:20:58.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.975+0000 7f57cffff700 1 -- 172.21.15.19:0/2765001046 learned_addr learned my addr 172.21.15.19:0/2765001046 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:58.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57ceffd700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d0135910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57cffff700 1 -- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 msgr2=0x7f57d0135910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57cffff700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d0135910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:58.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57cffff700 1 -- 172.21.15.19:0/2765001046 >> v1:172.21.15.19:6789/0 conn(0x7f57d009d6f0 legacy=0x7f57d009dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57cffff700 1 -- 172.21.15.19:0/2765001046 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d009b2d0 con 0x7f57d0135e50 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57ceffd700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57cffff700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f57c800d180 tx=0x7f57c800d490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98073977a483bc server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57ce7fc700 1 -- 172.21.15.19:0/2765001046 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8010070 con 0x7f57d0135e50 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57ce7fc700 1 -- 172.21.15.19:0/2765001046 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c800dd00 con 0x7f57d0135e50 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.976+0000 7f57ce7fc700 1 -- 172.21.15.19:0/2765001046 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800b310 con 0x7f57d0135e50 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 -- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 msgr2=0x7f57d0138230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f57c800d180 tx=0x7f57c800d490 comp rx=0 tx=0).stop 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 -- 172.21.15.19:0/2765001046 shutdown_connections 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0138230 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:58.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/2765001046 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d0135910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:58.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.977+0000 7f57d5b9c700 1 -- 172.21.15.19:0/2765001046 >> 172.21.15.19:0/2765001046 conn(0x7f57d0066f50 msgr2=0x7f57d009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:58.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.978+0000 7f57d5b9c700 1 -- 172.21.15.19:0/2765001046 shutdown_connections 2023-10-03T10:20:58.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.978+0000 7f57d5b9c700 1 -- 172.21.15.19:0/2765001046 wait complete. 2023-10-03T10:20:58.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 Processor -- start 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 -- start start 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57d009d6f0 0x7f57d0119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d01199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d011c900 con 0x7f57d009d6f0 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d012fb50 con 0x7f57d0135e50 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.979+0000 7f57d5b9c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00a1d00 con 0x7f57d009e1d0 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59574/0 (socket says 172.21.15.19:59574) 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 -- 172.21.15.19:0/1403689281 learned_addr learned my addr 172.21.15.19:0/1403689281 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:58.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cf7fe700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57d009d6f0 0x7f57d0119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 -- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 msgr2=0x7f57d01199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d01199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 -- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57d009d6f0 msgr2=0x7f57d0119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57d009d6f0 0x7f57d0119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 -- 172.21.15.19:0/1403689281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00094a0 con 0x7f57d0135e50 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.980+0000 7f57cffff700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f57c8004000 tx=0x7f57c8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.981+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8009a10 con 0x7f57d0135e50 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.981+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8009bb0 con 0x7f57d0135e50 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.981+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8004030 con 0x7f57d0135e50 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.981+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c800bd40 con 0x7f57d0135e50 2023-10-03T10:20:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.981+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d011c550 con 0x7f57d0135e50 2023-10-03T10:20:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.982+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f57c8004190 con 0x7f57d0135e50 2023-10-03T10:20:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.982+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f57c8043060 con 0x7f57d0135e50 2023-10-03T10:20:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.982+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d011c740 con 0x7f57d0135e50 2023-10-03T10:20:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:58.987+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f57c8019080 con 0x7f57d0135e50 2023-10-03T10:20:59.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.001+0000 7ff9f26fb700 1 Processor -- start 2023-10-03T10:20:59.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.001+0000 7ff9f26fb700 1 -- start start 2023-10-03T10:20:59.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f26fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f26fb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ff9ec09e410 0x7ff9ec134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f26fb700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec09b120 con 0x7ff9ec09e000 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f26fb700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec06b460 con 0x7ff9ec09e410 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f26fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec09a7e0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59582/0 (socket says 172.21.15.19:59582) 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9eb7fe700 1 --1- 172.21.15.19:0/349147800 >> v1:172.21.15.19:6789/0 conn(0x7ff9ec09e000 0x7ff9ec1339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34156/0 (socket says 172.21.15.19:34156) 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9f0c98700 1 --2- 172.21.15.19:0/349147800 >> v2:172.21.15.19:3300/0 conn(0x7ff9ec09e410 0x7ff9ec134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.002+0000 7ff9ebfff700 1 -- 172.21.15.19:0/349147800 learned_addr learned my addr 172.21.15.19:0/349147800 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9ebfff700 1 -- 172.21.15.19:0/349147800 >> v2:172.21.15.19:3300/0 conn(0x7ff9ec09e410 msgr2=0x7ff9ec134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9ebfff700 1 --2- 172.21.15.19:0/349147800 >> v2:172.21.15.19:3300/0 conn(0x7ff9ec09e410 0x7ff9ec134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9eaffd700 1 -- 172.21.15.19:0/349147800 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193177581 0 0) 0x7ff9ec09b120 con 0x7ff9ec09e000 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9ebfff700 1 -- 172.21.15.19:0/349147800 >> v1:172.21.15.19:6789/0 conn(0x7ff9ec09e000 legacy=0x7ff9ec1339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9ebfff700 1 -- 172.21.15.19:0/349147800 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec09a500 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9ebfff700 1 --2- 172.21.15.19:0/349147800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009920 tx=0x7ff9dc009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=414c785101ad83fe server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9eaffd700 1 -- 172.21.15.19:0/349147800 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc011830 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9eaffd700 1 -- 172.21.15.19:0/349147800 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc011990 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.003+0000 7ff9eaffd700 1 -- 172.21.15.19:0/349147800 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc011d20 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 -- 172.21.15.19:0/349147800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 msgr2=0x7ff9ec09dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/349147800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009920 tx=0x7ff9dc009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:59.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 -- 172.21.15.19:0/349147800 shutdown_connections 2023-10-03T10:20:59.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/349147800 >> v2:172.21.15.19:3300/0 conn(0x7ff9ec09e410 0x7ff9ec134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/349147800 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09d6f0 0x7ff9ec09dac0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 -- 172.21.15.19:0/349147800 >> 172.21.15.19:0/349147800 conn(0x7ff9ec066f50 msgr2=0x7ff9ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 -- 172.21.15.19:0/349147800 shutdown_connections 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.004+0000 7ff9f26fb700 1 -- 172.21.15.19:0/349147800 wait complete. 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.005+0000 7ff9f26fb700 1 Processor -- start 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.005+0000 7ff9f26fb700 1 -- start start 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9ec09e000 0x7ff9ec1a6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09e410 0x7ff9ec1a6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1aa220 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1a7950 con 0x7ff9ec09e410 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f26fb700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec1a7f70 con 0x7ff9ec09e000 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35100/0 (socket says 172.21.15.19:35100) 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9ebfff700 1 -- 172.21.15.19:0/128057548 learned_addr learned my addr 172.21.15.19:0/128057548 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:59.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9eb7fe700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9ec09e000 0x7ff9ec1a6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.006+0000 7ff9f0c98700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09e410 0x7ff9ec1a6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 -- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9ec09e000 msgr2=0x7ff9ec1a6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9ec09e000 0x7ff9ec1a6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 -- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09e410 msgr2=0x7ff9ec1a6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09e410 0x7ff9ec1a6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 -- 172.21.15.19:0/128057548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009550 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9ebfff700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009c70 tx=0x7ff9dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004240 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc01f070 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0045c0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec1a8ba0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.007+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec1a8ff0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.008+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff9dc021030 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.008+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff9dc0408f0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.008+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec09c710 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.014+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff9dc015080 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.097+0000 7fe19d5a0700 1 Processor -- start 2023-10-03T10:20:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.097+0000 7fe19d5a0700 1 -- start start 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe19d5a0700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe19809f410 0x7fe198136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe19d5a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 0x7fe1981393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe19d5a0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe198070940 con 0x7fe19809e930 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe19d5a0700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe19806fd60 con 0x7fe19809f410 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe19d5a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe19806fa80 con 0x7fe198136fe0 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe196ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe19809e930 0x7fe19809ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34158/0 (socket says 172.21.15.19:34158) 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe196ffd700 1 -- 172.21.15.19:0/4011475653 learned_addr learned my addr 172.21.15.19:0/4011475653 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe1977fe700 1 --2- 172.21.15.19:0/4011475653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 0x7fe1981393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.098+0000 7fe1967fc700 1 --2- 172.21.15.19:0/4011475653 >> v2:172.21.15.19:3300/0 conn(0x7fe19809f410 0x7fe198136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe1977fe700 1 -- 172.21.15.19:0/4011475653 >> v2:172.21.15.19:3300/0 conn(0x7fe19809f410 msgr2=0x7fe198136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe1977fe700 1 --2- 172.21.15.19:0/4011475653 >> v2:172.21.15.19:3300/0 conn(0x7fe19809f410 0x7fe198136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe1977fe700 1 -- 172.21.15.19:0/4011475653 >> v1:172.21.15.19:6789/0 conn(0x7fe19809e930 legacy=0x7fe19809ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe195ffb700 1 -- 172.21.15.19:0/4011475653 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176129092 0 0) 0x7fe198070940 con 0x7fe19809e930 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe1977fe700 1 -- 172.21.15.19:0/4011475653 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19809fb60 con 0x7fe198136fe0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe1977fe700 1 --2- 172.21.15.19:0/4011475653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 0x7fe1981393c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7214053f38a5d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe195ffb700 1 -- 172.21.15.19:0/4011475653 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000e070 con 0x7fe198136fe0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe195ffb700 1 -- 172.21.15.19:0/4011475653 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000bb20 con 0x7fe198136fe0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.099+0000 7fe195ffb700 1 -- 172.21.15.19:0/4011475653 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190012430 con 0x7fe198136fe0 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 -- 172.21.15.19:0/4011475653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 msgr2=0x7fe1981393c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/4011475653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 0x7fe1981393c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fe190009d90 tx=0x7fe19000b330 comp rx=0 tx=0).stop 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 -- 172.21.15.19:0/4011475653 shutdown_connections 2023-10-03T10:20:59.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/4011475653 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe198136fe0 0x7fe1981393c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/4011475653 >> v2:172.21.15.19:3300/0 conn(0x7fe19809f410 0x7fe198136aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.100+0000 7fe19d5a0700 1 -- 172.21.15.19:0/4011475653 >> 172.21.15.19:0/4011475653 conn(0x7fe1980a4210 msgr2=0x7fe1980a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.101+0000 7fe19d5a0700 1 -- 172.21.15.19:0/4011475653 shutdown_connections 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.101+0000 7fe19d5a0700 1 -- 172.21.15.19:0/4011475653 wait complete. 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 Processor -- start 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 -- start start 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe19809e930 0x7fe19806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe198136fe0 0x7fe19806c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198121e10 con 0x7fe198136fe0 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe198071d20 con 0x7fe19809e930 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe19d5a0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe19806d5d0 con 0x7fe19809f410 2023-10-03T10:20:59.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe1967fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe1967fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50000/0 (socket says 172.21.15.19:50000) 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.102+0000 7fe1967fc700 1 -- 172.21.15.19:0/2090272652 learned_addr learned my addr 172.21.15.19:0/2090272652 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1977fe700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe198136fe0 0x7fe19806c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe196ffd700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe19809e930 0x7fe19806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 -- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe19809e930 msgr2=0x7fe19806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe19809e930 0x7fe19806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 -- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe198136fe0 msgr2=0x7fe19806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe198136fe0 0x7fe19806c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 -- 172.21.15.19:0/2090272652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009a70 con 0x7fe19809f410 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe1967fc700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e9e0 tx=0x7fe18c00ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c009710 con 0x7fe19809f410 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c00c850 con 0x7fe19809f410 2023-10-03T10:20:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe19809de30 con 0x7fe19809f410 2023-10-03T10:20:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.103+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c00cbc0 con 0x7fe19809f410 2023-10-03T10:20:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.104+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1981220f0 con 0x7fe19809f410 2023-10-03T10:20:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.104+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe18c00cd20 con 0x7fe19809f410 2023-10-03T10:20:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.105+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe18c03fb60 con 0x7fe19809f410 2023-10-03T10:20:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.105+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198121f50 con 0x7fe19809f410 2023-10-03T10:20:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.110+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe198121f50 con 0x7fe19809f410 2023-10-03T10:20:59.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.140+0000 7f36dda1f700 1 Processor -- start 2023-10-03T10:20:59.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.140+0000 7f36dda1f700 1 -- start start 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f36d809e410 0x7f36d8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36d806b460 con 0x7f36d809e410 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d809b120 con 0x7f36d809d6f0 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36dda1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d809a7e0 con 0x7f36d809e000 2023-10-03T10:20:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59616/0 (socket says 172.21.15.19:59616) 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3743440385 learned_addr learned my addr 172.21.15.19:0/3743440385 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.141+0000 7f36d67fc700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d77fe700 1 --2- 172.21.15.19:0/3743440385 >> v2:172.21.15.19:3300/0 conn(0x7f36d809e410 0x7f36d8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 msgr2=0x7f36d81339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3743440385 >> v2:172.21.15.19:3300/0 conn(0x7f36d809e410 msgr2=0x7f36d8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3743440385 >> v2:172.21.15.19:3300/0 conn(0x7f36d809e410 0x7f36d8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3743440385 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d809a500 con 0x7f36d809d6f0 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009920 tx=0x7f36c8009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c40c1338d95f47d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d5ffb700 1 -- 172.21.15.19:0/3743440385 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011830 con 0x7f36d809d6f0 2023-10-03T10:20:59.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d5ffb700 1 -- 172.21.15.19:0/3743440385 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c8011990 con 0x7f36d809d6f0 2023-10-03T10:20:59.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.142+0000 7f36d5ffb700 1 -- 172.21.15.19:0/3743440385 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8011d20 con 0x7f36d809d6f0 2023-10-03T10:20:59.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 -- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 msgr2=0x7f36d809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.145 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009920 tx=0x7f36c8009c30 comp rx=0 tx=0).stop 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 -- 172.21.15.19:0/3743440385 shutdown_connections 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d809dac0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3743440385 >> v2:172.21.15.19:3300/0 conn(0x7f36d809e410 0x7f36d8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3743440385 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 -- 172.21.15.19:0/3743440385 >> 172.21.15.19:0/3743440385 conn(0x7f36d8066f50 msgr2=0x7f36d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 -- 172.21.15.19:0/3743440385 shutdown_connections 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.143+0000 7f36dda1f700 1 -- 172.21.15.19:0/3743440385 wait complete. 2023-10-03T10:20:59.146 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.144+0000 7f36dda1f700 1 Processor -- start 2023-10-03T10:20:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 -- start start 2023-10-03T10:20:59.147 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36d809e410 0x7f36d81ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36d809c710 con 0x7f36d809e410 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36d80a2140 con 0x7f36d809d6f0 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36dda1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f36d81aec80 con 0x7f36d809e000 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36d6ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59628/0 (socket says 172.21.15.19:59628) 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3181323784 learned_addr learned my addr 172.21.15.19:0/3181323784 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36d77fe700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36d809e410 0x7f36d81ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.145+0000 7f36d67fc700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:20:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 msgr2=0x7f36d81abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36d809e410 msgr2=0x7f36d81ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36d809e410 0x7f36d81ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 -- 172.21.15.19:0/3181323784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36c8009550 con 0x7f36d809d6f0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36d6ffd700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f36c8000c00 tx=0x7f36c8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c8004300 con 0x7f36d809d6f0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36c801f070 con 0x7f36d809d6f0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36d81af210 con 0x7f36d809d6f0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36d81afbf0 con 0x7f36d809d6f0 2023-10-03T10:20:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.146+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36c80036a0 con 0x7f36d809d6f0 2023-10-03T10:20:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.147+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36d8074ea0 con 0x7f36d809d6f0 2023-10-03T10:20:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.148+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f36c8021030 con 0x7f36d809d6f0 2023-10-03T10:20:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.148+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f36c8040ea0 con 0x7f36d809d6f0 2023-10-03T10:20:59.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.157+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f36c80239c0 con 0x7f36d809d6f0 2023-10-03T10:20:59.224 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.224+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f57d0074ea0 con 0x7f57d0135e50 2023-10-03T10:20:59.225 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.224+0000 7f57c7fff700 1 -- 172.21.15.19:0/1403689281 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f57c8027980 con 0x7f57d0135e50 2023-10-03T10:20:59.225 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.226+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 msgr2=0x7f57d0119f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f57c8004000 tx=0x7f57c8004ad0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 shutdown_connections 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f57d0135e50 0x7f57d0119f00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f57d009d6f0 0x7f57d0119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 --2- 172.21.15.19:0/1403689281 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f57d009e1d0 0x7f57d01199c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 >> 172.21.15.19:0/1403689281 conn(0x7f57d0066f50 msgr2=0x7f57d00a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 shutdown_connections 2023-10-03T10:20:59.228 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.227+0000 7f57d5b9c700 1 -- 172.21.15.19:0/1403689281 wait complete. 2023-10-03T10:20:59.242 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:20:59.261 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.261+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff9ec074ea0 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.261+0000 7ff9e8ff9700 1 -- 172.21.15.19:0/128057548 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff9dc01a450 con 0x7ff9ec09d6f0 2023-10-03T10:20:59.262 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 msgr2=0x7ff9ec1a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009c70 tx=0x7ff9dc004750 comp rx=0 tx=0).stop 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 shutdown_connections 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff9ec09e410 0x7ff9ec1a6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9ec09d6f0 0x7ff9ec1a5de0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 --2- 172.21.15.19:0/128057548 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff9ec09e000 0x7ff9ec1a6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 >> 172.21.15.19:0/128057548 conn(0x7ff9ec066f50 msgr2=0x7ff9ec1badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 shutdown_connections 2023-10-03T10:20:59.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.264+0000 7ff9f26fb700 1 -- 172.21.15.19:0/128057548 wait complete. 2023-10-03T10:20:59.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:20:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.321+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe198121f50 con 0x7fe19809f410 2023-10-03T10:20:59.322 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.321+0000 7fe17f7fe700 1 -- 172.21.15.19:0/2090272652 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe198121f50 con 0x7fe19809f410 2023-10-03T10:20:59.322 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 msgr2=0x7fe19806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00e9e0 tx=0x7fe18c00ecf0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 shutdown_connections 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe198136fe0 0x7fe19806c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe19809e930 0x7fe19806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.325 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 --2- 172.21.15.19:0/2090272652 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe19809f410 0x7fe19806bdf0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 >> 172.21.15.19:0/2090272652 conn(0x7fe1980a4210 msgr2=0x7fe1980a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 shutdown_connections 2023-10-03T10:20:59.326 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.324+0000 7fe19d5a0700 1 -- 172.21.15.19:0/2090272652 wait complete. 2023-10-03T10:20:59.338 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:20:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.366+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36d806c360 con 0x7f36d809d6f0 2023-10-03T10:20:59.367 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.366+0000 7f36bffff700 1 -- 172.21.15.19:0/3181323784 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f36c8015070 con 0x7f36d809d6f0 2023-10-03T10:20:59.367 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 msgr2=0x7f36d81aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f36c8000c00 tx=0x7f36c8004750 comp rx=0 tx=0).stop 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 shutdown_connections 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f36d809e410 0x7f36d81ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f36d809d6f0 0x7f36d81aba60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 --2- 172.21.15.19:0/3181323784 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f36d809e000 0x7f36d81abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 >> 172.21.15.19:0/3181323784 conn(0x7f36d8066f50 msgr2=0x7f36d806f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:20:59.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 shutdown_connections 2023-10-03T10:20:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:20:59.369+0000 7f36dda1f700 1 -- 172.21.15.19:0/3181323784 wait complete. 2023-10-03T10:20:59.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:00.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:00.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:00.948 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:00.949 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:01.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.103+0000 7f669cdb9700 1 Processor -- start 2023-10-03T10:21:01.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.103+0000 7f65ce266700 1 Processor -- start 2023-10-03T10:21:01.104 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.103+0000 7f65ce266700 1 -- start start 2023-10-03T10:21:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.103+0000 7f669cdb9700 1 -- start start 2023-10-03T10:21:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65ce266700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 0x7f65c8133c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65ce266700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 0x7f65c809de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.105 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65ce266700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c806f720 con 0x7f65c809e390 2023-10-03T10:21:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65ce266700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8070c80 con 0x7f65c81338c0 2023-10-03T10:21:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65ce266700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65c806fce0 con 0x7f65c81341d0 2023-10-03T10:21:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f66981338a0 0x7f6698133c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.106 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 0x7f669809e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 0x7f669813a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669806fef0 con 0x7f66981338a0 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669806ef30 con 0x7f669809e760 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f669cdb9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66981334b0 con 0x7f669809de50 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65c77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 0x7f65c809de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65c77fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 0x7f65c809de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50032/0 (socket says 172.21.15.19:50032) 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65c77fe700 1 -- 172.21.15.19:0/3676671914 learned_addr learned my addr 172.21.15.19:0/3676671914 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.104+0000 7f65c7fff700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 0x7f65c8133c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6695d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 0x7f669809e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6695d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 0x7f669809e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50040/0 (socket says 172.21.15.19:50040) 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6695d9b700 1 -- 172.21.15.19:0/1329834520 learned_addr learned my addr 172.21.15.19:0/1329834520 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 0x7f669813a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c7fff700 1 -- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 msgr2=0x7f65c809de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c7fff700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 0x7f65c809de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c7fff700 1 -- 172.21.15.19:0/3676671914 >> v1:172.21.15.19:6789/0 conn(0x7f65c809e390 legacy=0x7f65c813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c7fff700 1 -- 172.21.15.19:0/3676671914 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c81336a0 con 0x7f65c81338c0 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 -- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 msgr2=0x7f669809e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 0x7f669809e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 -- 172.21.15.19:0/1329834520 >> v2:172.21.15.19:3300/0 conn(0x7f66981338a0 msgr2=0x7f6698133c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 --2- 172.21.15.19:0/1329834520 >> v2:172.21.15.19:3300/0 conn(0x7f66981338a0 0x7f6698133c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 -- 172.21.15.19:0/1329834520 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669806fc30 con 0x7f669809e760 2023-10-03T10:21:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c7fff700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 0x7f65c8133c90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009870 tx=0x7f65b8009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c70ca48601db7d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f6696d9d700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 0x7f669813a730 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550baa0c0d64a94d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.105+0000 7f65c6ffd700 1 -- 172.21.15.19:0/3676671914 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8004230 con 0x7f65c81338c0 2023-10-03T10:21:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65c6ffd700 1 -- 172.21.15.19:0/3676671914 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b8004390 con 0x7f65c81338c0 2023-10-03T10:21:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65c6ffd700 1 -- 172.21.15.19:0/3676671914 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b80036a0 con 0x7f65c81338c0 2023-10-03T10:21:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f669559a700 1 -- 172.21.15.19:0/1329834520 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669000e070 con 0x7f669809e760 2023-10-03T10:21:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f669559a700 1 -- 172.21.15.19:0/1329834520 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669000bb20 con 0x7f669809e760 2023-10-03T10:21:01.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f669559a700 1 -- 172.21.15.19:0/1329834520 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6690012430 con 0x7f669809e760 2023-10-03T10:21:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 -- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 msgr2=0x7f65c8133c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 0x7f65c8133c90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f65b8009870 tx=0x7f65b8009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 -- 172.21.15.19:0/3676671914 shutdown_connections 2023-10-03T10:21:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81338c0 0x7f65c8133c90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 --2- 172.21.15.19:0/3676671914 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81341d0 0x7f65c809de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 -- 172.21.15.19:0/3676671914 >> 172.21.15.19:0/3676671914 conn(0x7f65c80a2aa0 msgr2=0x7f65c80a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.106+0000 7f65ce266700 1 -- 172.21.15.19:0/3676671914 shutdown_connections 2023-10-03T10:21:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f65ce266700 1 -- 172.21.15.19:0/3676671914 wait complete. 2023-10-03T10:21:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 -- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 msgr2=0x7f669813a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 0x7f669813a730 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f6690009d90 tx=0x7f669000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 -- 172.21.15.19:0/1329834520 shutdown_connections 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809e760 0x7f669813a730 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 --2- 172.21.15.19:0/1329834520 >> v2:172.21.15.19:3300/0 conn(0x7f66981338a0 0x7f6698133c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 --2- 172.21.15.19:0/1329834520 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809de50 0x7f669809e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.107+0000 7f669cdb9700 1 -- 172.21.15.19:0/1329834520 >> 172.21.15.19:0/1329834520 conn(0x7f66980a2aa0 msgr2=0x7f66980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.108+0000 7f669cdb9700 1 -- 172.21.15.19:0/1329834520 shutdown_connections 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.108+0000 7f669cdb9700 1 -- 172.21.15.19:0/1329834520 wait complete. 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.108+0000 7f65ce266700 1 Processor -- start 2023-10-03T10:21:01.114 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.108+0000 7f65ce266700 1 -- start start 2023-10-03T10:21:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f669cdb9700 1 Processor -- start 2023-10-03T10:21:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.115 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81338c0 0x7f65c81201b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 0x7f65c81206f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c81210d0 con 0x7f65c809e390 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8123790 con 0x7f65c81341d0 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65ce266700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8121920 con 0x7f65c81338c0 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65c7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65c7fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35146/0 (socket says 172.21.15.19:35146) 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65c7fff700 1 -- 172.21.15.19:0/297548724 learned_addr learned my addr 172.21.15.19:0/297548724 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65c77fe700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81338c0 0x7f65c81201b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.116 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f669cdb9700 1 -- start start 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.109+0000 7f65cc803700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 0x7f65c81206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 -- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81338c0 msgr2=0x7f65c81201b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81338c0 0x7f65c81201b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 -- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 msgr2=0x7f65c81206f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 0x7f65c81206f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.117 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 -- 172.21.15.19:0/297548724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b80094a0 con 0x7f65c809e390 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65cc803700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 0x7f65c81206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c7fff700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f65b80090b0 tx=0x7f65b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809de50 0x7f669811ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 0x7f669811f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 0x7f669811f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66981223e0 con 0x7f66981338a0 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66981225c0 con 0x7f669809de50 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f669cdb9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66981231a0 con 0x7f669809e760 2023-10-03T10:21:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6695d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 0x7f669811f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 0x7f669811f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6695d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 0x7f669811f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50054/0 (socket says 172.21.15.19:50054) 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6695d9b700 1 -- 172.21.15.19:0/2470098955 learned_addr learned my addr 172.21.15.19:0/2470098955 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8011630 con 0x7f65c809e390 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b801e070 con 0x7f65c809e390 2023-10-03T10:21:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b80119f0 con 0x7f65c809e390 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c806f960 con 0x7f65c809e390 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 -- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 msgr2=0x7f669811f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 0x7f669811f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 -- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809de50 msgr2=0x7f669811ebb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809de50 0x7f669811ebb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.110+0000 7f6696d9d700 1 -- 172.21.15.19:0/2470098955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6690009a70 con 0x7f66981338a0 2023-10-03T10:21:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c81231f0 con 0x7f65c809e390 2023-10-03T10:21:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f6696d9d700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 0x7f669811f630 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f6690016000 tx=0x7f6690004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900048b0 con 0x7f66981338a0 2023-10-03T10:21:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6690020070 con 0x7f66981338a0 2023-10-03T10:21:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.111+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66900276c0 con 0x7f66981338a0 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.112+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f65b8011b50 con 0x7f65c809e390 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.112+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f65b8040810 con 0x7f65c809e390 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.112+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c8130ec0 con 0x7f65c809e390 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.112+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66980a1020 con 0x7f66981338a0 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.112+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6698120640 con 0x7f66981338a0 2023-10-03T10:21:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.113+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6698122240 con 0x7f66981338a0 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.115+0000 7ffb53095700 1 Processor -- start 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.115+0000 7ffb53095700 1 -- start start 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb53095700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 0x7ffb4c09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb53095700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb53095700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4c09b120 con 0x7ffb4c09e410 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb53095700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb4c06b460 con 0x7ffb4c09d6f0 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb53095700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c09a7e0 con 0x7ffb4c09e000 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.124 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb50e31700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 0x7ffb4c09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50062/0 (socket says 172.21.15.19:50062) 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb50e31700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 0x7ffb4c09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35160/0 (socket says 172.21.15.19:35160) 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb4bfff700 1 -- 172.21.15.19:0/604714811 learned_addr learned my addr 172.21.15.19:0/604714811 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.116+0000 7ffb4bfff700 1 -- 172.21.15.19:0/604714811 >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 msgr2=0x7ffb4c09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7ffb4bfff700 1 --2- 172.21.15.19:0/604714811 >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 0x7ffb4c09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7ffb4bfff700 1 -- 172.21.15.19:0/604714811 >> v1:172.21.15.19:6789/0 conn(0x7ffb4c09e410 legacy=0x7ffb4c133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7ffb4bfff700 1 -- 172.21.15.19:0/604714811 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4c09a500 con 0x7ffb4c09e000 2023-10-03T10:21:01.125 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7f45de841700 1 Processor -- start 2023-10-03T10:21:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7f45de841700 1 -- start start 2023-10-03T10:21:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7ffb4bfff700 1 --2- 172.21.15.19:0/604714811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009920 tx=0x7ffb40009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf2d78b2e823250 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7ffb4b7fe700 1 -- 172.21.15.19:0/604714811 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011830 con 0x7ffb4c09e000 2023-10-03T10:21:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7ffb4b7fe700 1 -- 172.21.15.19:0/604714811 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb40011990 con 0x7ffb4c09e000 2023-10-03T10:21:01.126 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7ffb4b7fe700 1 -- 172.21.15.19:0/604714811 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40011d20 con 0x7ffb4c09e000 2023-10-03T10:21:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7f45de841700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f45d81339f0 0x7f45d8133dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.117+0000 7f45de841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d811d4a0 0x7f45d809de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45de841700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45d809b120 con 0x7f45d8134300 2023-10-03T10:21:01.127 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45de841700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45d806b460 con 0x7f45d81339f0 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45de841700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45d809a7e0 con 0x7f45d811d4a0 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f45d8134300 0x7f45d809d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34170/0 (socket says 172.21.15.19:34170) 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d77fe700 1 -- 172.21.15.19:0/2261886560 learned_addr learned my addr 172.21.15.19:0/2261886560 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 --2- 172.21.15.19:0/2261886560 >> v2:172.21.15.19:3300/0 conn(0x7f45d81339f0 0x7f45d8133dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45dcdde700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d811d4a0 0x7f45d809de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 -- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d811d4a0 msgr2=0x7f45d809de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d811d4a0 0x7f45d809de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 -- 172.21.15.19:0/2261886560 >> v1:172.21.15.19:6789/0 conn(0x7f45d8134300 legacy=0x7f45d809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 -- 172.21.15.19:0/2261886560 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d809a500 con 0x7f45d81339f0 2023-10-03T10:21:01.128 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.118+0000 7f45d7fff700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d81339f0 0x7f45d8133dc0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009dc0 tx=0x7f45d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5dd84b7ccf60176 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 -- 172.21.15.19:0/604714811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 msgr2=0x7ffb4c1339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 --2- 172.21.15.19:0/604714811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009920 tx=0x7ffb40009c30 comp rx=0 tx=0).stop 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 -- 172.21.15.19:0/604714811 shutdown_connections 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 --2- 172.21.15.19:0/604714811 >> v2:172.21.15.19:3300/0 conn(0x7ffb4c09d6f0 0x7ffb4c09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 --2- 172.21.15.19:0/604714811 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e000 0x7ffb4c1339f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.129 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 -- 172.21.15.19:0/604714811 >> 172.21.15.19:0/604714811 conn(0x7ffb4c066f50 msgr2=0x7ffb4c09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 -- 172.21.15.19:0/604714811 shutdown_connections 2023-10-03T10:21:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.119+0000 7ffb53095700 1 -- 172.21.15.19:0/604714811 wait complete. 2023-10-03T10:21:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.120+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f65c8130ec0 con 0x7f65c809e390 2023-10-03T10:21:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.120+0000 7ffb53095700 1 Processor -- start 2023-10-03T10:21:01.130 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.120+0000 7ffb53095700 1 -- start start 2023-10-03T10:21:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.120+0000 7f45d6ffd700 1 -- 172.21.15.19:0/2261886560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000e070 con 0x7f45d81339f0 2023-10-03T10:21:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f6690031480 con 0x7f66981338a0 2023-10-03T10:21:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7f45d6ffd700 1 -- 172.21.15.19:0/2261886560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d000bae0 con 0x7f45d81339f0 2023-10-03T10:21:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7f45d6ffd700 1 -- 172.21.15.19:0/2261886560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d000be90 con 0x7f45d81339f0 2023-10-03T10:21:01.131 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f6690022070 con 0x7f66981338a0 2023-10-03T10:21:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4c09d6f0 0x7ffb4c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e410 0x7ffb4c1a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.132 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1a7340 con 0x7ffb4c09d6f0 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1a7ac0 con 0x7ffb4c09e000 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb53095700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4c1a80e0 con 0x7ffb4c09e410 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb4bfff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59656/0 (socket says 172.21.15.19:59656) 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.121+0000 7ffb4bfff700 1 -- 172.21.15.19:0/1760830763 learned_addr learned my addr 172.21.15.19:0/1760830763 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 -- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d81339f0 msgr2=0x7f45d8133dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.133 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d81339f0 0x7f45d8133dc0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009dc0 tx=0x7f45d000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 -- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e410 msgr2=0x7ffb4c1a6930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-03T10:21:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e410 0x7ffb4c1a6930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 -- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4c09d6f0 msgr2=0x7ffb4c1a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4c09d6f0 0x7ffb4c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.134 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 -- 172.21.15.19:0/1760830763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb40009550 con 0x7ffb4c09e000 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 -- 172.21.15.19:0/2261886560 shutdown_connections 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d811d4a0 0x7f45d809de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 --2- 172.21.15.19:0/2261886560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d81339f0 0x7f45d8133dc0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 -- 172.21.15.19:0/2261886560 >> 172.21.15.19:0/2261886560 conn(0x7f45d8066f50 msgr2=0x7f45d809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 -- 172.21.15.19:0/2261886560 shutdown_connections 2023-10-03T10:21:01.135 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7f45de841700 1 -- 172.21.15.19:0/2261886560 wait complete. 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.122+0000 7ffb4bfff700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09a920 tx=0x7ffb40004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40004590 con 0x7ffb4c09e000 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb400036a0 con 0x7ffb4c09e000 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40003a50 con 0x7ffb4c09e000 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4c1a96f0 con 0x7ffb4c09e000 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7f45de841700 1 Processor -- start 2023-10-03T10:21:01.136 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7f45de841700 1 -- start start 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.123+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4c0a33a0 con 0x7ffb4c09e000 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 0x7f45d81cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 0x7f45d81cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d8134300 0x7f45d811d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45d81206d0 con 0x7f45d8134300 2023-10-03T10:21:01.137 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d811e950 con 0x7f45d811d4a0 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45de841700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45d809e580 con 0x7f45d81339f0 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45d7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 0x7f45d81cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45d7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 0x7f45d81cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59672/0 (socket says 172.21.15.19:59672) 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45d7fff700 1 -- 172.21.15.19:0/4000899042 learned_addr learned my addr 172.21.15.19:0/4000899042 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45d77fe700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 0x7f45d81cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7f45dcdde700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d8134300 0x7f45d811d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.124+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4c074ea0 con 0x7ffb4c09e000 2023-10-03T10:21:01.138 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7f45d77fe700 1 -- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 msgr2=0x7f45d81cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7f45d77fe700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 0x7f45d81cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7f45d77fe700 1 -- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d8134300 msgr2=0x7f45d811d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7f45d77fe700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d8134300 0x7f45d811d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7f45d77fe700 1 -- 172.21.15.19:0/4000899042 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0009a70 con 0x7f45d81339f0 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb40003bb0 con 0x7ffb4c09e000 2023-10-03T10:21:01.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.125+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb40041140 con 0x7ffb4c09e000 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45d77fe700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 0x7f45d81cce50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c530 tx=0x7f45c800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c800cea0 con 0x7f45d81339f0 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45c8005d70 con 0x7f45d81339f0 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45d809c710 con 0x7f45d81339f0 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45d8132870 con 0x7f45d81339f0 2023-10-03T10:21:01.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.126+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45c80072d0 con 0x7f45d81339f0 2023-10-03T10:21:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.127+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f6690025790 con 0x7f66981338a0 2023-10-03T10:21:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.127+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f45c8007430 con 0x7f45d81339f0 2023-10-03T10:21:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.127+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f45c803e9a0 con 0x7f45d81339f0 2023-10-03T10:21:01.141 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.129+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b80052e0 con 0x7f45d81339f0 2023-10-03T10:21:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.131+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb4001a420 con 0x7ffb4c09e000 2023-10-03T10:21:01.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.134+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f45c8017080 con 0x7f45d81339f0 2023-10-03T10:21:01.328 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.328+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65c8130ec0 con 0x7f65c809e390 2023-10-03T10:21:01.329 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.328+0000 7f65c4ff9700 1 -- 172.21.15.19:0/297548724 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f65c8130ec0 con 0x7f65c809e390 2023-10-03T10:21:01.329 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 msgr2=0x7f65c811fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f65b80090b0 tx=0x7f65b8004750 comp rx=0 tx=0).stop 2023-10-03T10:21:01.331 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 shutdown_connections 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f65c81341d0 0x7f65c81206f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f65c809e390 0x7f65c811fc70 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 --2- 172.21.15.19:0/297548724 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f65c81338c0 0x7f65c81201b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 >> 172.21.15.19:0/297548724 conn(0x7f65c80a2aa0 msgr2=0x7f65c809f160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 shutdown_connections 2023-10-03T10:21:01.332 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.330+0000 7f65ce266700 1 -- 172.21.15.19:0/297548724 wait complete. 2023-10-03T10:21:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.335+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6698122240 con 0x7f66981338a0 2023-10-03T10:21:01.336 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.336+0000 7f6686ffd700 1 -- 172.21.15.19:0/2470098955 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6698122240 con 0x7f66981338a0 2023-10-03T10:21:01.336 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:01.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 msgr2=0x7f669811f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 0x7f669811f630 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f6690016000 tx=0x7f6690004ad0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.339 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 shutdown_connections 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f66981338a0 0x7f669811f630 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f669809de50 0x7f669811ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 --2- 172.21.15.19:0/2470098955 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f669809e760 0x7f669811f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 >> 172.21.15.19:0/2470098955 conn(0x7f66980a2aa0 msgr2=0x7f669809ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 shutdown_connections 2023-10-03T10:21:01.340 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.338+0000 7f669cdb9700 1 -- 172.21.15.19:0/2470098955 wait complete. 2023-10-03T10:21:01.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:01.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:01.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.355+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ffb4c06c360 con 0x7ffb4c09e000 2023-10-03T10:21:01.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.356+0000 7ffb497fa700 1 -- 172.21.15.19:0/1760830763 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb40033070 con 0x7ffb4c09e000 2023-10-03T10:21:01.357 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:01.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 msgr2=0x7ffb4c1a63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c09a920 tx=0x7ffb40004750 comp rx=0 tx=0).stop 2023-10-03T10:21:01.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 shutdown_connections 2023-10-03T10:21:01.359 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb4c09e410 0x7ffb4c1a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb4c09d6f0 0x7ffb4c1a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 --2- 172.21.15.19:0/1760830763 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb4c09e000 0x7ffb4c1a63f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 >> 172.21.15.19:0/1760830763 conn(0x7ffb4c066f50 msgr2=0x7ffb4c1bad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 shutdown_connections 2023-10-03T10:21:01.360 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.358+0000 7ffb53095700 1 -- 172.21.15.19:0/1760830763 wait complete. 2023-10-03T10:21:01.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.360+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f45b8005590 con 0x7f45d81339f0 2023-10-03T10:21:01.361 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.360+0000 7f45d4ff9700 1 -- 172.21.15.19:0/4000899042 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f45c8019680 con 0x7f45d81339f0 2023-10-03T10:21:01.361 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:01.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 msgr2=0x7f45d81cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:01.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 0x7f45d81cce50 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f45c800c530 tx=0x7f45c800c840 comp rx=0 tx=0).stop 2023-10-03T10:21:01.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 shutdown_connections 2023-10-03T10:21:01.364 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45d8134300 0x7f45d811d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f45d811d4a0 0x7f45d81cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 --2- 172.21.15.19:0/4000899042 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f45d81339f0 0x7f45d81cce50 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:01.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 >> 172.21.15.19:0/4000899042 conn(0x7f45d8066f50 msgr2=0x7f45d8132cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:01.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 shutdown_connections 2023-10-03T10:21:01.365 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:01.363+0000 7f45de841700 1 -- 172.21.15.19:0/4000899042 wait complete. 2023-10-03T10:21:01.374 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:01.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:02.349 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:02.354 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:02.375 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:02.380 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.525+0000 7f43c4447700 1 Processor -- start 2023-10-03T10:21:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.525+0000 7f43c4447700 1 -- start start 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c4447700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c4447700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43bc09e000 0x7f43bc130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c4447700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc09f130 con 0x7f43bc09e410 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c4447700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc09f520 con 0x7f43bc09e000 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c4447700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc09e930 con 0x7f43bc09d6f0 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c21e3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c19e2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43bc09e000 0x7f43bc130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c21e3700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59680/0 (socket says 172.21.15.19:59680) 2023-10-03T10:21:02.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c19e2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f43bc09e000 0x7f43bc130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35188/0 (socket says 172.21.15.19:35188) 2023-10-03T10:21:02.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.526+0000 7f43c21e3700 1 -- 172.21.15.19:0/818656351 learned_addr learned my addr 172.21.15.19:0/818656351 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c19e2700 1 -- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 msgr2=0x7f43bc09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c19e2700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c19e2700 1 -- 172.21.15.19:0/818656351 >> v1:172.21.15.19:6789/0 conn(0x7f43bc09e410 legacy=0x7f43bc130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c11e1700 1 -- 172.21.15.19:0/818656351 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289397875 0 0) 0x7f43bc09f130 con 0x7f43bc09e410 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c19e2700 1 -- 172.21.15.19:0/818656351 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc09b2d0 con 0x7f43bc09e000 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c21e3700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c19e2700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc130660 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009840 tx=0x7f43ac009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4f940f87c87f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c11e1700 1 -- 172.21.15.19:0/818656351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011830 con 0x7f43bc09e000 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c11e1700 1 -- 172.21.15.19:0/818656351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac011990 con 0x7f43bc09e000 2023-10-03T10:21:02.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.527+0000 7f43c11e1700 1 -- 172.21.15.19:0/818656351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac011d20 con 0x7f43bc09e000 2023-10-03T10:21:02.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 -- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 msgr2=0x7f43bc130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc130660 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f43ac009840 tx=0x7f43ac009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:02.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 -- 172.21.15.19:0/818656351 shutdown_connections 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09d6f0 0x7f43bc09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 --2- 172.21.15.19:0/818656351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc130660 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 -- 172.21.15.19:0/818656351 >> 172.21.15.19:0/818656351 conn(0x7f43bc066f50 msgr2=0x7f43bc09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 -- 172.21.15.19:0/818656351 shutdown_connections 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.528+0000 7f43c4447700 1 -- 172.21.15.19:0/818656351 wait complete. 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 Processor -- start 2023-10-03T10:21:02.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 -- start start 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc11e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09e410 0x7f43bc11eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc121b40 con 0x7f43bc09e000 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc09c770 con 0x7f43bc09e410 2023-10-03T10:21:02.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.530+0000 7f43c4447700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc09a0c0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50098/0 (socket says 172.21.15.19:50098) 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 -- 172.21.15.19:0/1540372855 learned_addr learned my addr 172.21.15.19:0/1540372855 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c29e4700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09e410 0x7f43bc11eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c19e2700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc11e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 -- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09e410 msgr2=0x7f43bc11eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09e410 0x7f43bc11eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 -- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 msgr2=0x7f43bc11e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc11e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 -- 172.21.15.19:0/1540372855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009550 con 0x7f43bc09d6f0 2023-10-03T10:21:02.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.531+0000 7f43c21e3700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f43b8010df0 tx=0x7f43b800e640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.532+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800ed40 con 0x7f43bc09d6f0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.532+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800c070 con 0x7f43bc09d6f0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.532+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800eea0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.532+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac0094a0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.532+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc1215a0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.533+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc074ea0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.534+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f43b8004020 con 0x7f43bc09d6f0 2023-10-03T10:21:02.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.534+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f43b803ffc0 con 0x7f43bc09d6f0 2023-10-03T10:21:02.539 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.539+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f43b800d940 con 0x7f43bc09d6f0 2023-10-03T10:21:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.542+0000 7fcd4061f700 1 Processor -- start 2023-10-03T10:21:02.543 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.542+0000 7fcd4061f700 1 -- start start 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd4061f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809d6f0 0x7fcd3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd4061f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd3809e000 0x7fcd38130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd4061f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3809f130 con 0x7fcd3809e410 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd4061f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3809f520 con 0x7fcd3809e000 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd4061f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3809e930 con 0x7fcd3809d6f0 2023-10-03T10:21:02.544 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd3dbba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd3809e000 0x7fcd38130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd3dbba700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fcd3809e000 0x7fcd38130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35194/0 (socket says 172.21.15.19:35194) 2023-10-03T10:21:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd3ebbc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fcd3809e410 0x7fcd38130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34180/0 (socket says 172.21.15.19:34180) 2023-10-03T10:21:02.545 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.543+0000 7fcd3dbba700 1 -- 172.21.15.19:0/1180228285 learned_addr learned my addr 172.21.15.19:0/1180228285 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3e3bb700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809d6f0 0x7fcd3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3dbba700 1 -- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809d6f0 msgr2=0x7fcd3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3dbba700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809d6f0 0x7fcd3809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3d3b9700 1 -- 172.21.15.19:0/1180228285 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607479563 0 0) 0x7fcd3809f130 con 0x7fcd3809e410 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3dbba700 1 -- 172.21.15.19:0/1180228285 >> v1:172.21.15.19:6789/0 conn(0x7fcd3809e410 legacy=0x7fcd38130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3dbba700 1 -- 172.21.15.19:0/1180228285 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3809b2d0 con 0x7fcd3809e000 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3dbba700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809e000 0x7fcd38130660 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800bb90 tx=0x7fcd2800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ec7b60477f12f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3d3b9700 1 -- 172.21.15.19:0/1180228285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2800dd50 con 0x7fcd3809e000 2023-10-03T10:21:02.546 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3d3b9700 1 -- 172.21.15.19:0/1180228285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28010470 con 0x7fcd3809e000 2023-10-03T10:21:02.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.544+0000 7fcd3d3b9700 1 -- 172.21.15.19:0/1180228285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28010800 con 0x7fcd3809e000 2023-10-03T10:21:02.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.545+0000 7fe4b131a700 1 Processor -- start 2023-10-03T10:21:02.547 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.545+0000 7fe4b131a700 1 -- start start 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.545+0000 7fcd4061f700 1 -- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809e000 msgr2=0x7fcd38130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.545+0000 7fcd4061f700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809e000 0x7fcd38130660 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fcd2800bb90 tx=0x7fcd2800bea0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 -- 172.21.15.19:0/1180228285 shutdown_connections 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809d6f0 0x7fcd3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 --2- 172.21.15.19:0/1180228285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809e000 0x7fcd38130660 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 -- 172.21.15.19:0/1180228285 >> 172.21.15.19:0/1180228285 conn(0x7fcd38066f50 msgr2=0x7fcd3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 -- 172.21.15.19:0/1180228285 shutdown_connections 2023-10-03T10:21:02.548 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fcd4061f700 1 -- 172.21.15.19:0/1180228285 wait complete. 2023-10-03T10:21:02.549 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4b131a700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4ac09f410 0x7fe4ac136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4b131a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac136fe0 0x7fe4ac1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4b131a700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ac070940 con 0x7fe4ac09e930 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4b131a700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ac06fd60 con 0x7fe4ac09f410 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4b131a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac06fa80 con 0x7fe4ac136fe0 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4ac09f410 0x7fe4ac136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe4ac09f410 0x7fe4ac136aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35198/0 (socket says 172.21.15.19:35198) 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 -- 172.21.15.19:0/701035833 learned_addr learned my addr 172.21.15.19:0/701035833 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 -- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac136fe0 msgr2=0x7fe4ac1393c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 --2- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac136fe0 0x7fe4ac1393c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.550 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 -- 172.21.15.19:0/701035833 >> v1:172.21.15.19:6789/0 conn(0x7fe4ac09e930 legacy=0x7fe4ac09ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.546+0000 7fe4aa7fc700 1 -- 172.21.15.19:0/701035833 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ac09fb60 con 0x7fe4ac09f410 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fe4aa7fc700 1 --2- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac136aa0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098f0 tx=0x7fe4a0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79abfb3ead49a243 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fe4a9ffb700 1 -- 172.21.15.19:0/701035833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000b8a0 con 0x7fe4ac09f410 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fe4a9ffb700 1 -- 172.21.15.19:0/701035833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a000ba00 con 0x7fe4ac09f410 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fcd4061f700 1 Processor -- start 2023-10-03T10:21:02.551 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fe4a9ffb700 1 -- 172.21.15.19:0/701035833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a000bd90 con 0x7fe4ac09f410 2023-10-03T10:21:02.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.547+0000 7fcd4061f700 1 -- start start 2023-10-03T10:21:02.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 0x7fcd3811e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3809e410 0x7fcd3811eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.552 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38120560 con 0x7fcd3809d6f0 2023-10-03T10:21:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3809a0c0 con 0x7fcd3809e000 2023-10-03T10:21:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd4061f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38121ba0 con 0x7fcd3809e410 2023-10-03T10:21:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 -- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 msgr2=0x7fe4ac136aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 --2- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac136aa0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fe4a00098f0 tx=0x7fe4a0009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:02.553 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35212/0 (socket says 172.21.15.19:35212) 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 -- 172.21.15.19:0/4284365782 learned_addr learned my addr 172.21.15.19:0/4284365782 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3ebbc700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3809e410 0x7fcd3811eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 -- 172.21.15.19:0/701035833 shutdown_connections 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 --2- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac136fe0 0x7fe4ac1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 --2- 172.21.15.19:0/701035833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac136aa0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.554 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fe4b131a700 1 -- 172.21.15.19:0/701035833 >> 172.21.15.19:0/701035833 conn(0x7fe4ac0a4210 msgr2=0x7fe4ac0a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3dbba700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 0x7fcd3811e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 -- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3809e410 msgr2=0x7fcd3811eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3809e410 0x7fcd3811eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 -- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 msgr2=0x7fcd3811e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 0x7fcd3811e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.555 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3e3bb700 1 -- 172.21.15.19:0/4284365782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2800b7f0 con 0x7fcd3809d6f0 2023-10-03T10:21:02.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.548+0000 7fcd3dbba700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 0x7fcd3811e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:21:02.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.549+0000 7fe4b131a700 1 -- 172.21.15.19:0/701035833 shutdown_connections 2023-10-03T10:21:02.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.549+0000 7fe4b131a700 1 -- 172.21.15.19:0/701035833 wait complete. 2023-10-03T10:21:02.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.549+0000 7fcd3e3bb700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400d800 tx=0x7fcd3400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.556 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.549+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340125f0 con 0x7fcd3809d6f0 2023-10-03T10:21:02.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fe4b131a700 1 Processor -- start 2023-10-03T10:21:02.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fe4b131a700 1 -- start start 2023-10-03T10:21:02.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34012750 con 0x7fcd3809d6f0 2023-10-03T10:21:02.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3809c760 con 0x7fcd3809d6f0 2023-10-03T10:21:02.557 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd381201e0 con 0x7fcd3809d6f0 2023-10-03T10:21:02.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.550+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34012b00 con 0x7fcd3809d6f0 2023-10-03T10:21:02.558 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd38074ea0 con 0x7fcd3809d6f0 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac09e930 0x7fe4ac11ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac11f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac11dfe0 con 0x7fe4ac09f410 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac132520 con 0x7fe4ac136fe0 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4b131a700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ac06d880 con 0x7fe4ac09e930 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fe4ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59714/0 (socket says 172.21.15.19:59714) 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 -- 172.21.15.19:0/3572941661 learned_addr learned my addr 172.21.15.19:0/3572941661 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.559 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4aa7fc700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac11f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.551+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fcd34012ca0 con 0x7fcd3809d6f0 2023-10-03T10:21:02.560 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fcd34042030 con 0x7fcd3809d6f0 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 -- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac09e930 msgr2=0x7fe4ac11ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac09e930 0x7fe4ac11ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 -- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 msgr2=0x7fe4ac11f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac11f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 -- 172.21.15.19:0/3572941661 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a0009550 con 0x7fe4ac136fe0 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.552+0000 7fe4ab7fe700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400b9a0 tx=0x7fe4a400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.561 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.553+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400c930 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.553+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a400cab0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.553+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a400ce60 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.553+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ac0a3030 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.553+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ac11fb80 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.554+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe4a401d3b0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.554+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe4a403f4c0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.556+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac11d9a0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.562 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.557+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fcd34076750 con 0x7fcd3809d6f0 2023-10-03T10:21:02.563 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.561+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe4ac11d9a0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.567+0000 7fe85e913700 1 Processor -- start 2023-10-03T10:21:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.567+0000 7fe85e913700 1 -- start start 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe85e913700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe85e913700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe858134ec0 0x7fe8581379e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe85e913700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe858134980 con 0x7fe858137f20 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe85e913700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe85806c4b0 con 0x7fe858134ec0 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe85e913700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8580a09c0 con 0x7fe85806c0e0 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59722/0 (socket says 172.21.15.19:59722) 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 -- 172.21.15.19:0/1402337532 learned_addr learned my addr 172.21.15.19:0/1402337532 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe8577fe700 1 --2- 172.21.15.19:0/1402337532 >> v2:172.21.15.19:3300/0 conn(0x7fe858134ec0 0x7fe8581379e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 -- 172.21.15.19:0/1402337532 >> v2:172.21.15.19:3300/0 conn(0x7fe858134ec0 msgr2=0x7fe8581379e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 --2- 172.21.15.19:0/1402337532 >> v2:172.21.15.19:3300/0 conn(0x7fe858134ec0 0x7fe8581379e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.568+0000 7fe857fff700 1 -- 172.21.15.19:0/1402337532 >> v1:172.21.15.19:6789/0 conn(0x7fe858137f20 legacy=0x7fe85813ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.569+0000 7fe857fff700 1 -- 172.21.15.19:0/1402337532 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8580a0600 con 0x7fe85806c0e0 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.569+0000 7fe857fff700 1 --2- 172.21.15.19:0/1402337532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098f0 tx=0x7fe848009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3230beadf3aadf14 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.569+0000 7fe856ffd700 1 -- 172.21.15.19:0/1402337532 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848011830 con 0x7fe85806c0e0 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.569+0000 7fe856ffd700 1 -- 172.21.15.19:0/1402337532 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848011990 con 0x7fe85806c0e0 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.569+0000 7fe856ffd700 1 -- 172.21.15.19:0/1402337532 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848011d20 con 0x7fe85806c0e0 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 -- 172.21.15.19:0/1402337532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 msgr2=0x7fe85809ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 --2- 172.21.15.19:0/1402337532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fe8480098f0 tx=0x7fe848009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 -- 172.21.15.19:0/1402337532 shutdown_connections 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 --2- 172.21.15.19:0/1402337532 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe85806c0e0 0x7fe85809ac90 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 --2- 172.21.15.19:0/1402337532 >> v2:172.21.15.19:3300/0 conn(0x7fe858134ec0 0x7fe8581379e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 -- 172.21.15.19:0/1402337532 >> 172.21.15.19:0/1402337532 conn(0x7fe8580a4210 msgr2=0x7fe8580a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 -- 172.21.15.19:0/1402337532 shutdown_connections 2023-10-03T10:21:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.570+0000 7fe85e913700 1 -- 172.21.15.19:0/1402337532 wait complete. 2023-10-03T10:21:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.571+0000 7fe85e913700 1 Processor -- start 2023-10-03T10:21:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 -- start start 2023-10-03T10:21:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85806c0e0 0x7fe85811a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe858134ec0 0x7fe85811ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85811c5d0 con 0x7fe858137f20 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85811d3f0 con 0x7fe858134ec0 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85e913700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe858137c00 con 0x7fe85806c0e0 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85ceb0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85ceb0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35242/0 (socket says 172.21.15.19:35242) 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe85ceb0700 1 -- 172.21.15.19:0/915325723 learned_addr learned my addr 172.21.15.19:0/915325723 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.572+0000 7fe8577fe700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe858134ec0 0x7fe85811ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe857fff700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85806c0e0 0x7fe85811a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 -- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85806c0e0 msgr2=0x7fe85811a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85806c0e0 0x7fe85811a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 -- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe858134ec0 msgr2=0x7fe85811ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe858134ec0 0x7fe85811ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 -- 172.21.15.19:0/915325723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009550 con 0x7fe858137f20 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe85ceb0700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fe85000cc80 tx=0x7fe85000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe850003c00 con 0x7fe858137f20 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe850003d60 con 0x7fe858137f20 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.573+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85000ab30 con 0x7fe858137f20 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.574+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8580a03f0 con 0x7fe858137f20 2023-10-03T10:21:02.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.574+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85811d910 con 0x7fe858137f20 2023-10-03T10:21:02.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.575+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe858074ea0 con 0x7fe858137f20 2023-10-03T10:21:02.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.576+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe85000ac90 con 0x7fe858137f20 2023-10-03T10:21:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.576+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe8500401e0 con 0x7fe858137f20 2023-10-03T10:21:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.581+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe8500050d0 con 0x7fe858137f20 2023-10-03T10:21:02.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.756+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f43bc0a2140 con 0x7f43bc09d6f0 2023-10-03T10:21:02.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.756+0000 7f43b2ffd700 1 -- 172.21.15.19:0/1540372855 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f43b800d350 con 0x7f43bc09d6f0 2023-10-03T10:21:02.757 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 msgr2=0x7f43bc11e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f43b8010df0 tx=0x7f43b800e640 comp rx=0 tx=0).stop 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 shutdown_connections 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f43bc09e410 0x7f43bc11eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f43bc09d6f0 0x7f43bc11e020 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 --2- 172.21.15.19:0/1540372855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43bc09e000 0x7f43bc11e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 >> 172.21.15.19:0/1540372855 conn(0x7f43bc066f50 msgr2=0x7f43bc070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 shutdown_connections 2023-10-03T10:21:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.759+0000 7f43c4447700 1 -- 172.21.15.19:0/1540372855 wait complete. 2023-10-03T10:21:02.775 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.789+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe85811dc50 con 0x7fe858137f20 2023-10-03T10:21:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.790+0000 7fe854ff9700 1 -- 172.21.15.19:0/915325723 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe850011380 con 0x7fe858137f20 2023-10-03T10:21:02.791 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:02.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 msgr2=0x7fe85811b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fe85000cc80 tx=0x7fe85000cf90 comp rx=0 tx=0).stop 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 shutdown_connections 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe858137f20 0x7fe85811b370 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe85806c0e0 0x7fe85811a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 --2- 172.21.15.19:0/915325723 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe858134ec0 0x7fe85811ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 >> 172.21.15.19:0/915325723 conn(0x7fe8580a4210 msgr2=0x7fe85806c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 shutdown_connections 2023-10-03T10:21:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.792+0000 7fe85e913700 1 -- 172.21.15.19:0/915325723 wait complete. 2023-10-03T10:21:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.793+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcd380a2140 con 0x7fcd3809d6f0 2023-10-03T10:21:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.794+0000 7fcd2effd700 1 -- 172.21.15.19:0/4284365782 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcd3401e460 con 0x7fcd3809d6f0 2023-10-03T10:21:02.795 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe4ac11d9a0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 msgr2=0x7fcd3811e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400d800 tx=0x7fcd3400db10 comp rx=0 tx=0).stop 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 shutdown_connections 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fcd3809e410 0x7fcd3811eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcd3809d6f0 0x7fcd3811e080 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 --2- 172.21.15.19:0/4284365782 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fcd3809e000 0x7fcd3811e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 >> 172.21.15.19:0/4284365782 conn(0x7fcd38066f50 msgr2=0x7fcd38070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 shutdown_connections 2023-10-03T10:21:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fcd4061f700 1 -- 172.21.15.19:0/4284365782 wait complete. 2023-10-03T10:21:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.796+0000 7fe4937fe700 1 -- 172.21.15.19:0/3572941661 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe4ac11d9a0 con 0x7fe4ac136fe0 2023-10-03T10:21:02.799 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 msgr2=0x7fe4ac11f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fe4a400b9a0 tx=0x7fe4a400bcb0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 shutdown_connections 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe4ac136fe0 0x7fe4ac11f640 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe4ac09e930 0x7fe4ac11ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 --2- 172.21.15.19:0/3572941661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4ac09f410 0x7fe4ac11f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 >> 172.21.15.19:0/3572941661 conn(0x7fe4ac0a4210 msgr2=0x7fe4ac134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 shutdown_connections 2023-10-03T10:21:02.802 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:02.799+0000 7fe4b131a700 1 -- 172.21.15.19:0/3572941661 wait complete. 2023-10-03T10:21:02.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:02.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:02.817 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:03.776 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:03.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:03.816 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:03.818 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:03.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.932+0000 7fbddc97c700 1 Processor -- start 2023-10-03T10:21:03.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.932+0000 7fbddc97c700 1 -- start start 2023-10-03T10:21:03.933 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbddc97c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 0x7fbdd806ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbddc97c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 0x7fbdd8139860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbddc97c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdd809ece0 con 0x7fbdd806b080 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbddc97c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd809e760 con 0x7fbdd806a770 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbddc97c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd809e040 con 0x7fbdd8131d10 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd6d9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 0x7fbdd8139860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd5d9b700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbdd806b080 0x7fbdd8131600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34198/0 (socket says 172.21.15.19:34198) 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd5d9b700 1 -- 172.21.15.19:0/2278906362 learned_addr learned my addr 172.21.15.19:0/2278906362 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd659c700 1 --2- 172.21.15.19:0/2278906362 >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 0x7fbdd806ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd6d9d700 1 -- 172.21.15.19:0/2278906362 >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 msgr2=0x7fbdd806ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd6d9d700 1 --2- 172.21.15.19:0/2278906362 >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 0x7fbdd806ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd6d9d700 1 -- 172.21.15.19:0/2278906362 >> v1:172.21.15.19:6789/0 conn(0x7fbdd806b080 legacy=0x7fbdd8131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd6d9d700 1 -- 172.21.15.19:0/2278906362 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd809f630 con 0x7fbdd8131d10 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.933+0000 7fbdd559a700 1 -- 172.21.15.19:0/2278906362 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040399304 0 0) 0x7fbdd809ece0 con 0x7fbdd806b080 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd659c700 1 --2- 172.21.15.19:0/2278906362 >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 0x7fbdd806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd6d9d700 1 --2- 172.21.15.19:0/2278906362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 0x7fbdd8139860 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009d90 tx=0x7fbdd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f2b710cdd690871 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd559a700 1 -- 172.21.15.19:0/2278906362 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000e070 con 0x7fbdd8131d10 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd559a700 1 -- 172.21.15.19:0/2278906362 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd000bb20 con 0x7fbdd8131d10 2023-10-03T10:21:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.934+0000 7fbdd559a700 1 -- 172.21.15.19:0/2278906362 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0012430 con 0x7fbdd8131d10 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 -- 172.21.15.19:0/2278906362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 msgr2=0x7fbdd8139860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2278906362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 0x7fbdd8139860 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009d90 tx=0x7fbdd000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 -- 172.21.15.19:0/2278906362 shutdown_connections 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2278906362 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd8131d10 0x7fbdd8139860 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2278906362 >> v2:172.21.15.19:3300/0 conn(0x7fbdd806a770 0x7fbdd806ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 -- 172.21.15.19:0/2278906362 >> 172.21.15.19:0/2278906362 conn(0x7fbdd8066f50 msgr2=0x7fbdd809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 -- 172.21.15.19:0/2278906362 shutdown_connections 2023-10-03T10:21:03.937 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.935+0000 7fbddc97c700 1 -- 172.21.15.19:0/2278906362 wait complete. 2023-10-03T10:21:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.937+0000 7fbddc97c700 1 Processor -- start 2023-10-03T10:21:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.937+0000 7fbddc97c700 1 -- start start 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbdd806b080 0x7fbdd81209c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8131d10 0x7fbdd8120f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8131360 con 0x7fbdd8131d10 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8123920 con 0x7fbdd806a770 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbddc97c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd81220c0 con 0x7fbdd806b080 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59764/0 (socket says 172.21.15.19:59764) 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 -- 172.21.15.19:0/2307226778 learned_addr learned my addr 172.21.15.19:0/2307226778 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd6d9d700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8131d10 0x7fbdd8120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 -- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbdd806b080 msgr2=0x7fbdd81209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbdd806b080 0x7fbdd81209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 -- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8131d10 msgr2=0x7fbdd8120f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8131d10 0x7fbdd8120f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 -- 172.21.15.19:0/2307226778 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80094a0 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.938+0000 7fbdd659c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800ebe0 tx=0x7fbdc800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.939+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc8009800 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.939+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc800c910 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.939+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd0009a70 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.939+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800cc80 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.939+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd8124650 con 0x7fbdd806a770 2023-10-03T10:21:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.940+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbdc8013470 con 0x7fbdd806a770 2023-10-03T10:21:03.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.940+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbdc803f7f0 con 0x7fbdd806a770 2023-10-03T10:21:03.942 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.940+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8074ea0 con 0x7fbdd806a770 2023-10-03T10:21:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.951+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbdc8013720 con 0x7fbdd806a770 2023-10-03T10:21:03.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.970+0000 7fbb3d27e700 1 Processor -- start 2023-10-03T10:21:03.971 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 -- start start 2023-10-03T10:21:03.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809d6f0 0x7fbb3809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 0x7fbb381339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3809b120 con 0x7fbb3809e410 2023-10-03T10:21:03.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3806b460 con 0x7fbb3809e000 2023-10-03T10:21:03.972 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb3d27e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3809a7e0 con 0x7fbb3809d6f0 2023-10-03T10:21:03.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb367fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 0x7fbb381339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb377fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fbb3809e410 0x7fbb38133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34206/0 (socket says 172.21.15.19:34206) 2023-10-03T10:21:03.973 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.971+0000 7fbb377fe700 1 -- 172.21.15.19:0/2176656702 learned_addr learned my addr 172.21.15.19:0/2176656702 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb367fc700 1 -- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809d6f0 msgr2=0x7fbb3809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb367fc700 1 --2- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809d6f0 0x7fbb3809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb367fc700 1 -- 172.21.15.19:0/2176656702 >> v1:172.21.15.19:6789/0 conn(0x7fbb3809e410 legacy=0x7fbb38133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb35ffb700 1 -- 172.21.15.19:0/2176656702 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560328413 0 0) 0x7fbb3809b120 con 0x7fbb3809e410 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb367fc700 1 -- 172.21.15.19:0/2176656702 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3809a500 con 0x7fbb3809e000 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb367fc700 1 --2- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 0x7fbb381339f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009870 tx=0x7fbb20009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0f53b45a43b7be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb35ffb700 1 -- 172.21.15.19:0/2176656702 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011830 con 0x7fbb3809e000 2023-10-03T10:21:03.974 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb35ffb700 1 -- 172.21.15.19:0/2176656702 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb20011990 con 0x7fbb3809e000 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.972+0000 7fbb35ffb700 1 -- 172.21.15.19:0/2176656702 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb20011d20 con 0x7fbb3809e000 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 msgr2=0x7fbb381339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 0x7fbb381339f0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009870 tx=0x7fbb20009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2176656702 shutdown_connections 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809d6f0 0x7fbb3809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2176656702 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e000 0x7fbb381339f0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2176656702 >> 172.21.15.19:0/2176656702 conn(0x7fbb38066f50 msgr2=0x7fbb3809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2176656702 shutdown_connections 2023-10-03T10:21:03.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.973+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2176656702 wait complete. 2023-10-03T10:21:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 Processor -- start 2023-10-03T10:21:03.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 -- start start 2023-10-03T10:21:03.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809e000 0x7fbb38122990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.977 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e410 0x7fbb38122ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38124e60 con 0x7fbb3809d6f0 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb38125ed0 con 0x7fbb3809e410 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.975+0000 7fbb3d27e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbb381337a0 con 0x7fbb3809e000 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35264/0 (socket says 172.21.15.19:35264) 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 -- 172.21.15.19:0/2386880364 learned_addr learned my addr 172.21.15.19:0/2386880364 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb377fe700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e410 0x7fbb38122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 -- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809e000 msgr2=0x7fbb38122990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809e000 0x7fbb38122990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 -- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e410 msgr2=0x7fbb38122ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e410 0x7fbb38122ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 -- 172.21.15.19:0/2386880364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200094a0 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb36ffd700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b530 tx=0x7fbb2800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011830 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28011990 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb28011d20 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.976+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380720e0 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.977+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3809c760 con 0x7fbb3809d6f0 2023-10-03T10:21:03.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.978+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbb2801a400 con 0x7fbb3809d6f0 2023-10-03T10:21:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.978+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3811f030 con 0x7fbb3809d6f0 2023-10-03T10:21:03.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.978+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbb2803f7f0 con 0x7fbb3809d6f0 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.978+0000 7fc516839700 1 Processor -- start 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.978+0000 7fc516839700 1 -- start start 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc516839700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012c2f0 0x7fc510130040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc516839700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc51012cff0 0x7fc510137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc516839700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc51009a510 con 0x7fc51012cc20 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc516839700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc51012c7d0 con 0x7fc51012cff0 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc516839700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51009c190 con 0x7fc51012c2f0 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc514dd6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc51012cff0 0x7fc510137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc50ffff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc51012cc20 0x7fc51012f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34208/0 (socket says 172.21.15.19:34208) 2023-10-03T10:21:03.981 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc50ffff700 1 -- 172.21.15.19:0/1582531239 learned_addr learned my addr 172.21.15.19:0/1582531239 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.979+0000 7fc50f7fe700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012c2f0 0x7fc510130040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.980+0000 7fc514dd6700 1 -- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012c2f0 msgr2=0x7fc510130040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.980+0000 7fc514dd6700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012c2f0 0x7fc510130040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.980+0000 7fc514dd6700 1 -- 172.21.15.19:0/1582531239 >> v1:172.21.15.19:6789/0 conn(0x7fc51012cc20 legacy=0x7fc51012f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.980+0000 7fc514dd6700 1 -- 172.21.15.19:0/1582531239 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51009b540 con 0x7fc51012cff0 2023-10-03T10:21:03.982 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.980+0000 7fc514dd6700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012cff0 0x7fc510137cd0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc508009d90 tx=0x7fc50800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da7fc7848c166e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.983+0000 7f7d5938f700 1 Processor -- start 2023-10-03T10:21:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.983+0000 7f7d5938f700 1 -- start start 2023-10-03T10:21:03.984 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d5938f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7fc50effd700 1 -- 172.21.15.19:0/1582531239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50800e070 con 0x7fc51012cff0 2023-10-03T10:21:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d5938f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f7d5409e410 0x7f7d54130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d5938f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d5409f130 con 0x7f7d5409e000 2023-10-03T10:21:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d5938f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5409f520 con 0x7f7d5409e410 2023-10-03T10:21:03.985 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d5938f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5409e930 con 0x7f7d5409d6f0 2023-10-03T10:21:03.986 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbb2800f8d0 con 0x7fbb3809d6f0 2023-10-03T10:21:03.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7fc50effd700 1 -- 172.21.15.19:0/1582531239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50800bb20 con 0x7fc51012cff0 2023-10-03T10:21:03.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7fc50effd700 1 -- 172.21.15.19:0/1582531239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508012430 con 0x7fc51012cff0 2023-10-03T10:21:03.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 -- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012cff0 msgr2=0x7fc510137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.987 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012cff0 0x7fc510137cd0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fc508009d90 tx=0x7fc50800b330 comp rx=0 tx=0).stop 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 -- 172.21.15.19:0/1582531239 shutdown_connections 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012cff0 0x7fc510137cd0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 --2- 172.21.15.19:0/1582531239 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012c2f0 0x7fc510130040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 -- 172.21.15.19:0/1582531239 >> 172.21.15.19:0/1582531239 conn(0x7fc51009f470 msgr2=0x7fc5100a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 -- 172.21.15.19:0/1582531239 shutdown_connections 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7fc516839700 1 -- 172.21.15.19:0/1582531239 wait complete. 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7fc516839700 1 Processor -- start 2023-10-03T10:21:03.988 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d52ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d52ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50166/0 (socket says 172.21.15.19:50166) 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.984+0000 7f7d52ffd700 1 -- 172.21.15.19:0/785048678 learned_addr learned my addr 172.21.15.19:0/785048678 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d537fe700 1 --2- 172.21.15.19:0/785048678 >> v2:172.21.15.19:3300/0 conn(0x7f7d5409e410 0x7f7d54130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d52ffd700 1 -- 172.21.15.19:0/785048678 >> v2:172.21.15.19:3300/0 conn(0x7f7d5409e410 msgr2=0x7f7d54130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d52ffd700 1 --2- 172.21.15.19:0/785048678 >> v2:172.21.15.19:3300/0 conn(0x7f7d5409e410 0x7f7d54130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d52ffd700 1 -- 172.21.15.19:0/785048678 >> v1:172.21.15.19:6789/0 conn(0x7f7d5409e000 legacy=0x7f7d54130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d52ffd700 1 -- 172.21.15.19:0/785048678 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5409b2d0 con 0x7f7d5409d6f0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d52ffd700 1 --2- 172.21.15.19:0/785048678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bb90 tx=0x7f7d4400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b370d0d09ca4f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d51ffb700 1 -- 172.21.15.19:0/785048678 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400dd30 con 0x7f7d5409d6f0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d51ffb700 1 -- 172.21.15.19:0/785048678 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400de90 con 0x7f7d5409d6f0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.985+0000 7f7d51ffb700 1 -- 172.21.15.19:0/785048678 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d44010690 con 0x7f7d5409d6f0 2023-10-03T10:21:03.989 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 -- 172.21.15.19:0/785048678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 msgr2=0x7f7d5409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 --2- 172.21.15.19:0/785048678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400bb90 tx=0x7f7d4400bea0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 -- 172.21.15.19:0/785048678 shutdown_connections 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 --2- 172.21.15.19:0/785048678 >> v2:172.21.15.19:3300/0 conn(0x7f7d5409e410 0x7f7d54130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 --2- 172.21.15.19:0/785048678 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409d6f0 0x7f7d5409dac0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 -- 172.21.15.19:0/785048678 >> 172.21.15.19:0/785048678 conn(0x7f7d54066f50 msgr2=0x7f7d5409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 -- 172.21.15.19:0/785048678 shutdown_connections 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.986+0000 7f7d5938f700 1 -- 172.21.15.19:0/785048678 wait complete. 2023-10-03T10:21:03.990 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 -- start start 2023-10-03T10:21:03.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012c2f0 0x7fc51013f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7f7d5938f700 1 Processor -- start 2023-10-03T10:21:03.991 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 -- start start 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 0x7fc5101cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc51013c520 con 0x7fc51012c2f0 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc51013f3c0 con 0x7fc51012cc20 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.987+0000 7fc516839700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc510129680 con 0x7fc51012cff0 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc514dd6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 0x7fc5101cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59806/0 (socket says 172.21.15.19:59806) 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc514dd6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 0x7fc5101cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50172/0 (socket says 172.21.15.19:50172) 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 -- 172.21.15.19:0/1850585425 learned_addr learned my addr 172.21.15.19:0/1850585425 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:03.992 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50ffff700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012c2f0 0x7fc51013f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d5409d6f0 0x7f7d54122980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409e000 0x7f7d54122ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54124780 con 0x7f7d5409d6f0 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54124590 con 0x7f7d5409e410 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d5938f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7d540a1e90 con 0x7f7d5409e000 2023-10-03T10:21:03.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d52ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d5409d6f0 0x7f7d54122980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d537fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59810/0 (socket says 172.21.15.19:59810) 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d537fe700 1 -- 172.21.15.19:0/1648761171 learned_addr learned my addr 172.21.15.19:0/1648761171 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7f7d527fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409e000 0x7f7d54122ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 -- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 msgr2=0x7fc5101cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 0x7fc5101cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 -- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012c2f0 msgr2=0x7fc51013f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012c2f0 0x7fc51013f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.994 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.988+0000 7fc50f7fe700 1 -- 172.21.15.19:0/1850585425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508009a70 con 0x7fc51012cc20 2023-10-03T10:21:03.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 -- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409e000 msgr2=0x7f7d54122ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409e000 0x7f7d54122ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 -- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d5409d6f0 msgr2=0x7f7d54122980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:03.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d5409d6f0 0x7f7d54122980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:03.997 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 -- 172.21.15.19:0/1648761171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4400b7f0 con 0x7f7d5409e410 2023-10-03T10:21:03.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7fc50f7fe700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9b0 tx=0x7fc50400ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.998 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7f7d537fe700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00efc0 tx=0x7f7d4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400ee50 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50400c850 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50400cbc0 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.989+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51012b670 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.990+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc510129f10 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.991+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc51012b130 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.991+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc50400cd20 con 0x7fc51012cc20 2023-10-03T10:21:03.999 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.991+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc50403f800 con 0x7fc51012cc20 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.992+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00cd40 con 0x7f7d5409e410 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.992+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c00f040 con 0x7f7d5409e410 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.992+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c00cea0 con 0x7f7d5409e410 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.992+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d541264a0 con 0x7f7d5409e410 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.992+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d54124d80 con 0x7f7d5409e410 2023-10-03T10:21:04.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:03.993+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54125e60 con 0x7f7d5409e410 2023-10-03T10:21:04.001 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.001+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc5040232f0 con 0x7fc51012cc20 2023-10-03T10:21:04.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.001+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f7d4c0146c0 con 0x7f7d5409e410 2023-10-03T10:21:04.002 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.001+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f7d4c040880 con 0x7f7d5409e410 2023-10-03T10:21:04.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.010+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f7d4c012520 con 0x7f7d5409e410 2023-10-03T10:21:04.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.163+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbdd806c360 con 0x7fbdd806a770 2023-10-03T10:21:04.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.163+0000 7fbdc6ffd700 1 -- 172.21.15.19:0/2307226778 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbdc8017020 con 0x7fbdd806a770 2023-10-03T10:21:04.164 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.165+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 msgr2=0x7fbdd8120480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:04.166 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.165+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800ebe0 tx=0x7fbdc800eef0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.167 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 shutdown_connections 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8131d10 0x7fbdd8120f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbdd806a770 0x7fbdd8120480 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 --2- 172.21.15.19:0/2307226778 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbdd806b080 0x7fbdd81209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 >> 172.21.15.19:0/2307226778 conn(0x7fbdd8066f50 msgr2=0x7fbdd80a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 shutdown_connections 2023-10-03T10:21:04.168 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.167+0000 7fbddc97c700 1 -- 172.21.15.19:0/2307226778 wait complete. 2023-10-03T10:21:04.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.202+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbb38074ea0 con 0x7fbb3809d6f0 2023-10-03T10:21:04.203 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.202+0000 7fbb2f7fe700 1 -- 172.21.15.19:0/2386880364 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbb28015020 con 0x7fbb3809d6f0 2023-10-03T10:21:04.203 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.204+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 msgr2=0x7fbb38122450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.204+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fbb2800b530 tx=0x7fbb2800b840 comp rx=0 tx=0).stop 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.204+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 shutdown_connections 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.204+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbb3809e410 0x7fbb38122ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.205+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb3809d6f0 0x7fbb38122450 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.205+0000 7fbb3d27e700 1 --2- 172.21.15.19:0/2386880364 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbb3809e000 0x7fbb38122990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.205+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 >> 172.21.15.19:0/2386880364 conn(0x7fbb38066f50 msgr2=0x7fbb38133ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.205+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 shutdown_connections 2023-10-03T10:21:04.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.205+0000 7fbb3d27e700 1 -- 172.21.15.19:0/2386880364 wait complete. 2023-10-03T10:21:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.208+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc5100747f0 con 0x7fc51012cc20 2023-10-03T10:21:04.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.208+0000 7fc50cff9700 1 -- 172.21.15.19:0/1850585425 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc504021090 con 0x7fc51012cc20 2023-10-03T10:21:04.209 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 msgr2=0x7fc51013fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fc50400e9b0 tx=0x7fc50400ecc0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 shutdown_connections 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc51012cff0 0x7fc5101cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc51012c2f0 0x7fc51013f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 --2- 172.21.15.19:0/1850585425 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc51012cc20 0x7fc51013fce0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 >> 172.21.15.19:0/1850585425 conn(0x7fc51009f470 msgr2=0x7fc5100a12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:04.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 shutdown_connections 2023-10-03T10:21:04.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.211+0000 7fc516839700 1 -- 172.21.15.19:0/1850585425 wait complete. 2023-10-03T10:21:04.219 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.218+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7d54125e60 con 0x7f7d5409e410 2023-10-03T10:21:04.220 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.219+0000 7f7d3b7fe700 1 -- 172.21.15.19:0/1648761171 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7d54125e60 con 0x7f7d5409e410 2023-10-03T10:21:04.220 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:04.221 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 msgr2=0x7f7d54123400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00efc0 tx=0x7f7d4c00c3a0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 shutdown_connections 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f7d5409e410 0x7f7d54123400 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7d5409d6f0 0x7f7d54122980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 --2- 172.21.15.19:0/1648761171 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f7d5409e000 0x7f7d54122ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 >> 172.21.15.19:0/1648761171 conn(0x7f7d54066f50 msgr2=0x7f7d540a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 shutdown_connections 2023-10-03T10:21:04.223 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:04.222+0000 7f7d5938f700 1 -- 172.21.15.19:0/1648761171 wait complete. 2023-10-03T10:21:04.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:04.236 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:05.183 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:05.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:05.227 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:05.237 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:05.342 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.342+0000 7f4b340e6700 1 Processor -- start 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.342+0000 7f4b340e6700 1 -- start start 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b340e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c12ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b340e6700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c135c20 0x7f4b2c138000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b340e6700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c06fa40 con 0x7f4b2c12cf60 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b340e6700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c12cd90 con 0x7f4b2c135c20 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b340e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c071780 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.343 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b32683700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c135c20 0x7f4b2c138000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b31681700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c12ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b32683700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f4b2c135c20 0x7f4b2c138000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35318/0 (socket says 172.21.15.19:35318) 2023-10-03T10:21:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b31681700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c12ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59820/0 (socket says 172.21.15.19:59820) 2023-10-03T10:21:05.344 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.343+0000 7f4b32683700 1 -- 172.21.15.19:0/2540928728 learned_addr learned my addr 172.21.15.19:0/2540928728 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b32683700 1 -- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 msgr2=0x7f4b2c12ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:05.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b30e80700 1 -- 172.21.15.19:0/2540928728 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304327015 0 0) 0x7f4b2c06fa40 con 0x7f4b2c12cf60 2023-10-03T10:21:05.345 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b32683700 1 --2- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c12ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b32683700 1 -- 172.21.15.19:0/2540928728 >> v1:172.21.15.19:6789/0 conn(0x7f4b2c12cf60 legacy=0x7f4b2c12f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b32683700 1 -- 172.21.15.19:0/2540928728 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c071a40 con 0x7f4b2c135c20 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b32683700 1 --2- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c135c20 0x7f4b2c138000 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f4b24010370 tx=0x7f4b24010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=650fb96ac26ec831 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b30e80700 1 -- 172.21.15.19:0/2540928728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24013070 con 0x7f4b2c135c20 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b30e80700 1 -- 172.21.15.19:0/2540928728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24010e70 con 0x7f4b2c135c20 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.344+0000 7f4b30e80700 1 -- 172.21.15.19:0/2540928728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24017630 con 0x7f4b2c135c20 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 -- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c135c20 msgr2=0x7f4b2c138000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 --2- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c135c20 0x7f4b2c138000 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f4b24010370 tx=0x7f4b24010680 comp rx=0 tx=0).stop 2023-10-03T10:21:05.346 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 -- 172.21.15.19:0/2540928728 shutdown_connections 2023-10-03T10:21:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 --2- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c135c20 0x7f4b2c138000 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 --2- 172.21.15.19:0/2540928728 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c12ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 -- 172.21.15.19:0/2540928728 >> 172.21.15.19:0/2540928728 conn(0x7f4b2c0a2aa0 msgr2=0x7f4b2c0a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 -- 172.21.15.19:0/2540928728 shutdown_connections 2023-10-03T10:21:05.347 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.345+0000 7f4b340e6700 1 -- 172.21.15.19:0/2540928728 wait complete. 2023-10-03T10:21:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.346+0000 7f4b340e6700 1 Processor -- start 2023-10-03T10:21:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.346+0000 7f4b340e6700 1 -- start start 2023-10-03T10:21:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 0x7f4b2c09a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b2c135c20 0x7f4b2c1c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09c7d0 con 0x7f4b2c12cf60 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09ca40 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b340e6700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c09e970 con 0x7f4b2c135c20 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59832/0 (socket says 172.21.15.19:59832) 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 -- 172.21.15.19:0/899872589 learned_addr learned my addr 172.21.15.19:0/899872589 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b32683700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b2c135c20 0x7f4b2c1c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31681700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 0x7f4b2c09a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 -- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b2c135c20 msgr2=0x7f4b2c1c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b2c135c20 0x7f4b2c1c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 -- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 msgr2=0x7f4b2c09a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 0x7f4b2c09a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31e82700 1 -- 172.21.15.19:0/899872589 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b24010050 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.347+0000 7f4b31681700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 0x7f4b2c09a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b31e82700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001eb0 tx=0x7f4b2800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280054e0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b28003680 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b280039f0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0a14c0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.348+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c099d50 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.349+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c074ea0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.349+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f4b28003b50 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.350+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f4b2803eb20 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.358 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.358+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f4b2801b3b0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.378+0000 7f8fae984700 1 Processor -- start 2023-10-03T10:21:05.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.378+0000 7f8fae984700 1 -- start start 2023-10-03T10:21:05.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fae984700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f8fa809d6f0 0x7f8fa809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fae984700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 0x7f8fa8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fae984700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa809f130 con 0x7f8fa809e000 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fae984700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa809f520 con 0x7f8fa809d6f0 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fae984700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa809e930 con 0x7f8fa809e410 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8facf21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 0x7f8fa8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fa77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f8fa809e000 0x7f8fa8130660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34230/0 (socket says 172.21.15.19:34230) 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fa77fe700 1 -- 172.21.15.19:0/3611000327 learned_addr learned my addr 172.21.15.19:0/3611000327 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:05.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.379+0000 7f8fa7fff700 1 --2- 172.21.15.19:0/3611000327 >> v2:172.21.15.19:3300/0 conn(0x7f8fa809d6f0 0x7f8fa809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.381 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8fa6ffd700 1 -- 172.21.15.19:0/3611000327 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3738368828 0 0) 0x7f8fa809f130 con 0x7f8fa809e000 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8facf21700 1 -- 172.21.15.19:0/3611000327 >> v2:172.21.15.19:3300/0 conn(0x7f8fa809d6f0 msgr2=0x7f8fa809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8facf21700 1 --2- 172.21.15.19:0/3611000327 >> v2:172.21.15.19:3300/0 conn(0x7f8fa809d6f0 0x7f8fa809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8facf21700 1 -- 172.21.15.19:0/3611000327 >> v1:172.21.15.19:6789/0 conn(0x7f8fa809e000 legacy=0x7f8fa8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8facf21700 1 -- 172.21.15.19:0/3611000327 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa809b2d0 con 0x7f8fa809e410 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8facf21700 1 --2- 172.21.15.19:0/3611000327 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 0x7f8fa8130d70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009d90 tx=0x7f8fa000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f34d8ddf041a204 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8fa6ffd700 1 -- 172.21.15.19:0/3611000327 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa000e070 con 0x7f8fa809e410 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8fa6ffd700 1 -- 172.21.15.19:0/3611000327 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa000bb20 con 0x7f8fa809e410 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.380+0000 7f8fa6ffd700 1 -- 172.21.15.19:0/3611000327 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0012430 con 0x7f8fa809e410 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 -- 172.21.15.19:0/3611000327 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 msgr2=0x7f8fa8130d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.382 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 --2- 172.21.15.19:0/3611000327 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 0x7f8fa8130d70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009d90 tx=0x7f8fa000b330 comp rx=0 tx=0).stop 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 -- 172.21.15.19:0/3611000327 shutdown_connections 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 --2- 172.21.15.19:0/3611000327 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809e410 0x7f8fa8130d70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 --2- 172.21.15.19:0/3611000327 >> v2:172.21.15.19:3300/0 conn(0x7f8fa809d6f0 0x7f8fa809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 -- 172.21.15.19:0/3611000327 >> 172.21.15.19:0/3611000327 conn(0x7f8fa8066f50 msgr2=0x7f8fa809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 -- 172.21.15.19:0/3611000327 shutdown_connections 2023-10-03T10:21:05.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.381+0000 7f8fae984700 1 -- 172.21.15.19:0/3611000327 wait complete. 2023-10-03T10:21:05.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.383+0000 7f8fae984700 1 Processor -- start 2023-10-03T10:21:05.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.383+0000 7f8fae984700 1 -- start start 2023-10-03T10:21:05.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 0x7f8fa8131630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fa809e000 0x7f8fa8131b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 0x7f8fa81320b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa80a3a60 con 0x7f8fa809e000 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa809c700 con 0x7f8fa809d6f0 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fae984700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8134110 con 0x7f8fa809e410 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 0x7f8fa8131630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fa7fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 0x7f8fa8131630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59848/0 (socket says 172.21.15.19:59848) 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fa7fff700 1 -- 172.21.15.19:0/814241493 learned_addr learned my addr 172.21.15.19:0/814241493 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 0x7f8fa81320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8fa77fe700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fa809e000 0x7f8fa8131b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7fd9265b4700 1 Processor -- start 2023-10-03T10:21:05.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 -- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 msgr2=0x7f8fa8131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 0x7f8fa8131630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 -- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fa809e000 msgr2=0x7f8fa8131b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fa809e000 0x7f8fa8131b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.384+0000 7f8facf21700 1 -- 172.21.15.19:0/814241493 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009a70 con 0x7f8fa809e410 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7f8facf21700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 0x7f8fa81320b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0016000 tx=0x7f8fa0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0012430 con 0x7f8fa809e410 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0020070 con 0x7f8fa809e410 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa8133db0 con 0x7f8fa809e410 2023-10-03T10:21:05.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa81327a0 con 0x7f8fa809e410 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 -- start start 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd92012cf60 0x7fd92006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012f8b0 0x7fd92012fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd920130260 0x7fd920136c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92012d330 con 0x7fd920130260 2023-10-03T10:21:05.388 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92012cd90 con 0x7fd92012cf60 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd9265b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201306d0 con 0x7fd92012f8b0 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd924b51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd920130260 0x7fd920136c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd924b51700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fd920130260 0x7fd920136c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35360/0 (socket says 172.21.15.19:35360) 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd92012cf60 0x7fd92006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.385+0000 7fd924b51700 1 -- 172.21.15.19:0/3511819125 learned_addr learned my addr 172.21.15.19:0/3511819125 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 -- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012f8b0 msgr2=0x7fd92012fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012f8b0 0x7fd92012fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 -- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd92012cf60 msgr2=0x7fd92006f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd92012cf60 0x7fd92006f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 -- 172.21.15.19:0/3511819125 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd920071780 con 0x7fd920130260 2023-10-03T10:21:05.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd924b51700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd920130260 0x7fd920136c20 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd91800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14070fef67327fed server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd91effd700 1 -- 172.21.15.19:0/3511819125 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800e070 con 0x7fd920130260 2023-10-03T10:21:05.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd91effd700 1 -- 172.21.15.19:0/3511819125 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91800b910 con 0x7fd920130260 2023-10-03T10:21:05.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7fd91effd700 1 -- 172.21.15.19:0/3511819125 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800bcc0 con 0x7fd920130260 2023-10-03T10:21:05.390 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.386+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004280 con 0x7f8fa809e410 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 -- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd920130260 msgr2=0x7fd920136c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd920130260 0x7fd920136c20 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e50 tx=0x7fd91800b330 comp rx=0 tx=0).stop 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 -- 172.21.15.19:0/3511819125 shutdown_connections 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd92012cf60 0x7fd92006f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd920130260 0x7fd920136c20 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 --2- 172.21.15.19:0/3511819125 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012f8b0 0x7fd92012fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7fd9265b4700 1 -- 172.21.15.19:0/3511819125 >> 172.21.15.19:0/3511819125 conn(0x7fd9200a2aa0 msgr2=0x7fd9200a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f8fa00043e0 con 0x7f8fa809e410 2023-10-03T10:21:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f8fa0022070 con 0x7f8fa809e410 2023-10-03T10:21:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.387+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa8074ea0 con 0x7f8fa809e410 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.388+0000 7fd9265b4700 1 -- 172.21.15.19:0/3511819125 shutdown_connections 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.388+0000 7fd9265b4700 1 -- 172.21.15.19:0/3511819125 wait complete. 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.389+0000 7fd9265b4700 1 Processor -- start 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.389+0000 7fd9265b4700 1 -- start start 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012cf60 0x7fd920099d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd920130260 0x7fd92009a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92009b1c0 con 0x7fd92012f8b0 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9201201e0 con 0x7fd920130260 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd9265b4700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd92011f0d0 con 0x7fd92012cf60 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd91f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd91f7fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35368/0 (socket says 172.21.15.19:35368) 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd91f7fe700 1 -- 172.21.15.19:0/267675516 learned_addr learned my addr 172.21.15.19:0/267675516 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd924b51700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd920130260 0x7fd92009a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.390+0000 7fd91ffff700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012cf60 0x7fd920099d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 -- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012cf60 msgr2=0x7fd920099d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012cf60 0x7fd920099d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.395 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 -- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd920130260 msgr2=0x7fd92009a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd920130260 0x7fd92009a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 -- 172.21.15.19:0/267675516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009b30 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91f7fe700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b500 tx=0x7fd91400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914011830 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92012d9b0 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9140119b0 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd914011d60 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.391+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92009ba30 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.393+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fd91401a400 con 0x7fd92012f8b0 2023-10-03T10:21:05.396 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.393+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fd91403f6f0 con 0x7fd92012f8b0 2023-10-03T10:21:05.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.393+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f8fa002c080 con 0x7f8fa809e410 2023-10-03T10:21:05.397 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.394+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd920074ea0 con 0x7fd92012f8b0 2023-10-03T10:21:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.403+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fd914015020 con 0x7fd92012f8b0 2023-10-03T10:21:05.437 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.438+0000 7fbf59056700 1 Processor -- start 2023-10-03T10:21:05.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.438+0000 7fbf59056700 1 -- start start 2023-10-03T10:21:05.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.438+0000 7fbf59056700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 0x7fbf540a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.438 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf59056700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf59056700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf540a2a70 con 0x7fbf5409d630 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf59056700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540a01d0 con 0x7fbf54138d80 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf59056700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5409e2b0 con 0x7fbf540a0a30 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf5359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 0x7fbf540a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf5359e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:59866/0 (socket says 172.21.15.19:59866) 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf5359e700 1 -- 172.21.15.19:0/1120453478 learned_addr learned my addr 172.21.15.19:0/1120453478 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.439 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf5259c700 1 --1- 172.21.15.19:0/1120453478 >> v1:172.21.15.19:6789/0 conn(0x7fbf5409d630 0x7fbf540a1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:34238/0 (socket says 172.21.15.19:34238) 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 -- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 msgr2=0x7fbf5413b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 -- 172.21.15.19:0/1120453478 >> v1:172.21.15.19:6789/0 conn(0x7fbf5409d630 legacy=0x7fbf540a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 -- 172.21.15.19:0/1120453478 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5409dc50 con 0x7fbf540a0a30 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf5359e700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf51d9b700 1 -- 172.21.15.19:0/1120453478 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265779473 0 0) 0x7fbf540a2a70 con 0x7fbf5409d630 2023-10-03T10:21:05.440 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.439+0000 7fbf52d9d700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 0x7fbf540a0e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf44009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61686c7a97b3b712 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf51d9b700 1 -- 172.21.15.19:0/1120453478 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011830 con 0x7fbf540a0a30 2023-10-03T10:21:05.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf51d9b700 1 -- 172.21.15.19:0/1120453478 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44011990 con 0x7fbf540a0a30 2023-10-03T10:21:05.441 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf51d9b700 1 -- 172.21.15.19:0/1120453478 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011d20 con 0x7fbf540a0a30 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 -- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 msgr2=0x7fbf540a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 0x7fbf540a0e00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fbf44009870 tx=0x7fbf44009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 -- 172.21.15.19:0/1120453478 shutdown_connections 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf5413b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 --2- 172.21.15.19:0/1120453478 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf540a0a30 0x7fbf540a0e00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 -- 172.21.15.19:0/1120453478 >> 172.21.15.19:0/1120453478 conn(0x7fbf540a3050 msgr2=0x7fbf540a3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 -- 172.21.15.19:0/1120453478 shutdown_connections 2023-10-03T10:21:05.442 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.440+0000 7fbf59056700 1 -- 172.21.15.19:0/1120453478 wait complete. 2023-10-03T10:21:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.442+0000 7fbf59056700 1 Processor -- start 2023-10-03T10:21:05.443 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.442+0000 7fbf59056700 1 -- start start 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf540a0a30 0x7fbf5408a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf54133790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540a0410 con 0x7fbf540a0a30 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54136ec0 con 0x7fbf54138d80 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf59056700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5413ac70 con 0x7fbf5409d630 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf52d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf52d9d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:50248/0 (socket says 172.21.15.19:50248) 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf52d9d700 1 -- 172.21.15.19:0/2108656306 learned_addr learned my addr 172.21.15.19:0/2108656306 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.443+0000 7fbf5359e700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf54133790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:05.444 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 -- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 msgr2=0x7fbf54133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf54133790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 -- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf540a0a30 msgr2=0x7fbf5408a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf540a0a30 0x7fbf5408a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 -- 172.21.15.19:0/2108656306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009b30 con 0x7fbf5409d630 2023-10-03T10:21:05.445 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf52d9d700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbf440090b0 tx=0x7fbf44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44004480 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4401f070 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.444+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440038e0 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.445+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf440094a0 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.445+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf541371a0 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.446+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbf44021030 con 0x7fbf5409d630 2023-10-03T10:21:05.446 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.446+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbf44040900 con 0x7fbf5409d630 2023-10-03T10:21:05.448 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.449+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf540747f0 con 0x7fbf5409d630 2023-10-03T10:21:05.458 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.458+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbf44015080 con 0x7fbf5409d630 2023-10-03T10:21:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.572+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b2c0713a0 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.572 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.572+0000 7f4b227fc700 1 -- 172.21.15.19:0/899872589 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4b28017030 con 0x7f4b2c06f5d0 2023-10-03T10:21:05.572 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 msgr2=0x7f4b2c09a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4b28001eb0 tx=0x7f4b2800c800 comp rx=0 tx=0).stop 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 shutdown_connections 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f4b2c135c20 0x7f4b2c1c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f4b2c06f5d0 0x7f4b2c09a1a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.576 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 --2- 172.21.15.19:0/899872589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4b2c12cf60 0x7f4b2c09a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 >> 172.21.15.19:0/899872589 conn(0x7f4b2c0a2aa0 msgr2=0x7f4b2c06e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 shutdown_connections 2023-10-03T10:21:05.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.576+0000 7f4b340e6700 1 -- 172.21.15.19:0/899872589 wait complete. 2023-10-03T10:21:05.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:05.608 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.608+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8fa8134250 con 0x7f8fa809e410 2023-10-03T10:21:05.609 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.609+0000 7f8fa4ff9700 1 -- 172.21.15.19:0/814241493 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8fa001b400 con 0x7f8fa809e410 2023-10-03T10:21:05.609 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 msgr2=0x7f8fa81320b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 0x7f8fa81320b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0016000 tx=0x7f8fa0004ad0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.611 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 shutdown_connections 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f8fa809e410 0x7f8fa81320b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f8fa809d6f0 0x7f8fa8131630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 --2- 172.21.15.19:0/814241493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8fa809e000 0x7f8fa8131b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 >> 172.21.15.19:0/814241493 conn(0x7f8fa8066f50 msgr2=0x7f8fa80a20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 shutdown_connections 2023-10-03T10:21:05.612 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.611+0000 7f8fae984700 1 -- 172.21.15.19:0/814241493 wait complete. 2023-10-03T10:21:05.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:05.631 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.632+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd9200713a0 con 0x7fd92012f8b0 2023-10-03T10:21:05.632 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.632+0000 7fd91cff9700 1 -- 172.21.15.19:0/267675516 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd914029090 con 0x7fd92012f8b0 2023-10-03T10:21:05.632 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:05.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 msgr2=0x7fd92009a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b500 tx=0x7fd91400b810 comp rx=0 tx=0).stop 2023-10-03T10:21:05.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 shutdown_connections 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fd920130260 0x7fd92009a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fd92012cf60 0x7fd920099d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 --2- 172.21.15.19:0/267675516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd92012f8b0 0x7fd92009a2c0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 >> 172.21.15.19:0/267675516 conn(0x7fd9200a2aa0 msgr2=0x7fd92009e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 shutdown_connections 2023-10-03T10:21:05.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.634+0000 7fd9265b4700 1 -- 172.21.15.19:0/267675516 wait complete. 2023-10-03T10:21:05.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:05.671 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.672+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbf54072980 con 0x7fbf5409d630 2023-10-03T10:21:05.672 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.672+0000 7fbf3b7fe700 1 -- 172.21.15.19:0/2108656306 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbf44003a40 con 0x7fbf5409d630 2023-10-03T10:21:05.672 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 msgr2=0x7fbf5408a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbf440090b0 tx=0x7fbf44004750 comp rx=0 tx=0).stop 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 shutdown_connections 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbf54138d80 0x7fbf54133790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbf5409d630 0x7fbf5408a0c0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 --2- 172.21.15.19:0/2108656306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbf540a0a30 0x7fbf5408a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 >> 172.21.15.19:0/2108656306 conn(0x7fbf540a3050 msgr2=0x7fbf5409ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 shutdown_connections 2023-10-03T10:21:05.675 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:05.674+0000 7fbf59056700 1 -- 172.21.15.19:0/2108656306 wait complete. 2023-10-03T10:21:05.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:06.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:06.626 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:06.649 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:06.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.744+0000 7f5074676700 1 Processor -- start 2023-10-03T10:21:06.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.744+0000 7f5074676700 1 -- start start 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5074676700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f506c09d760 0x7f506c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5074676700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f506c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5074676700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c06b0a0 con 0x7f506c09e070 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5074676700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06b6d0 con 0x7f506c09d760 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5074676700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506c09b1c0 con 0x7f506c134130 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5071c11700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f506c09e070 0x7f506c133a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39962/0 (socket says 172.21.15.19:39962) 2023-10-03T10:21:06.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.745+0000 7f5071c11700 1 -- 172.21.15.19:0/3927572247 learned_addr learned my addr 172.21.15.19:0/3927572247 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:06.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5072412700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f506c09d760 0x7f506c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261773332 0 0) 0x7f506c06b0a0 con 0x7f506c09e070 2023-10-03T10:21:06.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50580035b0 con 0x7f506c09e070 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5072c13700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f506c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v1:172.21.15.19:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667711140 0 0) 0x7f50580035b0 con 0x7f506c09e070 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 msgr2=0x7f506c13bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f506c13bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f506c09d760 msgr2=0x7f506c09db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f506c09d760 0x7f506c09db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 --> v1:172.21.15.19:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c06b490 con 0x7f506c09e070 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v1:172.21.15.19:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3014450292 0 0) 0x7f505c0016c0 con 0x7f506c09e070 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 >> v1:172.21.15.19:6789/0 conn(0x7f506c09e070 legacy=0x7f506c133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f5058003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f5058005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c09b1c0 con 0x7f5058003fb0 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505800ba10 con 0x7f5058004d90 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f505800bb50 con 0x7f506c134130 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5072c13700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f5058005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5071c11700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.746+0000 7f5072412700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f5058003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 -- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 msgr2=0x7f5058003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f5058003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 -- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 msgr2=0x7f5058005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f5058005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 -- 172.21.15.19:0/3927572247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c06b490 con 0x7f5058003fb0 2023-10-03T10:21:06.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071c11700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f5058004850 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c340 tx=0x7f5058005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210fbd841c87f95e server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c007d00 con 0x7f5058003fb0 2023-10-03T10:21:06.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c005960 con 0x7f5058003fb0 2023-10-03T10:21:06.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.747+0000 7f5071410700 1 -- 172.21.15.19:0/3927572247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c005cf0 con 0x7f5058003fb0 2023-10-03T10:21:06.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 -- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 msgr2=0x7f5058004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f5058004850 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c340 tx=0x7f5058005880 comp rx=0 tx=0).stop 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 -- 172.21.15.19:0/3927572247 shutdown_connections 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f5058005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f5058004850 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 --2- 172.21.15.19:0/3927572247 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c134130 0x7f5058003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 -- 172.21.15.19:0/3927572247 >> 172.21.15.19:0/3927572247 conn(0x7f506c066f50 msgr2=0x7f506c0a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 -- 172.21.15.19:0/3927572247 shutdown_connections 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.748+0000 7f5074676700 1 -- 172.21.15.19:0/3927572247 wait complete. 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.750+0000 7f5074676700 1 Processor -- start 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.750+0000 7f5074676700 1 -- start start 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f506c122960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c09e070 0x7f506c122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c125230 con 0x7f5058003fb0 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c123880 con 0x7f5058004d90 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5074676700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f506c124160 con 0x7f506c09e070 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45350/0 (socket says 172.21.15.19:45350) 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 -- 172.21.15.19:0/201569367 learned_addr learned my addr 172.21.15.19:0/201569367 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 -- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c09e070 msgr2=0x7f506c122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c09e070 0x7f506c122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 -- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 msgr2=0x7f506c122960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f506c122960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 -- 172.21.15.19:0/201569367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c124e70 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.751+0000 7f5072412700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f5068011950 tx=0x7f5068011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.752+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068004240 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.752+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680043a0 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.752+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c09c6f0 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.752+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680036a0 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.752+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c125c10 con 0x7f5058003fb0 2023-10-03T10:21:06.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.753+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c0729a0 con 0x7f5058003fb0 2023-10-03T10:21:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.754+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f5068003820 con 0x7f5058003fb0 2023-10-03T10:21:06.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.754+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f506803ffc0 con 0x7f5058003fb0 2023-10-03T10:21:06.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.760+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f506801cdc0 con 0x7f5058003fb0 2023-10-03T10:21:06.786 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.786+0000 7fe0d6aa0700 1 Processor -- start 2023-10-03T10:21:06.787 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 -- start start 2023-10-03T10:21:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 0x7fe0d0131be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.788 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d0099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d01313c0 con 0x7fe0d009a3b0 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d009b580 con 0x7fe0d0099a40 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.787+0000 7fe0d6aa0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d006e8c0 con 0x7fe0d0131810 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d503d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe0d009a3b0 0x7fe0d0138650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39978/0 (socket says 172.21.15.19:39978) 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d503d700 1 -- 172.21.15.19:0/413066270 learned_addr learned my addr 172.21.15.19:0/413066270 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 0x7fe0d0131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0cf7fe700 1 -- 172.21.15.19:0/413066270 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756595743 0 0) 0x7fe0d01313c0 con 0x7fe0d009a3b0 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0cf7fe700 1 -- 172.21.15.19:0/413066270 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0c00035b0 con 0x7fe0d009a3b0 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 -- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 msgr2=0x7fe0d0099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d0099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 -- 172.21.15.19:0/413066270 >> v1:172.21.15.19:6789/0 conn(0x7fe0d009a3b0 legacy=0x7fe0d0138650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.789 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 -- 172.21.15.19:0/413066270 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d009a820 con 0x7fe0d0131810 2023-10-03T10:21:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0d483c700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 0x7fe0d0131be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009870 tx=0x7fe0c4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4acab2935bb39c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0cf7fe700 1 -- 172.21.15.19:0/413066270 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011830 con 0x7fe0d0131810 2023-10-03T10:21:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.788+0000 7fe0cf7fe700 1 -- 172.21.15.19:0/413066270 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c4011990 con 0x7fe0d0131810 2023-10-03T10:21:06.790 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0cf7fe700 1 -- 172.21.15.19:0/413066270 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4011d20 con 0x7fe0d0131810 2023-10-03T10:21:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 msgr2=0x7fe0d0131be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 0x7fe0d0131be0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4009870 tx=0x7fe0c4009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:06.791 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/413066270 shutdown_connections 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d0131810 0x7fe0d0131be0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/413066270 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d0099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/413066270 >> 172.21.15.19:0/413066270 conn(0x7fe0d00a2aa0 msgr2=0x7fe0d00a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/413066270 shutdown_connections 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.789+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/413066270 wait complete. 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.790+0000 7fe0d6aa0700 1 Processor -- start 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 -- start start 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.792 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 0x7fe0d006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 0x7fe0d0070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d011e360 con 0x7fe0d0131810 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d011ecd0 con 0x7fe0d0099a40 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d6aa0700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d011db80 con 0x7fe0d009a3b0 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d483c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d483c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37008/0 (socket says 172.21.15.19:37008) 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d483c700 1 -- 172.21.15.19:0/2594979301 learned_addr learned my addr 172.21.15.19:0/2594979301 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.791+0000 7fe0d503d700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 0x7fe0d0070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.793 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0cffff700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 0x7fe0d006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.796 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 -- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 msgr2=0x7fe0d006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 0x7fe0d006fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 -- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 msgr2=0x7fe0d0070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 0x7fe0d0070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 -- 172.21.15.19:0/2594979301 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40094a0 con 0x7fe0d0099a40 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d503d700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 0x7fe0d0070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0cffff700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 0x7fe0d006fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0d483c700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4004510 con 0x7fe0d0099a40 2023-10-03T10:21:06.797 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c40036a0 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.792+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4003a50 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.793+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d006eb00 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.793+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d011d290 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.794+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d0074ea0 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.794+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe0c4003bb0 con 0x7fe0d0099a40 2023-10-03T10:21:06.798 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.794+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe0c40402b0 con 0x7fe0d0099a40 2023-10-03T10:21:06.799 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.799+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe0c4003e60 con 0x7fe0d0099a40 2023-10-03T10:21:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.839+0000 7f937f13e700 1 Processor -- start 2023-10-03T10:21:06.839 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.839+0000 7f937f13e700 1 -- start start 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937f13e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937f13e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809e000 0x7f93781339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937f13e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937809b120 con 0x7f937809e410 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937f13e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937806b460 con 0x7f937809d6f0 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937f13e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f937809a7e0 con 0x7f937809e000 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937d6db700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f937809e410 0x7f9378133f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39994/0 (socket says 172.21.15.19:39994) 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937d6db700 1 -- 172.21.15.19:0/3860690087 learned_addr learned my addr 172.21.15.19:0/3860690087 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937ceda700 1 --2- 172.21.15.19:0/3860690087 >> v2:172.21.15.19:3300/0 conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f9377fff700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809e000 0x7f93781339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937ceda700 1 -- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809e000 msgr2=0x7f93781339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937ceda700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809e000 0x7f93781339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937ceda700 1 -- 172.21.15.19:0/3860690087 >> v1:172.21.15.19:6789/0 conn(0x7f937809e410 legacy=0x7f9378133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.840+0000 7f937ceda700 1 -- 172.21.15.19:0/3860690087 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937809a500 con 0x7f937809d6f0 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f937ceda700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809d6f0 0x7f937809dac0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f936c009840 tx=0x7f936c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b929dbcf7197839a server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f93777fe700 1 -- 172.21.15.19:0/3860690087 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c011830 con 0x7f937809d6f0 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f93777fe700 1 -- 172.21.15.19:0/3860690087 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c011990 con 0x7f937809d6f0 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f93777fe700 1 -- 172.21.15.19:0/3860690087 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c011d20 con 0x7f937809d6f0 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f937f13e700 1 -- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809d6f0 msgr2=0x7f937809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.841+0000 7f937f13e700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809d6f0 0x7f937809dac0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f936c009840 tx=0x7f936c009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 -- 172.21.15.19:0/3860690087 shutdown_connections 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809d6f0 0x7f937809dac0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 --2- 172.21.15.19:0/3860690087 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809e000 0x7f93781339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 -- 172.21.15.19:0/3860690087 >> 172.21.15.19:0/3860690087 conn(0x7f9378066f50 msgr2=0x7f937809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:06.842 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 -- 172.21.15.19:0/3860690087 shutdown_connections 2023-10-03T10:21:06.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.842+0000 7f937f13e700 1 -- 172.21.15.19:0/3860690087 wait complete. 2023-10-03T10:21:06.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 Processor -- start 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 -- start start 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f937809e000 0x7f93781a63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809e410 0x7f93781a6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93781a7340 con 0x7f937809e410 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93781a7ac0 con 0x7f937809e000 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.843+0000 7f937f13e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93781a80e0 con 0x7f937809d6f0 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41610/0 (socket says 172.21.15.19:41610) 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 -- 172.21.15.19:0/81525535 learned_addr learned my addr 172.21.15.19:0/81525535 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f9377fff700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f937809e000 0x7f93781a63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937d6db700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809e410 0x7f93781a6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 -- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f937809e000 msgr2=0x7f93781a63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f937809e000 0x7f93781a63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 -- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809e410 msgr2=0x7f93781a6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809e410 0x7f93781a6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 -- 172.21.15.19:0/81525535 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c0094a0 con 0x7f937809d6f0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.844+0000 7f937ceda700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f936c009fd0 tx=0x7f936c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.845+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0036a0 con 0x7f937809d6f0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.845+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c01e070 con 0x7f937809d6f0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.845+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93781a96f0 con 0x7f937809d6f0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.845+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c003a40 con 0x7f937809d6f0 2023-10-03T10:21:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.845+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937809c710 con 0x7f937809d6f0 2023-10-03T10:21:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.846+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378074ea0 con 0x7f937809d6f0 2023-10-03T10:21:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.846+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f936c003ba0 con 0x7f937809d6f0 2023-10-03T10:21:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.847+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f936c040770 con 0x7f937809d6f0 2023-10-03T10:21:06.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.852+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f936c010970 con 0x7f937809d6f0 2023-10-03T10:21:06.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.898+0000 7f074a166700 1 Processor -- start 2023-10-03T10:21:06.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.898+0000 7f074a166700 1 -- start start 2023-10-03T10:21:06.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.898+0000 7f074a166700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.898+0000 7f074a166700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f074406b080 0x7f0744131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f074a166700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074409ece0 con 0x7f0744131b40 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f074a166700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074409e760 con 0x7f074406b080 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f074a166700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f074409e040 con 0x7f074406a770 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f074406b080 0x7f0744131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f07437fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f074406b080 0x7f0744131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45382/0 (socket says 172.21.15.19:45382) 2023-10-03T10:21:06.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 -- 172.21.15.19:0/1932258394 learned_addr learned my addr 172.21.15.19:0/1932258394 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 -- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 msgr2=0x7f074406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 --2- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 -- 172.21.15.19:0/1932258394 >> v1:172.21.15.19:6789/0 conn(0x7f0744131b40 legacy=0x7f0744138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 -- 172.21.15.19:0/1932258394 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074409f630 con 0x7f074406b080 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.899+0000 7f0742ffd700 1 --2- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f074406b080 0x7f0744131600 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f07380098f0 tx=0x7f0738009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56cffcc186b1270 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.900+0000 7f07427fc700 1 -- 172.21.15.19:0/1932258394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738011830 con 0x7f074406b080 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.900+0000 7f07427fc700 1 -- 172.21.15.19:0/1932258394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738011990 con 0x7f074406b080 2023-10-03T10:21:06.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.900+0000 7f07427fc700 1 -- 172.21.15.19:0/1932258394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738011d20 con 0x7f074406b080 2023-10-03T10:21:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.900+0000 7f074a166700 1 -- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f074406b080 msgr2=0x7f0744131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.900+0000 7f074a166700 1 --2- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f074406b080 0x7f0744131600 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f07380098f0 tx=0x7f0738009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 -- 172.21.15.19:0/1932258394 shutdown_connections 2023-10-03T10:21:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 --2- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 --2- 172.21.15.19:0/1932258394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f074406b080 0x7f0744131600 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 -- 172.21.15.19:0/1932258394 >> 172.21.15.19:0/1932258394 conn(0x7f0744066f50 msgr2=0x7f074409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:06.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 -- 172.21.15.19:0/1932258394 shutdown_connections 2023-10-03T10:21:06.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.901+0000 7f074a166700 1 -- 172.21.15.19:0/1932258394 wait complete. 2023-10-03T10:21:06.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.902+0000 7f074a166700 1 Processor -- start 2023-10-03T10:21:06.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.902+0000 7f074a166700 1 -- start start 2023-10-03T10:21:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074411c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074411def0 con 0x7f0744131b40 2023-10-03T10:21:06.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0744071e60 con 0x7f074406b080 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f074a166700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0744131250 con 0x7f074406a770 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f0743fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f0743fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45390/0 (socket says 172.21.15.19:45390) 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37032/0 (socket says 172.21.15.19:37032) 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f0743fff700 1 -- 172.21.15.19:0/1827974202 learned_addr learned my addr 172.21.15.19:0/1827974202 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:06.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.903+0000 7f07437fe700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074411c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:06.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 -- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 msgr2=0x7f074411c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074411c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 -- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 msgr2=0x7f074411c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 -- 172.21.15.19:0/1827974202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0738009550 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0742ffd700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f0743fff700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f073c00cc50 tx=0x7f073c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c003c00 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c003d60 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074411f860 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00aab0 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.904+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0744120590 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.905+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f073c00ac10 con 0x7f0744131b40 2023-10-03T10:21:06.906 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.905+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f073c03f660 con 0x7f0744131b40 2023-10-03T10:21:06.907 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.906+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0744074ea0 con 0x7f0744131b40 2023-10-03T10:21:06.910 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:06.911+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f073c0198f0 con 0x7f0744131b40 2023-10-03T10:21:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.029+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe0d006b9e0 con 0x7fe0d0099a40 2023-10-03T10:21:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.029+0000 7fe0cd7fa700 1 -- 172.21.15.19:0/2594979301 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0c4028020 con 0x7fe0d0099a40 2023-10-03T10:21:07.029 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.031+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 msgr2=0x7fe0d006f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.031+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4000c00 tx=0x7fe0c4004750 comp rx=0 tx=0).stop 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 shutdown_connections 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d0131810 0x7fe0d0070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe0d0099a40 0x7fe0d006f5e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 --2- 172.21.15.19:0/2594979301 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe0d009a3b0 0x7fe0d006fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 >> 172.21.15.19:0/2594979301 conn(0x7fe0d00a2aa0 msgr2=0x7fe0d012e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 shutdown_connections 2023-10-03T10:21:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.032+0000 7fe0d6aa0700 1 -- 172.21.15.19:0/2594979301 wait complete. 2023-10-03T10:21:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.036+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f506c11f060 con 0x7f5058003fb0 2023-10-03T10:21:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.037+0000 7f5062ffd700 1 -- 172.21.15.19:0/201569367 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5068019030 con 0x7f5058003fb0 2023-10-03T10:21:07.036 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 msgr2=0x7f506c122420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f5068011950 tx=0x7f5068011d10 comp rx=0 tx=0).stop 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 shutdown_connections 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f506c09e070 0x7f506c122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5058003fb0 0x7f506c122420 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 --2- 172.21.15.19:0/201569367 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f5058004d90 0x7f506c122960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 >> 172.21.15.19:0/201569367 conn(0x7f506c066f50 msgr2=0x7f506c072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 shutdown_connections 2023-10-03T10:21:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.039+0000 7f5074676700 1 -- 172.21.15.19:0/201569367 wait complete. 2023-10-03T10:21:07.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:07.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:07.090 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.090+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f937806c360 con 0x7f937809d6f0 2023-10-03T10:21:07.091 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.091+0000 7f93757fa700 1 -- 172.21.15.19:0/81525535 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f936c015030 con 0x7f937809d6f0 2023-10-03T10:21:07.091 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 msgr2=0x7f93781a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f936c009fd0 tx=0x7f936c004750 comp rx=0 tx=0).stop 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 shutdown_connections 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f937809e410 0x7f93781a6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f937809d6f0 0x7f93781a5eb0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 --2- 172.21.15.19:0/81525535 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f937809e000 0x7f93781a63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.093 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 >> 172.21.15.19:0/81525535 conn(0x7f9378066f50 msgr2=0x7f93781badf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:07.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 shutdown_connections 2023-10-03T10:21:07.094 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.093+0000 7f937f13e700 1 -- 172.21.15.19:0/81525535 wait complete. 2023-10-03T10:21:07.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:07.139 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.140+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f074411fe60 con 0x7f0744131b40 2023-10-03T10:21:07.140 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.140+0000 7f072bfff700 1 -- 172.21.15.19:0/1827974202 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f073c019300 con 0x7f0744131b40 2023-10-03T10:21:07.140 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:07.142 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.142+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 msgr2=0x7f074411cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.142+0000 7f074a166700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f073c00cc50 tx=0x7f073c00cf60 comp rx=0 tx=0).stop 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 shutdown_connections 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0744131b40 0x7f074411cd60 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f074406a770 0x7f074411c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 --2- 172.21.15.19:0/1827974202 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f074406b080 0x7f074411c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 >> 172.21.15.19:0/1827974202 conn(0x7f0744066f50 msgr2=0x7f07440a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 shutdown_connections 2023-10-03T10:21:07.143 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:07.143+0000 7f074a166700 1 -- 172.21.15.19:0/1827974202 wait complete. 2023-10-03T10:21:07.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:08.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-03T10:21:08.060 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:08.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:08.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:08.204 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.204+0000 7fef96a64700 1 Processor -- start 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.204+0000 7fef96a64700 1 -- start start 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef96a64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef96a64700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 0x7fef9006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef96a64700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef90070ee0 con 0x7fef90134610 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef96a64700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef90071480 con 0x7fef9009eca0 2023-10-03T10:21:08.205 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef96a64700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9006f3c0 con 0x7fef9006e570 2023-10-03T10:21:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef8ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 0x7fef9006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef94800700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef8ffff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 0x7fef9006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45398/0 (socket says 172.21.15.19:45398) 2023-10-03T10:21:08.206 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef94800700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37040/0 (socket says 172.21.15.19:37040) 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.205+0000 7fef8ffff700 1 -- 172.21.15.19:0/3647152135 learned_addr learned my addr 172.21.15.19:0/3647152135 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef94800700 1 -- 172.21.15.19:0/3647152135 >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 msgr2=0x7fef9006ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef94800700 1 --2- 172.21.15.19:0/3647152135 >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 0x7fef9006ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef94800700 1 -- 172.21.15.19:0/3647152135 >> v1:172.21.15.19:6789/0 conn(0x7fef90134610 legacy=0x7fef90134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef94800700 1 -- 172.21.15.19:0/3647152135 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90071b90 con 0x7fef9006e570 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef94800700 1 --2- 172.21.15.19:0/3647152135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fef84009840 tx=0x7fef84009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f9612356cc4b7d server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef8f7fe700 1 -- 172.21.15.19:0/3647152135 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84011830 con 0x7fef9006e570 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef8f7fe700 1 -- 172.21.15.19:0/3647152135 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84011990 con 0x7fef9006e570 2023-10-03T10:21:08.207 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.206+0000 7fef8f7fe700 1 -- 172.21.15.19:0/3647152135 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84011d20 con 0x7fef9006e570 2023-10-03T10:21:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 -- 172.21.15.19:0/3647152135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 msgr2=0x7fef9006e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 --2- 172.21.15.19:0/3647152135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fef84009840 tx=0x7fef84009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:08.208 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 -- 172.21.15.19:0/3647152135 shutdown_connections 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 --2- 172.21.15.19:0/3647152135 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef9006e570 0x7fef9006e940 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 --2- 172.21.15.19:0/3647152135 >> v2:172.21.15.19:3300/0 conn(0x7fef9009eca0 0x7fef9006ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.207+0000 7fef96a64700 1 -- 172.21.15.19:0/3647152135 >> 172.21.15.19:0/3647152135 conn(0x7fef900a2aa0 msgr2=0x7fef900a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.208+0000 7fef96a64700 1 -- 172.21.15.19:0/3647152135 shutdown_connections 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.208+0000 7fef96a64700 1 -- 172.21.15.19:0/3647152135 wait complete. 2023-10-03T10:21:08.209 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 Processor -- start 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 -- start start 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef9006e570 0x7fef90140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 0x7fef90133080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9013cb10 con 0x7fef901335c0 2023-10-03T10:21:08.210 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9013da20 con 0x7fef90134610 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.209+0000 7fef96a64700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fef9013dc90 con 0x7fef9006e570 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45408/0 (socket says 172.21.15.19:45408) 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 -- 172.21.15.19:0/1036169055 learned_addr learned my addr 172.21.15.19:0/1036169055 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef94800700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef9006e570 0x7fef90140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef8ffff700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 0x7fef90133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 -- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef9006e570 msgr2=0x7fef90140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef9006e570 0x7fef90140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 -- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 msgr2=0x7fef90133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 0x7fef90133080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 -- 172.21.15.19:0/1036169055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef840094a0 con 0x7fef901335c0 2023-10-03T10:21:08.211 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef8ffff700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 0x7fef90133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:21:08.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.210+0000 7fef95001700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fef8800cc50 tx=0x7fef8800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.211+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88003c00 con 0x7fef901335c0 2023-10-03T10:21:08.212 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.211+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef88003d60 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.211+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef901343d0 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.211+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8800ab60 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.212+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef900a2150 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.213+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fef8800acc0 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.213+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef90070670 con 0x7fef901335c0 2023-10-03T10:21:08.213 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.213+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fef8803f7c0 con 0x7fef901335c0 2023-10-03T10:21:08.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.222+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fef880198f0 con 0x7fef901335c0 2023-10-03T10:21:08.240 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.240+0000 7f0e6a937700 1 Processor -- start 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.240+0000 7f0e6a937700 1 -- start start 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e6a937700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 0x7f0e6409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e6a937700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f650 0x7f0e64131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e6a937700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e64070940 con 0x7f0e6409f240 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e6a937700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6406fd60 con 0x7f0e6409e930 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e6a937700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6406fa80 con 0x7f0e6409f650 2023-10-03T10:21:08.241 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e637fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0e6409f240 0x7f0e641317f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40018/0 (socket says 172.21.15.19:40018) 2023-10-03T10:21:08.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e637fe700 1 -- 172.21.15.19:0/2725741810 learned_addr learned my addr 172.21.15.19:0/2725741810 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:08.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e68ed4700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f650 0x7f0e64131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.242 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.241+0000 7f0e63fff700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 0x7f0e6409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e62ffd700 1 -- 172.21.15.19:0/2725741810 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058852994 0 0) 0x7f0e64070940 con 0x7f0e6409f240 2023-10-03T10:21:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e62ffd700 1 -- 172.21.15.19:0/2725741810 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c0035b0 con 0x7f0e6409f240 2023-10-03T10:21:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e63fff700 1 -- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f650 msgr2=0x7f0e64131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e63fff700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f650 0x7f0e64131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.243 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e63fff700 1 -- 172.21.15.19:0/2725741810 >> v1:172.21.15.19:6789/0 conn(0x7f0e6409f240 legacy=0x7f0e641317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e63fff700 1 -- 172.21.15.19:0/2725741810 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6409fb60 con 0x7f0e6409e930 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e63fff700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 0x7f0e6409ed00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009870 tx=0x7f0e54009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce1b7c0ba48fb32 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e62ffd700 1 -- 172.21.15.19:0/2725741810 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54010a90 con 0x7f0e6409e930 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e62ffd700 1 -- 172.21.15.19:0/2725741810 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e54010bf0 con 0x7f0e6409e930 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.242+0000 7f0e62ffd700 1 -- 172.21.15.19:0/2725741810 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54018440 con 0x7f0e6409e930 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 -- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 msgr2=0x7f0e6409ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 0x7f0e6409ed00 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f0e54009870 tx=0x7f0e54009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 -- 172.21.15.19:0/2725741810 shutdown_connections 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f650 0x7f0e64131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 --2- 172.21.15.19:0/2725741810 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409e930 0x7f0e6409ed00 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 -- 172.21.15.19:0/2725741810 >> 172.21.15.19:0/2725741810 conn(0x7f0e640a4210 msgr2=0x7f0e640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.244 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 -- 172.21.15.19:0/2725741810 shutdown_connections 2023-10-03T10:21:08.245 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.243+0000 7f0e6a937700 1 -- 172.21.15.19:0/2725741810 wait complete. 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.244+0000 7f0e6a937700 1 Processor -- start 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.244+0000 7f0e6a937700 1 -- start start 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 0x7f0e6411e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f240 0x7f0e6411e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 0x7f0e6411ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.246 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e641219e0 con 0x7f0e6409e930 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6411f6f0 con 0x7f0e6409f650 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e6a937700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0e641316a0 con 0x7f0e6409f240 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e68ed4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 0x7f0e6411ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e68ed4700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 0x7f0e6411ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37068/0 (socket says 172.21.15.19:37068) 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e68ed4700 1 -- 172.21.15.19:0/68485643 learned_addr learned my addr 172.21.15.19:0/68485643 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 0x7f0e6411e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e637fe700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f240 0x7f0e6411e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 -- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f240 msgr2=0x7f0e6411e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f240 0x7f0e6411e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 -- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 msgr2=0x7f0e6411ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 0x7f0e6411ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.247 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.245+0000 7f0e63fff700 1 -- 172.21.15.19:0/68485643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540094a0 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e63fff700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 0x7f0e6411e300 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0e5401a000 tx=0x7f0e54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54003b70 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e54003cf0 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640a0190 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54023690 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.246+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e640a2f40 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.247+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6409a6d0 con 0x7f0e6409e930 2023-10-03T10:21:08.248 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.247+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0e5401f070 con 0x7f0e6409e930 2023-10-03T10:21:08.254 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.247+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0e5402bd40 con 0x7f0e6409e930 2023-10-03T10:21:08.256 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.256+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0e5404a060 con 0x7f0e6409e930 2023-10-03T10:21:08.290 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.291+0000 7f9495581700 1 Processor -- start 2023-10-03T10:21:08.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.291+0000 7f9495581700 1 -- start start 2023-10-03T10:21:08.291 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f9495581700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f949009d6f0 0x7f949009dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f9495581700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e440 0x7f9490134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f9495581700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f949009b120 con 0x7f949009e000 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f9495581700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949006b460 con 0x7f949009d6f0 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f9495581700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f949009a7e0 con 0x7f949009e440 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948effd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f949009d6f0 0x7f949009dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948e7fc700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f949009e000 0x7f94901339f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:40022/0 (socket says 172.21.15.19:40022) 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948e7fc700 1 -- 172.21.15.19:0/3950776022 learned_addr learned my addr 172.21.15.19:0/3950776022 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:21:08.292 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948f7fe700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e440 0x7f9490134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948dffb700 1 -- 172.21.15.19:0/3950776022 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443560110 0 0) 0x7f949009b120 con 0x7f949009e000 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948dffb700 1 -- 172.21.15.19:0/3950776022 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94780035b0 con 0x7f949009e000 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948effd700 1 -- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e440 msgr2=0x7f9490134100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948effd700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e440 0x7f9490134100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948effd700 1 -- 172.21.15.19:0/3950776022 >> v1:172.21.15.19:6789/0 conn(0x7f949009e000 legacy=0x7f94901339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.292+0000 7f948effd700 1 -- 172.21.15.19:0/3950776022 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f949009a500 con 0x7f949009d6f0 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.293+0000 7f948effd700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f949009dac0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f9480009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709ec044ca489eb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.293+0000 7f948dffb700 1 -- 172.21.15.19:0/3950776022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480011830 con 0x7f949009d6f0 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.293+0000 7f948dffb700 1 -- 172.21.15.19:0/3950776022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480011990 con 0x7f949009d6f0 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.293+0000 7f948dffb700 1 -- 172.21.15.19:0/3950776022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480011d20 con 0x7f949009d6f0 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 -- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 msgr2=0x7f949009dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f949009dac0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f9480009870 tx=0x7f9480009b80 comp rx=0 tx=0).stop 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 -- 172.21.15.19:0/3950776022 shutdown_connections 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e440 0x7f9490134100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 --2- 172.21.15.19:0/3950776022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f949009dac0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 -- 172.21.15.19:0/3950776022 >> 172.21.15.19:0/3950776022 conn(0x7f9490066f50 msgr2=0x7f949009f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 -- 172.21.15.19:0/3950776022 shutdown_connections 2023-10-03T10:21:08.295 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.294+0000 7f9495581700 1 -- 172.21.15.19:0/3950776022 wait complete. 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.296+0000 7f9495581700 1 Processor -- start 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.296+0000 7f9495581700 1 -- start start 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.296+0000 7f9495581700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.296+0000 7f9495581700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 0x7f94901c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f9495581700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f949009e440 0x7f94901c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.297 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f9495581700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94901a67c0 con 0x7f949009d6f0 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f9495581700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94901a65d0 con 0x7f949009e000 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f9495581700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f94901a6ea0 con 0x7f949009e440 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948effd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45438/0 (socket says 172.21.15.19:45438) 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948effd700 1 -- 172.21.15.19:0/753559949 learned_addr learned my addr 172.21.15.19:0/753559949 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 0x7f94901c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948f7fe700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f949009e440 0x7f94901c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 -- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f949009e440 msgr2=0x7f94901c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f949009e440 0x7f94901c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 -- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 msgr2=0x7f94901c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.298 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 -- 172.21.15.19:0/753559949 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800094a0 con 0x7f949009e000 2023-10-03T10:21:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948effd700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:21:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.297+0000 7f948e7fc700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 0x7f94901c8790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f948400c4c0 tx=0x7f948400c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.298+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484005d70 con 0x7f949009e000 2023-10-03T10:21:08.299 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.298+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94840070d0 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.298+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94901a84e0 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.298+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484007440 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.298+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94901a8200 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.299+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9490074ea0 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.300+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f94840075a0 con 0x7f949009e000 2023-10-03T10:21:08.300 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.300+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f948403ec70 con 0x7f949009e000 2023-10-03T10:21:08.308 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.309+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9484018af0 con 0x7f949009e000 2023-10-03T10:21:08.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.348+0000 7f063e39c700 1 Processor -- start 2023-10-03T10:21:08.348 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.348+0000 7f063e39c700 1 -- start start 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f063e39c700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f063809d6f0 0x7f063809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f063e39c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f063e39c700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063809b120 con 0x7f063809e410 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f063e39c700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063806b460 con 0x7f063809d6f0 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f063e39c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063809a7e0 con 0x7f063809e000 2023-10-03T10:21:08.349 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f06377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f0637fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f063809d6f0 0x7f063809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f06377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37098/0 (socket says 172.21.15.19:37098) 2023-10-03T10:21:08.350 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.349+0000 7f06377fe700 1 -- 172.21.15.19:0/1604267372 learned_addr learned my addr 172.21.15.19:0/1604267372 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f06377fe700 1 -- 172.21.15.19:0/1604267372 >> v2:172.21.15.19:3300/0 conn(0x7f063809d6f0 msgr2=0x7f063809dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f06377fe700 1 --2- 172.21.15.19:0/1604267372 >> v2:172.21.15.19:3300/0 conn(0x7f063809d6f0 0x7f063809dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f06377fe700 1 -- 172.21.15.19:0/1604267372 >> v1:172.21.15.19:6789/0 conn(0x7f063809e410 legacy=0x7f0638133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f06377fe700 1 -- 172.21.15.19:0/1604267372 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063809a500 con 0x7f063809e000 2023-10-03T10:21:08.351 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f06377fe700 1 --2- 172.21.15.19:0/1604267372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f062c009920 tx=0x7f062c009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34572058b6bd9db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f0636ffd700 1 -- 172.21.15.19:0/1604267372 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011830 con 0x7f063809e000 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f0636ffd700 1 -- 172.21.15.19:0/1604267372 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c011990 con 0x7f063809e000 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.350+0000 7f0636ffd700 1 -- 172.21.15.19:0/1604267372 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c011d20 con 0x7f063809e000 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 -- 172.21.15.19:0/1604267372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 msgr2=0x7f06381339f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 --2- 172.21.15.19:0/1604267372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f062c009920 tx=0x7f062c009c30 comp rx=0 tx=0).stop 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 -- 172.21.15.19:0/1604267372 shutdown_connections 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 --2- 172.21.15.19:0/1604267372 >> v2:172.21.15.19:3300/0 conn(0x7f063809d6f0 0x7f063809dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 --2- 172.21.15.19:0/1604267372 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381339f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 -- 172.21.15.19:0/1604267372 >> 172.21.15.19:0/1604267372 conn(0x7f0638066f50 msgr2=0x7f063809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 -- 172.21.15.19:0/1604267372 shutdown_connections 2023-10-03T10:21:08.352 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.351+0000 7f063e39c700 1 -- 172.21.15.19:0/1604267372 wait complete. 2023-10-03T10:21:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.353+0000 7f063e39c700 1 Processor -- start 2023-10-03T10:21:08.353 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.353+0000 7f063e39c700 1 -- start start 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f063809d6f0 0x7f06381a6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 0x7f06381a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06381a8e70 con 0x7f063809e410 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06381a98c0 con 0x7f063809e000 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063e39c700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f06381a7450 con 0x7f063809d6f0 2023-10-03T10:21:08.354 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f06377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f06377fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37104/0 (socket says 172.21.15.19:37104) 2023-10-03T10:21:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f06377fe700 1 -- 172.21.15.19:0/371427472 learned_addr learned my addr 172.21.15.19:0/371427472 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f063c939700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 0x7f06381a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.355 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.354+0000 7f0637fff700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f063809d6f0 0x7f06381a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 -- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f063809d6f0 msgr2=0x7f06381a6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f063809d6f0 0x7f06381a6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 -- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 msgr2=0x7f06381a6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381a6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.356 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 -- 172.21.15.19:0/371427472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c009550 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063c939700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 0x7f06381a6ab0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f063000cb90 tx=0x7f063000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630003c00 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630003d60 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06381a89b0 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063000aa80 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.355+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06381a7ca0 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.356+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f063000abe0 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.356+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f063003f4e0 con 0x7f063809e410 2023-10-03T10:21:08.357 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.357+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06381a9b20 con 0x7f063809e410 2023-10-03T10:21:08.366 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.366+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f06300050d0 con 0x7f063809e410 2023-10-03T10:21:08.466 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.467+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef90135130 con 0x7fef901335c0 2023-10-03T10:21:08.467 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.467+0000 7fef8d7fa700 1 -- 172.21.15.19:0/1036169055 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fef88019300 con 0x7fef901335c0 2023-10-03T10:21:08.467 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 msgr2=0x7fef90133a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fef8800cc50 tx=0x7fef8800cf60 comp rx=0 tx=0).stop 2023-10-03T10:21:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 shutdown_connections 2023-10-03T10:21:08.469 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef901335c0 0x7fef90133a30 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fef9006e570 0x7fef90140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 --2- 172.21.15.19:0/1036169055 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fef90134610 0x7fef90133080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 >> 172.21.15.19:0/1036169055 conn(0x7fef900a2aa0 msgr2=0x7fef9009e350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.469+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 shutdown_connections 2023-10-03T10:21:08.470 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.470+0000 7fef96a64700 1 -- 172.21.15.19:0/1036169055 wait complete. 2023-10-03T10:21:08.476 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.477+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e64074ea0 con 0x7f0e6409e930 2023-10-03T10:21:08.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.477+0000 7f0e60ff9700 1 -- 172.21.15.19:0/68485643 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e5404a090 con 0x7f0e6409e930 2023-10-03T10:21:08.477 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 msgr2=0x7f0e6411e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 0x7f0e6411e300 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0e5401a000 tx=0x7f0e54004750 comp rx=0 tx=0).stop 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 shutdown_connections 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0e6409f650 0x7f0e6411ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0e6409e930 0x7f0e6411e300 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 --2- 172.21.15.19:0/68485643 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0e6409f240 0x7f0e6411e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 >> 172.21.15.19:0/68485643 conn(0x7f0e640a4210 msgr2=0x7f0e64131b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 shutdown_connections 2023-10-03T10:21:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.480+0000 7f0e6a937700 1 -- 172.21.15.19:0/68485643 wait complete. 2023-10-03T10:21:08.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.1 2023-10-03T10:21:08.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:08.523 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.524+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f949009f420 con 0x7f949009e000 2023-10-03T10:21:08.524 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.524+0000 7f94777fe700 1 -- 172.21.15.19:0/753559949 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9484017020 con 0x7f949009e000 2023-10-03T10:21:08.524 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 msgr2=0x7f94901c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 0x7f94901c8790 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f948400c4c0 tx=0x7f948400c7d0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 shutdown_connections 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f949009e440 0x7f94901c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f949009d6f0 0x7f94901c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 --2- 172.21.15.19:0/753559949 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f949009e000 0x7f94901c8790 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 >> 172.21.15.19:0/753559949 conn(0x7f9490066f50 msgr2=0x7f94900a3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 shutdown_connections 2023-10-03T10:21:08.527 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.526+0000 7f9495581700 1 -- 172.21.15.19:0/753559949 wait complete. 2023-10-03T10:21:08.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.575+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f0638074ea0 con 0x7f063809e410 2023-10-03T10:21:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.575+0000 7f0634ff9700 1 -- 172.21.15.19:0/371427472 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0630011380 con 0x7f063809e410 2023-10-03T10:21:08.575 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 msgr2=0x7f06381a6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 0x7f06381a6ab0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f063000cb90 tx=0x7f063000cea0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 shutdown_connections 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f063809e410 0x7f06381a6ab0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f063809d6f0 0x7f06381a6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 --2- 172.21.15.19:0/371427472 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f063809e000 0x7f06381a6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 >> 172.21.15.19:0/371427472 conn(0x7f0638066f50 msgr2=0x7f06380a36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 shutdown_connections 2023-10-03T10:21:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:08.577+0000 7f063e39c700 1 -- 172.21.15.19:0/371427472 wait complete. 2023-10-03T10:21:08.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:21:09.486 INFO:tasks.ceph:ignoring flush pg stats error, probably testing upgrade: timed out waiting for mon to be updated with osd.1: 133143986179 < 133143986180 2023-10-03T10:21:09.486 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:21:09.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:21:09.496 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-03T10:21:09.541 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-03T10:21:09.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-03T10:21:09.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.644+0000 7f9da0555700 1 Processor -- start 2023-10-03T10:21:09.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.644+0000 7f9da0555700 1 -- start start 2023-10-03T10:21:09.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9809eca0 0x7f9d9806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 0x7f9d98134ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d98070ee0 con 0x7f9d98134610 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98071480 con 0x7f9d9809eca0 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9da0555700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9806f3c0 con 0x7f9d9806e570 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9eaf2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 0x7f9d98134ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9e2f1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9eaf2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 0x7f9d98134ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45474/0 (socket says 172.21.15.19:45474) 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9e2f1700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41668/0 (socket says 172.21.15.19:41668) 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9eaf2700 1 -- 172.21.15.19:0/2917059286 learned_addr learned my addr 172.21.15.19:0/2917059286 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.645+0000 7f9d9daf0700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9809eca0 0x7f9d9806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 -- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9809eca0 msgr2=0x7f9d9806ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9809eca0 0x7f9d9806ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 -- 172.21.15.19:0/2917059286 >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 msgr2=0x7f9d98134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 --2- 172.21.15.19:0/2917059286 >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 0x7f9d98134ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 -- 172.21.15.19:0/2917059286 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98071b90 con 0x7f9d9806e570 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9e2f1700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009840 tx=0x7f9d94009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37c4fbefec361b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9d2ef700 1 -- 172.21.15.19:0/2917059286 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011830 con 0x7f9d9806e570 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9d2ef700 1 -- 172.21.15.19:0/2917059286 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d94011990 con 0x7f9d9806e570 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.646+0000 7f9d9d2ef700 1 -- 172.21.15.19:0/2917059286 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d94011d20 con 0x7f9d9806e570 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 -- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 msgr2=0x7f9d9806e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009840 tx=0x7f9d94009b50 comp rx=0 tx=0).stop 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 -- 172.21.15.19:0/2917059286 shutdown_connections 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 --2- 172.21.15.19:0/2917059286 >> v2:172.21.15.19:3300/0 conn(0x7f9d98134610 0x7f9d98134ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d9806e570 0x7f9d9806e940 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.648 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 --2- 172.21.15.19:0/2917059286 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9809eca0 0x7f9d9806ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 -- 172.21.15.19:0/2917059286 >> 172.21.15.19:0/2917059286 conn(0x7f9d980a2aa0 msgr2=0x7f9d980a2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 -- 172.21.15.19:0/2917059286 shutdown_connections 2023-10-03T10:21:09.649 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.647+0000 7f9da0555700 1 -- 172.21.15.19:0/2917059286 wait complete. 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.649+0000 7f9da0555700 1 Processor -- start 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.649+0000 7f9da0555700 1 -- start start 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9806e570 0x7f9d98127360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d98134610 0x7f9d98125ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d9813ddf0 0x7f9d981263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9813e7d0 con 0x7f9d9813ddf0 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9813d4c0 con 0x7f9d9806e570 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9da0555700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9813d9e0 con 0x7f9d98134610 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d98134610 0x7f9d98125ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.650 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9eaf2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d9813ddf0 0x7f9d981263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d98134610 0x7f9d98125ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41672/0 (socket says 172.21.15.19:41672) 2023-10-03T10:21:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 -- 172.21.15.19:0/1224835389 learned_addr learned my addr 172.21.15.19:0/1224835389 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.651 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9e2f1700 1 --2- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9806e570 0x7f9d98127360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 -- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9806e570 msgr2=0x7f9d98127360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 --2- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f9d9806e570 0x7f9d98127360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 -- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d9813ddf0 msgr2=0x7f9d981263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 --2- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d9813ddf0 0x7f9d981263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.650+0000 7f9d9daf0700 1 -- 172.21.15.19:0/1224835389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940094a0 con 0x7f9d98134610 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9d9daf0700 1 --2- 172.21.15.19:0/1224835389 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f9d98134610 0x7f9d98125ea0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800e9e0 tx=0x7f9d8800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880096b0 con 0x7f9d98134610 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9da0555700 1 -- 172.21.15.19:0/1224835389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9813d200 con 0x7f9d98134610 2023-10-03T10:21:09.652 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8800ee80 con 0x7f9d98134610 2023-10-03T10:21:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8800c9f0 con 0x7f9d98134610 2023-10-03T10:21:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.651+0000 7f9da0555700 1 -- 172.21.15.19:0/1224835389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d981278a0 con 0x7f9d98134610 2023-10-03T10:21:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.652+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f9d8800cb50 con 0x7f9d98134610 2023-10-03T10:21:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.652+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f9d8803fb10 con 0x7f9d98134610 2023-10-03T10:21:09.653 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.653+0000 7f9da0555700 1 -- 172.21.15.19:0/1224835389 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d98074ea0 con 0x7f9d98134610 2023-10-03T10:21:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.658+0000 7f9d8effd700 1 -- 172.21.15.19:0/1224835389 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f9d8801b3b0 con 0x7f9d98134610 2023-10-03T10:21:09.683 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 Processor -- start 2023-10-03T10:21:09.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 -- start start 2023-10-03T10:21:09.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21a406a770 0x7f21a406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.684 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 0x7f21a4131fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a409ece0 con 0x7f21a406a770 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a409e760 con 0x7f21a4131b40 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.684+0000 7f21aa511700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a409e040 con 0x7f21a406b080 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a8aae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 0x7f21a4131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a3fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f21a406a770 0x7f21a406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41686/0 (socket says 172.21.15.19:41686) 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 -- 172.21.15.19:0/2646741197 learned_addr learned my addr 172.21.15.19:0/2646741197 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.685 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a8aae700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 0x7f21a4131fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:37134/0 (socket says 172.21.15.19:37134) 2023-10-03T10:21:09.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 -- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 msgr2=0x7f21a4131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 --2- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 0x7f21a4131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.686 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 -- 172.21.15.19:0/2646741197 >> v2:172.21.15.19:3300/0 conn(0x7f21a406a770 msgr2=0x7f21a406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 --2- 172.21.15.19:0/2646741197 >> v2:172.21.15.19:3300/0 conn(0x7f21a406a770 0x7f21a406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 -- 172.21.15.19:0/2646741197 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a409f630 con 0x7f21a406b080 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a37fe700 1 --2- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f21980098f0 tx=0x7f2198009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839c3db0febdbab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.685+0000 7f21a2ffd700 1 -- 172.21.15.19:0/2646741197 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011830 con 0x7f21a406b080 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21a2ffd700 1 -- 172.21.15.19:0/2646741197 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198011990 con 0x7f21a406b080 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21a2ffd700 1 -- 172.21.15.19:0/2646741197 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198011d20 con 0x7f21a406b080 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 -- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 msgr2=0x7f21a4131600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 --2- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f21980098f0 tx=0x7f2198009c00 comp rx=0 tx=0).stop 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 -- 172.21.15.19:0/2646741197 shutdown_connections 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 --2- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a4131b40 0x7f21a4131fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 --2- 172.21.15.19:0/2646741197 >> v2:172.21.15.19:3300/0 conn(0x7f21a406a770 0x7f21a406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.687 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 --2- 172.21.15.19:0/2646741197 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a406b080 0x7f21a4131600 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 -- 172.21.15.19:0/2646741197 >> 172.21.15.19:0/2646741197 conn(0x7f21a4066f50 msgr2=0x7f21a409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.686+0000 7f21aa511700 1 -- 172.21.15.19:0/2646741197 shutdown_connections 2023-10-03T10:21:09.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.687+0000 7f21aa511700 1 -- 172.21.15.19:0/2646741197 wait complete. 2023-10-03T10:21:09.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.688+0000 7f21aa511700 1 Processor -- start 2023-10-03T10:21:09.688 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.688+0000 7f21aa511700 1 -- start start 2023-10-03T10:21:09.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a406a770 0x7f21a4119480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a4131b40 0x7f21a4119f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.689 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a411b480 con 0x7f21a406b080 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a4137960 con 0x7f21a406a770 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21aa511700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21a411b980 con 0x7f21a4131b40 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21a37fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45484/0 (socket says 172.21.15.19:45484) 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21a37fe700 1 -- 172.21.15.19:0/842717634 learned_addr learned my addr 172.21.15.19:0/842717634 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21a8aae700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a4131b40 0x7f21a4119f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.689+0000 7f21a3fff700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a406a770 0x7f21a4119480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 -- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a4131b40 msgr2=0x7f21a4119f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a4131b40 0x7f21a4119f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 -- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a406a770 msgr2=0x7f21a4119480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a406a770 0x7f21a4119480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.690 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 -- 172.21.15.19:0/842717634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2198009550 con 0x7f21a406b080 2023-10-03T10:21:09.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a37fe700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f2198000c00 tx=0x7f2198004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.691 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198004240 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219801f070 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21aa511700 1 -- 172.21.15.19:0/842717634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a409a7f0 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21980045e0 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.690+0000 7f21aa511700 1 -- 172.21.15.19:0/842717634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a411afa0 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.691+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2198021030 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.691+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c0052e0 con 0x7f21a406b080 2023-10-03T10:21:09.692 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.691+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2198040940 con 0x7f21a406b080 2023-10-03T10:21:09.696 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.696+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f219801a450 con 0x7f21a406b080 2023-10-03T10:21:09.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.751+0000 7f03cfd5f700 1 Processor -- start 2023-10-03T10:21:09.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.751+0000 7f03cfd5f700 1 -- start start 2023-10-03T10:21:09.751 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cfd5f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c809d6f0 0x7f03c809dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cfd5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 0x7f03c8130d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cfd5f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03c809f130 con 0x7f03c809e000 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cfd5f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03c809f520 con 0x7f03c809d6f0 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cfd5f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c809e930 con 0x7f03c809e410 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cdafb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c809d6f0 0x7f03c809dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cdafb700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f03c809d6f0 0x7f03c809dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45486/0 (socket says 172.21.15.19:45486) 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03cdafb700 1 -- 172.21.15.19:0/310180708 learned_addr learned my addr 172.21.15.19:0/310180708 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.752+0000 7f03ce2fc700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 0x7f03c8130d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03cdafb700 1 -- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 msgr2=0x7f03c8130d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03cdafb700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 0x7f03c8130d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03cdafb700 1 -- 172.21.15.19:0/310180708 >> v1:172.21.15.19:6789/0 conn(0x7f03c809e000 legacy=0x7f03c8130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03ccaf9700 1 -- 172.21.15.19:0/310180708 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636317323 0 0) 0x7f03c809f130 con 0x7f03c809e000 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03cdafb700 1 -- 172.21.15.19:0/310180708 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c809b2d0 con 0x7f03c809d6f0 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03ce2fc700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 0x7f03c8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03cdafb700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809d6f0 0x7f03c809dac0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f03c400bb90 tx=0x7f03c400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f4d6adeca2368 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03ccaf9700 1 -- 172.21.15.19:0/310180708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400dd50 con 0x7f03c809d6f0 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03ccaf9700 1 -- 172.21.15.19:0/310180708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c4010470 con 0x7f03c809d6f0 2023-10-03T10:21:09.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.753+0000 7f03ccaf9700 1 -- 172.21.15.19:0/310180708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c4010800 con 0x7f03c809d6f0 2023-10-03T10:21:09.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 -- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809d6f0 msgr2=0x7f03c809dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809d6f0 0x7f03c809dac0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f03c400bb90 tx=0x7f03c400bea0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 -- 172.21.15.19:0/310180708 shutdown_connections 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809e410 0x7f03c8130d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/310180708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809d6f0 0x7f03c809dac0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 -- 172.21.15.19:0/310180708 >> 172.21.15.19:0/310180708 conn(0x7f03c8066f50 msgr2=0x7f03c809f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 -- 172.21.15.19:0/310180708 shutdown_connections 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.754+0000 7f03cfd5f700 1 -- 172.21.15.19:0/310180708 wait complete. 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.755+0000 7f03cfd5f700 1 Processor -- start 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.755+0000 7f03cfd5f700 1 -- start start 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809d6f0 0x7f03c811df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 0x7f03c811e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c81302d0 con 0x7f03c809e410 2023-10-03T10:21:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c8120d50 con 0x7f03c809e000 2023-10-03T10:21:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cfd5f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03c811f3a0 con 0x7f03c809d6f0 2023-10-03T10:21:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45496/0 (socket says 172.21.15.19:45496) 2023-10-03T10:21:09.757 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 -- 172.21.15.19:0/1617951925 learned_addr learned my addr 172.21.15.19:0/1617951925 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cdafb700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809d6f0 0x7f03c811df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 -- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809d6f0 msgr2=0x7f03c811df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cd2fa700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 0x7f03c811e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.758 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809d6f0 0x7f03c811df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 -- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 msgr2=0x7f03c811e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 0x7f03c811e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03ce2fc700 1 -- 172.21.15.19:0/1617951925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c400b7f0 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.756+0000 7f03cd2fa700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 0x7f03c811e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03ce2fc700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f03c0007f20 tx=0x7f03c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c000dde0 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c000f040 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03c8121730 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0003c60 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.757+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03c80a1d00 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.758+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f03c0004030 con 0x7f03c809e410 2023-10-03T10:21:09.759 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.758+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f03c003f840 con 0x7f03c809e410 2023-10-03T10:21:09.760 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.758+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03c809c700 con 0x7f03c809e410 2023-10-03T10:21:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.763+0000 7fbe4af43700 1 Processor -- start 2023-10-03T10:21:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.763+0000 7fbe4af43700 1 -- start start 2023-10-03T10:21:09.763 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.763+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f03c001d360 con 0x7f03c809e410 2023-10-03T10:21:09.764 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409d6f0 0x7fbe4409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 0x7fbe44130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 0x7fbe44130ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4409f520 con 0x7fbe4409e000 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4409f130 con 0x7fbe4409d6f0 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe4af43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4409e930 con 0x7fbe4409e410 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe43fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 0x7fbe44130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe43fff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 0x7fbe44130660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45498/0 (socket says 172.21.15.19:45498) 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe43fff700 1 -- 172.21.15.19:0/2064234040 learned_addr learned my addr 172.21.15.19:0/2064234040 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.764+0000 7fbe494e0700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 0x7fbe44130ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 -- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409d6f0 msgr2=0x7fbe4409dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.765 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409d6f0 0x7fbe4409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 -- 172.21.15.19:0/2064234040 >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 msgr2=0x7fbe44130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:21:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 --2- 172.21.15.19:0/2064234040 >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 0x7fbe44130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 -- 172.21.15.19:0/2064234040 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4409b2d0 con 0x7fbe4409e410 2023-10-03T10:21:09.766 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe494e0700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 0x7fbe44130ba0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009dc0 tx=0x7fbe3c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fee7aa0c3b037f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe437fe700 1 -- 172.21.15.19:0/2064234040 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00e070 con 0x7fbe4409e410 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe437fe700 1 -- 172.21.15.19:0/2064234040 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00bae0 con 0x7fbe4409e410 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.765+0000 7fbe437fe700 1 -- 172.21.15.19:0/2064234040 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3c00be90 con 0x7fbe4409e410 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 -- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 msgr2=0x7fbe44130ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 0x7fbe44130ba0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c009dc0 tx=0x7fbe3c00b330 comp rx=0 tx=0).stop 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 -- 172.21.15.19:0/2064234040 shutdown_connections 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409d6f0 0x7fbe4409dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2064234040 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409e410 0x7fbe44130ba0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2064234040 >> v2:172.21.15.19:3300/0 conn(0x7fbe4409e000 0x7fbe44130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.767 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.766+0000 7fbe4af43700 1 -- 172.21.15.19:0/2064234040 >> 172.21.15.19:0/2064234040 conn(0x7fbe44066f50 msgr2=0x7fbe4409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.767+0000 7fbe4af43700 1 -- 172.21.15.19:0/2064234040 shutdown_connections 2023-10-03T10:21:09.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.767+0000 7fbe4af43700 1 -- 172.21.15.19:0/2064234040 wait complete. 2023-10-03T10:21:09.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.768+0000 7fbe4af43700 1 Processor -- start 2023-10-03T10:21:09.768 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.768+0000 7fbe4af43700 1 -- start start 2023-10-03T10:21:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409e000 0x7fbe4411e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe4409e410 0x7fbe4411ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:21:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4411fb40 con 0x7fbe4409e410 2023-10-03T10:21:09.769 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe44120160 con 0x7fbe4409e000 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe4af43700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbe44120d90 con 0x7fbe4409d6f0 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe48cdf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe48cdf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:41718/0 (socket says 172.21.15.19:41718) 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe48cdf700 1 -- 172.21.15.19:0/2434367179 learned_addr learned my addr 172.21.15.19:0/2434367179 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe494e0700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe4409e410 0x7fbe4411ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.770 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.769+0000 7fbe43fff700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409e000 0x7fbe4411e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:21:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 -- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409e000 msgr2=0x7fbe4411e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409e000 0x7fbe4411e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.771 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 -- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe4409e410 msgr2=0x7fbe4411ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe4409e410 0x7fbe4411ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 -- 172.21.15.19:0/2434367179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009a70 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe48cdf700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800b530 tx=0x7fbe3800b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38011830 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe380119b0 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe44121770 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38011d60 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.770+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4409c700 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.771+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fbe3801a400 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.771+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fbe3803f610 con 0x7fbe4409d6f0 2023-10-03T10:21:09.772 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.772+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe4411ac20 con 0x7fbe4409d6f0 2023-10-03T10:21:09.776 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.777+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fbe38015080 con 0x7fbe4409d6f0 2023-10-03T10:21:09.908 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.908+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f217c005590 con 0x7f21a406b080 2023-10-03T10:21:09.909 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.909+0000 7f21a0ff9700 1 -- 172.21.15.19:0/842717634 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2198015020 con 0x7f21a406b080 2023-10-03T10:21:09.909 INFO:teuthology.orchestra.run.smithi019.stdout:141733920770 2023-10-03T10:21:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 msgr2=0x7f21a41199c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.911 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f2198000c00 tx=0x7f2198004750 comp rx=0 tx=0).stop 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 shutdown_connections 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f21a4131b40 0x7f21a4119f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f21a406a770 0x7f21a4119480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 --2- 172.21.15.19:0/842717634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f21a406b080 0x7f21a41199c0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 >> 172.21.15.19:0/842717634 conn(0x7f21a4066f50 msgr2=0x7f21a40708f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 shutdown_connections 2023-10-03T10:21:09.912 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.911+0000 7f218a7fc700 1 -- 172.21.15.19:0/842717634 wait complete. 2023-10-03T10:21:09.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 141733920771 got 141733920770 for osd.3 2023-10-03T10:21:09.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.993+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f03c8074ea0 con 0x7f03c809e410 2023-10-03T10:21:09.993 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.993+0000 7f03be7fc700 1 -- 172.21.15.19:0/1617951925 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f03c001a030 con 0x7f03c809e410 2023-10-03T10:21:09.993 INFO:teuthology.orchestra.run.smithi019.stdout:133143986179 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 msgr2=0x7f03c811e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f03c0007f20 tx=0x7f03c000d3b0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 shutdown_connections 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03c809e410 0x7f03c811e9c0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f03c809d6f0 0x7f03c811df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 --2- 172.21.15.19:0/1617951925 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f03c809e000 0x7f03c811e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 >> 172.21.15.19:0/1617951925 conn(0x7f03c8066f50 msgr2=0x7f03c8070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 shutdown_connections 2023-10-03T10:21:09.996 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:09.996+0000 7f03cfd5f700 1 -- 172.21.15.19:0/1617951925 wait complete. 2023-10-03T10:21:10.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.004+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbe44074ea0 con 0x7fbe4409d6f0 2023-10-03T10:21:10.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.004+0000 7fbe417fa700 1 -- 172.21.15.19:0/2434367179 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbe3800f8d0 con 0x7fbe4409d6f0 2023-10-03T10:21:10.004 INFO:teuthology.orchestra.run.smithi019.stdout:124554051587 2023-10-03T10:21:10.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.006+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 msgr2=0x7fbe4411df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800b530 tx=0x7fbe3800b840 comp rx=0 tx=0).stop 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 shutdown_connections 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe4409e410 0x7fbe4411ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fbe4409d6f0 0x7fbe4411df80 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 --2- 172.21.15.19:0/2434367179 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fbe4409e000 0x7fbe4411e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 >> 172.21.15.19:0/2434367179 conn(0x7fbe44066f50 msgr2=0x7fbe44130900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 shutdown_connections 2023-10-03T10:21:10.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:21:10.007+0000 7fbe4af43700 1 -- 172.21.15.19:0/2434367179 wait complete. 2023-10-03T10:21:10.009 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.2 2023-10-03T10:21:10.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.0 2023-10-03T10:23:09.528 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:23:09.529 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:09.594 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=9d915dab173846119f0cbb1fee11ea25 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1496, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:23:09.598 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:23:09.609 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2023-10-03T10:23:09.618 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:23:09.627 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2023-10-03T10:23:09.637 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2023-10-03T10:23:09.646 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-03T10:23:09.656 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-03T10:23:09.656 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:23:09.656 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:23:09.684 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:23:09.684 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:23:09.746 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:23:09.892 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 Processor -- start 2023-10-03T10:23:09.893 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 -- start start 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 0x7fb7ec09dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec130660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec09f130 con 0x7fb7ec09e410 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec09f520 con 0x7fb7ec09d6f0 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7f1b1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec09e930 con 0x7fb7ec09e000 2023-10-03T10:23:09.895 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7eb7fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 0x7fb7ec09dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7ebfff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb7ec09e410 0x7fb7ec130ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39698/0 (socket says 172.21.15.19:39698) 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.893+0000 7fb7ebfff700 1 -- 172.21.15.19:0/2294672475 learned_addr learned my addr 172.21.15.19:0/2294672475 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eaffd700 1 -- 172.21.15.19:0/2294672475 >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 msgr2=0x7fb7ec09dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eaffd700 1 --2- 172.21.15.19:0/2294672475 >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 0x7fb7ec09dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eaffd700 1 -- 172.21.15.19:0/2294672475 >> v1:172.21.15.19:6789/0 conn(0x7fb7ec09e410 legacy=0x7fb7ec130ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eaffd700 1 -- 172.21.15.19:0/2294672475 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec09b2d0 con 0x7fb7ec09e000 2023-10-03T10:23:09.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7ea7fc700 1 -- 172.21.15.19:0/2294672475 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305751193 0 0) 0x7fb7ec09f130 con 0x7fb7ec09e410 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eb7fe700 1 --2- 172.21.15.19:0/2294672475 >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 0x7fb7ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7eaffd700 1 --2- 172.21.15.19:0/2294672475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec130660 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009840 tx=0x7fb7e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134e43eda162809b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7ea7fc700 1 -- 172.21.15.19:0/2294672475 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011830 con 0x7fb7ec09e000 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7ea7fc700 1 -- 172.21.15.19:0/2294672475 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0011990 con 0x7fb7ec09e000 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.894+0000 7fb7ea7fc700 1 -- 172.21.15.19:0/2294672475 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0011d20 con 0x7fb7ec09e000 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2294672475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 msgr2=0x7fb7ec130660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2294672475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec130660 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009840 tx=0x7fb7e0009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:09.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2294672475 shutdown_connections 2023-10-03T10:23:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2294672475 >> v2:172.21.15.19:3300/0 conn(0x7fb7ec09d6f0 0x7fb7ec09dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2294672475 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec130660 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2294672475 >> 172.21.15.19:0/2294672475 conn(0x7fb7ec066f50 msgr2=0x7fb7ec09f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2294672475 shutdown_connections 2023-10-03T10:23:09.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.895+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2294672475 wait complete. 2023-10-03T10:23:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 Processor -- start 2023-10-03T10:23:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 -- start start 2023-10-03T10:23:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 0x7fb7ec06e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:09.900 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec070520 con 0x7fb7ec09e410 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec1259f0 con 0x7fb7ec09d6f0 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.896+0000 7fb7f1b1f700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0a1b80 con 0x7fb7ec09e000 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7eb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 0x7fb7ec06e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:09.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7eb7fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 0x7fb7ec06e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43898/0 (socket says 172.21.15.19:43898) 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32956/0 (socket says 172.21.15.19:32956) 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7eb7fe700 1 -- 172.21.15.19:0/2729059589 learned_addr learned my addr 172.21.15.19:0/2729059589 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 -- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 msgr2=0x7fb7ec06edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec06edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 -- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 msgr2=0x7fb7ec06e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 0x7fb7ec06e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:09.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 -- 172.21.15.19:0/2729059589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009a70 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7eaffd700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7ebfff700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c430 tx=0x7fb7e400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4004c80 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4004e00 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4007310 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00094a0 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.897+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec1245b0 con 0x7fb7ec09e410 2023-10-03T10:23:09.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.898+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7e4007470 con 0x7fb7ec09e410 2023-10-03T10:23:09.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.898+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7e403f270 con 0x7fb7ec09e410 2023-10-03T10:23:09.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.898+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec125670 con 0x7fb7ec09e410 2023-10-03T10:23:09.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:09.903+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7ec125670 con 0x7fb7ec09e410 2023-10-03T10:23:10.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.108+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7ec125670 con 0x7fb7ec09e410 2023-10-03T10:23:10.109 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.109+0000 7fb7d3fff700 1 -- 172.21.15.19:0/2729059589 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13394 (secure 0 0 0) 0x7fb7ec125670 con 0x7fb7ec09e410 2023-10-03T10:23:10.109 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:23:10.109 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:14:28.458962+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":33,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3138365138":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/873784498":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2790929541":"2023-10-04T10:14:28.458905+0000","172.21.15.19:6816/126819":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/487355738":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6817/497268310":"2023-10-04T10:13:56.033183+0000","172.21.15.19:0/2293884931":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2339933701":"2023-10-04T10:14:28.458905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.111+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 msgr2=0x7fb7ec06f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.111+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c430 tx=0x7fb7e400c740 comp rx=0 tx=0).stop 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 shutdown_connections 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7ec09e410 0x7fb7ec06f2f0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7ec09d6f0 0x7fb7ec06e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.112 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 --2- 172.21.15.19:0/2729059589 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7ec09e000 0x7fb7ec06edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 >> 172.21.15.19:0/2729059589 conn(0x7fb7ec066f50 msgr2=0x7fb7ec130a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:10.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 shutdown_connections 2023-10-03T10:23:10.113 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.112+0000 7fb7f1b1f700 1 -- 172.21.15.19:0/2729059589 wait complete. 2023-10-03T10:23:10.125 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:23:10.126 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:23:10.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.266+0000 7f2123e21700 1 Processor -- start 2023-10-03T10:23:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 -- start start 2023-10-03T10:23:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 0x7f211c134030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c09ea10 con 0x7f211c09d5c0 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c09e210 con 0x7f211c0a12d0 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2123e21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0a26f0 con 0x7f211c0a09c0 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2121bbd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2121bbd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43904/0 (socket says 172.21.15.19:43904) 2023-10-03T10:23:10.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f2121bbd700 1 -- 172.21.15.19:0/3745285340 learned_addr learned my addr 172.21.15.19:0/3745285340 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.267+0000 7f21223be700 1 --2- 172.21.15.19:0/3745285340 >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 0x7f211c134030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2121bbd700 1 -- 172.21.15.19:0/3745285340 >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 msgr2=0x7f211c134030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2121bbd700 1 --2- 172.21.15.19:0/3745285340 >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 0x7f211c134030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2121bbd700 1 -- 172.21.15.19:0/3745285340 >> v1:172.21.15.19:6789/0 conn(0x7f211c09d5c0 legacy=0x7f211c133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2121bbd700 1 -- 172.21.15.19:0/3745285340 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c09db70 con 0x7f211c0a09c0 2023-10-03T10:23:10.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f21223be700 1 --2- 172.21.15.19:0/3745285340 >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 0x7f211c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:10.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2121bbd700 1 --2- 172.21.15.19:0/3745285340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f21180098f0 tx=0x7f2118009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af04879968b57f96 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:10.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2120bbb700 1 -- 172.21.15.19:0/3745285340 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011830 con 0x7f211c0a09c0 2023-10-03T10:23:10.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2120bbb700 1 -- 172.21.15.19:0/3745285340 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011990 con 0x7f211c0a09c0 2023-10-03T10:23:10.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.268+0000 7f2120bbb700 1 -- 172.21.15.19:0/3745285340 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011d20 con 0x7f211c0a09c0 2023-10-03T10:23:10.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 -- 172.21.15.19:0/3745285340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 msgr2=0x7f211c0a0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 --2- 172.21.15.19:0/3745285340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f21180098f0 tx=0x7f2118009c00 comp rx=0 tx=0).stop 2023-10-03T10:23:10.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 -- 172.21.15.19:0/3745285340 shutdown_connections 2023-10-03T10:23:10.274 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 --2- 172.21.15.19:0/3745285340 >> v2:172.21.15.19:3300/0 conn(0x7f211c0a12d0 0x7f211c134030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 --2- 172.21.15.19:0/3745285340 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c0a0d90 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 -- 172.21.15.19:0/3745285340 >> 172.21.15.19:0/3745285340 conn(0x7f211c0a2fe0 msgr2=0x7f211c0a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 -- 172.21.15.19:0/3745285340 shutdown_connections 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.269+0000 7f2123e21700 1 -- 172.21.15.19:0/3745285340 wait complete. 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 Processor -- start 2023-10-03T10:23:10.275 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 -- start start 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c122810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0a6e50 con 0x7f211c0a12d0 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c1250d0 con 0x7f211c0a09c0 2023-10-03T10:23:10.276 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.270+0000 7f2123e21700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f211c133700 con 0x7f211c09d5c0 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21223be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21213bc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c122810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21223be700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32964/0 (socket says 172.21.15.19:32964) 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33136/0 (socket says 172.21.15.19:33136) 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21223be700 1 -- 172.21.15.19:0/2191750334 learned_addr learned my addr 172.21.15.19:0/2191750334 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:10.277 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 -- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 msgr2=0x7f211c122810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c122810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 -- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 msgr2=0x7f211c122d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 -- 172.21.15.19:0/2191750334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009a70 con 0x7f211c09d5c0 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21223be700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:10.278 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2121bbd700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2118016000 tx=0x7f2118004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180036a0 con 0x7f211c09d5c0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118003800 con 0x7f211c09d5c0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118003b90 con 0x7f211c09d5c0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118009550 con 0x7f211c09d5c0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.271+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c09cd10 con 0x7f211c09d5c0 2023-10-03T10:23:10.279 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.272+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f2118021070 con 0x7f211c09d5c0 2023-10-03T10:23:10.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.272+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f2118040b00 con 0x7f211c09d5c0 2023-10-03T10:23:10.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.272+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c04f2a0 con 0x7f211c09d5c0 2023-10-03T10:23:10.280 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.277+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f2118029080 con 0x7f211c09d5c0 2023-10-03T10:23:10.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.479+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f211c124c10 con 0x7f211c09d5c0 2023-10-03T10:23:10.479 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.479+0000 7f21127fc700 1 -- 172.21.15.19:0/2191750334 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2118015020 con 0x7f211c09d5c0 2023-10-03T10:23:10.480 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 msgr2=0x7f211c1222d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2118016000 tx=0x7f2118004750 comp rx=0 tx=0).stop 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 shutdown_connections 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c0a12d0 0x7f211c122d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f211c09d5c0 0x7f211c1222d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 --2- 172.21.15.19:0/2191750334 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f211c0a09c0 0x7f211c122810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.482 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 >> 172.21.15.19:0/2191750334 conn(0x7f211c0a2fe0 msgr2=0x7f211c0a4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:10.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 shutdown_connections 2023-10-03T10:23:10.483 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.482+0000 7f2123e21700 1 -- 172.21.15.19:0/2191750334 wait complete. 2023-10-03T10:23:10.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:23:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.634+0000 7ffb0d8ef700 1 Processor -- start 2023-10-03T10:23:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.634+0000 7ffb0d8ef700 1 -- start start 2023-10-03T10:23:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 0x7ffb080a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080a1810 con 0x7ffb080a09c0 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0809ea10 con 0x7ffb0809d5c0 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb0d8ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0809e210 con 0x7ffb08133920 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb06ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 0x7ffb080a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43920/0 (socket says 172.21.15.19:43920) 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33138/0 (socket says 172.21.15.19:33138) 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 -- 172.21.15.19:0/3994837837 learned_addr learned my addr 172.21.15.19:0/3994837837 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 -- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 msgr2=0x7ffb08133d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 -- 172.21.15.19:0/3994837837 >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 msgr2=0x7ffb080a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 --2- 172.21.15.19:0/3994837837 >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 0x7ffb080a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 -- 172.21.15.19:0/3994837837 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb080a26f0 con 0x7ffb0809d5c0 2023-10-03T10:23:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb06ffd700 1 --2- 172.21.15.19:0/3994837837 >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 0x7ffb080a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb077fe700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.635+0000 7ffb067fc700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00098f0 tx=0x7ffaf0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31b97f61cbceaea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb05ffb700 1 -- 172.21.15.19:0/3994837837 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011830 con 0x7ffb0809d5c0 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb05ffb700 1 -- 172.21.15.19:0/3994837837 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf0011990 con 0x7ffb0809d5c0 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb05ffb700 1 -- 172.21.15.19:0/3994837837 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0011d20 con 0x7ffb0809d5c0 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 msgr2=0x7ffb080a12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ffaf00098f0 tx=0x7ffaf0009c00 comp rx=0 tx=0).stop 2023-10-03T10:23:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/3994837837 shutdown_connections 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb08133920 0x7ffb08133d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/3994837837 >> v2:172.21.15.19:3300/0 conn(0x7ffb080a09c0 0x7ffb080a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/3994837837 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb080a12d0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/3994837837 >> 172.21.15.19:0/3994837837 conn(0x7ffb080a2fe0 msgr2=0x7ffb080a33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/3994837837 shutdown_connections 2023-10-03T10:23:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.636+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/3994837837 wait complete. 2023-10-03T10:23:10.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.637+0000 7ffb0d8ef700 1 Processor -- start 2023-10-03T10:23:10.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 -- start start 2023-10-03T10:23:10.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb0811f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb081223f0 con 0x7ffb08133920 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb08133260 con 0x7ffb0809d5c0 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb0d8ef700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0811edb0 con 0x7ffb080a09c0 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33148/0 (socket says 172.21.15.19:33148) 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32986/0 (socket says 172.21.15.19:32986) 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb06ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb0811f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 -- 172.21.15.19:0/1308278827 learned_addr learned my addr 172.21.15.19:0/1308278827 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 -- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 msgr2=0x7ffb0811f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb0811f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 -- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 msgr2=0x7ffb081c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.644 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.638+0000 7ffb067fc700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffb067fc700 1 -- 172.21.15.19:0/1308278827 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80094a0 con 0x7ffb080a09c0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffb077fe700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffb067fc700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0004240 con 0x7ffb080a09c0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf001f070 con 0x7ffb080a09c0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb00009a70 con 0x7ffb080a09c0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf00045c0 con 0x7ffb080a09c0 2023-10-03T10:23:10.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.639+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf0009550 con 0x7ffb080a09c0 2023-10-03T10:23:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.640+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffaf0021030 con 0x7ffb080a09c0 2023-10-03T10:23:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.640+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffaf0040620 con 0x7ffb080a09c0 2023-10-03T10:23:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.640+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0809cf10 con 0x7ffb080a09c0 2023-10-03T10:23:10.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.645+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffaf001a450 con 0x7ffb080a09c0 2023-10-03T10:23:10.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.849+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb0804f2a0 con 0x7ffb080a09c0 2023-10-03T10:23:10.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.850+0000 7ffafffff700 1 -- 172.21.15.19:0/1308278827 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffaf00233d0 con 0x7ffb080a09c0 2023-10-03T10:23:10.850 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:23:10.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 msgr2=0x7ffb0811f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:10.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ffaf0000c00 tx=0x7ffaf0004750 comp rx=0 tx=0).stop 2023-10-03T10:23:10.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 shutdown_connections 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb08133920 0x7ffb081c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb0809d5c0 0x7ffb0811f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 --2- 172.21.15.19:0/1308278827 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb080a09c0 0x7ffb0811f6e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 >> 172.21.15.19:0/1308278827 conn(0x7ffb080a2fe0 msgr2=0x7ffb081bbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 shutdown_connections 2023-10-03T10:23:10.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:10.852+0000 7ffb0d8ef700 1 -- 172.21.15.19:0/1308278827 wait complete. 2023-10-03T10:23:10.866 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:23:11.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.004+0000 7fa47d8cd700 1 Processor -- start 2023-10-03T10:23:11.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.004+0000 7fa47d8cd700 1 -- start start 2023-10-03T10:23:11.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47809cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa47809c030 con 0x7fa47809d330 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa478133580 con 0x7fa4781339d0 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa47d8cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47809df70 con 0x7fa47809a480 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4777fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47809cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4777fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32998/0 (socket says 172.21.15.19:32998) 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43942/0 (socket says 172.21.15.19:43942) 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4777fe700 1 -- 172.21.15.19:0/3578947266 learned_addr learned my addr 172.21.15.19:0/3578947266 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 -- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 msgr2=0x7fa478133da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 -- 172.21.15.19:0/3578947266 >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 msgr2=0x7fa47809d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 --2- 172.21.15.19:0/3578947266 >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.008 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4767fc700 1 -- 172.21.15.19:0/3578947266 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478099f80 con 0x7fa47809a480 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa4777fe700 1 --2- 172.21.15.19:0/3578947266 >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.005+0000 7fa476ffd700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa4767fc700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47809cdf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa460009870 tx=0x7fa460009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c29ef5bb99b552d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa475ffb700 1 -- 172.21.15.19:0/3578947266 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460011830 con 0x7fa47809a480 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa475ffb700 1 -- 172.21.15.19:0/3578947266 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa460011990 con 0x7fa47809a480 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa475ffb700 1 -- 172.21.15.19:0/3578947266 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460011d20 con 0x7fa47809a480 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 msgr2=0x7fa47809cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47809cdf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa460009870 tx=0x7fa460009b80 comp rx=0 tx=0).stop 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3578947266 shutdown_connections 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa4781339d0 0x7fa478133da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3578947266 >> v2:172.21.15.19:3300/0 conn(0x7fa47809d330 0x7fa47809d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3578947266 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47809cdf0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.006+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3578947266 >> 172.21.15.19:0/3578947266 conn(0x7fa4780a21b0 msgr2=0x7fa4780a25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.007+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3578947266 shutdown_connections 2023-10-03T10:23:11.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.007+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3578947266 wait complete. 2023-10-03T10:23:11.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.007+0000 7fa47d8cd700 1 Processor -- start 2023-10-03T10:23:11.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 -- start start 2023-10-03T10:23:11.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 0x7fa47812c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 0x7fa47812c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47812e7a0 con 0x7fa4781339d0 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47812ede0 con 0x7fa47809d330 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa47d8cd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa47812eb10 con 0x7fa47809a480 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa4777fe700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 0x7fa47812c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa4767fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 0x7fa47812c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa476ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33174/0 (socket says 172.21.15.19:33174) 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.008+0000 7fa476ffd700 1 -- 172.21.15.19:0/3674094248 learned_addr learned my addr 172.21.15.19:0/3674094248 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 -- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 msgr2=0x7fa47812c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 0x7fa47812c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 -- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 msgr2=0x7fa47812c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 0x7fa47812c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.014 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 -- 172.21.15.19:0/3674094248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa470009b30 con 0x7fa47809a480 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa4767fc700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 0x7fa47812c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa4777fe700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 0x7fa47812c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa476ffd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa46800ec10 tx=0x7fa46800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468005a20 con 0x7fa47809a480 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa468005b80 con 0x7fa47809a480 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa468009430 con 0x7fa47809a480 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800c850 con 0x7fa47809a480 2023-10-03T10:23:11.015 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.009+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4600094a0 con 0x7fa47809a480 2023-10-03T10:23:11.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.010+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fa46800c9b0 con 0x7fa47809a480 2023-10-03T10:23:11.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.010+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fa46803f900 con 0x7fa47809a480 2023-10-03T10:23:11.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.010+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa478128620 con 0x7fa47809a480 2023-10-03T10:23:11.016 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.015+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fa468020080 con 0x7fa47809a480 2023-10-03T10:23:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.218+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa47812efa0 con 0x7fa47809a480 2023-10-03T10:23:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.218+0000 7fa46ffff700 1 -- 172.21.15.19:0/3674094248 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa468006030 con 0x7fa47809a480 2023-10-03T10:23:11.218 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:23:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.220+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 msgr2=0x7fa47812baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.220+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa46800ec10 tx=0x7fa46800ef20 comp rx=0 tx=0).stop 2023-10-03T10:23:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 shutdown_connections 2023-10-03T10:23:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4781339d0 0x7fa47812c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fa47809a480 0x7fa47812baf0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 --2- 172.21.15.19:0/3674094248 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fa47809d330 0x7fa47812c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 >> 172.21.15.19:0/3674094248 conn(0x7fa4780a21b0 msgr2=0x7fa4781bac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 shutdown_connections 2023-10-03T10:23:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.221+0000 7fa47d8cd700 1 -- 172.21.15.19:0/3674094248 wait complete. 2023-10-03T10:23:11.234 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:23:11.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.374+0000 7fe6ad6cf700 1 Processor -- start 2023-10-03T10:23:11.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.374+0000 7fe6ad6cf700 1 -- start start 2023-10-03T10:23:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.374+0000 7fe6ad6cf700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 0x7fe6a8131d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6ad6cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 0x7fe6a806f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.376 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6ad6cf700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a809b730 con 0x7fe6a806f840 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6ad6cf700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a809b050 con 0x7fe6a8131950 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6ad6cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8131730 con 0x7fe6a806eed0 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a6ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 0x7fe6a8131d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 0x7fe6a806f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a77fe700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe6a806f840 0x7fe6a8138750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39724/0 (socket says 172.21.15.19:39724) 2023-10-03T10:23:11.377 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a77fe700 1 -- 172.21.15.19:0/1294210996 learned_addr learned my addr 172.21.15.19:0/1294210996 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a5ffb700 1 -- 172.21.15.19:0/1294210996 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951952218 0 0) 0x7fe6a809b730 con 0x7fe6a806f840 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 -- 172.21.15.19:0/1294210996 >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 msgr2=0x7fe6a8131d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 --2- 172.21.15.19:0/1294210996 >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 0x7fe6a8131d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 -- 172.21.15.19:0/1294210996 >> v1:172.21.15.19:6789/0 conn(0x7fe6a806f840 legacy=0x7fe6a8138750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 -- 172.21.15.19:0/1294210996 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a806fcc0 con 0x7fe6a806eed0 2023-10-03T10:23:11.378 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a6ffd700 1 --2- 172.21.15.19:0/1294210996 >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 0x7fe6a8131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a67fc700 1 --2- 172.21.15.19:0/1294210996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 0x7fe6a806f300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe690009840 tx=0x7fe690009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3067203bc34eba4b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a5ffb700 1 -- 172.21.15.19:0/1294210996 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690011830 con 0x7fe6a806eed0 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a5ffb700 1 -- 172.21.15.19:0/1294210996 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe690011990 con 0x7fe6a806eed0 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.375+0000 7fe6a5ffb700 1 -- 172.21.15.19:0/1294210996 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe690011d20 con 0x7fe6a806eed0 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/1294210996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 msgr2=0x7fe6a806f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.379 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/1294210996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 0x7fe6a806f300 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe690009840 tx=0x7fe690009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/1294210996 shutdown_connections 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/1294210996 >> v2:172.21.15.19:3300/0 conn(0x7fe6a8131950 0x7fe6a8131d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/1294210996 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a806eed0 0x7fe6a806f300 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/1294210996 >> 172.21.15.19:0/1294210996 conn(0x7fe6a80a2610 msgr2=0x7fe6a80a2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/1294210996 shutdown_connections 2023-10-03T10:23:11.380 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.376+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/1294210996 wait complete. 2023-10-03T10:23:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.377+0000 7fe6ad6cf700 1 Processor -- start 2023-10-03T10:23:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.377+0000 7fe6ad6cf700 1 -- start start 2023-10-03T10:23:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a806eed0 0x7fe6a811d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe6a806f840 0x7fe6a811dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.383 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8120640 con 0x7fe6a806eed0 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a811f570 con 0x7fe6a8131950 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6ad6cf700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a8120280 con 0x7fe6a806f840 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43966/0 (socket says 172.21.15.19:43966) 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 -- 172.21.15.19:0/2383114607 learned_addr learned my addr 172.21.15.19:0/2383114607 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:11.384 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a67fc700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe6a806f840 0x7fe6a811dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a6ffd700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a806eed0 0x7fe6a811d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 -- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe6a806f840 msgr2=0x7fe6a811dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe6a806f840 0x7fe6a811dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 -- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a806eed0 msgr2=0x7fe6a811d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a806eed0 0x7fe6a811d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.385 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 -- 172.21.15.19:0/2383114607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6980094a0 con 0x7fe6a8131950 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.378+0000 7fe6a77fe700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cc70 tx=0x7fe6a000cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000aac0 con 0x7fe6a8131950 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000ac40 con 0x7fe6a8131950 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a00070d0 con 0x7fe6a8131950 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900094a0 con 0x7fe6a8131950 2023-10-03T10:23:11.386 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a809b290 con 0x7fe6a8131950 2023-10-03T10:23:11.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.379+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe6a0007250 con 0x7fe6a8131950 2023-10-03T10:23:11.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.380+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe6a003f1e0 con 0x7fe6a8131950 2023-10-03T10:23:11.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.380+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a809a080 con 0x7fe6a8131950 2023-10-03T10:23:11.387 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.385+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe6a0018070 con 0x7fe6a8131950 2023-10-03T10:23:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.591+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6a81321e0 con 0x7fe6a8131950 2023-10-03T10:23:11.591 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.592+0000 7fe69f7fe700 1 -- 172.21.15.19:0/2383114607 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6a0019630 con 0x7fe6a8131950 2023-10-03T10:23:11.592 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:23:11.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 msgr2=0x7fe6a811e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe6a000cc70 tx=0x7fe6a000cf80 comp rx=0 tx=0).stop 2023-10-03T10:23:11.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 shutdown_connections 2023-10-03T10:23:11.594 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe6a8131950 0x7fe6a811e260 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe6a806eed0 0x7fe6a811d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 --2- 172.21.15.19:0/2383114607 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe6a806f840 0x7fe6a811dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 >> 172.21.15.19:0/2383114607 conn(0x7fe6a80a2610 msgr2=0x7fe6a80a13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 shutdown_connections 2023-10-03T10:23:11.595 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.594+0000 7fe6ad6cf700 1 -- 172.21.15.19:0/2383114607 wait complete. 2023-10-03T10:23:11.607 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:23:11.744 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 Processor -- start 2023-10-03T10:23:11.745 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 -- start start 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 0x7f0c641337f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6406b990 con 0x7f0c64134260 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c640a0590 con 0x7f0c64133420 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c69bab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6409fb80 con 0x7f0c64133e30 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c62ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c63fff700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7f0c64134260 0x7f0c641304d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39740/0 (socket says 172.21.15.19:39740) 2023-10-03T10:23:11.747 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c62ffd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33188/0 (socket says 172.21.15.19:33188) 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c637fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 0x7f0c641337f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.745+0000 7f0c63fff700 1 -- 172.21.15.19:0/3965967206 learned_addr learned my addr 172.21.15.19:0/3965967206 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c62ffd700 1 -- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 msgr2=0x7f0c641337f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c62ffd700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 0x7f0c641337f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c62ffd700 1 -- 172.21.15.19:0/3965967206 >> v1:172.21.15.19:6789/0 conn(0x7f0c64134260 legacy=0x7f0c641304d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c62ffd700 1 -- 172.21.15.19:0/3965967206 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640a0030 con 0x7f0c64133e30 2023-10-03T10:23:11.748 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c627fc700 1 -- 172.21.15.19:0/3965967206 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661482910 0 0) 0x7f0c6406b990 con 0x7f0c64134260 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c637fe700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 0x7f0c641337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c62ffd700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009870 tx=0x7f0c54009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ad8c24f0e2d341 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c627fc700 1 -- 172.21.15.19:0/3965967206 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011830 con 0x7f0c64133e30 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c627fc700 1 -- 172.21.15.19:0/3965967206 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54011990 con 0x7f0c64133e30 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.746+0000 7f0c627fc700 1 -- 172.21.15.19:0/3965967206 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54011d20 con 0x7f0c64133e30 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 -- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 msgr2=0x7f0c6412ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f0c54009870 tx=0x7f0c54009b80 comp rx=0 tx=0).stop 2023-10-03T10:23:11.749 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 -- 172.21.15.19:0/3965967206 shutdown_connections 2023-10-03T10:23:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64133420 0x7f0c641337f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 --2- 172.21.15.19:0/3965967206 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133e30 0x7f0c6412ff90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 -- 172.21.15.19:0/3965967206 >> 172.21.15.19:0/3965967206 conn(0x7f0c640a4210 msgr2=0x7f0c640a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 -- 172.21.15.19:0/3965967206 shutdown_connections 2023-10-03T10:23:11.750 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.747+0000 7f0c69bab700 1 -- 172.21.15.19:0/3965967206 wait complete. 2023-10-03T10:23:11.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.748+0000 7f0c69bab700 1 Processor -- start 2023-10-03T10:23:11.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 -- start start 2023-10-03T10:23:11.752 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c64133e30 0x7f0c6409c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64134260 0x7f0c6409cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6411f050 con 0x7f0c64133e30 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6409de50 con 0x7f0c64134260 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c69bab700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6411fc50 con 0x7f0c64133420 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c637fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33192/0 (socket says 172.21.15.19:33192) 2023-10-03T10:23:11.753 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c63fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64134260 0x7f0c6409cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c637fe700 1 -- 172.21.15.19:0/462414352 learned_addr learned my addr 172.21.15.19:0/462414352 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.749+0000 7f0c62ffd700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c64133e30 0x7f0c6409c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 -- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64134260 msgr2=0x7f0c6409cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64134260 0x7f0c6409cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 -- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c64133e30 msgr2=0x7f0c6409c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c64133e30 0x7f0c6409c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 -- 172.21.15.19:0/462414352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580094a0 con 0x7f0c64133420 2023-10-03T10:23:11.754 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c637fe700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800ebe0 tx=0x7f0c5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800c850 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800c9b0 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c540094a0 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800cd40 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.750+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6409e3e0 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.751+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f0c58013470 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.751+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f0c5803f7f0 con 0x7f0c64133420 2023-10-03T10:23:11.755 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.751+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c64120100 con 0x7f0c64133420 2023-10-03T10:23:11.756 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.756+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f0c58013720 con 0x7f0c64133420 2023-10-03T10:23:11.975 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.976+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c64074ea0 con 0x7f0c64133420 2023-10-03T10:23:11.976 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.976+0000 7f0c4bfff700 1 -- 172.21.15.19:0/462414352 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v41) v1 ==== 81+0+636 (secure 0 0 0) 0x7f0c58021030 con 0x7f0c64133420 2023-10-03T10:23:11.976 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3138365138 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.976 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/873784498 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2790929541 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6816/126819 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/487355738 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2933255455 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6816/118286 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2596252035 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:11.977 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6817/497268310 2023-10-04T10:13:56.033183+0000 2023-10-03T10:23:11.978 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2293884931 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.978 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2339933701 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:11.978 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.978+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 msgr2=0x7f0c6409c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.978+0000 7f0c69bab700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800ebe0 tx=0x7f0c5800eef0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.978+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 shutdown_connections 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f0c64134260 0x7f0c6409cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f0c64133420 0x7f0c6409c480 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 --2- 172.21.15.19:0/462414352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0c64133e30 0x7f0c6409c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:11.979 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 >> 172.21.15.19:0/462414352 conn(0x7f0c640a4210 msgr2=0x7f0c640a0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:11.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 shutdown_connections 2023-10-03T10:23:11.980 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:11.979+0000 7f0c69bab700 1 -- 172.21.15.19:0/462414352 wait complete. 2023-10-03T10:23:11.980 INFO:teuthology.orchestra.run.smithi019.stderr:listed 11 entries 2023-10-03T10:23:11.992 DEBUG:teuthology.orchestra.run.smithi027:> set -ex 2023-10-03T10:23:11.992 DEBUG:teuthology.orchestra.run.smithi027:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-03T10:23:12.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-03T10:23:12.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.153+0000 7fb7dc40e700 1 Processor -- start 2023-10-03T10:23:12.153 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.153+0000 7fb7dc40e700 1 -- start start 2023-10-03T10:23:12.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7dc40e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7d406a770 0x7fb7d406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.155 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7dc40e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7dc40e700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d409ece0 con 0x7fb7d4131b40 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7dc40e700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d409e760 con 0x7fb7d406a770 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7dc40e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d409e040 con 0x7fb7d406b080 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7d99a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da1aa700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fb7d406a770 0x7fb7d406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da9ab700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fb7d4131b40 0x7fb7d4138850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39754/0 (socket says 172.21.15.19:39754) 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7d99a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43984/0 (socket says 172.21.15.19:43984) 2023-10-03T10:23:12.156 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da9ab700 1 -- 172.21.15.19:0/1381732132 learned_addr learned my addr 172.21.15.19:0/1381732132 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da1aa700 1 -- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 msgr2=0x7fb7d4131600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da1aa700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da1aa700 1 -- 172.21.15.19:0/1381732132 >> v1:172.21.15.19:6789/0 conn(0x7fb7d4131b40 legacy=0x7fb7d4138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7da1aa700 1 -- 172.21.15.19:0/1381732132 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d409f630 con 0x7fb7d406a770 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.154+0000 7fb7d99a9700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7da1aa700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d406a770 0x7fb7d406ab40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009840 tx=0x7fb7d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a411dc2410d2c3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7d91a8700 1 -- 172.21.15.19:0/1381732132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011830 con 0x7fb7d406a770 2023-10-03T10:23:12.157 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7d91a8700 1 -- 172.21.15.19:0/1381732132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0011990 con 0x7fb7d406a770 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7d91a8700 1 -- 172.21.15.19:0/1381732132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0011d20 con 0x7fb7d406a770 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d406a770 msgr2=0x7fb7d406ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d406a770 0x7fb7d406ab40 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009840 tx=0x7fb7d0009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1381732132 shutdown_connections 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d406a770 0x7fb7d406ab40 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1381732132 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d4131600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1381732132 >> 172.21.15.19:0/1381732132 conn(0x7fb7d4066f50 msgr2=0x7fb7d409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:12.158 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1381732132 shutdown_connections 2023-10-03T10:23:12.159 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.155+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1381732132 wait complete. 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.156+0000 7fb7dc40e700 1 Processor -- start 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.156+0000 7fb7dc40e700 1 -- start start 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 0x7fb7d41c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4131610 con 0x7fb7d4131b40 2023-10-03T10:23:12.161 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d411fb10 con 0x7fb7d406b080 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7dc40e700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4071e60 con 0x7fb7d406a770 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7d99a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da1aa700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 0x7fb7d41c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7d99a9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:43998/0 (socket says 172.21.15.19:43998) 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33058/0 (socket says 172.21.15.19:33058) 2023-10-03T10:23:12.162 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7d99a9700 1 -- 172.21.15.19:0/1034216034 learned_addr learned my addr 172.21.15.19:0/1034216034 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 -- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 msgr2=0x7fb7d41c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 0x7fb7d41c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 -- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 msgr2=0x7fb7d41c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da9ab700 1 -- 172.21.15.19:0/1034216034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c40094a0 con 0x7fb7d4131b40 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7d99a9700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.163 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.157+0000 7fb7da1aa700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 0x7fb7d41c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7da9ab700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00caa0 tx=0x7fb7cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00a9a0 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc00ab00 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d00094a0 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc00ae70 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.158+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d411fdd0 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.159+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fb7cc01b3b0 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.159+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fb7cc03f260 con 0x7fb7d4131b40 2023-10-03T10:23:12.164 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.159+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d4074ea0 con 0x7fb7d4131b40 2023-10-03T10:23:12.165 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.164+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fb7cc017020 con 0x7fb7d4131b40 2023-10-03T10:23:12.369 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.369+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7d406c360 con 0x7fb7d4131b40 2023-10-03T10:23:12.370 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.370+0000 7fb7caffd700 1 -- 172.21.15.19:0/1034216034 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13394 (secure 0 0 0) 0x7fb7cc0192c0 con 0x7fb7d4131b40 2023-10-03T10:23:12.370 INFO:teuthology.orchestra.run.smithi019.stdout: 2023-10-03T10:23:12.371 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":41,"fsid":"7e072252-f281-43a7-ab05-1896c0d28d72","created":"2023-10-03T10:10:56.621164+0000","modified":"2023-10-03T10:14:28.458962+0000","last_up_change":"2023-10-03T10:13:50.569889+0000","last_in_change":"2023-10-03T10:10:58.479662+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"pacific","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-03T10:11:04.831433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-03T10:11:06.511040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-03T10:11:10.911282+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-03T10:11:12.226977+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.059999942779541,"score_stable":1.059999942779541,"optimal_score":1,"raw_score_acting":1.059999942779541,"raw_score_stable":1.059999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"254f1f35-d197-4b51-8a96-760da60c16a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":29,"up_thru":33,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6804","nonce":129535}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6805","nonce":129535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6807","nonce":129535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6806","nonce":129535}]},"public_addr":"172.21.15.19:6804/129535","cluster_addr":"172.21.15.19:6805/129535","heartbeat_back_addr":"172.21.15.19:6807/129535","heartbeat_front_addr":"172.21.15.19:6806/129535","state":["exists","up"]},{"osd":1,"uuid":"916c386e-c460-4114-9dbe-21434a2f252d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":23,"up_from":31,"up_thru":33,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6800","nonce":129633}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6801","nonce":129633}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6803","nonce":129633}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6802","nonce":129633}]},"public_addr":"172.21.15.19:6800/129633","cluster_addr":"172.21.15.19:6801/129633","heartbeat_back_addr":"172.21.15.19:6803/129633","heartbeat_front_addr":"172.21.15.19:6802/129633","state":["exists","up"]},{"osd":2,"uuid":"567f9cb5-3aaa-4022-97b8-d11809d82b46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":33,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6808","nonce":129743}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6809","nonce":129743}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6811","nonce":129743}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6810","nonce":129743}]},"public_addr":"172.21.15.19:6808/129743","cluster_addr":"172.21.15.19:6809/129743","heartbeat_back_addr":"172.21.15.19:6811/129743","heartbeat_front_addr":"172.21.15.19:6810/129743","state":["exists","up"]},{"osd":3,"uuid":"8991320d-e996-46ae-a954-e1235c1a6bd8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":26,"up_from":33,"up_thru":33,"down_at":27,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6812","nonce":130083}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6813","nonce":130083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6815","nonce":130083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.19:6814","nonce":130083}]},"public_addr":"172.21.15.19:6812/130083","cluster_addr":"172.21.15.19:6813/130083","heartbeat_back_addr":"172.21.15.19:6815/130083","heartbeat_front_addr":"172.21.15.19:6814/130083","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.629770+0000","dead_epoch":24},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.593513+0000","dead_epoch":25},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.383549+0000","dead_epoch":26},{"osd":3,"down_stamp":"2023-10-03T10:13:43.488726+0000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-03T10:11:03.603660+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.5","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.e","mappings":[{"from":3,"to":0}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.1f","mappings":[{"from":3,"to":0}]},{"pgid":"4.22","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:0/3138365138":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/873784498":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2790929541":"2023-10-04T10:14:28.458905+0000","172.21.15.19:6816/126819":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/487355738":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2933255455":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6816/118286":"2023-10-04T10:13:29.532347+0000","172.21.15.19:0/2596252035":"2023-10-04T10:13:29.532347+0000","172.21.15.19:6817/497268310":"2023-10-04T10:13:56.033183+0000","172.21.15.19:0/2293884931":"2023-10-04T10:14:28.458905+0000","172.21.15.19:0/2339933701":"2023-10-04T10:14:28.458905+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 msgr2=0x7fb7d41c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00caa0 tx=0x7fb7cc00cdb0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 shutdown_connections 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d4131b40 0x7fb7d41c6ac0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fb7d406a770 0x7fb7d41c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.373 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 --2- 172.21.15.19:0/1034216034 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fb7d406b080 0x7fb7d41c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 >> 172.21.15.19:0/1034216034 conn(0x7fb7d4066f50 msgr2=0x7fb7d40a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 shutdown_connections 2023-10-03T10:23:12.374 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.373+0000 7fb7dc40e700 1 -- 172.21.15.19:0/1034216034 wait complete. 2023-10-03T10:23:12.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-03T10:11:04.831433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-03T10:11:06.511040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-03T10:11:10.911282+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-03T10:11:12.226977+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.059999942779541, 'score_stable': 1.059999942779541, 'optimal_score': 1, 'raw_score_acting': 1.059999942779541, 'raw_score_stable': 1.059999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-03T10:23:12.387 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-03T10:23:12.526 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.526+0000 7ffb179c2700 1 Processor -- start 2023-10-03T10:23:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 -- start start 2023-10-03T10:23:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb1009f390 0x7ffb101399d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb100a01c0 con 0x7ffb1009e850 2023-10-03T10:23:12.528 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1009b560 con 0x7ffb1009f390 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb179c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1009f810 con 0x7ffb10131b30 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb1575e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb15f5f700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7ffb1009f390 0x7ffb101399d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb1575e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33222/0 (socket says 172.21.15.19:33222) 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb1575e700 1 -- 172.21.15.19:0/1018199035 learned_addr learned my addr 172.21.15.19:0/1018199035 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.527+0000 7ffb14f5d700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ffb1009e850 0x7ffb1009ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39764/0 (socket says 172.21.15.19:39764) 2023-10-03T10:23:12.529 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb15f5f700 1 -- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 msgr2=0x7ffb10131f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb15f5f700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb15f5f700 1 -- 172.21.15.19:0/1018199035 >> v1:172.21.15.19:6789/0 conn(0x7ffb1009e850 legacy=0x7ffb1009ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb03fff700 1 -- 172.21.15.19:0/1018199035 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4171290959 0 0) 0x7ffb100a01c0 con 0x7ffb1009e850 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb15f5f700 1 -- 172.21.15.19:0/1018199035 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1009a260 con 0x7ffb1009f390 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb1575e700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb15f5f700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009f390 0x7ffb101399d0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800f370 tx=0x7ffb0800f680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2180ce0c18ac5922 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb03fff700 1 -- 172.21.15.19:0/1018199035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08012070 con 0x7ffb1009f390 2023-10-03T10:23:12.530 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb03fff700 1 -- 172.21.15.19:0/1018199035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0800fe70 con 0x7ffb1009f390 2023-10-03T10:23:12.531 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.528+0000 7ffb03fff700 1 -- 172.21.15.19:0/1018199035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0800d2f0 con 0x7ffb1009f390 2023-10-03T10:23:12.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 -- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009f390 msgr2=0x7ffb101399d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009f390 0x7ffb101399d0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800f370 tx=0x7ffb0800f680 comp rx=0 tx=0).stop 2023-10-03T10:23:12.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 -- 172.21.15.19:0/1018199035 shutdown_connections 2023-10-03T10:23:12.533 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009f390 0x7ffb101399d0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 --2- 172.21.15.19:0/1018199035 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb10131f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 -- 172.21.15.19:0/1018199035 >> 172.21.15.19:0/1018199035 conn(0x7ffb100a4130 msgr2=0x7ffb100a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 -- 172.21.15.19:0/1018199035 shutdown_connections 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.529+0000 7ffb179c2700 1 -- 172.21.15.19:0/1018199035 wait complete. 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 Processor -- start 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 -- start start 2023-10-03T10:23:12.534 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 0x7ffb1011dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb1011ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1011fc00 con 0x7ffb1009e850 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb10120e50 con 0x7ffb1009f390 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb179c2700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb101201e0 con 0x7ffb10131b30 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb14f5d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb15f5f700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb1011ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.535 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb14f5d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3301/0 says I am v2:172.21.15.19:44008/0 (socket says 172.21.15.19:44008) 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb14f5d700 1 -- 172.21.15.19:0/2837625635 learned_addr learned my addr 172.21.15.19:0/2837625635 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.530+0000 7ffb1575e700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 0x7ffb1011dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 -- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 msgr2=0x7ffb1011ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb1011ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 -- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 msgr2=0x7ffb1011dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 0x7ffb1011dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.536 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 -- 172.21.15.19:0/2837625635 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009550 con 0x7ffb1009f390 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb15f5f700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb1011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb1575e700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 0x7ffb1011dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb14f5d700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c480 tx=0x7ffb0400c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04004c80 con 0x7ffb1009f390 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04004e00 con 0x7ffb1009f390 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0800f050 con 0x7ffb1009f390 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04007310 con 0x7ffb1009f390 2023-10-03T10:23:12.537 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.531+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb100a1f70 con 0x7ffb1009f390 2023-10-03T10:23:12.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.532+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ffb04007470 con 0x7ffb1009f390 2023-10-03T10:23:12.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.532+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ffb0403f1d0 con 0x7ffb1009f390 2023-10-03T10:23:12.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.532+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb10121720 con 0x7ffb1009f390 2023-10-03T10:23:12.538 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.537+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ffb04007720 con 0x7ffb1009f390 2023-10-03T10:23:12.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.739+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb1004f2a0 con 0x7ffb1009f390 2023-10-03T10:23:12.739 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.739+0000 7ffb01ffb700 1 -- 172.21.15.19:0/2837625635 <== mon.1 v2:172.21.15.19:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb0401b340 con 0x7ffb1009f390 2023-10-03T10:23:12.739 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2023-10-03T10:23:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 msgr2=0x7ffb1011e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ffb0400c480 tx=0x7ffb0400c790 comp rx=0 tx=0).stop 2023-10-03T10:23:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 shutdown_connections 2023-10-03T10:23:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ffb10131b30 0x7ffb1011ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.742 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb1009e850 0x7ffb1011dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 --2- 172.21.15.19:0/2837625635 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ffb1009f390 0x7ffb1011e530 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 >> 172.21.15.19:0/2837625635 conn(0x7ffb100a4130 msgr2=0x7ffb1006d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 shutdown_connections 2023-10-03T10:23:12.743 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.742+0000 7ffb179c2700 1 -- 172.21.15.19:0/2837625635 wait complete. 2023-10-03T10:23:12.755 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-03T10:23:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.894+0000 7fce2fd82700 1 Processor -- start 2023-10-03T10:23:12.894 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.894+0000 7fce2fd82700 1 -- start start 2023-10-03T10:23:12.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2fd82700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce280a37f0 0x7fce28137dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2fd82700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 0x7fce2806a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2fd82700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce2809ec10 con 0x7fce2806acb0 2023-10-03T10:23:12.896 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2fd82700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280a3bc0 con 0x7fce280a37f0 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2fd82700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce2809afe0 con 0x7fce28138300 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fce280a37f0 0x7fce28137dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2d31d700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 0x7fce2806a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2e31f700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fce2806acb0 0x7fce2813ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39774/0 (socket says 172.21.15.19:39774) 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2e31f700 1 -- 172.21.15.19:0/1601513331 learned_addr learned my addr 172.21.15.19:0/1601513331 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 -- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 msgr2=0x7fce2806a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 0x7fce2806a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.897 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 -- 172.21.15.19:0/1601513331 >> v1:172.21.15.19:6789/0 conn(0x7fce2806acb0 legacy=0x7fce2813ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 -- 172.21.15.19:0/1601513331 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2809f600 con 0x7fce280a37f0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2cb1c700 1 -- 172.21.15.19:0/1601513331 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561994634 0 0) 0x7fce2809ec10 con 0x7fce2806acb0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2d31d700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 0x7fce2806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.895+0000 7fce2db1e700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce280a37f0 0x7fce28137dc0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fce24009840 tx=0x7fce24009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418d412ebb30ecc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2cb1c700 1 -- 172.21.15.19:0/1601513331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24011830 con 0x7fce280a37f0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2cb1c700 1 -- 172.21.15.19:0/1601513331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24011990 con 0x7fce280a37f0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2cb1c700 1 -- 172.21.15.19:0/1601513331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24011d20 con 0x7fce280a37f0 2023-10-03T10:23:12.898 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 -- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce280a37f0 msgr2=0x7fce28137dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce280a37f0 0x7fce28137dc0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fce24009840 tx=0x7fce24009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 -- 172.21.15.19:0/1601513331 shutdown_connections 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce280a37f0 0x7fce28137dc0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 --2- 172.21.15.19:0/1601513331 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce28138300 0x7fce2806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 -- 172.21.15.19:0/1601513331 >> 172.21.15.19:0/1601513331 conn(0x7fce28066d70 msgr2=0x7fce280a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 -- 172.21.15.19:0/1601513331 shutdown_connections 2023-10-03T10:23:12.899 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.896+0000 7fce2fd82700 1 -- 172.21.15.19:0/1601513331 wait complete. 2023-10-03T10:23:12.901 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.897+0000 7fce2fd82700 1 Processor -- start 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.897+0000 7fce2fd82700 1 -- start start 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce280a37f0 0x7fce2806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280718f0 con 0x7fce28138300 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2811d270 con 0x7fce280a37f0 2023-10-03T10:23:12.902 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2fd82700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fce2811ca30 con 0x7fce2806acb0 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2db1e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2db1e700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33244/0 (socket says 172.21.15.19:33244) 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33092/0 (socket says 172.21.15.19:33092) 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2db1e700 1 -- 172.21.15.19:0/3536962931 learned_addr learned my addr 172.21.15.19:0/3536962931 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2d31d700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce280a37f0 0x7fce2806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 -- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 msgr2=0x7fce2806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.903 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 -- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce280a37f0 msgr2=0x7fce2806eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce280a37f0 0x7fce2806eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2e31f700 1 -- 172.21.15.19:0/3536962931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0094a0 con 0x7fce28138300 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.898+0000 7fce2db1e700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce2e31f700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fce2000cc10 tx=0x7fce2000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2000aa00 con 0x7fce28138300 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2000ab80 con 0x7fce28138300 2023-10-03T10:23:12.904 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce240094a0 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce200070d0 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.899+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2806fbb0 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.900+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fce20007230 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.900+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fce2003f510 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.900+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2804f2a0 con 0x7fce28138300 2023-10-03T10:23:12.905 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:12.905+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fce20018020 con 0x7fce28138300 2023-10-03T10:23:13.107 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.107+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce2806c380 con 0x7fce28138300 2023-10-03T10:23:13.108 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.108+0000 7fce1a7fc700 1 -- 172.21.15.19:0/3536962931 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v41) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce200074e0 con 0x7fce28138300 2023-10-03T10:23:13.108 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 8 2023-10-03T10:23:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 msgr2=0x7fce2806f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fce2000cc10 tx=0x7fce2000cf20 comp rx=0 tx=0).stop 2023-10-03T10:23:13.110 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 shutdown_connections 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce28138300 0x7fce2806f2e0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fce2806acb0 0x7fce2806e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 --2- 172.21.15.19:0/3536962931 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fce280a37f0 0x7fce2806eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 >> 172.21.15.19:0/3536962931 conn(0x7fce28066d70 msgr2=0x7fce28134420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 shutdown_connections 2023-10-03T10:23:13.111 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.110+0000 7fce2fd82700 1 -- 172.21.15.19:0/3536962931 wait complete. 2023-10-03T10:23:13.124 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-03T10:23:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.262+0000 7fe769afd700 1 Processor -- start 2023-10-03T10:23:13.262 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.262+0000 7fe769afd700 1 -- start start 2023-10-03T10:23:13.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe769afd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe764131760 0x7fe764131b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe769afd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 0x7fe7641395f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.264 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe769afd700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe764131350 con 0x7fe76406a770 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe769afd700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76409ea40 con 0x7fe764131760 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe769afd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe76409dfc0 con 0x7fe76406b2d0 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7637fe700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fe764131760 0x7fe764131b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe762ffd700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fe76406a770 0x7fe76406abc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39786/0 (socket says 172.21.15.19:39786) 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe762ffd700 1 -- 172.21.15.19:0/667655096 learned_addr learned my addr 172.21.15.19:0/667655096 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe763fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 0x7fe7641395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7637fe700 1 -- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 msgr2=0x7fe7641395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:13.265 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7637fe700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 0x7fe7641395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7637fe700 1 -- 172.21.15.19:0/667655096 >> v1:172.21.15.19:6789/0 conn(0x7fe76406a770 legacy=0x7fe76406abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7627fc700 1 -- 172.21.15.19:0/667655096 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655198786 0 0) 0x7fe764131350 con 0x7fe76406a770 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe7637fe700 1 -- 172.21.15.19:0/667655096 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76409e210 con 0x7fe764131760 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.263+0000 7fe763fff700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 0x7fe7641395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe7637fe700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764131760 0x7fe764131b30 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fe754009840 tx=0x7fe754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65c4badf16ab28b server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe7627fc700 1 -- 172.21.15.19:0/667655096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011830 con 0x7fe764131760 2023-10-03T10:23:13.266 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe7627fc700 1 -- 172.21.15.19:0/667655096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe754011990 con 0x7fe764131760 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe7627fc700 1 -- 172.21.15.19:0/667655096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe754011d20 con 0x7fe764131760 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 -- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764131760 msgr2=0x7fe764131b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764131760 0x7fe764131b30 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fe754009840 tx=0x7fe754009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 -- 172.21.15.19:0/667655096 shutdown_connections 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe76406b2d0 0x7fe7641395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 --2- 172.21.15.19:0/667655096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe764131760 0x7fe764131b30 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.267 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.264+0000 7fe769afd700 1 -- 172.21.15.19:0/667655096 >> 172.21.15.19:0/667655096 conn(0x7fe764066d70 msgr2=0x7fe7640a2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:13.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.265+0000 7fe769afd700 1 -- 172.21.15.19:0/667655096 shutdown_connections 2023-10-03T10:23:13.268 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.265+0000 7fe769afd700 1 -- 172.21.15.19:0/667655096 wait complete. 2023-10-03T10:23:13.269 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.265+0000 7fe769afd700 1 Processor -- start 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 -- start start 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe76406a770 0x7fe7640722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe764131760 0x7fe76411de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76412b980 con 0x7fe76406b2d0 2023-10-03T10:23:13.270 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76411fe60 con 0x7fe76406a770 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe769afd700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe764071c00 con 0x7fe764131760 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe762ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe7637fe700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe76406a770 0x7fe7640722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe762ffd700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33116/0 (socket says 172.21.15.19:33116) 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe762ffd700 1 -- 172.21.15.19:0/2898590393 learned_addr learned my addr 172.21.15.19:0/2898590393 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.266+0000 7fe763fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe764131760 0x7fe76411de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 -- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe764131760 msgr2=0x7fe76411de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.271 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe764131760 0x7fe76411de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 -- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe76406a770 msgr2=0x7fe7640722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe76406a770 0x7fe7640722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 -- 172.21.15.19:0/2898590393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009a70 con 0x7fe76406b2d0 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe762ffd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c520 tx=0x7fe75800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758004c80 con 0x7fe76406b2d0 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758004de0 con 0x7fe76406b2d0 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7540094a0 con 0x7fe76406b2d0 2023-10-03T10:23:13.272 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758007310 con 0x7fe76406b2d0 2023-10-03T10:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.267+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76411e3b0 con 0x7fe76406b2d0 2023-10-03T10:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.268+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fe758007470 con 0x7fe76406b2d0 2023-10-03T10:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.268+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fe75803f350 con 0x7fe76406b2d0 2023-10-03T10:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.268+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76404f2a0 con 0x7fe76406b2d0 2023-10-03T10:23:13.273 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.273+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fe7580123b0 con 0x7fe76406b2d0 2023-10-03T10:23:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.477+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe76406c380 con 0x7fe76406b2d0 2023-10-03T10:23:13.477 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.478+0000 7fe74bfff700 1 -- 172.21.15.19:0/2898590393 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe75800ce60 con 0x7fe76406b2d0 2023-10-03T10:23:13.478 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2023-10-03T10:23:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 msgr2=0x7fe76411d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c520 tx=0x7fe75800c830 comp rx=0 tx=0).stop 2023-10-03T10:23:13.480 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 shutdown_connections 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fe764131760 0x7fe76411de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fe76406a770 0x7fe7640722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 --2- 172.21.15.19:0/2898590393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe76406b2d0 0x7fe76411d930 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 >> 172.21.15.19:0/2898590393 conn(0x7fe764066d70 msgr2=0x7fe76412d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 shutdown_connections 2023-10-03T10:23:13.481 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.480+0000 7fe769afd700 1 -- 172.21.15.19:0/2898590393 wait complete. 2023-10-03T10:23:13.494 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-03T10:23:13.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.634+0000 7ff540825700 1 Processor -- start 2023-10-03T10:23:13.634 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 -- start start 2023-10-03T10:23:13.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 0x7ff53c138f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 0x7ff53c13b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c06bcc0 con 0x7ff53c071cd0 2023-10-03T10:23:13.635 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c06cbf0 con 0x7ff53c1394a0 2023-10-03T10:23:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff540825700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c06ba00 con 0x7ff53c136b80 2023-10-03T10:23:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff53ad9d700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 0x7ff53c13b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff539d9b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 0x7ff53c138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff53a59c700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7ff53c071cd0 0x7ff53c0720a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39790/0 (socket says 172.21.15.19:39790) 2023-10-03T10:23:13.636 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.635+0000 7ff53a59c700 1 -- 172.21.15.19:0/3054934693 learned_addr learned my addr 172.21.15.19:0/3054934693 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:13.637 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53959a700 1 -- 172.21.15.19:0/3054934693 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637135701 0 0) 0x7ff53c06bcc0 con 0x7ff53c071cd0 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53ad9d700 1 -- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 msgr2=0x7ff53c138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53ad9d700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 0x7ff53c138f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53ad9d700 1 -- 172.21.15.19:0/3054934693 >> v1:172.21.15.19:6789/0 conn(0x7ff53c071cd0 legacy=0x7ff53c0720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53ad9d700 1 -- 172.21.15.19:0/3054934693 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c09f860 con 0x7ff53c1394a0 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff539d9b700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 0x7ff53c138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53ad9d700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 0x7ff53c13b880 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff534009dc0 tx=0x7ff53400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0c5915f729cadf server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:13.638 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53959a700 1 -- 172.21.15.19:0/3054934693 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400e070 con 0x7ff53c1394a0 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53959a700 1 -- 172.21.15.19:0/3054934693 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400bb20 con 0x7ff53c1394a0 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.636+0000 7ff53959a700 1 -- 172.21.15.19:0/3054934693 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534012430 con 0x7ff53c1394a0 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 -- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 msgr2=0x7ff53c13b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 0x7ff53c13b880 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ff534009dc0 tx=0x7ff53400b330 comp rx=0 tx=0).stop 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 -- 172.21.15.19:0/3054934693 shutdown_connections 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c1394a0 0x7ff53c13b880 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 --2- 172.21.15.19:0/3054934693 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c136b80 0x7ff53c138f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.639 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 -- 172.21.15.19:0/3054934693 >> 172.21.15.19:0/3054934693 conn(0x7ff53c0a4130 msgr2=0x7ff53c0a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 -- 172.21.15.19:0/3054934693 shutdown_connections 2023-10-03T10:23:13.640 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.637+0000 7ff540825700 1 -- 172.21.15.19:0/3054934693 wait complete. 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.638+0000 7ff540825700 1 Processor -- start 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.638+0000 7ff540825700 1 -- start start 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 0x7ff53c13a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53c1394a0 0x7ff53c13a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:13.642 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09dc60 con 0x7ff53c1394a0 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09b740 con 0x7ff53c136b80 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff540825700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c09cda0 con 0x7ff53c071cd0 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff539d9b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 0x7ff53c13a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33280/0 (socket says 172.21.15.19:33280) 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 -- 172.21.15.19:0/3125486329 learned_addr learned my addr 172.21.15.19:0/3125486329 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:13.643 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53ad9d700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53c1394a0 0x7ff53c13a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 -- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 msgr2=0x7ff53c13a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 0x7ff53c13a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 -- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53c1394a0 msgr2=0x7ff53c13a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.645 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53c1394a0 0x7ff53c13a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 -- 172.21.15.19:0/3125486329 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240094a0 con 0x7ff53c071cd0 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff539d9b700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 0x7ff53c13a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff53a59c700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c520 tx=0x7ff52c00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.639+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004c80 con 0x7ff53c071cd0 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.640+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c004e00 con 0x7ff53c071cd0 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.640+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff534009a70 con 0x7ff53c071cd0 2023-10-03T10:23:13.646 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.640+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c007310 con 0x7ff53c071cd0 2023-10-03T10:23:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.640+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c06c0f0 con 0x7ff53c071cd0 2023-10-03T10:23:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.640+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7ff52c007470 con 0x7ff53c071cd0 2023-10-03T10:23:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.641+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7ff52c03f300 con 0x7ff53c071cd0 2023-10-03T10:23:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.641+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c09cba0 con 0x7ff53c071cd0 2023-10-03T10:23:13.647 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.646+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7ff52c0123b0 con 0x7ff53c071cd0 2023-10-03T10:23:13.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.847+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff53c04f2a0 con 0x7ff53c071cd0 2023-10-03T10:23:13.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.847+0000 7ff532ffd700 1 -- 172.21.15.19:0/3125486329 <== mon.2 v2:172.21.15.19:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff52c011360 con 0x7ff53c071cd0 2023-10-03T10:23:13.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2023-10-03T10:23:13.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 msgr2=0x7ff53c139cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:13.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00c520 tx=0x7ff52c00c830 comp rx=0 tx=0).stop 2023-10-03T10:23:13.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 shutdown_connections 2023-10-03T10:23:13.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff53c1394a0 0x7ff53c13a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7ff53c071cd0 0x7ff53c139cf0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 --2- 172.21.15.19:0/3125486329 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7ff53c136b80 0x7ff53c13a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:13.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 >> 172.21.15.19:0/3125486329 conn(0x7ff53c0a4130 msgr2=0x7ff53c1320e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:13.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 shutdown_connections 2023-10-03T10:23:13.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:13.849+0000 7ff540825700 1 -- 172.21.15.19:0/3125486329 wait complete. 2023-10-03T10:23:13.863 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-03T10:23:14.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.000+0000 7fc77a6d9700 1 Processor -- start 2023-10-03T10:23:14.000 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 -- start start 2023-10-03T10:23:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc77409ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc77409f240 0x7fc7741317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 -- --> v1:172.21.15.19:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc774070940 con 0x7fc77409f650 2023-10-03T10:23:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77406fd60 con 0x7fc77409f240 2023-10-03T10:23:14.003 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc77a6d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc77406fa80 con 0x7fc77409e930 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc773fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc77409ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc76bfff700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7fc77409f240 0x7fc7741317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc778c76700 1 --1- >> v1:172.21.15.19:6789/0 conn(0x7fc77409f650 0x7fc774131d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.19:6789/0 says I am v1:172.21.15.19:39798/0 (socket says 172.21.15.19:39798) 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.001+0000 7fc778c76700 1 -- 172.21.15.19:0/3949862366 learned_addr learned my addr 172.21.15.19:0/3949862366 (peer_addr_for_me v1:172.21.15.19:0/0) 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc7737fe700 1 -- 172.21.15.19:0/3949862366 <== mon.0 v1:172.21.15.19:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294228882 0 0) 0x7fc774070940 con 0x7fc77409f650 2023-10-03T10:23:14.004 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc7737fe700 1 -- 172.21.15.19:0/3949862366 --> v1:172.21.15.19:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7600035b0 con 0x7fc77409f650 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc76bfff700 1 -- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 msgr2=0x7fc77409ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc76bfff700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc77409ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc76bfff700 1 -- 172.21.15.19:0/3949862366 >> v1:172.21.15.19:6789/0 conn(0x7fc77409f650 legacy=0x7fc774131d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc76bfff700 1 -- 172.21.15.19:0/3949862366 --> v2:172.21.15.19:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77409fb60 con 0x7fc77409f240 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc773fff700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc77409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc76bfff700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741317f0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009840 tx=0x7fc75c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef46475a210f1b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:14.005 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc7737fe700 1 -- 172.21.15.19:0/3949862366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011830 con 0x7fc77409f240 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc7737fe700 1 -- 172.21.15.19:0/3949862366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c011990 con 0x7fc77409f240 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.002+0000 7fc7737fe700 1 -- 172.21.15.19:0/3949862366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c011d20 con 0x7fc77409f240 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 -- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 msgr2=0x7fc7741317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741317f0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fc75c009840 tx=0x7fc75c009b50 comp rx=0 tx=0).stop 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 -- 172.21.15.19:0/3949862366 shutdown_connections 2023-10-03T10:23:14.006 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc77409ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/3949862366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741317f0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 -- 172.21.15.19:0/3949862366 >> 172.21.15.19:0/3949862366 conn(0x7fc7740a4210 msgr2=0x7fc7740a4610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 -- 172.21.15.19:0/3949862366 shutdown_connections 2023-10-03T10:23:14.007 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.003+0000 7fc77a6d9700 1 -- 172.21.15.19:0/3949862366 wait complete. 2023-10-03T10:23:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.004+0000 7fc77a6d9700 1 Processor -- start 2023-10-03T10:23:14.009 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.004+0000 7fc77a6d9700 1 -- start start 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741a4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc77409f650 0x7fc7741a4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7741a5f00 con 0x7fc77409f240 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7741a6bc0 con 0x7fc77409f650 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc77a6d9700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740a32f0 con 0x7fc77409e930 2023-10-03T10:23:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc773fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc773fff700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:33302/0 (socket says 172.21.15.19:33302) 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc773fff700 1 -- 172.21.15.19:0/1331874493 learned_addr learned my addr 172.21.15.19:0/1331874493 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741a4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc778c76700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc77409f650 0x7fc7741a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 -- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 msgr2=0x7fc7741a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 -- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc77409f650 msgr2=0x7fc7741a4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc77409f650 0x7fc7741a4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc76bfff700 1 -- 172.21.15.19:0/1331874493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640094a0 con 0x7fc77409f240 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.005+0000 7fc773fff700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc76bfff700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741a4210 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fc75c016000 tx=0x7fc75c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c004380 con 0x7fc77409f240 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c01f070 con 0x7fc77409f240 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0094a0 con 0x7fc77409f240 2023-10-03T10:23:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c0036a0 con 0x7fc77409f240 2023-10-03T10:23:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.006+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7740a0190 con 0x7fc77409f240 2023-10-03T10:23:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.007+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7fc75c021030 con 0x7fc77409f240 2023-10-03T10:23:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.007+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7fc75c0406b0 con 0x7fc77409f240 2023-10-03T10:23:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.007+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7741a0b30 con 0x7fc77409f240 2023-10-03T10:23:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.012+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7fc75c0239c0 con 0x7fc77409f240 2023-10-03T10:23:14.233 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.234+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc774074ea0 con 0x7fc77409f240 2023-10-03T10:23:14.234 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.234+0000 7fc7717fa700 1 -- 172.21.15.19:0/1331874493 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 11 entries v41) v1 ==== 81+0+636 (secure 0 0 0) 0x7fc75c015030 con 0x7fc77409f240 2023-10-03T10:23:14.234 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/3138365138 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/873784498 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2790929541 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6816/126819 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/487355738 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2933255455 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6816/118286 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2596252035 2023-10-04T10:13:29.532347+0000 2023-10-03T10:23:14.235 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6817/497268310 2023-10-04T10:13:56.033183+0000 2023-10-03T10:23:14.236 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2293884931 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.236 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2339933701 2023-10-04T10:14:28.458905+0000 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 msgr2=0x7fc7741a4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741a4210 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fc75c016000 tx=0x7fc75c004750 comp rx=0 tx=0).stop 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 shutdown_connections 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7fc77409f650 0x7fc7741a4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7fc77409e930 0x7fc7741a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 --2- 172.21.15.19:0/1331874493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc77409f240 0x7fc7741a4210 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 >> 172.21.15.19:0/1331874493 conn(0x7fc7740a4210 msgr2=0x7fc7741b8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 shutdown_connections 2023-10-03T10:23:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:14.237+0000 7fc77a6d9700 1 -- 172.21.15.19:0/1331874493 wait complete. 2023-10-03T10:23:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:listed 11 entries 2023-10-03T10:23:14.250 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi027.front.sepia.ceph.com... 2023-10-03T10:23:14.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:23:14.251 DEBUG:teuthology.orchestra.run.smithi027:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-03T10:23:14.296 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi027.stderr:ceph-fuse[112336]: fuse finished with error 0 and tester_r 0 2023-10-03T10:23:14.298 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:23:20.399 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi027.front.sepia.ceph.com 2023-10-03T10:23:20.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:23:20.400 DEBUG:teuthology.orchestra.run.smithi027:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-03T10:23:20.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:23:20.438 DEBUG:teuthology.orchestra.run.smithi027:> ip netns list 2023-10-03T10:23:20.501 INFO:teuthology.orchestra.run.smithi027.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-03T10:23:20.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:23:20.501 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-03T10:23:20.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-03T10:23:20.583 DEBUG:teuthology.orchestra.run.smithi027:> sudo ip link delete ceph-brx 2023-10-03T10:23:20.684 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-03T10:23:20.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-03T10:23:20.696 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-03T10:23:20.840 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 Processor -- start 2023-10-03T10:23:20.841 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 -- start start 2023-10-03T10:23:20.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 0x7f3794133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.843 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 -- --> v2:172.21.15.19:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379406b460 con 0x7f379409e000 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379409b120 con 0x7f379409e410 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f379a20b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f379409a7e0 con 0x7f379409d6f0 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f3792ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f37937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f3793fff700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 0x7f3794133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f3792ffd700 1 --2- >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38146/0 (socket says 172.21.15.19:38146) 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f37937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3302/0 says I am v2:172.21.15.19:52804/0 (socket says 172.21.15.19:52804) 2023-10-03T10:23:20.844 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.841+0000 7f3792ffd700 1 -- 172.21.15.19:0/644636902 learned_addr learned my addr 172.21.15.19:0/644636902 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 -- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 msgr2=0x7f3794133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 0x7f3794133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 -- 172.21.15.19:0/644636902 >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 msgr2=0x7f37941339f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 --2- 172.21.15.19:0/644636902 >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 -- 172.21.15.19:0/644636902 --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379409a500 con 0x7f379409d6f0 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f3792ffd700 1 --2- 172.21.15.19:0/644636902 >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f3793fff700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 0x7f3794133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:20.845 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37937fe700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3784009870 tx=0x7f3784009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3bd28146037c8c server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37927fc700 1 -- 172.21.15.19:0/644636902 <== mon.2 v2:172.21.15.19:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784011830 con 0x7f379409d6f0 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37927fc700 1 -- 172.21.15.19:0/644636902 <== mon.2 v2:172.21.15.19:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784011990 con 0x7f379409d6f0 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.842+0000 7f37927fc700 1 -- 172.21.15.19:0/644636902 <== mon.2 v2:172.21.15.19:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3784011d20 con 0x7f379409d6f0 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 -- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 msgr2=0x7f379409dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3784009870 tx=0x7f3784009b80 comp rx=0 tx=0).stop 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 -- 172.21.15.19:0/644636902 shutdown_connections 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e410 0x7f3794133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.846 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 --2- 172.21.15.19:0/644636902 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f379409dac0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 --2- 172.21.15.19:0/644636902 >> v2:172.21.15.19:3300/0 conn(0x7f379409e000 0x7f37941339f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 -- 172.21.15.19:0/644636902 >> 172.21.15.19:0/644636902 conn(0x7f3794066f50 msgr2=0x7f379409f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-03T10:23:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 -- 172.21.15.19:0/644636902 shutdown_connections 2023-10-03T10:23:20.847 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.843+0000 7f379a20b700 1 -- 172.21.15.19:0/644636902 wait complete. 2023-10-03T10:23:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.844+0000 7f379a20b700 1 Processor -- start 2023-10-03T10:23:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.844+0000 7f379a20b700 1 -- start start 2023-10-03T10:23:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f37941a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.849 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e000 0x7f37941a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 0x7f37941a68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37941b9570 con 0x7f379409e410 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 -- --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37941a9900 con 0x7f379409e000 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f379a20b700 1 -- --> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37940a2140 con 0x7f379409d6f0 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3793fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 0x7f37941a68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f37937fe700 1 --2- >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f37941a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 --2- >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e000 0x7f37941a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-03T10:23:20.850 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3793fff700 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 0x7f37941a68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38148/0 (socket says 172.21.15.19:38148) 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3793fff700 1 -- 172.21.15.19:0/3126829725 learned_addr learned my addr 172.21.15.19:0/3126829725 (peer_addr_for_me v2:172.21.15.19:0/0) 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 -- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 msgr2=0x7f37941a5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 --2- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3302/0,v1:172.21.15.19:6791/0] conn(0x7f379409d6f0 0x7f37941a5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 -- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 msgr2=0x7f37941a68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 --2- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 0x7f37941a68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 -- 172.21.15.19:0/3126829725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788009550 con 0x7f379409e000 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3793fff700 1 --2- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f379409e410 0x7f37941a68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-03T10:23:20.851 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f3792ffd700 1 --2- 172.21.15.19:0/3126829725 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x7f379409e000 0x7f37941a63a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f379406e510 tx=0x7f378800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.845+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788004240 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.846+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880043a0 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.846+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880036a0 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.846+0000 7f379a20b700 1 -- 172.21.15.19:0/3126829725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378c009a70 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.846+0000 7f379a20b700 1 -- 172.21.15.19:0/3126829725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37840094a0 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.847+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 4 ==== mgrmap(e 10) v1 ==== 35252+0+0 (secure 0 0 0) 0x7f3788003800 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.847+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4364+0+0 (secure 0 0 0) 0x7f378803f890 con 0x7f379409e000 2023-10-03T10:23:20.852 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.847+0000 7f379a20b700 1 -- 172.21.15.19:0/3126829725 --> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794074ea0 con 0x7f379409e000 2023-10-03T10:23:20.853 INFO:teuthology.orchestra.run.smithi019.stderr:2023-10-03T10:23:20.852+0000 7f377bfff700 1 -- 172.21.15.19:0/3126829725 <== mon.1 v2:172.21.15.19:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173876 (secure 0 0 0) 0x7f3788013470 con 0x7f379409e000 2023-10-03T10:25:20.737 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-03T10:25:20.738 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:20.747 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-03T10:25:20.748 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-03T10:25:20.748 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:20.761 INFO:tasks.ceph.mds.a:Stopped 2023-10-03T10:25:20.762 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-03T10:25:20.762 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-03T10:25:20.762 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:20.831 INFO:tasks.ceph.osd.0:Stopped 2023-10-03T10:25:20.831 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-03T10:25:20.831 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:20.912 INFO:tasks.ceph.osd.1:Stopped 2023-10-03T10:25:20.912 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-03T10:25:20.913 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:20.980 INFO:tasks.ceph.osd.2:Stopped 2023-10-03T10:25:20.980 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-03T10:25:20.980 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:21.048 INFO:tasks.ceph.osd.3:Stopped 2023-10-03T10:25:21.049 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-03T10:25:21.049 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-03T10:25:21.049 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:21.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:21.049 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1469, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:25:21.060 INFO:tasks.ceph.mgr.x:Stopped 2023-10-03T10:25:21.060 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-03T10:25:21.060 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-03T10:25:21.061 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:21.102 INFO:tasks.ceph.mon.a:Stopped 2023-10-03T10:25:21.103 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-03T10:25:21.103 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:21.156 INFO:tasks.ceph.mon.b:Stopped 2023-10-03T10:25:21.156 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-03T10:25:21.156 INFO:teuthology.orchestra.run:waiting for 300 2023-10-03T10:25:21.210 INFO:tasks.ceph.mon.c:Stopped 2023-10-03T10:25:21.210 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-03T10:25:21.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | head -n 1 2023-10-03T10:25:21.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:25:21.298 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-03T10:25:21.521 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:25:21.521 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-03T10:25:21.605 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:25:21.605 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-03T10:25:21.758 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:25:21.758 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-03T10:25:21.852 INFO:tasks.ceph:Archiving mon data... 2023-10-03T10:25:21.853 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/data/mon.a.tgz 2023-10-03T10:25:21.854 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-10-03T10:25:21.877 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.suymAlFDgg 2023-10-03T10:25:21.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.suymAlFDgg 2023-10-03T10:25:22.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.suymAlFDgg 2023-10-03T10:25:22.126 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.suymAlFDgg is 318KB 2023-10-03T10:25:22.225 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.suymAlFDgg 2023-10-03T10:25:22.249 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/data/mon.b.tgz 2023-10-03T10:25:22.249 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-10-03T10:25:22.312 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.NT1jsuSmVP 2023-10-03T10:25:22.312 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NT1jsuSmVP 2023-10-03T10:25:22.451 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.NT1jsuSmVP 2023-10-03T10:25:22.548 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.NT1jsuSmVP is 320KB 2023-10-03T10:25:22.646 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.NT1jsuSmVP 2023-10-03T10:25:22.669 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/data/mon.c.tgz 2023-10-03T10:25:22.669 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2023-10-03T10:25:22.732 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.iwhhEkMpTF 2023-10-03T10:25:22.732 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.iwhhEkMpTF 2023-10-03T10:25:22.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.iwhhEkMpTF 2023-10-03T10:25:22.968 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.iwhhEkMpTF is 320KB 2023-10-03T10:25:23.066 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.iwhhEkMpTF 2023-10-03T10:25:23.089 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-03T10:25:23.089 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:25:23.131 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-03T10:25:23.170 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-03T10:25:23.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:25:23.206 DEBUG:teuthology.orchestra.run.smithi027:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-03T10:25:23.240 INFO:teuthology.orchestra.run.smithi019.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:25:23.243 INFO:teuthology.orchestra.run.smithi027.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-03T10:25:23.250 INFO:tasks.ceph:Archiving crash dumps... 2023-10-03T10:25:23.252 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi019/crash 2023-10-03T10:25:23.253 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:25:23.323 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/lib/ceph/crash to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi027/crash 2023-10-03T10:25:23.324 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-03T10:25:23.364 INFO:tasks.ceph:Compressing logs... 2023-10-03T10:25:23.365 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:25:23.368 DEBUG:teuthology.orchestra.run.smithi027:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-03T10:25:23.401 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191676.log 2023-10-03T10:25:23.401 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138089.log 2023-10-03T10:25:23.443 INFO:teuthology.orchestra.run.smithi027.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112336.log 2023-10-03T10:25:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:/var/log/ceph/ceph-client.0.112336.log: 96.6% -- replaced with /var/log/ceph/ceph-client.0.112336.log.gz 2023-10-03T10:25:23.451 INFO:teuthology.orchestra.run.smithi027.stderr: 2023-10-03T10:25:23.451 INFO:teuthology.orchestra.run.smithi027.stderr:real 0m0.020s 2023-10-03T10:25:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:user 0m0.017s 2023-10-03T10:25:23.452 INFO:teuthology.orchestra.run.smithi027.stderr:sys 0m0.012s 2023-10-03T10:25:23.589 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150296.log 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191676.log.gz 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187068.log 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138089.log.gz 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143609.log 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150296.log: /var/log/ceph/ceph-client.admin.187068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170631.log 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150296.log.gz 2023-10-03T10:25:23.590 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187068.log.gz 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176912.log 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143609.log.gz 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174551.log 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170631.log.gz 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143210.log 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174551.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176912.log.gz 2023-10-03T10:25:23.591 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149047.log 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174551.log.gz 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153218.log 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143210.log.gz 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175241.log 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153218.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149047.log.gz 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164351.log 2023-10-03T10:25:23.592 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153218.log.gz 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168297.log 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.175241.log.gz 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168771.log 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164351.log.gz 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164155.log 2023-10-03T10:25:23.593 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168297.log.gz 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190355.log 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168771.log.gz 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136325.log 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164155.log.gz 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160333.log 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.190355.log.gz 2023-10-03T10:25:23.594 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177549.log 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136325.log.gz 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135311.log 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160333.log.gz 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172887.log 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135311.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177549.log.gz 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160922.log 2023-10-03T10:25:23.595 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.135311.log.gz 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173083.log 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172887.log.gz 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194836.log 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160922.log.gz/var/log/ceph/ceph-client.admin.173083.log: 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151107.log 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173083.log.gz 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190578.log 2023-10-03T10:25:23.596 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194836.log.gz 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181129.log 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190578.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151107.log.gz 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181273.log 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190578.log.gz 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183063.log 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181129.log.gz 2023-10-03T10:25:23.597 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162642.log 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183063.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181273.log.gz 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173866.log 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183063.log.gz 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139631.log 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.162642.log.gz 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187165.log 2023-10-03T10:25:23.598 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139631.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173866.log.gz 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161437.log 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139631.log.gz 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155131.log 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187165.log.gz 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127712.log 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161437.log.gz/var/log/ceph/ceph-client.admin.155131.log: 2023-10-03T10:25:23.599 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183482.log 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155131.log.gz 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195424.log 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127712.log.gz 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160627.log 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195424.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183482.log.gz 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175426.log 2023-10-03T10:25:23.600 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.195424.log.gz 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145349.log 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160627.log.gz 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188011.log 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145349.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175426.log.gz 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145323.log 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145349.log.gz 2023-10-03T10:25:23.601 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148315.log 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188011.log.gz 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138771.log 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148315.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145323.log.gz 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174847.log 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148315.log.gz 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129168.log 2023-10-03T10:25:23.602 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138771.log.gz 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142963.log 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129168.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174847.log.gz 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189028.log 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129168.log.gz 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187030.log 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142963.log.gz 2023-10-03T10:25:23.603 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140245.log 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189028.log.gz 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136770.log 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.187030.log.gz 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137182.log 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140245.log.gz 2023-10-03T10:25:23.604 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149831.log 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.136770.log.gz 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125083.log 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.137182.log.gz 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144617.log 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.149831.log.gz 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184435.log 2023-10-03T10:25:23.605 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144617.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125083.log.gz 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166141.log 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144617.log.gz 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193916.log 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184435.log.gz 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125889.log 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193916.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166141.log.gz 2023-10-03T10:25:23.606 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156188.log 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193916.log.gz 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150811.log 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191873.log 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.125889.log.gz 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156188.log.gz 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151304.log 2023-10-03T10:25:23.607 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191873.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.150811.log.gz 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162417.log 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191873.log.gz 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147754.log 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.151304.log.gz 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162469.log 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162417.log.gz 2023-10-03T10:25:23.608 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178137.log 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.147754.log.gz 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160526.log 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178137.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162469.log.gz 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169873.log 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.178137.log.gz 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177696.log 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160526.log.gz 2023-10-03T10:25:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146303.log 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177696.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169873.log.gz 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175046.log 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177696.log.gz 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123466.log 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146303.log.gz 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191969.log 2023-10-03T10:25:23.610 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123466.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175046.log.gz 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167735.log 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123466.log.gz 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168475.log 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.191969.log.gz 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175018.log 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167735.log.gz 2023-10-03T10:25:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194089.log 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175018.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168475.log.gz 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179170.log 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175018.log.gz 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182204.log 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.194089.log.gz 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138183.log 2023-10-03T10:25:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182204.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179170.log.gz 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145009.log 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182204.log.gz 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192879.log 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138183.log.gz 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156973.log 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192879.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145009.log.gz 2023-10-03T10:25:23.613 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188199.log 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192879.log.gz 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185819.log 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156973.log.gz 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137083.log 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.188199.log.gz 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184017.log 2023-10-03T10:25:23.614 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185819.log.gz 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168324.log 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137083.log.gz 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146969.log 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168324.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184017.log.gz 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180293.log 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168324.log.gz 2023-10-03T10:25:23.615 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162072.log 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146969.log.gz 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125230.log 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180293.log.gz 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173767.log 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162072.log.gz 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167095.log 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149073.log 2023-10-03T10:25:23.616 INFO:teuthology.orchestra.run.smithi019.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.125230.log.gz 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173767.log.gz 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177818.log 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.167095.log.gz 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139090.log 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149073.log.gz 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166899.log 2023-10-03T10:25:23.617 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177818.log.gz 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181812.log 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139090.log.gz 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146891.log 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166899.log.gz 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141617.log 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146891.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.181812.log.gz 2023-10-03T10:25:23.618 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145153.log 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146891.log.gz 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163397.log 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141617.log.gz 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155991.log 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145153.log.gz 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171052.log 2023-10-03T10:25:23.619 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.163397.log.gz 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179705.log 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155991.log.gz 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161267.log 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179705.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171052.log.gz 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146354.log 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179705.log.gz 2023-10-03T10:25:23.620 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149635.log 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161267.log.gz 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155403.log 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149635.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146354.log.gz 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189520.log 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149635.log.gz 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152068.log 2023-10-03T10:25:23.621 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155403.log.gz 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185894.log 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152068.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189520.log.gz 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189794.log 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152068.log.gz 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183942.log 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.185894.log.gz 2023-10-03T10:25:23.622 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168967.log 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183942.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.189794.log.gz 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143611.log 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.183942.log.gz 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147138.log 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168967.log.gz 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193075.log 2023-10-03T10:25:23.623 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143611.log.gz 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136743.log 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147138.log.gz 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142375.log 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.193075.log.gz 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162979.log 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142375.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136743.log.gz 2023-10-03T10:25:23.624 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192291.log 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.142375.log.gz 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187264.log 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.162979.log.gz 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184704.log 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187264.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.192291.log.gz 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172787.log 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.187264.log.gz 2023-10-03T10:25:23.625 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185203.log 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184704.log.gz 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138575.log 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185203.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172787.log.gz 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141787.log 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185203.log.gz 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125693.log 2023-10-03T10:25:23.626 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.138575.log.gz 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149709.log 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141787.log.gz 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128776.log 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125693.log.gz 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176196.log 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128776.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149709.log.gz 2023-10-03T10:25:23.627 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174598.log 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128776.log.gz 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139678.log 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176196.log.gz 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188422.log 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174598.log.gz 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122501.log 2023-10-03T10:25:23.628 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188422.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.139678.log.gz 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124226.log 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.188422.log.gz 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180737.log 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122501.log.gz 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150615.log 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180737.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124226.log.gz 2023-10-03T10:25:23.629 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182057.log 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180737.log.gz 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140927.log 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150615.log.gz 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142671.log 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140927.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182057.log.gz 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160718.log 2023-10-03T10:25:23.630 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140927.log.gz 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142843.log 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142671.log.gz 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175189.log 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142843.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160718.log.gz 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157364.log 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142843.log.gz 2023-10-03T10:25:23.631 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145597.log 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175189.log.gz 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146917.log 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145597.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157364.log.gz 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174943.log 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145597.log.gz 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190970.log 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146917.log.gz 2023-10-03T10:25:23.632 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142179.log 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190970.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.174943.log.gz 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194332.log 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.190970.log.gz 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172591.log 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142179.log.gz 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190774.log 2023-10-03T10:25:23.633 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172591.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.194332.log.gz 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159103.log 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172591.log.gz 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176046.log 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.190774.log.gz 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172860.log 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176046.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159103.log.gz 2023-10-03T10:25:23.634 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162492.log 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.176046.log.gz 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162295.log 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172860.log.gz 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124691.log 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162492.log.gz 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155523.log 2023-10-03T10:25:23.635 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162295.log.gz 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189321.log 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124691.log: /var/log/ceph/ceph-client.admin.155523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186872.log 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124691.log.gz 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155523.log.gz 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184659.log 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189321.log.gz 2023-10-03T10:25:23.636 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191728.log 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184659.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186872.log.gz 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147087.log 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.184659.log.gz 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143434.log 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.191728.log.gz 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176242.log 2023-10-03T10:25:23.637 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147087.log.gz 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187949.log 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143434.log.gz 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194934.log 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176242.log.gz 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147335.log 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194934.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.187949.log.gz 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140535.log 2023-10-03T10:25:23.638 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.194934.log.gz 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142624.log 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147335.log.gz 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147530.log 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142624.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140535.log.gz 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149941.log 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142624.log.gz 2023-10-03T10:25:23.639 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129266.log 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147530.log.gz 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122619.log 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149941.log.gz 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173618.log 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129266.log: /var/log/ceph/ceph-client.admin.122619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166606.log 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129266.log.gz 2023-10-03T10:25:23.640 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122619.log.gz 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125742.log 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.173618.log.gz 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151697.log 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125742.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166606.log.gz 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139435.log 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125742.log.gz 2023-10-03T10:25:23.641 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164575.log 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151697.log.gz 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161633.log 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164575.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139435.log.gz 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157287.log 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.164575.log.gz 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150839.log 2023-10-03T10:25:23.642 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161633.log.gz 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143355.log 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150839.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157287.log.gz 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145715.log 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150839.log.gz 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124253.log 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143355.log.gz 2023-10-03T10:25:23.643 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144028.log 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124253.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.145715.log.gz 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193101.log 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124253.log.gz 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161867.log 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144028.log.gz 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124495.log 2023-10-03T10:25:23.644 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161867.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.193101.log.gz 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168867.log 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161867.log.gz 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147139.log 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.124495.log.gz 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170704.log 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147139.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168867.log.gz 2023-10-03T10:25:23.645 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152630.log 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147139.log.gz 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135113.log 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.170704.log.gz 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145127.log 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135113.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152630.log.gz 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159076.log 2023-10-03T10:25:23.646 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135113.log.gz 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161510.log 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145127.log.gz 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184213.log 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161510.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159076.log.gz 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149466.log 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161510.log.gz 2023-10-03T10:25:23.647 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173571.log 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184213.log.gz 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166703.log 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149466.log.gz 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174206.log 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173571.log.gz 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188832.log 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166703.log.gz 2023-10-03T10:25:23.648 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169507.log 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188832.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174206.log.gz 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195032.log 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188832.log.gz 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185793.log 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169507.log.gz 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140077.log 2023-10-03T10:25:23.649 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.195032.log.gz 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191531.log 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185793.log.gz 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136155.log 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140077.log: /var/log/ceph/ceph-client.admin.191531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172076.log 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140077.log.gz 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.191531.log.gz 2023-10-03T10:25:23.650 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187192.log 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136155.log.gz 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178088.log 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172076.log.gz 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176838.log 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.187192.log.gz 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170265.log 2023-10-03T10:25:23.651 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178088.log.gz 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138259.log 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.176838.log.gz 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159129.log 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170265.log.gz 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125181.log 2023-10-03T10:25:23.652 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.138259.log.gz 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194233.log 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125181.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159129.log.gz 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183429.log 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.125181.log.gz 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164252.log 2023-10-03T10:25:23.653 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194233.log.gz 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180711.log 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183429.log.gz 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153074.log 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164252.log.gz 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194429.log 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.180711.log.gz 2023-10-03T10:25:23.654 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122309.log 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194429.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.153074.log.gz 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155915.log 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194429.log.gz 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161683.log 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122309.log.gz 2023-10-03T10:25:23.655 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187460.log 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161683.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155915.log.gz 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195277.log 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161683.log.gz 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181077.log 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187460.log.gz 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150100.log 2023-10-03T10:25:23.656 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.195277.log.gz 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143559.log 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181077.log.gz 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128629.log 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150100.log.gz 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143559.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143559.log.gz 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148459.log 2023-10-03T10:25:23.657 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128629.log.gz 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187583.log 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192853.log 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187583.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148459.log.gz 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138967.log 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192853.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.187583.log.gz 2023-10-03T10:25:23.658 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170120.log 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.192853.log.gz 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123711.log 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138967.log.gz 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175242.log 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164743.log 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170120.log.gz 2023-10-03T10:25:23.659 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175242.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123711.log.gz 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135442.log 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.175242.log.gz 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158319.log /var/log/ceph/ceph-client.admin.164743.log: 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193723.log 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164743.log.gz 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158319.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135442.log.gz 2023-10-03T10:25:23.660 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191480.log 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158319.log.gz 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136584.log 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.193723.log.gz 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142844.log 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191480.log.gz 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191165.log 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142844.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136584.log.gz 2023-10-03T10:25:23.661 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159443.log 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142844.log.gz 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174232.log 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.191165.log.gz 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195081.log 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174232.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159443.log.gz 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167766.log 2023-10-03T10:25:23.662 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174232.log.gz 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180149.log 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.195081.log.gz 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147871.log 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180149.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167766.log.gz 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148877.log 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180149.log.gz 2023-10-03T10:25:23.663 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172638.log 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147871.log.gz 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175777.log 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148877.log.gz 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164769.log 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172638.log.gz 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188564.log 2023-10-03T10:25:23.664 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164769.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175777.log.gz 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127224.log 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164769.log.gz 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159469.log 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188564.log.gz 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136691.log 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159469.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127224.log.gz 2023-10-03T10:25:23.665 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192265.log 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.159469.log.gz 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165553.log 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136691.log.gz 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163201.log 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165553.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.192265.log.gz 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189990.log 2023-10-03T10:25:23.666 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165553.log.gz 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192364.log 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163201.log.gz 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157169.log 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192364.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.189990.log.gz 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173474.log 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.192364.log.gz 2023-10-03T10:25:23.667 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160431.log 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157169.log.gz 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.173474.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.170069.log 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173474.log.gz 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187779.log 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160431.log: /var/log/ceph/ceph-client.admin.170069.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160431.log.gz 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141813.log 2023-10-03T10:25:23.668 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170069.log.gz 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148559.log 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187779.log.gz 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146551.log 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148559.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141813.log.gz 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173473.log 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148559.log.gz 2023-10-03T10:25:23.669 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145226.log 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146551.log.gz 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183259.log 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145226.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173473.log.gz 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184239.log 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145226.log.gz 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149755.log 2023-10-03T10:25:23.670 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.183259.log.gz 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175850.log 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184239.log.gz 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183748.log 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175850.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.149755.log.gz 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168075.log 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175850.log.gz/var/log/ceph/ceph-client.admin.183748.log: 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141690.log 2023-10-03T10:25:23.671 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183748.log.gz 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137671.log 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168075.log.gz 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149904.log 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.141690.log.gz 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139968.log 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149904.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137671.log.gz 2023-10-03T10:25:23.672 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118617.log 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149904.log.gz 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158933.log 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139968.log.gz 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163423.log 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118617.log.gz 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174465.log 2023-10-03T10:25:23.673 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163423.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158933.log.gz 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142082.log 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.163423.log.gz 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191362.log 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174465.log.gz 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186381.log 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191362.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.142082.log.gz 2023-10-03T10:25:23.674 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140441.log 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.191362.log.gz 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170536.log 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186381.log.gz 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127079.log 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140441.log.gz 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173814.log 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170536.log.gz 2023-10-03T10:25:23.675 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144394.log 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173814.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127079.log.gz 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155013.log 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173814.log.gz 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188171.log 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144394.log.gz 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173056.log 2023-10-03T10:25:23.676 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.155013.log.gz 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188635.log 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.188171.log.gz 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135562.log 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173056.log.gz 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122913.log 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189793.log 2023-10-03T10:25:23.677 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.188635.log.gz 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.135562.log.gz 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173865.log 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189793.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.122913.log.gz-5 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.166411.log 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.189793.log.gz 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128200.log 2023-10-03T10:25:23.678 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.173865.log.gz 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135466.log 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166411.log: /var/log/ceph/ceph-client.admin.128200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167343.log 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166411.log.gz 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128200.log.gz 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163862.log 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164939.log 2023-10-03T10:25:23.679 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135466.log.gz 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167343.log.gz 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188828.log 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163862.log.gz 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160031.log /var/log/ceph/ceph-client.admin.164939.log: 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125595.log 2023-10-03T10:25:23.680 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164939.log.gz 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.188828.log.gz 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165775.log 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160031.log.gz 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179535.log 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125595.log.gz 2023-10-03T10:25:23.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166533.log 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165775.log.gz 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123662.log 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179535.log.gz 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169455.log 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.166533.log.gz 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179509.log 2023-10-03T10:25:23.682 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123662.log.gz 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189373.log 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169455.log.gz 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162783.log 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179509.log.gz 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149120.log 2023-10-03T10:25:23.683 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189373.log.gz 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181495.log 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162783.log.gz 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139286.log 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149120.log.gz 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127440.log 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181495.log.gz 2023-10-03T10:25:23.684 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180881.log 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139286.log.gz 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188440.log 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127440.log.gz 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155993.log 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188440.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180881.log.gz 2023-10-03T10:25:23.685 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137920.log 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188440.log.gz 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190944.log 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155993.log.gz 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183286.log 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190944.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.137920.log.gz 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149316.log 2023-10-03T10:25:23.686 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.190944.log.gz 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165945.log 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183286.log.gz 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169310.log 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149316.log.gz 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137724.log 2023-10-03T10:25:23.687 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165945.log.gz 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187557.log 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169310.log.gz 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129070.log 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.137724.log.gz 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150641.log 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.187557.log.gz 2023-10-03T10:25:23.688 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155011.log 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129070.log.gz 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156777.log 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150641.log.gz 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163666.log 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155011.log.gz 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167586.log 2023-10-03T10:25:23.689 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156777.log.gz 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166729.log 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163666.log.gz 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157561.log 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167586.log.gz 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163228.log 2023-10-03T10:25:23.690 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.166729.log.gz 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135187.log 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157561.log.gz 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136192.log 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163228.log.gz 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185455.log 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136192.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135187.log.gz 2023-10-03T10:25:23.691 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129315.log 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136192.log.gz 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148119.log 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.185455.log.gz 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165430.log 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148119.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129315.log.gz 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125546.log 2023-10-03T10:25:23.692 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148119.log.gz 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187064.log 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165430.log.gz 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183570.log 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125546.log.gz 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178921.log 2023-10-03T10:25:23.693 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187064.log.gz 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183091.log 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183570.log.gz 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170043.log 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178921.log.gz 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146381.log 2023-10-03T10:25:23.694 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.183091.log.gz 2023-10-03T10:25:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152826.log 2023-10-03T10:25:23.695 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170043.log.gz 2023-10-03T10:25:23.695 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156332.log 2023-10-03T10:25:23.695 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146381.log.gz 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166583.log 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%/var/log/ceph/ceph-client.admin.156332.log: -- replaced with /var/log/ceph/ceph-client.admin.152826.log.gz 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125132.log 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.156332.log.gz 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122717.log 2023-10-03T10:25:23.698 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166583.log.gz 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179117.log 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.125132.log.gz 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169728.log 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122717.log.gz 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179927.log 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.179117.log.gz 2023-10-03T10:25:23.699 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184631.log 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169728.log.gz 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176634.log 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179927.log.gz 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124544.log 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184631.log.gz 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165357.log 2023-10-03T10:25:23.700 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176634.log.gz 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187457.log 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124544.log.gz 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194088.log 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187457.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.165357.log.gz 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164181.log 2023-10-03T10:25:23.701 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187457.log.gz 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149512.log 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.194088.log.gz 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182867.log 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164181.log.gz 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153663.log 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149512.log.gz 2023-10-03T10:25:23.702 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186089.log 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182867.log.gz 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148145.log 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153663.log.gz 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122864.log 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186089.log.gz 2023-10-03T10:25:23.703 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167978.log 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148145.log.gz 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153171.log 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122864.log.gz 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188048.log 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167978.log.gz 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150492.log 2023-10-03T10:25:23.704 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153171.log.gz 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164965.log 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188048.log.gz 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180097.log 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.150492.log.gz 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176999.log 2023-10-03T10:25:23.705 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164965.log.gz 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151899.log 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176999.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180097.log.gz 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167709.log 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.176999.log.gz 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146184.log 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151899.log.gz 2023-10-03T10:25:23.706 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191361.log 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167709.log.gz 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159861.log 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146184.log.gz 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165723.log 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.191361.log.gz 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160849.log 2023-10-03T10:25:23.707 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159861.log.gz 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191088.log 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165723.log.gz 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186603.log 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.160849.log.gz 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151595.log 2023-10-03T10:25:23.708 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191088.log.gz 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157142.log 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186603.log.gz 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.151595.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.145179.log 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151595.log.gz 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123884.log 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157142.log.gz 2023-10-03T10:25:23.709 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176169.log 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123884.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.145179.log.gz 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186015.log 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.123884.log.gz 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166018.log 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176169.log.gz 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192746.log 2023-10-03T10:25:23.710 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186015.log.gz 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193722.log 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166018.log.gz 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184069.log 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192746.log.gz 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177353.log 2023-10-03T10:25:23.711 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.193722.log.gz 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179313.log 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184069.log.gz 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128580.log 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.177353.log.gz/var/log/ceph/ceph-client.admin.179313.log: 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188396.log 2023-10-03T10:25:23.712 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179313.log.gz 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157755.log 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128580.log.gz 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188396.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157755.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.188396.log.gz 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178163.log 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157755.log.gz 2023-10-03T10:25:23.713 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176438.log 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147165.log 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178163.log.gz 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169925.log 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176438.log.gz 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145422.log 2023-10-03T10:25:23.714 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147165.log: /var/log/ceph/ceph-client.admin.169925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148655.log 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.147165.log.gz 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145422.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.169925.log.gz 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182008.log 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.145422.log.gz 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118936.log 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148655.log.gz 2023-10-03T10:25:23.715 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190133.log 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182008.log.gz 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192095.log 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118936.log.gz 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195179.log 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190133.log.gz 2023-10-03T10:25:23.716 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159247.log 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.192095.log.gz--verbose 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:-- /var/log/ceph/ceph-client.admin.136913.log 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195179.log: /var/log/ceph/ceph-client.admin.159247.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.195179.log.gz 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164646.log 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154765.log 89.3% 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159247.log.gz 2023-10-03T10:25:23.717 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136913.log.gz 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144931.log 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154935.log 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164646.log.gz 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154765.log: /var/log/ceph/ceph-client.admin.144931.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154765.log.gz 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190552.log 2023-10-03T10:25:23.718 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.144931.log.gz 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129364.log 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154935.log: /var/log/ceph/ceph-client.admin.190552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129119.log 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154935.log.gz 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129364.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.190552.log.gz 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169115.log 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129364.log.gz 2023-10-03T10:25:23.719 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184461.log 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169115.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129119.log.gz 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118672.log 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.169115.log.gz 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176815.log 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173669.log 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118672.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.184461.log.gz 2023-10-03T10:25:23.720 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176815.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.118672.log.gz-5 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.192523.log 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% 95.6% -- replaced with /var/log/ceph/ceph-client.admin.176815.log.gz 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166311.log 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173669.log: /var/log/ceph/ceph-client.admin.192523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168174.log 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173669.log.gz 2023-10-03T10:25:23.721 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192523.log.gz 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136351.log 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.166311.log.gz 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152434.log 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168174.log: /var/log/ceph/ceph-client.admin.136351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181420.log 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168174.log.gz 2023-10-03T10:25:23.722 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136351.log.gz 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193148.log 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.152434.log.gz 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147562.log 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.181420.log.gz 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135264.log 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.193148.log.gz 2023-10-03T10:25:23.723 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186185.log 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147562.log.gz 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163986.log 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186185.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135264.log.gz 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189151.log 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.186185.log.gz 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183625.log 2023-10-03T10:25:23.724 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163986.log.gz 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135984.log 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189151.log.gz 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124031.log 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135984.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183625.log.gz 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180244.log 2023-10-03T10:25:23.725 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135984.log.gz 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138724.log 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180244.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124031.log.gz 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178872.log 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138724.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180244.log.gz 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122964.log 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.138724.log.gz 2023-10-03T10:25:23.726 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175385.log 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122964.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178872.log.gz 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146746.log 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122964.log.gz 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145519.log 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175385.log.gz 2023-10-03T10:25:23.727 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163630.log 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146746.log.gz 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169506.log 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.145519.log.gz 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181717.log 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.163630.log.gz 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153830.log 2023-10-03T10:25:23.728 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169506.log.gz 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164636.log 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153830.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.181717.log.gz 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170239.log 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153830.log.gz 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177892.log 2023-10-03T10:25:23.729 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164636.log.gz 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156503.log 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.170239.log.gz 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183455.log 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156503.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177892.log.gz 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140049.log 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156503.log.gz 2023-10-03T10:25:23.730 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163371.log 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183455.log.gz 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151007.log 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163371.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140049.log.gz 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140219.log 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.163371.log.gz 2023-10-03T10:25:23.731 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190160.log 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151007.log.gz 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182502.log 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190160.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140219.log.gz 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150323.log 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.190160.log.gz 2023-10-03T10:25:23.732 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135784.log 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182502.log.gz 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160523.log 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135784.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.150323.log.gzgzip 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.175581.log 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160523.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.135784.log.gz 2023-10-03T10:25:23.733 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128146.log 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160523.log.gz 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129783.log 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128146.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175581.log.gz 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186211.log 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128146.log.gz 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165749.log 2023-10-03T10:25:23.734 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129783.log.gz 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153563.log 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165749.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.186211.log.gz 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135611.log 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165749.log.gz 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172983.log 2023-10-03T10:25:23.735 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153563.log.gz 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139359.log 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172983.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135611.log.gz 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135513.log 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172983.log.gz 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144813.log 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139359.log.gz 2023-10-03T10:25:23.736 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179656.log 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144813.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135513.log.gz 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187261.log 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144813.log.gz 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179656.log: /var/log/ceph/ceph-client.admin.140637.log 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.179656.log.gz 2023-10-03T10:25:23.737 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129413.log 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140637.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.187261.log.gz 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172494.log 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140637.log.gz 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164842.log 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174747.log 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.129413.log.gz 2023-10-03T10:25:23.738 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172494.log.gz 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177108.log 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.164842.log.gz 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181861.log 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174747.log: gzip -5 --verbose /var/log/ceph/ceph-client.admin.177108.log: -- /var/log/ceph/ceph-client.admin.165135.log 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174747.log.gz 2023-10-03T10:25:23.739 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181861.log: gzip 88.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.177108.log.gz--verbose 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr:-- /var/log/ceph/ceph-client.admin.183847.log 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165135.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181861.log.gz 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170461.log 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165135.log.gz 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160726.log 2023-10-03T10:25:23.740 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183847.log.gz 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150715.log 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160726.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170461.log.gz 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154399.log 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160726.log.gz 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193919.log 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.150715.log.gz 2023-10-03T10:25:23.741 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185699.log 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193919.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154399.log.gz 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165580.log 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.193919.log.gz 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138455.log 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.185699.log.gz 2023-10-03T10:25:23.742 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164057.log 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165580.log.gz 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189347.log 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138455.log.gz 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154398.log 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.164057.log.gz/var/log/ceph/ceph-client.admin.189347.log: 2023-10-03T10:25:23.743 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184854.log 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189347.log.gz 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183678.log 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154398.log.gz 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161490.log 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184854.log.gz 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149549.log 2023-10-03T10:25:23.744 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.183678.log.gz 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192487.log 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161490.log.gz 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159665.log 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149549.log.gz/var/log/ceph/ceph-client.admin.192487.log: 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195228.log 2023-10-03T10:25:23.745 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.192487.log.gz 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183037.log 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195228.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159665.log.gz 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155600.log 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.195228.log.gz 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161072.log 2023-10-03T10:25:23.746 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.183037.log.gz 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180319.log 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155600.log.gz 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166998.log 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161072.log.gz 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136887.log 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180319.log.gz 2023-10-03T10:25:23.747 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184510.log 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136887.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166998.log.gz 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158123.log 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136887.log.gz 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145937.log 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.184510.log.gz 2023-10-03T10:25:23.748 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164424.log 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158123.log.gz 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174010.log 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145937.log.gz 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128120.log 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164424.log.gz 2023-10-03T10:25:23.749 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173226.log 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.174010.log.gz 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123221.log 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173226.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128120.log.gz 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173226.log.gz 2023-10-03T10:25:23.750 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161314.log 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123221.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151995.log 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123221.log.gz 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184137.log 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161314.log.gz 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166337.log 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172050.log 2023-10-03T10:25:23.751 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151995.log.gz 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184137.log: /var/log/ceph/ceph-client.admin.166337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.184137.log.gz 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137527.log 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166337.log.gz 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140273.log 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.137527.log: -- /var/log/ceph/ceph-client.admin.139239.log 2023-10-03T10:25:23.752 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172050.log.gz 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137527.log.gz 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140273.log.gz 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127639.log 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122570.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139239.log.gz 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155770.log 2023-10-03T10:25:23.753 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171292.log 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127639.log.gz 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138138.log 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155770.log.gz 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171292.log: /var/log/ceph/ceph-client.admin.194259.log 2023-10-03T10:25:23.754 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171292.log.gz 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171219.log 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194259.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.183651.log 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.138138.log.gz 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158515.log 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.194259.log.gz 2023-10-03T10:25:23.755 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.171219.log.gz 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123417.log 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183651.log.gz 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122815.log 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.158515.log.gz 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172199.log 2023-10-03T10:25:23.756 INFO:teuthology.orchestra.run.smithi019.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.123417.log.gz 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150910.log 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122815.log.gz 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169063.log 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172199.log: /var/log/ceph/ceph-client.admin.150910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179901.log 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172199.log.gz 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150910.log.gz 2023-10-03T10:25:23.757 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153367.log 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169063.log.gz 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145793.log 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179901.log.gz 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128972.log 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145793.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153367.log.gz 2023-10-03T10:25:23.758 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124083.log 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145793.log.gz 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155601.log 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162026.log 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128972.log.gz 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124083.log.gz 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147949.log 2023-10-03T10:25:23.759 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 /var/log/ceph/ceph-client.admin.162026.log: --verbose -- /var/log/ceph/ceph-client.admin.127283.log 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.155601.log.gz 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162101.log 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162026.log.gz 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127283.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147949.log.gz 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183374.log 2023-10-03T10:25:23.760 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127283.log.gz 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193343.log 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183374.log: gzip -5 --verbose -- 87.8%/var/log/ceph/ceph-client.admin.175924.log 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162101.log.gz 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193343.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.183374.log.gz 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.193343.log.gz 2023-10-03T10:25:23.761 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175924.log.gz 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193721.log 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177393.log 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193721.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193721.log.gz 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193245.log 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144421.log 2023-10-03T10:25:23.762 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177393.log.gz 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.193245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159639.log 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3%/var/log/ceph/ceph-client.admin.144421.log: -- replaced with /var/log/ceph/ceph-client.admin.193245.log.gz 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169534.log 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144421.log.gz 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128825.log 2023-10-03T10:25:23.763 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159639.log.gz 2023-10-03T10:25:23.764 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195130.log 2023-10-03T10:25:23.874 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169534.log: /var/log/ceph/ceph-client.admin.128825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143977.log 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169534.log.gz 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195130.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128825.log.gz 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180440.log 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.195130.log.gz 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165971.log 2023-10-03T10:25:23.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138651.log 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180440.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143977.log.gz 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165971.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180440.log.gz 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165971.log.gz 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138651.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138651.log.gz 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146773.log 2023-10-03T10:25:23.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187853.log 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124642.log 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146773.log.gz 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161903.log 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144147.log 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.187853.log.gz 2023-10-03T10:25:23.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124642.log: /var/log/ceph/ceph-client.admin.161903.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124642.log.gz 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158267.log 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161903.log.gz 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184605.log 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144147.log.gz 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.158267.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.190134.log 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184605.log: gzip 88.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.158267.log.gz-- 2023-10-03T10:25:23.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191702.log 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184605.log.gz 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137109.log 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190134.log.gz 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170881.log 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.191702.log.gz/var/log/ceph/ceph-client.admin.137109.log: 2023-10-03T10:25:23.879 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137109.log.gz 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170881.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.170881.log.gz 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192121.log 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153785.log 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165016.log 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153785.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192121.log.gz 2023-10-03T10:25:23.880 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153785.log.gz 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165016.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165016.log.gz 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184801.log 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165919.log 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158514.log 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.184801.log.gz 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182984.log 2023-10-03T10:25:23.881 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.165919.log.gz 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183821.log 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158514.log.gz 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135660.log 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182984.log.gz 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183821.log: /var/log/ceph/ceph-client.admin.135660.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.183821.log.gz 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.135660.log.gz 2023-10-03T10:25:23.882 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155599.log 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127949.log 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155599.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155599.log.gz 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127949.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127949.log.gz 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125791.log 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142401.log 2023-10-03T10:25:23.883 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186869.log 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142401.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125791.log.gz 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142401.log.gz 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160653.log 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.186869.log.gz 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155208.log 2023-10-03T10:25:23.884 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148924.log 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160653.log: /var/log/ceph/ceph-client.admin.155208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142231.log 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160653.log.gz 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.155208.log.gz 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151203.log 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142231.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148924.log.gz 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185623.log 2023-10-03T10:25:23.885 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142231.log.gz 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171834.log 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185623.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.151203.log.gz 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123015.log 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.185623.log.gz 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140880.log 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171834.log.gz 2023-10-03T10:25:23.886 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123015.log: /var/log/ceph/ceph-client.admin.140880.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123015.log.gz 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140880.log.gz 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149661.log 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154595.log 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171415.log 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149661.log.gz 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163763.log 2023-10-03T10:25:23.887 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- 89.0%/var/log/ceph/ceph-client.admin.179460.log 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154595.log.gz 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171415.log: /var/log/ceph/ceph-client.admin.163763.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171415.log.gz 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186238.log 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163763.log.gz 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172468.log 2023-10-03T10:25:23.888 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.179460.log.gz 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153040.log 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186238.log.gz 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152879.log 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172468.log: /var/log/ceph/ceph-client.admin.153040.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172468.log.gz 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153040.log.gz 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156384.log 2023-10-03T10:25:23.889 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152879.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152879.log.gz 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152387.log 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168726.log 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156384.log: /var/log/ceph/ceph-client.admin.152387.log: gzip 88.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.156384.log.gz-- 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153600.log 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152387.log.gz 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168893.log 2023-10-03T10:25:23.890 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168726.log.gz 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157509.log 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153600.log: /var/log/ceph/ceph-client.admin.168893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.153600.log.gz 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168893.log.gz 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157509.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157509.log.gz 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193645.log 2023-10-03T10:25:23.891 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125350.log 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173179.log 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127845.log 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.193645.log.gz 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125350.log: /var/log/ceph/ceph-client.admin.173179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161607.log 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125350.log.gz 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165804.log 2023-10-03T10:25:23.892 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173179.log.gz 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127845.log: /var/log/ceph/ceph-client.admin.161607.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127845.log.gz 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161607.log.gz 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127080.log 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165804.log.gz 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140731.log 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162613.log 2023-10-03T10:25:23.893 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127080.log.gz 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180123.log 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145766.log 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140731.log.gz 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162613.log: /var/log/ceph/ceph-client.admin.180123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154048.log 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162613.log.gz 2023-10-03T10:25:23.894 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180123.log.gz 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145766.log: /var/log/ceph/ceph-client.admin.154048.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145766.log.gz 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.154048.log.gz 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160104.log 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141983.log 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141298.log 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160104.log.gz 2023-10-03T10:25:23.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181299.log 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143237.log 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141983.log.gz 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141298.log: /var/log/ceph/ceph-client.admin.181299.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141298.log.gz 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163470.log 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181299.log.gz 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143237.log: /var/log/ceph/ceph-client.admin.163470.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143237.log.gz 2023-10-03T10:25:23.896 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143951.log 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163470.log.gz 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162268.log 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162222.log 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143951.log: /var/log/ceph/ceph-client.admin.162268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152683.log 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143951.log.gz 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162268.log.gz 2023-10-03T10:25:23.897 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183873.log 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 88.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.162222.log.gz/var/log/ceph/ceph-client.admin.156333.log 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152683.log: /var/log/ceph/ceph-client.admin.183873.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.152683.log.gz 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139163.log 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183873.log.gz 2023-10-03T10:25:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138372.log 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156333.log: /var/log/ceph/ceph-client.admin.139163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156333.log.gz 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138372.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.139163.log.gz 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171731.log 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138372.log.gz 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190356.log 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123760.log 2023-10-03T10:25:23.899 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194625.log 2023-10-03T10:25:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190356.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171731.log.gz 2023-10-03T10:25:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123760.log: gzip 89.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.190356.log.gz-- 2023-10-03T10:25:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168271.log 2023-10-03T10:25:23.901 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123760.log.gz 2023-10-03T10:25:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140611.log 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.194625.log.gz 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:gzip /var/log/ceph/ceph-client.admin.168271.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.144395.log 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161215.log 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168271.log.gz 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140611.log.gz 2023-10-03T10:25:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184900.log 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144395.log.gz 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173030.log 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161215.log.gz 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176608.log 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178947.log 2023-10-03T10:25:23.903 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184900.log.gz 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173030.log: /var/log/ceph/ceph-client.admin.176608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.173030.log.gz 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146550.log 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.176608.log.gz 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140415.log 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178947.log.gz 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124838.log 2023-10-03T10:25:23.904 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146550.log.gz 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140415.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140415.log.gz 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124838.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.124838.log.gz 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185304.log 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166507.log 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176961.log 2023-10-03T10:25:23.905 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185304.log.gz 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125301.log 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191773.log 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176961.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166507.log.gz 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125301.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176961.log.gzgzip 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.124936.log 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125301.log.gz 2023-10-03T10:25:23.906 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174794.log 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191773.log.gz 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151426.log 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124936.log.gz 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174794.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174794.log.gz 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151426.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.151426.log.gz 2023-10-03T10:25:23.907 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147309.log 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150518.log 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185989.log 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147309.log.gz 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174261.log 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.150518.log.gz 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179561.log 2023-10-03T10:25:23.908 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185989.log.gz 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124887.log 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174261.log.gz 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124887.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179561.log.gz 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124887.log.gz 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184313.log 2023-10-03T10:25:23.909 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189598.log 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159324.log 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.184313.log.gz 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172003.log 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167390.log 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189598.log.gz 2023-10-03T10:25:23.910 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159324.log: gzip /var/log/ceph/ceph-client.admin.172003.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.158881.log 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159324.log.gz 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.172003.log.gz 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142009.log 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.167390.log.gz--verbose 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:-- /var/log/ceph/ceph-client.admin.155771.log 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158881.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158881.log.gz 2023-10-03T10:25:23.911 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142009.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142009.log.gz/var/log/ceph/ceph-client.admin.155771.log: 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.155771.log.gz 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187656.log 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178359.log 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187656.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.187656.log.gz 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178359.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.178359.log.gz 2023-10-03T10:25:23.912 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136939.log 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151080.log 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160282.log 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.136939.log.gz 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181521.log 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159889.log 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151080.log.gz 2023-10-03T10:25:23.913 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160282.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160282.log.gz 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139827.log 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 87.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.181521.log.gz-- 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127508.log 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159889.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.159889.log.gz 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173422.log 2023-10-03T10:25:23.914 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139827.log.gz 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127508.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127508.log.gz 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173422.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173422.log.gz 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181913.log 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129673.log 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186043.log 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129673.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.181913.log.gz 2023-10-03T10:25:23.915 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124021.log 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.129673.log.gz 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124080.log 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186043.log: /var/log/ceph/ceph-client.admin.124021.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.186043.log.gz 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124080.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124021.log.gz 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124080.log.gz 2023-10-03T10:25:23.916 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177941.log 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192168.log 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150074.log 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177941.log.gz 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192168.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192168.log.gz 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150074.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.150074.log.gz 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189716.log 2023-10-03T10:25:23.917 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138481.log 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155992.log 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138481.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.189716.log.gz 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160906.log 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138481.log.gz 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155992.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.155992.log.gz 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188733.log 2023-10-03T10:25:23.918 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160906.log: 87.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.160906.log.gz--verbose 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:-- /var/log/ceph/ceph-client.admin.136495.log 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148754.log 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136495.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188733.log.gz 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177304.log 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.136495.log.gz 2023-10-03T10:25:23.919 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147922.log 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148754.log.gz 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177304.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.177304.log.gz 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148362.log 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147922.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147922.log.gz 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147726.log 2023-10-03T10:25:23.920 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164423.log 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.148362.log.gz 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169259.log 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.147726.log.gz 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164423.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164423.log.gz 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169259.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169259.log.gz 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190892.log 2023-10-03T10:25:23.921 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160131.log 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138677.log 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190892.log.gz 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172103.log 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160131.log.gz 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153048.log 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138677.log: /var/log/ceph/ceph-client.admin.172103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165331.log 2023-10-03T10:25:23.922 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138677.log.gz 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172103.log.gz 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167487.log 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176392.log 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153048.log.gz 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.165331.log.gz 2023-10-03T10:25:23.923 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123515.log 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190551.log 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%/var/log/ceph/ceph-client.admin.176392.log: -- replaced with /var/log/ceph/ceph-client.admin.167487.log.gz 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.176392.log.gz 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123515.log: /var/log/ceph/ceph-client.admin.169847.log 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190551.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123515.log.gz 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190551.log.gz/var/log/ceph/ceph-client.admin.169847.log: 2023-10-03T10:25:23.924 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169847.log.gz 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170316.log 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188955.log 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138528.log 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170316.log.gz 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154202.log 2023-10-03T10:25:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174355.log 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138528.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.188955.log.gz 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138528.log.gz 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189792.log 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.154202.log.gz 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181887.log 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174355.log.gz 2023-10-03T10:25:23.926 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170435.log 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.189792.log.gz 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158071.log 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181887.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181887.log.gz 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170435.log.gz 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158071.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158071.log.gz 2023-10-03T10:25:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127892.log 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158345.log 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155719.log 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.127892.log.gz 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158345.log.gz 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155719.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155719.log.gz 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154543.log 2023-10-03T10:25:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142597.log 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128923.log 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154543.log.gz 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175458.log 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.142597.log.gz 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163275.log 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175458.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128923.log.gz 2023-10-03T10:25:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144029.log 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.175458.log.gz 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137135.log 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163275.log.gz 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168671.log 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.144029.log.gz 2023-10-03T10:25:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128403.log 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137135.log.gz 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168671.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168671.log.gz 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128403.log.gz 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171023.log 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172395.log 2023-10-03T10:25:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162809.log 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171023.log.gz 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172395.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.172395.log.gz 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162809.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.162809.log.gz 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191532.log 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154007.log 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123121.log 2023-10-03T10:25:23.932 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.191532.log.gz 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143833.log 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154007.log.gz 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126801.log 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143833.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123121.log.gz 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136299.log 2023-10-03T10:25:23.933 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143833.log.gz 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.126801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182596.log 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136299.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126801.log.gz 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182596.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136299.log.gz 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182596.log.gz 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191284.log 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147479.log 2023-10-03T10:25:23.934 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182645.log 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191284.log.gz 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185670.log 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167317.log 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147479.log.gz 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182645.log: /var/log/ceph/ceph-client.admin.185670.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.182645.log.gz 2023-10-03T10:25:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169651.log 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185670.log.gz 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152852.log 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167317.log.gz 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169651.log: /var/log/ceph/ceph-client.admin.152852.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169651.log.gz 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152852.log.gz 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158880.log 2023-10-03T10:25:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178333.log 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158880.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158880.log.gz/var/log/ceph/ceph-client.admin.178333.log: 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.178333.log.gz 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128477.log 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139556.log 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168129.log 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128477.log.gz 2023-10-03T10:25:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171245.log 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190747.log 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139556.log.gz 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168129.log: /var/log/ceph/ceph-client.admin.171245.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168129.log.gz 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144787.log 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171245.log.gz 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141839.log 2023-10-03T10:25:23.938 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.190747.log.gz 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158541.log 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141839.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144787.log.gz 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185597.log 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141839.log.gz 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172246.log 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.158541.log.gz 2023-10-03T10:25:23.939 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153981.log 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.185597.log.gz 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172246.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.172246.log.gz/var/log/ceph/ceph-client.admin.153981.log: 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.153981.log.gz 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179757.log 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126952.log 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145911.log 2023-10-03T10:25:23.940 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.179757.log.gz 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.126952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171637.log 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188537.log 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126952.log.gz 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171637.log: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.145911.log.gz-5 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:--verbose -- /var/log/ceph/ceph-client.admin.174652.log 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188537.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171637.log.gz 2023-10-03T10:25:23.941 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.188537.log.gz 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174652.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174652.log.gz 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122668.log 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169311.log 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165161.log 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122668.log.gz 2023-10-03T10:25:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172272.log 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169311.log.gz 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189571.log 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165161.log.gz 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172272.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172272.log.gz 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.189571.log.gz 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123564.log 2023-10-03T10:25:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174061.log 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151231.log 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.123564.log.gz 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174061.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174061.log.gz 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151231.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151231.log.gz 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159835.log 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191164.log 2023-10-03T10:25:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141644.log 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159835.log.gz 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159077.log 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.191164.log.gz 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141644.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141644.log.gz 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159077.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159077.log.gz 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-03T10:25:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194285.log 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128727.log 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194285.log: 87.8%/var/log/ceph/ceph-client.admin.128727.log: -- replaced with /var/log/ceph/ceph-client.admin.194285.log.gz 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.128727.log.gz 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166115.log 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178779.log 2023-10-03T10:25:23.946 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166115.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166115.log.gz 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178779.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178779.log.gz 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157875.log 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153467.log 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157875.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.157875.log.gz 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153467.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.153467.log.gz 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150127.log 2023-10-03T10:25:23.947 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161411.log 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150127.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150127.log.gz 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161411.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161411.log.gz 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164795.log 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174402.log 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183233.log 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164795.log.gz 2023-10-03T10:25:23.948 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174402.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.174402.log.gz 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.183233.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.183233.log.gz 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141104.log 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135360.log 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141104.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.141104.log.gz 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135360.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135360.log.gz 2023-10-03T10:25:23.949 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179264.log 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188145.log 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127817.log 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188145.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.179264.log.gz 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188145.log.gz 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127817.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127817.log.gz 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157704.log 2023-10-03T10:25:23.950 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137369.log 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157704.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157704.log.gz 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137369.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137369.log.gz 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146695.log 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194455.log 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160823.log 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194455.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146695.log.gz 2023-10-03T10:25:23.951 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160823.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.194455.log.gz 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160823.log.gz 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127460.log 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189912.log 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127460.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127460.log.gz 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180685.log 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189912.log.gz 2023-10-03T10:25:23.952 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150456.log 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180685.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180685.log.gz 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150456.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150456.log.gz 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173375.log 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153759.log 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171441.log 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153759.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173375.log.gz 2023-10-03T10:25:23.953 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153759.log.gz 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171441.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.171441.log.gz 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170731.log 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168371.log 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146747.log 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170731.log.gz 2023-10-03T10:25:23.954 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168371.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.168371.log.gz 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146747.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146747.log.gz 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194983.log 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152096.log 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186435.log 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152096.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.194983.log.gz 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152096.log.gz 2023-10-03T10:25:23.955 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.186435.log.gz 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136546.log 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181616.log 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136546.log: /var/log/ceph/ceph-client.admin.181616.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136546.log.gz 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181616.log.gz 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148709.log 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171535.log 2023-10-03T10:25:23.956 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125399.log 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171535.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148709.log.gz 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171535.log.gz 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171927.log 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125399.log.gz 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169924.log 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185231.log 2023-10-03T10:25:23.957 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171927.log.gz 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169924.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169924.log.gz 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185231.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185231.log.gz 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166780.log 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182841.log 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155207.log 2023-10-03T10:25:23.958 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166780.log.gz 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182841.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.182841.log.gz 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155207.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.155207.log.gz 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179068.log 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169114.log 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140807.log 2023-10-03T10:25:23.959 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179068.log.gz 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169114.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169114.log.gz 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140807.log.gz 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161045.log 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188929.log 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135788.log 2023-10-03T10:25:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188929.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161045.log.gz 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188929.log.gz 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135788.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.135788.log.gz 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118224.log 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177034.log 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143041.log 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177034.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118224.log.gz 2023-10-03T10:25:23.961 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177034.log.gz 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143041.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143041.log.gz 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142205.log 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146185.log 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138285.log 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146185.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142205.log.gz 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146185.log.gz 2023-10-03T10:25:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138285.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.138285.log.gz 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158463.log 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157143.log 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158463.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158463.log.gz 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157143.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157143.log.gz 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171096.log 2023-10-03T10:25:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168575.log 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151843.log 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168575.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171096.log.gz 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168575.log.gz 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151843.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151843.log.gz 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189989.log 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147923.log 2023-10-03T10:25:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177745.log 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147923.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.189989.log.gz 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.147923.log.gz 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177745.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177745.log.gz 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145767.log 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179953.log 2023-10-03T10:25:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178974.log 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145767.log.gz 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179953.log: /var/log/ceph/ceph-client.admin.178974.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.179953.log.gz 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178974.log.gz 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144199.log 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147531.log 2023-10-03T10:25:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185427.log 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144199.log.gz 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186677.log 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147531.log.gz 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161829.log 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185427.log: /var/log/ceph/ceph-client.admin.186677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163959.log 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185427.log.gz 2023-10-03T10:25:23.967 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161829.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.186677.log.gz 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137279.log 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.161829.log.gz 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141421.log 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165190.log 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137279.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163959.log.gz 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141421.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137279.log.gz 2023-10-03T10:25:23.968 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165190.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141421.log.gz 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165190.log.gz 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152656.log 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190500.log 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143637.log 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152656.log.gz 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182306.log 2023-10-03T10:25:23.969 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162195.log 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190500.log.gz 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143637.log: /var/log/ceph/ceph-client.admin.182306.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143637.log.gz 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171611.log 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.182306.log.gz 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163079.log 2023-10-03T10:25:23.970 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.162195.log.gz 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171611.log: /var/log/ceph/ceph-client.admin.163079.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171611.log.gz 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163079.log.gz 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152779.log 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149269.log 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155797.log 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.152779.log.gz 2023-10-03T10:25:23.971 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135408.log 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.149269.log.gz 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137331.log 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186773.log 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135408.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.155797.log.gz 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137331.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.135408.log.gz 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186773.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.137331.log.gz 2023-10-03T10:25:23.972 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186773.log.gz 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180907.log 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141003.log 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166951.log 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180907.log.gz 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189224.log 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166951.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.141003.log.gz 2023-10-03T10:25:23.973 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166951.log.gz 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189224.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.189224.log.gz 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123887.log 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136129.log 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156750.log 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.123887.log.gz 2023-10-03T10:25:23.974 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178751.log 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178014.log 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136129.log.gz 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156750.log: /var/log/ceph/ceph-client.admin.178751.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.156750.log.gz 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6%/var/log/ceph/ceph-client.admin.178014.log: -- replaced with /var/log/ceph/ceph-client.admin.178751.log.gz 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.178014.log.gz 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139312.log 2023-10-03T10:25:23.975 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194885.log 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174990.log 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139312.log.gz 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156554.log 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194885.log.gz 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174990.log: /var/log/ceph/ceph-client.admin.156554.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174990.log.gz 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.156554.log.gz 2023-10-03T10:25:23.976 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165394.log 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137574.log 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180515.log 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165394.log.gz 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139116.log 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165234.log 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137574.log.gz 2023-10-03T10:25:23.977 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180515.log: /var/log/ceph/ceph-client.admin.139116.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.180515.log.gz 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193527.log 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.139116.log.gz 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138847.log 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165234.log.gz 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183180.log 2023-10-03T10:25:23.978 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182671.log 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193527.log.gz 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138847.log: /var/log/ceph/ceph-client.admin.183180.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.138847.log.gz 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.183180.log.gz 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182671.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.182671.log.gz 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191166.log 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149363.log 2023-10-03T10:25:23.979 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141225.log 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.191166.log.gz 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156699.log 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149363.log.gz 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146499.log 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141225.log: /var/log/ceph/ceph-client.admin.156699.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141225.log.gz 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146499.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.156699.log.gz 2023-10-03T10:25:23.980 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146499.log.gz 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129217.log 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151399.log 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129217.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129217.log.gz 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151399.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151399.log.gz 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193918.log 2023-10-03T10:25:23.981 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139483.log 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.193918.log.gz 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138920.log 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161803.log 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139483.log: /var/log/ceph/ceph-client.admin.138920.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139483.log.gz 2023-10-03T10:25:23.982 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138920.log.gz 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162882.log 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.161803.log.gz 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182253.log 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143807.log 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162882.log.gz 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125034.log 2023-10-03T10:25:23.983 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182253.log.gz 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143807.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143807.log.gz 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125034.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125034.log.gz 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157705.log 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158149.log 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150027.log 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157705.log.gz 2023-10-03T10:25:23.984 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158149.log: /var/log/ceph/ceph-client.admin.150027.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158149.log.gz 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.150027.log.gz 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178725.log 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178529.log 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138063.log 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.178725.log.gz 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178529.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-03T10:25:23.985 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.178529.log.gz 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138063.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.138063.log.gz 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163032.log 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.163032.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163032.log.gz 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167541.log 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167541.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167541.log.gz 2023-10-03T10:25:23.986 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194677.log 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194677.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.194677.log.gz 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136103.log 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136103.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.136103.log.gz 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139704.log 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139704.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139704.log.gz 2023-10-03T10:25:23.987 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139043.log 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139043.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139043.log.gz 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141295.log 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141295.log.gz 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143211.log 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143211.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143211.log.gz 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128480.log 2023-10-03T10:25:23.988 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128480.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128480.log.gz 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137893.log 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137893.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.137893.log.gz 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193525.log 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193525.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193525.log.gz 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143014.log 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143014.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.143014.log.gz 2023-10-03T10:25:23.989 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188636.log 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188636.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188636.log.gz 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151499.log 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151499.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151499.log.gz 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172690.log 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172690.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172690.log.gz 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176765.log 2023-10-03T10:25:23.990 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176765.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176765.log.gz 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148263.log 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148263.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148263.log.gz 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151668.log 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151668.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151668.log.gz 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182893.log 2023-10-03T10:25:23.991 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182893.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.182893.log.gz 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180048.log 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180048.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180048.log.gz 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149243.log 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149243.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.149243.log.gz 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162391.log 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162391.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162391.log.gz 2023-10-03T10:25:23.992 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177622.log 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177622.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177622.log.gz 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186286.log 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186286.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.186286.log.gz 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154816.log 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154816.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.154816.log.gz 2023-10-03T10:25:23.993 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166366.log 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166366.log.gz 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142571.log 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142571.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142571.log.gz 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169141.log 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169141.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169141.log.gz 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194528.log 2023-10-03T10:25:23.994 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194528.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.194528.log.gz 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167931.log 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167931.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.167931.log.gz 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170121.log 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170121.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170121.log.gz 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153244.log 2023-10-03T10:25:23.995 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153244.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153244.log.gz 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168697.log 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168697.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168697.log.gz 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170900.log 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170900.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.170900.log.gz 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173963.log 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173963.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173963.log.gz 2023-10-03T10:25:23.996 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144591.log 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144591.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144591.log.gz 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179339.log 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179339.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.179339.log.gz 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176708.log 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176708.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176708.log.gz 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150905.log 2023-10-03T10:25:23.997 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141494.log 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150905.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150905.log.gz 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141494.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141494.log.gz 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167121.log 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167121.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.167121.log.gz 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145963.log 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145963.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.145963.log.gz 2023-10-03T10:25:23.998 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146010.log 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.146010.log.gz 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127408.log 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127408.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.127408.log.gz 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144539.log 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144539.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144539.log.gz 2023-10-03T10:25:23.999 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192561.log 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192561.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192561.log.gz 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185500.log 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185500.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.185500.log.gz 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153440.log 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153440.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.153440.log.gz 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177157.log 2023-10-03T10:25:24.000 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177157.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177157.log.gz 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146355.log 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146355.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146355.log.gz 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167194.log 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192683.log 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167194.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167194.log.gz 2023-10-03T10:25:24.001 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124593.log 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.192683.log.gz 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166215.log 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124593.log.gz 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143381.log 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166215.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166215.log.gz 2023-10-03T10:25:24.002 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143381.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.143381.log.gz 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143159.log 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.143159.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143159.log.gz 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155209.log 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155209.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.155209.log.gz 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143015.log 2023-10-03T10:25:24.003 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143015.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.143015.log.gz 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175140.log 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175140.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175140.log.gz 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137330.log 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137330.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.137330.log.gz 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190382.log 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190382.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.190382.log.gz 2023-10-03T10:25:24.004 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179852.log 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179852.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.179852.log.gz 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176002.log 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176002.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.176002.log.gz 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157313.log 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157313.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.157313.log.gz 2023-10-03T10:25:24.005 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182697.log 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192709.log 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182697.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.182697.log.gz 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192709.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192709.log.gz 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177426.log 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177426.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.177426.log.gz 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134268.log 2023-10-03T10:25:24.006 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.134268.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134268.log.gz 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161241.log 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161241.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161241.log.gz 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152264.log 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152264.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.152264.log.gz 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124789.log 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124789.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124789.log.gz 2023-10-03T10:25:24.007 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178284.log 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178284.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.178284.log.gz 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150688.log 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150688.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150688.log.gz 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178555.log 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178555.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178555.log.gz 2023-10-03T10:25:24.008 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170929.log 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170929.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170929.log.gz 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127082.log 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127082.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.127082.log.gz 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148851.log 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148851.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.148851.log.gz 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122378.log 2023-10-03T10:25:24.009 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122378.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122378.log.gz 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152042.log 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152042.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152042.log.gz 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174159.log 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174159.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.174159.log.gz 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152975.log 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152975.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152975.log.gz 2023-10-03T10:25:24.010 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151872.log 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151872.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151872.log.gz 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164450.log 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164450.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164450.log.gz 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123170.log 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123170.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123170.log.gz 2023-10-03T10:25:24.011 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180345.log 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180345.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180345.log.gz 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123270.log 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123270.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123270.log.gz 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135384.log 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135384.log.gz 2023-10-03T10:25:24.012 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137966.log 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137966.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.137966.log.gz 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122427.log 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122427.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122427.log.gz 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161999.log 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161999.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161999.log.gz 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184852.log 2023-10-03T10:25:24.013 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184852.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.184852.log.gz 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154594.log 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154594.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.154594.log.gz 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172664.log 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172664.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172664.log.gz 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192461.log 2023-10-03T10:25:24.014 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192461.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.192461.log.gz 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185097.log 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185097.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.185097.log.gz 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163005.log 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163005.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163005.log.gz 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182475.log 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144225.log 2023-10-03T10:25:24.015 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182475.log: /var/log/ceph/ceph-client.admin.144225.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.182475.log.gz 2023-10-03T10:25:24.081 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144225.log.gz 2023-10-03T10:25:24.081 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158659.log 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158659.log.gz 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124227.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127212.log 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127212.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127212.log.gz 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162688.log 2023-10-03T10:25:24.082 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162688.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162688.log.gz 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123072.log 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123072.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123072.log.gz 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153271.log 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153271.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.153271.log.gz 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164254.log 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164254.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.164254.log.gz 2023-10-03T10:25:24.083 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129575.log 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129575.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129575.log.gz 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172442.log 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172442.log.gz 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151054.log 2023-10-03T10:25:24.084 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151054.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.151054.log.gz 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123885.log 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123885.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123885.log.gz 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118824.log 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118824.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118824.log.gz 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128372.log 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128372.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128372.log.gz 2023-10-03T10:25:24.085 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193297.log 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193297.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.193297.log.gz 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172298.log 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172298.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.172298.log.gz 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159495.log 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159495.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159495.log.gz 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157560.log 2023-10-03T10:25:24.086 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157560.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157560.log.gz 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165527.log 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165527.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.165527.log.gz 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167513.log 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167513.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167513.log.gz 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182449.log 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182449.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182449.log.gz 2023-10-03T10:25:24.087 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148681.log 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148681.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148681.log.gz 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154961.log 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154961.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.154961.log.gz 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150260.log 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150260.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150260.log.gz 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186407.log 2023-10-03T10:25:24.088 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186407.log: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.186407.log.gz 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192069.log 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151472.log 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192069.log: /var/log/ceph/ceph-client.admin.151472.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192069.log.gz 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151472.log.gz 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.111942.log 2023-10-03T10:25:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160235.log 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.111942.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.111942.log.gz 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160235.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.160235.log.gz 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152290.log 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156385.log 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152290.log: /var/log/ceph/ceph-client.admin.156385.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152290.log.gz 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156385.log.gz 2023-10-03T10:25:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143806.log 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136742.log 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143806.log: /var/log/ceph/ceph-client.admin.136742.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143806.log.gz 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.136742.log.gz 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136547.log 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164058.log 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136547.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.136547.log.gz 2023-10-03T10:25:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164058.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164058.log.gz 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191925.log 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180541.log 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191925.log: /var/log/ceph/ceph-client.admin.180541.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191925.log.gz 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180541.log.gz 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124397.log 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151791.log 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124397.log: /var/log/ceph/ceph-client.admin.151791.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.124397.log.gz 2023-10-03T10:25:24.092 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151791.log.gz 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144982.log 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171122.log 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144982.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.144982.log.gz 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171122.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171122.log.gz 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175728.log 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135933.log 2023-10-03T10:25:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175728.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.175728.log.gz 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135933.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135933.log.gz 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129021.log 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175806.log 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129021.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129021.log.gz 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175806.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175806.log.gz 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124740.log 2023-10-03T10:25:24.094 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180832.log 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124740.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124740.log.gz 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180832.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180832.log.gz 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182083.log 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127708.log 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182083.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.182083.log.gz 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127708.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127708.log.gz 2023-10-03T10:25:24.095 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176120.log 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156189.log 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176120.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176120.log.gz 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156189.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.156189.log.gz 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178406.log 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175617.log 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178406.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.178406.log.gz 2023-10-03T10:25:24.096 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175617.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.175617.log.gz 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168529.log 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175654.log 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168529.log: /var/log/ceph/ceph-client.admin.175654.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168529.log.gz 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175654.log.gz 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160058.log 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162587.log 2023-10-03T10:25:24.097 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160058.log: /var/log/ceph/ceph-client.admin.162587.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160058.log.gz 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162587.log.gz 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136986.log 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190748.log 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136986.log: /var/log/ceph/ceph-client.admin.190748.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.136986.log.gz 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.190748.log.gz 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156895.log 2023-10-03T10:25:24.098 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139853.log 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156895.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.156895.log.gz 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139853.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.139853.log.gz 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140340.log 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192952.log 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140340.log: /var/log/ceph/ceph-client.admin.192952.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140340.log.gz 2023-10-03T10:25:24.099 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.192952.log.gz 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127081.log 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194722.log 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127081.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127081.log.gz 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194722.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.194722.log.gz 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181469.log 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152486.log 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181469.log: /var/log/ceph/ceph-client.admin.152486.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181469.log.gz 2023-10-03T10:25:24.100 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152486.log.gz 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188982.log 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141395.log 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188982.log: /var/log/ceph/ceph-client.admin.141395.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.188982.log.gz 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.141395.log.gz 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161706.log 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161706.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161706.log.gz 2023-10-03T10:25:24.101 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164547.log 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181691.log 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164547.log: /var/log/ceph/ceph-client.admin.181691.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164547.log.gz 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159325.log 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.181691.log.gz 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191899.log 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159325.log.gz 2023-10-03T10:25:24.102 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191899.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.191899.log.gz 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176316.log 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176512.log 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122766.log 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.176316.log.gz 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176512.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.176512.log.gz 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138873.log 2023-10-03T10:25:24.103 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122766.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122766.log.gz 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138873.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.138873.log.gz 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125497.log 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174651.log 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125497.log: /var/log/ceph/ceph-client.admin.174651.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125497.log.gz 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174651.log.gz 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156751.log 2023-10-03T10:25:24.104 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147382.log 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156751.log: /var/log/ceph/ceph-client.admin.147382.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.156751.log.gz 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147382.log.gz 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195326.log 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193049.log 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.195326.log.gz/var/log/ceph/ceph-client.admin.193049.log: 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193049.log.gz 2023-10-03T10:25:24.105 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173278.log 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170489.log 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173278.log: /var/log/ceph/ceph-client.admin.170489.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173278.log.gz 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170489.log.gz 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175336.log 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149439.log 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175336.log: /var/log/ceph/ceph-client.admin.149439.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175336.log.gz 2023-10-03T10:25:24.106 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.149439.log.gz 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141031.log 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172848.log 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141031.log: /var/log/ceph/ceph-client.admin.172848.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141031.log.gz 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172848.log.gz 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189421.log 2023-10-03T10:25:24.107 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181325.log 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189421.log: /var/log/ceph/ceph-client.admin.181325.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.189421.log.gz 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.181325.log.gz 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159935.log 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168920.log 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159935.log: /var/log/ceph/ceph-client.admin.168920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159935.log.gz 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168920.log.gz 2023-10-03T10:25:24.108 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193841.log 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159738.log 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193841.log: /var/log/ceph/ceph-client.admin.159738.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.193841.log.gz 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159738.log.gz 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185848.log 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178676.log 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185848.log: /var/log/ceph/ceph-client.admin.178676.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.185848.log.gz 2023-10-03T10:25:24.109 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178676.log.gz 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193271.log 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158318.log 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193271.log: /var/log/ceph/ceph-client.admin.158318.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.193271.log.gz 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.158318.log.gz 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148118.log 2023-10-03T10:25:24.110 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148118.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148118.log.gz 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171318.log 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118568.log 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171318.log: /var/log/ceph/ceph-client.admin.118568.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171318.log.gz 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118568.log.gz 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135932.log 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162847.log 2023-10-03T10:25:24.111 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135932.log: /var/log/ceph/ceph-client.admin.162847.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135932.log.gz 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162847.log.gz 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189938.log 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157951.log 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189938.log: /var/log/ceph/ceph-client.admin.157951.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.189938.log.gz 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157951.log.gz 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147675.log 2023-10-03T10:25:24.112 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152263.log 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147675.log: /var/log/ceph/ceph-client.admin.152263.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.147675.log.gz 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.152263.log.gz 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156947.log 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192657.log 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156947.log: /var/log/ceph/ceph-client.admin.192657.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.156947.log.gz 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192657.log.gz 2023-10-03T10:25:24.113 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163175.log 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186630.log 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163175.log: /var/log/ceph/ceph-client.admin.186630.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163175.log.gz 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.186630.log.gz 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154203.log 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153955.log 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154203.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.154203.log.gz 2023-10-03T10:25:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153955.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.153955.log.gz 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174062.log 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141591.log 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174062.log: 88.0%/var/log/ceph/ceph-client.admin.141591.log: -- replaced with /var/log/ceph/ceph-client.admin.174062.log.gz 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.141591.log.gz 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165017.log 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137697.log 2023-10-03T10:25:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165017.log: /var/log/ceph/ceph-client.admin.137697.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165017.log.gz 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137697.log.gz 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163593.log 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141886.log 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163593.log: /var/log/ceph/ceph-client.admin.141886.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163593.log.gz 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.141886.log.gz 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180636.log 2023-10-03T10:25:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185260.log 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180636.log: /var/log/ceph/ceph-client.admin.185260.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180636.log.gz 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.185260.log.gz 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144786.log 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135785.log 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144786.log: 89.0%/var/log/ceph/ceph-client.admin.135785.log: -- replaced with /var/log/ceph/ceph-client.admin.144786.log.gz 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135785.log.gz 2023-10-03T10:25:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184997.log 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137770.log 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184997.log: /var/log/ceph/ceph-client.admin.137770.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.184997.log.gz 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.137770.log.gz 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180489.log 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156946.log 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.180489.log: /var/log/ceph/ceph-client.admin.156946.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180489.log.gz 2023-10-03T10:25:24.118 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.156946.log.gz 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144590.log 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182279.log 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144590.log: /var/log/ceph/ceph-client.admin.182279.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144590.log.gz 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.182279.log.gz 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126894.log 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157091.log 2023-10-03T10:25:24.119 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.126894.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.126894.log.gz 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157091.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157091.log.gz 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147283.log 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145375.log 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147283.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147283.log.gz 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157483.log 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145375.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145375.log.gz 2023-10-03T10:25:24.120 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137501.log 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157483.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.157483.log.gz 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195375.log 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128874.log 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.137501.log.gz 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.195375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142277.log 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.195375.log.gz 2023-10-03T10:25:24.121 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128874.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128874.log.gz 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163567.log 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142277.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142277.log.gz 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125448.log 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163567.log: /var/log/ceph/ceph-client.admin.125448.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163567.log.gz 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125448.log.gz 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193524.log 2023-10-03T10:25:24.122 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124446.log 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193524.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.193524.log.gz 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124446.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124446.log.gz 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154425.log 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169677.log 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154425.log: /var/log/ceph/ceph-client.admin.169677.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.154425.log.gz 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169677.log.gz 2023-10-03T10:25:24.123 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155404.log 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171807.log 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155404.log: /var/log/ceph/ceph-client.admin.171807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.155404.log.gz 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171807.log.gz 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182790.log 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145545.log 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182790.log: /var/log/ceph/ceph-client.admin.145545.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.182790.log.gz 2023-10-03T10:25:24.124 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.145545.log.gz 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187975.log 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128196.log 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187975.log: /var/log/ceph/ceph-client.admin.128196.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187975.log.gz 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128196.log.gz 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158737.log 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141199.log 2023-10-03T10:25:24.125 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158737.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.158737.log.gz 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192905.log 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141199.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141199.log.gz 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153858.log 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192905.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.192905.log.gz 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144198.log 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168501.log 2023-10-03T10:25:24.126 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153858.log.gz 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144198.log: /var/log/ceph/ceph-client.admin.168501.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.144198.log.gz 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168501.log.gz 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179366.log 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181224.log 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179366.log: /var/log/ceph/ceph-client.admin.181224.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.179366.log.gz 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.181224.log.gz 2023-10-03T10:25:24.127 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176365.log 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169729.log 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.176365.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.176365.log.gz 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169729.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169729.log.gz 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141490.log 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142767.log 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141490.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141490.log.gz 2023-10-03T10:25:24.128 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142767.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.142767.log.gz 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125644.log 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142429.log 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125644.log: /var/log/ceph/ceph-client.admin.142429.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.125644.log.gz 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.142429.log.gz 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178210.log 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129486.log 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178210.log: 87.8%/var/log/ceph/ceph-client.admin.129486.log: -- replaced with /var/log/ceph/ceph-client.admin.178210.log.gz 2023-10-03T10:25:24.129 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.129486.log.gz 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148067.log 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157365.log 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148067.log: /var/log/ceph/ceph-client.admin.157365.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148067.log.gz 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.157365.log.gz 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123368.log 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171705.log 2023-10-03T10:25:24.130 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123368.log: /var/log/ceph/ceph-client.admin.171705.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123368.log.gz 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171705.log.gz 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137867.log 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137867.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.137867.log.gz 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154621.log 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170317.log 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154621.log: /var/log/ceph/ceph-client.admin.170317.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.154621.log.gz 2023-10-03T10:25:24.131 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170317.log.gz 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135787.log 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177500.log 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135787.log: /var/log/ceph/ceph-client.admin.177500.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.135787.log.gz 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.177500.log.gz 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149857.log 2023-10-03T10:25:24.132 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180933.log 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149857.log: 88.9%/var/log/ceph/ceph-client.admin.180933.log: -- replaced with /var/log/ceph/ceph-client.admin.149857.log.gz 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180933.log.gz 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148289.log 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176561.log 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148289.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148289.log.gz/var/log/ceph/ceph-client.admin.176561.log: 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165626.log 2023-10-03T10:25:24.133 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.176561.log.gz 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148511.log 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165626.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165626.log.gz 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138379.log 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148511.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148511.log.gz 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191310.log 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138379.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.138379.log.gz 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127282.log 2023-10-03T10:25:24.134 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191310.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.191310.log.gz 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127282.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127282.log.gz 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187753.log 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163861.log 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187753.log: /var/log/ceph/ceph-client.admin.163861.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.187753.log.gz 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.163861.log.gz 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193526.log 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170657.log 2023-10-03T10:25:24.135 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.193526.log: /var/log/ceph/ceph-client.admin.170657.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.193526.log.gz 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170657.log.gz 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166925.log 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178584.log 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166925.log: /var/log/ceph/ceph-client.admin.178584.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.166925.log.gz 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.178584.log.gz 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189177.log 2023-10-03T10:25:24.136 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150223.log 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189177.log: /var/log/ceph/ceph-client.admin.150223.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.189177.log.gz 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.150223.log.gz 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188341.log 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157757.log 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188341.log: /var/log/ceph/ceph-client.admin.157757.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.188341.log.gz 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157757.log.gz 2023-10-03T10:25:24.137 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166167.log 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148485.log 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177774.log 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.166167.log.gz 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148485.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148485.log.gz 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144735.log 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152583.log 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.177774.log.gz 2023-10-03T10:25:24.138 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123319.log 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144735.log.gz 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171926.log 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152583.log.gz 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123319.log: /var/log/ceph/ceph-client.admin.171926.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.123319.log.gz 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171926.log.gz 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190186.log 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140685.log 2023-10-03T10:25:24.139 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190186.log: /var/log/ceph/ceph-client.admin.140685.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.190186.log.gz 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140685.log.gz 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177193.log 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167905.log 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177193.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177193.log.gz 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167905.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167905.log.gz 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151642.log 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153413.log 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151642.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151642.log.gz 2023-10-03T10:25:24.140 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153413.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.153413.log.gz 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142845.log 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154230.log 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142845.log: /var/log/ceph/ceph-client.admin.154230.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.142845.log.gz 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154230.log.gz 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185049.log 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140146.log 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185049.log: /var/log/ceph/ceph-client.admin.140146.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.185049.log.gz 2023-10-03T10:25:24.141 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.140146.log.gz 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190943.log 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184043.log 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190943.log: /var/log/ceph/ceph-client.admin.184043.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.190943.log.gz 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.184043.log.gz 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158907.log 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168101.log 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158907.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158907.log.gz 2023-10-03T10:25:24.142 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168101.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168101.log.gz 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185401.log 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156555.log 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185401.log: /var/log/ceph/ceph-client.admin.156555.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.185401.log.gz 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156555.log.gz 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194037.log 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163790.log 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194037.log: /var/log/ceph/ceph-client.admin.163790.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.194037.log.gz 2023-10-03T10:25:24.143 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.163790.log.gz 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181103.log 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160334.log 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181103.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.181103.log.gz 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160334.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.160334.log.gz 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167683.log 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167193.log 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167683.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.167683.log.gz 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167193.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167193.log.gz 2023-10-03T10:25:24.144 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182398.log 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177585.log 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182398.log: /var/log/ceph/ceph-client.admin.177585.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.182398.log.gz 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177585.log.gz 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140023.log 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191559.log 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140023.log: /var/log/ceph/ceph-client.admin.191559.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.140023.log.gz 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.191559.log.gz 2023-10-03T10:25:24.145 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140833.log 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190304.log 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140833.log: /var/log/ceph/ceph-client.admin.190304.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140833.log.gz 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.190304.log.gz 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142475.log 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187655.log 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142475.log: /var/log/ceph/ceph-client.admin.187655.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.142475.log.gz 2023-10-03T10:25:24.146 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.187655.log.gz 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144343.log 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186577.log 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144343.log: /var/log/ceph/ceph-client.admin.186577.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.144343.log.gz 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186577.log.gz 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118515.log 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187805.log 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118515.log: /var/log/ceph/ceph-client.admin.187805.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.118515.log.gz 2023-10-03T10:25:24.147 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.187805.log.gz 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124985.log 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194115.log 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124985.log: /var/log/ceph/ceph-client.admin.194115.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124985.log.gz 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.194115.log.gz 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143755.log 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194651.log 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143755.log: /var/log/ceph/ceph-client.admin.194651.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.143755.log.gz 2023-10-03T10:25:24.148 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.194651.log.gz 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154347.log 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143433.log 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154347.log: /var/log/ceph/ceph-client.admin.143433.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.154347.log.gz 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143433.log.gz 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158710.log 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173277.log 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158710.log: /var/log/ceph/ceph-client.admin.173277.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158710.log.gz 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.173277.log.gz 2023-10-03T10:25:24.149 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178480.log 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187361.log 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.178480.log: /var/log/ceph/ceph-client.admin.187361.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178480.log.gz 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.187361.log.gz 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161118.log 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139882.log 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161118.log: /var/log/ceph/ceph-client.admin.139882.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161118.log.gz 2023-10-03T10:25:24.150 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.139882.log.gz 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139508.log 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187387.log 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139508.log: /var/log/ceph/ceph-client.admin.187387.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139508.log.gz 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.187387.log.gz 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156111.log 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179143.log 2023-10-03T10:25:24.151 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156111.log: /var/log/ceph/ceph-client.admin.179143.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156111.log.gz 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179143.log.gz 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159541.log 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129898.log 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159541.log: /var/log/ceph/ceph-client.admin.129898.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.159541.log.gz 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.129898.log.gz 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158122.log 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127612.log 2023-10-03T10:25:24.152 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158122.log: /var/log/ceph/ceph-client.admin.127612.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158122.log.gz 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127612.log.gz 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145596.log 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.145596.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145596.log.gz 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188244.log 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188244.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.188244.log.gz 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125840.log 2023-10-03T10:25:24.153 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125840.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125840.log.gz 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128678.log 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128678.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128678.log.gz 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192318.log 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.192318.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.192318.log.gz 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189572.log 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189572.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.189572.log.gz 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156581.log 2023-10-03T10:25:24.154 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156581.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156581.log.gz 2023-10-03T10:25:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158711.log 2023-10-03T10:25:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158711.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158711.log.gz 2023-10-03T10:25:24.155 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167879.log 2023-10-03T10:25:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167879.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.167879.log.gz 2023-10-03T10:25:24.170 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123613.log 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123613.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123613.log.gz 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174428.log 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174428.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174428.log.gz 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175973.log 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175973.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.175973.log.gz 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179731.log 2023-10-03T10:25:24.171 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.179731.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179731.log.gz 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146577.log 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146577.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146577.log.gz 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124321.log 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124321.log.gz 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177968.log 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177968.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.177968.log.gz 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185023.log 2023-10-03T10:25:24.172 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185023.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.185023.log.gz 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186969.log 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186969.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.186969.log.gz 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152460.log 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152460.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152460.log.gz 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136398.log 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136398.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.136398.log.gz 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152191.log 2023-10-03T10:25:24.173 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152191.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.152191.log.gz 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146133.log 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146133.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.146133.log.gz 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159691.log 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159691.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.159691.log.gz 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140469.log 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.140469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140469.log.gz 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153636.log 2023-10-03T10:25:24.174 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153636.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.153636.log.gz 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155405.log 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155405.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.155405.log.gz 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186481.log 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186481.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.186481.log.gz 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123886.log 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.123886.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123886.log.gz 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141076.log 2023-10-03T10:25:24.175 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141076.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.141076.log.gz 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171488.log 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171488.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171488.log.gz 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169337.log 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169337.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.169337.log.gz 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137475.log 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137475.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.137475.log.gz 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159273.log 2023-10-03T10:25:24.176 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159273.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159273.log.gz 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135985.log 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135985.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.135985.log.gz 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181665.log 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.181665.log.gz 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175532.log 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175532.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.175532.log.gz 2023-10-03T10:25:24.177 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160530.log 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160530.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.160530.log.gz 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190696.log 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190696.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.190696.log.gz 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149165.log 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149165.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.149165.log.gz 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177230.log 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.177230.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177230.log.gz 2023-10-03T10:25:24.178 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150419.log 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150419.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.150419.log.gz 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151276.log 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.151276.log.gz 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142038.log 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142038.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142038.log.gz 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154739.log 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154739.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154739.log.gz 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189125.log 2023-10-03T10:25:24.179 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189125.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.189125.log.gz 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154151.log 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154151.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.154151.log.gz 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174848.log 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.174848.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.174848.log.gz 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167291.log 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.167291.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.167291.log.gz 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186800.log 2023-10-03T10:25:24.180 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186800.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.186800.log.gz 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188760.log 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.188760.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.188760.log.gz 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181028.log 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.181028.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.181028.log.gz 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157901.log 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157901.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157901.log.gz 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184409.log 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184409.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.184409.log.gz 2023-10-03T10:25:24.181 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146107.log 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146107.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.146107.log.gz 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144983.log 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144983.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.144983.log.gz 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156187.log 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156187.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.156187.log.gz 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154817.log 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154817.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.154817.log.gz 2023-10-03T10:25:24.182 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182121.log 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.182121.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.182121.log.gz 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194481.log 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.194481.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.194481.log.gz 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184268.log 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.184268.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.184268.log.gz 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170827.log 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170827.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170827.log.gz 2023-10-03T10:25:24.183 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157953.log 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157953.log.gz 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148952.log 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148952.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.148952.log.gz 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139751.log 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139751.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.139751.log.gz 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166781.log 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.166781.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.166781.log.gz 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161019.log 2023-10-03T10:25:24.184 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161019.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161019.log.gz 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146968.log 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146968.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146968.log.gz 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173670.log 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173670.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173670.log.gz 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155327.log 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155327.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.155327.log.gz 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147727.log 2023-10-03T10:25:24.185 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147727.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.147727.log.gz 2023-10-03T10:25:24.186 INFO:teuthology.orchestra.run.smithi019.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-03T10:25:24.212 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-03T10:25:24.235 INFO:teuthology.orchestra.run.smithi019.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-03T10:25:24.287 INFO:teuthology.orchestra.run.smithi019.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-03T10:25:24.413 INFO:teuthology.orchestra.run.smithi019.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-03T10:25:24.521 INFO:teuthology.orchestra.run.smithi019.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-03T10:25:24.523 INFO:teuthology.orchestra.run.smithi019.stderr: 2023-10-03T10:25:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m1.135s 2023-10-03T10:25:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m4.270s 2023-10-03T10:25:24.523 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m0.962s 2023-10-03T10:25:24.524 INFO:tasks.ceph:Archiving logs... 2023-10-03T10:25:24.524 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi019/log 2023-10-03T10:25:24.526 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:25:26.206 DEBUG:teuthology.misc:Transferring archived files from smithi027:/var/log/ceph to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi027/log 2023-10-03T10:25:26.207 DEBUG:teuthology.orchestra.run.smithi027:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-03T10:25:26.304 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:26.313 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-03T10:25:26.330 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:25:26.334 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-03T10:25:26.335 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:25:26.340 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-03T10:25:26.462 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-03T10:25:26.474 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-03T10:25:26.474 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:25:26.477 DEBUG:teuthology.orchestra.run.smithi027:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-03T10:25:26.496 INFO:teuthology.orchestra.run.smithi019.stderr:bash: ntpq: command not found 2023-10-03T10:25:26.497 INFO:teuthology.orchestra.run.smithi027.stderr:bash: ntpq: command not found 2023-10-03T10:25:26.501 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:25:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2023-10-03T10:25:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 +630us[ +625us] +/- 74ms 2023-10-03T10:25:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -179us[ -185us] +/- 60ms 2023-10-03T10:25:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 54 -325us[ -330us] +/- 66ms 2023-10-03T10:25:26.502 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:25:26.503 INFO:teuthology.orchestra.run.smithi027.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-03T10:25:26.504 INFO:teuthology.orchestra.run.smithi027.stdout:=============================================================================== 2023-10-03T10:25:26.504 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +612us[ +608us] +/- 74ms 2023-10-03T10:25:26.504 INFO:teuthology.orchestra.run.smithi027.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -202us[ -206us] +/- 61ms 2023-10-03T10:25:26.504 INFO:teuthology.orchestra.run.smithi027.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -338us[ -342us] +/- 66ms 2023-10-03T10:25:26.504 INFO:teuthology.orchestra.run.smithi027.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-03T10:25:26.505 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-03T10:25:26.516 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-03T10:25:26.517 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-03T10:25:26.528 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:25:26.602 DEBUG:teuthology.orchestra.run.smithi027:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-03T10:25:26.698 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:25:26.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:26.735 DEBUG:teuthology.orchestra.run.smithi027:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-03T10:25:26.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:26.768 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-03T10:25:26.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-03T10:25:26.800 INFO:teuthology.task.internal:Duration was 1516.567341 seconds 2023-10-03T10:25:26.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-03T10:25:26.812 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-03T10:25:26.812 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:25:26.814 DEBUG:teuthology.orchestra.run.smithi027:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-03T10:25:26.864 INFO:teuthology.orchestra.run.smithi027.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:25:26.871 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-03T10:25:27.128 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-03T10:25:27.128 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2023-10-03T10:25:27.129 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:25:27.157 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi027.front.sepia.ceph.com 2023-10-03T10:25:27.158 DEBUG:teuthology.orchestra.run.smithi027:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-03T10:25:27.181 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-03T10:25:27.182 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:25:27.200 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-03T10:25:27.260 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-03T10:25:27.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:27.262 DEBUG:teuthology.orchestra.run.smithi027:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:25:27.366 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-03T10:25:27.378 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-03T10:25:27.379 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:25:27.410 DEBUG:teuthology.orchestra.run.smithi027:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-03T10:25:27.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-03T10:25:27.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:27.453 DEBUG:teuthology.orchestra.run.smithi027:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:27.483 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2023-10-03T10:25:27.506 INFO:teuthology.orchestra.run.smithi027.stdout:kernel.core_pattern = core 2023-10-03T10:25:27.519 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:27.577 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi019.front.sepia.ceph.com, flagging run as failed 2023-10-03T10:25:27.578 DEBUG:teuthology.orchestra.run.smithi027:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:25:27.595 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:25:27.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-03T10:25:27.608 INFO:teuthology.task.internal:Transferring archived files... 2023-10-03T10:25:27.609 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi019 2023-10-03T10:25:27.609 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-03T10:26:49.288 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2023-10-03T10:26:49.299 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567/remote/smithi019/coredump/1696328038.126819.core.gz: gzip compressed data, was "1696328038.126819.core", last modified: Tue Oct 3 10:25:27 2023, max compression, original size modulo 2^32 1365295104 2023-10-03T10:26:49.300 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2023-10-03T10:26:55.137 INFO:teuthology.task.internal: core looks like: /tmp/tmp4isnfbs9: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-mgr -f --cluster ceph -i x', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-mgr', platform: 'x86_64' 2023-10-03T10:26:55.273 INFO:teuthology.task.internal: dump_program: ceph-mgr -f --cluster ceph -i x 2023-10-03T10:26:55.274 DEBUG:teuthology.orchestra.run.smithi019:> which 'ceph-mgr -f --cluster ceph -i x' 2023-10-03T10:26:55.297 INFO:teuthology.orchestra.run.smithi019.stderr:/usr/bin/which: invalid option -- 'f' 2023-10-03T10:26:55.298 INFO:teuthology.orchestra.run.smithi019.stderr:/usr/bin/which: unrecognized option '--cluster' 2023-10-03T10:26:55.298 INFO:teuthology.orchestra.run.smithi019.stderr:/usr/bin/which: no x in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2023-10-03T10:26:55.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:26:55.299 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-mgr 2023-10-03T10:26:55.299 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph 2023-10-03T10:26:55.299 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 96, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: "which 'ceph-mgr -f --cluster ceph -i x'" 2023-10-03T10:26:55.316 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-03T10:26:55.328 INFO:teuthology.task.internal:Not uploading archives. 2023-10-03T10:26:55.328 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-03T10:26:55.340 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-03T10:26:55.340 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:26:55.433 DEBUG:teuthology.orchestra.run.smithi027:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-03T10:26:55.447 INFO:teuthology.orchestra.run.smithi019.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest 2023-10-03T10:26:55.447 INFO:teuthology.orchestra.run.smithi019.stdout: 393225 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive 2023-10-03T10:26:55.447 INFO:teuthology.orchestra.run.smithi019.stdout: 393226 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:13 /home/ubuntu/cephtest/archive/coredump 2023-10-03T10:26:55.447 INFO:teuthology.orchestra.run.smithi019.stdout: 393232 361460 -rw------- 1 root root 1365295104 Oct 3 10:13 /home/ubuntu/cephtest/archive/coredump/1696328038.126819.core 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 655784 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 655822 28 -rw------- 1 ubuntu ubuntu 25558 Oct 3 10:25 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 525491 4 -rw-rw-rw- 1 ubuntu ubuntu 769 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 525359 112 -rw-rw-r-- 1 ubuntu ubuntu 114164 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:26:55.448 INFO:teuthology.orchestra.run.smithi019.stdout: 525358 132 -rw-rw-rw- 1 ubuntu ubuntu 133558 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:26:55.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-03T10:26:55.449 INFO:teuthology.orchestra.run.smithi019.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:26:55.450 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph.py", line 1950, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2742, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2574, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 2340, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1595, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_dparmar18_ceph_a6297898cc696a7db13e71aaa0b24c78a4c800c5/qa/tasks/ceph_manager.py", line 1586, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-03T10:26:55.462 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-03T10:26:55.474 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-03T10:26:55.524 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi019 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-03T10:26:55.524 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T10:26:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: 525357 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest 2023-10-03T10:26:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: 525358 4 drwxr-xr-x 4 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive 2023-10-03T10:26:55.531 INFO:teuthology.orchestra.run.smithi027.stdout: 655785 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive/audit 2023-10-03T10:26:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: 655787 220 -rw------- 1 ubuntu ubuntu 223022 Oct 3 10:25 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2023-10-03T10:26:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: 525360 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog 2023-10-03T10:26:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: 525482 4 -rw-rw-rw- 1 ubuntu ubuntu 899 Oct 3 10:23 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-10-03T10:26:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: 525362 92 -rw-rw-r-- 1 ubuntu ubuntu 92905 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-03T10:26:55.532 INFO:teuthology.orchestra.run.smithi027.stdout: 525361 88 -rw-rw-rw- 1 ubuntu ubuntu 86597 Oct 3 10:25 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-10-03T10:26:55.533 INFO:teuthology.orchestra.run.smithi027.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-03T10:26:55.552 DEBUG:teuthology.nuke:shortname: smithi019 2023-10-03T10:26:55.552 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:26:55.572 DEBUG:teuthology.nuke:shortname: smithi027 2023-10-03T10:26:55.572 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T10:26:55.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:45.951916', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJugLw4EpRV4k3fbFBvUpsZ4LKn1cu6pEnLFOGZ9MVVpKxi0uJPHk8SFSRxDeOw8MAoVN4SmqsVMRyF1ZTmrxZI='} 2023-10-03T10:26:55.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-03_09:48:43-fs:upgrade-fix-nfs-apply-err-reporting-distro-default-smithi/7409567', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 09:49:45.953588', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOvhCvZSoprhj9eQROITp419ViYyTHx4x2KJZ8CTKjfOptIDZgXnGHCXXcbxuUnDp0KLHXs9T201lg3xKSVYc0='} 2023-10-03T10:26:55.616 INFO:teuthology.orchestra.console.smithi019:Power off 2023-10-03T10:26:55.616 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:26:55.639 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-10-03T10:26:55.639 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:26:55.652 INFO:teuthology.orchestra.console.smithi027:Power off 2023-10-03T10:26:55.652 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T10:26:55.661 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T10:26:55.673 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-10-03T10:26:55.673 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:26:55.694 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-03T10:26:59.662 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:26:59.695 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:26:59.774 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-10-03T10:26:59.805 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-03T10:27:03.779 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:27:03.805 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:27:03.891 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-10-03T10:27:03.915 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-10-03T10:27:03.992 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-10-03T10:27:07.919 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T10:27:08.028 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-10-03T10:27:08.129 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-10-03T10:27:08.233 INFO:teuthology.run:Summary data: description: fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/blogbench}}} duration: 1516.56734085083 failure_reason: 'Command failed on smithi019 with status 124: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json''' flavor: default owner: scheduled_dparmar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=9d915dab173846119f0cbb1fee11ea25 status: fail success: false 2023-10-03T10:27:08.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T10:27:08.526 INFO:teuthology.run:FAIL